-- Logs begin at Thu 2022-08-04 15:33:26 UTC, end at Thu 2022-08-04 18:13:29 UTC. -- Aug 04 16:21:40.690083 n-d-846466-12 systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 16:21:40.698886 n-d-846466-12 devstack@n-api.service[104131]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 16:21:40.700858 n-d-846466-12 devstack@n-api.service[104131]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 16:21:40 2022] *** Aug 04 16:21:40.700858 n-d-846466-12 devstack@n-api.service[104131]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 16:21:40.700858 n-d-846466-12 devstack@n-api.service[104131]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 16:21:40.700858 n-d-846466-12 devstack@n-api.service[104131]: nodename: n-d-846466-12 Aug 04 16:21:40.700858 n-d-846466-12 devstack@n-api.service[104131]: machine: x86_64 Aug 04 16:21:40.700858 n-d-846466-12 devstack@n-api.service[104131]: clock source: unix Aug 04 16:21:40.700858 n-d-846466-12 devstack@n-api.service[104131]: pcre jit disabled Aug 04 16:21:40.700858 n-d-846466-12 devstack@n-api.service[104131]: detected number of CPU cores: 4 Aug 04 16:21:40.700858 n-d-846466-12 devstack@n-api.service[104131]: current working directory: / Aug 04 16:21:40.700858 n-d-846466-12 devstack@n-api.service[104131]: detected binary path: /usr/bin/uwsgi-core Aug 04 16:21:40.700858 n-d-846466-12 devstack@n-api.service[104131]: your processes number limit is 47680 Aug 04 16:21:40.701578 n-d-846466-12 devstack@n-api.service[104131]: your memory page size is 4096 bytes Aug 04 16:21:40.701578 n-d-846466-12 devstack@n-api.service[104131]: detected max file descriptor number: 2048 Aug 04 16:21:40.701578 n-d-846466-12 devstack@n-api.service[104131]: lock engine: pthread robust mutexes Aug 04 16:21:40.701578 n-d-846466-12 devstack@n-api.service[104131]: thunder lock: enabled Aug 04 16:21:40.701578 n-d-846466-12 devstack@n-api.service[104131]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 16:21:40.701578 n-d-846466-12 devstack@n-api.service[104131]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 16:21:40.739372 n-d-846466-12 devstack@n-api.service[104131]: Python main interpreter initialized at 0x55dd240b79c0 Aug 04 16:21:40.739372 n-d-846466-12 devstack@n-api.service[104131]: python threads support enabled Aug 04 16:21:40.739372 n-d-846466-12 devstack@n-api.service[104131]: your server socket listen backlog is limited to 100 connections Aug 04 16:21:40.739372 n-d-846466-12 devstack@n-api.service[104131]: your mercy for graceful operations on workers is 90 seconds Aug 04 16:21:40.739768 n-d-846466-12 devstack@n-api.service[104131]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 16:21:40.739768 n-d-846466-12 devstack@n-api.service[104131]: *** Operational MODE: preforking *** Aug 04 16:21:40.740030 n-d-846466-12 devstack@n-api.service[104131]: *** uWSGI is running in multiple interpreter mode *** Aug 04 16:21:40.740030 n-d-846466-12 devstack@n-api.service[104131]: spawned uWSGI master process (pid: 104131) Aug 04 16:21:40.740268 n-d-846466-12 systemd[1]: Started Devstack devstack@n-api.service. Aug 04 16:21:40.741053 n-d-846466-12 devstack@n-api.service[104131]: spawned uWSGI worker 1 (pid: 104132, cores: 1) Aug 04 16:21:40.741053 n-d-846466-12 devstack@n-api.service[104131]: spawned uWSGI worker 2 (pid: 104133, cores: 1) Aug 04 16:21:40.741229 n-d-846466-12 devstack@n-api.service[104131]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 16:21:41.389760 n-d-846466-12 devstack@n-api.service[104133]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 16:21:41.395595 n-d-846466-12 devstack@n-api.service[104132]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 16:21:42.462056 n-d-846466-12 devstack@n-api.service[104132]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 16:21:42.462056 n-d-846466-12 devstack@n-api.service[104132]: from cryptography.utils import int_from_bytes Aug 04 16:21:42.462866 n-d-846466-12 devstack@n-api.service[104133]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 16:21:42.462866 n-d-846466-12 devstack@n-api.service[104133]: from cryptography.utils import int_from_bytes Aug 04 16:21:42.463248 n-d-846466-12 devstack@n-api.service[104132]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 16:21:42.463248 n-d-846466-12 devstack@n-api.service[104132]: from cryptography.utils import int_from_bytes Aug 04 16:21:42.463363 n-d-846466-12 devstack@n-api.service[104133]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 16:21:42.463363 n-d-846466-12 devstack@n-api.service[104133]: from cryptography.utils import int_from_bytes Aug 04 16:21:44.928649 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 16:21:44.929267 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 16:21:44.929663 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 16:21:44.929751 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 16:21:44.929820 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 16:21:44.929894 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 16:21:44.929970 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 16:21:44.930057 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 16:21:44.930132 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 16:21:44.930201 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 16:21:44.930365 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.930457 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.930653 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.930861 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.930962 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.931205 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.931354 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.931490 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.931603 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.931836 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.931970 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.932139 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.932284 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.932424 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.932522 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.932764 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.932913 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.933004 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.933149 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.933316 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.933432 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.933654 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.933787 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-846466-12 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.933969 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-846466-12 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.934117 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.934286 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.934430 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.934595 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.934728 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.934872 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.935112 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.935275 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.935414 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.935550 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.935675 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.935795 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.936083 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.936083 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.936334 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.936650 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.936829 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.937119 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.937261 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.937446 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.937581 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.937801 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.937970 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.938115 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.938237 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.938713 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.939000 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.939152 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.939300 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.939457 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.939617 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.939747 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.939913 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.940046 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.940298 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.940494 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-846466-12 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.940650 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.940827 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.941017 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-846466-12 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.941178 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.941364 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.941515 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.941681 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.941828 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.941967 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.942138 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.942304 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.942453 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.942602 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.942746 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.942887 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.943038 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.943181 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.943339 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.943477 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.943573 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.943661 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.943828 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.944035 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.944139 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.944274 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.944428 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.944581 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.944726 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.944890 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.945025 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.945186 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.945364 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.945510 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.945678 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.945809 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.945976 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.946118 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.946272 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.946409 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.946499 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.946706 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.946802 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.946948 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.947099 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.947244 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.947408 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.947557 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.947723 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.947869 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.947958 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.948183 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.948274 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.948427 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.948520 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.948670 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.948789 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.948980 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.949078 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.949306 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.949414 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.949609 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.949707 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.949908 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.950061 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.950205 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.950361 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.950504 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.950656 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.950799 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.950950 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.951096 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.951247 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.951391 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.951555 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.951686 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.951858 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.951994 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.952259 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.952375 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.952459 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.952594 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.952762 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.952890 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.953151 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.953242 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.953417 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.953608 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.953811 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.954151 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.954251 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.954456 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.954534 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.954790 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.954879 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.955102 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.955204 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.955401 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.955492 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.955710 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.955807 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.956004 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.956103 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.956301 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.956393 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.956596 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.956686 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.956892 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.956982 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.957200 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.957319 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.957469 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.957568 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.957762 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.957858 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.958054 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.958143 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.958346 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.958447 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.958641 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.958732 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.958933 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.959035 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.959227 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.959325 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.959517 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.959609 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.959806 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.959896 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.960093 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.960192 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.960384 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.960473 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.960674 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.960762 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.960965 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.961068 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.961256 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.961402 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.961569 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.961658 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.961860 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.962039 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.962149 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.962244 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.962447 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.962547 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.962738 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.962840 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.963030 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.963116 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.963322 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.963409 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.963617 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.963716 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.963906 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.963994 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.964210 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.964423 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.964584 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.964751 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.964906 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.965053 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.965200 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.965456 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.965456 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.965793 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.965793 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.966077 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.966077 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.966346 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.966491 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.966682 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.966682 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.966977 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.967125 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.967270 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.967438 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.967583 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.967720 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.967865 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.968024 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.968169 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.968327 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.968470 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.968622 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.968766 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.968919 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.969064 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.969229 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.969406 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.970262 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.970414 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.970579 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.970724 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.970885 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.971033 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.971177 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.971320 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.971320 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.971595 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.971753 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.971895 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.972053 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.972198 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.972340 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.972495 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.972655 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.972798 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.972938 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.973083 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.973227 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.973897 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.974047 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.974195 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.974348 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:21:44.974490 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.974633 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.974788 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.974931 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.975074 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.975216 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.975369 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.975527 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.975670 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.975809 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.975940 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.976076 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.976217 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.976372 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.976515 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.976656 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.976796 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.976931 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.977078 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.977224 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.977385 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.977519 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.977651 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.977781 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.977911 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.978067 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.978205 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.978345 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.978584 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.978749 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.978894 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.979059 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.979203 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.979346 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.979487 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.979630 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.979771 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.979927 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.980075 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.980220 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.980362 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.980515 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.980672 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.980815 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.980966 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.981117 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.981261 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.981435 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.981596 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.981741 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.981882 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.982023 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.982166 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.982308 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.982479 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.982636 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.982779 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.982930 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.983073 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.983228 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.983517 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.983660 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.983801 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.983935 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.984076 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.984232 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.984376 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.984573 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.984722 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.984866 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.985039 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.985202 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.985401 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.985570 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.985784 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.985936 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.986084 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.986252 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.986395 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.986538 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.986679 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.986820 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.986960 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.986960 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.986960 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.987355 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.987500 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.987642 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.987785 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.987940 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.988086 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.988227 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.988380 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.988543 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.988701 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.988845 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.988999 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.989145 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.989310 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.989454 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.989615 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.989770 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.989917 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.990057 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.990199 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.990357 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.990512 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.990656 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.990810 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.990955 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.991097 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.991230 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.991374 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.991527 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.991670 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.991840 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.991986 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.992141 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.992300 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.992449 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.992606 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.992763 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.992905 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.993062 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.993204 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.993413 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.993557 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.993779 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.993929 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.994088 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.994233 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.994375 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.994519 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.994723 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.994872 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.995045 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.995190 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.995333 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.995477 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.995618 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.995774 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.995918 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.996078 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.996225 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.996364 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.996517 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.996675 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.996815 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.996975 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.997116 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.997353 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.997494 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.997649 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.997789 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.997941 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.998083 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.998241 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.998386 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.998610 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.998770 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.998915 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.999056 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.999209 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.999366 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.999520 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.999661 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.999804 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:44.999949 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.000086 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.000232 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.000368 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.000516 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.000658 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.001587 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.001738 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.001907 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.002052 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.002198 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.002342 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.002487 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.002632 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.002788 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.003014 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.003172 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.003328 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.003471 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.003635 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.003838 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.003997 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.004139 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.004280 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.004420 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.004639 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.004797 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.004953 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.005108 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.005249 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.005432 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.005590 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.005735 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.005876 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.006021 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.006164 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.006330 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.006330 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.006612 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.006612 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.006886 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.006886 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.007157 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.007157 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.007413 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.007565 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.007714 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.007857 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.008012 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.008166 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.008310 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.008461 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.008604 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.008750 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.008908 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.009053 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.009194 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.009396 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.009542 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.009684 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.009850 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.010009 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.010155 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.010308 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.010451 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.010614 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.010758 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.010903 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.011045 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.011185 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.011325 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.011479 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.011622 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.011768 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.011912 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.012054 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.012195 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.012448 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.012593 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.012740 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.012880 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.013077 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.013238 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.013433 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.013576 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.013720 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.013851 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.013990 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.014132 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.014289 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.014444 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.014601 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.014742 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.014883 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.015035 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.015175 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.015316 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.015457 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.015609 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.015747 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.015900 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.016038 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.016209 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.016382 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.016685 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.017364 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.017535 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.017693 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.017838 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.017996 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.018142 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.018287 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.018446 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.018603 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.018748 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.018926 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.019081 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.019240 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.019383 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.019525 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.019686 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.019831 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.020314 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.020474 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.020620 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.020773 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.020913 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.021064 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.021064 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.021363 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.021481 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.021592 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.021717 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.021829 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.021947 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.022096 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.022224 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.022348 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.022481 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.022617 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.022776 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.022917 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.023055 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.023193 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.023339 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.023339 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.023596 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.023735 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.023868 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.024078 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.024214 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.024351 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.024496 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.024629 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.024762 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.024762 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.025020 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.025154 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.025338 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.025483 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.025624 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.025779 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.025929 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.026068 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.026275 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.026422 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.026555 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.026683 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.026824 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.026976 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.027113 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.027250 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.027402 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.027572 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.027736 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.027893 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.028035 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.028192 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.028333 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.028486 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.028630 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.028630 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.028905 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.029048 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.029200 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.029418 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.029618 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.029792 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.029938 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.030084 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.030236 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.030379 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.030532 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.030675 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.030818 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.030958 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.031102 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.031243 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.031398 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.031541 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.031694 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.032548 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.032792 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.032939 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.033099 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.033317 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.033456 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.033602 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.033748 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.033889 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.034062 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.034208 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.034352 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.034507 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.034654 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.034812 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.034956 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.035100 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.035242 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.035242 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.035500 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.035657 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.035800 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.035952 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.036095 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.036237 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.036389 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.036544 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.036685 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.036826 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.036966 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.037111 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.037250 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.037498 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.037641 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.037781 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.037936 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.038096 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.038259 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.038415 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.038571 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.038725 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.038878 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.038878 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.039123 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.039382 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.039531 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.039678 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.039822 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.039961 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.040098 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.040251 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.040392 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.040551 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.040705 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.040845 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.040996 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.041138 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.041328 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.041472 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.041637 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.041794 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.041939 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.042081 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.042233 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.042366 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.042499 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.042650 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.042791 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.042934 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.043089 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.043234 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.043378 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.043534 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.043681 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.043823 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.043981 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.044133 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.044274 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.044420 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.044563 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.044728 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.044870 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.045011 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.045207 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.045207 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.045530 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.045689 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.045834 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.045976 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.046120 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.046264 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.046465 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.046627 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.046768 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.046910 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.047052 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.047052 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.047339 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.048118 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.048271 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.048432 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.048578 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.048708 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.048850 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.048978 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.049109 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.049239 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.049432 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.049570 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.049718 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.049852 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.049992 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.050135 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.050277 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.050432 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.050590 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.050747 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.050892 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.051035 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.051179 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.051343 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.051488 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.051644 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.051800 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.051953 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.052109 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.052267 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.052411 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.052605 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.052753 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.052896 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.053049 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.053206 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.053371 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.053533 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.053689 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.053836 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.053990 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.054160 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.054301 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.054441 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.054582 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.054723 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.054867 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.055025 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.055180 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.055323 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.055477 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.055623 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.055791 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.055936 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.056080 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.056232 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.056379 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.056572 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.056721 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.056861 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.057005 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.057159 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.057328 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.057473 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.057635 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.057776 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.057927 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.058085 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.058228 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.058373 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.058539 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.058682 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.058839 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.058982 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.059134 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.059290 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.059446 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.059591 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.059731 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.059881 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.060040 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.060196 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.060341 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.060487 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.060631 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.060777 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.060919 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.061081 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.061227 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.061429 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.061572 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.061713 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.061864 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.062021 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.062169 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.062322 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.062466 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.062608 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.062771 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.062916 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.063098 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.063248 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.063981 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.064211 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.064376 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.064526 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.064660 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.064792 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.064925 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.065068 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.065225 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.065381 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.065508 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.065649 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.065791 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.065934 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.066211 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.066359 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.066515 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.066643 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.066787 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.066943 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.067080 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.067205 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.067349 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.067491 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.067631 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.067790 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.067995 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.068140 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.068283 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.068426 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.068586 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.068747 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.068892 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.069036 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.069182 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.069423 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.069583 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.069747 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.069893 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.070035 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.070177 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.070330 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.070495 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.070640 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.070784 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.070928 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.071077 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.071211 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.071374 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.071515 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.071680 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.071824 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.071967 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.072110 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.072266 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.072410 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.072550 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.072694 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.072897 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.073055 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.073212 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.073379 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.073538 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.073694 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.073840 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.074002 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.074147 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.074290 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.074437 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.074635 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.074782 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.074941 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.075083 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.075227 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.075370 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.075574 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.075720 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.075880 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.076022 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.076165 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.076309 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.076451 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.076591 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.076734 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.076879 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.077020 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.077163 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.077372 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.077537 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.077679 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.077823 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.077966 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.078105 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.078237 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.078387 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.078527 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.078716 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.078868 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.079182 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.079329 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.079597 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.079759 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.079913 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.080056 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.080200 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.080342 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.080500 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.080645 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.080788 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.080944 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.081085 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.081248 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.081416 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.081560 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.081705 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.081848 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.081990 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.082166 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.082311 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.082453 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.082598 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.082741 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.082883 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.083029 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.083170 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.083312 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.083454 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.083593 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.083731 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.083883 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.084029 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.084171 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.084313 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.084469 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.084633 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.084777 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.084918 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.085061 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.085202 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.085396 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.085554 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.085692 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.085829 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.085829 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.086084 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.086219 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.086219 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.086487 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.086634 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.086763 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.086903 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.087053 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.087220 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.087360 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.087360 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.087630 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.087771 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.087914 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.088053 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.088195 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.088336 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.088478 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.088620 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.088809 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.088965 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.089122 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.089300 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.089448 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.089589 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.089730 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.089872 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.090033 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.090179 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.090338 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.090481 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.090625 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.090768 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.090924 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.091069 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.091212 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.091368 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.091512 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.091512 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.091786 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.091930 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.092074 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.092216 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.092370 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.092537 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.092695 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.092695 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.092968 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.093126 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.093301 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.093467 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.093613 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.093757 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.093901 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.094043 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.094178 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.094458 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.095135 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.095296 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.095442 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.095597 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.095805 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.095966 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.096109 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.096264 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.096409 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.096565 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.096722 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.096849 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.097003 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.097147 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.097313 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.097459 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.097620 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.097763 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.097916 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.098061 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.098218 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.098361 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.098519 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.098736 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.098882 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.099025 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.099169 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.099312 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.099468 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.099612 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.099762 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.099906 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.100046 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.100203 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.100346 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.100487 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.100640 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.100786 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.100920 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.101073 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.101211 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.101433 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.101580 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.101722 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.101867 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.102023 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.102181 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.102325 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.102468 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.102614 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.102756 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.102922 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.103068 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.103211 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.103355 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.103498 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.103650 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.103792 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.103928 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.104073 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.104211 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.104353 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.104617 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.104774 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.104915 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.105055 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.105196 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.105357 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.105527 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.105658 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.105795 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.105932 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.106091 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.106237 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.106394 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.106536 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.106684 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.106825 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.106951 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.107107 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.107250 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.107405 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.107549 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.107703 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.107847 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.108008 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.108165 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.108307 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.108448 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.108591 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.108746 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.108904 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.109046 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.109190 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.109423 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.109575 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.109718 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.109920 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.110246 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.110901 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.111048 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.111202 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.111360 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.111516 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.111662 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.111806 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.111951 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.112093 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.112346 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.112491 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.112653 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.112811 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.112957 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.113099 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.113336 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.113486 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.113631 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.113774 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.113918 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.114062 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.114225 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.114382 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.114526 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.114669 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.114822 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.115039 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.115187 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.115187 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.115447 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.115589 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.115743 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.115898 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.116041 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.116193 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.116336 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.116336 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.116595 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.116761 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.116905 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.117039 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.117177 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.117347 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.117483 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.117634 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.117771 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.117902 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.118034 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.118173 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.118326 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.118476 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.118634 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.118775 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.118918 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.119080 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.119335 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.119479 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.119634 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.119777 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.119922 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.120072 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.120237 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.120381 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.120515 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.120646 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.120798 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.120955 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.121123 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.121268 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.121495 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.121664 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.121807 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.121963 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.122108 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.122250 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.122405 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.122552 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.122711 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.122858 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.123001 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.123156 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.123308 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.123463 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.123627 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.123772 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.123917 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.124060 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.124203 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.124359 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.124503 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.124645 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.124787 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.124929 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.125145 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.125346 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.125530 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.125719 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.125884 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.126639 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.126793 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.126953 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.127101 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.127244 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.127379 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.127512 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.127666 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.127666 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.127937 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.128081 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.128224 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.128366 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.128524 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.128666 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.128821 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.128821 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.129087 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.129243 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.129468 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.129626 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.129771 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.129914 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.130056 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.130202 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.130363 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.130507 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.130662 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.130808 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.130808 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.131095 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.131240 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.131385 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.131529 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.131670 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.131811 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.131970 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.132113 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.132255 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.132400 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.132543 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.132700 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.132856 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.132997 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.133156 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.133323 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.133540 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.133702 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.133862 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.133999 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.134134 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.134283 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.134427 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.134584 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.134728 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.134871 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.135024 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.135240 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.135382 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.135546 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.135700 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.135842 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.135994 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.136138 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.136263 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.136424 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.136571 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.136713 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.136856 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.136998 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.137201 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.137389 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.137537 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.137695 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.137833 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.137974 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.138134 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.138278 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.138416 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.138557 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.138695 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.138823 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.138953 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.139079 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.139202 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.139321 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.139443 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.139571 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.139717 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.139864 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.139996 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.140145 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.140255 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.140337 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.140433 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.140549 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.140692 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.140807 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.140901 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.140993 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.141076 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.141190 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.141498 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.141606 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.141691 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.141771 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.141853 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.141934 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.142019 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.142102 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.142182 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.142325 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.142724 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.142815 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.142897 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.142978 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.143332 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.143435 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.143519 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.143590 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.143657 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.143733 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.143810 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.143879 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.143947 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.144015 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.144082 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.144150 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.144227 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.144305 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.144387 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.144455 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.144531 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.144612 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.144689 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.144689 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.144839 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.144908 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.145336 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.145407 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.145563 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.145699 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.145793 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.145864 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.145944 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.145944 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.145944 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.146143 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.146210 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.146283 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.146351 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.146427 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.146427 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.146548 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.146614 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.146679 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.146745 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.146823 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.146893 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.146959 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.147026 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.147091 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.147157 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.147232 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.147310 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.147378 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.147445 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.147510 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.147510 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.147510 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.147718 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.147786 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.147852 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.147931 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.148009 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.148079 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.148158 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.148235 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.148304 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.148392 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.148483 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.148573 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.148663 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.148745 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.148824 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.148917 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.148998 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.149086 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.149168 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.149255 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.149399 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.149499 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.149582 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.149662 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.149742 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.149822 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.149902 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.149994 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.150085 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.150166 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.150247 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.150326 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.150420 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.150502 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.150581 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.150668 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.150749 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.150836 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.150927 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.150927 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.151091 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.151173 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.151253 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.151333 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.151426 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.151508 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.151596 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.151684 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.151766 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.151854 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.151943 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.151943 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.152091 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.152172 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.152251 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.152339 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.152421 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.152501 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.152588 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.152680 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.152761 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.152850 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.152931 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.153057 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.153146 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.153478 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.153595 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.153801 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.153899 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.154078 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.154166 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.154380 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.154484 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.154691 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.154781 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.154991 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.155081 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.155284 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.155386 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.155578 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.155674 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.155880 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.155976 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.156174 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.156264 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.156470 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.156558 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.156785 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.156901 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.157194 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.157638 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.157722 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.157824 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.157918 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.158000 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.158089 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.158302 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.158399 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.158605 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.158743 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.158897 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.159023 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.159187 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.159295 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.159480 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.159580 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.159770 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.159868 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.160060 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.160156 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.160349 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.160447 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.160638 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.160735 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.160926 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.161023 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.161216 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.161347 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.161531 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.161623 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.161830 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.161923 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.162123 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.162221 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.162417 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.162508 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.162707 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.162797 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.163001 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.163102 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.163293 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.163384 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.163613 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.163711 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.163933 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.164044 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.164236 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.164325 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.164550 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.164640 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.164849 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.164950 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.165152 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.165242 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.165473 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.165564 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.165833 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.165944 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.166070 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.166163 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.166372 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.166462 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.166671 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.166779 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.166997 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.167097 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.167310 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.167429 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.167590 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.167761 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.167931 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.168074 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.168212 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.168352 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.168494 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.168630 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.168764 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.168899 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.169058 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.169206 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.169419 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.169507 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.169676 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.169765 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.169977 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.170090 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.170277 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.170366 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.170579 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.170669 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.170883 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.170979 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.171186 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.171282 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.171486 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.171574 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.171785 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.171873 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.172088 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.172176 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.172403 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.172495 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.173009 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.173104 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.173187 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.173269 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.173375 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.173469 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.173656 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.173746 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.174001 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.174138 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.174303 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.174393 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.174622 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.174712 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.174941 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.175028 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.175246 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.175344 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.175544 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.175633 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.175838 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.175931 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.176074 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 16:21:45.176182 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.176488 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.176792 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.177125 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.177470 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.177778 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.178081 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.178376 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:21:45.178613 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 16:21:45.333744 n-d-846466-12 devstack@n-api.service[104133]: INFO dbcounter [None req-72b1d844-57bd-4bdf-9e7d-46e317ae9beb None None] Registered counter for database nova_api Aug 04 16:21:45.338414 n-d-846466-12 devstack@n-api.service[104132]: INFO dbcounter [None req-27655857-ca43-45b6-9ae7-c1f7a8bc886f None None] Registered counter for database nova_api Aug 04 16:21:45.355765 n-d-846466-12 devstack@n-api.service[104133]: DEBUG oslo_db.sqlalchemy.engines [None req-72b1d844-57bd-4bdf-9e7d-46e317ae9beb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:21:45.358354 n-d-846466-12 devstack@n-api.service[104132]: DEBUG oslo_db.sqlalchemy.engines [None req-27655857-ca43-45b6-9ae7-c1f7a8bc886f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104132) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:21:45.363320 n-d-846466-12 devstack@n-api.service[104133]: DEBUG dbcounter [-] [104133] Writer thread running {{(pid=104133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 16:21:45.365087 n-d-846466-12 devstack@n-api.service[104132]: DEBUG dbcounter [-] [104132] Writer thread running {{(pid=104132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 16:21:45.417696 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.context [None req-72b1d844-57bd-4bdf-9e7d-46e317ae9beb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e056d029-674a-446e-ac9e-5108621d9db2(cell1) {{(pid=104133) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 16:21:45.419468 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.context [None req-27655857-ca43-45b6-9ae7-c1f7a8bc886f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e056d029-674a-446e-ac9e-5108621d9db2(cell1) {{(pid=104132) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 16:21:45.421680 n-d-846466-12 devstack@n-api.service[104133]: DEBUG oslo_concurrency.lockutils [None req-72b1d844-57bd-4bdf-9e7d-46e317ae9beb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:21:45.423272 n-d-846466-12 devstack@n-api.service[104133]: DEBUG oslo_concurrency.lockutils [None req-72b1d844-57bd-4bdf-9e7d-46e317ae9beb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:21:45.423464 n-d-846466-12 devstack@n-api.service[104132]: DEBUG oslo_concurrency.lockutils [None req-27655857-ca43-45b6-9ae7-c1f7a8bc886f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:21:45.424053 n-d-846466-12 devstack@n-api.service[104133]: DEBUG oslo_concurrency.lockutils [None req-72b1d844-57bd-4bdf-9e7d-46e317ae9beb None None] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:21:45.425014 n-d-846466-12 devstack@n-api.service[104132]: DEBUG oslo_concurrency.lockutils [None req-27655857-ca43-45b6-9ae7-c1f7a8bc886f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:21:45.425819 n-d-846466-12 devstack@n-api.service[104132]: DEBUG oslo_concurrency.lockutils [None req-27655857-ca43-45b6-9ae7-c1f7a8bc886f None None] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:21:45.426073 n-d-846466-12 devstack@n-api.service[104133]: DEBUG oslo_concurrency.lockutils [None req-72b1d844-57bd-4bdf-9e7d-46e317ae9beb None None] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:21:45.427779 n-d-846466-12 devstack@n-api.service[104132]: DEBUG oslo_concurrency.lockutils [None req-27655857-ca43-45b6-9ae7-c1f7a8bc886f None None] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:21:45.428061 n-d-846466-12 devstack@n-api.service[104133]: INFO dbcounter [None req-72b1d844-57bd-4bdf-9e7d-46e317ae9beb None None] Registered counter for database nova_cell0 Aug 04 16:21:45.429775 n-d-846466-12 devstack@n-api.service[104132]: INFO dbcounter [None req-27655857-ca43-45b6-9ae7-c1f7a8bc886f None None] Registered counter for database nova_cell0 Aug 04 16:21:45.433561 n-d-846466-12 devstack@n-api.service[104133]: INFO dbcounter [None req-72b1d844-57bd-4bdf-9e7d-46e317ae9beb None None] Registered counter for database nova_cell1 Aug 04 16:21:45.435326 n-d-846466-12 devstack@n-api.service[104132]: INFO dbcounter [None req-27655857-ca43-45b6-9ae7-c1f7a8bc886f None None] Registered counter for database nova_cell1 Aug 04 16:21:45.441677 n-d-846466-12 devstack@n-api.service[104133]: DEBUG oslo_db.sqlalchemy.engines [None req-72b1d844-57bd-4bdf-9e7d-46e317ae9beb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:21:45.444781 n-d-846466-12 devstack@n-api.service[104132]: DEBUG oslo_db.sqlalchemy.engines [None req-27655857-ca43-45b6-9ae7-c1f7a8bc886f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104132) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:21:45.444929 n-d-846466-12 devstack@n-api.service[104133]: DEBUG oslo_db.sqlalchemy.engines [None req-72b1d844-57bd-4bdf-9e7d-46e317ae9beb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:21:45.448429 n-d-846466-12 devstack@n-api.service[104132]: DEBUG oslo_db.sqlalchemy.engines [None req-27655857-ca43-45b6-9ae7-c1f7a8bc886f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104132) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:21:45.451380 n-d-846466-12 devstack@n-api.service[104133]: DEBUG dbcounter [-] [104133] Writer thread running {{(pid=104133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 16:21:45.451499 n-d-846466-12 devstack@n-api.service[104132]: DEBUG dbcounter [-] [104132] Writer thread running {{(pid=104132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 16:21:45.454375 n-d-846466-12 devstack@n-api.service[104133]: DEBUG dbcounter [-] [104133] Writer thread running {{(pid=104133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 16:21:45.587128 n-d-846466-12 devstack@n-api.service[104132]: DEBUG dbcounter [-] [104132] Writer thread running {{(pid=104132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 16:21:45.596402 n-d-846466-12 devstack@n-api.service[104132]: INFO dbcounter [None req-27655857-ca43-45b6-9ae7-c1f7a8bc886f None None] Registered counter for database nova_cell0 Aug 04 16:21:45.602381 n-d-846466-12 devstack@n-api.service[104133]: INFO dbcounter [None req-72b1d844-57bd-4bdf-9e7d-46e317ae9beb None None] Registered counter for database nova_cell0 Aug 04 16:21:45.603909 n-d-846466-12 devstack@n-api.service[104132]: DEBUG oslo_db.sqlalchemy.engines [None req-27655857-ca43-45b6-9ae7-c1f7a8bc886f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104132) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:21:45.608639 n-d-846466-12 devstack@n-api.service[104132]: DEBUG dbcounter [-] [104132] Writer thread running {{(pid=104132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 16:21:45.611728 n-d-846466-12 devstack@n-api.service[104133]: DEBUG oslo_db.sqlalchemy.engines [None req-72b1d844-57bd-4bdf-9e7d-46e317ae9beb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:21:45.616677 n-d-846466-12 devstack@n-api.service[104133]: DEBUG dbcounter [-] [104133] Writer thread running {{(pid=104133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 16:21:45.940848 n-d-846466-12 devstack@n-api.service[104133]: WARNING keystonemiddleware.auth_token [None req-72b1d844-57bd-4bdf-9e7d-46e317ae9beb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 16:21:45.943976 n-d-846466-12 devstack@n-api.service[104132]: WARNING keystonemiddleware.auth_token [None req-27655857-ca43-45b6-9ae7-c1f7a8bc886f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 16:21:45.948144 n-d-846466-12 devstack@n-api.service[104133]: WARNING keystonemiddleware.auth_token [None req-72b1d844-57bd-4bdf-9e7d-46e317ae9beb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 16:21:45.951140 n-d-846466-12 devstack@n-api.service[104132]: WARNING keystonemiddleware.auth_token [None req-27655857-ca43-45b6-9ae7-c1f7a8bc886f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 16:21:46.288201 n-d-846466-12 devstack@n-api.service[104133]: WARNING keystonemiddleware.auth_token [None req-72b1d844-57bd-4bdf-9e7d-46e317ae9beb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 16:21:46.291614 n-d-846466-12 devstack@n-api.service[104132]: WARNING keystonemiddleware.auth_token [None req-27655857-ca43-45b6-9ae7-c1f7a8bc886f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 16:21:46.294605 n-d-846466-12 devstack@n-api.service[104133]: WARNING keystonemiddleware.auth_token [None req-72b1d844-57bd-4bdf-9e7d-46e317ae9beb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 16:21:46.297853 n-d-846466-12 devstack@n-api.service[104132]: WARNING keystonemiddleware.auth_token [None req-27655857-ca43-45b6-9ae7-c1f7a8bc886f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 16:21:46.300274 n-d-846466-12 devstack@n-api.service[104133]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55dd240b79c0 pid: 104133 (default app) Aug 04 16:21:46.302447 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-72b1d844-57bd-4bdf-9e7d-46e317ae9beb None None] Calling method '>' {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:21:46.303023 n-d-846466-12 devstack@n-api.service[104132]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55dd240b79c0 pid: 104132 (default app) Aug 04 16:21:46.303626 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-72b1d844-57bd-4bdf-9e7d-46e317ae9beb None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001778 Aug 04 16:21:46.304025 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 788 bytes} [Thu Aug 4 16:21:46 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:23:07.485126 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-27655857-ca43-45b6-9ae7-c1f7a8bc886f None None] Calling method '>' {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:23:07.487066 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-27655857-ca43-45b6-9ae7-c1f7a8bc886f None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002668 Aug 04 16:23:07.493273 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 931 bytes} [Thu Aug 4 16:23:07 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:23:07.505411 n-d-846466-12 devstack@n-api.service[104133]: DEBUG dbcounter [-] [104133] Writing DB stats nova_api:SELECT=3 {{(pid=104133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:23:07.507002 n-d-846466-12 devstack@n-api.service[104133]: DEBUG dbcounter [-] [104133] Writing DB stats nova_cell1:SELECT=3 {{(pid=104133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:23:07.508253 n-d-846466-12 devstack@n-api.service[104133]: DEBUG dbcounter [-] [104133] Writing DB stats nova_cell0:SELECT=3 {{(pid=104133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:23:07.509339 n-d-846466-12 devstack@n-api.service[104133]: DEBUG dbcounter [-] [104133] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:23:08.458814 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-b0416735-b43d-41c1-bf2c-e0f11fe3b290 admin admin] Calling method '>' {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:23:08.491429 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-b0416735-b43d-41c1-bf2c-e0f11fe3b290 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.996553 Aug 04 16:23:08.505320 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 2/3] 10.222.0.23 () {60 vars in 1292 bytes} [Thu Aug 4 16:23:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:23:10.802530 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-27655857-ca43-45b6-9ae7-c1f7a8bc886f None None] Calling method '>' {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:23:10.803488 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-27655857-ca43-45b6-9ae7-c1f7a8bc886f None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 04 16:23:10.805328 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 2/4] 10.222.0.23 () {54 vars in 931 bytes} [Thu Aug 4 16:23:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:23:11.264679 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-26d93280-9aa5-4b69-a597-b1aab38e14da admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "disk": 1, "rxtx_factor": 1.0, "name": "cirros256", "os-flavor-access:is_public": true, "vcpus": 1, "id": "c1", "swap": 0}} {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:23:11.285620 n-d-846466-12 devstack@n-api.service[104133]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:23:11.285620 n-d-846466-12 devstack@n-api.service[104133]: warnings.warn(msg) Aug 04 16:23:11.317216 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-26d93280-9aa5-4b69-a597-b1aab38e14da admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.505283 Aug 04 16:23:11.318436 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 3/5] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Aug 4 16:23:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:23:11.332342 n-d-846466-12 devstack@n-api.service[104132]: DEBUG dbcounter [-] [104132] Writing DB stats nova_api:SELECT=3 {{(pid=104132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:23:11.333172 n-d-846466-12 devstack@n-api.service[104132]: DEBUG dbcounter [-] [104132] Writing DB stats nova_cell0:SELECT=3 {{(pid=104132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:23:11.334185 n-d-846466-12 devstack@n-api.service[104132]: DEBUG dbcounter [-] [104132] Writing DB stats nova_cell1:SELECT=3 {{(pid=104132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:23:11.334925 n-d-846466-12 devstack@n-api.service[104132]: DEBUG dbcounter [-] [104132] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:23:11.545548 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-e5167f5d-0151-4c7d-b8c5-ede4dc3fa4bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:23:11.551767 n-d-846466-12 devstack@n-api.service[104132]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:23:11.551767 n-d-846466-12 devstack@n-api.service[104132]: warnings.warn(msg) Aug 04 16:23:11.664793 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-e5167f5d-0151-4c7d-b8c5-ede4dc3fa4bf admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.337011 Aug 04 16:23:11.666056 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 3/6] 10.222.0.23 () {64 vars in 1336 bytes} [Thu Aug 4 16:23:11 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:23:14.004784 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-26d93280-9aa5-4b69-a597-b1aab38e14da admin admin] Calling method '>' {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:23:14.005531 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-26d93280-9aa5-4b69-a597-b1aab38e14da admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Aug 04 16:23:14.006247 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 4/7] 10.222.0.23 () {54 vars in 931 bytes} [Thu Aug 4 16:23:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:23:14.977019 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-22369cd7-8951-46eb-af20-d8570d449e26 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 512, "disk": 5}} {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:23:14.996200 n-d-846466-12 devstack@n-api.service[104132]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:23:14.996200 n-d-846466-12 devstack@n-api.service[104132]: warnings.warn(msg) Aug 04 16:23:15.018906 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-22369cd7-8951-46eb-af20-d8570d449e26 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.005928 Aug 04 16:23:15.019802 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 4/8] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Aug 4 16:23:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:23:15.043217 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-b2400656-f3ab-423f-936f-f3042160b088 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:23:15.047275 n-d-846466-12 devstack@n-api.service[104133]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:23:15.047275 n-d-846466-12 devstack@n-api.service[104133]: warnings.warn(msg) Aug 04 16:23:15.096879 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-b2400656-f3ab-423f-936f-f3042160b088 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.062774 Aug 04 16:23:15.101407 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 5/9] 10.222.0.23 () {64 vars in 1336 bytes} [Thu Aug 4 16:23:15 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:23:17.710135 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-22369cd7-8951-46eb-af20-d8570d449e26 admin admin] Calling method '>' {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:23:17.712006 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-22369cd7-8951-46eb-af20-d8570d449e26 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003171 Aug 04 16:23:17.713121 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 931 bytes} [Thu Aug 4 16:23:17 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:23:18.285231 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-d1597c21-eef7-4920-868f-434955e34a6a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "id": "d2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "ram": 1024, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:23:18.314287 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-d1597c21-eef7-4920-868f-434955e34a6a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.592117 Aug 04 16:23:18.315283 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 6/11] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Aug 4 16:23:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:23:18.329515 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-218b0746-6fac-40a4-8af5-8a5610adf0d9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:23:18.364588 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-218b0746-6fac-40a4-8af5-8a5610adf0d9 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039210 Aug 04 16:23:18.374548 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 6/12] 10.222.0.23 () {64 vars in 1336 bytes} [Thu Aug 4 16:23:18 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:23:22.066937 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-d1597c21-eef7-4920-868f-434955e34a6a admin admin] Calling method '>' {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:23:22.068668 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-d1597c21-eef7-4920-868f-434955e34a6a admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002467 Aug 04 16:23:22.069892 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 7/13] 10.222.0.23 () {54 vars in 931 bytes} [Thu Aug 4 16:23:22 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:23:22.802069 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-a5bc23f2-2d9f-4a28-a7fb-2f630ed087d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "ram": 2048, "disk": 10, "id": "d3", "name": "ds2G", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:23:22.828678 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-a5bc23f2-2d9f-4a28-a7fb-2f630ed087d0 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.749035 Aug 04 16:23:22.829250 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 7/14] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Aug 4 16:23:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 16:23:22.847816 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-20833909-338f-4440-b7c3-eb09f45102f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:23:22.890075 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-20833909-338f-4440-b7c3-eb09f45102f7 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047867 Aug 04 16:23:22.890687 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 8/15] 10.222.0.23 () {64 vars in 1336 bytes} [Thu Aug 4 16:23:22 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:23:25.377075 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-a5bc23f2-2d9f-4a28-a7fb-2f630ed087d0 admin admin] Calling method '>' {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:23:25.379325 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-a5bc23f2-2d9f-4a28-a7fb-2f630ed087d0 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002849 Aug 04 16:23:25.380214 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 8/16] 10.222.0.23 () {54 vars in 931 bytes} [Thu Aug 4 16:23:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:23:25.928552 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-5e36f9b3-26fa-4099-91fe-9dd33a44ce21 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "rxtx_factor": 1.0, "disk": 20, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:23:25.952700 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-5e36f9b3-26fa-4099-91fe-9dd33a44ce21 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.565733 Aug 04 16:23:25.953969 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 9/17] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Aug 4 16:23:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:23:25.966637 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-67b763ea-d9cd-4f7c-b6a7-b20103fa7d68 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:23:26.005418 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-67b763ea-d9cd-4f7c-b6a7-b20103fa7d68 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042899 Aug 04 16:23:26.016295 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 9/18] 10.222.0.23 () {64 vars in 1336 bytes} [Thu Aug 4 16:23:25 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:23:28.394779 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-5e36f9b3-26fa-4099-91fe-9dd33a44ce21 admin admin] Calling method '>' {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:23:28.396903 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-5e36f9b3-26fa-4099-91fe-9dd33a44ce21 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001843 Aug 04 16:23:28.404392 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 10/19] 10.222.0.23 () {54 vars in 931 bytes} [Thu Aug 4 16:23:28 2022] GET /compute/v2.1 => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:23:28.936910 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-aef16022-6d78-44a6-863a-a9f79012c62c admin admin] Calling method '>' {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:23:28.972301 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-aef16022-6d78-44a6-863a-a9f79012c62c admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.565803 Aug 04 16:23:28.972301 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 10/20] 10.222.0.23 () {60 vars in 1292 bytes} [Thu Aug 4 16:23:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:23:31.719267 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-5e36f9b3-26fa-4099-91fe-9dd33a44ce21 admin admin] Calling method '>' {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:23:31.720626 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-5e36f9b3-26fa-4099-91fe-9dd33a44ce21 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001907 Aug 04 16:23:31.721606 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 11/21] 10.222.0.23 () {54 vars in 931 bytes} [Thu Aug 4 16:23:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:23:32.407232 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-a450c98b-e25c-41da-932d-64b86cae179c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "name": "m1.tiny", "vcpus": 1, "disk": 1, "id": "1"}} {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:23:32.432282 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-a450c98b-e25c-41da-932d-64b86cae179c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.703815 Aug 04 16:23:32.432929 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 11/22] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Aug 4 16:23:31 2022] POST /compute/v2.1/flavors => generated 402 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 16:23:32.447757 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-77e1d299-3504-48bc-bd64-eba3c764169d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:23:32.484739 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-77e1d299-3504-48bc-bd64-eba3c764169d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040391 Aug 04 16:23:32.486439 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 12/23] 10.222.0.23 () {64 vars in 1333 bytes} [Thu Aug 4 16:23:32 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:23:34.922868 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-a450c98b-e25c-41da-932d-64b86cae179c admin admin] Calling method '>' {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:23:34.924022 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-a450c98b-e25c-41da-932d-64b86cae179c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001630 Aug 04 16:23:34.924516 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 12/24] 10.222.0.23 () {54 vars in 931 bytes} [Thu Aug 4 16:23:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:23:35.603282 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-a8a1673b-8c86-45bf-8d66-2bc565051aae admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 20, "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "id": "2", "name": "m1.small"}} {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:23:35.626061 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-a8a1673b-8c86-45bf-8d66-2bc565051aae admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.693354 Aug 04 16:23:35.626669 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 13/25] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Aug 4 16:23:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:23:35.645270 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-a4be013b-e0df-4330-a1a9-f908d5661f99 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:23:35.687297 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-a4be013b-e0df-4330-a1a9-f908d5661f99 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050678 Aug 04 16:23:35.688324 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 13/26] 10.222.0.23 () {64 vars in 1333 bytes} [Thu Aug 4 16:23:35 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:23:38.004785 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-a8a1673b-8c86-45bf-8d66-2bc565051aae admin admin] Calling method '>' {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:23:38.005863 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-a8a1673b-8c86-45bf-8d66-2bc565051aae admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Aug 04 16:23:38.006289 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 14/27] 10.222.0.23 () {54 vars in 931 bytes} [Thu Aug 4 16:23:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:23:38.506809 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-037853d4-0a9b-4b4c-b9a9-79a8c17efb06 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 40, "os-flavor-access:is_public": true, "name": "m1.medium", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "3", "vcpus": 2}} {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:23:38.532063 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-037853d4-0a9b-4b4c-b9a9-79a8c17efb06 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.517049 Aug 04 16:23:38.532632 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 14/28] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Aug 4 16:23:38 2022] POST /compute/v2.1/flavors => generated 406 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:23:38.546932 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-8a9a3dd8-9309-4cd9-9357-c52d84b8fa0d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:23:38.554543 n-d-846466-12 devstack@n-api.service[104133]: DEBUG dbcounter [-] [104133] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:23:38.584830 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-8a9a3dd8-9309-4cd9-9357-c52d84b8fa0d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043057 Aug 04 16:23:38.585809 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 15/29] 10.222.0.23 () {64 vars in 1333 bytes} [Thu Aug 4 16:23:38 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:23:41.013647 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-037853d4-0a9b-4b4c-b9a9-79a8c17efb06 admin admin] Calling method '>' {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:23:41.021123 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-037853d4-0a9b-4b4c-b9a9-79a8c17efb06 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.010447 Aug 04 16:23:41.022565 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 15/30] 10.222.0.23 () {54 vars in 931 bytes} [Thu Aug 4 16:23:41 2022] GET /compute/v2.1 => generated 388 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:23:41.723931 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-5271162d-ccaa-4588-ba2d-ed69a66b9883 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "disk": 80, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "rxtx_factor": 1.0, "id": "4", "name": "m1.large"}} {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:23:41.762916 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-5271162d-ccaa-4588-ba2d-ed69a66b9883 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.729177 Aug 04 16:23:41.763957 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 16/31] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Aug 4 16:23:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:23:41.785324 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-b3a2ce74-2df9-42e2-b5c7-8ba4d8b9d9c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:23:41.796617 n-d-846466-12 devstack@n-api.service[104132]: DEBUG dbcounter [-] [104132] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=104132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:23:41.832535 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-b3a2ce74-2df9-42e2-b5c7-8ba4d8b9d9c1 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.053875 Aug 04 16:23:41.837477 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 16/32] 10.222.0.23 () {64 vars in 1333 bytes} [Thu Aug 4 16:23:41 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:23:44.934655 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-5271162d-ccaa-4588-ba2d-ed69a66b9883 admin admin] Calling method '>' {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:23:44.936642 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-5271162d-ccaa-4588-ba2d-ed69a66b9883 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002543 Aug 04 16:23:44.937304 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 17/33] 10.222.0.23 () {54 vars in 931 bytes} [Thu Aug 4 16:23:44 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:23:45.598159 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-00b4cc53-e78c-4116-bad7-ee4e9c7d94df admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "disk": 160, "rxtx_factor": 1.0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "swap": 0, "id": "5", "os-flavor-access:is_public": true}} {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:23:45.639316 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-00b4cc53-e78c-4116-bad7-ee4e9c7d94df admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.691329 Aug 04 16:23:45.645331 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 17/34] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Aug 4 16:23:44 2022] POST /compute/v2.1/flavors => generated 408 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 16:23:45.657621 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-3fbbf887-3de8-4d99-868a-c675e69318b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:23:45.698436 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-3fbbf887-3de8-4d99-868a-c675e69318b5 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044494 Aug 04 16:23:45.700399 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 18/35] 10.222.0.23 () {64 vars in 1333 bytes} [Thu Aug 4 16:23:45 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:24:08.337358 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-00b4cc53-e78c-4116-bad7-ee4e9c7d94df admin admin] Calling method '>' {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:08.339018 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-00b4cc53-e78c-4116-bad7-ee4e9c7d94df admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002595 Aug 04 16:24:08.339723 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 18/36] 10.222.0.23 () {54 vars in 931 bytes} [Thu Aug 4 16:24:08 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:24:08.355519 n-d-846466-12 devstack@n-api.service[104133]: DEBUG dbcounter [-] [104133] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:24:08.877553 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-0ba94e89-2a0f-495b-887b-ed12e1e2f3be admin admin] Calling method '>' {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:08.897568 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-0ba94e89-2a0f-495b-887b-ed12e1e2f3be admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.546962 Aug 04 16:24:08.898257 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 19/37] 10.222.0.23 () {60 vars in 1292 bytes} [Thu Aug 4 16:24:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:24:10.071830 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-00b4cc53-e78c-4116-bad7-ee4e9c7d94df admin admin] Calling method '>' {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:10.072838 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-00b4cc53-e78c-4116-bad7-ee4e9c7d94df admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Aug 04 16:24:10.073235 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 19/38] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Aug 4 16:24:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:24:10.800574 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-a316f7d3-d989-440a-bf24-25a5d3670d69 admin admin] Calling method '>' {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:10.806807 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.wsgi [None req-a316f7d3-d989-440a-bf24-25a5d3670d69 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 16:24:10.810504 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-a316f7d3-d989-440a-bf24-25a5d3670d69 admin admin] Request method failure captured: Aug 04 16:24:10.810504 n-d-846466-12 devstack@n-api.service[104133]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 04 16:24:10.810504 n-d-846466-12 devstack@n-api.service[104133]: Accept: application/json Aug 04 16:24:10.810504 n-d-846466-12 devstack@n-api.service[104133]: Accept-Encoding: gzip, deflate Aug 04 16:24:10.810504 n-d-846466-12 devstack@n-api.service[104133]: Connection: keep-alive Aug 04 16:24:10.810504 n-d-846466-12 devstack@n-api.service[104133]: Content-Length: 0 Aug 04 16:24:10.810504 n-d-846466-12 devstack@n-api.service[104133]: Host: 10.222.0.23 Aug 04 16:24:10.810504 n-d-846466-12 devstack@n-api.service[104133]: Openstack-Api-Version: compute 2.90 Aug 04 16:24:10.810504 n-d-846466-12 devstack@n-api.service[104133]: Openstack-System-Scope: None Aug 04 16:24:10.810504 n-d-846466-12 devstack@n-api.service[104133]: User-Agent: python-novaclient Aug 04 16:24:10.810504 n-d-846466-12 devstack@n-api.service[104133]: X-Auth-Token: gAAAAABi6_KphVx4v4hzYfyaAWnymwEtMzLvVyhQJDuKrIzObq8kcS3dfE-6G0TtTwYslraOS4o6OMz6DFc-TiBq76XwiyMB9nMB7FaFezgu2R62InI-_u3O8JivFRhxpP0OC_k2OE2-NyiY_OoU7d7Z3AKdbl8rHHLC_gHsa13VppumIX_Hhmg Aug 04 16:24:10.810504 n-d-846466-12 devstack@n-api.service[104133]: X-Domain-Id: None Aug 04 16:24:10.810504 n-d-846466-12 devstack@n-api.service[104133]: X-Domain-Name: None Aug 04 16:24:10.810504 n-d-846466-12 devstack@n-api.service[104133]: X-Identity-Status: Confirmed Aug 04 16:24:10.810504 n-d-846466-12 devstack@n-api.service[104133]: X-Is-Admin-Project: True Aug 04 16:24:10.810504 n-d-846466-12 devstack@n-api.service[104133]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 16:24:10.810504 n-d-846466-12 devstack@n-api.service[104133]: X-Project-Domain-Id: default Aug 04 16:24:10.810504 n-d-846466-12 devstack@n-api.service[104133]: X-Project-Domain-Name: Default Aug 04 16:24:10.810504 n-d-846466-12 devstack@n-api.service[104133]: X-Project-Id: 382d33b4657f4a7ca22182927c23cf57 Aug 04 16:24:10.810504 n-d-846466-12 devstack@n-api.service[104133]: X-Project-Name: admin Aug 04 16:24:10.810504 n-d-846466-12 devstack@n-api.service[104133]: X-Role: member,reader,admin Aug 04 16:24:10.810504 n-d-846466-12 devstack@n-api.service[104133]: X-Roles: member,reader,admin Aug 04 16:24:10.813090 n-d-846466-12 devstack@n-api.service[104133]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/382d33b4657f4a7ca22182927c23cf57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_382d33b4657f4a7ca22182927c23cf57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/382d33b4657f4a7ca22182927c23cf57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/382d33b4657f4a7ca22182927c23cf57"}]}] Aug 04 16:24:10.813090 n-d-846466-12 devstack@n-api.service[104133]: X-Tenant: admin Aug 04 16:24:10.813090 n-d-846466-12 devstack@n-api.service[104133]: X-Tenant-Id: 382d33b4657f4a7ca22182927c23cf57 Aug 04 16:24:10.813090 n-d-846466-12 devstack@n-api.service[104133]: X-Tenant-Name: admin Aug 04 16:24:10.813090 n-d-846466-12 devstack@n-api.service[104133]: X-User: admin Aug 04 16:24:10.813090 n-d-846466-12 devstack@n-api.service[104133]: X-User-Domain-Id: default Aug 04 16:24:10.813090 n-d-846466-12 devstack@n-api.service[104133]: X-User-Domain-Name: Default Aug 04 16:24:10.813090 n-d-846466-12 devstack@n-api.service[104133]: X-User-Id: e8cfa7aae1b549988836e9d10bb68b2c Aug 04 16:24:10.813090 n-d-846466-12 devstack@n-api.service[104133]: X-User-Name: admin Aug 04 16:24:10.813090 n-d-846466-12 devstack@n-api.service[104133]: method: > Aug 04 16:24:10.813090 n-d-846466-12 devstack@n-api.service[104133]: exception: Flavor 42 could not be found. Aug 04 16:24:10.813090 n-d-846466-12 devstack@n-api.service[104133]: action_args: {'id': '42'} Aug 04 16:24:10.813090 n-d-846466-12 devstack@n-api.service[104133]: {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:24:10.813090 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:24:10.814719 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 16:24:10.814719 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 16:24:10.814719 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 16:24:10.814719 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 16:24:10.814719 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:24:10.814719 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:24:10.814719 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 16:24:10.814719 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 16:24:10.814719 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 16:24:10.814719 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:24:10.814719 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 16:24:10.814719 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 16:24:10.814719 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 04 16:24:10.814719 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi Aug 04 16:24:10.814719 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:24:10.814719 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi Aug 04 16:24:10.814719 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:24:10.814719 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:24:10.814719 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:24:10.816787 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:24:10.816787 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:24:10.816787 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:24:10.816787 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:24:10.816787 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 16:24:10.816787 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:24:10.816787 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 04 16:24:10.816787 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi Aug 04 16:24:10.816787 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:24:10.816787 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi Aug 04 16:24:10.816787 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:24:10.816787 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:24:10.816787 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:24:10.816787 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:24:10.816787 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:24:10.816787 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 04 16:24:10.816787 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi Aug 04 16:24:10.816787 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-a316f7d3-d989-440a-bf24-25a5d3670d69 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:24:10.818769 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-a316f7d3-d989-440a-bf24-25a5d3670d69 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.516492 Aug 04 16:24:10.818769 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 20/39] 10.222.0.23 () {60 vars in 1190 bytes} [Thu Aug 4 16:24:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 518 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 16:24:10.825641 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-6eec9e44-bc08-4d13-85f1-da266aaa22a8 admin admin] Calling method '>' {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:10.829946 n-d-846466-12 devstack@n-api.service[104132]: DEBUG dbcounter [-] [104132] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=104132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:24:10.863609 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-6eec9e44-bc08-4d13-85f1-da266aaa22a8 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.041937 Aug 04 16:24:10.864237 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 20/40] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Aug 4 16:24:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:24:10.875540 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-784ff4c7-d07f-4d20-9f3a-e693bc430915 admin admin] Calling method '>' {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:10.901164 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-784ff4c7-d07f-4d20-9f3a-e693bc430915 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029507 Aug 04 16:24:10.901784 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 21/41] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Aug 4 16:24:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:24:10.913838 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-31ba5f40-7701-4623-bdba-d3e0bdc84636 admin admin] Calling method '>' {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:10.921031 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.wsgi [None req-31ba5f40-7701-4623-bdba-d3e0bdc84636 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 16:24:10.931107 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-31ba5f40-7701-4623-bdba-d3e0bdc84636 admin admin] Request method failure captured: Aug 04 16:24:10.931107 n-d-846466-12 devstack@n-api.service[104132]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 04 16:24:10.931107 n-d-846466-12 devstack@n-api.service[104132]: Accept: application/json Aug 04 16:24:10.931107 n-d-846466-12 devstack@n-api.service[104132]: Accept-Encoding: gzip, deflate Aug 04 16:24:10.931107 n-d-846466-12 devstack@n-api.service[104132]: Connection: keep-alive Aug 04 16:24:10.931107 n-d-846466-12 devstack@n-api.service[104132]: Content-Length: 0 Aug 04 16:24:10.931107 n-d-846466-12 devstack@n-api.service[104132]: Host: 10.222.0.23 Aug 04 16:24:10.931107 n-d-846466-12 devstack@n-api.service[104132]: Openstack-Api-Version: compute 2.90 Aug 04 16:24:10.931107 n-d-846466-12 devstack@n-api.service[104132]: Openstack-System-Scope: None Aug 04 16:24:10.931107 n-d-846466-12 devstack@n-api.service[104132]: User-Agent: python-novaclient Aug 04 16:24:10.931107 n-d-846466-12 devstack@n-api.service[104132]: X-Auth-Token: gAAAAABi6_KphVx4v4hzYfyaAWnymwEtMzLvVyhQJDuKrIzObq8kcS3dfE-6G0TtTwYslraOS4o6OMz6DFc-TiBq76XwiyMB9nMB7FaFezgu2R62InI-_u3O8JivFRhxpP0OC_k2OE2-NyiY_OoU7d7Z3AKdbl8rHHLC_gHsa13VppumIX_Hhmg Aug 04 16:24:10.931107 n-d-846466-12 devstack@n-api.service[104132]: X-Domain-Id: None Aug 04 16:24:10.931107 n-d-846466-12 devstack@n-api.service[104132]: X-Domain-Name: None Aug 04 16:24:10.931107 n-d-846466-12 devstack@n-api.service[104132]: X-Identity-Status: Confirmed Aug 04 16:24:10.931107 n-d-846466-12 devstack@n-api.service[104132]: X-Is-Admin-Project: True Aug 04 16:24:10.931107 n-d-846466-12 devstack@n-api.service[104132]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 16:24:10.931107 n-d-846466-12 devstack@n-api.service[104132]: X-Project-Domain-Id: default Aug 04 16:24:10.931107 n-d-846466-12 devstack@n-api.service[104132]: X-Project-Domain-Name: Default Aug 04 16:24:10.931107 n-d-846466-12 devstack@n-api.service[104132]: X-Project-Id: 382d33b4657f4a7ca22182927c23cf57 Aug 04 16:24:10.931107 n-d-846466-12 devstack@n-api.service[104132]: X-Project-Name: admin Aug 04 16:24:10.931107 n-d-846466-12 devstack@n-api.service[104132]: X-Role: member,reader,admin Aug 04 16:24:10.931107 n-d-846466-12 devstack@n-api.service[104132]: X-Roles: member,reader,admin Aug 04 16:24:10.933622 n-d-846466-12 devstack@n-api.service[104132]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/382d33b4657f4a7ca22182927c23cf57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_382d33b4657f4a7ca22182927c23cf57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/382d33b4657f4a7ca22182927c23cf57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/382d33b4657f4a7ca22182927c23cf57"}]}] Aug 04 16:24:10.933622 n-d-846466-12 devstack@n-api.service[104132]: X-Tenant: admin Aug 04 16:24:10.933622 n-d-846466-12 devstack@n-api.service[104132]: X-Tenant-Id: 382d33b4657f4a7ca22182927c23cf57 Aug 04 16:24:10.933622 n-d-846466-12 devstack@n-api.service[104132]: X-Tenant-Name: admin Aug 04 16:24:10.933622 n-d-846466-12 devstack@n-api.service[104132]: X-User: admin Aug 04 16:24:10.933622 n-d-846466-12 devstack@n-api.service[104132]: X-User-Domain-Id: default Aug 04 16:24:10.933622 n-d-846466-12 devstack@n-api.service[104132]: X-User-Domain-Name: Default Aug 04 16:24:10.933622 n-d-846466-12 devstack@n-api.service[104132]: X-User-Id: e8cfa7aae1b549988836e9d10bb68b2c Aug 04 16:24:10.933622 n-d-846466-12 devstack@n-api.service[104132]: X-User-Name: admin Aug 04 16:24:10.933622 n-d-846466-12 devstack@n-api.service[104132]: method: > Aug 04 16:24:10.933622 n-d-846466-12 devstack@n-api.service[104132]: exception: Flavor 42 could not be found. Aug 04 16:24:10.933622 n-d-846466-12 devstack@n-api.service[104132]: action_args: {'id': '42'} Aug 04 16:24:10.933622 n-d-846466-12 devstack@n-api.service[104132]: {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:24:10.933622 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:24:10.935190 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 16:24:10.935190 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 16:24:10.935190 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 16:24:10.935190 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 16:24:10.935190 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:24:10.935190 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:24:10.935190 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 16:24:10.935190 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 16:24:10.935190 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 16:24:10.935190 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:24:10.935190 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 16:24:10.935190 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 16:24:10.935190 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 04 16:24:10.935190 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi Aug 04 16:24:10.935190 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:24:10.935190 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi Aug 04 16:24:10.935190 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:24:10.935190 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:24:10.935190 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:24:10.937618 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:24:10.937618 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:24:10.937618 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:24:10.937618 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:24:10.937618 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 16:24:10.937618 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:24:10.937618 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 04 16:24:10.937618 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi Aug 04 16:24:10.937618 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:24:10.937618 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi Aug 04 16:24:10.937618 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:24:10.937618 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:24:10.937618 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:24:10.937618 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:24:10.937618 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:24:10.937618 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 04 16:24:10.937618 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi Aug 04 16:24:10.937618 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-31ba5f40-7701-4623-bdba-d3e0bdc84636 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:24:10.939736 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-31ba5f40-7701-4623-bdba-d3e0bdc84636 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.024030 Aug 04 16:24:10.939736 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 21/42] 10.222.0.23 () {60 vars in 1190 bytes} [Thu Aug 4 16:24:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 04 16:24:12.043406 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-784ff4c7-d07f-4d20-9f3a-e693bc430915 admin admin] Calling method '>' {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:12.045110 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-784ff4c7-d07f-4d20-9f3a-e693bc430915 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001979 Aug 04 16:24:12.045911 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 22/43] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Aug 4 16:24:12 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:24:12.702738 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-f5045a49-ba9b-4691-b489-71e9a7288d31 admin admin] Calling method '>' {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:12.709013 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.wsgi [None req-f5045a49-ba9b-4691-b489-71e9a7288d31 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 16:24:12.710650 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-f5045a49-ba9b-4691-b489-71e9a7288d31 admin admin] Request method failure captured: Aug 04 16:24:12.710650 n-d-846466-12 devstack@n-api.service[104132]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 04 16:24:12.710650 n-d-846466-12 devstack@n-api.service[104132]: Accept: application/json Aug 04 16:24:12.710650 n-d-846466-12 devstack@n-api.service[104132]: Accept-Encoding: gzip, deflate Aug 04 16:24:12.710650 n-d-846466-12 devstack@n-api.service[104132]: Connection: keep-alive Aug 04 16:24:12.710650 n-d-846466-12 devstack@n-api.service[104132]: Content-Length: 0 Aug 04 16:24:12.710650 n-d-846466-12 devstack@n-api.service[104132]: Host: 10.222.0.23 Aug 04 16:24:12.710650 n-d-846466-12 devstack@n-api.service[104132]: Openstack-Api-Version: compute 2.90 Aug 04 16:24:12.710650 n-d-846466-12 devstack@n-api.service[104132]: Openstack-System-Scope: None Aug 04 16:24:12.710650 n-d-846466-12 devstack@n-api.service[104132]: User-Agent: python-novaclient Aug 04 16:24:12.710650 n-d-846466-12 devstack@n-api.service[104132]: X-Auth-Token: gAAAAABi6_KrAgZ8er0iKyiJI_dEAEjs8OzFhncuyXyG3QCBKTLxXGLjU6y-h3hVYmNeQUtzJNSpRraoGBs9rG3kwcQIMhuvCtpO68tKpY0PLR8rsg0bGKpKO_QH7llQWuT3PIOGn-aYSek5IDQUE64rTYKjpkF7uPN07j7HWz6Vaj5-SIvvjzg Aug 04 16:24:12.710650 n-d-846466-12 devstack@n-api.service[104132]: X-Domain-Id: None Aug 04 16:24:12.710650 n-d-846466-12 devstack@n-api.service[104132]: X-Domain-Name: None Aug 04 16:24:12.710650 n-d-846466-12 devstack@n-api.service[104132]: X-Identity-Status: Confirmed Aug 04 16:24:12.710650 n-d-846466-12 devstack@n-api.service[104132]: X-Is-Admin-Project: True Aug 04 16:24:12.710650 n-d-846466-12 devstack@n-api.service[104132]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 16:24:12.710650 n-d-846466-12 devstack@n-api.service[104132]: X-Project-Domain-Id: default Aug 04 16:24:12.710650 n-d-846466-12 devstack@n-api.service[104132]: X-Project-Domain-Name: Default Aug 04 16:24:12.710650 n-d-846466-12 devstack@n-api.service[104132]: X-Project-Id: 382d33b4657f4a7ca22182927c23cf57 Aug 04 16:24:12.710650 n-d-846466-12 devstack@n-api.service[104132]: X-Project-Name: admin Aug 04 16:24:12.710650 n-d-846466-12 devstack@n-api.service[104132]: X-Role: member,reader,admin Aug 04 16:24:12.710650 n-d-846466-12 devstack@n-api.service[104132]: X-Roles: member,reader,admin Aug 04 16:24:12.713012 n-d-846466-12 devstack@n-api.service[104132]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/382d33b4657f4a7ca22182927c23cf57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_382d33b4657f4a7ca22182927c23cf57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/382d33b4657f4a7ca22182927c23cf57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/382d33b4657f4a7ca22182927c23cf57"}]}] Aug 04 16:24:12.713012 n-d-846466-12 devstack@n-api.service[104132]: X-Tenant: admin Aug 04 16:24:12.713012 n-d-846466-12 devstack@n-api.service[104132]: X-Tenant-Id: 382d33b4657f4a7ca22182927c23cf57 Aug 04 16:24:12.713012 n-d-846466-12 devstack@n-api.service[104132]: X-Tenant-Name: admin Aug 04 16:24:12.713012 n-d-846466-12 devstack@n-api.service[104132]: X-User: admin Aug 04 16:24:12.713012 n-d-846466-12 devstack@n-api.service[104132]: X-User-Domain-Id: default Aug 04 16:24:12.713012 n-d-846466-12 devstack@n-api.service[104132]: X-User-Domain-Name: Default Aug 04 16:24:12.713012 n-d-846466-12 devstack@n-api.service[104132]: X-User-Id: e8cfa7aae1b549988836e9d10bb68b2c Aug 04 16:24:12.713012 n-d-846466-12 devstack@n-api.service[104132]: X-User-Name: admin Aug 04 16:24:12.713012 n-d-846466-12 devstack@n-api.service[104132]: method: > Aug 04 16:24:12.713012 n-d-846466-12 devstack@n-api.service[104132]: exception: Flavor 84 could not be found. Aug 04 16:24:12.713012 n-d-846466-12 devstack@n-api.service[104132]: action_args: {'id': '84'} Aug 04 16:24:12.713012 n-d-846466-12 devstack@n-api.service[104132]: {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:24:12.713012 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:24:12.715004 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 16:24:12.715004 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 16:24:12.715004 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 16:24:12.715004 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 16:24:12.715004 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:24:12.715004 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:24:12.715004 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 16:24:12.715004 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 16:24:12.715004 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 16:24:12.715004 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:24:12.715004 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 16:24:12.715004 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 16:24:12.715004 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 04 16:24:12.715004 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi Aug 04 16:24:12.715004 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:24:12.715004 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi Aug 04 16:24:12.715004 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:24:12.715004 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:24:12.715004 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:24:12.717376 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:24:12.717376 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:24:12.717376 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:24:12.717376 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:24:12.717376 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 16:24:12.717376 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:24:12.717376 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 04 16:24:12.717376 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi Aug 04 16:24:12.717376 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:24:12.717376 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi Aug 04 16:24:12.717376 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:24:12.717376 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:24:12.717376 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:24:12.717376 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:24:12.717376 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:24:12.717376 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 04 16:24:12.717376 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi Aug 04 16:24:12.717376 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-f5045a49-ba9b-4691-b489-71e9a7288d31 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:24:12.719657 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-f5045a49-ba9b-4691-b489-71e9a7288d31 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.513749 Aug 04 16:24:12.719657 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 22/44] 10.222.0.23 () {60 vars in 1190 bytes} [Thu Aug 4 16:24:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 515 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 16:24:12.725814 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-d76312f5-2253-4bcc-a0b0-e6d170498f76 admin admin] Calling method '>' {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:12.742046 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-d76312f5-2253-4bcc-a0b0-e6d170498f76 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019899 Aug 04 16:24:12.742636 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 23/45] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Aug 4 16:24:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:24:12.753335 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-90d18e48-0192-496c-af98-453bee728976 admin admin] Calling method '>' {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:12.770572 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-90d18e48-0192-496c-af98-453bee728976 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020792 Aug 04 16:24:12.771187 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 23/46] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Aug 4 16:24:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:24:12.783236 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-cf0031fc-a8aa-47e7-9093-a2691bba8522 admin admin] Calling method '>' {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:12.789123 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.wsgi [None req-cf0031fc-a8aa-47e7-9093-a2691bba8522 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 16:24:12.790665 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-cf0031fc-a8aa-47e7-9093-a2691bba8522 admin admin] Request method failure captured: Aug 04 16:24:12.790665 n-d-846466-12 devstack@n-api.service[104133]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 04 16:24:12.790665 n-d-846466-12 devstack@n-api.service[104133]: Accept: application/json Aug 04 16:24:12.790665 n-d-846466-12 devstack@n-api.service[104133]: Accept-Encoding: gzip, deflate Aug 04 16:24:12.790665 n-d-846466-12 devstack@n-api.service[104133]: Connection: keep-alive Aug 04 16:24:12.790665 n-d-846466-12 devstack@n-api.service[104133]: Content-Length: 0 Aug 04 16:24:12.790665 n-d-846466-12 devstack@n-api.service[104133]: Host: 10.222.0.23 Aug 04 16:24:12.790665 n-d-846466-12 devstack@n-api.service[104133]: Openstack-Api-Version: compute 2.90 Aug 04 16:24:12.790665 n-d-846466-12 devstack@n-api.service[104133]: Openstack-System-Scope: None Aug 04 16:24:12.790665 n-d-846466-12 devstack@n-api.service[104133]: User-Agent: python-novaclient Aug 04 16:24:12.790665 n-d-846466-12 devstack@n-api.service[104133]: X-Auth-Token: gAAAAABi6_KrAgZ8er0iKyiJI_dEAEjs8OzFhncuyXyG3QCBKTLxXGLjU6y-h3hVYmNeQUtzJNSpRraoGBs9rG3kwcQIMhuvCtpO68tKpY0PLR8rsg0bGKpKO_QH7llQWuT3PIOGn-aYSek5IDQUE64rTYKjpkF7uPN07j7HWz6Vaj5-SIvvjzg Aug 04 16:24:12.790665 n-d-846466-12 devstack@n-api.service[104133]: X-Domain-Id: None Aug 04 16:24:12.790665 n-d-846466-12 devstack@n-api.service[104133]: X-Domain-Name: None Aug 04 16:24:12.790665 n-d-846466-12 devstack@n-api.service[104133]: X-Identity-Status: Confirmed Aug 04 16:24:12.790665 n-d-846466-12 devstack@n-api.service[104133]: X-Is-Admin-Project: True Aug 04 16:24:12.790665 n-d-846466-12 devstack@n-api.service[104133]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 16:24:12.790665 n-d-846466-12 devstack@n-api.service[104133]: X-Project-Domain-Id: default Aug 04 16:24:12.790665 n-d-846466-12 devstack@n-api.service[104133]: X-Project-Domain-Name: Default Aug 04 16:24:12.790665 n-d-846466-12 devstack@n-api.service[104133]: X-Project-Id: 382d33b4657f4a7ca22182927c23cf57 Aug 04 16:24:12.790665 n-d-846466-12 devstack@n-api.service[104133]: X-Project-Name: admin Aug 04 16:24:12.790665 n-d-846466-12 devstack@n-api.service[104133]: X-Role: member,reader,admin Aug 04 16:24:12.790665 n-d-846466-12 devstack@n-api.service[104133]: X-Roles: member,reader,admin Aug 04 16:24:12.793063 n-d-846466-12 devstack@n-api.service[104133]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/382d33b4657f4a7ca22182927c23cf57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_382d33b4657f4a7ca22182927c23cf57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/382d33b4657f4a7ca22182927c23cf57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/382d33b4657f4a7ca22182927c23cf57"}]}] Aug 04 16:24:12.793063 n-d-846466-12 devstack@n-api.service[104133]: X-Tenant: admin Aug 04 16:24:12.793063 n-d-846466-12 devstack@n-api.service[104133]: X-Tenant-Id: 382d33b4657f4a7ca22182927c23cf57 Aug 04 16:24:12.793063 n-d-846466-12 devstack@n-api.service[104133]: X-Tenant-Name: admin Aug 04 16:24:12.793063 n-d-846466-12 devstack@n-api.service[104133]: X-User: admin Aug 04 16:24:12.793063 n-d-846466-12 devstack@n-api.service[104133]: X-User-Domain-Id: default Aug 04 16:24:12.793063 n-d-846466-12 devstack@n-api.service[104133]: X-User-Domain-Name: Default Aug 04 16:24:12.793063 n-d-846466-12 devstack@n-api.service[104133]: X-User-Id: e8cfa7aae1b549988836e9d10bb68b2c Aug 04 16:24:12.793063 n-d-846466-12 devstack@n-api.service[104133]: X-User-Name: admin Aug 04 16:24:12.793063 n-d-846466-12 devstack@n-api.service[104133]: method: > Aug 04 16:24:12.793063 n-d-846466-12 devstack@n-api.service[104133]: exception: Flavor 84 could not be found. Aug 04 16:24:12.793063 n-d-846466-12 devstack@n-api.service[104133]: action_args: {'id': '84'} Aug 04 16:24:12.793063 n-d-846466-12 devstack@n-api.service[104133]: {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:24:12.793063 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:24:12.794694 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 16:24:12.794694 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 16:24:12.794694 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 16:24:12.794694 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 16:24:12.794694 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:24:12.794694 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:24:12.794694 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 16:24:12.794694 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 16:24:12.794694 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 16:24:12.794694 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:24:12.794694 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 16:24:12.794694 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 16:24:12.794694 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 04 16:24:12.794694 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi Aug 04 16:24:12.794694 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:24:12.794694 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi Aug 04 16:24:12.794694 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:24:12.794694 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:24:12.794694 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:24:12.796813 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:24:12.796813 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:24:12.796813 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:24:12.796813 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:24:12.796813 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 16:24:12.796813 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:24:12.796813 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 04 16:24:12.796813 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi Aug 04 16:24:12.796813 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:24:12.796813 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi Aug 04 16:24:12.796813 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:24:12.796813 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:24:12.796813 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:24:12.796813 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:24:12.796813 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:24:12.796813 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 04 16:24:12.796813 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi Aug 04 16:24:12.796813 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-cf0031fc-a8aa-47e7-9093-a2691bba8522 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:24:12.798761 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-cf0031fc-a8aa-47e7-9093-a2691bba8522 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013984 Aug 04 16:24:12.798761 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 24/47] 10.222.0.23 () {60 vars in 1190 bytes} [Thu Aug 4 16:24:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 16:24:13.978868 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-90d18e48-0192-496c-af98-453bee728976 admin admin] Calling method '>' {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:13.980556 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-90d18e48-0192-496c-af98-453bee728976 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002564 Aug 04 16:24:13.981307 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 24/48] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Aug 4 16:24:13 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:24:14.745197 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-4bae84c1-5712-46bd-8473-a7e8392a89a9 admin admin] Calling method '>' {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:14.752300 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.wsgi [None req-4bae84c1-5712-46bd-8473-a7e8392a89a9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 16:24:14.753934 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-4bae84c1-5712-46bd-8473-a7e8392a89a9 admin admin] Request method failure captured: Aug 04 16:24:14.753934 n-d-846466-12 devstack@n-api.service[104133]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 04 16:24:14.753934 n-d-846466-12 devstack@n-api.service[104133]: Accept: application/json Aug 04 16:24:14.753934 n-d-846466-12 devstack@n-api.service[104133]: Accept-Encoding: gzip, deflate Aug 04 16:24:14.753934 n-d-846466-12 devstack@n-api.service[104133]: Connection: keep-alive Aug 04 16:24:14.753934 n-d-846466-12 devstack@n-api.service[104133]: Content-Length: 0 Aug 04 16:24:14.753934 n-d-846466-12 devstack@n-api.service[104133]: Host: 10.222.0.23 Aug 04 16:24:14.753934 n-d-846466-12 devstack@n-api.service[104133]: Openstack-Api-Version: compute 2.90 Aug 04 16:24:14.753934 n-d-846466-12 devstack@n-api.service[104133]: Openstack-System-Scope: None Aug 04 16:24:14.753934 n-d-846466-12 devstack@n-api.service[104133]: User-Agent: python-novaclient Aug 04 16:24:14.753934 n-d-846466-12 devstack@n-api.service[104133]: X-Auth-Token: gAAAAABi6_Ktn427MEGkG_WHhXAt0xkFoau-m-vQ2U8xTAk_z83zu6HeR_yQpu6csJXevdq1NGcoOCI-J9x5af07N-1MdbPxvoIlrrET28GxqX1CuDxvLYaFe4OSwHRfakXXZCOaebq-OiROunHl0N-99Zdu_fxqcUGJsPHFvKD6ZxyM32g5IGI Aug 04 16:24:14.753934 n-d-846466-12 devstack@n-api.service[104133]: X-Domain-Id: None Aug 04 16:24:14.753934 n-d-846466-12 devstack@n-api.service[104133]: X-Domain-Name: None Aug 04 16:24:14.753934 n-d-846466-12 devstack@n-api.service[104133]: X-Identity-Status: Confirmed Aug 04 16:24:14.753934 n-d-846466-12 devstack@n-api.service[104133]: X-Is-Admin-Project: True Aug 04 16:24:14.753934 n-d-846466-12 devstack@n-api.service[104133]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 16:24:14.753934 n-d-846466-12 devstack@n-api.service[104133]: X-Project-Domain-Id: default Aug 04 16:24:14.753934 n-d-846466-12 devstack@n-api.service[104133]: X-Project-Domain-Name: Default Aug 04 16:24:14.753934 n-d-846466-12 devstack@n-api.service[104133]: X-Project-Id: 382d33b4657f4a7ca22182927c23cf57 Aug 04 16:24:14.753934 n-d-846466-12 devstack@n-api.service[104133]: X-Project-Name: admin Aug 04 16:24:14.753934 n-d-846466-12 devstack@n-api.service[104133]: X-Role: member,reader,admin Aug 04 16:24:14.753934 n-d-846466-12 devstack@n-api.service[104133]: X-Roles: member,reader,admin Aug 04 16:24:14.756207 n-d-846466-12 devstack@n-api.service[104133]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/382d33b4657f4a7ca22182927c23cf57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_382d33b4657f4a7ca22182927c23cf57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/382d33b4657f4a7ca22182927c23cf57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/382d33b4657f4a7ca22182927c23cf57"}]}] Aug 04 16:24:14.756207 n-d-846466-12 devstack@n-api.service[104133]: X-Tenant: admin Aug 04 16:24:14.756207 n-d-846466-12 devstack@n-api.service[104133]: X-Tenant-Id: 382d33b4657f4a7ca22182927c23cf57 Aug 04 16:24:14.756207 n-d-846466-12 devstack@n-api.service[104133]: X-Tenant-Name: admin Aug 04 16:24:14.756207 n-d-846466-12 devstack@n-api.service[104133]: X-User: admin Aug 04 16:24:14.756207 n-d-846466-12 devstack@n-api.service[104133]: X-User-Domain-Id: default Aug 04 16:24:14.756207 n-d-846466-12 devstack@n-api.service[104133]: X-User-Domain-Name: Default Aug 04 16:24:14.756207 n-d-846466-12 devstack@n-api.service[104133]: X-User-Id: e8cfa7aae1b549988836e9d10bb68b2c Aug 04 16:24:14.756207 n-d-846466-12 devstack@n-api.service[104133]: X-User-Name: admin Aug 04 16:24:14.756207 n-d-846466-12 devstack@n-api.service[104133]: method: > Aug 04 16:24:14.756207 n-d-846466-12 devstack@n-api.service[104133]: exception: Flavor 451 could not be found. Aug 04 16:24:14.756207 n-d-846466-12 devstack@n-api.service[104133]: action_args: {'id': '451'} Aug 04 16:24:14.756207 n-d-846466-12 devstack@n-api.service[104133]: {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:24:14.756207 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:24:14.757889 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 16:24:14.757889 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 16:24:14.757889 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 16:24:14.757889 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 16:24:14.757889 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:24:14.757889 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:24:14.757889 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 16:24:14.757889 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 16:24:14.757889 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 16:24:14.757889 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:24:14.757889 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 16:24:14.757889 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 16:24:14.757889 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 04 16:24:14.757889 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi Aug 04 16:24:14.757889 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:24:14.757889 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi Aug 04 16:24:14.757889 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:24:14.757889 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:24:14.757889 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:24:14.759828 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:24:14.759828 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:24:14.759828 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:24:14.759828 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:24:14.759828 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 16:24:14.759828 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:24:14.759828 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 04 16:24:14.759828 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi Aug 04 16:24:14.759828 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:24:14.759828 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi Aug 04 16:24:14.759828 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:24:14.759828 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:24:14.759828 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:24:14.759828 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:24:14.759828 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:24:14.759828 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 04 16:24:14.759828 n-d-846466-12 devstack@n-api.service[104133]: ERROR nova.api.openstack.wsgi Aug 04 16:24:14.759828 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-4bae84c1-5712-46bd-8473-a7e8392a89a9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:24:14.761723 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-4bae84c1-5712-46bd-8473-a7e8392a89a9 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.627017 Aug 04 16:24:14.761723 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 25/49] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Aug 4 16:24:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 628 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 16:24:14.768693 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-ff4e8bb2-b11b-4133-9a7b-0398c4b3c10b admin admin] Calling method '>' {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:14.785992 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-ff4e8bb2-b11b-4133-9a7b-0398c4b3c10b admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020978 Aug 04 16:24:14.786914 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 25/50] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Aug 4 16:24:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:24:14.799885 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-f648ea5b-61c0-41c6-95ca-acdff072827e admin admin] Calling method '>' {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:14.817499 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-f648ea5b-61c0-41c6-95ca-acdff072827e admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021437 Aug 04 16:24:14.818133 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 26/51] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Aug 4 16:24:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:24:14.831281 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-5fca235f-5bab-4d02-8d11-ce76a80ca689 admin admin] Calling method '>' {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:14.840276 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.wsgi [None req-5fca235f-5bab-4d02-8d11-ce76a80ca689 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 16:24:14.842909 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-5fca235f-5bab-4d02-8d11-ce76a80ca689 admin admin] Request method failure captured: Aug 04 16:24:14.842909 n-d-846466-12 devstack@n-api.service[104132]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 04 16:24:14.842909 n-d-846466-12 devstack@n-api.service[104132]: Accept: application/json Aug 04 16:24:14.842909 n-d-846466-12 devstack@n-api.service[104132]: Accept-Encoding: gzip, deflate Aug 04 16:24:14.842909 n-d-846466-12 devstack@n-api.service[104132]: Connection: keep-alive Aug 04 16:24:14.842909 n-d-846466-12 devstack@n-api.service[104132]: Content-Length: 0 Aug 04 16:24:14.842909 n-d-846466-12 devstack@n-api.service[104132]: Host: 10.222.0.23 Aug 04 16:24:14.842909 n-d-846466-12 devstack@n-api.service[104132]: Openstack-Api-Version: compute 2.90 Aug 04 16:24:14.842909 n-d-846466-12 devstack@n-api.service[104132]: Openstack-System-Scope: None Aug 04 16:24:14.842909 n-d-846466-12 devstack@n-api.service[104132]: User-Agent: python-novaclient Aug 04 16:24:14.842909 n-d-846466-12 devstack@n-api.service[104132]: X-Auth-Token: gAAAAABi6_Ktn427MEGkG_WHhXAt0xkFoau-m-vQ2U8xTAk_z83zu6HeR_yQpu6csJXevdq1NGcoOCI-J9x5af07N-1MdbPxvoIlrrET28GxqX1CuDxvLYaFe4OSwHRfakXXZCOaebq-OiROunHl0N-99Zdu_fxqcUGJsPHFvKD6ZxyM32g5IGI Aug 04 16:24:14.842909 n-d-846466-12 devstack@n-api.service[104132]: X-Domain-Id: None Aug 04 16:24:14.842909 n-d-846466-12 devstack@n-api.service[104132]: X-Domain-Name: None Aug 04 16:24:14.842909 n-d-846466-12 devstack@n-api.service[104132]: X-Identity-Status: Confirmed Aug 04 16:24:14.842909 n-d-846466-12 devstack@n-api.service[104132]: X-Is-Admin-Project: True Aug 04 16:24:14.842909 n-d-846466-12 devstack@n-api.service[104132]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 16:24:14.842909 n-d-846466-12 devstack@n-api.service[104132]: X-Project-Domain-Id: default Aug 04 16:24:14.842909 n-d-846466-12 devstack@n-api.service[104132]: X-Project-Domain-Name: Default Aug 04 16:24:14.842909 n-d-846466-12 devstack@n-api.service[104132]: X-Project-Id: 382d33b4657f4a7ca22182927c23cf57 Aug 04 16:24:14.842909 n-d-846466-12 devstack@n-api.service[104132]: X-Project-Name: admin Aug 04 16:24:14.842909 n-d-846466-12 devstack@n-api.service[104132]: X-Role: member,reader,admin Aug 04 16:24:14.842909 n-d-846466-12 devstack@n-api.service[104132]: X-Roles: member,reader,admin Aug 04 16:24:14.844520 n-d-846466-12 devstack@n-api.service[104132]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/382d33b4657f4a7ca22182927c23cf57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_382d33b4657f4a7ca22182927c23cf57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/382d33b4657f4a7ca22182927c23cf57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/382d33b4657f4a7ca22182927c23cf57"}]}] Aug 04 16:24:14.844520 n-d-846466-12 devstack@n-api.service[104132]: X-Tenant: admin Aug 04 16:24:14.844520 n-d-846466-12 devstack@n-api.service[104132]: X-Tenant-Id: 382d33b4657f4a7ca22182927c23cf57 Aug 04 16:24:14.844520 n-d-846466-12 devstack@n-api.service[104132]: X-Tenant-Name: admin Aug 04 16:24:14.844520 n-d-846466-12 devstack@n-api.service[104132]: X-User: admin Aug 04 16:24:14.844520 n-d-846466-12 devstack@n-api.service[104132]: X-User-Domain-Id: default Aug 04 16:24:14.844520 n-d-846466-12 devstack@n-api.service[104132]: X-User-Domain-Name: Default Aug 04 16:24:14.844520 n-d-846466-12 devstack@n-api.service[104132]: X-User-Id: e8cfa7aae1b549988836e9d10bb68b2c Aug 04 16:24:14.844520 n-d-846466-12 devstack@n-api.service[104132]: X-User-Name: admin Aug 04 16:24:14.844520 n-d-846466-12 devstack@n-api.service[104132]: method: > Aug 04 16:24:14.844520 n-d-846466-12 devstack@n-api.service[104132]: exception: Flavor 451 could not be found. Aug 04 16:24:14.844520 n-d-846466-12 devstack@n-api.service[104132]: action_args: {'id': '451'} Aug 04 16:24:14.844520 n-d-846466-12 devstack@n-api.service[104132]: {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:24:14.844520 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:24:14.845604 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 16:24:14.845604 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 16:24:14.845604 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 16:24:14.845604 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 16:24:14.845604 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:24:14.845604 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:24:14.845604 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 16:24:14.845604 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 16:24:14.845604 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 16:24:14.845604 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:24:14.845604 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 16:24:14.845604 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 16:24:14.845604 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 04 16:24:14.845604 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi Aug 04 16:24:14.845604 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:24:14.845604 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi Aug 04 16:24:14.845604 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:24:14.845604 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:24:14.845604 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:24:14.846868 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:24:14.846868 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:24:14.846868 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:24:14.846868 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:24:14.846868 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 16:24:14.846868 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:24:14.846868 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 04 16:24:14.846868 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi Aug 04 16:24:14.846868 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:24:14.846868 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi Aug 04 16:24:14.846868 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:24:14.846868 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:24:14.846868 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:24:14.846868 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:24:14.846868 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:24:14.846868 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 04 16:24:14.846868 n-d-846466-12 devstack@n-api.service[104132]: ERROR nova.api.openstack.wsgi Aug 04 16:24:14.846868 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-5fca235f-5bab-4d02-8d11-ce76a80ca689 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:24:14.848199 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-5fca235f-5bab-4d02-8d11-ce76a80ca689 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.020107 Aug 04 16:24:14.848199 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 26/52] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Aug 4 16:24:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 16:24:15.877379 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-f648ea5b-61c0-41c6-95ca-acdff072827e admin admin] Calling method '>' {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:15.879226 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-f648ea5b-61c0-41c6-95ca-acdff072827e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002629 Aug 04 16:24:15.880018 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 27/53] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Aug 4 16:24:15 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:24:16.563233 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-e1948e6f-1601-47a6-8089-fccb04c50e76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:16.585095 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-e1948e6f-1601-47a6-8089-fccb04c50e76 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.559137 Aug 04 16:24:16.585684 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 27/54] 10.222.0.23 () {64 vars in 1235 bytes} [Thu Aug 4 16:24:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:24:17.977777 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-f648ea5b-61c0-41c6-95ca-acdff072827e admin admin] Calling method '>' {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:17.979595 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-f648ea5b-61c0-41c6-95ca-acdff072827e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002633 Aug 04 16:24:17.980327 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 28/55] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Aug 4 16:24:17 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:24:18.809569 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-65505774-40bd-49c6-a244-4e8367ce4912 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:18.833905 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-65505774-40bd-49c6-a244-4e8367ce4912 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.588146 Aug 04 16:24:18.834493 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 28/56] 10.222.0.23 () {64 vars in 1235 bytes} [Thu Aug 4 16:24:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 16:24:19.863139 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-f648ea5b-61c0-41c6-95ca-acdff072827e admin admin] Calling method '>' {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:19.864329 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-f648ea5b-61c0-41c6-95ca-acdff072827e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001640 Aug 04 16:24:19.864783 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 29/57] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Aug 4 16:24:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:24:20.500184 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-067be50d-0716-4956-9e25-b34282bd6777 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:20.526239 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-067be50d-0716-4956-9e25-b34282bd6777 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.521240 Aug 04 16:24:20.526692 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 29/58] 10.222.0.23 () {64 vars in 1235 bytes} [Thu Aug 4 16:24:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:24:21.548938 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-f648ea5b-61c0-41c6-95ca-acdff072827e admin admin] Calling method '>' {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:21.550058 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-f648ea5b-61c0-41c6-95ca-acdff072827e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001588 Aug 04 16:24:21.550506 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 30/59] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Aug 4 16:24:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:24:22.156972 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-1208b38a-ace0-4591-95d7-5e580243b20b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:24:22.179349 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-1208b38a-ace0-4591-95d7-5e580243b20b admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.489688 Aug 04 16:24:22.179910 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 30/60] 10.222.0.23 () {64 vars in 1235 bytes} [Thu Aug 4 16:24:21 2022] POST /compute/v2.1/flavors => generated 409 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:24:23.250068 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-f648ea5b-61c0-41c6-95ca-acdff072827e admin admin] Calling method '>' {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:23.251773 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-f648ea5b-61c0-41c6-95ca-acdff072827e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002501 Aug 04 16:24:23.252326 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 31/61] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Aug 4 16:24:23 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:24:23.817647 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-e43a4ba3-cff0-49c8-87d3-8e608d8a55bf admin admin] Calling method '>' {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:24:23.838918 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-e43a4ba3-cff0-49c8-87d3-8e608d8a55bf admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.446358 Aug 04 16:24:23.839465 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 31/62] 10.222.0.23 () {60 vars in 1202 bytes} [Thu Aug 4 16:24:23 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:25:20.940621 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-f648ea5b-61c0-41c6-95ca-acdff072827e admin admin] Calling method '>' {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:20.941605 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-f648ea5b-61c0-41c6-95ca-acdff072827e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Aug 04 16:25:20.942022 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 32/63] 10.222.0.23 () {54 vars in 931 bytes} [Thu Aug 4 16:25:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:25:20.953907 n-d-846466-12 devstack@n-api.service[104132]: DEBUG dbcounter [-] [104132] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=104132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:25:21.394030 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-fee63b71-61e7-48b3-b84b-74f174075938 admin admin] Calling method '>' {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:21.416258 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-fee63b71-61e7-48b3-b84b-74f174075938 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.467217 Aug 04 16:25:21.416888 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 32/64] 10.222.0.23 () {60 vars in 1292 bytes} [Thu Aug 4 16:25:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:25:21.438391 n-d-846466-12 devstack@n-api.service[104133]: DEBUG dbcounter [-] [104133] Writing DB stats nova_api:SELECT=14 {{(pid=104133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:25:21.442264 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-2dc0c72b-3f78-4f29-a745-657c335bd297 admin admin] Calling method '>' {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:21.451945 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-2dc0c72b-3f78-4f29-a745-657c335bd297 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013945 Aug 04 16:25:21.451945 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 33/65] 10.222.0.23 () {60 vars in 1283 bytes} [Thu Aug 4 16:25:21 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:25:21.467249 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-3ac644ad-186c-4ee1-b61a-fc923100f168 admin admin] Calling method '>' {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:21.481330 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-3ac644ad-186c-4ee1-b61a-fc923100f168 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.020356 Aug 04 16:25:21.482254 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 33/66] 10.222.0.23 () {60 vars in 1286 bytes} [Thu Aug 4 16:25:21 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:21.494472 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-d1bb8ccd-c47f-4b38-b512-5e2943885c26 admin admin] Calling method '>' {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:21.502598 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-d1bb8ccd-c47f-4b38-b512-5e2943885c26 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011746 Aug 04 16:25:21.503138 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 34/67] 10.222.0.23 () {60 vars in 1286 bytes} [Thu Aug 4 16:25:21 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:25:21.515511 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-767ce940-a339-4230-8f07-2f52bbae46e8 admin admin] Calling method '>' {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:25:21.524065 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-767ce940-a339-4230-8f07-2f52bbae46e8 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012374 Aug 04 16:25:21.524869 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 34/68] 10.222.0.23 () {60 vars in 1283 bytes} [Thu Aug 4 16:25:21 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:30:38.437743 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-d1bb8ccd-c47f-4b38-b512-5e2943885c26 admin admin] Calling method '>' {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:38.438736 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-d1bb8ccd-c47f-4b38-b512-5e2943885c26 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Aug 04 16:30:38.439131 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 35/69] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Aug 4 16:30:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:30:38.581245 n-d-846466-12 devstack@n-api.service[104132]: DEBUG dbcounter [-] [104132] Writing DB stats nova_api:SELECT=6 {{(pid=104132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:30:38.736919 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-06c1628f-a74b-4e2c-bb74-3eeac1c4d02c admin admin] Calling method '>' {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:38.739348 n-d-846466-12 devstack@n-api.service[104132]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:30:38.739348 n-d-846466-12 devstack@n-api.service[104132]: warnings.warn(msg) Aug 04 16:30:38.740612 n-d-846466-12 devstack@n-api.service[104132]: DEBUG oslo_concurrency.lockutils [None req-06c1628f-a74b-4e2c-bb74-3eeac1c4d02c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:30:38.741049 n-d-846466-12 devstack@n-api.service[104132]: DEBUG oslo_concurrency.lockutils [None req-06c1628f-a74b-4e2c-bb74-3eeac1c4d02c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=104132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:30:38.741860 n-d-846466-12 devstack@n-api.service[104132]: DEBUG oslo_concurrency.lockutils [None req-06c1628f-a74b-4e2c-bb74-3eeac1c4d02c admin admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:30:38.742284 n-d-846466-12 devstack@n-api.service[104132]: DEBUG oslo_concurrency.lockutils [None req-06c1628f-a74b-4e2c-bb74-3eeac1c4d02c admin admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:30:38.784143 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-06c1628f-a74b-4e2c-bb74-3eeac1c4d02c admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.204357 Aug 04 16:30:38.784661 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 35/70] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Aug 4 16:30:38 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:30:39.648994 n-d-846466-12 devstack@n-api.service[104133]: DEBUG nova.api.openstack.wsgi [None req-d1bb8ccd-c47f-4b38-b512-5e2943885c26 admin admin] Calling method '>' {{(pid=104133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:39.651856 n-d-846466-12 devstack@n-api.service[104133]: INFO nova.api.openstack.requestlog [None req-d1bb8ccd-c47f-4b38-b512-5e2943885c26 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003554 Aug 04 16:30:39.652591 n-d-846466-12 devstack@n-api.service[104133]: [pid: 104133|app: 0|req: 36/71] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Aug 4 16:30:39 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:30:39.848379 n-d-846466-12 devstack@n-api.service[104132]: DEBUG nova.api.openstack.wsgi [None req-d48fa862-a3eb-4111-9199-edc237098f0c admin admin] Calling method '>' {{(pid=104132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:30:39.850884 n-d-846466-12 devstack@n-api.service[104132]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:30:39.850884 n-d-846466-12 devstack@n-api.service[104132]: warnings.warn(msg) Aug 04 16:30:39.852101 n-d-846466-12 devstack@n-api.service[104132]: DEBUG oslo_concurrency.lockutils [None req-d48fa862-a3eb-4111-9199-edc237098f0c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:30:39.852538 n-d-846466-12 devstack@n-api.service[104132]: DEBUG oslo_concurrency.lockutils [None req-d48fa862-a3eb-4111-9199-edc237098f0c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:30:39.853418 n-d-846466-12 devstack@n-api.service[104132]: DEBUG oslo_concurrency.lockutils [None req-d48fa862-a3eb-4111-9199-edc237098f0c admin admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:30:39.853931 n-d-846466-12 devstack@n-api.service[104132]: DEBUG oslo_concurrency.lockutils [None req-d48fa862-a3eb-4111-9199-edc237098f0c admin admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:30:39.877492 n-d-846466-12 devstack@n-api.service[104132]: INFO nova.api.openstack.requestlog [None req-d48fa862-a3eb-4111-9199-edc237098f0c admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.085099 Aug 04 16:30:39.878068 n-d-846466-12 devstack@n-api.service[104132]: [pid: 104132|app: 0|req: 36/72] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Aug 4 16:30:39 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:31:24.875686 n-d-846466-12 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 04 16:31:24.876552 n-d-846466-12 devstack@n-api.service[104131]: Thu Aug 4 16:31:24 2022 - graceful shutdown triggered... Aug 04 16:31:24.877086 n-d-846466-12 devstack@n-api.service[104132]: Gracefully killing worker 1 (pid: 104132)... Aug 04 16:31:24.877660 n-d-846466-12 devstack@n-api.service[104133]: Gracefully killing worker 2 (pid: 104133)... Aug 04 16:31:25.876728 n-d-846466-12 devstack@n-api.service[104131]: worker 1 buried after 1 seconds Aug 04 16:31:25.876728 n-d-846466-12 devstack@n-api.service[104131]: worker 2 buried after 1 seconds Aug 04 16:31:25.876728 n-d-846466-12 devstack@n-api.service[104131]: goodbye to uWSGI. Aug 04 16:31:25.878367 n-d-846466-12 systemd[1]: devstack@n-api.service: Succeeded. Aug 04 16:31:25.878922 n-d-846466-12 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 04 16:31:25.881690 n-d-846466-12 systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 16:31:25.896189 n-d-846466-12 devstack@n-api.service[126112]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 16:31:25.912692 n-d-846466-12 devstack@n-api.service[126112]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 16:31:25 2022] *** Aug 04 16:31:25.912692 n-d-846466-12 devstack@n-api.service[126112]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 16:31:25.912692 n-d-846466-12 devstack@n-api.service[126112]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 16:31:25.912692 n-d-846466-12 devstack@n-api.service[126112]: nodename: n-d-846466-12 Aug 04 16:31:25.912692 n-d-846466-12 devstack@n-api.service[126112]: machine: x86_64 Aug 04 16:31:25.912692 n-d-846466-12 devstack@n-api.service[126112]: clock source: unix Aug 04 16:31:25.912692 n-d-846466-12 devstack@n-api.service[126112]: pcre jit disabled Aug 04 16:31:25.912692 n-d-846466-12 devstack@n-api.service[126112]: detected number of CPU cores: 4 Aug 04 16:31:25.912692 n-d-846466-12 devstack@n-api.service[126112]: current working directory: / Aug 04 16:31:25.912692 n-d-846466-12 devstack@n-api.service[126112]: detected binary path: /usr/bin/uwsgi-core Aug 04 16:31:25.912692 n-d-846466-12 devstack@n-api.service[126112]: your processes number limit is 47680 Aug 04 16:31:25.912692 n-d-846466-12 devstack@n-api.service[126112]: your memory page size is 4096 bytes Aug 04 16:31:25.912692 n-d-846466-12 devstack@n-api.service[126112]: detected max file descriptor number: 2048 Aug 04 16:31:25.912692 n-d-846466-12 devstack@n-api.service[126112]: lock engine: pthread robust mutexes Aug 04 16:31:25.913762 n-d-846466-12 devstack@n-api.service[126112]: thunder lock: enabled Aug 04 16:31:25.913762 n-d-846466-12 devstack@n-api.service[126112]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 16:31:25.913762 n-d-846466-12 devstack@n-api.service[126112]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 16:31:25.955775 n-d-846466-12 devstack@n-api.service[126112]: Python main interpreter initialized at 0x56094d6089c0 Aug 04 16:31:25.955775 n-d-846466-12 devstack@n-api.service[126112]: python threads support enabled Aug 04 16:31:25.955775 n-d-846466-12 devstack@n-api.service[126112]: your server socket listen backlog is limited to 100 connections Aug 04 16:31:25.955775 n-d-846466-12 devstack@n-api.service[126112]: your mercy for graceful operations on workers is 90 seconds Aug 04 16:31:25.956288 n-d-846466-12 devstack@n-api.service[126112]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 16:31:25.956288 n-d-846466-12 devstack@n-api.service[126112]: *** Operational MODE: preforking *** Aug 04 16:31:25.956523 n-d-846466-12 devstack@n-api.service[126112]: *** uWSGI is running in multiple interpreter mode *** Aug 04 16:31:25.956523 n-d-846466-12 devstack@n-api.service[126112]: spawned uWSGI master process (pid: 126112) Aug 04 16:31:25.956778 n-d-846466-12 systemd[1]: Started Devstack devstack@n-api.service. Aug 04 16:31:25.959041 n-d-846466-12 devstack@n-api.service[126112]: spawned uWSGI worker 1 (pid: 126125, cores: 1) Aug 04 16:31:25.959041 n-d-846466-12 devstack@n-api.service[126112]: spawned uWSGI worker 2 (pid: 126126, cores: 1) Aug 04 16:31:25.959041 n-d-846466-12 devstack@n-api.service[126112]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 16:31:26.623454 n-d-846466-12 devstack@n-api.service[126125]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 16:31:26.648419 n-d-846466-12 devstack@n-api.service[126126]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 16:31:27.807789 n-d-846466-12 devstack@n-api.service[126125]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 16:31:27.807789 n-d-846466-12 devstack@n-api.service[126125]: from cryptography.utils import int_from_bytes Aug 04 16:31:27.808780 n-d-846466-12 devstack@n-api.service[126125]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 16:31:27.808780 n-d-846466-12 devstack@n-api.service[126125]: from cryptography.utils import int_from_bytes Aug 04 16:31:27.821815 n-d-846466-12 devstack@n-api.service[126126]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 16:31:27.821815 n-d-846466-12 devstack@n-api.service[126126]: from cryptography.utils import int_from_bytes Aug 04 16:31:27.822968 n-d-846466-12 devstack@n-api.service[126126]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 16:31:27.822968 n-d-846466-12 devstack@n-api.service[126126]: from cryptography.utils import int_from_bytes Aug 04 16:31:30.129582 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 16:31:30.130216 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 16:31:30.130567 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 16:31:30.130763 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 16:31:30.130974 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 16:31:30.131364 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.131690 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.132025 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.132337 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.132664 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.132971 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.133439 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.133618 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.133921 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.134171 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.134489 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.134852 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-846466-12 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.135165 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.135467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.135765 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.136072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.136364 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.136674 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.137114 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.137511 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.138184 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.138496 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.138902 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.139251 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.139565 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.139869 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.140192 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.140501 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.140824 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.141129 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.141559 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-846466-12 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.141879 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.142190 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.142503 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.142939 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.143603 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.143880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.144174 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.144507 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.144796 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.145135 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.145476 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.145791 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.146106 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.146405 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.146707 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.147058 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.147328 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.147615 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.147923 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.148683 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.148836 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.149126 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.149422 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.149746 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.149999 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.153348 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.153348 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.153348 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.153348 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.153348 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.153348 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.153348 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.153945 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.153945 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.153945 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.153945 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.153945 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.153945 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.154542 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.154542 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.154775 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.155189 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.155439 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.155731 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.156496 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.156496 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.156718 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.157035 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.157714 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.157714 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.157969 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.158273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.158586 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.158918 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.159246 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.159582 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.159792 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.160063 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.160375 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.160679 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.160979 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.161308 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.161600 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.161908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.162209 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.162506 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.162806 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.163106 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.163408 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.163716 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.164018 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.164324 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.164644 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.164955 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.165258 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.165620 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.165963 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.166423 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.166712 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.166978 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.167264 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.167588 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.167899 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.168200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.168514 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.168818 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.169120 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.169466 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.169772 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.170071 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.170384 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.170688 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.170990 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.171289 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.171587 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.171889 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.172188 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.172484 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.172786 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.173081 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.173420 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.173747 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.174052 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.174355 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.174656 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.174976 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.175300 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.175702 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.175958 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.176448 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.176684 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.176891 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.177390 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.177625 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.177841 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.181313 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.181313 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.181313 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.181313 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.181313 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.181313 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.181313 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.181313 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.183101 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.183101 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.183101 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.183101 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.183101 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.183101 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.183101 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.184530 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.184530 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.184530 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.184530 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.184530 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.185675 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.185675 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.185675 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.185675 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.186520 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 16:31:30.186520 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 16:31:30.187416 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.187416 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.187821 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 16:31:30.188046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.188247 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 16:31:30.188477 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.188800 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 16:31:30.189005 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.189207 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.189438 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.189657 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.189874 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.190111 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.190312 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.190515 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.190716 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.190943 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.191160 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.191362 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.191570 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.191773 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.194921 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.195271 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.195501 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.195709 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.195943 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.196161 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.196378 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.196606 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.196812 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.197013 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-846466-12 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.197251 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.197486 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.197732 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.197963 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.198180 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.198380 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.198380 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.198790 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.199004 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.199230 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.199450 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.199653 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.199862 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.200060 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.200262 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.203163 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.203424 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.203690 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.203942 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.204181 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.204447 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.204671 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.204891 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.205099 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.206248 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.206472 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.206692 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.206909 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.207437 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.207670 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.207893 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.208127 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.208348 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.208562 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.211497 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.211771 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.211988 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-846466-12 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.212215 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.212441 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.212662 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.212948 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.213206 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.213439 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.213663 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.213663 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.214071 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.214280 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.214482 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.214690 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.214926 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.215142 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.215352 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.215651 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.215857 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.216085 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.216283 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.216505 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.216719 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.216929 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.217131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.219452 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.219745 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.220016 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.220533 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.220749 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.220954 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.221176 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.221598 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.221819 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.222022 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.222022 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.222022 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.222602 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.222834 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.223715 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.223931 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.225099 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.225387 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.225872 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.226077 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.227244 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.227469 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.227575 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.227687 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.227796 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.227887 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.227887 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.228060 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.228149 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.228244 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.228446 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.228546 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.228629 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.228832 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.229038 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.229648 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.229750 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.229849 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.229945 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.230041 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.230129 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.230225 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.230320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.230433 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.230551 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.230672 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.230786 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.230882 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.230974 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.231068 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.231143 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.231230 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.231310 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.231394 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.231495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.231594 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.231676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.231756 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.231756 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.231894 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.231894 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.232063 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.232158 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.232245 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.232337 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.232437 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.232525 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.232614 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.232702 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.232796 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.232888 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.232985 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.233073 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.233167 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.233261 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.233369 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.233444 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.233607 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.233708 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.233708 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.233878 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.233972 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.234067 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.234176 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.234275 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.234370 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.234468 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.234561 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.234561 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.234725 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.234811 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.234896 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.234984 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.235078 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.235177 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.235265 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.235350 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.235430 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.235521 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.235610 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.235708 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.235799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.235873 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.235954 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.236029 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.236106 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.236196 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.236277 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.236357 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.236432 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.236512 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.236592 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.236676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.236750 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.236828 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.236908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.236989 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.237083 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.237158 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.237237 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.239584 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.239704 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.239791 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.239895 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.239979 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.240062 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.240136 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.240224 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.240314 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.240396 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.240484 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.240622 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.240729 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.240814 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.240912 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.241010 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.241119 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.241208 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.241403 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.241490 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.241563 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.241690 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.241786 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.241889 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.241986 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.241986 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.241986 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.241986 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.242276 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.242377 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.242477 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.242571 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.242657 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.242781 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.242781 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.242781 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.243024 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.243118 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.243214 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.243302 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.243394 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.243492 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.243587 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.243673 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.243766 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.243898 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.244042 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.244144 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.244357 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.244943 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.245033 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.245109 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.245192 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.245274 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.245388 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.245464 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.245544 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.245628 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.245719 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.245801 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:31:30.245801 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.247917 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.248051 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.248051 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.248226 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.248310 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.248392 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.248466 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.248546 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.249412 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.249509 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.249584 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.249665 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.249755 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.249755 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.249912 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.249988 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.250115 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.250202 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.250284 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.250366 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.250366 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.250521 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.250604 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.250604 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.250742 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.250824 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.250911 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.250994 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.251069 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.251140 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.251220 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.251311 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.251394 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.251468 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.251547 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.251620 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.251700 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.251788 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.251863 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.251934 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.252013 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.252087 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.253488 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.253591 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.253669 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.253751 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.253832 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.253908 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.253980 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.254068 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.254151 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.254225 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.254305 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.254379 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.254467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.254542 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.254621 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.254694 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.254765 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.254845 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.254932 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.255015 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.255089 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.255160 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.255232 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.255303 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.255385 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.255459 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.255530 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.255602 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.255682 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.255762 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.255850 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.255938 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.256010 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.256090 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.256163 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.256375 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.256454 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.256527 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.256599 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.256670 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.256748 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.256841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.256841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.256996 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.257070 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.257070 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.257230 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.259109 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.259109 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.259314 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.259391 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.259475 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.259557 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.260210 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.261254 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.261372 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.261467 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.261545 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.261618 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.261690 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.261771 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.261845 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.261932 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.262015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.262103 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.262178 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.262258 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.262363 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.262468 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.262563 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.262679 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.262766 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.262841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.262912 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.262998 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.263072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.263143 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.263222 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.263302 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.263388 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.263388 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.263388 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.263388 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.263659 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.263739 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.263821 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.263901 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.263981 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.264054 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.264054 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.264210 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.264293 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.265429 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.265543 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.265621 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.265701 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.265785 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.265874 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.265957 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.266031 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.266109 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.266183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.266264 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.266264 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.266406 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.266486 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.266559 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.266630 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.266630 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.266630 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.266630 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.266630 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.266964 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.267036 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.267122 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.267196 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.267275 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.267355 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.267435 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.267519 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.267593 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.267674 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.267674 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.267813 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.267893 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.267893 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.267893 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.267893 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.268157 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.269121 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.269223 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.269336 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.269428 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.269511 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.269595 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.269676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.269757 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.269848 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.269929 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.269929 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.270076 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.270157 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.270229 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.270313 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.270386 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.270466 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.270539 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.270618 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.270704 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.270786 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.270866 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.270947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.271020 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.271091 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.271175 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.271248 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.271319 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.271319 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.271453 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.271532 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.271532 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.271680 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.271753 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.271832 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.271911 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.271989 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.272074 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.272147 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.272218 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.272297 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.272377 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.272464 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.272538 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.272616 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.272753 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.272877 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.272992 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.273119 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.273242 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.273380 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.273495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.273620 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.273735 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.273859 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.273980 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.274094 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.274213 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.274327 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.274439 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.274581 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.275321 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.275477 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.275753 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.275975 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.276536 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.276697 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.276825 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.276978 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.277118 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.277257 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.277420 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.277565 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.277724 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.277918 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.278050 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.278203 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.278944 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.279093 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.279234 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.279374 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.279505 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.279647 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.279786 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.279927 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.280056 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.280186 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.280324 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.280470 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.280609 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.280739 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.280870 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.280999 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.281128 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.281128 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.281454 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.281595 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.281595 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.282427 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.282571 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.282711 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.282848 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.282987 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.283115 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.283243 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.283380 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.283518 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.283655 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.283784 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.283912 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.284056 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.284195 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.284326 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.284454 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.284581 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.284748 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.285550 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.285700 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.285840 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.285971 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.286102 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.286230 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.286370 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.286501 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.286631 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.286761 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.286890 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.287027 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.287757 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.287876 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.288016 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.288156 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.288298 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.288428 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.288428 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.288641 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.288762 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.288886 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.289009 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.289125 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.289239 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.289381 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.289619 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.289773 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.289929 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.290084 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.290231 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.290377 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.290545 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.290701 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.290980 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.291144 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.291930 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.292093 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.292243 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.292390 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.292554 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.292702 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.292896 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.293048 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.293204 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.293204 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.293751 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.293899 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.294045 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.294045 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.294045 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.294473 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.294473 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.294761 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.294916 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.295642 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.295798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.295956 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.296118 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.296264 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.296264 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.296551 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.296712 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.296859 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.297018 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.297166 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.297166 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.297588 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.297758 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.297908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.298067 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.298222 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.298378 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.298524 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.298681 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.298837 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.298991 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.299152 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.299307 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.299462 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.299623 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.299771 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.299923 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.300048 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.300163 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.300163 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.300390 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.300390 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.300390 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.300722 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.300940 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.301102 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.301204 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.301415 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.301528 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.301528 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.301742 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.301867 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.301999 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.302091 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.302177 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.302262 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.302356 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.302487 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.302610 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.302610 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.302803 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.302978 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.302978 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.303187 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.303276 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.303365 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.303460 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.303460 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.303712 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.303712 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.303928 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.304026 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.304154 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.304154 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.304393 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.304531 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.304662 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.304759 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.304892 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.304984 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.305070 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.305155 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.305268 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.305409 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.305514 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.305903 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.306052 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.306191 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.306322 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.306543 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.306758 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.306970 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.307162 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.307322 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.307494 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.307494 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.307494 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.307951 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.308088 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.308243 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.308383 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.308524 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.308664 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.308765 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.308890 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.309011 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.309145 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.309262 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.309524 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.309648 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.309773 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.309903 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.310048 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.310179 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.310310 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.310436 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.310583 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.310713 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.310857 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.311597 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.311708 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.311798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.311798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.311981 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.312117 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.312117 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.312323 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.312415 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.312553 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.312659 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.312799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.312891 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.312989 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.313085 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.313224 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.313351 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.313443 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.313529 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.313660 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.313758 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.313858 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.314004 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.314135 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.314226 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.314308 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.314403 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.314500 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.314587 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.314680 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.314819 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.314958 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.315094 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.315201 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.315290 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.315426 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.315526 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.315623 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.315711 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.315847 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.315963 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.316063 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.316159 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.316256 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.316591 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.316699 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.316846 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.316987 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.317088 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.317176 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.317272 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.317422 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.317516 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.317615 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.317712 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.317712 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.317966 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.318063 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.318157 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.318253 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.318347 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.318488 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.318595 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.318690 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.318778 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.318870 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.318870 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.319087 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.319185 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.319281 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.319409 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.319504 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.319621 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.319724 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.319813 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.319813 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.319979 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.320072 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.320167 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.320268 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.320356 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.320449 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.320544 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.320639 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.320726 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.320826 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.320921 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.321054 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.321144 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.321238 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.321238 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.321453 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.321550 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.321682 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.321773 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.321866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.321963 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.322193 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.322352 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.322507 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.322626 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.322775 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.322977 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.323461 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.323561 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.323649 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.323786 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.323877 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.323974 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.324074 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.324201 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.324314 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.324438 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.324563 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.324674 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.324771 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.324866 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.324954 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.325049 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.325136 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.325261 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.325399 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.325521 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.325665 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.325800 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.325896 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.325983 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.326077 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.326163 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.326295 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.326424 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.326781 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.326878 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.326878 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.327056 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.327203 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.327306 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.327401 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.327495 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.327582 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.327674 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.327769 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.327769 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.327940 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.328028 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.328028 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.328202 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.328297 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.328391 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.328486 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.328573 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.328658 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.328750 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.328853 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.328949 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.329043 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.329137 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.329224 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.329354 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.329485 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.329578 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.329716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.329809 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.329895 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.329995 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.330090 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.330186 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.330273 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.330358 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.330442 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.330535 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.330622 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.330754 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.330852 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.330947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.331042 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.331130 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.331248 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.331387 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.331547 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.331644 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.331859 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.332050 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.332203 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.332335 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.332473 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.332598 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.332738 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.332876 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.333143 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.333294 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.333500 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.333773 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.333930 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.334083 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.334225 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.334402 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.334560 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.334736 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.334892 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.335034 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.335185 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.335399 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.335553 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.335734 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.335923 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.336062 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.336198 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.336349 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.336517 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.336658 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.336828 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.336963 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.337114 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.337258 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.337555 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.337694 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.337888 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.338026 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.338173 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.338313 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.338450 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.338760 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.338914 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.339057 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.339206 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.339382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.339602 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.339748 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.339888 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.340027 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.340176 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.340539 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.340717 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.340717 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.341001 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.341152 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.341332 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.341495 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.341639 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.341792 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.342037 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.342209 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.342353 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.342504 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.342678 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.342814 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.342970 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.343119 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.343450 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.343650 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.343650 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.343923 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.344070 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.344250 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.344404 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.344594 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.344594 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.344894 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.345130 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.345130 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.345431 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.345568 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.345705 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.345839 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.346021 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.346185 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.346333 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.346460 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.346603 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.346750 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.346951 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.347135 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.347306 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.347453 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.347650 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.347815 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.348004 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.348148 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.348374 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.348509 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.348639 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.348779 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.348916 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.352488 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.352649 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.352798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.352943 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.353097 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.353253 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.353638 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.353865 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.354054 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.354230 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.354417 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.354592 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.354780 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.355055 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.355239 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.355434 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.355576 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.355712 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.355846 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.355992 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.356191 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.356383 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.356533 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.356728 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.356870 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.357002 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.357002 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.357402 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.357560 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.357712 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.357894 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.358079 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.358262 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.358445 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.358641 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.358641 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.358988 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.359164 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.359339 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.359484 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.359484 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.359755 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.359755 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.360071 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.360241 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.360415 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.360608 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.360774 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.360971 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.361162 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.361368 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.361552 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.361758 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.361907 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.362054 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.362189 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.362332 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.362467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.362608 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.362744 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.362887 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.363034 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.363172 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.363309 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.363444 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.363444 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.363743 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.363905 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.364055 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.364280 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.364431 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.364579 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.364715 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.364843 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.364986 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.365201 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.365473 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.365621 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.365764 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.365915 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.366064 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.366246 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.366469 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.366635 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.366790 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.366943 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.367110 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.367310 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.367457 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.367639 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.367780 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.367920 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.368213 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.368348 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.368542 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.368739 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.368882 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.369102 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.369252 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.369504 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.369504 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.369816 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.369998 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.370177 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.370332 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.370478 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.370478 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.370733 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.370733 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.371002 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.371149 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.371298 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.371443 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.371590 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.371723 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.371877 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.372027 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.372183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.372337 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.372493 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.372642 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.372810 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.373046 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.373190 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.373399 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.373565 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.373725 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.373884 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.374033 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.374165 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.374293 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.374432 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.374591 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.374733 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.374872 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.375010 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.375153 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.375349 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.375349 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.375680 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.375900 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.376092 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.376276 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.376483 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.376680 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.376877 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.377038 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.377179 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.377340 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.377555 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.377702 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.377892 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.378044 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.378186 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.378378 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.378536 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.378731 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.378884 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.379026 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.379180 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.379340 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.379480 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.379752 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.379919 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.380070 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.380211 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.380366 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.380520 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.380659 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.380798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.380939 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.381079 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.381234 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.381401 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.381541 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.381708 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.381846 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.381998 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.382158 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.382298 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.382436 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.410770 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.411090 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.411242 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.411414 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.411644 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.412007 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.412207 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.412613 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.412809 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.412975 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.413207 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.413411 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.413634 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.413872 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.414000 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.414186 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.414395 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.414566 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.414744 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.414936 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.415185 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.415421 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.415618 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.415882 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.416351 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.416491 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.416676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.416778 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.416873 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.416968 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.417093 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.417222 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.417377 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.417492 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.417605 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.417729 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.417729 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.418024 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.418259 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.418400 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.418516 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.418635 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.418807 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.419015 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.419015 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.419313 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.419485 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.419667 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.419806 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.420006 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.420150 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.420344 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.420531 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.420765 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.420957 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.421221 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.421583 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.421905 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.421905 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.422419 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.422419 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.422419 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.422419 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.422419 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.423817 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.424092 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.424297 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.424573 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.424898 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.424898 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.425564 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.425983 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.426376 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.426627 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.426880 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.427066 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.427158 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.427231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.427400 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.427550 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.427698 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.427830 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.427917 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.428011 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.428158 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.428292 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.428442 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.428559 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.428689 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.428810 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.428955 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.428955 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.429170 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.429275 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.429454 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.429552 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.429680 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.429784 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.429912 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.430050 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.430242 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.430327 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.430437 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.430514 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.430585 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.430736 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.430814 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.430896 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.430970 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.431041 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.431113 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.431183 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.431253 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.431360 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.431620 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.431709 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.431781 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.431895 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.431958 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.432016 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.432130 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.432211 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.432272 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.432331 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.432389 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.432389 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.432389 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.432389 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.432596 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.432664 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.432840 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.432923 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.433005 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.433079 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.433150 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.433221 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.433221 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 16:31:30.433465 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.433465 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.433465 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.433465 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.433465 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.433465 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.433465 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.433465 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.433958 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.433958 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.433958 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.433958 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.433958 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.433958 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.433958 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.433958 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.434498 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.434498 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.434498 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.434498 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.434498 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.434498 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.434498 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.434498 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.435130 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.435130 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.435130 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.435130 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.435130 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.435130 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.435130 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.435130 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.435614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.435614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.435614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.435614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.435614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.435614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.435614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.435614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.436183 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.436183 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.436183 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.436183 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.436183 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.436183 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.436183 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.436183 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.436667 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.436667 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.436667 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.436667 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.436667 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.436667 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.436667 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.436667 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.437358 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.437358 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.437358 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.437358 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.437358 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.437358 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.437358 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.437358 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.437940 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.437940 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.437940 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.437940 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.437940 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.437940 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.437940 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.437940 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.449175 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.449175 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.449175 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.449175 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.449175 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.449175 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.449175 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.449175 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.450171 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.450171 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.450171 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.450171 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.450171 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.450171 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.450171 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.450171 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.450798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.450798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.450798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.450798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.450798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.450798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.450798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.450798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.451447 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.451447 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.451447 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.451447 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.451447 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.451447 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.451447 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.451447 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.452186 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.452186 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.452186 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.452186 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.452186 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.452186 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.452186 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.452186 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.452874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.452874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.452874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.452874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.452874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.452874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.452874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.452874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.453462 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.453462 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.453462 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.453462 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.453462 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.453462 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.453462 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.453462 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.454103 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.454103 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.454103 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.454103 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.454103 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.454103 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.454103 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.454103 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.454585 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.454585 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.454585 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.454585 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:31:30.454585 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 16:31:30.557825 n-d-846466-12 devstack@n-api.service[126125]: INFO dbcounter [None req-c191a1b4-b9dd-4e85-bbd0-7821b703bba5 None None] Registered counter for database nova_api Aug 04 16:31:30.578678 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_db.sqlalchemy.engines [None req-c191a1b4-b9dd-4e85-bbd0-7821b703bba5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126125) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:31:30.585801 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writer thread running {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 16:31:30.604921 n-d-846466-12 devstack@n-api.service[126126]: INFO dbcounter [None req-25c28f3c-90d0-4966-8e1b-5fd1ff7bc369 None None] Registered counter for database nova_api Aug 04 16:31:30.625818 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_db.sqlalchemy.engines [None req-25c28f3c-90d0-4966-8e1b-5fd1ff7bc369 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126126) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:31:30.633415 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writer thread running {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 16:31:30.644488 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.context [None req-c191a1b4-b9dd-4e85-bbd0-7821b703bba5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e056d029-674a-446e-ac9e-5108621d9db2(cell1) {{(pid=126125) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 16:31:30.648675 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c191a1b4-b9dd-4e85-bbd0-7821b703bba5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:31:30.650433 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c191a1b4-b9dd-4e85-bbd0-7821b703bba5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:31:30.651363 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c191a1b4-b9dd-4e85-bbd0-7821b703bba5 None None] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:31:30.653440 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c191a1b4-b9dd-4e85-bbd0-7821b703bba5 None None] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:31:30.655493 n-d-846466-12 devstack@n-api.service[126125]: INFO dbcounter [None req-c191a1b4-b9dd-4e85-bbd0-7821b703bba5 None None] Registered counter for database nova_cell0 Aug 04 16:31:30.659795 n-d-846466-12 devstack@n-api.service[126125]: INFO dbcounter [None req-c191a1b4-b9dd-4e85-bbd0-7821b703bba5 None None] Registered counter for database nova_cell1 Aug 04 16:31:30.667512 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_db.sqlalchemy.engines [None req-c191a1b4-b9dd-4e85-bbd0-7821b703bba5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126125) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:31:30.670048 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_db.sqlalchemy.engines [None req-c191a1b4-b9dd-4e85-bbd0-7821b703bba5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126125) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:31:30.677195 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writer thread running {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 16:31:30.679970 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writer thread running {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 16:31:30.692202 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.context [None req-25c28f3c-90d0-4966-8e1b-5fd1ff7bc369 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e056d029-674a-446e-ac9e-5108621d9db2(cell1) {{(pid=126126) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 16:31:30.696361 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-25c28f3c-90d0-4966-8e1b-5fd1ff7bc369 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:31:30.698049 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-25c28f3c-90d0-4966-8e1b-5fd1ff7bc369 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:31:30.698849 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-25c28f3c-90d0-4966-8e1b-5fd1ff7bc369 None None] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:31:30.700880 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-25c28f3c-90d0-4966-8e1b-5fd1ff7bc369 None None] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:31:30.702919 n-d-846466-12 devstack@n-api.service[126126]: INFO dbcounter [None req-25c28f3c-90d0-4966-8e1b-5fd1ff7bc369 None None] Registered counter for database nova_cell0 Aug 04 16:31:30.707152 n-d-846466-12 devstack@n-api.service[126126]: INFO dbcounter [None req-25c28f3c-90d0-4966-8e1b-5fd1ff7bc369 None None] Registered counter for database nova_cell1 Aug 04 16:31:30.716657 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_db.sqlalchemy.engines [None req-25c28f3c-90d0-4966-8e1b-5fd1ff7bc369 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126126) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:31:30.717678 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_db.sqlalchemy.engines [None req-25c28f3c-90d0-4966-8e1b-5fd1ff7bc369 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126126) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:31:30.724170 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writer thread running {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 16:31:30.726677 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writer thread running {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 16:31:30.829206 n-d-846466-12 devstack@n-api.service[126125]: INFO dbcounter [None req-c191a1b4-b9dd-4e85-bbd0-7821b703bba5 None None] Registered counter for database nova_cell0 Aug 04 16:31:30.837072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_db.sqlalchemy.engines [None req-c191a1b4-b9dd-4e85-bbd0-7821b703bba5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126125) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:31:30.842138 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writer thread running {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 16:31:30.871796 n-d-846466-12 devstack@n-api.service[126126]: INFO dbcounter [None req-25c28f3c-90d0-4966-8e1b-5fd1ff7bc369 None None] Registered counter for database nova_cell0 Aug 04 16:31:30.879177 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_db.sqlalchemy.engines [None req-25c28f3c-90d0-4966-8e1b-5fd1ff7bc369 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126126) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:31:30.884212 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writer thread running {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 16:31:31.164716 n-d-846466-12 devstack@n-api.service[126125]: WARNING keystonemiddleware.auth_token [None req-c191a1b4-b9dd-4e85-bbd0-7821b703bba5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 16:31:31.172155 n-d-846466-12 devstack@n-api.service[126125]: WARNING keystonemiddleware.auth_token [None req-c191a1b4-b9dd-4e85-bbd0-7821b703bba5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 16:31:31.205668 n-d-846466-12 devstack@n-api.service[126126]: WARNING keystonemiddleware.auth_token [None req-25c28f3c-90d0-4966-8e1b-5fd1ff7bc369 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 16:31:31.213156 n-d-846466-12 devstack@n-api.service[126126]: WARNING keystonemiddleware.auth_token [None req-25c28f3c-90d0-4966-8e1b-5fd1ff7bc369 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 16:31:31.522586 n-d-846466-12 devstack@n-api.service[126125]: WARNING keystonemiddleware.auth_token [None req-c191a1b4-b9dd-4e85-bbd0-7821b703bba5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 16:31:31.528592 n-d-846466-12 devstack@n-api.service[126125]: WARNING keystonemiddleware.auth_token [None req-c191a1b4-b9dd-4e85-bbd0-7821b703bba5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 16:31:31.535192 n-d-846466-12 devstack@n-api.service[126125]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56094d6089c0 pid: 126125 (default app) Aug 04 16:31:31.557832 n-d-846466-12 devstack@n-api.service[126126]: WARNING keystonemiddleware.auth_token [None req-25c28f3c-90d0-4966-8e1b-5fd1ff7bc369 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 16:31:31.563872 n-d-846466-12 devstack@n-api.service[126126]: WARNING keystonemiddleware.auth_token [None req-25c28f3c-90d0-4966-8e1b-5fd1ff7bc369 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 16:31:31.570049 n-d-846466-12 devstack@n-api.service[126126]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56094d6089c0 pid: 126126 (default app) Aug 04 16:32:12.047116 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:32:12.049425 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:32:12.051012 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:32:12.052414 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:32:13.667697 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-aae54f65-a05e-4a6c-b5e8-a9ff4c4922d0 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Calling method '.version_select at 0x7f7e874a0dc0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:13.689669 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:13.689669 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:32:13.713627 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:32:13.714457 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:32:13.716550 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:32:13.717354 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:32:13.718751 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-aae54f65-a05e-4a6c-b5e8-a9ff4c4922d0 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e056d029-674a-446e-ac9e-5108621d9db2(cell1) {{(pid=126125) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 04 16:32:13.741702 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aae54f65-a05e-4a6c-b5e8-a9ff4c4922d0 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:13.742639 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aae54f65-a05e-4a6c-b5e8-a9ff4c4922d0 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:13.826416 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aae54f65-a05e-4a6c-b5e8-a9ff4c4922d0 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:13.829169 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aae54f65-a05e-4a6c-b5e8-a9ff4c4922d0 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:13.880888 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aae54f65-a05e-4a6c-b5e8-a9ff4c4922d0 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:13.880888 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aae54f65-a05e-4a6c-b5e8-a9ff4c4922d0 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:13.888893 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-aae54f65-a05e-4a6c-b5e8-a9ff4c4922d0 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 1.860127 Aug 04 16:32:13.902012 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1/1] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:32:12 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 1867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:13.907858 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5f1d3eed-2e56-4502-9fa2-08e50d175d08 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Calling method '.version_select at 0x7f7e873ec1f0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:13.910702 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:13.910702 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:32:13.913457 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5f1d3eed-2e56-4502-9fa2-08e50d175d08 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:13.913913 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5f1d3eed-2e56-4502-9fa2-08e50d175d08 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:13.952999 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5f1d3eed-2e56-4502-9fa2-08e50d175d08 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:13.953693 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5f1d3eed-2e56-4502-9fa2-08e50d175d08 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:13.981237 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5f1d3eed-2e56-4502-9fa2-08e50d175d08 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:13.981983 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5f1d3eed-2e56-4502-9fa2-08e50d175d08 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:13.991399 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5f1d3eed-2e56-4502-9fa2-08e50d175d08 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.087056 Aug 04 16:32:13.992805 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2/2] 10.222.0.23 () {58 vars in 1167 bytes} [Thu Aug 4 16:32:13 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:32:14.010624 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-329f2784-f7be-4adb-9110-87329fdaef23 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Calling method '.version_select at 0x7f7e87361940>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:14.012080 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:14.012080 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:32:14.013816 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-329f2784-f7be-4adb-9110-87329fdaef23 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:14.014459 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-329f2784-f7be-4adb-9110-87329fdaef23 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:14.030711 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-329f2784-f7be-4adb-9110-87329fdaef23 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:14.031168 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-329f2784-f7be-4adb-9110-87329fdaef23 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:14.064480 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-329f2784-f7be-4adb-9110-87329fdaef23 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:14.064933 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-329f2784-f7be-4adb-9110-87329fdaef23 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:14.072272 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-329f2784-f7be-4adb-9110-87329fdaef23 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.066761 Aug 04 16:32:14.073426 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3/3] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:32:14 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:32:14.819695 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e102693c-b0c9-44c8-badb-425b5542b82a tempest-AggregatesAdminTestV241-205209225 tempest-AggregatesAdminTestV241-205209225-project-admin] Calling method '.version_select at 0x7f7e873ec790>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:14.828733 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:14.828733 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:32:14.832286 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e102693c-b0c9-44c8-badb-425b5542b82a tempest-AggregatesAdminTestV241-205209225 tempest-AggregatesAdminTestV241-205209225-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:14.837155 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e102693c-b0c9-44c8-badb-425b5542b82a tempest-AggregatesAdminTestV241-205209225 tempest-AggregatesAdminTestV241-205209225-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:14.878478 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e102693c-b0c9-44c8-badb-425b5542b82a tempest-AggregatesAdminTestV241-205209225 tempest-AggregatesAdminTestV241-205209225-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:14.880242 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e102693c-b0c9-44c8-badb-425b5542b82a tempest-AggregatesAdminTestV241-205209225 tempest-AggregatesAdminTestV241-205209225-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:14.909513 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e102693c-b0c9-44c8-badb-425b5542b82a tempest-AggregatesAdminTestV241-205209225 tempest-AggregatesAdminTestV241-205209225-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:14.910514 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e102693c-b0c9-44c8-badb-425b5542b82a tempest-AggregatesAdminTestV241-205209225 tempest-AggregatesAdminTestV241-205209225-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:14.932152 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e102693c-b0c9-44c8-badb-425b5542b82a tempest-AggregatesAdminTestV241-205209225 tempest-AggregatesAdminTestV241-205209225-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.857133 Aug 04 16:32:14.933235 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 4/4] 10.222.0.23 () {60 vars in 1208 bytes} [Thu Aug 4 16:32:14 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:32:14.937923 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-06759610-6576-4422-bbc0-064f08c5a9dc tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Calling method '.version_select at 0x7f7e87361b80>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:14.939056 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:14.939056 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:32:14.945136 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-06759610-6576-4422-bbc0-064f08c5a9dc tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:14.946303 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-06759610-6576-4422-bbc0-064f08c5a9dc tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:14.979080 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-06759610-6576-4422-bbc0-064f08c5a9dc tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:14.980751 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-06759610-6576-4422-bbc0-064f08c5a9dc tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:15.005972 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-06759610-6576-4422-bbc0-064f08c5a9dc tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 759 microversion: 2.1 time: 0.061097 Aug 04 16:32:15.005972 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 5/5] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Aug 4 16:32:14 2022] GET /compute/v2.1/os-hypervisors/1 => generated 759 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:15.222413 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f030cb2d-5ee0-422b-9970-2cfdfdbba98f tempest-FlavorMetadataValidation-1499721141 tempest-FlavorMetadataValidation-1499721141-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1590828930", "id": 852546029, "os-flavor-access:is_public": "True"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:15.259483 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:15.259483 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:32:15.323081 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f030cb2d-5ee0-422b-9970-2cfdfdbba98f tempest-FlavorMetadataValidation-1499721141 tempest-FlavorMetadataValidation-1499721141-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.86 time: 0.323473 Aug 04 16:32:15.329377 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 6/6] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Aug 4 16:32:14 2022] POST /compute/v2.1/flavors => generated 468 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:32:15.575918 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8430c0ca-a6e4-42d1-ac99-b7e18fa623f8 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Calling method '.version_select at 0x7f7e8749fd30>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:15.578933 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:15.578933 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:32:15.582344 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c3cc1118-8eec-4f20-8061-f9859d8f934f tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:15.586574 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:15.586574 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:32:15.588734 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3cc1118-8eec-4f20-8061-f9859d8f934f tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:15.589401 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3cc1118-8eec-4f20-8061-f9859d8f934f tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:15.591835 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3cc1118-8eec-4f20-8061-f9859d8f934f tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:15.592515 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3cc1118-8eec-4f20-8061-f9859d8f934f tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:15.596181 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8430c0ca-a6e4-42d1-ac99-b7e18fa623f8 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e056d029-674a-446e-ac9e-5108621d9db2(cell1) {{(pid=126126) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 04 16:32:15.597546 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8430c0ca-a6e4-42d1-ac99-b7e18fa623f8 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:15.598522 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8430c0ca-a6e4-42d1-ac99-b7e18fa623f8 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:15.654050 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8430c0ca-a6e4-42d1-ac99-b7e18fa623f8 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:15.654680 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8430c0ca-a6e4-42d1-ac99-b7e18fa623f8 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:15.669905 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8430c0ca-a6e4-42d1-ac99-b7e18fa623f8 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:15.670570 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8430c0ca-a6e4-42d1-ac99-b7e18fa623f8 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:15.681317 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8430c0ca-a6e4-42d1-ac99-b7e18fa623f8 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 1.974201 Aug 04 16:32:15.682383 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1/7] 10.222.0.23 () {58 vars in 1167 bytes} [Thu Aug 4 16:32:13 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 1977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:15.691387 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c3cc1118-8eec-4f20-8061-f9859d8f934f tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.360603 Aug 04 16:32:15.698970 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 7/8] 10.222.0.23 () {58 vars in 1176 bytes} [Thu Aug 4 16:32:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:15.715221 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4b75b93f-da97-4c85-9d6b-2e31e037e878 tempest-AggregatesAdminTestV241-205209225 tempest-AggregatesAdminTestV241-205209225-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-789614242"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:15.721814 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:15.721814 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:32:15.726325 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.aggregate [None req-4b75b93f-da97-4c85-9d6b-2e31e037e878 tempest-AggregatesAdminTestV241-205209225 tempest-AggregatesAdminTestV241-205209225-project-admin] Generated uuid eae5fe0d-b11c-43fd-90e9-8666e4f7d150 for aggregate {{(pid=126125) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:32:15.874393 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4b75b93f-da97-4c85-9d6b-2e31e037e878 tempest-AggregatesAdminTestV241-205209225 tempest-AggregatesAdminTestV241-205209225-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.170446 Aug 04 16:32:15.877554 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 8/9] 10.222.0.23 () {62 vars in 1205 bytes} [Thu Aug 4 16:32:15 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:32:15.888191 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-758b4991-cc32-4d5d-a317-71b37c286c2d tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Calling method '.version_select at 0x7f7e8725edc0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:15.890143 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:15.890143 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:32:15.893336 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-758b4991-cc32-4d5d-a317-71b37c286c2d tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:15.894517 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-758b4991-cc32-4d5d-a317-71b37c286c2d tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:15.936290 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-758b4991-cc32-4d5d-a317-71b37c286c2d tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.055813 Aug 04 16:32:15.937152 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 9/10] 10.222.0.23 () {58 vars in 1179 bytes} [Thu Aug 4 16:32:15 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:15.943991 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5660c666-bbd3-4451-a1c9-61322e6fd3af tempest-FlavorMetadataValidation-1499721141 tempest-FlavorMetadataValidation-1499721141-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:15.948210 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:15.948210 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:32:15.985969 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2ac464b7-1f7c-4b3f-956c-e602fa3336f6 tempest-FlavorsV261TestJSON-1822891821 tempest-FlavorsV261TestJSON-1822891821-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-193706937", "id": 1586587898, "os-flavor-access:is_public": "True"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:16.036281 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:16.036281 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:32:16.118059 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2ac464b7-1f7c-4b3f-956c-e602fa3336f6 tempest-FlavorsV261TestJSON-1822891821 tempest-FlavorsV261TestJSON-1822891821-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 0.433000 Aug 04 16:32:16.119383 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2/11] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Aug 4 16:32:15 2022] POST /compute/v2.1/flavors => generated 467 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:32:16.132777 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-02791aae-5c44-424c-bc55-d35a5ad4461e tempest-AggregatesAdminTestV241-205209225 tempest-AggregatesAdminTestV241-205209225-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1572466808"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:16.239205 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5660c666-bbd3-4451-a1c9-61322e6fd3af tempest-FlavorMetadataValidation-1499721141 tempest-FlavorMetadataValidation-1499721141-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/852546029/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.300775 Aug 04 16:32:16.240144 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 10/12] 10.222.0.23 () {62 vars in 1262 bytes} [Thu Aug 4 16:32:15 2022] POST /compute/v2.1/flavors/852546029/os-extra_specs => generated 62 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:16.245797 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-28e8f747-b625-4e3e-9587-9765918bbbe7 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Calling method '.version_select at 0x7f7e8726d9d0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:16.246833 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:16.246833 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:32:16.248355 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-28e8f747-b625-4e3e-9587-9765918bbbe7 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:16.248802 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-28e8f747-b625-4e3e-9587-9765918bbbe7 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:16.264517 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-28e8f747-b625-4e3e-9587-9765918bbbe7 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:16.265187 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-28e8f747-b625-4e3e-9587-9765918bbbe7 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:16.278083 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-28e8f747-b625-4e3e-9587-9765918bbbe7 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:16.278690 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-28e8f747-b625-4e3e-9587-9765918bbbe7 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:16.285044 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-28e8f747-b625-4e3e-9587-9765918bbbe7 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.043266 Aug 04 16:32:16.286056 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 11/13] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:32:16 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:16.306567 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:16.306567 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:32:16.468343 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-02791aae-5c44-424c-bc55-d35a5ad4461e tempest-AggregatesAdminTestV241-205209225 tempest-AggregatesAdminTestV241-205209225-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.344923 Aug 04 16:32:16.477226 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3/14] 10.222.0.23 () {62 vars in 1210 bytes} [Thu Aug 4 16:32:16 2022] PUT /compute/v2.1/os-aggregates/1 => generated 299 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:32:16.489741 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a27b4c4e-a579-4a43-a2a4-e9fa7da2ec98 tempest-FlavorMetadataValidation-1499721141 tempest-FlavorMetadataValidation-1499721141-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:16.491806 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:16.491806 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:32:16.549650 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a27b4c4e-a579-4a43-a2a4-e9fa7da2ec98 tempest-FlavorMetadataValidation-1499721141 tempest-FlavorMetadataValidation-1499721141-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/852546029" status: 202 len: 0 microversion: 2.86 time: 0.075470 Aug 04 16:32:16.553974 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 4/15] 10.222.0.23 () {60 vars in 1199 bytes} [Thu Aug 4 16:32:16 2022] DELETE /compute/v2.1/flavors/852546029 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:32:16.558453 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-05e88949-94c0-46ff-b5f2-019dc63d851b tempest-FlavorsV261TestJSON-863278166 tempest-FlavorsV261TestJSON-863278166-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:16.561532 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7e5f4257-ab0c-43f4-914b-406eac56ce2d tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Calling method '.version_select at 0x7f7e87286d30>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:16.563528 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:16.563528 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:32:16.565804 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7e5f4257-ab0c-43f4-914b-406eac56ce2d tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:16.566709 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7e5f4257-ab0c-43f4-914b-406eac56ce2d tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:16.596387 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7e5f4257-ab0c-43f4-914b-406eac56ce2d tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:16.597234 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7e5f4257-ab0c-43f4-914b-406eac56ce2d tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:16.609581 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7e5f4257-ab0c-43f4-914b-406eac56ce2d tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 759 microversion: 2.1 time: 0.055814 Aug 04 16:32:16.611962 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 5/16] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Aug 4 16:32:16 2022] GET /compute/v2.1/os-hypervisors/1 => generated 759 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:16.619044 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-94dcf5f8-b4c8-46d8-af58-8748fa588418 tempest-AggregatesAdminTestV241-205209225 tempest-AggregatesAdminTestV241-205209225-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:16.619812 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:16.619812 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:32:16.627380 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-05e88949-94c0-46ff-b5f2-019dc63d851b tempest-FlavorsV261TestJSON-863278166 tempest-FlavorsV261TestJSON-863278166-project] 10.222.0.23 "GET /compute/v2.1/flavors/1586587898" status: 200 len: 467 microversion: 2.61 time: 0.339357 Aug 04 16:32:16.628322 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 12/17] 10.222.0.23 () {60 vars in 1199 bytes} [Thu Aug 4 16:32:16 2022] GET /compute/v2.1/flavors/1586587898 => generated 467 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:32:16.634602 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8ec86ae4-82de-4e0c-9928-c58c38343855 tempest-FlavorMetadataValidation-1499721141 tempest-FlavorMetadataValidation-1499721141-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:16.640278 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-94dcf5f8-b4c8-46d8-af58-8748fa588418 tempest-AggregatesAdminTestV241-205209225 tempest-AggregatesAdminTestV241-205209225-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.026974 Aug 04 16:32:16.641627 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 6/18] 10.222.0.23 () {60 vars in 1190 bytes} [Thu Aug 4 16:32:16 2022] GET /compute/v2.1/os-aggregates/1 => generated 299 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:32:16.647542 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-85fe8ff8-80a6-4771-aa2c-2f45ab201b0e tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Calling method '.version_select at 0x7f7e85a4baf0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:16.648787 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:16.648787 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:32:16.650439 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-85fe8ff8-80a6-4771-aa2c-2f45ab201b0e tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:16.651320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-85fe8ff8-80a6-4771-aa2c-2f45ab201b0e tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:16.669029 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-85fe8ff8-80a6-4771-aa2c-2f45ab201b0e tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:16.669505 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-85fe8ff8-80a6-4771-aa2c-2f45ab201b0e tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:16.674149 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8ec86ae4-82de-4e0c-9928-c58c38343855 tempest-FlavorMetadataValidation-1499721141 tempest-FlavorMetadataValidation-1499721141-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6233 microversion: 2.86 time: 0.044263 Aug 04 16:32:16.678072 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-85fe8ff8-80a6-4771-aa2c-2f45ab201b0e tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 759 microversion: 2.1 time: 0.034898 Aug 04 16:32:16.681809 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 13/19] 10.222.0.23 () {60 vars in 1187 bytes} [Thu Aug 4 16:32:16 2022] GET /compute/v2.1/flavors/detail => generated 6233 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:32:16.688314 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 7/20] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Aug 4 16:32:16 2022] GET /compute/v2.1/os-hypervisors/2 => generated 759 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:16.689484 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3b8fb04f-c589-49f5-9de1-6f00513bcd87 tempest-FlavorsV261TestJSON-1822891821 tempest-FlavorsV261TestJSON-1822891821-project-admin] Action: 'update', calling method: .version_select at 0x7f7e8786a430>, body: {"flavor": {"description": "new"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:16.699620 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1698a1d9-34f6-4831-a33f-5240cc35a593 tempest-AggregatesAdminTestV241-205209225 tempest-AggregatesAdminTestV241-205209225-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846466-12"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:16.702542 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:16.702542 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:32:16.708471 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:16.708471 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:32:16.724655 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1698a1d9-34f6-4831-a33f-5240cc35a593 tempest-AggregatesAdminTestV241-205209225 tempest-AggregatesAdminTestV241-205209225-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:16.725167 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1698a1d9-34f6-4831-a33f-5240cc35a593 tempest-AggregatesAdminTestV241-205209225 tempest-AggregatesAdminTestV241-205209225-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:16.751042 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3b8fb04f-c589-49f5-9de1-6f00513bcd87 tempest-FlavorsV261TestJSON-1822891821 tempest-FlavorsV261TestJSON-1822891821-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/1586587898" status: 200 len: 468 microversion: 2.61 time: 0.066986 Aug 04 16:32:16.757346 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 14/21] 10.222.0.23 () {62 vars in 1219 bytes} [Thu Aug 4 16:32:16 2022] PUT /compute/v2.1/flavors/1586587898 => generated 468 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:32:16.768497 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-576f4f72-5e63-4740-bd3f-028121c04692 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Calling method '.version_select at 0x7f7e8726d550>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:16.769789 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:16.769789 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:32:16.771505 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-576f4f72-5e63-4740-bd3f-028121c04692 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:16.772207 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-576f4f72-5e63-4740-bd3f-028121c04692 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:16.797185 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-576f4f72-5e63-4740-bd3f-028121c04692 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:16.798268 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-576f4f72-5e63-4740-bd3f-028121c04692 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:16.814431 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-576f4f72-5e63-4740-bd3f-028121c04692 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:16.815277 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-576f4f72-5e63-4740-bd3f-028121c04692 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:16.825858 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-576f4f72-5e63-4740-bd3f-028121c04692 tempest-HypervisorAdminTestJSON-1821285365 tempest-HypervisorAdminTestJSON-1821285365-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=126125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 16:32:16.827475 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f025b080-016a-4b56-8b3e-cf4074bae83a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:16.828052 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f025b080-016a-4b56-8b3e-cf4074bae83a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:16.829125 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f025b080-016a-4b56-8b3e-cf4074bae83a None None] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:16.829802 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f025b080-016a-4b56-8b3e-cf4074bae83a None None] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:16.839946 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.compute.rpcapi [None req-f025b080-016a-4b56-8b3e-cf4074bae83a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 04 16:32:16.841355 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f025b080-016a-4b56-8b3e-cf4074bae83a None None] Releasing lock "compute-rpcapi-router" {{(pid=126125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 16:32:16.931794 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f025b080-016a-4b56-8b3e-cf4074bae83a None None] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.177125 Aug 04 16:32:16.932464 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 15/22] 10.222.0.23 () {58 vars in 1173 bytes} [Thu Aug 4 16:32:16 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:16.945094 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3ebc5da2-b688-4a6f-bdf4-6db0edbc9430 tempest-FlavorsV261TestJSON-863278166 tempest-FlavorsV261TestJSON-863278166-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:17.005054 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3ebc5da2-b688-4a6f-bdf4-6db0edbc9430 tempest-FlavorsV261TestJSON-863278166 tempest-FlavorsV261TestJSON-863278166-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6249 microversion: 2.61 time: 0.063966 Aug 04 16:32:17.013867 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 16/23] 10.222.0.23 () {60 vars in 1187 bytes} [Thu Aug 4 16:32:16 2022] GET /compute/v2.1/flavors/detail => generated 6249 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:32:17.030597 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3938f288-d703-4fa4-a5fb-322a960c4468 tempest-FlavorsV261TestJSON-863278166 tempest-FlavorsV261TestJSON-863278166-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:17.072463 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3938f288-d703-4fa4-a5fb-322a960c4468 tempest-FlavorsV261TestJSON-863278166 tempest-FlavorsV261TestJSON-863278166-project] 10.222.0.23 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.61 time: 0.046109 Aug 04 16:32:17.084339 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 17/24] 10.222.0.23 () {60 vars in 1166 bytes} [Thu Aug 4 16:32:17 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:32:17.098809 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5327b560-0223-4803-9e8e-62acc85c6ce7 tempest-FlavorsV261TestJSON-1822891821 tempest-FlavorsV261TestJSON-1822891821-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:17.100788 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:17.100788 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:32:17.159254 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5327b560-0223-4803-9e8e-62acc85c6ce7 tempest-FlavorsV261TestJSON-1822891821 tempest-FlavorsV261TestJSON-1822891821-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1586587898" status: 202 len: 0 microversion: 2.61 time: 0.072855 Aug 04 16:32:17.160394 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 18/25] 10.222.0.23 () {60 vars in 1202 bytes} [Thu Aug 4 16:32:17 2022] DELETE /compute/v2.1/flavors/1586587898 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:32:17.173787 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8884ef9e-dbd7-472f-84b8-5c27839e913b tempest-FlavorsV261TestJSON-1822891821 tempest-FlavorsV261TestJSON-1822891821-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:17.234720 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8884ef9e-dbd7-472f-84b8-5c27839e913b tempest-FlavorsV261TestJSON-1822891821 tempest-FlavorsV261TestJSON-1822891821-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.067235 Aug 04 16:32:17.236380 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 19/26] 10.222.0.23 () {60 vars in 1187 bytes} [Thu Aug 4 16:32:17 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:32:17.515730 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1698a1d9-34f6-4831-a33f-5240cc35a593 tempest-AggregatesAdminTestV241-205209225 tempest-AggregatesAdminTestV241-205209225-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.41 time: 0.823834 Aug 04 16:32:17.516805 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 8/27] 10.222.0.23 () {62 vars in 1232 bytes} [Thu Aug 4 16:32:16 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:32:17.539824 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-191f0fdf-37c5-4b16-bcb2-df86ab745313 tempest-AggregatesAdminTestV241-205209225 tempest-AggregatesAdminTestV241-205209225-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846466-12"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:17.544033 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:17.544033 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:32:17.554999 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-191f0fdf-37c5-4b16-bcb2-df86ab745313 tempest-AggregatesAdminTestV241-205209225 tempest-AggregatesAdminTestV241-205209225-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:17.556681 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-191f0fdf-37c5-4b16-bcb2-df86ab745313 tempest-AggregatesAdminTestV241-205209225 tempest-AggregatesAdminTestV241-205209225-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:18.946050 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5bc9af26-809a-4383-ad95-c13e40702bee tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-177513390", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:19.215846 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-191f0fdf-37c5-4b16-bcb2-df86ab745313 tempest-AggregatesAdminTestV241-205209225 tempest-AggregatesAdminTestV241-205209225-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.41 time: 1.680511 Aug 04 16:32:19.217594 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 20/28] 10.222.0.23 () {62 vars in 1232 bytes} [Thu Aug 4 16:32:17 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:32:19.235260 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4a6a125c-1286-48b4-814b-39f8e4c94ed0 tempest-AggregatesAdminTestV241-205209225 tempest-AggregatesAdminTestV241-205209225-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:19.236112 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:19.236112 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:32:19.274802 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4a6a125c-1286-48b4-814b-39f8e4c94ed0 tempest-AggregatesAdminTestV241-205209225 tempest-AggregatesAdminTestV241-205209225-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.048095 Aug 04 16:32:19.280861 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 21/29] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Aug 4 16:32:19 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:19.361237 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b7c9f857-6755-48b3-934a-42a02460f00c tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-406769862", "name": "tempest-test_aggregate-2056432837"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:19.386686 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:19.386686 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:32:19.388543 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.aggregate [None req-b7c9f857-6755-48b3-934a-42a02460f00c tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Generated uuid 16da2d34-01e2-457e-87cc-13af2a875b9f for aggregate {{(pid=126125) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:32:19.438406 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b7c9f857-6755-48b3-934a-42a02460f00c tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.080722 Aug 04 16:32:19.441880 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 22/30] 10.222.0.23 () {60 vars in 1165 bytes} [Thu Aug 4 16:32:19 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:32:19.451514 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-27308423-a400-4fc8-95d4-7b99887d61d0 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:19.452713 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:19.452713 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:32:19.471188 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-27308423-a400-4fc8-95d4-7b99887d61d0 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 301 microversion: 2.1 time: 0.023184 Aug 04 16:32:19.472586 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 23/31] 10.222.0.23 () {58 vars in 1143 bytes} [Thu Aug 4 16:32:19 2022] GET /compute/v2.1/os-aggregates => generated 301 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:32:19.489686 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2b9c2898-c7cc-45f2-b7a0-009e446237bc tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846466-12"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:19.495884 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:19.495884 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:32:19.503255 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=1,nova_api:DELETE=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:32:19.511015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2b9c2898-c7cc-45f2-b7a0-009e446237bc tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:19.511870 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2b9c2898-c7cc-45f2-b7a0-009e446237bc tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:19.826374 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2b9c2898-c7cc-45f2-b7a0-009e446237bc tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 314 microversion: 2.1 time: 0.342833 Aug 04 16:32:19.827746 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 24/32] 10.222.0.23 () {60 vars in 1191 bytes} [Thu Aug 4 16:32:19 2022] POST /compute/v2.1/os-aggregates/2/action => generated 314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:21.022802 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-5bc9af26-809a-4383-ad95-c13e40702bee tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] validate_networks() for None {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:32:21.235657 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8781214d-52fb-4045-baa4-0a3c5c321760 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-232116290", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "availability_zone": "tempest-test_az-406769862"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:21.297408 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8781214d-52fb-4045-baa4-0a3c5c321760 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:21.298234 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8781214d-52fb-4045-baa4-0a3c5c321760 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:21.299606 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8781214d-52fb-4045-baa4-0a3c5c321760 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:21.300375 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8781214d-52fb-4045-baa4-0a3c5c321760 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:21.400281 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-5bc9af26-809a-4383-ad95-c13e40702bee tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:32:21.400702 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-5bc9af26-809a-4383-ad95-c13e40702bee tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:32:21.401179 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-5bc9af26-809a-4383-ad95-c13e40702bee tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:32:21.401889 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-5bc9af26-809a-4383-ad95-c13e40702bee tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:32:21.402299 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-5bc9af26-809a-4383-ad95-c13e40702bee tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:32:21.440440 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5bc9af26-809a-4383-ad95-c13e40702bee tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:21.442978 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5bc9af26-809a-4383-ad95-c13e40702bee tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:21.444259 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5bc9af26-809a-4383-ad95-c13e40702bee tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:21.444938 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5bc9af26-809a-4383-ad95-c13e40702bee tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:21.489191 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-5bc9af26-809a-4383-ad95-c13e40702bee tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Getting quotas for project f665aa7b40ce4198a7958d9c382058f3. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:32:21.502292 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-5bc9af26-809a-4383-ad95-c13e40702bee tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Getting quotas for user 9dc6220916eb443387bbf353c267342c and project f665aa7b40ce4198a7958d9c382058f3. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:32:21.520113 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5bc9af26-809a-4383-ad95-c13e40702bee tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:32:21.526150 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5bc9af26-809a-4383-ad95-c13e40702bee tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: e40c21e9-d19a-4e5f-9c7d-c4507025e94e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:32:21.622752 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5bc9af26-809a-4383-ad95-c13e40702bee tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.475006 Aug 04 16:32:21.636045 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 9/33] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:32:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 3489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:32:21.644972 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d7df49b1-1937-4099-af39-8a7f277b3993 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:21.646477 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d7df49b1-1937-4099-af39-8a7f277b3993 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: e40c21e9-d19a-4e5f-9c7d-c4507025e94e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:21.853948 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d7df49b1-1937-4099-af39-8a7f277b3993 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:21.870489 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d7df49b1-1937-4099-af39-8a7f277b3993 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e" status: 200 len: 1219 microversion: 2.1 time: 0.232759 Aug 04 16:32:21.871094 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 10/34] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:21 2022] GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e => generated 1219 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:22.653476 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-8781214d-52fb-4045-baa4-0a3c5c321760 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] validate_networks() for None {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:32:22.894498 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2afeeb4c-9441-4660-88f9-c91601995cdf tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:22.896129 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2afeeb4c-9441-4660-88f9-c91601995cdf tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: e40c21e9-d19a-4e5f-9c7d-c4507025e94e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:23.069292 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2afeeb4c-9441-4660-88f9-c91601995cdf tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:23.083782 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2afeeb4c-9441-4660-88f9-c91601995cdf tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e" status: 200 len: 1219 microversion: 2.1 time: 0.193811 Aug 04 16:32:23.087295 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 11/35] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:22 2022] GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e => generated 1219 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:32:23.117903 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-8781214d-52fb-4045-baa4-0a3c5c321760 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:32:23.118513 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-8781214d-52fb-4045-baa4-0a3c5c321760 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:32:23.119007 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-8781214d-52fb-4045-baa4-0a3c5c321760 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:32:23.119417 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-8781214d-52fb-4045-baa4-0a3c5c321760 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:32:23.119844 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-8781214d-52fb-4045-baa4-0a3c5c321760 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:32:23.143184 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8781214d-52fb-4045-baa4-0a3c5c321760 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:23.144173 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8781214d-52fb-4045-baa4-0a3c5c321760 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:23.145452 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8781214d-52fb-4045-baa4-0a3c5c321760 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:23.147163 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8781214d-52fb-4045-baa4-0a3c5c321760 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:23.196595 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-8781214d-52fb-4045-baa4-0a3c5c321760 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Getting quotas for project 0ce23f198a99464ab95a3e5f98dde567. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:32:23.205450 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-8781214d-52fb-4045-baa4-0a3c5c321760 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Getting quotas for user 9134e4e91c6a4139a4dd8d2865a6cb51 and project 0ce23f198a99464ab95a3e5f98dde567. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:32:23.224206 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8781214d-52fb-4045-baa4-0a3c5c321760 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:32:23.228934 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8781214d-52fb-4045-baa4-0a3c5c321760 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] [instance: 5961044f-b35a-4051-b041-84548b5965d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:32:23.324857 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8781214d-52fb-4045-baa4-0a3c5c321760 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.860058 Aug 04 16:32:23.326557 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 25/36] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:32:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 16:32:23.343151 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-aa608b86-d2d5-4062-87c2-ec66907b1dd2 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:23.345901 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-aa608b86-d2d5-4062-87c2-ec66907b1dd2 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] [instance: 5961044f-b35a-4051-b041-84548b5965d5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:23.509554 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-aa608b86-d2d5-4062-87c2-ec66907b1dd2 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9134e4e91c6a4139a4dd8d2865a6cb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce23f198a99464ab95a3e5f98dde567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:23.520560 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-aa608b86-d2d5-4062-87c2-ec66907b1dd2 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] 10.222.0.23 "GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5" status: 200 len: 1241 microversion: 2.1 time: 0.184127 Aug 04 16:32:23.528691 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 12/37] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:23 2022] GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5 => generated 1241 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:24.109539 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-48fc5f79-bb63-462b-b3a5-4fdbc9645d70 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:24.110161 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-48fc5f79-bb63-462b-b3a5-4fdbc9645d70 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: e40c21e9-d19a-4e5f-9c7d-c4507025e94e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:24.166597 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-48fc5f79-bb63-462b-b3a5-4fdbc9645d70 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:24.168345 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-48fc5f79-bb63-462b-b3a5-4fdbc9645d70 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:24.171732 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-48fc5f79-bb63-462b-b3a5-4fdbc9645d70 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:24.172783 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-48fc5f79-bb63-462b-b3a5-4fdbc9645d70 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:24.444947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-48fc5f79-bb63-462b-b3a5-4fdbc9645d70 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:24.474023 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-48fc5f79-bb63-462b-b3a5-4fdbc9645d70 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e" status: 200 len: 1215 microversion: 2.1 time: 0.373533 Aug 04 16:32:24.485765 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 26/38] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:24 2022] GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e => generated 1215 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:32:24.548260 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-32cd4a37-1bfc-4b20-8116-923a070e8d71 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:24.548997 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-32cd4a37-1bfc-4b20-8116-923a070e8d71 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] [instance: 5961044f-b35a-4051-b041-84548b5965d5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:24.690897 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-32cd4a37-1bfc-4b20-8116-923a070e8d71 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9134e4e91c6a4139a4dd8d2865a6cb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce23f198a99464ab95a3e5f98dde567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:24.715794 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-32cd4a37-1bfc-4b20-8116-923a070e8d71 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] 10.222.0.23 "GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5" status: 200 len: 1241 microversion: 2.1 time: 0.175241 Aug 04 16:32:24.730468 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 13/39] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:24 2022] GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5 => generated 1241 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:25.506823 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ec227d6f-dc94-466a-9e1a-f33c158a0a63 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:25.507439 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ec227d6f-dc94-466a-9e1a-f33c158a0a63 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: e40c21e9-d19a-4e5f-9c7d-c4507025e94e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:25.516599 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec227d6f-dc94-466a-9e1a-f33c158a0a63 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:25.517255 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec227d6f-dc94-466a-9e1a-f33c158a0a63 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:25.518777 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec227d6f-dc94-466a-9e1a-f33c158a0a63 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:25.519422 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec227d6f-dc94-466a-9e1a-f33c158a0a63 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:25.666905 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ec227d6f-dc94-466a-9e1a-f33c158a0a63 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:25.707037 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ec227d6f-dc94-466a-9e1a-f33c158a0a63 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e" status: 200 len: 1277 microversion: 2.1 time: 0.202926 Aug 04 16:32:25.725382 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 27/40] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:25 2022] GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e => generated 1277 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:25.739791 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-af31bff1-e29c-4f60-b71e-23cff7cea2cb tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:25.740645 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-af31bff1-e29c-4f60-b71e-23cff7cea2cb tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] [instance: 5961044f-b35a-4051-b041-84548b5965d5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:25.773154 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-af31bff1-e29c-4f60-b71e-23cff7cea2cb tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:25.776160 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-af31bff1-e29c-4f60-b71e-23cff7cea2cb tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:25.783947 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-af31bff1-e29c-4f60-b71e-23cff7cea2cb tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:25.784679 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-af31bff1-e29c-4f60-b71e-23cff7cea2cb tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:26.423426 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-af31bff1-e29c-4f60-b71e-23cff7cea2cb tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9134e4e91c6a4139a4dd8d2865a6cb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce23f198a99464ab95a3e5f98dde567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:26.448413 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-af31bff1-e29c-4f60-b71e-23cff7cea2cb tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] 10.222.0.23 "GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5" status: 200 len: 1289 microversion: 2.1 time: 0.711308 Aug 04 16:32:26.457429 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 14/41] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:25 2022] GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5 => generated 1289 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:26.731544 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-162968ab-57dd-4351-8b80-659a3b4b4441 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:26.732156 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-162968ab-57dd-4351-8b80-659a3b4b4441 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: e40c21e9-d19a-4e5f-9c7d-c4507025e94e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:26.749146 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-162968ab-57dd-4351-8b80-659a3b4b4441 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:26.750215 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-162968ab-57dd-4351-8b80-659a3b4b4441 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:26.751552 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-162968ab-57dd-4351-8b80-659a3b4b4441 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:26.753346 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-162968ab-57dd-4351-8b80-659a3b4b4441 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:27.471545 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1d71b553-0f0e-48ae-9234-a46108b2f654 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:27.472216 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1d71b553-0f0e-48ae-9234-a46108b2f654 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] [instance: 5961044f-b35a-4051-b041-84548b5965d5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:27.486125 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d71b553-0f0e-48ae-9234-a46108b2f654 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:27.486569 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d71b553-0f0e-48ae-9234-a46108b2f654 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:27.492265 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d71b553-0f0e-48ae-9234-a46108b2f654 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:27.492701 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d71b553-0f0e-48ae-9234-a46108b2f654 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:27.848518 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-162968ab-57dd-4351-8b80-659a3b4b4441 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:27.877932 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-162968ab-57dd-4351-8b80-659a3b4b4441 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e" status: 200 len: 1277 microversion: 2.1 time: 1.150228 Aug 04 16:32:27.894782 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 28/42] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:26 2022] GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e => generated 1277 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:28.124117 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1d71b553-0f0e-48ae-9234-a46108b2f654 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9134e4e91c6a4139a4dd8d2865a6cb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce23f198a99464ab95a3e5f98dde567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:28.135676 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1d71b553-0f0e-48ae-9234-a46108b2f654 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] 10.222.0.23 "GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5" status: 200 len: 1295 microversion: 2.1 time: 0.668401 Aug 04 16:32:28.144276 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 15/43] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:27 2022] GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5 => generated 1295 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:28.285901 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1d71b553-0f0e-48ae-9234-a46108b2f654 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:28.287004 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1d71b553-0f0e-48ae-9234-a46108b2f654 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001439 Aug 04 16:32:28.287363 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 16/44] 10.222.0.23 () {56 vars in 886 bytes} [Thu Aug 4 16:32:28 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Aug 04 16:32:28.913839 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-42c12d8c-e3e0-48d0-97ec-b5dcb83132af tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:28.919422 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-42c12d8c-e3e0-48d0-97ec-b5dcb83132af tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: e40c21e9-d19a-4e5f-9c7d-c4507025e94e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:29.009622 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-42c12d8c-e3e0-48d0-97ec-b5dcb83132af tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:29.015226 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-42c12d8c-e3e0-48d0-97ec-b5dcb83132af tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:29.017237 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-42c12d8c-e3e0-48d0-97ec-b5dcb83132af tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:29.028892 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-42c12d8c-e3e0-48d0-97ec-b5dcb83132af tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:29.220189 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-97f3f47a-19d2-4d22-b481-4e038c6d842d tempest-InstanceUsageAuditLogTestJSON-1800384903 tempest-InstanceUsageAuditLogTestJSON-1800384903-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:29.231155 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:29.231155 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:32:29.328736 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-97f3f47a-19d2-4d22-b481-4e038c6d842d tempest-InstanceUsageAuditLogTestJSON-1800384903 tempest-InstanceUsageAuditLogTestJSON-1800384903-project-admin] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-04 16:32:27" status: 200 len: 318 microversion: 2.1 time: 1.427114 Aug 04 16:32:29.330481 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 29/45] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Aug 4 16:32:27 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-04%2016%3A32%3A27 => generated 318 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:29.343296 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f37de876-edc5-4f1a-925e-0afd7cd5748b tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:29.344168 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f37de876-edc5-4f1a-925e-0afd7cd5748b tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] [instance: 5961044f-b35a-4051-b041-84548b5965d5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:29.366239 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f37de876-edc5-4f1a-925e-0afd7cd5748b tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:29.366697 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f37de876-edc5-4f1a-925e-0afd7cd5748b tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:29.367606 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f37de876-edc5-4f1a-925e-0afd7cd5748b tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:29.368041 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f37de876-edc5-4f1a-925e-0afd7cd5748b tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:29.945331 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-42c12d8c-e3e0-48d0-97ec-b5dcb83132af tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:29.979671 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-42c12d8c-e3e0-48d0-97ec-b5dcb83132af tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e" status: 200 len: 1319 microversion: 2.1 time: 1.073910 Aug 04 16:32:29.981524 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 17/46] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:28 2022] GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e => generated 1319 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:32:29.987392 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f37de876-edc5-4f1a-925e-0afd7cd5748b tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9134e4e91c6a4139a4dd8d2865a6cb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce23f198a99464ab95a3e5f98dde567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:29.996115 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f37de876-edc5-4f1a-925e-0afd7cd5748b tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] 10.222.0.23 "GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5" status: 200 len: 1295 microversion: 2.1 time: 0.664336 Aug 04 16:32:30.002978 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 30/47] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:29 2022] GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5 => generated 1295 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:30.006405 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8c03867c-dc05-4ff3-8759-9fab877d80a5 tempest-InstanceUsageAuditLogTestJSON-1800384903 tempest-InstanceUsageAuditLogTestJSON-1800384903-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:30.014386 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:30.014386 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:32:30.065462 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8c03867c-dc05-4ff3-8759-9fab877d80a5 tempest-InstanceUsageAuditLogTestJSON-1800384903 tempest-InstanceUsageAuditLogTestJSON-1800384903-project-admin] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.080648 Aug 04 16:32:30.080429 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 18/48] 10.222.0.23 () {58 vars in 1185 bytes} [Thu Aug 4 16:32:29 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:31.184532 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-efcbf977-ac84-4563-80c7-267f18a7410b tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-844424891", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:31.382006 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a9d35f7d-3b1b-456e-bf5d-56bfc1f62415 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:31.417470 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a9d35f7d-3b1b-456e-bf5d-56bfc1f62415 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 1.335333 Aug 04 16:32:31.431094 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 19/49] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Aug 4 16:32:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:31.442887 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-05d1951a-85ee-486e-bd51-22c054039729 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:31.443755 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-05d1951a-85ee-486e-bd51-22c054039729 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: e40c21e9-d19a-4e5f-9c7d-c4507025e94e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:31.454037 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-05d1951a-85ee-486e-bd51-22c054039729 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:31.454653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-05d1951a-85ee-486e-bd51-22c054039729 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:31.455707 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-05d1951a-85ee-486e-bd51-22c054039729 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:31.456327 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-05d1951a-85ee-486e-bd51-22c054039729 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:31.462642 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:32:31.957657 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-05d1951a-85ee-486e-bd51-22c054039729 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:31.975765 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-05d1951a-85ee-486e-bd51-22c054039729 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e" status: 200 len: 1319 microversion: 2.1 time: 0.543129 Aug 04 16:32:31.979798 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 20/50] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:31 2022] GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e => generated 1319 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:32.007669 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9cf0d78a-610c-4117-b0e1-22b1b8c41d31 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:32.009492 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9cf0d78a-610c-4117-b0e1-22b1b8c41d31 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] [instance: 5961044f-b35a-4051-b041-84548b5965d5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:32.024923 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9cf0d78a-610c-4117-b0e1-22b1b8c41d31 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:32.028793 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9cf0d78a-610c-4117-b0e1-22b1b8c41d31 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:32.031943 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9cf0d78a-610c-4117-b0e1-22b1b8c41d31 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:32.032695 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9cf0d78a-610c-4117-b0e1-22b1b8c41d31 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:32.755202 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9cf0d78a-610c-4117-b0e1-22b1b8c41d31 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9134e4e91c6a4139a4dd8d2865a6cb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce23f198a99464ab95a3e5f98dde567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:32.772094 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9cf0d78a-610c-4117-b0e1-22b1b8c41d31 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] 10.222.0.23 "GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5" status: 200 len: 1337 microversion: 2.1 time: 0.784189 Aug 04 16:32:32.777495 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 21/51] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:31 2022] GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5 => generated 1337 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:33.182892 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=8 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:32:33.365858 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-97321067-8ecf-4782-89be-845a3cff5c25 tempest-ServersWithSpecificFlavorTestJSON-342277255 tempest-ServersWithSpecificFlavorTestJSON-342277255-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1810706749", "id": 1332659819, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:33.369339 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:33.369339 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:32:33.420410 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-97321067-8ecf-4782-89be-845a3cff5c25 tempest-ServersWithSpecificFlavorTestJSON-342277255 tempest-ServersWithSpecificFlavorTestJSON-342277255-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.640602 Aug 04 16:32:33.424425 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 22/52] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:32:32 2022] POST /compute/v2.1/flavors => generated 425 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:33.429802 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e7b96fd6-75dc-4118-9410-7491381b3f4e tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:33.433380 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e7b96fd6-75dc-4118-9410-7491381b3f4e tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: e40c21e9-d19a-4e5f-9c7d-c4507025e94e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:33.453158 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e7b96fd6-75dc-4118-9410-7491381b3f4e tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:33.455764 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e7b96fd6-75dc-4118-9410-7491381b3f4e tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:33.458849 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e7b96fd6-75dc-4118-9410-7491381b3f4e tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:33.460236 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e7b96fd6-75dc-4118-9410-7491381b3f4e tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:33.968277 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e7b96fd6-75dc-4118-9410-7491381b3f4e tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:33.977607 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e7b96fd6-75dc-4118-9410-7491381b3f4e tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e" status: 200 len: 1319 microversion: 2.1 time: 0.551587 Aug 04 16:32:33.982777 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 23/53] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:33 2022] GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e => generated 1319 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:34.479870 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-42d48a87-f7d5-4463-97f3-3c12fd6a82b2 tempest-FlavorsExtraSpecsTestJSON-191975643 tempest-FlavorsExtraSpecsTestJSON-191975643-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1138443935", "ram": 512, "vcpus": 1, "disk": 10, "id": 909288872, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:34.514117 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:34.514117 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:32:34.558914 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-42d48a87-f7d5-4463-97f3-3c12fd6a82b2 tempest-FlavorsExtraSpecsTestJSON-191975643 tempest-FlavorsExtraSpecsTestJSON-191975643-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.573692 Aug 04 16:32:34.567700 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 24/54] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:32:33 2022] POST /compute/v2.1/flavors => generated 413 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:34.591365 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fa7adcf2-e09b-42b4-b1a6-a3d94b051574 tempest-ServersWithSpecificFlavorTestJSON-342277255 tempest-ServersWithSpecificFlavorTestJSON-342277255-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:34.658896 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fa7adcf2-e09b-42b4-b1a6-a3d94b051574 tempest-ServersWithSpecificFlavorTestJSON-342277255 tempest-ServersWithSpecificFlavorTestJSON-342277255-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.087682 Aug 04 16:32:34.667268 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 25/55] 10.222.0.23 () {58 vars in 1182 bytes} [Thu Aug 4 16:32:34 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:32:34.678597 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-201eba8e-337e-4e4e-ba61-c3329fc70647 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:34.679670 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-201eba8e-337e-4e4e-ba61-c3329fc70647 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] [instance: 5961044f-b35a-4051-b041-84548b5965d5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:34.693865 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-201eba8e-337e-4e4e-ba61-c3329fc70647 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:34.696553 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-201eba8e-337e-4e4e-ba61-c3329fc70647 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:34.698136 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-201eba8e-337e-4e4e-ba61-c3329fc70647 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:34.701595 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-201eba8e-337e-4e4e-ba61-c3329fc70647 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:36.239419 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-201eba8e-337e-4e4e-ba61-c3329fc70647 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9134e4e91c6a4139a4dd8d2865a6cb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce23f198a99464ab95a3e5f98dde567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:36.282568 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-201eba8e-337e-4e4e-ba61-c3329fc70647 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] 10.222.0.23 "GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5" status: 200 len: 1337 microversion: 2.1 time: 1.611471 Aug 04 16:32:36.283834 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 26/56] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:34 2022] GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5 => generated 1337 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:36.302709 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3f658fa1-00e3-4895-84fc-0b67141ea576 tempest-FlavorsExtraSpecsTestJSON-191975643 tempest-FlavorsExtraSpecsTestJSON-191975643-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:36.306045 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:36.306045 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:32:36.353059 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=8,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:SAVEPOINT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:32:36.379133 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3f658fa1-00e3-4895-84fc-0b67141ea576 tempest-FlavorsExtraSpecsTestJSON-191975643 tempest-FlavorsExtraSpecsTestJSON-191975643-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/909288872/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.093305 Aug 04 16:32:36.384867 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 27/57] 10.222.0.23 () {60 vars in 1221 bytes} [Thu Aug 4 16:32:36 2022] POST /compute/v2.1/flavors/909288872/os-extra_specs => generated 66 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:32:36.396314 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d3ed9048-9c33-4dc5-85f4-2fb6490712b0 tempest-ServersWithSpecificFlavorTestJSON-342277255 tempest-ServersWithSpecificFlavorTestJSON-342277255-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-661351228", "id": 1896151957, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:36.410480 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:36.410480 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:32:36.444258 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d3ed9048-9c33-4dc5-85f4-2fb6490712b0 tempest-ServersWithSpecificFlavorTestJSON-342277255 tempest-ServersWithSpecificFlavorTestJSON-342277255-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.058137 Aug 04 16:32:36.449644 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 28/58] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:32:36 2022] POST /compute/v2.1/flavors => generated 424 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:36.471619 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2aa6401f-1c16-4cfc-9cad-707ecb6f7940 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:36.472279 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2aa6401f-1c16-4cfc-9cad-707ecb6f7940 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: e40c21e9-d19a-4e5f-9c7d-c4507025e94e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:36.492107 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2aa6401f-1c16-4cfc-9cad-707ecb6f7940 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:36.494792 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2aa6401f-1c16-4cfc-9cad-707ecb6f7940 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:36.495995 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2aa6401f-1c16-4cfc-9cad-707ecb6f7940 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:36.496652 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2aa6401f-1c16-4cfc-9cad-707ecb6f7940 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:37.680906 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2aa6401f-1c16-4cfc-9cad-707ecb6f7940 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:37.713733 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2aa6401f-1c16-4cfc-9cad-707ecb6f7940 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e" status: 200 len: 1319 microversion: 2.1 time: 1.260339 Aug 04 16:32:37.717389 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 29/59] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:36 2022] GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e => generated 1319 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:38.313926 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-f6e93030-99f8-464a-a715-3ebddd9c53e5 req-e3b89d0f-3d5b-4966-aaa2-97f97bf992d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e40c21e9-d19a-4e5f-9c7d-c4507025e94e", "tag": "f0ca0e96-7387-46db-9244-1e3b3f97dd7a"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:38.348569 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f6e93030-99f8-464a-a715-3ebddd9c53e5 req-e3b89d0f-3d5b-4966-aaa2-97f97bf992d0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:38.349005 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f6e93030-99f8-464a-a715-3ebddd9c53e5 req-e3b89d0f-3d5b-4966-aaa2-97f97bf992d0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:38.460786 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-f6e93030-99f8-464a-a715-3ebddd9c53e5 req-e3b89d0f-3d5b-4966-aaa2-97f97bf992d0 service nova] Creating event network-changed:f0ca0e96-7387-46db-9244-1e3b3f97dd7a for instance e40c21e9-d19a-4e5f-9c7d-c4507025e94e on n-h1-846466-12 Aug 04 16:32:38.461417 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f6e93030-99f8-464a-a715-3ebddd9c53e5 req-e3b89d0f-3d5b-4966-aaa2-97f97bf992d0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=126126) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 16:32:38.462608 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b6e4003-178d-40f5-bc82-aa785efb18b9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:38.463066 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b6e4003-178d-40f5-bc82-aa785efb18b9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:38.463874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b6e4003-178d-40f5-bc82-aa785efb18b9 None None] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:38.464279 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b6e4003-178d-40f5-bc82-aa785efb18b9 None None] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:38.507559 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.compute.rpcapi [None req-3b6e4003-178d-40f5-bc82-aa785efb18b9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 04 16:32:38.513461 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b6e4003-178d-40f5-bc82-aa785efb18b9 None None] Releasing lock "compute-rpcapi-router" {{(pid=126126) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 16:32:38.598446 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3b6e4003-178d-40f5-bc82-aa785efb18b9 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.875026 Aug 04 16:32:38.599804 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 30/60] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:39.231479 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-32f84b8f-3b9c-4ddc-b166-4d3030f7d92c tempest-FlavorsExtraSpecsTestJSON-1828125916 tempest-FlavorsExtraSpecsTestJSON-1828125916-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:39.274879 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-32f84b8f-3b9c-4ddc-b166-4d3030f7d92c tempest-FlavorsExtraSpecsTestJSON-1828125916 tempest-FlavorsExtraSpecsTestJSON-1828125916-project] 10.222.0.23 "GET /compute/v2.1/flavors/909288872/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.668549 Aug 04 16:32:39.275520 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 31/61] 10.222.0.23 () {58 vars in 1200 bytes} [Thu Aug 4 16:32:38 2022] GET /compute/v2.1/flavors/909288872/os-extra_specs => generated 66 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:32:39.285170 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ba1fae97-aec4-4b51-aeb8-baa1de965d08 tempest-ServersWithSpecificFlavorTestJSON-342277255 tempest-ServersWithSpecificFlavorTestJSON-342277255-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:39.305182 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ba1fae97-aec4-4b51-aeb8-baa1de965d08 tempest-ServersWithSpecificFlavorTestJSON-342277255 tempest-ServersWithSpecificFlavorTestJSON-342277255-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.027568 Aug 04 16:32:39.306834 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 32/62] 10.222.0.23 () {58 vars in 1182 bytes} [Thu Aug 4 16:32:39 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:32:39.316060 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-be9a6397-3c0a-4d07-a4e3-b35186f6d748 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:39.317392 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-be9a6397-3c0a-4d07-a4e3-b35186f6d748 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] [instance: 5961044f-b35a-4051-b041-84548b5965d5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:39.321908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=10 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:32:39.332485 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be9a6397-3c0a-4d07-a4e3-b35186f6d748 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:39.333012 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be9a6397-3c0a-4d07-a4e3-b35186f6d748 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:39.333919 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be9a6397-3c0a-4d07-a4e3-b35186f6d748 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:39.334485 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be9a6397-3c0a-4d07-a4e3-b35186f6d748 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:39.726853 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-be9a6397-3c0a-4d07-a4e3-b35186f6d748 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9134e4e91c6a4139a4dd8d2865a6cb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce23f198a99464ab95a3e5f98dde567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:39.737580 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-be9a6397-3c0a-4d07-a4e3-b35186f6d748 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] 10.222.0.23 "GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5" status: 200 len: 1337 microversion: 2.1 time: 0.427385 Aug 04 16:32:39.739692 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 33/63] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:39 2022] GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5 => generated 1337 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:40.001898 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=82 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:32:40.057813 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=18 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:32:40.364786 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e25c4e0b-4b32-45d3-92e3-e4d6c71e0c20 tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] Calling method '.version_select at 0x7f7e85890820>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:40.369737 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:40.369737 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:32:40.372983 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e25c4e0b-4b32-45d3-92e3-e4d6c71e0c20 tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:40.374186 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e25c4e0b-4b32-45d3-92e3-e4d6c71e0c20 tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:40.376748 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e25c4e0b-4b32-45d3-92e3-e4d6c71e0c20 tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:40.378031 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e25c4e0b-4b32-45d3-92e3-e4d6c71e0c20 tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:40.474606 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e25c4e0b-4b32-45d3-92e3-e4d6c71e0c20 tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 402 microversion: 2.1 time: 0.733343 Aug 04 16:32:40.476147 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 34/64] 10.222.0.23 () {58 vars in 1128 bytes} [Thu Aug 4 16:32:39 2022] GET /compute/v2.1/os-hosts => generated 402 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:40.486507 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d125601d-2b47-4e04-a9a7-d4263c9437d2 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:40.487565 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d125601d-2b47-4e04-a9a7-d4263c9437d2 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: e40c21e9-d19a-4e5f-9c7d-c4507025e94e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:40.513048 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d125601d-2b47-4e04-a9a7-d4263c9437d2 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:40.513866 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d125601d-2b47-4e04-a9a7-d4263c9437d2 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:40.514944 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d125601d-2b47-4e04-a9a7-d4263c9437d2 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:40.515320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d125601d-2b47-4e04-a9a7-d4263c9437d2 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:40.761814 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d125601d-2b47-4e04-a9a7-d4263c9437d2 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:40.780312 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d125601d-2b47-4e04-a9a7-d4263c9437d2 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e" status: 200 len: 1319 microversion: 2.1 time: 0.302517 Aug 04 16:32:40.781365 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 35/65] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:40 2022] GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e => generated 1319 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:40.801924 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1c63b798-9f84-48ad-a6d2-4a0e15134161 tempest-FlavorsExtraSpecsTestJSON-191975643 tempest-FlavorsExtraSpecsTestJSON-191975643-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:40.807608 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:40.807608 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:32:40.861662 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1c63b798-9f84-48ad-a6d2-4a0e15134161 tempest-FlavorsExtraSpecsTestJSON-191975643 tempest-FlavorsExtraSpecsTestJSON-191975643-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/909288872/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.065144 Aug 04 16:32:40.862649 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 36/66] 10.222.0.23 () {60 vars in 1221 bytes} [Thu Aug 4 16:32:40 2022] POST /compute/v2.1/flavors/909288872/os-extra_specs => generated 66 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:32:40.873383 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-664dbaef-02e0-49f5-9a1c-67d7cd2dbea1 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Action: 'create', calling method: .version_select at 0x7f7e857878b0>, body: {"keypair": {"name": "tempest-keypair-271659618", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLwYKDMfs53kGm+WftDUzZ1VNVqC9KTmkChZJ1EgBwnWErpqPk09Ygg+BUqdo4q6ZFj8+mYxVX0mS2OMR2du790zmJ/zShQM7NJMaLKWJqO4vbZRf8BvLoPqzfjoU8xCQ=="}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:40.922307 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-664dbaef-02e0-49f5-9a1c-67d7cd2dbea1 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Getting quotas for project 5cd96a8c91974b8ba7919d5349f380ee. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:32:40.940438 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-664dbaef-02e0-49f5-9a1c-67d7cd2dbea1 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Getting quotas for user 7a427fb7481d4799a83729910f33b01b and project 5cd96a8c91974b8ba7919d5349f380ee. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:32:40.983790 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-664dbaef-02e0-49f5-9a1c-67d7cd2dbea1 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.119843 Aug 04 16:32:40.984608 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 37/67] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 16:32:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:41.071306 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-071a4660-c72b-4289-ba64-11bb87a2dd5d tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Calling method '.version_select at 0x7f7e858d4310>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:41.158232 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-071a4660-c72b-4289-ba64-11bb87a2dd5d tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/9ab13893bf3a49a0b4d88542cdeaa19f" status: 200 len: 371 microversion: 2.1 time: 0.172555 Aug 04 16:32:41.166773 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 38/68] 10.222.0.23 () {58 vars in 1242 bytes} [Thu Aug 4 16:32:40 2022] GET /compute/v2.1/os-quota-sets/9ab13893bf3a49a0b4d88542cdeaa19f => generated 371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:41.196548 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:32:41.356640 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fcca6082-2003-4a89-8540-ffacea25596e tempest-HostsAdminNegativeTestJSON-223532599 tempest-HostsAdminNegativeTestJSON-223532599-project] Calling method '.version_select at 0x7f7e8581ac10>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:41.360604 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:41.360604 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:32:41.366087 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fcca6082-2003-4a89-8540-ffacea25596e tempest-HostsAdminNegativeTestJSON-223532599 tempest-HostsAdminNegativeTestJSON-223532599-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '9da47d00cf544844847ff9fecd1cae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ccfa7ef0d74211865f82afe0eabe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:41.387913 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fcca6082-2003-4a89-8540-ffacea25596e tempest-HostsAdminNegativeTestJSON-223532599 tempest-HostsAdminNegativeTestJSON-223532599-project] Request method failure captured: Aug 04 16:32:41.387913 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 04 16:32:41.387913 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:32:41.387913 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:32:41.387913 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:32:41.387913 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:32:41.387913 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:32:41.387913 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:32:41.387913 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:32:41.387913 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:32:41.387913 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_SkjD2z-pH5ZY__8tv435ATI1YMkCOjDbnm0lN2Ze7S59a-V3465-l8m-PTfEryNmt2AZW46g-KaESQyDDlcDZjZ2e0ez9nlz_QCcj0C4046nO5EdyDz4T9nE0fzHo8PtJsGKhVmtKJWVqGF1uokuv33qetwKqbI9i5Pc6_EL9OGgw Aug 04 16:32:41.387913 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:32:41.387913 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:32:41.387913 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:32:41.387913 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:32:41.387913 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:32:41.387913 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:32:41.387913 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 53ccfa7ef0d74211865f82afe0eabe5b Aug 04 16:32:41.387913 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-223532599 Aug 04 16:32:41.387913 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:32:41.387913 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:32:41.389225 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/53ccfa7ef0d74211865f82afe0eabe5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_53ccfa7ef0d74211865f82afe0eabe5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/53ccfa7ef0d74211865f82afe0eabe5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/53ccfa7ef0d74211865f82afe0eabe5b"}]}] Aug 04 16:32:41.389225 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-HostsAdminNegativeTestJSON-223532599 Aug 04 16:32:41.389225 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 53ccfa7ef0d74211865f82afe0eabe5b Aug 04 16:32:41.389225 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-223532599 Aug 04 16:32:41.389225 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-HostsAdminNegativeTestJSON-223532599-project Aug 04 16:32:41.389225 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:32:41.389225 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:32:41.389225 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 9da47d00cf544844847ff9fecd1cae67 Aug 04 16:32:41.389225 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-HostsAdminNegativeTestJSON-223532599-project Aug 04 16:32:41.389225 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:32:41.389225 n-d-846466-12 devstack@n-api.service[126126]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 04 16:32:41.389225 n-d-846466-12 devstack@n-api.service[126126]: action_args: {} Aug 04 16:32:41.389225 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:32:41.390015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:41.390015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:41.390015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:41.390015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:32:41.390015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:32:41.390015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:32:41.390015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:32:41.390015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 16:32:41.390015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:32:41.390015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:32:41.390015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:32:41.390015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 04 16:32:41.390015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 04 16:32:41.390015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:32:41.390015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:32:41.390015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:32:41.390015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:32:41.390015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:32:41.390015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:32:41.391111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:32:41.391111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:32:41.391111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:32:41.391111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:32:41.391111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:32:41.391111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:32:41.391111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:32:41.391111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:32:41.391111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 04 16:32:41.391111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:41.391111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:32:41.391111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:41.391111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:41.391111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:41.391111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:41.391111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:32:41.391111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:32:41.391111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 04 16:32:41.391111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:41.393609 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fcca6082-2003-4a89-8540-ffacea25596e tempest-HostsAdminNegativeTestJSON-223532599 tempest-HostsAdminNegativeTestJSON-223532599-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:32:41.393609 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fcca6082-2003-4a89-8540-ffacea25596e tempest-HostsAdminNegativeTestJSON-223532599 tempest-HostsAdminNegativeTestJSON-223532599-project] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.230087 Aug 04 16:32:41.401126 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 39/69] 10.222.0.23 () {58 vars in 1128 bytes} [Thu Aug 4 16:32:41 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 241 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:32:41.411946 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-5375006f-fe78-48a5-8839-8508f1f36138 req-46a2098b-7ee6-4d84-ac18-131bd8f8b809 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5961044f-b35a-4051-b041-84548b5965d5", "tag": "d461805a-8b8b-408f-9fa3-99e31d86b832"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:41.445517 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-5375006f-fe78-48a5-8839-8508f1f36138 req-46a2098b-7ee6-4d84-ac18-131bd8f8b809 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:41.446599 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-5375006f-fe78-48a5-8839-8508f1f36138 req-46a2098b-7ee6-4d84-ac18-131bd8f8b809 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:41.472674 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-5375006f-fe78-48a5-8839-8508f1f36138 req-46a2098b-7ee6-4d84-ac18-131bd8f8b809 service nova] Creating event network-changed:d461805a-8b8b-408f-9fa3-99e31d86b832 for instance 5961044f-b35a-4051-b041-84548b5965d5 on n-h2-846466-12 Aug 04 16:32:41.502938 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-5375006f-fe78-48a5-8839-8508f1f36138 req-46a2098b-7ee6-4d84-ac18-131bd8f8b809 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099295 Aug 04 16:32:41.505916 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 40/70] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:41.526290 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-31d87ba0-8447-4db8-b336-1f851d4f84f6 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:41.527545 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-31d87ba0-8447-4db8-b336-1f851d4f84f6 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] [instance: 5961044f-b35a-4051-b041-84548b5965d5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:41.559039 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-31d87ba0-8447-4db8-b336-1f851d4f84f6 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:41.559701 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-31d87ba0-8447-4db8-b336-1f851d4f84f6 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:41.561452 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-31d87ba0-8447-4db8-b336-1f851d4f84f6 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:41.563677 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-31d87ba0-8447-4db8-b336-1f851d4f84f6 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:41.986649 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-31d87ba0-8447-4db8-b336-1f851d4f84f6 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9134e4e91c6a4139a4dd8d2865a6cb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce23f198a99464ab95a3e5f98dde567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:41.999501 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-31d87ba0-8447-4db8-b336-1f851d4f84f6 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] 10.222.0.23 "GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5" status: 200 len: 1337 microversion: 2.1 time: 0.489005 Aug 04 16:32:42.012821 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 41/71] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:41 2022] GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5 => generated 1337 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:42.028177 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d286091f-5d9d-4a4a-baf6-f28a470d0d05 tempest-FlavorsExtraSpecsTestJSON-1828125916 tempest-FlavorsExtraSpecsTestJSON-1828125916-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:42.045802 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d286091f-5d9d-4a4a-baf6-f28a470d0d05 tempest-FlavorsExtraSpecsTestJSON-1828125916 tempest-FlavorsExtraSpecsTestJSON-1828125916-project] 10.222.0.23 "GET /compute/v2.1/flavors/909288872/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.040801 Aug 04 16:32:42.064016 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 42/72] 10.222.0.23 () {58 vars in 1242 bytes} [Thu Aug 4 16:32:42 2022] GET /compute/v2.1/flavors/909288872/os-extra_specs/hw:numa_nodes => generated 22 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:32:42.069222 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-25370138-60bf-447a-be9e-d11b36033d63 tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Action: 'update', calling method: .version_select at 0x7f7e8581a820>, body: {"quota_set": {"ram": "5120"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:42.184485 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-25370138-60bf-447a-be9e-d11b36033d63 tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:42.190245 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-25370138-60bf-447a-be9e-d11b36033d63 tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:42.191734 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-25370138-60bf-447a-be9e-d11b36033d63 tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:42.193233 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-25370138-60bf-447a-be9e-d11b36033d63 tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:42.353586 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-25370138-60bf-447a-be9e-d11b36033d63 tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/9ab13893bf3a49a0b4d88542cdeaa19f" status: 200 len: 328 microversion: 2.1 time: 0.288023 Aug 04 16:32:42.357546 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 43/73] 10.222.0.23 () {60 vars in 1262 bytes} [Thu Aug 4 16:32:42 2022] PUT /compute/v2.1/os-quota-sets/9ab13893bf3a49a0b4d88542cdeaa19f => generated 328 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:42.364708 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6e6cfad2-9287-40e1-bd93-26c26b11fc82 tempest-HostsAdminNegativeTestJSON-223532599 tempest-HostsAdminNegativeTestJSON-223532599-project] Calling method '.version_select at 0x7f7e857470d0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:42.367869 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:42.367869 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:32:42.370631 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6e6cfad2-9287-40e1-bd93-26c26b11fc82 tempest-HostsAdminNegativeTestJSON-223532599 tempest-HostsAdminNegativeTestJSON-223532599-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '9da47d00cf544844847ff9fecd1cae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ccfa7ef0d74211865f82afe0eabe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:42.372978 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6e6cfad2-9287-40e1-bd93-26c26b11fc82 tempest-HostsAdminNegativeTestJSON-223532599 tempest-HostsAdminNegativeTestJSON-223532599-project] Request method failure captured: Aug 04 16:32:42.372978 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/os-hosts/n-d-846466-12/reboot HTTP/1.1 Aug 04 16:32:42.372978 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:32:42.372978 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:32:42.372978 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:32:42.372978 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:32:42.372978 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:32:42.372978 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:32:42.372978 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:32:42.372978 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:32:42.372978 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_SkjD2z-pH5ZY__8tv435ATI1YMkCOjDbnm0lN2Ze7S59a-V3465-l8m-PTfEryNmt2AZW46g-KaESQyDDlcDZjZ2e0ez9nlz_QCcj0C4046nO5EdyDz4T9nE0fzHo8PtJsGKhVmtKJWVqGF1uokuv33qetwKqbI9i5Pc6_EL9OGgw Aug 04 16:32:42.372978 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:32:42.372978 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:32:42.372978 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:32:42.372978 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:32:42.372978 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:32:42.372978 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:32:42.372978 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 53ccfa7ef0d74211865f82afe0eabe5b Aug 04 16:32:42.372978 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-223532599 Aug 04 16:32:42.372978 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:32:42.372978 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:32:42.374400 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/53ccfa7ef0d74211865f82afe0eabe5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_53ccfa7ef0d74211865f82afe0eabe5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/53ccfa7ef0d74211865f82afe0eabe5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/53ccfa7ef0d74211865f82afe0eabe5b"}]}] Aug 04 16:32:42.374400 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-HostsAdminNegativeTestJSON-223532599 Aug 04 16:32:42.374400 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 53ccfa7ef0d74211865f82afe0eabe5b Aug 04 16:32:42.374400 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-223532599 Aug 04 16:32:42.374400 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-HostsAdminNegativeTestJSON-223532599-project Aug 04 16:32:42.374400 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:32:42.374400 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:32:42.374400 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 9da47d00cf544844847ff9fecd1cae67 Aug 04 16:32:42.374400 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-HostsAdminNegativeTestJSON-223532599-project Aug 04 16:32:42.374400 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:32:42.374400 n-d-846466-12 devstack@n-api.service[126126]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 04 16:32:42.374400 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'n-d-846466-12'} Aug 04 16:32:42.374400 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:32:42.375389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:42.375389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:42.375389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:42.375389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:32:42.375389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:32:42.375389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:32:42.375389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:32:42.375389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:32:42.375389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:32:42.375389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 04 16:32:42.375389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 04 16:32:42.375389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:32:42.375389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:32:42.375389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:32:42.375389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:32:42.375389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:32:42.375389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:32:42.375389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:32:42.375389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:32:42.376625 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:32:42.376625 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:32:42.376625 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:32:42.376625 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:32:42.376625 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:32:42.376625 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:32:42.376625 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 04 16:32:42.376625 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:42.376625 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:32:42.376625 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:42.376625 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:42.376625 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:42.376625 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:42.376625 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:32:42.376625 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:32:42.376625 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 04 16:32:42.376625 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:42.382448 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6e6cfad2-9287-40e1-bd93-26c26b11fc82 tempest-HostsAdminNegativeTestJSON-223532599 tempest-HostsAdminNegativeTestJSON-223532599-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:32:42.384750 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6e6cfad2-9287-40e1-bd93-26c26b11fc82 tempest-HostsAdminNegativeTestJSON-223532599 tempest-HostsAdminNegativeTestJSON-223532599-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-d-846466-12/reboot" status: 403 len: 111 microversion: 2.1 time: 0.025544 Aug 04 16:32:42.385860 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 44/74] 10.222.0.23 () {58 vars in 1191 bytes} [Thu Aug 4 16:32:42 2022] GET /compute/v2.1/os-hosts/n-d-846466-12/reboot => generated 111 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:32:42.397854 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5941b3ff-7d9f-40e3-b100-a5775a17c745 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:42.398955 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5941b3ff-7d9f-40e3-b100-a5775a17c745 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: e40c21e9-d19a-4e5f-9c7d-c4507025e94e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:42.413856 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5941b3ff-7d9f-40e3-b100-a5775a17c745 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:42.414953 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5941b3ff-7d9f-40e3-b100-a5775a17c745 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:42.416491 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5941b3ff-7d9f-40e3-b100-a5775a17c745 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:42.417201 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5941b3ff-7d9f-40e3-b100-a5775a17c745 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:42.481222 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=100 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:32:42.745760 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5941b3ff-7d9f-40e3-b100-a5775a17c745 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:42.795506 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5941b3ff-7d9f-40e3-b100-a5775a17c745 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e" status: 200 len: 1319 microversion: 2.1 time: 0.400088 Aug 04 16:32:42.796657 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 45/75] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:42 2022] GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e => generated 1319 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:42.810716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2a7bf6ba-92ca-4a07-84ab-a272761cfe73 tempest-FlavorsExtraSpecsTestJSON-191975643 tempest-FlavorsExtraSpecsTestJSON-191975643-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:42.816085 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:42.816085 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:32:42.875875 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2a7bf6ba-92ca-4a07-84ab-a272761cfe73 tempest-FlavorsExtraSpecsTestJSON-191975643 tempest-FlavorsExtraSpecsTestJSON-191975643-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/909288872/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.076697 Aug 04 16:32:42.882253 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 46/76] 10.222.0.23 () {60 vars in 1221 bytes} [Thu Aug 4 16:32:42 2022] POST /compute/v2.1/flavors/909288872/os-extra_specs => generated 66 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:32:42.889602 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d041967f-343b-4cce-884a-93d8c2baaa65 tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:42.916348 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d041967f-343b-4cce-884a-93d8c2baaa65 tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-quota-sets/9ab13893bf3a49a0b4d88542cdeaa19f" status: 202 len: 0 microversion: 2.1 time: 0.032446 Aug 04 16:32:42.920801 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 47/77] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Aug 4 16:32:42 2022] DELETE /compute/v2.1/os-quota-sets/9ab13893bf3a49a0b4d88542cdeaa19f => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:32:42.932832 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b8f3ffa2-e7de-495a-8322-04219080efe1 tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] Calling method '.version_select at 0x7f7e856fd670>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:42.937949 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:42.937949 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:32:42.968843 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-b8f3ffa2-e7de-495a-8322-04219080efe1 tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:32:42.984517 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b8f3ffa2-e7de-495a-8322-04219080efe1 tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] Request method failure captured: Aug 04 16:32:42.984517 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 04 16:32:42.984517 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:32:42.984517 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:32:42.984517 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:32:42.984517 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:32:42.984517 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:32:42.984517 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:32:42.984517 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:32:42.984517 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:32:42.984517 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_SmjjjiVmYn6NdlSIQSvr-8K67NjNBPFj6eQnLOBUn7CnxemOE7tsjnZMzwsNAH226BxHagXFdirv99tVHb8_CZfG0_ho3JcfG6VRhq-sc_GkN56w9Sw5z80KGOeb4qFedGNQYr_JNlyninrrarLHhQdhccdH0Z0iKSmDHBHtcRWnE Aug 04 16:32:42.984517 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:32:42.984517 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:32:42.984517 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:32:42.984517 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:32:42.984517 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:32:42.984517 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:32:42.984517 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 9cffbdd745484f08960acd9d643e91ec Aug 04 16:32:42.984517 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1989536293 Aug 04 16:32:42.984517 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader,admin Aug 04 16:32:42.984517 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader,admin Aug 04 16:32:42.986022 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9cffbdd745484f08960acd9d643e91ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9cffbdd745484f08960acd9d643e91ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9cffbdd745484f08960acd9d643e91ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9cffbdd745484f08960acd9d643e91ec"}]}] Aug 04 16:32:42.986022 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1989536293 Aug 04 16:32:42.986022 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 9cffbdd745484f08960acd9d643e91ec Aug 04 16:32:42.986022 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1989536293 Aug 04 16:32:42.986022 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-HostsAdminNegativeTestJSON-1989536293-project-admin Aug 04 16:32:42.986022 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:32:42.986022 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:32:42.986022 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: c32002df48fc4282b75af840899bfe7b Aug 04 16:32:42.986022 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1989536293-project-admin Aug 04 16:32:42.986022 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:32:42.986022 n-d-846466-12 devstack@n-api.service[126126]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:32:42.986022 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'nonexistent_hostname'} Aug 04 16:32:42.986022 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:32:42.987226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:42.987226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 04 16:32:42.987226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 04 16:32:42.987226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 16:32:42.987226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 16:32:42.987226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:32:42.987226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:32:42.987226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:32:42.987226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:32:42.987226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 16:32:42.987226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 16:32:42.987226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 04 16:32:42.987226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 04 16:32:42.987226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:32:42.987226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:32:42.987226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 04 16:32:42.987226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 04 16:32:42.987226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:32:42.987226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:32:42.988640 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 04 16:32:42.988640 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 04 16:32:42.988640 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:32:42.988640 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:42.988640 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:32:42.988640 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:42.988640 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:42.988640 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:42.988640 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:42.988640 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:32:42.988640 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:32:42.988640 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:32:42.988640 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:32:42.988640 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:32:42.988640 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:32:42.988640 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 04 16:32:42.988640 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 04 16:32:42.988640 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 04 16:32:42.988640 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:32:42.990495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:32:42.990495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:42.990495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:32:42.990495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:42.990495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:42.990495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:42.990495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:42.990495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:32:42.990495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:32:42.990495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:32:42.990495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:42.992589 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b8f3ffa2-e7de-495a-8322-04219080efe1 tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:32:42.996326 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b8f3ffa2-e7de-495a-8322-04219080efe1 tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.073299 Aug 04 16:32:43.001835 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 48/78] 10.222.0.23 () {58 vars in 1212 bytes} [Thu Aug 4 16:32:42 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:32:43.008628 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5554d153-66bb-4a7a-a919-0eb74c0739fc tempest-FlavorsExtraSpecsTestJSON-191975643 tempest-FlavorsExtraSpecsTestJSON-191975643-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:43.036525 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5554d153-66bb-4a7a-a919-0eb74c0739fc tempest-FlavorsExtraSpecsTestJSON-191975643 tempest-FlavorsExtraSpecsTestJSON-191975643-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/909288872/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.032512 Aug 04 16:32:43.041699 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 49/79] 10.222.0.23 () {58 vars in 1200 bytes} [Thu Aug 4 16:32:43 2022] GET /compute/v2.1/flavors/909288872/os-extra_specs => generated 66 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:32:43.048819 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-664098e5-d7f5-4f8b-bc6a-2268b58e3dbe tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Calling method '.version_select at 0x7f7e8565bdc0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:43.213087 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-664098e5-d7f5-4f8b-bc6a-2268b58e3dbe tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/9ab13893bf3a49a0b4d88542cdeaa19f" status: 200 len: 371 microversion: 2.1 time: 0.169672 Aug 04 16:32:43.224477 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 50/80] 10.222.0.23 () {58 vars in 1242 bytes} [Thu Aug 4 16:32:43 2022] GET /compute/v2.1/os-quota-sets/9ab13893bf3a49a0b4d88542cdeaa19f => generated 371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:43.234016 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bad418e1-e323-45ad-add2-a77a2320ac0c tempest-HostsAdminNegativeTestJSON-223532599 tempest-HostsAdminNegativeTestJSON-223532599-project] Calling method '.version_select at 0x7f7e8565b940>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:43.235122 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:43.235122 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:32:43.237320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bad418e1-e323-45ad-add2-a77a2320ac0c tempest-HostsAdminNegativeTestJSON-223532599 tempest-HostsAdminNegativeTestJSON-223532599-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '9da47d00cf544844847ff9fecd1cae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ccfa7ef0d74211865f82afe0eabe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:43.242559 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bad418e1-e323-45ad-add2-a77a2320ac0c tempest-HostsAdminNegativeTestJSON-223532599 tempest-HostsAdminNegativeTestJSON-223532599-project] Request method failure captured: Aug 04 16:32:43.242559 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/os-hosts/n-d-846466-12 HTTP/1.1 Aug 04 16:32:43.242559 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:32:43.242559 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:32:43.242559 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:32:43.242559 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:32:43.242559 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:32:43.242559 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:32:43.242559 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:32:43.242559 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:32:43.242559 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_SkjD2z-pH5ZY__8tv435ATI1YMkCOjDbnm0lN2Ze7S59a-V3465-l8m-PTfEryNmt2AZW46g-KaESQyDDlcDZjZ2e0ez9nlz_QCcj0C4046nO5EdyDz4T9nE0fzHo8PtJsGKhVmtKJWVqGF1uokuv33qetwKqbI9i5Pc6_EL9OGgw Aug 04 16:32:43.242559 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:32:43.242559 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:32:43.242559 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:32:43.242559 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:32:43.242559 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:32:43.242559 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:32:43.242559 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 53ccfa7ef0d74211865f82afe0eabe5b Aug 04 16:32:43.242559 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-223532599 Aug 04 16:32:43.242559 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:32:43.242559 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:32:43.243953 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/53ccfa7ef0d74211865f82afe0eabe5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_53ccfa7ef0d74211865f82afe0eabe5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/53ccfa7ef0d74211865f82afe0eabe5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/53ccfa7ef0d74211865f82afe0eabe5b"}]}] Aug 04 16:32:43.243953 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-HostsAdminNegativeTestJSON-223532599 Aug 04 16:32:43.243953 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 53ccfa7ef0d74211865f82afe0eabe5b Aug 04 16:32:43.243953 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-223532599 Aug 04 16:32:43.243953 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-HostsAdminNegativeTestJSON-223532599-project Aug 04 16:32:43.243953 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:32:43.243953 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:32:43.243953 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 9da47d00cf544844847ff9fecd1cae67 Aug 04 16:32:43.243953 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-HostsAdminNegativeTestJSON-223532599-project Aug 04 16:32:43.243953 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:32:43.243953 n-d-846466-12 devstack@n-api.service[126126]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 04 16:32:43.243953 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'n-d-846466-12'} Aug 04 16:32:43.243953 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:32:43.244660 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:43.244660 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:43.244660 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:43.244660 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:32:43.244660 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:32:43.244660 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:32:43.244660 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:32:43.244660 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:32:43.244660 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:32:43.244660 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 04 16:32:43.244660 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 04 16:32:43.244660 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:32:43.244660 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:32:43.244660 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:32:43.244660 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:32:43.244660 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:32:43.244660 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:32:43.244660 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:32:43.244660 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:32:43.246243 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:32:43.246243 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:32:43.246243 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:32:43.246243 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:32:43.246243 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:32:43.246243 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:32:43.246243 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 04 16:32:43.246243 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:43.246243 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:32:43.246243 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:43.246243 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:43.246243 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:43.246243 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:43.246243 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:32:43.246243 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:32:43.246243 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 04 16:32:43.246243 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:43.254976 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bad418e1-e323-45ad-add2-a77a2320ac0c tempest-HostsAdminNegativeTestJSON-223532599 tempest-HostsAdminNegativeTestJSON-223532599-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:32:43.254976 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bad418e1-e323-45ad-add2-a77a2320ac0c tempest-HostsAdminNegativeTestJSON-223532599 tempest-HostsAdminNegativeTestJSON-223532599-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-d-846466-12" status: 403 len: 109 microversion: 2.1 time: 0.024925 Aug 04 16:32:43.254976 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 51/81] 10.222.0.23 () {58 vars in 1170 bytes} [Thu Aug 4 16:32:43 2022] GET /compute/v2.1/os-hosts/n-d-846466-12 => generated 109 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:32:43.258830 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1d8ab787-b80d-460a-92c7-c23c7d81b337 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:43.265549 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1d8ab787-b80d-460a-92c7-c23c7d81b337 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] [instance: 5961044f-b35a-4051-b041-84548b5965d5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:43.277909 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d8ab787-b80d-460a-92c7-c23c7d81b337 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:43.281322 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d8ab787-b80d-460a-92c7-c23c7d81b337 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:43.284192 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d8ab787-b80d-460a-92c7-c23c7d81b337 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:43.284886 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d8ab787-b80d-460a-92c7-c23c7d81b337 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:43.415408 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-efcbf977-ac84-4563-80c7-267f18a7410b tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] validate_networks() for None {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:32:43.645794 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1d8ab787-b80d-460a-92c7-c23c7d81b337 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9134e4e91c6a4139a4dd8d2865a6cb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce23f198a99464ab95a3e5f98dde567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:43.663074 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1d8ab787-b80d-460a-92c7-c23c7d81b337 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] 10.222.0.23 "GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5" status: 200 len: 1337 microversion: 2.1 time: 0.412677 Aug 04 16:32:43.663803 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 52/82] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:43 2022] GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5 => generated 1337 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:43.670127 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f9a595bc-2c22-42d5-9011-0e075138b7a3 tempest-FlavorsExtraSpecsTestJSON-191975643 tempest-FlavorsExtraSpecsTestJSON-191975643-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:43.696662 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:43.696662 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:32:43.720070 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:RELEASE=6,nova_api:SAVEPOINT=5,nova_api:INSERT=4,nova_api:SELECT=83,nova_api:DELETE=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:32:43.774175 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f9a595bc-2c22-42d5-9011-0e075138b7a3 tempest-FlavorsExtraSpecsTestJSON-191975643 tempest-FlavorsExtraSpecsTestJSON-191975643-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/909288872/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.107732 Aug 04 16:32:43.779213 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 53/83] 10.222.0.23 () {60 vars in 1262 bytes} [Thu Aug 4 16:32:43 2022] PUT /compute/v2.1/flavors/909288872/os-extra_specs/hw:numa_nodes => generated 22 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:32:43.784615 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dd0552cc-d688-4f21-9d0c-0f23d8d666a7 tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] Calling method '.version_select at 0x7f7e8565be50>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:43.785814 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:43.785814 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:32:43.792157 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-dd0552cc-d688-4f21-9d0c-0f23d8d666a7 tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:32:43.794351 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dd0552cc-d688-4f21-9d0c-0f23d8d666a7 tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] Request method failure captured: Aug 04 16:32:43.794351 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 04 16:32:43.794351 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:32:43.794351 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:32:43.794351 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:32:43.794351 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:32:43.794351 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:32:43.794351 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:32:43.794351 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:32:43.794351 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:32:43.794351 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_SmjjjiVmYn6NdlSIQSvr-8K67NjNBPFj6eQnLOBUn7CnxemOE7tsjnZMzwsNAH226BxHagXFdirv99tVHb8_CZfG0_ho3JcfG6VRhq-sc_GkN56w9Sw5z80KGOeb4qFedGNQYr_JNlyninrrarLHhQdhccdH0Z0iKSmDHBHtcRWnE Aug 04 16:32:43.794351 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:32:43.794351 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:32:43.794351 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:32:43.794351 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:32:43.794351 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:32:43.794351 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:32:43.794351 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 9cffbdd745484f08960acd9d643e91ec Aug 04 16:32:43.794351 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1989536293 Aug 04 16:32:43.794351 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader,admin Aug 04 16:32:43.794351 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader,admin Aug 04 16:32:43.795815 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9cffbdd745484f08960acd9d643e91ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9cffbdd745484f08960acd9d643e91ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9cffbdd745484f08960acd9d643e91ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9cffbdd745484f08960acd9d643e91ec"}]}] Aug 04 16:32:43.795815 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1989536293 Aug 04 16:32:43.795815 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 9cffbdd745484f08960acd9d643e91ec Aug 04 16:32:43.795815 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1989536293 Aug 04 16:32:43.795815 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-HostsAdminNegativeTestJSON-1989536293-project-admin Aug 04 16:32:43.795815 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:32:43.795815 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:32:43.795815 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: c32002df48fc4282b75af840899bfe7b Aug 04 16:32:43.795815 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1989536293-project-admin Aug 04 16:32:43.795815 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:32:43.795815 n-d-846466-12 devstack@n-api.service[126126]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:32:43.795815 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'nonexistent_hostname'} Aug 04 16:32:43.795815 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:32:43.797495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:43.797495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 04 16:32:43.797495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 04 16:32:43.797495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:32:43.797495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:32:43.797495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 04 16:32:43.797495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 04 16:32:43.797495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:32:43.797495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:32:43.797495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 04 16:32:43.797495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 04 16:32:43.797495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:32:43.797495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:43.797495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:32:43.797495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:43.797495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:43.797495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:43.797495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:43.797495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:32:43.798498 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:32:43.798498 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:32:43.798498 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:32:43.798498 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:32:43.798498 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:32:43.798498 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 04 16:32:43.798498 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:32:43.798498 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:32:43.798498 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:43.798498 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:32:43.798498 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:43.798498 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:43.798498 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:43.798498 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:43.798498 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:32:43.798498 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:32:43.798498 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:32:43.798498 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:43.800692 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dd0552cc-d688-4f21-9d0c-0f23d8d666a7 tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:32:43.800692 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dd0552cc-d688-4f21-9d0c-0f23d8d666a7 tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.015312 Aug 04 16:32:43.801199 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 54/84] 10.222.0.23 () {58 vars in 1191 bytes} [Thu Aug 4 16:32:43 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:32:43.806887 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c3592750-59bb-4149-bd62-12152e1410dd tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Calling method '.version_select at 0x7f7e85669af0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:43.852198 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-efcbf977-ac84-4563-80c7-267f18a7410b tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:32:43.852769 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-efcbf977-ac84-4563-80c7-267f18a7410b tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:32:43.853245 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-efcbf977-ac84-4563-80c7-267f18a7410b tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:32:43.854158 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-efcbf977-ac84-4563-80c7-267f18a7410b tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:32:43.854747 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-efcbf977-ac84-4563-80c7-267f18a7410b tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:32:43.870513 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-efcbf977-ac84-4563-80c7-267f18a7410b tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:43.872751 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-efcbf977-ac84-4563-80c7-267f18a7410b tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:43.874995 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-efcbf977-ac84-4563-80c7-267f18a7410b tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:43.875677 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-efcbf977-ac84-4563-80c7-267f18a7410b tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:43.901164 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-efcbf977-ac84-4563-80c7-267f18a7410b tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Getting quotas for project 10b0ceaab59d4aeaa8667cef6f62559e. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:32:43.907866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-efcbf977-ac84-4563-80c7-267f18a7410b tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Getting quotas for user 052613a51b86400c916dbc800563896c and project 10b0ceaab59d4aeaa8667cef6f62559e. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:32:43.925610 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-efcbf977-ac84-4563-80c7-267f18a7410b tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:32:43.929433 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-efcbf977-ac84-4563-80c7-267f18a7410b tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: dc4b9aed-b141-46b5-a62b-a039640c6310] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:32:43.996532 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-efcbf977-ac84-4563-80c7-267f18a7410b tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 13.991197 Aug 04 16:32:43.997792 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 31/85] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:32:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 13994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:32:44.004331 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7019d5ee-76db-48f4-bc05-ac9e04f53b5b tempest-FlavorsExtraSpecsTestJSON-191975643 tempest-FlavorsExtraSpecsTestJSON-191975643-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:44.013468 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7019d5ee-76db-48f4-bc05-ac9e04f53b5b tempest-FlavorsExtraSpecsTestJSON-191975643 tempest-FlavorsExtraSpecsTestJSON-191975643-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/909288872/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.014576 Aug 04 16:32:44.014805 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 32/86] 10.222.0.23 () {58 vars in 1200 bytes} [Thu Aug 4 16:32:43 2022] GET /compute/v2.1/flavors/909288872/os-extra_specs => generated 66 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:32:44.020498 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-88efda26-fb86-4530-bd01-a21b7a1f1f40 tempest-HostsAdminNegativeTestJSON-223532599 tempest-HostsAdminNegativeTestJSON-223532599-project] Calling method '.version_select at 0x7f7e84f559d0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:44.021604 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:44.021604 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:32:44.022940 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-88efda26-fb86-4530-bd01-a21b7a1f1f40 tempest-HostsAdminNegativeTestJSON-223532599 tempest-HostsAdminNegativeTestJSON-223532599-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '9da47d00cf544844847ff9fecd1cae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ccfa7ef0d74211865f82afe0eabe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:44.026047 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-88efda26-fb86-4530-bd01-a21b7a1f1f40 tempest-HostsAdminNegativeTestJSON-223532599 tempest-HostsAdminNegativeTestJSON-223532599-project] Request method failure captured: Aug 04 16:32:44.026047 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/os-hosts/n-d-846466-12/shutdown HTTP/1.1 Aug 04 16:32:44.026047 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:32:44.026047 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:32:44.026047 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:32:44.026047 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:32:44.026047 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:32:44.026047 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:32:44.026047 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:32:44.026047 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:32:44.026047 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_SkjD2z-pH5ZY__8tv435ATI1YMkCOjDbnm0lN2Ze7S59a-V3465-l8m-PTfEryNmt2AZW46g-KaESQyDDlcDZjZ2e0ez9nlz_QCcj0C4046nO5EdyDz4T9nE0fzHo8PtJsGKhVmtKJWVqGF1uokuv33qetwKqbI9i5Pc6_EL9OGgw Aug 04 16:32:44.026047 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:32:44.026047 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:32:44.026047 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:32:44.026047 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:32:44.026047 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:32:44.026047 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:32:44.026047 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 53ccfa7ef0d74211865f82afe0eabe5b Aug 04 16:32:44.026047 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-223532599 Aug 04 16:32:44.026047 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:32:44.026047 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:32:44.027390 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/53ccfa7ef0d74211865f82afe0eabe5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_53ccfa7ef0d74211865f82afe0eabe5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/53ccfa7ef0d74211865f82afe0eabe5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/53ccfa7ef0d74211865f82afe0eabe5b"}]}] Aug 04 16:32:44.027390 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-HostsAdminNegativeTestJSON-223532599 Aug 04 16:32:44.027390 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 53ccfa7ef0d74211865f82afe0eabe5b Aug 04 16:32:44.027390 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-223532599 Aug 04 16:32:44.027390 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-HostsAdminNegativeTestJSON-223532599-project Aug 04 16:32:44.027390 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:32:44.027390 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:32:44.027390 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 9da47d00cf544844847ff9fecd1cae67 Aug 04 16:32:44.027390 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-HostsAdminNegativeTestJSON-223532599-project Aug 04 16:32:44.027390 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:32:44.027390 n-d-846466-12 devstack@n-api.service[126125]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 04 16:32:44.027390 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'n-d-846466-12'} Aug 04 16:32:44.027390 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:32:44.028190 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:44.028190 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:44.028190 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:44.028190 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:32:44.028190 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:32:44.028190 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:32:44.028190 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:32:44.028190 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:32:44.028190 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:32:44.028190 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 04 16:32:44.028190 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 04 16:32:44.028190 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:32:44.028190 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:32:44.028190 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:32:44.028190 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:32:44.028190 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:32:44.028190 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:32:44.028190 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:32:44.028190 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:32:44.029512 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:32:44.029512 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:32:44.029512 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:32:44.029512 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:32:44.029512 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:32:44.029512 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:32:44.029512 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 04 16:32:44.029512 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:32:44.029512 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:32:44.029512 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:32:44.029512 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:44.029512 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:44.029512 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:44.029512 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:32:44.029512 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:32:44.029512 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 04 16:32:44.029512 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:32:44.030595 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-88efda26-fb86-4530-bd01-a21b7a1f1f40 tempest-HostsAdminNegativeTestJSON-223532599 tempest-HostsAdminNegativeTestJSON-223532599-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:32:44.030595 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-88efda26-fb86-4530-bd01-a21b7a1f1f40 tempest-HostsAdminNegativeTestJSON-223532599 tempest-HostsAdminNegativeTestJSON-223532599-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-d-846466-12/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.011380 Aug 04 16:32:44.030595 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 33/87] 10.222.0.23 () {58 vars in 1197 bytes} [Thu Aug 4 16:32:44 2022] GET /compute/v2.1/os-hosts/n-d-846466-12/shutdown => generated 113 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:32:44.033528 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2acf4160-8911-4174-99db-50b7abb5557c tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:44.034329 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2acf4160-8911-4174-99db-50b7abb5557c tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: e40c21e9-d19a-4e5f-9c7d-c4507025e94e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:44.041780 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2acf4160-8911-4174-99db-50b7abb5557c tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:44.042322 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2acf4160-8911-4174-99db-50b7abb5557c tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:44.043428 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2acf4160-8911-4174-99db-50b7abb5557c tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:44.043984 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2acf4160-8911-4174-99db-50b7abb5557c tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:44.057632 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c3592750-59bb-4149-bd62-12152e1410dd tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/d552456ac9664a5cb7d8d2ef40f158df/defaults" status: 200 len: 371 microversion: 2.1 time: 0.255612 Aug 04 16:32:44.058306 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 55/88] 10.222.0.23 () {58 vars in 1269 bytes} [Thu Aug 4 16:32:43 2022] GET /compute/v2.1/os-quota-sets/d552456ac9664a5cb7d8d2ef40f158df/defaults => generated 371 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:44.076016 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-05fb80c1-0a75-41ab-b743-73269673d238 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-2033891024", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "1896151957", "adminPass": "***", "networks": [{"uuid": "07ae128f-d870-4ee5-a69c-fe59fccdadb9"}], "security_groups": [{"name": "tempest-securitygroup--1113529029"}], "key_name": "tempest-keypair-271659618", "user_data": "}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:44.256106 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2acf4160-8911-4174-99db-50b7abb5557c tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:44.261562 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-05fb80c1-0a75-41ab-b743-73269673d238 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] validate_networks() for [('07ae128f-d870-4ee5-a69c-fe59fccdadb9', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:32:44.278267 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2acf4160-8911-4174-99db-50b7abb5557c tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e" status: 200 len: 1319 microversion: 2.1 time: 0.249219 Aug 04 16:32:44.278888 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 34/89] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:44 2022] GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:44.289791 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-975f9e1b-bf30-4d10-b045-8f19b7982178 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:44.290400 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-975f9e1b-bf30-4d10-b045-8f19b7982178 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: dc4b9aed-b141-46b5-a62b-a039640c6310] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:44.547158 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-975f9e1b-bf30-4d10-b045-8f19b7982178 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052613a51b86400c916dbc800563896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0ceaab59d4aeaa8667cef6f62559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:44.560220 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-975f9e1b-bf30-4d10-b045-8f19b7982178 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "GET /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310" status: 200 len: 1218 microversion: 2.1 time: 0.280035 Aug 04 16:32:44.560806 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 35/90] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:44 2022] GET /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310 => generated 1218 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:44.565372 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1a7300b1-b353-44c3-b533-5de05a28c4ce tempest-FlavorsExtraSpecsTestJSON-191975643 tempest-FlavorsExtraSpecsTestJSON-191975643-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:44.566146 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:44.566146 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:32:44.596800 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1a7300b1-b353-44c3-b533-5de05a28c4ce tempest-FlavorsExtraSpecsTestJSON-191975643 tempest-FlavorsExtraSpecsTestJSON-191975643-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/909288872/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.034809 Aug 04 16:32:44.597499 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 36/91] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Aug 4 16:32:44 2022] DELETE /compute/v2.1/flavors/909288872/os-extra_specs/hw:numa_nodes => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 16:32:44.603002 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-47463d35-4e7d-4552-bae1-94b43064b1b4 tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] Calling method '.version_select at 0x7f7e84f851f0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:44.603824 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:44.603824 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:32:44.614803 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-47463d35-4e7d-4552-bae1-94b43064b1b4 tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:32:44.620965 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-47463d35-4e7d-4552-bae1-94b43064b1b4 tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] Request method failure captured: Aug 04 16:32:44.620965 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 04 16:32:44.620965 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:32:44.620965 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:32:44.620965 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:32:44.620965 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:32:44.620965 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:32:44.620965 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:32:44.620965 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:32:44.620965 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:32:44.620965 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_SmjjjiVmYn6NdlSIQSvr-8K67NjNBPFj6eQnLOBUn7CnxemOE7tsjnZMzwsNAH226BxHagXFdirv99tVHb8_CZfG0_ho3JcfG6VRhq-sc_GkN56w9Sw5z80KGOeb4qFedGNQYr_JNlyninrrarLHhQdhccdH0Z0iKSmDHBHtcRWnE Aug 04 16:32:44.620965 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:32:44.620965 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:32:44.620965 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:32:44.620965 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:32:44.620965 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:32:44.620965 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:32:44.620965 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 9cffbdd745484f08960acd9d643e91ec Aug 04 16:32:44.620965 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1989536293 Aug 04 16:32:44.620965 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader,admin Aug 04 16:32:44.620965 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader,admin Aug 04 16:32:44.622496 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9cffbdd745484f08960acd9d643e91ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9cffbdd745484f08960acd9d643e91ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9cffbdd745484f08960acd9d643e91ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9cffbdd745484f08960acd9d643e91ec"}]}] Aug 04 16:32:44.622496 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1989536293 Aug 04 16:32:44.622496 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 9cffbdd745484f08960acd9d643e91ec Aug 04 16:32:44.622496 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1989536293 Aug 04 16:32:44.622496 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-HostsAdminNegativeTestJSON-1989536293-project-admin Aug 04 16:32:44.622496 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:32:44.622496 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:32:44.622496 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: c32002df48fc4282b75af840899bfe7b Aug 04 16:32:44.622496 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1989536293-project-admin Aug 04 16:32:44.622496 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:32:44.622496 n-d-846466-12 devstack@n-api.service[126125]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:32:44.622496 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'nonexistent_hostname'} Aug 04 16:32:44.622496 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:32:44.623230 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:44.623230 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 04 16:32:44.623230 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 04 16:32:44.623230 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 16:32:44.623230 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 16:32:44.623230 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:32:44.623230 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:32:44.623230 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:32:44.623230 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:32:44.623230 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 16:32:44.623230 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 16:32:44.623230 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 04 16:32:44.623230 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 04 16:32:44.623230 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:32:44.623230 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:32:44.623230 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 04 16:32:44.623230 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 04 16:32:44.623230 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:32:44.623230 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:32:44.624665 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 04 16:32:44.624665 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 04 16:32:44.624665 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:32:44.624665 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:32:44.624665 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:32:44.624665 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:32:44.624665 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:44.624665 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:44.624665 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:44.624665 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:32:44.624665 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:32:44.624665 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:32:44.624665 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:32:44.624665 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:32:44.624665 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:32:44.624665 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 04 16:32:44.624665 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 04 16:32:44.624665 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 04 16:32:44.624665 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:32:44.625712 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:32:44.625712 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:32:44.625712 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:32:44.625712 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:32:44.625712 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:44.625712 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:44.625712 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:44.625712 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:32:44.625712 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:32:44.625712 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:32:44.625712 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:32:44.625712 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-47463d35-4e7d-4552-bae1-94b43064b1b4 tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:32:44.625712 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-47463d35-4e7d-4552-bae1-94b43064b1b4 tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.023931 Aug 04 16:32:44.625712 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 37/92] 10.222.0.23 () {58 vars in 1218 bytes} [Thu Aug 4 16:32:44 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:32:44.628627 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-774b4404-41e4-4cbe-abcf-82a0e1aecbaf tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Action: 'update', calling method: .version_select at 0x7f7e84eb55e0>, body: {"quota_set": {"ram": "5120"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:44.761590 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-774b4404-41e4-4cbe-abcf-82a0e1aecbaf tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:44.762086 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-774b4404-41e4-4cbe-abcf-82a0e1aecbaf tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:44.762821 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-774b4404-41e4-4cbe-abcf-82a0e1aecbaf tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:44.763248 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-774b4404-41e4-4cbe-abcf-82a0e1aecbaf tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:44.824770 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-774b4404-41e4-4cbe-abcf-82a0e1aecbaf tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/163ed32295b24ec1b097930cdd1da98e" status: 200 len: 328 microversion: 2.1 time: 0.200763 Aug 04 16:32:44.825581 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 38/93] 10.222.0.23 () {60 vars in 1262 bytes} [Thu Aug 4 16:32:44 2022] PUT /compute/v2.1/os-quota-sets/163ed32295b24ec1b097930cdd1da98e => generated 328 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:44.830214 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cac385d9-a531-4d5b-829e-26b44173d137 tempest-FlavorsExtraSpecsTestJSON-191975643 tempest-FlavorsExtraSpecsTestJSON-191975643-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:44.852035 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cac385d9-a531-4d5b-829e-26b44173d137 tempest-FlavorsExtraSpecsTestJSON-191975643 tempest-FlavorsExtraSpecsTestJSON-191975643-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/909288872/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.025442 Aug 04 16:32:44.852975 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 39/94] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Aug 4 16:32:44 2022] DELETE /compute/v2.1/flavors/909288872/os-extra_specs/hw:cpu_policy => generated 0 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 16:32:44.857918 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ceb657c8-c492-41a3-ad78-bbd929bfbf45 tempest-HostsAdminNegativeTestJSON-223532599 tempest-HostsAdminNegativeTestJSON-223532599-project] Calling method '.version_select at 0x7f7e84de4310>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:44.858778 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:44.858778 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:32:44.859998 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ceb657c8-c492-41a3-ad78-bbd929bfbf45 tempest-HostsAdminNegativeTestJSON-223532599 tempest-HostsAdminNegativeTestJSON-223532599-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '9da47d00cf544844847ff9fecd1cae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ccfa7ef0d74211865f82afe0eabe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:44.861725 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ceb657c8-c492-41a3-ad78-bbd929bfbf45 tempest-HostsAdminNegativeTestJSON-223532599 tempest-HostsAdminNegativeTestJSON-223532599-project] Request method failure captured: Aug 04 16:32:44.861725 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/os-hosts/n-d-846466-12/startup HTTP/1.1 Aug 04 16:32:44.861725 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:32:44.861725 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:32:44.861725 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:32:44.861725 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:32:44.861725 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:32:44.861725 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:32:44.861725 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:32:44.861725 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:32:44.861725 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_SkjD2z-pH5ZY__8tv435ATI1YMkCOjDbnm0lN2Ze7S59a-V3465-l8m-PTfEryNmt2AZW46g-KaESQyDDlcDZjZ2e0ez9nlz_QCcj0C4046nO5EdyDz4T9nE0fzHo8PtJsGKhVmtKJWVqGF1uokuv33qetwKqbI9i5Pc6_EL9OGgw Aug 04 16:32:44.861725 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:32:44.861725 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:32:44.861725 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:32:44.861725 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:32:44.861725 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:32:44.861725 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:32:44.861725 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 53ccfa7ef0d74211865f82afe0eabe5b Aug 04 16:32:44.861725 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-223532599 Aug 04 16:32:44.861725 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:32:44.861725 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:32:44.862873 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/53ccfa7ef0d74211865f82afe0eabe5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_53ccfa7ef0d74211865f82afe0eabe5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/53ccfa7ef0d74211865f82afe0eabe5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/53ccfa7ef0d74211865f82afe0eabe5b"}]}] Aug 04 16:32:44.862873 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-HostsAdminNegativeTestJSON-223532599 Aug 04 16:32:44.862873 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 53ccfa7ef0d74211865f82afe0eabe5b Aug 04 16:32:44.862873 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-223532599 Aug 04 16:32:44.862873 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-HostsAdminNegativeTestJSON-223532599-project Aug 04 16:32:44.862873 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:32:44.862873 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:32:44.862873 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 9da47d00cf544844847ff9fecd1cae67 Aug 04 16:32:44.862873 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-HostsAdminNegativeTestJSON-223532599-project Aug 04 16:32:44.862873 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:32:44.862873 n-d-846466-12 devstack@n-api.service[126125]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 04 16:32:44.862873 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'n-d-846466-12'} Aug 04 16:32:44.862873 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:32:44.863558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:44.863558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:44.863558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:44.863558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:32:44.863558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:32:44.863558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:32:44.863558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:32:44.863558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:32:44.863558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:32:44.863558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 04 16:32:44.863558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 04 16:32:44.863558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:32:44.863558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:32:44.863558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:32:44.863558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:32:44.863558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:32:44.863558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:32:44.863558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:32:44.863558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:32:44.864539 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:32:44.864539 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:32:44.864539 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:32:44.864539 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:32:44.864539 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:32:44.864539 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:32:44.864539 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 04 16:32:44.864539 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:32:44.864539 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:32:44.864539 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:32:44.864539 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:44.864539 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:44.864539 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:44.864539 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:32:44.864539 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:32:44.864539 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 04 16:32:44.864539 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:32:44.865485 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ceb657c8-c492-41a3-ad78-bbd929bfbf45 tempest-HostsAdminNegativeTestJSON-223532599 tempest-HostsAdminNegativeTestJSON-223532599-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:32:44.865485 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ceb657c8-c492-41a3-ad78-bbd929bfbf45 tempest-HostsAdminNegativeTestJSON-223532599 tempest-HostsAdminNegativeTestJSON-223532599-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-d-846466-12/startup" status: 403 len: 110 microversion: 2.1 time: 0.008996 Aug 04 16:32:44.865485 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 40/95] 10.222.0.23 () {58 vars in 1194 bytes} [Thu Aug 4 16:32:44 2022] GET /compute/v2.1/os-hosts/n-d-846466-12/startup => generated 110 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:32:44.870518 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-42269763-b773-407f-b1ca-614076cc0898 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:44.871130 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-42269763-b773-407f-b1ca-614076cc0898 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] [instance: 5961044f-b35a-4051-b041-84548b5965d5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:44.877988 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-42269763-b773-407f-b1ca-614076cc0898 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:44.878435 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-42269763-b773-407f-b1ca-614076cc0898 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:44.879230 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-42269763-b773-407f-b1ca-614076cc0898 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:44.879644 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-42269763-b773-407f-b1ca-614076cc0898 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:45.123220 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-42269763-b773-407f-b1ca-614076cc0898 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9134e4e91c6a4139a4dd8d2865a6cb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce23f198a99464ab95a3e5f98dde567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:45.130794 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-42269763-b773-407f-b1ca-614076cc0898 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] 10.222.0.23 "GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5" status: 200 len: 1337 microversion: 2.1 time: 0.266322 Aug 04 16:32:45.131346 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 41/96] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:44 2022] GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5 => generated 1337 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:45.136100 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-926a883c-433c-4326-b6c8-eaf455f886bf tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Calling method '.version_select at 0x7f7e84de4ee0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:45.167470 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-05fb80c1-0a75-41ab-b743-73269673d238 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:32:45.167943 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-05fb80c1-0a75-41ab-b743-73269673d238 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:32:45.168338 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-05fb80c1-0a75-41ab-b743-73269673d238 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:32:45.168736 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-05fb80c1-0a75-41ab-b743-73269673d238 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:32:45.169134 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-05fb80c1-0a75-41ab-b743-73269673d238 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:32:45.178357 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-05fb80c1-0a75-41ab-b743-73269673d238 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:45.178795 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-05fb80c1-0a75-41ab-b743-73269673d238 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:45.179587 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-05fb80c1-0a75-41ab-b743-73269673d238 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:45.180009 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-05fb80c1-0a75-41ab-b743-73269673d238 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:45.200120 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-926a883c-433c-4326-b6c8-eaf455f886bf tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:45.200921 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-926a883c-433c-4326-b6c8-eaf455f886bf tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:45.201807 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-05fb80c1-0a75-41ab-b743-73269673d238 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Getting quotas for project 5cd96a8c91974b8ba7919d5349f380ee. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:32:45.201992 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-926a883c-433c-4326-b6c8-eaf455f886bf tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:45.202308 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-926a883c-433c-4326-b6c8-eaf455f886bf tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:45.207188 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-05fb80c1-0a75-41ab-b743-73269673d238 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Getting quotas for user 7a427fb7481d4799a83729910f33b01b and project 5cd96a8c91974b8ba7919d5349f380ee. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:32:45.222377 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-926a883c-433c-4326-b6c8-eaf455f886bf tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/163ed32295b24ec1b097930cdd1da98e/detail" status: 200 len: 916 microversion: 2.1 time: 0.089683 Aug 04 16:32:45.222711 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-05fb80c1-0a75-41ab-b743-73269673d238 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:32:45.223502 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 42/97] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Aug 4 16:32:45 2022] GET /compute/v2.1/os-quota-sets/163ed32295b24ec1b097930cdd1da98e/detail => generated 916 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:45.225096 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-05fb80c1-0a75-41ab-b743-73269673d238 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: ac53ca0d-94da-45a3-bd53-f013b5b61d51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:32:45.239473 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8641a697-cf6a-439b-bc6b-9e80c4b6ad21 tempest-FlavorsExtraSpecsTestJSON-191975643 tempest-FlavorsExtraSpecsTestJSON-191975643-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:45.249323 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8641a697-cf6a-439b-bc6b-9e80c4b6ad21 tempest-FlavorsExtraSpecsTestJSON-191975643 tempest-FlavorsExtraSpecsTestJSON-191975643-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/909288872/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.024578 Aug 04 16:32:45.253433 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 43/98] 10.222.0.23 () {58 vars in 1200 bytes} [Thu Aug 4 16:32:45 2022] GET /compute/v2.1/flavors/909288872/os-extra_specs => generated 19 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:32:45.263715 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d27a9bf8-251c-441a-a2b0-cf02a47eb66a tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] Calling method '.version_select at 0x7f7e84de4790>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:45.264948 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:45.264948 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:32:45.276239 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-d27a9bf8-251c-441a-a2b0-cf02a47eb66a tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:32:45.279463 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d27a9bf8-251c-441a-a2b0-cf02a47eb66a tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] Request method failure captured: Aug 04 16:32:45.279463 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 04 16:32:45.279463 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:32:45.279463 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:32:45.279463 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:32:45.279463 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:32:45.279463 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:32:45.279463 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:32:45.279463 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:32:45.279463 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:32:45.279463 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_SmjjjiVmYn6NdlSIQSvr-8K67NjNBPFj6eQnLOBUn7CnxemOE7tsjnZMzwsNAH226BxHagXFdirv99tVHb8_CZfG0_ho3JcfG6VRhq-sc_GkN56w9Sw5z80KGOeb4qFedGNQYr_JNlyninrrarLHhQdhccdH0Z0iKSmDHBHtcRWnE Aug 04 16:32:45.279463 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:32:45.279463 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:32:45.279463 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:32:45.279463 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:32:45.279463 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:32:45.279463 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:32:45.279463 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 9cffbdd745484f08960acd9d643e91ec Aug 04 16:32:45.279463 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1989536293 Aug 04 16:32:45.279463 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader,admin Aug 04 16:32:45.279463 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader,admin Aug 04 16:32:45.281009 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9cffbdd745484f08960acd9d643e91ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9cffbdd745484f08960acd9d643e91ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9cffbdd745484f08960acd9d643e91ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9cffbdd745484f08960acd9d643e91ec"}]}] Aug 04 16:32:45.281009 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1989536293 Aug 04 16:32:45.281009 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 9cffbdd745484f08960acd9d643e91ec Aug 04 16:32:45.281009 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1989536293 Aug 04 16:32:45.281009 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-HostsAdminNegativeTestJSON-1989536293-project-admin Aug 04 16:32:45.281009 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:32:45.281009 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:32:45.281009 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: c32002df48fc4282b75af840899bfe7b Aug 04 16:32:45.281009 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1989536293-project-admin Aug 04 16:32:45.281009 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:32:45.281009 n-d-846466-12 devstack@n-api.service[126125]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:32:45.281009 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'nonexistent_hostname'} Aug 04 16:32:45.281009 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:32:45.282043 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:45.282043 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 04 16:32:45.282043 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 04 16:32:45.282043 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 16:32:45.282043 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 16:32:45.282043 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:32:45.282043 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:32:45.282043 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:32:45.282043 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:32:45.282043 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 16:32:45.282043 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 16:32:45.282043 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 04 16:32:45.282043 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 04 16:32:45.282043 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:32:45.282043 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:32:45.282043 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 04 16:32:45.282043 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 04 16:32:45.282043 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:32:45.282043 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:32:45.283128 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 04 16:32:45.283128 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 04 16:32:45.283128 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:32:45.283128 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:32:45.283128 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:32:45.283128 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:32:45.283128 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:45.283128 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:45.283128 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:45.283128 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:32:45.283128 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:32:45.283128 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:32:45.283128 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:32:45.283128 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:32:45.283128 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:32:45.283128 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 04 16:32:45.283128 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 04 16:32:45.283128 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 04 16:32:45.283128 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:32:45.284120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:32:45.284120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:32:45.284120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:32:45.284120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:32:45.284120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:45.284120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:45.284120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:45.284120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:32:45.284120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:32:45.284120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:32:45.284120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:32:45.284120 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d27a9bf8-251c-441a-a2b0-cf02a47eb66a tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:32:45.284120 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d27a9bf8-251c-441a-a2b0-cf02a47eb66a tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.026869 Aug 04 16:32:45.284120 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 44/99] 10.222.0.23 () {58 vars in 1215 bytes} [Thu Aug 4 16:32:45 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:32:45.289199 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3595e58a-ecfb-435a-b212-d08d40e9fea4 tempest-FlavorsExtraSpecsTestJSON-191975643 tempest-FlavorsExtraSpecsTestJSON-191975643-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:45.289745 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:45.289745 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:32:45.301039 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-05fb80c1-0a75-41ab-b743-73269673d238 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.241517 Aug 04 16:32:45.305684 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 56/100] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:32:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 1247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:32:45.311542 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ca3b7a77-59ac-42b1-960b-7790edd8e608 tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] Action: 'update', calling method: .version_select at 0x7f7e8581a940>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:45.321174 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ca3b7a77-59ac-42b1-960b-7790edd8e608 tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] Request method failure captured: Aug 04 16:32:45.321174 n-d-846466-12 devstack@n-api.service[126126]: request: PUT /compute/v2.1/os-hosts/n-d-846466-12 HTTP/1.1 Aug 04 16:32:45.321174 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:32:45.321174 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:32:45.321174 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:32:45.321174 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 51 Aug 04 16:32:45.321174 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:32:45.321174 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:32:45.321174 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:32:45.321174 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:32:45.321174 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_SmjjjiVmYn6NdlSIQSvr-8K67NjNBPFj6eQnLOBUn7CnxemOE7tsjnZMzwsNAH226BxHagXFdirv99tVHb8_CZfG0_ho3JcfG6VRhq-sc_GkN56w9Sw5z80KGOeb4qFedGNQYr_JNlyninrrarLHhQdhccdH0Z0iKSmDHBHtcRWnE Aug 04 16:32:45.321174 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:32:45.321174 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:32:45.321174 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:32:45.321174 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:32:45.321174 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:32:45.321174 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:32:45.321174 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 9cffbdd745484f08960acd9d643e91ec Aug 04 16:32:45.321174 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1989536293 Aug 04 16:32:45.321174 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader,admin Aug 04 16:32:45.321174 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader,admin Aug 04 16:32:45.322619 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9cffbdd745484f08960acd9d643e91ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9cffbdd745484f08960acd9d643e91ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9cffbdd745484f08960acd9d643e91ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9cffbdd745484f08960acd9d643e91ec"}]}] Aug 04 16:32:45.322619 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1989536293 Aug 04 16:32:45.322619 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 9cffbdd745484f08960acd9d643e91ec Aug 04 16:32:45.322619 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1989536293 Aug 04 16:32:45.322619 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-HostsAdminNegativeTestJSON-1989536293-project-admin Aug 04 16:32:45.322619 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:32:45.322619 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:32:45.322619 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: c32002df48fc4282b75af840899bfe7b Aug 04 16:32:45.322619 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1989536293-project-admin Aug 04 16:32:45.322619 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 16:32:45.322619 n-d-846466-12 devstack@n-api.service[126126]: {"status": "enable", "maintenance_mode": "invalid"} Aug 04 16:32:45.322619 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:32:45.322619 n-d-846466-12 devstack@n-api.service[126126]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 04 16:32:45.323321 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'n-d-846466-12', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 04 16:32:45.323321 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:32:45.323321 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:45.323321 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:32:45.323321 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:32:45.323321 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:32:45.323321 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:32:45.323321 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 04 16:32:45.323321 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:45.323321 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 04 16:32:45.323321 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 04 16:32:45.323321 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi 'disable', Aug 04 16:32:45.323321 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi 'Enable', Aug 04 16:32:45.323321 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi 'Disable', Aug 04 16:32:45.323321 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 04 16:32:45.323321 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 04 16:32:45.323321 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 04 16:32:45.323321 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:45.323321 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi On instance: Aug 04 16:32:45.323321 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi 'invalid' Aug 04 16:32:45.323321 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:45.323321 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:32:45.323321 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:45.323321 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:45.323321 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:45.324687 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:45.324687 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:32:45.324687 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:32:45.324687 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:32:45.324687 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:32:45.324687 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:32:45.324687 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:32:45.324687 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 16:32:45.324687 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 16:32:45.324687 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:32:45.324687 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:32:45.324687 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:32:45.324687 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:32:45.324687 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 04 16:32:45.324687 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:45.324687 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:32:45.324687 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:45.324687 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:45.324687 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:45.325835 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:45.325835 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:32:45.325835 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:32:45.325835 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 04 16:32:45.325835 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:45.325835 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ca3b7a77-59ac-42b1-960b-7790edd8e608 tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:32:45.325835 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ca3b7a77-59ac-42b1-960b-7790edd8e608 tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/n-d-846466-12" status: 400 len: 199 microversion: 2.1 time: 0.015414 Aug 04 16:32:45.325835 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 57/101] 10.222.0.23 () {60 vars in 1190 bytes} [Thu Aug 4 16:32:45 2022] PUT /compute/v2.1/os-hosts/n-d-846466-12 => generated 199 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:32:45.331221 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5a3a118b-7462-4e18-b140-a032c1789fb5 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:45.331508 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5a3a118b-7462-4e18-b140-a032c1789fb5 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: e40c21e9-d19a-4e5f-9c7d-c4507025e94e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:45.338882 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3595e58a-ecfb-435a-b212-d08d40e9fea4 tempest-FlavorsExtraSpecsTestJSON-191975643 tempest-FlavorsExtraSpecsTestJSON-191975643-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/909288872" status: 202 len: 0 microversion: 2.1 time: 0.054984 Aug 04 16:32:45.339838 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 45/102] 10.222.0.23 () {58 vars in 1158 bytes} [Thu Aug 4 16:32:45 2022] DELETE /compute/v2.1/flavors/909288872 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:32:45.348395 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fd52119e-1ea5-47cc-baeb-23cd3d198c7f tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:45.349391 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fd52119e-1ea5-47cc-baeb-23cd3d198c7f tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: ac53ca0d-94da-45a3-bd53-f013b5b61d51] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:45.351840 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a3a118b-7462-4e18-b140-a032c1789fb5 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:45.352555 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a3a118b-7462-4e18-b140-a032c1789fb5 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:45.353615 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a3a118b-7462-4e18-b140-a032c1789fb5 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:45.354929 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a3a118b-7462-4e18-b140-a032c1789fb5 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:45.451725 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fd52119e-1ea5-47cc-baeb-23cd3d198c7f tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a427fb7481d4799a83729910f33b01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd96a8c91974b8ba7919d5349f380ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:45.462616 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fd52119e-1ea5-47cc-baeb-23cd3d198c7f tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51" status: 200 len: 1264 microversion: 2.1 time: 0.121619 Aug 04 16:32:45.466062 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 46/103] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:45 2022] GET /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51 => generated 1264 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:45.474713 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ea58b97d-b70f-4fbe-939f-076cb61c5b62 tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] Action: 'update', calling method: .version_select at 0x7f7e84de49d0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:45.480954 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ea58b97d-b70f-4fbe-939f-076cb61c5b62 tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] Request method failure captured: Aug 04 16:32:45.480954 n-d-846466-12 devstack@n-api.service[126125]: request: PUT /compute/v2.1/os-hosts/n-d-846466-12 HTTP/1.1 Aug 04 16:32:45.480954 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:32:45.480954 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:32:45.480954 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:32:45.480954 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 51 Aug 04 16:32:45.480954 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:32:45.480954 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:32:45.480954 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:32:45.480954 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:32:45.480954 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_SmjjjiVmYn6NdlSIQSvr-8K67NjNBPFj6eQnLOBUn7CnxemOE7tsjnZMzwsNAH226BxHagXFdirv99tVHb8_CZfG0_ho3JcfG6VRhq-sc_GkN56w9Sw5z80KGOeb4qFedGNQYr_JNlyninrrarLHhQdhccdH0Z0iKSmDHBHtcRWnE Aug 04 16:32:45.480954 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:32:45.480954 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:32:45.480954 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:32:45.480954 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:32:45.480954 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:32:45.480954 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:32:45.480954 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 9cffbdd745484f08960acd9d643e91ec Aug 04 16:32:45.480954 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1989536293 Aug 04 16:32:45.480954 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader,admin Aug 04 16:32:45.480954 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader,admin Aug 04 16:32:45.482328 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9cffbdd745484f08960acd9d643e91ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9cffbdd745484f08960acd9d643e91ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9cffbdd745484f08960acd9d643e91ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9cffbdd745484f08960acd9d643e91ec"}]}] Aug 04 16:32:45.482328 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1989536293 Aug 04 16:32:45.482328 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 9cffbdd745484f08960acd9d643e91ec Aug 04 16:32:45.482328 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1989536293 Aug 04 16:32:45.482328 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-HostsAdminNegativeTestJSON-1989536293-project-admin Aug 04 16:32:45.482328 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:32:45.482328 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:32:45.482328 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: c32002df48fc4282b75af840899bfe7b Aug 04 16:32:45.482328 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1989536293-project-admin Aug 04 16:32:45.482328 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:32:45.482328 n-d-846466-12 devstack@n-api.service[126125]: {"status": "invalid", "maintenance_mode": "enable"} Aug 04 16:32:45.482328 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:32:45.482328 n-d-846466-12 devstack@n-api.service[126125]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 04 16:32:45.483117 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'n-d-846466-12', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 04 16:32:45.483117 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:32:45.483117 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:45.483117 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:32:45.483117 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:32:45.483117 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:32:45.483117 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:32:45.483117 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 04 16:32:45.483117 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:32:45.483117 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 04 16:32:45.483117 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 04 16:32:45.483117 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'disable', Aug 04 16:32:45.483117 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'Enable', Aug 04 16:32:45.483117 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'Disable', Aug 04 16:32:45.483117 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 04 16:32:45.483117 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 04 16:32:45.483117 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 04 16:32:45.483117 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:32:45.483117 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi On instance: Aug 04 16:32:45.483117 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'invalid' Aug 04 16:32:45.483117 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:32:45.483117 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:32:45.483117 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:32:45.483117 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:45.483117 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:45.484418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:45.484418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:32:45.484418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:32:45.484418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:32:45.484418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:32:45.484418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:32:45.484418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:32:45.484418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 16:32:45.484418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 16:32:45.484418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:32:45.484418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:32:45.484418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:32:45.484418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:32:45.484418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 04 16:32:45.484418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:32:45.484418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:32:45.484418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:32:45.484418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:45.484418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:45.485437 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:45.485437 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:32:45.485437 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:32:45.485437 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 04 16:32:45.485437 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:32:45.488048 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ea58b97d-b70f-4fbe-939f-076cb61c5b62 tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:32:45.489364 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ea58b97d-b70f-4fbe-939f-076cb61c5b62 tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/n-d-846466-12" status: 400 len: 189 microversion: 2.1 time: 0.021896 Aug 04 16:32:45.491083 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 47/104] 10.222.0.23 () {60 vars in 1190 bytes} [Thu Aug 4 16:32:45 2022] PUT /compute/v2.1/os-hosts/n-d-846466-12 => generated 189 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:32:45.496159 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-effa91ad-9b74-4e17-96ea-10731ac7763e tempest-FlavorsExtraSpecsTestJSON-191975643 tempest-FlavorsExtraSpecsTestJSON-191975643-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:45.519647 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5a3a118b-7462-4e18-b140-a032c1789fb5 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:45.558900 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-effa91ad-9b74-4e17-96ea-10731ac7763e tempest-FlavorsExtraSpecsTestJSON-191975643 tempest-FlavorsExtraSpecsTestJSON-191975643-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.049946 Aug 04 16:32:45.558900 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 48/105] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:32:45 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:45.560342 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5a3a118b-7462-4e18-b140-a032c1789fb5 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e" status: 200 len: 1319 microversion: 2.1 time: 0.220243 Aug 04 16:32:45.560707 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-70588d51-db51-4840-b87a-c9f6280c2adb tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Action: 'update', calling method: .version_select at 0x7f7e84d8b4c0>, body: {"quota_set": {"ram": "2048"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:45.569373 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 58/106] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:45 2022] GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:45.574478 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0844498f-bc40-4c5c-b4e1-b08626d9d291 tempest-HostsAdminNegativeTestJSON-223532599 tempest-HostsAdminNegativeTestJSON-223532599-project] Action: 'update', calling method: .version_select at 0x7f7e8565bee0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:45.579663 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:45.579663 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:32:45.580856 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0844498f-bc40-4c5c-b4e1-b08626d9d291 tempest-HostsAdminNegativeTestJSON-223532599 tempest-HostsAdminNegativeTestJSON-223532599-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '9da47d00cf544844847ff9fecd1cae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ccfa7ef0d74211865f82afe0eabe5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:45.582547 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0844498f-bc40-4c5c-b4e1-b08626d9d291 tempest-HostsAdminNegativeTestJSON-223532599 tempest-HostsAdminNegativeTestJSON-223532599-project] Request method failure captured: Aug 04 16:32:45.582547 n-d-846466-12 devstack@n-api.service[126126]: request: PUT /compute/v2.1/os-hosts/n-d-846466-12 HTTP/1.1 Aug 04 16:32:45.582547 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:32:45.582547 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:32:45.582547 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:32:45.582547 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 50 Aug 04 16:32:45.582547 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:32:45.582547 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:32:45.582547 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:32:45.582547 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:32:45.582547 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_SkjD2z-pH5ZY__8tv435ATI1YMkCOjDbnm0lN2Ze7S59a-V3465-l8m-PTfEryNmt2AZW46g-KaESQyDDlcDZjZ2e0ez9nlz_QCcj0C4046nO5EdyDz4T9nE0fzHo8PtJsGKhVmtKJWVqGF1uokuv33qetwKqbI9i5Pc6_EL9OGgw Aug 04 16:32:45.582547 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:32:45.582547 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:32:45.582547 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:32:45.582547 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:32:45.582547 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:32:45.582547 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:32:45.582547 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 53ccfa7ef0d74211865f82afe0eabe5b Aug 04 16:32:45.582547 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-223532599 Aug 04 16:32:45.582547 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:32:45.582547 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:32:45.584155 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/53ccfa7ef0d74211865f82afe0eabe5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_53ccfa7ef0d74211865f82afe0eabe5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/53ccfa7ef0d74211865f82afe0eabe5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/53ccfa7ef0d74211865f82afe0eabe5b"}]}] Aug 04 16:32:45.584155 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-HostsAdminNegativeTestJSON-223532599 Aug 04 16:32:45.584155 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 53ccfa7ef0d74211865f82afe0eabe5b Aug 04 16:32:45.584155 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-223532599 Aug 04 16:32:45.584155 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-HostsAdminNegativeTestJSON-223532599-project Aug 04 16:32:45.584155 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:32:45.584155 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:32:45.584155 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 9da47d00cf544844847ff9fecd1cae67 Aug 04 16:32:45.584155 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-HostsAdminNegativeTestJSON-223532599-project Aug 04 16:32:45.584155 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 16:32:45.584155 n-d-846466-12 devstack@n-api.service[126126]: {"status": "enable", "maintenance_mode": "enable"} Aug 04 16:32:45.584155 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:32:45.584155 n-d-846466-12 devstack@n-api.service[126126]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 04 16:32:45.584155 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'n-d-846466-12', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 04 16:32:45.585354 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:32:45.585354 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:45.585354 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:45.585354 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:45.585354 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:32:45.585354 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:32:45.585354 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:32:45.585354 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:32:45.585354 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:32:45.585354 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:32:45.585354 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:32:45.585354 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:32:45.585354 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 04 16:32:45.585354 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 04 16:32:45.585354 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:32:45.585354 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:32:45.585354 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:32:45.585354 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:32:45.585354 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:32:45.585354 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:32:45.586520 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:32:45.586520 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:32:45.586520 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:32:45.586520 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:32:45.586520 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:32:45.586520 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:32:45.586520 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:32:45.586520 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:32:45.586520 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 04 16:32:45.586520 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:45.586520 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:32:45.586520 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:45.586520 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:45.586520 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:45.586520 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:45.586520 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:32:45.586520 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:32:45.586520 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 04 16:32:45.586520 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:45.589611 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0844498f-bc40-4c5c-b4e1-b08626d9d291 tempest-HostsAdminNegativeTestJSON-223532599 tempest-HostsAdminNegativeTestJSON-223532599-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:32:45.590464 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0844498f-bc40-4c5c-b4e1-b08626d9d291 tempest-HostsAdminNegativeTestJSON-223532599 tempest-HostsAdminNegativeTestJSON-223532599-project] 10.222.0.23 "PUT /compute/v2.1/os-hosts/n-d-846466-12" status: 403 len: 111 microversion: 2.1 time: 0.020002 Aug 04 16:32:45.591242 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 59/107] 10.222.0.23 () {60 vars in 1190 bytes} [Thu Aug 4 16:32:45 2022] PUT /compute/v2.1/os-hosts/n-d-846466-12 => generated 111 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:32:45.601429 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a5c3b4b2-880d-4c40-81e9-acb5f041e14c tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:45.602050 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a5c3b4b2-880d-4c40-81e9-acb5f041e14c tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: dc4b9aed-b141-46b5-a62b-a039640c6310] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:45.609686 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a5c3b4b2-880d-4c40-81e9-acb5f041e14c tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:45.610733 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a5c3b4b2-880d-4c40-81e9-acb5f041e14c tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:45.612110 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a5c3b4b2-880d-4c40-81e9-acb5f041e14c tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:45.612741 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a5c3b4b2-880d-4c40-81e9-acb5f041e14c tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:45.668918 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-70588d51-db51-4840-b87a-c9f6280c2adb tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:45.669567 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-70588d51-db51-4840-b87a-c9f6280c2adb tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:45.670610 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-70588d51-db51-4840-b87a-c9f6280c2adb tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:45.671289 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-70588d51-db51-4840-b87a-c9f6280c2adb tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:45.689738 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a5c3b4b2-880d-4c40-81e9-acb5f041e14c tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052613a51b86400c916dbc800563896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0ceaab59d4aeaa8667cef6f62559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:45.700716 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a5c3b4b2-880d-4c40-81e9-acb5f041e14c tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "GET /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310" status: 200 len: 1270 microversion: 2.1 time: 0.102751 Aug 04 16:32:45.712265 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 60/108] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:45 2022] GET /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310 => generated 1270 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:45.720930 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-503197b0-6c8f-4dd3-b297-bc01b06777f2 tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] Action: 'update', calling method: .version_select at 0x7f7e8565b3a0>, body: {"status": null, "maintenance_mode": null} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:45.724825 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-503197b0-6c8f-4dd3-b297-bc01b06777f2 tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] Request method failure captured: Aug 04 16:32:45.724825 n-d-846466-12 devstack@n-api.service[126126]: request: PUT /compute/v2.1/os-hosts/n-d-846466-12 HTTP/1.1 Aug 04 16:32:45.724825 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:32:45.724825 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:32:45.724825 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:32:45.724825 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 42 Aug 04 16:32:45.724825 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:32:45.724825 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:32:45.724825 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:32:45.724825 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:32:45.724825 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_SmjjjiVmYn6NdlSIQSvr-8K67NjNBPFj6eQnLOBUn7CnxemOE7tsjnZMzwsNAH226BxHagXFdirv99tVHb8_CZfG0_ho3JcfG6VRhq-sc_GkN56w9Sw5z80KGOeb4qFedGNQYr_JNlyninrrarLHhQdhccdH0Z0iKSmDHBHtcRWnE Aug 04 16:32:45.724825 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:32:45.724825 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:32:45.724825 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:32:45.724825 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:32:45.724825 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:32:45.724825 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:32:45.724825 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 9cffbdd745484f08960acd9d643e91ec Aug 04 16:32:45.724825 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1989536293 Aug 04 16:32:45.724825 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader,admin Aug 04 16:32:45.724825 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader,admin Aug 04 16:32:45.726329 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9cffbdd745484f08960acd9d643e91ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9cffbdd745484f08960acd9d643e91ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9cffbdd745484f08960acd9d643e91ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9cffbdd745484f08960acd9d643e91ec"}]}] Aug 04 16:32:45.726329 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1989536293 Aug 04 16:32:45.726329 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 9cffbdd745484f08960acd9d643e91ec Aug 04 16:32:45.726329 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1989536293 Aug 04 16:32:45.726329 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-HostsAdminNegativeTestJSON-1989536293-project-admin Aug 04 16:32:45.726329 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:32:45.726329 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:32:45.726329 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: c32002df48fc4282b75af840899bfe7b Aug 04 16:32:45.726329 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1989536293-project-admin Aug 04 16:32:45.726329 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 16:32:45.726329 n-d-846466-12 devstack@n-api.service[126126]: {"status": null, "maintenance_mode": null} Aug 04 16:32:45.726329 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:32:45.726329 n-d-846466-12 devstack@n-api.service[126126]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 04 16:32:45.726329 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'n-d-846466-12', 'body': {'status': None, 'maintenance_mode': None}} Aug 04 16:32:45.727135 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:32:45.727135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:45.727135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:32:45.727135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:32:45.727135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:32:45.727135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:32:45.727135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 04 16:32:45.727135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:45.727135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 04 16:32:45.727135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 04 16:32:45.727135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi 'disable', Aug 04 16:32:45.727135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi 'Enable', Aug 04 16:32:45.727135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi 'Disable', Aug 04 16:32:45.727135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 04 16:32:45.727135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 04 16:32:45.727135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 04 16:32:45.727135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:45.727135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi On instance: Aug 04 16:32:45.727135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi None Aug 04 16:32:45.727135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:45.727135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:32:45.727135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:45.727135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:45.727135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:45.727135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:45.729032 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:32:45.729032 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:32:45.729032 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:32:45.729032 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:32:45.729032 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:32:45.729032 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:32:45.729032 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 16:32:45.729032 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 16:32:45.729032 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:32:45.729032 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:32:45.729032 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:32:45.729032 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:32:45.729032 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 04 16:32:45.729032 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:45.729032 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:32:45.729032 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:45.729032 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:45.729032 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:45.729032 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:45.730218 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:32:45.730218 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:32:45.730218 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 04 16:32:45.730218 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:45.731295 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-503197b0-6c8f-4dd3-b297-bc01b06777f2 tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:32:45.732323 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-503197b0-6c8f-4dd3-b297-bc01b06777f2 tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/n-d-846466-12" status: 400 len: 127 microversion: 2.1 time: 0.015424 Aug 04 16:32:45.732669 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-70588d51-db51-4840-b87a-c9f6280c2adb tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:45.733268 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-70588d51-db51-4840-b87a-c9f6280c2adb tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:45.734085 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-70588d51-db51-4840-b87a-c9f6280c2adb tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:45.734676 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-70588d51-db51-4840-b87a-c9f6280c2adb tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:45.737733 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 61/109] 10.222.0.23 () {60 vars in 1190 bytes} [Thu Aug 4 16:32:45 2022] PUT /compute/v2.1/os-hosts/n-d-846466-12 => generated 127 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:32:45.742770 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0f0c08ed-dee7-429d-bbfa-9c788b43011e tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] Action: 'update', calling method: .version_select at 0x7f7e855f2160>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:45.745504 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:45.745504 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:32:45.746305 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.hosts [None req-0f0c08ed-dee7-429d-bbfa-9c788b43011e tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] Enabling host nonexistent_hostname. Aug 04 16:32:45.755289 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-0f0c08ed-dee7-429d-bbfa-9c788b43011e tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:32:45.757948 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0f0c08ed-dee7-429d-bbfa-9c788b43011e tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] Request method failure captured: Aug 04 16:32:45.757948 n-d-846466-12 devstack@n-api.service[126126]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 04 16:32:45.757948 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:32:45.757948 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:32:45.757948 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:32:45.757948 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 50 Aug 04 16:32:45.757948 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:32:45.757948 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:32:45.757948 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:32:45.757948 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:32:45.757948 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_SmjjjiVmYn6NdlSIQSvr-8K67NjNBPFj6eQnLOBUn7CnxemOE7tsjnZMzwsNAH226BxHagXFdirv99tVHb8_CZfG0_ho3JcfG6VRhq-sc_GkN56w9Sw5z80KGOeb4qFedGNQYr_JNlyninrrarLHhQdhccdH0Z0iKSmDHBHtcRWnE Aug 04 16:32:45.757948 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:32:45.757948 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:32:45.757948 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:32:45.757948 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:32:45.757948 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:32:45.757948 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:32:45.757948 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 9cffbdd745484f08960acd9d643e91ec Aug 04 16:32:45.757948 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1989536293 Aug 04 16:32:45.757948 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader,admin Aug 04 16:32:45.757948 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader,admin Aug 04 16:32:45.759176 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9cffbdd745484f08960acd9d643e91ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9cffbdd745484f08960acd9d643e91ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9cffbdd745484f08960acd9d643e91ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9cffbdd745484f08960acd9d643e91ec"}]}] Aug 04 16:32:45.759176 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1989536293 Aug 04 16:32:45.759176 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 9cffbdd745484f08960acd9d643e91ec Aug 04 16:32:45.759176 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1989536293 Aug 04 16:32:45.759176 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-HostsAdminNegativeTestJSON-1989536293-project-admin Aug 04 16:32:45.759176 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:32:45.759176 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:32:45.759176 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: c32002df48fc4282b75af840899bfe7b Aug 04 16:32:45.759176 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1989536293-project-admin Aug 04 16:32:45.759176 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 16:32:45.759176 n-d-846466-12 devstack@n-api.service[126126]: {"status": "enable", "maintenance_mode": "enable"} Aug 04 16:32:45.759176 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:32:45.759176 n-d-846466-12 devstack@n-api.service[126126]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:32:45.759176 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 04 16:32:45.759945 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:32:45.759945 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:45.759945 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 04 16:32:45.759945 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 04 16:32:45.759945 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 16:32:45.759945 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 16:32:45.759945 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:32:45.759945 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:32:45.759945 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:32:45.759945 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:32:45.759945 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 16:32:45.759945 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 16:32:45.759945 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 04 16:32:45.759945 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 04 16:32:45.759945 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:32:45.759945 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:32:45.759945 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 04 16:32:45.759945 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 04 16:32:45.760929 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:32:45.760929 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:32:45.760929 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 04 16:32:45.760929 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 04 16:32:45.760929 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:32:45.760929 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:45.760929 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:32:45.760929 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:45.760929 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:45.760929 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:45.760929 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:45.760929 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:32:45.760929 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:32:45.760929 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:32:45.760929 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:32:45.760929 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:32:45.760929 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:32:45.760929 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:32:45.760929 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:32:45.760929 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 04 16:32:45.762145 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 04 16:32:45.762145 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 04 16:32:45.762145 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:32:45.762145 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:32:45.762145 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:45.762145 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:32:45.762145 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:45.762145 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:45.762145 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:45.762145 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:45.762145 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:32:45.762145 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:32:45.762145 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:32:45.762145 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:45.762145 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0f0c08ed-dee7-429d-bbfa-9c788b43011e tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:32:45.763104 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0f0c08ed-dee7-429d-bbfa-9c788b43011e tempest-HostsAdminNegativeTestJSON-1989536293 tempest-HostsAdminNegativeTestJSON-1989536293-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.020562 Aug 04 16:32:45.763104 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 62/110] 10.222.0.23 () {60 vars in 1211 bytes} [Thu Aug 4 16:32:45 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:32:45.830807 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5,nova_api:SAVEPOINT=1,nova_api:RELEASE=1,nova_api:DELETE=5 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:32:45.859704 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-70588d51-db51-4840-b87a-c9f6280c2adb tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/163ed32295b24ec1b097930cdd1da98e?user_id=f9eb046677d14aba9cae1291e0fdcd9f" status: 200 len: 328 microversion: 2.1 time: 0.315311 Aug 04 16:32:45.867370 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 49/111] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Aug 4 16:32:45 2022] PUT /compute/v2.1/os-quota-sets/163ed32295b24ec1b097930cdd1da98e?user_id=f9eb046677d14aba9cae1291e0fdcd9f => generated 328 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:45.874844 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-332086e6-5a0b-4cec-a8e7-45badfd4f3c3 tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Calling method '.version_select at 0x7f7e8565b310>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:46.152562 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-30aa61c3-151d-4f61-9a4b-fd06de210194 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:46.153181 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-30aa61c3-151d-4f61-9a4b-fd06de210194 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] [instance: 5961044f-b35a-4051-b041-84548b5965d5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:46.161156 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-30aa61c3-151d-4f61-9a4b-fd06de210194 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:46.161634 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-30aa61c3-151d-4f61-9a4b-fd06de210194 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:46.162428 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-30aa61c3-151d-4f61-9a4b-fd06de210194 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:46.163095 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-30aa61c3-151d-4f61-9a4b-fd06de210194 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:46.292953 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-332086e6-5a0b-4cec-a8e7-45badfd4f3c3 tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/163ed32295b24ec1b097930cdd1da98e?user_id=f9eb046677d14aba9cae1291e0fdcd9f" status: 200 len: 370 microversion: 2.1 time: 0.422799 Aug 04 16:32:46.298205 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 63/112] 10.222.0.23 () {58 vars in 1323 bytes} [Thu Aug 4 16:32:45 2022] GET /compute/v2.1/os-quota-sets/163ed32295b24ec1b097930cdd1da98e?user_id=f9eb046677d14aba9cae1291e0fdcd9f => generated 370 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:46.446653 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-30aa61c3-151d-4f61-9a4b-fd06de210194 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9134e4e91c6a4139a4dd8d2865a6cb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce23f198a99464ab95a3e5f98dde567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:46.455574 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-30aa61c3-151d-4f61-9a4b-fd06de210194 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] 10.222.0.23 "GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5" status: 200 len: 1337 microversion: 2.1 time: 0.306891 Aug 04 16:32:46.457643 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 50/113] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:46 2022] GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5 => generated 1337 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:46.485924 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-535d4ade-c72b-4d53-88d0-15eb4fc78927 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:46.487233 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-535d4ade-c72b-4d53-88d0-15eb4fc78927 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: ac53ca0d-94da-45a3-bd53-f013b5b61d51] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:46.508869 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-535d4ade-c72b-4d53-88d0-15eb4fc78927 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:46.509342 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-535d4ade-c72b-4d53-88d0-15eb4fc78927 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:46.510375 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-535d4ade-c72b-4d53-88d0-15eb4fc78927 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:46.511650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-535d4ade-c72b-4d53-88d0-15eb4fc78927 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:46.588464 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f3620ab9-3823-4449-b605-0be66797f619 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:46.589106 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f3620ab9-3823-4449-b605-0be66797f619 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: e40c21e9-d19a-4e5f-9c7d-c4507025e94e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:46.605600 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3620ab9-3823-4449-b605-0be66797f619 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:46.608891 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3620ab9-3823-4449-b605-0be66797f619 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:46.610042 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3620ab9-3823-4449-b605-0be66797f619 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:46.610999 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3620ab9-3823-4449-b605-0be66797f619 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:46.620700 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-535d4ade-c72b-4d53-88d0-15eb4fc78927 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a427fb7481d4799a83729910f33b01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd96a8c91974b8ba7919d5349f380ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:46.635551 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-535d4ade-c72b-4d53-88d0-15eb4fc78927 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51" status: 200 len: 1316 microversion: 2.1 time: 0.151315 Aug 04 16:32:46.636255 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 64/114] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:46 2022] GET /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:46.732734 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d261898b-7816-4fb8-8c86-a6addb5c70c5 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:46.735181 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d261898b-7816-4fb8-8c86-a6addb5c70c5 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: dc4b9aed-b141-46b5-a62b-a039640c6310] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:46.752227 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d261898b-7816-4fb8-8c86-a6addb5c70c5 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:46.753395 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d261898b-7816-4fb8-8c86-a6addb5c70c5 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:46.754522 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d261898b-7816-4fb8-8c86-a6addb5c70c5 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:46.755382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d261898b-7816-4fb8-8c86-a6addb5c70c5 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:46.954580 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d261898b-7816-4fb8-8c86-a6addb5c70c5 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052613a51b86400c916dbc800563896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0ceaab59d4aeaa8667cef6f62559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:46.969617 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d261898b-7816-4fb8-8c86-a6addb5c70c5 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "GET /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310" status: 200 len: 1276 microversion: 2.1 time: 0.247797 Aug 04 16:32:46.970816 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 65/115] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:46 2022] GET /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310 => generated 1276 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:46.976603 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1d5e869e-8997-4f1b-aca7-18e0b0d5d66c tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Calling method '.version_select at 0x7f7e8587b0d0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:47.062358 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f3620ab9-3823-4449-b605-0be66797f619 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:47.071944 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f3620ab9-3823-4449-b605-0be66797f619 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e" status: 200 len: 1319 microversion: 2.1 time: 0.491087 Aug 04 16:32:47.072784 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 51/116] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:46 2022] GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e => generated 1319 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:47.477226 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2c795827-5c81-4db4-9026-95fd46263889 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:47.477893 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2c795827-5c81-4db4-9026-95fd46263889 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] [instance: 5961044f-b35a-4051-b041-84548b5965d5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:47.494702 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2c795827-5c81-4db4-9026-95fd46263889 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:47.498089 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2c795827-5c81-4db4-9026-95fd46263889 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:47.501658 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2c795827-5c81-4db4-9026-95fd46263889 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:47.506153 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2c795827-5c81-4db4-9026-95fd46263889 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:47.700134 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1d5e869e-8997-4f1b-aca7-18e0b0d5d66c tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/d552456ac9664a5cb7d8d2ef40f158df/defaults" status: 200 len: 371 microversion: 2.1 time: 0.727988 Aug 04 16:32:47.700778 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 66/117] 10.222.0.23 () {58 vars in 1269 bytes} [Thu Aug 4 16:32:46 2022] GET /compute/v2.1/os-quota-sets/d552456ac9664a5cb7d8d2ef40f158df/defaults => generated 371 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:47.711961 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bb6bea0c-4a7b-4520-b449-af72ca998ed7 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:47.715130 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bb6bea0c-4a7b-4520-b449-af72ca998ed7 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: ac53ca0d-94da-45a3-bd53-f013b5b61d51] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:47.730880 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bb6bea0c-4a7b-4520-b449-af72ca998ed7 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:47.731337 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bb6bea0c-4a7b-4520-b449-af72ca998ed7 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:47.732116 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bb6bea0c-4a7b-4520-b449-af72ca998ed7 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:47.732549 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bb6bea0c-4a7b-4520-b449-af72ca998ed7 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:47.922128 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bb6bea0c-4a7b-4520-b449-af72ca998ed7 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a427fb7481d4799a83729910f33b01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd96a8c91974b8ba7919d5349f380ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:47.940295 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bb6bea0c-4a7b-4520-b449-af72ca998ed7 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51" status: 200 len: 1322 microversion: 2.1 time: 0.235160 Aug 04 16:32:47.942614 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 67/118] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:47 2022] GET /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:47.958157 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2628c711-221e-44ab-bcb1-03979ca494a9 tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Action: 'update', calling method: .version_select at 0x7f7e85669160>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:48.090738 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2c795827-5c81-4db4-9026-95fd46263889 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9134e4e91c6a4139a4dd8d2865a6cb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce23f198a99464ab95a3e5f98dde567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:48.105861 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2c795827-5c81-4db4-9026-95fd46263889 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] 10.222.0.23 "GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5" status: 200 len: 1337 microversion: 2.1 time: 0.632227 Aug 04 16:32:48.108161 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 52/119] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:47 2022] GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5 => generated 1337 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:48.120548 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4a881219-8b43-44ab-b110-7f81fa4703c7 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:48.124761 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4a881219-8b43-44ab-b110-7f81fa4703c7 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: dc4b9aed-b141-46b5-a62b-a039640c6310] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:48.138845 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4a881219-8b43-44ab-b110-7f81fa4703c7 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:48.139288 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4a881219-8b43-44ab-b110-7f81fa4703c7 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:48.140123 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4a881219-8b43-44ab-b110-7f81fa4703c7 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:48.140488 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4a881219-8b43-44ab-b110-7f81fa4703c7 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:48.393800 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2628c711-221e-44ab-bcb1-03979ca494a9 tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:48.394990 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2628c711-221e-44ab-bcb1-03979ca494a9 tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:48.396037 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2628c711-221e-44ab-bcb1-03979ca494a9 tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:48.396945 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2628c711-221e-44ab-bcb1-03979ca494a9 tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:48.824402 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2628c711-221e-44ab-bcb1-03979ca494a9 tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/d552456ac9664a5cb7d8d2ef40f158df" status: 200 len: 329 microversion: 2.1 time: 0.880028 Aug 04 16:32:48.826990 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 68/120] 10.222.0.23 () {60 vars in 1263 bytes} [Thu Aug 4 16:32:47 2022] PUT /compute/v2.1/os-quota-sets/d552456ac9664a5cb7d8d2ef40f158df => generated 329 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:48.838289 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f353c199-af7c-42fb-9375-f0abc3b48e86 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:48.840161 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f353c199-af7c-42fb-9375-f0abc3b48e86 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: e40c21e9-d19a-4e5f-9c7d-c4507025e94e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:48.851759 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f353c199-af7c-42fb-9375-f0abc3b48e86 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:48.852995 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f353c199-af7c-42fb-9375-f0abc3b48e86 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:48.854580 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f353c199-af7c-42fb-9375-f0abc3b48e86 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:48.855539 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f353c199-af7c-42fb-9375-f0abc3b48e86 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:48.895177 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4a881219-8b43-44ab-b110-7f81fa4703c7 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052613a51b86400c916dbc800563896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0ceaab59d4aeaa8667cef6f62559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:48.911790 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4a881219-8b43-44ab-b110-7f81fa4703c7 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "GET /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310" status: 200 len: 1318 microversion: 2.1 time: 0.799804 Aug 04 16:32:48.914497 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 53/121] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:48 2022] GET /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310 => generated 1318 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:48.930558 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6b7e6fad-1079-42a8-9e06-995c92763b0e tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Action: 'update', calling method: .version_select at 0x7f7e84d5c700>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:49.258275 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f353c199-af7c-42fb-9375-f0abc3b48e86 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:49.269588 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f353c199-af7c-42fb-9375-f0abc3b48e86 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e" status: 200 len: 1319 microversion: 2.1 time: 0.440396 Aug 04 16:32:49.283296 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 69/122] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:48 2022] GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e => generated 1319 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:49.290727 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ff687cc5-7f52-45ef-8498-bbca4fbf90ca tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:49.291621 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ff687cc5-7f52-45ef-8498-bbca4fbf90ca tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: ac53ca0d-94da-45a3-bd53-f013b5b61d51] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:49.300221 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ff687cc5-7f52-45ef-8498-bbca4fbf90ca tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:49.301042 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ff687cc5-7f52-45ef-8498-bbca4fbf90ca tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:49.302806 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ff687cc5-7f52-45ef-8498-bbca4fbf90ca tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:49.303511 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ff687cc5-7f52-45ef-8498-bbca4fbf90ca tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:49.448941 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6b7e6fad-1079-42a8-9e06-995c92763b0e tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:49.449891 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6b7e6fad-1079-42a8-9e06-995c92763b0e tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:49.450865 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6b7e6fad-1079-42a8-9e06-995c92763b0e tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:49.451439 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6b7e6fad-1079-42a8-9e06-995c92763b0e tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:49.840724 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ff687cc5-7f52-45ef-8498-bbca4fbf90ca tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a427fb7481d4799a83729910f33b01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd96a8c91974b8ba7919d5349f380ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:49.849167 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ff687cc5-7f52-45ef-8498-bbca4fbf90ca tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51" status: 200 len: 1390 microversion: 2.1 time: 0.563368 Aug 04 16:32:49.850654 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 70/123] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:49 2022] GET /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51 => generated 1390 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:49.856648 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8a8a7f4b-fc5b-4bbb-b7ee-727974783461 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:49.857652 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8a8a7f4b-fc5b-4bbb-b7ee-727974783461 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] [instance: 5961044f-b35a-4051-b041-84548b5965d5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:49.864821 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a8a7f4b-fc5b-4bbb-b7ee-727974783461 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:49.865259 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a8a7f4b-fc5b-4bbb-b7ee-727974783461 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:49.866322 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a8a7f4b-fc5b-4bbb-b7ee-727974783461 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:49.866839 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a8a7f4b-fc5b-4bbb-b7ee-727974783461 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:50.107961 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6b7e6fad-1079-42a8-9e06-995c92763b0e tempest-QuotasAdminTestJSON-682969114 tempest-QuotasAdminTestJSON-682969114-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/d552456ac9664a5cb7d8d2ef40f158df" status: 200 len: 329 microversion: 2.1 time: 1.189932 Aug 04 16:32:50.109513 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 54/124] 10.222.0.23 () {60 vars in 1263 bytes} [Thu Aug 4 16:32:48 2022] PUT /compute/v2.1/os-quota-sets/d552456ac9664a5cb7d8d2ef40f158df => generated 329 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:50.122442 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c9c61dfd-d514-458f-97a9-00656ce79a1a tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:50.123423 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c9c61dfd-d514-458f-97a9-00656ce79a1a tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: dc4b9aed-b141-46b5-a62b-a039640c6310] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:50.135461 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c9c61dfd-d514-458f-97a9-00656ce79a1a tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:50.137042 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c9c61dfd-d514-458f-97a9-00656ce79a1a tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:50.140376 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c9c61dfd-d514-458f-97a9-00656ce79a1a tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:50.141086 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c9c61dfd-d514-458f-97a9-00656ce79a1a tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:50.343483 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8a8a7f4b-fc5b-4bbb-b7ee-727974783461 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9134e4e91c6a4139a4dd8d2865a6cb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce23f198a99464ab95a3e5f98dde567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:50.368964 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8a8a7f4b-fc5b-4bbb-b7ee-727974783461 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] 10.222.0.23 "GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5" status: 200 len: 1337 microversion: 2.1 time: 0.513152 Aug 04 16:32:50.371738 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 71/125] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:49 2022] GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5 => generated 1337 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:50.383443 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-604f5613-7288-4b87-838c-0afe1a32c382 req-41235fdb-d152-4609-a59c-ac7e1bef3a36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc4b9aed-b141-46b5-a62b-a039640c6310", "tag": "b36286b7-ac15-434a-b1b1-2550a45b0402"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:50.420201 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-604f5613-7288-4b87-838c-0afe1a32c382 req-41235fdb-d152-4609-a59c-ac7e1bef3a36 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:50.421479 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-604f5613-7288-4b87-838c-0afe1a32c382 req-41235fdb-d152-4609-a59c-ac7e1bef3a36 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:50.449843 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-604f5613-7288-4b87-838c-0afe1a32c382 req-41235fdb-d152-4609-a59c-ac7e1bef3a36 service nova] Creating event network-changed:b36286b7-ac15-434a-b1b1-2550a45b0402 for instance dc4b9aed-b141-46b5-a62b-a039640c6310 on n-h1-846466-12 Aug 04 16:32:50.467015 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-604f5613-7288-4b87-838c-0afe1a32c382 req-41235fdb-d152-4609-a59c-ac7e1bef3a36 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092423 Aug 04 16:32:50.468542 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 72/126] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:50.554244 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c9c61dfd-d514-458f-97a9-00656ce79a1a tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052613a51b86400c916dbc800563896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0ceaab59d4aeaa8667cef6f62559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:50.568531 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c9c61dfd-d514-458f-97a9-00656ce79a1a tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "GET /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310" status: 200 len: 1318 microversion: 2.1 time: 0.457335 Aug 04 16:32:50.569696 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 55/127] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:50 2022] GET /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310 => generated 1318 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:50.576229 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7e1ff336-d809-4fde-9154-12e047d240d0 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:50.577449 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7e1ff336-d809-4fde-9154-12e047d240d0 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: e40c21e9-d19a-4e5f-9c7d-c4507025e94e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:50.586037 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7e1ff336-d809-4fde-9154-12e047d240d0 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:50.586655 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7e1ff336-d809-4fde-9154-12e047d240d0 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:50.587576 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7e1ff336-d809-4fde-9154-12e047d240d0 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:50.588067 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7e1ff336-d809-4fde-9154-12e047d240d0 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:50.875398 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-eddd7221-ee2b-4f0e-91a2-2e1da7be4c2f req-df79e51e-0695-45d8-989a-2f08239a4d0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e40c21e9-d19a-4e5f-9c7d-c4507025e94e", "name": "network-vif-plugged", "status": "completed", "tag": "f0ca0e96-7387-46db-9244-1e3b3f97dd7a"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:50.896057 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=78,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=1,nova_api:INSERT=17 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:32:50.905590 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7e1ff336-d809-4fde-9154-12e047d240d0 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:50.908094 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-eddd7221-ee2b-4f0e-91a2-2e1da7be4c2f req-df79e51e-0695-45d8-989a-2f08239a4d0f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:50.909184 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-eddd7221-ee2b-4f0e-91a2-2e1da7be4c2f req-df79e51e-0695-45d8-989a-2f08239a4d0f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:50.919154 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7e1ff336-d809-4fde-9154-12e047d240d0 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e" status: 200 len: 1319 microversion: 2.1 time: 0.347983 Aug 04 16:32:50.919747 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 56/128] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:50 2022] GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e => generated 1319 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:50.933978 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-71052eac-bae2-44a8-91cd-19fa2b3432ed tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:50.933978 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-71052eac-bae2-44a8-91cd-19fa2b3432ed tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: ac53ca0d-94da-45a3-bd53-f013b5b61d51] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:50.947399 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-71052eac-bae2-44a8-91cd-19fa2b3432ed tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:50.948109 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-71052eac-bae2-44a8-91cd-19fa2b3432ed tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:50.949236 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-71052eac-bae2-44a8-91cd-19fa2b3432ed tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:50.949958 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-71052eac-bae2-44a8-91cd-19fa2b3432ed tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:50.966075 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-eddd7221-ee2b-4f0e-91a2-2e1da7be4c2f req-df79e51e-0695-45d8-989a-2f08239a4d0f service nova] Creating event network-vif-plugged:f0ca0e96-7387-46db-9244-1e3b3f97dd7a for instance e40c21e9-d19a-4e5f-9c7d-c4507025e94e on n-h1-846466-12 Aug 04 16:32:50.977225 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-eddd7221-ee2b-4f0e-91a2-2e1da7be4c2f req-df79e51e-0695-45d8-989a-2f08239a4d0f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.504805 Aug 04 16:32:50.978611 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 73/129] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:51.283596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-71052eac-bae2-44a8-91cd-19fa2b3432ed tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a427fb7481d4799a83729910f33b01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd96a8c91974b8ba7919d5349f380ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:51.293648 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-71052eac-bae2-44a8-91cd-19fa2b3432ed tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51" status: 200 len: 1390 microversion: 2.1 time: 0.372813 Aug 04 16:32:51.294464 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 57/130] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:50 2022] GET /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51 => generated 1390 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:51.390834 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-57362c04-635b-41dc-a3be-c6a6d0ada03c tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:51.391510 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-57362c04-635b-41dc-a3be-c6a6d0ada03c tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] [instance: 5961044f-b35a-4051-b041-84548b5965d5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:51.400215 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-57362c04-635b-41dc-a3be-c6a6d0ada03c tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:51.401345 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-57362c04-635b-41dc-a3be-c6a6d0ada03c tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:51.403162 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-57362c04-635b-41dc-a3be-c6a6d0ada03c tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:51.404341 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-57362c04-635b-41dc-a3be-c6a6d0ada03c tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:51.599305 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c500a028-5617-4297-a95e-efab35ce6f78 tempest-FlavorsV255TestJSON-1332749091 tempest-FlavorsV255TestJSON-1332749091-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-915976176", "id": 1111733067, "os-flavor-access:is_public": "True"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:51.604683 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:51.604683 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:32:51.628184 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c500a028-5617-4297-a95e-efab35ce6f78 tempest-FlavorsV255TestJSON-1332749091 tempest-FlavorsV255TestJSON-1332749091-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.427348 Aug 04 16:32:51.636718 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 74/131] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Aug 4 16:32:51 2022] POST /compute/v2.1/flavors => generated 448 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 16:32:51.636924 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-57362c04-635b-41dc-a3be-c6a6d0ada03c tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9134e4e91c6a4139a4dd8d2865a6cb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce23f198a99464ab95a3e5f98dde567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:51.637421 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0b71c6e3-3f3b-4a83-84e8-47338af64e53 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:51.637421 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0b71c6e3-3f3b-4a83-84e8-47338af64e53 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: dc4b9aed-b141-46b5-a62b-a039640c6310] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:51.641466 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-57362c04-635b-41dc-a3be-c6a6d0ada03c tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] 10.222.0.23 "GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5" status: 200 len: 1337 microversion: 2.1 time: 0.254959 Aug 04 16:32:51.642581 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 58/132] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:51 2022] GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5 => generated 1337 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:32:51.642750 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0b71c6e3-3f3b-4a83-84e8-47338af64e53 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:51.644069 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0b71c6e3-3f3b-4a83-84e8-47338af64e53 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:51.645000 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0b71c6e3-3f3b-4a83-84e8-47338af64e53 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:51.646107 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0b71c6e3-3f3b-4a83-84e8-47338af64e53 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:51.815391 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0b71c6e3-3f3b-4a83-84e8-47338af64e53 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052613a51b86400c916dbc800563896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0ceaab59d4aeaa8667cef6f62559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:51.823852 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0b71c6e3-3f3b-4a83-84e8-47338af64e53 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "GET /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310" status: 200 len: 1318 microversion: 2.1 time: 0.193362 Aug 04 16:32:51.824443 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 75/133] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:51 2022] GET /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:51.920998 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a6ac545a-4d4c-44ce-a835-870dcb334d60 tempest-FlavorsV255TestJSON-1469347348 tempest-FlavorsV255TestJSON-1469347348-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:51.930390 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a6ac545a-4d4c-44ce-a835-870dcb334d60 tempest-FlavorsV255TestJSON-1469347348 tempest-FlavorsV255TestJSON-1469347348-project] 10.222.0.23 "GET /compute/v2.1/flavors/1111733067" status: 200 len: 448 microversion: 2.55 time: 0.270118 Aug 04 16:32:51.931511 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 59/134] 10.222.0.23 () {60 vars in 1199 bytes} [Thu Aug 4 16:32:51 2022] GET /compute/v2.1/flavors/1111733067 => generated 448 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:32:51.939999 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-54da1e32-077e-4ba3-80c2-7994c11fee0c tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:51.941208 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-54da1e32-077e-4ba3-80c2-7994c11fee0c tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: e40c21e9-d19a-4e5f-9c7d-c4507025e94e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:51.944850 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-99482664-bcfc-4e92-a86b-3ac6f83cc3d4 tempest-FlavorsV255TestJSON-1332749091 tempest-FlavorsV255TestJSON-1332749091-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:51.947753 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:51.947753 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:32:51.948717 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-54da1e32-077e-4ba3-80c2-7994c11fee0c tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:51.949153 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-54da1e32-077e-4ba3-80c2-7994c11fee0c tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:51.949940 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-54da1e32-077e-4ba3-80c2-7994c11fee0c tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:51.955215 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-54da1e32-077e-4ba3-80c2-7994c11fee0c tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:51.976349 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-99482664-bcfc-4e92-a86b-3ac6f83cc3d4 tempest-FlavorsV255TestJSON-1332749091 tempest-FlavorsV255TestJSON-1332749091-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/1111733067" status: 200 len: 449 microversion: 2.55 time: 0.036007 Aug 04 16:32:51.978444 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 60/135] 10.222.0.23 () {62 vars in 1219 bytes} [Thu Aug 4 16:32:51 2022] PUT /compute/v2.1/flavors/1111733067 => generated 449 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:32:51.993087 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4534e0bc-0d93-4169-8a05-71b188480c89 tempest-FlavorsV255TestJSON-1469347348 tempest-FlavorsV255TestJSON-1469347348-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:52.040709 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4534e0bc-0d93-4169-8a05-71b188480c89 tempest-FlavorsV255TestJSON-1469347348 tempest-FlavorsV255TestJSON-1469347348-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6595 microversion: 2.55 time: 0.053842 Aug 04 16:32:52.045334 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 61/136] 10.222.0.23 () {60 vars in 1187 bytes} [Thu Aug 4 16:32:51 2022] GET /compute/v2.1/flavors/detail => generated 6595 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:32:52.063342 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-71177b67-e65c-4d11-9ccd-f41157f66060 tempest-FlavorsV255TestJSON-1469347348 tempest-FlavorsV255TestJSON-1469347348-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:52.090327 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-71177b67-e65c-4d11-9ccd-f41157f66060 tempest-FlavorsV255TestJSON-1469347348 tempest-FlavorsV255TestJSON-1469347348-project] 10.222.0.23 "GET /compute/v2.1/flavors" status: 200 len: 3685 microversion: 2.55 time: 0.032380 Aug 04 16:32:52.091118 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 62/137] 10.222.0.23 () {60 vars in 1166 bytes} [Thu Aug 4 16:32:52 2022] GET /compute/v2.1/flavors => generated 3685 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:32:52.156192 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-54da1e32-077e-4ba3-80c2-7994c11fee0c tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:52.165884 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-54da1e32-077e-4ba3-80c2-7994c11fee0c tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e" status: 200 len: 1319 microversion: 2.1 time: 0.229485 Aug 04 16:32:52.166678 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 76/138] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:51 2022] GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:52.172056 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4eaacdf8-67d8-43e4-ba74-652599c6c174 tempest-FlavorsV255TestJSON-1332749091 tempest-FlavorsV255TestJSON-1332749091-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:52.172923 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:52.172923 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:32:52.197529 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4eaacdf8-67d8-43e4-ba74-652599c6c174 tempest-FlavorsV255TestJSON-1332749091 tempest-FlavorsV255TestJSON-1332749091-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1111733067" status: 202 len: 0 microversion: 2.55 time: 0.029057 Aug 04 16:32:52.198426 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 77/139] 10.222.0.23 () {60 vars in 1202 bytes} [Thu Aug 4 16:32:52 2022] DELETE /compute/v2.1/flavors/1111733067 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:32:52.207217 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-eb4fb0a1-c579-41dc-8a80-272108fbde99 tempest-FlavorsV255TestJSON-1332749091 tempest-FlavorsV255TestJSON-1332749091-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:52.238148 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-eb4fb0a1-c579-41dc-8a80-272108fbde99 tempest-FlavorsV255TestJSON-1332749091 tempest-FlavorsV255TestJSON-1332749091-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6156 microversion: 2.55 time: 0.034965 Aug 04 16:32:52.245377 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 78/140] 10.222.0.23 () {60 vars in 1187 bytes} [Thu Aug 4 16:32:52 2022] GET /compute/v2.1/flavors/detail => generated 6156 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:32:52.245599 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-72bad7f0-09d1-43c8-9060-556a663a07bd tempest-HypervisorAdminUnderV252Test-1667759502 tempest-HypervisorAdminUnderV252Test-1667759502-project-admin] Calling method '.version_select at 0x7f7e84d4b700>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:52.245599 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:52.245599 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:32:52.245599 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-72bad7f0-09d1-43c8-9060-556a663a07bd tempest-HypervisorAdminUnderV252Test-1667759502 tempest-HypervisorAdminUnderV252Test-1667759502-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:52.245599 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-72bad7f0-09d1-43c8-9060-556a663a07bd tempest-HypervisorAdminUnderV252Test-1667759502 tempest-HypervisorAdminUnderV252Test-1667759502-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:52.254081 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=14,nova_api:UPDATE=15 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:32:52.259310 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-72bad7f0-09d1-43c8-9060-556a663a07bd tempest-HypervisorAdminUnderV252Test-1667759502 tempest-HypervisorAdminUnderV252Test-1667759502-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:52.259987 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-72bad7f0-09d1-43c8-9060-556a663a07bd tempest-HypervisorAdminUnderV252Test-1667759502 tempest-HypervisorAdminUnderV252Test-1667759502-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:52.278162 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-72bad7f0-09d1-43c8-9060-556a663a07bd tempest-HypervisorAdminUnderV252Test-1667759502 tempest-HypervisorAdminUnderV252Test-1667759502-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:52.278781 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-72bad7f0-09d1-43c8-9060-556a663a07bd tempest-HypervisorAdminUnderV252Test-1667759502 tempest-HypervisorAdminUnderV252Test-1667759502-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:52.287041 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-72bad7f0-09d1-43c8-9060-556a663a07bd tempest-HypervisorAdminUnderV252Test-1667759502 tempest-HypervisorAdminUnderV252Test-1667759502-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.194939 Aug 04 16:32:52.293865 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 63/141] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:32:52 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:52.298826 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-12f3204d-b683-4fee-a4d7-9286494630ef tempest-HypervisorAdminUnderV252Test-1667759502 tempest-HypervisorAdminUnderV252Test-1667759502-project-admin] Calling method '.version_select at 0x7f7e85787e50>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:52.299728 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:52.299728 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:32:52.301068 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-12f3204d-b683-4fee-a4d7-9286494630ef tempest-HypervisorAdminUnderV252Test-1667759502 tempest-HypervisorAdminUnderV252Test-1667759502-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:52.301642 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-12f3204d-b683-4fee-a4d7-9286494630ef tempest-HypervisorAdminUnderV252Test-1667759502 tempest-HypervisorAdminUnderV252Test-1667759502-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:52.316284 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1cd54de4-f677-4c3b-8e8f-41d2de1710bd tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:52.317076 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1cd54de4-f677-4c3b-8e8f-41d2de1710bd tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: ac53ca0d-94da-45a3-bd53-f013b5b61d51] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:52.325969 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1cd54de4-f677-4c3b-8e8f-41d2de1710bd tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:52.328579 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1cd54de4-f677-4c3b-8e8f-41d2de1710bd tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:52.331015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1cd54de4-f677-4c3b-8e8f-41d2de1710bd tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:52.331963 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1cd54de4-f677-4c3b-8e8f-41d2de1710bd tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:52.342660 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-12f3204d-b683-4fee-a4d7-9286494630ef tempest-HypervisorAdminUnderV252Test-1667759502 tempest-HypervisorAdminUnderV252Test-1667759502-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:52.343237 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-12f3204d-b683-4fee-a4d7-9286494630ef tempest-HypervisorAdminUnderV252Test-1667759502 tempest-HypervisorAdminUnderV252Test-1667759502-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:52.382564 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-12f3204d-b683-4fee-a4d7-9286494630ef tempest-HypervisorAdminUnderV252Test-1667759502 tempest-HypervisorAdminUnderV252Test-1667759502-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:52.383102 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-12f3204d-b683-4fee-a4d7-9286494630ef tempest-HypervisorAdminUnderV252Test-1667759502 tempest-HypervisorAdminUnderV252Test-1667759502-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:52.390720 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-12f3204d-b683-4fee-a4d7-9286494630ef tempest-HypervisorAdminUnderV252Test-1667759502 tempest-HypervisorAdminUnderV252Test-1667759502-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/n-h2-846466-12/servers" status: 200 len: 197 microversion: 2.1 time: 0.094754 Aug 04 16:32:52.392568 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 79/142] 10.222.0.23 () {58 vars in 1215 bytes} [Thu Aug 4 16:32:52 2022] GET /compute/v2.1/os-hypervisors/n-h2-846466-12/servers => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:52.404910 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2cb769f8-0b4e-408a-9ab4-1245ae7d382c tempest-HypervisorAdminUnderV252Test-1667759502 tempest-HypervisorAdminUnderV252Test-1667759502-project-admin] Calling method '.version_select at 0x7f7e8565bee0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:52.405793 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:52.405793 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:32:52.407056 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2cb769f8-0b4e-408a-9ab4-1245ae7d382c tempest-HypervisorAdminUnderV252Test-1667759502 tempest-HypervisorAdminUnderV252Test-1667759502-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:52.407382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2cb769f8-0b4e-408a-9ab4-1245ae7d382c tempest-HypervisorAdminUnderV252Test-1667759502 tempest-HypervisorAdminUnderV252Test-1667759502-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:52.422453 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2cb769f8-0b4e-408a-9ab4-1245ae7d382c tempest-HypervisorAdminUnderV252Test-1667759502 tempest-HypervisorAdminUnderV252Test-1667759502-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:52.422886 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2cb769f8-0b4e-408a-9ab4-1245ae7d382c tempest-HypervisorAdminUnderV252Test-1667759502 tempest-HypervisorAdminUnderV252Test-1667759502-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:52.433701 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2cb769f8-0b4e-408a-9ab4-1245ae7d382c tempest-HypervisorAdminUnderV252Test-1667759502 tempest-HypervisorAdminUnderV252Test-1667759502-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:52.434335 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2cb769f8-0b4e-408a-9ab4-1245ae7d382c tempest-HypervisorAdminUnderV252Test-1667759502 tempest-HypervisorAdminUnderV252Test-1667759502-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:52.441165 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2cb769f8-0b4e-408a-9ab4-1245ae7d382c tempest-HypervisorAdminUnderV252Test-1667759502 tempest-HypervisorAdminUnderV252Test-1667759502-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.040685 Aug 04 16:32:52.442062 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 80/143] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:32:52 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:52.455599 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bcf6961b-9ef4-4454-8fb1-3ae19e9ca7da tempest-HypervisorAdminUnderV252Test-1667759502 tempest-HypervisorAdminUnderV252Test-1667759502-project-admin] Calling method '.version_select at 0x7f7e8565b3a0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:52.456597 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:52.456597 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:32:52.458230 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bcf6961b-9ef4-4454-8fb1-3ae19e9ca7da tempest-HypervisorAdminUnderV252Test-1667759502 tempest-HypervisorAdminUnderV252Test-1667759502-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:52.459019 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bcf6961b-9ef4-4454-8fb1-3ae19e9ca7da tempest-HypervisorAdminUnderV252Test-1667759502 tempest-HypervisorAdminUnderV252Test-1667759502-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:52.473183 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bcf6961b-9ef4-4454-8fb1-3ae19e9ca7da tempest-HypervisorAdminUnderV252Test-1667759502 tempest-HypervisorAdminUnderV252Test-1667759502-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:52.473669 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bcf6961b-9ef4-4454-8fb1-3ae19e9ca7da tempest-HypervisorAdminUnderV252Test-1667759502 tempest-HypervisorAdminUnderV252Test-1667759502-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:52.482434 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bcf6961b-9ef4-4454-8fb1-3ae19e9ca7da tempest-HypervisorAdminUnderV252Test-1667759502 tempest-HypervisorAdminUnderV252Test-1667759502-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/n-h2-846466-12/search" status: 200 len: 105 microversion: 2.1 time: 0.033249 Aug 04 16:32:52.483242 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 81/144] 10.222.0.23 () {58 vars in 1212 bytes} [Thu Aug 4 16:32:52 2022] GET /compute/v2.1/os-hypervisors/n-h2-846466-12/search => generated 105 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:32:52.507125 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-e9a5713d-3b4a-4cd4-9892-82a674e434d1 req-53125994-b56c-4439-bf10-777e8cce21f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac53ca0d-94da-45a3-bd53-f013b5b61d51", "tag": "4c2eed2c-2a7c-44ed-915e-f94311a74757"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:52.510506 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1cd54de4-f677-4c3b-8e8f-41d2de1710bd tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a427fb7481d4799a83729910f33b01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd96a8c91974b8ba7919d5349f380ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:52.518966 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-e9a5713d-3b4a-4cd4-9892-82a674e434d1 req-53125994-b56c-4439-bf10-777e8cce21f1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:52.519401 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1cd54de4-f677-4c3b-8e8f-41d2de1710bd tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51" status: 200 len: 1390 microversion: 2.1 time: 0.206978 Aug 04 16:32:52.519675 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-e9a5713d-3b4a-4cd4-9892-82a674e434d1 req-53125994-b56c-4439-bf10-777e8cce21f1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:52.533697 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-e9a5713d-3b4a-4cd4-9892-82a674e434d1 req-53125994-b56c-4439-bf10-777e8cce21f1 service nova] Creating event network-changed:4c2eed2c-2a7c-44ed-915e-f94311a74757 for instance ac53ca0d-94da-45a3-bd53-f013b5b61d51 on n-h1-846466-12 Aug 04 16:32:52.534947 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 64/145] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:52 2022] GET /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51 => generated 1390 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:52.540482 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-e9a5713d-3b4a-4cd4-9892-82a674e434d1 req-53125994-b56c-4439-bf10-777e8cce21f1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035848 Aug 04 16:32:52.540482 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 82/146] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:32:52.664164 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-13e8f05d-4983-4a9c-9695-302b777c8374 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:52.665588 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-13e8f05d-4983-4a9c-9695-302b777c8374 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] [instance: 5961044f-b35a-4051-b041-84548b5965d5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:52.674282 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-13e8f05d-4983-4a9c-9695-302b777c8374 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:52.675994 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-13e8f05d-4983-4a9c-9695-302b777c8374 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:52.676964 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-13e8f05d-4983-4a9c-9695-302b777c8374 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:52.677563 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-13e8f05d-4983-4a9c-9695-302b777c8374 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:52.847504 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e838a902-21c7-48c8-a233-439373613406 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:52.848196 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e838a902-21c7-48c8-a233-439373613406 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: dc4b9aed-b141-46b5-a62b-a039640c6310] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:52.857872 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e838a902-21c7-48c8-a233-439373613406 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:52.862798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e838a902-21c7-48c8-a233-439373613406 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:52.863630 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e838a902-21c7-48c8-a233-439373613406 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:52.864047 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e838a902-21c7-48c8-a233-439373613406 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:52.893987 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=100 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:32:52.984014 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-13e8f05d-4983-4a9c-9695-302b777c8374 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9134e4e91c6a4139a4dd8d2865a6cb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce23f198a99464ab95a3e5f98dde567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:53.006584 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-13e8f05d-4983-4a9c-9695-302b777c8374 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] 10.222.0.23 "GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5" status: 200 len: 1337 microversion: 2.1 time: 0.348274 Aug 04 16:32:53.008460 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 65/147] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:52 2022] GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5 => generated 1337 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:53.024741 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-47ab9671-70e1-435e-bb6c-939ec9beff20 req-c2a98384-c699-46c1-b348-71f40c9e490c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5961044f-b35a-4051-b041-84548b5965d5", "name": "network-vif-plugged", "status": "completed", "tag": "d461805a-8b8b-408f-9fa3-99e31d86b832"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:53.053964 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-47ab9671-70e1-435e-bb6c-939ec9beff20 req-c2a98384-c699-46c1-b348-71f40c9e490c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:53.054408 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-47ab9671-70e1-435e-bb6c-939ec9beff20 req-c2a98384-c699-46c1-b348-71f40c9e490c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:53.079697 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-47ab9671-70e1-435e-bb6c-939ec9beff20 req-c2a98384-c699-46c1-b348-71f40c9e490c service nova] Creating event network-vif-plugged:d461805a-8b8b-408f-9fa3-99e31d86b832 for instance 5961044f-b35a-4051-b041-84548b5965d5 on n-h2-846466-12 Aug 04 16:32:53.086904 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-47ab9671-70e1-435e-bb6c-939ec9beff20 req-c2a98384-c699-46c1-b348-71f40c9e490c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076040 Aug 04 16:32:53.091881 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 66/148] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:53.092518 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e838a902-21c7-48c8-a233-439373613406 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052613a51b86400c916dbc800563896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0ceaab59d4aeaa8667cef6f62559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:53.102196 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e838a902-21c7-48c8-a233-439373613406 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "GET /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310" status: 200 len: 1318 microversion: 2.1 time: 0.258689 Aug 04 16:32:53.116186 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 83/149] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:52 2022] GET /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310 => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:53.197864 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f048b201-4c41-4aa7-bbb0-f77d00241af3 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:53.198855 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f048b201-4c41-4aa7-bbb0-f77d00241af3 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: e40c21e9-d19a-4e5f-9c7d-c4507025e94e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:53.213125 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f048b201-4c41-4aa7-bbb0-f77d00241af3 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:53.213734 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f048b201-4c41-4aa7-bbb0-f77d00241af3 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:53.214652 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f048b201-4c41-4aa7-bbb0-f77d00241af3 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:53.215357 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f048b201-4c41-4aa7-bbb0-f77d00241af3 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:53.491618 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f048b201-4c41-4aa7-bbb0-f77d00241af3 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:53.500836 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f048b201-4c41-4aa7-bbb0-f77d00241af3 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e" status: 200 len: 1319 microversion: 2.1 time: 0.316753 Aug 04 16:32:53.501625 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 67/150] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:53 2022] GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e => generated 1319 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:53.543654 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2ab40421-b1b7-481c-ba7e-73235d615a3c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:53.544255 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2ab40421-b1b7-481c-ba7e-73235d615a3c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: ac53ca0d-94da-45a3-bd53-f013b5b61d51] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:53.550608 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ab40421-b1b7-481c-ba7e-73235d615a3c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:53.551029 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ab40421-b1b7-481c-ba7e-73235d615a3c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:53.551770 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ab40421-b1b7-481c-ba7e-73235d615a3c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:53.552375 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ab40421-b1b7-481c-ba7e-73235d615a3c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:53.944974 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2ab40421-b1b7-481c-ba7e-73235d615a3c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a427fb7481d4799a83729910f33b01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd96a8c91974b8ba7919d5349f380ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:53.953911 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2ab40421-b1b7-481c-ba7e-73235d615a3c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51" status: 200 len: 1390 microversion: 2.1 time: 0.413718 Aug 04 16:32:53.954635 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 84/151] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:53 2022] GET /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51 => generated 1390 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:54.031656 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-88bb3a8d-1791-43bb-90f8-8ff1f41dcdc1 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:54.032142 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-88bb3a8d-1791-43bb-90f8-8ff1f41dcdc1 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] [instance: 5961044f-b35a-4051-b041-84548b5965d5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:54.039594 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-88bb3a8d-1791-43bb-90f8-8ff1f41dcdc1 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:54.040958 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-88bb3a8d-1791-43bb-90f8-8ff1f41dcdc1 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:54.041799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-88bb3a8d-1791-43bb-90f8-8ff1f41dcdc1 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:54.042386 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-88bb3a8d-1791-43bb-90f8-8ff1f41dcdc1 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:54.046918 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=100 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:32:54.124141 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d4961dd1-97ab-4b9d-95ea-6f1b57126fbf tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:54.124660 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d4961dd1-97ab-4b9d-95ea-6f1b57126fbf tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: dc4b9aed-b141-46b5-a62b-a039640c6310] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:54.141485 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d4961dd1-97ab-4b9d-95ea-6f1b57126fbf tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:54.141927 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d4961dd1-97ab-4b9d-95ea-6f1b57126fbf tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:54.143285 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d4961dd1-97ab-4b9d-95ea-6f1b57126fbf tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:54.144005 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d4961dd1-97ab-4b9d-95ea-6f1b57126fbf tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:54.226307 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-88bb3a8d-1791-43bb-90f8-8ff1f41dcdc1 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9134e4e91c6a4139a4dd8d2865a6cb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce23f198a99464ab95a3e5f98dde567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:54.237812 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-88bb3a8d-1791-43bb-90f8-8ff1f41dcdc1 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] 10.222.0.23 "GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5" status: 200 len: 1337 microversion: 2.1 time: 0.210859 Aug 04 16:32:54.247088 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 68/152] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:54 2022] GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5 => generated 1337 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:54.355341 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d4961dd1-97ab-4b9d-95ea-6f1b57126fbf tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052613a51b86400c916dbc800563896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0ceaab59d4aeaa8667cef6f62559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:54.364060 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d4961dd1-97ab-4b9d-95ea-6f1b57126fbf tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "GET /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310" status: 200 len: 1318 microversion: 2.1 time: 0.243747 Aug 04 16:32:54.365013 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 85/153] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:54 2022] GET /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:32:54.528703 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1625e461-d6d7-41d2-898d-d2322d8fe003 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:54.529410 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1625e461-d6d7-41d2-898d-d2322d8fe003 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: e40c21e9-d19a-4e5f-9c7d-c4507025e94e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:54.545814 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1625e461-d6d7-41d2-898d-d2322d8fe003 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:54.546859 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1625e461-d6d7-41d2-898d-d2322d8fe003 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:54.548322 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1625e461-d6d7-41d2-898d-d2322d8fe003 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:54.549055 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1625e461-d6d7-41d2-898d-d2322d8fe003 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:54.808499 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1625e461-d6d7-41d2-898d-d2322d8fe003 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:54.816655 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1625e461-d6d7-41d2-898d-d2322d8fe003 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e" status: 200 len: 1469 microversion: 2.1 time: 0.294494 Aug 04 16:32:54.817253 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 69/154] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:54 2022] GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e => generated 1469 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:54.936984 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e599205d-8687-4452-ba4d-6da77025cdb3 tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] Calling method '.version_select at 0x7f7e8565b3a0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:55.051986 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e599205d-8687-4452-ba4d-6da77025cdb3 tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/da18ed1da01548f89f484fa2528ef3c7" status: 200 len: 371 microversion: 2.1 time: 0.287446 Aug 04 16:32:55.053159 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 86/155] 10.222.0.23 () {58 vars in 1242 bytes} [Thu Aug 4 16:32:54 2022] GET /compute/v2.1/os-quota-sets/da18ed1da01548f89f484fa2528ef3c7 => generated 371 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:55.058991 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c1dde787-a3e3-4918-be45-bb70dbfea641 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:55.059932 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c1dde787-a3e3-4918-be45-bb70dbfea641 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: ac53ca0d-94da-45a3-bd53-f013b5b61d51] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:55.068574 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c1dde787-a3e3-4918-be45-bb70dbfea641 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:55.069465 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c1dde787-a3e3-4918-be45-bb70dbfea641 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:55.070598 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c1dde787-a3e3-4918-be45-bb70dbfea641 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:55.071227 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c1dde787-a3e3-4918-be45-bb70dbfea641 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:55.133240 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8b7754da-cc36-4991-a179-c3596b67cea0 tempest-DeleteServersAdminTestJSON-608170302 tempest-DeleteServersAdminTestJSON-608170302-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:55.134599 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8b7754da-cc36-4991-a179-c3596b67cea0 tempest-DeleteServersAdminTestJSON-608170302 tempest-DeleteServersAdminTestJSON-608170302-project-admin] [instance: e40c21e9-d19a-4e5f-9c7d-c4507025e94e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:55.143940 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8b7754da-cc36-4991-a179-c3596b67cea0 tempest-DeleteServersAdminTestJSON-608170302 tempest-DeleteServersAdminTestJSON-608170302-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:55.145076 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8b7754da-cc36-4991-a179-c3596b67cea0 tempest-DeleteServersAdminTestJSON-608170302 tempest-DeleteServersAdminTestJSON-608170302-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:55.146113 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8b7754da-cc36-4991-a179-c3596b67cea0 tempest-DeleteServersAdminTestJSON-608170302 tempest-DeleteServersAdminTestJSON-608170302-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:55.146962 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8b7754da-cc36-4991-a179-c3596b67cea0 tempest-DeleteServersAdminTestJSON-608170302 tempest-DeleteServersAdminTestJSON-608170302-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:55.271820 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8b7754da-cc36-4991-a179-c3596b67cea0 tempest-DeleteServersAdminTestJSON-608170302 tempest-DeleteServersAdminTestJSON-608170302-project-admin] [instance: e40c21e9-d19a-4e5f-9c7d-c4507025e94e] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:32:55.445684 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c1dde787-a3e3-4918-be45-bb70dbfea641 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a427fb7481d4799a83729910f33b01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd96a8c91974b8ba7919d5349f380ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:55.472976 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c1dde787-a3e3-4918-be45-bb70dbfea641 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51" status: 200 len: 1390 microversion: 2.1 time: 0.418386 Aug 04 16:32:55.476444 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 87/156] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:55 2022] GET /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51 => generated 1390 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:55.487376 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2c687c3f-7a34-4bd8-a96d-4ee58f26cd72 tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] Action: 'update', calling method: .version_select at 0x7f7e855bf4c0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:55.497270 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8b7754da-cc36-4991-a179-c3596b67cea0 tempest-DeleteServersAdminTestJSON-608170302 tempest-DeleteServersAdminTestJSON-608170302-project-admin] 10.222.0.23 "DELETE /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e" status: 204 len: 0 microversion: 2.1 time: 0.661304 Aug 04 16:32:55.498643 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 70/157] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:32:54 2022] DELETE /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e => generated 0 bytes in 664 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 16:32:55.505683 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-673e248b-4042-44c8-9e37-97df797a64c0 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:55.506846 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-673e248b-4042-44c8-9e37-97df797a64c0 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] [instance: 5961044f-b35a-4051-b041-84548b5965d5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:55.519079 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-673e248b-4042-44c8-9e37-97df797a64c0 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:55.519833 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-673e248b-4042-44c8-9e37-97df797a64c0 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:55.521067 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-673e248b-4042-44c8-9e37-97df797a64c0 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:55.522469 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-673e248b-4042-44c8-9e37-97df797a64c0 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:55.862315 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-673e248b-4042-44c8-9e37-97df797a64c0 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9134e4e91c6a4139a4dd8d2865a6cb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce23f198a99464ab95a3e5f98dde567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:55.873019 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-673e248b-4042-44c8-9e37-97df797a64c0 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] 10.222.0.23 "GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5" status: 200 len: 1486 microversion: 2.1 time: 0.372740 Aug 04 16:32:55.874187 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 71/158] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:55 2022] GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5 => generated 1486 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:55.879441 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-619e7cf9-35c7-444d-8b7c-9b9b113d33a6 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:55.880901 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-619e7cf9-35c7-444d-8b7c-9b9b113d33a6 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: dc4b9aed-b141-46b5-a62b-a039640c6310] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:55.888478 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-619e7cf9-35c7-444d-8b7c-9b9b113d33a6 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:55.889313 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-619e7cf9-35c7-444d-8b7c-9b9b113d33a6 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:55.890581 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-619e7cf9-35c7-444d-8b7c-9b9b113d33a6 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:55.891206 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-619e7cf9-35c7-444d-8b7c-9b9b113d33a6 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:55.915343 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2c687c3f-7a34-4bd8-a96d-4ee58f26cd72 tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:55.916256 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2c687c3f-7a34-4bd8-a96d-4ee58f26cd72 tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:55.917409 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2c687c3f-7a34-4bd8-a96d-4ee58f26cd72 tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:55.917889 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2c687c3f-7a34-4bd8-a96d-4ee58f26cd72 tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:56.004793 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2c687c3f-7a34-4bd8-a96d-4ee58f26cd72 tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/da18ed1da01548f89f484fa2528ef3c7" status: 200 len: 328 microversion: 2.1 time: 0.526883 Aug 04 16:32:56.005959 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 88/159] 10.222.0.23 () {60 vars in 1262 bytes} [Thu Aug 4 16:32:55 2022] PUT /compute/v2.1/os-quota-sets/da18ed1da01548f89f484fa2528ef3c7 => generated 328 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:56.022364 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-aa1c165b-bd6c-4d28-a5ba-bb5502b267cb tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:56.023653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-aa1c165b-bd6c-4d28-a5ba-bb5502b267cb tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: e40c21e9-d19a-4e5f-9c7d-c4507025e94e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:56.036429 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aa1c165b-bd6c-4d28-a5ba-bb5502b267cb tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:56.036874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aa1c165b-bd6c-4d28-a5ba-bb5502b267cb tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:56.037844 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aa1c165b-bd6c-4d28-a5ba-bb5502b267cb tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:56.038592 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aa1c165b-bd6c-4d28-a5ba-bb5502b267cb tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:56.262230 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-619e7cf9-35c7-444d-8b7c-9b9b113d33a6 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052613a51b86400c916dbc800563896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0ceaab59d4aeaa8667cef6f62559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:56.276642 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-619e7cf9-35c7-444d-8b7c-9b9b113d33a6 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "GET /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310" status: 200 len: 1318 microversion: 2.1 time: 0.397119 Aug 04 16:32:56.277841 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 72/160] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:55 2022] GET /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310 => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:56.285705 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-50e23266-0dd6-4e34-bf47-be07c121d088 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:56.287532 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-50e23266-0dd6-4e34-bf47-be07c121d088 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] [instance: 5961044f-b35a-4051-b041-84548b5965d5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:56.299430 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-aa1c165b-bd6c-4d28-a5ba-bb5502b267cb tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:56.311084 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-aa1c165b-bd6c-4d28-a5ba-bb5502b267cb tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e" status: 200 len: 1475 microversion: 2.1 time: 0.304039 Aug 04 16:32:56.312149 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 89/161] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:56 2022] GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e => generated 1475 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:56.325046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50e23266-0dd6-4e34-bf47-be07c121d088 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:56.325046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50e23266-0dd6-4e34-bf47-be07c121d088 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:56.325046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50e23266-0dd6-4e34-bf47-be07c121d088 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:56.325046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50e23266-0dd6-4e34-bf47-be07c121d088 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:56.601303 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-50e23266-0dd6-4e34-bf47-be07c121d088 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5" status: 200 len: 1639 microversion: 2.1 time: 0.322145 Aug 04 16:32:56.601900 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 73/162] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:56 2022] GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5 => generated 1639 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:56.609699 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-00dd57b6-afec-4f32-9def-288b3770360a tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:56.610315 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-00dd57b6-afec-4f32-9def-288b3770360a tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: ac53ca0d-94da-45a3-bd53-f013b5b61d51] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:56.617969 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-00dd57b6-afec-4f32-9def-288b3770360a tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:56.618727 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-00dd57b6-afec-4f32-9def-288b3770360a tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:56.619600 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-00dd57b6-afec-4f32-9def-288b3770360a tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:56.620103 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-00dd57b6-afec-4f32-9def-288b3770360a tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:56.633854 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b79526c2-0cfc-4732-97b7-2f19464d876c tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1711970586", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:56.700716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-b79526c2-0cfc-4732-97b7-2f19464d876c tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] validate_networks() for None {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:32:56.882568 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-00dd57b6-afec-4f32-9def-288b3770360a tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a427fb7481d4799a83729910f33b01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd96a8c91974b8ba7919d5349f380ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:56.891162 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-00dd57b6-afec-4f32-9def-288b3770360a tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51" status: 200 len: 1390 microversion: 2.1 time: 0.288214 Aug 04 16:32:56.892009 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 74/163] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:56 2022] GET /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51 => generated 1390 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:56.897873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-92e99a4f-44d5-4e37-bdfd-1791d6024434 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:56.898884 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-92e99a4f-44d5-4e37-bdfd-1791d6024434 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] [instance: 5961044f-b35a-4051-b041-84548b5965d5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:56.912066 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-92e99a4f-44d5-4e37-bdfd-1791d6024434 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:56.912662 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-92e99a4f-44d5-4e37-bdfd-1791d6024434 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:56.920566 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-92e99a4f-44d5-4e37-bdfd-1791d6024434 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:56.921408 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-92e99a4f-44d5-4e37-bdfd-1791d6024434 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:56.956341 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-92e99a4f-44d5-4e37-bdfd-1791d6024434 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] [instance: 5961044f-b35a-4051-b041-84548b5965d5] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:32:56.991645 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-b79526c2-0cfc-4732-97b7-2f19464d876c tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:32:56.992155 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-b79526c2-0cfc-4732-97b7-2f19464d876c tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:32:56.992656 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-b79526c2-0cfc-4732-97b7-2f19464d876c tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:32:56.993075 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-b79526c2-0cfc-4732-97b7-2f19464d876c tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:32:56.993582 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-b79526c2-0cfc-4732-97b7-2f19464d876c tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:32:57.014023 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b79526c2-0cfc-4732-97b7-2f19464d876c tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:57.014527 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b79526c2-0cfc-4732-97b7-2f19464d876c tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:57.015421 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b79526c2-0cfc-4732-97b7-2f19464d876c tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:57.015848 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b79526c2-0cfc-4732-97b7-2f19464d876c tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:57.056610 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-b79526c2-0cfc-4732-97b7-2f19464d876c tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Getting quotas for project da18ed1da01548f89f484fa2528ef3c7. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:32:57.061193 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-b79526c2-0cfc-4732-97b7-2f19464d876c tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Getting quotas for user 53dfb22b7cc9407d9b1214b2b3644d0b and project da18ed1da01548f89f484fa2528ef3c7. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:32:57.073790 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.utils [None req-b79526c2-0cfc-4732-97b7-2f19464d876c tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] cores quota exceeded for da18ed1da01548f89f484fa2528ef3c7, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=126126) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 04 16:32:57.074608 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-b79526c2-0cfc-4732-97b7-2f19464d876c tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 04 16:32:57.078966 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b79526c2-0cfc-4732-97b7-2f19464d876c tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Request method failure captured: Aug 04 16:32:57.078966 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 16:32:57.078966 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:32:57.078966 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:32:57.078966 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:32:57.078966 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 145 Aug 04 16:32:57.078966 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:32:57.078966 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:32:57.078966 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:32:57.078966 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:32:57.078966 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_S1FSTuUH1i4hcSJDD-ku7udyraCuj8WXAqKfUWfoh0OjVte_X0vxJaB1Tlqp7m7iFlwUUKEJoiiuAwl0whMuAA9djH92U2qzgHdaqLFpcSrLV8yoybJtBSuYrZ2O5B8HATjuH-qFoFgAFYhlVPu6ol4k-p_2vYnDWMg04iXeWIzPg Aug 04 16:32:57.078966 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:32:57.078966 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:32:57.078966 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:32:57.078966 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:32:57.078966 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:32:57.078966 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:32:57.078966 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: da18ed1da01548f89f484fa2528ef3c7 Aug 04 16:32:57.078966 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-QuotasAdminNegativeTest-561137333 Aug 04 16:32:57.078966 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:32:57.078966 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:32:57.080328 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da18ed1da01548f89f484fa2528ef3c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_da18ed1da01548f89f484fa2528ef3c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da18ed1da01548f89f484fa2528ef3c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/da18ed1da01548f89f484fa2528ef3c7"}]}] Aug 04 16:32:57.080328 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-QuotasAdminNegativeTest-561137333 Aug 04 16:32:57.080328 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: da18ed1da01548f89f484fa2528ef3c7 Aug 04 16:32:57.080328 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-561137333 Aug 04 16:32:57.080328 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-QuotasAdminNegativeTest-561137333-project Aug 04 16:32:57.080328 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:32:57.080328 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:32:57.080328 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 53dfb22b7cc9407d9b1214b2b3644d0b Aug 04 16:32:57.080328 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-QuotasAdminNegativeTest-561137333-project Aug 04 16:32:57.080328 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 16:32:57.080328 n-d-846466-12 devstack@n-api.service[126126]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1711970586", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452"}} Aug 04 16:32:57.080328 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:32:57.081254 n-d-846466-12 devstack@n-api.service[126126]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 04 16:32:57.081254 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1711970586', 'imageRef': '58d80c01-1581-4a2f-bbb0-c2eaf1affa00', 'flavorRef': '452'}}} Aug 04 16:32:57.081254 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:32:57.081254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:57.081254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 04 16:32:57.081254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 04 16:32:57.081254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:32:57.081254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:32:57.081254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 04 16:32:57.081254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc Aug 04 16:32:57.081254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 04 16:32:57.081254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 04 16:32:57.081254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:32:57.081254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:32:57.081254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 04 16:32:57.081254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 04 16:32:57.081254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 04 16:32:57.081254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 04 16:32:57.082452 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 04 16:32:57.082452 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 04 16:32:57.082452 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 04 16:32:57.082452 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:57.082452 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:32:57.082452 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:57.082452 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:57.082452 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 04 16:32:57.082452 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 04 16:32:57.082452 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 04 16:32:57.082452 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 04 16:32:57.082452 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 04 16:32:57.082452 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 04 16:32:57.082452 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 04 16:32:57.082452 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 04 16:32:57.082452 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 04 16:32:57.082452 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 04 16:32:57.082452 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 04 16:32:57.082452 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:57.082452 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:32:57.082452 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:57.083635 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:57.083635 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:57.083635 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:57.083635 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:32:57.083635 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:32:57.083635 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:32:57.083635 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:32:57.083635 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:32:57.083635 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:32:57.083635 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:32:57.083635 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:32:57.083635 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:32:57.083635 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:32:57.083635 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 16:32:57.083635 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 04 16:32:57.083635 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 04 16:32:57.083635 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 04 16:32:57.083635 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:57.083635 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:32:57.083635 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:57.083635 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:57.084818 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:57.084818 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:57.084818 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:32:57.084818 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:32:57.084818 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 04 16:32:57.084818 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:57.084818 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b79526c2-0cfc-4732-97b7-2f19464d876c tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:32:57.084818 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b79526c2-0cfc-4732-97b7-2f19464d876c tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.753828 Aug 04 16:32:57.086422 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 90/164] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:32:56 2022] POST /compute/v2.1/servers => generated 111 bytes in 759 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:32:57.090653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cb780d8c-0f9c-461f-a58a-bdd8c00b6a77 tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] Action: 'update', calling method: .version_select at 0x7f7e854b45e0>, body: {"quota_set": {"cores": 20}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:57.156745 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-92e99a4f-44d5-4e37-bdfd-1791d6024434 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5" status: 204 len: 0 microversion: 2.1 time: 0.262773 Aug 04 16:32:57.160447 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 75/165] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:32:56 2022] DELETE /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:32:57.173118 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c43e94db-adb4-40ab-956a-50096448b181 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:57.174689 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c43e94db-adb4-40ab-956a-50096448b181 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] [instance: 5961044f-b35a-4051-b041-84548b5965d5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:57.184039 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c43e94db-adb4-40ab-956a-50096448b181 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:57.184720 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c43e94db-adb4-40ab-956a-50096448b181 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:57.186108 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c43e94db-adb4-40ab-956a-50096448b181 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:57.186730 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c43e94db-adb4-40ab-956a-50096448b181 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:57.426700 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cb780d8c-0f9c-461f-a58a-bdd8c00b6a77 tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:57.427111 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cb780d8c-0f9c-461f-a58a-bdd8c00b6a77 tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:57.430204 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cb780d8c-0f9c-461f-a58a-bdd8c00b6a77 tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:57.431955 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cb780d8c-0f9c-461f-a58a-bdd8c00b6a77 tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:57.516553 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c43e94db-adb4-40ab-956a-50096448b181 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9134e4e91c6a4139a4dd8d2865a6cb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce23f198a99464ab95a3e5f98dde567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:57.529576 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c43e94db-adb4-40ab-956a-50096448b181 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] 10.222.0.23 "GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5" status: 200 len: 1492 microversion: 2.1 time: 0.367056 Aug 04 16:32:57.531238 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cb780d8c-0f9c-461f-a58a-bdd8c00b6a77 tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/da18ed1da01548f89f484fa2528ef3c7" status: 200 len: 329 microversion: 2.1 time: 0.443394 Aug 04 16:32:57.540701 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 91/166] 10.222.0.23 () {60 vars in 1262 bytes} [Thu Aug 4 16:32:57 2022] PUT /compute/v2.1/os-quota-sets/da18ed1da01548f89f484fa2528ef3c7 => generated 329 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:57.546563 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 76/167] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:57 2022] GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5 => generated 1492 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:57.551193 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-72a958a9-35f8-4644-ad55-67b05abcbf20 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:57.552199 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-72a958a9-35f8-4644-ad55-67b05abcbf20 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: dc4b9aed-b141-46b5-a62b-a039640c6310] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:57.561256 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-72a958a9-35f8-4644-ad55-67b05abcbf20 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:57.562012 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3452ddde-375e-4133-802f-6f8b09aa8d36 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:57.562176 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-72a958a9-35f8-4644-ad55-67b05abcbf20 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:57.562989 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-72a958a9-35f8-4644-ad55-67b05abcbf20 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:57.563219 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3452ddde-375e-4133-802f-6f8b09aa8d36 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: e40c21e9-d19a-4e5f-9c7d-c4507025e94e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:57.563588 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-72a958a9-35f8-4644-ad55-67b05abcbf20 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:57.570179 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3452ddde-375e-4133-802f-6f8b09aa8d36 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:57.570862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3452ddde-375e-4133-802f-6f8b09aa8d36 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:57.571995 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3452ddde-375e-4133-802f-6f8b09aa8d36 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:57.572959 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3452ddde-375e-4133-802f-6f8b09aa8d36 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:57.855219 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-72a958a9-35f8-4644-ad55-67b05abcbf20 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052613a51b86400c916dbc800563896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0ceaab59d4aeaa8667cef6f62559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:57.870667 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-72a958a9-35f8-4644-ad55-67b05abcbf20 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "GET /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310" status: 200 len: 1318 microversion: 2.1 time: 0.323707 Aug 04 16:32:57.873492 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 92/168] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:57 2022] GET /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310 => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:57.883578 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d5b4b09b-dcbf-4fe1-a189-16cac4a9fe8f tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] Calling method '.version_select at 0x7f7e854b4700>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:57.900662 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3452ddde-375e-4133-802f-6f8b09aa8d36 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:57.915770 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3452ddde-375e-4133-802f-6f8b09aa8d36 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e" status: 200 len: 1475 microversion: 2.1 time: 0.364944 Aug 04 16:32:57.916451 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 77/169] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:57 2022] GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e => generated 1475 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:57.923167 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-d18bd42a-ae7c-40af-b531-1fe2cc38f6b9 req-44c95ebb-ed8d-4652-9112-60277c6231bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc4b9aed-b141-46b5-a62b-a039640c6310", "name": "network-vif-plugged", "status": "completed", "tag": "b36286b7-ac15-434a-b1b1-2550a45b0402"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:57.935433 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-d18bd42a-ae7c-40af-b531-1fe2cc38f6b9 req-44c95ebb-ed8d-4652-9112-60277c6231bf service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:57.936365 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-d18bd42a-ae7c-40af-b531-1fe2cc38f6b9 req-44c95ebb-ed8d-4652-9112-60277c6231bf service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:57.951644 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-d18bd42a-ae7c-40af-b531-1fe2cc38f6b9 req-44c95ebb-ed8d-4652-9112-60277c6231bf service nova] Creating event network-vif-plugged:b36286b7-ac15-434a-b1b1-2550a45b0402 for instance dc4b9aed-b141-46b5-a62b-a039640c6310 on n-h1-846466-12 Aug 04 16:32:57.957898 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-d18bd42a-ae7c-40af-b531-1fe2cc38f6b9 req-44c95ebb-ed8d-4652-9112-60277c6231bf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038334 Aug 04 16:32:57.959792 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 78/170] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:57.967481 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0dbb58de-640e-42f4-948a-7db4bb00766f tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:57.968613 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0dbb58de-640e-42f4-948a-7db4bb00766f tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: ac53ca0d-94da-45a3-bd53-f013b5b61d51] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:57.977947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0dbb58de-640e-42f4-948a-7db4bb00766f tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:57.979541 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0dbb58de-640e-42f4-948a-7db4bb00766f tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:57.981053 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0dbb58de-640e-42f4-948a-7db4bb00766f tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:57.981739 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0dbb58de-640e-42f4-948a-7db4bb00766f tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:58.307161 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0dbb58de-640e-42f4-948a-7db4bb00766f tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a427fb7481d4799a83729910f33b01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd96a8c91974b8ba7919d5349f380ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:58.316862 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0dbb58de-640e-42f4-948a-7db4bb00766f tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51" status: 200 len: 1390 microversion: 2.1 time: 0.355307 Aug 04 16:32:58.320783 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 79/171] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:57 2022] GET /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51 => generated 1390 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:58.359971 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d5b4b09b-dcbf-4fe1-a189-16cac4a9fe8f tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/da18ed1da01548f89f484fa2528ef3c7" status: 200 len: 371 microversion: 2.1 time: 0.484699 Aug 04 16:32:58.362238 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-41a27240-c972-4977-93a2-4762b929b313 req-b1cf2964-9a3e-4b18-b080-ad29906f459e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e40c21e9-d19a-4e5f-9c7d-c4507025e94e", "name": "network-vif-deleted", "tag": "f0ca0e96-7387-46db-9244-1e3b3f97dd7a"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:58.372647 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 93/172] 10.222.0.23 () {58 vars in 1242 bytes} [Thu Aug 4 16:32:57 2022] GET /compute/v2.1/os-quota-sets/da18ed1da01548f89f484fa2528ef3c7 => generated 371 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:58.385357 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-41a27240-c972-4977-93a2-4762b929b313 req-b1cf2964-9a3e-4b18-b080-ad29906f459e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:58.386314 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-41a27240-c972-4977-93a2-4762b929b313 req-b1cf2964-9a3e-4b18-b080-ad29906f459e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:58.401556 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-41a27240-c972-4977-93a2-4762b929b313 req-b1cf2964-9a3e-4b18-b080-ad29906f459e service nova] Creating event network-vif-deleted:f0ca0e96-7387-46db-9244-1e3b3f97dd7a for instance e40c21e9-d19a-4e5f-9c7d-c4507025e94e on n-h1-846466-12 Aug 04 16:32:58.408553 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-41a27240-c972-4977-93a2-4762b929b313 req-b1cf2964-9a3e-4b18-b080-ad29906f459e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064889 Aug 04 16:32:58.409620 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 80/173] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:58.418571 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d523da26-0f47-4ba4-8ff0-67c89d3fadba tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] Action: 'update', calling method: .version_select at 0x7f7e84da5c10>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:58.474867 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-24f28022-edd1-4d51-8778-cb5077fb9bd8 tempest-InstanceUsageAuditLogNegativeTestJSON-1279633435 tempest-InstanceUsageAuditLogNegativeTestJSON-1279633435-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:58.476398 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:58.476398 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:32:58.480123 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-24f28022-edd1-4d51-8778-cb5077fb9bd8 tempest-InstanceUsageAuditLogNegativeTestJSON-1279633435 tempest-InstanceUsageAuditLogNegativeTestJSON-1279633435-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 04 16:32:58.488415 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-24f28022-edd1-4d51-8778-cb5077fb9bd8 tempest-InstanceUsageAuditLogNegativeTestJSON-1279633435 tempest-InstanceUsageAuditLogNegativeTestJSON-1279633435-project-admin] Request method failure captured: Aug 04 16:32:58.488415 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 04 16:32:58.488415 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:32:58.488415 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:32:58.488415 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:32:58.488415 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:32:58.488415 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:32:58.488415 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:32:58.488415 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:32:58.488415 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:32:58.488415 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_S5S74iq-J5lT1YPTCk1-eyJjauFE3SOPM4GD9N_i7Zs70WyDRBilUTAYaE3VZDus-sV9DJyDJeRVFdhGsPclD3TVBYAxavZQ5ybBu9nWhfOrX1uI8anOGkXw9vJ71Fv2Z5NWKGldVZ_5-lpAI_EBRFbDrWxbuvbCc3stSyR-Pu1Sk Aug 04 16:32:58.488415 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:32:58.488415 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:32:58.488415 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:32:58.488415 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:32:58.488415 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:32:58.488415 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:32:58.488415 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: a6eeabfbd50d4c1aa31801ba8553255b Aug 04 16:32:58.488415 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1279633435 Aug 04 16:32:58.488415 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader,admin Aug 04 16:32:58.488415 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader,admin Aug 04 16:32:58.490103 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a6eeabfbd50d4c1aa31801ba8553255b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a6eeabfbd50d4c1aa31801ba8553255b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a6eeabfbd50d4c1aa31801ba8553255b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a6eeabfbd50d4c1aa31801ba8553255b"}]}] Aug 04 16:32:58.490103 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1279633435 Aug 04 16:32:58.490103 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: a6eeabfbd50d4c1aa31801ba8553255b Aug 04 16:32:58.490103 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1279633435 Aug 04 16:32:58.490103 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1279633435-project-admin Aug 04 16:32:58.490103 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:32:58.490103 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:32:58.490103 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 4dceb711cafa412095e5feff9aed35e5 Aug 04 16:32:58.490103 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1279633435-project-admin Aug 04 16:32:58.490103 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:32:58.490103 n-d-846466-12 devstack@n-api.service[126126]: exception: Invalid timestamp for date invalid_time Aug 04 16:32:58.491071 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'invalid_time'} Aug 04 16:32:58.491071 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:32:58.491071 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:58.491071 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 04 16:32:58.491071 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 04 16:32:58.491071 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 04 16:32:58.491071 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 04 16:32:58.491071 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 04 16:32:58.491071 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 04 16:32:58.491071 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 04 16:32:58.491071 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:58.491071 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:32:58.491071 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:58.491071 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:58.491071 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:58.491071 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:58.491071 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:32:58.491071 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:32:58.491071 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:32:58.491071 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:32:58.492394 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 04 16:32:58.492394 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 04 16:32:58.492394 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 04 16:32:58.492394 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:58.492394 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:32:58.492394 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:58.492394 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:58.492394 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:58.492394 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:58.492394 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:32:58.492394 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:32:58.492394 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 04 16:32:58.492394 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:58.503213 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-24f28022-edd1-4d51-8778-cb5077fb9bd8 tempest-InstanceUsageAuditLogNegativeTestJSON-1279633435 tempest-InstanceUsageAuditLogNegativeTestJSON-1279633435-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:32:58.504105 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-24f28022-edd1-4d51-8778-cb5077fb9bd8 tempest-InstanceUsageAuditLogNegativeTestJSON-1279633435 tempest-InstanceUsageAuditLogNegativeTestJSON-1279633435-project-admin] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.130468 Aug 04 16:32:58.509542 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 94/174] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Aug 4 16:32:58 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 16:32:58.529995 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d523da26-0f47-4ba4-8ff0-67c89d3fadba tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:58.530511 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d523da26-0f47-4ba4-8ff0-67c89d3fadba tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:58.531542 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d523da26-0f47-4ba4-8ff0-67c89d3fadba tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:58.532060 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d523da26-0f47-4ba4-8ff0-67c89d3fadba tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:58.608690 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d523da26-0f47-4ba4-8ff0-67c89d3fadba tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/da18ed1da01548f89f484fa2528ef3c7" status: 200 len: 328 microversion: 2.1 time: 0.197306 Aug 04 16:32:58.628128 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 81/175] 10.222.0.23 () {60 vars in 1262 bytes} [Thu Aug 4 16:32:58 2022] PUT /compute/v2.1/os-quota-sets/da18ed1da01548f89f484fa2528ef3c7 => generated 328 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:32:58.654950 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6e886493-b885-4827-bdaf-3d93b3fc5f24 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:58.656619 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6e886493-b885-4827-bdaf-3d93b3fc5f24 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] [instance: 5961044f-b35a-4051-b041-84548b5965d5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:58.673237 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6e886493-b885-4827-bdaf-3d93b3fc5f24 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:58.673800 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6e886493-b885-4827-bdaf-3d93b3fc5f24 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:58.674620 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6e886493-b885-4827-bdaf-3d93b3fc5f24 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:58.675049 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6e886493-b885-4827-bdaf-3d93b3fc5f24 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:58.708378 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4ea5301e-c3d9-4239-a38e-f114e5a17a7b tempest-InstanceUsageAuditLogNegativeTestJSON-1176760207 tempest-InstanceUsageAuditLogNegativeTestJSON-1176760207-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:58.709138 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:32:58.709138 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:32:58.710439 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4ea5301e-c3d9-4239-a38e-f114e5a17a7b tempest-InstanceUsageAuditLogNegativeTestJSON-1176760207 tempest-InstanceUsageAuditLogNegativeTestJSON-1176760207-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '63667d16ba8148d2846043325cc84af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6aeeeb4fc64bd587e343370b1c0ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:58.712814 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4ea5301e-c3d9-4239-a38e-f114e5a17a7b tempest-InstanceUsageAuditLogNegativeTestJSON-1176760207 tempest-InstanceUsageAuditLogNegativeTestJSON-1176760207-project] Request method failure captured: Aug 04 16:32:58.712814 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 04 16:32:58.712814 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:32:58.712814 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:32:58.712814 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:32:58.712814 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:32:58.712814 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:32:58.712814 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:32:58.712814 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:32:58.712814 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:32:58.712814 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_S4w90eV3DHSk4hZu2AABDfj6MbuoKpHYb1cloZAq4FxgCm6nmQUKuSynmyXebduhoGzl8i-3ttRJJGE0geMueMYWgfGo5u9P8X_dOaHram0GGftRA9Q8wkNZt3-aoSqDh3wuN-VPgDhPd4JkldygFyBRpXNkPZUfJ1Hd6bZDregWE Aug 04 16:32:58.712814 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:32:58.712814 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:32:58.712814 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:32:58.712814 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:32:58.712814 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:32:58.712814 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:32:58.712814 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 1f6aeeeb4fc64bd587e343370b1c0ed6 Aug 04 16:32:58.712814 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1176760207 Aug 04 16:32:58.712814 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:32:58.712814 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:32:58.714168 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1f6aeeeb4fc64bd587e343370b1c0ed6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1f6aeeeb4fc64bd587e343370b1c0ed6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1f6aeeeb4fc64bd587e343370b1c0ed6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1f6aeeeb4fc64bd587e343370b1c0ed6"}]}] Aug 04 16:32:58.714168 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1176760207 Aug 04 16:32:58.714168 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 1f6aeeeb4fc64bd587e343370b1c0ed6 Aug 04 16:32:58.714168 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1176760207 Aug 04 16:32:58.714168 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1176760207-project Aug 04 16:32:58.714168 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:32:58.714168 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:32:58.714168 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 63667d16ba8148d2846043325cc84af6 Aug 04 16:32:58.714168 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1176760207-project Aug 04 16:32:58.714168 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:32:58.714852 n-d-846466-12 devstack@n-api.service[126126]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 04 16:32:58.714852 n-d-846466-12 devstack@n-api.service[126126]: action_args: {} Aug 04 16:32:58.714852 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:32:58.714852 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:58.714852 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:58.714852 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:58.714852 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:32:58.714852 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:32:58.714852 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:32:58.714852 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:32:58.714852 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 04 16:32:58.714852 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 04 16:32:58.714852 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:32:58.714852 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:32:58.714852 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:32:58.714852 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:32:58.714852 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:32:58.714852 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:32:58.714852 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:32:58.714852 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:32:58.716057 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:32:58.716057 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:32:58.716057 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:32:58.716057 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:32:58.716057 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:32:58.716057 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:32:58.716057 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 04 16:32:58.716057 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:58.716057 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:32:58.716057 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:58.716057 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:58.716057 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:58.716057 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:58.716057 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:32:58.716057 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:32:58.716057 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 04 16:32:58.716057 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:58.718541 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4ea5301e-c3d9-4239-a38e-f114e5a17a7b tempest-InstanceUsageAuditLogNegativeTestJSON-1176760207 tempest-InstanceUsageAuditLogNegativeTestJSON-1176760207-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:32:58.719514 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4ea5301e-c3d9-4239-a38e-f114e5a17a7b tempest-InstanceUsageAuditLogNegativeTestJSON-1176760207 tempest-InstanceUsageAuditLogNegativeTestJSON-1176760207-project] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.208850 Aug 04 16:32:58.720073 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 95/176] 10.222.0.23 () {58 vars in 1185 bytes} [Thu Aug 4 16:32:58 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 210 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:32:58.728926 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4b331bc9-5101-465c-8c46-fd472e9514fe tempest-InstanceUsageAuditLogNegativeTestJSON-1176760207 tempest-InstanceUsageAuditLogNegativeTestJSON-1176760207-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:58.733234 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4b331bc9-5101-465c-8c46-fd472e9514fe tempest-InstanceUsageAuditLogNegativeTestJSON-1176760207 tempest-InstanceUsageAuditLogNegativeTestJSON-1176760207-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '63667d16ba8148d2846043325cc84af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6aeeeb4fc64bd587e343370b1c0ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:58.735089 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4b331bc9-5101-465c-8c46-fd472e9514fe tempest-InstanceUsageAuditLogNegativeTestJSON-1176760207 tempest-InstanceUsageAuditLogNegativeTestJSON-1176760207-project] Request method failure captured: Aug 04 16:32:58.735089 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-04%2016:32:58 HTTP/1.1 Aug 04 16:32:58.735089 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:32:58.735089 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:32:58.735089 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:32:58.735089 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:32:58.735089 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:32:58.735089 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:32:58.735089 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:32:58.735089 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:32:58.735089 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_S4w90eV3DHSk4hZu2AABDfj6MbuoKpHYb1cloZAq4FxgCm6nmQUKuSynmyXebduhoGzl8i-3ttRJJGE0geMueMYWgfGo5u9P8X_dOaHram0GGftRA9Q8wkNZt3-aoSqDh3wuN-VPgDhPd4JkldygFyBRpXNkPZUfJ1Hd6bZDregWE Aug 04 16:32:58.735089 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:32:58.735089 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:32:58.735089 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:32:58.735089 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:32:58.735089 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:32:58.735089 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:32:58.735089 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 1f6aeeeb4fc64bd587e343370b1c0ed6 Aug 04 16:32:58.735089 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1176760207 Aug 04 16:32:58.735089 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:32:58.735089 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:32:58.736378 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1f6aeeeb4fc64bd587e343370b1c0ed6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1f6aeeeb4fc64bd587e343370b1c0ed6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1f6aeeeb4fc64bd587e343370b1c0ed6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1f6aeeeb4fc64bd587e343370b1c0ed6"}]}] Aug 04 16:32:58.736378 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1176760207 Aug 04 16:32:58.736378 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 1f6aeeeb4fc64bd587e343370b1c0ed6 Aug 04 16:32:58.736378 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1176760207 Aug 04 16:32:58.736378 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1176760207-project Aug 04 16:32:58.736378 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:32:58.736378 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:32:58.736378 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 63667d16ba8148d2846043325cc84af6 Aug 04 16:32:58.736378 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1176760207-project Aug 04 16:32:58.736378 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:32:58.736954 n-d-846466-12 devstack@n-api.service[126126]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 04 16:32:58.736954 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '2022-08-04 16:32:58'} Aug 04 16:32:58.736954 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:32:58.736954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:58.736954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:58.736954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:58.736954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:32:58.736954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:32:58.736954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:32:58.736954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:32:58.736954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 04 16:32:58.736954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 04 16:32:58.736954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:32:58.736954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:32:58.736954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:32:58.736954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:32:58.736954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:32:58.736954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:32:58.736954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:32:58.736954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:32:58.738663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:32:58.738663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:32:58.738663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:32:58.738663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:32:58.738663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:32:58.738663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:32:58.738663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 04 16:32:58.738663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:58.738663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:32:58.738663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:58.738663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:58.738663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:58.738663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:58.738663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:32:58.738663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:32:58.738663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 04 16:32:58.738663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:58.741957 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4b331bc9-5101-465c-8c46-fd472e9514fe tempest-InstanceUsageAuditLogNegativeTestJSON-1176760207 tempest-InstanceUsageAuditLogNegativeTestJSON-1176760207-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:32:58.741957 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4b331bc9-5101-465c-8c46-fd472e9514fe tempest-InstanceUsageAuditLogNegativeTestJSON-1176760207 tempest-InstanceUsageAuditLogNegativeTestJSON-1176760207-project] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-04 16:32:58" status: 403 len: 128 microversion: 2.1 time: 0.011573 Aug 04 16:32:58.741957 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 96/177] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Aug 4 16:32:58 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-04%2016%3A32%3A58 => generated 128 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:32:58.790808 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-682b9f95-076d-4378-866c-2cf838329fe2 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-306152931", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:32:58.905239 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-682b9f95-076d-4378-866c-2cf838329fe2 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] validate_networks() for None {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:32:59.053041 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6e886493-b885-4827-bdaf-3d93b3fc5f24 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9134e4e91c6a4139a4dd8d2865a6cb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce23f198a99464ab95a3e5f98dde567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:59.067223 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6e886493-b885-4827-bdaf-3d93b3fc5f24 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] 10.222.0.23 "GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5" status: 200 len: 1492 microversion: 2.1 time: 0.434231 Aug 04 16:32:59.086252 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 82/178] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:58 2022] GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5 => generated 1492 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:59.091015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-74425328-8dbe-46d5-a837-117a116ef6bf tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:59.091620 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-74425328-8dbe-46d5-a837-117a116ef6bf tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: dc4b9aed-b141-46b5-a62b-a039640c6310] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:59.109017 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-74425328-8dbe-46d5-a837-117a116ef6bf tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:59.109491 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-74425328-8dbe-46d5-a837-117a116ef6bf tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:59.110254 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-74425328-8dbe-46d5-a837-117a116ef6bf tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:59.110678 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-74425328-8dbe-46d5-a837-117a116ef6bf tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:59.136398 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:32:59.642772 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-74425328-8dbe-46d5-a837-117a116ef6bf tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052613a51b86400c916dbc800563896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0ceaab59d4aeaa8667cef6f62559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:32:59.659353 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-74425328-8dbe-46d5-a837-117a116ef6bf tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "GET /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310" status: 200 len: 1318 microversion: 2.1 time: 0.572037 Aug 04 16:32:59.659948 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 83/179] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:59 2022] GET /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310 => generated 1318 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:32:59.668987 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-42ee17c2-9a1a-419d-b6dc-f080731ae968 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:59.669619 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-42ee17c2-9a1a-419d-b6dc-f080731ae968 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: e40c21e9-d19a-4e5f-9c7d-c4507025e94e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:59.685341 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-42ee17c2-9a1a-419d-b6dc-f080731ae968 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:59.686022 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-42ee17c2-9a1a-419d-b6dc-f080731ae968 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:59.686953 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-42ee17c2-9a1a-419d-b6dc-f080731ae968 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:59.687633 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-42ee17c2-9a1a-419d-b6dc-f080731ae968 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:59.706007 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-42ee17c2-9a1a-419d-b6dc-f080731ae968 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] HTTP exception thrown: Instance e40c21e9-d19a-4e5f-9c7d-c4507025e94e could not be found. Aug 04 16:32:59.715832 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-42ee17c2-9a1a-419d-b6dc-f080731ae968 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Request method failure captured: Aug 04 16:32:59.715832 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e HTTP/1.1 Aug 04 16:32:59.715832 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:32:59.715832 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:32:59.715832 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:32:59.715832 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:32:59.715832 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:32:59.715832 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:32:59.715832 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:32:59.715832 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:32:59.715832 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_SQWRtweLL8S9FjSUzm2SHuxcy69sC0P2uSa0cAMC_DSXd55JKKy9O0dh7gYHIEN2QmdOgsstNJhd59hz6UKJUYTZOugtHzLy20RO8LIhlz0LqchYQHFvdJ594sBdwr5SQDY386_-as12hJUY4QrUkh3neIrBSLD0tqe2NPGnA6xKg Aug 04 16:32:59.715832 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:32:59.715832 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:32:59.715832 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:32:59.715832 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:32:59.715832 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:32:59.715832 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:32:59.715832 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: f665aa7b40ce4198a7958d9c382058f3 Aug 04 16:32:59.715832 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1073884544 Aug 04 16:32:59.715832 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:32:59.715832 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:32:59.717056 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f665aa7b40ce4198a7958d9c382058f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f665aa7b40ce4198a7958d9c382058f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f665aa7b40ce4198a7958d9c382058f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f665aa7b40ce4198a7958d9c382058f3"}]}] Aug 04 16:32:59.717056 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-DeleteServersAdminTestJSON-1073884544 Aug 04 16:32:59.717056 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: f665aa7b40ce4198a7958d9c382058f3 Aug 04 16:32:59.717056 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1073884544 Aug 04 16:32:59.717056 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-DeleteServersAdminTestJSON-1073884544-project Aug 04 16:32:59.717056 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:32:59.717056 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:32:59.717056 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 9dc6220916eb443387bbf353c267342c Aug 04 16:32:59.717056 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-DeleteServersAdminTestJSON-1073884544-project Aug 04 16:32:59.717056 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:32:59.717056 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance e40c21e9-d19a-4e5f-9c7d-c4507025e94e could not be found. Aug 04 16:32:59.717056 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'e40c21e9-d19a-4e5f-9c7d-c4507025e94e'} Aug 04 16:32:59.717968 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:32:59.717968 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:59.717968 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:32:59.717968 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:32:59.717968 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:32:59.717968 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:32:59.717968 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:32:59.717968 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:32:59.717968 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:32:59.717968 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:32:59.717968 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e40c21e9-d19a-4e5f-9c7d-c4507025e94e could not be found. Aug 04 16:32:59.717968 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:32:59.717968 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:32:59.717968 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:32:59.717968 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:59.717968 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:59.717968 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:59.717968 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:32:59.717968 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:32:59.717968 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:32:59.719200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:32:59.719200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:32:59.719200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:32:59.719200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:32:59.719200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:32:59.719200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:32:59.719200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:32:59.719200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e40c21e9-d19a-4e5f-9c7d-c4507025e94e could not be found. Aug 04 16:32:59.719200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:32:59.719200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:32:59.719200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:32:59.719200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:59.719200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:59.719200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:59.719200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:32:59.719200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:32:59.719200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e40c21e9-d19a-4e5f-9c7d-c4507025e94e could not be found. Aug 04 16:32:59.719200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:32:59.721326 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-42ee17c2-9a1a-419d-b6dc-f080731ae968 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Returning 404 to user: Instance e40c21e9-d19a-4e5f-9c7d-c4507025e94e could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:32:59.722702 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-42ee17c2-9a1a-419d-b6dc-f080731ae968 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e" status: 404 len: 111 microversion: 2.1 time: 0.061456 Aug 04 16:32:59.746596 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 84/180] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:59 2022] GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:32:59.778215 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f6db50ae-a7b0-4ce8-ba24-c84e90c4c20c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:32:59.778848 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f6db50ae-a7b0-4ce8-ba24-c84e90c4c20c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: ac53ca0d-94da-45a3-bd53-f013b5b61d51] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:32:59.796022 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f6db50ae-a7b0-4ce8-ba24-c84e90c4c20c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:59.796486 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f6db50ae-a7b0-4ce8-ba24-c84e90c4c20c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:59.798145 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f6db50ae-a7b0-4ce8-ba24-c84e90c4c20c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:59.798582 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f6db50ae-a7b0-4ce8-ba24-c84e90c4c20c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:59.869480 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-682b9f95-076d-4378-866c-2cf838329fe2 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:32:59.871179 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-682b9f95-076d-4378-866c-2cf838329fe2 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:32:59.871880 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-682b9f95-076d-4378-866c-2cf838329fe2 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:32:59.872513 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-682b9f95-076d-4378-866c-2cf838329fe2 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:32:59.873121 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-682b9f95-076d-4378-866c-2cf838329fe2 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:32:59.887281 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-682b9f95-076d-4378-866c-2cf838329fe2 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:59.887997 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-682b9f95-076d-4378-866c-2cf838329fe2 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:59.889074 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-682b9f95-076d-4378-866c-2cf838329fe2 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:32:59.891012 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-682b9f95-076d-4378-866c-2cf838329fe2 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:32:59.937480 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-682b9f95-076d-4378-866c-2cf838329fe2 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Getting quotas for project da18ed1da01548f89f484fa2528ef3c7. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:32:59.948503 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-682b9f95-076d-4378-866c-2cf838329fe2 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Getting quotas for user 53dfb22b7cc9407d9b1214b2b3644d0b and project da18ed1da01548f89f484fa2528ef3c7. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:32:59.951894 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:32:59.972904 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.utils [None req-682b9f95-076d-4378-866c-2cf838329fe2 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] instances quota exceeded for da18ed1da01548f89f484fa2528ef3c7, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=126126) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 04 16:32:59.973784 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-682b9f95-076d-4378-866c-2cf838329fe2 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 04 16:32:59.977499 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-682b9f95-076d-4378-866c-2cf838329fe2 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Request method failure captured: Aug 04 16:32:59.977499 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 16:32:59.977499 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:32:59.977499 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:32:59.977499 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:32:59.977499 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 144 Aug 04 16:32:59.977499 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:32:59.977499 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:32:59.977499 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:32:59.977499 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:32:59.977499 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_S1FSTuUH1i4hcSJDD-ku7udyraCuj8WXAqKfUWfoh0OjVte_X0vxJaB1Tlqp7m7iFlwUUKEJoiiuAwl0whMuAA9djH92U2qzgHdaqLFpcSrLV8yoybJtBSuYrZ2O5B8HATjuH-qFoFgAFYhlVPu6ol4k-p_2vYnDWMg04iXeWIzPg Aug 04 16:32:59.977499 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:32:59.977499 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:32:59.977499 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:32:59.977499 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:32:59.977499 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:32:59.977499 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:32:59.977499 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: da18ed1da01548f89f484fa2528ef3c7 Aug 04 16:32:59.977499 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-QuotasAdminNegativeTest-561137333 Aug 04 16:32:59.977499 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:32:59.977499 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:32:59.978687 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da18ed1da01548f89f484fa2528ef3c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_da18ed1da01548f89f484fa2528ef3c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da18ed1da01548f89f484fa2528ef3c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/da18ed1da01548f89f484fa2528ef3c7"}]}] Aug 04 16:32:59.978687 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-QuotasAdminNegativeTest-561137333 Aug 04 16:32:59.978687 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: da18ed1da01548f89f484fa2528ef3c7 Aug 04 16:32:59.978687 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-561137333 Aug 04 16:32:59.978687 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-QuotasAdminNegativeTest-561137333-project Aug 04 16:32:59.978687 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:32:59.978687 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:32:59.978687 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 53dfb22b7cc9407d9b1214b2b3644d0b Aug 04 16:32:59.978687 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-QuotasAdminNegativeTest-561137333-project Aug 04 16:32:59.978687 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 16:32:59.978687 n-d-846466-12 devstack@n-api.service[126126]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-306152931", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452"}} Aug 04 16:32:59.978687 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:32:59.979439 n-d-846466-12 devstack@n-api.service[126126]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 04 16:32:59.979439 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-306152931', 'imageRef': '58d80c01-1581-4a2f-bbb0-c2eaf1affa00', 'flavorRef': '452'}}} Aug 04 16:32:59.979439 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:32:59.979439 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:59.979439 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 04 16:32:59.979439 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 04 16:32:59.979439 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:32:59.979439 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:32:59.979439 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 04 16:32:59.979439 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc Aug 04 16:32:59.979439 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 04 16:32:59.979439 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 04 16:32:59.979439 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:32:59.979439 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:32:59.979439 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 04 16:32:59.979439 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 04 16:32:59.979439 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 04 16:32:59.979439 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 04 16:32:59.980509 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 04 16:32:59.980509 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 04 16:32:59.980509 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 04 16:32:59.980509 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:59.980509 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:32:59.980509 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:59.980509 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:59.980509 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 04 16:32:59.980509 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 04 16:32:59.980509 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 04 16:32:59.980509 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 04 16:32:59.980509 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 04 16:32:59.980509 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 04 16:32:59.980509 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 04 16:32:59.980509 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 04 16:32:59.980509 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 04 16:32:59.980509 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 04 16:32:59.980509 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 04 16:32:59.980509 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:59.980509 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:32:59.980509 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:59.982942 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:59.982942 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:59.982942 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:59.982942 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:32:59.982942 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:32:59.982942 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:32:59.982942 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:32:59.982942 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:32:59.982942 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:32:59.982942 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:32:59.982942 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:32:59.982942 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:32:59.982942 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:32:59.982942 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 16:32:59.982942 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 04 16:32:59.982942 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 04 16:32:59.982942 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 04 16:32:59.982942 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:59.982942 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:32:59.982942 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:59.982942 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:32:59.985637 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:32:59.985637 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:32:59.985637 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:32:59.985637 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:32:59.985637 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 04 16:32:59.985637 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:32:59.985637 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-682b9f95-076d-4378-866c-2cf838329fe2 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:32:59.985637 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-682b9f95-076d-4378-866c-2cf838329fe2 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.197854 Aug 04 16:32:59.989388 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 97/181] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:32:58 2022] POST /compute/v2.1/servers => generated 119 bytes in 1202 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:33:00.004556 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-523e58be-e2a7-47bf-990d-6bc02fab4f0a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-2036133544", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:00.132443 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-523e58be-e2a7-47bf-990d-6bc02fab4f0a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] validate_networks() for None {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:33:00.229834 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f6db50ae-a7b0-4ce8-ba24-c84e90c4c20c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a427fb7481d4799a83729910f33b01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd96a8c91974b8ba7919d5349f380ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:00.245376 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f6db50ae-a7b0-4ce8-ba24-c84e90c4c20c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51" status: 200 len: 1390 microversion: 2.1 time: 0.497271 Aug 04 16:33:00.264544 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 85/182] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:32:59 2022] GET /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51 => generated 1390 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:00.274585 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-630c44f7-41c3-4bfa-ad89-be9d480017a1 req-8e60fe5d-d656-4a8b-b1e0-01af0e11b7b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac53ca0d-94da-45a3-bd53-f013b5b61d51", "name": "network-vif-plugged", "status": "completed", "tag": "4c2eed2c-2a7c-44ed-915e-f94311a74757"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:00.294915 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-630c44f7-41c3-4bfa-ad89-be9d480017a1 req-8e60fe5d-d656-4a8b-b1e0-01af0e11b7b3 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:00.297354 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-630c44f7-41c3-4bfa-ad89-be9d480017a1 req-8e60fe5d-d656-4a8b-b1e0-01af0e11b7b3 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:00.312461 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-630c44f7-41c3-4bfa-ad89-be9d480017a1 req-8e60fe5d-d656-4a8b-b1e0-01af0e11b7b3 service nova] Creating event network-vif-plugged:4c2eed2c-2a7c-44ed-915e-f94311a74757 for instance ac53ca0d-94da-45a3-bd53-f013b5b61d51 on n-h1-846466-12 Aug 04 16:33:00.330593 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-630c44f7-41c3-4bfa-ad89-be9d480017a1 req-8e60fe5d-d656-4a8b-b1e0-01af0e11b7b3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064301 Aug 04 16:33:00.332224 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 86/183] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:00.340246 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-42f30be1-8fc4-46c0-a0be-f445654be6b5 tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] Action: 'update', calling method: .version_select at 0x7f7e84ecaa60>, body: {"quota_set": {"instances": 10}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:00.638543 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-523e58be-e2a7-47bf-990d-6bc02fab4f0a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:33:00.639143 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-523e58be-e2a7-47bf-990d-6bc02fab4f0a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:33:00.639627 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-523e58be-e2a7-47bf-990d-6bc02fab4f0a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:33:00.640043 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-523e58be-e2a7-47bf-990d-6bc02fab4f0a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:33:00.640521 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-523e58be-e2a7-47bf-990d-6bc02fab4f0a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:33:00.659677 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-523e58be-e2a7-47bf-990d-6bc02fab4f0a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:00.660131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-523e58be-e2a7-47bf-990d-6bc02fab4f0a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:00.660951 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-523e58be-e2a7-47bf-990d-6bc02fab4f0a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:00.661556 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-523e58be-e2a7-47bf-990d-6bc02fab4f0a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:00.716850 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-523e58be-e2a7-47bf-990d-6bc02fab4f0a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Getting quotas for project f665aa7b40ce4198a7958d9c382058f3. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:33:00.725913 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-523e58be-e2a7-47bf-990d-6bc02fab4f0a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Getting quotas for user 9dc6220916eb443387bbf353c267342c and project f665aa7b40ce4198a7958d9c382058f3. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:33:00.745641 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-523e58be-e2a7-47bf-990d-6bc02fab4f0a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:33:00.748460 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-523e58be-e2a7-47bf-990d-6bc02fab4f0a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: f5548cac-028e-4bca-b862-d471688b9c50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:33:00.820801 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-523e58be-e2a7-47bf-990d-6bc02fab4f0a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.828986 Aug 04 16:33:00.821497 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 98/184] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:32:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:33:00.826622 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8cdff638-dabc-4dc4-b778-395cc91c7cbc tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:00.827742 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8cdff638-dabc-4dc4-b778-395cc91c7cbc tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] [instance: 5961044f-b35a-4051-b041-84548b5965d5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:00.841061 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8cdff638-dabc-4dc4-b778-395cc91c7cbc tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:00.841539 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8cdff638-dabc-4dc4-b778-395cc91c7cbc tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:00.842305 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8cdff638-dabc-4dc4-b778-395cc91c7cbc tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:00.842762 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8cdff638-dabc-4dc4-b778-395cc91c7cbc tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:00.899763 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8cdff638-dabc-4dc4-b778-395cc91c7cbc tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:00.901626 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8cdff638-dabc-4dc4-b778-395cc91c7cbc tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:00.902119 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-8cdff638-dabc-4dc4-b778-395cc91c7cbc tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lazy-loading 'fault' on Instance uuid 5961044f-b35a-4051-b041-84548b5965d5 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:33:00.935075 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-42f30be1-8fc4-46c0-a0be-f445654be6b5 tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:00.939274 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-42f30be1-8fc4-46c0-a0be-f445654be6b5 tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:00.941894 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-42f30be1-8fc4-46c0-a0be-f445654be6b5 tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:00.945315 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-42f30be1-8fc4-46c0-a0be-f445654be6b5 tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:01.091856 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8cdff638-dabc-4dc4-b778-395cc91c7cbc tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9134e4e91c6a4139a4dd8d2865a6cb51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce23f198a99464ab95a3e5f98dde567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:01.110139 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8cdff638-dabc-4dc4-b778-395cc91c7cbc tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] 10.222.0.23 "GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5" status: 200 len: 1327 microversion: 2.1 time: 0.287381 Aug 04 16:33:01.118703 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 99/185] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:00 2022] GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5 => generated 1327 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:01.149958 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-732a1bf8-e347-41d6-9dec-c6a707fa3a9d req-27a93fff-77ab-4617-95a2-f7ecb415c644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5961044f-b35a-4051-b041-84548b5965d5", "name": "network-vif-deleted", "tag": "d461805a-8b8b-408f-9fa3-99e31d86b832"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:01.165703 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-42f30be1-8fc4-46c0-a0be-f445654be6b5 tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/da18ed1da01548f89f484fa2528ef3c7" status: 200 len: 329 microversion: 2.1 time: 0.831306 Aug 04 16:33:01.166528 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 87/186] 10.222.0.23 () {60 vars in 1262 bytes} [Thu Aug 4 16:33:00 2022] PUT /compute/v2.1/os-quota-sets/da18ed1da01548f89f484fa2528ef3c7 => generated 329 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:01.180266 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-732a1bf8-e347-41d6-9dec-c6a707fa3a9d req-27a93fff-77ab-4617-95a2-f7ecb415c644 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:01.182083 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3bba79e0-616b-4188-9a7b-71344e962d72 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:01.184020 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-732a1bf8-e347-41d6-9dec-c6a707fa3a9d req-27a93fff-77ab-4617-95a2-f7ecb415c644 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:01.185616 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3bba79e0-616b-4188-9a7b-71344e962d72 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: dc4b9aed-b141-46b5-a62b-a039640c6310] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:01.206704 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3bba79e0-616b-4188-9a7b-71344e962d72 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:01.207350 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3bba79e0-616b-4188-9a7b-71344e962d72 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:01.208337 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3bba79e0-616b-4188-9a7b-71344e962d72 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:01.209842 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3bba79e0-616b-4188-9a7b-71344e962d72 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:01.214965 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-732a1bf8-e347-41d6-9dec-c6a707fa3a9d req-27a93fff-77ab-4617-95a2-f7ecb415c644 service nova] Creating event network-vif-deleted:d461805a-8b8b-408f-9fa3-99e31d86b832 for instance 5961044f-b35a-4051-b041-84548b5965d5 on n-h2-846466-12 Aug 04 16:33:01.228837 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-732a1bf8-e347-41d6-9dec-c6a707fa3a9d req-27a93fff-77ab-4617-95a2-f7ecb415c644 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107613 Aug 04 16:33:01.231045 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 100/187] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:01.243262 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-71c3af9c-8170-4b22-afd5-4bfba8ad81f9 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:01.245476 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-71c3af9c-8170-4b22-afd5-4bfba8ad81f9 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: f5548cac-028e-4bca-b862-d471688b9c50] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:01.584825 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-71c3af9c-8170-4b22-afd5-4bfba8ad81f9 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:01.591553 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=100 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:33:01.598500 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-71c3af9c-8170-4b22-afd5-4bfba8ad81f9 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50" status: 200 len: 1220 microversion: 2.1 time: 0.365799 Aug 04 16:33:01.602312 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 101/188] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:01 2022] GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50 => generated 1220 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:01.611904 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c5cef909-28f1-4237-b2c1-e72fda79bd91 tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] Calling method '.version_select at 0x7f7e8565be50>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:02.136695 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c5cef909-28f1-4237-b2c1-e72fda79bd91 tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/da18ed1da01548f89f484fa2528ef3c7" status: 200 len: 371 microversion: 2.1 time: 0.532131 Aug 04 16:33:02.141330 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 102/189] 10.222.0.23 () {58 vars in 1242 bytes} [Thu Aug 4 16:33:01 2022] GET /compute/v2.1/os-quota-sets/da18ed1da01548f89f484fa2528ef3c7 => generated 371 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:02.151740 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f4aed285-87a1-4da8-851b-f56fd7353c00 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:02.160934 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f4aed285-87a1-4da8-851b-f56fd7353c00 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: ac53ca0d-94da-45a3-bd53-f013b5b61d51] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:02.200822 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f4aed285-87a1-4da8-851b-f56fd7353c00 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:02.201275 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f4aed285-87a1-4da8-851b-f56fd7353c00 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:02.202162 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f4aed285-87a1-4da8-851b-f56fd7353c00 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:02.202546 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f4aed285-87a1-4da8-851b-f56fd7353c00 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:02.341708 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3bba79e0-616b-4188-9a7b-71344e962d72 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052613a51b86400c916dbc800563896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0ceaab59d4aeaa8667cef6f62559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:02.352938 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3bba79e0-616b-4188-9a7b-71344e962d72 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "GET /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310" status: 200 len: 1468 microversion: 2.1 time: 1.185151 Aug 04 16:33:02.357347 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 88/190] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:01 2022] GET /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310 => generated 1468 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:02.371857 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-accd193a-01e8-415a-bede-c2962e605c7a tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:02.373492 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-accd193a-01e8-415a-bede-c2962e605c7a tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] [instance: 5961044f-b35a-4051-b041-84548b5965d5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:02.388546 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-accd193a-01e8-415a-bede-c2962e605c7a tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:02.390967 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-accd193a-01e8-415a-bede-c2962e605c7a tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:02.391955 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-accd193a-01e8-415a-bede-c2962e605c7a tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:02.394532 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-accd193a-01e8-415a-bede-c2962e605c7a tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:02.427984 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-accd193a-01e8-415a-bede-c2962e605c7a tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] HTTP exception thrown: Instance 5961044f-b35a-4051-b041-84548b5965d5 could not be found. Aug 04 16:33:02.435218 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-accd193a-01e8-415a-bede-c2962e605c7a tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Request method failure captured: Aug 04 16:33:02.435218 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5 HTTP/1.1 Aug 04 16:33:02.435218 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:33:02.435218 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:33:02.435218 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:33:02.435218 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:33:02.435218 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:33:02.435218 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:33:02.435218 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:33:02.435218 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:02.435218 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_SK2EqOJBZ69IN6Fx6p539COPvucPbDUlR5kqCaH_Hgu3xY0djlYdCtxIYEq_f-tvO9GbHmEHLZHobrWmJ3A8XkbXUgiRA8Qm5myhb7Vhwrj3cq_YqqyjnVXNimgSzTAMb0bGEDj1tJZHEib4aWn8K4LnEFKVgolQqt3Mz4tOSXnQI Aug 04 16:33:02.435218 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:33:02.435218 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:33:02.435218 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:33:02.435218 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:33:02.435218 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:33:02.435218 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:33:02.435218 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 0ce23f198a99464ab95a3e5f98dde567 Aug 04 16:33:02.435218 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-AggregatesAdminTestJSON-687745325 Aug 04 16:33:02.435218 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:33:02.435218 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:33:02.436439 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ce23f198a99464ab95a3e5f98dde567"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0ce23f198a99464ab95a3e5f98dde567"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ce23f198a99464ab95a3e5f98dde567"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0ce23f198a99464ab95a3e5f98dde567"}]}] Aug 04 16:33:02.436439 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-AggregatesAdminTestJSON-687745325 Aug 04 16:33:02.436439 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 0ce23f198a99464ab95a3e5f98dde567 Aug 04 16:33:02.436439 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-687745325 Aug 04 16:33:02.436439 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-AggregatesAdminTestJSON-687745325-project Aug 04 16:33:02.436439 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:33:02.436439 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:33:02.436439 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 9134e4e91c6a4139a4dd8d2865a6cb51 Aug 04 16:33:02.436439 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-AggregatesAdminTestJSON-687745325-project Aug 04 16:33:02.436439 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:33:02.436439 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 5961044f-b35a-4051-b041-84548b5965d5 could not be found. Aug 04 16:33:02.436439 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '5961044f-b35a-4051-b041-84548b5965d5'} Aug 04 16:33:02.437151 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:02.437151 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:02.437151 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:33:02.437151 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:33:02.437151 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:33:02.437151 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:33:02.437151 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:33:02.437151 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:33:02.437151 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:33:02.437151 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:33:02.437151 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5961044f-b35a-4051-b041-84548b5965d5 could not be found. Aug 04 16:33:02.437151 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:02.437151 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:02.437151 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:02.437151 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:02.437151 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:02.437151 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:02.437151 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:02.437151 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:02.437151 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:02.442457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:02.442457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:33:02.442457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:33:02.442457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:33:02.442457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:33:02.442457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:33:02.442457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:33:02.442457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5961044f-b35a-4051-b041-84548b5965d5 could not be found. Aug 04 16:33:02.442457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:02.442457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:02.442457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:02.442457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:02.442457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:02.442457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:02.442457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:33:02.442457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:33:02.442457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5961044f-b35a-4051-b041-84548b5965d5 could not be found. Aug 04 16:33:02.442457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:02.443446 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-accd193a-01e8-415a-bede-c2962e605c7a tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Returning 404 to user: Instance 5961044f-b35a-4051-b041-84548b5965d5 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:02.443446 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-accd193a-01e8-415a-bede-c2962e605c7a tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] 10.222.0.23 "GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5" status: 404 len: 111 microversion: 2.1 time: 0.078261 Aug 04 16:33:02.443446 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 89/191] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:02 2022] GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:33:02.449168 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5119f2a0-998f-45b4-af37-b8e8c461d1eb tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] Action: 'update', calling method: .version_select at 0x7f7e850d7af0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:02.658982 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f4aed285-87a1-4da8-851b-f56fd7353c00 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a427fb7481d4799a83729910f33b01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd96a8c91974b8ba7919d5349f380ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:02.683879 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f4aed285-87a1-4da8-851b-f56fd7353c00 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51" status: 200 len: 1588 microversion: 2.1 time: 0.537697 Aug 04 16:33:02.685597 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 103/192] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:02 2022] GET /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51 => generated 1588 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:02.976662 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5119f2a0-998f-45b4-af37-b8e8c461d1eb tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:02.977120 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5119f2a0-998f-45b4-af37-b8e8c461d1eb tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:02.978027 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5119f2a0-998f-45b4-af37-b8e8c461d1eb tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:02.984748 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5119f2a0-998f-45b4-af37-b8e8c461d1eb tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:03.045653 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:33:03.123548 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5119f2a0-998f-45b4-af37-b8e8c461d1eb tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/da18ed1da01548f89f484fa2528ef3c7" status: 200 len: 325 microversion: 2.1 time: 0.681609 Aug 04 16:33:03.126653 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 90/193] 10.222.0.23 () {60 vars in 1262 bytes} [Thu Aug 4 16:33:02 2022] PUT /compute/v2.1/os-quota-sets/da18ed1da01548f89f484fa2528ef3c7 => generated 325 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:03.149324 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-584af178-d6eb-4835-a536-21901e9334c0 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846466-12"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:03.153401 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:03.153401 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:03.172072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-584af178-d6eb-4835-a536-21901e9334c0 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:03.194413 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-584af178-d6eb-4835-a536-21901e9334c0 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:03.440128 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f16d8ca5-75b4-4cbd-8b35-f2f95a98dadf tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1356220275", "block_migration": true, "disk_over_commit": false}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:03.442717 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f16d8ca5-75b4-4cbd-8b35-f2f95a98dadf tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] [instance: dc4b9aed-b141-46b5-a62b-a039640c6310] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:03.460505 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f16d8ca5-75b4-4cbd-8b35-f2f95a98dadf tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:03.462143 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f16d8ca5-75b4-4cbd-8b35-f2f95a98dadf tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:03.464455 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f16d8ca5-75b4-4cbd-8b35-f2f95a98dadf tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:03.467856 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f16d8ca5-75b4-4cbd-8b35-f2f95a98dadf tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:03.520830 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-584af178-d6eb-4835-a536-21901e9334c0 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 298 microversion: 2.1 time: 0.392830 Aug 04 16:33:03.521471 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 91/194] 10.222.0.23 () {60 vars in 1191 bytes} [Thu Aug 4 16:33:03 2022] POST /compute/v2.1/os-aggregates/2/action => generated 298 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:03.532723 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-df5ca6fc-8bf1-4bd2-a2cb-cac85ab41849 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:03.533362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-df5ca6fc-8bf1-4bd2-a2cb-cac85ab41849 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: f5548cac-028e-4bca-b862-d471688b9c50] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:03.552025 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df5ca6fc-8bf1-4bd2-a2cb-cac85ab41849 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:03.552470 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df5ca6fc-8bf1-4bd2-a2cb-cac85ab41849 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:03.553337 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df5ca6fc-8bf1-4bd2-a2cb-cac85ab41849 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:03.553771 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df5ca6fc-8bf1-4bd2-a2cb-cac85ab41849 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:03.694429 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-f16d8ca5-75b4-4cbd-8b35-f2f95a98dadf tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] Lazy-loading 'flavor' on Instance uuid dc4b9aed-b141-46b5-a62b-a039640c6310 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:33:03.757329 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-df5ca6fc-8bf1-4bd2-a2cb-cac85ab41849 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:03.773539 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-df5ca6fc-8bf1-4bd2-a2cb-cac85ab41849 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50" status: 200 len: 1278 microversion: 2.1 time: 0.248792 Aug 04 16:33:03.774167 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 92/195] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:03 2022] GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50 => generated 1278 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:03.788063 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a82c157d-0896-4bb9-ac43-f3a3eee0562f tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:03.788888 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a82c157d-0896-4bb9-ac43-f3a3eee0562f tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: ac53ca0d-94da-45a3-bd53-f013b5b61d51] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:03.819668 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a82c157d-0896-4bb9-ac43-f3a3eee0562f tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:03.828766 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a82c157d-0896-4bb9-ac43-f3a3eee0562f tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:03.829969 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a82c157d-0896-4bb9-ac43-f3a3eee0562f tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:03.832066 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a82c157d-0896-4bb9-ac43-f3a3eee0562f tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:04.090424 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a82c157d-0896-4bb9-ac43-f3a3eee0562f tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.315110 Aug 04 16:33:04.091028 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 93/196] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Aug 4 16:33:03 2022] GET /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51/os-interface => generated 285 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:04.092181 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f16d8ca5-75b4-4cbd-8b35-f2f95a98dadf tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] [instance: dc4b9aed-b141-46b5-a62b-a039640c6310] Going to try to live migrate instance to tempest-host-1356220275 {{(pid=126126) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 16:33:04.100471 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-f16d8ca5-75b4-4cbd-8b35-f2f95a98dadf tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] HTTP exception thrown: Compute host tempest-host-1356220275 could not be found. Aug 04 16:33:04.105003 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f16d8ca5-75b4-4cbd-8b35-f2f95a98dadf tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] Request method failure captured: Aug 04 16:33:04.105003 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310/action HTTP/1.1 Aug 04 16:33:04.105003 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:33:04.105003 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:33:04.105003 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:33:04.105003 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 107 Aug 04 16:33:04.105003 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:33:04.105003 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:33:04.105003 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:33:04.105003 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:04.105003 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_SciJ2Xm5QZWtK-zOVftY2swQNK19Rw0MRNnSEThmobyNwyKoiOCIzRCxACbuDbmoaFo8fqRcFP8CDKIvr4Mao24NLUb-KlCooK1e8RAB6PXdY1IYSMBrGRDnNKNfEygP52T1fUQIzTJ3LPv1zLuvpDTHaGzv_MyR0aXvqE5mhv4yM Aug 04 16:33:04.105003 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:33:04.105003 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:33:04.105003 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:33:04.105003 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:33:04.105003 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:33:04.105003 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:33:04.105003 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 7cc5a5606209492691c8408539c3b395 Aug 04 16:33:04.105003 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-LiveMigrationNegativeTest-219743403 Aug 04 16:33:04.105003 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader,admin Aug 04 16:33:04.105003 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader,admin Aug 04 16:33:04.106590 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7cc5a5606209492691c8408539c3b395"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7cc5a5606209492691c8408539c3b395"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7cc5a5606209492691c8408539c3b395"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7cc5a5606209492691c8408539c3b395"}]}] Aug 04 16:33:04.106590 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-LiveMigrationNegativeTest-219743403 Aug 04 16:33:04.106590 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 7cc5a5606209492691c8408539c3b395 Aug 04 16:33:04.106590 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-219743403 Aug 04 16:33:04.106590 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-LiveMigrationNegativeTest-219743403-project-admin Aug 04 16:33:04.106590 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:33:04.106590 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:33:04.106590 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: bed18f1355f74759849faf9901e22303 Aug 04 16:33:04.106590 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-LiveMigrationNegativeTest-219743403-project-admin Aug 04 16:33:04.106590 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 16:33:04.106590 n-d-846466-12 devstack@n-api.service[126126]: {"os-migrateLive": {"host": "tempest-host-1356220275", "block_migration": true, "disk_over_commit": false}} Aug 04 16:33:04.106590 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:33:04.107436 n-d-846466-12 devstack@n-api.service[126126]: exception: Compute host tempest-host-1356220275 could not be found. Aug 04 16:33:04.107436 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'dc4b9aed-b141-46b5-a62b-a039640c6310', 'body': {'os-migrateLive': {'host': 'tempest-host-1356220275', 'block_migration': True, 'disk_over_commit': False}}} Aug 04 16:33:04.107436 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:04.107436 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:04.107436 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 04 16:33:04.107436 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 04 16:33:04.107436 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 04 16:33:04.107436 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 16:33:04.107436 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 04 16:33:04.107436 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 16:33:04.107436 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 04 16:33:04.107436 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 16:33:04.107436 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 16:33:04.107436 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 16:33:04.107436 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 04 16:33:04.107436 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 16:33:04.107436 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 04 16:33:04.107436 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 16:33:04.107436 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 16:33:04.108708 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 16:33:04.108708 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 16:33:04.108708 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 16:33:04.108708 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5436, in live_migrate Aug 04 16:33:04.108708 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 04 16:33:04.108708 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:33:04.108708 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:33:04.108708 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 04 16:33:04.108708 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 04 16:33:04.108708 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 04 16:33:04.108708 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:04.108708 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 04 16:33:04.108708 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 04 16:33:04.108708 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 04 16:33:04.108708 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 04 16:33:04.108708 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 04 16:33:04.108708 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 04 16:33:04.108708 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1356220275 could not be found. Aug 04 16:33:04.108708 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:04.110009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:04.110009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:04.110009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:04.110009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:04.110009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:04.110009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:04.110009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:04.110009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:04.110009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:04.110009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:33:04.110009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:33:04.110009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:33:04.110009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:33:04.110009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:33:04.110009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:33:04.110009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 04 16:33:04.110009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 04 16:33:04.110009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 16:33:04.110009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1356220275 could not be found. Aug 04 16:33:04.110009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:04.111430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:04.111430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:04.111430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:04.111430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:04.111430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:04.111430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:33:04.111430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:33:04.111430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1356220275 could not be found. Aug 04 16:33:04.111430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:04.112055 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-73e9763c-5b8f-421c-8b9e-c031818c9455 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-969101282", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:04.113110 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f16d8ca5-75b4-4cbd-8b35-f2f95a98dadf tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] Returning 400 to user: Compute host tempest-host-1356220275 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:04.114388 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f16d8ca5-75b4-4cbd-8b35-f2f95a98dadf tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310/action" status: 400 len: 100 microversion: 2.1 time: 1.427033 Aug 04 16:33:04.115135 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 104/197] 10.222.0.23 () {60 vars in 1279 bytes} [Thu Aug 4 16:33:02 2022] POST /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310/action => generated 100 bytes in 1429 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:33:04.130229 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4d5d3407-8a04-44cb-9168-b281457fc820 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:04.131473 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:04.131473 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:04.197597 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4d5d3407-8a04-44cb-9168-b281457fc820 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.077742 Aug 04 16:33:04.201592 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 105/198] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Aug 4 16:33:04 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 16:33:04.214569 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1d07bec1-6f85-4c36-8806-d876a3341296 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:04.216730 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1d07bec1-6f85-4c36-8806-d876a3341296 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: dc4b9aed-b141-46b5-a62b-a039640c6310] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:04.231474 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-73e9763c-5b8f-421c-8b9e-c031818c9455 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] validate_networks() for None {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:33:04.237654 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d07bec1-6f85-4c36-8806-d876a3341296 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:04.239058 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d07bec1-6f85-4c36-8806-d876a3341296 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:04.240703 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d07bec1-6f85-4c36-8806-d876a3341296 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:04.242103 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d07bec1-6f85-4c36-8806-d876a3341296 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:05.313664 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1d07bec1-6f85-4c36-8806-d876a3341296 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052613a51b86400c916dbc800563896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0ceaab59d4aeaa8667cef6f62559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:05.327638 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1d07bec1-6f85-4c36-8806-d876a3341296 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "GET /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310" status: 200 len: 1468 microversion: 2.1 time: 1.123377 Aug 04 16:33:05.328223 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 106/199] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:04 2022] GET /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310 => generated 1468 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:05.339472 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3ff467e6-ba70-4304-a83c-c725aee7467c tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1776878461"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:05.345580 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:05.345580 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:05.347254 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.aggregate [None req-3ff467e6-ba70-4304-a83c-c725aee7467c tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Generated uuid 35f4361b-47a6-45ed-968e-84e539f0f209 for aggregate {{(pid=126126) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:33:05.391476 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3ff467e6-ba70-4304-a83c-c725aee7467c tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.061699 Aug 04 16:33:05.393421 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 107/200] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Aug 4 16:33:05 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:05.401178 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-53ebf39b-dfaa-4ad1-a408-dbd4eaa5a27a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:05.403051 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-53ebf39b-dfaa-4ad1-a408-dbd4eaa5a27a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: f5548cac-028e-4bca-b862-d471688b9c50] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:05.414263 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-53ebf39b-dfaa-4ad1-a408-dbd4eaa5a27a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:05.415040 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-53ebf39b-dfaa-4ad1-a408-dbd4eaa5a27a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:05.416056 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-53ebf39b-dfaa-4ad1-a408-dbd4eaa5a27a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:05.417224 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-53ebf39b-dfaa-4ad1-a408-dbd4eaa5a27a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:05.579084 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-73e9763c-5b8f-421c-8b9e-c031818c9455 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:33:05.580063 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-73e9763c-5b8f-421c-8b9e-c031818c9455 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:33:05.580666 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-73e9763c-5b8f-421c-8b9e-c031818c9455 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:33:05.581228 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-73e9763c-5b8f-421c-8b9e-c031818c9455 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:33:05.581813 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-73e9763c-5b8f-421c-8b9e-c031818c9455 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:33:05.596612 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-73e9763c-5b8f-421c-8b9e-c031818c9455 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:05.604266 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-73e9763c-5b8f-421c-8b9e-c031818c9455 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:05.605372 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-73e9763c-5b8f-421c-8b9e-c031818c9455 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:05.605807 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-73e9763c-5b8f-421c-8b9e-c031818c9455 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:05.627522 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-73e9763c-5b8f-421c-8b9e-c031818c9455 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Getting quotas for project da18ed1da01548f89f484fa2528ef3c7. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:33:05.631816 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-73e9763c-5b8f-421c-8b9e-c031818c9455 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Getting quotas for user 53dfb22b7cc9407d9b1214b2b3644d0b and project da18ed1da01548f89f484fa2528ef3c7. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:33:05.648421 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.utils [None req-73e9763c-5b8f-421c-8b9e-c031818c9455 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] ram quota exceeded for da18ed1da01548f89f484fa2528ef3c7, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=126125) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 04 16:33:05.650260 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-73e9763c-5b8f-421c-8b9e-c031818c9455 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 04 16:33:05.655981 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-73e9763c-5b8f-421c-8b9e-c031818c9455 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Request method failure captured: Aug 04 16:33:05.655981 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 16:33:05.655981 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:33:05.655981 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:33:05.655981 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:33:05.655981 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 144 Aug 04 16:33:05.655981 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:33:05.655981 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:33:05.655981 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:33:05.655981 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:05.655981 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_S1FSTuUH1i4hcSJDD-ku7udyraCuj8WXAqKfUWfoh0OjVte_X0vxJaB1Tlqp7m7iFlwUUKEJoiiuAwl0whMuAA9djH92U2qzgHdaqLFpcSrLV8yoybJtBSuYrZ2O5B8HATjuH-qFoFgAFYhlVPu6ol4k-p_2vYnDWMg04iXeWIzPg Aug 04 16:33:05.655981 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:33:05.655981 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:33:05.655981 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:33:05.655981 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:33:05.655981 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:33:05.655981 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:33:05.655981 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: da18ed1da01548f89f484fa2528ef3c7 Aug 04 16:33:05.655981 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-QuotasAdminNegativeTest-561137333 Aug 04 16:33:05.655981 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:33:05.655981 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:33:05.657359 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da18ed1da01548f89f484fa2528ef3c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_da18ed1da01548f89f484fa2528ef3c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da18ed1da01548f89f484fa2528ef3c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/da18ed1da01548f89f484fa2528ef3c7"}]}] Aug 04 16:33:05.657359 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-QuotasAdminNegativeTest-561137333 Aug 04 16:33:05.657359 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: da18ed1da01548f89f484fa2528ef3c7 Aug 04 16:33:05.657359 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-561137333 Aug 04 16:33:05.657359 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-QuotasAdminNegativeTest-561137333-project Aug 04 16:33:05.657359 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:33:05.657359 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:33:05.657359 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 53dfb22b7cc9407d9b1214b2b3644d0b Aug 04 16:33:05.657359 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-QuotasAdminNegativeTest-561137333-project Aug 04 16:33:05.657359 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:33:05.657359 n-d-846466-12 devstack@n-api.service[126125]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-969101282", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452"}} Aug 04 16:33:05.657359 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:33:05.658068 n-d-846466-12 devstack@n-api.service[126125]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 04 16:33:05.658068 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-969101282', 'imageRef': '58d80c01-1581-4a2f-bbb0-c2eaf1affa00', 'flavorRef': '452'}}} Aug 04 16:33:05.658068 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:05.658068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:05.658068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 04 16:33:05.658068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 04 16:33:05.658068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:33:05.658068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:33:05.658068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 04 16:33:05.658068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc Aug 04 16:33:05.658068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 04 16:33:05.658068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 04 16:33:05.658068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:33:05.658068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:33:05.658068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 04 16:33:05.658068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 04 16:33:05.658068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 04 16:33:05.658068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 04 16:33:05.659084 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 04 16:33:05.659084 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 04 16:33:05.659084 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 04 16:33:05.659084 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:05.659084 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:05.659084 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:05.659084 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:05.659084 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 04 16:33:05.659084 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 04 16:33:05.659084 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 04 16:33:05.659084 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 04 16:33:05.659084 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 04 16:33:05.659084 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 04 16:33:05.659084 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 04 16:33:05.659084 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 04 16:33:05.659084 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 04 16:33:05.659084 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 04 16:33:05.659084 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 04 16:33:05.659084 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:05.659084 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:05.659084 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:05.660254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:05.660254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:05.660254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:05.660254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:05.660254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:05.660254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:05.660254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:05.660254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:33:05.660254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:33:05.660254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:33:05.660254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:33:05.660254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:33:05.660254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:33:05.660254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 16:33:05.660254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 04 16:33:05.660254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 04 16:33:05.660254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 04 16:33:05.660254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:05.660254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:05.660254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:05.660254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:05.661429 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:05.661429 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:05.661429 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:33:05.661429 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:33:05.661429 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 04 16:33:05.661429 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:05.664329 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-73e9763c-5b8f-421c-8b9e-c031818c9455 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:05.665617 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-73e9763c-5b8f-421c-8b9e-c031818c9455 tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.563722 Aug 04 16:33:05.667160 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 94/201] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:33:04 2022] POST /compute/v2.1/servers => generated 110 bytes in 1576 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:33:05.675379 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-71e229fa-8630-4f76-acac-dde8e919fd1e tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846466-12"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:05.679855 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:05.679855 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:05.690387 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-71e229fa-8630-4f76-acac-dde8e919fd1e tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:05.690761 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-71e229fa-8630-4f76-acac-dde8e919fd1e tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:05.820144 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-53ebf39b-dfaa-4ad1-a408-dbd4eaa5a27a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:05.868261 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-53ebf39b-dfaa-4ad1-a408-dbd4eaa5a27a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50" status: 200 len: 1278 microversion: 2.1 time: 0.473434 Aug 04 16:33:05.868893 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 108/202] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:05 2022] GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50 => generated 1278 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:05.879364 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1dd641a9-f3a9-4630-b473-cdf829e8c0e1 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1535224314", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:05.958872 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-71e229fa-8630-4f76-acac-dde8e919fd1e tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 243 microversion: 2.1 time: 0.290627 Aug 04 16:33:05.959839 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 95/203] 10.222.0.23 () {60 vars in 1191 bytes} [Thu Aug 4 16:33:05 2022] POST /compute/v2.1/os-aggregates/3/action => generated 243 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:05.971757 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3998d3f2-d893-4717-af71-c5326b7ab4aa tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] Action: 'update', calling method: .version_select at 0x7f7e84b39ca0>, body: {"quota_set": {"ram": 51200}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:05.985167 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-1dd641a9-f3a9-4630-b473-cdf829e8c0e1 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] validate_networks() for None {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:33:06.544295 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3998d3f2-d893-4717-af71-c5326b7ab4aa tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:06.547706 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3998d3f2-d893-4717-af71-c5326b7ab4aa tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:06.549432 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3998d3f2-d893-4717-af71-c5326b7ab4aa tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:06.555146 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3998d3f2-d893-4717-af71-c5326b7ab4aa tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:06.604877 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=100 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:33:06.674310 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3998d3f2-d893-4717-af71-c5326b7ab4aa tempest-QuotasAdminNegativeTest-1615008890 tempest-QuotasAdminNegativeTest-1615008890-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/da18ed1da01548f89f484fa2528ef3c7" status: 200 len: 329 microversion: 2.1 time: 0.712677 Aug 04 16:33:06.675931 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 96/204] 10.222.0.23 () {60 vars in 1262 bytes} [Thu Aug 4 16:33:05 2022] PUT /compute/v2.1/os-quota-sets/da18ed1da01548f89f484fa2528ef3c7 => generated 329 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:06.688001 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e9d04f4c-cf12-4838-8376-7e3e5197654d tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:06.688892 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:06.688892 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:06.700675 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e9d04f4c-cf12-4838-8376-7e3e5197654d tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 243 microversion: 2.1 time: 0.023300 Aug 04 16:33:06.701783 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 97/205] 10.222.0.23 () {58 vars in 1149 bytes} [Thu Aug 4 16:33:06 2022] GET /compute/v2.1/os-aggregates/3 => generated 243 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:06.722916 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cb304de8-b930-4ce7-85be-361c080d484a tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Action: 'update', calling method: .version_select at 0x7f7e8793fb80>, body: {"quota_set": {"ram": 0}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:06.730777 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cb304de8-b930-4ce7-85be-361c080d484a tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '53dfb22b7cc9407d9b1214b2b3644d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da18ed1da01548f89f484fa2528ef3c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:06.733070 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cb304de8-b930-4ce7-85be-361c080d484a tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Request method failure captured: Aug 04 16:33:06.733070 n-d-846466-12 devstack@n-api.service[126125]: request: PUT /compute/v2.1/os-quota-sets/da18ed1da01548f89f484fa2528ef3c7 HTTP/1.1 Aug 04 16:33:06.733070 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:33:06.733070 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:33:06.733070 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:33:06.733070 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 25 Aug 04 16:33:06.733070 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:33:06.733070 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:33:06.733070 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:33:06.733070 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:06.733070 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_S1FSTuUH1i4hcSJDD-ku7udyraCuj8WXAqKfUWfoh0OjVte_X0vxJaB1Tlqp7m7iFlwUUKEJoiiuAwl0whMuAA9djH92U2qzgHdaqLFpcSrLV8yoybJtBSuYrZ2O5B8HATjuH-qFoFgAFYhlVPu6ol4k-p_2vYnDWMg04iXeWIzPg Aug 04 16:33:06.733070 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:33:06.733070 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:33:06.733070 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:33:06.733070 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:33:06.733070 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:33:06.733070 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:33:06.733070 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: da18ed1da01548f89f484fa2528ef3c7 Aug 04 16:33:06.733070 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-QuotasAdminNegativeTest-561137333 Aug 04 16:33:06.733070 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:33:06.733070 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:33:06.734389 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da18ed1da01548f89f484fa2528ef3c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_da18ed1da01548f89f484fa2528ef3c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da18ed1da01548f89f484fa2528ef3c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/da18ed1da01548f89f484fa2528ef3c7"}]}] Aug 04 16:33:06.734389 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-QuotasAdminNegativeTest-561137333 Aug 04 16:33:06.734389 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: da18ed1da01548f89f484fa2528ef3c7 Aug 04 16:33:06.734389 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-561137333 Aug 04 16:33:06.734389 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-QuotasAdminNegativeTest-561137333-project Aug 04 16:33:06.734389 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:33:06.734389 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:33:06.734389 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 53dfb22b7cc9407d9b1214b2b3644d0b Aug 04 16:33:06.734389 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-QuotasAdminNegativeTest-561137333-project Aug 04 16:33:06.734389 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:33:06.734389 n-d-846466-12 devstack@n-api.service[126125]: {"quota_set": {"ram": 0}} Aug 04 16:33:06.734389 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:33:06.734389 n-d-846466-12 devstack@n-api.service[126125]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 04 16:33:06.734389 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'da18ed1da01548f89f484fa2528ef3c7', 'body': {'quota_set': {'ram': 0}}} Aug 04 16:33:06.735713 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:06.735713 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:06.735713 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:06.735713 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:06.735713 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:06.735713 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:06.735713 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:33:06.735713 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:33:06.735713 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:06.735713 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:06.735713 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:33:06.735713 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:33:06.735713 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 04 16:33:06.735713 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 04 16:33:06.735713 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 16:33:06.735713 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:33:06.735713 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 16:33:06.735713 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:33:06.735713 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 04 16:33:06.736769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 04 16:33:06.736769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:33:06.736769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:33:06.736769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:33:06.736769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:33:06.736769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:33:06.736769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:33:06.736769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:33:06.736769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:33:06.736769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:33:06.736769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:33:06.736769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:33:06.736769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:33:06.736769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:33:06.736769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:33:06.736769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 04 16:33:06.736769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:06.736769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:06.736769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:06.736769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:06.737937 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:06.737937 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:06.737937 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:33:06.737937 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:33:06.737937 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 04 16:33:06.737937 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:06.737937 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cb304de8-b930-4ce7-85be-361c080d484a tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:06.737937 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cb304de8-b930-4ce7-85be-361c080d484a tempest-QuotasAdminNegativeTest-561137333 tempest-QuotasAdminNegativeTest-561137333-project] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/da18ed1da01548f89f484fa2528ef3c7" status: 403 len: 116 microversion: 2.1 time: 0.031695 Aug 04 16:33:06.737937 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 98/206] 10.222.0.23 () {60 vars in 1262 bytes} [Thu Aug 4 16:33:06 2022] PUT /compute/v2.1/os-quota-sets/da18ed1da01548f89f484fa2528ef3c7 => generated 116 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:33:06.755321 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5ce554c9-908e-4687-9031-b5090547681a tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846466-12"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:06.759773 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:06.759773 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:06.782432 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ce554c9-908e-4687-9031-b5090547681a tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:06.784064 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ce554c9-908e-4687-9031-b5090547681a tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:06.873908 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-1dd641a9-f3a9-4630-b473-cdf829e8c0e1 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:33:06.875099 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-1dd641a9-f3a9-4630-b473-cdf829e8c0e1 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:33:06.875778 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-1dd641a9-f3a9-4630-b473-cdf829e8c0e1 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:33:06.876383 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-1dd641a9-f3a9-4630-b473-cdf829e8c0e1 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:33:06.876979 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-1dd641a9-f3a9-4630-b473-cdf829e8c0e1 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:33:06.896514 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1dd641a9-f3a9-4630-b473-cdf829e8c0e1 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:06.897699 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1dd641a9-f3a9-4630-b473-cdf829e8c0e1 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:06.904855 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1dd641a9-f3a9-4630-b473-cdf829e8c0e1 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:06.907393 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1dd641a9-f3a9-4630-b473-cdf829e8c0e1 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:06.925657 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=21 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:33:06.943689 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-1dd641a9-f3a9-4630-b473-cdf829e8c0e1 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Getting quotas for project 10b0ceaab59d4aeaa8667cef6f62559e. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:33:06.969208 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5ce554c9-908e-4687-9031-b5090547681a tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.232714 Aug 04 16:33:06.971968 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 99/207] 10.222.0.23 () {60 vars in 1191 bytes} [Thu Aug 4 16:33:06 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:06.973813 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-1dd641a9-f3a9-4630-b473-cdf829e8c0e1 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Getting quotas for user 052613a51b86400c916dbc800563896c and project 10b0ceaab59d4aeaa8667cef6f62559e. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:33:06.983666 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cc39a341-c3e1-40ce-bb02-323f46793f37 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:06.984773 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cc39a341-c3e1-40ce-bb02-323f46793f37 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: f5548cac-028e-4bca-b862-d471688b9c50] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:06.999793 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1dd641a9-f3a9-4630-b473-cdf829e8c0e1 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:33:07.002030 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cc39a341-c3e1-40ce-bb02-323f46793f37 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:07.002693 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cc39a341-c3e1-40ce-bb02-323f46793f37 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:07.005860 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1dd641a9-f3a9-4630-b473-cdf829e8c0e1 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: 1ae03eb0-d144-4135-87eb-d8816b9988e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:33:07.006830 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cc39a341-c3e1-40ce-bb02-323f46793f37 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:07.007430 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cc39a341-c3e1-40ce-bb02-323f46793f37 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:07.099724 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1dd641a9-f3a9-4630-b473-cdf829e8c0e1 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.227545 Aug 04 16:33:07.107362 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 109/208] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:33:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:33:07.116360 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b075a956-8c0e-4dcf-8f61-3fa54c279081 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:07.117538 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:07.117538 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:07.151903 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b075a956-8c0e-4dcf-8f61-3fa54c279081 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.044183 Aug 04 16:33:07.159446 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 110/209] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Aug 4 16:33:07 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 16:33:07.167813 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b707cb80-aad3-4567-ab44-2402f9eb9048 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:07.169070 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b707cb80-aad3-4567-ab44-2402f9eb9048 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: 1ae03eb0-d144-4135-87eb-d8816b9988e8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:07.602727 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b707cb80-aad3-4567-ab44-2402f9eb9048 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052613a51b86400c916dbc800563896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0ceaab59d4aeaa8667cef6f62559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:07.634938 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b707cb80-aad3-4567-ab44-2402f9eb9048 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8" status: 200 len: 1219 microversion: 2.1 time: 0.464710 Aug 04 16:33:07.634938 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 111/210] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:07 2022] GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8 => generated 1219 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:07.661212 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-574ae9ad-add0-4208-b6a6-7897ea3c767c tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1475263583"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:07.676962 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:07.676962 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:07.680789 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.aggregate [None req-574ae9ad-add0-4208-b6a6-7897ea3c767c tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Generated uuid e1f2f2b8-5160-4457-b130-231cc20a46b1 for aggregate {{(pid=126126) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:33:07.751450 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-574ae9ad-add0-4208-b6a6-7897ea3c767c tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.112558 Aug 04 16:33:07.764160 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 112/211] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Aug 4 16:33:07 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:07.767341 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cc39a341-c3e1-40ce-bb02-323f46793f37 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:07.783919 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cc39a341-c3e1-40ce-bb02-323f46793f37 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50" status: 200 len: 1320 microversion: 2.1 time: 0.810546 Aug 04 16:33:07.786745 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-54578353-f302-4ca9-b876-b8796187ea7e tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846466-12"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:07.788482 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 100/212] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:06 2022] GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50 => generated 1320 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:07.823971 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:07.823971 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:07.857258 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-54578353-f302-4ca9-b876-b8796187ea7e tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:07.858151 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-54578353-f302-4ca9-b876-b8796187ea7e tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:08.136259 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-54578353-f302-4ca9-b876-b8796187ea7e tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 243 microversion: 2.1 time: 0.369694 Aug 04 16:33:08.145335 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 113/213] 10.222.0.23 () {60 vars in 1191 bytes} [Thu Aug 4 16:33:07 2022] POST /compute/v2.1/os-aggregates/4/action => generated 243 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:08.154830 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0daf1bfc-cf43-482c-9505-12066f46c568 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:08.155752 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:08.155752 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:08.169257 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0daf1bfc-cf43-482c-9505-12066f46c568 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.019150 Aug 04 16:33:08.173352 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 101/214] 10.222.0.23 () {58 vars in 1143 bytes} [Thu Aug 4 16:33:08 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:08.185862 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c82e46e2-23c2-48ea-96c1-61b59af38902 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846466-12"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:08.189314 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:08.189314 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:08.211253 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c82e46e2-23c2-48ea-96c1-61b59af38902 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:08.212202 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c82e46e2-23c2-48ea-96c1-61b59af38902 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:08.284561 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0547fa48-85a9-4445-adce-32ff71ad3488 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:08.285839 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0547fa48-85a9-4445-adce-32ff71ad3488 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: ac53ca0d-94da-45a3-bd53-f013b5b61d51] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:08.301011 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0547fa48-85a9-4445-adce-32ff71ad3488 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:08.301771 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0547fa48-85a9-4445-adce-32ff71ad3488 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:08.302717 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0547fa48-85a9-4445-adce-32ff71ad3488 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:08.306074 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0547fa48-85a9-4445-adce-32ff71ad3488 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:08.524726 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c82e46e2-23c2-48ea-96c1-61b59af38902 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.343475 Aug 04 16:33:08.528607 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 114/215] 10.222.0.23 () {60 vars in 1191 bytes} [Thu Aug 4 16:33:08 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:08.542850 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-dae45b53-0547-432d-a93a-3b8d27c63d43 req-af6b4dfe-60fd-4d71-a46f-9653dc24e9f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac53ca0d-94da-45a3-bd53-f013b5b61d51", "tag": "4c2eed2c-2a7c-44ed-915e-f94311a74757"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:08.587787 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-dae45b53-0547-432d-a93a-3b8d27c63d43 req-af6b4dfe-60fd-4d71-a46f-9653dc24e9f2 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:08.589059 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-dae45b53-0547-432d-a93a-3b8d27c63d43 req-af6b4dfe-60fd-4d71-a46f-9653dc24e9f2 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:08.663838 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-dae45b53-0547-432d-a93a-3b8d27c63d43 req-af6b4dfe-60fd-4d71-a46f-9653dc24e9f2 service nova] Creating event network-changed:4c2eed2c-2a7c-44ed-915e-f94311a74757 for instance ac53ca0d-94da-45a3-bd53-f013b5b61d51 on n-h1-846466-12 Aug 04 16:33:08.679400 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-dae45b53-0547-432d-a93a-3b8d27c63d43 req-af6b4dfe-60fd-4d71-a46f-9653dc24e9f2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148677 Aug 04 16:33:08.680034 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 115/216] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:08.692991 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-557a1098-4ecf-46f2-8c5a-ccce6f6ea1b1 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:08.695618 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:08.695618 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:08.707711 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=9,nova_api:DELETE=5 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:33:08.746682 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-557a1098-4ecf-46f2-8c5a-ccce6f6ea1b1 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.062925 Aug 04 16:33:08.752643 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 116/217] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Aug 4 16:33:08 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 16:33:08.758745 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2a72d829-9d1a-49d7-9bb9-f070126f70de tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:08.759733 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2a72d829-9d1a-49d7-9bb9-f070126f70de tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: 1ae03eb0-d144-4135-87eb-d8816b9988e8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:08.768717 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a72d829-9d1a-49d7-9bb9-f070126f70de tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:08.769478 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a72d829-9d1a-49d7-9bb9-f070126f70de tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:08.770867 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a72d829-9d1a-49d7-9bb9-f070126f70de tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:08.771508 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a72d829-9d1a-49d7-9bb9-f070126f70de tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:09.128307 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0547fa48-85a9-4445-adce-32ff71ad3488 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a427fb7481d4799a83729910f33b01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd96a8c91974b8ba7919d5349f380ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:09.141477 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0547fa48-85a9-4445-adce-32ff71ad3488 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51" status: 200 len: 1588 microversion: 2.1 time: 0.863502 Aug 04 16:33:09.146652 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 102/218] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:08 2022] GET /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51 => generated 1588 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:09.148687 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2a72d829-9d1a-49d7-9bb9-f070126f70de tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052613a51b86400c916dbc800563896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0ceaab59d4aeaa8667cef6f62559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:09.159867 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2a72d829-9d1a-49d7-9bb9-f070126f70de tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8" status: 200 len: 1279 microversion: 2.1 time: 0.410977 Aug 04 16:33:09.160975 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b1b865ef-2c91-46a2-8a94-1dd5b521db0a tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-843408537"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:09.164650 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:09.164650 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:09.166047 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.aggregate [None req-b1b865ef-2c91-46a2-8a94-1dd5b521db0a tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Generated uuid 8b9a4af2-8303-4dfb-aa3e-af807d4c9a90 for aggregate {{(pid=126125) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:33:09.176226 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 117/219] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:08 2022] GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8 => generated 1279 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:09.192854 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c80fdda6-8327-4276-97fe-f3a415898eef tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:09.196323 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c80fdda6-8327-4276-97fe-f3a415898eef tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: f5548cac-028e-4bca-b862-d471688b9c50] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:09.211980 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c80fdda6-8327-4276-97fe-f3a415898eef tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:09.215715 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c80fdda6-8327-4276-97fe-f3a415898eef tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:09.219349 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b1b865ef-2c91-46a2-8a94-1dd5b521db0a tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.071311 Aug 04 16:33:09.220766 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 103/220] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Aug 4 16:33:09 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:09.222603 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c80fdda6-8327-4276-97fe-f3a415898eef tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:09.224527 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c80fdda6-8327-4276-97fe-f3a415898eef tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:09.233095 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-79d306f0-30b7-4402-b1b2-ec03e82e62b1 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846466-12"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:09.236444 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:09.236444 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:09.271878 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-79d306f0-30b7-4402-b1b2-ec03e82e62b1 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:09.273476 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-79d306f0-30b7-4402-b1b2-ec03e82e62b1 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:09.281240 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=100 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:33:09.501577 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-79d306f0-30b7-4402-b1b2-ec03e82e62b1 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 242 microversion: 2.1 time: 0.272629 Aug 04 16:33:09.502490 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 104/221] 10.222.0.23 () {60 vars in 1191 bytes} [Thu Aug 4 16:33:09 2022] POST /compute/v2.1/os-aggregates/5/action => generated 242 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:33:09.515089 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b3d624c5-67fb-4b4e-b850-3f6f2dc2cf54 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846466-12"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:09.518674 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:09.518674 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:09.541069 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b3d624c5-67fb-4b4e-b850-3f6f2dc2cf54 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:09.541548 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b3d624c5-67fb-4b4e-b850-3f6f2dc2cf54 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:09.778347 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b3d624c5-67fb-4b4e-b850-3f6f2dc2cf54 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 226 microversion: 2.1 time: 0.267464 Aug 04 16:33:09.780348 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 105/222] 10.222.0.23 () {60 vars in 1191 bytes} [Thu Aug 4 16:33:09 2022] POST /compute/v2.1/os-aggregates/5/action => generated 226 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:09.795131 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-764a030b-9645-46a1-83e6-b6c6b6bc0618 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:09.796395 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:09.796395 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:09.852855 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-764a030b-9645-46a1-83e6-b6c6b6bc0618 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.065190 Aug 04 16:33:09.853852 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 106/223] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Aug 4 16:33:09 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 04 16:33:09.863266 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-906ca64f-8fa8-4631-8216-e4d51097a6e5 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1959547237"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:09.866822 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:09.866822 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:09.867884 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.aggregate [None req-906ca64f-8fa8-4631-8216-e4d51097a6e5 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Generated uuid 5c86822e-da92-43ad-80e4-939dc2232ee4 for aggregate {{(pid=126125) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:33:09.882388 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:DELETE=5,nova_api:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:33:09.927147 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-906ca64f-8fa8-4631-8216-e4d51097a6e5 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.066024 Aug 04 16:33:09.929243 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 107/224] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Aug 4 16:33:09 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:09.936681 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f7651562-ca3f-4413-9cd9-190d71053dc5 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-658506377"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:09.941823 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:09.941823 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:09.942904 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.aggregate [None req-f7651562-ca3f-4413-9cd9-190d71053dc5 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Generated uuid 2b8f07ad-af68-4e5d-b2de-3d3db8f5bb68 for aggregate {{(pid=126125) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:33:09.975273 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f7651562-ca3f-4413-9cd9-190d71053dc5 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.044645 Aug 04 16:33:09.980743 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 108/225] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Aug 4 16:33:09 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:09.986785 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f9ef211f-e439-42eb-84ed-42ee80eb4d48 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:09.990543 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:09.990543 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:10.035704 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f9ef211f-e439-42eb-84ed-42ee80eb4d48 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.053394 Aug 04 16:33:10.037197 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 109/226] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Aug 4 16:33:09 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 16:33:10.045523 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cc167dd7-29a4-4726-9339-bbad477f2580 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846466-12"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:10.049858 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:10.049858 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:10.070784 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cc167dd7-29a4-4726-9339-bbad477f2580 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:10.071770 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cc167dd7-29a4-4726-9339-bbad477f2580 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:10.334003 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cc167dd7-29a4-4726-9339-bbad477f2580 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 242 microversion: 2.1 time: 0.294513 Aug 04 16:33:10.345574 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 110/227] 10.222.0.23 () {60 vars in 1191 bytes} [Thu Aug 4 16:33:10 2022] POST /compute/v2.1/os-aggregates/7/action => generated 242 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:10.350943 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bca98775-f3c6-4fb9-ba0b-337adfd66a72 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:10.351756 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:10.351756 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:10.373172 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-bca98775-f3c6-4fb9-ba0b-337adfd66a72 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Aug 04 16:33:10.375473 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bca98775-f3c6-4fb9-ba0b-337adfd66a72 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Request method failure captured: Aug 04 16:33:10.375473 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Aug 04 16:33:10.375473 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:33:10.375473 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:33:10.375473 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:33:10.375473 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:33:10.375473 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:33:10.375473 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:33:10.375473 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:33:10.375473 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:10.375473 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_SNU1G4Ig21KsUdaC52JEbO64A_NjG0tsvpynKWVchFXqGwogomwXWBi1bhmhklTi6Qx3JbErs1CL5gvbLpATGXoNAE-TxScPj8-NehzINiY49mF7yd0-RkQOuUAdacvSNMvuJ5khdTx7LxQbRhS9K2K00vC1KvWE9wGVebhWk2Chs Aug 04 16:33:10.375473 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:33:10.375473 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:33:10.375473 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:33:10.375473 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:33:10.375473 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:33:10.375473 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:33:10.375473 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: bd7633ce779e41558666f43454c3cd02 Aug 04 16:33:10.375473 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-AggregatesAdminTestJSON-1390392660 Aug 04 16:33:10.375473 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader,admin Aug 04 16:33:10.375473 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader,admin Aug 04 16:33:10.376783 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd7633ce779e41558666f43454c3cd02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bd7633ce779e41558666f43454c3cd02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd7633ce779e41558666f43454c3cd02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bd7633ce779e41558666f43454c3cd02"}]}] Aug 04 16:33:10.376783 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-AggregatesAdminTestJSON-1390392660 Aug 04 16:33:10.376783 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: bd7633ce779e41558666f43454c3cd02 Aug 04 16:33:10.376783 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1390392660 Aug 04 16:33:10.376783 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-AggregatesAdminTestJSON-1390392660-project-admin Aug 04 16:33:10.376783 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:33:10.376783 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:33:10.376783 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 3760affa861b4cf09a5dce358c2c28c0 Aug 04 16:33:10.376783 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-AggregatesAdminTestJSON-1390392660-project-admin Aug 04 16:33:10.376783 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:33:10.376783 n-d-846466-12 devstack@n-api.service[126125]: exception: Aggregate 6 could not be found. Aug 04 16:33:10.376783 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '6'} Aug 04 16:33:10.376783 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:10.377596 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:10.377596 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 04 16:33:10.377596 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 04 16:33:10.377596 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Aug 04 16:33:10.377596 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 04 16:33:10.377596 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:33:10.377596 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:33:10.377596 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 04 16:33:10.377596 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 04 16:33:10.377596 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:33:10.377596 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:33:10.377596 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 04 16:33:10.377596 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 04 16:33:10.377596 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Aug 04 16:33:10.377596 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:10.377596 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:10.377596 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:10.377596 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:10.377596 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:10.378708 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:10.378708 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:10.378708 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:10.378708 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:10.378708 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:10.378708 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 04 16:33:10.378708 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:33:10.378708 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Aug 04 16:33:10.378708 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:10.378708 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:10.378708 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:10.378708 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:10.378708 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:10.378708 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:10.378708 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:33:10.378708 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:33:10.378708 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Aug 04 16:33:10.378708 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:10.382649 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bca98775-f3c6-4fb9-ba0b-337adfd66a72 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:10.382649 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bca98775-f3c6-4fb9-ba0b-337adfd66a72 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.030210 Aug 04 16:33:10.382649 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 111/228] 10.222.0.23 () {58 vars in 1149 bytes} [Thu Aug 4 16:33:10 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:33:10.389044 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4335c746-659e-440c-8d26-e2b452721b35 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:10.390666 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4335c746-659e-440c-8d26-e2b452721b35 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: 1ae03eb0-d144-4135-87eb-d8816b9988e8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:10.401160 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4335c746-659e-440c-8d26-e2b452721b35 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:10.401660 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4335c746-659e-440c-8d26-e2b452721b35 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:10.402523 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4335c746-659e-440c-8d26-e2b452721b35 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:10.402954 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4335c746-659e-440c-8d26-e2b452721b35 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:10.568918 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4335c746-659e-440c-8d26-e2b452721b35 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052613a51b86400c916dbc800563896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0ceaab59d4aeaa8667cef6f62559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:10.579239 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4335c746-659e-440c-8d26-e2b452721b35 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8" status: 200 len: 1277 microversion: 2.1 time: 0.200322 Aug 04 16:33:10.582898 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 112/229] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:10 2022] GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8 => generated 1277 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:10.592977 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3c41d0b1-6d69-4ece-bfe2-0dcfc7be6c82 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846466-12"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:10.605781 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:10.605781 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:10.626340 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3c41d0b1-6d69-4ece-bfe2-0dcfc7be6c82 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:10.626340 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3c41d0b1-6d69-4ece-bfe2-0dcfc7be6c82 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:10.638561 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c80fdda6-8327-4276-97fe-f3a415898eef tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:10.684606 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-3c41d0b1-6d69-4ece-bfe2-0dcfc7be6c82 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] HTTP exception thrown: Aggregate 7 already has host n-h2-846466-12. Aug 04 16:33:10.718163 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c80fdda6-8327-4276-97fe-f3a415898eef tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50" status: 200 len: 1320 microversion: 2.1 time: 1.538968 Aug 04 16:33:10.719955 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 118/230] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:09 2022] GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50 => generated 1320 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:10.725212 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3c41d0b1-6d69-4ece-bfe2-0dcfc7be6c82 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Request method failure captured: Aug 04 16:33:10.725212 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/os-aggregates/7/action HTTP/1.1 Aug 04 16:33:10.725212 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:33:10.725212 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:33:10.725212 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:33:10.725212 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 40 Aug 04 16:33:10.725212 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:33:10.725212 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:33:10.725212 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:33:10.725212 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:10.725212 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_SOp7dYsA8yrXNLWGfM4nirfsqKWORI6Ep5uZ6EG139ZdJI0EvxWFx70MIQGhLT-giIfYvf5VWhxo6aVlyfl8UtnmNr6UKrQEn2EggnQzG6F6ZBYKtNvBaLIT_gFNFdRziQDT6Zch4MUyzR83RFdu4yJ6RYK8xNxCkAOA-hwhiuorI Aug 04 16:33:10.725212 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:33:10.725212 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:33:10.725212 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:33:10.725212 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:33:10.725212 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:33:10.725212 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:33:10.725212 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: c4702c1958e4426182df0685c06f9b9c Aug 04 16:33:10.725212 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1729454419 Aug 04 16:33:10.725212 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader,admin Aug 04 16:33:10.725212 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader,admin Aug 04 16:33:10.727876 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4702c1958e4426182df0685c06f9b9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c4702c1958e4426182df0685c06f9b9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4702c1958e4426182df0685c06f9b9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c4702c1958e4426182df0685c06f9b9c"}]}] Aug 04 16:33:10.727876 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1729454419 Aug 04 16:33:10.727876 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: c4702c1958e4426182df0685c06f9b9c Aug 04 16:33:10.727876 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1729454419 Aug 04 16:33:10.727876 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin Aug 04 16:33:10.727876 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:33:10.727876 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:33:10.727876 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: e1bc9c2d161c4396966cc1539f6a801d Aug 04 16:33:10.727876 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin Aug 04 16:33:10.727876 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:33:10.727876 n-d-846466-12 devstack@n-api.service[126125]: {"add_host": {"host": "n-h2-846466-12"}} Aug 04 16:33:10.727876 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:33:10.727876 n-d-846466-12 devstack@n-api.service[126125]: exception: Aggregate 7 already has host n-h2-846466-12. Aug 04 16:33:10.729648 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '7', 'body': {'add_host': {'host': 'n-h2-846466-12'}}} Aug 04 16:33:10.729648 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:10.729648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:10.729648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 16:33:10.729648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 04 16:33:10.729648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 16:33:10.729648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 04 16:33:10.729648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 16:33:10.729648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 04 16:33:10.729648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 16:33:10.729648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 04 16:33:10.729648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 16:33:10.729648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 16:33:10.729648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 16:33:10.729648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result.read() Aug 04 16:33:10.729648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 16:33:10.729648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 04 16:33:10.729648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 16:33:10.729648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 04 16:33:10.732118 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 16:33:10.732118 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 04 16:33:10.732118 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 16:33:10.732118 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 04 16:33:10.732118 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-846466-12-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 04 16:33:10.732118 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:10.732118 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 04 16:33:10.732118 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:10.732118 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:10.732118 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 04 16:33:10.732118 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 04 16:33:10.732118 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 04 16:33:10.732118 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi session.flush() Aug 04 16:33:10.732118 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 16:33:10.732118 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 04 16:33:10.732118 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 16:33:10.732118 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 04 16:33:10.732118 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 16:33:10.732118 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 04 16:33:10.745866 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 16:33:10.745866 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception Aug 04 16:33:10.745866 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 16:33:10.745866 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 04 16:33:10.745866 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 16:33:10.745866 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 04 16:33:10.745866 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 16:33:10.745866 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 04 16:33:10.745866 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 16:33:10.745866 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 04 16:33:10.745866 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 04 16:33:10.745866 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 04 16:33:10.745866 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 16:33:10.745866 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 16:33:10.745866 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 16:33:10.745866 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 04 16:33:10.745866 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 16:33:10.745866 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 04 16:33:10.749362 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 16:33:10.749362 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 04 16:33:10.749362 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 16:33:10.749362 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 16:33:10.749362 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 16:33:10.749362 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception Aug 04 16:33:10.749362 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 16:33:10.749362 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 04 16:33:10.749362 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 16:33:10.749362 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 04 16:33:10.749362 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 16:33:10.749362 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 04 16:33:10.749362 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 16:33:10.749362 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 04 16:33:10.749362 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 16:33:10.749362 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 16:33:10.749362 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 16:33:10.749362 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result.read() Aug 04 16:33:10.752655 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 16:33:10.752655 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 04 16:33:10.752655 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 16:33:10.752655 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 04 16:33:10.752655 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 16:33:10.752655 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 04 16:33:10.752655 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 16:33:10.752655 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 04 16:33:10.752655 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-846466-12-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 04 16:33:10.752655 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 04 16:33:10.752655 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 4, 16, 33, 10, 660567), 'updated_at': None, 'host': 'n-h2-846466-12', 'aggregate_id': 7}] Aug 04 16:33:10.752655 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 16:33:10.752655 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:10.752655 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:10.752655 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:10.752655 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:10.752655 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 04 16:33:10.757619 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 04 16:33:10.757619 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 16:33:10.757619 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 16:33:10.757619 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:33:10.757619 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:33:10.757619 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:33:10.757619 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:33:10.757619 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 16:33:10.757619 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 16:33:10.757619 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6594, in add_host_to_aggregate Aug 04 16:33:10.757619 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 04 16:33:10.757619 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 04 16:33:10.757619 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 04 16:33:10.757619 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 04 16:33:10.757619 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 04 16:33:10.757619 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 04 16:33:10.757619 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 04 16:33:10.757619 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 7 already has host n-h2-846466-12. Aug 04 16:33:10.757619 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:10.757619 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:10.762349 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:10.762349 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:10.762349 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:10.762349 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:10.762349 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:10.762349 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:10.762349 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:10.762349 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:10.762349 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:33:10.762349 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:33:10.762349 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 04 16:33:10.762349 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 04 16:33:10.762349 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 7 already has host n-h2-846466-12. Aug 04 16:33:10.762349 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:10.762349 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:10.762349 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:10.762349 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:10.762349 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:10.762349 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:10.762349 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:33:10.762349 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:33:10.765648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 already has host n-h2-846466-12. Aug 04 16:33:10.765648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:10.765648 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3c41d0b1-6d69-4ece-bfe2-0dcfc7be6c82 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Returning 409 to user: Aggregate 7 already has host n-h2-846466-12. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:10.768418 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3c41d0b1-6d69-4ece-bfe2-0dcfc7be6c82 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/7/action" status: 409 len: 96 microversion: 2.1 time: 0.182832 Aug 04 16:33:10.778885 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 113/231] 10.222.0.23 () {60 vars in 1191 bytes} [Thu Aug 4 16:33:10 2022] POST /compute/v2.1/os-aggregates/7/action => generated 96 bytes in 194 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 04 16:33:10.788340 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-603719e7-dc9c-486d-897b-c940c485d63d tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:10.810249 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:10.810249 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:10.826407 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-397926a5-9944-4edb-b9d8-528caa060f30 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846466-12"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:10.840333 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:10.840333 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:10.865036 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-603719e7-dc9c-486d-897b-c940c485d63d tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Aug 04 16:33:10.870970 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-603719e7-dc9c-486d-897b-c940c485d63d tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Request method failure captured: Aug 04 16:33:10.870970 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Aug 04 16:33:10.870970 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:33:10.870970 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:33:10.870970 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:33:10.870970 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:33:10.870970 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:33:10.870970 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:33:10.870970 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:33:10.870970 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:10.870970 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_SNU1G4Ig21KsUdaC52JEbO64A_NjG0tsvpynKWVchFXqGwogomwXWBi1bhmhklTi6Qx3JbErs1CL5gvbLpATGXoNAE-TxScPj8-NehzINiY49mF7yd0-RkQOuUAdacvSNMvuJ5khdTx7LxQbRhS9K2K00vC1KvWE9wGVebhWk2Chs Aug 04 16:33:10.870970 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:33:10.870970 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:33:10.870970 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:33:10.870970 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:33:10.870970 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:33:10.870970 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:33:10.870970 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: bd7633ce779e41558666f43454c3cd02 Aug 04 16:33:10.870970 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-AggregatesAdminTestJSON-1390392660 Aug 04 16:33:10.870970 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader,admin Aug 04 16:33:10.870970 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader,admin Aug 04 16:33:10.873737 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd7633ce779e41558666f43454c3cd02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bd7633ce779e41558666f43454c3cd02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd7633ce779e41558666f43454c3cd02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bd7633ce779e41558666f43454c3cd02"}]}] Aug 04 16:33:10.873737 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-AggregatesAdminTestJSON-1390392660 Aug 04 16:33:10.873737 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: bd7633ce779e41558666f43454c3cd02 Aug 04 16:33:10.873737 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1390392660 Aug 04 16:33:10.873737 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-AggregatesAdminTestJSON-1390392660-project-admin Aug 04 16:33:10.873737 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:33:10.873737 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:33:10.873737 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 3760affa861b4cf09a5dce358c2c28c0 Aug 04 16:33:10.873737 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-AggregatesAdminTestJSON-1390392660-project-admin Aug 04 16:33:10.873737 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:33:10.873737 n-d-846466-12 devstack@n-api.service[126126]: exception: Aggregate 6 could not be found. Aug 04 16:33:10.873737 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '6'} Aug 04 16:33:10.873737 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:10.875962 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:10.875962 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 04 16:33:10.875962 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 04 16:33:10.875962 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 16:33:10.875962 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 16:33:10.875962 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:33:10.875962 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:33:10.875962 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:33:10.875962 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:33:10.875962 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 16:33:10.875962 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 16:33:10.875962 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Aug 04 16:33:10.875962 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 04 16:33:10.875962 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:33:10.875962 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:33:10.875962 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 04 16:33:10.875962 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 04 16:33:10.875962 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:33:10.875962 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:33:10.880136 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 04 16:33:10.880136 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 04 16:33:10.880136 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Aug 04 16:33:10.880136 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:10.880136 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:10.880136 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:10.880136 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:10.880136 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:10.880136 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:10.880136 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:10.880136 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:10.880136 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:10.880136 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:10.880136 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 04 16:33:10.880136 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:33:10.880136 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Aug 04 16:33:10.880136 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:10.880136 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:10.880136 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:10.880136 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:10.880136 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:10.886687 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:10.886687 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:33:10.886687 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:33:10.886687 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Aug 04 16:33:10.886687 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:10.888449 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-397926a5-9944-4edb-b9d8-528caa060f30 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:10.888449 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-397926a5-9944-4edb-b9d8-528caa060f30 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:10.890131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-603719e7-dc9c-486d-897b-c940c485d63d tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:10.893564 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-603719e7-dc9c-486d-897b-c940c485d63d tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.137786 Aug 04 16:33:10.895260 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 119/232] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Aug 4 16:33:10 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:33:10.923539 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-abd5316e-7395-490a-8b12-596e38a4b2d0 req-04a1c3ce-8d9e-462e-a2f6-709152008e15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5548cac-028e-4bca-b862-d471688b9c50", "tag": "5bca5e77-28f1-4d92-ae07-3a6f6331f63e"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:10.973903 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-abd5316e-7395-490a-8b12-596e38a4b2d0 req-04a1c3ce-8d9e-462e-a2f6-709152008e15 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:10.974653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-abd5316e-7395-490a-8b12-596e38a4b2d0 req-04a1c3ce-8d9e-462e-a2f6-709152008e15 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:11.026018 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-abd5316e-7395-490a-8b12-596e38a4b2d0 req-04a1c3ce-8d9e-462e-a2f6-709152008e15 service nova] Creating event network-changed:5bca5e77-28f1-4d92-ae07-3a6f6331f63e for instance f5548cac-028e-4bca-b862-d471688b9c50 on n-h2-846466-12 Aug 04 16:33:11.046887 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-abd5316e-7395-490a-8b12-596e38a4b2d0 req-04a1c3ce-8d9e-462e-a2f6-709152008e15 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132883 Aug 04 16:33:11.050618 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 120/233] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:11.061234 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-91257d5d-a4d1-4ee3-9c32-02057aed00fb tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-927821735", "name": "tempest-test_aggregate-1682422659"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:11.153588 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:11.153588 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:11.154685 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.aggregate [None req-91257d5d-a4d1-4ee3-9c32-02057aed00fb tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Generated uuid 7636b440-984a-461e-8624-b45eb37131e5 for aggregate {{(pid=126126) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:33:11.230238 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-91257d5d-a4d1-4ee3-9c32-02057aed00fb tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.177183 Aug 04 16:33:11.243248 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 121/234] 10.222.0.23 () {60 vars in 1165 bytes} [Thu Aug 4 16:33:11 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:11.248928 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5a7b52b7-826e-4861-93ec-648e5041971e tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:11.249731 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:11.249731 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:11.294340 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5a7b52b7-826e-4861-93ec-648e5041971e tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.049324 Aug 04 16:33:11.295286 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 122/235] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Aug 4 16:33:11 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 16:33:11.304281 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-397926a5-9944-4edb-b9d8-528caa060f30 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 226 microversion: 2.1 time: 0.502272 Aug 04 16:33:11.305038 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6811ccd7-7efd-4f87-93bd-ac5c73b7a434 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:11.305897 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:11.305897 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:11.308061 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 114/236] 10.222.0.23 () {60 vars in 1191 bytes} [Thu Aug 4 16:33:10 2022] POST /compute/v2.1/os-aggregates/7/action => generated 226 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:11.318306 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-6811ccd7-7efd-4f87-93bd-ac5c73b7a434 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Aug 04 16:33:11.324209 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6811ccd7-7efd-4f87-93bd-ac5c73b7a434 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Request method failure captured: Aug 04 16:33:11.324209 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Aug 04 16:33:11.324209 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:33:11.324209 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:33:11.324209 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:33:11.324209 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:33:11.324209 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:33:11.324209 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:33:11.324209 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:33:11.324209 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:11.324209 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_SNU1G4Ig21KsUdaC52JEbO64A_NjG0tsvpynKWVchFXqGwogomwXWBi1bhmhklTi6Qx3JbErs1CL5gvbLpATGXoNAE-TxScPj8-NehzINiY49mF7yd0-RkQOuUAdacvSNMvuJ5khdTx7LxQbRhS9K2K00vC1KvWE9wGVebhWk2Chs Aug 04 16:33:11.324209 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:33:11.324209 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:33:11.324209 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:33:11.324209 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:33:11.324209 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:33:11.324209 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:33:11.324209 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: bd7633ce779e41558666f43454c3cd02 Aug 04 16:33:11.324209 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-AggregatesAdminTestJSON-1390392660 Aug 04 16:33:11.324209 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader,admin Aug 04 16:33:11.324209 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader,admin Aug 04 16:33:11.327061 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd7633ce779e41558666f43454c3cd02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bd7633ce779e41558666f43454c3cd02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd7633ce779e41558666f43454c3cd02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bd7633ce779e41558666f43454c3cd02"}]}] Aug 04 16:33:11.327061 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-AggregatesAdminTestJSON-1390392660 Aug 04 16:33:11.327061 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: bd7633ce779e41558666f43454c3cd02 Aug 04 16:33:11.327061 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1390392660 Aug 04 16:33:11.327061 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-AggregatesAdminTestJSON-1390392660-project-admin Aug 04 16:33:11.327061 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:33:11.327061 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:33:11.327061 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 3760affa861b4cf09a5dce358c2c28c0 Aug 04 16:33:11.327061 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-AggregatesAdminTestJSON-1390392660-project-admin Aug 04 16:33:11.327061 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:33:11.327061 n-d-846466-12 devstack@n-api.service[126126]: exception: Aggregate 8 could not be found. Aug 04 16:33:11.327061 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '8'} Aug 04 16:33:11.327061 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:11.328686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:11.328686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 04 16:33:11.328686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 04 16:33:11.328686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Aug 04 16:33:11.328686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 04 16:33:11.328686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:33:11.328686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:33:11.328686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 04 16:33:11.328686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 04 16:33:11.328686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:33:11.328686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:33:11.328686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 04 16:33:11.328686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 04 16:33:11.328686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Aug 04 16:33:11.328686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:11.328686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:11.328686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:11.328686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:11.328686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:11.331086 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:11.331086 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:11.331086 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:11.331086 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:11.331086 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:11.331086 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 04 16:33:11.331086 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:33:11.331086 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Aug 04 16:33:11.331086 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:11.331086 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:11.331086 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:11.331086 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:11.331086 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:11.331086 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:11.331086 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:33:11.331086 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:33:11.331086 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Aug 04 16:33:11.331086 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:11.339196 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6811ccd7-7efd-4f87-93bd-ac5c73b7a434 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:11.339196 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6811ccd7-7efd-4f87-93bd-ac5c73b7a434 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.027494 Aug 04 16:33:11.339196 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 123/237] 10.222.0.23 () {58 vars in 1149 bytes} [Thu Aug 4 16:33:11 2022] GET /compute/v2.1/os-aggregates/8 => generated 77 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:33:11.342525 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-540f434b-4ede-4267-ac39-60b143fe9f9e tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:11.343346 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:11.343346 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:11.347009 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-81584199-d6d2-481e-8cee-404b9e5a924d tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:11.352249 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:11.352249 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:11.370775 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-540f434b-4ede-4267-ac39-60b143fe9f9e tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Aug 04 16:33:11.372465 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-540f434b-4ede-4267-ac39-60b143fe9f9e tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Request method failure captured: Aug 04 16:33:11.372465 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/os-aggregates/8 HTTP/1.1 Aug 04 16:33:11.372465 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:33:11.372465 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:33:11.372465 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:33:11.372465 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:33:11.372465 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:33:11.372465 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:33:11.372465 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:33:11.372465 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:11.372465 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_SNU1G4Ig21KsUdaC52JEbO64A_NjG0tsvpynKWVchFXqGwogomwXWBi1bhmhklTi6Qx3JbErs1CL5gvbLpATGXoNAE-TxScPj8-NehzINiY49mF7yd0-RkQOuUAdacvSNMvuJ5khdTx7LxQbRhS9K2K00vC1KvWE9wGVebhWk2Chs Aug 04 16:33:11.372465 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:33:11.372465 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:33:11.372465 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:33:11.372465 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:33:11.372465 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:33:11.372465 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:33:11.372465 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: bd7633ce779e41558666f43454c3cd02 Aug 04 16:33:11.372465 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-AggregatesAdminTestJSON-1390392660 Aug 04 16:33:11.372465 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader,admin Aug 04 16:33:11.372465 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader,admin Aug 04 16:33:11.374921 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd7633ce779e41558666f43454c3cd02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bd7633ce779e41558666f43454c3cd02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd7633ce779e41558666f43454c3cd02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bd7633ce779e41558666f43454c3cd02"}]}] Aug 04 16:33:11.374921 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-AggregatesAdminTestJSON-1390392660 Aug 04 16:33:11.374921 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: bd7633ce779e41558666f43454c3cd02 Aug 04 16:33:11.374921 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1390392660 Aug 04 16:33:11.374921 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-AggregatesAdminTestJSON-1390392660-project-admin Aug 04 16:33:11.374921 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:33:11.374921 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:33:11.374921 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 3760affa861b4cf09a5dce358c2c28c0 Aug 04 16:33:11.374921 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-AggregatesAdminTestJSON-1390392660-project-admin Aug 04 16:33:11.374921 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:33:11.374921 n-d-846466-12 devstack@n-api.service[126126]: exception: Aggregate 8 could not be found. Aug 04 16:33:11.374921 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '8'} Aug 04 16:33:11.374921 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:11.383022 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:11.383022 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 04 16:33:11.383022 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 04 16:33:11.383022 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 16:33:11.383022 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 16:33:11.383022 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:33:11.383022 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:33:11.383022 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:33:11.383022 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:33:11.383022 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 16:33:11.383022 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 16:33:11.383022 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Aug 04 16:33:11.383022 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 04 16:33:11.383022 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:33:11.383022 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:33:11.383022 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 04 16:33:11.383022 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 04 16:33:11.383022 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:33:11.383022 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:33:11.385349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 04 16:33:11.385349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 04 16:33:11.385349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Aug 04 16:33:11.385349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:11.385349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:11.385349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:11.385349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:11.385349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:11.385349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:11.385349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:11.385349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:11.385349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:11.385349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:11.385349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 04 16:33:11.385349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:33:11.385349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Aug 04 16:33:11.385349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:11.385349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:11.385349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:11.385349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:11.385349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:11.387819 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:11.387819 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:33:11.387819 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:33:11.387819 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Aug 04 16:33:11.387819 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:11.387819 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-540f434b-4ede-4267-ac39-60b143fe9f9e tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:11.387819 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-540f434b-4ede-4267-ac39-60b143fe9f9e tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.036329 Aug 04 16:33:11.387819 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 124/238] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Aug 4 16:33:11 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 77 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:33:11.387819 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-03ebcbb4-a20f-4762-aa44-9bab5aca9400 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-632508456"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:11.394067 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:11.394067 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:11.395074 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.aggregate [None req-03ebcbb4-a20f-4762-aa44-9bab5aca9400 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Generated uuid 18681e1c-72d2-46fc-9a04-006fdc9fe47f for aggregate {{(pid=126126) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:33:11.438860 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-03ebcbb4-a20f-4762-aa44-9bab5aca9400 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.054981 Aug 04 16:33:11.439893 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 125/239] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Aug 4 16:33:11 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:11.455596 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-81584199-d6d2-481e-8cee-404b9e5a924d tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.137017 Aug 04 16:33:11.456717 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-81aca0f0-c1cb-45c6-af61-176ddca2d6fe tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:11.457489 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 115/240] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Aug 4 16:33:11 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 16:33:11.461164 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:11.461164 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:11.469880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ced90dc4-1fd3-411e-828f-b7c60e8ca357 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-99285618"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:11.477646 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:11.477646 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:11.482728 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.aggregate [None req-ced90dc4-1fd3-411e-828f-b7c60e8ca357 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Generated uuid 619c47e9-4487-4f17-8284-dc6f0ed96d0b for aggregate {{(pid=126125) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:33:11.496896 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-81aca0f0-c1cb-45c6-af61-176ddca2d6fe tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 226 microversion: 2.1 time: 0.045764 Aug 04 16:33:11.497851 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 126/241] 10.222.0.23 () {58 vars in 1149 bytes} [Thu Aug 4 16:33:11 2022] GET /compute/v2.1/os-aggregates/9 => generated 226 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:33:11.514983 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7292272f-8b66-4719-ba14-670254db0bff tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:11.524733 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:11.524733 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:11.540845 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ced90dc4-1fd3-411e-828f-b7c60e8ca357 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.074930 Aug 04 16:33:11.542059 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 116/242] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Aug 4 16:33:11 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:11.609880 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7292272f-8b66-4719-ba14-670254db0bff tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 264 microversion: 2.1 time: 0.095249 Aug 04 16:33:11.610820 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 127/243] 10.222.0.23 () {60 vars in 1191 bytes} [Thu Aug 4 16:33:11 2022] POST /compute/v2.1/os-aggregates/9/action => generated 264 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:33:11.617032 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-12705c64-02f9-48f1-bd9c-9c9487d1774d tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:11.621045 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-12705c64-02f9-48f1-bd9c-9c9487d1774d tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: 1ae03eb0-d144-4135-87eb-d8816b9988e8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:11.647540 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-12705c64-02f9-48f1-bd9c-9c9487d1774d tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:11.652036 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-12705c64-02f9-48f1-bd9c-9c9487d1774d tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:11.655899 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-12705c64-02f9-48f1-bd9c-9c9487d1774d tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:11.656603 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-12705c64-02f9-48f1-bd9c-9c9487d1774d tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:12.371590 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-05a93cf3-fba2-4152-9afa-28ad7baee144 tempest-AggregatesAdminNegativeTestJSON-1771418743 tempest-AggregatesAdminNegativeTestJSON-1771418743-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846466-12"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:12.374912 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:12.374912 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:12.375832 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-05a93cf3-fba2-4152-9afa-28ad7baee144 tempest-AggregatesAdminNegativeTestJSON-1771418743 tempest-AggregatesAdminNegativeTestJSON-1771418743-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '5c41f29a4c194e1a80ea01c8a18be89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889e94129fd4233b0016a0c15f67cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:12.377467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-05a93cf3-fba2-4152-9afa-28ad7baee144 tempest-AggregatesAdminNegativeTestJSON-1771418743 tempest-AggregatesAdminNegativeTestJSON-1771418743-project] Request method failure captured: Aug 04 16:33:12.377467 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 Aug 04 16:33:12.377467 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:33:12.377467 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:33:12.377467 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:33:12.377467 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 40 Aug 04 16:33:12.377467 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:33:12.377467 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:33:12.377467 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:33:12.377467 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:12.377467 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_SLHOP5R1Te60BFmtVhkSdA0PjcgEnnI3t3zYNfyll53XAWqxbL5JEAPcDgL4iBN7QKYMOyczkWcF2lRoc_7j2zbzT-JHLluvsek4cTuqhFDIAH_DUiH0TU21rarZ33EZCYr6p_5l8InnkYqoXXxbW_71HsXqkl-7Z0X4D63ziBqS0 Aug 04 16:33:12.377467 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:33:12.377467 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:33:12.377467 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:33:12.377467 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:33:12.377467 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:33:12.377467 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:33:12.377467 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: c889e94129fd4233b0016a0c15f67cb5 Aug 04 16:33:12.377467 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1771418743 Aug 04 16:33:12.377467 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:33:12.377467 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:33:12.378937 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c889e94129fd4233b0016a0c15f67cb5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c889e94129fd4233b0016a0c15f67cb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c889e94129fd4233b0016a0c15f67cb5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c889e94129fd4233b0016a0c15f67cb5"}]}] Aug 04 16:33:12.378937 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1771418743 Aug 04 16:33:12.378937 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: c889e94129fd4233b0016a0c15f67cb5 Aug 04 16:33:12.378937 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1771418743 Aug 04 16:33:12.378937 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-AggregatesAdminNegativeTestJSON-1771418743-project Aug 04 16:33:12.378937 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:33:12.378937 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:33:12.378937 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 5c41f29a4c194e1a80ea01c8a18be89f Aug 04 16:33:12.378937 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1771418743-project Aug 04 16:33:12.378937 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:33:12.378937 n-d-846466-12 devstack@n-api.service[126125]: {"add_host": {"host": "n-h2-846466-12"}} Aug 04 16:33:12.378937 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:33:12.378937 n-d-846466-12 devstack@n-api.service[126125]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 04 16:33:12.379861 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '10', 'body': {'add_host': {'host': 'n-h2-846466-12'}}} Aug 04 16:33:12.379861 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:12.379861 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:12.379861 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:12.379861 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:12.379861 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:12.379861 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:12.379861 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:12.379861 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:12.379861 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:33:12.379861 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:33:12.379861 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 04 16:33:12.379861 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 04 16:33:12.379861 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:33:12.379861 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:33:12.379861 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:33:12.379861 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:33:12.379861 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:33:12.379861 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:33:12.381262 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:33:12.381262 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:33:12.381262 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:33:12.381262 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:33:12.381262 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:33:12.381262 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:33:12.381262 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:33:12.381262 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:33:12.381262 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 04 16:33:12.381262 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:12.381262 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:12.381262 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:12.381262 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:12.381262 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:12.381262 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:12.381262 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:33:12.381262 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:33:12.381262 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 04 16:33:12.381262 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:12.382771 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-05a93cf3-fba2-4152-9afa-28ad7baee144 tempest-AggregatesAdminNegativeTestJSON-1771418743 tempest-AggregatesAdminNegativeTestJSON-1771418743-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:12.382771 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-05a93cf3-fba2-4152-9afa-28ad7baee144 tempest-AggregatesAdminNegativeTestJSON-1771418743 tempest-AggregatesAdminNegativeTestJSON-1771418743-project] 10.222.0.23 "POST /compute/v2.1/os-aggregates/10/action" status: 403 len: 118 microversion: 2.1 time: 0.825359 Aug 04 16:33:12.401059 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 117/244] 10.222.0.23 () {60 vars in 1194 bytes} [Thu Aug 4 16:33:11 2022] POST /compute/v2.1/os-aggregates/10/action => generated 118 bytes in 840 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:33:12.407135 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7f1d138c-a574-42d5-8679-cd61b9057078 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:12.407950 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:12.407950 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:12.425363 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7f1d138c-a574-42d5-8679-cd61b9057078 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 240 microversion: 2.1 time: 0.022003 Aug 04 16:33:12.425955 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 118/245] 10.222.0.23 () {58 vars in 1149 bytes} [Thu Aug 4 16:33:12 2022] GET /compute/v2.1/os-aggregates/9 => generated 240 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:12.446220 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-872005df-4ee9-4029-88bf-2ffbdd7dd0a8 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:12.460361 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-872005df-4ee9-4029-88bf-2ffbdd7dd0a8 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: f5548cac-028e-4bca-b862-d471688b9c50] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:12.477533 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-872005df-4ee9-4029-88bf-2ffbdd7dd0a8 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:12.478048 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-872005df-4ee9-4029-88bf-2ffbdd7dd0a8 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:12.478754 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-872005df-4ee9-4029-88bf-2ffbdd7dd0a8 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:12.479184 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-872005df-4ee9-4029-88bf-2ffbdd7dd0a8 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:12.656843 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-12705c64-02f9-48f1-bd9c-9c9487d1774d tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052613a51b86400c916dbc800563896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0ceaab59d4aeaa8667cef6f62559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:12.668558 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-12705c64-02f9-48f1-bd9c-9c9487d1774d tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8" status: 200 len: 1319 microversion: 2.1 time: 1.056366 Aug 04 16:33:12.678289 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 128/246] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:11 2022] GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8 => generated 1319 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:12.683720 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ec033b02-0cfc-4b41-a9e3-0d223a926cb0 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:12.684491 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:12.684491 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:12.740553 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ec033b02-0cfc-4b41-a9e3-0d223a926cb0 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.060373 Aug 04 16:33:12.741808 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 129/247] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Aug 4 16:33:12 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 16:33:12.751590 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3d0ebb85-5480-4244-b2ee-a57df7af843d tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:12.752760 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:12.752760 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:12.791772 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3d0ebb85-5480-4244-b2ee-a57df7af843d tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.048727 Aug 04 16:33:12.792986 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 130/248] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Aug 4 16:33:12 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 16:33:12.806396 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3614fba9-66e0-4919-b3ef-72b50db26fa2 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-555449961"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:12.809182 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:12.809182 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:12.810233 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.aggregate [None req-3614fba9-66e0-4919-b3ef-72b50db26fa2 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Generated uuid 9c9641b4-cf4b-4b9f-ab45-15b8283cb42a for aggregate {{(pid=126126) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:33:12.854476 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3614fba9-66e0-4919-b3ef-72b50db26fa2 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.060066 Aug 04 16:33:12.855097 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 131/249] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Aug 4 16:33:12 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:12.861925 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e740f3b2-3e08-4e4e-9dbb-7a87f06cac13 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1422986386", "availability_zone": "tempest-test_az-24842473"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:12.867692 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:12.867692 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:12.869981 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.aggregate [None req-e740f3b2-3e08-4e4e-9dbb-7a87f06cac13 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Generated uuid 4a694190-a51b-424a-9deb-6cd6b0b9768f for aggregate {{(pid=126126) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:33:12.949486 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e740f3b2-3e08-4e4e-9dbb-7a87f06cac13 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.092462 Aug 04 16:33:12.959734 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 132/250] 10.222.0.23 () {60 vars in 1165 bytes} [Thu Aug 4 16:33:12 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:12.966020 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6952e8bb-aac5-4b64-bb07-790f4fd12b4a tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-669383599"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:12.971679 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:12.971679 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:12.981988 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6952e8bb-aac5-4b64-bb07-790f4fd12b4a tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:12.982530 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6952e8bb-aac5-4b64-bb07-790f4fd12b4a tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:12.996964 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6952e8bb-aac5-4b64-bb07-790f4fd12b4a tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:12.997549 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6952e8bb-aac5-4b64-bb07-790f4fd12b4a tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:13.010625 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-6952e8bb-aac5-4b64-bb07-790f4fd12b4a tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-669383599 could not be found. Aug 04 16:33:13.013205 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6952e8bb-aac5-4b64-bb07-790f4fd12b4a tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Request method failure captured: Aug 04 16:33:13.013205 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Aug 04 16:33:13.013205 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:33:13.013205 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:33:13.013205 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:33:13.013205 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 57 Aug 04 16:33:13.013205 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:33:13.013205 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:33:13.013205 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:33:13.013205 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:13.013205 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_SOp7dYsA8yrXNLWGfM4nirfsqKWORI6Ep5uZ6EG139ZdJI0EvxWFx70MIQGhLT-giIfYvf5VWhxo6aVlyfl8UtnmNr6UKrQEn2EggnQzG6F6ZBYKtNvBaLIT_gFNFdRziQDT6Zch4MUyzR83RFdu4yJ6RYK8xNxCkAOA-hwhiuorI Aug 04 16:33:13.013205 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:33:13.013205 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:33:13.013205 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:33:13.013205 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:33:13.013205 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:33:13.013205 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:33:13.013205 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: c4702c1958e4426182df0685c06f9b9c Aug 04 16:33:13.013205 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1729454419 Aug 04 16:33:13.013205 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader,admin Aug 04 16:33:13.013205 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader,admin Aug 04 16:33:13.014695 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4702c1958e4426182df0685c06f9b9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c4702c1958e4426182df0685c06f9b9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4702c1958e4426182df0685c06f9b9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c4702c1958e4426182df0685c06f9b9c"}]}] Aug 04 16:33:13.014695 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1729454419 Aug 04 16:33:13.014695 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: c4702c1958e4426182df0685c06f9b9c Aug 04 16:33:13.014695 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1729454419 Aug 04 16:33:13.014695 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin Aug 04 16:33:13.014695 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:33:13.014695 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:33:13.014695 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: e1bc9c2d161c4396966cc1539f6a801d Aug 04 16:33:13.014695 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin Aug 04 16:33:13.014695 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 16:33:13.014695 n-d-846466-12 devstack@n-api.service[126126]: {"add_host": {"host": "tempest-nonexist_host-669383599"}} Aug 04 16:33:13.014695 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:33:13.015502 n-d-846466-12 devstack@n-api.service[126126]: exception: Compute host tempest-nonexist_host-669383599 could not be found. Aug 04 16:33:13.015502 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '11', 'body': {'add_host': {'host': 'tempest-nonexist_host-669383599'}}} Aug 04 16:33:13.015502 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:13.015502 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:13.015502 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5949, in _get_service_in_cell_by_host Aug 04 16:33:13.015502 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 04 16:33:13.015502 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:33:13.015502 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:33:13.015502 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 04 16:33:13.015502 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 04 16:33:13.015502 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:33:13.015502 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:33:13.015502 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 04 16:33:13.015502 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 04 16:33:13.015502 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-669383599' is not mapped to any cell Aug 04 16:33:13.015502 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.015502 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:13.015502 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.015502 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:13.015502 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5955, in _get_service_in_cell_by_host Aug 04 16:33:13.016858 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 04 16:33:13.016858 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 04 16:33:13.016858 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 04 16:33:13.016858 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 04 16:33:13.016858 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.016858 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:13.016858 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.016858 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:13.016858 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 04 16:33:13.016858 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 04 16:33:13.016858 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 16:33:13.016858 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 16:33:13.016858 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:33:13.016858 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:33:13.016858 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:33:13.016858 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:33:13.016858 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 16:33:13.016858 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 16:33:13.016858 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6574, in add_host_to_aggregate Aug 04 16:33:13.016858 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 04 16:33:13.018571 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5957, in _get_service_in_cell_by_host Aug 04 16:33:13.018571 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 04 16:33:13.018571 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-669383599 could not be found. Aug 04 16:33:13.018571 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.018571 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:13.018571 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.018571 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:13.018571 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:13.018571 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:13.018571 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:13.018571 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:13.018571 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:13.018571 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:13.018571 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:33:13.018571 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:33:13.018571 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 04 16:33:13.018571 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:33:13.018571 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-669383599 could not be found. Aug 04 16:33:13.018571 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.018571 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:13.018571 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.020042 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:13.020042 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:13.020042 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:13.020042 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:33:13.020042 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:33:13.020042 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-669383599 could not be found. Aug 04 16:33:13.020042 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.020042 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6952e8bb-aac5-4b64-bb07-790f4fd12b4a tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-669383599 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:13.020042 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6952e8bb-aac5-4b64-bb07-790f4fd12b4a tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/11/action" status: 404 len: 110 microversion: 2.1 time: 0.054927 Aug 04 16:33:13.024584 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 133/251] 10.222.0.23 () {60 vars in 1194 bytes} [Thu Aug 4 16:33:12 2022] POST /compute/v2.1/os-aggregates/11/action => generated 110 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:33:13.032105 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-06694135-eab0-4fb3-b624-17cb05f0e252 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1422986386_new", "availability_zone": "tempest-test_az-24842473_new"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:13.038798 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:13.038798 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:13.089758 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-06694135-eab0-4fb3-b624-17cb05f0e252 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:13.090213 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-06694135-eab0-4fb3-b624-17cb05f0e252 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:13.154777 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-06694135-eab0-4fb3-b624-17cb05f0e252 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 333 microversion: 2.1 time: 0.128305 Aug 04 16:33:13.169734 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 134/252] 10.222.0.23 () {60 vars in 1173 bytes} [Thu Aug 4 16:33:13 2022] PUT /compute/v2.1/os-aggregates/12 => generated 333 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:13.179809 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bebf575d-2f3c-463b-b785-dc5b3e403d77 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:13.181676 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:13.181676 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:13.200632 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-872005df-4ee9-4029-88bf-2ffbdd7dd0a8 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:13.215658 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-872005df-4ee9-4029-88bf-2ffbdd7dd0a8 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50" status: 200 len: 1320 microversion: 2.1 time: 0.777409 Aug 04 16:33:13.241180 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 119/253] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:12 2022] GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50 => generated 1320 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:13.261797 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-77fb5fac-1a56-4f72-8124-8412db98ae9e tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:13.265252 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bebf575d-2f3c-463b-b785-dc5b3e403d77 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.091855 Aug 04 16:33:13.265503 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:13.265503 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:13.265703 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 135/254] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Aug 4 16:33:13 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 16:33:13.279087 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1a4a60f6-efa7-4754-a2bf-41b6606c35a5 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:13.285226 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1a4a60f6-efa7-4754-a2bf-41b6606c35a5 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Request method failure captured: Aug 04 16:33:13.285226 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 04 16:33:13.285226 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:33:13.285226 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:33:13.285226 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:33:13.285226 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 283 Aug 04 16:33:13.285226 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:33:13.285226 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:33:13.285226 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:33:13.285226 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:13.285226 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_SOp7dYsA8yrXNLWGfM4nirfsqKWORI6Ep5uZ6EG139ZdJI0EvxWFx70MIQGhLT-giIfYvf5VWhxo6aVlyfl8UtnmNr6UKrQEn2EggnQzG6F6ZBYKtNvBaLIT_gFNFdRziQDT6Zch4MUyzR83RFdu4yJ6RYK8xNxCkAOA-hwhiuorI Aug 04 16:33:13.285226 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:33:13.285226 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:33:13.285226 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:33:13.285226 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:33:13.285226 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:33:13.285226 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:33:13.285226 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: c4702c1958e4426182df0685c06f9b9c Aug 04 16:33:13.285226 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1729454419 Aug 04 16:33:13.285226 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader,admin Aug 04 16:33:13.285226 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader,admin Aug 04 16:33:13.286707 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4702c1958e4426182df0685c06f9b9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c4702c1958e4426182df0685c06f9b9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4702c1958e4426182df0685c06f9b9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c4702c1958e4426182df0685c06f9b9c"}]}] Aug 04 16:33:13.286707 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1729454419 Aug 04 16:33:13.286707 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: c4702c1958e4426182df0685c06f9b9c Aug 04 16:33:13.286707 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1729454419 Aug 04 16:33:13.286707 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin Aug 04 16:33:13.286707 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:33:13.286707 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:33:13.286707 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: e1bc9c2d161c4396966cc1539f6a801d Aug 04 16:33:13.286707 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin Aug 04 16:33:13.286707 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 16:33:13.287330 n-d-846466-12 devstack@n-api.service[126126]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 04 16:33:13.287330 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:33:13.287330 n-d-846466-12 devstack@n-api.service[126126]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 16:33:13.287330 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 04 16:33:13.287330 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:13.287330 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:13.287330 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:33:13.287330 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:33:13.287330 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:33:13.287330 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:33:13.287992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 16:33:13.287992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.287992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 04 16:33:13.287992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 16:33:13.287992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.287992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 04 16:33:13.287992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 04 16:33:13.287992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.287992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:13.287992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.287992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:13.287992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:13.287992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:13.287992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:13.287992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:13.287992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:13.287992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:13.288929 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:33:13.288929 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:33:13.288929 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 16:33:13.288929 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 16:33:13.288929 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:33:13.288929 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:33:13.288929 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:33:13.288929 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:33:13.288929 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 16:33:13.288929 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.288929 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:13.288929 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.288929 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:13.288929 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:13.288929 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:13.292421 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:33:13.292421 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:33:13.292421 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 16:33:13.292421 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.292421 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1a4a60f6-efa7-4754-a2bf-41b6606c35a5 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:13.292757 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1a4a60f6-efa7-4754-a2bf-41b6606c35a5 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.013696 Aug 04 16:33:13.292757 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 136/255] 10.222.0.23 () {60 vars in 1165 bytes} [Thu Aug 4 16:33:13 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:33:13.295173 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-77fb5fac-1a56-4f72-8124-8412db98ae9e tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 336 microversion: 2.1 time: 0.050386 Aug 04 16:33:13.295753 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 120/256] 10.222.0.23 () {58 vars in 1143 bytes} [Thu Aug 4 16:33:13 2022] GET /compute/v2.1/os-aggregates => generated 336 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:13.307660 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9ad1762b-a62d-432f-bb00-82ad605f4af5 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:13.308815 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:13.308815 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:13.310005 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2748dc97-cfcd-4e66-af55-e603a0b1a6f0 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:13.314160 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2748dc97-cfcd-4e66-af55-e603a0b1a6f0 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Request method failure captured: Aug 04 16:33:13.314160 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 04 16:33:13.314160 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:33:13.314160 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:33:13.314160 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:33:13.314160 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 27 Aug 04 16:33:13.314160 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:33:13.314160 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:33:13.314160 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:33:13.314160 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:13.314160 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_SOp7dYsA8yrXNLWGfM4nirfsqKWORI6Ep5uZ6EG139ZdJI0EvxWFx70MIQGhLT-giIfYvf5VWhxo6aVlyfl8UtnmNr6UKrQEn2EggnQzG6F6ZBYKtNvBaLIT_gFNFdRziQDT6Zch4MUyzR83RFdu4yJ6RYK8xNxCkAOA-hwhiuorI Aug 04 16:33:13.314160 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:33:13.314160 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:33:13.314160 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:33:13.314160 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:33:13.314160 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:33:13.314160 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:33:13.314160 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: c4702c1958e4426182df0685c06f9b9c Aug 04 16:33:13.314160 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1729454419 Aug 04 16:33:13.314160 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader,admin Aug 04 16:33:13.314160 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader,admin Aug 04 16:33:13.315674 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4702c1958e4426182df0685c06f9b9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c4702c1958e4426182df0685c06f9b9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4702c1958e4426182df0685c06f9b9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c4702c1958e4426182df0685c06f9b9c"}]}] Aug 04 16:33:13.315674 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1729454419 Aug 04 16:33:13.315674 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: c4702c1958e4426182df0685c06f9b9c Aug 04 16:33:13.315674 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1729454419 Aug 04 16:33:13.315674 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin Aug 04 16:33:13.315674 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:33:13.315674 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:33:13.315674 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: e1bc9c2d161c4396966cc1539f6a801d Aug 04 16:33:13.315674 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin Aug 04 16:33:13.315674 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 16:33:13.315674 n-d-846466-12 devstack@n-api.service[126126]: {"aggregate": {"name": ""}} Aug 04 16:33:13.315674 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:33:13.315674 n-d-846466-12 devstack@n-api.service[126126]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 04 16:33:13.316594 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 04 16:33:13.316594 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:13.316594 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:13.316594 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:33:13.316594 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:33:13.316594 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:33:13.316594 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:33:13.316594 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 04 16:33:13.316594 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.316594 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 04 16:33:13.316594 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 16:33:13.316594 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.316594 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 04 16:33:13.316594 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi '' Aug 04 16:33:13.316594 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.316594 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:13.316594 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.316594 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:13.316594 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:13.316594 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:13.316594 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:13.316594 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:13.316594 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:13.318185 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:13.318185 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:33:13.318185 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:33:13.318185 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 16:33:13.318185 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 16:33:13.318185 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:33:13.318185 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:33:13.318185 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:33:13.318185 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:33:13.318185 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 04 16:33:13.318185 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.318185 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:13.318185 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.318185 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:13.318185 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:13.318185 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:13.318185 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:33:13.318185 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:33:13.318185 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 04 16:33:13.318185 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.322035 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2748dc97-cfcd-4e66-af55-e603a0b1a6f0 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:13.322035 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2748dc97-cfcd-4e66-af55-e603a0b1a6f0 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.011976 Aug 04 16:33:13.322211 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 137/257] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Aug 4 16:33:13 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:33:13.330331 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fe3f0ddf-f838-4c7e-8286-e8e5e390c066 tempest-AggregatesAdminNegativeTestJSON-1771418743 tempest-AggregatesAdminNegativeTestJSON-1771418743-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2033564404"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:13.333048 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:13.333048 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:13.334077 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fe3f0ddf-f838-4c7e-8286-e8e5e390c066 tempest-AggregatesAdminNegativeTestJSON-1771418743 tempest-AggregatesAdminNegativeTestJSON-1771418743-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '5c41f29a4c194e1a80ea01c8a18be89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889e94129fd4233b0016a0c15f67cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:13.338305 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fe3f0ddf-f838-4c7e-8286-e8e5e390c066 tempest-AggregatesAdminNegativeTestJSON-1771418743 tempest-AggregatesAdminNegativeTestJSON-1771418743-project] Request method failure captured: Aug 04 16:33:13.338305 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 04 16:33:13.338305 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:33:13.338305 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:33:13.338305 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:33:13.338305 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 60 Aug 04 16:33:13.338305 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:33:13.338305 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:33:13.338305 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:33:13.338305 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:13.338305 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_SLHOP5R1Te60BFmtVhkSdA0PjcgEnnI3t3zYNfyll53XAWqxbL5JEAPcDgL4iBN7QKYMOyczkWcF2lRoc_7j2zbzT-JHLluvsek4cTuqhFDIAH_DUiH0TU21rarZ33EZCYr6p_5l8InnkYqoXXxbW_71HsXqkl-7Z0X4D63ziBqS0 Aug 04 16:33:13.338305 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:33:13.338305 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:33:13.338305 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:33:13.338305 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:33:13.338305 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:33:13.338305 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:33:13.338305 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: c889e94129fd4233b0016a0c15f67cb5 Aug 04 16:33:13.338305 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1771418743 Aug 04 16:33:13.338305 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:33:13.338305 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:33:13.340305 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c889e94129fd4233b0016a0c15f67cb5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c889e94129fd4233b0016a0c15f67cb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c889e94129fd4233b0016a0c15f67cb5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c889e94129fd4233b0016a0c15f67cb5"}]}] Aug 04 16:33:13.340305 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1771418743 Aug 04 16:33:13.340305 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: c889e94129fd4233b0016a0c15f67cb5 Aug 04 16:33:13.340305 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1771418743 Aug 04 16:33:13.340305 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-AggregatesAdminNegativeTestJSON-1771418743-project Aug 04 16:33:13.340305 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:33:13.340305 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:33:13.340305 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 5c41f29a4c194e1a80ea01c8a18be89f Aug 04 16:33:13.340305 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1771418743-project Aug 04 16:33:13.340305 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 16:33:13.340305 n-d-846466-12 devstack@n-api.service[126126]: {"aggregate": {"name": "tempest-test_aggregate-2033564404"}} Aug 04 16:33:13.340305 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:33:13.340305 n-d-846466-12 devstack@n-api.service[126126]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 04 16:33:13.341135 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-2033564404'}}} Aug 04 16:33:13.341135 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:13.341135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:13.341135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:13.341135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:13.341135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:13.341135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:13.341135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:13.341135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:13.341135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:33:13.341135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:33:13.341135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:33:13.341135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:33:13.341135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 04 16:33:13.341135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 04 16:33:13.341135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:33:13.341135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:33:13.341135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:33:13.341135 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:33:13.342456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:33:13.342456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:33:13.342456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:33:13.342456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:33:13.342456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:33:13.342456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:33:13.342456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:33:13.342456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:33:13.342456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:33:13.342456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:33:13.342456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 04 16:33:13.342456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.342456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:13.342456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.342456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:13.342456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:13.342456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:13.342456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:33:13.342456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:33:13.342456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 04 16:33:13.343858 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.343858 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fe3f0ddf-f838-4c7e-8286-e8e5e390c066 tempest-AggregatesAdminNegativeTestJSON-1771418743 tempest-AggregatesAdminNegativeTestJSON-1771418743-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:13.343858 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fe3f0ddf-f838-4c7e-8286-e8e5e390c066 tempest-AggregatesAdminNegativeTestJSON-1771418743 tempest-AggregatesAdminNegativeTestJSON-1771418743-project] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.015431 Aug 04 16:33:13.365831 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 138/258] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Aug 4 16:33:13 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:33:13.378717 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9ad1762b-a62d-432f-bb00-82ad605f4af5 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.075011 Aug 04 16:33:13.384196 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 121/259] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Aug 4 16:33:13 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 04 16:33:13.393213 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1df26a82-518f-437d-8bb2-3c0a8beda865 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-348067137"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:13.398211 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4e1d47a7-4cbd-4885-a09a-3dffd15c738f tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-783900705"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:13.402458 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:13.402458 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:13.403798 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.aggregate [None req-1df26a82-518f-437d-8bb2-3c0a8beda865 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Generated uuid e0c7808e-5db6-4f9b-ad3b-3f4d7deafca5 for aggregate {{(pid=126125) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:33:13.406812 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.aggregate [None req-4e1d47a7-4cbd-4885-a09a-3dffd15c738f tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Generated uuid 3fe08f79-0c28-457a-a7dd-a683d2087eff for aggregate {{(pid=126126) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:33:13.450042 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4e1d47a7-4cbd-4885-a09a-3dffd15c738f tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.082825 Aug 04 16:33:13.463375 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1df26a82-518f-437d-8bb2-3c0a8beda865 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.077691 Aug 04 16:33:13.464528 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 122/260] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Aug 4 16:33:13 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:13.479566 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-896b8969-5400-4d0a-af5e-e8146e34d7a5 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-783900705"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:13.482996 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 139/261] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Aug 4 16:33:13 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:13.485722 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:13.485722 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:13.488692 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.aggregate [None req-896b8969-5400-4d0a-af5e-e8146e34d7a5 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Generated uuid a34e1278-3bd9-4460-9bac-2bf38c51e1ff for aggregate {{(pid=126125) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:33:13.508843 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5dbe2167-e76f-4f83-acc8-5f5ff704fb2c tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:13.510275 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:13.510275 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:13.526622 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-896b8969-5400-4d0a-af5e-e8146e34d7a5 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-783900705 already exists. Aug 04 16:33:13.528415 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-896b8969-5400-4d0a-af5e-e8146e34d7a5 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Request method failure captured: Aug 04 16:33:13.528415 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 04 16:33:13.528415 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:33:13.528415 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:33:13.528415 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:33:13.528415 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 59 Aug 04 16:33:13.528415 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:33:13.528415 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:33:13.528415 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:33:13.528415 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:13.528415 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_SOp7dYsA8yrXNLWGfM4nirfsqKWORI6Ep5uZ6EG139ZdJI0EvxWFx70MIQGhLT-giIfYvf5VWhxo6aVlyfl8UtnmNr6UKrQEn2EggnQzG6F6ZBYKtNvBaLIT_gFNFdRziQDT6Zch4MUyzR83RFdu4yJ6RYK8xNxCkAOA-hwhiuorI Aug 04 16:33:13.528415 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:33:13.528415 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:33:13.528415 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:33:13.528415 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:33:13.528415 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:33:13.528415 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:33:13.528415 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: c4702c1958e4426182df0685c06f9b9c Aug 04 16:33:13.528415 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1729454419 Aug 04 16:33:13.528415 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader,admin Aug 04 16:33:13.528415 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader,admin Aug 04 16:33:13.529915 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4702c1958e4426182df0685c06f9b9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c4702c1958e4426182df0685c06f9b9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4702c1958e4426182df0685c06f9b9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c4702c1958e4426182df0685c06f9b9c"}]}] Aug 04 16:33:13.529915 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1729454419 Aug 04 16:33:13.529915 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: c4702c1958e4426182df0685c06f9b9c Aug 04 16:33:13.529915 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1729454419 Aug 04 16:33:13.529915 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin Aug 04 16:33:13.529915 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:33:13.529915 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:33:13.529915 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: e1bc9c2d161c4396966cc1539f6a801d Aug 04 16:33:13.529915 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin Aug 04 16:33:13.529915 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:33:13.529915 n-d-846466-12 devstack@n-api.service[126125]: {"aggregate": {"name": "tempest-test_aggregate-783900705"}} Aug 04 16:33:13.529915 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:33:13.529915 n-d-846466-12 devstack@n-api.service[126125]: exception: Aggregate tempest-test_aggregate-783900705 already exists. Aug 04 16:33:13.530803 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-783900705'}}} Aug 04 16:33:13.530803 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:13.530803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:13.530803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 04 16:33:13.530803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 04 16:33:13.530803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 16:33:13.530803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 16:33:13.530803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:33:13.530803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:33:13.530803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:33:13.530803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:33:13.530803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 16:33:13.530803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 16:33:13.530803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6411, in create_aggregate Aug 04 16:33:13.530803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 04 16:33:13.530803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 04 16:33:13.530803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 04 16:33:13.530803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 04 16:33:13.530803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 04 16:33:13.532066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:33:13.532066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:33:13.532066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 04 16:33:13.532066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 04 16:33:13.532066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-783900705 already exists. Aug 04 16:33:13.532066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.532066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:13.532066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.532066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:13.532066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:13.532066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:13.532066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:13.532066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:13.532066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:13.532066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:13.532066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:33:13.532066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:33:13.532066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:33:13.532066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:33:13.532066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 04 16:33:13.533395 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 04 16:33:13.533395 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-783900705 already exists. Aug 04 16:33:13.533395 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.533395 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:13.533395 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.533395 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:13.533395 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:13.533395 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:13.533395 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:33:13.533395 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:33:13.533395 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-783900705 already exists. Aug 04 16:33:13.533395 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.533395 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-896b8969-5400-4d0a-af5e-e8146e34d7a5 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-783900705 already exists. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:13.533395 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-896b8969-5400-4d0a-af5e-e8146e34d7a5 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.064116 Aug 04 16:33:13.534222 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 123/262] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Aug 4 16:33:13 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 65 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:33:13.543439 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-717c3a37-ee80-4f42-a42e-c5be119f3ad7 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:13.544135 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:13.544135 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:13.554533 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5dbe2167-e76f-4f83-acc8-5f5ff704fb2c tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 444 microversion: 2.1 time: 0.070124 Aug 04 16:33:13.563083 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 140/263] 10.222.0.23 () {58 vars in 1143 bytes} [Thu Aug 4 16:33:13 2022] GET /compute/v2.1/os-aggregates => generated 444 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:13.582868 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ef3699e3-54e0-4461-aa55-59738f54ac25 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:13.583808 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:13.583808 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:13.592602 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-717c3a37-ee80-4f42-a42e-c5be119f3ad7 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.053054 Aug 04 16:33:13.593684 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 124/264] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Aug 4 16:33:13 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 04 16:33:13.603732 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e376f1b4-3290-4ba2-b4e9-349c59a64865 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1727366967"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:13.606596 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:13.606596 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:13.607559 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.aggregate [None req-e376f1b4-3290-4ba2-b4e9-349c59a64865 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Generated uuid 968b2272-6b2b-4f65-8dc9-ec771e183d79 for aggregate {{(pid=126125) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:33:13.643067 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ef3699e3-54e0-4461-aa55-59738f54ac25 tempest-AggregatesAdminTestJSON-1390392660 tempest-AggregatesAdminTestJSON-1390392660-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.070596 Aug 04 16:33:13.648551 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 141/265] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Aug 4 16:33:13 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 16:33:13.658008 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0c7c95e6-b67c-4b81-97d7-36166d84d467 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:13.658795 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0c7c95e6-b67c-4b81-97d7-36166d84d467 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] [instance: 5961044f-b35a-4051-b041-84548b5965d5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:13.667292 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=12,nova_api:INSERT=8,nova_api:UPDATE=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:33:13.674328 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e376f1b4-3290-4ba2-b4e9-349c59a64865 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.069947 Aug 04 16:33:13.678392 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 125/266] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Aug 4 16:33:13 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:33:13.690821 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c7c95e6-b67c-4b81-97d7-36166d84d467 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:13.691193 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c7c95e6-b67c-4b81-97d7-36166d84d467 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:13.691991 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c7c95e6-b67c-4b81-97d7-36166d84d467 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:13.692426 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c7c95e6-b67c-4b81-97d7-36166d84d467 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:13.698060 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d6214c35-b413-4ba5-b87f-dc892e90b18f tempest-AggregatesAdminNegativeTestJSON-1771418743 tempest-AggregatesAdminNegativeTestJSON-1771418743-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:13.698984 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:13.698984 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:13.699926 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d6214c35-b413-4ba5-b87f-dc892e90b18f tempest-AggregatesAdminNegativeTestJSON-1771418743 tempest-AggregatesAdminNegativeTestJSON-1771418743-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '5c41f29a4c194e1a80ea01c8a18be89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889e94129fd4233b0016a0c15f67cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:13.701571 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d6214c35-b413-4ba5-b87f-dc892e90b18f tempest-AggregatesAdminNegativeTestJSON-1771418743 tempest-AggregatesAdminNegativeTestJSON-1771418743-project] Request method failure captured: Aug 04 16:33:13.701571 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Aug 04 16:33:13.701571 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:33:13.701571 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:33:13.701571 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:33:13.701571 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:33:13.701571 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:33:13.701571 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:33:13.701571 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:33:13.701571 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:13.701571 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_SLHOP5R1Te60BFmtVhkSdA0PjcgEnnI3t3zYNfyll53XAWqxbL5JEAPcDgL4iBN7QKYMOyczkWcF2lRoc_7j2zbzT-JHLluvsek4cTuqhFDIAH_DUiH0TU21rarZ33EZCYr6p_5l8InnkYqoXXxbW_71HsXqkl-7Z0X4D63ziBqS0 Aug 04 16:33:13.701571 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:33:13.701571 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:33:13.701571 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:33:13.701571 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:33:13.701571 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:33:13.701571 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:33:13.701571 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: c889e94129fd4233b0016a0c15f67cb5 Aug 04 16:33:13.701571 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1771418743 Aug 04 16:33:13.701571 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:33:13.701571 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:33:13.702840 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c889e94129fd4233b0016a0c15f67cb5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c889e94129fd4233b0016a0c15f67cb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c889e94129fd4233b0016a0c15f67cb5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c889e94129fd4233b0016a0c15f67cb5"}]}] Aug 04 16:33:13.702840 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1771418743 Aug 04 16:33:13.702840 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: c889e94129fd4233b0016a0c15f67cb5 Aug 04 16:33:13.702840 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1771418743 Aug 04 16:33:13.702840 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-AggregatesAdminNegativeTestJSON-1771418743-project Aug 04 16:33:13.702840 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:33:13.702840 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:33:13.702840 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 5c41f29a4c194e1a80ea01c8a18be89f Aug 04 16:33:13.702840 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1771418743-project Aug 04 16:33:13.702840 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:33:13.702840 n-d-846466-12 devstack@n-api.service[126125]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 04 16:33:13.702840 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '15'} Aug 04 16:33:13.703523 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:13.703523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:13.703523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:13.703523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:13.703523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:13.703523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:13.703523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:13.703523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:13.703523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 04 16:33:13.703523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 04 16:33:13.703523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:33:13.703523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:33:13.703523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:33:13.703523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:33:13.703523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:33:13.703523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:33:13.703523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:33:13.703523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:33:13.703523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:33:13.709325 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:33:13.709325 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:33:13.709325 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:33:13.709325 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:33:13.709325 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:33:13.709325 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 04 16:33:13.709325 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.709325 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:13.709325 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.709325 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:13.709325 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:13.709325 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:13.709325 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:33:13.709325 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:33:13.709325 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 04 16:33:13.709325 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.709325 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d6214c35-b413-4ba5-b87f-dc892e90b18f tempest-AggregatesAdminNegativeTestJSON-1771418743 tempest-AggregatesAdminNegativeTestJSON-1771418743-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:13.710386 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d6214c35-b413-4ba5-b87f-dc892e90b18f tempest-AggregatesAdminNegativeTestJSON-1771418743 tempest-AggregatesAdminNegativeTestJSON-1771418743-project] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.017329 Aug 04 16:33:13.710386 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 126/267] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Aug 4 16:33:13 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:33:13.727475 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9079e109-d95b-440b-9b50-354737770045 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:13.730472 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9079e109-d95b-440b-9b50-354737770045 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: 1ae03eb0-d144-4135-87eb-d8816b9988e8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:13.743548 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-0c7c95e6-b67c-4b81-97d7-36166d84d467 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] HTTP exception thrown: Instance 5961044f-b35a-4051-b041-84548b5965d5 could not be found. Aug 04 16:33:13.747415 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0c7c95e6-b67c-4b81-97d7-36166d84d467 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Request method failure captured: Aug 04 16:33:13.747415 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5 HTTP/1.1 Aug 04 16:33:13.747415 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:33:13.747415 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:33:13.747415 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:33:13.747415 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:33:13.747415 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:33:13.747415 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:33:13.747415 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:33:13.747415 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:13.747415 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_SK2EqOJBZ69IN6Fx6p539COPvucPbDUlR5kqCaH_Hgu3xY0djlYdCtxIYEq_f-tvO9GbHmEHLZHobrWmJ3A8XkbXUgiRA8Qm5myhb7Vhwrj3cq_YqqyjnVXNimgSzTAMb0bGEDj1tJZHEib4aWn8K4LnEFKVgolQqt3Mz4tOSXnQI Aug 04 16:33:13.747415 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:33:13.747415 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:33:13.747415 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:33:13.747415 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:33:13.747415 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:33:13.747415 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:33:13.747415 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 0ce23f198a99464ab95a3e5f98dde567 Aug 04 16:33:13.747415 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-AggregatesAdminTestJSON-687745325 Aug 04 16:33:13.747415 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:33:13.747415 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:33:13.749078 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ce23f198a99464ab95a3e5f98dde567"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0ce23f198a99464ab95a3e5f98dde567"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ce23f198a99464ab95a3e5f98dde567"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0ce23f198a99464ab95a3e5f98dde567"}]}] Aug 04 16:33:13.749078 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-AggregatesAdminTestJSON-687745325 Aug 04 16:33:13.749078 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 0ce23f198a99464ab95a3e5f98dde567 Aug 04 16:33:13.749078 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-687745325 Aug 04 16:33:13.749078 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-AggregatesAdminTestJSON-687745325-project Aug 04 16:33:13.749078 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:33:13.749078 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:33:13.749078 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 9134e4e91c6a4139a4dd8d2865a6cb51 Aug 04 16:33:13.749078 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-AggregatesAdminTestJSON-687745325-project Aug 04 16:33:13.749078 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:33:13.749078 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 5961044f-b35a-4051-b041-84548b5965d5 could not be found. Aug 04 16:33:13.749078 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '5961044f-b35a-4051-b041-84548b5965d5'} Aug 04 16:33:13.749986 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:13.749986 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:13.749986 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:33:13.749986 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:33:13.749986 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:33:13.749986 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:33:13.749986 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:33:13.749986 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:33:13.749986 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:33:13.749986 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:33:13.749986 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5961044f-b35a-4051-b041-84548b5965d5 could not be found. Aug 04 16:33:13.749986 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.749986 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:13.749986 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.749986 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:13.749986 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:13.749986 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:13.749986 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:13.749986 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:13.749986 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:13.751287 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:13.751287 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:33:13.751287 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:33:13.751287 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:33:13.751287 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:33:13.751287 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:33:13.751287 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:33:13.751287 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:33:13.751287 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:33:13.751287 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5961044f-b35a-4051-b041-84548b5965d5 could not be found. Aug 04 16:33:13.751287 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.751287 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:13.751287 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.751287 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:13.751287 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:13.751287 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:13.751287 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:33:13.751287 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:33:13.751287 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5961044f-b35a-4051-b041-84548b5965d5 could not be found. Aug 04 16:33:13.751287 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.754872 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9079e109-d95b-440b-9b50-354737770045 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:13.756026 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0c7c95e6-b67c-4b81-97d7-36166d84d467 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Returning 404 to user: Instance 5961044f-b35a-4051-b041-84548b5965d5 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:13.757500 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0c7c95e6-b67c-4b81-97d7-36166d84d467 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5" status: 404 len: 111 microversion: 2.1 time: 0.107036 Aug 04 16:33:13.757838 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9079e109-d95b-440b-9b50-354737770045 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:13.759117 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9079e109-d95b-440b-9b50-354737770045 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:13.761672 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 142/268] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:33:13 2022] DELETE /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:33:13.763396 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9079e109-d95b-440b-9b50-354737770045 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:13.770019 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4d4107f1-cd4c-4627-bcf9-9243d64e7c99 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:13.770814 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:13.770814 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:13.813404 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4d4107f1-cd4c-4627-bcf9-9243d64e7c99 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.049946 Aug 04 16:33:13.814130 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 143/269] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Aug 4 16:33:13 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 16:33:13.826868 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5417472c-a2e9-4870-bcd4-ae64beebd378 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:13.827532 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5417472c-a2e9-4870-bcd4-ae64beebd378 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] [instance: 5961044f-b35a-4051-b041-84548b5965d5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:13.843271 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5417472c-a2e9-4870-bcd4-ae64beebd378 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:13.843748 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5417472c-a2e9-4870-bcd4-ae64beebd378 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:13.844543 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5417472c-a2e9-4870-bcd4-ae64beebd378 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:13.846523 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5417472c-a2e9-4870-bcd4-ae64beebd378 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:13.869200 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-5417472c-a2e9-4870-bcd4-ae64beebd378 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] HTTP exception thrown: Instance 5961044f-b35a-4051-b041-84548b5965d5 could not be found. Aug 04 16:33:13.873048 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5417472c-a2e9-4870-bcd4-ae64beebd378 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Request method failure captured: Aug 04 16:33:13.873048 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5 HTTP/1.1 Aug 04 16:33:13.873048 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:33:13.873048 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:33:13.873048 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:33:13.873048 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:33:13.873048 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:33:13.873048 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:33:13.873048 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:33:13.873048 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:13.873048 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_SK2EqOJBZ69IN6Fx6p539COPvucPbDUlR5kqCaH_Hgu3xY0djlYdCtxIYEq_f-tvO9GbHmEHLZHobrWmJ3A8XkbXUgiRA8Qm5myhb7Vhwrj3cq_YqqyjnVXNimgSzTAMb0bGEDj1tJZHEib4aWn8K4LnEFKVgolQqt3Mz4tOSXnQI Aug 04 16:33:13.873048 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:33:13.873048 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:33:13.873048 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:33:13.873048 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:33:13.873048 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:33:13.873048 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:33:13.873048 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 0ce23f198a99464ab95a3e5f98dde567 Aug 04 16:33:13.873048 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-AggregatesAdminTestJSON-687745325 Aug 04 16:33:13.873048 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:33:13.873048 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:33:13.874707 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ce23f198a99464ab95a3e5f98dde567"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0ce23f198a99464ab95a3e5f98dde567"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ce23f198a99464ab95a3e5f98dde567"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0ce23f198a99464ab95a3e5f98dde567"}]}] Aug 04 16:33:13.874707 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-AggregatesAdminTestJSON-687745325 Aug 04 16:33:13.874707 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 0ce23f198a99464ab95a3e5f98dde567 Aug 04 16:33:13.874707 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-687745325 Aug 04 16:33:13.874707 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-AggregatesAdminTestJSON-687745325-project Aug 04 16:33:13.874707 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:33:13.874707 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:33:13.874707 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 9134e4e91c6a4139a4dd8d2865a6cb51 Aug 04 16:33:13.874707 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-AggregatesAdminTestJSON-687745325-project Aug 04 16:33:13.874707 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:33:13.874707 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 5961044f-b35a-4051-b041-84548b5965d5 could not be found. Aug 04 16:33:13.874707 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '5961044f-b35a-4051-b041-84548b5965d5'} Aug 04 16:33:13.875500 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:13.875500 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:13.875500 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:33:13.875500 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:33:13.875500 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:33:13.875500 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:33:13.875500 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:33:13.875500 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:33:13.875500 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:33:13.875500 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:33:13.875500 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5961044f-b35a-4051-b041-84548b5965d5 could not be found. Aug 04 16:33:13.875500 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.875500 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:13.875500 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.875500 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:13.875500 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:13.875500 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:13.875500 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:13.875500 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:13.875500 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:13.876917 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:13.876917 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:33:13.876917 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:33:13.876917 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:33:13.876917 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:33:13.876917 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:33:13.876917 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:33:13.876917 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5961044f-b35a-4051-b041-84548b5965d5 could not be found. Aug 04 16:33:13.876917 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.876917 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:13.876917 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.876917 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:13.876917 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:13.876917 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:13.876917 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:33:13.876917 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:33:13.876917 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5961044f-b35a-4051-b041-84548b5965d5 could not be found. Aug 04 16:33:13.876917 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.878190 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5417472c-a2e9-4870-bcd4-ae64beebd378 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] Returning 404 to user: Instance 5961044f-b35a-4051-b041-84548b5965d5 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:13.878190 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5417472c-a2e9-4870-bcd4-ae64beebd378 tempest-AggregatesAdminTestJSON-687745325 tempest-AggregatesAdminTestJSON-687745325-project] 10.222.0.23 "GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5" status: 404 len: 111 microversion: 2.1 time: 0.053170 Aug 04 16:33:13.879190 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 144/270] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:13 2022] GET /compute/v2.1/servers/5961044f-b35a-4051-b041-84548b5965d5 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:33:13.895255 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e9c3c204-d040-4cb7-a168-1343d61985c0 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:13.896332 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:13.896332 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:13.913230 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-e9c3c204-d040-4cb7-a168-1343d61985c0 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 04 16:33:13.915692 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e9c3c204-d040-4cb7-a168-1343d61985c0 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Request method failure captured: Aug 04 16:33:13.915692 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 04 16:33:13.915692 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:33:13.915692 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:33:13.915692 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:33:13.915692 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:33:13.915692 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:33:13.915692 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:33:13.915692 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:33:13.915692 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:13.915692 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_SOp7dYsA8yrXNLWGfM4nirfsqKWORI6Ep5uZ6EG139ZdJI0EvxWFx70MIQGhLT-giIfYvf5VWhxo6aVlyfl8UtnmNr6UKrQEn2EggnQzG6F6ZBYKtNvBaLIT_gFNFdRziQDT6Zch4MUyzR83RFdu4yJ6RYK8xNxCkAOA-hwhiuorI Aug 04 16:33:13.915692 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:33:13.915692 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:33:13.915692 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:33:13.915692 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:33:13.915692 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:33:13.915692 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:33:13.915692 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: c4702c1958e4426182df0685c06f9b9c Aug 04 16:33:13.915692 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1729454419 Aug 04 16:33:13.915692 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader,admin Aug 04 16:33:13.915692 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader,admin Aug 04 16:33:13.917042 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4702c1958e4426182df0685c06f9b9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c4702c1958e4426182df0685c06f9b9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4702c1958e4426182df0685c06f9b9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c4702c1958e4426182df0685c06f9b9c"}]}] Aug 04 16:33:13.917042 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1729454419 Aug 04 16:33:13.917042 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: c4702c1958e4426182df0685c06f9b9c Aug 04 16:33:13.917042 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1729454419 Aug 04 16:33:13.917042 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin Aug 04 16:33:13.917042 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:33:13.917042 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:33:13.917042 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: e1bc9c2d161c4396966cc1539f6a801d Aug 04 16:33:13.917042 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin Aug 04 16:33:13.917042 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:33:13.917042 n-d-846466-12 devstack@n-api.service[126126]: exception: Aggregate -1 could not be found. Aug 04 16:33:13.917042 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '-1'} Aug 04 16:33:13.917894 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:13.917894 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:13.917894 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 04 16:33:13.917894 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 04 16:33:13.917894 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 16:33:13.917894 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 16:33:13.917894 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:33:13.917894 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:33:13.917894 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:33:13.917894 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:33:13.917894 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 16:33:13.917894 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 16:33:13.917894 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Aug 04 16:33:13.917894 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 04 16:33:13.917894 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:33:13.917894 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:33:13.917894 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 04 16:33:13.917894 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 04 16:33:13.917894 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:33:13.919235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:33:13.919235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 04 16:33:13.919235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 04 16:33:13.919235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 04 16:33:13.919235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.919235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:13.919235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.919235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:13.919235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:13.919235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:13.919235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:13.919235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:13.919235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:13.919235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:13.919235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 04 16:33:13.919235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:33:13.919235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 04 16:33:13.919235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.919235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:13.919235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.919235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:13.920529 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:13.920529 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:13.920529 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:33:13.920529 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:33:13.920529 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 04 16:33:13.920529 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:13.920529 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e9c3c204-d040-4cb7-a168-1343d61985c0 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:13.920529 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e9c3c204-d040-4cb7-a168-1343d61985c0 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.036932 Aug 04 16:33:13.922425 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 145/271] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Aug 4 16:33:13 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:33:13.928985 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fb273d8c-0f75-4873-b7ab-47806150a67b tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1436558514"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:13.931837 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:13.931837 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:13.933728 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.aggregate [None req-fb273d8c-0f75-4873-b7ab-47806150a67b tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Generated uuid 68234b4d-43ee-45ed-a87b-19cb2a0fdb5c for aggregate {{(pid=126126) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:33:13.992412 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fb273d8c-0f75-4873-b7ab-47806150a67b tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.060893 Aug 04 16:33:13.994720 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 146/272] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Aug 4 16:33:13 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:14.014809 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3bb8b29d-1806-42d7-8dbb-4d7258938a2e tempest-AggregatesAdminNegativeTestJSON-1771418743 tempest-AggregatesAdminNegativeTestJSON-1771418743-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:14.015967 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:14.015967 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:14.019523 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3bb8b29d-1806-42d7-8dbb-4d7258938a2e tempest-AggregatesAdminNegativeTestJSON-1771418743 tempest-AggregatesAdminNegativeTestJSON-1771418743-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '5c41f29a4c194e1a80ea01c8a18be89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889e94129fd4233b0016a0c15f67cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:14.032325 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3bb8b29d-1806-42d7-8dbb-4d7258938a2e tempest-AggregatesAdminNegativeTestJSON-1771418743 tempest-AggregatesAdminNegativeTestJSON-1771418743-project] Request method failure captured: Aug 04 16:33:14.032325 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Aug 04 16:33:14.032325 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:33:14.032325 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:33:14.032325 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:33:14.032325 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:33:14.032325 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:33:14.032325 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:33:14.032325 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:33:14.032325 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:14.032325 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_SLHOP5R1Te60BFmtVhkSdA0PjcgEnnI3t3zYNfyll53XAWqxbL5JEAPcDgL4iBN7QKYMOyczkWcF2lRoc_7j2zbzT-JHLluvsek4cTuqhFDIAH_DUiH0TU21rarZ33EZCYr6p_5l8InnkYqoXXxbW_71HsXqkl-7Z0X4D63ziBqS0 Aug 04 16:33:14.032325 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:33:14.032325 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:33:14.032325 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:33:14.032325 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:33:14.032325 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:33:14.032325 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:33:14.032325 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: c889e94129fd4233b0016a0c15f67cb5 Aug 04 16:33:14.032325 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1771418743 Aug 04 16:33:14.032325 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:33:14.032325 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:33:14.034111 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c889e94129fd4233b0016a0c15f67cb5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c889e94129fd4233b0016a0c15f67cb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c889e94129fd4233b0016a0c15f67cb5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c889e94129fd4233b0016a0c15f67cb5"}]}] Aug 04 16:33:14.034111 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1771418743 Aug 04 16:33:14.034111 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: c889e94129fd4233b0016a0c15f67cb5 Aug 04 16:33:14.034111 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1771418743 Aug 04 16:33:14.034111 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-AggregatesAdminNegativeTestJSON-1771418743-project Aug 04 16:33:14.034111 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:33:14.034111 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:33:14.034111 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 5c41f29a4c194e1a80ea01c8a18be89f Aug 04 16:33:14.034111 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1771418743-project Aug 04 16:33:14.034111 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:33:14.034111 n-d-846466-12 devstack@n-api.service[126126]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 04 16:33:14.034111 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '16'} Aug 04 16:33:14.034964 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:14.034964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:14.034964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:14.034964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:14.034964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:14.034964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:14.034964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:14.034964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:14.034964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 04 16:33:14.034964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 04 16:33:14.034964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:33:14.034964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:33:14.034964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:33:14.034964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:33:14.034964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:33:14.034964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:33:14.034964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:33:14.034964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:33:14.034964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:33:14.038210 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:33:14.038210 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:33:14.038210 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:33:14.038210 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:33:14.038210 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:33:14.038210 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 04 16:33:14.038210 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:14.038210 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:14.038210 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:14.038210 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:14.038210 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:14.038210 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:14.038210 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:33:14.038210 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:33:14.038210 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 04 16:33:14.038210 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:14.041516 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3bb8b29d-1806-42d7-8dbb-4d7258938a2e tempest-AggregatesAdminNegativeTestJSON-1771418743 tempest-AggregatesAdminNegativeTestJSON-1771418743-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:14.043388 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3bb8b29d-1806-42d7-8dbb-4d7258938a2e tempest-AggregatesAdminNegativeTestJSON-1771418743 tempest-AggregatesAdminNegativeTestJSON-1771418743-project] 10.222.0.23 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.035189 Aug 04 16:33:14.044604 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 147/273] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Aug 4 16:33:14 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:33:14.059466 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5cc8823c-1760-4032-846d-5d1c6685b58a tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:14.063306 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:14.063306 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:14.141680 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5cc8823c-1760-4032-846d-5d1c6685b58a tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.090124 Aug 04 16:33:14.149134 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 148/274] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Aug 4 16:33:14 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 04 16:33:14.165891 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5628b857-a8cc-45f1-a6cb-cb0298ed5c40 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:14.169955 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:14.169955 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:14.218869 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-5628b857-a8cc-45f1-a6cb-cb0298ed5c40 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 04 16:33:14.221528 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5628b857-a8cc-45f1-a6cb-cb0298ed5c40 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Request method failure captured: Aug 04 16:33:14.221528 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 04 16:33:14.221528 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:33:14.221528 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:33:14.221528 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:33:14.221528 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:33:14.221528 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:33:14.221528 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:33:14.221528 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:33:14.221528 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:14.221528 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_SOp7dYsA8yrXNLWGfM4nirfsqKWORI6Ep5uZ6EG139ZdJI0EvxWFx70MIQGhLT-giIfYvf5VWhxo6aVlyfl8UtnmNr6UKrQEn2EggnQzG6F6ZBYKtNvBaLIT_gFNFdRziQDT6Zch4MUyzR83RFdu4yJ6RYK8xNxCkAOA-hwhiuorI Aug 04 16:33:14.221528 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:33:14.221528 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:33:14.221528 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:33:14.221528 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:33:14.221528 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:33:14.221528 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:33:14.221528 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: c4702c1958e4426182df0685c06f9b9c Aug 04 16:33:14.221528 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1729454419 Aug 04 16:33:14.221528 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader,admin Aug 04 16:33:14.221528 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader,admin Aug 04 16:33:14.222946 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4702c1958e4426182df0685c06f9b9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c4702c1958e4426182df0685c06f9b9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4702c1958e4426182df0685c06f9b9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c4702c1958e4426182df0685c06f9b9c"}]}] Aug 04 16:33:14.222946 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1729454419 Aug 04 16:33:14.222946 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: c4702c1958e4426182df0685c06f9b9c Aug 04 16:33:14.222946 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1729454419 Aug 04 16:33:14.222946 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin Aug 04 16:33:14.222946 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:33:14.222946 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:33:14.222946 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: e1bc9c2d161c4396966cc1539f6a801d Aug 04 16:33:14.222946 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin Aug 04 16:33:14.222946 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:33:14.222946 n-d-846466-12 devstack@n-api.service[126126]: exception: Aggregate -1 could not be found. Aug 04 16:33:14.222946 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '-1'} Aug 04 16:33:14.223770 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:14.223770 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:14.223770 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 04 16:33:14.223770 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 04 16:33:14.223770 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Aug 04 16:33:14.223770 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 04 16:33:14.223770 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:33:14.223770 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:33:14.223770 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 04 16:33:14.223770 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 04 16:33:14.223770 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:33:14.223770 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:33:14.223770 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 04 16:33:14.223770 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 04 16:33:14.223770 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 04 16:33:14.223770 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:14.223770 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:14.223770 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:14.223770 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:14.223770 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:14.225604 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:14.225604 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:14.225604 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:14.225604 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:14.225604 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:14.225604 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 04 16:33:14.225604 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:33:14.225604 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 04 16:33:14.225604 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:14.225604 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:14.225604 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:14.225604 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:14.225604 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:14.225604 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:14.225604 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:33:14.225604 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:33:14.225604 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 04 16:33:14.225604 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:14.229977 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5628b857-a8cc-45f1-a6cb-cb0298ed5c40 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:14.230998 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5628b857-a8cc-45f1-a6cb-cb0298ed5c40 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.076322 Aug 04 16:33:14.235526 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 149/275] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Aug 4 16:33:14 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:33:14.247328 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5a9b71ac-9e2f-46eb-8280-9343716c2e22 tempest-AggregatesAdminNegativeTestJSON-1771418743 tempest-AggregatesAdminNegativeTestJSON-1771418743-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:14.261795 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:14.261795 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:14.265454 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5a9b71ac-9e2f-46eb-8280-9343716c2e22 tempest-AggregatesAdminNegativeTestJSON-1771418743 tempest-AggregatesAdminNegativeTestJSON-1771418743-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '5c41f29a4c194e1a80ea01c8a18be89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889e94129fd4233b0016a0c15f67cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:14.268166 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5a9b71ac-9e2f-46eb-8280-9343716c2e22 tempest-AggregatesAdminNegativeTestJSON-1771418743 tempest-AggregatesAdminNegativeTestJSON-1771418743-project] Request method failure captured: Aug 04 16:33:14.268166 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 04 16:33:14.268166 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:33:14.268166 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:33:14.268166 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:33:14.268166 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:33:14.268166 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:33:14.268166 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:33:14.268166 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:33:14.268166 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:14.268166 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_SLHOP5R1Te60BFmtVhkSdA0PjcgEnnI3t3zYNfyll53XAWqxbL5JEAPcDgL4iBN7QKYMOyczkWcF2lRoc_7j2zbzT-JHLluvsek4cTuqhFDIAH_DUiH0TU21rarZ33EZCYr6p_5l8InnkYqoXXxbW_71HsXqkl-7Z0X4D63ziBqS0 Aug 04 16:33:14.268166 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:33:14.268166 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:33:14.268166 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:33:14.268166 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:33:14.268166 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:33:14.268166 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:33:14.268166 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: c889e94129fd4233b0016a0c15f67cb5 Aug 04 16:33:14.268166 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1771418743 Aug 04 16:33:14.268166 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:33:14.268166 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:33:14.269656 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c889e94129fd4233b0016a0c15f67cb5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c889e94129fd4233b0016a0c15f67cb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c889e94129fd4233b0016a0c15f67cb5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c889e94129fd4233b0016a0c15f67cb5"}]}] Aug 04 16:33:14.269656 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1771418743 Aug 04 16:33:14.269656 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: c889e94129fd4233b0016a0c15f67cb5 Aug 04 16:33:14.269656 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1771418743 Aug 04 16:33:14.269656 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-AggregatesAdminNegativeTestJSON-1771418743-project Aug 04 16:33:14.269656 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:33:14.269656 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:33:14.269656 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 5c41f29a4c194e1a80ea01c8a18be89f Aug 04 16:33:14.269656 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1771418743-project Aug 04 16:33:14.269656 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:33:14.269656 n-d-846466-12 devstack@n-api.service[126126]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 04 16:33:14.269656 n-d-846466-12 devstack@n-api.service[126126]: action_args: {} Aug 04 16:33:14.270446 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:14.270446 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:14.270446 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:14.270446 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:14.270446 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:14.270446 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:14.270446 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:14.270446 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:14.270446 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 04 16:33:14.270446 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 04 16:33:14.270446 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:33:14.270446 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:33:14.270446 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:33:14.270446 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:33:14.270446 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:33:14.270446 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:33:14.270446 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:33:14.270446 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:33:14.270446 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:33:14.271776 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:33:14.271776 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:33:14.271776 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:33:14.271776 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:33:14.271776 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:33:14.271776 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 04 16:33:14.271776 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:14.271776 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:14.271776 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:14.271776 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:14.271776 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:14.271776 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:14.271776 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:33:14.271776 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:33:14.271776 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 04 16:33:14.271776 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:14.277542 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5a9b71ac-9e2f-46eb-8280-9343716c2e22 tempest-AggregatesAdminNegativeTestJSON-1771418743 tempest-AggregatesAdminNegativeTestJSON-1771418743-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:14.279815 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5a9b71ac-9e2f-46eb-8280-9343716c2e22 tempest-AggregatesAdminNegativeTestJSON-1771418743 tempest-AggregatesAdminNegativeTestJSON-1771418743-project] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.038742 Aug 04 16:33:14.282148 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 150/276] 10.222.0.23 () {58 vars in 1143 bytes} [Thu Aug 4 16:33:14 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:33:14.309001 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-30e1e684-d0d4-45d1-9161-8a575f96c561 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:14.310634 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-30e1e684-d0d4-45d1-9161-8a575f96c561 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: f5548cac-028e-4bca-b862-d471688b9c50] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:14.322921 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-30e1e684-d0d4-45d1-9161-8a575f96c561 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:14.323847 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-30e1e684-d0d4-45d1-9161-8a575f96c561 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:14.324796 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-30e1e684-d0d4-45d1-9161-8a575f96c561 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:14.325694 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-30e1e684-d0d4-45d1-9161-8a575f96c561 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:15.582434 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-30e1e684-d0d4-45d1-9161-8a575f96c561 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:15.598369 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-30e1e684-d0d4-45d1-9161-8a575f96c561 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50" status: 200 len: 1320 microversion: 2.1 time: 1.314374 Aug 04 16:33:15.601929 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 151/277] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:14 2022] GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50 => generated 1320 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:15.607910 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-66a8c2d0-e4c5-44bd-8dba-878da2a0e234 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-317935142"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:15.614568 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:15.614568 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:15.618114 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.aggregate [None req-66a8c2d0-e4c5-44bd-8dba-878da2a0e234 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Generated uuid 0c9ff299-2bdb-48d6-9034-51fc93e9b594 for aggregate {{(pid=126126) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:33:15.633688 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9079e109-d95b-440b-9b50-354737770045 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052613a51b86400c916dbc800563896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0ceaab59d4aeaa8667cef6f62559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:15.658107 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9079e109-d95b-440b-9b50-354737770045 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8" status: 200 len: 1319 microversion: 2.1 time: 1.953147 Aug 04 16:33:15.659360 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 127/278] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:13 2022] GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8 => generated 1319 bytes in 1955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:15.676295 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-66a8c2d0-e4c5-44bd-8dba-878da2a0e234 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.072883 Aug 04 16:33:15.681989 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 152/279] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Aug 4 16:33:15 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:15.703140 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cfc018bf-460b-4552-a7dc-619fb5ecfc50 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846466-12"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:15.709688 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:15.709688 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:15.723703 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cfc018bf-460b-4552-a7dc-619fb5ecfc50 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:15.727854 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cfc018bf-460b-4552-a7dc-619fb5ecfc50 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:15.750485 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=100 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:33:15.871456 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-1057de58-8775-4636-858b-289795f4f601 req-8c4bbbe6-038b-4976-9af3-3c5d08b7fbe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ae03eb0-d144-4135-87eb-d8816b9988e8", "tag": "29d020a6-de6a-4a60-b380-be4b7724ab85"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:15.897862 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-1057de58-8775-4636-858b-289795f4f601 req-8c4bbbe6-038b-4976-9af3-3c5d08b7fbe7 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:15.898340 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-1057de58-8775-4636-858b-289795f4f601 req-8c4bbbe6-038b-4976-9af3-3c5d08b7fbe7 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:15.962143 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-1057de58-8775-4636-858b-289795f4f601 req-8c4bbbe6-038b-4976-9af3-3c5d08b7fbe7 service nova] Creating event network-changed:29d020a6-de6a-4a60-b380-be4b7724ab85 for instance 1ae03eb0-d144-4135-87eb-d8816b9988e8 on n-h1-846466-12 Aug 04 16:33:15.993991 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-1057de58-8775-4636-858b-289795f4f601 req-8c4bbbe6-038b-4976-9af3-3c5d08b7fbe7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154814 Aug 04 16:33:15.994646 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 153/280] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 04 16:33:16.053252 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cfc018bf-460b-4552-a7dc-619fb5ecfc50 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.361598 Aug 04 16:33:16.054057 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 128/281] 10.222.0.23 () {60 vars in 1194 bytes} [Thu Aug 4 16:33:15 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:16.070563 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-87b640dd-d41a-4548-a6c3-fad6d81f3456 tempest-AggregatesAdminNegativeTestJSON-1771418743 tempest-AggregatesAdminNegativeTestJSON-1771418743-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846466-12"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:16.076681 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:16.076681 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:16.079615 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-87b640dd-d41a-4548-a6c3-fad6d81f3456 tempest-AggregatesAdminNegativeTestJSON-1771418743 tempest-AggregatesAdminNegativeTestJSON-1771418743-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '5c41f29a4c194e1a80ea01c8a18be89f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889e94129fd4233b0016a0c15f67cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:16.085106 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-87b640dd-d41a-4548-a6c3-fad6d81f3456 tempest-AggregatesAdminNegativeTestJSON-1771418743 tempest-AggregatesAdminNegativeTestJSON-1771418743-project] Request method failure captured: Aug 04 16:33:16.085106 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Aug 04 16:33:16.085106 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:33:16.085106 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:33:16.085106 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:33:16.085106 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 43 Aug 04 16:33:16.085106 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:33:16.085106 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:33:16.085106 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:33:16.085106 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:16.085106 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_SLHOP5R1Te60BFmtVhkSdA0PjcgEnnI3t3zYNfyll53XAWqxbL5JEAPcDgL4iBN7QKYMOyczkWcF2lRoc_7j2zbzT-JHLluvsek4cTuqhFDIAH_DUiH0TU21rarZ33EZCYr6p_5l8InnkYqoXXxbW_71HsXqkl-7Z0X4D63ziBqS0 Aug 04 16:33:16.085106 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:33:16.085106 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:33:16.085106 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:33:16.085106 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:33:16.085106 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:33:16.085106 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:33:16.085106 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: c889e94129fd4233b0016a0c15f67cb5 Aug 04 16:33:16.085106 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1771418743 Aug 04 16:33:16.085106 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:33:16.085106 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:33:16.087203 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c889e94129fd4233b0016a0c15f67cb5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c889e94129fd4233b0016a0c15f67cb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c889e94129fd4233b0016a0c15f67cb5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c889e94129fd4233b0016a0c15f67cb5"}]}] Aug 04 16:33:16.087203 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1771418743 Aug 04 16:33:16.087203 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: c889e94129fd4233b0016a0c15f67cb5 Aug 04 16:33:16.087203 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1771418743 Aug 04 16:33:16.087203 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-AggregatesAdminNegativeTestJSON-1771418743-project Aug 04 16:33:16.087203 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:33:16.087203 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:33:16.087203 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 5c41f29a4c194e1a80ea01c8a18be89f Aug 04 16:33:16.087203 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1771418743-project Aug 04 16:33:16.087203 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 16:33:16.087203 n-d-846466-12 devstack@n-api.service[126126]: {"remove_host": {"host": "n-h2-846466-12"}} Aug 04 16:33:16.087203 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:33:16.087203 n-d-846466-12 devstack@n-api.service[126126]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 04 16:33:16.090457 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-846466-12'}}} Aug 04 16:33:16.090457 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:16.090457 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:16.090457 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:16.090457 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:16.090457 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:16.090457 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:16.090457 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:16.090457 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:16.090457 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:33:16.090457 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:33:16.090457 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 04 16:33:16.090457 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 04 16:33:16.090457 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:33:16.090457 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:33:16.090457 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:33:16.090457 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:33:16.090457 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:33:16.090457 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:33:16.092281 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:33:16.092281 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:33:16.092281 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:33:16.092281 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:33:16.092281 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:33:16.092281 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:33:16.092281 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:33:16.092281 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:33:16.092281 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 04 16:33:16.092281 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:16.092281 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:16.092281 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:16.092281 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:16.092281 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:16.092281 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:16.092281 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:33:16.092281 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:33:16.092281 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 04 16:33:16.092281 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:16.097506 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-87b640dd-d41a-4548-a6c3-fad6d81f3456 tempest-AggregatesAdminNegativeTestJSON-1771418743 tempest-AggregatesAdminNegativeTestJSON-1771418743-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:16.105671 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-87b640dd-d41a-4548-a6c3-fad6d81f3456 tempest-AggregatesAdminNegativeTestJSON-1771418743 tempest-AggregatesAdminNegativeTestJSON-1771418743-project] 10.222.0.23 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.038108 Aug 04 16:33:16.108467 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 154/282] 10.222.0.23 () {60 vars in 1194 bytes} [Thu Aug 4 16:33:16 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:33:16.119143 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6f7cfdf0-ea4e-488d-9d64-0dfefa4b8e97 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846466-12"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:16.122045 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:16.122045 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:16.147926 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6f7cfdf0-ea4e-488d-9d64-0dfefa4b8e97 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:16.148345 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6f7cfdf0-ea4e-488d-9d64-0dfefa4b8e97 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:16.418187 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6f7cfdf0-ea4e-488d-9d64-0dfefa4b8e97 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.301955 Aug 04 16:33:16.421116 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 129/283] 10.222.0.23 () {60 vars in 1194 bytes} [Thu Aug 4 16:33:16 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:16.444965 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4428a280-1a27-4d85-9cbf-e7cd9646dbf6 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:16.447577 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:16.447577 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:16.488204 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4428a280-1a27-4d85-9cbf-e7cd9646dbf6 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.056862 Aug 04 16:33:16.489370 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 155/284] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Aug 4 16:33:16 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 16:33:16.501391 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1721167d-4876-4c5a-a734-491495089339 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2038483752"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:16.523808 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:16.523808 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:16.530902 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.aggregate [None req-1721167d-4876-4c5a-a734-491495089339 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Generated uuid d7e096bc-099b-4b3e-a5af-f8aa3215e438 for aggregate {{(pid=126125) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:33:16.580979 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1721167d-4876-4c5a-a734-491495089339 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.084003 Aug 04 16:33:16.582481 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 130/285] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Aug 4 16:33:16 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:16.611195 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-285b5435-1318-47b3-b1f5-2735be986049 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:16.617308 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=23 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:33:16.621833 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-35f2fdc8-3539-4e6f-be6c-be02c7c2e09d tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:16.622495 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-35f2fdc8-3539-4e6f-be6c-be02c7c2e09d tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: f5548cac-028e-4bca-b862-d471688b9c50] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:16.624438 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=81,nova_api:DELETE=10 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:33:16.627156 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:16.627156 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:16.652647 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-35f2fdc8-3539-4e6f-be6c-be02c7c2e09d tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:16.653218 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-35f2fdc8-3539-4e6f-be6c-be02c7c2e09d tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:16.653897 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-35f2fdc8-3539-4e6f-be6c-be02c7c2e09d tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:16.654324 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-35f2fdc8-3539-4e6f-be6c-be02c7c2e09d tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:16.658757 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-285b5435-1318-47b3-b1f5-2735be986049 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:16.659145 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-285b5435-1318-47b3-b1f5-2735be986049 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:16.674574 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:33:16.680209 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-285b5435-1318-47b3-b1f5-2735be986049 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:16.680651 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-285b5435-1318-47b3-b1f5-2735be986049 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:16.712351 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.compute.aggregates [None req-285b5435-1318-47b3-b1f5-2735be986049 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 04 16:33:16.712897 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-285b5435-1318-47b3-b1f5-2735be986049 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Aug 04 16:33:16.714876 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-285b5435-1318-47b3-b1f5-2735be986049 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Request method failure captured: Aug 04 16:33:16.714876 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Aug 04 16:33:16.714876 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:33:16.714876 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:33:16.714876 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:33:16.714876 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 42 Aug 04 16:33:16.714876 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:33:16.714876 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:33:16.714876 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:33:16.714876 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:16.714876 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_SOp7dYsA8yrXNLWGfM4nirfsqKWORI6Ep5uZ6EG139ZdJI0EvxWFx70MIQGhLT-giIfYvf5VWhxo6aVlyfl8UtnmNr6UKrQEn2EggnQzG6F6ZBYKtNvBaLIT_gFNFdRziQDT6Zch4MUyzR83RFdu4yJ6RYK8xNxCkAOA-hwhiuorI Aug 04 16:33:16.714876 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:33:16.714876 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:33:16.714876 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:33:16.714876 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:33:16.714876 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:33:16.714876 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:33:16.714876 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: c4702c1958e4426182df0685c06f9b9c Aug 04 16:33:16.714876 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1729454419 Aug 04 16:33:16.714876 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader,admin Aug 04 16:33:16.714876 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader,admin Aug 04 16:33:16.716260 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4702c1958e4426182df0685c06f9b9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c4702c1958e4426182df0685c06f9b9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4702c1958e4426182df0685c06f9b9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c4702c1958e4426182df0685c06f9b9c"}]}] Aug 04 16:33:16.716260 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1729454419 Aug 04 16:33:16.716260 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: c4702c1958e4426182df0685c06f9b9c Aug 04 16:33:16.716260 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1729454419 Aug 04 16:33:16.716260 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin Aug 04 16:33:16.716260 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:33:16.716260 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:33:16.716260 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: e1bc9c2d161c4396966cc1539f6a801d Aug 04 16:33:16.716260 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin Aug 04 16:33:16.716260 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 16:33:16.716260 n-d-846466-12 devstack@n-api.service[126126]: {"remove_host": {"host": "nonexist_host"}} Aug 04 16:33:16.716260 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:33:16.716260 n-d-846466-12 devstack@n-api.service[126126]: exception: Cannot remove host nonexist_host in aggregate 18 Aug 04 16:33:16.717033 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 04 16:33:16.717033 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:16.717033 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:16.717033 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5949, in _get_service_in_cell_by_host Aug 04 16:33:16.717033 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 04 16:33:16.717033 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:33:16.717033 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:33:16.717033 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 04 16:33:16.717033 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 04 16:33:16.717033 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:33:16.717033 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:33:16.717033 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 04 16:33:16.717033 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 04 16:33:16.717033 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 04 16:33:16.717033 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:16.717033 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:16.717033 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:16.717033 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:16.717033 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5955, in _get_service_in_cell_by_host Aug 04 16:33:16.717033 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 04 16:33:16.718221 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 04 16:33:16.718221 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 04 16:33:16.718221 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 04 16:33:16.718221 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:16.718221 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:16.718221 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:16.718221 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:16.718221 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 04 16:33:16.718221 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 04 16:33:16.718221 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 16:33:16.718221 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 16:33:16.718221 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:33:16.718221 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:33:16.718221 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:33:16.718221 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:33:16.718221 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 16:33:16.718221 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 16:33:16.718221 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6636, in remove_host_from_aggregate Aug 04 16:33:16.718221 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 04 16:33:16.718221 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5957, in _get_service_in_cell_by_host Aug 04 16:33:16.719401 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 04 16:33:16.719401 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 04 16:33:16.719401 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:16.719401 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:16.719401 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:16.719401 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:16.719401 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:16.719401 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:16.719401 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:16.719401 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:16.719401 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:16.719401 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:16.719401 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:33:16.719401 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:33:16.719401 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 04 16:33:16.719401 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 16:33:16.719401 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Aug 04 16:33:16.719401 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:16.719401 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:16.719401 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:16.719401 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:16.723729 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:16.723729 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:16.723729 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:33:16.723729 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:33:16.723729 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Aug 04 16:33:16.723729 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:16.723729 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-285b5435-1318-47b3-b1f5-2735be986049 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:16.723729 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-285b5435-1318-47b3-b1f5-2735be986049 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.126236 Aug 04 16:33:16.728152 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 156/286] 10.222.0.23 () {60 vars in 1194 bytes} [Thu Aug 4 16:33:16 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:33:16.743830 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ce1f70ef-4f5b-42ec-a96d-2a2a2e3f3cf5 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:16.744565 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ce1f70ef-4f5b-42ec-a96d-2a2a2e3f3cf5 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: 1ae03eb0-d144-4135-87eb-d8816b9988e8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:16.765319 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ce1f70ef-4f5b-42ec-a96d-2a2a2e3f3cf5 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:16.777036 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ce1f70ef-4f5b-42ec-a96d-2a2a2e3f3cf5 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:16.777968 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ce1f70ef-4f5b-42ec-a96d-2a2a2e3f3cf5 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:16.778446 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ce1f70ef-4f5b-42ec-a96d-2a2a2e3f3cf5 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:17.254098 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-35f2fdc8-3539-4e6f-be6c-be02c7c2e09d tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:17.268368 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-35f2fdc8-3539-4e6f-be6c-be02c7c2e09d tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50" status: 200 len: 1320 microversion: 2.1 time: 0.651869 Aug 04 16:33:17.270062 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 131/287] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:16 2022] GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50 => generated 1320 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:17.281156 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-38e69a7e-a6d1-4116-a7de-e2167906a869 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:17.288502 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ce1f70ef-4f5b-42ec-a96d-2a2a2e3f3cf5 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052613a51b86400c916dbc800563896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0ceaab59d4aeaa8667cef6f62559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:17.299195 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ce1f70ef-4f5b-42ec-a96d-2a2a2e3f3cf5 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8" status: 200 len: 1319 microversion: 2.1 time: 0.569854 Aug 04 16:33:17.300609 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:17.300609 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:17.304941 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 157/288] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:16 2022] GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8 => generated 1319 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:17.346275 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-38e69a7e-a6d1-4116-a7de-e2167906a869 tempest-AggregatesAdminNegativeTestJSON-1729454419 tempest-AggregatesAdminNegativeTestJSON-1729454419-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.075073 Aug 04 16:33:17.346822 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 132/289] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Aug 4 16:33:17 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 16:33:18.009454 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=10 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:33:18.293520 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-59b5c644-fe31-4c52-9fe4-9b71cefc3122 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:18.294129 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-59b5c644-fe31-4c52-9fe4-9b71cefc3122 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: f5548cac-028e-4bca-b862-d471688b9c50] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:18.309857 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-59b5c644-fe31-4c52-9fe4-9b71cefc3122 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:18.310305 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-59b5c644-fe31-4c52-9fe4-9b71cefc3122 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:18.311086 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-59b5c644-fe31-4c52-9fe4-9b71cefc3122 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:18.311517 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-59b5c644-fe31-4c52-9fe4-9b71cefc3122 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:18.603275 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-97f38474-2aa0-40f2-84e5-4d2ff985c808 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-353416353", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:18.715716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-97f38474-2aa0-40f2-84e5-4d2ff985c808 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] validate_networks() for None {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:33:18.729330 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-59b5c644-fe31-4c52-9fe4-9b71cefc3122 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:18.738743 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-59b5c644-fe31-4c52-9fe4-9b71cefc3122 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50" status: 200 len: 1320 microversion: 2.1 time: 0.449729 Aug 04 16:33:18.744260 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 133/290] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:18 2022] GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50 => generated 1320 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:33:18.749163 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ce8051ad-45a6-4336-aa12-7afd4dfc3d1b tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:18.749810 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ce8051ad-45a6-4336-aa12-7afd4dfc3d1b tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: 1ae03eb0-d144-4135-87eb-d8816b9988e8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:18.763950 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ce8051ad-45a6-4336-aa12-7afd4dfc3d1b tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:18.764397 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ce8051ad-45a6-4336-aa12-7afd4dfc3d1b tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:18.765181 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ce8051ad-45a6-4336-aa12-7afd4dfc3d1b tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:18.765650 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ce8051ad-45a6-4336-aa12-7afd4dfc3d1b tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:19.164900 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-97f38474-2aa0-40f2-84e5-4d2ff985c808 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:33:19.165821 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-97f38474-2aa0-40f2-84e5-4d2ff985c808 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:33:19.166295 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-97f38474-2aa0-40f2-84e5-4d2ff985c808 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:33:19.167242 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-97f38474-2aa0-40f2-84e5-4d2ff985c808 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:33:19.169714 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-97f38474-2aa0-40f2-84e5-4d2ff985c808 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:33:19.208380 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-97f38474-2aa0-40f2-84e5-4d2ff985c808 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:19.214131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-97f38474-2aa0-40f2-84e5-4d2ff985c808 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:19.215044 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-97f38474-2aa0-40f2-84e5-4d2ff985c808 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:19.219783 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-97f38474-2aa0-40f2-84e5-4d2ff985c808 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:19.284328 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-97f38474-2aa0-40f2-84e5-4d2ff985c808 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Getting quotas for project c9cb965024d94d7cae0c5652212e7cc2. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:33:19.310629 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-97f38474-2aa0-40f2-84e5-4d2ff985c808 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Getting quotas for user 1c73c354a6ee4ab881f483ff65a21dc4 and project c9cb965024d94d7cae0c5652212e7cc2. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:33:19.344905 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-97f38474-2aa0-40f2-84e5-4d2ff985c808 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:33:19.347745 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-97f38474-2aa0-40f2-84e5-4d2ff985c808 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: 92c85400-67f0-4930-bf61-28770e84b98c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:33:19.502832 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-97f38474-2aa0-40f2-84e5-4d2ff985c808 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.494221 Aug 04 16:33:19.511275 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 158/291] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:33:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:33:19.523551 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1f17ab10-a3b1-475b-8305-b3919a86291c tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:19.524105 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1f17ab10-a3b1-475b-8305-b3919a86291c tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: 92c85400-67f0-4930-bf61-28770e84b98c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:19.540833 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ce8051ad-45a6-4336-aa12-7afd4dfc3d1b tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052613a51b86400c916dbc800563896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0ceaab59d4aeaa8667cef6f62559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:19.565591 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ce8051ad-45a6-4336-aa12-7afd4dfc3d1b tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8" status: 200 len: 1319 microversion: 2.1 time: 0.812387 Aug 04 16:33:19.565591 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 134/292] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:18 2022] GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8 => generated 1319 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:19.745757 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1f17ab10-a3b1-475b-8305-b3919a86291c tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c73c354a6ee4ab881f483ff65a21dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cb965024d94d7cae0c5652212e7cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:19.757117 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1f17ab10-a3b1-475b-8305-b3919a86291c tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c" status: 200 len: 1221 microversion: 2.1 time: 0.242401 Aug 04 16:33:19.758678 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 159/293] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:19 2022] GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c => generated 1221 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:19.766588 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3d765aa4-29c5-4274-819d-72eaba2d53e3 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:19.773891 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3d765aa4-29c5-4274-819d-72eaba2d53e3 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: f5548cac-028e-4bca-b862-d471688b9c50] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:19.813559 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3d765aa4-29c5-4274-819d-72eaba2d53e3 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:19.819089 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3d765aa4-29c5-4274-819d-72eaba2d53e3 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:19.823745 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3d765aa4-29c5-4274-819d-72eaba2d53e3 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:19.844390 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3d765aa4-29c5-4274-819d-72eaba2d53e3 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:20.507525 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3d765aa4-29c5-4274-819d-72eaba2d53e3 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:20.517618 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3d765aa4-29c5-4274-819d-72eaba2d53e3 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50" status: 200 len: 1320 microversion: 2.1 time: 0.759785 Aug 04 16:33:20.518592 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 135/294] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:19 2022] GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50 => generated 1320 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:20.594206 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-20ebd252-abe1-46d4-89f8-aa26984edeca tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:20.594206 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-20ebd252-abe1-46d4-89f8-aa26984edeca tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: 1ae03eb0-d144-4135-87eb-d8816b9988e8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:20.628687 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-20ebd252-abe1-46d4-89f8-aa26984edeca tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:20.629894 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-20ebd252-abe1-46d4-89f8-aa26984edeca tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:20.636284 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-20ebd252-abe1-46d4-89f8-aa26984edeca tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:20.640146 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-20ebd252-abe1-46d4-89f8-aa26984edeca tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:20.798065 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c655a0dc-2226-46bb-900b-48144219ae7f tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:20.800104 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c655a0dc-2226-46bb-900b-48144219ae7f tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: 92c85400-67f0-4930-bf61-28770e84b98c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:20.812480 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c655a0dc-2226-46bb-900b-48144219ae7f tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:20.815346 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c655a0dc-2226-46bb-900b-48144219ae7f tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:20.820478 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c655a0dc-2226-46bb-900b-48144219ae7f tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:20.824704 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c655a0dc-2226-46bb-900b-48144219ae7f tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:20.991727 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c655a0dc-2226-46bb-900b-48144219ae7f tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c73c354a6ee4ab881f483ff65a21dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cb965024d94d7cae0c5652212e7cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:21.003619 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c655a0dc-2226-46bb-900b-48144219ae7f tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c" status: 200 len: 1217 microversion: 2.1 time: 0.207976 Aug 04 16:33:21.022044 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 136/295] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:20 2022] GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c => generated 1217 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:21.120245 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-20ebd252-abe1-46d4-89f8-aa26984edeca tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052613a51b86400c916dbc800563896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0ceaab59d4aeaa8667cef6f62559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:21.148944 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-20ebd252-abe1-46d4-89f8-aa26984edeca tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8" status: 200 len: 1319 microversion: 2.1 time: 0.566075 Aug 04 16:33:21.150437 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 160/296] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:20 2022] GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8 => generated 1319 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:21.539798 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-89c3f92c-f119-4665-9098-f0da4c4c453a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:21.540418 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-89c3f92c-f119-4665-9098-f0da4c4c453a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: f5548cac-028e-4bca-b862-d471688b9c50] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:21.564573 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-89c3f92c-f119-4665-9098-f0da4c4c453a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:21.565015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-89c3f92c-f119-4665-9098-f0da4c4c453a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:21.565975 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-89c3f92c-f119-4665-9098-f0da4c4c453a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:21.566626 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-89c3f92c-f119-4665-9098-f0da4c4c453a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:22.038414 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d05f9937-1177-4611-b102-2c0889bbb04c tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:22.042972 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d05f9937-1177-4611-b102-2c0889bbb04c tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: 92c85400-67f0-4930-bf61-28770e84b98c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:22.066389 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d05f9937-1177-4611-b102-2c0889bbb04c tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:22.066829 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d05f9937-1177-4611-b102-2c0889bbb04c tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:22.067611 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d05f9937-1177-4611-b102-2c0889bbb04c tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:22.068032 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d05f9937-1177-4611-b102-2c0889bbb04c tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:22.393004 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d05f9937-1177-4611-b102-2c0889bbb04c tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c73c354a6ee4ab881f483ff65a21dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cb965024d94d7cae0c5652212e7cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:22.410029 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d05f9937-1177-4611-b102-2c0889bbb04c tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c" status: 200 len: 1279 microversion: 2.1 time: 0.384639 Aug 04 16:33:22.410648 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 161/297] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:22 2022] GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c => generated 1279 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:33:22.689957 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fbcdabae-ace0-4875-96fe-421b64806026 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-772929037", "id": 1922683006, "os-flavor-access:is_public": "True"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:22.693297 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:22.693297 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:22.733061 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fbcdabae-ace0-4875-96fe-421b64806026 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.308272 Aug 04 16:33:22.761114 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 162/298] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:33:22 2022] POST /compute/v2.1/flavors => generated 429 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:22.786857 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-3b978a27-1451-4ab7-a886-aae2c8a31af6 req-13293832-1673-422c-bf2b-6967c274fef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5548cac-028e-4bca-b862-d471688b9c50", "name": "network-vif-plugged", "status": "completed", "tag": "5bca5e77-28f1-4d92-ae07-3a6f6331f63e"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:22.809711 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-3b978a27-1451-4ab7-a886-aae2c8a31af6 req-13293832-1673-422c-bf2b-6967c274fef6 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:22.810414 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-3b978a27-1451-4ab7-a886-aae2c8a31af6 req-13293832-1673-422c-bf2b-6967c274fef6 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:22.834745 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-3b978a27-1451-4ab7-a886-aae2c8a31af6 req-13293832-1673-422c-bf2b-6967c274fef6 service nova] Creating event network-vif-plugged:5bca5e77-28f1-4d92-ae07-3a6f6331f63e for instance f5548cac-028e-4bca-b862-d471688b9c50 on n-h2-846466-12 Aug 04 16:33:22.847374 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-3b978a27-1451-4ab7-a886-aae2c8a31af6 req-13293832-1673-422c-bf2b-6967c274fef6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083004 Aug 04 16:33:22.850854 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 163/299] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:22.859861 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a0237f6e-872f-4787-ba2a-23988041c6fe tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:22.860757 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a0237f6e-872f-4787-ba2a-23988041c6fe tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: 1ae03eb0-d144-4135-87eb-d8816b9988e8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:22.869218 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a0237f6e-872f-4787-ba2a-23988041c6fe tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:22.870090 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a0237f6e-872f-4787-ba2a-23988041c6fe tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:22.871163 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a0237f6e-872f-4787-ba2a-23988041c6fe tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:22.871756 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a0237f6e-872f-4787-ba2a-23988041c6fe tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:23.346193 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-89c3f92c-f119-4665-9098-f0da4c4c453a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:23.375112 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-89c3f92c-f119-4665-9098-f0da4c4c453a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50" status: 200 len: 1320 microversion: 2.1 time: 1.839410 Aug 04 16:33:23.376100 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 137/300] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:21 2022] GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50 => generated 1320 bytes in 1841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:33:23.409201 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e38c11cb-bdbb-412c-a405-755fea68d6db tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:23.414562 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:23.414562 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:23.480786 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e38c11cb-bdbb-412c-a405-755fea68d6db tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1922683006" status: 202 len: 0 microversion: 2.1 time: 0.081253 Aug 04 16:33:23.482342 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 138/301] 10.222.0.23 () {58 vars in 1161 bytes} [Thu Aug 4 16:33:23 2022] DELETE /compute/v2.1/flavors/1922683006 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:33:23.491245 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-16e9a72c-a77e-4286-9b0c-fd0da3229a36 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:23.492241 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-16e9a72c-a77e-4286-9b0c-fd0da3229a36 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: 92c85400-67f0-4930-bf61-28770e84b98c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:23.508746 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-16e9a72c-a77e-4286-9b0c-fd0da3229a36 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:23.509732 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-16e9a72c-a77e-4286-9b0c-fd0da3229a36 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:23.512523 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-16e9a72c-a77e-4286-9b0c-fd0da3229a36 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:23.514316 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-16e9a72c-a77e-4286-9b0c-fd0da3229a36 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:23.647484 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a0237f6e-872f-4787-ba2a-23988041c6fe tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052613a51b86400c916dbc800563896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0ceaab59d4aeaa8667cef6f62559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:23.666099 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a0237f6e-872f-4787-ba2a-23988041c6fe tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8" status: 200 len: 1319 microversion: 2.1 time: 0.812777 Aug 04 16:33:23.666688 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 164/302] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:22 2022] GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8 => generated 1319 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:23.671131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-36f0694c-2b9d-42a9-bf58-1fb179ad632b tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:23.699981 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-36f0694c-2b9d-42a9-bf58-1fb179ad632b tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.032187 Aug 04 16:33:23.701122 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 165/303] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:33:23 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:23.720402 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cb0f6ab1-cc15-48a3-ab8f-b123c489ee23 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1311894565", "id": 832706329, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:23.723941 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:23.723941 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:23.753463 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cb0f6ab1-cc15-48a3-ab8f-b123c489ee23 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.036782 Aug 04 16:33:23.754394 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 166/304] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:33:23 2022] POST /compute/v2.1/flavors => generated 414 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:33:23.763213 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-16e9a72c-a77e-4286-9b0c-fd0da3229a36 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c73c354a6ee4ab881f483ff65a21dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cb965024d94d7cae0c5652212e7cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:23.765804 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-efccdca5-733f-4de7-ad60-86f27c2d0807 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:23.783539 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-16e9a72c-a77e-4286-9b0c-fd0da3229a36 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c" status: 200 len: 1279 microversion: 2.1 time: 0.299815 Aug 04 16:33:23.799926 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 139/305] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:23 2022] GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c => generated 1279 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:23.829561 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-efccdca5-733f-4de7-ad60-86f27c2d0807 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6224 microversion: 2.1 time: 0.061252 Aug 04 16:33:23.830292 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 167/306] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:33:23 2022] GET /compute/v2.1/flavors/detail => generated 6224 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:23.855491 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0b98b112-b82a-443f-bea1-f518a1ff8c56 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:23.857881 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:23.857881 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:23.902483 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0b98b112-b82a-443f-bea1-f518a1ff8c56 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/832706329" status: 202 len: 0 microversion: 2.1 time: 0.056597 Aug 04 16:33:23.903518 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 140/307] 10.222.0.23 () {58 vars in 1158 bytes} [Thu Aug 4 16:33:23 2022] DELETE /compute/v2.1/flavors/832706329 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:33:23.916356 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5ffdc22a-4330-40aa-9196-883a504be929 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:23.949747 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5ffdc22a-4330-40aa-9196-883a504be929 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.039938 Aug 04 16:33:23.963878 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 168/308] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:33:23 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:23.980252 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4df1b6f8-0879-41d6-ae16-a3f1ba40ac31 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-763847227", "id": 1823964430, "os-flavor-access:is_public": "True"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:23.986447 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:23.986447 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:24.016543 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4df1b6f8-0879-41d6-ae16-a3f1ba40ac31 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.043339 Aug 04 16:33:24.022034 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 141/309] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:33:23 2022] POST /compute/v2.1/flavors => generated 428 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:24.040915 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3d90344d-e823-4bcd-8b17-78daaf2cf885 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:24.042107 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:24.042107 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:24.072628 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3d90344d-e823-4bcd-8b17-78daaf2cf885 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1823964430" status: 202 len: 0 microversion: 2.1 time: 0.041715 Aug 04 16:33:24.073573 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 169/310] 10.222.0.23 () {58 vars in 1161 bytes} [Thu Aug 4 16:33:24 2022] DELETE /compute/v2.1/flavors/1823964430 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:33:24.082370 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-055abe8a-c2ab-431d-98b4-020027cac12f tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:24.117898 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-055abe8a-c2ab-431d-98b4-020027cac12f tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.039538 Aug 04 16:33:24.119159 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 142/311] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:33:24 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:24.140412 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-104d9d76-a894-4252-bcc3-456d50ef161f tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-69445054", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:24.191580 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-104d9d76-a894-4252-bcc3-456d50ef161f tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 505 microversion: 2.1 time: 0.055053 Aug 04 16:33:24.200275 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 170/312] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:33:24 2022] POST /compute/v2.1/flavors => generated 505 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:24.206689 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bbcf6ffb-c6a0-47b0-9171-a95413e4ae17 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:24.231541 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bbcf6ffb-c6a0-47b0-9171-a95413e4ae17 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/9898e99a-3763-449d-82c5-9ad9a47ac64c" status: 202 len: 0 microversion: 2.1 time: 0.029437 Aug 04 16:33:24.233726 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 143/313] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:33:24 2022] DELETE /compute/v2.1/flavors/9898e99a-3763-449d-82c5-9ad9a47ac64c => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:33:24.250250 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ca858211-afe0-4535-93f5-28d49630e759 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:24.298642 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ca858211-afe0-4535-93f5-28d49630e759 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.061562 Aug 04 16:33:24.299354 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 171/314] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:33:24 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:24.321910 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fd5d6e73-d4dd-4e00-aaae-43b2a5b8ef3a tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-853284619", "id": "6e670615-2a96-488f-9165-46b4fcb4da93", "os-flavor-access:is_public": "True"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:24.352812 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fd5d6e73-d4dd-4e00-aaae-43b2a5b8ef3a tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.034801 Aug 04 16:33:24.354547 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 144/315] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:33:24 2022] POST /compute/v2.1/flavors => generated 506 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:24.368206 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-daacdfe0-5e16-4db8-acf0-6ca466befebd tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:24.378352 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=11,nova_api:INSERT=8 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:33:24.394160 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-daacdfe0-5e16-4db8-acf0-6ca466befebd tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/6e670615-2a96-488f-9165-46b4fcb4da93" status: 202 len: 0 microversion: 2.1 time: 0.031103 Aug 04 16:33:24.402151 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-13ab854e-407b-444d-b163-68f002305b6f tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:24.403305 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-13ab854e-407b-444d-b163-68f002305b6f tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: f5548cac-028e-4bca-b862-d471688b9c50] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:24.412077 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 172/316] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:33:24 2022] DELETE /compute/v2.1/flavors/6e670615-2a96-488f-9165-46b4fcb4da93 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:33:24.418991 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-13ab854e-407b-444d-b163-68f002305b6f tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:24.422837 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9f0c14ae-d259-4709-b2fd-03549405e1f2 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:24.424061 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-13ab854e-407b-444d-b163-68f002305b6f tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:24.426246 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-13ab854e-407b-444d-b163-68f002305b6f tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:24.432736 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-13ab854e-407b-444d-b163-68f002305b6f tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:24.487577 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9f0c14ae-d259-4709-b2fd-03549405e1f2 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.067646 Aug 04 16:33:24.492500 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 173/317] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:33:24 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:24.522739 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-35b84979-cf28-4b0a-ae58-4df3c6879448 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1232173122", "id": 416321058, "os-flavor-access:is_public": "True"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:24.553736 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-35b84979-cf28-4b0a-ae58-4df3c6879448 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.043576 Aug 04 16:33:24.555271 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 174/318] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:33:24 2022] POST /compute/v2.1/flavors => generated 411 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:33:24.576607 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-15675366-71fa-4d11-8ddb-5de365810058 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:24.586806 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-15675366-71fa-4d11-8ddb-5de365810058 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/416321058" status: 200 len: 411 microversion: 2.1 time: 0.024235 Aug 04 16:33:24.589483 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 175/319] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Aug 4 16:33:24 2022] GET /compute/v2.1/flavors/416321058 => generated 411 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:25.180305 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-314e8078-2a20-4d07-9c8d-85739ef4e73d tempest-FlavorsAdminTestJSON-27971472 tempest-FlavorsAdminTestJSON-27971472-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:25.243738 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-314e8078-2a20-4d07-9c8d-85739ef4e73d tempest-FlavorsAdminTestJSON-27971472 tempest-FlavorsAdminTestJSON-27971472-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6221 microversion: 2.1 time: 0.646991 Aug 04 16:33:25.249216 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 176/320] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:33:24 2022] GET /compute/v2.1/flavors/detail => generated 6221 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:25.280308 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-65d99dff-8af5-48a9-80c5-81441700e2d5 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:25.281996 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-65d99dff-8af5-48a9-80c5-81441700e2d5 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: 1ae03eb0-d144-4135-87eb-d8816b9988e8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:25.302483 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65d99dff-8af5-48a9-80c5-81441700e2d5 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:25.303526 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65d99dff-8af5-48a9-80c5-81441700e2d5 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:25.305358 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65d99dff-8af5-48a9-80c5-81441700e2d5 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:25.308114 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65d99dff-8af5-48a9-80c5-81441700e2d5 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:25.345336 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-13ab854e-407b-444d-b163-68f002305b6f tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:25.358491 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-13ab854e-407b-444d-b163-68f002305b6f tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50" status: 200 len: 1320 microversion: 2.1 time: 0.959835 Aug 04 16:33:25.362558 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 145/321] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:24 2022] GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50 => generated 1320 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:33:25.378524 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6e5be9d7-a148-481f-b32a-f519d693fd1c tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:25.387942 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6e5be9d7-a148-481f-b32a-f519d693fd1c tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: 92c85400-67f0-4930-bf61-28770e84b98c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:25.397742 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6e5be9d7-a148-481f-b32a-f519d693fd1c tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:25.398383 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6e5be9d7-a148-481f-b32a-f519d693fd1c tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:25.400132 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6e5be9d7-a148-481f-b32a-f519d693fd1c tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:25.401569 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6e5be9d7-a148-481f-b32a-f519d693fd1c tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:25.666893 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6e5be9d7-a148-481f-b32a-f519d693fd1c tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c73c354a6ee4ab881f483ff65a21dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cb965024d94d7cae0c5652212e7cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:25.677890 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6e5be9d7-a148-481f-b32a-f519d693fd1c tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c" status: 200 len: 1279 microversion: 2.1 time: 0.313769 Aug 04 16:33:25.678488 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 146/322] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:25 2022] GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c => generated 1279 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:25.708112 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ac2cc1fe-d89f-4508-8a2a-93c622645c68 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:25.718361 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:25.718361 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:25.783674 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ac2cc1fe-d89f-4508-8a2a-93c622645c68 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/416321058" status: 202 len: 0 microversion: 2.1 time: 0.095681 Aug 04 16:33:25.785362 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 147/323] 10.222.0.23 () {58 vars in 1158 bytes} [Thu Aug 4 16:33:25 2022] DELETE /compute/v2.1/flavors/416321058 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:33:25.796625 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-03f9fca9-e6fd-4439-af6b-03cd6f7fa9cf tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:25.852320 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-03f9fca9-e6fd-4439-af6b-03cd6f7fa9cf tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.062022 Aug 04 16:33:25.868075 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 148/324] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:33:25 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:25.890271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3a3c719c-774c-46ab-91f1-1c14db9d4f01 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-623353503", "id": 1221100684, "os-flavor-access:is_public": "False"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:25.895290 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:25.895290 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:25.955051 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3a3c719c-774c-46ab-91f1-1c14db9d4f01 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.076956 Aug 04 16:33:25.965655 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 149/325] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:33:25 2022] POST /compute/v2.1/flavors => generated 429 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:25.977840 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8e497de7-ea56-4a62-91f8-54b5cffd3e60 tempest-FlavorsAdminTestJSON-27971472 tempest-FlavorsAdminTestJSON-27971472-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "1221100684"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:26.002080 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-8e497de7-ea56-4a62-91f8-54b5cffd3e60 tempest-FlavorsAdminTestJSON-27971472 tempest-FlavorsAdminTestJSON-27971472-project] HTTP exception thrown: Flavor 1221100684 could not be found. Aug 04 16:33:26.010280 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8e497de7-ea56-4a62-91f8-54b5cffd3e60 tempest-FlavorsAdminTestJSON-27971472 tempest-FlavorsAdminTestJSON-27971472-project] Request method failure captured: Aug 04 16:33:26.010280 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 16:33:26.010280 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:33:26.010280 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:33:26.010280 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:33:26.010280 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 107 Aug 04 16:33:26.010280 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:33:26.010280 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:33:26.010280 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:33:26.010280 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:26.010280 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_TPIF6LG9H578F9a_KILYup9F4y5LX1i0o0tFLcTtT8GrSbMXDATPaC6aFAjHnewsJB7om-C5QgthH_osvb84GdgbpyUsaR0qt9KNEJR1PeKQYRlv9pjR3Si8ejKZgqOY63TUotrX5XpgXlR9_gQ-eQtHEioms--Qke_IVCr6HPZPs Aug 04 16:33:26.010280 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:33:26.010280 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:33:26.010280 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:33:26.010280 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:33:26.010280 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:33:26.010280 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:33:26.010280 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: b78074abd5974adb9804ccf50f2c783e Aug 04 16:33:26.010280 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-FlavorsAdminTestJSON-27971472 Aug 04 16:33:26.010280 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:33:26.010280 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:33:26.011821 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b78074abd5974adb9804ccf50f2c783e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b78074abd5974adb9804ccf50f2c783e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b78074abd5974adb9804ccf50f2c783e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b78074abd5974adb9804ccf50f2c783e"}]}] Aug 04 16:33:26.011821 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-FlavorsAdminTestJSON-27971472 Aug 04 16:33:26.011821 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: b78074abd5974adb9804ccf50f2c783e Aug 04 16:33:26.011821 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-27971472 Aug 04 16:33:26.011821 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-FlavorsAdminTestJSON-27971472-project Aug 04 16:33:26.011821 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:33:26.011821 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:33:26.011821 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 5150dfb3d3204ad8b3e3f7327722ca57 Aug 04 16:33:26.011821 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-FlavorsAdminTestJSON-27971472-project Aug 04 16:33:26.011821 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:33:26.011821 n-d-846466-12 devstack@n-api.service[126125]: {"server": {"name": "test", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "1221100684"}} Aug 04 16:33:26.011821 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:33:26.011821 n-d-846466-12 devstack@n-api.service[126125]: exception: Flavor 1221100684 could not be found. Aug 04 16:33:26.013068 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '58d80c01-1581-4a2f-bbb0-c2eaf1affa00', 'flavorRef': '1221100684'}}} Aug 04 16:33:26.013068 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:26.013068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:26.013068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 04 16:33:26.013068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 04 16:33:26.013068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 16:33:26.013068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 16:33:26.013068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:33:26.013068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:33:26.013068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 16:33:26.013068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 16:33:26.013068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 16:33:26.013068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:26.013068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 16:33:26.013068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 16:33:26.013068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1221100684 could not be found. Aug 04 16:33:26.013068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:26.013068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:26.013068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:26.013068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:26.014289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:26.014289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:26.014289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:26.014289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:26.014289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:26.014289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:26.014289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:33:26.014289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:33:26.014289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:33:26.014289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:33:26.014289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:33:26.014289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:33:26.014289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 16:33:26.014289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 04 16:33:26.014289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 04 16:33:26.014289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1221100684 could not be found. Aug 04 16:33:26.014289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:26.014289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:26.014289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:26.014289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:26.014289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:26.015516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:26.015516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:33:26.015516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:33:26.015516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1221100684 could not be found. Aug 04 16:33:26.015516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:26.019961 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8e497de7-ea56-4a62-91f8-54b5cffd3e60 tempest-FlavorsAdminTestJSON-27971472 tempest-FlavorsAdminTestJSON-27971472-project] Returning 400 to user: Flavor 1221100684 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:26.024067 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8e497de7-ea56-4a62-91f8-54b5cffd3e60 tempest-FlavorsAdminTestJSON-27971472 tempest-FlavorsAdminTestJSON-27971472-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.056867 Aug 04 16:33:26.028664 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 150/326] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:33:25 2022] POST /compute/v2.1/servers => generated 81 bytes in 62 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 16:33:26.045411 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-32742bfc-0fdc-4119-b1bf-dd379738cb4d tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:26.093860 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-32742bfc-0fdc-4119-b1bf-dd379738cb4d tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1221100684" status: 202 len: 0 microversion: 2.1 time: 0.063557 Aug 04 16:33:26.094723 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 151/327] 10.222.0.23 () {58 vars in 1161 bytes} [Thu Aug 4 16:33:26 2022] DELETE /compute/v2.1/flavors/1221100684 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:33:26.105330 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c6200efa-5ddf-4ab7-a275-d11a3618b6d3 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:26.144474 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c6200efa-5ddf-4ab7-a275-d11a3618b6d3 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.044397 Aug 04 16:33:26.150785 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 152/328] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:33:26 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:33:26.153524 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-65d99dff-8af5-48a9-80c5-81441700e2d5 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052613a51b86400c916dbc800563896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0ceaab59d4aeaa8667cef6f62559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:26.171386 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-65d99dff-8af5-48a9-80c5-81441700e2d5 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8" status: 200 len: 1319 microversion: 2.1 time: 0.918597 Aug 04 16:33:26.172484 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 177/329] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:25 2022] GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8 => generated 1319 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:26.187500 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-361cb5f1-b435-4447-baac-c0eb31d717b9 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2027991674", "id": 604704272, "os-flavor-access:is_public": "False"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:26.236023 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-361cb5f1-b435-4447-baac-c0eb31d717b9 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.066791 Aug 04 16:33:26.239613 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 153/330] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:33:26 2022] POST /compute/v2.1/flavors => generated 412 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:26.251598 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-77501336-90fa-401a-939b-206c6f714ae6 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-655454155", "id": 350545869, "os-flavor-access:is_public": "True"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:26.256093 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:26.256093 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:26.292906 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-77501336-90fa-401a-939b-206c6f714ae6 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.044963 Aug 04 16:33:26.308995 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 178/331] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:33:26 2022] POST /compute/v2.1/flavors => generated 410 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:26.311433 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-30ca9761-d807-408b-bf9a-a088c3f6721e tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:26.345310 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-30ca9761-d807-408b-bf9a-a088c3f6721e tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.038578 Aug 04 16:33:26.347203 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 154/332] 10.222.0.23 () {58 vars in 1169 bytes} [Thu Aug 4 16:33:26 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:26.364131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4e284cdc-147d-4b81-870c-d4a69e05bc29 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:26.388023 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1f7d3af6-7f86-4a46-b57f-45e5ffbe10d6 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:26.389569 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1f7d3af6-7f86-4a46-b57f-45e5ffbe10d6 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: f5548cac-028e-4bca-b862-d471688b9c50] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:26.410948 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4e284cdc-147d-4b81-870c-d4a69e05bc29 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.054696 Aug 04 16:33:26.413079 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 179/333] 10.222.0.23 () {58 vars in 1177 bytes} [Thu Aug 4 16:33:26 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:26.416442 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f7d3af6-7f86-4a46-b57f-45e5ffbe10d6 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:26.417183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f7d3af6-7f86-4a46-b57f-45e5ffbe10d6 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:26.418712 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-cd59b246-2eb0-4216-a19f-32d3675223a9 req-0f04ac41-82ba-49e5-b2da-0cbe127d1cec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ae03eb0-d144-4135-87eb-d8816b9988e8", "name": "network-vif-plugged", "status": "completed", "tag": "29d020a6-de6a-4a60-b380-be4b7724ab85"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:26.422659 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f7d3af6-7f86-4a46-b57f-45e5ffbe10d6 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:26.423148 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f7d3af6-7f86-4a46-b57f-45e5ffbe10d6 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:26.450563 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-cd59b246-2eb0-4216-a19f-32d3675223a9 req-0f04ac41-82ba-49e5-b2da-0cbe127d1cec service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:26.451290 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-cd59b246-2eb0-4216-a19f-32d3675223a9 req-0f04ac41-82ba-49e5-b2da-0cbe127d1cec service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:26.464719 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-cd59b246-2eb0-4216-a19f-32d3675223a9 req-0f04ac41-82ba-49e5-b2da-0cbe127d1cec service nova] Creating event network-vif-plugged:29d020a6-de6a-4a60-b380-be4b7724ab85 for instance 1ae03eb0-d144-4135-87eb-d8816b9988e8 on n-h1-846466-12 Aug 04 16:33:26.474666 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-cd59b246-2eb0-4216-a19f-32d3675223a9 req-0f04ac41-82ba-49e5-b2da-0cbe127d1cec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059767 Aug 04 16:33:26.475993 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 180/334] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:26.482753 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ec912375-4426-4594-b132-c228a62ad35f tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:26.502507 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ec912375-4426-4594-b132-c228a62ad35f tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.024284 Aug 04 16:33:26.503974 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 181/335] 10.222.0.23 () {58 vars in 1171 bytes} [Thu Aug 4 16:33:26 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:26.534188 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b66bd184-53b6-4649-9c0b-a4b375883b9f tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:26.549375 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b66bd184-53b6-4649-9c0b-a4b375883b9f tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.024825 Aug 04 16:33:26.554624 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 182/336] 10.222.0.23 () {58 vars in 1169 bytes} [Thu Aug 4 16:33:26 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:26.566940 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f1fda17a-8b25-4bcd-9e37-fa616735c074 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:26.600785 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f1fda17a-8b25-4bcd-9e37-fa616735c074 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6220 microversion: 2.1 time: 0.037671 Aug 04 16:33:26.603262 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 183/337] 10.222.0.23 () {58 vars in 1169 bytes} [Thu Aug 4 16:33:26 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6220 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:26.627650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0665fedb-eba0-4be9-8718-d5f7a56e2e5d tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:26.660432 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0665fedb-eba0-4be9-8718-d5f7a56e2e5d tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6220 microversion: 2.1 time: 0.040970 Aug 04 16:33:26.678169 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 184/338] 10.222.0.23 () {58 vars in 1175 bytes} [Thu Aug 4 16:33:26 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6220 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:26.686153 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a108ecb6-5167-434c-a954-a84dffa8c623 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:26.722597 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a108ecb6-5167-434c-a954-a84dffa8c623 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6220 microversion: 2.1 time: 0.042918 Aug 04 16:33:26.736370 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 185/339] 10.222.0.23 () {58 vars in 1173 bytes} [Thu Aug 4 16:33:26 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6220 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:26.749880 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8059e155-caa2-4a5c-ab4d-73f515eebb2a tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:26.753764 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8059e155-caa2-4a5c-ab4d-73f515eebb2a tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: 92c85400-67f0-4930-bf61-28770e84b98c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:26.805417 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8059e155-caa2-4a5c-ab4d-73f515eebb2a tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:26.811820 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8059e155-caa2-4a5c-ab4d-73f515eebb2a tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:26.816886 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8059e155-caa2-4a5c-ab4d-73f515eebb2a tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:26.817826 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8059e155-caa2-4a5c-ab4d-73f515eebb2a tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:27.295255 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1f7d3af6-7f86-4a46-b57f-45e5ffbe10d6 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:27.311505 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1f7d3af6-7f86-4a46-b57f-45e5ffbe10d6 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50" status: 200 len: 1469 microversion: 2.1 time: 0.932219 Aug 04 16:33:27.312090 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 155/340] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:26 2022] GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50 => generated 1469 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:33:27.340527 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1c12aebd-4f9f-4c59-9d17-d1f3080f55cc tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:27.407776 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1c12aebd-4f9f-4c59-9d17-d1f3080f55cc tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6220 microversion: 2.1 time: 0.075610 Aug 04 16:33:27.409513 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 156/341] 10.222.0.23 () {58 vars in 1169 bytes} [Thu Aug 4 16:33:27 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6220 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:27.415992 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1e6644a7-7743-4439-bd63-f4c1fbe90130 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:27.416601 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1e6644a7-7743-4439-bd63-f4c1fbe90130 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: 1ae03eb0-d144-4135-87eb-d8816b9988e8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:27.418735 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=17,nova_api:INSERT=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:33:27.432393 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1e6644a7-7743-4439-bd63-f4c1fbe90130 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:27.433178 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1e6644a7-7743-4439-bd63-f4c1fbe90130 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:27.434387 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1e6644a7-7743-4439-bd63-f4c1fbe90130 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:27.434983 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1e6644a7-7743-4439-bd63-f4c1fbe90130 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:27.969089 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8059e155-caa2-4a5c-ab4d-73f515eebb2a tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c73c354a6ee4ab881f483ff65a21dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cb965024d94d7cae0c5652212e7cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:27.985646 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8059e155-caa2-4a5c-ab4d-73f515eebb2a tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c" status: 200 len: 1321 microversion: 2.1 time: 1.244725 Aug 04 16:33:27.986774 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 186/342] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:26 2022] GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c => generated 1321 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:28.015295 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0a3ceef6-e5c3-40aa-9e9e-67019b489f69 tempest-DeleteServersAdminTestJSON-608170302 tempest-DeleteServersAdminTestJSON-608170302-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:28.024651 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0a3ceef6-e5c3-40aa-9e9e-67019b489f69 tempest-DeleteServersAdminTestJSON-608170302 tempest-DeleteServersAdminTestJSON-608170302-project-admin] [instance: f5548cac-028e-4bca-b862-d471688b9c50] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:28.046779 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0a3ceef6-e5c3-40aa-9e9e-67019b489f69 tempest-DeleteServersAdminTestJSON-608170302 tempest-DeleteServersAdminTestJSON-608170302-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:28.047545 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0a3ceef6-e5c3-40aa-9e9e-67019b489f69 tempest-DeleteServersAdminTestJSON-608170302 tempest-DeleteServersAdminTestJSON-608170302-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:28.050117 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0a3ceef6-e5c3-40aa-9e9e-67019b489f69 tempest-DeleteServersAdminTestJSON-608170302 tempest-DeleteServersAdminTestJSON-608170302-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:28.050882 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0a3ceef6-e5c3-40aa-9e9e-67019b489f69 tempest-DeleteServersAdminTestJSON-608170302 tempest-DeleteServersAdminTestJSON-608170302-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:28.191433 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1e6644a7-7743-4439-bd63-f4c1fbe90130 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052613a51b86400c916dbc800563896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0ceaab59d4aeaa8667cef6f62559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:28.205697 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1e6644a7-7743-4439-bd63-f4c1fbe90130 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8" status: 200 len: 1319 microversion: 2.1 time: 0.794167 Aug 04 16:33:28.206503 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 157/343] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:27 2022] GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8 => generated 1319 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:28.221474 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5d6f761f-e753-413c-b4c1-09f2d93ff808 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:28.227700 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:28.227700 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:28.295920 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5d6f761f-e753-413c-b4c1-09f2d93ff808 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/350545869" status: 202 len: 0 microversion: 2.1 time: 0.078078 Aug 04 16:33:28.296525 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 158/344] 10.222.0.23 () {58 vars in 1158 bytes} [Thu Aug 4 16:33:28 2022] DELETE /compute/v2.1/flavors/350545869 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:33:28.367991 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0a3ceef6-e5c3-40aa-9e9e-67019b489f69 tempest-DeleteServersAdminTestJSON-608170302 tempest-DeleteServersAdminTestJSON-608170302-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50/action" status: 202 len: 0 microversion: 2.1 time: 0.363110 Aug 04 16:33:28.368673 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 187/345] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:33:27 2022] POST /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:33:28.391036 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-612e14bb-0ea9-4592-9692-2540e3fcef9d tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:28.482620 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-612e14bb-0ea9-4592-9692-2540e3fcef9d tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.112779 Aug 04 16:33:28.483443 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 188/346] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:33:28 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:28.498813 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6daa3285-ee3d-43c4-b556-63faec7a8a49 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:28.499690 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6daa3285-ee3d-43c4-b556-63faec7a8a49 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: f5548cac-028e-4bca-b862-d471688b9c50] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:28.512988 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6daa3285-ee3d-43c4-b556-63faec7a8a49 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:28.514309 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6daa3285-ee3d-43c4-b556-63faec7a8a49 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:28.517531 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6daa3285-ee3d-43c4-b556-63faec7a8a49 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:28.519430 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6daa3285-ee3d-43c4-b556-63faec7a8a49 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:28.617140 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d6ea922d-6769-4aa4-b47a-d59f392ec10c tempest-AZAdminV2TestJSON-1071446079 tempest-AZAdminV2TestJSON-1071446079-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:28.618964 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d6ea922d-6769-4aa4-b47a-d59f392ec10c tempest-AZAdminV2TestJSON-1071446079 tempest-AZAdminV2TestJSON-1071446079-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:28.619411 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d6ea922d-6769-4aa4-b47a-d59f392ec10c tempest-AZAdminV2TestJSON-1071446079 tempest-AZAdminV2TestJSON-1071446079-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:28.620216 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d6ea922d-6769-4aa4-b47a-d59f392ec10c tempest-AZAdminV2TestJSON-1071446079 tempest-AZAdminV2TestJSON-1071446079-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:28.620639 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d6ea922d-6769-4aa4-b47a-d59f392ec10c tempest-AZAdminV2TestJSON-1071446079 tempest-AZAdminV2TestJSON-1071446079-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:28.622296 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6daa3285-ee3d-43c4-b556-63faec7a8a49 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:28.622735 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6daa3285-ee3d-43c4-b556-63faec7a8a49 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:28.623185 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-6daa3285-ee3d-43c4-b556-63faec7a8a49 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lazy-loading 'fault' on Instance uuid f5548cac-028e-4bca-b862-d471688b9c50 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:33:28.703694 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d6ea922d-6769-4aa4-b47a-d59f392ec10c tempest-AZAdminV2TestJSON-1071446079 tempest-AZAdminV2TestJSON-1071446079-project-admin] 10.222.0.23 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.405594 Aug 04 16:33:28.711736 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 159/347] 10.222.0.23 () {58 vars in 1164 bytes} [Thu Aug 4 16:33:28 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:33:28.716706 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-176bb975-0026-4d57-b484-e9d69300c198 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:28.717573 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:28.717573 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:28.760321 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-176bb975-0026-4d57-b484-e9d69300c198 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/604704272" status: 202 len: 0 microversion: 2.1 time: 0.047055 Aug 04 16:33:28.760917 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 160/348] 10.222.0.23 () {58 vars in 1158 bytes} [Thu Aug 4 16:33:28 2022] DELETE /compute/v2.1/flavors/604704272 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:33:28.766180 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b647564d-7571-4c29-bd7d-76ae0fc134d8 tempest-AZAdminV2TestJSON-1071446079 tempest-AZAdminV2TestJSON-1071446079-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:28.767544 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:28.767544 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:28.778892 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b647564d-7571-4c29-bd7d-76ae0fc134d8 tempest-AZAdminV2TestJSON-1071446079 tempest-AZAdminV2TestJSON-1071446079-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:28.779609 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b647564d-7571-4c29-bd7d-76ae0fc134d8 tempest-AZAdminV2TestJSON-1071446079 tempest-AZAdminV2TestJSON-1071446079-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:28.780605 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b647564d-7571-4c29-bd7d-76ae0fc134d8 tempest-AZAdminV2TestJSON-1071446079 tempest-AZAdminV2TestJSON-1071446079-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:28.781230 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b647564d-7571-4c29-bd7d-76ae0fc134d8 tempest-AZAdminV2TestJSON-1071446079 tempest-AZAdminV2TestJSON-1071446079-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:28.832235 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b647564d-7571-4c29-bd7d-76ae0fc134d8 tempest-AZAdminV2TestJSON-1071446079 tempest-AZAdminV2TestJSON-1071446079-project-admin] 10.222.0.23 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.069808 Aug 04 16:33:28.842435 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 161/349] 10.222.0.23 () {58 vars in 1185 bytes} [Thu Aug 4 16:33:28 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:28.847250 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8f501d7e-984a-4dc9-b2e4-0b53a2fc8823 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:28.895392 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8f501d7e-984a-4dc9-b2e4-0b53a2fc8823 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.051660 Aug 04 16:33:28.905735 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 162/350] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:33:28 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:28.919599 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-01432d06-2d57-4d02-9abe-93a1423b67c6 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1021214421", "id": 615569542, "os-flavor-access:is_public": "False"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:28.923317 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:28.923317 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:28.956674 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-01432d06-2d57-4d02-9abe-93a1423b67c6 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.040667 Aug 04 16:33:28.957204 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 163/351] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:33:28 2022] POST /compute/v2.1/flavors => generated 412 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:28.969140 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4f4a3967-1207-44fe-b780-9a70f6e1516c tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:29.034732 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4f4a3967-1207-44fe-b780-9a70f6e1516c tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.067744 Aug 04 16:33:29.040375 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 164/352] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:33:28 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:33:29.046020 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1f8725ad-2cae-49e2-a1f9-eb2ef62a472d tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:29.061109 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1f8725ad-2cae-49e2-a1f9-eb2ef62a472d tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: 92c85400-67f0-4930-bf61-28770e84b98c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:29.079466 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f8725ad-2cae-49e2-a1f9-eb2ef62a472d tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:29.079907 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f8725ad-2cae-49e2-a1f9-eb2ef62a472d tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:29.081244 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f8725ad-2cae-49e2-a1f9-eb2ef62a472d tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:29.082066 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f8725ad-2cae-49e2-a1f9-eb2ef62a472d tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:29.249571 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=7 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:33:29.469487 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6daa3285-ee3d-43c4-b556-63faec7a8a49 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:29.493426 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6daa3285-ee3d-43c4-b556-63faec7a8a49 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50" status: 200 len: 1452 microversion: 2.1 time: 1.008512 Aug 04 16:33:29.494822 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 189/353] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:28 2022] GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50 => generated 1452 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:29.500022 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-05536a4c-da64-47db-b431-b73e3aa7b83f tempest-FlavorsAdminTestJSON-27971472 tempest-FlavorsAdminTestJSON-27971472-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:29.565910 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-05536a4c-da64-47db-b431-b73e3aa7b83f tempest-FlavorsAdminTestJSON-27971472 tempest-FlavorsAdminTestJSON-27971472-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.069459 Aug 04 16:33:29.566516 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 190/354] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:33:29 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:29.583690 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f8615be3-72b1-4558-88f9-03e2adbc6796 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:29.584374 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f8615be3-72b1-4558-88f9-03e2adbc6796 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: 1ae03eb0-d144-4135-87eb-d8816b9988e8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:29.591688 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f8615be3-72b1-4558-88f9-03e2adbc6796 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:29.592671 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f8615be3-72b1-4558-88f9-03e2adbc6796 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:29.593662 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f8615be3-72b1-4558-88f9-03e2adbc6796 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:29.594150 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f8615be3-72b1-4558-88f9-03e2adbc6796 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:29.753514 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=8 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:33:29.914651 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1f8725ad-2cae-49e2-a1f9-eb2ef62a472d tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c73c354a6ee4ab881f483ff65a21dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cb965024d94d7cae0c5652212e7cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:29.924681 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1f8725ad-2cae-49e2-a1f9-eb2ef62a472d tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c" status: 200 len: 1321 microversion: 2.1 time: 0.881378 Aug 04 16:33:29.936538 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 165/355] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:29 2022] GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c => generated 1321 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:29.944016 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-300e0866-41cb-4e94-b4d9-5b4c7723739e tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:29.952776 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-300e0866-41cb-4e94-b4d9-5b4c7723739e tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: f5548cac-028e-4bca-b862-d471688b9c50] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:29.973174 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-300e0866-41cb-4e94-b4d9-5b4c7723739e tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:29.973735 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-300e0866-41cb-4e94-b4d9-5b4c7723739e tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:29.974632 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-300e0866-41cb-4e94-b4d9-5b4c7723739e tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:29.975369 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-300e0866-41cb-4e94-b4d9-5b4c7723739e tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:30.007124 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-300e0866-41cb-4e94-b4d9-5b4c7723739e tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: f5548cac-028e-4bca-b862-d471688b9c50] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:33:30.178009 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-300e0866-41cb-4e94-b4d9-5b4c7723739e tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50" status: 204 len: 0 microversion: 2.1 time: 0.238025 Aug 04 16:33:30.183093 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 166/356] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:33:29 2022] DELETE /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:33:30.189778 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-95e23327-5def-4a77-84ef-14f531b67ffd tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:30.191519 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:30.191519 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:30.215637 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-95e23327-5def-4a77-84ef-14f531b67ffd tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/615569542" status: 202 len: 0 microversion: 2.1 time: 0.029040 Aug 04 16:33:30.218118 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 167/357] 10.222.0.23 () {58 vars in 1158 bytes} [Thu Aug 4 16:33:30 2022] DELETE /compute/v2.1/flavors/615569542 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:33:30.244194 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-01313169-3d3d-4bbd-9177-7d343c733508 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:30.246737 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-01313169-3d3d-4bbd-9177-7d343c733508 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: f5548cac-028e-4bca-b862-d471688b9c50] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:30.260062 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-01313169-3d3d-4bbd-9177-7d343c733508 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:30.261799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-01313169-3d3d-4bbd-9177-7d343c733508 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:30.262983 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-01313169-3d3d-4bbd-9177-7d343c733508 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:30.263635 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-01313169-3d3d-4bbd-9177-7d343c733508 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:30.297830 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:33:30.300910 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f8615be3-72b1-4558-88f9-03e2adbc6796 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052613a51b86400c916dbc800563896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0ceaab59d4aeaa8667cef6f62559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:30.311110 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f8615be3-72b1-4558-88f9-03e2adbc6796 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8" status: 200 len: 1468 microversion: 2.1 time: 0.739525 Aug 04 16:33:30.317419 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 191/358] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:29 2022] GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8 => generated 1468 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:30.320535 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-01313169-3d3d-4bbd-9177-7d343c733508 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:30.321029 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-01313169-3d3d-4bbd-9177-7d343c733508 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:30.321528 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-01313169-3d3d-4bbd-9177-7d343c733508 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lazy-loading 'fault' on Instance uuid f5548cac-028e-4bca-b862-d471688b9c50 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:33:30.323058 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-88b25901-35a3-458c-b2cb-b5260c4d57d4 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:30.366390 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-88b25901-35a3-458c-b2cb-b5260c4d57d4 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.047135 Aug 04 16:33:30.387916 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 192/359] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:33:30 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:30.393517 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-786ef365-d771-4bb8-9a0b-dea812f8e038 tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:30.399620 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-786ef365-d771-4bb8-9a0b-dea812f8e038 tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] [instance: 1ae03eb0-d144-4135-87eb-d8816b9988e8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:30.419043 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-786ef365-d771-4bb8-9a0b-dea812f8e038 tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:30.422072 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-786ef365-d771-4bb8-9a0b-dea812f8e038 tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:30.422993 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-786ef365-d771-4bb8-9a0b-dea812f8e038 tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:30.423436 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-786ef365-d771-4bb8-9a0b-dea812f8e038 tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:30.484161 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:33:30.498596 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-786ef365-d771-4bb8-9a0b-dea812f8e038 tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] Lazy-loading 'flavor' on Instance uuid 1ae03eb0-d144-4135-87eb-d8816b9988e8 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:33:30.638442 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-786ef365-d771-4bb8-9a0b-dea812f8e038 tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8/action" status: 202 len: 0 microversion: 2.1 time: 0.248886 Aug 04 16:33:30.639076 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 193/360] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:33:30 2022] POST /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:33:30.653128 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7d23dbd5-a5fa-485b-8799-4b473870c94f tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-22633563", "id": 1211015247, "os-flavor-access:is_public": "True"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:30.669740 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:30.669740 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:30.703566 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7d23dbd5-a5fa-485b-8799-4b473870c94f tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.059846 Aug 04 16:33:30.705543 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 194/361] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:33:30 2022] POST /compute/v2.1/flavors => generated 412 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:30.717941 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9fea4116-4c5c-4877-812c-7e8810f6e5fa tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:30.718991 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9fea4116-4c5c-4877-812c-7e8810f6e5fa tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: 1ae03eb0-d144-4135-87eb-d8816b9988e8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:30.727200 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9fea4116-4c5c-4877-812c-7e8810f6e5fa tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:30.727693 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9fea4116-4c5c-4877-812c-7e8810f6e5fa tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:30.728494 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9fea4116-4c5c-4877-812c-7e8810f6e5fa tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:30.728918 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9fea4116-4c5c-4877-812c-7e8810f6e5fa tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:31.011465 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-01313169-3d3d-4bbd-9177-7d343c733508 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:31.020308 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-01313169-3d3d-4bbd-9177-7d343c733508 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50" status: 200 len: 1458 microversion: 2.1 time: 0.800601 Aug 04 16:33:31.021810 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 168/362] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:30 2022] GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50 => generated 1458 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:31.027740 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b0d20b67-9847-4031-a44f-5838732d8121 tempest-FlavorsAdminTestJSON-27971472 tempest-FlavorsAdminTestJSON-27971472-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:31.065613 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b0d20b67-9847-4031-a44f-5838732d8121 tempest-FlavorsAdminTestJSON-27971472 tempest-FlavorsAdminTestJSON-27971472-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6222 microversion: 2.1 time: 0.042110 Aug 04 16:33:31.080910 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 169/363] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:33:31 2022] GET /compute/v2.1/flavors/detail => generated 6222 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:31.087785 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a81be94c-8ca5-421c-993b-b8720afc7ece tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:31.088564 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a81be94c-8ca5-421c-993b-b8720afc7ece tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: 92c85400-67f0-4930-bf61-28770e84b98c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:31.096222 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a81be94c-8ca5-421c-993b-b8720afc7ece tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:31.096665 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a81be94c-8ca5-421c-993b-b8720afc7ece tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:31.097753 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a81be94c-8ca5-421c-993b-b8720afc7ece tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:31.098204 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a81be94c-8ca5-421c-993b-b8720afc7ece tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:31.773607 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9fea4116-4c5c-4877-812c-7e8810f6e5fa tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052613a51b86400c916dbc800563896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0ceaab59d4aeaa8667cef6f62559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:31.787123 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9fea4116-4c5c-4877-812c-7e8810f6e5fa tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8" status: 200 len: 1476 microversion: 2.1 time: 1.080190 Aug 04 16:33:31.788715 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 195/364] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:30 2022] GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8 => generated 1476 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:31.797331 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-26d9faad-e102-4f2c-81f5-57ae943df861 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:31.798695 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:31.798695 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:31.826089 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-26d9faad-e102-4f2c-81f5-57ae943df861 tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1211015247" status: 202 len: 0 microversion: 2.1 time: 0.034397 Aug 04 16:33:31.827149 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 196/365] 10.222.0.23 () {58 vars in 1161 bytes} [Thu Aug 4 16:33:31 2022] DELETE /compute/v2.1/flavors/1211015247 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:33:31.858000 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-1b7c1878-4066-481e-9041-6dba3937902f req-029a2522-dbf1-4a95-9efa-90d8388a591d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92c85400-67f0-4930-bf61-28770e84b98c", "tag": "39a2a768-1a97-4d6f-ba46-987474d856d5"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:31.880790 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-1b7c1878-4066-481e-9041-6dba3937902f req-029a2522-dbf1-4a95-9efa-90d8388a591d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:31.881570 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-1b7c1878-4066-481e-9041-6dba3937902f req-029a2522-dbf1-4a95-9efa-90d8388a591d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:31.898059 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-1b7c1878-4066-481e-9041-6dba3937902f req-029a2522-dbf1-4a95-9efa-90d8388a591d service nova] Creating event network-changed:39a2a768-1a97-4d6f-ba46-987474d856d5 for instance 92c85400-67f0-4930-bf61-28770e84b98c on n-h2-846466-12 Aug 04 16:33:31.906270 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-1b7c1878-4066-481e-9041-6dba3937902f req-029a2522-dbf1-4a95-9efa-90d8388a591d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075305 Aug 04 16:33:31.908057 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 197/366] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:31.916667 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e91a6b3d-a5d8-408e-beb4-1c53e6797aae tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:31.944407 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e91a6b3d-a5d8-408e-beb4-1c53e6797aae tempest-FlavorsAdminTestJSON-850945434 tempest-FlavorsAdminTestJSON-850945434-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.034678 Aug 04 16:33:31.945589 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 198/367] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:33:31 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:32.043729 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f5e78648-c60e-47bd-8857-10059393342b tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:32.045118 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f5e78648-c60e-47bd-8857-10059393342b tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: f5548cac-028e-4bca-b862-d471688b9c50] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:32.070676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f5e78648-c60e-47bd-8857-10059393342b tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:32.071148 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f5e78648-c60e-47bd-8857-10059393342b tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:32.074318 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f5e78648-c60e-47bd-8857-10059393342b tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:32.084365 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f5e78648-c60e-47bd-8857-10059393342b tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:32.184001 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f5e78648-c60e-47bd-8857-10059393342b tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:32.185517 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f5e78648-c60e-47bd-8857-10059393342b tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:32.186163 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-f5e78648-c60e-47bd-8857-10059393342b tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lazy-loading 'fault' on Instance uuid f5548cac-028e-4bca-b862-d471688b9c50 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:33:32.378752 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a81be94c-8ca5-421c-993b-b8720afc7ece tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c73c354a6ee4ab881f483ff65a21dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cb965024d94d7cae0c5652212e7cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:32.395101 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a81be94c-8ca5-421c-993b-b8720afc7ece tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c" status: 200 len: 1321 microversion: 2.1 time: 1.312142 Aug 04 16:33:32.402719 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 170/368] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:31 2022] GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c => generated 1321 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:32.754949 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f5e78648-c60e-47bd-8857-10059393342b tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:32.763964 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f5e78648-c60e-47bd-8857-10059393342b tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50" status: 200 len: 1458 microversion: 2.1 time: 0.725004 Aug 04 16:33:32.765021 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 199/369] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:32 2022] GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50 => generated 1458 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:32.808657 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-aefb554e-732a-4669-b3aa-652f2bd40024 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:32.811999 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-aefb554e-732a-4669-b3aa-652f2bd40024 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: 1ae03eb0-d144-4135-87eb-d8816b9988e8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:32.822369 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aefb554e-732a-4669-b3aa-652f2bd40024 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:32.822921 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aefb554e-732a-4669-b3aa-652f2bd40024 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:32.824127 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aefb554e-732a-4669-b3aa-652f2bd40024 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:32.824625 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aefb554e-732a-4669-b3aa-652f2bd40024 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:33.385455 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-aefb554e-732a-4669-b3aa-652f2bd40024 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052613a51b86400c916dbc800563896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0ceaab59d4aeaa8667cef6f62559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:33.400513 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-aefb554e-732a-4669-b3aa-652f2bd40024 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8" status: 200 len: 1459 microversion: 2.1 time: 0.595951 Aug 04 16:33:33.402075 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 171/370] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:32 2022] GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8 => generated 1459 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:33.417484 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c4497f84-f41e-414d-9492-bf8d25324791 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:33.418679 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c4497f84-f41e-414d-9492-bf8d25324791 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: 92c85400-67f0-4930-bf61-28770e84b98c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:33.428655 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4497f84-f41e-414d-9492-bf8d25324791 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:33.430366 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a64f2224-8169-4150-8d18-b7a787dfbd73 tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:33.434847 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4497f84-f41e-414d-9492-bf8d25324791 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:33.435461 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a64f2224-8169-4150-8d18-b7a787dfbd73 tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] [instance: 1ae03eb0-d144-4135-87eb-d8816b9988e8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:33.436218 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4497f84-f41e-414d-9492-bf8d25324791 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:33.436801 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4497f84-f41e-414d-9492-bf8d25324791 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:33.471444 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a64f2224-8169-4150-8d18-b7a787dfbd73 tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:33.472754 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a64f2224-8169-4150-8d18-b7a787dfbd73 tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:33.476811 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a64f2224-8169-4150-8d18-b7a787dfbd73 tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:33.478951 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a64f2224-8169-4150-8d18-b7a787dfbd73 tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:34.142309 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c4497f84-f41e-414d-9492-bf8d25324791 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c73c354a6ee4ab881f483ff65a21dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cb965024d94d7cae0c5652212e7cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:34.150223 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c4497f84-f41e-414d-9492-bf8d25324791 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c" status: 200 len: 1321 microversion: 2.1 time: 0.737467 Aug 04 16:33:34.162034 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 200/371] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:33 2022] GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c => generated 1321 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:34.167583 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1e1f6291-e203-40e1-994c-8d4b782507e5 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:34.167583 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1e1f6291-e203-40e1-994c-8d4b782507e5 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: f5548cac-028e-4bca-b862-d471688b9c50] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:34.175154 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1e1f6291-e203-40e1-994c-8d4b782507e5 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:34.175593 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1e1f6291-e203-40e1-994c-8d4b782507e5 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:34.189180 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1e1f6291-e203-40e1-994c-8d4b782507e5 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:34.189770 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1e1f6291-e203-40e1-994c-8d4b782507e5 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:34.232747 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1e1f6291-e203-40e1-994c-8d4b782507e5 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:34.233223 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1e1f6291-e203-40e1-994c-8d4b782507e5 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:34.233982 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-1e1f6291-e203-40e1-994c-8d4b782507e5 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lazy-loading 'fault' on Instance uuid f5548cac-028e-4bca-b862-d471688b9c50 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:33:34.304663 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1e1f6291-e203-40e1-994c-8d4b782507e5 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc6220916eb443387bbf353c267342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f665aa7b40ce4198a7958d9c382058f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:34.312683 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1e1f6291-e203-40e1-994c-8d4b782507e5 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50" status: 200 len: 1288 microversion: 2.1 time: 0.157989 Aug 04 16:33:34.313260 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 201/372] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:34 2022] GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50 => generated 1288 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:34.333081 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-b3cf0451-6b9a-4eca-b051-8b2a36a8cd40 req-81423f2c-2053-4dc7-a227-5b2fb9a42692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5548cac-028e-4bca-b862-d471688b9c50", "name": "network-vif-deleted", "tag": "5bca5e77-28f1-4d92-ae07-3a6f6331f63e"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:34.351572 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-b3cf0451-6b9a-4eca-b051-8b2a36a8cd40 req-81423f2c-2053-4dc7-a227-5b2fb9a42692 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:34.352026 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-b3cf0451-6b9a-4eca-b051-8b2a36a8cd40 req-81423f2c-2053-4dc7-a227-5b2fb9a42692 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:34.368763 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-b3cf0451-6b9a-4eca-b051-8b2a36a8cd40 req-81423f2c-2053-4dc7-a227-5b2fb9a42692 service nova] Creating event network-vif-deleted:5bca5e77-28f1-4d92-ae07-3a6f6331f63e for instance f5548cac-028e-4bca-b862-d471688b9c50 on n-h2-846466-12 Aug 04 16:33:34.376671 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-b3cf0451-6b9a-4eca-b051-8b2a36a8cd40 req-81423f2c-2053-4dc7-a227-5b2fb9a42692 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053740 Aug 04 16:33:34.377591 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 202/373] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:34.512100 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a64f2224-8169-4150-8d18-b7a787dfbd73 tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8" status: 200 len: 1612 microversion: 2.1 time: 1.091630 Aug 04 16:33:34.531494 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 172/374] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:33 2022] GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8 => generated 1612 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:33:34.534639 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4b1ed869-621e-481a-8694-b70a356ea359 tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:34.538030 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:34.538030 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:34.539973 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4b1ed869-621e-481a-8694-b70a356ea359 tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:34.541617 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4b1ed869-621e-481a-8694-b70a356ea359 tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:34.544707 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4b1ed869-621e-481a-8694-b70a356ea359 tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:34.545526 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4b1ed869-621e-481a-8694-b70a356ea359 tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:34.609470 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4b1ed869-621e-481a-8694-b70a356ea359 tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.079143 Aug 04 16:33:34.611028 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 173/375] 10.222.0.23 () {58 vars in 1176 bytes} [Thu Aug 4 16:33:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:34.644277 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-79f47fe4-f2ef-45e0-a5eb-7b05997b41ec tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-846466-12", "block_migration": true, "disk_over_commit": false}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:34.653169 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-79f47fe4-f2ef-45e0-a5eb-7b05997b41ec tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] [instance: 1ae03eb0-d144-4135-87eb-d8816b9988e8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:34.663910 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-79f47fe4-f2ef-45e0-a5eb-7b05997b41ec tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:34.664623 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-79f47fe4-f2ef-45e0-a5eb-7b05997b41ec tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:34.666606 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-79f47fe4-f2ef-45e0-a5eb-7b05997b41ec tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:34.667764 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-79f47fe4-f2ef-45e0-a5eb-7b05997b41ec tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:34.756889 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0a29648a-ad18-44e6-8423-1ddebd1a933b tempest-AZAdminNegativeTestJSON-1941282688 tempest-AZAdminNegativeTestJSON-1941282688-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:34.758676 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:34.758676 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:34.760577 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0a29648a-ad18-44e6-8423-1ddebd1a933b tempest-AZAdminNegativeTestJSON-1941282688 tempest-AZAdminNegativeTestJSON-1941282688-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'b8777e9b73c04691a800cbf401633afe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54368de71c34ba98315f03043a34900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:34.765686 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0a29648a-ad18-44e6-8423-1ddebd1a933b tempest-AZAdminNegativeTestJSON-1941282688 tempest-AZAdminNegativeTestJSON-1941282688-project] Request method failure captured: Aug 04 16:33:34.765686 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 04 16:33:34.765686 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:33:34.765686 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:33:34.765686 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:33:34.765686 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:33:34.765686 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:33:34.765686 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:33:34.765686 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:33:34.765686 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:34.765686 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_TcY1S0ex3bl69HpmYmaRlV6m14xMzay50FA3R4qpW0eEd8ZjtayT75ZIl-N_ulXGq9ipDL_JHi-NtMmuS5yiSuZAhbo7JTkZBwdF5wKyeQuRweUycyEhVsdToxpN65iKy9r93JaPLke8iRtWZoIk6gi-C42HBqk2hGc6tOYIbk6t0 Aug 04 16:33:34.765686 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:33:34.765686 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:33:34.765686 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:33:34.765686 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:33:34.765686 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:33:34.765686 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:33:34.765686 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: e54368de71c34ba98315f03043a34900 Aug 04 16:33:34.765686 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1941282688 Aug 04 16:33:34.765686 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:33:34.765686 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:33:34.767580 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e54368de71c34ba98315f03043a34900"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e54368de71c34ba98315f03043a34900"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e54368de71c34ba98315f03043a34900"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e54368de71c34ba98315f03043a34900"}]}] Aug 04 16:33:34.767580 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-AZAdminNegativeTestJSON-1941282688 Aug 04 16:33:34.767580 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: e54368de71c34ba98315f03043a34900 Aug 04 16:33:34.767580 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1941282688 Aug 04 16:33:34.767580 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-AZAdminNegativeTestJSON-1941282688-project Aug 04 16:33:34.767580 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:33:34.767580 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:33:34.767580 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: b8777e9b73c04691a800cbf401633afe Aug 04 16:33:34.767580 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-AZAdminNegativeTestJSON-1941282688-project Aug 04 16:33:34.767580 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:33:34.767580 n-d-846466-12 devstack@n-api.service[126126]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 04 16:33:34.767580 n-d-846466-12 devstack@n-api.service[126126]: action_args: {} Aug 04 16:33:34.768553 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:34.768553 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:34.768553 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:34.768553 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:34.768553 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:34.768553 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:34.768553 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:34.768553 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:34.768553 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 04 16:33:34.768553 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 04 16:33:34.768553 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:33:34.768553 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:33:34.768553 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:33:34.768553 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:33:34.768553 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:33:34.768553 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:33:34.768553 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:33:34.768553 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:33:34.768553 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:33:34.771121 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:33:34.771121 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:33:34.771121 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:33:34.771121 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:33:34.771121 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:33:34.771121 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 04 16:33:34.771121 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:34.771121 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:34.771121 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:34.771121 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:34.771121 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:34.771121 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:34.771121 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:33:34.771121 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:33:34.771121 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 04 16:33:34.771121 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:34.776290 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0a29648a-ad18-44e6-8423-1ddebd1a933b tempest-AZAdminNegativeTestJSON-1941282688 tempest-AZAdminNegativeTestJSON-1941282688-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:34.779213 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0a29648a-ad18-44e6-8423-1ddebd1a933b tempest-AZAdminNegativeTestJSON-1941282688 tempest-AZAdminNegativeTestJSON-1941282688-project] 10.222.0.23 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.398087 Aug 04 16:33:34.781561 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 203/376] 10.222.0.23 () {58 vars in 1185 bytes} [Thu Aug 4 16:33:34 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 403 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:33:35.175388 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9d8dde4a-f35b-4653-8b99-cb324926acec tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:35.176596 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9d8dde4a-f35b-4653-8b99-cb324926acec tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: 92c85400-67f0-4930-bf61-28770e84b98c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:35.204998 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d8dde4a-f35b-4653-8b99-cb324926acec tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:35.205486 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d8dde4a-f35b-4653-8b99-cb324926acec tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:35.206293 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d8dde4a-f35b-4653-8b99-cb324926acec tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:35.219460 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d8dde4a-f35b-4653-8b99-cb324926acec tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:35.546734 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-79f47fe4-f2ef-45e0-a5eb-7b05997b41ec tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] Lazy-loading 'flavor' on Instance uuid 1ae03eb0-d144-4135-87eb-d8816b9988e8 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:33:35.688016 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-79f47fe4-f2ef-45e0-a5eb-7b05997b41ec tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 1ae03eb0-d144-4135-87eb-d8816b9988e8 while it is in vm_state suspended Aug 04 16:33:35.690617 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-79f47fe4-f2ef-45e0-a5eb-7b05997b41ec tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] Request method failure captured: Aug 04 16:33:35.690617 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8/action HTTP/1.1 Aug 04 16:33:35.690617 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:33:35.690617 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:33:35.690617 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:33:35.690617 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 98 Aug 04 16:33:35.690617 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:33:35.690617 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:33:35.690617 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:33:35.690617 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:35.690617 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_SciJ2Xm5QZWtK-zOVftY2swQNK19Rw0MRNnSEThmobyNwyKoiOCIzRCxACbuDbmoaFo8fqRcFP8CDKIvr4Mao24NLUb-KlCooK1e8RAB6PXdY1IYSMBrGRDnNKNfEygP52T1fUQIzTJ3LPv1zLuvpDTHaGzv_MyR0aXvqE5mhv4yM Aug 04 16:33:35.690617 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:33:35.690617 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:33:35.690617 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:33:35.690617 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:33:35.690617 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:33:35.690617 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:33:35.690617 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 7cc5a5606209492691c8408539c3b395 Aug 04 16:33:35.690617 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-LiveMigrationNegativeTest-219743403 Aug 04 16:33:35.690617 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader,admin Aug 04 16:33:35.690617 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader,admin Aug 04 16:33:35.691866 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7cc5a5606209492691c8408539c3b395"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7cc5a5606209492691c8408539c3b395"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7cc5a5606209492691c8408539c3b395"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7cc5a5606209492691c8408539c3b395"}]}] Aug 04 16:33:35.691866 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-LiveMigrationNegativeTest-219743403 Aug 04 16:33:35.691866 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 7cc5a5606209492691c8408539c3b395 Aug 04 16:33:35.691866 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-219743403 Aug 04 16:33:35.691866 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-LiveMigrationNegativeTest-219743403-project-admin Aug 04 16:33:35.691866 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:33:35.691866 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:33:35.691866 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: bed18f1355f74759849faf9901e22303 Aug 04 16:33:35.691866 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-LiveMigrationNegativeTest-219743403-project-admin Aug 04 16:33:35.691866 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:33:35.691866 n-d-846466-12 devstack@n-api.service[126125]: {"os-migrateLive": {"host": "n-h2-846466-12", "block_migration": true, "disk_over_commit": false}} Aug 04 16:33:35.691866 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:33:35.692613 n-d-846466-12 devstack@n-api.service[126125]: exception: Cannot 'os-migrateLive' instance 1ae03eb0-d144-4135-87eb-d8816b9988e8 while it is in vm_state suspended Aug 04 16:33:35.692613 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '1ae03eb0-d144-4135-87eb-d8816b9988e8', 'body': {'os-migrateLive': {'host': 'n-h2-846466-12', 'block_migration': True, 'disk_over_commit': False}}} Aug 04 16:33:35.692613 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:35.692613 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:35.692613 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 04 16:33:35.692613 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 04 16:33:35.692613 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 04 16:33:35.692613 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 16:33:35.692613 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 04 16:33:35.692613 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 16:33:35.692613 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 04 16:33:35.692613 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 16:33:35.692613 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 16:33:35.692613 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 16:33:35.692613 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 04 16:33:35.692613 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 16:33:35.692613 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 04 16:33:35.692613 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 16:33:35.694267 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 16:33:35.694267 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 16:33:35.694267 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 16:33:35.694267 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 16:33:35.694267 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1ae03eb0-d144-4135-87eb-d8816b9988e8 in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 04 16:33:35.694267 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:35.694267 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:35.694267 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:35.694267 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:35.694267 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:35.694267 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:35.694267 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:35.694267 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:35.694267 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:35.694267 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:35.694267 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:33:35.694267 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:33:35.694267 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:33:35.694267 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:33:35.694267 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:33:35.695792 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:33:35.695792 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 04 16:33:35.695792 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 04 16:33:35.695792 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 16:33:35.695792 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 16:33:35.695792 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 16:33:35.695792 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 1ae03eb0-d144-4135-87eb-d8816b9988e8 while it is in vm_state suspended Aug 04 16:33:35.695792 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:35.695792 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:35.695792 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:35.695792 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:35.695792 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:35.695792 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:35.695792 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:33:35.695792 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:33:35.695792 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 1ae03eb0-d144-4135-87eb-d8816b9988e8 while it is in vm_state suspended Aug 04 16:33:35.695792 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:35.697008 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-79f47fe4-f2ef-45e0-a5eb-7b05997b41ec tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 1ae03eb0-d144-4135-87eb-d8816b9988e8 while it is in vm_state suspended {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:35.697008 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-79f47fe4-f2ef-45e0-a5eb-7b05997b41ec tempest-LiveMigrationNegativeTest-219743403 tempest-LiveMigrationNegativeTest-219743403-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8/action" status: 409 len: 155 microversion: 2.1 time: 1.074033 Aug 04 16:33:35.697008 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 174/377] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:33:34 2022] POST /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8/action => generated 155 bytes in 1076 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 04 16:33:35.706781 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a9d6ec27-e71d-4274-8c33-acc3080e5012 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:35.707522 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a9d6ec27-e71d-4274-8c33-acc3080e5012 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: f5548cac-028e-4bca-b862-d471688b9c50] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:35.728074 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a9d6ec27-e71d-4274-8c33-acc3080e5012 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:35.731181 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a9d6ec27-e71d-4274-8c33-acc3080e5012 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:35.732887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a9d6ec27-e71d-4274-8c33-acc3080e5012 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:35.736294 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a9d6ec27-e71d-4274-8c33-acc3080e5012 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:35.762438 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-a9d6ec27-e71d-4274-8c33-acc3080e5012 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] HTTP exception thrown: Instance f5548cac-028e-4bca-b862-d471688b9c50 could not be found. Aug 04 16:33:35.775981 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a9d6ec27-e71d-4274-8c33-acc3080e5012 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Request method failure captured: Aug 04 16:33:35.775981 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50 HTTP/1.1 Aug 04 16:33:35.775981 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:33:35.775981 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:33:35.775981 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:33:35.775981 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:33:35.775981 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:33:35.775981 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:33:35.775981 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:33:35.775981 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:35.775981 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_SQWRtweLL8S9FjSUzm2SHuxcy69sC0P2uSa0cAMC_DSXd55JKKy9O0dh7gYHIEN2QmdOgsstNJhd59hz6UKJUYTZOugtHzLy20RO8LIhlz0LqchYQHFvdJ594sBdwr5SQDY386_-as12hJUY4QrUkh3neIrBSLD0tqe2NPGnA6xKg Aug 04 16:33:35.775981 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:33:35.775981 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:33:35.775981 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:33:35.775981 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:33:35.775981 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:33:35.775981 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:33:35.775981 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: f665aa7b40ce4198a7958d9c382058f3 Aug 04 16:33:35.775981 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1073884544 Aug 04 16:33:35.775981 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:33:35.775981 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:33:35.777530 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f665aa7b40ce4198a7958d9c382058f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f665aa7b40ce4198a7958d9c382058f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f665aa7b40ce4198a7958d9c382058f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f665aa7b40ce4198a7958d9c382058f3"}]}] Aug 04 16:33:35.777530 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-DeleteServersAdminTestJSON-1073884544 Aug 04 16:33:35.777530 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: f665aa7b40ce4198a7958d9c382058f3 Aug 04 16:33:35.777530 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1073884544 Aug 04 16:33:35.777530 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-DeleteServersAdminTestJSON-1073884544-project Aug 04 16:33:35.777530 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:33:35.777530 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:33:35.777530 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 9dc6220916eb443387bbf353c267342c Aug 04 16:33:35.777530 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-DeleteServersAdminTestJSON-1073884544-project Aug 04 16:33:35.777530 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:33:35.777530 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance f5548cac-028e-4bca-b862-d471688b9c50 could not be found. Aug 04 16:33:35.777530 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'f5548cac-028e-4bca-b862-d471688b9c50'} Aug 04 16:33:35.778587 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:35.778587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:35.778587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:33:35.778587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:33:35.778587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:33:35.778587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:33:35.778587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:33:35.778587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:33:35.778587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:33:35.778587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:33:35.778587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5548cac-028e-4bca-b862-d471688b9c50 could not be found. Aug 04 16:33:35.778587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:35.778587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:35.778587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:35.778587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:35.778587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:35.778587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:35.778587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:35.778587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:35.778587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:35.779804 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:35.779804 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:33:35.779804 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:33:35.779804 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:33:35.779804 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:33:35.779804 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:33:35.779804 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:33:35.779804 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5548cac-028e-4bca-b862-d471688b9c50 could not be found. Aug 04 16:33:35.779804 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:35.779804 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:35.779804 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:35.779804 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:35.779804 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:35.779804 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:35.779804 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:33:35.779804 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:33:35.779804 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5548cac-028e-4bca-b862-d471688b9c50 could not be found. Aug 04 16:33:35.779804 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:35.780965 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a9d6ec27-e71d-4274-8c33-acc3080e5012 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Returning 404 to user: Instance f5548cac-028e-4bca-b862-d471688b9c50 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:35.782575 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a9d6ec27-e71d-4274-8c33-acc3080e5012 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50" status: 404 len: 111 microversion: 2.1 time: 0.085302 Aug 04 16:33:35.784656 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 175/378] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:35 2022] GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:33:35.794871 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3c0ad6de-8da1-481b-9145-c51813fc2e4e tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:35.796031 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3c0ad6de-8da1-481b-9145-c51813fc2e4e tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: 1ae03eb0-d144-4135-87eb-d8816b9988e8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:35.804702 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3c0ad6de-8da1-481b-9145-c51813fc2e4e tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:35.805912 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3c0ad6de-8da1-481b-9145-c51813fc2e4e tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:35.807315 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3c0ad6de-8da1-481b-9145-c51813fc2e4e tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:35.807831 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3c0ad6de-8da1-481b-9145-c51813fc2e4e tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:35.866218 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3c0ad6de-8da1-481b-9145-c51813fc2e4e tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: 1ae03eb0-d144-4135-87eb-d8816b9988e8] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:33:35.917634 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9d8dde4a-f35b-4653-8b99-cb324926acec tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c73c354a6ee4ab881f483ff65a21dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cb965024d94d7cae0c5652212e7cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:35.931997 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9d8dde4a-f35b-4653-8b99-cb324926acec tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c" status: 200 len: 1321 microversion: 2.1 time: 0.759755 Aug 04 16:33:35.934992 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 204/379] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:35 2022] GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c => generated 1321 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:33:35.965967 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4679236d-f727-498b-8f9f-e25b7ccd403a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:35.967941 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4679236d-f727-498b-8f9f-e25b7ccd403a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: f5548cac-028e-4bca-b862-d471688b9c50] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:35.985376 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4679236d-f727-498b-8f9f-e25b7ccd403a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:35.987935 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4679236d-f727-498b-8f9f-e25b7ccd403a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:35.990253 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4679236d-f727-498b-8f9f-e25b7ccd403a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:35.990913 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4679236d-f727-498b-8f9f-e25b7ccd403a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:36.046224 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-4679236d-f727-498b-8f9f-e25b7ccd403a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] HTTP exception thrown: Instance f5548cac-028e-4bca-b862-d471688b9c50 could not be found. Aug 04 16:33:36.048537 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4679236d-f727-498b-8f9f-e25b7ccd403a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Request method failure captured: Aug 04 16:33:36.048537 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50 HTTP/1.1 Aug 04 16:33:36.048537 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:33:36.048537 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:33:36.048537 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:33:36.048537 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:33:36.048537 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:33:36.048537 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:33:36.048537 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:33:36.048537 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:36.048537 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_SQWRtweLL8S9FjSUzm2SHuxcy69sC0P2uSa0cAMC_DSXd55JKKy9O0dh7gYHIEN2QmdOgsstNJhd59hz6UKJUYTZOugtHzLy20RO8LIhlz0LqchYQHFvdJ594sBdwr5SQDY386_-as12hJUY4QrUkh3neIrBSLD0tqe2NPGnA6xKg Aug 04 16:33:36.048537 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:33:36.048537 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:33:36.048537 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:33:36.048537 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:33:36.048537 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:33:36.048537 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:33:36.048537 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: f665aa7b40ce4198a7958d9c382058f3 Aug 04 16:33:36.048537 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1073884544 Aug 04 16:33:36.048537 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:33:36.048537 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:33:36.050061 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f665aa7b40ce4198a7958d9c382058f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f665aa7b40ce4198a7958d9c382058f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f665aa7b40ce4198a7958d9c382058f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f665aa7b40ce4198a7958d9c382058f3"}]}] Aug 04 16:33:36.050061 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-DeleteServersAdminTestJSON-1073884544 Aug 04 16:33:36.050061 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: f665aa7b40ce4198a7958d9c382058f3 Aug 04 16:33:36.050061 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1073884544 Aug 04 16:33:36.050061 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-DeleteServersAdminTestJSON-1073884544-project Aug 04 16:33:36.050061 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:33:36.050061 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:33:36.050061 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 9dc6220916eb443387bbf353c267342c Aug 04 16:33:36.050061 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-DeleteServersAdminTestJSON-1073884544-project Aug 04 16:33:36.050061 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:33:36.050061 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance f5548cac-028e-4bca-b862-d471688b9c50 could not be found. Aug 04 16:33:36.050061 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'f5548cac-028e-4bca-b862-d471688b9c50'} Aug 04 16:33:36.050926 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:36.050926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:36.050926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:33:36.050926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:33:36.050926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:33:36.050926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:33:36.050926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:33:36.050926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:33:36.050926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:33:36.050926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:33:36.050926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5548cac-028e-4bca-b862-d471688b9c50 could not be found. Aug 04 16:33:36.050926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:36.050926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:36.050926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:36.050926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:36.050926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:36.050926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:36.050926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:36.050926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:36.050926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:36.052590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:36.052590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:33:36.052590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:33:36.052590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:33:36.052590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:33:36.052590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:33:36.052590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:33:36.052590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:33:36.052590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:33:36.052590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5548cac-028e-4bca-b862-d471688b9c50 could not be found. Aug 04 16:33:36.052590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:36.052590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:36.052590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:36.052590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:36.052590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:36.052590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:36.052590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:33:36.052590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:33:36.052590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5548cac-028e-4bca-b862-d471688b9c50 could not be found. Aug 04 16:33:36.052590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:36.054635 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4679236d-f727-498b-8f9f-e25b7ccd403a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Returning 404 to user: Instance f5548cac-028e-4bca-b862-d471688b9c50 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:36.055361 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4679236d-f727-498b-8f9f-e25b7ccd403a tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50" status: 404 len: 111 microversion: 2.1 time: 0.116273 Aug 04 16:33:36.056479 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 205/380] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:33:35 2022] DELETE /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:33:36.069661 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5d3539fa-d539-416c-b0eb-b5f2f98ed286 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:36.070279 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5d3539fa-d539-416c-b0eb-b5f2f98ed286 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: f5548cac-028e-4bca-b862-d471688b9c50] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:36.087190 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5d3539fa-d539-416c-b0eb-b5f2f98ed286 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:36.087631 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5d3539fa-d539-416c-b0eb-b5f2f98ed286 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:36.089535 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5d3539fa-d539-416c-b0eb-b5f2f98ed286 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:36.090182 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5d3539fa-d539-416c-b0eb-b5f2f98ed286 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:36.101122 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3c0ad6de-8da1-481b-9145-c51813fc2e4e tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8" status: 204 len: 0 microversion: 2.1 time: 0.314498 Aug 04 16:33:36.102099 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 176/381] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:33:35 2022] DELETE /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:33:36.111755 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-66be3474-a505-4996-a393-46c7418a7e5d tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:36.112455 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-66be3474-a505-4996-a393-46c7418a7e5d tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: 1ae03eb0-d144-4135-87eb-d8816b9988e8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:36.127507 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-66be3474-a505-4996-a393-46c7418a7e5d tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:36.127985 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-66be3474-a505-4996-a393-46c7418a7e5d tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:36.129096 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-5d3539fa-d539-416c-b0eb-b5f2f98ed286 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] HTTP exception thrown: Instance f5548cac-028e-4bca-b862-d471688b9c50 could not be found. Aug 04 16:33:36.131273 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5d3539fa-d539-416c-b0eb-b5f2f98ed286 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Request method failure captured: Aug 04 16:33:36.131273 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50 HTTP/1.1 Aug 04 16:33:36.131273 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:33:36.131273 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:33:36.131273 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:33:36.131273 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:33:36.131273 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:33:36.131273 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:33:36.131273 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:33:36.131273 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:36.131273 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_SQWRtweLL8S9FjSUzm2SHuxcy69sC0P2uSa0cAMC_DSXd55JKKy9O0dh7gYHIEN2QmdOgsstNJhd59hz6UKJUYTZOugtHzLy20RO8LIhlz0LqchYQHFvdJ594sBdwr5SQDY386_-as12hJUY4QrUkh3neIrBSLD0tqe2NPGnA6xKg Aug 04 16:33:36.131273 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:33:36.131273 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:33:36.131273 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:33:36.131273 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:33:36.131273 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:33:36.131273 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:33:36.131273 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: f665aa7b40ce4198a7958d9c382058f3 Aug 04 16:33:36.131273 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1073884544 Aug 04 16:33:36.131273 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:33:36.131273 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:33:36.132586 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f665aa7b40ce4198a7958d9c382058f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f665aa7b40ce4198a7958d9c382058f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f665aa7b40ce4198a7958d9c382058f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f665aa7b40ce4198a7958d9c382058f3"}]}] Aug 04 16:33:36.132586 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-DeleteServersAdminTestJSON-1073884544 Aug 04 16:33:36.132586 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: f665aa7b40ce4198a7958d9c382058f3 Aug 04 16:33:36.132586 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1073884544 Aug 04 16:33:36.132586 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-DeleteServersAdminTestJSON-1073884544-project Aug 04 16:33:36.132586 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:33:36.132586 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:33:36.132586 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 9dc6220916eb443387bbf353c267342c Aug 04 16:33:36.132586 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-DeleteServersAdminTestJSON-1073884544-project Aug 04 16:33:36.132586 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:33:36.132586 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance f5548cac-028e-4bca-b862-d471688b9c50 could not be found. Aug 04 16:33:36.132586 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'f5548cac-028e-4bca-b862-d471688b9c50'} Aug 04 16:33:36.133253 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:36.133253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:36.133253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:33:36.133253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:33:36.133253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:33:36.133253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:33:36.133253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:33:36.133253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:33:36.133253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:33:36.133253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:33:36.133253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5548cac-028e-4bca-b862-d471688b9c50 could not be found. Aug 04 16:33:36.133253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:36.133253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:36.133253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:36.133253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:36.133253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:36.133253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:36.133253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:36.133253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:36.133253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:36.134469 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:36.134469 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:33:36.134469 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:33:36.134469 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:33:36.134469 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:33:36.134469 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:33:36.134469 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:33:36.134469 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5548cac-028e-4bca-b862-d471688b9c50 could not be found. Aug 04 16:33:36.134469 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:36.134469 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:36.134469 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:36.134469 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:36.134469 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:36.134469 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:36.134469 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:33:36.134469 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:33:36.134469 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5548cac-028e-4bca-b862-d471688b9c50 could not be found. Aug 04 16:33:36.134469 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:36.135469 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-66be3474-a505-4996-a393-46c7418a7e5d tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:36.135469 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-66be3474-a505-4996-a393-46c7418a7e5d tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:36.141402 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5d3539fa-d539-416c-b0eb-b5f2f98ed286 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Returning 404 to user: Instance f5548cac-028e-4bca-b862-d471688b9c50 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:36.148334 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5d3539fa-d539-416c-b0eb-b5f2f98ed286 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50" status: 404 len: 111 microversion: 2.1 time: 0.087587 Aug 04 16:33:36.149796 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 206/382] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:36 2022] GET /compute/v2.1/servers/f5548cac-028e-4bca-b862-d471688b9c50 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:33:36.175425 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9ed8c922-cfab-4246-ace3-9e2abde54323 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:36.181775 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9ed8c922-cfab-4246-ace3-9e2abde54323 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: e40c21e9-d19a-4e5f-9c7d-c4507025e94e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:36.197261 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9ed8c922-cfab-4246-ace3-9e2abde54323 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:36.197800 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9ed8c922-cfab-4246-ace3-9e2abde54323 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:36.198848 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9ed8c922-cfab-4246-ace3-9e2abde54323 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:36.199329 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9ed8c922-cfab-4246-ace3-9e2abde54323 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:36.223283 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-9ed8c922-cfab-4246-ace3-9e2abde54323 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] HTTP exception thrown: Instance e40c21e9-d19a-4e5f-9c7d-c4507025e94e could not be found. Aug 04 16:33:36.229055 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9ed8c922-cfab-4246-ace3-9e2abde54323 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Request method failure captured: Aug 04 16:33:36.229055 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e HTTP/1.1 Aug 04 16:33:36.229055 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:33:36.229055 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:33:36.229055 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:33:36.229055 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:33:36.229055 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:33:36.229055 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:33:36.229055 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:33:36.229055 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:36.229055 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_SQWRtweLL8S9FjSUzm2SHuxcy69sC0P2uSa0cAMC_DSXd55JKKy9O0dh7gYHIEN2QmdOgsstNJhd59hz6UKJUYTZOugtHzLy20RO8LIhlz0LqchYQHFvdJ594sBdwr5SQDY386_-as12hJUY4QrUkh3neIrBSLD0tqe2NPGnA6xKg Aug 04 16:33:36.229055 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:33:36.229055 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:33:36.229055 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:33:36.229055 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:33:36.229055 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:33:36.229055 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:33:36.229055 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: f665aa7b40ce4198a7958d9c382058f3 Aug 04 16:33:36.229055 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1073884544 Aug 04 16:33:36.229055 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:33:36.229055 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:33:36.230694 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f665aa7b40ce4198a7958d9c382058f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f665aa7b40ce4198a7958d9c382058f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f665aa7b40ce4198a7958d9c382058f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f665aa7b40ce4198a7958d9c382058f3"}]}] Aug 04 16:33:36.230694 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-DeleteServersAdminTestJSON-1073884544 Aug 04 16:33:36.230694 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: f665aa7b40ce4198a7958d9c382058f3 Aug 04 16:33:36.230694 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1073884544 Aug 04 16:33:36.230694 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-DeleteServersAdminTestJSON-1073884544-project Aug 04 16:33:36.230694 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:33:36.230694 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:33:36.230694 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 9dc6220916eb443387bbf353c267342c Aug 04 16:33:36.230694 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-DeleteServersAdminTestJSON-1073884544-project Aug 04 16:33:36.230694 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:33:36.230694 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance e40c21e9-d19a-4e5f-9c7d-c4507025e94e could not be found. Aug 04 16:33:36.230694 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'e40c21e9-d19a-4e5f-9c7d-c4507025e94e'} Aug 04 16:33:36.231521 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:36.231521 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:36.231521 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:33:36.231521 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:33:36.231521 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:33:36.231521 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:33:36.231521 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:33:36.231521 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:33:36.231521 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:33:36.231521 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:33:36.231521 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e40c21e9-d19a-4e5f-9c7d-c4507025e94e could not be found. Aug 04 16:33:36.231521 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:36.231521 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:36.231521 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:36.231521 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:36.231521 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:36.231521 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:36.231521 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:36.231521 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:36.231521 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:36.232890 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:36.232890 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:33:36.232890 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:33:36.232890 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:33:36.232890 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:33:36.232890 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:33:36.232890 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:33:36.232890 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:33:36.232890 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:33:36.232890 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e40c21e9-d19a-4e5f-9c7d-c4507025e94e could not be found. Aug 04 16:33:36.232890 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:36.232890 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:36.232890 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:36.232890 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:36.232890 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:36.232890 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:36.232890 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:33:36.232890 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:33:36.232890 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e40c21e9-d19a-4e5f-9c7d-c4507025e94e could not be found. Aug 04 16:33:36.232890 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:36.237106 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9ed8c922-cfab-4246-ace3-9e2abde54323 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Returning 404 to user: Instance e40c21e9-d19a-4e5f-9c7d-c4507025e94e could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:36.238692 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9ed8c922-cfab-4246-ace3-9e2abde54323 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e" status: 404 len: 111 microversion: 2.1 time: 0.082767 Aug 04 16:33:36.243424 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 207/383] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:33:36 2022] DELETE /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:33:36.250982 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bab83df0-9e62-430d-845c-017ed9a48a61 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:36.251875 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bab83df0-9e62-430d-845c-017ed9a48a61 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] [instance: e40c21e9-d19a-4e5f-9c7d-c4507025e94e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:36.275064 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bab83df0-9e62-430d-845c-017ed9a48a61 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:36.276392 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bab83df0-9e62-430d-845c-017ed9a48a61 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:36.279149 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bab83df0-9e62-430d-845c-017ed9a48a61 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:36.279851 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bab83df0-9e62-430d-845c-017ed9a48a61 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:36.308449 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-bab83df0-9e62-430d-845c-017ed9a48a61 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] HTTP exception thrown: Instance e40c21e9-d19a-4e5f-9c7d-c4507025e94e could not be found. Aug 04 16:33:36.311711 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bab83df0-9e62-430d-845c-017ed9a48a61 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Request method failure captured: Aug 04 16:33:36.311711 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e HTTP/1.1 Aug 04 16:33:36.311711 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:33:36.311711 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:33:36.311711 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:33:36.311711 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:33:36.311711 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:33:36.311711 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:33:36.311711 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:33:36.311711 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:36.311711 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_SQWRtweLL8S9FjSUzm2SHuxcy69sC0P2uSa0cAMC_DSXd55JKKy9O0dh7gYHIEN2QmdOgsstNJhd59hz6UKJUYTZOugtHzLy20RO8LIhlz0LqchYQHFvdJ594sBdwr5SQDY386_-as12hJUY4QrUkh3neIrBSLD0tqe2NPGnA6xKg Aug 04 16:33:36.311711 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:33:36.311711 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:33:36.311711 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:33:36.311711 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:33:36.311711 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:33:36.311711 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:33:36.311711 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: f665aa7b40ce4198a7958d9c382058f3 Aug 04 16:33:36.311711 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1073884544 Aug 04 16:33:36.311711 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:33:36.311711 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:33:36.312992 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f665aa7b40ce4198a7958d9c382058f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f665aa7b40ce4198a7958d9c382058f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f665aa7b40ce4198a7958d9c382058f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f665aa7b40ce4198a7958d9c382058f3"}]}] Aug 04 16:33:36.312992 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-DeleteServersAdminTestJSON-1073884544 Aug 04 16:33:36.312992 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: f665aa7b40ce4198a7958d9c382058f3 Aug 04 16:33:36.312992 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1073884544 Aug 04 16:33:36.312992 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-DeleteServersAdminTestJSON-1073884544-project Aug 04 16:33:36.312992 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:33:36.312992 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:33:36.312992 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 9dc6220916eb443387bbf353c267342c Aug 04 16:33:36.312992 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-DeleteServersAdminTestJSON-1073884544-project Aug 04 16:33:36.312992 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:33:36.312992 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance e40c21e9-d19a-4e5f-9c7d-c4507025e94e could not be found. Aug 04 16:33:36.312992 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'e40c21e9-d19a-4e5f-9c7d-c4507025e94e'} Aug 04 16:33:36.313724 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:36.313724 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:36.313724 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:33:36.313724 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:33:36.313724 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:33:36.313724 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:33:36.313724 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:33:36.313724 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:33:36.313724 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:33:36.313724 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:33:36.313724 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e40c21e9-d19a-4e5f-9c7d-c4507025e94e could not be found. Aug 04 16:33:36.313724 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:36.313724 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:36.313724 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:36.313724 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:36.313724 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:36.313724 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:36.313724 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:36.313724 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:36.313724 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:36.314816 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:36.314816 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:33:36.314816 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:33:36.314816 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:33:36.314816 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:33:36.314816 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:33:36.314816 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:33:36.314816 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e40c21e9-d19a-4e5f-9c7d-c4507025e94e could not be found. Aug 04 16:33:36.314816 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:36.314816 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:36.314816 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:36.314816 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:36.314816 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:36.314816 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:36.314816 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:33:36.314816 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:33:36.314816 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e40c21e9-d19a-4e5f-9c7d-c4507025e94e could not be found. Aug 04 16:33:36.314816 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:36.317736 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bab83df0-9e62-430d-845c-017ed9a48a61 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] Returning 404 to user: Instance e40c21e9-d19a-4e5f-9c7d-c4507025e94e could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:36.319282 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bab83df0-9e62-430d-845c-017ed9a48a61 tempest-DeleteServersAdminTestJSON-1073884544 tempest-DeleteServersAdminTestJSON-1073884544-project] 10.222.0.23 "GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e" status: 404 len: 111 microversion: 2.1 time: 0.073480 Aug 04 16:33:36.324027 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 208/384] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:36 2022] GET /compute/v2.1/servers/e40c21e9-d19a-4e5f-9c7d-c4507025e94e => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:33:36.420517 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-66be3474-a505-4996-a393-46c7418a7e5d tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052613a51b86400c916dbc800563896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0ceaab59d4aeaa8667cef6f62559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:36.432709 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-66be3474-a505-4996-a393-46c7418a7e5d tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8" status: 200 len: 1465 microversion: 2.1 time: 0.326042 Aug 04 16:33:36.434001 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 177/385] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:36 2022] GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8 => generated 1465 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:36.956651 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-417e1455-3f80-4673-918b-42765f565021 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:36.957271 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-417e1455-3f80-4673-918b-42765f565021 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: 92c85400-67f0-4930-bf61-28770e84b98c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:36.972428 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-417e1455-3f80-4673-918b-42765f565021 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:36.972861 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-417e1455-3f80-4673-918b-42765f565021 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:36.981862 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-417e1455-3f80-4673-918b-42765f565021 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:36.982338 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-417e1455-3f80-4673-918b-42765f565021 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:37.326508 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-417e1455-3f80-4673-918b-42765f565021 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c73c354a6ee4ab881f483ff65a21dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cb965024d94d7cae0c5652212e7cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:37.343041 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-417e1455-3f80-4673-918b-42765f565021 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c" status: 200 len: 1321 microversion: 2.1 time: 0.390813 Aug 04 16:33:37.343632 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 209/386] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:36 2022] GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c => generated 1321 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:37.454268 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4c6f1c75-d180-42f8-8215-516d81b69449 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:37.455409 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4c6f1c75-d180-42f8-8215-516d81b69449 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: 1ae03eb0-d144-4135-87eb-d8816b9988e8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:37.467130 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4c6f1c75-d180-42f8-8215-516d81b69449 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:37.467864 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4c6f1c75-d180-42f8-8215-516d81b69449 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:37.468846 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4c6f1c75-d180-42f8-8215-516d81b69449 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:37.469792 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4c6f1c75-d180-42f8-8215-516d81b69449 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:38.630354 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-93e59ec6-92c2-41dc-8a60-cbecc0e66bb0 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-882777419", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "b9488b95-3e40-4213-8fe1-ea17248f446a"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:38.645943 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:33:38.687916 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4c6f1c75-d180-42f8-8215-516d81b69449 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052613a51b86400c916dbc800563896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0ceaab59d4aeaa8667cef6f62559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:38.697950 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4c6f1c75-d180-42f8-8215-516d81b69449 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8" status: 200 len: 1465 microversion: 2.1 time: 1.247483 Aug 04 16:33:38.702369 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 178/387] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:37 2022] GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8 => generated 1465 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:38.712987 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d72e75bb-efe0-4807-b441-f6dbe4823175 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:38.717604 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d72e75bb-efe0-4807-b441-f6dbe4823175 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: 92c85400-67f0-4930-bf61-28770e84b98c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:38.729149 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-93e59ec6-92c2-41dc-8a60-cbecc0e66bb0 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] validate_networks() for [('b9488b95-3e40-4213-8fe1-ea17248f446a', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:33:38.736422 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d72e75bb-efe0-4807-b441-f6dbe4823175 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:38.736983 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d72e75bb-efe0-4807-b441-f6dbe4823175 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:38.738083 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d72e75bb-efe0-4807-b441-f6dbe4823175 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:38.738632 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d72e75bb-efe0-4807-b441-f6dbe4823175 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:39.307027 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d72e75bb-efe0-4807-b441-f6dbe4823175 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c73c354a6ee4ab881f483ff65a21dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cb965024d94d7cae0c5652212e7cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:39.315781 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d72e75bb-efe0-4807-b441-f6dbe4823175 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c" status: 200 len: 1321 microversion: 2.1 time: 0.611334 Aug 04 16:33:39.322465 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 179/388] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:38 2022] GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c => generated 1321 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:39.860580 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dd145ab9-4b1e-4913-a5b1-411ee3bd7f2b tempest-FlavorsExtraSpecsNegativeTestJSON-915186396 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1549751500", "ram": 512, "vcpus": 1, "disk": 10, "id": 1301729226, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:39.865037 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:39.865037 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:39.909268 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dd145ab9-4b1e-4913-a5b1-411ee3bd7f2b tempest-FlavorsExtraSpecsNegativeTestJSON-915186396 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.585097 Aug 04 16:33:39.911494 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 180/389] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:33:39 2022] POST /compute/v2.1/flavors => generated 416 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:39.929114 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3525d0c4-1161-4f2d-b97c-ee4264056355 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:39.931684 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3525d0c4-1161-4f2d-b97c-ee4264056355 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: 1ae03eb0-d144-4135-87eb-d8816b9988e8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:39.949267 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3525d0c4-1161-4f2d-b97c-ee4264056355 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:39.950016 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3525d0c4-1161-4f2d-b97c-ee4264056355 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:39.951425 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3525d0c4-1161-4f2d-b97c-ee4264056355 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:39.952163 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3525d0c4-1161-4f2d-b97c-ee4264056355 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:40.106491 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-93e59ec6-92c2-41dc-8a60-cbecc0e66bb0 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:33:40.107153 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-93e59ec6-92c2-41dc-8a60-cbecc0e66bb0 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:33:40.108072 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-93e59ec6-92c2-41dc-8a60-cbecc0e66bb0 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:33:40.108370 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-93e59ec6-92c2-41dc-8a60-cbecc0e66bb0 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:33:40.117775 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-93e59ec6-92c2-41dc-8a60-cbecc0e66bb0 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:33:40.150877 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-93e59ec6-92c2-41dc-8a60-cbecc0e66bb0 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:40.166567 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-93e59ec6-92c2-41dc-8a60-cbecc0e66bb0 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:40.168473 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-93e59ec6-92c2-41dc-8a60-cbecc0e66bb0 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:40.173408 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-93e59ec6-92c2-41dc-8a60-cbecc0e66bb0 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:40.201940 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3525d0c4-1161-4f2d-b97c-ee4264056355 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052613a51b86400c916dbc800563896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0ceaab59d4aeaa8667cef6f62559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:40.214877 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3525d0c4-1161-4f2d-b97c-ee4264056355 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8" status: 200 len: 1423 microversion: 2.1 time: 0.301704 Aug 04 16:33:40.218699 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 181/390] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:39 2022] GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8 => generated 1423 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:40.258550 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-93e59ec6-92c2-41dc-8a60-cbecc0e66bb0 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Getting quotas for project 82b3a898ed4b4e0a82ae35830cb00ca9. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:33:40.268153 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-93e59ec6-92c2-41dc-8a60-cbecc0e66bb0 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Getting quotas for user 51b742cff6a948d0883501917706f66e and project 82b3a898ed4b4e0a82ae35830cb00ca9. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:33:40.289069 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-93e59ec6-92c2-41dc-8a60-cbecc0e66bb0 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:33:40.292342 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-93e59ec6-92c2-41dc-8a60-cbecc0e66bb0 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: f23a3c47-f725-4ad2-b88d-b972ff4b2ee9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:33:40.426619 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-93e59ec6-92c2-41dc-8a60-cbecc0e66bb0 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.305452 Aug 04 16:33:40.427463 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 210/391] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:33:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2308 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 16:33:40.449060 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-a0142223-868b-489d-be59-73c9fa481703 req-8f303967-9d99-4106-9d8a-a38e93524a23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ae03eb0-d144-4135-87eb-d8816b9988e8", "name": "network-vif-deleted", "tag": "29d020a6-de6a-4a60-b380-be4b7724ab85"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:40.490179 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a0142223-868b-489d-be59-73c9fa481703 req-8f303967-9d99-4106-9d8a-a38e93524a23 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:40.490611 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a0142223-868b-489d-be59-73c9fa481703 req-8f303967-9d99-4106-9d8a-a38e93524a23 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:40.528347 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-a0142223-868b-489d-be59-73c9fa481703 req-8f303967-9d99-4106-9d8a-a38e93524a23 service nova] Creating event network-vif-deleted:29d020a6-de6a-4a60-b380-be4b7724ab85 for instance 1ae03eb0-d144-4135-87eb-d8816b9988e8 on n-h1-846466-12 Aug 04 16:33:40.548442 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-a0142223-868b-489d-be59-73c9fa481703 req-8f303967-9d99-4106-9d8a-a38e93524a23 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105740 Aug 04 16:33:40.551575 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 211/392] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:40.565640 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-033afbc0-0b88-4010-8e34-1f62633ac990 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:40.566307 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-033afbc0-0b88-4010-8e34-1f62633ac990 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: 92c85400-67f0-4930-bf61-28770e84b98c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:40.587629 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-033afbc0-0b88-4010-8e34-1f62633ac990 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:40.588383 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-033afbc0-0b88-4010-8e34-1f62633ac990 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:40.591702 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-033afbc0-0b88-4010-8e34-1f62633ac990 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:40.596958 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-033afbc0-0b88-4010-8e34-1f62633ac990 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:40.747521 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b5125736-a4b2-4958-9ca7-a34d4e29b9b2 tempest-FlavorsExtraSpecsNegativeTestJSON-491751866 tempest-FlavorsExtraSpecsNegativeTestJSON-491751866-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:40.774981 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-b5125736-a4b2-4958-9ca7-a34d4e29b9b2 tempest-FlavorsExtraSpecsNegativeTestJSON-491751866 tempest-FlavorsExtraSpecsNegativeTestJSON-491751866-project] HTTP exception thrown: Flavor 1301729226 has no extra specs with key hw:cpu_thread_policy. Aug 04 16:33:40.776374 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b5125736-a4b2-4958-9ca7-a34d4e29b9b2 tempest-FlavorsExtraSpecsNegativeTestJSON-491751866 tempest-FlavorsExtraSpecsNegativeTestJSON-491751866-project] Request method failure captured: Aug 04 16:33:40.776374 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/flavors/1301729226/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 04 16:33:40.776374 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:33:40.776374 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:33:40.776374 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:33:40.776374 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:33:40.776374 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:33:40.776374 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:33:40.776374 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:33:40.776374 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:40.776374 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_TgqngaHSthIrR7J0EwD7sHc7-8RgvwokysVtWBboQQ1-cMQgJ_OeR37ot8VPfXXm8wjkc_OeuPbWzMO2nauUZ0iiLjqcuk8uJ38hxnx8TOkug7_1PpsF7qD2sYsSQVepLjcrL44hVdJHYSYRQbiNHkeAw3OobOEru97bcmV2J3puc Aug 04 16:33:40.776374 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:33:40.776374 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:33:40.776374 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:33:40.776374 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:33:40.776374 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:33:40.776374 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:33:40.776374 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 9064fabc72844186999eca65394bd2a2 Aug 04 16:33:40.776374 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-491751866 Aug 04 16:33:40.776374 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:33:40.776374 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:33:40.777610 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9064fabc72844186999eca65394bd2a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9064fabc72844186999eca65394bd2a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9064fabc72844186999eca65394bd2a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9064fabc72844186999eca65394bd2a2"}]}] Aug 04 16:33:40.777610 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-491751866 Aug 04 16:33:40.777610 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 9064fabc72844186999eca65394bd2a2 Aug 04 16:33:40.777610 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-491751866 Aug 04 16:33:40.777610 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-491751866-project Aug 04 16:33:40.777610 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:33:40.777610 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:33:40.777610 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: e60b3121380c479da8e84fe5c0b1cf60 Aug 04 16:33:40.777610 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-491751866-project Aug 04 16:33:40.777610 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:33:40.777610 n-d-846466-12 devstack@n-api.service[126125]: exception: Flavor 1301729226 has no extra specs with key hw:cpu_thread_policy. Aug 04 16:33:40.778324 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'flavor_id': '1301729226', 'id': 'hw:cpu_thread_policy'} Aug 04 16:33:40.778324 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:40.778324 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:40.778324 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 04 16:33:40.778324 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 04 16:33:40.778324 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 04 16:33:40.778324 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:40.778324 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:40.778324 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:40.778324 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:40.778324 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:40.778324 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:40.778324 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:40.778324 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:40.778324 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:40.778324 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:40.778324 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 04 16:33:40.778324 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 16:33:40.778324 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1301729226 has no extra specs with key hw:cpu_thread_policy. Aug 04 16:33:40.778324 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:40.778324 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:40.778324 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:40.779550 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:40.779550 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:40.779550 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:40.779550 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:33:40.779550 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:33:40.779550 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1301729226 has no extra specs with key hw:cpu_thread_policy. Aug 04 16:33:40.779550 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:40.779550 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b5125736-a4b2-4958-9ca7-a34d4e29b9b2 tempest-FlavorsExtraSpecsNegativeTestJSON-491751866 tempest-FlavorsExtraSpecsNegativeTestJSON-491751866-project] Returning 404 to user: Flavor 1301729226 has no extra specs with key hw:cpu_thread_policy. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:40.779550 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b5125736-a4b2-4958-9ca7-a34d4e29b9b2 tempest-FlavorsExtraSpecsNegativeTestJSON-491751866 tempest-FlavorsExtraSpecsNegativeTestJSON-491751866-project] 10.222.0.23 "GET /compute/v2.1/flavors/1301729226/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.559775 Aug 04 16:33:40.781179 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 182/393] 10.222.0.23 () {58 vars in 1266 bytes} [Thu Aug 4 16:33:40 2022] GET /compute/v2.1/flavors/1301729226/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 562 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:33:40.787105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9364aaaf-2ed6-4f21-91da-a6cb067bf2f4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:40.787675 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9364aaaf-2ed6-4f21-91da-a6cb067bf2f4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: f23a3c47-f725-4ad2-b88d-b972ff4b2ee9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:41.004599 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-033afbc0-0b88-4010-8e34-1f62633ac990 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c73c354a6ee4ab881f483ff65a21dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cb965024d94d7cae0c5652212e7cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:41.016097 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9364aaaf-2ed6-4f21-91da-a6cb067bf2f4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:41.017821 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-033afbc0-0b88-4010-8e34-1f62633ac990 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c" status: 200 len: 1321 microversion: 2.1 time: 0.461905 Aug 04 16:33:41.023074 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 212/394] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:40 2022] GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c => generated 1321 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:41.027300 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9364aaaf-2ed6-4f21-91da-a6cb067bf2f4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9" status: 200 len: 1210 microversion: 2.1 time: 0.244762 Aug 04 16:33:41.028265 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 183/395] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:40 2022] GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 => generated 1210 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:41.055653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-69f9de8f-ceb2-4204-8f3e-388af63b9d8e tempest-FlavorsExtraSpecsNegativeTestJSON-491751866 tempest-FlavorsExtraSpecsNegativeTestJSON-491751866-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:41.059746 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:41.059746 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:41.061173 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-69f9de8f-ceb2-4204-8f3e-388af63b9d8e tempest-FlavorsExtraSpecsNegativeTestJSON-491751866 tempest-FlavorsExtraSpecsNegativeTestJSON-491751866-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'e60b3121380c479da8e84fe5c0b1cf60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9064fabc72844186999eca65394bd2a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:41.063514 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-69f9de8f-ceb2-4204-8f3e-388af63b9d8e tempest-FlavorsExtraSpecsNegativeTestJSON-491751866 tempest-FlavorsExtraSpecsNegativeTestJSON-491751866-project] Request method failure captured: Aug 04 16:33:41.063514 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/flavors/1301729226/os-extra_specs HTTP/1.1 Aug 04 16:33:41.063514 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:33:41.063514 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:33:41.063514 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:33:41.063514 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 66 Aug 04 16:33:41.063514 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:33:41.063514 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:33:41.063514 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:33:41.063514 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:41.063514 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_TgqngaHSthIrR7J0EwD7sHc7-8RgvwokysVtWBboQQ1-cMQgJ_OeR37ot8VPfXXm8wjkc_OeuPbWzMO2nauUZ0iiLjqcuk8uJ38hxnx8TOkug7_1PpsF7qD2sYsSQVepLjcrL44hVdJHYSYRQbiNHkeAw3OobOEru97bcmV2J3puc Aug 04 16:33:41.063514 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:33:41.063514 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:33:41.063514 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:33:41.063514 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:33:41.063514 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:33:41.063514 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:33:41.063514 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 9064fabc72844186999eca65394bd2a2 Aug 04 16:33:41.063514 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-491751866 Aug 04 16:33:41.063514 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:33:41.063514 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:33:41.064753 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9064fabc72844186999eca65394bd2a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9064fabc72844186999eca65394bd2a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9064fabc72844186999eca65394bd2a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9064fabc72844186999eca65394bd2a2"}]}] Aug 04 16:33:41.064753 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-491751866 Aug 04 16:33:41.064753 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 9064fabc72844186999eca65394bd2a2 Aug 04 16:33:41.064753 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-491751866 Aug 04 16:33:41.064753 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-491751866-project Aug 04 16:33:41.064753 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:33:41.064753 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:33:41.064753 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: e60b3121380c479da8e84fe5c0b1cf60 Aug 04 16:33:41.064753 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-491751866-project Aug 04 16:33:41.064753 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 16:33:41.064753 n-d-846466-12 devstack@n-api.service[126126]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 04 16:33:41.064753 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:33:41.065466 n-d-846466-12 devstack@n-api.service[126126]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 04 16:33:41.065466 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'flavor_id': '1301729226', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 04 16:33:41.065466 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:41.065466 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:41.065466 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:41.065466 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:41.065466 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:41.065466 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:41.065466 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:41.065466 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:41.065466 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:33:41.065466 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:33:41.065466 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 04 16:33:41.065466 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 04 16:33:41.065466 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:33:41.065466 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:33:41.065466 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:33:41.065466 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:33:41.065466 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:33:41.066547 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:33:41.066547 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:33:41.066547 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:33:41.066547 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:33:41.066547 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:33:41.066547 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:33:41.066547 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:33:41.066547 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:33:41.066547 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:33:41.066547 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 04 16:33:41.066547 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:41.066547 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:41.066547 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:41.066547 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:41.066547 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:41.066547 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:41.066547 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:33:41.066547 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:33:41.066547 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 04 16:33:41.066547 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:41.069574 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-69f9de8f-ceb2-4204-8f3e-388af63b9d8e tempest-FlavorsExtraSpecsNegativeTestJSON-491751866 tempest-FlavorsExtraSpecsNegativeTestJSON-491751866-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:41.070867 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-69f9de8f-ceb2-4204-8f3e-388af63b9d8e tempest-FlavorsExtraSpecsNegativeTestJSON-491751866 tempest-FlavorsExtraSpecsNegativeTestJSON-491751866-project] 10.222.0.23 "POST /compute/v2.1/flavors/1301729226/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.020542 Aug 04 16:33:41.072098 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 213/396] 10.222.0.23 () {60 vars in 1224 bytes} [Thu Aug 4 16:33:41 2022] POST /compute/v2.1/flavors/1301729226/os-extra_specs => generated 124 bytes in 47 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:33:41.089040 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-97c63ed2-a242-4e03-aa79-23affd2ae721 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:41.092916 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:41.092916 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:41.132871 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=9,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:33:41.172667 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-97c63ed2-a242-4e03-aa79-23affd2ae721 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1301729226/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.093962 Aug 04 16:33:41.173365 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 184/397] 10.222.0.23 () {60 vars in 1224 bytes} [Thu Aug 4 16:33:41 2022] POST /compute/v2.1/flavors/1301729226/os-extra_specs => generated 66 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:33:41.193470 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0a188f1c-3677-43f9-b93f-849e9ed04079 tempest-FlavorsExtraSpecsNegativeTestJSON-491751866 tempest-FlavorsExtraSpecsNegativeTestJSON-491751866-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:41.195261 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:41.195261 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:41.196383 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0a188f1c-3677-43f9-b93f-849e9ed04079 tempest-FlavorsExtraSpecsNegativeTestJSON-491751866 tempest-FlavorsExtraSpecsNegativeTestJSON-491751866-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'e60b3121380c479da8e84fe5c0b1cf60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9064fabc72844186999eca65394bd2a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:41.198026 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0a188f1c-3677-43f9-b93f-849e9ed04079 tempest-FlavorsExtraSpecsNegativeTestJSON-491751866 tempest-FlavorsExtraSpecsNegativeTestJSON-491751866-project] Request method failure captured: Aug 04 16:33:41.198026 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/flavors/1301729226/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 04 16:33:41.198026 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:33:41.198026 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:33:41.198026 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:33:41.198026 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:33:41.198026 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:33:41.198026 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:33:41.198026 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:33:41.198026 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:41.198026 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_TgqngaHSthIrR7J0EwD7sHc7-8RgvwokysVtWBboQQ1-cMQgJ_OeR37ot8VPfXXm8wjkc_OeuPbWzMO2nauUZ0iiLjqcuk8uJ38hxnx8TOkug7_1PpsF7qD2sYsSQVepLjcrL44hVdJHYSYRQbiNHkeAw3OobOEru97bcmV2J3puc Aug 04 16:33:41.198026 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:33:41.198026 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:33:41.198026 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:33:41.198026 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:33:41.198026 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:33:41.198026 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:33:41.198026 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 9064fabc72844186999eca65394bd2a2 Aug 04 16:33:41.198026 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-491751866 Aug 04 16:33:41.198026 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:33:41.198026 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:33:41.199900 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9064fabc72844186999eca65394bd2a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9064fabc72844186999eca65394bd2a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9064fabc72844186999eca65394bd2a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9064fabc72844186999eca65394bd2a2"}]}] Aug 04 16:33:41.199900 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-491751866 Aug 04 16:33:41.199900 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 9064fabc72844186999eca65394bd2a2 Aug 04 16:33:41.199900 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-491751866 Aug 04 16:33:41.199900 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-491751866-project Aug 04 16:33:41.199900 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:33:41.199900 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:33:41.199900 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: e60b3121380c479da8e84fe5c0b1cf60 Aug 04 16:33:41.199900 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-491751866-project Aug 04 16:33:41.199900 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:33:41.199900 n-d-846466-12 devstack@n-api.service[126126]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 04 16:33:41.200646 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'flavor_id': '1301729226', 'id': 'hw:numa_nodes'} Aug 04 16:33:41.200646 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:41.200646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:41.200646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:41.200646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:41.200646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:41.200646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:41.200646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:41.200646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:41.200646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 04 16:33:41.200646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 04 16:33:41.200646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:33:41.200646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:33:41.200646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:33:41.200646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:33:41.200646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:33:41.200646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:33:41.200646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:33:41.200646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:33:41.200646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:33:41.202349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:33:41.202349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:33:41.202349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:33:41.202349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:33:41.202349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:33:41.202349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 04 16:33:41.202349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:41.202349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:41.202349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:41.202349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:41.202349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:41.202349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:41.202349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:33:41.202349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:33:41.202349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 04 16:33:41.202349 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:41.202349 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0a188f1c-3677-43f9-b93f-849e9ed04079 tempest-FlavorsExtraSpecsNegativeTestJSON-491751866 tempest-FlavorsExtraSpecsNegativeTestJSON-491751866-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:41.203922 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0a188f1c-3677-43f9-b93f-849e9ed04079 tempest-FlavorsExtraSpecsNegativeTestJSON-491751866 tempest-FlavorsExtraSpecsNegativeTestJSON-491751866-project] 10.222.0.23 "DELETE /compute/v2.1/flavors/1301729226/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.020119 Aug 04 16:33:41.216161 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e3553c6e-a9a8-4ed9-8ca3-04be27354edb tempest-FlavorsExtraSpecsNegativeTestJSON-915186396 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:41.221080 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 214/398] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Aug 4 16:33:41 2022] DELETE /compute/v2.1/flavors/1301729226/os-extra_specs/hw:numa_nodes => generated 124 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:33:41.249470 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d1308587-cb39-4b86-93e4-6bfcd96f5e8e tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:41.251288 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d1308587-cb39-4b86-93e4-6bfcd96f5e8e tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: 1ae03eb0-d144-4135-87eb-d8816b9988e8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:41.264871 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d1308587-cb39-4b86-93e4-6bfcd96f5e8e tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:41.274252 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d1308587-cb39-4b86-93e4-6bfcd96f5e8e tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:41.277617 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d1308587-cb39-4b86-93e4-6bfcd96f5e8e tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:41.278084 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d1308587-cb39-4b86-93e4-6bfcd96f5e8e tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:41.309834 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e3553c6e-a9a8-4ed9-8ca3-04be27354edb tempest-FlavorsExtraSpecsNegativeTestJSON-915186396 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1301729226/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.099544 Aug 04 16:33:41.311149 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 185/399] 10.222.0.23 () {60 vars in 1224 bytes} [Thu Aug 4 16:33:41 2022] POST /compute/v2.1/flavors/1301729226/os-extra_specs => generated 66 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 16:33:41.320906 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-d1308587-cb39-4b86-93e4-6bfcd96f5e8e tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] HTTP exception thrown: Instance 1ae03eb0-d144-4135-87eb-d8816b9988e8 could not be found. Aug 04 16:33:41.322186 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-26ab1593-cde4-4a2f-9b80-a0babebd992d tempest-FlavorsExtraSpecsNegativeTestJSON-491751866 tempest-FlavorsExtraSpecsNegativeTestJSON-491751866-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:41.322614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d1308587-cb39-4b86-93e4-6bfcd96f5e8e tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Request method failure captured: Aug 04 16:33:41.322614 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8 HTTP/1.1 Aug 04 16:33:41.322614 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:33:41.322614 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:33:41.322614 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:33:41.322614 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:33:41.322614 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:33:41.322614 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:33:41.322614 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:33:41.322614 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:41.322614 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_SYhh95_KuN9IgWFJfBWnN2QccKVHcIrSTZkienI2MYlcZIgZJQDjKaV1uLmD_AA3PDiDk0EztKmsyJZyul_BWmuVVKoyhLSORalhxR93oD_4vb_6VzoFvvnXQi7Bc4J356Ks3SmulNV2c8nLv9bbj5SE2jT_xWcLKfFPBzkpiFneE Aug 04 16:33:41.322614 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:33:41.322614 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:33:41.322614 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:33:41.322614 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:33:41.322614 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:33:41.322614 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:33:41.322614 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 10b0ceaab59d4aeaa8667cef6f62559e Aug 04 16:33:41.322614 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-LiveMigrationNegativeTest-297127435 Aug 04 16:33:41.322614 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:33:41.322614 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:33:41.323829 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/10b0ceaab59d4aeaa8667cef6f62559e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_10b0ceaab59d4aeaa8667cef6f62559e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/10b0ceaab59d4aeaa8667cef6f62559e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/10b0ceaab59d4aeaa8667cef6f62559e"}]}] Aug 04 16:33:41.323829 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-LiveMigrationNegativeTest-297127435 Aug 04 16:33:41.323829 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 10b0ceaab59d4aeaa8667cef6f62559e Aug 04 16:33:41.323829 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-297127435 Aug 04 16:33:41.323829 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-LiveMigrationNegativeTest-297127435-project Aug 04 16:33:41.323829 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:33:41.323829 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:33:41.323829 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 052613a51b86400c916dbc800563896c Aug 04 16:33:41.323829 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-LiveMigrationNegativeTest-297127435-project Aug 04 16:33:41.323829 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:33:41.323829 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 1ae03eb0-d144-4135-87eb-d8816b9988e8 could not be found. Aug 04 16:33:41.323829 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '1ae03eb0-d144-4135-87eb-d8816b9988e8'} Aug 04 16:33:41.324504 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:41.324504 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:41.324504 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:33:41.324504 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:33:41.324504 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:33:41.324504 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:33:41.324504 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:33:41.324504 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:33:41.324504 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:33:41.324504 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:33:41.324504 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ae03eb0-d144-4135-87eb-d8816b9988e8 could not be found. Aug 04 16:33:41.324504 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:41.324504 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:41.324504 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:41.324504 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:41.324504 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:41.324504 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:41.324504 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:41.324504 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:41.324504 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:41.325709 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:41.325709 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:33:41.325709 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:33:41.325709 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:33:41.325709 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:33:41.325709 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:33:41.325709 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:33:41.325709 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ae03eb0-d144-4135-87eb-d8816b9988e8 could not be found. Aug 04 16:33:41.325709 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:41.325709 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:41.325709 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:41.325709 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:41.325709 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:41.325709 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:41.325709 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:33:41.325709 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:33:41.325709 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ae03eb0-d144-4135-87eb-d8816b9988e8 could not be found. Aug 04 16:33:41.325709 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:41.326725 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d1308587-cb39-4b86-93e4-6bfcd96f5e8e tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Returning 404 to user: Instance 1ae03eb0-d144-4135-87eb-d8816b9988e8 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:41.326725 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d1308587-cb39-4b86-93e4-6bfcd96f5e8e tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8" status: 404 len: 111 microversion: 2.1 time: 0.087531 Aug 04 16:33:41.327592 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 215/400] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:41 2022] GET /compute/v2.1/servers/1ae03eb0-d144-4135-87eb-d8816b9988e8 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:33:41.331009 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:41.331009 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:41.332525 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-26ab1593-cde4-4a2f-9b80-a0babebd992d tempest-FlavorsExtraSpecsNegativeTestJSON-491751866 tempest-FlavorsExtraSpecsNegativeTestJSON-491751866-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'e60b3121380c479da8e84fe5c0b1cf60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9064fabc72844186999eca65394bd2a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:41.332692 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-502fd211-3f30-45f0-8511-02d425ec7094 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:41.333125 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-502fd211-3f30-45f0-8511-02d425ec7094 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: dc4b9aed-b141-46b5-a62b-a039640c6310] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:41.336412 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-26ab1593-cde4-4a2f-9b80-a0babebd992d tempest-FlavorsExtraSpecsNegativeTestJSON-491751866 tempest-FlavorsExtraSpecsNegativeTestJSON-491751866-project] Request method failure captured: Aug 04 16:33:41.336412 n-d-846466-12 devstack@n-api.service[126125]: request: PUT /compute/v2.1/flavors/1301729226/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 04 16:33:41.336412 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:33:41.336412 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:33:41.336412 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:33:41.336412 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 22 Aug 04 16:33:41.336412 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:33:41.336412 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:33:41.336412 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:33:41.336412 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:41.336412 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_TgqngaHSthIrR7J0EwD7sHc7-8RgvwokysVtWBboQQ1-cMQgJ_OeR37ot8VPfXXm8wjkc_OeuPbWzMO2nauUZ0iiLjqcuk8uJ38hxnx8TOkug7_1PpsF7qD2sYsSQVepLjcrL44hVdJHYSYRQbiNHkeAw3OobOEru97bcmV2J3puc Aug 04 16:33:41.336412 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:33:41.336412 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:33:41.336412 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:33:41.336412 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:33:41.336412 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:33:41.336412 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:33:41.336412 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 9064fabc72844186999eca65394bd2a2 Aug 04 16:33:41.336412 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-491751866 Aug 04 16:33:41.336412 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:33:41.336412 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:33:41.338255 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9064fabc72844186999eca65394bd2a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9064fabc72844186999eca65394bd2a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9064fabc72844186999eca65394bd2a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9064fabc72844186999eca65394bd2a2"}]}] Aug 04 16:33:41.338255 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-491751866 Aug 04 16:33:41.338255 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 9064fabc72844186999eca65394bd2a2 Aug 04 16:33:41.338255 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-491751866 Aug 04 16:33:41.338255 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-491751866-project Aug 04 16:33:41.338255 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:33:41.338255 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:33:41.338255 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: e60b3121380c479da8e84fe5c0b1cf60 Aug 04 16:33:41.338255 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-491751866-project Aug 04 16:33:41.338255 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:33:41.338255 n-d-846466-12 devstack@n-api.service[126125]: {"hw:numa_nodes": "1"} Aug 04 16:33:41.338255 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:33:41.338255 n-d-846466-12 devstack@n-api.service[126125]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 04 16:33:41.339065 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'flavor_id': '1301729226', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 04 16:33:41.339065 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:41.339065 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:41.339065 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:41.339065 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:41.339065 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:41.339065 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:41.339065 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:41.339065 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:41.339065 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:33:41.339065 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:33:41.339065 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 04 16:33:41.339065 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 04 16:33:41.339065 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:33:41.339065 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:33:41.339065 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:33:41.339065 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:33:41.339065 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:33:41.339065 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:33:41.340142 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:33:41.340142 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:33:41.340142 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:33:41.340142 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:33:41.340142 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:33:41.340142 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:33:41.340142 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:33:41.340142 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:33:41.340142 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 04 16:33:41.340142 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:41.340142 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:41.340142 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:41.340142 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:41.340142 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:41.340142 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:41.340142 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:33:41.340142 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:33:41.340142 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 04 16:33:41.340142 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:41.343001 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-26ab1593-cde4-4a2f-9b80-a0babebd992d tempest-FlavorsExtraSpecsNegativeTestJSON-491751866 tempest-FlavorsExtraSpecsNegativeTestJSON-491751866-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:41.345496 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-26ab1593-cde4-4a2f-9b80-a0babebd992d tempest-FlavorsExtraSpecsNegativeTestJSON-491751866 tempest-FlavorsExtraSpecsNegativeTestJSON-491751866-project] 10.222.0.23 "PUT /compute/v2.1/flavors/1301729226/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.027023 Aug 04 16:33:41.347302 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 186/401] 10.222.0.23 () {60 vars in 1265 bytes} [Thu Aug 4 16:33:41 2022] PUT /compute/v2.1/flavors/1301729226/os-extra_specs/hw:numa_nodes => generated 124 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:33:41.360278 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-502fd211-3f30-45f0-8511-02d425ec7094 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:41.362646 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-502fd211-3f30-45f0-8511-02d425ec7094 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:41.363590 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3507eca4-2f1a-4fc9-bd9a-17c515d89441 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:41.365255 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-502fd211-3f30-45f0-8511-02d425ec7094 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:41.365916 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:41.365916 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:41.367768 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-502fd211-3f30-45f0-8511-02d425ec7094 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:41.386731 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-3507eca4-2f1a-4fc9-bd9a-17c515d89441 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396-project-admin] HTTP exception thrown: Flavor 1301729226 has no extra specs with key hw:cpu_thread_policy. Aug 04 16:33:41.390880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3507eca4-2f1a-4fc9-bd9a-17c515d89441 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396-project-admin] Request method failure captured: Aug 04 16:33:41.390880 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/flavors/1301729226/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 04 16:33:41.390880 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:33:41.390880 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:33:41.390880 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:33:41.390880 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:33:41.390880 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:33:41.390880 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:33:41.390880 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:33:41.390880 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:41.390880 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_Ti-Dc9nUTBwoKyYLSRmz1A-GGJGmg5SyF-tGl8VrXoI-0BAMoPs444C9qbhy8FBvj9GTC_cy33dqGMhirAK13E3WjFAewzM_5A4fRfPoMQ-5WEKgxLUBLb7OKPiVkMnh06WwwDMawlOEl-BlMIg0QYFRkjPHvw0h2j5KWN_fvPJCI Aug 04 16:33:41.390880 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:33:41.390880 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:33:41.390880 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:33:41.390880 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:33:41.390880 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:33:41.390880 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:33:41.390880 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 3075d8cece044a5194feca9e2059eb95 Aug 04 16:33:41.390880 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-915186396 Aug 04 16:33:41.390880 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader,admin Aug 04 16:33:41.390880 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader,admin Aug 04 16:33:41.392675 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3075d8cece044a5194feca9e2059eb95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3075d8cece044a5194feca9e2059eb95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3075d8cece044a5194feca9e2059eb95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3075d8cece044a5194feca9e2059eb95"}]}] Aug 04 16:33:41.392675 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-915186396 Aug 04 16:33:41.392675 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 3075d8cece044a5194feca9e2059eb95 Aug 04 16:33:41.392675 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-915186396 Aug 04 16:33:41.392675 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-915186396-project-admin Aug 04 16:33:41.392675 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:33:41.392675 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:33:41.392675 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: d57424f5dcee4dcaa649073579901fd6 Aug 04 16:33:41.392675 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-915186396-project-admin Aug 04 16:33:41.392675 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:33:41.392675 n-d-846466-12 devstack@n-api.service[126125]: exception: Flavor 1301729226 has no extra specs with key hw:cpu_thread_policy. Aug 04 16:33:41.393438 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'flavor_id': '1301729226', 'id': 'hw:cpu_thread_policy'} Aug 04 16:33:41.393438 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:41.393438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:41.393438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 04 16:33:41.393438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 04 16:33:41.393438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 04 16:33:41.393438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:41.393438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:41.393438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:41.393438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:41.393438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:41.393438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:41.393438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:41.393438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:41.393438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:41.393438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:41.393438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 04 16:33:41.393438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 16:33:41.393438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1301729226 has no extra specs with key hw:cpu_thread_policy. Aug 04 16:33:41.393438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:41.393438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:41.393438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:41.394674 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:41.394674 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:41.394674 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:41.394674 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:33:41.394674 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:33:41.394674 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1301729226 has no extra specs with key hw:cpu_thread_policy. Aug 04 16:33:41.394674 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:41.398565 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3507eca4-2f1a-4fc9-bd9a-17c515d89441 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396-project-admin] Returning 404 to user: Flavor 1301729226 has no extra specs with key hw:cpu_thread_policy. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:41.399933 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3507eca4-2f1a-4fc9-bd9a-17c515d89441 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1301729226/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.045050 Aug 04 16:33:41.404032 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 187/402] 10.222.0.23 () {58 vars in 1269 bytes} [Thu Aug 4 16:33:41 2022] DELETE /compute/v2.1/flavors/1301729226/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:33:41.423063 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-736c03ec-154c-4722-b10d-f6e8334f5ee2 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:41.428998 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-736c03ec-154c-4722-b10d-f6e8334f5ee2 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 04 16:33:41.435000 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-736c03ec-154c-4722-b10d-f6e8334f5ee2 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396-project-admin] Request method failure captured: Aug 04 16:33:41.435000 n-d-846466-12 devstack@n-api.service[126125]: request: PUT /compute/v2.1/flavors/1301729226/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 04 16:33:41.435000 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:33:41.435000 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:33:41.435000 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:33:41.435000 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 27 Aug 04 16:33:41.435000 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:33:41.435000 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:33:41.435000 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:33:41.435000 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:41.435000 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_Ti-Dc9nUTBwoKyYLSRmz1A-GGJGmg5SyF-tGl8VrXoI-0BAMoPs444C9qbhy8FBvj9GTC_cy33dqGMhirAK13E3WjFAewzM_5A4fRfPoMQ-5WEKgxLUBLb7OKPiVkMnh06WwwDMawlOEl-BlMIg0QYFRkjPHvw0h2j5KWN_fvPJCI Aug 04 16:33:41.435000 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:33:41.435000 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:33:41.435000 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:33:41.435000 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:33:41.435000 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:33:41.435000 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:33:41.435000 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 3075d8cece044a5194feca9e2059eb95 Aug 04 16:33:41.435000 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-915186396 Aug 04 16:33:41.435000 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader,admin Aug 04 16:33:41.435000 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader,admin Aug 04 16:33:41.436387 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3075d8cece044a5194feca9e2059eb95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3075d8cece044a5194feca9e2059eb95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3075d8cece044a5194feca9e2059eb95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3075d8cece044a5194feca9e2059eb95"}]}] Aug 04 16:33:41.436387 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-915186396 Aug 04 16:33:41.436387 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 3075d8cece044a5194feca9e2059eb95 Aug 04 16:33:41.436387 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-915186396 Aug 04 16:33:41.436387 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-915186396-project-admin Aug 04 16:33:41.436387 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:33:41.436387 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:33:41.436387 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: d57424f5dcee4dcaa649073579901fd6 Aug 04 16:33:41.436387 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-915186396-project-admin Aug 04 16:33:41.436387 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:33:41.436387 n-d-846466-12 devstack@n-api.service[126125]: {"hw:cpu_policy": "shared"} Aug 04 16:33:41.436387 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:33:41.436387 n-d-846466-12 devstack@n-api.service[126125]: exception: Request body and URI mismatch Aug 04 16:33:41.437241 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'flavor_id': '1301729226', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 04 16:33:41.437241 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:41.437241 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:41.437241 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:41.437241 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:41.437241 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:41.437241 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:41.437241 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:41.437241 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:41.437241 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:33:41.437241 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:33:41.437241 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 04 16:33:41.437241 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 04 16:33:41.437241 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 04 16:33:41.437241 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:41.437241 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:41.437241 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:41.437241 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:41.437241 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:41.437241 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:41.438418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:33:41.438418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:33:41.438418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 04 16:33:41.438418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:41.440781 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-736c03ec-154c-4722-b10d-f6e8334f5ee2 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:41.441985 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-736c03ec-154c-4722-b10d-f6e8334f5ee2 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/1301729226/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.025812 Aug 04 16:33:41.443462 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 188/403] 10.222.0.23 () {60 vars in 1265 bytes} [Thu Aug 4 16:33:41 2022] PUT /compute/v2.1/flavors/1301729226/os-extra_specs/hw:numa_nodes => generated 73 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 16:33:41.449007 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-502fd211-3f30-45f0-8511-02d425ec7094 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: dc4b9aed-b141-46b5-a62b-a039640c6310] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:33:41.455693 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3b735bc2-51d0-4fa6-a193-43e303f957a6 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:41.460649 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3b735bc2-51d0-4fa6-a193-43e303f957a6 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396-project-admin] Request method failure captured: Aug 04 16:33:41.460649 n-d-846466-12 devstack@n-api.service[126125]: request: PUT /compute/v2.1/flavors/1301729226/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 04 16:33:41.460649 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:33:41.460649 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:33:41.460649 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:33:41.460649 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 49 Aug 04 16:33:41.460649 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:33:41.460649 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:33:41.460649 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:33:41.460649 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:41.460649 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_Ti-Dc9nUTBwoKyYLSRmz1A-GGJGmg5SyF-tGl8VrXoI-0BAMoPs444C9qbhy8FBvj9GTC_cy33dqGMhirAK13E3WjFAewzM_5A4fRfPoMQ-5WEKgxLUBLb7OKPiVkMnh06WwwDMawlOEl-BlMIg0QYFRkjPHvw0h2j5KWN_fvPJCI Aug 04 16:33:41.460649 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:33:41.460649 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:33:41.460649 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:33:41.460649 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:33:41.460649 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:33:41.460649 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:33:41.460649 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 3075d8cece044a5194feca9e2059eb95 Aug 04 16:33:41.460649 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-915186396 Aug 04 16:33:41.460649 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader,admin Aug 04 16:33:41.460649 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader,admin Aug 04 16:33:41.462046 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3075d8cece044a5194feca9e2059eb95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3075d8cece044a5194feca9e2059eb95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3075d8cece044a5194feca9e2059eb95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3075d8cece044a5194feca9e2059eb95"}]}] Aug 04 16:33:41.462046 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-915186396 Aug 04 16:33:41.462046 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 3075d8cece044a5194feca9e2059eb95 Aug 04 16:33:41.462046 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-915186396 Aug 04 16:33:41.462046 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-915186396-project-admin Aug 04 16:33:41.462046 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:33:41.462046 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:33:41.462046 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: d57424f5dcee4dcaa649073579901fd6 Aug 04 16:33:41.462046 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-915186396-project-admin Aug 04 16:33:41.462046 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:33:41.462046 n-d-846466-12 devstack@n-api.service[126125]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 04 16:33:41.462046 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:33:41.462854 n-d-846466-12 devstack@n-api.service[126125]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 04 16:33:41.462854 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'flavor_id': '1301729226', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 04 16:33:41.462854 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:41.462854 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:41.462854 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:33:41.462854 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:33:41.462854 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:33:41.462854 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:33:41.462854 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 04 16:33:41.462854 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:41.462854 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 04 16:33:41.462854 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 04 16:33:41.462854 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 04 16:33:41.462854 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 04 16:33:41.462854 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 04 16:33:41.462854 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 04 16:33:41.462854 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 04 16:33:41.462854 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 04 16:33:41.462854 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:41.462854 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi On instance: Aug 04 16:33:41.462854 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 04 16:33:41.462854 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:41.464133 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:41.464133 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:41.464133 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:41.464133 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:41.464133 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:41.464133 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:41.464133 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:41.464133 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:41.464133 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:41.464133 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 16:33:41.464133 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 16:33:41.464133 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:33:41.464133 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:33:41.464133 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:33:41.464133 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:33:41.464133 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 04 16:33:41.464133 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:41.464133 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:41.464133 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:41.464133 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:41.468093 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:41.468093 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:41.468093 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:33:41.468093 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:33:41.468093 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 04 16:33:41.468093 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:41.468093 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3b735bc2-51d0-4fa6-a193-43e303f957a6 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:41.468093 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3b735bc2-51d0-4fa6-a193-43e303f957a6 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/1301729226/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.010601 Aug 04 16:33:41.468093 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 189/404] 10.222.0.23 () {60 vars in 1265 bytes} [Thu Aug 4 16:33:41 2022] PUT /compute/v2.1/flavors/1301729226/os-extra_specs/hw:numa_nodes => generated 117 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 16:33:41.476814 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-306039f3-eff2-4ddf-adf2-f402fdbd5e30 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:41.478393 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:41.478393 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:41.574701 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-306039f3-eff2-4ddf-adf2-f402fdbd5e30 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1301729226" status: 202 len: 0 microversion: 2.1 time: 0.087319 Aug 04 16:33:41.575786 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 190/405] 10.222.0.23 () {58 vars in 1161 bytes} [Thu Aug 4 16:33:41 2022] DELETE /compute/v2.1/flavors/1301729226 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 16:33:41.586027 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-78d73ee6-e652-418b-931b-2994cde49308 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:41.672992 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-78d73ee6-e652-418b-931b-2994cde49308 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396 tempest-FlavorsExtraSpecsNegativeTestJSON-915186396-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.091904 Aug 04 16:33:41.675996 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 191/406] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:33:41 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:33:41.730248 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-4f0f1a24-4358-418e-9811-d2a449dbb8a0 req-837c4b13-f3fe-40a2-8d88-0f47855730ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92c85400-67f0-4930-bf61-28770e84b98c", "name": "network-vif-plugged", "status": "completed", "tag": "39a2a768-1a97-4d6f-ba46-987474d856d5"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:41.748514 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-4f0f1a24-4358-418e-9811-d2a449dbb8a0 req-837c4b13-f3fe-40a2-8d88-0f47855730ec service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:41.751870 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-4f0f1a24-4358-418e-9811-d2a449dbb8a0 req-837c4b13-f3fe-40a2-8d88-0f47855730ec service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:41.778435 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-4f0f1a24-4358-418e-9811-d2a449dbb8a0 req-837c4b13-f3fe-40a2-8d88-0f47855730ec service nova] Creating event network-vif-plugged:39a2a768-1a97-4d6f-ba46-987474d856d5 for instance 92c85400-67f0-4930-bf61-28770e84b98c on n-h2-846466-12 Aug 04 16:33:41.787275 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-4f0f1a24-4358-418e-9811-d2a449dbb8a0 req-837c4b13-f3fe-40a2-8d88-0f47855730ec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060454 Aug 04 16:33:41.790064 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 192/407] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:33:41.861912 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-502fd211-3f30-45f0-8511-02d425ec7094 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310" status: 204 len: 0 microversion: 2.1 time: 0.532192 Aug 04 16:33:41.877242 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b9197a14-d981-40b2-a9b1-6a8f45bfe538 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:41.878369 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b9197a14-d981-40b2-a9b1-6a8f45bfe538 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: dc4b9aed-b141-46b5-a62b-a039640c6310] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:41.882169 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 216/408] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:33:41 2022] DELETE /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:33:41.889716 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b9197a14-d981-40b2-a9b1-6a8f45bfe538 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:41.890657 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b9197a14-d981-40b2-a9b1-6a8f45bfe538 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:41.893440 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b9197a14-d981-40b2-a9b1-6a8f45bfe538 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:41.894209 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b9197a14-d981-40b2-a9b1-6a8f45bfe538 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:42.044527 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4bd3450a-94aa-4ea4-a2a7-8643a99f0384 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:42.046374 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4bd3450a-94aa-4ea4-a2a7-8643a99f0384 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: 92c85400-67f0-4930-bf61-28770e84b98c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:42.071545 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4bd3450a-94aa-4ea4-a2a7-8643a99f0384 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:42.072159 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4bd3450a-94aa-4ea4-a2a7-8643a99f0384 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:42.075303 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4bd3450a-94aa-4ea4-a2a7-8643a99f0384 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:42.078098 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4bd3450a-94aa-4ea4-a2a7-8643a99f0384 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:42.429484 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b9197a14-d981-40b2-a9b1-6a8f45bfe538 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052613a51b86400c916dbc800563896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0ceaab59d4aeaa8667cef6f62559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:42.438721 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b9197a14-d981-40b2-a9b1-6a8f45bfe538 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "GET /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310" status: 200 len: 1474 microversion: 2.1 time: 0.568766 Aug 04 16:33:42.444202 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 193/409] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:41 2022] GET /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310 => generated 1474 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:42.465330 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f1a3c8be-0159-4055-9563-bf2f443a4d49 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:42.472252 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f1a3c8be-0159-4055-9563-bf2f443a4d49 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: f23a3c47-f725-4ad2-b88d-b972ff4b2ee9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:42.489026 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f1a3c8be-0159-4055-9563-bf2f443a4d49 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:42.489629 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f1a3c8be-0159-4055-9563-bf2f443a4d49 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:42.490335 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4bd3450a-94aa-4ea4-a2a7-8643a99f0384 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c73c354a6ee4ab881f483ff65a21dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cb965024d94d7cae0c5652212e7cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:42.490812 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f1a3c8be-0159-4055-9563-bf2f443a4d49 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:42.490978 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f1a3c8be-0159-4055-9563-bf2f443a4d49 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:42.493835 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:33:42.501958 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4bd3450a-94aa-4ea4-a2a7-8643a99f0384 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c" status: 200 len: 1321 microversion: 2.1 time: 0.465989 Aug 04 16:33:42.505247 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 217/410] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:42 2022] GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c => generated 1321 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:42.616542 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f1a3c8be-0159-4055-9563-bf2f443a4d49 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:42.627790 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f1a3c8be-0159-4055-9563-bf2f443a4d49 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9" status: 200 len: 1206 microversion: 2.1 time: 0.181262 Aug 04 16:33:42.638299 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 194/411] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:42 2022] GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 => generated 1206 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:42.941405 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d744d88c-fd0a-481c-9607-29abd6eb9066 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:42.943142 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d744d88c-fd0a-481c-9607-29abd6eb9066 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: ac53ca0d-94da-45a3-bd53-f013b5b61d51] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:42.963569 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d744d88c-fd0a-481c-9607-29abd6eb9066 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:42.964676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d744d88c-fd0a-481c-9607-29abd6eb9066 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:42.979018 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d744d88c-fd0a-481c-9607-29abd6eb9066 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:42.979883 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d744d88c-fd0a-481c-9607-29abd6eb9066 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:43.040061 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d744d88c-fd0a-481c-9607-29abd6eb9066 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: ac53ca0d-94da-45a3-bd53-f013b5b61d51] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:33:43.194191 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d744d88c-fd0a-481c-9607-29abd6eb9066 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51" status: 204 len: 0 microversion: 2.1 time: 0.257854 Aug 04 16:33:43.197344 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 218/412] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:33:42 2022] DELETE /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:33:43.467452 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7912c8f8-71af-42ae-9ffa-f4ddc1be9198 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:43.468365 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7912c8f8-71af-42ae-9ffa-f4ddc1be9198 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: dc4b9aed-b141-46b5-a62b-a039640c6310] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:43.484698 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7912c8f8-71af-42ae-9ffa-f4ddc1be9198 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:43.486455 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7912c8f8-71af-42ae-9ffa-f4ddc1be9198 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:43.487712 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7912c8f8-71af-42ae-9ffa-f4ddc1be9198 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:43.488529 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7912c8f8-71af-42ae-9ffa-f4ddc1be9198 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:43.716855 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7912c8f8-71af-42ae-9ffa-f4ddc1be9198 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052613a51b86400c916dbc800563896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0ceaab59d4aeaa8667cef6f62559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:43.728622 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7912c8f8-71af-42ae-9ffa-f4ddc1be9198 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "GET /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310" status: 200 len: 1474 microversion: 2.1 time: 0.266820 Aug 04 16:33:43.729392 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 219/413] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:43 2022] GET /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310 => generated 1474 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:43.738702 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4860dbca-a9bc-44f6-82d7-e16f6da86c1e tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:43.739570 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4860dbca-a9bc-44f6-82d7-e16f6da86c1e tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: 92c85400-67f0-4930-bf61-28770e84b98c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:43.747352 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4860dbca-a9bc-44f6-82d7-e16f6da86c1e tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:43.748062 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4860dbca-a9bc-44f6-82d7-e16f6da86c1e tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:43.748832 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4860dbca-a9bc-44f6-82d7-e16f6da86c1e tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:43.749550 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4860dbca-a9bc-44f6-82d7-e16f6da86c1e tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:43.861098 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-503104ee-6f9f-4399-9b56-207854aa5624 tempest-FlavorsAccessTestJSON-1813047062 tempest-FlavorsAccessTestJSON-1813047062-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1213613243", "id": 1430778036, "os-flavor-access:is_public": "False"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:43.865982 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:43.865982 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:43.890968 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-503104ee-6f9f-4399-9b56-207854aa5624 tempest-FlavorsAccessTestJSON-1813047062 tempest-FlavorsAccessTestJSON-1813047062-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.488074 Aug 04 16:33:43.891920 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 195/414] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:33:43 2022] POST /compute/v2.1/flavors => generated 431 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:33:43.906683 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e58a89e8-fab4-4188-b769-12eca2da9561 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1127404149", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "1332659819", "adminPass": "***", "networks": [{"uuid": "07ae128f-d870-4ee5-a69c-fe59fccdadb9"}], "security_groups": [{"name": "tempest-securitygroup--1113529029"}], "key_name": "tempest-keypair-271659618", "user_data": "}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:43.971970 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4860dbca-a9bc-44f6-82d7-e16f6da86c1e tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c73c354a6ee4ab881f483ff65a21dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cb965024d94d7cae0c5652212e7cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:43.980633 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4860dbca-a9bc-44f6-82d7-e16f6da86c1e tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c" status: 200 len: 1470 microversion: 2.1 time: 0.249853 Aug 04 16:33:43.981210 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 220/415] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:43 2022] GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c => generated 1470 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:44.014084 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-84199aed-9cf6-4990-8b9f-a60e70d93b7a tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:44.017329 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-84199aed-9cf6-4990-8b9f-a60e70d93b7a tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: f23a3c47-f725-4ad2-b88d-b972ff4b2ee9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:44.044663 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-84199aed-9cf6-4990-8b9f-a60e70d93b7a tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:44.045414 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-84199aed-9cf6-4990-8b9f-a60e70d93b7a tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:44.046447 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-84199aed-9cf6-4990-8b9f-a60e70d93b7a tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:44.047660 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-84199aed-9cf6-4990-8b9f-a60e70d93b7a tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:44.118342 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-e58a89e8-fab4-4188-b769-12eca2da9561 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] validate_networks() for [('07ae128f-d870-4ee5-a69c-fe59fccdadb9', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:33:44.421812 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-84199aed-9cf6-4990-8b9f-a60e70d93b7a tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:44.431482 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-84199aed-9cf6-4990-8b9f-a60e70d93b7a tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9" status: 200 len: 1262 microversion: 2.1 time: 0.449151 Aug 04 16:33:44.435363 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 221/416] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:43 2022] GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 => generated 1262 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:44.447488 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-56abf9b2-8717-4ab5-818c-3f1ac4d54790 tempest-FlavorsAccessTestJSON-1813047062 tempest-FlavorsAccessTestJSON-1813047062-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "8d432e7a57374f1bbe92a96376cba963"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:44.460925 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:44.460925 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:44.563372 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:33:44.857363 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-e58a89e8-fab4-4188-b769-12eca2da9561 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:33:44.857894 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-e58a89e8-fab4-4188-b769-12eca2da9561 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:33:44.858549 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-e58a89e8-fab4-4188-b769-12eca2da9561 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:33:44.859050 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-e58a89e8-fab4-4188-b769-12eca2da9561 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:33:44.859595 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-e58a89e8-fab4-4188-b769-12eca2da9561 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:33:44.874616 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e58a89e8-fab4-4188-b769-12eca2da9561 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:44.876457 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e58a89e8-fab4-4188-b769-12eca2da9561 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:44.878590 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e58a89e8-fab4-4188-b769-12eca2da9561 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:44.879281 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e58a89e8-fab4-4188-b769-12eca2da9561 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:44.907611 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-e58a89e8-fab4-4188-b769-12eca2da9561 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Getting quotas for project 5cd96a8c91974b8ba7919d5349f380ee. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:33:44.913396 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-e58a89e8-fab4-4188-b769-12eca2da9561 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Getting quotas for user 7a427fb7481d4799a83729910f33b01b and project 5cd96a8c91974b8ba7919d5349f380ee. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:33:44.936937 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e58a89e8-fab4-4188-b769-12eca2da9561 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:33:44.941584 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e58a89e8-fab4-4188-b769-12eca2da9561 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: f8497465-98e6-46f0-bd09-11c432c292a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:33:45.053641 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e58a89e8-fab4-4188-b769-12eca2da9561 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.152046 Aug 04 16:33:45.055912 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 196/417] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:33:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 1163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:33:45.120906 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-56abf9b2-8717-4ab5-818c-3f1ac4d54790 tempest-FlavorsAccessTestJSON-1813047062 tempest-FlavorsAccessTestJSON-1813047062-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1430778036/action" status: 200 len: 97 microversion: 2.1 time: 0.684200 Aug 04 16:33:45.124542 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 222/418] 10.222.0.23 () {60 vars in 1200 bytes} [Thu Aug 4 16:33:44 2022] POST /compute/v2.1/flavors/1430778036/action => generated 97 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:33:45.498366 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-94c7d829-d30c-4a70-9a6a-3f1d48c90c80 tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:45.499578 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-94c7d829-d30c-4a70-9a6a-3f1d48c90c80 tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] [instance: d1381d6a-2538-4806-8ced-937948aa2469] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:45.511331 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-94c7d829-d30c-4a70-9a6a-3f1d48c90c80 tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] HTTP exception thrown: Instance d1381d6a-2538-4806-8ced-937948aa2469 could not be found. Aug 04 16:33:45.513034 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-94c7d829-d30c-4a70-9a6a-3f1d48c90c80 tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Request method failure captured: Aug 04 16:33:45.513034 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers/d1381d6a-2538-4806-8ced-937948aa2469/action HTTP/1.1 Aug 04 16:33:45.513034 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:33:45.513034 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:33:45.513034 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:33:45.513034 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 15 Aug 04 16:33:45.513034 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:33:45.513034 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:33:45.513034 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:33:45.513034 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:45.513034 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_TNUieXndj_whJCz4472FtDKfXYjgMXSxI0w9zFZcI1wSjwAN2UHLahDDkutG6pskTOvgQAQyheVE1NfvhNAFOmM6L0sUUPQ9HkZgkdad2aDvjNP66ZbqXWlntsX8fwymRQ754wex6A-0-knKD4IUU-Kd3JkTHV8iVQIzeK7mpMHtU Aug 04 16:33:45.513034 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:33:45.513034 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:33:45.513034 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:33:45.513034 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:33:45.513034 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:33:45.513034 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:33:45.513034 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: d5361d068b5a4ca9936049683638e8f8 Aug 04 16:33:45.513034 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1400456038 Aug 04 16:33:45.513034 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader,admin Aug 04 16:33:45.513034 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader,admin Aug 04 16:33:45.514294 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d5361d068b5a4ca9936049683638e8f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d5361d068b5a4ca9936049683638e8f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d5361d068b5a4ca9936049683638e8f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d5361d068b5a4ca9936049683638e8f8"}]}] Aug 04 16:33:45.514294 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1400456038 Aug 04 16:33:45.514294 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: d5361d068b5a4ca9936049683638e8f8 Aug 04 16:33:45.514294 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1400456038 Aug 04 16:33:45.514294 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersAdminNegativeTestJSON-1400456038-project-admin Aug 04 16:33:45.514294 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:33:45.514294 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:33:45.514294 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: fd3d83f42eaa4553addf5380f20dd98a Aug 04 16:33:45.514294 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1400456038-project-admin Aug 04 16:33:45.514294 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:33:45.514294 n-d-846466-12 devstack@n-api.service[126125]: {"migrate": {}} Aug 04 16:33:45.514294 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:33:45.514294 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance d1381d6a-2538-4806-8ced-937948aa2469 could not be found. Aug 04 16:33:45.515076 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'd1381d6a-2538-4806-8ced-937948aa2469', 'body': {'migrate': {}}} Aug 04 16:33:45.515076 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:45.515076 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:45.515076 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:33:45.515076 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:33:45.515076 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:33:45.515076 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:33:45.515076 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 16:33:45.515076 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 16:33:45.515076 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1381d6a-2538-4806-8ced-937948aa2469 could not be found. Aug 04 16:33:45.515076 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:45.515076 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:45.515076 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:45.515076 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:45.515076 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:45.515076 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:45.515076 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:45.515076 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:45.515076 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:45.515076 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:45.516218 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:33:45.516218 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:33:45.516218 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 04 16:33:45.516218 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 04 16:33:45.516218 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:33:45.516218 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:33:45.516218 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1381d6a-2538-4806-8ced-937948aa2469 could not be found. Aug 04 16:33:45.516218 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:45.516218 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:45.516218 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:45.516218 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:45.516218 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:45.516218 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:45.516218 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:33:45.516218 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:33:45.516218 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1381d6a-2538-4806-8ced-937948aa2469 could not be found. Aug 04 16:33:45.516218 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:45.518650 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-94c7d829-d30c-4a70-9a6a-3f1d48c90c80 tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Returning 404 to user: Instance d1381d6a-2538-4806-8ced-937948aa2469 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:45.518650 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-94c7d829-d30c-4a70-9a6a-3f1d48c90c80 tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/d1381d6a-2538-4806-8ced-937948aa2469/action" status: 404 len: 111 microversion: 2.1 time: 0.458187 Aug 04 16:33:45.524526 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 197/419] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:33:45 2022] POST /compute/v2.1/servers/d1381d6a-2538-4806-8ced-937948aa2469/action => generated 111 bytes in 467 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:33:45.534026 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-50ae4c26-d7f4-4329-a1d3-c4d5d7811bb2 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:45.534647 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-50ae4c26-d7f4-4329-a1d3-c4d5d7811bb2 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: dc4b9aed-b141-46b5-a62b-a039640c6310] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:45.544635 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50ae4c26-d7f4-4329-a1d3-c4d5d7811bb2 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:45.545004 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50ae4c26-d7f4-4329-a1d3-c4d5d7811bb2 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:45.545827 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50ae4c26-d7f4-4329-a1d3-c4d5d7811bb2 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:45.546260 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50ae4c26-d7f4-4329-a1d3-c4d5d7811bb2 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:45.556495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cd14fea5-38dd-40d4-88c1-3dd0f74f5ade tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Calling method '.version_select at 0x7f7e851fd820>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:45.559191 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:45.559191 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:45.560844 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cd14fea5-38dd-40d4-88c1-3dd0f74f5ade tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:45.560844 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cd14fea5-38dd-40d4-88c1-3dd0f74f5ade tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:45.561664 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cd14fea5-38dd-40d4-88c1-3dd0f74f5ade tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:45.562079 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cd14fea5-38dd-40d4-88c1-3dd0f74f5ade tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:45.658491 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cd14fea5-38dd-40d4-88c1-3dd0f74f5ade tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.532725 Aug 04 16:33:45.659083 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 223/420] 10.222.0.23 () {58 vars in 1128 bytes} [Thu Aug 4 16:33:45 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:45.675314 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-84041971-4b07-4957-a9dc-88e7265f62df tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:45.676174 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-84041971-4b07-4957-a9dc-88e7265f62df tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: f8497465-98e6-46f0-bd09-11c432c292a1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:45.897319 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-84041971-4b07-4957-a9dc-88e7265f62df tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a427fb7481d4799a83729910f33b01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd96a8c91974b8ba7919d5349f380ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:45.914702 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-84041971-4b07-4957-a9dc-88e7265f62df tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1" status: 200 len: 1264 microversion: 2.1 time: 0.245625 Aug 04 16:33:45.917640 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 224/421] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:45 2022] GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1 => generated 1264 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:46.129878 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-50ae4c26-d7f4-4329-a1d3-c4d5d7811bb2 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052613a51b86400c916dbc800563896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0ceaab59d4aeaa8667cef6f62559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:46.140911 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-50ae4c26-d7f4-4329-a1d3-c4d5d7811bb2 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "GET /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310" status: 200 len: 1474 microversion: 2.1 time: 0.614002 Aug 04 16:33:46.154601 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 198/422] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:45 2022] GET /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310 => generated 1474 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:46.154601 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2895a428-46da-40e7-afb9-70d3e439a130 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:46.154601 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2895a428-46da-40e7-afb9-70d3e439a130 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: f23a3c47-f725-4ad2-b88d-b972ff4b2ee9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:46.169586 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2895a428-46da-40e7-afb9-70d3e439a130 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:46.170044 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2895a428-46da-40e7-afb9-70d3e439a130 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:46.173967 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2895a428-46da-40e7-afb9-70d3e439a130 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:46.174596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2895a428-46da-40e7-afb9-70d3e439a130 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:46.223345 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:33:46.367584 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2895a428-46da-40e7-afb9-70d3e439a130 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:46.375498 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2895a428-46da-40e7-afb9-70d3e439a130 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9" status: 200 len: 1268 microversion: 2.1 time: 0.230830 Aug 04 16:33:46.376075 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 199/423] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:46 2022] GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 => generated 1268 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:46.396719 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-17c37c3e-681b-4ac9-a923-19638957fb10 tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Calling method '.version_select at 0x7f7e8479e550>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:46.399648 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:46.399648 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:46.401164 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-17c37c3e-681b-4ac9-a923-19638957fb10 tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:46.401885 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-17c37c3e-681b-4ac9-a923-19638957fb10 tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:46.402862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-17c37c3e-681b-4ac9-a923-19638957fb10 tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:46.403445 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-17c37c3e-681b-4ac9-a923-19638957fb10 tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:46.435204 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-17c37c3e-681b-4ac9-a923-19638957fb10 tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.047743 Aug 04 16:33:46.442423 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 200/424] 10.222.0.23 () {58 vars in 1139 bytes} [Thu Aug 4 16:33:46 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:46.448507 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c0ae4bcf-dc21-4696-b700-44e97f450010 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2104273117", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:46.529438 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-c0ae4bcf-dc21-4696-b700-44e97f450010 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] validate_networks() for None {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:33:46.551371 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f4dfc6f3-fa15-4828-9b3b-31f249f61c63 tempest-FlavorsAccessTestJSON-2067905281 tempest-FlavorsAccessTestJSON-2067905281-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:46.597499 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f4dfc6f3-fa15-4828-9b3b-31f249f61c63 tempest-FlavorsAccessTestJSON-2067905281 tempest-FlavorsAccessTestJSON-2067905281-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6241 microversion: 2.1 time: 0.678678 Aug 04 16:33:46.622064 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 225/425] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:33:45 2022] GET /compute/v2.1/flavors/detail => generated 6241 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:46.633085 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-90162664-b7af-4ef3-aa1c-dfc327cbad7c tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Calling method '.version_select at 0x7f7e853cc700>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:46.650318 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:46.650318 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:46.650318 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-90162664-b7af-4ef3-aa1c-dfc327cbad7c tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:46.650318 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-90162664-b7af-4ef3-aa1c-dfc327cbad7c tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:46.650318 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-90162664-b7af-4ef3-aa1c-dfc327cbad7c tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:46.650744 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-90162664-b7af-4ef3-aa1c-dfc327cbad7c tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:46.733513 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-90162664-b7af-4ef3-aa1c-dfc327cbad7c tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.109793 Aug 04 16:33:46.737324 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 226/426] 10.222.0.23 () {58 vars in 1145 bytes} [Thu Aug 4 16:33:46 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:33:46.761785 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ac15afe4-182b-4a3b-9c36-8478c14d7191 tempest-FlavorsAccessTestJSON-1813047062 tempest-FlavorsAccessTestJSON-1813047062-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "8d432e7a57374f1bbe92a96376cba963"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:46.776295 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:46.776295 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:47.425450 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-c0ae4bcf-dc21-4696-b700-44e97f450010 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:33:47.426136 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-c0ae4bcf-dc21-4696-b700-44e97f450010 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:33:47.426306 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-c0ae4bcf-dc21-4696-b700-44e97f450010 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:33:47.429133 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-c0ae4bcf-dc21-4696-b700-44e97f450010 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:33:47.429765 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-c0ae4bcf-dc21-4696-b700-44e97f450010 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:33:47.460403 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0ae4bcf-dc21-4696-b700-44e97f450010 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:47.466540 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0ae4bcf-dc21-4696-b700-44e97f450010 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:47.476011 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0ae4bcf-dc21-4696-b700-44e97f450010 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:47.476513 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0ae4bcf-dc21-4696-b700-44e97f450010 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:47.525801 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ac15afe4-182b-4a3b-9c36-8478c14d7191 tempest-FlavorsAccessTestJSON-1813047062 tempest-FlavorsAccessTestJSON-1813047062-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1430778036/action" status: 200 len: 21 microversion: 2.1 time: 0.785358 Aug 04 16:33:47.526797 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 227/427] 10.222.0.23 () {60 vars in 1200 bytes} [Thu Aug 4 16:33:46 2022] POST /compute/v2.1/flavors/1430778036/action => generated 21 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:33:47.541642 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-c0ae4bcf-dc21-4696-b700-44e97f450010 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Getting quotas for project c9cb965024d94d7cae0c5652212e7cc2. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:33:47.548297 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-c0ae4bcf-dc21-4696-b700-44e97f450010 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Getting quotas for user 1c73c354a6ee4ab881f483ff65a21dc4 and project c9cb965024d94d7cae0c5652212e7cc2. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:33:47.550714 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-ec26af25-0811-4e02-b497-6f2433684b5e req-95801e15-95ea-4dac-8ae0-caf585f6f42c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc4b9aed-b141-46b5-a62b-a039640c6310", "name": "network-vif-deleted", "tag": "b36286b7-ac15-434a-b1b1-2550a45b0402"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:47.577734 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-ec26af25-0811-4e02-b497-6f2433684b5e req-95801e15-95ea-4dac-8ae0-caf585f6f42c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:47.579094 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-ec26af25-0811-4e02-b497-6f2433684b5e req-95801e15-95ea-4dac-8ae0-caf585f6f42c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:47.592285 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c0ae4bcf-dc21-4696-b700-44e97f450010 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:33:47.595286 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c0ae4bcf-dc21-4696-b700-44e97f450010 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: c494f329-3998-482b-82fd-e1c88c7d4b33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:33:47.611303 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-ec26af25-0811-4e02-b497-6f2433684b5e req-95801e15-95ea-4dac-8ae0-caf585f6f42c service nova] Creating event network-vif-deleted:b36286b7-ac15-434a-b1b1-2550a45b0402 for instance dc4b9aed-b141-46b5-a62b-a039640c6310 on n-h1-846466-12 Aug 04 16:33:47.624387 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-ec26af25-0811-4e02-b497-6f2433684b5e req-95801e15-95ea-4dac-8ae0-caf585f6f42c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079705 Aug 04 16:33:47.628218 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 228/428] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:47.642494 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5a1123ae-9226-420e-8cf5-8ba0b4b95530 tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Calling method '.version_select at 0x7f7e85240e50>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:47.648388 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:47.648388 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:47.652927 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a1123ae-9226-420e-8cf5-8ba0b4b95530 tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:47.653840 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a1123ae-9226-420e-8cf5-8ba0b4b95530 tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:47.655404 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a1123ae-9226-420e-8cf5-8ba0b4b95530 tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:47.657719 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a1123ae-9226-420e-8cf5-8ba0b4b95530 tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:47.710436 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c0ae4bcf-dc21-4696-b700-44e97f450010 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.266251 Aug 04 16:33:47.711720 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 201/429] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:33:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1268 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:33:47.722412 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-05552265-5768-4fae-bcc9-161f9b0650d1 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:47.723536 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-05552265-5768-4fae-bcc9-161f9b0650d1 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: f8497465-98e6-46f0-bd09-11c432c292a1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:47.733776 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-05552265-5768-4fae-bcc9-161f9b0650d1 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:47.734754 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-05552265-5768-4fae-bcc9-161f9b0650d1 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:47.735757 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-05552265-5768-4fae-bcc9-161f9b0650d1 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:47.736346 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-05552265-5768-4fae-bcc9-161f9b0650d1 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:47.762648 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5a1123ae-9226-420e-8cf5-8ba0b4b95530 tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.126732 Aug 04 16:33:47.765580 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 229/430] 10.222.0.23 () {58 vars in 1128 bytes} [Thu Aug 4 16:33:47 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:47.779021 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3bb6ea3a-a85e-4f23-b0a1-3e956d494955 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:47.793523 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3bb6ea3a-a85e-4f23-b0a1-3e956d494955 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] [instance: dc4b9aed-b141-46b5-a62b-a039640c6310] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:47.810165 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3bb6ea3a-a85e-4f23-b0a1-3e956d494955 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:47.811224 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3bb6ea3a-a85e-4f23-b0a1-3e956d494955 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:47.812468 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3bb6ea3a-a85e-4f23-b0a1-3e956d494955 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:47.813314 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3bb6ea3a-a85e-4f23-b0a1-3e956d494955 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:47.849730 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-3bb6ea3a-a85e-4f23-b0a1-3e956d494955 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] HTTP exception thrown: Instance dc4b9aed-b141-46b5-a62b-a039640c6310 could not be found. Aug 04 16:33:47.859592 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3bb6ea3a-a85e-4f23-b0a1-3e956d494955 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Request method failure captured: Aug 04 16:33:47.859592 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310 HTTP/1.1 Aug 04 16:33:47.859592 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:33:47.859592 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:33:47.859592 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:33:47.859592 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:33:47.859592 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:33:47.859592 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:33:47.859592 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:33:47.859592 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:47.859592 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_SYhh95_KuN9IgWFJfBWnN2QccKVHcIrSTZkienI2MYlcZIgZJQDjKaV1uLmD_AA3PDiDk0EztKmsyJZyul_BWmuVVKoyhLSORalhxR93oD_4vb_6VzoFvvnXQi7Bc4J356Ks3SmulNV2c8nLv9bbj5SE2jT_xWcLKfFPBzkpiFneE Aug 04 16:33:47.859592 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:33:47.859592 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:33:47.859592 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:33:47.859592 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:33:47.859592 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:33:47.859592 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:33:47.859592 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 10b0ceaab59d4aeaa8667cef6f62559e Aug 04 16:33:47.859592 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-LiveMigrationNegativeTest-297127435 Aug 04 16:33:47.859592 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:33:47.859592 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:33:47.861124 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/10b0ceaab59d4aeaa8667cef6f62559e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_10b0ceaab59d4aeaa8667cef6f62559e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/10b0ceaab59d4aeaa8667cef6f62559e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/10b0ceaab59d4aeaa8667cef6f62559e"}]}] Aug 04 16:33:47.861124 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-LiveMigrationNegativeTest-297127435 Aug 04 16:33:47.861124 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 10b0ceaab59d4aeaa8667cef6f62559e Aug 04 16:33:47.861124 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-297127435 Aug 04 16:33:47.861124 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-LiveMigrationNegativeTest-297127435-project Aug 04 16:33:47.861124 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:33:47.861124 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:33:47.861124 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 052613a51b86400c916dbc800563896c Aug 04 16:33:47.861124 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-LiveMigrationNegativeTest-297127435-project Aug 04 16:33:47.861124 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:33:47.861124 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance dc4b9aed-b141-46b5-a62b-a039640c6310 could not be found. Aug 04 16:33:47.861124 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'dc4b9aed-b141-46b5-a62b-a039640c6310'} Aug 04 16:33:47.862117 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:47.862117 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:47.862117 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:33:47.862117 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:33:47.862117 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:33:47.862117 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:33:47.862117 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:33:47.862117 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:33:47.862117 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:33:47.862117 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:33:47.862117 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc4b9aed-b141-46b5-a62b-a039640c6310 could not be found. Aug 04 16:33:47.862117 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:47.862117 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:47.862117 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:47.862117 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:47.862117 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:47.862117 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:47.862117 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:47.862117 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:47.862117 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:47.863526 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:47.863526 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:33:47.863526 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:33:47.863526 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:33:47.863526 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:33:47.863526 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:33:47.863526 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:33:47.863526 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc4b9aed-b141-46b5-a62b-a039640c6310 could not be found. Aug 04 16:33:47.863526 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:47.863526 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:47.863526 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:47.863526 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:47.863526 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:47.863526 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:47.863526 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:33:47.863526 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:33:47.863526 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc4b9aed-b141-46b5-a62b-a039640c6310 could not be found. Aug 04 16:33:47.863526 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:33:47.868260 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3bb6ea3a-a85e-4f23-b0a1-3e956d494955 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] Returning 404 to user: Instance dc4b9aed-b141-46b5-a62b-a039640c6310 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:47.871209 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3bb6ea3a-a85e-4f23-b0a1-3e956d494955 tempest-LiveMigrationNegativeTest-297127435 tempest-LiveMigrationNegativeTest-297127435-project] 10.222.0.23 "GET /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310" status: 404 len: 111 microversion: 2.1 time: 0.102057 Aug 04 16:33:47.874708 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 230/431] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:47 2022] GET /compute/v2.1/servers/dc4b9aed-b141-46b5-a62b-a039640c6310 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:33:47.880999 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d0fd0616-294d-4817-b760-d957e6d0db7c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:47.890490 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d0fd0616-294d-4817-b760-d957e6d0db7c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: f23a3c47-f725-4ad2-b88d-b972ff4b2ee9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:47.932369 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d0fd0616-294d-4817-b760-d957e6d0db7c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:47.933144 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d0fd0616-294d-4817-b760-d957e6d0db7c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:47.934498 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d0fd0616-294d-4817-b760-d957e6d0db7c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:47.948162 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-05552265-5768-4fae-bcc9-161f9b0650d1 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a427fb7481d4799a83729910f33b01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd96a8c91974b8ba7919d5349f380ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:47.958709 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d0fd0616-294d-4817-b760-d957e6d0db7c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:47.977935 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-05552265-5768-4fae-bcc9-161f9b0650d1 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1" status: 200 len: 1322 microversion: 2.1 time: 0.262001 Aug 04 16:33:47.980491 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 202/432] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:47 2022] GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1 => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:47.990401 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-96a2b4db-bfc8-4041-b349-c4b2018ac818 tempest-FlavorsAccessTestJSON-2067905281 tempest-FlavorsAccessTestJSON-2067905281-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:48.046923 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-96a2b4db-bfc8-4041-b349-c4b2018ac818 tempest-FlavorsAccessTestJSON-2067905281 tempest-FlavorsAccessTestJSON-2067905281-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.064530 Aug 04 16:33:48.048756 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 203/433] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:33:47 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:48.071773 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c5bd46fc-b43d-4a2d-8fae-1e6813dd5d9e tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:48.072406 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c5bd46fc-b43d-4a2d-8fae-1e6813dd5d9e tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: c494f329-3998-482b-82fd-e1c88c7d4b33] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:48.737232 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c5bd46fc-b43d-4a2d-8fae-1e6813dd5d9e tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c73c354a6ee4ab881f483ff65a21dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cb965024d94d7cae0c5652212e7cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:48.748658 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c5bd46fc-b43d-4a2d-8fae-1e6813dd5d9e tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "GET /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33" status: 200 len: 1222 microversion: 2.1 time: 0.697221 Aug 04 16:33:48.749258 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 204/434] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:48 2022] GET /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33 => generated 1222 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:48.772079 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0de454c8-5d7e-4686-8789-91a189008cf1 tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Calling method '.version_select at 0x7f7e8479e160>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:48.779314 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:48.779314 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:48.781124 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0de454c8-5d7e-4686-8789-91a189008cf1 tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:48.781828 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0de454c8-5d7e-4686-8789-91a189008cf1 tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:48.803228 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0de454c8-5d7e-4686-8789-91a189008cf1 tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:48.803833 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0de454c8-5d7e-4686-8789-91a189008cf1 tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:48.864471 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0de454c8-5d7e-4686-8789-91a189008cf1 tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.106382 Aug 04 16:33:48.866987 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 205/435] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Aug 4 16:33:48 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:49.004271 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d0fd0616-294d-4817-b760-d957e6d0db7c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:49.020626 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d0fd0616-294d-4817-b760-d957e6d0db7c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9" status: 200 len: 1310 microversion: 2.1 time: 1.143664 Aug 04 16:33:49.038748 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 231/436] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:47 2022] GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 => generated 1310 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:49.051236 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f5b30d27-514a-4dbe-a352-513472bf9b9c tempest-FlavorsAccessTestJSON-1813047062 tempest-FlavorsAccessTestJSON-1813047062-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:49.053644 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:49.053644 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:49.116256 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f5b30d27-514a-4dbe-a352-513472bf9b9c tempest-FlavorsAccessTestJSON-1813047062 tempest-FlavorsAccessTestJSON-1813047062-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1430778036" status: 202 len: 0 microversion: 2.1 time: 0.076013 Aug 04 16:33:49.121425 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 232/437] 10.222.0.23 () {58 vars in 1161 bytes} [Thu Aug 4 16:33:49 2022] DELETE /compute/v2.1/flavors/1430778036 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:33:49.137878 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0d4b4d3b-9b0e-4ed0-be26-e1f6efb4fdcb tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Calling method '.version_select at 0x7f7e851cf1f0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:49.143450 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:49.143450 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:49.147534 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0d4b4d3b-9b0e-4ed0-be26-e1f6efb4fdcb tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:49.148261 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0d4b4d3b-9b0e-4ed0-be26-e1f6efb4fdcb tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:49.150353 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0d4b4d3b-9b0e-4ed0-be26-e1f6efb4fdcb tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:49.152228 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0d4b4d3b-9b0e-4ed0-be26-e1f6efb4fdcb tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:49.197107 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-74006102-ca97-4c26-8b84-e1d4f5da5128 req-7db49ba3-9d87-4bb2-9f90-fc9350a0a70d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac53ca0d-94da-45a3-bd53-f013b5b61d51", "name": "network-vif-deleted", "tag": "4c2eed2c-2a7c-44ed-915e-f94311a74757"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:49.222352 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-74006102-ca97-4c26-8b84-e1d4f5da5128 req-7db49ba3-9d87-4bb2-9f90-fc9350a0a70d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:49.222843 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-74006102-ca97-4c26-8b84-e1d4f5da5128 req-7db49ba3-9d87-4bb2-9f90-fc9350a0a70d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:49.246807 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0d4b4d3b-9b0e-4ed0-be26-e1f6efb4fdcb tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.123903 Aug 04 16:33:49.247645 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 233/438] 10.222.0.23 () {58 vars in 1128 bytes} [Thu Aug 4 16:33:49 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:49.272410 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4e0b701d-933c-4410-ad8e-0c99ee4064b7 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:49.273606 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4e0b701d-933c-4410-ad8e-0c99ee4064b7 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: f8497465-98e6-46f0-bd09-11c432c292a1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:49.282759 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4e0b701d-933c-4410-ad8e-0c99ee4064b7 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:49.285223 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4e0b701d-933c-4410-ad8e-0c99ee4064b7 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:49.287883 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-74006102-ca97-4c26-8b84-e1d4f5da5128 req-7db49ba3-9d87-4bb2-9f90-fc9350a0a70d service nova] Creating event network-vif-deleted:4c2eed2c-2a7c-44ed-915e-f94311a74757 for instance ac53ca0d-94da-45a3-bd53-f013b5b61d51 on n-h1-846466-12 Aug 04 16:33:49.289098 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4e0b701d-933c-4410-ad8e-0c99ee4064b7 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:49.290614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4e0b701d-933c-4410-ad8e-0c99ee4064b7 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:49.296939 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-74006102-ca97-4c26-8b84-e1d4f5da5128 req-7db49ba3-9d87-4bb2-9f90-fc9350a0a70d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.428418 Aug 04 16:33:49.299678 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 206/439] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:49.319052 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dc5ce8af-5e55-40c2-aa0d-0cfe71472650 tempest-FlavorsAccessTestJSON-1813047062 tempest-FlavorsAccessTestJSON-1813047062-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:49.372850 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dc5ce8af-5e55-40c2-aa0d-0cfe71472650 tempest-FlavorsAccessTestJSON-1813047062 tempest-FlavorsAccessTestJSON-1813047062-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.062738 Aug 04 16:33:49.376370 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 207/440] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:33:49 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:49.382293 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-eaeadc76-7035-486f-adba-60b9a3f81061 tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Calling method '.version_select at 0x7f7e849039d0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:49.383569 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:49.383569 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:49.402342 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SAVEPOINT=4,nova_api:INSERT=9,nova_api:RELEASE=4,nova_api:SELECT=80,nova_api:DELETE=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:33:49.415267 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eaeadc76-7035-486f-adba-60b9a3f81061 tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:49.416115 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eaeadc76-7035-486f-adba-60b9a3f81061 tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:49.471169 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eaeadc76-7035-486f-adba-60b9a3f81061 tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:49.478442 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eaeadc76-7035-486f-adba-60b9a3f81061 tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:49.542145 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-eaeadc76-7035-486f-adba-60b9a3f81061 tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-h2-846466-12" status: 200 len: 603 microversion: 2.1 time: 0.163584 Aug 04 16:33:49.547180 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 208/441] 10.222.0.23 () {58 vars in 1173 bytes} [Thu Aug 4 16:33:49 2022] GET /compute/v2.1/os-hosts/n-h2-846466-12 => generated 603 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:49.549630 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-60489db8-9910-442a-bbc3-ba77f333e315 tempest-FlavorsAccessTestJSON-1813047062 tempest-FlavorsAccessTestJSON-1813047062-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1978137995", "id": 319817588, "os-flavor-access:is_public": "False"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:49.554099 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:49.554099 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:49.582701 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-60489db8-9910-442a-bbc3-ba77f333e315 tempest-FlavorsAccessTestJSON-1813047062 tempest-FlavorsAccessTestJSON-1813047062-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.037867 Aug 04 16:33:49.584046 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 209/442] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:33:49 2022] POST /compute/v2.1/flavors => generated 428 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:49.590509 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-831d6e35-146c-47b4-8120-6ba7ff9056e4 tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Calling method '.version_select at 0x7f7e848d1b80>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:49.591835 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:49.591835 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:49.600424 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-831d6e35-146c-47b4-8120-6ba7ff9056e4 tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:49.601635 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-831d6e35-146c-47b4-8120-6ba7ff9056e4 tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:49.622369 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-831d6e35-146c-47b4-8120-6ba7ff9056e4 tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:49.623457 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-831d6e35-146c-47b4-8120-6ba7ff9056e4 tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:49.679393 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-831d6e35-146c-47b4-8120-6ba7ff9056e4 tempest-HostsAdminTestJSON-1130380129 tempest-HostsAdminTestJSON-1130380129-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-h1-846466-12" status: 200 len: 603 microversion: 2.1 time: 0.091914 Aug 04 16:33:49.684143 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4e0b701d-933c-4410-ad8e-0c99ee4064b7 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a427fb7481d4799a83729910f33b01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd96a8c91974b8ba7919d5349f380ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:49.696806 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4e0b701d-933c-4410-ad8e-0c99ee4064b7 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1" status: 200 len: 1322 microversion: 2.1 time: 0.440550 Aug 04 16:33:49.697185 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 210/443] 10.222.0.23 () {58 vars in 1173 bytes} [Thu Aug 4 16:33:49 2022] GET /compute/v2.1/os-hosts/n-h1-846466-12 => generated 603 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:49.710516 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 234/444] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:49 2022] GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1 => generated 1322 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:49.716636 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-112acbce-81f3-4051-a7e5-1defd33a0bad tempest-FlavorsAccessTestJSON-1813047062 tempest-FlavorsAccessTestJSON-1813047062-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:49.718090 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:49.718090 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:49.748439 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-112acbce-81f3-4051-a7e5-1defd33a0bad tempest-FlavorsAccessTestJSON-1813047062 tempest-FlavorsAccessTestJSON-1813047062-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/319817588/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.049693 Aug 04 16:33:49.750674 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 211/445] 10.222.0.23 () {58 vars in 1206 bytes} [Thu Aug 4 16:33:49 2022] GET /compute/v2.1/flavors/319817588/os-flavor-access => generated 21 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:33:49.764425 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9c129a3a-bcc5-4ef5-b757-94aa7a713269 tempest-FlavorsAccessTestJSON-1813047062 tempest-FlavorsAccessTestJSON-1813047062-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:49.766403 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:49.766403 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:49.780119 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a3bda82e-38f0-434d-874c-c864917161ff tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:49.781514 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a3bda82e-38f0-434d-874c-c864917161ff tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: c494f329-3998-482b-82fd-e1c88c7d4b33] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:49.792587 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a3bda82e-38f0-434d-874c-c864917161ff tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:49.794379 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a3bda82e-38f0-434d-874c-c864917161ff tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:49.796780 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a3bda82e-38f0-434d-874c-c864917161ff tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:49.805117 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=7 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:33:49.814374 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9c129a3a-bcc5-4ef5-b757-94aa7a713269 tempest-FlavorsAccessTestJSON-1813047062 tempest-FlavorsAccessTestJSON-1813047062-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/319817588" status: 202 len: 0 microversion: 2.1 time: 0.055537 Aug 04 16:33:49.814841 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a3bda82e-38f0-434d-874c-c864917161ff tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:49.819148 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 235/446] 10.222.0.23 () {58 vars in 1158 bytes} [Thu Aug 4 16:33:49 2022] DELETE /compute/v2.1/flavors/319817588 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:33:49.857026 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d5c32368-5390-4661-a6ff-0edf1cd7e4f3 tempest-FlavorsAccessTestJSON-1813047062 tempest-FlavorsAccessTestJSON-1813047062-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:49.900964 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d5c32368-5390-4661-a6ff-0edf1cd7e4f3 tempest-FlavorsAccessTestJSON-1813047062 tempest-FlavorsAccessTestJSON-1813047062-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.070601 Aug 04 16:33:49.902179 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 236/447] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:33:49 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:50.047056 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-920d0efc-f11d-453b-b426-b1b2273ff168 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:50.047756 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-920d0efc-f11d-453b-b426-b1b2273ff168 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: f23a3c47-f725-4ad2-b88d-b972ff4b2ee9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:50.060689 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-920d0efc-f11d-453b-b426-b1b2273ff168 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:50.061135 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-920d0efc-f11d-453b-b426-b1b2273ff168 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:50.065557 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-920d0efc-f11d-453b-b426-b1b2273ff168 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:50.066015 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-920d0efc-f11d-453b-b426-b1b2273ff168 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:50.398928 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a3bda82e-38f0-434d-874c-c864917161ff tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c73c354a6ee4ab881f483ff65a21dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cb965024d94d7cae0c5652212e7cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:50.411763 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a3bda82e-38f0-434d-874c-c864917161ff tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "GET /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33" status: 200 len: 1274 microversion: 2.1 time: 0.637147 Aug 04 16:33:50.416275 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 212/448] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:49 2022] GET /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33 => generated 1274 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:50.735254 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c66b96c4-42ca-4616-b1b8-2a10e25cd9a6 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:50.736998 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c66b96c4-42ca-4616-b1b8-2a10e25cd9a6 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: f8497465-98e6-46f0-bd09-11c432c292a1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:50.746435 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c66b96c4-42ca-4616-b1b8-2a10e25cd9a6 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:50.747246 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c66b96c4-42ca-4616-b1b8-2a10e25cd9a6 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:50.748038 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c66b96c4-42ca-4616-b1b8-2a10e25cd9a6 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:50.748698 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c66b96c4-42ca-4616-b1b8-2a10e25cd9a6 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:50.901880 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-920d0efc-f11d-453b-b426-b1b2273ff168 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:50.919281 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-920d0efc-f11d-453b-b426-b1b2273ff168 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9" status: 200 len: 1310 microversion: 2.1 time: 0.878263 Aug 04 16:33:50.921477 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 237/449] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:50 2022] GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 => generated 1310 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:51.235955 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c66b96c4-42ca-4616-b1b8-2a10e25cd9a6 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a427fb7481d4799a83729910f33b01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd96a8c91974b8ba7919d5349f380ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:51.268784 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c66b96c4-42ca-4616-b1b8-2a10e25cd9a6 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1" status: 200 len: 1390 microversion: 2.1 time: 0.540595 Aug 04 16:33:51.269774 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 213/450] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:50 2022] GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1 => generated 1390 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:51.438767 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-47daed84-07db-47a9-9e96-fe12c81d62b3 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:51.439536 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-47daed84-07db-47a9-9e96-fe12c81d62b3 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: c494f329-3998-482b-82fd-e1c88c7d4b33] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:51.447826 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-47daed84-07db-47a9-9e96-fe12c81d62b3 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:51.448725 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-47daed84-07db-47a9-9e96-fe12c81d62b3 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:51.450072 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-47daed84-07db-47a9-9e96-fe12c81d62b3 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:51.450748 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-47daed84-07db-47a9-9e96-fe12c81d62b3 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:51.605407 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-47daed84-07db-47a9-9e96-fe12c81d62b3 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c73c354a6ee4ab881f483ff65a21dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cb965024d94d7cae0c5652212e7cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:51.616064 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-47daed84-07db-47a9-9e96-fe12c81d62b3 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "GET /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33" status: 200 len: 1280 microversion: 2.1 time: 0.183032 Aug 04 16:33:51.617052 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 238/451] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:51 2022] GET /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33 => generated 1280 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:51.871848 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-ed93339d-1fa1-4610-aeff-0a9e16548cf9 req-c35909e4-2745-496b-84f1-3df162297a78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f23a3c47-f725-4ad2-b88d-b972ff4b2ee9", "tag": "77a7f0dd-2800-4d07-92d9-a10d97d83794"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:51.891705 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-ed93339d-1fa1-4610-aeff-0a9e16548cf9 req-c35909e4-2745-496b-84f1-3df162297a78 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:51.892199 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-ed93339d-1fa1-4610-aeff-0a9e16548cf9 req-c35909e4-2745-496b-84f1-3df162297a78 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:51.928038 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-ed93339d-1fa1-4610-aeff-0a9e16548cf9 req-c35909e4-2745-496b-84f1-3df162297a78 service nova] Creating event network-changed:77a7f0dd-2800-4d07-92d9-a10d97d83794 for instance f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 on n-h1-846466-12 Aug 04 16:33:51.941147 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-ed93339d-1fa1-4610-aeff-0a9e16548cf9 req-c35909e4-2745-496b-84f1-3df162297a78 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071116 Aug 04 16:33:51.941147 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 214/452] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:51.950981 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9cd43227-029f-4b98-a4f1-fb67713edf6d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:51.951831 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9cd43227-029f-4b98-a4f1-fb67713edf6d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: f23a3c47-f725-4ad2-b88d-b972ff4b2ee9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:51.960941 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9cd43227-029f-4b98-a4f1-fb67713edf6d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:51.961690 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9cd43227-029f-4b98-a4f1-fb67713edf6d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:51.962811 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9cd43227-029f-4b98-a4f1-fb67713edf6d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:51.966486 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9cd43227-029f-4b98-a4f1-fb67713edf6d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:52.294105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e1de1b37-0713-4ad6-9225-85d011388eb6 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:52.295172 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e1de1b37-0713-4ad6-9225-85d011388eb6 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: f8497465-98e6-46f0-bd09-11c432c292a1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:52.318664 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e1de1b37-0713-4ad6-9225-85d011388eb6 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:52.321030 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e1de1b37-0713-4ad6-9225-85d011388eb6 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:52.325589 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e1de1b37-0713-4ad6-9225-85d011388eb6 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:52.328292 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e1de1b37-0713-4ad6-9225-85d011388eb6 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:52.558527 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9cd43227-029f-4b98-a4f1-fb67713edf6d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:52.573899 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9cd43227-029f-4b98-a4f1-fb67713edf6d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9" status: 200 len: 1310 microversion: 2.1 time: 0.631517 Aug 04 16:33:52.574495 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 239/453] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:51 2022] GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 => generated 1310 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:52.638232 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3d9d8df9-b93f-44a5-a56f-2e99c834f380 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:52.639036 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3d9d8df9-b93f-44a5-a56f-2e99c834f380 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: c494f329-3998-482b-82fd-e1c88c7d4b33] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:52.659058 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3d9d8df9-b93f-44a5-a56f-2e99c834f380 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:52.659810 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3d9d8df9-b93f-44a5-a56f-2e99c834f380 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:52.661824 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3d9d8df9-b93f-44a5-a56f-2e99c834f380 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:52.662558 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3d9d8df9-b93f-44a5-a56f-2e99c834f380 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:52.812304 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3d9d8df9-b93f-44a5-a56f-2e99c834f380 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c73c354a6ee4ab881f483ff65a21dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cb965024d94d7cae0c5652212e7cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:52.837473 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3d9d8df9-b93f-44a5-a56f-2e99c834f380 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "GET /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33" status: 200 len: 1280 microversion: 2.1 time: 0.202917 Aug 04 16:33:52.838808 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 240/454] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:52 2022] GET /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33 => generated 1280 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:53.077481 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e1de1b37-0713-4ad6-9225-85d011388eb6 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a427fb7481d4799a83729910f33b01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd96a8c91974b8ba7919d5349f380ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:53.092852 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e1de1b37-0713-4ad6-9225-85d011388eb6 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1" status: 200 len: 1390 microversion: 2.1 time: 0.800979 Aug 04 16:33:53.093548 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 215/455] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:52 2022] GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1 => generated 1390 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:53.598227 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6466fee1-4c31-41cc-9cf6-93b435bab523 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:53.599640 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6466fee1-4c31-41cc-9cf6-93b435bab523 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: f23a3c47-f725-4ad2-b88d-b972ff4b2ee9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:53.608710 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6466fee1-4c31-41cc-9cf6-93b435bab523 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:53.609178 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6466fee1-4c31-41cc-9cf6-93b435bab523 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:53.609953 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6466fee1-4c31-41cc-9cf6-93b435bab523 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:53.618714 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6466fee1-4c31-41cc-9cf6-93b435bab523 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:53.860257 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7d10c27e-3ef2-41aa-88c6-b91ff9394b19 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:53.861139 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7d10c27e-3ef2-41aa-88c6-b91ff9394b19 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: c494f329-3998-482b-82fd-e1c88c7d4b33] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:53.875335 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d10c27e-3ef2-41aa-88c6-b91ff9394b19 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:53.875782 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d10c27e-3ef2-41aa-88c6-b91ff9394b19 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:53.876586 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d10c27e-3ef2-41aa-88c6-b91ff9394b19 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:53.877020 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d10c27e-3ef2-41aa-88c6-b91ff9394b19 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:54.736787 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7d10c27e-3ef2-41aa-88c6-b91ff9394b19 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c73c354a6ee4ab881f483ff65a21dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cb965024d94d7cae0c5652212e7cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:54.751988 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7d10c27e-3ef2-41aa-88c6-b91ff9394b19 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "GET /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33" status: 200 len: 1322 microversion: 2.1 time: 0.894052 Aug 04 16:33:54.753577 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 216/456] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:53 2022] GET /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33 => generated 1322 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:33:54.773742 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dd39f177-27d5-4bdb-9974-9017a9b8abff tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:54.777971 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dd39f177-27d5-4bdb-9974-9017a9b8abff tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: f8497465-98e6-46f0-bd09-11c432c292a1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:54.802283 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dd39f177-27d5-4bdb-9974-9017a9b8abff tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:54.803330 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dd39f177-27d5-4bdb-9974-9017a9b8abff tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:54.804136 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dd39f177-27d5-4bdb-9974-9017a9b8abff tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:54.804566 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dd39f177-27d5-4bdb-9974-9017a9b8abff tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:54.808610 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6466fee1-4c31-41cc-9cf6-93b435bab523 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:54.824544 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6466fee1-4c31-41cc-9cf6-93b435bab523 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9" status: 200 len: 1310 microversion: 2.1 time: 1.228178 Aug 04 16:33:54.843076 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 241/457] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:53 2022] GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 => generated 1310 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:33:54.854479 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-09b8bb88-f845-4ff0-90a5-5aac069ad63f req-58e2caee-f7a8-4334-b901-20850aaa87df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8497465-98e6-46f0-bd09-11c432c292a1", "tag": "b9b0943e-30ce-4930-b73a-72ae1d9df661"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:54.882476 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-09b8bb88-f845-4ff0-90a5-5aac069ad63f req-58e2caee-f7a8-4334-b901-20850aaa87df service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:54.883129 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-09b8bb88-f845-4ff0-90a5-5aac069ad63f req-58e2caee-f7a8-4334-b901-20850aaa87df service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:54.915907 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-09b8bb88-f845-4ff0-90a5-5aac069ad63f req-58e2caee-f7a8-4334-b901-20850aaa87df service nova] Creating event network-changed:b9b0943e-30ce-4930-b73a-72ae1d9df661 for instance f8497465-98e6-46f0-bd09-11c432c292a1 on n-h2-846466-12 Aug 04 16:33:54.928611 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-09b8bb88-f845-4ff0-90a5-5aac069ad63f req-58e2caee-f7a8-4334-b901-20850aaa87df service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084133 Aug 04 16:33:54.933449 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 242/458] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:55.545569 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-f1cee079-6254-4118-bcdf-5d60d2a64502 req-a2d78b4a-d16e-4e07-817d-8ed4c1b2c9df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c494f329-3998-482b-82fd-e1c88c7d4b33", "tag": "4621cdfc-64dc-4897-9055-91299e52d7f8"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:55.558284 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f1cee079-6254-4118-bcdf-5d60d2a64502 req-a2d78b4a-d16e-4e07-817d-8ed4c1b2c9df service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:55.558960 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f1cee079-6254-4118-bcdf-5d60d2a64502 req-a2d78b4a-d16e-4e07-817d-8ed4c1b2c9df service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:55.583933 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dd39f177-27d5-4bdb-9974-9017a9b8abff tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a427fb7481d4799a83729910f33b01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd96a8c91974b8ba7919d5349f380ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:55.592396 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-f1cee079-6254-4118-bcdf-5d60d2a64502 req-a2d78b4a-d16e-4e07-817d-8ed4c1b2c9df service nova] Creating event network-changed:4621cdfc-64dc-4897-9055-91299e52d7f8 for instance c494f329-3998-482b-82fd-e1c88c7d4b33 on n-h1-846466-12 Aug 04 16:33:55.597535 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dd39f177-27d5-4bdb-9974-9017a9b8abff tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1" status: 200 len: 1390 microversion: 2.1 time: 0.842103 Aug 04 16:33:55.603214 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-f1cee079-6254-4118-bcdf-5d60d2a64502 req-a2d78b4a-d16e-4e07-817d-8ed4c1b2c9df service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063589 Aug 04 16:33:55.607457 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 243/459] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:55.616063 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 217/460] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:54 2022] GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1 => generated 1390 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:55.781815 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-345cbb5f-26c7-4bbe-8de9-94fa210f53e3 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:55.782699 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-345cbb5f-26c7-4bbe-8de9-94fa210f53e3 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: c494f329-3998-482b-82fd-e1c88c7d4b33] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:55.804856 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-345cbb5f-26c7-4bbe-8de9-94fa210f53e3 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:55.805681 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-345cbb5f-26c7-4bbe-8de9-94fa210f53e3 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:55.807235 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-345cbb5f-26c7-4bbe-8de9-94fa210f53e3 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:55.809080 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-345cbb5f-26c7-4bbe-8de9-94fa210f53e3 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:55.902359 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=8 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:33:56.184827 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b3a999cb-ac6c-4251-805b-07422441aea1 tempest-NetworksTest-1268231238 tempest-NetworksTest-1268231238-project-admin] Calling method '.version_select at 0x7f7e85236dc0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:56.306173 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-345cbb5f-26c7-4bbe-8de9-94fa210f53e3 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c73c354a6ee4ab881f483ff65a21dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cb965024d94d7cae0c5652212e7cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:56.320438 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-345cbb5f-26c7-4bbe-8de9-94fa210f53e3 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "GET /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33" status: 200 len: 1322 microversion: 2.1 time: 0.544070 Aug 04 16:33:56.321884 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 218/461] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:55 2022] GET /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33 => generated 1322 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:56.341617 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d01a2f68-1596-4c49-812f-aad0be115fc5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:56.342354 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d01a2f68-1596-4c49-812f-aad0be115fc5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: f23a3c47-f725-4ad2-b88d-b972ff4b2ee9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:56.359865 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d01a2f68-1596-4c49-812f-aad0be115fc5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:56.360306 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d01a2f68-1596-4c49-812f-aad0be115fc5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:56.362488 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d01a2f68-1596-4c49-812f-aad0be115fc5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:56.365172 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d01a2f68-1596-4c49-812f-aad0be115fc5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:56.627940 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b3a999cb-ac6c-4251-805b-07422441aea1 tempest-NetworksTest-1268231238 tempest-NetworksTest-1268231238-project-admin] 10.222.0.23 "GET /compute/v2.1/os-networks" status: 200 len: 5374 microversion: 2.1 time: 0.893440 Aug 04 16:33:56.628791 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 244/462] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Aug 4 16:33:55 2022] GET /compute/v2.1/os-networks => generated 5374 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:56.638011 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0203b0fc-8fb7-4c21-941b-69d32c56f7a6 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:56.639129 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0203b0fc-8fb7-4c21-941b-69d32c56f7a6 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: f8497465-98e6-46f0-bd09-11c432c292a1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:56.648378 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0203b0fc-8fb7-4c21-941b-69d32c56f7a6 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:56.648985 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0203b0fc-8fb7-4c21-941b-69d32c56f7a6 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:56.650081 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0203b0fc-8fb7-4c21-941b-69d32c56f7a6 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:56.650654 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0203b0fc-8fb7-4c21-941b-69d32c56f7a6 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:56.792186 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d01a2f68-1596-4c49-812f-aad0be115fc5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:56.805946 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d01a2f68-1596-4c49-812f-aad0be115fc5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9" status: 200 len: 1310 microversion: 2.1 time: 0.482254 Aug 04 16:33:56.806538 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 219/463] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:56 2022] GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 => generated 1310 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:56.824662 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-96ebca72-62bd-4092-9b91-4040689b47a1 tempest-NetworksTest-1268231238 tempest-NetworksTest-1268231238-project-admin] Calling method '.version_select at 0x7f7e848d13a0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:57.400721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0203b0fc-8fb7-4c21-941b-69d32c56f7a6 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a427fb7481d4799a83729910f33b01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd96a8c91974b8ba7919d5349f380ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:57.411717 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0203b0fc-8fb7-4c21-941b-69d32c56f7a6 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1" status: 200 len: 1390 microversion: 2.1 time: 0.781198 Aug 04 16:33:57.412574 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 245/464] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:56 2022] GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1 => generated 1390 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:57.425658 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f0003bb7-fb9c-45c4-af8c-8a22a2a75c7f tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:57.426829 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f0003bb7-fb9c-45c4-af8c-8a22a2a75c7f tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: c494f329-3998-482b-82fd-e1c88c7d4b33] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:57.442645 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f0003bb7-fb9c-45c4-af8c-8a22a2a75c7f tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:57.447365 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f0003bb7-fb9c-45c4-af8c-8a22a2a75c7f tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:57.449881 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f0003bb7-fb9c-45c4-af8c-8a22a2a75c7f tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:57.450411 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f0003bb7-fb9c-45c4-af8c-8a22a2a75c7f tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:57.478206 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:33:57.553372 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-96ebca72-62bd-4092-9b91-4040689b47a1 tempest-NetworksTest-1268231238 tempest-NetworksTest-1268231238-project-admin] 10.222.0.23 "GET /compute/v2.1/os-networks/7059c2bd-3196-46e8-9859-a9efe4fcb75b" status: 200 len: 652 microversion: 2.1 time: 0.745519 Aug 04 16:33:57.560706 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 220/465] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Aug 4 16:33:56 2022] GET /compute/v2.1/os-networks/7059c2bd-3196-46e8-9859-a9efe4fcb75b => generated 652 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:57.570513 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ec877a0e-fa65-4480-a09f-85809d0f3d13 tempest-NetworksTest-1268231238 tempest-NetworksTest-1268231238-project-admin] Calling method '.version_select at 0x7f7e847794c0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:57.882387 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f0003bb7-fb9c-45c4-af8c-8a22a2a75c7f tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c73c354a6ee4ab881f483ff65a21dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cb965024d94d7cae0c5652212e7cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:57.904171 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f0003bb7-fb9c-45c4-af8c-8a22a2a75c7f tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "GET /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33" status: 200 len: 1322 microversion: 2.1 time: 0.489675 Aug 04 16:33:57.904763 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 246/466] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:57 2022] GET /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33 => generated 1322 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:57.922273 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-408a7ca9-1d44-4b47-9ac5-718d9dc6279d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:57.922876 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-408a7ca9-1d44-4b47-9ac5-718d9dc6279d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: f23a3c47-f725-4ad2-b88d-b972ff4b2ee9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:57.929936 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-408a7ca9-1d44-4b47-9ac5-718d9dc6279d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:57.934258 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-408a7ca9-1d44-4b47-9ac5-718d9dc6279d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:57.935143 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-408a7ca9-1d44-4b47-9ac5-718d9dc6279d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:57.935585 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-408a7ca9-1d44-4b47-9ac5-718d9dc6279d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:58.104110 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ec877a0e-fa65-4480-a09f-85809d0f3d13 tempest-NetworksTest-1268231238 tempest-NetworksTest-1268231238-project-admin] 10.222.0.23 "GET /compute/v2.1/os-networks" status: 200 len: 5374 microversion: 2.1 time: 0.541693 Aug 04 16:33:58.105116 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 221/467] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Aug 4 16:33:57 2022] GET /compute/v2.1/os-networks => generated 5374 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:58.334174 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-408a7ca9-1d44-4b47-9ac5-718d9dc6279d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:58.344630 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-408a7ca9-1d44-4b47-9ac5-718d9dc6279d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9" status: 200 len: 1310 microversion: 2.1 time: 0.426103 Aug 04 16:33:58.359137 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 247/468] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:57 2022] GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 => generated 1310 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:58.436562 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4e992c23-807d-413c-a172-02f92faa67fe tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:58.438320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4e992c23-807d-413c-a172-02f92faa67fe tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: f8497465-98e6-46f0-bd09-11c432c292a1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:58.449963 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4e992c23-807d-413c-a172-02f92faa67fe tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:58.450835 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4e992c23-807d-413c-a172-02f92faa67fe tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:58.452424 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4e992c23-807d-413c-a172-02f92faa67fe tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:58.453022 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4e992c23-807d-413c-a172-02f92faa67fe tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:58.634994 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f4bb4b86-9358-44b2-aefa-975d8f5b0f20 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Action: 'update', calling method: .version_select at 0x7f7e84749820>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:58.642730 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:58.642730 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:58.646424 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f4bb4b86-9358-44b2-aefa-975d8f5b0f20 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:58.647493 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f4bb4b86-9358-44b2-aefa-975d8f5b0f20 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:58.660216 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f4bb4b86-9358-44b2-aefa-975d8f5b0f20 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:58.661198 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f4bb4b86-9358-44b2-aefa-975d8f5b0f20 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:58.671698 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-f4bb4b86-9358-44b2-aefa-975d8f5b0f20 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] HTTP exception thrown: Service e54a7471-33d5-4ec4-bdab-bdfceaa5b35c could not be found. Aug 04 16:33:58.674075 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f4bb4b86-9358-44b2-aefa-975d8f5b0f20 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Request method failure captured: Aug 04 16:33:58.674075 n-d-846466-12 devstack@n-api.service[126125]: request: PUT /compute/v2.1/os-services/e54a7471-33d5-4ec4-bdab-bdfceaa5b35c HTTP/1.1 Aug 04 16:33:58.674075 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:33:58.674075 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:33:58.674075 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:33:58.674075 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 56 Aug 04 16:33:58.674075 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:33:58.674075 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:33:58.674075 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:33:58.674075 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:58.674075 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_T2JzgL3xSDK-XHWu3KXIZBskn0SeBGcuysJOiks0pX64MYxklFK2jiH5b2R-z1NU0T301oRgACZHnlcdD17lEffswz6DbqEW4aF3jUb1aeLiRTF57B6yb28ZCAQCXOws2fx_Ii5RoSy_duWdAqOeRbMlBvXHgTxTh5A44If8ylXYE Aug 04 16:33:58.674075 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:33:58.674075 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:33:58.674075 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:33:58.674075 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:33:58.674075 n-d-846466-12 devstack@n-api.service[126125]: X-Openstack-Nova-Api-Version: 2.53 Aug 04 16:33:58.674075 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:33:58.674075 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:33:58.674075 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 23213e31e7ce48e48555f6d03a5ca49b Aug 04 16:33:58.674075 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1896658426 Aug 04 16:33:58.674075 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader,admin Aug 04 16:33:58.674075 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader,admin Aug 04 16:33:58.675548 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/23213e31e7ce48e48555f6d03a5ca49b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_23213e31e7ce48e48555f6d03a5ca49b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/23213e31e7ce48e48555f6d03a5ca49b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/23213e31e7ce48e48555f6d03a5ca49b"}]}] Aug 04 16:33:58.675548 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1896658426 Aug 04 16:33:58.675548 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 23213e31e7ce48e48555f6d03a5ca49b Aug 04 16:33:58.675548 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1896658426 Aug 04 16:33:58.675548 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin Aug 04 16:33:58.675548 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:33:58.675548 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:33:58.675548 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 161555fdd1af41ce87f9ef82660c05a2 Aug 04 16:33:58.675548 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin Aug 04 16:33:58.675548 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:33:58.675548 n-d-846466-12 devstack@n-api.service[126125]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 04 16:33:58.675548 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:33:58.675548 n-d-846466-12 devstack@n-api.service[126125]: exception: Service e54a7471-33d5-4ec4-bdab-bdfceaa5b35c could not be found. Aug 04 16:33:58.678216 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'e54a7471-33d5-4ec4-bdab-bdfceaa5b35c', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 04 16:33:58.678216 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:58.678216 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:58.678216 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Aug 04 16:33:58.678216 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 04 16:33:58.678216 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 04 16:33:58.678216 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 04 16:33:58.678216 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 04 16:33:58.678216 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:58.678216 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:58.678216 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:58.678216 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:58.678216 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 04 16:33:58.678216 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 04 16:33:58.678216 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Aug 04 16:33:58.678216 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 04 16:33:58.678216 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service e54a7471-33d5-4ec4-bdab-bdfceaa5b35c could not be found. Aug 04 16:33:58.678216 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:58.678216 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:58.678216 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:58.678216 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:58.679970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:58.679970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:58.679970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:58.679970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:58.679970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:33:58.679970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:33:58.679970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:58.679970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:58.679970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:33:58.679970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:33:58.679970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 04 16:33:58.679970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:33:58.679970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service e54a7471-33d5-4ec4-bdab-bdfceaa5b35c could not be found. Aug 04 16:33:58.679970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:58.679970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:58.679970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:58.679970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:58.679970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:58.679970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:58.679970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:33:58.681803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:33:58.681803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service e54a7471-33d5-4ec4-bdab-bdfceaa5b35c could not be found. Aug 04 16:33:58.681803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:58.683981 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f4bb4b86-9358-44b2-aefa-975d8f5b0f20 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Returning 404 to user: Service e54a7471-33d5-4ec4-bdab-bdfceaa5b35c could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:58.685186 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f4bb4b86-9358-44b2-aefa-975d8f5b0f20 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-services/e54a7471-33d5-4ec4-bdab-bdfceaa5b35c" status: 404 len: 110 microversion: 2.53 time: 0.450155 Aug 04 16:33:58.691765 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 222/469] 10.222.0.23 () {62 vars in 1309 bytes} [Thu Aug 4 16:33:58 2022] PUT /compute/v2.1/os-services/e54a7471-33d5-4ec4-bdab-bdfceaa5b35c => generated 110 bytes in 457 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 04 16:33:58.699313 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-20e99112-f30f-4c18-9f4e-2d49e336404f tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Action: 'update', calling method: .version_select at 0x7f7e84779430>, body: {"status": "disabled"} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:58.712923 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-20e99112-f30f-4c18-9f4e-2d49e336404f tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:58.713528 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-20e99112-f30f-4c18-9f4e-2d49e336404f tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:58.731481 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-20e99112-f30f-4c18-9f4e-2d49e336404f tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:58.732159 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-20e99112-f30f-4c18-9f4e-2d49e336404f tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:58.742581 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-20e99112-f30f-4c18-9f4e-2d49e336404f tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] HTTP exception thrown: Service e54a7471-33d5-4ec4-bdab-bdfceaa5b35c could not be found. Aug 04 16:33:58.744385 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-20e99112-f30f-4c18-9f4e-2d49e336404f tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Request method failure captured: Aug 04 16:33:58.744385 n-d-846466-12 devstack@n-api.service[126125]: request: PUT /compute/v2.1/os-services/e54a7471-33d5-4ec4-bdab-bdfceaa5b35c HTTP/1.1 Aug 04 16:33:58.744385 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:33:58.744385 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:33:58.744385 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:33:58.744385 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 22 Aug 04 16:33:58.744385 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:33:58.744385 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:33:58.744385 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:33:58.744385 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:58.744385 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_T2JzgL3xSDK-XHWu3KXIZBskn0SeBGcuysJOiks0pX64MYxklFK2jiH5b2R-z1NU0T301oRgACZHnlcdD17lEffswz6DbqEW4aF3jUb1aeLiRTF57B6yb28ZCAQCXOws2fx_Ii5RoSy_duWdAqOeRbMlBvXHgTxTh5A44If8ylXYE Aug 04 16:33:58.744385 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:33:58.744385 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:33:58.744385 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:33:58.744385 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:33:58.744385 n-d-846466-12 devstack@n-api.service[126125]: X-Openstack-Nova-Api-Version: 2.53 Aug 04 16:33:58.744385 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:33:58.744385 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:33:58.744385 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 23213e31e7ce48e48555f6d03a5ca49b Aug 04 16:33:58.744385 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1896658426 Aug 04 16:33:58.744385 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader,admin Aug 04 16:33:58.744385 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader,admin Aug 04 16:33:58.745990 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/23213e31e7ce48e48555f6d03a5ca49b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_23213e31e7ce48e48555f6d03a5ca49b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/23213e31e7ce48e48555f6d03a5ca49b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/23213e31e7ce48e48555f6d03a5ca49b"}]}] Aug 04 16:33:58.745990 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1896658426 Aug 04 16:33:58.745990 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 23213e31e7ce48e48555f6d03a5ca49b Aug 04 16:33:58.745990 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1896658426 Aug 04 16:33:58.745990 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin Aug 04 16:33:58.745990 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:33:58.745990 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:33:58.745990 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 161555fdd1af41ce87f9ef82660c05a2 Aug 04 16:33:58.745990 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin Aug 04 16:33:58.745990 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:33:58.745990 n-d-846466-12 devstack@n-api.service[126125]: {"status": "disabled"} Aug 04 16:33:58.745990 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:33:58.745990 n-d-846466-12 devstack@n-api.service[126125]: exception: Service e54a7471-33d5-4ec4-bdab-bdfceaa5b35c could not be found. Aug 04 16:33:58.745990 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'e54a7471-33d5-4ec4-bdab-bdfceaa5b35c', 'body': {'status': 'disabled'}} Aug 04 16:33:58.746990 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:58.746990 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:58.746990 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Aug 04 16:33:58.746990 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 04 16:33:58.746990 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 04 16:33:58.746990 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 04 16:33:58.746990 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 04 16:33:58.746990 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:58.746990 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:58.746990 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:58.746990 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:58.746990 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 04 16:33:58.746990 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 04 16:33:58.746990 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Aug 04 16:33:58.746990 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 04 16:33:58.746990 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service e54a7471-33d5-4ec4-bdab-bdfceaa5b35c could not be found. Aug 04 16:33:58.746990 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:58.746990 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:58.746990 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:58.746990 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:58.746990 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:58.748437 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:58.748437 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:58.748437 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:58.748437 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:33:58.748437 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:33:58.748437 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:58.748437 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:58.748437 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:33:58.748437 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:33:58.748437 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 04 16:33:58.748437 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:33:58.748437 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service e54a7471-33d5-4ec4-bdab-bdfceaa5b35c could not be found. Aug 04 16:33:58.748437 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:58.748437 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:58.748437 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:58.748437 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:58.748437 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:58.748437 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:58.748437 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:33:58.748437 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:33:58.749899 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service e54a7471-33d5-4ec4-bdab-bdfceaa5b35c could not be found. Aug 04 16:33:58.749899 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:58.749899 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-20e99112-f30f-4c18-9f4e-2d49e336404f tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Returning 404 to user: Service e54a7471-33d5-4ec4-bdab-bdfceaa5b35c could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:58.749899 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-20e99112-f30f-4c18-9f4e-2d49e336404f tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-services/e54a7471-33d5-4ec4-bdab-bdfceaa5b35c" status: 404 len: 110 microversion: 2.53 time: 0.052820 Aug 04 16:33:58.757756 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 223/470] 10.222.0.23 () {62 vars in 1309 bytes} [Thu Aug 4 16:33:58 2022] PUT /compute/v2.1/os-services/e54a7471-33d5-4ec4-bdab-bdfceaa5b35c => generated 110 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:33:58.767461 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cb0e8768-518e-4f16-b043-8e47bf7faf89 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Action: 'update', calling method: .version_select at 0x7f7e848d13a0>, body: {"status": "enabled"} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:58.771957 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4e992c23-807d-413c-a172-02f92faa67fe tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a427fb7481d4799a83729910f33b01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd96a8c91974b8ba7919d5349f380ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:58.779117 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cb0e8768-518e-4f16-b043-8e47bf7faf89 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:58.779821 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cb0e8768-518e-4f16-b043-8e47bf7faf89 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:58.785959 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4e992c23-807d-413c-a172-02f92faa67fe tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1" status: 200 len: 1390 microversion: 2.1 time: 0.352060 Aug 04 16:33:58.787188 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 248/471] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:58 2022] GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1 => generated 1390 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:58.792550 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=16 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:33:58.794447 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cb0e8768-518e-4f16-b043-8e47bf7faf89 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:58.795043 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cb0e8768-518e-4f16-b043-8e47bf7faf89 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:58.806108 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-cb0e8768-518e-4f16-b043-8e47bf7faf89 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] HTTP exception thrown: Service e54a7471-33d5-4ec4-bdab-bdfceaa5b35c could not be found. Aug 04 16:33:58.808361 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cb0e8768-518e-4f16-b043-8e47bf7faf89 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Request method failure captured: Aug 04 16:33:58.808361 n-d-846466-12 devstack@n-api.service[126125]: request: PUT /compute/v2.1/os-services/e54a7471-33d5-4ec4-bdab-bdfceaa5b35c HTTP/1.1 Aug 04 16:33:58.808361 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:33:58.808361 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:33:58.808361 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:33:58.808361 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 21 Aug 04 16:33:58.808361 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:33:58.808361 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:33:58.808361 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:33:58.808361 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:33:58.808361 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_T2JzgL3xSDK-XHWu3KXIZBskn0SeBGcuysJOiks0pX64MYxklFK2jiH5b2R-z1NU0T301oRgACZHnlcdD17lEffswz6DbqEW4aF3jUb1aeLiRTF57B6yb28ZCAQCXOws2fx_Ii5RoSy_duWdAqOeRbMlBvXHgTxTh5A44If8ylXYE Aug 04 16:33:58.808361 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:33:58.808361 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:33:58.808361 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:33:58.808361 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:33:58.808361 n-d-846466-12 devstack@n-api.service[126125]: X-Openstack-Nova-Api-Version: 2.53 Aug 04 16:33:58.808361 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:33:58.808361 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:33:58.808361 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 23213e31e7ce48e48555f6d03a5ca49b Aug 04 16:33:58.808361 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1896658426 Aug 04 16:33:58.808361 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader,admin Aug 04 16:33:58.808361 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader,admin Aug 04 16:33:58.810033 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/23213e31e7ce48e48555f6d03a5ca49b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_23213e31e7ce48e48555f6d03a5ca49b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/23213e31e7ce48e48555f6d03a5ca49b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/23213e31e7ce48e48555f6d03a5ca49b"}]}] Aug 04 16:33:58.810033 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1896658426 Aug 04 16:33:58.810033 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 23213e31e7ce48e48555f6d03a5ca49b Aug 04 16:33:58.810033 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1896658426 Aug 04 16:33:58.810033 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin Aug 04 16:33:58.810033 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:33:58.810033 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:33:58.810033 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 161555fdd1af41ce87f9ef82660c05a2 Aug 04 16:33:58.810033 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin Aug 04 16:33:58.810033 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:33:58.810033 n-d-846466-12 devstack@n-api.service[126125]: {"status": "enabled"} Aug 04 16:33:58.810033 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:33:58.810033 n-d-846466-12 devstack@n-api.service[126125]: exception: Service e54a7471-33d5-4ec4-bdab-bdfceaa5b35c could not be found. Aug 04 16:33:58.810033 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'e54a7471-33d5-4ec4-bdab-bdfceaa5b35c', 'body': {'status': 'enabled'}} Aug 04 16:33:58.811046 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:33:58.811046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:58.811046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Aug 04 16:33:58.811046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 04 16:33:58.811046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 04 16:33:58.811046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 04 16:33:58.811046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 04 16:33:58.811046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:58.811046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:58.811046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:58.811046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:58.811046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 04 16:33:58.811046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 04 16:33:58.811046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Aug 04 16:33:58.811046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 04 16:33:58.811046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service e54a7471-33d5-4ec4-bdab-bdfceaa5b35c could not be found. Aug 04 16:33:58.811046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:58.811046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:58.811046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:58.811046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:58.811046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:58.812525 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:58.812525 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:33:58.812525 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:33:58.812525 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:33:58.812525 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:33:58.812525 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:33:58.812525 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:33:58.812525 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:33:58.812525 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:33:58.812525 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 04 16:33:58.812525 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:33:58.812525 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service e54a7471-33d5-4ec4-bdab-bdfceaa5b35c could not be found. Aug 04 16:33:58.812525 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:58.812525 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:33:58.812525 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:58.812525 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:33:58.812525 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:33:58.812525 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:33:58.812525 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:33:58.812525 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:33:58.813998 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service e54a7471-33d5-4ec4-bdab-bdfceaa5b35c could not be found. Aug 04 16:33:58.813998 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:33:58.815340 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cb0e8768-518e-4f16-b043-8e47bf7faf89 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Returning 404 to user: Service e54a7471-33d5-4ec4-bdab-bdfceaa5b35c could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:33:58.816528 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cb0e8768-518e-4f16-b043-8e47bf7faf89 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-services/e54a7471-33d5-4ec4-bdab-bdfceaa5b35c" status: 404 len: 110 microversion: 2.53 time: 0.054960 Aug 04 16:33:58.818456 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 224/472] 10.222.0.23 () {62 vars in 1309 bytes} [Thu Aug 4 16:33:58 2022] PUT /compute/v2.1/os-services/e54a7471-33d5-4ec4-bdab-bdfceaa5b35c => generated 110 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:33:58.826989 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6fdf7e24-2358-453c-8e44-a92b74d33892 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:58.830502 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:58.830502 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:33:58.831766 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6fdf7e24-2358-453c-8e44-a92b74d33892 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:58.832208 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6fdf7e24-2358-453c-8e44-a92b74d33892 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:58.833937 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6fdf7e24-2358-453c-8e44-a92b74d33892 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:58.834374 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6fdf7e24-2358-453c-8e44-a92b74d33892 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:58.868930 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6fdf7e24-2358-453c-8e44-a92b74d33892 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.045580 Aug 04 16:33:58.870326 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 249/473] 10.222.0.23 () {60 vars in 1178 bytes} [Thu Aug 4 16:33:58 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:33:58.887251 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-377410ec-ffa4-42e2-83b0-08d37a43bdd8 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:58.892694 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:58.892694 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:58.894062 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-377410ec-ffa4-42e2-83b0-08d37a43bdd8 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:58.899139 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-377410ec-ffa4-42e2-83b0-08d37a43bdd8 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:58.900133 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-377410ec-ffa4-42e2-83b0-08d37a43bdd8 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:58.902571 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-377410ec-ffa4-42e2-83b0-08d37a43bdd8 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:58.925849 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1024dbff-9280-447e-ac94-9c6c695b9eb2 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:58.927458 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1024dbff-9280-447e-ac94-9c6c695b9eb2 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: c494f329-3998-482b-82fd-e1c88c7d4b33] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:58.937836 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1024dbff-9280-447e-ac94-9c6c695b9eb2 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:58.941574 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1024dbff-9280-447e-ac94-9c6c695b9eb2 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:58.945755 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1024dbff-9280-447e-ac94-9c6c695b9eb2 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:58.946835 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1024dbff-9280-447e-ac94-9c6c695b9eb2 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:58.975836 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-377410ec-ffa4-42e2-83b0-08d37a43bdd8 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.096600 Aug 04 16:33:58.976470 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 225/474] 10.222.0.23 () {60 vars in 1211 bytes} [Thu Aug 4 16:33:58 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:33:58.996844 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0bee1965-e514-453a-bffc-22940471ff6a tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:59.003294 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:59.003294 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:59.007500 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0bee1965-e514-453a-bffc-22940471ff6a tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:59.007948 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0bee1965-e514-453a-bffc-22940471ff6a tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:59.008999 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0bee1965-e514-453a-bffc-22940471ff6a tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:59.009462 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0bee1965-e514-453a-bffc-22940471ff6a tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:59.046972 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0bee1965-e514-453a-bffc-22940471ff6a tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.058864 Aug 04 16:33:59.073969 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 226/475] 10.222.0.23 () {60 vars in 1178 bytes} [Thu Aug 4 16:33:58 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:33:59.089692 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e0ed795d-ec2a-4c54-8518-4f9910059210 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:59.096110 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:59.096110 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:59.098485 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e0ed795d-ec2a-4c54-8518-4f9910059210 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:59.099484 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e0ed795d-ec2a-4c54-8518-4f9910059210 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:59.100593 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e0ed795d-ec2a-4c54-8518-4f9910059210 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:59.102901 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e0ed795d-ec2a-4c54-8518-4f9910059210 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:59.162341 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e0ed795d-ec2a-4c54-8518-4f9910059210 tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=n-d-846466-12&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.084873 Aug 04 16:33:59.173974 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 227/476] 10.222.0.23 () {60 vars in 1237 bytes} [Thu Aug 4 16:33:59 2022] GET /compute/v2.1/os-services?host=n-d-846466-12&binary=xxx => generated 16 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:59.188469 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cda1ef5b-96d8-4673-a5f0-584fdcdb50db tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:59.195328 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:59.195328 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:59.199752 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cda1ef5b-96d8-4673-a5f0-584fdcdb50db tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:59.200202 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cda1ef5b-96d8-4673-a5f0-584fdcdb50db tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:59.201778 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cda1ef5b-96d8-4673-a5f0-584fdcdb50db tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:59.202594 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cda1ef5b-96d8-4673-a5f0-584fdcdb50db tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:59.320236 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cda1ef5b-96d8-4673-a5f0-584fdcdb50db tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.143991 Aug 04 16:33:59.335468 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 228/477] 10.222.0.23 () {60 vars in 1178 bytes} [Thu Aug 4 16:33:59 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:33:59.356414 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-10c49150-c02c-4186-9c81-b5725074c16c req-f56fe51f-bfe5-4fbd-8160-fda57f36ae18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23a3c47-f725-4ad2-b88d-b972ff4b2ee9", "name": "network-vif-plugged", "status": "completed", "tag": "77a7f0dd-2800-4d07-92d9-a10d97d83794"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:33:59.392369 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-10c49150-c02c-4186-9c81-b5725074c16c req-f56fe51f-bfe5-4fbd-8160-fda57f36ae18 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:59.392860 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-10c49150-c02c-4186-9c81-b5725074c16c req-f56fe51f-bfe5-4fbd-8160-fda57f36ae18 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:59.404063 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1024dbff-9280-447e-ac94-9c6c695b9eb2 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c73c354a6ee4ab881f483ff65a21dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cb965024d94d7cae0c5652212e7cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:59.408205 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-10c49150-c02c-4186-9c81-b5725074c16c req-f56fe51f-bfe5-4fbd-8160-fda57f36ae18 service nova] Creating event network-vif-plugged:77a7f0dd-2800-4d07-92d9-a10d97d83794 for instance f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 on n-h1-846466-12 Aug 04 16:33:59.413797 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-10c49150-c02c-4186-9c81-b5725074c16c req-f56fe51f-bfe5-4fbd-8160-fda57f36ae18 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076969 Aug 04 16:33:59.415218 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 229/478] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:33:59.418838 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1024dbff-9280-447e-ac94-9c6c695b9eb2 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "GET /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33" status: 200 len: 1322 microversion: 2.1 time: 0.496803 Aug 04 16:33:59.420791 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 250/479] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:58 2022] GET /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33 => generated 1322 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:59.435036 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ac13b119-8b00-4eb5-97fb-cb26dce1db6f tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:59.435656 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ac13b119-8b00-4eb5-97fb-cb26dce1db6f tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: f23a3c47-f725-4ad2-b88d-b972ff4b2ee9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:33:59.436180 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c02172b7-9fb9-4f56-bc8f-d4c6696c289b tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:33:59.439664 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:33:59.439664 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:33:59.442271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c02172b7-9fb9-4f56-bc8f-d4c6696c289b tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:59.442787 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c02172b7-9fb9-4f56-bc8f-d4c6696c289b tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:59.445054 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c02172b7-9fb9-4f56-bc8f-d4c6696c289b tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:59.445609 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c02172b7-9fb9-4f56-bc8f-d4c6696c289b tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:59.465864 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ac13b119-8b00-4eb5-97fb-cb26dce1db6f tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:59.466945 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ac13b119-8b00-4eb5-97fb-cb26dce1db6f tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:59.468269 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ac13b119-8b00-4eb5-97fb-cb26dce1db6f tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:33:59.468709 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ac13b119-8b00-4eb5-97fb-cb26dce1db6f tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:33:59.514428 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c02172b7-9fb9-4f56-bc8f-d4c6696c289b tempest-ServicesAdminNegativeV253TestJSON-1896658426 tempest-ServicesAdminNegativeV253TestJSON-1896658426-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.097678 Aug 04 16:33:59.517935 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 230/480] 10.222.0.23 () {60 vars in 1239 bytes} [Thu Aug 4 16:33:59 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:33:59.702429 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ac13b119-8b00-4eb5-97fb-cb26dce1db6f tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:33:59.715389 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ac13b119-8b00-4eb5-97fb-cb26dce1db6f tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9" status: 200 len: 1310 microversion: 2.1 time: 0.292217 Aug 04 16:33:59.729504 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 251/481] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:33:59 2022] GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 => generated 1310 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:00.042582 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e61e3a07-bc0a-4ae8-aae5-1d8282180791 tempest-KeyPairsV210TestJSON-1508451933 tempest-KeyPairsV210TestJSON-1508451933-project-admin] Action: 'create', calling method: .version_select at 0x7f7e84779820>, body: {"keypair": {"name": "tempest-keypair-631066434", "type": "ssh", "user_id": "78ad483566a34b719e47d2c4386eda80", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/kTYpWa50rGKp347S0fS4P8PyKl/TPhmhnJKCtGPcPowiNX5AADuhKwSomhrp2ACP5goIK7gQzcuJ3Myi9RhmnplprJrMQmGCVO4hNr+VlWvMwWQeqUN6b3L7WzTLFxQ=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:00.068402 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-e61e3a07-bc0a-4ae8-aae5-1d8282180791 tempest-KeyPairsV210TestJSON-1508451933 tempest-KeyPairsV210TestJSON-1508451933-project-admin] Getting quotas for project cd26718eae4f48f893dc1895496bb4e1. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:34:00.073777 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-e61e3a07-bc0a-4ae8-aae5-1d8282180791 tempest-KeyPairsV210TestJSON-1508451933 tempest-KeyPairsV210TestJSON-1508451933-project-admin] Getting quotas for user 2d2dbf335e424d7facfc9a1f732bfbf5 and project cd26718eae4f48f893dc1895496bb4e1. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:34:00.112297 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e61e3a07-bc0a-4ae8-aae5-1d8282180791 tempest-KeyPairsV210TestJSON-1508451933 tempest-KeyPairsV210TestJSON-1508451933-project-admin] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.592919 Aug 04 16:34:00.113721 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 231/482] 10.222.0.23 () {62 vars in 1200 bytes} [Thu Aug 4 16:33:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 595 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 16:34:00.135763 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b00b944b-581d-44eb-a4ce-3c37803239d3 tempest-ServicesAdminNegativeV253TestJSON-678257939 tempest-ServicesAdminNegativeV253TestJSON-678257939-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:00.138408 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:34:00.138408 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:34:00.146291 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b00b944b-581d-44eb-a4ce-3c37803239d3 tempest-ServicesAdminNegativeV253TestJSON-678257939 tempest-ServicesAdminNegativeV253TestJSON-678257939-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '144bd7f56f1a4f8c9d06e4d2f58e3089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd85cfa249fff4148a4d86979feaeecd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:00.153068 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b00b944b-581d-44eb-a4ce-3c37803239d3 tempest-ServicesAdminNegativeV253TestJSON-678257939 tempest-ServicesAdminNegativeV253TestJSON-678257939-project] Request method failure captured: Aug 04 16:34:00.153068 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 04 16:34:00.153068 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:34:00.153068 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:34:00.153068 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:34:00.153068 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:34:00.153068 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:34:00.153068 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:34:00.153068 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:34:00.153068 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:34:00.153068 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_T0hK0Ax7MhY6tSPpTNtZvLtQqtqaCDhpiH0OQDp_2f4rOG2JOVidhvLvS6B98P8QOy2aJOLKDfWs9Vo0lfsgo28BYg1i52qj5LEIFrbQvOr-lxhc-_fpHibUOPgMoBtvNG5H6g1x93Q8K9pUsEhgTQmxaLsMU7g6EuRbYUls81yz4 Aug 04 16:34:00.153068 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:34:00.153068 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:34:00.153068 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:34:00.153068 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:34:00.153068 n-d-846466-12 devstack@n-api.service[126126]: X-Openstack-Nova-Api-Version: 2.53 Aug 04 16:34:00.153068 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:34:00.153068 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:34:00.153068 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: d85cfa249fff4148a4d86979feaeecd1 Aug 04 16:34:00.153068 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-678257939 Aug 04 16:34:00.153068 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:34:00.153068 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:34:00.154427 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d85cfa249fff4148a4d86979feaeecd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d85cfa249fff4148a4d86979feaeecd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d85cfa249fff4148a4d86979feaeecd1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d85cfa249fff4148a4d86979feaeecd1"}]}] Aug 04 16:34:00.154427 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-678257939 Aug 04 16:34:00.154427 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: d85cfa249fff4148a4d86979feaeecd1 Aug 04 16:34:00.154427 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-678257939 Aug 04 16:34:00.154427 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServicesAdminNegativeV253TestJSON-678257939-project Aug 04 16:34:00.154427 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:34:00.154427 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:34:00.154427 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 144bd7f56f1a4f8c9d06e4d2f58e3089 Aug 04 16:34:00.154427 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-678257939-project Aug 04 16:34:00.154427 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:34:00.154427 n-d-846466-12 devstack@n-api.service[126126]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 04 16:34:00.154427 n-d-846466-12 devstack@n-api.service[126126]: action_args: {} Aug 04 16:34:00.155223 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:34:00.155223 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:00.155223 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:00.155223 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:00.155223 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:34:00.155223 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:34:00.155223 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 16:34:00.155223 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:34:00.155223 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 16:34:00.155223 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:34:00.155223 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:34:00.155223 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:34:00.155223 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Aug 04 16:34:00.155223 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 04 16:34:00.155223 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:34:00.155223 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:34:00.155223 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:34:00.155223 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:34:00.155223 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:34:00.156762 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:34:00.156762 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:34:00.156762 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:34:00.156762 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:34:00.156762 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:34:00.156762 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:34:00.156762 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:34:00.156762 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:34:00.156762 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:34:00.156762 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 04 16:34:00.156762 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:00.156762 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:00.156762 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:00.156762 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:00.156762 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:00.156762 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:00.156762 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:34:00.156762 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:34:00.156762 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 04 16:34:00.156762 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:00.162914 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b00b944b-581d-44eb-a4ce-3c37803239d3 tempest-ServicesAdminNegativeV253TestJSON-678257939 tempest-ServicesAdminNegativeV253TestJSON-678257939-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:34:00.162914 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b00b944b-581d-44eb-a4ce-3c37803239d3 tempest-ServicesAdminNegativeV253TestJSON-678257939 tempest-ServicesAdminNegativeV253TestJSON-678257939-project] 10.222.0.23 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.426117 Aug 04 16:34:00.162914 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 252/483] 10.222.0.23 () {60 vars in 1178 bytes} [Thu Aug 4 16:33:59 2022] GET /compute/v2.1/os-services => generated 112 bytes in 432 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:34:00.176190 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-031a4f08-73f9-4cb9-8f50-c843d602af6b tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:00.179936 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-031a4f08-73f9-4cb9-8f50-c843d602af6b tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: f8497465-98e6-46f0-bd09-11c432c292a1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:00.208755 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-031a4f08-73f9-4cb9-8f50-c843d602af6b tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:00.209628 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-031a4f08-73f9-4cb9-8f50-c843d602af6b tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:00.220495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-031a4f08-73f9-4cb9-8f50-c843d602af6b tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:00.223161 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-031a4f08-73f9-4cb9-8f50-c843d602af6b tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:00.322699 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8ba059af-8849-417e-a3ac-e6c667964c24 tempest-HypervisorAdminNegativeTestJSON-1809178379 tempest-HypervisorAdminNegativeTestJSON-1809178379-project] Calling method '.version_select at 0x7f7e8479e4c0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:00.323648 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:34:00.323648 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:34:00.325513 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8ba059af-8849-417e-a3ac-e6c667964c24 tempest-HypervisorAdminNegativeTestJSON-1809178379 tempest-HypervisorAdminNegativeTestJSON-1809178379-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'f26f9108a1b544ed985b206c7a10e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f8615b8a734c60b1db98a5b7d1a538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:00.326857 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8ba059af-8849-417e-a3ac-e6c667964c24 tempest-HypervisorAdminNegativeTestJSON-1809178379 tempest-HypervisorAdminNegativeTestJSON-1809178379-project] Request method failure captured: Aug 04 16:34:00.326857 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 04 16:34:00.326857 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:34:00.326857 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:34:00.326857 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:34:00.326857 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:34:00.326857 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:34:00.326857 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:34:00.326857 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:34:00.326857 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:34:00.326857 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_T1NrisBgOeQpCYQqWnGJk-tlJdkMZfvqgx45cUqETs10YkZjDLg-rG4zHVAVGOGjZBAfNq0n82KHltwnSWVL1MWylpb25ZxtaBdWzSFxWNwSUqQtQhEzBEGqtB7doYyapWUy4z1RJC2MEt7ydcrHTQHwCIv6dofPk6QoLI4oELj8o Aug 04 16:34:00.326857 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:34:00.326857 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:34:00.326857 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:34:00.326857 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:34:00.326857 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:34:00.326857 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:34:00.326857 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 04f8615b8a734c60b1db98a5b7d1a538 Aug 04 16:34:00.326857 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1809178379 Aug 04 16:34:00.326857 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:34:00.326857 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:34:00.328406 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/04f8615b8a734c60b1db98a5b7d1a538"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_04f8615b8a734c60b1db98a5b7d1a538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/04f8615b8a734c60b1db98a5b7d1a538"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/04f8615b8a734c60b1db98a5b7d1a538"}]}] Aug 04 16:34:00.328406 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1809178379 Aug 04 16:34:00.328406 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 04f8615b8a734c60b1db98a5b7d1a538 Aug 04 16:34:00.328406 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1809178379 Aug 04 16:34:00.328406 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-HypervisorAdminNegativeTestJSON-1809178379-project Aug 04 16:34:00.328406 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:34:00.328406 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:34:00.328406 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: f26f9108a1b544ed985b206c7a10e74e Aug 04 16:34:00.328406 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1809178379-project Aug 04 16:34:00.328406 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:34:00.328406 n-d-846466-12 devstack@n-api.service[126125]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 04 16:34:00.328406 n-d-846466-12 devstack@n-api.service[126125]: action_args: {} Aug 04 16:34:00.328406 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:34:00.329455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:00.329455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:00.329455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:00.329455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:34:00.329455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:34:00.329455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:34:00.329455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:34:00.329455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:34:00.329455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:34:00.329455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 04 16:34:00.329455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 04 16:34:00.329455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 04 16:34:00.329455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 04 16:34:00.329455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:34:00.329455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:34:00.329455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:34:00.329455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:34:00.329455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:34:00.329455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:34:00.330764 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:34:00.330764 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:34:00.330764 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:34:00.330764 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:34:00.330764 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:34:00.330764 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:34:00.330764 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:34:00.330764 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:34:00.330764 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 04 16:34:00.330764 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:00.330764 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:00.330764 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:00.330764 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:00.330764 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:00.330764 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:00.330764 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:34:00.330764 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:34:00.330764 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 04 16:34:00.330764 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:00.339407 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8ba059af-8849-417e-a3ac-e6c667964c24 tempest-HypervisorAdminNegativeTestJSON-1809178379 tempest-HypervisorAdminNegativeTestJSON-1809178379-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:34:00.340445 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8ba059af-8849-417e-a3ac-e6c667964c24 tempest-HypervisorAdminNegativeTestJSON-1809178379 tempest-HypervisorAdminNegativeTestJSON-1809178379-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.225504 Aug 04 16:34:00.343236 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 232/484] 10.222.0.23 () {58 vars in 1167 bytes} [Thu Aug 4 16:34:00 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 229 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:34:00.362122 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cd79e124-0c59-46a8-af83-8fe374c19872 tempest-KeyPairsV210TestJSON-1508451933 tempest-KeyPairsV210TestJSON-1508451933-project-admin] Action: 'create', calling method: .version_select at 0x7f7e846f5820>, body: {"keypair": {"name": "tempest-keypair-224303474", "type": "ssh", "user_id": "78ad483566a34b719e47d2c4386eda80", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGR1mZizyA2M5nkGWvb45bnVC9DHTX+q4/e5Czhuy7nci3BIAaxonuENPTwLr6+fCdvoKrNALyJnZcaH0OtjAKGnT/KSFZM42/+YI5Ymil7OAGB3QffAwOjeaW8gLxa/NQ=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:00.420238 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-cd79e124-0c59-46a8-af83-8fe374c19872 tempest-KeyPairsV210TestJSON-1508451933 tempest-KeyPairsV210TestJSON-1508451933-project-admin] Getting quotas for project cd26718eae4f48f893dc1895496bb4e1. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:34:00.431390 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-cd79e124-0c59-46a8-af83-8fe374c19872 tempest-KeyPairsV210TestJSON-1508451933 tempest-KeyPairsV210TestJSON-1508451933-project-admin] Getting quotas for user 2d2dbf335e424d7facfc9a1f732bfbf5 and project cd26718eae4f48f893dc1895496bb4e1. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:34:00.490558 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cd79e124-0c59-46a8-af83-8fe374c19872 tempest-KeyPairsV210TestJSON-1508451933 tempest-KeyPairsV210TestJSON-1508451933-project-admin] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.145293 Aug 04 16:34:00.493849 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 233/485] 10.222.0.23 () {62 vars in 1200 bytes} [Thu Aug 4 16:34:00 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 148 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 16:34:00.504214 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5176eb04-a4a1-4b85-bb74-d8e7ca167bf7 tempest-HypervisorAdminNegativeTestJSON-1809178379 tempest-HypervisorAdminNegativeTestJSON-1809178379-project] Calling method '.version_select at 0x7f7e84909700>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:00.507701 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:34:00.507701 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:34:00.510229 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5176eb04-a4a1-4b85-bb74-d8e7ca167bf7 tempest-HypervisorAdminNegativeTestJSON-1809178379 tempest-HypervisorAdminNegativeTestJSON-1809178379-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'f26f9108a1b544ed985b206c7a10e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f8615b8a734c60b1db98a5b7d1a538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:00.513069 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5176eb04-a4a1-4b85-bb74-d8e7ca167bf7 tempest-HypervisorAdminNegativeTestJSON-1809178379 tempest-HypervisorAdminNegativeTestJSON-1809178379-project] Request method failure captured: Aug 04 16:34:00.513069 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 04 16:34:00.513069 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:34:00.513069 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:34:00.513069 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:34:00.513069 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:34:00.513069 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:34:00.513069 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:34:00.513069 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:34:00.513069 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:34:00.513069 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_T1NrisBgOeQpCYQqWnGJk-tlJdkMZfvqgx45cUqETs10YkZjDLg-rG4zHVAVGOGjZBAfNq0n82KHltwnSWVL1MWylpb25ZxtaBdWzSFxWNwSUqQtQhEzBEGqtB7doYyapWUy4z1RJC2MEt7ydcrHTQHwCIv6dofPk6QoLI4oELj8o Aug 04 16:34:00.513069 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:34:00.513069 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:34:00.513069 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:34:00.513069 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:34:00.513069 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:34:00.513069 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:34:00.513069 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 04f8615b8a734c60b1db98a5b7d1a538 Aug 04 16:34:00.513069 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1809178379 Aug 04 16:34:00.513069 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:34:00.513069 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:34:00.514678 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/04f8615b8a734c60b1db98a5b7d1a538"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_04f8615b8a734c60b1db98a5b7d1a538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/04f8615b8a734c60b1db98a5b7d1a538"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/04f8615b8a734c60b1db98a5b7d1a538"}]}] Aug 04 16:34:00.514678 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1809178379 Aug 04 16:34:00.514678 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 04f8615b8a734c60b1db98a5b7d1a538 Aug 04 16:34:00.514678 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1809178379 Aug 04 16:34:00.514678 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-HypervisorAdminNegativeTestJSON-1809178379-project Aug 04 16:34:00.514678 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:34:00.514678 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:34:00.514678 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: f26f9108a1b544ed985b206c7a10e74e Aug 04 16:34:00.514678 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1809178379-project Aug 04 16:34:00.514678 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:34:00.514678 n-d-846466-12 devstack@n-api.service[126125]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 04 16:34:00.514678 n-d-846466-12 devstack@n-api.service[126125]: action_args: {} Aug 04 16:34:00.514678 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:34:00.515454 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:00.515454 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:00.515454 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:00.515454 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:34:00.515454 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:34:00.515454 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:34:00.515454 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:34:00.515454 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:34:00.515454 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:34:00.515454 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 04 16:34:00.515454 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 04 16:34:00.515454 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 04 16:34:00.515454 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 04 16:34:00.515454 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:34:00.515454 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:34:00.515454 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:34:00.515454 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:34:00.515454 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:34:00.515454 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:34:00.516902 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:34:00.516902 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:34:00.516902 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:34:00.516902 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:34:00.516902 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:34:00.516902 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:34:00.516902 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:34:00.516902 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:34:00.516902 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 04 16:34:00.516902 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:00.516902 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:00.516902 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:00.516902 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:00.516902 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:00.516902 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:00.516902 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:34:00.516902 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:34:00.516902 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 04 16:34:00.516902 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:00.521396 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5176eb04-a4a1-4b85-bb74-d8e7ca167bf7 tempest-HypervisorAdminNegativeTestJSON-1809178379 tempest-HypervisorAdminNegativeTestJSON-1809178379-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:34:00.522242 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-031a4f08-73f9-4cb9-8f50-c843d602af6b tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a427fb7481d4799a83729910f33b01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd96a8c91974b8ba7919d5349f380ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:00.523793 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5176eb04-a4a1-4b85-bb74-d8e7ca167bf7 tempest-HypervisorAdminNegativeTestJSON-1809178379 tempest-HypervisorAdminNegativeTestJSON-1809178379-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.028589 Aug 04 16:34:00.527900 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 234/486] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:34:00 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:34:00.536721 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-031a4f08-73f9-4cb9-8f50-c843d602af6b tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1" status: 200 len: 1390 microversion: 2.1 time: 0.372561 Aug 04 16:34:00.536861 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-edcb6ed7-2fbf-4fcf-a0a6-80736b7f6642 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:00.537606 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-edcb6ed7-2fbf-4fcf-a0a6-80736b7f6642 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: c494f329-3998-482b-82fd-e1c88c7d4b33] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:00.538442 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 253/487] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:00 2022] GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1 => generated 1390 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:00.544819 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e44b33ad-be0b-4870-8f00-ee5260b963bf tempest-KeyPairsV210TestJSON-1508451933 tempest-KeyPairsV210TestJSON-1508451933-project-admin] Calling method '.version_select at 0x7f7e872c33a0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:00.546124 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-edcb6ed7-2fbf-4fcf-a0a6-80736b7f6642 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:00.546570 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-edcb6ed7-2fbf-4fcf-a0a6-80736b7f6642 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:00.547338 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-edcb6ed7-2fbf-4fcf-a0a6-80736b7f6642 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:00.547765 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-edcb6ed7-2fbf-4fcf-a0a6-80736b7f6642 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:00.555739 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e44b33ad-be0b-4870-8f00-ee5260b963bf tempest-KeyPairsV210TestJSON-1508451933 tempest-KeyPairsV210TestJSON-1508451933-project-admin] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-631066434?user_id=78ad483566a34b719e47d2c4386eda80" status: 200 len: 511 microversion: 2.10 time: 0.015771 Aug 04 16:34:00.556615 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 254/488] 10.222.0.23 () {60 vars in 1337 bytes} [Thu Aug 4 16:34:00 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-631066434?user_id=78ad483566a34b719e47d2c4386eda80 => generated 511 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:34:00.562039 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-244f83f8-81b3-40e8-ab67-0e7d8998cf8e tempest-HypervisorAdminNegativeTestJSON-1809178379 tempest-HypervisorAdminNegativeTestJSON-1809178379-project] Calling method '.version_select at 0x7f7e853d70d0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:00.562930 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:34:00.562930 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:34:00.564166 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-244f83f8-81b3-40e8-ab67-0e7d8998cf8e tempest-HypervisorAdminNegativeTestJSON-1809178379 tempest-HypervisorAdminNegativeTestJSON-1809178379-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'f26f9108a1b544ed985b206c7a10e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f8615b8a734c60b1db98a5b7d1a538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:00.566473 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-244f83f8-81b3-40e8-ab67-0e7d8998cf8e tempest-HypervisorAdminNegativeTestJSON-1809178379 tempest-HypervisorAdminNegativeTestJSON-1809178379-project] Request method failure captured: Aug 04 16:34:00.566473 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 04 16:34:00.566473 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:34:00.566473 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:34:00.566473 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:34:00.566473 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:34:00.566473 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:34:00.566473 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:34:00.566473 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:34:00.566473 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:34:00.566473 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_T1NrisBgOeQpCYQqWnGJk-tlJdkMZfvqgx45cUqETs10YkZjDLg-rG4zHVAVGOGjZBAfNq0n82KHltwnSWVL1MWylpb25ZxtaBdWzSFxWNwSUqQtQhEzBEGqtB7doYyapWUy4z1RJC2MEt7ydcrHTQHwCIv6dofPk6QoLI4oELj8o Aug 04 16:34:00.566473 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:34:00.566473 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:34:00.566473 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:34:00.566473 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:34:00.566473 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:34:00.566473 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:34:00.566473 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 04f8615b8a734c60b1db98a5b7d1a538 Aug 04 16:34:00.566473 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1809178379 Aug 04 16:34:00.566473 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:34:00.566473 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:34:00.567801 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/04f8615b8a734c60b1db98a5b7d1a538"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_04f8615b8a734c60b1db98a5b7d1a538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/04f8615b8a734c60b1db98a5b7d1a538"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/04f8615b8a734c60b1db98a5b7d1a538"}]}] Aug 04 16:34:00.567801 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1809178379 Aug 04 16:34:00.567801 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 04f8615b8a734c60b1db98a5b7d1a538 Aug 04 16:34:00.567801 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1809178379 Aug 04 16:34:00.567801 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-HypervisorAdminNegativeTestJSON-1809178379-project Aug 04 16:34:00.567801 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:34:00.567801 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:34:00.567801 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: f26f9108a1b544ed985b206c7a10e74e Aug 04 16:34:00.567801 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1809178379-project Aug 04 16:34:00.567801 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:34:00.567801 n-d-846466-12 devstack@n-api.service[126126]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 04 16:34:00.567801 n-d-846466-12 devstack@n-api.service[126126]: action_args: {} Aug 04 16:34:00.567801 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:34:00.568623 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:00.568623 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:00.568623 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:00.568623 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:34:00.568623 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:34:00.568623 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:34:00.568623 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:34:00.568623 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:34:00.568623 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:34:00.568623 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 04 16:34:00.568623 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 04 16:34:00.568623 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:34:00.568623 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:34:00.568623 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:34:00.568623 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:34:00.568623 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:34:00.568623 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:34:00.568623 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:34:00.568623 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:34:00.569756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:34:00.569756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:34:00.569756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:34:00.569756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:34:00.569756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:34:00.569756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:34:00.569756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 04 16:34:00.569756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:00.569756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:00.569756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:00.569756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:00.569756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:00.569756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:00.569756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:34:00.569756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:34:00.569756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 04 16:34:00.569756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:00.572684 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-244f83f8-81b3-40e8-ab67-0e7d8998cf8e tempest-HypervisorAdminNegativeTestJSON-1809178379 tempest-HypervisorAdminNegativeTestJSON-1809178379-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:34:00.573786 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-244f83f8-81b3-40e8-ab67-0e7d8998cf8e tempest-HypervisorAdminNegativeTestJSON-1809178379 tempest-HypervisorAdminNegativeTestJSON-1809178379-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.015790 Aug 04 16:34:00.575213 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 255/489] 10.222.0.23 () {58 vars in 1179 bytes} [Thu Aug 4 16:34:00 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:34:00.580810 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-646aec14-4493-41e8-b2aa-838599750e07 tempest-KeyPairsV210TestJSON-1508451933 tempest-KeyPairsV210TestJSON-1508451933-project-admin] Action: 'create', calling method: .version_select at 0x7f7e851980d0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1977404042", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9uZVi8SrhS4a54bxfLI5vm0MYuBfy+1anmV/plI8lxZ4540jR21ZWAasavu7IdCYxBJqim0jvRmQ/z6u70XKwrD3eWiGKKMST1fIARpqgEYEU2Umi2nKM5Vw51OzUnww=="}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:00.600464 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-646aec14-4493-41e8-b2aa-838599750e07 tempest-KeyPairsV210TestJSON-1508451933 tempest-KeyPairsV210TestJSON-1508451933-project-admin] Getting quotas for project cd26718eae4f48f893dc1895496bb4e1. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:34:00.606199 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-646aec14-4493-41e8-b2aa-838599750e07 tempest-KeyPairsV210TestJSON-1508451933 tempest-KeyPairsV210TestJSON-1508451933-project-admin] Getting quotas for user 2d2dbf335e424d7facfc9a1f732bfbf5 and project cd26718eae4f48f893dc1895496bb4e1. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:34:00.655589 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-646aec14-4493-41e8-b2aa-838599750e07 tempest-KeyPairsV210TestJSON-1508451933 tempest-KeyPairsV210TestJSON-1508451933-project-admin] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.078689 Aug 04 16:34:00.659540 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 256/490] 10.222.0.23 () {62 vars in 1200 bytes} [Thu Aug 4 16:34:00 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 83 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 16:34:00.804904 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-edcb6ed7-2fbf-4fcf-a0a6-80736b7f6642 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c73c354a6ee4ab881f483ff65a21dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cb965024d94d7cae0c5652212e7cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:00.827990 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-edcb6ed7-2fbf-4fcf-a0a6-80736b7f6642 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "GET /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33" status: 200 len: 1322 microversion: 2.1 time: 0.298666 Aug 04 16:34:00.837177 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 235/491] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:00 2022] GET /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33 => generated 1322 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:00.855431 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0860d5a3-19cb-4bc3-b30b-02cd024519b0 tempest-KeyPairsV210TestJSON-1508451933 tempest-KeyPairsV210TestJSON-1508451933-project-admin] Calling method '.version_select at 0x7f7e846f5b80>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:00.870960 n-d-846466-12 devstack@n-api.service[126125]: WARNING oslo_db.sqlalchemy.utils [None req-0860d5a3-19cb-4bc3-b30b-02cd024519b0 tempest-KeyPairsV210TestJSON-1508451933 tempest-KeyPairsV210TestJSON-1508451933-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 04 16:34:00.903787 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0860d5a3-19cb-4bc3-b30b-02cd024519b0 tempest-KeyPairsV210TestJSON-1508451933 tempest-KeyPairsV210TestJSON-1508451933-project-admin] 10.222.0.23 "GET /compute/v2.1/os-keypairs?user_id=78ad483566a34b719e47d2c4386eda80" status: 200 len: 724 microversion: 2.10 time: 0.059399 Aug 04 16:34:00.908049 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 236/492] 10.222.0.23 () {60 vars in 1259 bytes} [Thu Aug 4 16:34:00 2022] GET /compute/v2.1/os-keypairs?user_id=78ad483566a34b719e47d2c4386eda80 => generated 724 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:34:00.926999 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e3456965-f306-4e93-ac52-2ea559c077f3 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:00.928886 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e3456965-f306-4e93-ac52-2ea559c077f3 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: f23a3c47-f725-4ad2-b88d-b972ff4b2ee9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:00.958563 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3456965-f306-4e93-ac52-2ea559c077f3 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:00.960203 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3456965-f306-4e93-ac52-2ea559c077f3 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:00.964577 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3456965-f306-4e93-ac52-2ea559c077f3 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:00.965066 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3456965-f306-4e93-ac52-2ea559c077f3 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:01.009481 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=100 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:34:01.272794 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5183609a-2aa1-419c-953a-1224422bfa63 tempest-HypervisorAdminNegativeTestJSON-1608650686 tempest-HypervisorAdminNegativeTestJSON-1608650686-project-admin] Calling method '.version_select at 0x7f7e853d78b0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:01.273640 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:34:01.273640 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:34:01.276928 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5183609a-2aa1-419c-953a-1224422bfa63 tempest-HypervisorAdminNegativeTestJSON-1608650686 tempest-HypervisorAdminNegativeTestJSON-1608650686-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:01.277568 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5183609a-2aa1-419c-953a-1224422bfa63 tempest-HypervisorAdminNegativeTestJSON-1608650686 tempest-HypervisorAdminNegativeTestJSON-1608650686-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:01.308697 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5183609a-2aa1-419c-953a-1224422bfa63 tempest-HypervisorAdminNegativeTestJSON-1608650686 tempest-HypervisorAdminNegativeTestJSON-1608650686-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:01.310676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5183609a-2aa1-419c-953a-1224422bfa63 tempest-HypervisorAdminNegativeTestJSON-1608650686 tempest-HypervisorAdminNegativeTestJSON-1608650686-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:01.334419 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5183609a-2aa1-419c-953a-1224422bfa63 tempest-HypervisorAdminNegativeTestJSON-1608650686 tempest-HypervisorAdminNegativeTestJSON-1608650686-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:01.338668 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5183609a-2aa1-419c-953a-1224422bfa63 tempest-HypervisorAdminNegativeTestJSON-1608650686 tempest-HypervisorAdminNegativeTestJSON-1608650686-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:01.348182 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e3456965-f306-4e93-ac52-2ea559c077f3 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:01.358992 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5183609a-2aa1-419c-953a-1224422bfa63 tempest-HypervisorAdminNegativeTestJSON-1608650686 tempest-HypervisorAdminNegativeTestJSON-1608650686-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.698134 Aug 04 16:34:01.359841 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 257/493] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:34:00 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:01.364097 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e3456965-f306-4e93-ac52-2ea559c077f3 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9" status: 200 len: 1494 microversion: 2.1 time: 0.454515 Aug 04 16:34:01.364780 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 237/494] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:00 2022] GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 => generated 1494 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:01.369931 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2facc6c2-6a11-4e76-a109-ec7c17905785 tempest-KeyPairsV210TestJSON-1508451933 tempest-KeyPairsV210TestJSON-1508451933-project-admin] Calling method '.version_select at 0x7f7e872c33a0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:01.371964 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f3e9c6c3-3a0d-4253-80bf-e351f5672f67 tempest-HypervisorAdminNegativeTestJSON-1809178379 tempest-HypervisorAdminNegativeTestJSON-1809178379-project] Calling method '.version_select at 0x7f7e846f58b0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:01.379553 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:34:01.379553 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:34:01.380946 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f3e9c6c3-3a0d-4253-80bf-e351f5672f67 tempest-HypervisorAdminNegativeTestJSON-1809178379 tempest-HypervisorAdminNegativeTestJSON-1809178379-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'f26f9108a1b544ed985b206c7a10e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f8615b8a734c60b1db98a5b7d1a538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:01.382603 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f3e9c6c3-3a0d-4253-80bf-e351f5672f67 tempest-HypervisorAdminNegativeTestJSON-1809178379 tempest-HypervisorAdminNegativeTestJSON-1809178379-project] Request method failure captured: Aug 04 16:34:01.382603 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 04 16:34:01.382603 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:34:01.382603 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:34:01.382603 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:34:01.382603 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:34:01.382603 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:34:01.382603 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:34:01.382603 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:34:01.382603 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:34:01.382603 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_T1NrisBgOeQpCYQqWnGJk-tlJdkMZfvqgx45cUqETs10YkZjDLg-rG4zHVAVGOGjZBAfNq0n82KHltwnSWVL1MWylpb25ZxtaBdWzSFxWNwSUqQtQhEzBEGqtB7doYyapWUy4z1RJC2MEt7ydcrHTQHwCIv6dofPk6QoLI4oELj8o Aug 04 16:34:01.382603 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:34:01.382603 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:34:01.382603 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:34:01.382603 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:34:01.382603 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:34:01.382603 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:34:01.382603 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 04f8615b8a734c60b1db98a5b7d1a538 Aug 04 16:34:01.382603 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1809178379 Aug 04 16:34:01.382603 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:34:01.382603 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:34:01.384012 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/04f8615b8a734c60b1db98a5b7d1a538"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_04f8615b8a734c60b1db98a5b7d1a538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/04f8615b8a734c60b1db98a5b7d1a538"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/04f8615b8a734c60b1db98a5b7d1a538"}]}] Aug 04 16:34:01.384012 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1809178379 Aug 04 16:34:01.384012 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 04f8615b8a734c60b1db98a5b7d1a538 Aug 04 16:34:01.384012 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1809178379 Aug 04 16:34:01.384012 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-HypervisorAdminNegativeTestJSON-1809178379-project Aug 04 16:34:01.384012 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:34:01.384012 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:34:01.384012 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: f26f9108a1b544ed985b206c7a10e74e Aug 04 16:34:01.384012 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1809178379-project Aug 04 16:34:01.384012 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:34:01.384012 n-d-846466-12 devstack@n-api.service[126125]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 04 16:34:01.384012 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '1'} Aug 04 16:34:01.384012 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:34:01.385006 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:01.385006 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:01.385006 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:01.385006 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:34:01.385006 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:34:01.385006 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:34:01.385006 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:34:01.385006 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:34:01.385006 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:34:01.385006 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 04 16:34:01.385006 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 04 16:34:01.385006 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:34:01.385006 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:34:01.385006 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:34:01.385006 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:34:01.385006 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:34:01.385006 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:34:01.385006 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:34:01.385006 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:34:01.386149 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:34:01.386149 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:34:01.386149 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:34:01.386149 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:34:01.386149 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:34:01.386149 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:34:01.386149 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 04 16:34:01.386149 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:01.386149 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:01.386149 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:01.386149 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:01.386149 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:01.386149 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:01.386149 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:34:01.386149 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:34:01.386149 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 04 16:34:01.386149 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:01.387154 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f3e9c6c3-3a0d-4253-80bf-e351f5672f67 tempest-HypervisorAdminNegativeTestJSON-1809178379 tempest-HypervisorAdminNegativeTestJSON-1809178379-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:34:01.387154 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f3e9c6c3-3a0d-4253-80bf-e351f5672f67 tempest-HypervisorAdminNegativeTestJSON-1809178379 tempest-HypervisorAdminNegativeTestJSON-1809178379-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.016943 Aug 04 16:34:01.387154 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 238/495] 10.222.0.23 () {58 vars in 1173 bytes} [Thu Aug 4 16:34:01 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:34:01.408871 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2facc6c2-6a11-4e76-a109-ec7c17905785 tempest-KeyPairsV210TestJSON-1508451933 tempest-KeyPairsV210TestJSON-1508451933-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1977404042" status: 204 len: 0 microversion: 2.10 time: 0.047615 Aug 04 16:34:01.410169 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 258/496] 10.222.0.23 () {60 vars in 1325 bytes} [Thu Aug 4 16:34:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1977404042 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 16:34:01.420244 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-91e70199-4585-49c5-bfee-69229ee51114 tempest-HypervisorAdminNegativeTestJSON-1608650686 tempest-HypervisorAdminNegativeTestJSON-1608650686-project-admin] Calling method '.version_select at 0x7f7e851fd4c0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:01.422298 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:34:01.422298 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:34:01.424356 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-91e70199-4585-49c5-bfee-69229ee51114 tempest-HypervisorAdminNegativeTestJSON-1608650686 tempest-HypervisorAdminNegativeTestJSON-1608650686-project-admin] HTTP exception thrown: Hypervisor with ID 'fc2a3ace-1b9d-4b8f-8559-e1146f6c6cbc' could not be found. Aug 04 16:34:01.435200 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-91e70199-4585-49c5-bfee-69229ee51114 tempest-HypervisorAdminNegativeTestJSON-1608650686 tempest-HypervisorAdminNegativeTestJSON-1608650686-project-admin] Request method failure captured: Aug 04 16:34:01.435200 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/os-hypervisors/fc2a3ace-1b9d-4b8f-8559-e1146f6c6cbc/uptime HTTP/1.1 Aug 04 16:34:01.435200 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:34:01.435200 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:34:01.435200 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:34:01.435200 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:34:01.435200 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:34:01.435200 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:34:01.435200 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:34:01.435200 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:34:01.435200 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_T399E9feuc1_xn73eRs4X1AkbwTiKtKvNmbKcw0g8CCRKXE1BrJ7lyz9LywOnpJJ55bdiINpaCNUEfQXXaUgLyy3AiR2iTwGjwEbQy6qrGzz_EURtE8O9RSqsccwanwqLcrpY4AJY8jApM8k3D0PjkSeki5XAaRm5UXnG6nEkN_pI Aug 04 16:34:01.435200 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:34:01.435200 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:34:01.435200 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:34:01.435200 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:34:01.435200 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:34:01.435200 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:34:01.435200 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 910f5784ce674f70ac8c1784cee4c891 Aug 04 16:34:01.435200 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1608650686 Aug 04 16:34:01.435200 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader,admin Aug 04 16:34:01.435200 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader,admin Aug 04 16:34:01.436881 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/910f5784ce674f70ac8c1784cee4c891"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_910f5784ce674f70ac8c1784cee4c891"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/910f5784ce674f70ac8c1784cee4c891"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/910f5784ce674f70ac8c1784cee4c891"}]}] Aug 04 16:34:01.436881 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1608650686 Aug 04 16:34:01.436881 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 910f5784ce674f70ac8c1784cee4c891 Aug 04 16:34:01.436881 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1608650686 Aug 04 16:34:01.436881 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-HypervisorAdminNegativeTestJSON-1608650686-project-admin Aug 04 16:34:01.436881 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:34:01.436881 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:34:01.436881 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: bbfbd159947540a3a9b2463f8d7bf531 Aug 04 16:34:01.436881 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1608650686-project-admin Aug 04 16:34:01.436881 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:34:01.436881 n-d-846466-12 devstack@n-api.service[126126]: exception: Hypervisor with ID 'fc2a3ace-1b9d-4b8f-8559-e1146f6c6cbc' could not be found. Aug 04 16:34:01.436881 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'fc2a3ace-1b9d-4b8f-8559-e1146f6c6cbc'} Aug 04 16:34:01.442003 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:34:01.442003 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:01.442003 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 04 16:34:01.442003 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 04 16:34:01.442003 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'fc2a3ace-1b9d-4b8f-8559-e1146f6c6cbc' Aug 04 16:34:01.442003 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:01.442003 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:01.442003 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:01.442003 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:01.442003 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 04 16:34:01.442003 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 04 16:34:01.442003 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 04 16:34:01.442003 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 04 16:34:01.442003 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 04 16:34:01.442003 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:01.442003 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:01.442003 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:01.442003 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:01.442003 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 04 16:34:01.442003 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 04 16:34:01.442003 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 04 16:34:01.442003 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 04 16:34:01.443801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 04 16:34:01.443801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:01.443801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:01.443801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:01.443801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:01.443801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:01.443801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:01.443801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:34:01.443801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:34:01.443801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:34:01.443801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:34:01.443801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:34:01.443801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:34:01.443801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 04 16:34:01.443801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 04 16:34:01.443801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 04 16:34:01.443801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 16:34:01.443801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'fc2a3ace-1b9d-4b8f-8559-e1146f6c6cbc' could not be found. Aug 04 16:34:01.443801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:01.443801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:01.443801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:01.445275 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:01.445275 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:01.445275 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:01.445275 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:34:01.445275 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:34:01.445275 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'fc2a3ace-1b9d-4b8f-8559-e1146f6c6cbc' could not be found. Aug 04 16:34:01.445275 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:01.445275 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-91e70199-4585-49c5-bfee-69229ee51114 tempest-HypervisorAdminNegativeTestJSON-1608650686 tempest-HypervisorAdminNegativeTestJSON-1608650686-project-admin] Returning 404 to user: Hypervisor with ID 'fc2a3ace-1b9d-4b8f-8559-e1146f6c6cbc' could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:34:01.445275 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-91e70199-4585-49c5-bfee-69229ee51114 tempest-HypervisorAdminNegativeTestJSON-1608650686 tempest-HypervisorAdminNegativeTestJSON-1608650686-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/fc2a3ace-1b9d-4b8f-8559-e1146f6c6cbc/uptime" status: 404 len: 123 microversion: 2.1 time: 0.025169 Aug 04 16:34:01.445275 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 259/497] 10.222.0.23 () {58 vars in 1278 bytes} [Thu Aug 4 16:34:01 2022] GET /compute/v2.1/os-hypervisors/fc2a3ace-1b9d-4b8f-8559-e1146f6c6cbc/uptime => generated 123 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:34:01.446213 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-529f96f3-abd4-45af-a541-830457faee92 tempest-KeyPairsV210TestJSON-1508451933 tempest-KeyPairsV210TestJSON-1508451933-project-admin] Calling method '.version_select at 0x7f7e85240d30>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:01.471416 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-529f96f3-abd4-45af-a541-830457faee92 tempest-KeyPairsV210TestJSON-1508451933 tempest-KeyPairsV210TestJSON-1508451933-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-224303474?user_id=78ad483566a34b719e47d2c4386eda80" status: 204 len: 0 microversion: 2.10 time: 0.032360 Aug 04 16:34:01.472344 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 260/498] 10.222.0.23 () {60 vars in 1340 bytes} [Thu Aug 4 16:34:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-224303474?user_id=78ad483566a34b719e47d2c4386eda80 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 16:34:01.478264 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-24f52721-9782-408b-9e4d-e7c2df62059f req-c4a63e14-a883-41f3-a3e6-72ae66e158c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c494f329-3998-482b-82fd-e1c88c7d4b33", "name": "network-vif-plugged", "status": "completed", "tag": "4621cdfc-64dc-4897-9055-91299e52d7f8"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:01.495371 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-24f52721-9782-408b-9e4d-e7c2df62059f req-c4a63e14-a883-41f3-a3e6-72ae66e158c5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:01.496113 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-24f52721-9782-408b-9e4d-e7c2df62059f req-c4a63e14-a883-41f3-a3e6-72ae66e158c5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:01.511894 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-24f52721-9782-408b-9e4d-e7c2df62059f req-c4a63e14-a883-41f3-a3e6-72ae66e158c5 service nova] Creating event network-vif-plugged:4621cdfc-64dc-4897-9055-91299e52d7f8 for instance c494f329-3998-482b-82fd-e1c88c7d4b33 on n-h1-846466-12 Aug 04 16:34:01.519700 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-24f52721-9782-408b-9e4d-e7c2df62059f req-c4a63e14-a883-41f3-a3e6-72ae66e158c5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045740 Aug 04 16:34:01.520876 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 261/499] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:01.531452 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e2c014a7-4c4c-4aa4-b25b-de4ba83d6b4c tempest-HypervisorAdminNegativeTestJSON-1608650686 tempest-HypervisorAdminNegativeTestJSON-1608650686-project-admin] Calling method '.version_select at 0x7f7e8581a040>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:01.532480 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:34:01.532480 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:34:01.534070 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e2c014a7-4c4c-4aa4-b25b-de4ba83d6b4c tempest-HypervisorAdminNegativeTestJSON-1608650686 tempest-HypervisorAdminNegativeTestJSON-1608650686-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:01.534743 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e2c014a7-4c4c-4aa4-b25b-de4ba83d6b4c tempest-HypervisorAdminNegativeTestJSON-1608650686 tempest-HypervisorAdminNegativeTestJSON-1608650686-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:01.554582 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e2c014a7-4c4c-4aa4-b25b-de4ba83d6b4c tempest-HypervisorAdminNegativeTestJSON-1608650686 tempest-HypervisorAdminNegativeTestJSON-1608650686-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:01.555127 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e2c014a7-4c4c-4aa4-b25b-de4ba83d6b4c tempest-HypervisorAdminNegativeTestJSON-1608650686 tempest-HypervisorAdminNegativeTestJSON-1608650686-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:01.568716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e2c014a7-4c4c-4aa4-b25b-de4ba83d6b4c tempest-HypervisorAdminNegativeTestJSON-1608650686 tempest-HypervisorAdminNegativeTestJSON-1608650686-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:01.570351 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e2c014a7-4c4c-4aa4-b25b-de4ba83d6b4c tempest-HypervisorAdminNegativeTestJSON-1608650686 tempest-HypervisorAdminNegativeTestJSON-1608650686-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:01.572152 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f7dc97b1-0ab6-4ff3-9ebc-f63642c09591 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:01.573123 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f7dc97b1-0ab6-4ff3-9ebc-f63642c09591 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] [instance: f23a3c47-f725-4ad2-b88d-b972ff4b2ee9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:01.581055 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f7dc97b1-0ab6-4ff3-9ebc-f63642c09591 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:01.581386 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e2c014a7-4c4c-4aa4-b25b-de4ba83d6b4c tempest-HypervisorAdminNegativeTestJSON-1608650686 tempest-HypervisorAdminNegativeTestJSON-1608650686-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.058982 Aug 04 16:34:01.581522 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f7dc97b1-0ab6-4ff3-9ebc-f63642c09591 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:01.582394 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f7dc97b1-0ab6-4ff3-9ebc-f63642c09591 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:01.582977 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f7dc97b1-0ab6-4ff3-9ebc-f63642c09591 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:01.588996 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 262/500] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:34:01 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:01.596914 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ca4a64e4-bd6d-47b7-af3a-a0b0356c1b1a tempest-KeyPairsV210TestJSON-1508451933 tempest-KeyPairsV210TestJSON-1508451933-project-admin] Calling method '.version_select at 0x7f7e851cf9d0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:01.627552 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ca4a64e4-bd6d-47b7-af3a-a0b0356c1b1a tempest-KeyPairsV210TestJSON-1508451933 tempest-KeyPairsV210TestJSON-1508451933-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-631066434?user_id=78ad483566a34b719e47d2c4386eda80" status: 204 len: 0 microversion: 2.10 time: 0.036964 Aug 04 16:34:01.628783 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 263/501] 10.222.0.23 () {60 vars in 1340 bytes} [Thu Aug 4 16:34:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-631066434?user_id=78ad483566a34b719e47d2c4386eda80 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 16:34:01.653879 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-01f101d5-d695-494f-b8fb-46562a408379 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:01.654636 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-01f101d5-d695-494f-b8fb-46562a408379 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: f8497465-98e6-46f0-bd09-11c432c292a1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:01.668726 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-01f101d5-d695-494f-b8fb-46562a408379 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:01.669835 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-01f101d5-d695-494f-b8fb-46562a408379 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:01.670856 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-01f101d5-d695-494f-b8fb-46562a408379 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:01.671470 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-01f101d5-d695-494f-b8fb-46562a408379 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:01.899917 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f7dc97b1-0ab6-4ff3-9ebc-f63642c09591 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9" status: 200 len: 1647 microversion: 2.1 time: 0.514387 Aug 04 16:34:01.906252 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 239/502] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:01 2022] GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 => generated 1647 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:01.931511 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c2e1a15a-db45-455a-8327-ff8c7c98b98f tempest-HypervisorAdminNegativeTestJSON-1809178379 tempest-HypervisorAdminNegativeTestJSON-1809178379-project] Calling method '.version_select at 0x7f7e847e4040>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:01.937881 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:34:01.937881 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:34:01.939232 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c2e1a15a-db45-455a-8327-ff8c7c98b98f tempest-HypervisorAdminNegativeTestJSON-1809178379 tempest-HypervisorAdminNegativeTestJSON-1809178379-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'f26f9108a1b544ed985b206c7a10e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f8615b8a734c60b1db98a5b7d1a538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:01.940871 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c2e1a15a-db45-455a-8327-ff8c7c98b98f tempest-HypervisorAdminNegativeTestJSON-1809178379 tempest-HypervisorAdminNegativeTestJSON-1809178379-project] Request method failure captured: Aug 04 16:34:01.940871 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 04 16:34:01.940871 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:34:01.940871 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:34:01.940871 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:34:01.940871 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:34:01.940871 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:34:01.940871 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:34:01.940871 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:34:01.940871 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:34:01.940871 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_T1NrisBgOeQpCYQqWnGJk-tlJdkMZfvqgx45cUqETs10YkZjDLg-rG4zHVAVGOGjZBAfNq0n82KHltwnSWVL1MWylpb25ZxtaBdWzSFxWNwSUqQtQhEzBEGqtB7doYyapWUy4z1RJC2MEt7ydcrHTQHwCIv6dofPk6QoLI4oELj8o Aug 04 16:34:01.940871 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:34:01.940871 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:34:01.940871 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:34:01.940871 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:34:01.940871 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:34:01.940871 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:34:01.940871 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 04f8615b8a734c60b1db98a5b7d1a538 Aug 04 16:34:01.940871 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1809178379 Aug 04 16:34:01.940871 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:34:01.940871 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:34:01.942537 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/04f8615b8a734c60b1db98a5b7d1a538"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_04f8615b8a734c60b1db98a5b7d1a538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/04f8615b8a734c60b1db98a5b7d1a538"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/04f8615b8a734c60b1db98a5b7d1a538"}]}] Aug 04 16:34:01.942537 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1809178379 Aug 04 16:34:01.942537 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 04f8615b8a734c60b1db98a5b7d1a538 Aug 04 16:34:01.942537 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1809178379 Aug 04 16:34:01.942537 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-HypervisorAdminNegativeTestJSON-1809178379-project Aug 04 16:34:01.942537 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:34:01.942537 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:34:01.942537 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: f26f9108a1b544ed985b206c7a10e74e Aug 04 16:34:01.942537 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1809178379-project Aug 04 16:34:01.942537 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:34:01.942537 n-d-846466-12 devstack@n-api.service[126125]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 04 16:34:01.942537 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '1'} Aug 04 16:34:01.942537 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:34:01.943401 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:01.943401 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:01.943401 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:01.943401 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:34:01.943401 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:34:01.943401 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:34:01.943401 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:34:01.943401 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:34:01.943401 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:34:01.943401 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 04 16:34:01.943401 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 04 16:34:01.943401 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 04 16:34:01.943401 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 04 16:34:01.943401 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:34:01.943401 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:34:01.943401 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:34:01.943401 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:34:01.943401 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:34:01.943401 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:34:01.944509 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:34:01.944509 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:34:01.944509 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:34:01.944509 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:34:01.944509 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:34:01.944509 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:34:01.944509 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:34:01.944509 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:34:01.944509 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 04 16:34:01.944509 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:01.944509 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:01.944509 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:01.944509 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:01.944509 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:01.944509 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:01.944509 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:34:01.944509 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:34:01.944509 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 04 16:34:01.944509 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:01.946329 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c2e1a15a-db45-455a-8327-ff8c7c98b98f tempest-HypervisorAdminNegativeTestJSON-1809178379 tempest-HypervisorAdminNegativeTestJSON-1809178379-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:34:01.946329 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c2e1a15a-db45-455a-8327-ff8c7c98b98f tempest-HypervisorAdminNegativeTestJSON-1809178379 tempest-HypervisorAdminNegativeTestJSON-1809178379-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.032692 Aug 04 16:34:01.970694 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 240/503] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Aug 4 16:34:01 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 64 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:34:01.995302 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a4c0ff71-9b8a-4544-9544-2ff218134a91 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:01.995915 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a4c0ff71-9b8a-4544-9544-2ff218134a91 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: c494f329-3998-482b-82fd-e1c88c7d4b33] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:02.029941 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a4c0ff71-9b8a-4544-9544-2ff218134a91 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:02.035703 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a4c0ff71-9b8a-4544-9544-2ff218134a91 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:02.040144 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a4c0ff71-9b8a-4544-9544-2ff218134a91 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:02.040588 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a4c0ff71-9b8a-4544-9544-2ff218134a91 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:02.211622 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-01f101d5-d695-494f-b8fb-46562a408379 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a427fb7481d4799a83729910f33b01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd96a8c91974b8ba7919d5349f380ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:02.225513 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-01f101d5-d695-494f-b8fb-46562a408379 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1" status: 200 len: 1390 microversion: 2.1 time: 0.595046 Aug 04 16:34:02.241174 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 264/504] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:01 2022] GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1 => generated 1390 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:02.273508 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2251abe1-62f9-431a-a6a9-5016d0bb1971 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:02.278720 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2251abe1-62f9-431a-a6a9-5016d0bb1971 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] [instance: f23a3c47-f725-4ad2-b88d-b972ff4b2ee9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:02.301572 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2251abe1-62f9-431a-a6a9-5016d0bb1971 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:02.304033 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2251abe1-62f9-431a-a6a9-5016d0bb1971 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:02.306350 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2251abe1-62f9-431a-a6a9-5016d0bb1971 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:02.308689 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2251abe1-62f9-431a-a6a9-5016d0bb1971 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:03.017580 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a4c0ff71-9b8a-4544-9544-2ff218134a91 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c73c354a6ee4ab881f483ff65a21dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cb965024d94d7cae0c5652212e7cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:03.030040 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a4c0ff71-9b8a-4544-9544-2ff218134a91 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "GET /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33" status: 200 len: 1322 microversion: 2.1 time: 1.058221 Aug 04 16:34:03.030624 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 241/505] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:01 2022] GET /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33 => generated 1322 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:03.045619 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0f48d941-7b33-4e1b-94ca-9879a12ebe2f tempest-HypervisorAdminNegativeTestJSON-1608650686 tempest-HypervisorAdminNegativeTestJSON-1608650686-project-admin] Calling method '.version_select at 0x7f7e8479e1f0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:03.046671 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:34:03.046671 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:34:03.048155 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-0f48d941-7b33-4e1b-94ca-9879a12ebe2f tempest-HypervisorAdminNegativeTestJSON-1608650686 tempest-HypervisorAdminNegativeTestJSON-1608650686-project-admin] HTTP exception thrown: Hypervisor with ID 'f73d76c3-16f6-4735-a083-b320154404ff' could not be found. Aug 04 16:34:03.050862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0f48d941-7b33-4e1b-94ca-9879a12ebe2f tempest-HypervisorAdminNegativeTestJSON-1608650686 tempest-HypervisorAdminNegativeTestJSON-1608650686-project-admin] Request method failure captured: Aug 04 16:34:03.050862 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/os-hypervisors/f73d76c3-16f6-4735-a083-b320154404ff HTTP/1.1 Aug 04 16:34:03.050862 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:34:03.050862 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:34:03.050862 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:34:03.050862 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:34:03.050862 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:34:03.050862 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:34:03.050862 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:34:03.050862 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:34:03.050862 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_T399E9feuc1_xn73eRs4X1AkbwTiKtKvNmbKcw0g8CCRKXE1BrJ7lyz9LywOnpJJ55bdiINpaCNUEfQXXaUgLyy3AiR2iTwGjwEbQy6qrGzz_EURtE8O9RSqsccwanwqLcrpY4AJY8jApM8k3D0PjkSeki5XAaRm5UXnG6nEkN_pI Aug 04 16:34:03.050862 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:34:03.050862 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:34:03.050862 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:34:03.050862 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:34:03.050862 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:34:03.050862 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:34:03.050862 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 910f5784ce674f70ac8c1784cee4c891 Aug 04 16:34:03.050862 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1608650686 Aug 04 16:34:03.050862 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader,admin Aug 04 16:34:03.050862 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader,admin Aug 04 16:34:03.052893 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/910f5784ce674f70ac8c1784cee4c891"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_910f5784ce674f70ac8c1784cee4c891"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/910f5784ce674f70ac8c1784cee4c891"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/910f5784ce674f70ac8c1784cee4c891"}]}] Aug 04 16:34:03.052893 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1608650686 Aug 04 16:34:03.052893 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 910f5784ce674f70ac8c1784cee4c891 Aug 04 16:34:03.052893 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1608650686 Aug 04 16:34:03.052893 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-HypervisorAdminNegativeTestJSON-1608650686-project-admin Aug 04 16:34:03.052893 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:34:03.052893 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:34:03.052893 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: bbfbd159947540a3a9b2463f8d7bf531 Aug 04 16:34:03.052893 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1608650686-project-admin Aug 04 16:34:03.052893 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:34:03.052893 n-d-846466-12 devstack@n-api.service[126125]: exception: Hypervisor with ID 'f73d76c3-16f6-4735-a083-b320154404ff' could not be found. Aug 04 16:34:03.052893 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'f73d76c3-16f6-4735-a083-b320154404ff'} Aug 04 16:34:03.053927 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:34:03.053927 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:03.053927 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 04 16:34:03.053927 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 04 16:34:03.053927 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'f73d76c3-16f6-4735-a083-b320154404ff' Aug 04 16:34:03.053927 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:03.053927 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:03.053927 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:03.053927 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:03.053927 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 04 16:34:03.053927 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 04 16:34:03.053927 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 04 16:34:03.053927 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 04 16:34:03.053927 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 04 16:34:03.053927 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:03.053927 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:03.053927 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:03.053927 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:03.053927 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 04 16:34:03.053927 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 04 16:34:03.053927 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 04 16:34:03.053927 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 04 16:34:03.055499 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 04 16:34:03.055499 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:03.055499 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:03.055499 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:03.055499 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:03.055499 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:03.055499 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:03.055499 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:34:03.055499 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:34:03.055499 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:34:03.055499 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:34:03.055499 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:34:03.055499 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:34:03.055499 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 04 16:34:03.055499 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 04 16:34:03.055499 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 04 16:34:03.055499 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 04 16:34:03.055499 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 04 16:34:03.055499 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 16:34:03.055499 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'f73d76c3-16f6-4735-a083-b320154404ff' could not be found. Aug 04 16:34:03.056925 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:03.056925 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:03.056925 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:03.056925 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:03.056925 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:03.056925 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:03.056925 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:34:03.056925 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:34:03.056925 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'f73d76c3-16f6-4735-a083-b320154404ff' could not be found. Aug 04 16:34:03.056925 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:03.061094 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0f48d941-7b33-4e1b-94ca-9879a12ebe2f tempest-HypervisorAdminNegativeTestJSON-1608650686 tempest-HypervisorAdminNegativeTestJSON-1608650686-project-admin] Returning 404 to user: Hypervisor with ID 'f73d76c3-16f6-4735-a083-b320154404ff' could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:34:03.064376 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0f48d941-7b33-4e1b-94ca-9879a12ebe2f tempest-HypervisorAdminNegativeTestJSON-1608650686 tempest-HypervisorAdminNegativeTestJSON-1608650686-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/f73d76c3-16f6-4735-a083-b320154404ff" status: 404 len: 123 microversion: 2.1 time: 0.028640 Aug 04 16:34:03.066270 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 242/506] 10.222.0.23 () {58 vars in 1257 bytes} [Thu Aug 4 16:34:03 2022] GET /compute/v2.1/os-hypervisors/f73d76c3-16f6-4735-a083-b320154404ff => generated 123 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:34:03.179377 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2251abe1-62f9-431a-a6a9-5016d0bb1971 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9" status: 200 len: 1647 microversion: 2.1 time: 0.936533 Aug 04 16:34:03.179968 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 265/507] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:02 2022] GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 => generated 1647 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:03.204101 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d7e5b0b9-962f-4515-be52-4ffe2b9a629f tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:03.207554 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:34:03.207554 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:34:03.208989 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d7e5b0b9-962f-4515-be52-4ffe2b9a629f tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:03.209479 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d7e5b0b9-962f-4515-be52-4ffe2b9a629f tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:03.210288 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d7e5b0b9-962f-4515-be52-4ffe2b9a629f tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:03.210719 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d7e5b0b9-962f-4515-be52-4ffe2b9a629f tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:03.250609 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0b707201-f9a9-4609-96b7-28e554470f10 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:03.251210 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0b707201-f9a9-4609-96b7-28e554470f10 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: f8497465-98e6-46f0-bd09-11c432c292a1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:03.276351 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0b707201-f9a9-4609-96b7-28e554470f10 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:03.278085 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0b707201-f9a9-4609-96b7-28e554470f10 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:03.280317 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0b707201-f9a9-4609-96b7-28e554470f10 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:03.280960 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0b707201-f9a9-4609-96b7-28e554470f10 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:03.322065 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d7e5b0b9-962f-4515-be52-4ffe2b9a629f tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.123467 Aug 04 16:34:03.329797 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 243/508] 10.222.0.23 () {58 vars in 1176 bytes} [Thu Aug 4 16:34:03 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:03.340172 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8de24bfc-b8aa-40a6-a73a-dec23cf92d81 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-846466-12", "block_migration": true, "disk_over_commit": false}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:03.342703 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8de24bfc-b8aa-40a6-a73a-dec23cf92d81 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] [instance: f23a3c47-f725-4ad2-b88d-b972ff4b2ee9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:03.376435 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8de24bfc-b8aa-40a6-a73a-dec23cf92d81 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:03.378099 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8de24bfc-b8aa-40a6-a73a-dec23cf92d81 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:03.392714 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8de24bfc-b8aa-40a6-a73a-dec23cf92d81 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:03.393494 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8de24bfc-b8aa-40a6-a73a-dec23cf92d81 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:03.459774 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-8de24bfc-b8aa-40a6-a73a-dec23cf92d81 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lazy-loading 'flavor' on Instance uuid f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:34:03.491857 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8de24bfc-b8aa-40a6-a73a-dec23cf92d81 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] [instance: f23a3c47-f725-4ad2-b88d-b972ff4b2ee9] Going to try to live migrate instance to n-h2-846466-12 {{(pid=126125) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 16:34:03.972596 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0b707201-f9a9-4609-96b7-28e554470f10 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a427fb7481d4799a83729910f33b01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd96a8c91974b8ba7919d5349f380ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:03.982841 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0b707201-f9a9-4609-96b7-28e554470f10 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1" status: 200 len: 1390 microversion: 2.1 time: 0.739450 Aug 04 16:34:03.991541 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 266/509] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:03 2022] GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1 => generated 1390 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:04.000792 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-b24901b4-3a62-4ebe-971c-e59736014bfb req-89ff4681-ad5a-4507-ae10-cf531931edbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8497465-98e6-46f0-bd09-11c432c292a1", "name": "network-vif-plugged", "status": "completed", "tag": "b9b0943e-30ce-4930-b73a-72ae1d9df661"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:04.032397 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-b24901b4-3a62-4ebe-971c-e59736014bfb req-89ff4681-ad5a-4507-ae10-cf531931edbc service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:04.047792 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-b24901b4-3a62-4ebe-971c-e59736014bfb req-89ff4681-ad5a-4507-ae10-cf531931edbc service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:04.084456 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-b24901b4-3a62-4ebe-971c-e59736014bfb req-89ff4681-ad5a-4507-ae10-cf531931edbc service nova] Creating event network-vif-plugged:b9b0943e-30ce-4930-b73a-72ae1d9df661 for instance f8497465-98e6-46f0-bd09-11c432c292a1 on n-h2-846466-12 Aug 04 16:34:04.101615 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-b24901b4-3a62-4ebe-971c-e59736014bfb req-89ff4681-ad5a-4507-ae10-cf531931edbc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108661 Aug 04 16:34:04.105630 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 267/510] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:04.128343 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8b9499ee-d0b9-4dfd-906d-1967b936db18 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:04.130712 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8b9499ee-d0b9-4dfd-906d-1967b936db18 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: c494f329-3998-482b-82fd-e1c88c7d4b33] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:04.153575 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8b9499ee-d0b9-4dfd-906d-1967b936db18 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:04.154350 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8b9499ee-d0b9-4dfd-906d-1967b936db18 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:04.155516 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8b9499ee-d0b9-4dfd-906d-1967b936db18 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:04.160325 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8b9499ee-d0b9-4dfd-906d-1967b936db18 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:05.111972 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8b9499ee-d0b9-4dfd-906d-1967b936db18 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c73c354a6ee4ab881f483ff65a21dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cb965024d94d7cae0c5652212e7cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:05.123961 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8b9499ee-d0b9-4dfd-906d-1967b936db18 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "GET /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33" status: 200 len: 1471 microversion: 2.1 time: 1.016804 Aug 04 16:34:05.137941 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 268/511] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:04 2022] GET /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33 => generated 1471 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:05.153536 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-45d90b35-3536-4e42-a51f-6448c984528d tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:05.154308 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-45d90b35-3536-4e42-a51f-6448c984528d tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: f8497465-98e6-46f0-bd09-11c432c292a1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:05.162117 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-45d90b35-3536-4e42-a51f-6448c984528d tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:05.162850 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-45d90b35-3536-4e42-a51f-6448c984528d tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:05.163998 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-45d90b35-3536-4e42-a51f-6448c984528d tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:05.164647 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-45d90b35-3536-4e42-a51f-6448c984528d tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:05.626699 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-45d90b35-3536-4e42-a51f-6448c984528d tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a427fb7481d4799a83729910f33b01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd96a8c91974b8ba7919d5349f380ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:05.645612 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-45d90b35-3536-4e42-a51f-6448c984528d tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1" status: 200 len: 1390 microversion: 2.1 time: 0.503547 Aug 04 16:34:05.647610 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 269/512] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:05 2022] GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1 => generated 1390 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:05.660717 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c055e8be-a4c5-4daf-8796-a4f4b5d00f82 tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:05.661602 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c055e8be-a4c5-4daf-8796-a4f4b5d00f82 tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] [instance: c494f329-3998-482b-82fd-e1c88c7d4b33] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:05.681952 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c055e8be-a4c5-4daf-8796-a4f4b5d00f82 tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:05.682894 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c055e8be-a4c5-4daf-8796-a4f4b5d00f82 tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:05.683888 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c055e8be-a4c5-4daf-8796-a4f4b5d00f82 tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:05.684312 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c055e8be-a4c5-4daf-8796-a4f4b5d00f82 tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:05.798437 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-c055e8be-a4c5-4daf-8796-a4f4b5d00f82 tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Lazy-loading 'flavor' on Instance uuid c494f329-3998-482b-82fd-e1c88c7d4b33 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:34:05.916038 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c055e8be-a4c5-4daf-8796-a4f4b5d00f82 tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33/action" status: 202 len: 0 microversion: 2.1 time: 0.266659 Aug 04 16:34:05.922893 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 270/513] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:34:05 2022] POST /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:34:05.931234 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3dde02d5-eba6-4915-8195-95a50d214bd8 tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:05.932591 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3dde02d5-eba6-4915-8195-95a50d214bd8 tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] [instance: c494f329-3998-482b-82fd-e1c88c7d4b33] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:05.941978 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3dde02d5-eba6-4915-8195-95a50d214bd8 tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:05.943709 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3dde02d5-eba6-4915-8195-95a50d214bd8 tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:05.945478 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3dde02d5-eba6-4915-8195-95a50d214bd8 tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:05.946188 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3dde02d5-eba6-4915-8195-95a50d214bd8 tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:05.970777 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:34:06.484005 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3dde02d5-eba6-4915-8195-95a50d214bd8 tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33" status: 200 len: 1632 microversion: 2.1 time: 0.558837 Aug 04 16:34:06.500900 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 271/514] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:05 2022] GET /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33 => generated 1632 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:07.213383 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c6183052-0ba5-419c-af70-7bbe90910558 tempest-QuotaClassesAdmin257Test-259381781 tempest-QuotaClassesAdmin257Test-259381781-project-admin] Calling method '.version_select at 0x7f7e8565bdc0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:07.214530 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:34:07.214530 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:34:07.238820 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c6183052-0ba5-419c-af70-7bbe90910558 tempest-QuotaClassesAdmin257Test-259381781 tempest-QuotaClassesAdmin257Test-259381781-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.733989 Aug 04 16:34:07.239964 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 272/515] 10.222.0.23 () {60 vars in 1226 bytes} [Thu Aug 4 16:34:06 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:34:07.261645 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a5da9235-2e84-4f81-a082-03e7549cc5f4 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:07.267345 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a5da9235-2e84-4f81-a082-03e7549cc5f4 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: f8497465-98e6-46f0-bd09-11c432c292a1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:07.284127 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a5da9235-2e84-4f81-a082-03e7549cc5f4 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:07.286641 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a5da9235-2e84-4f81-a082-03e7549cc5f4 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:07.287682 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a5da9235-2e84-4f81-a082-03e7549cc5f4 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:07.288645 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a5da9235-2e84-4f81-a082-03e7549cc5f4 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:07.654141 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a5da9235-2e84-4f81-a082-03e7549cc5f4 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a427fb7481d4799a83729910f33b01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd96a8c91974b8ba7919d5349f380ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:07.670212 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a5da9235-2e84-4f81-a082-03e7549cc5f4 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1" status: 200 len: 1587 microversion: 2.1 time: 0.416644 Aug 04 16:34:07.671447 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 273/516] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:07 2022] GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1 => generated 1587 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:07.676662 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-048f40c5-070b-4cf8-a7ec-a016de239754 tempest-QuotaClassesAdmin257Test-259381781 tempest-QuotaClassesAdmin257Test-259381781-project-admin] Action: 'update', calling method: .version_select at 0x7f7e853cc160>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:07.679814 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:34:07.679814 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:34:07.764118 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:34:08.001749 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-048f40c5-070b-4cf8-a7ec-a016de239754 tempest-QuotaClassesAdmin257Test-259381781 tempest-QuotaClassesAdmin257Test-259381781-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.327987 Aug 04 16:34:08.010687 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 274/517] 10.222.0.23 () {62 vars in 1247 bytes} [Thu Aug 4 16:34:07 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:34:08.017241 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2ced387e-2c69-4e9b-99c1-02dfac120f5a tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:08.017872 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2ced387e-2c69-4e9b-99c1-02dfac120f5a tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] [instance: c494f329-3998-482b-82fd-e1c88c7d4b33] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:08.030846 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ced387e-2c69-4e9b-99c1-02dfac120f5a tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:08.031905 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ced387e-2c69-4e9b-99c1-02dfac120f5a tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:08.032583 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ced387e-2c69-4e9b-99c1-02dfac120f5a tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:08.033018 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ced387e-2c69-4e9b-99c1-02dfac120f5a tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:08.372260 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2ced387e-2c69-4e9b-99c1-02dfac120f5a tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33" status: 200 len: 1615 microversion: 2.1 time: 0.360518 Aug 04 16:34:08.373485 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 275/518] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:08 2022] GET /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33 => generated 1615 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:08.380192 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ff548e82-c51d-4034-97ff-f515de8c0714 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:08.381038 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ff548e82-c51d-4034-97ff-f515de8c0714 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: f8497465-98e6-46f0-bd09-11c432c292a1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:08.409439 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ff548e82-c51d-4034-97ff-f515de8c0714 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:08.410580 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ff548e82-c51d-4034-97ff-f515de8c0714 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:08.411839 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ff548e82-c51d-4034-97ff-f515de8c0714 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:08.412476 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ff548e82-c51d-4034-97ff-f515de8c0714 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:08.532306 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ff548e82-c51d-4034-97ff-f515de8c0714 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.155490 Aug 04 16:34:08.551565 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 276/519] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Aug 4 16:34:08 2022] GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1/os-interface => generated 284 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:08.556784 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-534dd2be-80c9-49ec-a72c-669ba67befcc tempest-QuotaClassesAdmin257Test-259381781 tempest-QuotaClassesAdmin257Test-259381781-project-admin] Calling method '.version_select at 0x7f7e850ee670>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:08.581509 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:34:08.581509 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:34:08.597171 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-534dd2be-80c9-49ec-a72c-669ba67befcc tempest-QuotaClassesAdmin257Test-259381781 tempest-QuotaClassesAdmin257Test-259381781-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.044225 Aug 04 16:34:08.607814 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 277/520] 10.222.0.23 () {60 vars in 1226 bytes} [Thu Aug 4 16:34:08 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:34:08.618142 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-634bc46f-da6b-4c58-8d0f-3291a37ede3d tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:08.619087 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-634bc46f-da6b-4c58-8d0f-3291a37ede3d tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] [instance: c494f329-3998-482b-82fd-e1c88c7d4b33] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:08.632563 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-634bc46f-da6b-4c58-8d0f-3291a37ede3d tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:08.633400 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-634bc46f-da6b-4c58-8d0f-3291a37ede3d tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:08.634421 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-634bc46f-da6b-4c58-8d0f-3291a37ede3d tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:08.635062 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-634bc46f-da6b-4c58-8d0f-3291a37ede3d tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:08.767428 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-634bc46f-da6b-4c58-8d0f-3291a37ede3d tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] HTTP exception thrown: Cannot 'migrate' instance c494f329-3998-482b-82fd-e1c88c7d4b33 while it is in vm_state suspended Aug 04 16:34:08.771021 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-634bc46f-da6b-4c58-8d0f-3291a37ede3d tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Request method failure captured: Aug 04 16:34:08.771021 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33/action HTTP/1.1 Aug 04 16:34:08.771021 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:34:08.771021 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:34:08.771021 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:34:08.771021 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 15 Aug 04 16:34:08.771021 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:34:08.771021 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:34:08.771021 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:34:08.771021 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:34:08.771021 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_TNUieXndj_whJCz4472FtDKfXYjgMXSxI0w9zFZcI1wSjwAN2UHLahDDkutG6pskTOvgQAQyheVE1NfvhNAFOmM6L0sUUPQ9HkZgkdad2aDvjNP66ZbqXWlntsX8fwymRQ754wex6A-0-knKD4IUU-Kd3JkTHV8iVQIzeK7mpMHtU Aug 04 16:34:08.771021 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:34:08.771021 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:34:08.771021 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:34:08.771021 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:34:08.771021 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:34:08.771021 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:34:08.771021 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: d5361d068b5a4ca9936049683638e8f8 Aug 04 16:34:08.771021 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1400456038 Aug 04 16:34:08.771021 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader,admin Aug 04 16:34:08.771021 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader,admin Aug 04 16:34:08.772642 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d5361d068b5a4ca9936049683638e8f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d5361d068b5a4ca9936049683638e8f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d5361d068b5a4ca9936049683638e8f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d5361d068b5a4ca9936049683638e8f8"}]}] Aug 04 16:34:08.772642 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1400456038 Aug 04 16:34:08.772642 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: d5361d068b5a4ca9936049683638e8f8 Aug 04 16:34:08.772642 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1400456038 Aug 04 16:34:08.772642 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersAdminNegativeTestJSON-1400456038-project-admin Aug 04 16:34:08.772642 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:34:08.772642 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:34:08.772642 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: fd3d83f42eaa4553addf5380f20dd98a Aug 04 16:34:08.772642 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1400456038-project-admin Aug 04 16:34:08.772642 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 16:34:08.772642 n-d-846466-12 devstack@n-api.service[126126]: {"migrate": {}} Aug 04 16:34:08.772642 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:34:08.772642 n-d-846466-12 devstack@n-api.service[126126]: exception: Cannot 'migrate' instance c494f329-3998-482b-82fd-e1c88c7d4b33 while it is in vm_state suspended Aug 04 16:34:08.773700 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'c494f329-3998-482b-82fd-e1c88c7d4b33', 'body': {'migrate': {}}} Aug 04 16:34:08.773700 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:34:08.773700 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:08.773700 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 04 16:34:08.773700 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 04 16:34:08.773700 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 04 16:34:08.773700 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 16:34:08.773700 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 04 16:34:08.773700 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 16:34:08.773700 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 04 16:34:08.773700 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 16:34:08.773700 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 16:34:08.773700 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 16:34:08.773700 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 16:34:08.773700 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 16:34:08.773700 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 16:34:08.773700 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 16:34:08.773700 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c494f329-3998-482b-82fd-e1c88c7d4b33 in vm_state suspended. Cannot resize while the instance is in this state. Aug 04 16:34:08.773700 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:08.775190 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:08.775190 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:08.775190 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:08.775190 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:08.775190 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:08.775190 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:34:08.775190 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:34:08.775190 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:34:08.775190 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:34:08.775190 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:34:08.775190 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:34:08.775190 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 04 16:34:08.775190 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 16:34:08.775190 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 16:34:08.775190 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 16:34:08.775190 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance c494f329-3998-482b-82fd-e1c88c7d4b33 while it is in vm_state suspended Aug 04 16:34:08.775190 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:08.775190 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:08.775190 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:08.775190 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:08.776730 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:08.776730 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:08.776730 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:34:08.776730 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:34:08.776730 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance c494f329-3998-482b-82fd-e1c88c7d4b33 while it is in vm_state suspended Aug 04 16:34:08.776730 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:08.777273 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-634bc46f-da6b-4c58-8d0f-3291a37ede3d tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Returning 409 to user: Cannot 'migrate' instance c494f329-3998-482b-82fd-e1c88c7d4b33 while it is in vm_state suspended {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:34:08.781729 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-634bc46f-da6b-4c58-8d0f-3291a37ede3d tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33/action" status: 409 len: 148 microversion: 2.1 time: 0.170879 Aug 04 16:34:08.782544 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 278/521] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:34:08 2022] POST /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33/action => generated 148 bytes in 174 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:34:08.804123 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4539ee5a-b0eb-42f2-b00d-e1fd11423428 tempest-QuotaClassesAdmin257Test-259381781 tempest-QuotaClassesAdmin257Test-259381781-project-admin] Action: 'update', calling method: .version_select at 0x7f7e85240e50>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:08.808835 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:34:08.808835 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:34:08.848965 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=12 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:34:08.935182 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4539ee5a-b0eb-42f2-b00d-e1fd11423428 tempest-QuotaClassesAdmin257Test-259381781 tempest-QuotaClassesAdmin257Test-259381781-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.137411 Aug 04 16:34:08.935987 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 279/522] 10.222.0.23 () {62 vars in 1247 bytes} [Thu Aug 4 16:34:08 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:34:08.947119 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-342a250e-0104-45e3-9f2f-19278537b4ab tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:08.959530 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-342a250e-0104-45e3-9f2f-19278537b4ab tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Request method failure captured: Aug 04 16:34:08.959530 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c/action HTTP/1.1 Aug 04 16:34:08.959530 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:34:08.959530 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:34:08.959530 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:34:08.959530 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 39 Aug 04 16:34:08.959530 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:34:08.959530 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:34:08.959530 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:34:08.959530 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:34:08.959530 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_TNUieXndj_whJCz4472FtDKfXYjgMXSxI0w9zFZcI1wSjwAN2UHLahDDkutG6pskTOvgQAQyheVE1NfvhNAFOmM6L0sUUPQ9HkZgkdad2aDvjNP66ZbqXWlntsX8fwymRQ754wex6A-0-knKD4IUU-Kd3JkTHV8iVQIzeK7mpMHtU Aug 04 16:34:08.959530 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:34:08.959530 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:34:08.959530 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:34:08.959530 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:34:08.959530 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:34:08.959530 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:34:08.959530 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: d5361d068b5a4ca9936049683638e8f8 Aug 04 16:34:08.959530 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1400456038 Aug 04 16:34:08.959530 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader,admin Aug 04 16:34:08.959530 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader,admin Aug 04 16:34:08.960894 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d5361d068b5a4ca9936049683638e8f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d5361d068b5a4ca9936049683638e8f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d5361d068b5a4ca9936049683638e8f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d5361d068b5a4ca9936049683638e8f8"}]}] Aug 04 16:34:08.960894 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1400456038 Aug 04 16:34:08.960894 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: d5361d068b5a4ca9936049683638e8f8 Aug 04 16:34:08.960894 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1400456038 Aug 04 16:34:08.960894 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersAdminNegativeTestJSON-1400456038-project-admin Aug 04 16:34:08.960894 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:34:08.960894 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:34:08.960894 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: fd3d83f42eaa4553addf5380f20dd98a Aug 04 16:34:08.960894 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1400456038-project-admin Aug 04 16:34:08.960894 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 16:34:08.960894 n-d-846466-12 devstack@n-api.service[126126]: {"os-resetState": {"state": "invalid"}} Aug 04 16:34:08.960894 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:34:08.961717 n-d-846466-12 devstack@n-api.service[126126]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 04 16:34:08.961717 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '92c85400-67f0-4930-bf61-28770e84b98c', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 04 16:34:08.961717 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:34:08.961717 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:08.961717 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:34:08.961717 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:34:08.961717 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:34:08.961717 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:34:08.961717 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 04 16:34:08.961717 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:08.961717 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 04 16:34:08.961717 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 04 16:34:08.961717 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:08.961717 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 04 16:34:08.961717 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi 'invalid' Aug 04 16:34:08.961717 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:08.961717 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:08.961717 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:08.961717 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:08.961717 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:08.961717 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:08.961717 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:34:08.963060 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:34:08.963060 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:34:08.963060 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:34:08.963060 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 16:34:08.963060 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 16:34:08.963060 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:34:08.963060 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:34:08.963060 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:34:08.963060 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:34:08.963060 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 04 16:34:08.963060 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:08.963060 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:08.963060 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:08.963060 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:08.963060 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:08.963060 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:08.963060 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:34:08.963060 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:34:08.963060 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 04 16:34:08.964197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:08.966287 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-342a250e-0104-45e3-9f2f-19278537b4ab tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:34:08.967697 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-342a250e-0104-45e3-9f2f-19278537b4ab tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c/action" status: 400 len: 144 microversion: 2.1 time: 0.029216 Aug 04 16:34:08.971741 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 280/523] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:34:08 2022] POST /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c/action => generated 144 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:34:09.194140 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8de24bfc-b8aa-40a6-a73a-dec23cf92d81 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9/action" status: 202 len: 0 microversion: 2.1 time: 5.861250 Aug 04 16:34:09.195311 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 244/524] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:34:03 2022] POST /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9/action => generated 0 bytes in 5864 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:34:09.201214 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fd31ad19-1aca-4ec1-9d93-799af72ed425 tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:09.216810 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fd31ad19-1aca-4ec1-9d93-799af72ed425 tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Request method failure captured: Aug 04 16:34:09.216810 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c/action HTTP/1.1 Aug 04 16:34:09.216810 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:34:09.216810 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:34:09.216810 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:34:09.216810 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 31 Aug 04 16:34:09.216810 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:34:09.216810 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:34:09.216810 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:34:09.216810 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:34:09.216810 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_TNUieXndj_whJCz4472FtDKfXYjgMXSxI0w9zFZcI1wSjwAN2UHLahDDkutG6pskTOvgQAQyheVE1NfvhNAFOmM6L0sUUPQ9HkZgkdad2aDvjNP66ZbqXWlntsX8fwymRQ754wex6A-0-knKD4IUU-Kd3JkTHV8iVQIzeK7mpMHtU Aug 04 16:34:09.216810 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:34:09.216810 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:34:09.216810 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:34:09.216810 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:34:09.216810 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:34:09.216810 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:34:09.216810 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: d5361d068b5a4ca9936049683638e8f8 Aug 04 16:34:09.216810 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1400456038 Aug 04 16:34:09.216810 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader,admin Aug 04 16:34:09.216810 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader,admin Aug 04 16:34:09.218348 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d5361d068b5a4ca9936049683638e8f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d5361d068b5a4ca9936049683638e8f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d5361d068b5a4ca9936049683638e8f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d5361d068b5a4ca9936049683638e8f8"}]}] Aug 04 16:34:09.218348 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1400456038 Aug 04 16:34:09.218348 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: d5361d068b5a4ca9936049683638e8f8 Aug 04 16:34:09.218348 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1400456038 Aug 04 16:34:09.218348 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersAdminNegativeTestJSON-1400456038-project-admin Aug 04 16:34:09.218348 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:34:09.218348 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:34:09.218348 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: fd3d83f42eaa4553addf5380f20dd98a Aug 04 16:34:09.218348 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1400456038-project-admin Aug 04 16:34:09.218348 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:34:09.218348 n-d-846466-12 devstack@n-api.service[126125]: {"os-resetState": {"state": 1}} Aug 04 16:34:09.218348 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:34:09.218348 n-d-846466-12 devstack@n-api.service[126125]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 04 16:34:09.219105 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '92c85400-67f0-4930-bf61-28770e84b98c', 'body': {'os-resetState': {'state': 1}}} Aug 04 16:34:09.219105 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:34:09.219105 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:09.219105 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:34:09.219105 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:34:09.219105 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:34:09.219105 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:34:09.219105 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 04 16:34:09.219105 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:09.219105 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 04 16:34:09.219105 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 04 16:34:09.219105 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:09.219105 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 04 16:34:09.219105 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 1 Aug 04 16:34:09.219105 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:09.219105 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:09.219105 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:09.219105 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:09.219105 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:09.219105 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:09.219105 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:34:09.219105 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:34:09.220369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:34:09.220369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:34:09.220369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 16:34:09.220369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 16:34:09.220369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:34:09.220369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:34:09.220369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:34:09.220369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:34:09.220369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 04 16:34:09.220369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:09.220369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:09.220369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:09.220369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:09.220369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:09.220369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:09.220369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:34:09.220369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:34:09.220369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 04 16:34:09.220369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:09.221553 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fd31ad19-1aca-4ec1-9d93-799af72ed425 tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:34:09.225601 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fd31ad19-1aca-4ec1-9d93-799af72ed425 tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c/action" status: 400 len: 120 microversion: 2.1 time: 0.023877 Aug 04 16:34:09.240616 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 245/525] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:34:09 2022] POST /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c/action => generated 120 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:34:09.268650 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-424087df-ea1c-4b8e-9c9d-3ec46521849e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:09.278628 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-424087df-ea1c-4b8e-9c9d-3ec46521849e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: f23a3c47-f725-4ad2-b88d-b972ff4b2ee9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:09.307178 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-424087df-ea1c-4b8e-9c9d-3ec46521849e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:09.314312 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-424087df-ea1c-4b8e-9c9d-3ec46521849e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:09.315490 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-424087df-ea1c-4b8e-9c9d-3ec46521849e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:09.318239 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-424087df-ea1c-4b8e-9c9d-3ec46521849e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:09.813045 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2a391bfa-6b93-4645-875c-b9c54faf4788 tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:09.842401 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2a391bfa-6b93-4645-875c-b9c54faf4788 tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.867882 Aug 04 16:34:09.845129 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 281/526] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Aug 4 16:34:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:09.850420 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cd6943ed-5c6c-4df4-b631-e023f443ddcf tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:09.861916 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cd6943ed-5c6c-4df4-b631-e023f443ddcf tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Failed to fetch instance by id 999 {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 04 16:34:09.863462 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-cd6943ed-5c6c-4df4-b631-e023f443ddcf tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 04 16:34:09.877833 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cd6943ed-5c6c-4df4-b631-e023f443ddcf tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Request method failure captured: Aug 04 16:34:09.877833 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 04 16:34:09.877833 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:34:09.877833 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:34:09.877833 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:34:09.877833 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 37 Aug 04 16:34:09.877833 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:34:09.877833 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:34:09.877833 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:34:09.877833 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:34:09.877833 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_TNUieXndj_whJCz4472FtDKfXYjgMXSxI0w9zFZcI1wSjwAN2UHLahDDkutG6pskTOvgQAQyheVE1NfvhNAFOmM6L0sUUPQ9HkZgkdad2aDvjNP66ZbqXWlntsX8fwymRQ754wex6A-0-knKD4IUU-Kd3JkTHV8iVQIzeK7mpMHtU Aug 04 16:34:09.877833 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:34:09.877833 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:34:09.877833 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:34:09.877833 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:34:09.877833 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:34:09.877833 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:34:09.877833 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: d5361d068b5a4ca9936049683638e8f8 Aug 04 16:34:09.877833 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1400456038 Aug 04 16:34:09.877833 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader,admin Aug 04 16:34:09.877833 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader,admin Aug 04 16:34:09.879340 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d5361d068b5a4ca9936049683638e8f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d5361d068b5a4ca9936049683638e8f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d5361d068b5a4ca9936049683638e8f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d5361d068b5a4ca9936049683638e8f8"}]}] Aug 04 16:34:09.879340 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1400456038 Aug 04 16:34:09.879340 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: d5361d068b5a4ca9936049683638e8f8 Aug 04 16:34:09.879340 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1400456038 Aug 04 16:34:09.879340 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersAdminNegativeTestJSON-1400456038-project-admin Aug 04 16:34:09.879340 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:34:09.879340 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:34:09.879340 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: fd3d83f42eaa4553addf5380f20dd98a Aug 04 16:34:09.879340 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1400456038-project-admin Aug 04 16:34:09.879340 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 16:34:09.879340 n-d-846466-12 devstack@n-api.service[126126]: {"os-resetState": {"state": "error"}} Aug 04 16:34:09.879340 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:34:09.879340 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 999 could not be found. Aug 04 16:34:09.880270 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 04 16:34:09.880270 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:34:09.880270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:09.880270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:34:09.880270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:34:09.880270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 04 16:34:09.880270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 04 16:34:09.880270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 04 16:34:09.880270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:09.880270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:09.880270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:09.880270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:09.880270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:09.880270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:09.880270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:34:09.880270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:34:09.880270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:34:09.880270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:34:09.880270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:34:09.880270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:34:09.880270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 04 16:34:09.882346 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 04 16:34:09.882346 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:34:09.882346 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:34:09.882346 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 04 16:34:09.882346 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:09.882346 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:09.882346 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:09.882346 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:09.882346 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:09.882346 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:09.882346 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:34:09.882346 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:34:09.882346 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 04 16:34:09.882346 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:09.882346 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cd6943ed-5c6c-4df4-b631-e023f443ddcf tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:34:09.882346 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cd6943ed-5c6c-4df4-b631-e023f443ddcf tempest-ServersAdminNegativeTestJSON-1400456038 tempest-ServersAdminNegativeTestJSON-1400456038-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.033097 Aug 04 16:34:09.884547 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 282/527] 10.222.0.23 () {60 vars in 1179 bytes} [Thu Aug 4 16:34:09 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:34:09.895084 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-282a8759-9071-4ff3-a254-a14be8ec99af tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:09.939740 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-282a8759-9071-4ff3-a254-a14be8ec99af tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] 10.222.0.23 "GET /compute/v2.1/flavors" status: 200 len: 3081 microversion: 2.1 time: 0.054027 Aug 04 16:34:09.948492 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 283/528] 10.222.0.23 () {58 vars in 1125 bytes} [Thu Aug 4 16:34:09 2022] GET /compute/v2.1/flavors => generated 3081 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:09.956969 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-318546d2-fd4b-40e4-9763-90be90b87d28 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:09.957797 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-318546d2-fd4b-40e4-9763-90be90b87d28 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: c494f329-3998-482b-82fd-e1c88c7d4b33] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:09.969403 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-318546d2-fd4b-40e4-9763-90be90b87d28 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:09.969854 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-318546d2-fd4b-40e4-9763-90be90b87d28 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:09.970618 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-318546d2-fd4b-40e4-9763-90be90b87d28 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:09.974909 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-318546d2-fd4b-40e4-9763-90be90b87d28 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:10.026397 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-318546d2-fd4b-40e4-9763-90be90b87d28 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: c494f329-3998-482b-82fd-e1c88c7d4b33] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:34:10.124988 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-424087df-ea1c-4b8e-9c9d-3ec46521849e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:10.139569 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-424087df-ea1c-4b8e-9c9d-3ec46521849e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9" status: 200 len: 1504 microversion: 2.1 time: 0.895357 Aug 04 16:34:10.140966 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 246/529] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:09 2022] GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 => generated 1504 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:10.147707 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-08a43b87-64f6-4537-8f44-eee8127ad210 tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:10.169015 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-08a43b87-64f6-4537-8f44-eee8127ad210 tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025888 Aug 04 16:34:10.180959 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 247/530] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Aug 4 16:34:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:10.196638 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-70ea53a4-9ba4-43e6-ae61-49f647b70071 tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:10.204915 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:34:10.217438 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-318546d2-fd4b-40e4-9763-90be90b87d28 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33" status: 204 len: 0 microversion: 2.1 time: 0.267336 Aug 04 16:34:10.218695 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 284/531] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:34:09 2022] DELETE /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:34:10.219988 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-70ea53a4-9ba4-43e6-ae61-49f647b70071 tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027214 Aug 04 16:34:10.223575 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 248/532] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Aug 4 16:34:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:10.232149 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a30f20ae-c435-40cb-8aa1-61cfd2ed65d7 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:10.235580 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a30f20ae-c435-40cb-8aa1-61cfd2ed65d7 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: c494f329-3998-482b-82fd-e1c88c7d4b33] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:10.260952 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-080d6111-159f-48cc-8212-ed829ee2a482 tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:10.277338 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a30f20ae-c435-40cb-8aa1-61cfd2ed65d7 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:10.277797 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a30f20ae-c435-40cb-8aa1-61cfd2ed65d7 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:10.278933 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a30f20ae-c435-40cb-8aa1-61cfd2ed65d7 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:10.279817 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a30f20ae-c435-40cb-8aa1-61cfd2ed65d7 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:10.331676 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-080d6111-159f-48cc-8212-ed829ee2a482 tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.094306 Aug 04 16:34:10.343656 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 249/533] 10.222.0.23 () {58 vars in 1165 bytes} [Thu Aug 4 16:34:10 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:10.351358 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8b8fe933-4ca3-4175-89ba-2a462e767da0 tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:10.367251 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8b8fe933-4ca3-4175-89ba-2a462e767da0 tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018594 Aug 04 16:34:10.368332 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 250/534] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Aug 4 16:34:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:10.382386 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-896959c7-b71c-4c4c-87ef-f65d77d70d75 tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:10.464971 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-896959c7-b71c-4c4c-87ef-f65d77d70d75 tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.088592 Aug 04 16:34:10.466132 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 251/535] 10.222.0.23 () {58 vars in 1169 bytes} [Thu Aug 4 16:34:10 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:34:10.484416 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-69ac2c20-2e25-4d7c-a19e-0e5513cbc52c tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:10.500448 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=8 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:34:10.527106 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-69ac2c20-2e25-4d7c-a19e-0e5513cbc52c tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.047603 Aug 04 16:34:10.528441 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 252/536] 10.222.0.23 () {58 vars in 1161 bytes} [Thu Aug 4 16:34:10 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:10.561711 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-53934f3c-2371-469c-99ef-3f7fa32aa4a1 tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:10.571977 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-53934f3c-2371-469c-99ef-3f7fa32aa4a1 tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015750 Aug 04 16:34:10.581617 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 253/537] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Aug 4 16:34:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:10.596840 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-301686c8-e1bf-4cc1-bdf8-2a60efca7e11 tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:10.658075 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-301686c8-e1bf-4cc1-bdf8-2a60efca7e11 tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.062109 Aug 04 16:34:10.671551 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 254/538] 10.222.0.23 () {58 vars in 1167 bytes} [Thu Aug 4 16:34:10 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:10.680369 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e87ec2dc-09ea-4ccc-bd98-c616e011fcdd tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:10.691849 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e87ec2dc-09ea-4ccc-bd98-c616e011fcdd tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015702 Aug 04 16:34:10.700234 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 255/539] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Aug 4 16:34:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:34:10.707054 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2b4cba44-760a-49bf-9d6e-066d7ed428a8 tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:10.734837 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2b4cba44-760a-49bf-9d6e-066d7ed428a8 tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] 10.222.0.23 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.033128 Aug 04 16:34:10.735654 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 256/540] 10.222.0.23 () {58 vars in 1144 bytes} [Thu Aug 4 16:34:10 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:10.752433 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9004ecba-5906-4e17-ac05-fd750bc2408e tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:10.764481 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9004ecba-5906-4e17-ac05-fd750bc2408e tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016074 Aug 04 16:34:10.765460 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 257/541] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Aug 4 16:34:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:10.777355 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-34e67328-a106-4515-9ef4-b67b1aa5d5e1 tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:10.805603 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-34e67328-a106-4515-9ef4-b67b1aa5d5e1 tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] 10.222.0.23 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.031740 Aug 04 16:34:10.814722 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 258/542] 10.222.0.23 () {58 vars in 1148 bytes} [Thu Aug 4 16:34:10 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:10.824559 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5c0cb011-dc4d-4c7f-870e-4c0b46fe297e tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:10.841789 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5c0cb011-dc4d-4c7f-870e-4c0b46fe297e tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] 10.222.0.23 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.025575 Aug 04 16:34:10.849535 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 259/543] 10.222.0.23 () {58 vars in 1140 bytes} [Thu Aug 4 16:34:10 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:10.874421 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d79cd703-390e-4bab-a95c-0db4c2b1dfd8 tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:10.916061 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d79cd703-390e-4bab-a95c-0db4c2b1dfd8 tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.049715 Aug 04 16:34:10.923705 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 260/544] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Aug 4 16:34:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:10.942909 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-605cc0be-b50a-45a6-832e-c2caaefed49f tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:11.023340 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-605cc0be-b50a-45a6-832e-c2caaefed49f tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] 10.222.0.23 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.097491 Aug 04 16:34:11.028176 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 261/545] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:34:10 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:11.058270 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cabc0eb2-7d73-4cf4-96fc-4ca17b40bf9c tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:11.127094 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cabc0eb2-7d73-4cf4-96fc-4ca17b40bf9c tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.085007 Aug 04 16:34:11.132648 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 262/546] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:34:11 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:11.162609 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2a49f12e-8c45-42bb-8018-57fdd5e00a9b tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:11.183670 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2a49f12e-8c45-42bb-8018-57fdd5e00a9b tempest-FlavorsV2TestJSON-1732862991 tempest-FlavorsV2TestJSON-1732862991-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023753 Aug 04 16:34:11.184491 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 263/547] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Aug 4 16:34:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:11.191133 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a30f20ae-c435-40cb-8aa1-61cfd2ed65d7 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c73c354a6ee4ab881f483ff65a21dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cb965024d94d7cae0c5652212e7cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:11.192387 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e3ff4e03-9c2a-4dd0-8103-a3ae45dc4d50 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:11.195245 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e3ff4e03-9c2a-4dd0-8103-a3ae45dc4d50 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: f23a3c47-f725-4ad2-b88d-b972ff4b2ee9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:11.206695 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a30f20ae-c435-40cb-8aa1-61cfd2ed65d7 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "GET /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33" status: 200 len: 1468 microversion: 2.1 time: 0.979760 Aug 04 16:34:11.208535 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 285/548] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:10 2022] GET /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33 => generated 1468 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:11.220478 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3ff4e03-9c2a-4dd0-8103-a3ae45dc4d50 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:11.221656 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3ff4e03-9c2a-4dd0-8103-a3ae45dc4d50 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:11.230945 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3ff4e03-9c2a-4dd0-8103-a3ae45dc4d50 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:11.231618 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3ff4e03-9c2a-4dd0-8103-a3ae45dc4d50 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:11.962915 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bfe615d2-0c72-4def-8551-af9150df7d1e tempest-HypervisorAdminNegativeUnderV252Test-189033534 tempest-HypervisorAdminNegativeUnderV252Test-189033534-project-admin] Calling method '.version_select at 0x7f7e850b4790>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:11.963921 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:34:11.963921 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:34:11.965403 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bfe615d2-0c72-4def-8551-af9150df7d1e tempest-HypervisorAdminNegativeUnderV252Test-189033534 tempest-HypervisorAdminNegativeUnderV252Test-189033534-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:11.965894 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bfe615d2-0c72-4def-8551-af9150df7d1e tempest-HypervisorAdminNegativeUnderV252Test-189033534 tempest-HypervisorAdminNegativeUnderV252Test-189033534-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:12.004372 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bfe615d2-0c72-4def-8551-af9150df7d1e tempest-HypervisorAdminNegativeUnderV252Test-189033534 tempest-HypervisorAdminNegativeUnderV252Test-189033534-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:12.009370 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bfe615d2-0c72-4def-8551-af9150df7d1e tempest-HypervisorAdminNegativeUnderV252Test-189033534 tempest-HypervisorAdminNegativeUnderV252Test-189033534-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:12.046536 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bfe615d2-0c72-4def-8551-af9150df7d1e tempest-HypervisorAdminNegativeUnderV252Test-189033534 tempest-HypervisorAdminNegativeUnderV252Test-189033534-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:12.047039 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bfe615d2-0c72-4def-8551-af9150df7d1e tempest-HypervisorAdminNegativeUnderV252Test-189033534 tempest-HypervisorAdminNegativeUnderV252Test-189033534-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:12.075923 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bfe615d2-0c72-4def-8551-af9150df7d1e tempest-HypervisorAdminNegativeUnderV252Test-189033534 tempest-HypervisorAdminNegativeUnderV252Test-189033534-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.830537 Aug 04 16:34:12.077067 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 286/549] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:34:11 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:12.494897 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e3ff4e03-9c2a-4dd0-8103-a3ae45dc4d50 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:12.503166 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e3ff4e03-9c2a-4dd0-8103-a3ae45dc4d50 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9" status: 200 len: 1504 microversion: 2.1 time: 1.317253 Aug 04 16:34:12.508609 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 264/550] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:11 2022] GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 => generated 1504 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:12.515779 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5ce15d28-8ffd-4e93-8c22-d214ce757d3f tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:12.522326 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5ce15d28-8ffd-4e93-8c22-d214ce757d3f tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: c494f329-3998-482b-82fd-e1c88c7d4b33] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:12.532149 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ce15d28-8ffd-4e93-8c22-d214ce757d3f tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:12.539661 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ce15d28-8ffd-4e93-8c22-d214ce757d3f tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:12.540512 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ce15d28-8ffd-4e93-8c22-d214ce757d3f tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:12.540946 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ce15d28-8ffd-4e93-8c22-d214ce757d3f tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:12.636473 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-813a8983-4b46-40b6-8449-1c8091036611 tempest-HypervisorAdminNegativeUnderV252Test-2133192221 tempest-HypervisorAdminNegativeUnderV252Test-2133192221-project] Calling method '.version_select at 0x7f7e850b4b80>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:12.637180 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:34:12.637180 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:34:12.638610 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-813a8983-4b46-40b6-8449-1c8091036611 tempest-HypervisorAdminNegativeUnderV252Test-2133192221 tempest-HypervisorAdminNegativeUnderV252Test-2133192221-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'a953fb61484f416d820aebcf40d3d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032c8c9d20514c40ab9cd0da5880cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:12.640494 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-813a8983-4b46-40b6-8449-1c8091036611 tempest-HypervisorAdminNegativeUnderV252Test-2133192221 tempest-HypervisorAdminNegativeUnderV252Test-2133192221-project] Request method failure captured: Aug 04 16:34:12.640494 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/os-hypervisors/n-h2-846466-12/search HTTP/1.1 Aug 04 16:34:12.640494 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:34:12.640494 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:34:12.640494 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:34:12.640494 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:34:12.640494 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:34:12.640494 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:34:12.640494 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:34:12.640494 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:34:12.640494 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_UBPHQIwLBv9qxFv7Pe9KetgWSlgyvquR7wELFqTaHyEaFarpbhn6XIWxR9WwzxP5hyZjf05zhVy3ML5V1wq98r_iiqxtYok-AvRp6c04YVTm_sv440OE8vJNOiLfZ5Cng3nH1MT8tM0VwZoqF6Edm6aIZdOzeh5iQqlC96gU8Lj2c Aug 04 16:34:12.640494 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:34:12.640494 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:34:12.640494 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:34:12.640494 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:34:12.640494 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:34:12.640494 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:34:12.640494 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 032c8c9d20514c40ab9cd0da5880cc45 Aug 04 16:34:12.640494 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2133192221 Aug 04 16:34:12.640494 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:34:12.640494 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:34:12.642464 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/032c8c9d20514c40ab9cd0da5880cc45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_032c8c9d20514c40ab9cd0da5880cc45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/032c8c9d20514c40ab9cd0da5880cc45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/032c8c9d20514c40ab9cd0da5880cc45"}]}] Aug 04 16:34:12.642464 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2133192221 Aug 04 16:34:12.642464 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 032c8c9d20514c40ab9cd0da5880cc45 Aug 04 16:34:12.642464 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2133192221 Aug 04 16:34:12.642464 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2133192221-project Aug 04 16:34:12.642464 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:34:12.642464 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:34:12.642464 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: a953fb61484f416d820aebcf40d3d730 Aug 04 16:34:12.642464 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2133192221-project Aug 04 16:34:12.642464 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:34:12.642464 n-d-846466-12 devstack@n-api.service[126126]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 04 16:34:12.642464 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'n-h2-846466-12'} Aug 04 16:34:12.643362 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:34:12.643362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:12.643362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:12.643362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:12.643362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:34:12.643362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:34:12.643362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:34:12.643362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:34:12.643362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:34:12.643362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:34:12.643362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 04 16:34:12.643362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 04 16:34:12.643362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:34:12.643362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:34:12.643362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:34:12.643362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:34:12.643362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:34:12.643362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:34:12.643362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:34:12.644837 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:34:12.644837 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:34:12.644837 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:34:12.644837 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:34:12.644837 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:34:12.644837 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:34:12.644837 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:34:12.644837 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 04 16:34:12.644837 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:12.644837 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:12.644837 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:12.644837 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:12.644837 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:12.644837 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:12.644837 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:34:12.644837 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:34:12.644837 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 04 16:34:12.644837 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:12.648390 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-813a8983-4b46-40b6-8449-1c8091036611 tempest-HypervisorAdminNegativeUnderV252Test-2133192221 tempest-HypervisorAdminNegativeUnderV252Test-2133192221-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:34:12.649933 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-813a8983-4b46-40b6-8449-1c8091036611 tempest-HypervisorAdminNegativeUnderV252Test-2133192221 tempest-HypervisorAdminNegativeUnderV252Test-2133192221-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/n-h2-846466-12/search" status: 403 len: 117 microversion: 2.1 time: 0.560986 Aug 04 16:34:12.651151 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 287/551] 10.222.0.23 () {58 vars in 1212 bytes} [Thu Aug 4 16:34:12 2022] GET /compute/v2.1/os-hypervisors/n-h2-846466-12/search => generated 117 bytes in 566 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:34:12.661490 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d63f37a9-ce65-4f09-9496-c163de5194c1 tempest-HypervisorAdminNegativeUnderV252Test-189033534 tempest-HypervisorAdminNegativeUnderV252Test-189033534-project-admin] Calling method '.version_select at 0x7f7e850aa160>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:12.663618 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d63f37a9-ce65-4f09-9496-c163de5194c1 tempest-HypervisorAdminNegativeUnderV252Test-189033534 tempest-HypervisorAdminNegativeUnderV252Test-189033534-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:12.664269 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d63f37a9-ce65-4f09-9496-c163de5194c1 tempest-HypervisorAdminNegativeUnderV252Test-189033534 tempest-HypervisorAdminNegativeUnderV252Test-189033534-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:12.672911 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-d63f37a9-ce65-4f09-9496-c163de5194c1 tempest-HypervisorAdminNegativeUnderV252Test-189033534 tempest-HypervisorAdminNegativeUnderV252Test-189033534-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 04 16:34:12.674650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d63f37a9-ce65-4f09-9496-c163de5194c1 tempest-HypervisorAdminNegativeUnderV252Test-189033534 tempest-HypervisorAdminNegativeUnderV252Test-189033534-project-admin] Request method failure captured: Aug 04 16:34:12.674650 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 04 16:34:12.674650 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:34:12.674650 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:34:12.674650 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:34:12.674650 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:34:12.674650 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:34:12.674650 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:34:12.674650 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:34:12.674650 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:34:12.674650 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_UCPi1j03mnPlBsO5UbDXUs8Eb-HjSmHVCH3l6JYOH-t4F0MqdBoGRDTk_NlbkkB3_OUhPDE3M4wqjHJY-x8nOv6xT5b0ZxjuAUZTAyK5bpfoUyFcQvC0e9pqJDktivlQdtzINuAqBTVcadGmk64wFgwymYCMqXCL4wX6T8qLwbtOo Aug 04 16:34:12.674650 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:34:12.674650 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:34:12.674650 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:34:12.674650 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:34:12.674650 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:34:12.674650 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:34:12.674650 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: ef52da491682466badff61e6601fa812 Aug 04 16:34:12.674650 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-189033534 Aug 04 16:34:12.674650 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader,admin Aug 04 16:34:12.674650 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader,admin Aug 04 16:34:12.676560 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ef52da491682466badff61e6601fa812"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ef52da491682466badff61e6601fa812"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ef52da491682466badff61e6601fa812"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ef52da491682466badff61e6601fa812"}]}] Aug 04 16:34:12.676560 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-189033534 Aug 04 16:34:12.676560 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: ef52da491682466badff61e6601fa812 Aug 04 16:34:12.676560 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-189033534 Aug 04 16:34:12.676560 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-189033534-project-admin Aug 04 16:34:12.676560 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:34:12.676560 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:34:12.676560 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 941dedd308da4bfd9b1af35bb669ec9f Aug 04 16:34:12.676560 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-189033534-project-admin Aug 04 16:34:12.676560 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:34:12.676560 n-d-846466-12 devstack@n-api.service[126126]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 04 16:34:12.676560 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 04 16:34:12.677549 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:34:12.677549 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:12.677549 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:12.677549 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:12.677549 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:34:12.677549 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:34:12.677549 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:34:12.677549 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:34:12.677549 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:34:12.677549 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:34:12.677549 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 04 16:34:12.677549 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 04 16:34:12.677549 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 04 16:34:12.677549 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 16:34:12.677549 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 04 16:34:12.677549 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:12.677549 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:12.677549 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:12.677549 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:12.677549 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:12.678973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:12.678973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:34:12.678973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:34:12.678973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 04 16:34:12.678973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:12.680838 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d63f37a9-ce65-4f09-9496-c163de5194c1 tempest-HypervisorAdminNegativeUnderV252Test-189033534 tempest-HypervisorAdminNegativeUnderV252Test-189033534-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:34:12.681894 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d63f37a9-ce65-4f09-9496-c163de5194c1 tempest-HypervisorAdminNegativeUnderV252Test-189033534 tempest-HypervisorAdminNegativeUnderV252Test-189033534-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.025492 Aug 04 16:34:12.683260 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 288/552] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Aug 4 16:34:12 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:34:12.694000 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-beffcb48-dee9-4c66-b4c9-e301d46cb133 tempest-HypervisorAdminNegativeUnderV252Test-189033534 tempest-HypervisorAdminNegativeUnderV252Test-189033534-project-admin] Calling method '.version_select at 0x7f7e850aac10>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:12.695362 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:34:12.695362 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:34:12.697256 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-beffcb48-dee9-4c66-b4c9-e301d46cb133 tempest-HypervisorAdminNegativeUnderV252Test-189033534 tempest-HypervisorAdminNegativeUnderV252Test-189033534-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:12.698227 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-beffcb48-dee9-4c66-b4c9-e301d46cb133 tempest-HypervisorAdminNegativeUnderV252Test-189033534 tempest-HypervisorAdminNegativeUnderV252Test-189033534-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:12.718669 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-beffcb48-dee9-4c66-b4c9-e301d46cb133 tempest-HypervisorAdminNegativeUnderV252Test-189033534 tempest-HypervisorAdminNegativeUnderV252Test-189033534-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:12.719133 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-beffcb48-dee9-4c66-b4c9-e301d46cb133 tempest-HypervisorAdminNegativeUnderV252Test-189033534 tempest-HypervisorAdminNegativeUnderV252Test-189033534-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:12.741538 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-beffcb48-dee9-4c66-b4c9-e301d46cb133 tempest-HypervisorAdminNegativeUnderV252Test-189033534 tempest-HypervisorAdminNegativeUnderV252Test-189033534-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:12.741990 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-beffcb48-dee9-4c66-b4c9-e301d46cb133 tempest-HypervisorAdminNegativeUnderV252Test-189033534 tempest-HypervisorAdminNegativeUnderV252Test-189033534-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:12.767116 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-beffcb48-dee9-4c66-b4c9-e301d46cb133 tempest-HypervisorAdminNegativeUnderV252Test-189033534 tempest-HypervisorAdminNegativeUnderV252Test-189033534-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.075542 Aug 04 16:34:12.768512 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 289/553] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:34:12 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:34:12.784248 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c1c920e2-bd70-447a-a094-57621dc927ff tempest-HypervisorAdminNegativeUnderV252Test-2133192221 tempest-HypervisorAdminNegativeUnderV252Test-2133192221-project] Calling method '.version_select at 0x7f7e850aaaf0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:12.785811 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:34:12.785811 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:34:12.786954 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c1c920e2-bd70-447a-a094-57621dc927ff tempest-HypervisorAdminNegativeUnderV252Test-2133192221 tempest-HypervisorAdminNegativeUnderV252Test-2133192221-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'a953fb61484f416d820aebcf40d3d730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032c8c9d20514c40ab9cd0da5880cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:12.789093 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c1c920e2-bd70-447a-a094-57621dc927ff tempest-HypervisorAdminNegativeUnderV252Test-2133192221 tempest-HypervisorAdminNegativeUnderV252Test-2133192221-project] Request method failure captured: Aug 04 16:34:12.789093 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 04 16:34:12.789093 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:34:12.789093 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:34:12.789093 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:34:12.789093 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:34:12.789093 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:34:12.789093 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:34:12.789093 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:34:12.789093 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:34:12.789093 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_UBPHQIwLBv9qxFv7Pe9KetgWSlgyvquR7wELFqTaHyEaFarpbhn6XIWxR9WwzxP5hyZjf05zhVy3ML5V1wq98r_iiqxtYok-AvRp6c04YVTm_sv440OE8vJNOiLfZ5Cng3nH1MT8tM0VwZoqF6Edm6aIZdOzeh5iQqlC96gU8Lj2c Aug 04 16:34:12.789093 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:34:12.789093 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:34:12.789093 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:34:12.789093 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:34:12.789093 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:34:12.789093 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:34:12.789093 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 032c8c9d20514c40ab9cd0da5880cc45 Aug 04 16:34:12.789093 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2133192221 Aug 04 16:34:12.789093 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:34:12.789093 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:34:12.790590 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/032c8c9d20514c40ab9cd0da5880cc45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_032c8c9d20514c40ab9cd0da5880cc45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/032c8c9d20514c40ab9cd0da5880cc45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/032c8c9d20514c40ab9cd0da5880cc45"}]}] Aug 04 16:34:12.790590 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2133192221 Aug 04 16:34:12.790590 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 032c8c9d20514c40ab9cd0da5880cc45 Aug 04 16:34:12.790590 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2133192221 Aug 04 16:34:12.790590 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2133192221-project Aug 04 16:34:12.790590 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:34:12.790590 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:34:12.790590 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: a953fb61484f416d820aebcf40d3d730 Aug 04 16:34:12.790590 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2133192221-project Aug 04 16:34:12.790590 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:34:12.790590 n-d-846466-12 devstack@n-api.service[126126]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 04 16:34:12.790590 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '1'} Aug 04 16:34:12.791477 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:34:12.791477 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:12.791477 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:12.791477 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:12.791477 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:34:12.791477 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:34:12.791477 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:34:12.791477 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:34:12.791477 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:34:12.791477 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:34:12.791477 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 04 16:34:12.791477 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 04 16:34:12.791477 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:34:12.791477 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:34:12.791477 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:34:12.791477 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:34:12.791477 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:34:12.791477 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:34:12.791477 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:34:12.792866 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:34:12.792866 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:34:12.792866 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:34:12.792866 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:34:12.792866 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:34:12.792866 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:34:12.792866 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:34:12.792866 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 04 16:34:12.792866 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:12.792866 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:12.792866 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:12.792866 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:12.792866 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:12.792866 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:12.792866 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:34:12.792866 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:34:12.792866 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 04 16:34:12.792866 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:12.794143 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c1c920e2-bd70-447a-a094-57621dc927ff tempest-HypervisorAdminNegativeUnderV252Test-2133192221 tempest-HypervisorAdminNegativeUnderV252Test-2133192221-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:34:12.794143 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c1c920e2-bd70-447a-a094-57621dc927ff tempest-HypervisorAdminNegativeUnderV252Test-2133192221 tempest-HypervisorAdminNegativeUnderV252Test-2133192221-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.014696 Aug 04 16:34:12.794143 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 290/554] 10.222.0.23 () {58 vars in 1176 bytes} [Thu Aug 4 16:34:12 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:34:12.802458 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4beb03fd-f1fc-4477-97cc-62acfbc1533f tempest-HypervisorAdminNegativeUnderV252Test-189033534 tempest-HypervisorAdminNegativeUnderV252Test-189033534-project-admin] Calling method '.version_select at 0x7f7e850b4e50>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:12.818757 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4beb03fd-f1fc-4477-97cc-62acfbc1533f tempest-HypervisorAdminNegativeUnderV252Test-189033534 tempest-HypervisorAdminNegativeUnderV252Test-189033534-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:12.819200 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4beb03fd-f1fc-4477-97cc-62acfbc1533f tempest-HypervisorAdminNegativeUnderV252Test-189033534 tempest-HypervisorAdminNegativeUnderV252Test-189033534-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:12.826096 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-4beb03fd-f1fc-4477-97cc-62acfbc1533f tempest-HypervisorAdminNegativeUnderV252Test-189033534 tempest-HypervisorAdminNegativeUnderV252Test-189033534-project-admin] HTTP exception thrown: No hypervisor matching 'af4b2818-0d1c-471c-a192-4584fd26b0aa' could be found. Aug 04 16:34:12.827451 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4beb03fd-f1fc-4477-97cc-62acfbc1533f tempest-HypervisorAdminNegativeUnderV252Test-189033534 tempest-HypervisorAdminNegativeUnderV252Test-189033534-project-admin] Request method failure captured: Aug 04 16:34:12.827451 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/os-hypervisors/af4b2818-0d1c-471c-a192-4584fd26b0aa/servers HTTP/1.1 Aug 04 16:34:12.827451 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:34:12.827451 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:34:12.827451 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:34:12.827451 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:34:12.827451 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:34:12.827451 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:34:12.827451 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:34:12.827451 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:34:12.827451 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_UCPi1j03mnPlBsO5UbDXUs8Eb-HjSmHVCH3l6JYOH-t4F0MqdBoGRDTk_NlbkkB3_OUhPDE3M4wqjHJY-x8nOv6xT5b0ZxjuAUZTAyK5bpfoUyFcQvC0e9pqJDktivlQdtzINuAqBTVcadGmk64wFgwymYCMqXCL4wX6T8qLwbtOo Aug 04 16:34:12.827451 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:34:12.827451 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:34:12.827451 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:34:12.827451 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:34:12.827451 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:34:12.827451 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:34:12.827451 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: ef52da491682466badff61e6601fa812 Aug 04 16:34:12.827451 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-189033534 Aug 04 16:34:12.827451 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader,admin Aug 04 16:34:12.827451 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader,admin Aug 04 16:34:12.829082 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ef52da491682466badff61e6601fa812"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ef52da491682466badff61e6601fa812"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ef52da491682466badff61e6601fa812"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ef52da491682466badff61e6601fa812"}]}] Aug 04 16:34:12.829082 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-189033534 Aug 04 16:34:12.829082 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: ef52da491682466badff61e6601fa812 Aug 04 16:34:12.829082 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-189033534 Aug 04 16:34:12.829082 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-189033534-project-admin Aug 04 16:34:12.829082 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:34:12.829082 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:34:12.829082 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 941dedd308da4bfd9b1af35bb669ec9f Aug 04 16:34:12.829082 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-189033534-project-admin Aug 04 16:34:12.829082 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:34:12.829082 n-d-846466-12 devstack@n-api.service[126126]: exception: No hypervisor matching 'af4b2818-0d1c-471c-a192-4584fd26b0aa' could be found. Aug 04 16:34:12.829082 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'af4b2818-0d1c-471c-a192-4584fd26b0aa'} Aug 04 16:34:12.830009 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:34:12.830009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:12.830009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:12.830009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:12.830009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:34:12.830009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:34:12.830009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:34:12.830009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:34:12.830009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:34:12.830009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:34:12.830009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 04 16:34:12.830009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 04 16:34:12.830009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 04 16:34:12.830009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 16:34:12.830009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'af4b2818-0d1c-471c-a192-4584fd26b0aa' could be found. Aug 04 16:34:12.830009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:12.830009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:12.830009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:12.830009 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:12.831382 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:12.831382 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:12.831382 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:34:12.831382 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:34:12.831382 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'af4b2818-0d1c-471c-a192-4584fd26b0aa' could be found. Aug 04 16:34:12.831382 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:12.831382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4beb03fd-f1fc-4477-97cc-62acfbc1533f tempest-HypervisorAdminNegativeUnderV252Test-189033534 tempest-HypervisorAdminNegativeUnderV252Test-189033534-project-admin] Returning 404 to user: No hypervisor matching 'af4b2818-0d1c-471c-a192-4584fd26b0aa' could be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:34:12.831382 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4beb03fd-f1fc-4477-97cc-62acfbc1533f tempest-HypervisorAdminNegativeUnderV252Test-189033534 tempest-HypervisorAdminNegativeUnderV252Test-189033534-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/af4b2818-0d1c-471c-a192-4584fd26b0aa/servers" status: 404 len: 123 microversion: 2.1 time: 0.031294 Aug 04 16:34:12.831382 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 291/555] 10.222.0.23 () {58 vars in 1281 bytes} [Thu Aug 4 16:34:12 2022] GET /compute/v2.1/os-hypervisors/af4b2818-0d1c-471c-a192-4584fd26b0aa/servers => generated 123 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:34:13.125498 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5ce15d28-8ffd-4e93-8c22-d214ce757d3f tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c73c354a6ee4ab881f483ff65a21dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cb965024d94d7cae0c5652212e7cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:13.137533 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5ce15d28-8ffd-4e93-8c22-d214ce757d3f tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "GET /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33" status: 200 len: 1468 microversion: 2.1 time: 0.627525 Aug 04 16:34:13.138379 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 265/556] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:12 2022] GET /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33 => generated 1468 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:13.192993 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6c8a4f37-56c3-4703-b4a3-d365f73699e1 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:13.193872 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6c8a4f37-56c3-4703-b4a3-d365f73699e1 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: f8497465-98e6-46f0-bd09-11c432c292a1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:13.217749 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c8a4f37-56c3-4703-b4a3-d365f73699e1 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:13.218587 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c8a4f37-56c3-4703-b4a3-d365f73699e1 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:13.219623 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c8a4f37-56c3-4703-b4a3-d365f73699e1 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:13.220232 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c8a4f37-56c3-4703-b4a3-d365f73699e1 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:13.240287 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-344a28c2-9e3c-470e-8056-37e30c5a7285 req-4c2c10fb-53d0-477c-b281-8666f2e6eebe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8497465-98e6-46f0-bd09-11c432c292a1", "tag": "b9b0943e-30ce-4930-b73a-72ae1d9df661"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:13.258057 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=26 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:34:13.260184 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-344a28c2-9e3c-470e-8056-37e30c5a7285 req-4c2c10fb-53d0-477c-b281-8666f2e6eebe service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:13.267581 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-344a28c2-9e3c-470e-8056-37e30c5a7285 req-4c2c10fb-53d0-477c-b281-8666f2e6eebe service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:13.310862 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-344a28c2-9e3c-470e-8056-37e30c5a7285 req-4c2c10fb-53d0-477c-b281-8666f2e6eebe service nova] Creating event network-changed:b9b0943e-30ce-4930-b73a-72ae1d9df661 for instance f8497465-98e6-46f0-bd09-11c432c292a1 on n-h2-846466-12 Aug 04 16:34:13.331218 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-344a28c2-9e3c-470e-8056-37e30c5a7285 req-4c2c10fb-53d0-477c-b281-8666f2e6eebe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094780 Aug 04 16:34:13.332203 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 266/557] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:34:13.530852 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1fa40dce-6145-4355-8a89-d2a85b4fc389 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:13.532177 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1fa40dce-6145-4355-8a89-d2a85b4fc389 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: f23a3c47-f725-4ad2-b88d-b972ff4b2ee9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:13.545905 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1fa40dce-6145-4355-8a89-d2a85b4fc389 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:13.549964 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1fa40dce-6145-4355-8a89-d2a85b4fc389 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:13.551330 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1fa40dce-6145-4355-8a89-d2a85b4fc389 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:13.552078 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1fa40dce-6145-4355-8a89-d2a85b4fc389 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:14.535142 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1fa40dce-6145-4355-8a89-d2a85b4fc389 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:14.551391 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1fa40dce-6145-4355-8a89-d2a85b4fc389 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9" status: 200 len: 1504 microversion: 2.1 time: 1.025046 Aug 04 16:34:14.586612 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 267/558] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:13 2022] GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 => generated 1504 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:34:14.593627 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-ba376569-4640-441f-a231-bcbebe4f4a6a req-9440aaba-7a4c-469d-80dc-a0ced422e871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c494f329-3998-482b-82fd-e1c88c7d4b33", "name": "network-vif-deleted", "tag": "4621cdfc-64dc-4897-9055-91299e52d7f8"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:14.606553 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-ba376569-4640-441f-a231-bcbebe4f4a6a req-9440aaba-7a4c-469d-80dc-a0ced422e871 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:14.608040 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-ba376569-4640-441f-a231-bcbebe4f4a6a req-9440aaba-7a4c-469d-80dc-a0ced422e871 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:14.623015 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-ba376569-4640-441f-a231-bcbebe4f4a6a req-9440aaba-7a4c-469d-80dc-a0ced422e871 service nova] Creating event network-vif-deleted:4621cdfc-64dc-4897-9055-91299e52d7f8 for instance c494f329-3998-482b-82fd-e1c88c7d4b33 on n-h1-846466-12 Aug 04 16:34:14.634787 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-ba376569-4640-441f-a231-bcbebe4f4a6a req-9440aaba-7a4c-469d-80dc-a0ced422e871 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046272 Aug 04 16:34:14.636347 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 268/559] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:14.644071 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8dab73cf-3705-40f4-983e-62cd900695f8 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:14.649171 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8dab73cf-3705-40f4-983e-62cd900695f8 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: c494f329-3998-482b-82fd-e1c88c7d4b33] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:14.659688 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8dab73cf-3705-40f4-983e-62cd900695f8 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:14.661246 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8dab73cf-3705-40f4-983e-62cd900695f8 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:14.662568 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8dab73cf-3705-40f4-983e-62cd900695f8 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:14.663296 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8dab73cf-3705-40f4-983e-62cd900695f8 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:14.696495 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-8dab73cf-3705-40f4-983e-62cd900695f8 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] HTTP exception thrown: Instance c494f329-3998-482b-82fd-e1c88c7d4b33 could not be found. Aug 04 16:34:14.700190 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8dab73cf-3705-40f4-983e-62cd900695f8 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Request method failure captured: Aug 04 16:34:14.700190 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33 HTTP/1.1 Aug 04 16:34:14.700190 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:34:14.700190 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:34:14.700190 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:34:14.700190 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:34:14.700190 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:34:14.700190 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:34:14.700190 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:34:14.700190 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:34:14.700190 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_TL4NFmC0nmZKf9YuULeVR2dlLX7pBa9IzNsG0jub7S8iVVALqmq5h6LVfZnQNfSnde0xJ5KxfP3mVSF1KDdw9_ugZxAZh6kfjk0avIdcvdg45Yi5ERjpaVsHDeAZTEetyzda--86dfrP2_GDCKk50VjwqR3ppCp7G3RKUWglkifz0 Aug 04 16:34:14.700190 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:34:14.700190 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:34:14.700190 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:34:14.700190 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:34:14.700190 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:34:14.700190 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:34:14.700190 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: c9cb965024d94d7cae0c5652212e7cc2 Aug 04 16:34:14.700190 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2146395414 Aug 04 16:34:14.700190 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:34:14.700190 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:34:14.701562 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9cb965024d94d7cae0c5652212e7cc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c9cb965024d94d7cae0c5652212e7cc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9cb965024d94d7cae0c5652212e7cc2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c9cb965024d94d7cae0c5652212e7cc2"}]}] Aug 04 16:34:14.701562 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2146395414 Aug 04 16:34:14.701562 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: c9cb965024d94d7cae0c5652212e7cc2 Aug 04 16:34:14.701562 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2146395414 Aug 04 16:34:14.701562 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersAdminNegativeTestJSON-2146395414-project Aug 04 16:34:14.701562 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:34:14.701562 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:34:14.701562 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 1c73c354a6ee4ab881f483ff65a21dc4 Aug 04 16:34:14.701562 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2146395414-project Aug 04 16:34:14.701562 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:34:14.701562 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance c494f329-3998-482b-82fd-e1c88c7d4b33 could not be found. Aug 04 16:34:14.701562 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'c494f329-3998-482b-82fd-e1c88c7d4b33'} Aug 04 16:34:14.702364 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:34:14.702364 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:14.702364 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:34:14.702364 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:34:14.702364 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:34:14.702364 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:34:14.702364 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:34:14.702364 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:34:14.702364 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:34:14.702364 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:34:14.702364 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c494f329-3998-482b-82fd-e1c88c7d4b33 could not be found. Aug 04 16:34:14.702364 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:14.702364 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:14.702364 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:14.702364 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:14.702364 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:14.702364 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:14.702364 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:34:14.702364 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:34:14.702364 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:34:14.703548 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:34:14.703548 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:34:14.703548 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:34:14.703548 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:34:14.703548 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:34:14.703548 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:34:14.703548 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:34:14.703548 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c494f329-3998-482b-82fd-e1c88c7d4b33 could not be found. Aug 04 16:34:14.703548 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:14.703548 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:14.703548 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:14.703548 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:14.703548 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:14.703548 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:14.703548 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:34:14.703548 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:34:14.703548 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c494f329-3998-482b-82fd-e1c88c7d4b33 could not be found. Aug 04 16:34:14.703548 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:14.708182 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8dab73cf-3705-40f4-983e-62cd900695f8 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Returning 404 to user: Instance c494f329-3998-482b-82fd-e1c88c7d4b33 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:34:14.709359 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8dab73cf-3705-40f4-983e-62cd900695f8 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "GET /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33" status: 404 len: 111 microversion: 2.1 time: 0.070602 Aug 04 16:34:14.712693 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 269/560] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:14 2022] GET /compute/v2.1/servers/c494f329-3998-482b-82fd-e1c88c7d4b33 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:34:14.734486 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-21f23844-0364-4ed0-b73f-5608648a6484 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:14.739686 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-21f23844-0364-4ed0-b73f-5608648a6484 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: 92c85400-67f0-4930-bf61-28770e84b98c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:14.755385 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-21f23844-0364-4ed0-b73f-5608648a6484 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:14.755958 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-21f23844-0364-4ed0-b73f-5608648a6484 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:14.756880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-21f23844-0364-4ed0-b73f-5608648a6484 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:14.757434 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-21f23844-0364-4ed0-b73f-5608648a6484 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:14.801248 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-21f23844-0364-4ed0-b73f-5608648a6484 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: 92c85400-67f0-4930-bf61-28770e84b98c] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:34:14.978927 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-21f23844-0364-4ed0-b73f-5608648a6484 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "DELETE /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c" status: 204 len: 0 microversion: 2.1 time: 0.260669 Aug 04 16:34:14.980339 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 270/561] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:34:14 2022] DELETE /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:34:14.993143 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f50b3581-6417-4b25-b4de-ed8e091d2ced tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:14.994433 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f50b3581-6417-4b25-b4de-ed8e091d2ced tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: 92c85400-67f0-4930-bf61-28770e84b98c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:15.010343 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f50b3581-6417-4b25-b4de-ed8e091d2ced tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:15.011415 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f50b3581-6417-4b25-b4de-ed8e091d2ced tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:15.016438 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f50b3581-6417-4b25-b4de-ed8e091d2ced tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:15.017374 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f50b3581-6417-4b25-b4de-ed8e091d2ced tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:15.049882 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6c8a4f37-56c3-4703-b4a3-d365f73699e1 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a427fb7481d4799a83729910f33b01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd96a8c91974b8ba7919d5349f380ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:15.068251 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6c8a4f37-56c3-4703-b4a3-d365f73699e1 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1" status: 200 len: 1587 microversion: 2.1 time: 1.878957 Aug 04 16:34:15.068851 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 292/562] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:13 2022] GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1 => generated 1587 bytes in 1883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:15.345661 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f50b3581-6417-4b25-b4de-ed8e091d2ced tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c73c354a6ee4ab881f483ff65a21dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cb965024d94d7cae0c5652212e7cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:15.358992 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f50b3581-6417-4b25-b4de-ed8e091d2ced tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c" status: 200 len: 1476 microversion: 2.1 time: 0.368944 Aug 04 16:34:15.360241 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 271/563] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:14 2022] GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c => generated 1476 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:34:15.451589 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-abf61a7e-9ca5-4380-96c3-5b97da0cd168 req-c329920d-1a0d-4501-8224-dd1ae8441aab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23a3c47-f725-4ad2-b88d-b972ff4b2ee9", "name": "network-vif-unplugged", "status": "completed", "tag": "77a7f0dd-2800-4d07-92d9-a10d97d83794"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:15.486814 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-abf61a7e-9ca5-4380-96c3-5b97da0cd168 req-c329920d-1a0d-4501-8224-dd1ae8441aab service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:15.487705 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-abf61a7e-9ca5-4380-96c3-5b97da0cd168 req-c329920d-1a0d-4501-8224-dd1ae8441aab service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:15.519235 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-abf61a7e-9ca5-4380-96c3-5b97da0cd168 req-c329920d-1a0d-4501-8224-dd1ae8441aab service nova] Creating event network-vif-unplugged:77a7f0dd-2800-4d07-92d9-a10d97d83794 for instance f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 on n-h1-846466-12 Aug 04 16:34:15.534353 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-abf61a7e-9ca5-4380-96c3-5b97da0cd168 req-c329920d-1a0d-4501-8224-dd1ae8441aab service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088370 Aug 04 16:34:15.535653 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 293/564] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:15.574516 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7a58f6cf-0107-46f8-9856-80654854f527 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:15.575238 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7a58f6cf-0107-46f8-9856-80654854f527 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: f23a3c47-f725-4ad2-b88d-b972ff4b2ee9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:15.602260 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a58f6cf-0107-46f8-9856-80654854f527 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:15.603003 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a58f6cf-0107-46f8-9856-80654854f527 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:15.606849 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a58f6cf-0107-46f8-9856-80654854f527 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:15.607341 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a58f6cf-0107-46f8-9856-80654854f527 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:16.815826 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5825474a-7f3c-4161-90c6-950888d9a07c tempest-FlavorsV2NegativeTest-1606820891 tempest-FlavorsV2NegativeTest-1606820891-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:16.839233 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5825474a-7f3c-4161-90c6-950888d9a07c tempest-FlavorsV2NegativeTest-1606820891 tempest-FlavorsV2NegativeTest-1606820891-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.697653 Aug 04 16:34:16.853309 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 294/565] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Aug 4 16:34:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:34:16.855162 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fa02efa5-65e1-470d-a498-75b2ffd1b8d7 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:16.864010 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fa02efa5-65e1-470d-a498-75b2ffd1b8d7 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: 92c85400-67f0-4930-bf61-28770e84b98c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:16.878636 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fa02efa5-65e1-470d-a498-75b2ffd1b8d7 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:16.879521 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fa02efa5-65e1-470d-a498-75b2ffd1b8d7 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:16.879810 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fa02efa5-65e1-470d-a498-75b2ffd1b8d7 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:16.884876 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fa02efa5-65e1-470d-a498-75b2ffd1b8d7 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:16.990341 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7a58f6cf-0107-46f8-9856-80654854f527 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:17.003825 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7a58f6cf-0107-46f8-9856-80654854f527 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9" status: 200 len: 1504 microversion: 2.1 time: 1.435119 Aug 04 16:34:17.008258 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 272/566] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:15 2022] GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 => generated 1504 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:17.257767 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-389ceeca-c0d7-4c9c-9f6d-7d1a2ef858ba tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1944330296", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:17.360259 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-389ceeca-c0d7-4c9c-9f6d-7d1a2ef858ba tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] validate_networks() for None {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:34:17.751023 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fa02efa5-65e1-470d-a498-75b2ffd1b8d7 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c73c354a6ee4ab881f483ff65a21dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cb965024d94d7cae0c5652212e7cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:17.773255 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fa02efa5-65e1-470d-a498-75b2ffd1b8d7 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c" status: 200 len: 1476 microversion: 2.1 time: 0.929693 Aug 04 16:34:17.791131 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 295/567] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:16 2022] GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c => generated 1476 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:18.320970 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-389ceeca-c0d7-4c9c-9f6d-7d1a2ef858ba tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:34:18.321581 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-389ceeca-c0d7-4c9c-9f6d-7d1a2ef858ba tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:34:18.322233 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-389ceeca-c0d7-4c9c-9f6d-7d1a2ef858ba tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:34:18.322625 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-389ceeca-c0d7-4c9c-9f6d-7d1a2ef858ba tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:34:18.323040 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-389ceeca-c0d7-4c9c-9f6d-7d1a2ef858ba tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:34:18.343098 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-389ceeca-c0d7-4c9c-9f6d-7d1a2ef858ba tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:18.345988 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-389ceeca-c0d7-4c9c-9f6d-7d1a2ef858ba tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:18.347896 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-389ceeca-c0d7-4c9c-9f6d-7d1a2ef858ba tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:18.351288 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-389ceeca-c0d7-4c9c-9f6d-7d1a2ef858ba tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:18.405505 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-389ceeca-c0d7-4c9c-9f6d-7d1a2ef858ba tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Getting quotas for project 969f99390a91400baf4892e97f12c0c5. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:34:18.418867 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-389ceeca-c0d7-4c9c-9f6d-7d1a2ef858ba tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Getting quotas for user 65b83cb4ac4d4398b1a0ca841f947794 and project 969f99390a91400baf4892e97f12c0c5. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:34:18.455444 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-389ceeca-c0d7-4c9c-9f6d-7d1a2ef858ba tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:34:18.458037 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-389ceeca-c0d7-4c9c-9f6d-7d1a2ef858ba tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] [instance: 703cd64d-197c-4791-944a-7fc4a25acb8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:34:18.616292 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-389ceeca-c0d7-4c9c-9f6d-7d1a2ef858ba tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.528263 Aug 04 16:34:18.622212 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 273/568] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:34:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 16:34:18.647705 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-b3f49759-f9f7-420e-a912-bc08356a714e req-d207afe7-3d5b-4ace-8f08-38ec30a8a62e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92c85400-67f0-4930-bf61-28770e84b98c", "name": "network-vif-deleted", "tag": "39a2a768-1a97-4d6f-ba46-987474d856d5"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:18.676425 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-b3f49759-f9f7-420e-a912-bc08356a714e req-d207afe7-3d5b-4ace-8f08-38ec30a8a62e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:18.676706 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-b3f49759-f9f7-420e-a912-bc08356a714e req-d207afe7-3d5b-4ace-8f08-38ec30a8a62e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:18.699445 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-b3f49759-f9f7-420e-a912-bc08356a714e req-d207afe7-3d5b-4ace-8f08-38ec30a8a62e service nova] Creating event network-vif-deleted:39a2a768-1a97-4d6f-ba46-987474d856d5 for instance 92c85400-67f0-4930-bf61-28770e84b98c on n-h2-846466-12 Aug 04 16:34:18.712000 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-b3f49759-f9f7-420e-a912-bc08356a714e req-d207afe7-3d5b-4ace-8f08-38ec30a8a62e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088278 Aug 04 16:34:18.723475 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 274/569] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:18.728844 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-eec023e5-83e6-4e0e-a5f5-775b0ba868f7 req-64192a70-a326-4b59-8063-067a97d4ca02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f23a3c47-f725-4ad2-b88d-b972ff4b2ee9", "tag": "77a7f0dd-2800-4d07-92d9-a10d97d83794"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:18.739522 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-eec023e5-83e6-4e0e-a5f5-775b0ba868f7 req-64192a70-a326-4b59-8063-067a97d4ca02 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:18.740263 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-eec023e5-83e6-4e0e-a5f5-775b0ba868f7 req-64192a70-a326-4b59-8063-067a97d4ca02 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:18.753898 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-eec023e5-83e6-4e0e-a5f5-775b0ba868f7 req-64192a70-a326-4b59-8063-067a97d4ca02 service nova] Creating event network-changed:77a7f0dd-2800-4d07-92d9-a10d97d83794 for instance f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 on n-h1-846466-12 Aug 04 16:34:18.761275 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-eec023e5-83e6-4e0e-a5f5-775b0ba868f7 req-64192a70-a326-4b59-8063-067a97d4ca02 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036191 Aug 04 16:34:18.762158 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 275/570] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:18.772212 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bf3cdea8-9bb2-4b4b-ab57-90a0464865ff tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:18.773186 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bf3cdea8-9bb2-4b4b-ab57-90a0464865ff tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: f23a3c47-f725-4ad2-b88d-b972ff4b2ee9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:18.781657 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf3cdea8-9bb2-4b4b-ab57-90a0464865ff tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:18.783026 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf3cdea8-9bb2-4b4b-ab57-90a0464865ff tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:18.784001 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf3cdea8-9bb2-4b4b-ab57-90a0464865ff tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:18.787330 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf3cdea8-9bb2-4b4b-ab57-90a0464865ff tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:18.811793 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bea9d629-0f10-44a7-b63a-725e3cb3ae36 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1647342610", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "2ab6e0fe-802f-4938-8f6b-adfd35fddb62"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:18.846925 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:34:18.932388 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=33,nova_cell0:UPDATE=7 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:34:18.955780 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-bea9d629-0f10-44a7-b63a-725e3cb3ae36 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] validate_networks() for [('2ab6e0fe-802f-4938-8f6b-adfd35fddb62', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:34:19.275237 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bf3cdea8-9bb2-4b4b-ab57-90a0464865ff tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:19.287916 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bf3cdea8-9bb2-4b4b-ab57-90a0464865ff tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9" status: 200 len: 1504 microversion: 2.1 time: 0.522664 Aug 04 16:34:19.289387 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 276/571] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:18 2022] GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 => generated 1504 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:19.306213 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-69cbbb84-cda3-40da-aeae-c43ab2058e68 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:19.317476 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-69cbbb84-cda3-40da-aeae-c43ab2058e68 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] [instance: 703cd64d-197c-4791-944a-7fc4a25acb8f] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:19.497134 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-69cbbb84-cda3-40da-aeae-c43ab2058e68 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b83cb4ac4d4398b1a0ca841f947794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969f99390a91400baf4892e97f12c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:19.515057 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-69cbbb84-cda3-40da-aeae-c43ab2058e68 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] 10.222.0.23 "GET /compute/v2.1/servers/703cd64d-197c-4791-944a-7fc4a25acb8f" status: 200 len: 1223 microversion: 2.1 time: 0.222284 Aug 04 16:34:19.517593 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 277/572] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:19 2022] GET /compute/v2.1/servers/703cd64d-197c-4791-944a-7fc4a25acb8f => generated 1223 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:19.537874 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c9556745-b2b7-41a0-9c09-213dbf294056 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:19.538769 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c9556745-b2b7-41a0-9c09-213dbf294056 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] [instance: 92c85400-67f0-4930-bf61-28770e84b98c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:19.554853 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c9556745-b2b7-41a0-9c09-213dbf294056 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:19.555296 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c9556745-b2b7-41a0-9c09-213dbf294056 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:19.556070 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c9556745-b2b7-41a0-9c09-213dbf294056 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:19.556495 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c9556745-b2b7-41a0-9c09-213dbf294056 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:19.599431 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-c9556745-b2b7-41a0-9c09-213dbf294056 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] HTTP exception thrown: Instance 92c85400-67f0-4930-bf61-28770e84b98c could not be found. Aug 04 16:34:19.610967 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c9556745-b2b7-41a0-9c09-213dbf294056 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Request method failure captured: Aug 04 16:34:19.610967 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c HTTP/1.1 Aug 04 16:34:19.610967 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:34:19.610967 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:34:19.610967 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:34:19.610967 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:34:19.610967 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:34:19.610967 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:34:19.610967 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:34:19.610967 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:34:19.610967 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_TL4NFmC0nmZKf9YuULeVR2dlLX7pBa9IzNsG0jub7S8iVVALqmq5h6LVfZnQNfSnde0xJ5KxfP3mVSF1KDdw9_ugZxAZh6kfjk0avIdcvdg45Yi5ERjpaVsHDeAZTEetyzda--86dfrP2_GDCKk50VjwqR3ppCp7G3RKUWglkifz0 Aug 04 16:34:19.610967 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:34:19.610967 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:34:19.610967 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:34:19.610967 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:34:19.610967 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:34:19.610967 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:34:19.610967 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: c9cb965024d94d7cae0c5652212e7cc2 Aug 04 16:34:19.610967 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2146395414 Aug 04 16:34:19.610967 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:34:19.610967 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:34:19.612546 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9cb965024d94d7cae0c5652212e7cc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c9cb965024d94d7cae0c5652212e7cc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9cb965024d94d7cae0c5652212e7cc2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c9cb965024d94d7cae0c5652212e7cc2"}]}] Aug 04 16:34:19.612546 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2146395414 Aug 04 16:34:19.612546 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: c9cb965024d94d7cae0c5652212e7cc2 Aug 04 16:34:19.612546 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2146395414 Aug 04 16:34:19.612546 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersAdminNegativeTestJSON-2146395414-project Aug 04 16:34:19.612546 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:34:19.612546 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:34:19.612546 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 1c73c354a6ee4ab881f483ff65a21dc4 Aug 04 16:34:19.612546 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2146395414-project Aug 04 16:34:19.612546 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:34:19.612546 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 92c85400-67f0-4930-bf61-28770e84b98c could not be found. Aug 04 16:34:19.612546 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '92c85400-67f0-4930-bf61-28770e84b98c'} Aug 04 16:34:19.613812 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:34:19.613812 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:19.613812 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:34:19.613812 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:34:19.613812 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:34:19.613812 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:34:19.613812 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:34:19.613812 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:34:19.613812 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:34:19.613812 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:34:19.613812 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92c85400-67f0-4930-bf61-28770e84b98c could not be found. Aug 04 16:34:19.613812 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:19.613812 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:19.613812 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:19.613812 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:19.613812 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:19.613812 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:19.613812 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:34:19.613812 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:34:19.613812 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:34:19.616042 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:34:19.616042 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:34:19.616042 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:34:19.616042 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:34:19.616042 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:34:19.616042 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:34:19.616042 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:34:19.616042 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92c85400-67f0-4930-bf61-28770e84b98c could not be found. Aug 04 16:34:19.616042 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:19.616042 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:19.616042 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:19.616042 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:19.616042 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:19.616042 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:19.616042 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:34:19.616042 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:34:19.616042 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92c85400-67f0-4930-bf61-28770e84b98c could not be found. Aug 04 16:34:19.616042 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:19.618213 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c9556745-b2b7-41a0-9c09-213dbf294056 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] Returning 404 to user: Instance 92c85400-67f0-4930-bf61-28770e84b98c could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:34:19.618213 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c9556745-b2b7-41a0-9c09-213dbf294056 tempest-ServersAdminNegativeTestJSON-2146395414 tempest-ServersAdminNegativeTestJSON-2146395414-project] 10.222.0.23 "GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c" status: 404 len: 111 microversion: 2.1 time: 0.093611 Aug 04 16:34:19.618213 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 278/573] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:19 2022] GET /compute/v2.1/servers/92c85400-67f0-4930-bf61-28770e84b98c => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:34:19.638184 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4024cb89-f4d3-4c78-b31a-21b9375d6843 tempest-FlavorsV2NegativeTest-1606820891 tempest-FlavorsV2NegativeTest-1606820891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1750839570", "imageRef": "e616fee6-a49d-41b8-966e-93be9577b6df", "flavorRef": "452"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:19.814872 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-4024cb89-f4d3-4c78-b31a-21b9375d6843 tempest-FlavorsV2NegativeTest-1606820891 tempest-FlavorsV2NegativeTest-1606820891-project] validate_networks() for None {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:34:20.417990 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-bea9d629-0f10-44a7-b63a-725e3cb3ae36 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:34:20.418560 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-bea9d629-0f10-44a7-b63a-725e3cb3ae36 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:34:20.418849 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-bea9d629-0f10-44a7-b63a-725e3cb3ae36 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:34:20.419246 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-bea9d629-0f10-44a7-b63a-725e3cb3ae36 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:34:20.419646 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-bea9d629-0f10-44a7-b63a-725e3cb3ae36 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:34:20.435552 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bea9d629-0f10-44a7-b63a-725e3cb3ae36 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:20.442735 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bea9d629-0f10-44a7-b63a-725e3cb3ae36 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:20.443775 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bea9d629-0f10-44a7-b63a-725e3cb3ae36 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:20.444217 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bea9d629-0f10-44a7-b63a-725e3cb3ae36 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:20.444703 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-4024cb89-f4d3-4c78-b31a-21b9375d6843 tempest-FlavorsV2NegativeTest-1606820891 tempest-FlavorsV2NegativeTest-1606820891-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 04 16:34:20.446709 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4024cb89-f4d3-4c78-b31a-21b9375d6843 tempest-FlavorsV2NegativeTest-1606820891 tempest-FlavorsV2NegativeTest-1606820891-project] Request method failure captured: Aug 04 16:34:20.446709 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 16:34:20.446709 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:34:20.446709 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:34:20.446709 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:34:20.446709 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 143 Aug 04 16:34:20.446709 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:34:20.446709 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:34:20.446709 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:34:20.446709 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:34:20.446709 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_UHZNQ7caQbTtqoyFbHF0Y1uAzYUbUmV3LOLZm4Gcuj-FBQyPQ_5YjIwm68S0gcJgo3oGFfNcuUm8rUKUYq869RzNIOG-33WaSMDUbxMwgTCAuWNfbGKuLqpeVX2hskqqFn4uciMlyJKX7-C_J9VK7CUVs5ecwr8JKrreJTUJr_ByU Aug 04 16:34:20.446709 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:34:20.446709 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:34:20.446709 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:34:20.446709 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:34:20.446709 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:34:20.446709 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:34:20.446709 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 5ede22b02ca745de82d44d053db0de26 Aug 04 16:34:20.446709 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-FlavorsV2NegativeTest-1606820891 Aug 04 16:34:20.446709 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:34:20.446709 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:34:20.448190 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5ede22b02ca745de82d44d053db0de26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5ede22b02ca745de82d44d053db0de26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5ede22b02ca745de82d44d053db0de26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5ede22b02ca745de82d44d053db0de26"}]}] Aug 04 16:34:20.448190 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-FlavorsV2NegativeTest-1606820891 Aug 04 16:34:20.448190 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 5ede22b02ca745de82d44d053db0de26 Aug 04 16:34:20.448190 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1606820891 Aug 04 16:34:20.448190 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-FlavorsV2NegativeTest-1606820891-project Aug 04 16:34:20.448190 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:34:20.448190 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:34:20.448190 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 77ccf78fdffd4d4fb0777faa51ffbce0 Aug 04 16:34:20.448190 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-FlavorsV2NegativeTest-1606820891-project Aug 04 16:34:20.448190 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:34:20.448190 n-d-846466-12 devstack@n-api.service[126125]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1750839570", "imageRef": "e616fee6-a49d-41b8-966e-93be9577b6df", "flavorRef": "452"}} Aug 04 16:34:20.448190 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:34:20.449003 n-d-846466-12 devstack@n-api.service[126125]: exception: Flavor's memory is too small for requested image. Aug 04 16:34:20.449003 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1750839570', 'imageRef': 'e616fee6-a49d-41b8-966e-93be9577b6df', 'flavorRef': '452'}}} Aug 04 16:34:20.449003 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:34:20.449003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:20.449003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 04 16:34:20.449003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 04 16:34:20.449003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 04 16:34:20.449003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 04 16:34:20.449003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 04 16:34:20.449003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 04 16:34:20.449003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1007, in _checks_for_create_and_rebuild Aug 04 16:34:20.449003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 04 16:34:20.449003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 671, in _validate_flavor_image Aug 04 16:34:20.449003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 04 16:34:20.449003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 739, in _validate_flavor_image_nostatus Aug 04 16:34:20.449003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 04 16:34:20.449003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 04 16:34:20.449003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:20.449003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:20.449003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:20.450988 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:20.450988 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:20.450988 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:20.450988 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:34:20.450988 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:34:20.450988 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:34:20.450988 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:34:20.450988 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:34:20.450988 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:34:20.450988 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:34:20.450988 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:34:20.450988 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:34:20.450988 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:34:20.450988 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 16:34:20.450988 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 04 16:34:20.450988 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 04 16:34:20.450988 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 04 16:34:20.450988 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:20.450988 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:20.450988 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:20.450988 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:20.453380 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:20.453380 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:20.453380 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:34:20.453380 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:34:20.453380 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 04 16:34:20.453380 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:20.454970 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4024cb89-f4d3-4c78-b31a-21b9375d6843 tempest-FlavorsV2NegativeTest-1606820891 tempest-FlavorsV2NegativeTest-1606820891-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:34:20.456063 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4024cb89-f4d3-4c78-b31a-21b9375d6843 tempest-FlavorsV2NegativeTest-1606820891 tempest-FlavorsV2NegativeTest-1606820891-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.840961 Aug 04 16:34:20.460717 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 279/574] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:34:19 2022] POST /compute/v2.1/servers => generated 93 bytes in 846 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 16:34:20.467094 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b998d8d0-2aaa-42e2-89a5-18569f2deead tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:20.471463 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b998d8d0-2aaa-42e2-89a5-18569f2deead tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: f23a3c47-f725-4ad2-b88d-b972ff4b2ee9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:20.484590 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b998d8d0-2aaa-42e2-89a5-18569f2deead tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:20.491522 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b998d8d0-2aaa-42e2-89a5-18569f2deead tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:20.492705 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b998d8d0-2aaa-42e2-89a5-18569f2deead tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:20.496022 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-bea9d629-0f10-44a7-b63a-725e3cb3ae36 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Getting quotas for project e96e3e6168ec421da0cac9eaa8849255. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:34:20.496393 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b998d8d0-2aaa-42e2-89a5-18569f2deead tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:20.514339 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-bea9d629-0f10-44a7-b63a-725e3cb3ae36 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Getting quotas for user 5bf98871e1344215bd667945e6881320 and project e96e3e6168ec421da0cac9eaa8849255. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:34:20.559918 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bea9d629-0f10-44a7-b63a-725e3cb3ae36 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:34:20.562266 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bea9d629-0f10-44a7-b63a-725e3cb3ae36 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: b61f1675-928c-4591-8213-474c2bc174be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:34:20.690688 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bea9d629-0f10-44a7-b63a-725e3cb3ae36 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.897836 Aug 04 16:34:20.712206 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 296/575] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Aug 4 16:34:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2920 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 16:34:20.746037 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b998d8d0-2aaa-42e2-89a5-18569f2deead tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:20.751769 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-698707c8-938e-4218-aa23-b1a7f50d36bb tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:20.756029 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b998d8d0-2aaa-42e2-89a5-18569f2deead tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9" status: 200 len: 1504 microversion: 2.1 time: 0.292378 Aug 04 16:34:20.756756 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 280/576] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:20 2022] GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 => generated 1504 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:20.757364 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-698707c8-938e-4218-aa23-b1a7f50d36bb tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] [instance: 703cd64d-197c-4791-944a-7fc4a25acb8f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:20.785140 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fe76f46a-9554-4773-8682-b42ca08545e7 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:20.785862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fe76f46a-9554-4773-8682-b42ca08545e7 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: b61f1675-928c-4591-8213-474c2bc174be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:20.797696 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-698707c8-938e-4218-aa23-b1a7f50d36bb tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:20.798141 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-698707c8-938e-4218-aa23-b1a7f50d36bb tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:20.798921 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-698707c8-938e-4218-aa23-b1a7f50d36bb tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:20.799353 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-698707c8-938e-4218-aa23-b1a7f50d36bb tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:21.806419 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fe76f46a-9554-4773-8682-b42ca08545e7 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:21.820586 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fe76f46a-9554-4773-8682-b42ca08545e7 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:21.829867 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fe76f46a-9554-4773-8682-b42ca08545e7 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:21.835121 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fe76f46a-9554-4773-8682-b42ca08545e7 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be" status: 200 len: 1262 microversion: 2.25 time: 1.076596 Aug 04 16:34:21.838728 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 281/577] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:34:20 2022] GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be => generated 1262 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:34:21.859957 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-42911bb6-e489-45d3-a4cc-cb23de2520f2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:21.863093 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-42911bb6-e489-45d3-a4cc-cb23de2520f2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: f23a3c47-f725-4ad2-b88d-b972ff4b2ee9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:21.866770 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-698707c8-938e-4218-aa23-b1a7f50d36bb tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b83cb4ac4d4398b1a0ca841f947794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969f99390a91400baf4892e97f12c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:21.876287 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-698707c8-938e-4218-aa23-b1a7f50d36bb tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] 10.222.0.23 "GET /compute/v2.1/servers/703cd64d-197c-4791-944a-7fc4a25acb8f" status: 200 len: 1293 microversion: 2.1 time: 1.162587 Aug 04 16:34:21.882584 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 297/578] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:20 2022] GET /compute/v2.1/servers/703cd64d-197c-4791-944a-7fc4a25acb8f => generated 1293 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:21.902445 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-42911bb6-e489-45d3-a4cc-cb23de2520f2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:21.903046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-42911bb6-e489-45d3-a4cc-cb23de2520f2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:21.903885 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-42911bb6-e489-45d3-a4cc-cb23de2520f2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:21.906951 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-42911bb6-e489-45d3-a4cc-cb23de2520f2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:22.505628 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-42911bb6-e489-45d3-a4cc-cb23de2520f2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:22.516796 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-42911bb6-e489-45d3-a4cc-cb23de2520f2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9" status: 200 len: 1504 microversion: 2.1 time: 0.674118 Aug 04 16:34:22.516894 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 282/579] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:21 2022] GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 => generated 1504 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:22.864422 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-03187f60-41ef-4dc5-8f30-29fba43e223b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:22.865090 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-03187f60-41ef-4dc5-8f30-29fba43e223b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: b61f1675-928c-4591-8213-474c2bc174be] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:22.867317 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=13,nova_api:INSERT=8 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:34:22.885131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03187f60-41ef-4dc5-8f30-29fba43e223b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:22.892825 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03187f60-41ef-4dc5-8f30-29fba43e223b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:22.896144 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03187f60-41ef-4dc5-8f30-29fba43e223b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:22.897922 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03187f60-41ef-4dc5-8f30-29fba43e223b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:22.908465 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d081eac0-d800-48dd-80d8-4a1180830752 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:22.910090 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d081eac0-d800-48dd-80d8-4a1180830752 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] [instance: 703cd64d-197c-4791-944a-7fc4a25acb8f] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:22.924831 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d081eac0-d800-48dd-80d8-4a1180830752 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:22.926913 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d081eac0-d800-48dd-80d8-4a1180830752 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:22.932685 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d081eac0-d800-48dd-80d8-4a1180830752 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:22.933412 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d081eac0-d800-48dd-80d8-4a1180830752 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:23.219813 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d081eac0-d800-48dd-80d8-4a1180830752 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b83cb4ac4d4398b1a0ca841f947794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969f99390a91400baf4892e97f12c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:23.234770 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d081eac0-d800-48dd-80d8-4a1180830752 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] 10.222.0.23 "GET /compute/v2.1/servers/703cd64d-197c-4791-944a-7fc4a25acb8f" status: 200 len: 1281 microversion: 2.1 time: 0.329029 Aug 04 16:34:23.237494 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 283/580] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:22 2022] GET /compute/v2.1/servers/703cd64d-197c-4791-944a-7fc4a25acb8f => generated 1281 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:34:23.333254 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-03187f60-41ef-4dc5-8f30-29fba43e223b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:23.357516 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-03187f60-41ef-4dc5-8f30-29fba43e223b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:23.361353 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-03187f60-41ef-4dc5-8f30-29fba43e223b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:23.366727 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-03187f60-41ef-4dc5-8f30-29fba43e223b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be" status: 200 len: 1322 microversion: 2.25 time: 0.507908 Aug 04 16:34:23.373076 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 298/581] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:34:22 2022] GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be => generated 1322 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:34:23.537943 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ef16beb6-131f-486e-bca7-8498b63bdf9e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:23.538953 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ef16beb6-131f-486e-bca7-8498b63bdf9e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: f23a3c47-f725-4ad2-b88d-b972ff4b2ee9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:23.554102 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ef16beb6-131f-486e-bca7-8498b63bdf9e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:23.557207 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ef16beb6-131f-486e-bca7-8498b63bdf9e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:23.558358 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ef16beb6-131f-486e-bca7-8498b63bdf9e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:23.561709 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ef16beb6-131f-486e-bca7-8498b63bdf9e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:23.718514 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0a886ec4-4c3f-4f5c-8cc3-029c39b5a07b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-267365267", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:23.819437 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-0a886ec4-4c3f-4f5c-8cc3-029c39b5a07b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] validate_networks() for None {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:34:24.527507 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ef16beb6-131f-486e-bca7-8498b63bdf9e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:24.539215 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ef16beb6-131f-486e-bca7-8498b63bdf9e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9" status: 200 len: 1504 microversion: 2.1 time: 1.006802 Aug 04 16:34:24.540537 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 299/582] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:23 2022] GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 => generated 1504 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:34:24.555090 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-348c864b-676b-41c6-bdc8-55e9ddc9047a tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:24.556164 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-348c864b-676b-41c6-bdc8-55e9ddc9047a tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] [instance: 703cd64d-197c-4791-944a-7fc4a25acb8f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:24.573348 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-348c864b-676b-41c6-bdc8-55e9ddc9047a tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:24.578038 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-348c864b-676b-41c6-bdc8-55e9ddc9047a tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:24.581088 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-348c864b-676b-41c6-bdc8-55e9ddc9047a tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:24.581797 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-348c864b-676b-41c6-bdc8-55e9ddc9047a tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:24.619875 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:34:25.229239 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-348c864b-676b-41c6-bdc8-55e9ddc9047a tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b83cb4ac4d4398b1a0ca841f947794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969f99390a91400baf4892e97f12c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:25.241110 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-348c864b-676b-41c6-bdc8-55e9ddc9047a tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] 10.222.0.23 "GET /compute/v2.1/servers/703cd64d-197c-4791-944a-7fc4a25acb8f" status: 200 len: 1323 microversion: 2.1 time: 0.699241 Aug 04 16:34:25.244773 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-0a886ec4-4c3f-4f5c-8cc3-029c39b5a07b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:34:25.245984 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-0a886ec4-4c3f-4f5c-8cc3-029c39b5a07b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:34:25.246697 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-0a886ec4-4c3f-4f5c-8cc3-029c39b5a07b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:34:25.247289 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-0a886ec4-4c3f-4f5c-8cc3-029c39b5a07b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:34:25.247942 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-0a886ec4-4c3f-4f5c-8cc3-029c39b5a07b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:34:25.250319 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:34:25.255517 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 300/583] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:24 2022] GET /compute/v2.1/servers/703cd64d-197c-4791-944a-7fc4a25acb8f => generated 1323 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:25.268124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7b6012cd-3e75-4bb3-88a6-108f37112135 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:25.268979 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7b6012cd-3e75-4bb3-88a6-108f37112135 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: b61f1675-928c-4591-8213-474c2bc174be] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:25.273844 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0a886ec4-4c3f-4f5c-8cc3-029c39b5a07b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:25.274380 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0a886ec4-4c3f-4f5c-8cc3-029c39b5a07b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:25.275274 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0a886ec4-4c3f-4f5c-8cc3-029c39b5a07b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:25.275699 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0a886ec4-4c3f-4f5c-8cc3-029c39b5a07b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:25.283243 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b6012cd-3e75-4bb3-88a6-108f37112135 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:25.283940 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b6012cd-3e75-4bb3-88a6-108f37112135 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:25.285020 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b6012cd-3e75-4bb3-88a6-108f37112135 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:25.289240 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b6012cd-3e75-4bb3-88a6-108f37112135 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:25.341704 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-0a886ec4-4c3f-4f5c-8cc3-029c39b5a07b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Getting quotas for project c456fd996bb544478bdb39c6a7ca04a6. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:34:25.352658 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-0a886ec4-4c3f-4f5c-8cc3-029c39b5a07b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Getting quotas for user 6e582cea96b64285b4232b96162a274c and project c456fd996bb544478bdb39c6a7ca04a6. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:34:25.390255 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0a886ec4-4c3f-4f5c-8cc3-029c39b5a07b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:34:25.392416 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0a886ec4-4c3f-4f5c-8cc3-029c39b5a07b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:34:25.479433 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0a886ec4-4c3f-4f5c-8cc3-029c39b5a07b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.074771 Aug 04 16:34:25.484748 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 284/584] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:34:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2081 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:34:25.490546 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-1ed89248-8bf5-4ae1-830b-07599996adae req-c8932c33-6857-4c07-96e7-152c2168705a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "703cd64d-197c-4791-944a-7fc4a25acb8f", "tag": "28c7bd54-5c48-49be-a7f2-a3c50f2a045d"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:25.502875 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-1ed89248-8bf5-4ae1-830b-07599996adae req-c8932c33-6857-4c07-96e7-152c2168705a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:25.503679 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-1ed89248-8bf5-4ae1-830b-07599996adae req-c8932c33-6857-4c07-96e7-152c2168705a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:25.549340 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-1ed89248-8bf5-4ae1-830b-07599996adae req-c8932c33-6857-4c07-96e7-152c2168705a service nova] Creating event network-changed:28c7bd54-5c48-49be-a7f2-a3c50f2a045d for instance 703cd64d-197c-4791-944a-7fc4a25acb8f on n-h1-846466-12 Aug 04 16:34:25.556667 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-1ed89248-8bf5-4ae1-830b-07599996adae req-c8932c33-6857-4c07-96e7-152c2168705a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069472 Aug 04 16:34:25.560326 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 285/585] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:25.570684 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-91f7e21f-dc2b-427d-9e3f-89eacb9766de tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:25.571702 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-91f7e21f-dc2b-427d-9e3f-89eacb9766de tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:25.940295 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7b6012cd-3e75-4bb3-88a6-108f37112135 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:25.956529 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7b6012cd-3e75-4bb3-88a6-108f37112135 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:25.960977 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7b6012cd-3e75-4bb3-88a6-108f37112135 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:25.960977 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7b6012cd-3e75-4bb3-88a6-108f37112135 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be" status: 200 len: 1320 microversion: 2.25 time: 0.702768 Aug 04 16:34:25.960977 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 301/586] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:34:25 2022] GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be => generated 1320 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:34:25.975389 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0aab41a4-4047-404f-a465-df26fc26e545 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:25.976105 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0aab41a4-4047-404f-a465-df26fc26e545 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: f23a3c47-f725-4ad2-b88d-b972ff4b2ee9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:25.992945 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0aab41a4-4047-404f-a465-df26fc26e545 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:25.993439 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0aab41a4-4047-404f-a465-df26fc26e545 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:25.994700 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0aab41a4-4047-404f-a465-df26fc26e545 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:25.995141 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0aab41a4-4047-404f-a465-df26fc26e545 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:26.043838 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-91f7e21f-dc2b-427d-9e3f-89eacb9766de tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:26.063594 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-91f7e21f-dc2b-427d-9e3f-89eacb9766de tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1212 microversion: 2.1 time: 0.501066 Aug 04 16:34:26.064193 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 286/587] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:25 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1212 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:26.282046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5e8a9bf7-88db-432b-a436-98232a688268 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:26.282761 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5e8a9bf7-88db-432b-a436-98232a688268 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] [instance: 703cd64d-197c-4791-944a-7fc4a25acb8f] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:26.301876 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5e8a9bf7-88db-432b-a436-98232a688268 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:26.302349 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5e8a9bf7-88db-432b-a436-98232a688268 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:26.303188 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5e8a9bf7-88db-432b-a436-98232a688268 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:26.303611 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5e8a9bf7-88db-432b-a436-98232a688268 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:26.782440 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0aab41a4-4047-404f-a465-df26fc26e545 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:26.802701 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0aab41a4-4047-404f-a465-df26fc26e545 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9" status: 200 len: 1504 microversion: 2.1 time: 0.841090 Aug 04 16:34:26.804266 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 302/588] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:25 2022] GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 => generated 1504 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:26.981702 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5e8a9bf7-88db-432b-a436-98232a688268 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b83cb4ac4d4398b1a0ca841f947794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969f99390a91400baf4892e97f12c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:26.998175 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5e8a9bf7-88db-432b-a436-98232a688268 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] 10.222.0.23 "GET /compute/v2.1/servers/703cd64d-197c-4791-944a-7fc4a25acb8f" status: 200 len: 1323 microversion: 2.1 time: 0.735843 Aug 04 16:34:27.002572 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 287/589] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:26 2022] GET /compute/v2.1/servers/703cd64d-197c-4791-944a-7fc4a25acb8f => generated 1323 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:34:27.018454 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3d13c2d2-8939-49b7-ad92-1a147b9723f1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:27.019145 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3d13c2d2-8939-49b7-ad92-1a147b9723f1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: b61f1675-928c-4591-8213-474c2bc174be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:27.031561 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3d13c2d2-8939-49b7-ad92-1a147b9723f1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:27.032008 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3d13c2d2-8939-49b7-ad92-1a147b9723f1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:27.034899 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3d13c2d2-8939-49b7-ad92-1a147b9723f1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:27.035389 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3d13c2d2-8939-49b7-ad92-1a147b9723f1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:27.123714 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c9fe9b31-4259-49ec-abdd-9d863071f7ac tempest-ServicesAdminTestJSON-1015780673 tempest-ServicesAdminTestJSON-1015780673-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:27.128024 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:34:27.128024 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:34:27.129968 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9fe9b31-4259-49ec-abdd-9d863071f7ac tempest-ServicesAdminTestJSON-1015780673 tempest-ServicesAdminTestJSON-1015780673-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:27.130669 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9fe9b31-4259-49ec-abdd-9d863071f7ac tempest-ServicesAdminTestJSON-1015780673 tempest-ServicesAdminTestJSON-1015780673-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:27.131630 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9fe9b31-4259-49ec-abdd-9d863071f7ac tempest-ServicesAdminTestJSON-1015780673 tempest-ServicesAdminTestJSON-1015780673-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:27.132205 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9fe9b31-4259-49ec-abdd-9d863071f7ac tempest-ServicesAdminTestJSON-1015780673 tempest-ServicesAdminTestJSON-1015780673-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:27.188570 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3d13c2d2-8939-49b7-ad92-1a147b9723f1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:27.190158 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c9fe9b31-4259-49ec-abdd-9d863071f7ac tempest-ServicesAdminTestJSON-1015780673 tempest-ServicesAdminTestJSON-1015780673-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.354331 Aug 04 16:34:27.191072 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 303/590] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Aug 4 16:34:26 2022] GET /compute/v2.1/os-services => generated 949 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:27.197247 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0824be8f-ff5a-4c56-8934-f88ee4ac234c tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:27.198250 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0824be8f-ff5a-4c56-8934-f88ee4ac234c tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:27.206049 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0824be8f-ff5a-4c56-8934-f88ee4ac234c tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:27.208497 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0824be8f-ff5a-4c56-8934-f88ee4ac234c tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:27.208624 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3d13c2d2-8939-49b7-ad92-1a147b9723f1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:27.209708 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0824be8f-ff5a-4c56-8934-f88ee4ac234c tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:27.210111 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3d13c2d2-8939-49b7-ad92-1a147b9723f1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:27.210620 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0824be8f-ff5a-4c56-8934-f88ee4ac234c tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:27.211252 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3d13c2d2-8939-49b7-ad92-1a147b9723f1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be" status: 200 len: 1320 microversion: 2.25 time: 0.206938 Aug 04 16:34:27.211819 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 288/591] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:34:27 2022] GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be => generated 1320 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:34:27.229072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4f065550-adbe-4814-a091-d2ed6723780e tempest-ServicesAdminTestJSON-1015780673 tempest-ServicesAdminTestJSON-1015780673-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:27.231862 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:34:27.231862 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:34:27.233124 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4f065550-adbe-4814-a091-d2ed6723780e tempest-ServicesAdminTestJSON-1015780673 tempest-ServicesAdminTestJSON-1015780673-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:27.233616 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4f065550-adbe-4814-a091-d2ed6723780e tempest-ServicesAdminTestJSON-1015780673 tempest-ServicesAdminTestJSON-1015780673-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:27.234417 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4f065550-adbe-4814-a091-d2ed6723780e tempest-ServicesAdminTestJSON-1015780673 tempest-ServicesAdminTestJSON-1015780673-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:27.234917 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4f065550-adbe-4814-a091-d2ed6723780e tempest-ServicesAdminTestJSON-1015780673 tempest-ServicesAdminTestJSON-1015780673-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:27.294363 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4f065550-adbe-4814-a091-d2ed6723780e tempest-ServicesAdminTestJSON-1015780673 tempest-ServicesAdminTestJSON-1015780673-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=n-d-846466-12" status: 200 len: 581 microversion: 2.1 time: 0.081468 Aug 04 16:34:27.308571 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 289/592] 10.222.0.23 () {58 vars in 1174 bytes} [Thu Aug 4 16:34:27 2022] GET /compute/v2.1/os-services?host=n-d-846466-12 => generated 581 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:27.319045 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cf5f56cf-a106-4544-8a13-81dc636a57d7 tempest-ServicesAdminTestJSON-1015780673 tempest-ServicesAdminTestJSON-1015780673-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:27.325910 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:34:27.325910 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:34:27.331366 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cf5f56cf-a106-4544-8a13-81dc636a57d7 tempest-ServicesAdminTestJSON-1015780673 tempest-ServicesAdminTestJSON-1015780673-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:27.332246 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cf5f56cf-a106-4544-8a13-81dc636a57d7 tempest-ServicesAdminTestJSON-1015780673 tempest-ServicesAdminTestJSON-1015780673-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:27.346260 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cf5f56cf-a106-4544-8a13-81dc636a57d7 tempest-ServicesAdminTestJSON-1015780673 tempest-ServicesAdminTestJSON-1015780673-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:27.348343 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cf5f56cf-a106-4544-8a13-81dc636a57d7 tempest-ServicesAdminTestJSON-1015780673 tempest-ServicesAdminTestJSON-1015780673-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:27.404752 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0824be8f-ff5a-4c56-8934-f88ee4ac234c tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:27.413299 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0824be8f-ff5a-4c56-8934-f88ee4ac234c tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1264 microversion: 2.1 time: 0.220422 Aug 04 16:34:27.413591 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 304/593] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:27 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1264 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:27.433614 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cf5f56cf-a106-4544-8a13-81dc636a57d7 tempest-ServicesAdminTestJSON-1015780673 tempest-ServicesAdminTestJSON-1015780673-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.123158 Aug 04 16:34:27.444995 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 290/594] 10.222.0.23 () {58 vars in 1176 bytes} [Thu Aug 4 16:34:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:27.457614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ffecc477-c5db-4130-8a21-a7a4cb28217d tempest-ServicesAdminTestJSON-1015780673 tempest-ServicesAdminTestJSON-1015780673-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:27.460549 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:34:27.460549 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:34:27.462146 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ffecc477-c5db-4130-8a21-a7a4cb28217d tempest-ServicesAdminTestJSON-1015780673 tempest-ServicesAdminTestJSON-1015780673-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:27.462588 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ffecc477-c5db-4130-8a21-a7a4cb28217d tempest-ServicesAdminTestJSON-1015780673 tempest-ServicesAdminTestJSON-1015780673-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:27.463399 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ffecc477-c5db-4130-8a21-a7a4cb28217d tempest-ServicesAdminTestJSON-1015780673 tempest-ServicesAdminTestJSON-1015780673-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:27.463829 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ffecc477-c5db-4130-8a21-a7a4cb28217d tempest-ServicesAdminTestJSON-1015780673 tempest-ServicesAdminTestJSON-1015780673-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:27.520646 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ffecc477-c5db-4130-8a21-a7a4cb28217d tempest-ServicesAdminTestJSON-1015780673 tempest-ServicesAdminTestJSON-1015780673-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.066878 Aug 04 16:34:27.521261 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 305/595] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Aug 4 16:34:27 2022] GET /compute/v2.1/os-services => generated 949 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:27.834249 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ab115578-728a-4a98-8e5c-1f5bbc128e12 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:27.834857 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ab115578-728a-4a98-8e5c-1f5bbc128e12 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: f23a3c47-f725-4ad2-b88d-b972ff4b2ee9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:27.846821 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab115578-728a-4a98-8e5c-1f5bbc128e12 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:27.847376 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab115578-728a-4a98-8e5c-1f5bbc128e12 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:27.850546 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab115578-728a-4a98-8e5c-1f5bbc128e12 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:27.851071 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab115578-728a-4a98-8e5c-1f5bbc128e12 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:28.022256 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e8e7653a-0221-4845-9de4-2d85ffab6b31 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:28.022856 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e8e7653a-0221-4845-9de4-2d85ffab6b31 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] [instance: 703cd64d-197c-4791-944a-7fc4a25acb8f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:28.035825 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e8e7653a-0221-4845-9de4-2d85ffab6b31 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:28.036242 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e8e7653a-0221-4845-9de4-2d85ffab6b31 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:28.037198 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e8e7653a-0221-4845-9de4-2d85ffab6b31 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:28.037650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e8e7653a-0221-4845-9de4-2d85ffab6b31 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:28.356176 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ab115578-728a-4a98-8e5c-1f5bbc128e12 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:28.367220 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ab115578-728a-4a98-8e5c-1f5bbc128e12 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9" status: 200 len: 1504 microversion: 2.1 time: 0.537728 Aug 04 16:34:28.368444 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 291/596] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:27 2022] GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 => generated 1504 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:28.374885 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fa4eb259-6b0b-4611-993f-c323e850985f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:28.375620 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fa4eb259-6b0b-4611-993f-c323e850985f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: b61f1675-928c-4591-8213-474c2bc174be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:28.383601 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fa4eb259-6b0b-4611-993f-c323e850985f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:28.384513 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fa4eb259-6b0b-4611-993f-c323e850985f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:28.386783 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fa4eb259-6b0b-4611-993f-c323e850985f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:28.387460 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fa4eb259-6b0b-4611-993f-c323e850985f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:28.649783 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e8e7653a-0221-4845-9de4-2d85ffab6b31 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b83cb4ac4d4398b1a0ca841f947794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969f99390a91400baf4892e97f12c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:28.662778 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e8e7653a-0221-4845-9de4-2d85ffab6b31 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] 10.222.0.23 "GET /compute/v2.1/servers/703cd64d-197c-4791-944a-7fc4a25acb8f" status: 200 len: 1323 microversion: 2.1 time: 0.644326 Aug 04 16:34:28.673151 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 306/597] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:28 2022] GET /compute/v2.1/servers/703cd64d-197c-4791-944a-7fc4a25acb8f => generated 1323 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:34:28.690663 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-434e23e3-d9bc-4c38-bcf3-b31b678f0f0f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:28.695968 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-434e23e3-d9bc-4c38-bcf3-b31b678f0f0f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:28.713645 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-434e23e3-d9bc-4c38-bcf3-b31b678f0f0f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:28.714426 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-434e23e3-d9bc-4c38-bcf3-b31b678f0f0f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:28.716411 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-434e23e3-d9bc-4c38-bcf3-b31b678f0f0f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:28.717084 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-434e23e3-d9bc-4c38-bcf3-b31b678f0f0f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:28.983848 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-434e23e3-d9bc-4c38-bcf3-b31b678f0f0f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:29.006304 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-434e23e3-d9bc-4c38-bcf3-b31b678f0f0f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1270 microversion: 2.1 time: 0.324965 Aug 04 16:34:29.033419 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 307/598] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:28 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1270 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:29.057560 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-07039d3c-a7e2-4b62-abf9-c7cff0d03a48 req-d74936d0-80fb-4bf0-98a4-db618cc7022e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "703cd64d-197c-4791-944a-7fc4a25acb8f", "name": "network-vif-plugged", "status": "completed", "tag": "28c7bd54-5c48-49be-a7f2-a3c50f2a045d"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:29.070513 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-07039d3c-a7e2-4b62-abf9-c7cff0d03a48 req-d74936d0-80fb-4bf0-98a4-db618cc7022e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:29.071116 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-07039d3c-a7e2-4b62-abf9-c7cff0d03a48 req-d74936d0-80fb-4bf0-98a4-db618cc7022e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:29.087242 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fa4eb259-6b0b-4611-993f-c323e850985f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:29.091082 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-07039d3c-a7e2-4b62-abf9-c7cff0d03a48 req-d74936d0-80fb-4bf0-98a4-db618cc7022e service nova] Creating event network-vif-plugged:28c7bd54-5c48-49be-a7f2-a3c50f2a045d for instance 703cd64d-197c-4791-944a-7fc4a25acb8f on n-h1-846466-12 Aug 04 16:34:29.096424 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-07039d3c-a7e2-4b62-abf9-c7cff0d03a48 req-d74936d0-80fb-4bf0-98a4-db618cc7022e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045283 Aug 04 16:34:29.096671 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fa4eb259-6b0b-4611-993f-c323e850985f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:29.098413 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fa4eb259-6b0b-4611-993f-c323e850985f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:29.100040 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 308/599] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:29.107245 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fa4eb259-6b0b-4611-993f-c323e850985f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be" status: 200 len: 1362 microversion: 2.25 time: 0.737317 Aug 04 16:34:29.122175 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 292/600] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:34:28 2022] GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be => generated 1362 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:34:29.389482 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1f5803b0-550d-468c-a433-196aac436256 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:29.392513 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1f5803b0-550d-468c-a433-196aac436256 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: f23a3c47-f725-4ad2-b88d-b972ff4b2ee9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:29.400053 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1f5803b0-550d-468c-a433-196aac436256 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:29.400524 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1f5803b0-550d-468c-a433-196aac436256 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:29.401367 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1f5803b0-550d-468c-a433-196aac436256 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:29.402295 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1f5803b0-550d-468c-a433-196aac436256 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:29.693970 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ef22529f-dccc-4177-95bb-870818fb1f15 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:29.695256 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ef22529f-dccc-4177-95bb-870818fb1f15 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] [instance: 703cd64d-197c-4791-944a-7fc4a25acb8f] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:29.702507 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef22529f-dccc-4177-95bb-870818fb1f15 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:29.703009 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef22529f-dccc-4177-95bb-870818fb1f15 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:29.704150 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef22529f-dccc-4177-95bb-870818fb1f15 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:29.705071 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef22529f-dccc-4177-95bb-870818fb1f15 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:30.536614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:34:30.620300 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ef22529f-dccc-4177-95bb-870818fb1f15 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b83cb4ac4d4398b1a0ca841f947794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969f99390a91400baf4892e97f12c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:30.635208 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ef22529f-dccc-4177-95bb-870818fb1f15 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] 10.222.0.23 "GET /compute/v2.1/servers/703cd64d-197c-4791-944a-7fc4a25acb8f" status: 200 len: 1323 microversion: 2.1 time: 0.945234 Aug 04 16:34:30.639604 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 293/601] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:29 2022] GET /compute/v2.1/servers/703cd64d-197c-4791-944a-7fc4a25acb8f => generated 1323 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:30.646586 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-312883c3-1b08-43cf-b23a-b817b2312d01 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:30.647469 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-312883c3-1b08-43cf-b23a-b817b2312d01 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:30.656869 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-312883c3-1b08-43cf-b23a-b817b2312d01 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:30.657665 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-312883c3-1b08-43cf-b23a-b817b2312d01 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:30.658635 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-312883c3-1b08-43cf-b23a-b817b2312d01 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:30.659224 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-312883c3-1b08-43cf-b23a-b817b2312d01 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:30.711567 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1f5803b0-550d-468c-a433-196aac436256 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:30.720761 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1f5803b0-550d-468c-a433-196aac436256 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9" status: 200 len: 1504 microversion: 2.1 time: 1.335486 Aug 04 16:34:30.721382 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 309/602] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:29 2022] GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 => generated 1504 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:30.727353 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fc8bb170-2221-4c3e-8a63-86ebba54f91a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:30.728230 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fc8bb170-2221-4c3e-8a63-86ebba54f91a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: b61f1675-928c-4591-8213-474c2bc174be] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:30.735036 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fc8bb170-2221-4c3e-8a63-86ebba54f91a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:30.735826 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fc8bb170-2221-4c3e-8a63-86ebba54f91a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:30.736851 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fc8bb170-2221-4c3e-8a63-86ebba54f91a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:30.738294 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fc8bb170-2221-4c3e-8a63-86ebba54f91a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:30.821769 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-312883c3-1b08-43cf-b23a-b817b2312d01 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:30.834583 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-312883c3-1b08-43cf-b23a-b817b2312d01 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1270 microversion: 2.1 time: 0.192106 Aug 04 16:34:30.838119 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 294/603] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:30 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1270 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:31.403618 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fc8bb170-2221-4c3e-8a63-86ebba54f91a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:31.415862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-61067dc3-b9ac-4639-832d-4708781f36dd tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1372260121", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "ce185855-ad88-40d0-ad8d-f7db4d7f58b9"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:31.416325 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fc8bb170-2221-4c3e-8a63-86ebba54f91a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:31.420995 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fc8bb170-2221-4c3e-8a63-86ebba54f91a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:31.426418 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fc8bb170-2221-4c3e-8a63-86ebba54f91a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be" status: 200 len: 1362 microversion: 2.25 time: 0.702346 Aug 04 16:34:31.429122 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 310/604] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:34:30 2022] GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be => generated 1362 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:34:31.489200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-61067dc3-b9ac-4639-832d-4708781f36dd tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] validate_networks() for [('ce185855-ad88-40d0-ad8d-f7db4d7f58b9', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:34:31.660876 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ea5039a6-8a32-4c29-b6ce-7480b3fb6758 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:31.661576 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ea5039a6-8a32-4c29-b6ce-7480b3fb6758 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] [instance: 703cd64d-197c-4791-944a-7fc4a25acb8f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:31.672827 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea5039a6-8a32-4c29-b6ce-7480b3fb6758 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:31.673850 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea5039a6-8a32-4c29-b6ce-7480b3fb6758 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:31.675850 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea5039a6-8a32-4c29-b6ce-7480b3fb6758 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:31.677888 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea5039a6-8a32-4c29-b6ce-7480b3fb6758 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:32.782481 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ea5039a6-8a32-4c29-b6ce-7480b3fb6758 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b83cb4ac4d4398b1a0ca841f947794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969f99390a91400baf4892e97f12c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:32.793084 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ea5039a6-8a32-4c29-b6ce-7480b3fb6758 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] 10.222.0.23 "GET /compute/v2.1/servers/703cd64d-197c-4791-944a-7fc4a25acb8f" status: 200 len: 1473 microversion: 2.1 time: 1.136549 Aug 04 16:34:32.805309 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 311/605] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:31 2022] GET /compute/v2.1/servers/703cd64d-197c-4791-944a-7fc4a25acb8f => generated 1473 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:34:32.805309 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-f8252ac8-722b-4512-be3c-061bba6e92ae req-7c7c9811-b358-444d-b543-0eb90a39affd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b61f1675-928c-4591-8213-474c2bc174be", "tag": "c6da17eb-62d8-4f32-b0fd-b4686bc2423e"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:32.815687 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f8252ac8-722b-4512-be3c-061bba6e92ae req-7c7c9811-b358-444d-b543-0eb90a39affd service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:32.816116 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f8252ac8-722b-4512-be3c-061bba6e92ae req-7c7c9811-b358-444d-b543-0eb90a39affd service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:32.828569 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-f8252ac8-722b-4512-be3c-061bba6e92ae req-7c7c9811-b358-444d-b543-0eb90a39affd service nova] Creating event network-changed:c6da17eb-62d8-4f32-b0fd-b4686bc2423e for instance b61f1675-928c-4591-8213-474c2bc174be on n-h2-846466-12 Aug 04 16:34:32.834565 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-f8252ac8-722b-4512-be3c-061bba6e92ae req-7c7c9811-b358-444d-b543-0eb90a39affd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035217 Aug 04 16:34:32.835545 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 312/606] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:32.847418 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6eda8aa6-b5d3-4a8e-bfef-c87f3eb64888 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:32.849946 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6eda8aa6-b5d3-4a8e-bfef-c87f3eb64888 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: f23a3c47-f725-4ad2-b88d-b972ff4b2ee9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:32.857885 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6eda8aa6-b5d3-4a8e-bfef-c87f3eb64888 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:32.858356 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6eda8aa6-b5d3-4a8e-bfef-c87f3eb64888 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:32.859238 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6eda8aa6-b5d3-4a8e-bfef-c87f3eb64888 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:32.859766 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6eda8aa6-b5d3-4a8e-bfef-c87f3eb64888 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:33.478140 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6eda8aa6-b5d3-4a8e-bfef-c87f3eb64888 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:33.494137 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6eda8aa6-b5d3-4a8e-bfef-c87f3eb64888 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9" status: 200 len: 1494 microversion: 2.1 time: 0.656929 Aug 04 16:34:33.495219 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 313/607] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:32 2022] GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 => generated 1494 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:33.504739 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-426ae374-f395-4a37-904a-f4223bbc47f6 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:33.507966 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-426ae374-f395-4a37-904a-f4223bbc47f6 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:33.517727 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-426ae374-f395-4a37-904a-f4223bbc47f6 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:33.518071 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-426ae374-f395-4a37-904a-f4223bbc47f6 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:33.523731 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-426ae374-f395-4a37-904a-f4223bbc47f6 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:33.524443 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-426ae374-f395-4a37-904a-f4223bbc47f6 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:33.712119 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-61067dc3-b9ac-4639-832d-4708781f36dd tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:34:33.712605 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-61067dc3-b9ac-4639-832d-4708781f36dd tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:34:33.713223 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-61067dc3-b9ac-4639-832d-4708781f36dd tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:34:33.713749 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-61067dc3-b9ac-4639-832d-4708781f36dd tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:34:33.714542 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-61067dc3-b9ac-4639-832d-4708781f36dd tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:34:33.728556 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-61067dc3-b9ac-4639-832d-4708781f36dd tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:33.729503 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-61067dc3-b9ac-4639-832d-4708781f36dd tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:33.730367 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-61067dc3-b9ac-4639-832d-4708781f36dd tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:33.730897 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-61067dc3-b9ac-4639-832d-4708781f36dd tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:33.752814 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-61067dc3-b9ac-4639-832d-4708781f36dd tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Getting quotas for project 25f22de02d3e4db281f6372e8191b95f. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:34:33.759311 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-61067dc3-b9ac-4639-832d-4708781f36dd tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Getting quotas for user b4a732f446814c9fa080979bef241023 and project 25f22de02d3e4db281f6372e8191b95f. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:34:33.774086 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-61067dc3-b9ac-4639-832d-4708781f36dd tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:34:33.778867 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-61067dc3-b9ac-4639-832d-4708781f36dd tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 35b3ee83-f946-4c4c-bff9-80b8bd368788] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:34:33.845636 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-61067dc3-b9ac-4639-832d-4708781f36dd tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.005234 Aug 04 16:34:33.847265 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 295/608] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:34:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 3008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:34:33.852618 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-10f64e14-3c7f-4a1b-9d8a-f53602da7ae6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:33.853662 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-10f64e14-3c7f-4a1b-9d8a-f53602da7ae6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: b61f1675-928c-4591-8213-474c2bc174be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:33.862598 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-10f64e14-3c7f-4a1b-9d8a-f53602da7ae6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:33.863601 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-10f64e14-3c7f-4a1b-9d8a-f53602da7ae6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:33.864819 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-10f64e14-3c7f-4a1b-9d8a-f53602da7ae6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:33.865612 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-10f64e14-3c7f-4a1b-9d8a-f53602da7ae6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:33.909009 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-426ae374-f395-4a37-904a-f4223bbc47f6 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:33.928896 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-426ae374-f395-4a37-904a-f4223bbc47f6 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1312 microversion: 2.1 time: 0.428637 Aug 04 16:34:33.930401 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 314/609] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:33 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1312 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:33.957614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4b2bbdc6-c5b1-4739-872d-18e41bbf0700 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:33.959677 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4b2bbdc6-c5b1-4739-872d-18e41bbf0700 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] [instance: 703cd64d-197c-4791-944a-7fc4a25acb8f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:33.974270 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b2bbdc6-c5b1-4739-872d-18e41bbf0700 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:33.975812 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b2bbdc6-c5b1-4739-872d-18e41bbf0700 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:33.978370 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b2bbdc6-c5b1-4739-872d-18e41bbf0700 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:33.979121 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b2bbdc6-c5b1-4739-872d-18e41bbf0700 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:34.034315 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4b2bbdc6-c5b1-4739-872d-18e41bbf0700 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '65b83cb4ac4d4398b1a0ca841f947794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969f99390a91400baf4892e97f12c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:34.042948 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4b2bbdc6-c5b1-4739-872d-18e41bbf0700 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Request method failure captured: Aug 04 16:34:34.042948 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/703cd64d-197c-4791-944a-7fc4a25acb8f/diagnostics HTTP/1.1 Aug 04 16:34:34.042948 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:34:34.042948 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:34:34.042948 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:34:34.042948 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:34:34.042948 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:34:34.042948 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:34:34.042948 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:34:34.042948 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:34:34.042948 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_UHUD099y_qVhKQG74MMhYOEbjEvI8ZDjIWmgbxUVvUA48_kSGaO3tD-qc3QousMhATXf_wwipXWact-X2tq5KgM2koqBbIsAJUc-FCPj_9QHTtImKdZY8vCIt5fEqUapdGACpRwYIcVzEcRfX2jZsZxntr00a7hOqBdFeInfMNSTE Aug 04 16:34:34.042948 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:34:34.042948 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:34:34.042948 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:34:34.042948 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:34:34.042948 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:34:34.042948 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:34:34.042948 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 969f99390a91400baf4892e97f12c0c5 Aug 04 16:34:34.042948 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-347082379 Aug 04 16:34:34.042948 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:34:34.042948 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:34:34.044638 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/969f99390a91400baf4892e97f12c0c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_969f99390a91400baf4892e97f12c0c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/969f99390a91400baf4892e97f12c0c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/969f99390a91400baf4892e97f12c0c5"}]}] Aug 04 16:34:34.044638 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-347082379 Aug 04 16:34:34.044638 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 969f99390a91400baf4892e97f12c0c5 Aug 04 16:34:34.044638 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-347082379 Aug 04 16:34:34.044638 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServerDiagnosticsNegativeTest-347082379-project Aug 04 16:34:34.044638 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:34:34.044638 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:34:34.044638 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 65b83cb4ac4d4398b1a0ca841f947794 Aug 04 16:34:34.044638 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-347082379-project Aug 04 16:34:34.044638 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:34:34.044638 n-d-846466-12 devstack@n-api.service[126126]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 04 16:34:34.045612 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'server_id': '703cd64d-197c-4791-944a-7fc4a25acb8f'} Aug 04 16:34:34.045612 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:34:34.045612 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:34.045612 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:34.045612 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:34.045612 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:34:34.045612 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:34:34.045612 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:34:34.045612 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:34:34.045612 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 04 16:34:34.045612 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 04 16:34:34.045612 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:34:34.045612 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:34:34.045612 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:34:34.045612 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:34:34.045612 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:34:34.045612 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:34:34.045612 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:34:34.045612 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:34:34.045612 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:34:34.047099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:34:34.047099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:34:34.047099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:34:34.047099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:34:34.047099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:34:34.047099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 04 16:34:34.047099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:34.047099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:34.047099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:34.047099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:34.047099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:34.047099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:34.047099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:34:34.047099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:34:34.047099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 04 16:34:34.047099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:34:34.047099 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4b2bbdc6-c5b1-4739-872d-18e41bbf0700 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:34:34.048329 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4b2bbdc6-c5b1-4739-872d-18e41bbf0700 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] 10.222.0.23 "GET /compute/v2.1/servers/703cd64d-197c-4791-944a-7fc4a25acb8f/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.100970 Aug 04 16:34:34.057269 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 315/610] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:34:33 2022] GET /compute/v2.1/servers/703cd64d-197c-4791-944a-7fc4a25acb8f/diagnostics => generated 117 bytes in 110 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:34:34.060669 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8fc27b84-abd6-4bbc-ad4b-20df32ca32df tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Calling method '.version_select at 0x7f7e8504f040>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:34.064515 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8fc27b84-abd6-4bbc-ad4b-20df32ca32df tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:34.064964 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8fc27b84-abd6-4bbc-ad4b-20df32ca32df tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:34.081828 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8fc27b84-abd6-4bbc-ad4b-20df32ca32df tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 404 microversion: 2.1 time: 0.024871 Aug 04 16:34:34.082733 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 316/611] 10.222.0.23 () {58 vars in 1143 bytes} [Thu Aug 4 16:34:34 2022] GET /compute/v2.1/os-migrations => generated 404 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:34.087496 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a9a19daf-1989-4a9a-97a6-6197751a69d8 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:34.088114 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a9a19daf-1989-4a9a-97a6-6197751a69d8 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 35b3ee83-f946-4c4c-bff9-80b8bd368788] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:34.286302 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a9a19daf-1989-4a9a-97a6-6197751a69d8 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a732f446814c9fa080979bef241023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f22de02d3e4db281f6372e8191b95f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:34.294518 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a9a19daf-1989-4a9a-97a6-6197751a69d8 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "GET /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788" status: 200 len: 1224 microversion: 2.1 time: 0.210163 Aug 04 16:34:34.307613 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 317/612] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:34 2022] GET /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788 => generated 1224 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:34.307613 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ca80a93c-85cc-4ab4-8da2-9b399002d6da tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:34.307613 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ca80a93c-85cc-4ab4-8da2-9b399002d6da tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] [instance: 703cd64d-197c-4791-944a-7fc4a25acb8f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:34.329713 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ca80a93c-85cc-4ab4-8da2-9b399002d6da tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:34.330624 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ca80a93c-85cc-4ab4-8da2-9b399002d6da tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:34.332906 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ca80a93c-85cc-4ab4-8da2-9b399002d6da tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:34.346778 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ca80a93c-85cc-4ab4-8da2-9b399002d6da tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:34.388951 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ca80a93c-85cc-4ab4-8da2-9b399002d6da tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] [instance: 703cd64d-197c-4791-944a-7fc4a25acb8f] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:34:34.405129 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-10f64e14-3c7f-4a1b-9d8a-f53602da7ae6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:34.418902 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-10f64e14-3c7f-4a1b-9d8a-f53602da7ae6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:34.420808 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-10f64e14-3c7f-4a1b-9d8a-f53602da7ae6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:34.422359 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-10f64e14-3c7f-4a1b-9d8a-f53602da7ae6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be" status: 200 len: 1362 microversion: 2.25 time: 0.573895 Aug 04 16:34:34.423078 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 296/613] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:34:33 2022] GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be => generated 1362 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:34:34.458622 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fac971e6-0e7d-4ef9-a140-dc940a1cd3de tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:34.462444 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fac971e6-0e7d-4ef9-a140-dc940a1cd3de tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] [instance: f23a3c47-f725-4ad2-b88d-b972ff4b2ee9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:34.477620 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fac971e6-0e7d-4ef9-a140-dc940a1cd3de tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:34.484698 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fac971e6-0e7d-4ef9-a140-dc940a1cd3de tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:34.485582 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fac971e6-0e7d-4ef9-a140-dc940a1cd3de tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:34.486057 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fac971e6-0e7d-4ef9-a140-dc940a1cd3de tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:34.580692 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ca80a93c-85cc-4ab4-8da2-9b399002d6da tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] 10.222.0.23 "DELETE /compute/v2.1/servers/703cd64d-197c-4791-944a-7fc4a25acb8f" status: 204 len: 0 microversion: 2.1 time: 0.282570 Aug 04 16:34:34.585374 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 318/614] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:34:34 2022] DELETE /compute/v2.1/servers/703cd64d-197c-4791-944a-7fc4a25acb8f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:34:34.611262 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1f5d15c1-16a8-49d1-81b0-d1562b43140c tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:34.613566 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1f5d15c1-16a8-49d1-81b0-d1562b43140c tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] [instance: 703cd64d-197c-4791-944a-7fc4a25acb8f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:34.630992 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1f5d15c1-16a8-49d1-81b0-d1562b43140c tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:34.632271 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1f5d15c1-16a8-49d1-81b0-d1562b43140c tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:34.633546 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1f5d15c1-16a8-49d1-81b0-d1562b43140c tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:34.634225 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1f5d15c1-16a8-49d1-81b0-d1562b43140c tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:34.777988 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fac971e6-0e7d-4ef9-a140-dc940a1cd3de tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9" status: 200 len: 1647 microversion: 2.1 time: 0.323470 Aug 04 16:34:34.778564 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 297/615] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:34 2022] GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 => generated 1647 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:34.950749 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c190c67b-39a8-487d-97b8-a10a13401b99 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:34.951940 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c190c67b-39a8-487d-97b8-a10a13401b99 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:34.964497 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c190c67b-39a8-487d-97b8-a10a13401b99 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:34.968332 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c190c67b-39a8-487d-97b8-a10a13401b99 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:34.969535 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c190c67b-39a8-487d-97b8-a10a13401b99 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:34.970241 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c190c67b-39a8-487d-97b8-a10a13401b99 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:35.217686 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1f5d15c1-16a8-49d1-81b0-d1562b43140c tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b83cb4ac4d4398b1a0ca841f947794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969f99390a91400baf4892e97f12c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:35.227180 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1f5d15c1-16a8-49d1-81b0-d1562b43140c tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] 10.222.0.23 "GET /compute/v2.1/servers/703cd64d-197c-4791-944a-7fc4a25acb8f" status: 200 len: 1479 microversion: 2.1 time: 0.638099 Aug 04 16:34:35.243144 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 319/616] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:34 2022] GET /compute/v2.1/servers/703cd64d-197c-4791-944a-7fc4a25acb8f => generated 1479 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:35.248645 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5e641c90-65a1-4cfb-88d6-78719eb8499c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-115948404", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "b9488b95-3e40-4213-8fe1-ea17248f446a"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:35.310155 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-5e641c90-65a1-4cfb-88d6-78719eb8499c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] validate_networks() for [('b9488b95-3e40-4213-8fe1-ea17248f446a', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:34:35.824095 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c190c67b-39a8-487d-97b8-a10a13401b99 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:35.834953 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c190c67b-39a8-487d-97b8-a10a13401b99 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1312 microversion: 2.1 time: 0.888323 Aug 04 16:34:35.836313 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 298/617] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:34 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1312 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:34:35.876991 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-4b2099f5-f624-43fc-87f8-750ebd945dbc req-2be69b73-b06b-4e36-96bf-c6b4efef2b63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a33abce-4d0a-4919-94db-28cea706d412", "tag": "e1d80942-af44-4bef-a238-f9fca1aa7ddf"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:35.896985 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-4b2099f5-f624-43fc-87f8-750ebd945dbc req-2be69b73-b06b-4e36-96bf-c6b4efef2b63 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:35.898571 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-4b2099f5-f624-43fc-87f8-750ebd945dbc req-2be69b73-b06b-4e36-96bf-c6b4efef2b63 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:35.913529 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-4b2099f5-f624-43fc-87f8-750ebd945dbc req-2be69b73-b06b-4e36-96bf-c6b4efef2b63 service nova] Creating event network-changed:e1d80942-af44-4bef-a238-f9fca1aa7ddf for instance 5a33abce-4d0a-4919-94db-28cea706d412 on n-h1-846466-12 Aug 04 16:34:35.919758 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-4b2099f5-f624-43fc-87f8-750ebd945dbc req-2be69b73-b06b-4e36-96bf-c6b4efef2b63 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082086 Aug 04 16:34:35.920843 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 299/618] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:35.927590 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5912292b-ffaf-4c50-81c2-99f789404ec6 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:35.928743 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5912292b-ffaf-4c50-81c2-99f789404ec6 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 35b3ee83-f946-4c4c-bff9-80b8bd368788] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:35.936496 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5912292b-ffaf-4c50-81c2-99f789404ec6 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:35.937125 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5912292b-ffaf-4c50-81c2-99f789404ec6 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:35.938304 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5912292b-ffaf-4c50-81c2-99f789404ec6 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:35.939127 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5912292b-ffaf-4c50-81c2-99f789404ec6 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:36.157805 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5912292b-ffaf-4c50-81c2-99f789404ec6 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a732f446814c9fa080979bef241023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f22de02d3e4db281f6372e8191b95f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:36.189480 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5912292b-ffaf-4c50-81c2-99f789404ec6 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "GET /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788" status: 200 len: 1220 microversion: 2.1 time: 0.264993 Aug 04 16:34:36.190101 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 300/619] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:35 2022] GET /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788 => generated 1220 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:36.210954 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-94c92bc3-3121-48ec-a480-62ac3e3b35fe tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:36.211567 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-94c92bc3-3121-48ec-a480-62ac3e3b35fe tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: b61f1675-928c-4591-8213-474c2bc174be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:36.218405 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-94c92bc3-3121-48ec-a480-62ac3e3b35fe tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:36.218851 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-94c92bc3-3121-48ec-a480-62ac3e3b35fe tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:36.219651 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-94c92bc3-3121-48ec-a480-62ac3e3b35fe tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:36.220274 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-94c92bc3-3121-48ec-a480-62ac3e3b35fe tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:36.238153 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=100 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:34:36.915874 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-94c92bc3-3121-48ec-a480-62ac3e3b35fe tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:36.924680 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-94c92bc3-3121-48ec-a480-62ac3e3b35fe tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:36.926233 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-94c92bc3-3121-48ec-a480-62ac3e3b35fe tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:36.927630 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-94c92bc3-3121-48ec-a480-62ac3e3b35fe tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be" status: 200 len: 1362 microversion: 2.25 time: 0.725286 Aug 04 16:34:36.928384 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 301/620] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:34:36 2022] GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be => generated 1362 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:34:36.933084 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-98a241d1-6c30-45d6-b526-52253e20ecc7 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:36.933894 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-98a241d1-6c30-45d6-b526-52253e20ecc7 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] [instance: 703cd64d-197c-4791-944a-7fc4a25acb8f] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:36.974823 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-98a241d1-6c30-45d6-b526-52253e20ecc7 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:36.974823 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-98a241d1-6c30-45d6-b526-52253e20ecc7 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:36.978732 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-98a241d1-6c30-45d6-b526-52253e20ecc7 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:36.979857 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-98a241d1-6c30-45d6-b526-52253e20ecc7 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:37.133923 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-98a241d1-6c30-45d6-b526-52253e20ecc7 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b83cb4ac4d4398b1a0ca841f947794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '969f99390a91400baf4892e97f12c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:37.142165 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-98a241d1-6c30-45d6-b526-52253e20ecc7 tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] 10.222.0.23 "GET /compute/v2.1/servers/703cd64d-197c-4791-944a-7fc4a25acb8f" status: 200 len: 1437 microversion: 2.1 time: 0.212510 Aug 04 16:34:37.155990 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 302/621] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:36 2022] GET /compute/v2.1/servers/703cd64d-197c-4791-944a-7fc4a25acb8f => generated 1437 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:37.163837 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d13ef662-c083-4f26-ba43-5b1708165bc9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:37.165012 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d13ef662-c083-4f26-ba43-5b1708165bc9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:37.178642 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d13ef662-c083-4f26-ba43-5b1708165bc9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:37.180304 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d13ef662-c083-4f26-ba43-5b1708165bc9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:37.182866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d13ef662-c083-4f26-ba43-5b1708165bc9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:37.183573 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d13ef662-c083-4f26-ba43-5b1708165bc9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:37.494715 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:34:38.246151 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-5e641c90-65a1-4cfb-88d6-78719eb8499c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:34:38.246566 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-5e641c90-65a1-4cfb-88d6-78719eb8499c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:34:38.247035 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-5e641c90-65a1-4cfb-88d6-78719eb8499c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:34:38.247439 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-5e641c90-65a1-4cfb-88d6-78719eb8499c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:34:38.247896 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-5e641c90-65a1-4cfb-88d6-78719eb8499c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:34:38.273261 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e641c90-65a1-4cfb-88d6-78719eb8499c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:38.273744 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e641c90-65a1-4cfb-88d6-78719eb8499c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:38.275689 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e641c90-65a1-4cfb-88d6-78719eb8499c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:38.276125 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e641c90-65a1-4cfb-88d6-78719eb8499c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:38.302184 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:34:38.320523 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d13ef662-c083-4f26-ba43-5b1708165bc9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:38.353259 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-5e641c90-65a1-4cfb-88d6-78719eb8499c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Getting quotas for project 82b3a898ed4b4e0a82ae35830cb00ca9. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:34:38.354212 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d13ef662-c083-4f26-ba43-5b1708165bc9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1312 microversion: 2.1 time: 1.193459 Aug 04 16:34:38.355683 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 303/622] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:37 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1312 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:38.386994 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-15905d86-da0c-4694-a709-2054a631ac1b req-72a3c269-5e6e-4aee-8981-08d44bdf1560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "703cd64d-197c-4791-944a-7fc4a25acb8f", "name": "network-vif-deleted", "tag": "28c7bd54-5c48-49be-a7f2-a3c50f2a045d"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:38.387265 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-5e641c90-65a1-4cfb-88d6-78719eb8499c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Getting quotas for user 51b742cff6a948d0883501917706f66e and project 82b3a898ed4b4e0a82ae35830cb00ca9. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:34:38.439551 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-15905d86-da0c-4694-a709-2054a631ac1b req-72a3c269-5e6e-4aee-8981-08d44bdf1560 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:38.445702 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-15905d86-da0c-4694-a709-2054a631ac1b req-72a3c269-5e6e-4aee-8981-08d44bdf1560 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:38.463034 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5e641c90-65a1-4cfb-88d6-78719eb8499c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:34:38.467739 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5e641c90-65a1-4cfb-88d6-78719eb8499c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: a80ed729-9d91-4fba-a785-77d5aeacb767] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:34:38.484045 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-15905d86-da0c-4694-a709-2054a631ac1b req-72a3c269-5e6e-4aee-8981-08d44bdf1560 service nova] Creating event network-vif-deleted:28c7bd54-5c48-49be-a7f2-a3c50f2a045d for instance 703cd64d-197c-4791-944a-7fc4a25acb8f on n-h1-846466-12 Aug 04 16:34:38.498133 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-15905d86-da0c-4694-a709-2054a631ac1b req-72a3c269-5e6e-4aee-8981-08d44bdf1560 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124383 Aug 04 16:34:38.500191 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 304/623] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:38.516807 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d09a7095-03fc-440a-ad44-cacb0eb46c44 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:38.518085 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d09a7095-03fc-440a-ad44-cacb0eb46c44 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 35b3ee83-f946-4c4c-bff9-80b8bd368788] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:38.537885 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d09a7095-03fc-440a-ad44-cacb0eb46c44 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:38.538664 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d09a7095-03fc-440a-ad44-cacb0eb46c44 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:38.539683 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d09a7095-03fc-440a-ad44-cacb0eb46c44 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:38.542876 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d09a7095-03fc-440a-ad44-cacb0eb46c44 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:38.584275 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5e641c90-65a1-4cfb-88d6-78719eb8499c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.339746 Aug 04 16:34:38.588280 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 320/624] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:34:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 3344 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:34:38.598744 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-71ed4369-b371-4eea-9ecf-beaa06cbe53b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:38.599723 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-71ed4369-b371-4eea-9ecf-beaa06cbe53b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: b61f1675-928c-4591-8213-474c2bc174be] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:38.617770 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-71ed4369-b371-4eea-9ecf-beaa06cbe53b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:38.618375 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-71ed4369-b371-4eea-9ecf-beaa06cbe53b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:38.619255 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-71ed4369-b371-4eea-9ecf-beaa06cbe53b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:38.619780 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-71ed4369-b371-4eea-9ecf-beaa06cbe53b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:39.176564 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d09a7095-03fc-440a-ad44-cacb0eb46c44 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a732f446814c9fa080979bef241023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f22de02d3e4db281f6372e8191b95f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:39.191933 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-71ed4369-b371-4eea-9ecf-beaa06cbe53b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:39.206819 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-71ed4369-b371-4eea-9ecf-beaa06cbe53b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:39.210592 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d09a7095-03fc-440a-ad44-cacb0eb46c44 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "GET /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788" status: 200 len: 1324 microversion: 2.1 time: 0.707902 Aug 04 16:34:39.211346 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 305/625] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:38 2022] GET /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788 => generated 1324 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:39.214133 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-71ed4369-b371-4eea-9ecf-beaa06cbe53b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:39.215599 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-71ed4369-b371-4eea-9ecf-beaa06cbe53b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be" status: 200 len: 1362 microversion: 2.25 time: 0.625572 Aug 04 16:34:39.227092 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9f8a6f9b-5d8b-46f2-ab36-5022c062a81b tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:39.228938 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9f8a6f9b-5d8b-46f2-ab36-5022c062a81b tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] [instance: 703cd64d-197c-4791-944a-7fc4a25acb8f] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:39.242607 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 321/626] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:34:38 2022] GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be => generated 1362 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:34:39.255574 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-04f8d7ed-e0f0-4d86-8b4c-beaf6b8300f0 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:39.256123 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-04f8d7ed-e0f0-4d86-8b4c-beaf6b8300f0 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: a80ed729-9d91-4fba-a785-77d5aeacb767] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:39.282363 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9f8a6f9b-5d8b-46f2-ab36-5022c062a81b tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:39.282816 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9f8a6f9b-5d8b-46f2-ab36-5022c062a81b tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:39.283628 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9f8a6f9b-5d8b-46f2-ab36-5022c062a81b tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:39.284121 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9f8a6f9b-5d8b-46f2-ab36-5022c062a81b tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:39.312450 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-9f8a6f9b-5d8b-46f2-ab36-5022c062a81b tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] HTTP exception thrown: Instance 703cd64d-197c-4791-944a-7fc4a25acb8f could not be found. Aug 04 16:34:39.314729 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9f8a6f9b-5d8b-46f2-ab36-5022c062a81b tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Request method failure captured: Aug 04 16:34:39.314729 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/703cd64d-197c-4791-944a-7fc4a25acb8f HTTP/1.1 Aug 04 16:34:39.314729 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:34:39.314729 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:34:39.314729 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:34:39.314729 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:34:39.314729 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:34:39.314729 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:34:39.314729 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:34:39.314729 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:34:39.314729 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_UHUD099y_qVhKQG74MMhYOEbjEvI8ZDjIWmgbxUVvUA48_kSGaO3tD-qc3QousMhATXf_wwipXWact-X2tq5KgM2koqBbIsAJUc-FCPj_9QHTtImKdZY8vCIt5fEqUapdGACpRwYIcVzEcRfX2jZsZxntr00a7hOqBdFeInfMNSTE Aug 04 16:34:39.314729 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:34:39.314729 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:34:39.314729 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:34:39.314729 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:34:39.314729 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:34:39.314729 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:34:39.314729 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 969f99390a91400baf4892e97f12c0c5 Aug 04 16:34:39.314729 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-347082379 Aug 04 16:34:39.314729 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:34:39.314729 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:34:39.316376 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/969f99390a91400baf4892e97f12c0c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_969f99390a91400baf4892e97f12c0c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/969f99390a91400baf4892e97f12c0c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/969f99390a91400baf4892e97f12c0c5"}]}] Aug 04 16:34:39.316376 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-347082379 Aug 04 16:34:39.316376 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 969f99390a91400baf4892e97f12c0c5 Aug 04 16:34:39.316376 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-347082379 Aug 04 16:34:39.316376 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerDiagnosticsNegativeTest-347082379-project Aug 04 16:34:39.316376 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:34:39.316376 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:34:39.316376 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 65b83cb4ac4d4398b1a0ca841f947794 Aug 04 16:34:39.316376 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-347082379-project Aug 04 16:34:39.316376 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:34:39.316376 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 703cd64d-197c-4791-944a-7fc4a25acb8f could not be found. Aug 04 16:34:39.316376 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '703cd64d-197c-4791-944a-7fc4a25acb8f'} Aug 04 16:34:39.317248 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:34:39.317248 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:39.317248 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:34:39.317248 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:34:39.317248 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:34:39.317248 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:34:39.317248 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:34:39.317248 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:34:39.317248 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:34:39.317248 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:34:39.317248 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 703cd64d-197c-4791-944a-7fc4a25acb8f could not be found. Aug 04 16:34:39.317248 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:39.317248 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:39.317248 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:39.317248 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:39.317248 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:39.317248 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:39.317248 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:34:39.317248 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:34:39.317248 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:34:39.318769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:34:39.318769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:34:39.318769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:34:39.318769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:34:39.318769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:34:39.318769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:34:39.318769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:34:39.318769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 703cd64d-197c-4791-944a-7fc4a25acb8f could not be found. Aug 04 16:34:39.318769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:39.318769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:39.318769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:39.318769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:39.318769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:39.318769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:39.318769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:34:39.318769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:34:39.318769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 703cd64d-197c-4791-944a-7fc4a25acb8f could not be found. Aug 04 16:34:39.318769 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:39.322060 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9f8a6f9b-5d8b-46f2-ab36-5022c062a81b tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] Returning 404 to user: Instance 703cd64d-197c-4791-944a-7fc4a25acb8f could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:34:39.323113 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9f8a6f9b-5d8b-46f2-ab36-5022c062a81b tempest-ServerDiagnosticsNegativeTest-347082379 tempest-ServerDiagnosticsNegativeTest-347082379-project] 10.222.0.23 "GET /compute/v2.1/servers/703cd64d-197c-4791-944a-7fc4a25acb8f" status: 404 len: 111 microversion: 2.1 time: 0.105842 Aug 04 16:34:39.324127 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 306/627] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:39 2022] GET /compute/v2.1/servers/703cd64d-197c-4791-944a-7fc4a25acb8f => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:34:39.375907 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-49c47b24-631c-4777-aef0-825253e97e59 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:39.376603 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-49c47b24-631c-4777-aef0-825253e97e59 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:39.389692 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-49c47b24-631c-4777-aef0-825253e97e59 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:39.391899 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-49c47b24-631c-4777-aef0-825253e97e59 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:39.394460 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-49c47b24-631c-4777-aef0-825253e97e59 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:39.396118 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-49c47b24-631c-4777-aef0-825253e97e59 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:39.539565 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-04f8d7ed-e0f0-4d86-8b4c-beaf6b8300f0 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:39.558488 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-04f8d7ed-e0f0-4d86-8b4c-beaf6b8300f0 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767" status: 200 len: 1210 microversion: 2.1 time: 0.314586 Aug 04 16:34:39.561603 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 322/628] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:39 2022] GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767 => generated 1210 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:40.001210 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-49c47b24-631c-4777-aef0-825253e97e59 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:40.020217 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-49c47b24-631c-4777-aef0-825253e97e59 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1312 microversion: 2.1 time: 0.648479 Aug 04 16:34:40.026056 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 307/629] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:39 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1312 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:40.232312 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-503b664a-4b0c-43a2-9341-96638ebaa065 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:40.232926 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-503b664a-4b0c-43a2-9341-96638ebaa065 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 35b3ee83-f946-4c4c-bff9-80b8bd368788] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:40.242440 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ea6bd527-b988-4931-bf34-c2085e1a9d93 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:40.247814 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ea6bd527-b988-4931-bf34-c2085e1a9d93 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: b61f1675-928c-4591-8213-474c2bc174be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:40.248853 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-503b664a-4b0c-43a2-9341-96638ebaa065 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:40.252562 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ea6bd527-b988-4931-bf34-c2085e1a9d93 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:40.257756 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-503b664a-4b0c-43a2-9341-96638ebaa065 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:40.258557 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ea6bd527-b988-4931-bf34-c2085e1a9d93 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:40.260383 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-503b664a-4b0c-43a2-9341-96638ebaa065 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:40.261188 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ea6bd527-b988-4931-bf34-c2085e1a9d93 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:40.268406 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ea6bd527-b988-4931-bf34-c2085e1a9d93 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:40.269192 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-503b664a-4b0c-43a2-9341-96638ebaa065 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:40.938203 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-503b664a-4b0c-43a2-9341-96638ebaa065 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a732f446814c9fa080979bef241023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f22de02d3e4db281f6372e8191b95f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:40.975950 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ea6bd527-b988-4931-bf34-c2085e1a9d93 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:40.993494 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-503b664a-4b0c-43a2-9341-96638ebaa065 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "GET /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788" status: 200 len: 1324 microversion: 2.1 time: 0.759124 Aug 04 16:34:41.012791 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 323/630] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:40 2022] GET /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788 => generated 1324 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:41.021238 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ea6bd527-b988-4931-bf34-c2085e1a9d93 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:41.023082 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ea6bd527-b988-4931-bf34-c2085e1a9d93 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:41.024380 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ea6bd527-b988-4931-bf34-c2085e1a9d93 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be" status: 200 len: 1362 microversion: 2.25 time: 0.785794 Aug 04 16:34:41.024802 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 308/631] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:34:40 2022] GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be => generated 1362 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:34:41.026200 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6cbfbd42-4f37-4139-ba7f-c3df0fc0151b tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:41.026854 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6cbfbd42-4f37-4139-ba7f-c3df0fc0151b tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: a80ed729-9d91-4fba-a785-77d5aeacb767] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:41.035765 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6cbfbd42-4f37-4139-ba7f-c3df0fc0151b tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:41.036761 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6cbfbd42-4f37-4139-ba7f-c3df0fc0151b tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:41.037913 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6cbfbd42-4f37-4139-ba7f-c3df0fc0151b tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:41.038492 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6cbfbd42-4f37-4139-ba7f-c3df0fc0151b tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:41.055084 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b837d82b-9f1b-48ce-868d-6f6cbaee6367 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:41.056994 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b837d82b-9f1b-48ce-868d-6f6cbaee6367 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:41.075760 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b837d82b-9f1b-48ce-868d-6f6cbaee6367 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:41.076487 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b837d82b-9f1b-48ce-868d-6f6cbaee6367 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:41.081061 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b837d82b-9f1b-48ce-868d-6f6cbaee6367 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:41.083517 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b837d82b-9f1b-48ce-868d-6f6cbaee6367 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:41.394067 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6cbfbd42-4f37-4139-ba7f-c3df0fc0151b tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:41.405678 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6cbfbd42-4f37-4139-ba7f-c3df0fc0151b tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767" status: 200 len: 1268 microversion: 2.1 time: 0.391620 Aug 04 16:34:41.406265 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 324/632] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:41 2022] GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767 => generated 1268 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:41.747810 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b837d82b-9f1b-48ce-868d-6f6cbaee6367 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:41.756452 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b837d82b-9f1b-48ce-868d-6f6cbaee6367 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1312 microversion: 2.1 time: 0.704855 Aug 04 16:34:41.780917 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 309/633] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:41 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1312 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:41.903555 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-65b4a9ed-4f86-451a-9a87-855cb044e512 req-bb4f337a-a425-405b-8a3c-b11c0087536f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35b3ee83-f946-4c4c-bff9-80b8bd368788", "tag": "88be3f31-89a1-4c97-bc28-c49392694bb7"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:41.939606 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-65b4a9ed-4f86-451a-9a87-855cb044e512 req-bb4f337a-a425-405b-8a3c-b11c0087536f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:41.940459 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-65b4a9ed-4f86-451a-9a87-855cb044e512 req-bb4f337a-a425-405b-8a3c-b11c0087536f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:42.004852 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-65b4a9ed-4f86-451a-9a87-855cb044e512 req-bb4f337a-a425-405b-8a3c-b11c0087536f service nova] Creating event network-changed:88be3f31-89a1-4c97-bc28-c49392694bb7 for instance 35b3ee83-f946-4c4c-bff9-80b8bd368788 on n-h1-846466-12 Aug 04 16:34:42.017072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-55a17c37-a3f8-4e6a-b309-6d1c4ff101a1 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:42.018607 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-55a17c37-a3f8-4e6a-b309-6d1c4ff101a1 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 35b3ee83-f946-4c4c-bff9-80b8bd368788] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:42.030598 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-65b4a9ed-4f86-451a-9a87-855cb044e512 req-bb4f337a-a425-405b-8a3c-b11c0087536f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129091 Aug 04 16:34:42.032867 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 325/634] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:42.035958 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-55a17c37-a3f8-4e6a-b309-6d1c4ff101a1 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:42.036651 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-55a17c37-a3f8-4e6a-b309-6d1c4ff101a1 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:42.038294 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-55a17c37-a3f8-4e6a-b309-6d1c4ff101a1 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:42.039258 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-55a17c37-a3f8-4e6a-b309-6d1c4ff101a1 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:42.051768 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1bb5af2e-a719-4e29-a372-bcb12b3f02e3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:42.052829 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1bb5af2e-a719-4e29-a372-bcb12b3f02e3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: b61f1675-928c-4591-8213-474c2bc174be] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:42.069723 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1bb5af2e-a719-4e29-a372-bcb12b3f02e3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:42.076535 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1bb5af2e-a719-4e29-a372-bcb12b3f02e3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:42.077721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1bb5af2e-a719-4e29-a372-bcb12b3f02e3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:42.078658 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1bb5af2e-a719-4e29-a372-bcb12b3f02e3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:42.595643 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1bb5af2e-a719-4e29-a372-bcb12b3f02e3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:42.596374 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-55a17c37-a3f8-4e6a-b309-6d1c4ff101a1 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a732f446814c9fa080979bef241023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f22de02d3e4db281f6372e8191b95f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:42.618284 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1bb5af2e-a719-4e29-a372-bcb12b3f02e3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:42.620447 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1bb5af2e-a719-4e29-a372-bcb12b3f02e3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:42.622484 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1bb5af2e-a719-4e29-a372-bcb12b3f02e3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be" status: 200 len: 1362 microversion: 2.25 time: 0.578332 Aug 04 16:34:42.626605 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-55a17c37-a3f8-4e6a-b309-6d1c4ff101a1 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "GET /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788" status: 200 len: 1324 microversion: 2.1 time: 0.612092 Aug 04 16:34:42.628863 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 310/635] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:42 2022] GET /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788 => generated 1324 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:42.641566 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 326/636] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:34:42 2022] GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be => generated 1362 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:34:42.653260 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a08c4330-ccb3-42ef-8b30-24e93bb85a11 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:42.658709 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a08c4330-ccb3-42ef-8b30-24e93bb85a11 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: a80ed729-9d91-4fba-a785-77d5aeacb767] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:42.701569 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a08c4330-ccb3-42ef-8b30-24e93bb85a11 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:42.702006 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a08c4330-ccb3-42ef-8b30-24e93bb85a11 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:42.702785 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a08c4330-ccb3-42ef-8b30-24e93bb85a11 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:42.714187 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a08c4330-ccb3-42ef-8b30-24e93bb85a11 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:42.781329 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-93bfd8eb-e8e3-43ba-ba2c-c50b96eea58d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:42.783276 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-93bfd8eb-e8e3-43ba-ba2c-c50b96eea58d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:42.809667 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-93bfd8eb-e8e3-43ba-ba2c-c50b96eea58d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:42.813230 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-93bfd8eb-e8e3-43ba-ba2c-c50b96eea58d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:42.816828 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-93bfd8eb-e8e3-43ba-ba2c-c50b96eea58d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:42.818063 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-93bfd8eb-e8e3-43ba-ba2c-c50b96eea58d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:42.837402 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a08c4330-ccb3-42ef-8b30-24e93bb85a11 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:42.859507 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a08c4330-ccb3-42ef-8b30-24e93bb85a11 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767" status: 200 len: 1268 microversion: 2.1 time: 0.211675 Aug 04 16:34:42.875327 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 327/637] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:42 2022] GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767 => generated 1268 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:43.133467 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-1e4db583-2c81-4498-80ba-9542962dbdf2 req-5238a9fc-b885-48bd-aae9-164b9b24e200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b61f1675-928c-4591-8213-474c2bc174be", "name": "network-vif-plugged", "status": "completed", "tag": "c6da17eb-62d8-4f32-b0fd-b4686bc2423e"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:43.145694 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-1e4db583-2c81-4498-80ba-9542962dbdf2 req-5238a9fc-b885-48bd-aae9-164b9b24e200 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:43.146196 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-1e4db583-2c81-4498-80ba-9542962dbdf2 req-5238a9fc-b885-48bd-aae9-164b9b24e200 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:43.162376 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-1e4db583-2c81-4498-80ba-9542962dbdf2 req-5238a9fc-b885-48bd-aae9-164b9b24e200 service nova] Creating event network-vif-plugged:c6da17eb-62d8-4f32-b0fd-b4686bc2423e for instance b61f1675-928c-4591-8213-474c2bc174be on n-h2-846466-12 Aug 04 16:34:43.174227 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-1e4db583-2c81-4498-80ba-9542962dbdf2 req-5238a9fc-b885-48bd-aae9-164b9b24e200 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045444 Aug 04 16:34:43.175592 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 328/638] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:34:43.316570 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-93bfd8eb-e8e3-43ba-ba2c-c50b96eea58d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:43.326779 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-93bfd8eb-e8e3-43ba-ba2c-c50b96eea58d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1312 microversion: 2.1 time: 0.552393 Aug 04 16:34:43.328002 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 311/639] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:42 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1312 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:34:43.652935 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-341f552e-2364-4cbb-b254-ce8e51c955f3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:43.654644 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-341f552e-2364-4cbb-b254-ce8e51c955f3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: b61f1675-928c-4591-8213-474c2bc174be] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:43.671550 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2b48c96f-8666-45a9-a128-896c1e5ce8bb tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:43.673766 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2b48c96f-8666-45a9-a128-896c1e5ce8bb tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 35b3ee83-f946-4c4c-bff9-80b8bd368788] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:43.687273 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-341f552e-2364-4cbb-b254-ce8e51c955f3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:43.688000 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-341f552e-2364-4cbb-b254-ce8e51c955f3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:43.689263 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-341f552e-2364-4cbb-b254-ce8e51c955f3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:43.689845 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-341f552e-2364-4cbb-b254-ce8e51c955f3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:43.694300 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2b48c96f-8666-45a9-a128-896c1e5ce8bb tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:43.694804 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2b48c96f-8666-45a9-a128-896c1e5ce8bb tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:43.695614 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2b48c96f-8666-45a9-a128-896c1e5ce8bb tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:43.696044 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2b48c96f-8666-45a9-a128-896c1e5ce8bb tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:43.744228 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=10 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:34:43.771443 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=24 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:34:44.093328 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2b48c96f-8666-45a9-a128-896c1e5ce8bb tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a732f446814c9fa080979bef241023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f22de02d3e4db281f6372e8191b95f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:44.124798 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2b48c96f-8666-45a9-a128-896c1e5ce8bb tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "GET /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788" status: 200 len: 1324 microversion: 2.1 time: 0.453295 Aug 04 16:34:44.139201 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 312/640] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:43 2022] GET /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788 => generated 1324 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:44.156408 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-660b0cd6-bfd5-4f41-b78f-a220579de69b tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:44.157167 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-660b0cd6-bfd5-4f41-b78f-a220579de69b tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: a80ed729-9d91-4fba-a785-77d5aeacb767] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:44.175588 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-660b0cd6-bfd5-4f41-b78f-a220579de69b tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:44.176061 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-660b0cd6-bfd5-4f41-b78f-a220579de69b tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:44.178582 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-660b0cd6-bfd5-4f41-b78f-a220579de69b tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:44.180476 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-660b0cd6-bfd5-4f41-b78f-a220579de69b tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:44.192382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-341f552e-2364-4cbb-b254-ce8e51c955f3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:44.215097 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-341f552e-2364-4cbb-b254-ce8e51c955f3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:44.222668 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-341f552e-2364-4cbb-b254-ce8e51c955f3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:44.225301 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-341f552e-2364-4cbb-b254-ce8e51c955f3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be" status: 200 len: 1362 microversion: 2.25 time: 0.582435 Aug 04 16:34:44.226430 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 329/641] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:34:43 2022] GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be => generated 1362 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:34:44.353860 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-481b47fd-45b8-45a5-80f2-80ce88091dec tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:44.354933 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-481b47fd-45b8-45a5-80f2-80ce88091dec tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:44.366272 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-481b47fd-45b8-45a5-80f2-80ce88091dec tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:44.366752 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-481b47fd-45b8-45a5-80f2-80ce88091dec tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:44.367608 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-481b47fd-45b8-45a5-80f2-80ce88091dec tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:44.368049 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-481b47fd-45b8-45a5-80f2-80ce88091dec tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:44.411947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-660b0cd6-bfd5-4f41-b78f-a220579de69b tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:44.426150 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-660b0cd6-bfd5-4f41-b78f-a220579de69b tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767" status: 200 len: 1310 microversion: 2.1 time: 0.283377 Aug 04 16:34:44.429219 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 313/642] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:44 2022] GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767 => generated 1310 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:44.730406 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-481b47fd-45b8-45a5-80f2-80ce88091dec tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:44.747052 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-481b47fd-45b8-45a5-80f2-80ce88091dec tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1312 microversion: 2.1 time: 0.401460 Aug 04 16:34:44.749158 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 330/643] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:44 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1312 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:34:45.148472 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5c43e9f0-92ea-451b-8ff2-b966e0cb1894 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:45.149788 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5c43e9f0-92ea-451b-8ff2-b966e0cb1894 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 35b3ee83-f946-4c4c-bff9-80b8bd368788] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:45.163179 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5c43e9f0-92ea-451b-8ff2-b966e0cb1894 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:45.167629 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5c43e9f0-92ea-451b-8ff2-b966e0cb1894 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:45.168801 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5c43e9f0-92ea-451b-8ff2-b966e0cb1894 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:45.171729 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5c43e9f0-92ea-451b-8ff2-b966e0cb1894 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:45.371946 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-de46d9bf-8a56-46ea-b778-df39256fbabd tempest-FloatingIPDetailsNegativeTestJSON-1820252150 tempest-FloatingIPDetailsNegativeTestJSON-1820252150-project] Calling method '.version_select at 0x7f7e846309d0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:45.559079 n-d-846466-12 devstack@n-api.service[126125]: DEBUG neutronclient.v2_0.client [None req-de46d9bf-8a56-46ea-b778-df39256fbabd tempest-FloatingIPDetailsNegativeTestJSON-1820252150 tempest-FloatingIPDetailsNegativeTestJSON-1820252150-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 88e7b0a9-0266-4e20-91a9-1a51de051788 could not be found", "detail": ""}} {{(pid=126125) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:34:45.561066 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-de46d9bf-8a56-46ea-b778-df39256fbabd tempest-FloatingIPDetailsNegativeTestJSON-1820252150 tempest-FloatingIPDetailsNegativeTestJSON-1820252150-project] HTTP exception thrown: Floating IP not found for ID 88e7b0a9-0266-4e20-91a9-1a51de051788 Aug 04 16:34:45.576751 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-de46d9bf-8a56-46ea-b778-df39256fbabd tempest-FloatingIPDetailsNegativeTestJSON-1820252150 tempest-FloatingIPDetailsNegativeTestJSON-1820252150-project] Request method failure captured: Aug 04 16:34:45.576751 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/os-floating-ips/88e7b0a9-0266-4e20-91a9-1a51de051788 HTTP/1.1 Aug 04 16:34:45.576751 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:34:45.576751 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:34:45.576751 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:34:45.576751 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:34:45.576751 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:34:45.576751 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:34:45.576751 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:34:45.576751 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:34:45.576751 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_Uko1sWB1aZipapAQc0x3BvpXNj5OgzHu0XOAkHB4P1queX37Mt_UjogMDfVb5f0DE2jmrjurpM-lSL1nrkkWEmSutaV1iG29oPHgCdPytgOvPiRCs0sKlG9QxfzmtFknPyDzy0eXMXzBCpeZTdVHlkj6doleCzm0Te-lky63lWZjA Aug 04 16:34:45.576751 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:34:45.576751 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:34:45.576751 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:34:45.576751 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:34:45.576751 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:34:45.576751 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:34:45.576751 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: a9823901e54b4d59a661d8fda3ca215a Aug 04 16:34:45.576751 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1820252150 Aug 04 16:34:45.576751 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:34:45.576751 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:34:45.578142 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a9823901e54b4d59a661d8fda3ca215a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a9823901e54b4d59a661d8fda3ca215a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a9823901e54b4d59a661d8fda3ca215a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a9823901e54b4d59a661d8fda3ca215a"}]}] Aug 04 16:34:45.578142 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1820252150 Aug 04 16:34:45.578142 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: a9823901e54b4d59a661d8fda3ca215a Aug 04 16:34:45.578142 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1820252150 Aug 04 16:34:45.578142 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1820252150-project Aug 04 16:34:45.578142 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:34:45.578142 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:34:45.578142 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: cf5f1abd43754d179d176bfb054cd622 Aug 04 16:34:45.578142 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1820252150-project Aug 04 16:34:45.578142 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:34:45.578142 n-d-846466-12 devstack@n-api.service[126125]: exception: Floating IP not found for ID 88e7b0a9-0266-4e20-91a9-1a51de051788 Aug 04 16:34:45.578142 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '88e7b0a9-0266-4e20-91a9-1a51de051788'} Aug 04 16:34:45.578942 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:34:45.578942 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:45.578942 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 04 16:34:45.578942 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 04 16:34:45.578942 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:34:45.578942 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:34:45.578942 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 04 16:34:45.578942 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 04 16:34:45.578942 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:34:45.578942 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:34:45.578942 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 16:34:45.578942 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 16:34:45.578942 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:34:45.578942 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:34:45.578942 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:34:45.578942 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:34:45.578942 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:34:45.578942 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:34:45.578942 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:34:45.580145 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:34:45.580145 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:34:45.580145 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:34:45.580145 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:34:45.580145 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:34:45.580145 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:34:45.580145 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:34:45.580145 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 88e7b0a9-0266-4e20-91a9-1a51de051788 could not be found Aug 04 16:34:45.580145 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b631ab60-6569-40eb-b954-76cec30b6b6a'] Aug 04 16:34:45.580145 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:45.580145 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:45.580145 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:45.580145 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:45.580145 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 04 16:34:45.580145 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 04 16:34:45.580145 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 04 16:34:45.580145 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 04 16:34:45.580145 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 88e7b0a9-0266-4e20-91a9-1a51de051788. Aug 04 16:34:45.580145 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:45.584894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:45.584894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:45.584894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:45.584894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:45.584894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:45.584894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:34:45.584894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:34:45.584894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:34:45.584894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:34:45.584894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:34:45.584894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:34:45.584894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 04 16:34:45.584894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 16:34:45.584894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 88e7b0a9-0266-4e20-91a9-1a51de051788 Aug 04 16:34:45.584894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:45.584894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:45.584894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:45.584894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:45.584894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:45.584894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:45.584894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:34:45.589360 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:34:45.589360 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 88e7b0a9-0266-4e20-91a9-1a51de051788 Aug 04 16:34:45.589360 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:45.589360 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-de46d9bf-8a56-46ea-b778-df39256fbabd tempest-FloatingIPDetailsNegativeTestJSON-1820252150 tempest-FloatingIPDetailsNegativeTestJSON-1820252150-project] Returning 404 to user: Floating IP not found for ID 88e7b0a9-0266-4e20-91a9-1a51de051788 {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:34:45.589360 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-de46d9bf-8a56-46ea-b778-df39256fbabd tempest-FloatingIPDetailsNegativeTestJSON-1820252150 tempest-FloatingIPDetailsNegativeTestJSON-1820252150-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/88e7b0a9-0266-4e20-91a9-1a51de051788" status: 404 len: 111 microversion: 2.1 time: 0.615948 Aug 04 16:34:45.589360 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 314/644] 10.222.0.23 () {58 vars in 1260 bytes} [Thu Aug 4 16:34:44 2022] GET /compute/v2.1/os-floating-ips/88e7b0a9-0266-4e20-91a9-1a51de051788 => generated 111 bytes in 618 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:34:45.590599 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9abf2599-3be0-4441-a596-57351fc21560 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:45.591582 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9abf2599-3be0-4441-a596-57351fc21560 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: b61f1675-928c-4591-8213-474c2bc174be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:45.604186 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9abf2599-3be0-4441-a596-57351fc21560 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:45.604633 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9abf2599-3be0-4441-a596-57351fc21560 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:45.617599 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9abf2599-3be0-4441-a596-57351fc21560 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:45.618633 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9abf2599-3be0-4441-a596-57351fc21560 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:45.842847 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5c43e9f0-92ea-451b-8ff2-b966e0cb1894 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a732f446814c9fa080979bef241023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f22de02d3e4db281f6372e8191b95f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:45.859929 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5c43e9f0-92ea-451b-8ff2-b966e0cb1894 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "GET /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788" status: 200 len: 1324 microversion: 2.1 time: 0.717147 Aug 04 16:34:45.873145 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 331/645] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:45 2022] GET /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788 => generated 1324 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:45.873145 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e3c72105-b0b8-4953-85f5-28cc937ea985 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:45.873145 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e3c72105-b0b8-4953-85f5-28cc937ea985 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: a80ed729-9d91-4fba-a785-77d5aeacb767] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:45.895491 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e3c72105-b0b8-4953-85f5-28cc937ea985 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:45.895948 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e3c72105-b0b8-4953-85f5-28cc937ea985 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:45.897348 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e3c72105-b0b8-4953-85f5-28cc937ea985 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:45.897348 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e3c72105-b0b8-4953-85f5-28cc937ea985 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:46.009974 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9abf2599-3be0-4441-a596-57351fc21560 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:46.019239 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9abf2599-3be0-4441-a596-57351fc21560 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:46.035056 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9abf2599-3be0-4441-a596-57351fc21560 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:46.042250 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9abf2599-3be0-4441-a596-57351fc21560 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be" status: 200 len: 1557 microversion: 2.25 time: 0.462323 Aug 04 16:34:46.043128 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 315/646] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:34:45 2022] GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be => generated 1557 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:34:46.058320 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3d9d6cbc-ea0d-425f-8e4d-d48880ce1304 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:46.059561 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3d9d6cbc-ea0d-425f-8e4d-d48880ce1304 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:46.081795 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3d9d6cbc-ea0d-425f-8e4d-d48880ce1304 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:46.082700 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3d9d6cbc-ea0d-425f-8e4d-d48880ce1304 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:46.087482 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3d9d6cbc-ea0d-425f-8e4d-d48880ce1304 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:46.091833 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3d9d6cbc-ea0d-425f-8e4d-d48880ce1304 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:46.452438 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3d9d6cbc-ea0d-425f-8e4d-d48880ce1304 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:46.469757 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3d9d6cbc-ea0d-425f-8e4d-d48880ce1304 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1312 microversion: 2.1 time: 0.420657 Aug 04 16:34:46.473194 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e3c72105-b0b8-4953-85f5-28cc937ea985 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:46.480831 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 316/647] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:46 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1312 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:46.491353 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e3c72105-b0b8-4953-85f5-28cc937ea985 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767" status: 200 len: 1310 microversion: 2.1 time: 0.621505 Aug 04 16:34:46.491839 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-f7eb89b9-ca42-49f8-b8f8-8e1c9c431365 req-1ffc2e1a-0c64-4a30-bfdc-f67054055e74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a33abce-4d0a-4919-94db-28cea706d412", "name": "network-vif-plugged", "status": "completed", "tag": "e1d80942-af44-4bef-a238-f9fca1aa7ddf"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:46.493184 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 332/648] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:45 2022] GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767 => generated 1310 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:46.507283 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-f7eb89b9-ca42-49f8-b8f8-8e1c9c431365 req-1ffc2e1a-0c64-4a30-bfdc-f67054055e74 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:46.507728 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-f7eb89b9-ca42-49f8-b8f8-8e1c9c431365 req-1ffc2e1a-0c64-4a30-bfdc-f67054055e74 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:46.528714 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-f7eb89b9-ca42-49f8-b8f8-8e1c9c431365 req-1ffc2e1a-0c64-4a30-bfdc-f67054055e74 service nova] Creating event network-vif-plugged:e1d80942-af44-4bef-a238-f9fca1aa7ddf for instance 5a33abce-4d0a-4919-94db-28cea706d412 on n-h1-846466-12 Aug 04 16:34:46.538202 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-f7eb89b9-ca42-49f8-b8f8-8e1c9c431365 req-1ffc2e1a-0c64-4a30-bfdc-f67054055e74 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054293 Aug 04 16:34:46.541441 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 317/649] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:46.548213 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-75e7a7d2-fcbd-409b-ae26-0dde60b56b85 req-40c90f0d-b730-4b7a-b62f-3028d6d181c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a80ed729-9d91-4fba-a785-77d5aeacb767", "tag": "79848b85-9a77-47be-a4af-fb28446f2cd4"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:46.575050 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-75e7a7d2-fcbd-409b-ae26-0dde60b56b85 req-40c90f0d-b730-4b7a-b62f-3028d6d181c3 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:46.576528 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-75e7a7d2-fcbd-409b-ae26-0dde60b56b85 req-40c90f0d-b730-4b7a-b62f-3028d6d181c3 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:46.604074 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-75e7a7d2-fcbd-409b-ae26-0dde60b56b85 req-40c90f0d-b730-4b7a-b62f-3028d6d181c3 service nova] Creating event network-changed:79848b85-9a77-47be-a4af-fb28446f2cd4 for instance a80ed729-9d91-4fba-a785-77d5aeacb767 on n-h1-846466-12 Aug 04 16:34:46.624945 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-75e7a7d2-fcbd-409b-ae26-0dde60b56b85 req-40c90f0d-b730-4b7a-b62f-3028d6d181c3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081831 Aug 04 16:34:46.626734 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 318/650] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:46.775015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-14122d84-7e65-44e4-a76f-291e8eef9814 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-244988324", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": "none"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:46.796718 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:34:46.838070 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-05f8b55c-d031-46d2-af78-68bf043b5480 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:46.838778 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-05f8b55c-d031-46d2-af78-68bf043b5480 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] [instance: b61f1675-928c-4591-8213-474c2bc174be] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:46.845802 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-05f8b55c-d031-46d2-af78-68bf043b5480 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:46.846659 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-05f8b55c-d031-46d2-af78-68bf043b5480 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:46.847352 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-05f8b55c-d031-46d2-af78-68bf043b5480 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:46.847889 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-05f8b55c-d031-46d2-af78-68bf043b5480 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:46.877206 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-14122d84-7e65-44e4-a76f-291e8eef9814 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:34:46.877206 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-14122d84-7e65-44e4-a76f-291e8eef9814 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:34:46.877206 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-14122d84-7e65-44e4-a76f-291e8eef9814 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:34:46.879179 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-14122d84-7e65-44e4-a76f-291e8eef9814 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:34:46.879708 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-14122d84-7e65-44e4-a76f-291e8eef9814 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:34:46.905185 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14122d84-7e65-44e4-a76f-291e8eef9814 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:46.905839 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14122d84-7e65-44e4-a76f-291e8eef9814 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:46.906743 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14122d84-7e65-44e4-a76f-291e8eef9814 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:46.907175 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14122d84-7e65-44e4-a76f-291e8eef9814 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:46.973690 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-14122d84-7e65-44e4-a76f-291e8eef9814 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Getting quotas for project b17b02d81b3c4cb59e0e48ca9af08e3b. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:34:46.990729 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-14122d84-7e65-44e4-a76f-291e8eef9814 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Getting quotas for user cf14182a3e94485395968d3fb3f4d97a and project b17b02d81b3c4cb59e0e48ca9af08e3b. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:34:47.030040 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-14122d84-7e65-44e4-a76f-291e8eef9814 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:34:47.033351 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-14122d84-7e65-44e4-a76f-291e8eef9814 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:34:47.078478 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-05f8b55c-d031-46d2-af78-68bf043b5480 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lazy-loading 'services' on Instance uuid b61f1675-928c-4591-8213-474c2bc174be {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:34:47.105216 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-14122d84-7e65-44e4-a76f-291e8eef9814 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.431021 Aug 04 16:34:47.107372 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 319/651] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Aug 4 16:34:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 435 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 16:34:47.121071 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a798cb03-25e0-49c7-8a7f-4cc86758a461 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:47.122072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a798cb03-25e0-49c7-8a7f-4cc86758a461 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 35b3ee83-f946-4c4c-bff9-80b8bd368788] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:47.138840 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a798cb03-25e0-49c7-8a7f-4cc86758a461 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:47.139576 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a798cb03-25e0-49c7-8a7f-4cc86758a461 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:47.141219 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a798cb03-25e0-49c7-8a7f-4cc86758a461 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:47.144849 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a798cb03-25e0-49c7-8a7f-4cc86758a461 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:47.197671 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-05f8b55c-d031-46d2-af78-68bf043b5480 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be" status: 200 len: 2052 microversion: 2.25 time: 0.702946 Aug 04 16:34:47.199657 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 333/652] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:34:46 2022] GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be => generated 2052 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:34:47.213217 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bdae1791-ce53-4467-a1c0-018d47544e86 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:47.227510 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bdae1791-ce53-4467-a1c0-018d47544e86 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:47.249859 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:34:47.437132 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bdae1791-ce53-4467-a1c0-018d47544e86 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:47.449234 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bdae1791-ce53-4467-a1c0-018d47544e86 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:47.450908 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bdae1791-ce53-4467-a1c0-018d47544e86 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:47.471616 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bdae1791-ce53-4467-a1c0-018d47544e86 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] 10.222.0.23 "PUT /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1358 microversion: 2.75 time: 0.263802 Aug 04 16:34:47.472708 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 334/653] 10.222.0.23 () {62 vars in 1297 bytes} [Thu Aug 4 16:34:47 2022] PUT /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1358 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:34:47.478450 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bef76ab6-f929-44ef-abf0-df42e3613146 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:47.479274 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bef76ab6-f929-44ef-abf0-df42e3613146 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] [instance: b61f1675-928c-4591-8213-474c2bc174be] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:47.500345 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bef76ab6-f929-44ef-abf0-df42e3613146 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:47.501159 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bef76ab6-f929-44ef-abf0-df42e3613146 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:47.504740 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bef76ab6-f929-44ef-abf0-df42e3613146 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:47.506764 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bef76ab6-f929-44ef-abf0-df42e3613146 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:47.511226 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a798cb03-25e0-49c7-8a7f-4cc86758a461 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a732f446814c9fa080979bef241023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f22de02d3e4db281f6372e8191b95f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:47.548432 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a798cb03-25e0-49c7-8a7f-4cc86758a461 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "GET /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788" status: 200 len: 1324 microversion: 2.1 time: 0.429537 Aug 04 16:34:47.549985 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 320/654] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:47 2022] GET /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788 => generated 1324 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:47.560181 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1704dc34-4a7d-4377-9dc7-86215edf6b9c tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:47.565252 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1704dc34-4a7d-4377-9dc7-86215edf6b9c tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:47.577163 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1704dc34-4a7d-4377-9dc7-86215edf6b9c tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:47.577887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1704dc34-4a7d-4377-9dc7-86215edf6b9c tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:47.578865 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1704dc34-4a7d-4377-9dc7-86215edf6b9c tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:47.579640 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1704dc34-4a7d-4377-9dc7-86215edf6b9c tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:48.303653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:34:48.398436 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-bef76ab6-f929-44ef-abf0-df42e3613146 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lazy-loading 'services' on Instance uuid b61f1675-928c-4591-8213-474c2bc174be {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:34:48.401251 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1704dc34-4a7d-4377-9dc7-86215edf6b9c tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:48.415404 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1704dc34-4a7d-4377-9dc7-86215edf6b9c tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1312 microversion: 2.1 time: 0.863512 Aug 04 16:34:48.417773 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 321/655] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:47 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1312 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:48.427318 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9ce79b46-57f8-42b2-8eaf-97a4cbdcd70c tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:48.428340 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9ce79b46-57f8-42b2-8eaf-97a4cbdcd70c tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:48.439367 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9ce79b46-57f8-42b2-8eaf-97a4cbdcd70c tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:48.440324 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9ce79b46-57f8-42b2-8eaf-97a4cbdcd70c tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:48.441817 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bef76ab6-f929-44ef-abf0-df42e3613146 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be" status: 200 len: 2052 microversion: 2.25 time: 0.967756 Aug 04 16:34:48.442409 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9ce79b46-57f8-42b2-8eaf-97a4cbdcd70c tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:48.443184 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9ce79b46-57f8-42b2-8eaf-97a4cbdcd70c tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:48.466560 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 335/656] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:34:47 2022] GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be => generated 2052 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:34:48.476353 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f6ddcf86-1d2d-476f-9d4b-c4a75a43d845 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:48.477220 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f6ddcf86-1d2d-476f-9d4b-c4a75a43d845 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: a80ed729-9d91-4fba-a785-77d5aeacb767] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:48.486453 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6ddcf86-1d2d-476f-9d4b-c4a75a43d845 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:48.487081 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6ddcf86-1d2d-476f-9d4b-c4a75a43d845 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:48.487998 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6ddcf86-1d2d-476f-9d4b-c4a75a43d845 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:48.488665 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6ddcf86-1d2d-476f-9d4b-c4a75a43d845 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:48.599519 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=100 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:34:48.721611 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9ce79b46-57f8-42b2-8eaf-97a4cbdcd70c tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:48.752142 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9ce79b46-57f8-42b2-8eaf-97a4cbdcd70c tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:48.756912 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9ce79b46-57f8-42b2-8eaf-97a4cbdcd70c tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:48.761423 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f6ddcf86-1d2d-476f-9d4b-c4a75a43d845 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:48.769988 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f6ddcf86-1d2d-476f-9d4b-c4a75a43d845 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767" status: 200 len: 1310 microversion: 2.1 time: 0.302206 Aug 04 16:34:48.776118 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9ce79b46-57f8-42b2-8eaf-97a4cbdcd70c tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1410 microversion: 2.75 time: 0.356284 Aug 04 16:34:48.779446 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 322/657] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:34:48 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1410 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:34:48.784874 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 336/658] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:48 2022] GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767 => generated 1310 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:48.789188 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f1c969f7-36d3-4563-a3e1-55455eac906c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:48.790312 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1afe96d2-4020-4292-962d-a69b2c320c03 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:48.793160 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f1c969f7-36d3-4563-a3e1-55455eac906c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: f8497465-98e6-46f0-bd09-11c432c292a1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:48.793501 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:34:48.793501 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:34:48.795169 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1afe96d2-4020-4292-962d-a69b2c320c03 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:48.795765 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1afe96d2-4020-4292-962d-a69b2c320c03 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:48.796823 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1afe96d2-4020-4292-962d-a69b2c320c03 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:48.798190 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1afe96d2-4020-4292-962d-a69b2c320c03 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:48.823595 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f1c969f7-36d3-4563-a3e1-55455eac906c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:48.825578 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f1c969f7-36d3-4563-a3e1-55455eac906c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:48.826415 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f1c969f7-36d3-4563-a3e1-55455eac906c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:48.826852 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f1c969f7-36d3-4563-a3e1-55455eac906c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:48.827993 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1afe96d2-4020-4292-962d-a69b2c320c03 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.041584 Aug 04 16:34:48.828855 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 337/659] 10.222.0.23 () {60 vars in 1217 bytes} [Thu Aug 4 16:34:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:34:48.854913 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-01847afc-35b9-4e66-8712-4fc60620b061 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:48.857729 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-01847afc-35b9-4e66-8712-4fc60620b061 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 35b3ee83-f946-4c4c-bff9-80b8bd368788] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:48.868788 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-01847afc-35b9-4e66-8712-4fc60620b061 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:48.869446 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-01847afc-35b9-4e66-8712-4fc60620b061 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:48.871049 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-01847afc-35b9-4e66-8712-4fc60620b061 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:48.871487 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-01847afc-35b9-4e66-8712-4fc60620b061 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:48.891331 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f1c969f7-36d3-4563-a3e1-55455eac906c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: f8497465-98e6-46f0-bd09-11c432c292a1] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:34:49.085443 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f1c969f7-36d3-4563-a3e1-55455eac906c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1" status: 204 len: 0 microversion: 2.1 time: 0.301273 Aug 04 16:34:49.087954 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 323/660] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:34:48 2022] DELETE /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:34:49.098411 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b8d63e63-4ff2-4946-9279-968e10fd5565 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-846466-12", "block_migration": "auto"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:49.102843 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b8d63e63-4ff2-4946-9279-968e10fd5565 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] [instance: b61f1675-928c-4591-8213-474c2bc174be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:49.112272 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8d63e63-4ff2-4946-9279-968e10fd5565 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:49.112981 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8d63e63-4ff2-4946-9279-968e10fd5565 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:49.113645 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8d63e63-4ff2-4946-9279-968e10fd5565 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:49.114199 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8d63e63-4ff2-4946-9279-968e10fd5565 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:49.139587 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-01847afc-35b9-4e66-8712-4fc60620b061 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a732f446814c9fa080979bef241023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f22de02d3e4db281f6372e8191b95f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:49.157995 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-01847afc-35b9-4e66-8712-4fc60620b061 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "GET /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788" status: 200 len: 1324 microversion: 2.1 time: 0.322291 Aug 04 16:34:49.159828 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 338/661] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:48 2022] GET /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788 => generated 1324 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:49.166997 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-66d128a6-578f-4f60-8aa5-8e7e6e24f09c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:49.168003 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-66d128a6-578f-4f60-8aa5-8e7e6e24f09c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: f8497465-98e6-46f0-bd09-11c432c292a1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:49.176889 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-66d128a6-578f-4f60-8aa5-8e7e6e24f09c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:49.177960 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-66d128a6-578f-4f60-8aa5-8e7e6e24f09c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:49.178986 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-66d128a6-578f-4f60-8aa5-8e7e6e24f09c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:49.179576 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-66d128a6-578f-4f60-8aa5-8e7e6e24f09c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:49.194372 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-b8d63e63-4ff2-4946-9279-968e10fd5565 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lazy-loading 'flavor' on Instance uuid b61f1675-928c-4591-8213-474c2bc174be {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:34:49.246450 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b8d63e63-4ff2-4946-9279-968e10fd5565 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] [instance: b61f1675-928c-4591-8213-474c2bc174be] Going to try to live migrate instance to n-h1-846466-12 {{(pid=126125) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 16:34:49.489020 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-66d128a6-578f-4f60-8aa5-8e7e6e24f09c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a427fb7481d4799a83729910f33b01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd96a8c91974b8ba7919d5349f380ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:49.507207 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-66d128a6-578f-4f60-8aa5-8e7e6e24f09c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1" status: 200 len: 1712 microversion: 2.1 time: 0.345939 Aug 04 16:34:49.522158 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 339/662] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:49 2022] GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1 => generated 1712 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:49.529701 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6e8fc2a1-ac76-4cdb-9ca8-f9fbb81336f5 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:49.530872 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6e8fc2a1-ac76-4cdb-9ca8-f9fbb81336f5 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:49.539590 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e8fc2a1-ac76-4cdb-9ca8-f9fbb81336f5 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:49.540307 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e8fc2a1-ac76-4cdb-9ca8-f9fbb81336f5 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:49.541436 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e8fc2a1-ac76-4cdb-9ca8-f9fbb81336f5 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:49.542028 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e8fc2a1-ac76-4cdb-9ca8-f9fbb81336f5 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:49.759336 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6e8fc2a1-ac76-4cdb-9ca8-f9fbb81336f5 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:49.762593 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=100 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:34:49.771173 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6e8fc2a1-ac76-4cdb-9ca8-f9fbb81336f5 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1461 microversion: 2.1 time: 0.247280 Aug 04 16:34:49.772915 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 340/663] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:49 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1461 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:49.792756 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-424cc9f9-09cc-46fb-b924-cad277969205 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:49.795398 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-424cc9f9-09cc-46fb-b924-cad277969205 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: a80ed729-9d91-4fba-a785-77d5aeacb767] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:49.805335 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-424cc9f9-09cc-46fb-b924-cad277969205 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:49.806061 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-424cc9f9-09cc-46fb-b924-cad277969205 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:49.807215 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-424cc9f9-09cc-46fb-b924-cad277969205 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:49.808242 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-424cc9f9-09cc-46fb-b924-cad277969205 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:49.988127 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-424cc9f9-09cc-46fb-b924-cad277969205 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:49.996521 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-424cc9f9-09cc-46fb-b924-cad277969205 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767" status: 200 len: 1310 microversion: 2.1 time: 0.207950 Aug 04 16:34:50.006108 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 341/664] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:49 2022] GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767 => generated 1310 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:34:50.186684 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f63ebb5d-fc30-4c75-9144-0109ff9f8edf tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:50.187361 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f63ebb5d-fc30-4c75-9144-0109ff9f8edf tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:50.196303 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f63ebb5d-fc30-4c75-9144-0109ff9f8edf tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:50.197790 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f63ebb5d-fc30-4c75-9144-0109ff9f8edf tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:50.199468 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f63ebb5d-fc30-4c75-9144-0109ff9f8edf tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:50.202334 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f63ebb5d-fc30-4c75-9144-0109ff9f8edf tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:50.712130 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f63ebb5d-fc30-4c75-9144-0109ff9f8edf tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1614 microversion: 2.1 time: 0.704134 Aug 04 16:34:50.713830 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 342/665] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:50 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1614 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:50.719781 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fee8b065-cb28-4f6f-8859-0cc2854d0efe tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:50.720628 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fee8b065-cb28-4f6f-8859-0cc2854d0efe tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:50.735909 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fee8b065-cb28-4f6f-8859-0cc2854d0efe tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:50.743723 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fee8b065-cb28-4f6f-8859-0cc2854d0efe tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:50.744851 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fee8b065-cb28-4f6f-8859-0cc2854d0efe tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:50.745387 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fee8b065-cb28-4f6f-8859-0cc2854d0efe tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:50.881693 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fee8b065-cb28-4f6f-8859-0cc2854d0efe tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:50.897595 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fee8b065-cb28-4f6f-8859-0cc2854d0efe tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:50.899407 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fee8b065-cb28-4f6f-8859-0cc2854d0efe tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:50.905938 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fee8b065-cb28-4f6f-8859-0cc2854d0efe tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1416 microversion: 2.75 time: 0.190663 Aug 04 16:34:50.906744 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 343/666] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:34:50 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1416 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:34:50.912638 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-6cb5ab37-43ac-4b57-b022-0463555261bf req-eaeba0f8-ca0e-4dbe-a4c1-91180204f4c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b3ee83-f946-4c4c-bff9-80b8bd368788", "name": "network-vif-plugged", "status": "completed", "tag": "88be3f31-89a1-4c97-bc28-c49392694bb7"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:50.924831 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-6cb5ab37-43ac-4b57-b022-0463555261bf req-eaeba0f8-ca0e-4dbe-a4c1-91180204f4c4 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:50.925533 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-6cb5ab37-43ac-4b57-b022-0463555261bf req-eaeba0f8-ca0e-4dbe-a4c1-91180204f4c4 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:50.939997 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-6cb5ab37-43ac-4b57-b022-0463555261bf req-eaeba0f8-ca0e-4dbe-a4c1-91180204f4c4 service nova] Creating event network-vif-plugged:88be3f31-89a1-4c97-bc28-c49392694bb7 for instance 35b3ee83-f946-4c4c-bff9-80b8bd368788 on n-h1-846466-12 Aug 04 16:34:50.947016 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-6cb5ab37-43ac-4b57-b022-0463555261bf req-eaeba0f8-ca0e-4dbe-a4c1-91180204f4c4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038876 Aug 04 16:34:50.948152 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 344/667] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:50.966868 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2a6a3ad1-9739-46e4-9d62-014f4633354a tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:50.968797 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2a6a3ad1-9739-46e4-9d62-014f4633354a tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 35b3ee83-f946-4c4c-bff9-80b8bd368788] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:50.994339 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a6a3ad1-9739-46e4-9d62-014f4633354a tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:50.995292 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a6a3ad1-9739-46e4-9d62-014f4633354a tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:50.996320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a6a3ad1-9739-46e4-9d62-014f4633354a tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:50.997007 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a6a3ad1-9739-46e4-9d62-014f4633354a tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:51.367049 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2a6a3ad1-9739-46e4-9d62-014f4633354a tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a732f446814c9fa080979bef241023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f22de02d3e4db281f6372e8191b95f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:51.383699 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2a6a3ad1-9739-46e4-9d62-014f4633354a tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "GET /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788" status: 200 len: 1324 microversion: 2.1 time: 0.433989 Aug 04 16:34:51.385753 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 345/668] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:50 2022] GET /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788 => generated 1324 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:51.406163 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fcb4807c-2456-45d7-b2df-3fe233999433 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:51.406804 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fcb4807c-2456-45d7-b2df-3fe233999433 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: f8497465-98e6-46f0-bd09-11c432c292a1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:51.432300 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fcb4807c-2456-45d7-b2df-3fe233999433 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:51.438825 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fcb4807c-2456-45d7-b2df-3fe233999433 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:51.438825 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fcb4807c-2456-45d7-b2df-3fe233999433 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:51.440639 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fcb4807c-2456-45d7-b2df-3fe233999433 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:51.734368 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fcb4807c-2456-45d7-b2df-3fe233999433 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a427fb7481d4799a83729910f33b01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd96a8c91974b8ba7919d5349f380ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:51.747745 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fcb4807c-2456-45d7-b2df-3fe233999433 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1" status: 200 len: 1712 microversion: 2.1 time: 0.360705 Aug 04 16:34:51.748341 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 346/669] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:51 2022] GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1 => generated 1712 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:51.760073 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-461096fc-ade3-419c-9e15-5894872920aa tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:51.760073 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-461096fc-ade3-419c-9e15-5894872920aa tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:51.777149 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-461096fc-ade3-419c-9e15-5894872920aa tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:51.784525 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-461096fc-ade3-419c-9e15-5894872920aa tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:51.785496 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-461096fc-ade3-419c-9e15-5894872920aa tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:51.785949 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-461096fc-ade3-419c-9e15-5894872920aa tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:51.863753 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-461096fc-ade3-419c-9e15-5894872920aa tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '59e7b930d8b34ffbaa2c13974ca024cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf192b7f3924c32b45bb63e397ea6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:51.864259 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-461096fc-ade3-419c-9e15-5894872920aa tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] flavor_id is None. Assuming migration. {{(pid=126126) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 04 16:34:51.864694 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-461096fc-ade3-419c-9e15-5894872920aa tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=126126) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 16:34:52.429805 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-461096fc-ade3-419c-9e15-5894872920aa tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412/action" status: 202 len: 0 microversion: 2.1 time: 0.674132 Aug 04 16:34:52.433654 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 347/670] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:34:51 2022] POST /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412/action => generated 0 bytes in 682 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:34:52.443447 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e3cff681-1863-407a-959a-0559c6a692dd tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:52.447609 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e3cff681-1863-407a-959a-0559c6a692dd tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: a80ed729-9d91-4fba-a785-77d5aeacb767] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:52.468326 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e3cff681-1863-407a-959a-0559c6a692dd tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:52.469585 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e3cff681-1863-407a-959a-0559c6a692dd tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:52.472993 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e3cff681-1863-407a-959a-0559c6a692dd tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:52.473477 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e3cff681-1863-407a-959a-0559c6a692dd tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:52.795223 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e3cff681-1863-407a-959a-0559c6a692dd tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:52.809363 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e3cff681-1863-407a-959a-0559c6a692dd tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767" status: 200 len: 1310 microversion: 2.1 time: 0.374984 Aug 04 16:34:52.810279 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 348/671] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:52 2022] GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767 => generated 1310 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:52.822109 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-70880b5e-2695-4668-8546-e6d5c7e04067 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:52.826118 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-70880b5e-2695-4668-8546-e6d5c7e04067 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:52.841020 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70880b5e-2695-4668-8546-e6d5c7e04067 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:52.844668 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70880b5e-2695-4668-8546-e6d5c7e04067 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:52.845694 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70880b5e-2695-4668-8546-e6d5c7e04067 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:52.847130 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70880b5e-2695-4668-8546-e6d5c7e04067 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:53.000165 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-70880b5e-2695-4668-8546-e6d5c7e04067 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:53.020627 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-70880b5e-2695-4668-8546-e6d5c7e04067 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:53.022158 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-70880b5e-2695-4668-8546-e6d5c7e04067 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:53.027694 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-70880b5e-2695-4668-8546-e6d5c7e04067 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1437 microversion: 2.75 time: 0.214821 Aug 04 16:34:53.046792 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 349/672] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:34:52 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1437 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:34:53.046792 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e1297e28-47fa-4de2-873e-032a9aa9deac tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:53.046792 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e1297e28-47fa-4de2-873e-032a9aa9deac tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 35b3ee83-f946-4c4c-bff9-80b8bd368788] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:53.048956 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e1297e28-47fa-4de2-873e-032a9aa9deac tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:53.049510 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e1297e28-47fa-4de2-873e-032a9aa9deac tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:53.050248 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e1297e28-47fa-4de2-873e-032a9aa9deac tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:53.050673 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e1297e28-47fa-4de2-873e-032a9aa9deac tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:53.322440 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e1297e28-47fa-4de2-873e-032a9aa9deac tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a732f446814c9fa080979bef241023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f22de02d3e4db281f6372e8191b95f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:53.331103 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e1297e28-47fa-4de2-873e-032a9aa9deac tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "GET /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788" status: 200 len: 1521 microversion: 2.1 time: 0.301523 Aug 04 16:34:53.331982 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 350/673] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:53 2022] GET /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788 => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:53.336937 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dd8b216f-822e-464f-9804-5c2eb55af51a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:53.351948 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-dd8b216f-822e-464f-9804-5c2eb55af51a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:53.361165 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd8b216f-822e-464f-9804-5c2eb55af51a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:53.361831 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd8b216f-822e-464f-9804-5c2eb55af51a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:53.362994 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd8b216f-822e-464f-9804-5c2eb55af51a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:53.363428 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd8b216f-822e-464f-9804-5c2eb55af51a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:53.667781 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b8d63e63-4ff2-4946-9279-968e10fd5565 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be/action" status: 202 len: 0 microversion: 2.25 time: 4.578170 Aug 04 16:34:53.669509 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 324/674] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Aug 4 16:34:49 2022] POST /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be/action => generated 0 bytes in 4581 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:34:53.676667 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-61c0b6d2-2b16-4969-8934-a90eae5cbb4c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:53.678005 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-61c0b6d2-2b16-4969-8934-a90eae5cbb4c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: f8497465-98e6-46f0-bd09-11c432c292a1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:53.706909 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-61c0b6d2-2b16-4969-8934-a90eae5cbb4c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:53.712550 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-61c0b6d2-2b16-4969-8934-a90eae5cbb4c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:53.713958 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-61c0b6d2-2b16-4969-8934-a90eae5cbb4c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:53.715105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-61c0b6d2-2b16-4969-8934-a90eae5cbb4c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:53.878328 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-61c0b6d2-2b16-4969-8934-a90eae5cbb4c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a427fb7481d4799a83729910f33b01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd96a8c91974b8ba7919d5349f380ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:53.903098 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-61c0b6d2-2b16-4969-8934-a90eae5cbb4c tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1" status: 200 len: 1644 microversion: 2.1 time: 0.231908 Aug 04 16:34:53.904727 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 325/675] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:53 2022] GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1 => generated 1644 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:53.913259 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-31899804-7130-4088-ac2c-af882b09d664 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:53.917378 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-31899804-7130-4088-ac2c-af882b09d664 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:53.926165 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-31899804-7130-4088-ac2c-af882b09d664 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:53.927072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-31899804-7130-4088-ac2c-af882b09d664 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:53.928106 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-31899804-7130-4088-ac2c-af882b09d664 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:53.929796 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-31899804-7130-4088-ac2c-af882b09d664 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:54.062432 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-dd8b216f-822e-464f-9804-5c2eb55af51a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:54.072909 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-31899804-7130-4088-ac2c-af882b09d664 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:34:54.073185 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dd8b216f-822e-464f-9804-5c2eb55af51a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1470 microversion: 2.1 time: 0.740129 Aug 04 16:34:54.075839 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-31899804-7130-4088-ac2c-af882b09d664 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:34:54.076763 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-31899804-7130-4088-ac2c-af882b09d664 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:34:54.077071 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-31899804-7130-4088-ac2c-af882b09d664 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:34:54.077257 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 351/676] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:53 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1470 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:54.094320 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-31899804-7130-4088-ac2c-af882b09d664 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:34:54.094612 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2746826f-f3b2-4c8f-975b-732598043cd5 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Action: 'create', calling method: .version_select at 0x7f7e85016af0>, body: {"pool": null} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:54.206927 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-31899804-7130-4088-ac2c-af882b09d664 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:54.214857 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-31899804-7130-4088-ac2c-af882b09d664 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:54.215416 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-31899804-7130-4088-ac2c-af882b09d664 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:54.216758 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-31899804-7130-4088-ac2c-af882b09d664 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:54.217254 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-31899804-7130-4088-ac2c-af882b09d664 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:54.356999 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-31899804-7130-4088-ac2c-af882b09d664 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:54.374194 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-31899804-7130-4088-ac2c-af882b09d664 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:54.375699 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-31899804-7130-4088-ac2c-af882b09d664 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:54.392946 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-31899804-7130-4088-ac2c-af882b09d664 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] 10.222.0.23 "POST /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5/action" status: 202 len: 1494 microversion: 2.75 time: 0.485901 Aug 04 16:34:54.393876 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 326/677] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Aug 4 16:34:53 2022] POST /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5/action => generated 1494 bytes in 488 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 04 16:34:54.400928 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-3ae9cc28-81b3-4fec-a14c-37c736a8b1dc req-3d007c67-fc6b-46c7-ab67-a6580d8bb71f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a80ed729-9d91-4fba-a785-77d5aeacb767", "name": "network-vif-plugged", "status": "completed", "tag": "79848b85-9a77-47be-a4af-fb28446f2cd4"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:54.413227 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-3ae9cc28-81b3-4fec-a14c-37c736a8b1dc req-3d007c67-fc6b-46c7-ab67-a6580d8bb71f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:54.413994 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-3ae9cc28-81b3-4fec-a14c-37c736a8b1dc req-3d007c67-fc6b-46c7-ab67-a6580d8bb71f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:54.433107 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-3ae9cc28-81b3-4fec-a14c-37c736a8b1dc req-3d007c67-fc6b-46c7-ab67-a6580d8bb71f service nova] Creating event network-vif-plugged:79848b85-9a77-47be-a4af-fb28446f2cd4 for instance a80ed729-9d91-4fba-a785-77d5aeacb767 on n-h1-846466-12 Aug 04 16:34:54.443244 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-3ae9cc28-81b3-4fec-a14c-37c736a8b1dc req-3d007c67-fc6b-46c7-ab67-a6580d8bb71f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047938 Aug 04 16:34:54.444088 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 327/678] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:54.452431 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c82bcd45-6475-4507-a684-130593998f87 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:54.453331 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c82bcd45-6475-4507-a684-130593998f87 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: b61f1675-928c-4591-8213-474c2bc174be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:54.460858 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c82bcd45-6475-4507-a684-130593998f87 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:54.461661 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c82bcd45-6475-4507-a684-130593998f87 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:54.463133 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c82bcd45-6475-4507-a684-130593998f87 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:54.463940 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c82bcd45-6475-4507-a684-130593998f87 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:55.707803 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c82bcd45-6475-4507-a684-130593998f87 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:55.719866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c82bcd45-6475-4507-a684-130593998f87 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:55.723709 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c82bcd45-6475-4507-a684-130593998f87 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:55.733571 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c82bcd45-6475-4507-a684-130593998f87 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be" status: 200 len: 1567 microversion: 2.25 time: 1.287678 Aug 04 16:34:55.745791 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 328/679] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:34:54 2022] GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be => generated 1567 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:34:55.756493 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3b87fe87-7834-44ca-b603-9bb02df6246a tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:55.757110 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3b87fe87-7834-44ca-b603-9bb02df6246a tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: a80ed729-9d91-4fba-a785-77d5aeacb767] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:55.777815 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b87fe87-7834-44ca-b603-9bb02df6246a tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:55.779149 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b87fe87-7834-44ca-b603-9bb02df6246a tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:55.780154 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b87fe87-7834-44ca-b603-9bb02df6246a tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:55.780595 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b87fe87-7834-44ca-b603-9bb02df6246a tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:56.223545 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3b87fe87-7834-44ca-b603-9bb02df6246a tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:56.234551 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3b87fe87-7834-44ca-b603-9bb02df6246a tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767" status: 200 len: 1310 microversion: 2.1 time: 0.487240 Aug 04 16:34:56.238429 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 329/680] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:55 2022] GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767 => generated 1310 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:56.248041 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6a5b0138-4ed9-4ed7-ad64-a29ed478622a tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:56.249101 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6a5b0138-4ed9-4ed7-ad64-a29ed478622a tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:56.260513 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a5b0138-4ed9-4ed7-ad64-a29ed478622a tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:56.261202 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a5b0138-4ed9-4ed7-ad64-a29ed478622a tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:56.262236 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a5b0138-4ed9-4ed7-ad64-a29ed478622a tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:56.266214 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a5b0138-4ed9-4ed7-ad64-a29ed478622a tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:56.469260 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6a5b0138-4ed9-4ed7-ad64-a29ed478622a tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:56.478885 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6a5b0138-4ed9-4ed7-ad64-a29ed478622a tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:56.480404 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6a5b0138-4ed9-4ed7-ad64-a29ed478622a tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:56.505239 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6a5b0138-4ed9-4ed7-ad64-a29ed478622a tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1446 microversion: 2.75 time: 0.262970 Aug 04 16:34:56.506715 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 330/681] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:34:56 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1446 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:34:56.518761 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0d17d3dc-a85e-4d34-ae5b-36979abd054f tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:56.519800 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0d17d3dc-a85e-4d34-ae5b-36979abd054f tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: f8497465-98e6-46f0-bd09-11c432c292a1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:56.526974 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0d17d3dc-a85e-4d34-ae5b-36979abd054f tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:56.532159 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0d17d3dc-a85e-4d34-ae5b-36979abd054f tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:56.533406 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0d17d3dc-a85e-4d34-ae5b-36979abd054f tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:56.534056 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0d17d3dc-a85e-4d34-ae5b-36979abd054f tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:56.596995 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0d17d3dc-a85e-4d34-ae5b-36979abd054f tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:56.597769 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0d17d3dc-a85e-4d34-ae5b-36979abd054f tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:56.598379 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-0d17d3dc-a85e-4d34-ae5b-36979abd054f tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lazy-loading 'fault' on Instance uuid f8497465-98e6-46f0-bd09-11c432c292a1 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:34:56.765158 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0d17d3dc-a85e-4d34-ae5b-36979abd054f tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a427fb7481d4799a83729910f33b01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd96a8c91974b8ba7919d5349f380ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:56.775888 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0d17d3dc-a85e-4d34-ae5b-36979abd054f tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1" status: 200 len: 1354 microversion: 2.1 time: 0.267587 Aug 04 16:34:56.781129 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 331/682] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:56 2022] GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1 => generated 1354 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:56.788294 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fe8e7a5d-ce64-4d4d-a774-81902c3e2ecc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:56.796069 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fe8e7a5d-ce64-4d4d-a774-81902c3e2ecc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:56.804103 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fe8e7a5d-ce64-4d4d-a774-81902c3e2ecc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:56.804579 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fe8e7a5d-ce64-4d4d-a774-81902c3e2ecc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:56.814749 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fe8e7a5d-ce64-4d4d-a774-81902c3e2ecc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:56.815315 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fe8e7a5d-ce64-4d4d-a774-81902c3e2ecc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:56.934926 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:34:57.012128 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:34:57.343747 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fe8e7a5d-ce64-4d4d-a774-81902c3e2ecc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:57.353705 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fe8e7a5d-ce64-4d4d-a774-81902c3e2ecc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1470 microversion: 2.1 time: 0.571321 Aug 04 16:34:57.354305 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 332/683] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:56 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1470 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:57.380232 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-72792591-ace2-4e99-b07c-fe2b46901c0d req-72924c76-1890-4454-92ca-743729231d95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8497465-98e6-46f0-bd09-11c432c292a1", "name": "network-vif-deleted", "tag": "b9b0943e-30ce-4930-b73a-72ae1d9df661"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:57.412361 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-72792591-ace2-4e99-b07c-fe2b46901c0d req-72924c76-1890-4454-92ca-743729231d95 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:57.412984 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-72792591-ace2-4e99-b07c-fe2b46901c0d req-72924c76-1890-4454-92ca-743729231d95 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:57.447168 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=12 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:34:57.482097 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-72792591-ace2-4e99-b07c-fe2b46901c0d req-72924c76-1890-4454-92ca-743729231d95 service nova] Creating event network-vif-deleted:b9b0943e-30ce-4930-b73a-72ae1d9df661 for instance f8497465-98e6-46f0-bd09-11c432c292a1 on n-h2-846466-12 Aug 04 16:34:57.499978 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-72792591-ace2-4e99-b07c-fe2b46901c0d req-72924c76-1890-4454-92ca-743729231d95 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144414 Aug 04 16:34:57.500601 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 333/684] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:57.518090 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-7e61374b-3bef-492a-bd2a-1ba967ca6f1a req-4a383f3d-6cbb-430f-8da4-d76119e983be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b61f1675-928c-4591-8213-474c2bc174be", "name": "network-vif-unplugged", "status": "completed", "tag": "c6da17eb-62d8-4f32-b0fd-b4686bc2423e"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:57.540026 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7e61374b-3bef-492a-bd2a-1ba967ca6f1a req-4a383f3d-6cbb-430f-8da4-d76119e983be service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:57.540675 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7e61374b-3bef-492a-bd2a-1ba967ca6f1a req-4a383f3d-6cbb-430f-8da4-d76119e983be service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:57.557748 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:34:57.560720 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-7e61374b-3bef-492a-bd2a-1ba967ca6f1a req-4a383f3d-6cbb-430f-8da4-d76119e983be service nova] Creating event network-vif-unplugged:c6da17eb-62d8-4f32-b0fd-b4686bc2423e for instance b61f1675-928c-4591-8213-474c2bc174be on n-h2-846466-12 Aug 04 16:34:57.569031 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-7e61374b-3bef-492a-bd2a-1ba967ca6f1a req-4a383f3d-6cbb-430f-8da4-d76119e983be service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066944 Aug 04 16:34:57.571681 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 334/685] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:57.589893 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cabeeec0-30f2-4c3b-9374-811ae528bed4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:57.590946 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cabeeec0-30f2-4c3b-9374-811ae528bed4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: b61f1675-928c-4591-8213-474c2bc174be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:57.621970 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cabeeec0-30f2-4c3b-9374-811ae528bed4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:57.624063 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cabeeec0-30f2-4c3b-9374-811ae528bed4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:57.626090 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cabeeec0-30f2-4c3b-9374-811ae528bed4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:57.626919 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cabeeec0-30f2-4c3b-9374-811ae528bed4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:58.101674 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cabeeec0-30f2-4c3b-9374-811ae528bed4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:58.124785 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cabeeec0-30f2-4c3b-9374-811ae528bed4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:58.127955 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cabeeec0-30f2-4c3b-9374-811ae528bed4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:58.133591 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cabeeec0-30f2-4c3b-9374-811ae528bed4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be" status: 200 len: 1567 microversion: 2.25 time: 0.560451 Aug 04 16:34:58.134594 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 335/686] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:34:57 2022] GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be => generated 1567 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:34:58.142654 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b91b6de8-bf33-4ed2-8b92-21b133d06907 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:58.147646 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b91b6de8-bf33-4ed2-8b92-21b133d06907 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: a80ed729-9d91-4fba-a785-77d5aeacb767] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:58.153134 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b91b6de8-bf33-4ed2-8b92-21b133d06907 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:58.153691 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b91b6de8-bf33-4ed2-8b92-21b133d06907 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:58.158418 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b91b6de8-bf33-4ed2-8b92-21b133d06907 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:58.159231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b91b6de8-bf33-4ed2-8b92-21b133d06907 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:58.418103 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b91b6de8-bf33-4ed2-8b92-21b133d06907 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:58.433809 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b91b6de8-bf33-4ed2-8b92-21b133d06907 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767" status: 200 len: 1493 microversion: 2.1 time: 0.297186 Aug 04 16:34:58.434801 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 336/687] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:58 2022] GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767 => generated 1493 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:58.442272 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f22d0aff-e2ae-46e4-a3d2-7d59e28bef02 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:58.442895 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f22d0aff-e2ae-46e4-a3d2-7d59e28bef02 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:58.461416 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f22d0aff-e2ae-46e4-a3d2-7d59e28bef02 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:58.462131 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f22d0aff-e2ae-46e4-a3d2-7d59e28bef02 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:58.463110 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f22d0aff-e2ae-46e4-a3d2-7d59e28bef02 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:58.463706 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f22d0aff-e2ae-46e4-a3d2-7d59e28bef02 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:58.599884 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f22d0aff-e2ae-46e4-a3d2-7d59e28bef02 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:58.609274 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f22d0aff-e2ae-46e4-a3d2-7d59e28bef02 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:58.610980 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f22d0aff-e2ae-46e4-a3d2-7d59e28bef02 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:58.619648 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f22d0aff-e2ae-46e4-a3d2-7d59e28bef02 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1446 microversion: 2.75 time: 0.182090 Aug 04 16:34:58.620930 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 337/688] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:34:58 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1446 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:34:58.626404 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4deb246f-c55d-4a32-9772-93228e432fed tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:58.627353 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4deb246f-c55d-4a32-9772-93228e432fed tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: f8497465-98e6-46f0-bd09-11c432c292a1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:58.637753 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4deb246f-c55d-4a32-9772-93228e432fed tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:58.638608 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4deb246f-c55d-4a32-9772-93228e432fed tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:58.639937 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4deb246f-c55d-4a32-9772-93228e432fed tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:58.640927 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4deb246f-c55d-4a32-9772-93228e432fed tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:58.656902 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-4deb246f-c55d-4a32-9772-93228e432fed tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] HTTP exception thrown: Instance f8497465-98e6-46f0-bd09-11c432c292a1 could not be found. Aug 04 16:34:58.659092 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4deb246f-c55d-4a32-9772-93228e432fed tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Request method failure captured: Aug 04 16:34:58.659092 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1 HTTP/1.1 Aug 04 16:34:58.659092 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:34:58.659092 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:34:58.659092 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:34:58.659092 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:34:58.659092 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:34:58.659092 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:34:58.659092 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:34:58.659092 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:34:58.659092 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_SRb208r6TufvSTFYVXwyj3DTtXZ8jpzunXKKjMOHyUs9L_C2dDHOjfAJrnLCso0jrhuGhfBgNREQORB1aujt4F5Tri2XO2GAkgJem82YirkLqG7yvzOz41SmvKBzV6LvJVPtkiFmgyV5IoYWxq6Z3N-2SdIC5DGPqTU82sr_zsHrY Aug 04 16:34:58.659092 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:34:58.659092 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:34:58.659092 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:34:58.659092 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:34:58.659092 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:34:58.659092 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:34:58.659092 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 5cd96a8c91974b8ba7919d5349f380ee Aug 04 16:34:58.659092 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-651926315 Aug 04 16:34:58.659092 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:34:58.659092 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:34:58.660793 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5cd96a8c91974b8ba7919d5349f380ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5cd96a8c91974b8ba7919d5349f380ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5cd96a8c91974b8ba7919d5349f380ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5cd96a8c91974b8ba7919d5349f380ee"}]}] Aug 04 16:34:58.660793 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-651926315 Aug 04 16:34:58.660793 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 5cd96a8c91974b8ba7919d5349f380ee Aug 04 16:34:58.660793 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-651926315 Aug 04 16:34:58.660793 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersWithSpecificFlavorTestJSON-651926315-project Aug 04 16:34:58.660793 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:34:58.660793 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:34:58.660793 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 7a427fb7481d4799a83729910f33b01b Aug 04 16:34:58.660793 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-651926315-project Aug 04 16:34:58.660793 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:34:58.660793 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance f8497465-98e6-46f0-bd09-11c432c292a1 could not be found. Aug 04 16:34:58.660793 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'f8497465-98e6-46f0-bd09-11c432c292a1'} Aug 04 16:34:58.661825 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:34:58.661825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:58.661825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:34:58.661825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:34:58.661825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:34:58.661825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:34:58.661825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:34:58.661825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:34:58.661825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:34:58.661825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:34:58.661825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8497465-98e6-46f0-bd09-11c432c292a1 could not be found. Aug 04 16:34:58.661825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:58.661825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:58.661825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:58.661825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:58.661825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:58.661825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:58.661825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:34:58.661825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:34:58.661825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:34:58.663432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:34:58.663432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:34:58.663432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:34:58.663432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:34:58.663432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:34:58.663432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:34:58.663432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:34:58.663432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8497465-98e6-46f0-bd09-11c432c292a1 could not be found. Aug 04 16:34:58.663432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:58.663432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:58.663432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:58.663432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:58.663432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:58.663432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:58.663432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:34:58.663432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:34:58.663432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8497465-98e6-46f0-bd09-11c432c292a1 could not be found. Aug 04 16:34:58.663432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:58.665828 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4deb246f-c55d-4a32-9772-93228e432fed tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Returning 404 to user: Instance f8497465-98e6-46f0-bd09-11c432c292a1 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:34:58.667075 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4deb246f-c55d-4a32-9772-93228e432fed tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1" status: 404 len: 111 microversion: 2.1 time: 0.044696 Aug 04 16:34:58.668153 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 338/689] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:58 2022] GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:34:58.674447 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a3c58ef5-2429-43c0-93fa-69f3cd41ba07 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:58.675316 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a3c58ef5-2429-43c0-93fa-69f3cd41ba07 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:58.684408 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a3c58ef5-2429-43c0-93fa-69f3cd41ba07 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:58.687209 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a3c58ef5-2429-43c0-93fa-69f3cd41ba07 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:58.688427 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a3c58ef5-2429-43c0-93fa-69f3cd41ba07 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:58.689038 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a3c58ef5-2429-43c0-93fa-69f3cd41ba07 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:58.810738 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:34:58.997234 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2746826f-f3b2-4c8f-975b-732598043cd5 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.918621 Aug 04 16:34:58.998157 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 352/690] 10.222.0.23 () {60 vars in 1170 bytes} [Thu Aug 4 16:34:54 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4920 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:34:59.010080 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d9e5f801-07d0-4e94-b207-1f25a98d29a2 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:59.012384 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d9e5f801-07d0-4e94-b207-1f25a98d29a2 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] [instance: a80ed729-9d91-4fba-a785-77d5aeacb767] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:59.021942 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d9e5f801-07d0-4e94-b207-1f25a98d29a2 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:59.022314 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a3c58ef5-2429-43c0-93fa-69f3cd41ba07 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:59.024169 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d9e5f801-07d0-4e94-b207-1f25a98d29a2 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:59.030224 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a3c58ef5-2429-43c0-93fa-69f3cd41ba07 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1475 microversion: 2.1 time: 0.360579 Aug 04 16:34:59.030804 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 339/691] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:58 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1475 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:59.036515 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f91fc2bf-53c9-4dfd-af86-f5733d516715 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:59.037457 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f91fc2bf-53c9-4dfd-af86-f5733d516715 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: ac53ca0d-94da-45a3-bd53-f013b5b61d51] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:59.038406 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d9e5f801-07d0-4e94-b207-1f25a98d29a2 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:59.041610 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d9e5f801-07d0-4e94-b207-1f25a98d29a2 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:59.044745 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f91fc2bf-53c9-4dfd-af86-f5733d516715 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:59.045420 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f91fc2bf-53c9-4dfd-af86-f5733d516715 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:59.046370 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f91fc2bf-53c9-4dfd-af86-f5733d516715 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:59.046939 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f91fc2bf-53c9-4dfd-af86-f5733d516715 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:59.062484 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-f91fc2bf-53c9-4dfd-af86-f5733d516715 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] HTTP exception thrown: Instance ac53ca0d-94da-45a3-bd53-f013b5b61d51 could not be found. Aug 04 16:34:59.072049 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f91fc2bf-53c9-4dfd-af86-f5733d516715 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Request method failure captured: Aug 04 16:34:59.072049 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51 HTTP/1.1 Aug 04 16:34:59.072049 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:34:59.072049 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:34:59.072049 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:34:59.072049 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:34:59.072049 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:34:59.072049 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:34:59.072049 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:34:59.072049 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:34:59.072049 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_SRb208r6TufvSTFYVXwyj3DTtXZ8jpzunXKKjMOHyUs9L_C2dDHOjfAJrnLCso0jrhuGhfBgNREQORB1aujt4F5Tri2XO2GAkgJem82YirkLqG7yvzOz41SmvKBzV6LvJVPtkiFmgyV5IoYWxq6Z3N-2SdIC5DGPqTU82sr_zsHrY Aug 04 16:34:59.072049 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:34:59.072049 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:34:59.072049 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:34:59.072049 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:34:59.072049 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:34:59.072049 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:34:59.072049 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 5cd96a8c91974b8ba7919d5349f380ee Aug 04 16:34:59.072049 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-651926315 Aug 04 16:34:59.072049 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:34:59.072049 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:34:59.073774 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5cd96a8c91974b8ba7919d5349f380ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5cd96a8c91974b8ba7919d5349f380ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5cd96a8c91974b8ba7919d5349f380ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5cd96a8c91974b8ba7919d5349f380ee"}]}] Aug 04 16:34:59.073774 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-651926315 Aug 04 16:34:59.073774 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 5cd96a8c91974b8ba7919d5349f380ee Aug 04 16:34:59.073774 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-651926315 Aug 04 16:34:59.073774 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersWithSpecificFlavorTestJSON-651926315-project Aug 04 16:34:59.073774 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:34:59.073774 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:34:59.073774 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 7a427fb7481d4799a83729910f33b01b Aug 04 16:34:59.073774 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-651926315-project Aug 04 16:34:59.073774 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:34:59.073774 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance ac53ca0d-94da-45a3-bd53-f013b5b61d51 could not be found. Aug 04 16:34:59.073774 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'ac53ca0d-94da-45a3-bd53-f013b5b61d51'} Aug 04 16:34:59.074647 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:34:59.074647 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:59.074647 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:34:59.074647 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:34:59.074647 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:34:59.074647 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:34:59.074647 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:34:59.074647 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:34:59.074647 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:34:59.074647 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:34:59.074647 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac53ca0d-94da-45a3-bd53-f013b5b61d51 could not be found. Aug 04 16:34:59.074647 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:59.074647 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:59.074647 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:59.074647 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:59.074647 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:59.074647 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:59.074647 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:34:59.074647 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:34:59.074647 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:34:59.076067 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:34:59.076067 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:34:59.076067 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:34:59.076067 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:34:59.076067 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:34:59.076067 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:34:59.076067 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:34:59.076067 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:34:59.076067 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:34:59.076067 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac53ca0d-94da-45a3-bd53-f013b5b61d51 could not be found. Aug 04 16:34:59.076067 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:59.076067 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:59.076067 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:59.076067 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:59.076067 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:59.076067 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:59.076067 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:34:59.076067 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:34:59.076067 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac53ca0d-94da-45a3-bd53-f013b5b61d51 could not be found. Aug 04 16:34:59.076067 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:59.078938 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f91fc2bf-53c9-4dfd-af86-f5733d516715 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Returning 404 to user: Instance ac53ca0d-94da-45a3-bd53-f013b5b61d51 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:34:59.080276 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f91fc2bf-53c9-4dfd-af86-f5733d516715 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51" status: 404 len: 111 microversion: 2.1 time: 0.047457 Aug 04 16:34:59.085880 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 340/692] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:34:59 2022] DELETE /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:34:59.094513 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-00e40f56-f79f-424a-9b11-835350806aed tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:59.098186 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-00e40f56-f79f-424a-9b11-835350806aed tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: ac53ca0d-94da-45a3-bd53-f013b5b61d51] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:59.107669 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-00e40f56-f79f-424a-9b11-835350806aed tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:59.122447 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-00e40f56-f79f-424a-9b11-835350806aed tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:59.124555 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-00e40f56-f79f-424a-9b11-835350806aed tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:59.124999 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-00e40f56-f79f-424a-9b11-835350806aed tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:59.146525 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-00e40f56-f79f-424a-9b11-835350806aed tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] HTTP exception thrown: Instance ac53ca0d-94da-45a3-bd53-f013b5b61d51 could not be found. Aug 04 16:34:59.149006 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-00e40f56-f79f-424a-9b11-835350806aed tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Request method failure captured: Aug 04 16:34:59.149006 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51 HTTP/1.1 Aug 04 16:34:59.149006 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:34:59.149006 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:34:59.149006 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:34:59.149006 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:34:59.149006 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:34:59.149006 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:34:59.149006 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:34:59.149006 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:34:59.149006 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_SRb208r6TufvSTFYVXwyj3DTtXZ8jpzunXKKjMOHyUs9L_C2dDHOjfAJrnLCso0jrhuGhfBgNREQORB1aujt4F5Tri2XO2GAkgJem82YirkLqG7yvzOz41SmvKBzV6LvJVPtkiFmgyV5IoYWxq6Z3N-2SdIC5DGPqTU82sr_zsHrY Aug 04 16:34:59.149006 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:34:59.149006 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:34:59.149006 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:34:59.149006 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:34:59.149006 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:34:59.149006 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:34:59.149006 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 5cd96a8c91974b8ba7919d5349f380ee Aug 04 16:34:59.149006 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-651926315 Aug 04 16:34:59.149006 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:34:59.149006 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:34:59.150612 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5cd96a8c91974b8ba7919d5349f380ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5cd96a8c91974b8ba7919d5349f380ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5cd96a8c91974b8ba7919d5349f380ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5cd96a8c91974b8ba7919d5349f380ee"}]}] Aug 04 16:34:59.150612 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-651926315 Aug 04 16:34:59.150612 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 5cd96a8c91974b8ba7919d5349f380ee Aug 04 16:34:59.150612 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-651926315 Aug 04 16:34:59.150612 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersWithSpecificFlavorTestJSON-651926315-project Aug 04 16:34:59.150612 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:34:59.150612 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:34:59.150612 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 7a427fb7481d4799a83729910f33b01b Aug 04 16:34:59.150612 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-651926315-project Aug 04 16:34:59.150612 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:34:59.150612 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance ac53ca0d-94da-45a3-bd53-f013b5b61d51 could not be found. Aug 04 16:34:59.150612 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'ac53ca0d-94da-45a3-bd53-f013b5b61d51'} Aug 04 16:34:59.151383 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:34:59.151383 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:59.151383 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:34:59.151383 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:34:59.151383 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:34:59.151383 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:34:59.151383 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:34:59.151383 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:34:59.151383 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:34:59.151383 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:34:59.151383 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac53ca0d-94da-45a3-bd53-f013b5b61d51 could not be found. Aug 04 16:34:59.151383 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:59.151383 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:59.151383 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:59.151383 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:59.151383 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:59.151383 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:59.151383 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:34:59.151383 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:34:59.151383 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:34:59.152595 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:34:59.152595 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:34:59.152595 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:34:59.152595 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:34:59.152595 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:34:59.152595 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:34:59.152595 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:34:59.152595 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac53ca0d-94da-45a3-bd53-f013b5b61d51 could not be found. Aug 04 16:34:59.152595 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:59.152595 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:34:59.152595 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:59.152595 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:34:59.152595 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:34:59.152595 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:34:59.152595 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:34:59.152595 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:34:59.152595 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac53ca0d-94da-45a3-bd53-f013b5b61d51 could not be found. Aug 04 16:34:59.152595 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:34:59.155317 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-00e40f56-f79f-424a-9b11-835350806aed tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Returning 404 to user: Instance ac53ca0d-94da-45a3-bd53-f013b5b61d51 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:34:59.156371 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-00e40f56-f79f-424a-9b11-835350806aed tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51" status: 404 len: 111 microversion: 2.1 time: 0.065746 Aug 04 16:34:59.157658 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 341/693] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:59 2022] GET /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:34:59.166387 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3c564c4e-fba2-40a1-aec0-fd49dfeb69c6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:59.167446 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3c564c4e-fba2-40a1-aec0-fd49dfeb69c6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: b61f1675-928c-4591-8213-474c2bc174be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:59.175925 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3c564c4e-fba2-40a1-aec0-fd49dfeb69c6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:59.176687 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3c564c4e-fba2-40a1-aec0-fd49dfeb69c6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:59.177995 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3c564c4e-fba2-40a1-aec0-fd49dfeb69c6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:59.178638 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3c564c4e-fba2-40a1-aec0-fd49dfeb69c6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:59.277413 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d9e5f801-07d0-4e94-b207-1f25a98d29a2 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767" status: 200 len: 1646 microversion: 2.1 time: 0.277340 Aug 04 16:34:59.282038 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 353/694] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:58 2022] GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767 => generated 1646 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:59.301229 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9f9ded29-520f-4303-ab73-a5ccd077dd8b tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '.version_select at 0x7f7e8504fca0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:59.330438 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9f9ded29-520f-4303-ab73-a5ccd077dd8b tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-271659618" status: 202 len: 0 microversion: 2.1 time: 0.046822 Aug 04 16:34:59.333673 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 354/695] 10.222.0.23 () {58 vars in 1218 bytes} [Thu Aug 4 16:34:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-271659618 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:34:59.345101 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6e450a6d-66c2-49a5-92b2-cc16fb0bcb25 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-370826107", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "ce185855-ad88-40d0-ad8d-f7db4d7f58b9"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:59.507019 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3c564c4e-fba2-40a1-aec0-fd49dfeb69c6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:59.523451 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3c564c4e-fba2-40a1-aec0-fd49dfeb69c6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:59.535660 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3c564c4e-fba2-40a1-aec0-fd49dfeb69c6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:34:59.536814 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3c564c4e-fba2-40a1-aec0-fd49dfeb69c6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be" status: 200 len: 1567 microversion: 2.25 time: 0.377688 Aug 04 16:34:59.537399 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 342/696] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:34:59 2022] GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be => generated 1567 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:34:59.553676 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3e7d3041-6880-4f17-8504-89d19f38e82b tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:34:59.553676 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3e7d3041-6880-4f17-8504-89d19f38e82b tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] [instance: a80ed729-9d91-4fba-a785-77d5aeacb767] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:34:59.554098 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-6e450a6d-66c2-49a5-92b2-cc16fb0bcb25 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] validate_networks() for [('ce185855-ad88-40d0-ad8d-f7db4d7f58b9', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:34:59.558312 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3e7d3041-6880-4f17-8504-89d19f38e82b tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:59.559010 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3e7d3041-6880-4f17-8504-89d19f38e82b tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:59.559940 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3e7d3041-6880-4f17-8504-89d19f38e82b tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:59.560532 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3e7d3041-6880-4f17-8504-89d19f38e82b tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:34:59.874910 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3e7d3041-6880-4f17-8504-89d19f38e82b tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767" status: 200 len: 1646 microversion: 2.1 time: 0.336258 Aug 04 16:34:59.896317 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 343/697] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:34:59 2022] GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767 => generated 1646 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:34:59.913468 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-7fdee74b-a077-43bd-8e26-5dc3dffe8ffe req-7cf3d118-d44b-4b60-bd57-f5ad0490c6a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b61f1675-928c-4591-8213-474c2bc174be", "tag": "c6da17eb-62d8-4f32-b0fd-b4686bc2423e"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:34:59.951580 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7fdee74b-a077-43bd-8e26-5dc3dffe8ffe req-7cf3d118-d44b-4b60-bd57-f5ad0490c6a7 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:34:59.952064 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7fdee74b-a077-43bd-8e26-5dc3dffe8ffe req-7cf3d118-d44b-4b60-bd57-f5ad0490c6a7 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:00.001909 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-7fdee74b-a077-43bd-8e26-5dc3dffe8ffe req-7cf3d118-d44b-4b60-bd57-f5ad0490c6a7 service nova] Creating event network-changed:c6da17eb-62d8-4f32-b0fd-b4686bc2423e for instance b61f1675-928c-4591-8213-474c2bc174be on n-h2-846466-12 Aug 04 16:35:00.010743 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-7fdee74b-a077-43bd-8e26-5dc3dffe8ffe req-7cf3d118-d44b-4b60-bd57-f5ad0490c6a7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112367 Aug 04 16:35:00.011921 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 344/698] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:35:00.018441 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-178f9ca7-de62-4470-87c6-f99241047982 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:00.019400 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-178f9ca7-de62-4470-87c6-f99241047982 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:00.036786 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-178f9ca7-de62-4470-87c6-f99241047982 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:00.037256 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-178f9ca7-de62-4470-87c6-f99241047982 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:00.038102 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-178f9ca7-de62-4470-87c6-f99241047982 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:00.038532 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-178f9ca7-de62-4470-87c6-f99241047982 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:00.199696 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-178f9ca7-de62-4470-87c6-f99241047982 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:00.230195 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-178f9ca7-de62-4470-87c6-f99241047982 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:00.238496 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-178f9ca7-de62-4470-87c6-f99241047982 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:00.266737 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-178f9ca7-de62-4470-87c6-f99241047982 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1446 microversion: 2.75 time: 0.253432 Aug 04 16:35:00.269793 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 345/699] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:00 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1446 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:00.277294 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-30f64ea3-b547-41a6-889f-46b5a25eb77f tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:00.296731 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:35:00.296731 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:35:00.299897 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-30f64ea3-b547-41a6-889f-46b5a25eb77f tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:00.301246 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-30f64ea3-b547-41a6-889f-46b5a25eb77f tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:00.302328 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-30f64ea3-b547-41a6-889f-46b5a25eb77f tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:00.302986 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-30f64ea3-b547-41a6-889f-46b5a25eb77f tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:00.395531 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-30f64ea3-b547-41a6-889f-46b5a25eb77f tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.124274 Aug 04 16:35:00.396036 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 346/700] 10.222.0.23 () {58 vars in 1176 bytes} [Thu Aug 4 16:35:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:35:00.403282 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9d72d52a-88c6-49db-947f-9e4d00df4ca3 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:00.403893 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9d72d52a-88c6-49db-947f-9e4d00df4ca3 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:00.430043 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9d72d52a-88c6-49db-947f-9e4d00df4ca3 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:00.430476 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9d72d52a-88c6-49db-947f-9e4d00df4ca3 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:00.431250 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9d72d52a-88c6-49db-947f-9e4d00df4ca3 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:00.431672 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9d72d52a-88c6-49db-947f-9e4d00df4ca3 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:01.319476 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9d72d52a-88c6-49db-947f-9e4d00df4ca3 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:01.332093 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9d72d52a-88c6-49db-947f-9e4d00df4ca3 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1475 microversion: 2.1 time: 0.934978 Aug 04 16:35:01.332692 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 347/701] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:00 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1475 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:01.349941 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-de6ecbb8-1ff0-41ab-9d3f-97ce10af8a80 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:01.350850 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-de6ecbb8-1ff0-41ab-9d3f-97ce10af8a80 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] [instance: a80ed729-9d91-4fba-a785-77d5aeacb767] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:01.361157 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-de6ecbb8-1ff0-41ab-9d3f-97ce10af8a80 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:01.373193 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-de6ecbb8-1ff0-41ab-9d3f-97ce10af8a80 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:01.374128 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-de6ecbb8-1ff0-41ab-9d3f-97ce10af8a80 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:01.374558 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-de6ecbb8-1ff0-41ab-9d3f-97ce10af8a80 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:01.516993 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-6e450a6d-66c2-49a5-92b2-cc16fb0bcb25 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:35:01.518562 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-6e450a6d-66c2-49a5-92b2-cc16fb0bcb25 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:35:01.519417 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-6e450a6d-66c2-49a5-92b2-cc16fb0bcb25 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:35:01.520212 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-6e450a6d-66c2-49a5-92b2-cc16fb0bcb25 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:35:01.521251 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-6e450a6d-66c2-49a5-92b2-cc16fb0bcb25 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:35:01.547882 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e450a6d-66c2-49a5-92b2-cc16fb0bcb25 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:01.550431 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e450a6d-66c2-49a5-92b2-cc16fb0bcb25 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:01.551877 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e450a6d-66c2-49a5-92b2-cc16fb0bcb25 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:01.553626 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e450a6d-66c2-49a5-92b2-cc16fb0bcb25 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:01.564139 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-de6ecbb8-1ff0-41ab-9d3f-97ce10af8a80 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767/action" status: 202 len: 0 microversion: 2.1 time: 0.227715 Aug 04 16:35:01.568613 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 348/702] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:35:01 2022] POST /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:35:01.595848 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f1e83c43-d230-4523-97df-31a01c45ba34 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:01.598988 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f1e83c43-d230-4523-97df-31a01c45ba34 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: b61f1675-928c-4591-8213-474c2bc174be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:01.607934 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:35:01.626600 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f1e83c43-d230-4523-97df-31a01c45ba34 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:01.627086 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f1e83c43-d230-4523-97df-31a01c45ba34 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:01.634155 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f1e83c43-d230-4523-97df-31a01c45ba34 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:01.634596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f1e83c43-d230-4523-97df-31a01c45ba34 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:01.641767 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-6e450a6d-66c2-49a5-92b2-cc16fb0bcb25 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Getting quotas for project 25f22de02d3e4db281f6372e8191b95f. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:35:01.665135 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-6e450a6d-66c2-49a5-92b2-cc16fb0bcb25 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Getting quotas for user b4a732f446814c9fa080979bef241023 and project 25f22de02d3e4db281f6372e8191b95f. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:35:01.735988 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6e450a6d-66c2-49a5-92b2-cc16fb0bcb25 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:35:01.751166 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6e450a6d-66c2-49a5-92b2-cc16fb0bcb25 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 2d2e5f9c-c00d-46b1-b55c-b2bda4428946] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:35:01.829872 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6e450a6d-66c2-49a5-92b2-cc16fb0bcb25 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.493700 Aug 04 16:35:01.838322 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 355/703] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:34:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:35:01.845395 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1265c035-28a6-42fb-ab26-7081732229f8 tempest-ServersWithSpecificFlavorTestJSON-342277255 tempest-ServersWithSpecificFlavorTestJSON-342277255-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:01.847366 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:35:01.847366 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:35:01.902120 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1265c035-28a6-42fb-ab26-7081732229f8 tempest-ServersWithSpecificFlavorTestJSON-342277255 tempest-ServersWithSpecificFlavorTestJSON-342277255-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1896151957" status: 202 len: 0 microversion: 2.1 time: 0.062283 Aug 04 16:35:01.903072 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 356/704] 10.222.0.23 () {58 vars in 1161 bytes} [Thu Aug 4 16:35:01 2022] DELETE /compute/v2.1/flavors/1896151957 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:35:01.912075 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-766edba4-e1f6-4160-ab60-7215b20cb4aa tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:01.914141 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-766edba4-e1f6-4160-ab60-7215b20cb4aa tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:01.924254 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-766edba4-e1f6-4160-ab60-7215b20cb4aa tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:01.924972 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-766edba4-e1f6-4160-ab60-7215b20cb4aa tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:01.926218 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-766edba4-e1f6-4160-ab60-7215b20cb4aa tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:01.928416 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-766edba4-e1f6-4160-ab60-7215b20cb4aa tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:02.503265 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f1e83c43-d230-4523-97df-31a01c45ba34 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:02.522112 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f1e83c43-d230-4523-97df-31a01c45ba34 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:02.528373 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f1e83c43-d230-4523-97df-31a01c45ba34 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:02.529734 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f1e83c43-d230-4523-97df-31a01c45ba34 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be" status: 200 len: 1567 microversion: 2.25 time: 0.957651 Aug 04 16:35:02.530325 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 349/705] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:01 2022] GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be => generated 1567 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:02.553258 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c015307c-806f-4106-a93a-54cede45d430 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:02.557932 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c015307c-806f-4106-a93a-54cede45d430 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] [instance: a80ed729-9d91-4fba-a785-77d5aeacb767] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:02.580558 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c015307c-806f-4106-a93a-54cede45d430 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:02.583192 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c015307c-806f-4106-a93a-54cede45d430 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:02.587584 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c015307c-806f-4106-a93a-54cede45d430 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:02.594161 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c015307c-806f-4106-a93a-54cede45d430 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:02.852743 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-766edba4-e1f6-4160-ab60-7215b20cb4aa tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:02.868544 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-766edba4-e1f6-4160-ab60-7215b20cb4aa tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:02.873475 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-766edba4-e1f6-4160-ab60-7215b20cb4aa tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:02.885301 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-766edba4-e1f6-4160-ab60-7215b20cb4aa tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1446 microversion: 2.75 time: 0.980730 Aug 04 16:35:02.888476 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 357/706] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:01 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1446 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:02.926384 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-edb0bbb0-2fe9-428e-be64-3a5f95c7dfdd tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:02.930726 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-edb0bbb0-2fe9-428e-be64-3a5f95c7dfdd tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 2d2e5f9c-c00d-46b1-b55c-b2bda4428946] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:03.028541 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-edb0bbb0-2fe9-428e-be64-3a5f95c7dfdd tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:03.035160 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-edb0bbb0-2fe9-428e-be64-3a5f95c7dfdd tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:03.041315 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-edb0bbb0-2fe9-428e-be64-3a5f95c7dfdd tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:03.043066 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-edb0bbb0-2fe9-428e-be64-3a5f95c7dfdd tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:03.465584 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-edb0bbb0-2fe9-428e-be64-3a5f95c7dfdd tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a732f446814c9fa080979bef241023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f22de02d3e4db281f6372e8191b95f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:03.490449 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-edb0bbb0-2fe9-428e-be64-3a5f95c7dfdd tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "GET /compute/v2.1/servers/2d2e5f9c-c00d-46b1-b55c-b2bda4428946" status: 200 len: 1227 microversion: 2.1 time: 0.579305 Aug 04 16:35:03.491337 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 358/707] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:02 2022] GET /compute/v2.1/servers/2d2e5f9c-c00d-46b1-b55c-b2bda4428946 => generated 1227 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:03.507752 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2bb861a8-19ba-42d2-9742-f7ff12d3d6ac tempest-ServersWithSpecificFlavorTestJSON-342277255 tempest-ServersWithSpecificFlavorTestJSON-342277255-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:03.560174 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2bb861a8-19ba-42d2-9742-f7ff12d3d6ac tempest-ServersWithSpecificFlavorTestJSON-342277255 tempest-ServersWithSpecificFlavorTestJSON-342277255-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.066045 Aug 04 16:35:03.576009 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 359/708] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:35:03 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:03.606848 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-39eab3a7-73ff-4cb6-80c8-ebac8a42f085 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:03.624316 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-39eab3a7-73ff-4cb6-80c8-ebac8a42f085 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:03.645534 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39eab3a7-73ff-4cb6-80c8-ebac8a42f085 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:03.648340 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39eab3a7-73ff-4cb6-80c8-ebac8a42f085 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:03.650000 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39eab3a7-73ff-4cb6-80c8-ebac8a42f085 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:03.652697 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39eab3a7-73ff-4cb6-80c8-ebac8a42f085 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:03.803356 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c015307c-806f-4106-a93a-54cede45d430 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767" status: 200 len: 1631 microversion: 2.1 time: 1.267009 Aug 04 16:35:03.807369 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 350/709] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:02 2022] GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767 => generated 1631 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:03.830642 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bf476468-f395-4208-8d51-ab76faabc6d9 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:03.833764 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bf476468-f395-4208-8d51-ab76faabc6d9 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: b61f1675-928c-4591-8213-474c2bc174be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:03.850234 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf476468-f395-4208-8d51-ab76faabc6d9 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:03.852860 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf476468-f395-4208-8d51-ab76faabc6d9 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:03.854518 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf476468-f395-4208-8d51-ab76faabc6d9 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:03.857204 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf476468-f395-4208-8d51-ab76faabc6d9 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:04.367201 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-39eab3a7-73ff-4cb6-80c8-ebac8a42f085 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:04.378955 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-39eab3a7-73ff-4cb6-80c8-ebac8a42f085 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1475 microversion: 2.1 time: 0.801476 Aug 04 16:35:04.384325 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 360/710] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:03 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1475 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:04.389704 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c82046d9-1308-4620-a0de-cb013d248547 tempest-ServersWithSpecificFlavorTestJSON-342277255 tempest-ServersWithSpecificFlavorTestJSON-342277255-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:04.391332 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:35:04.391332 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:35:04.413523 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c82046d9-1308-4620-a0de-cb013d248547 tempest-ServersWithSpecificFlavorTestJSON-342277255 tempest-ServersWithSpecificFlavorTestJSON-342277255-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1332659819" status: 202 len: 0 microversion: 2.1 time: 0.027486 Aug 04 16:35:04.415082 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 361/711] 10.222.0.23 () {58 vars in 1161 bytes} [Thu Aug 4 16:35:04 2022] DELETE /compute/v2.1/flavors/1332659819 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:35:04.433062 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3956e2e6-1b1f-4f12-85b3-843bd4585321 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-846466-12", "block_migration": true, "disk_over_commit": false}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:04.437956 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3956e2e6-1b1f-4f12-85b3-843bd4585321 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] [instance: a80ed729-9d91-4fba-a785-77d5aeacb767] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:04.444511 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=7,nova_api:INSERT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:35:04.452096 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3956e2e6-1b1f-4f12-85b3-843bd4585321 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:04.457910 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3956e2e6-1b1f-4f12-85b3-843bd4585321 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:04.458932 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3956e2e6-1b1f-4f12-85b3-843bd4585321 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:04.460865 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3956e2e6-1b1f-4f12-85b3-843bd4585321 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:04.464417 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:35:04.539246 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-3956e2e6-1b1f-4f12-85b3-843bd4585321 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lazy-loading 'flavor' on Instance uuid a80ed729-9d91-4fba-a785-77d5aeacb767 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:35:04.571921 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3956e2e6-1b1f-4f12-85b3-843bd4585321 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] [instance: a80ed729-9d91-4fba-a785-77d5aeacb767] Going to try to live migrate instance to n-h2-846466-12 {{(pid=126126) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 16:35:05.303695 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bf476468-f395-4208-8d51-ab76faabc6d9 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:05.320619 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bf476468-f395-4208-8d51-ab76faabc6d9 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:05.331093 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bf476468-f395-4208-8d51-ab76faabc6d9 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:05.351653 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bf476468-f395-4208-8d51-ab76faabc6d9 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be" status: 200 len: 1567 microversion: 2.25 time: 1.538531 Aug 04 16:35:05.365629 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 351/712] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:03 2022] GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be => generated 1567 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:05.393011 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9a1eb57e-95e8-4739-91d5-52dc3fff251e tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:05.397338 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9a1eb57e-95e8-4739-91d5-52dc3fff251e tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:05.427781 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9a1eb57e-95e8-4739-91d5-52dc3fff251e tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:05.435951 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9a1eb57e-95e8-4739-91d5-52dc3fff251e tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:05.440002 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9a1eb57e-95e8-4739-91d5-52dc3fff251e tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:05.440002 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9a1eb57e-95e8-4739-91d5-52dc3fff251e tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:05.802557 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9a1eb57e-95e8-4739-91d5-52dc3fff251e tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:05.844742 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9a1eb57e-95e8-4739-91d5-52dc3fff251e tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:05.854188 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9a1eb57e-95e8-4739-91d5-52dc3fff251e tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:05.876630 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9a1eb57e-95e8-4739-91d5-52dc3fff251e tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1446 microversion: 2.75 time: 0.508569 Aug 04 16:35:05.881136 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 352/713] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:05 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1446 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:05.896058 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-81f26e1a-c258-4848-b091-7a9e30f25d08 tempest-ServersWithSpecificFlavorTestJSON-342277255 tempest-ServersWithSpecificFlavorTestJSON-342277255-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:05.989204 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-81f26e1a-c258-4848-b091-7a9e30f25d08 tempest-ServersWithSpecificFlavorTestJSON-342277255 tempest-ServersWithSpecificFlavorTestJSON-342277255-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.105861 Aug 04 16:35:05.992152 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 353/714] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:35:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:06.000405 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ea710823-48ea-4709-afa4-d5637b04eb31 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:06.008575 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ea710823-48ea-4709-afa4-d5637b04eb31 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 2d2e5f9c-c00d-46b1-b55c-b2bda4428946] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:06.042375 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ea710823-48ea-4709-afa4-d5637b04eb31 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:06.044264 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ea710823-48ea-4709-afa4-d5637b04eb31 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:06.046449 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ea710823-48ea-4709-afa4-d5637b04eb31 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:06.047212 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ea710823-48ea-4709-afa4-d5637b04eb31 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:06.529392 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ea710823-48ea-4709-afa4-d5637b04eb31 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a732f446814c9fa080979bef241023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f22de02d3e4db281f6372e8191b95f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:06.534798 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:35:06.549739 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ea710823-48ea-4709-afa4-d5637b04eb31 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "GET /compute/v2.1/servers/2d2e5f9c-c00d-46b1-b55c-b2bda4428946" status: 200 len: 1281 microversion: 2.1 time: 0.556309 Aug 04 16:35:06.551994 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 354/715] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:05 2022] GET /compute/v2.1/servers/2d2e5f9c-c00d-46b1-b55c-b2bda4428946 => generated 1281 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:06.565783 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6449b0bb-bc60-4d0f-a86f-2e89800178e6 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:06.566414 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6449b0bb-bc60-4d0f-a86f-2e89800178e6 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:06.587623 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6449b0bb-bc60-4d0f-a86f-2e89800178e6 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:06.588072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6449b0bb-bc60-4d0f-a86f-2e89800178e6 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:06.594078 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6449b0bb-bc60-4d0f-a86f-2e89800178e6 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:06.595128 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6449b0bb-bc60-4d0f-a86f-2e89800178e6 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:07.168155 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6449b0bb-bc60-4d0f-a86f-2e89800178e6 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:07.179656 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6449b0bb-bc60-4d0f-a86f-2e89800178e6 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1475 microversion: 2.1 time: 0.626552 Aug 04 16:35:07.181715 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 355/716] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:06 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1475 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:07.187267 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-040515d6-da44-4357-809d-a40fb795cc15 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:07.194168 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-040515d6-da44-4357-809d-a40fb795cc15 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: f8497465-98e6-46f0-bd09-11c432c292a1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:07.207053 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-040515d6-da44-4357-809d-a40fb795cc15 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:07.209897 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-040515d6-da44-4357-809d-a40fb795cc15 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:07.210974 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-040515d6-da44-4357-809d-a40fb795cc15 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:07.213444 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-040515d6-da44-4357-809d-a40fb795cc15 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:07.241945 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-040515d6-da44-4357-809d-a40fb795cc15 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] HTTP exception thrown: Instance f8497465-98e6-46f0-bd09-11c432c292a1 could not be found. Aug 04 16:35:07.249917 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-040515d6-da44-4357-809d-a40fb795cc15 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Request method failure captured: Aug 04 16:35:07.249917 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1 HTTP/1.1 Aug 04 16:35:07.249917 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:35:07.249917 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:35:07.249917 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:35:07.249917 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:35:07.249917 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:35:07.249917 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:35:07.249917 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:35:07.249917 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:35:07.249917 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_SRb208r6TufvSTFYVXwyj3DTtXZ8jpzunXKKjMOHyUs9L_C2dDHOjfAJrnLCso0jrhuGhfBgNREQORB1aujt4F5Tri2XO2GAkgJem82YirkLqG7yvzOz41SmvKBzV6LvJVPtkiFmgyV5IoYWxq6Z3N-2SdIC5DGPqTU82sr_zsHrY Aug 04 16:35:07.249917 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:35:07.249917 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:35:07.249917 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:35:07.249917 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:35:07.249917 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:35:07.249917 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:35:07.249917 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 5cd96a8c91974b8ba7919d5349f380ee Aug 04 16:35:07.249917 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-651926315 Aug 04 16:35:07.249917 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:35:07.249917 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:35:07.251410 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5cd96a8c91974b8ba7919d5349f380ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5cd96a8c91974b8ba7919d5349f380ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5cd96a8c91974b8ba7919d5349f380ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5cd96a8c91974b8ba7919d5349f380ee"}]}] Aug 04 16:35:07.251410 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-651926315 Aug 04 16:35:07.251410 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 5cd96a8c91974b8ba7919d5349f380ee Aug 04 16:35:07.251410 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-651926315 Aug 04 16:35:07.251410 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersWithSpecificFlavorTestJSON-651926315-project Aug 04 16:35:07.251410 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:35:07.251410 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:35:07.251410 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 7a427fb7481d4799a83729910f33b01b Aug 04 16:35:07.251410 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-651926315-project Aug 04 16:35:07.251410 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:35:07.251410 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance f8497465-98e6-46f0-bd09-11c432c292a1 could not be found. Aug 04 16:35:07.251410 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'f8497465-98e6-46f0-bd09-11c432c292a1'} Aug 04 16:35:07.252370 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:35:07.252370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:07.252370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:35:07.252370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:35:07.252370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:35:07.252370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:35:07.252370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:35:07.252370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:35:07.252370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:35:07.252370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:35:07.252370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8497465-98e6-46f0-bd09-11c432c292a1 could not be found. Aug 04 16:35:07.252370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:07.252370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:07.252370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:07.252370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:07.252370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:07.252370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:07.252370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:35:07.252370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:35:07.252370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:35:07.253742 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:35:07.253742 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:35:07.253742 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:35:07.253742 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:35:07.253742 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:35:07.253742 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:35:07.253742 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:35:07.253742 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:35:07.253742 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:35:07.253742 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8497465-98e6-46f0-bd09-11c432c292a1 could not be found. Aug 04 16:35:07.253742 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:07.253742 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:07.253742 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:07.253742 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:07.253742 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:07.253742 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:07.253742 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:35:07.253742 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:35:07.253742 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8497465-98e6-46f0-bd09-11c432c292a1 could not be found. Aug 04 16:35:07.253742 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:07.260014 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-040515d6-da44-4357-809d-a40fb795cc15 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Returning 404 to user: Instance f8497465-98e6-46f0-bd09-11c432c292a1 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:35:07.266194 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-040515d6-da44-4357-809d-a40fb795cc15 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1" status: 404 len: 111 microversion: 2.1 time: 0.081632 Aug 04 16:35:07.267453 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 356/717] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:35:07 2022] DELETE /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:35:07.278483 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f67ab8c6-cc8d-4399-a0f4-99f4436ae8cb tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:07.285142 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f67ab8c6-cc8d-4399-a0f4-99f4436ae8cb tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: b61f1675-928c-4591-8213-474c2bc174be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:07.297732 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f67ab8c6-cc8d-4399-a0f4-99f4436ae8cb tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:07.302255 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f67ab8c6-cc8d-4399-a0f4-99f4436ae8cb tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:07.303877 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f67ab8c6-cc8d-4399-a0f4-99f4436ae8cb tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:07.308463 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f67ab8c6-cc8d-4399-a0f4-99f4436ae8cb tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:07.845896 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f67ab8c6-cc8d-4399-a0f4-99f4436ae8cb tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:07.860643 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f67ab8c6-cc8d-4399-a0f4-99f4436ae8cb tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:07.863390 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f67ab8c6-cc8d-4399-a0f4-99f4436ae8cb tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:07.866814 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f67ab8c6-cc8d-4399-a0f4-99f4436ae8cb tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be" status: 200 len: 1567 microversion: 2.25 time: 0.597220 Aug 04 16:35:07.868420 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 357/718] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:07 2022] GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be => generated 1567 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:07.882396 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6fa48631-6bad-45ff-83c9-7b88ddb3fdb1 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:07.884520 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6fa48631-6bad-45ff-83c9-7b88ddb3fdb1 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:07.900661 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6fa48631-6bad-45ff-83c9-7b88ddb3fdb1 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:07.901939 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6fa48631-6bad-45ff-83c9-7b88ddb3fdb1 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:07.903137 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6fa48631-6bad-45ff-83c9-7b88ddb3fdb1 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:07.904106 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6fa48631-6bad-45ff-83c9-7b88ddb3fdb1 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:08.036960 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6fa48631-6bad-45ff-83c9-7b88ddb3fdb1 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:08.060879 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6fa48631-6bad-45ff-83c9-7b88ddb3fdb1 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:08.071825 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6fa48631-6bad-45ff-83c9-7b88ddb3fdb1 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:08.117881 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6fa48631-6bad-45ff-83c9-7b88ddb3fdb1 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1446 microversion: 2.75 time: 0.243415 Aug 04 16:35:08.130840 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 358/719] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:07 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1446 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:08.165079 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f83aa13e-ee33-4256-bccb-1b82ee6950c9 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:08.167075 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f83aa13e-ee33-4256-bccb-1b82ee6950c9 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: f8497465-98e6-46f0-bd09-11c432c292a1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:08.170302 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3956e2e6-1b1f-4f12-85b3-843bd4585321 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767/action" status: 202 len: 0 microversion: 2.1 time: 3.753420 Aug 04 16:35:08.175264 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 362/720] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:35:04 2022] POST /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767/action => generated 0 bytes in 3759 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:35:08.182281 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-53ad8a4c-1e5a-4c02-8572-97de3ccd51f6 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:08.183305 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-53ad8a4c-1e5a-4c02-8572-97de3ccd51f6 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 2d2e5f9c-c00d-46b1-b55c-b2bda4428946] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:08.213773 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f83aa13e-ee33-4256-bccb-1b82ee6950c9 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:08.216717 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f83aa13e-ee33-4256-bccb-1b82ee6950c9 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:08.217778 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f83aa13e-ee33-4256-bccb-1b82ee6950c9 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:08.219267 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-53ad8a4c-1e5a-4c02-8572-97de3ccd51f6 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:08.219941 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f83aa13e-ee33-4256-bccb-1b82ee6950c9 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:08.229790 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-53ad8a4c-1e5a-4c02-8572-97de3ccd51f6 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:08.231867 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-53ad8a4c-1e5a-4c02-8572-97de3ccd51f6 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:08.232509 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-53ad8a4c-1e5a-4c02-8572-97de3ccd51f6 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:08.294429 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-f83aa13e-ee33-4256-bccb-1b82ee6950c9 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] HTTP exception thrown: Instance f8497465-98e6-46f0-bd09-11c432c292a1 could not be found. Aug 04 16:35:08.296901 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f83aa13e-ee33-4256-bccb-1b82ee6950c9 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Request method failure captured: Aug 04 16:35:08.296901 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1 HTTP/1.1 Aug 04 16:35:08.296901 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:35:08.296901 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:35:08.296901 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:35:08.296901 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:35:08.296901 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:35:08.296901 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:35:08.296901 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:35:08.296901 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:35:08.296901 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_SRb208r6TufvSTFYVXwyj3DTtXZ8jpzunXKKjMOHyUs9L_C2dDHOjfAJrnLCso0jrhuGhfBgNREQORB1aujt4F5Tri2XO2GAkgJem82YirkLqG7yvzOz41SmvKBzV6LvJVPtkiFmgyV5IoYWxq6Z3N-2SdIC5DGPqTU82sr_zsHrY Aug 04 16:35:08.296901 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:35:08.296901 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:35:08.296901 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:35:08.296901 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:35:08.296901 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:35:08.296901 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:35:08.296901 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 5cd96a8c91974b8ba7919d5349f380ee Aug 04 16:35:08.296901 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-651926315 Aug 04 16:35:08.296901 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:35:08.296901 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:35:08.298482 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5cd96a8c91974b8ba7919d5349f380ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5cd96a8c91974b8ba7919d5349f380ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5cd96a8c91974b8ba7919d5349f380ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5cd96a8c91974b8ba7919d5349f380ee"}]}] Aug 04 16:35:08.298482 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-651926315 Aug 04 16:35:08.298482 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 5cd96a8c91974b8ba7919d5349f380ee Aug 04 16:35:08.298482 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-651926315 Aug 04 16:35:08.298482 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersWithSpecificFlavorTestJSON-651926315-project Aug 04 16:35:08.298482 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:35:08.298482 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:35:08.298482 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 7a427fb7481d4799a83729910f33b01b Aug 04 16:35:08.298482 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-651926315-project Aug 04 16:35:08.298482 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:35:08.298482 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance f8497465-98e6-46f0-bd09-11c432c292a1 could not be found. Aug 04 16:35:08.298482 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'f8497465-98e6-46f0-bd09-11c432c292a1'} Aug 04 16:35:08.299359 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:35:08.299359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:08.299359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:35:08.299359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:35:08.299359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:35:08.299359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:35:08.299359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:35:08.299359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:35:08.299359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:35:08.299359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:35:08.299359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8497465-98e6-46f0-bd09-11c432c292a1 could not be found. Aug 04 16:35:08.299359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:08.299359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:08.299359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:08.299359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:08.299359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:08.299359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:08.299359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:35:08.299359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:35:08.299359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:35:08.300681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:35:08.300681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:35:08.300681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:35:08.300681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:35:08.300681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:35:08.300681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:35:08.300681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:35:08.300681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8497465-98e6-46f0-bd09-11c432c292a1 could not be found. Aug 04 16:35:08.300681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:08.300681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:08.300681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:08.300681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:08.300681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:08.300681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:08.300681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:35:08.300681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:35:08.300681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8497465-98e6-46f0-bd09-11c432c292a1 could not be found. Aug 04 16:35:08.300681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:08.352643 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f83aa13e-ee33-4256-bccb-1b82ee6950c9 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Returning 404 to user: Instance f8497465-98e6-46f0-bd09-11c432c292a1 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:35:08.356069 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f83aa13e-ee33-4256-bccb-1b82ee6950c9 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1" status: 404 len: 111 microversion: 2.1 time: 0.217413 Aug 04 16:35:08.374708 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 359/721] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:08 2022] GET /compute/v2.1/servers/f8497465-98e6-46f0-bd09-11c432c292a1 => generated 111 bytes in 242 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:35:08.422085 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4ab909ed-e338-4f14-b4b9-0d87c8600edc tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:08.422637 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4ab909ed-e338-4f14-b4b9-0d87c8600edc tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: a80ed729-9d91-4fba-a785-77d5aeacb767] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:08.482409 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4ab909ed-e338-4f14-b4b9-0d87c8600edc tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:08.483185 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4ab909ed-e338-4f14-b4b9-0d87c8600edc tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:08.484073 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4ab909ed-e338-4f14-b4b9-0d87c8600edc tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:08.497261 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4ab909ed-e338-4f14-b4b9-0d87c8600edc tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:09.684392 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4ab909ed-e338-4f14-b4b9-0d87c8600edc tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:09.696870 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4ab909ed-e338-4f14-b4b9-0d87c8600edc tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767" status: 200 len: 1503 microversion: 2.1 time: 1.320912 Aug 04 16:35:09.700809 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 360/722] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:08 2022] GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767 => generated 1503 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:09.717965 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-704cd4e6-155d-4522-8db3-32d035ee2c37 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:09.718682 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-704cd4e6-155d-4522-8db3-32d035ee2c37 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:09.731194 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-704cd4e6-155d-4522-8db3-32d035ee2c37 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:09.731937 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-704cd4e6-155d-4522-8db3-32d035ee2c37 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:09.733015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-704cd4e6-155d-4522-8db3-32d035ee2c37 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:09.733629 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-704cd4e6-155d-4522-8db3-32d035ee2c37 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:09.790104 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-53ad8a4c-1e5a-4c02-8572-97de3ccd51f6 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a732f446814c9fa080979bef241023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f22de02d3e4db281f6372e8191b95f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:09.812529 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-53ad8a4c-1e5a-4c02-8572-97de3ccd51f6 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "GET /compute/v2.1/servers/2d2e5f9c-c00d-46b1-b55c-b2bda4428946" status: 200 len: 1323 microversion: 2.1 time: 1.623605 Aug 04 16:35:09.818519 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 363/723] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:08 2022] GET /compute/v2.1/servers/2d2e5f9c-c00d-46b1-b55c-b2bda4428946 => generated 1323 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:09.824909 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bf208937-b773-4008-a0b0-20c3f88955f2 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:09.825831 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bf208937-b773-4008-a0b0-20c3f88955f2 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: ac53ca0d-94da-45a3-bd53-f013b5b61d51] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:09.833368 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf208937-b773-4008-a0b0-20c3f88955f2 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:09.834192 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf208937-b773-4008-a0b0-20c3f88955f2 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:09.835192 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf208937-b773-4008-a0b0-20c3f88955f2 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:09.835831 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf208937-b773-4008-a0b0-20c3f88955f2 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:09.874408 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-bf208937-b773-4008-a0b0-20c3f88955f2 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] HTTP exception thrown: Instance ac53ca0d-94da-45a3-bd53-f013b5b61d51 could not be found. Aug 04 16:35:09.877244 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bf208937-b773-4008-a0b0-20c3f88955f2 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Request method failure captured: Aug 04 16:35:09.877244 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51 HTTP/1.1 Aug 04 16:35:09.877244 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:35:09.877244 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:35:09.877244 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:35:09.877244 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:35:09.877244 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:35:09.877244 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:35:09.877244 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:35:09.877244 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:35:09.877244 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_SRb208r6TufvSTFYVXwyj3DTtXZ8jpzunXKKjMOHyUs9L_C2dDHOjfAJrnLCso0jrhuGhfBgNREQORB1aujt4F5Tri2XO2GAkgJem82YirkLqG7yvzOz41SmvKBzV6LvJVPtkiFmgyV5IoYWxq6Z3N-2SdIC5DGPqTU82sr_zsHrY Aug 04 16:35:09.877244 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:35:09.877244 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:35:09.877244 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:35:09.877244 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:35:09.877244 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:35:09.877244 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:35:09.877244 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 5cd96a8c91974b8ba7919d5349f380ee Aug 04 16:35:09.877244 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-651926315 Aug 04 16:35:09.877244 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:35:09.877244 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:35:09.878928 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5cd96a8c91974b8ba7919d5349f380ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5cd96a8c91974b8ba7919d5349f380ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5cd96a8c91974b8ba7919d5349f380ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5cd96a8c91974b8ba7919d5349f380ee"}]}] Aug 04 16:35:09.878928 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-651926315 Aug 04 16:35:09.878928 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 5cd96a8c91974b8ba7919d5349f380ee Aug 04 16:35:09.878928 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-651926315 Aug 04 16:35:09.878928 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersWithSpecificFlavorTestJSON-651926315-project Aug 04 16:35:09.878928 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:35:09.878928 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:35:09.878928 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 7a427fb7481d4799a83729910f33b01b Aug 04 16:35:09.878928 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-651926315-project Aug 04 16:35:09.878928 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:35:09.878928 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance ac53ca0d-94da-45a3-bd53-f013b5b61d51 could not be found. Aug 04 16:35:09.878928 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'ac53ca0d-94da-45a3-bd53-f013b5b61d51'} Aug 04 16:35:09.879781 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:35:09.879781 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:09.879781 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:35:09.879781 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:35:09.879781 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:35:09.879781 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:35:09.879781 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:35:09.879781 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:35:09.879781 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:35:09.879781 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:35:09.879781 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac53ca0d-94da-45a3-bd53-f013b5b61d51 could not be found. Aug 04 16:35:09.879781 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:35:09.879781 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:09.879781 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:35:09.879781 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:09.879781 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:09.879781 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:09.879781 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:35:09.879781 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:35:09.879781 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:35:09.881067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:35:09.881067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:35:09.881067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:35:09.881067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:35:09.881067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:35:09.881067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:35:09.881067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:35:09.881067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:35:09.881067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:35:09.881067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac53ca0d-94da-45a3-bd53-f013b5b61d51 could not be found. Aug 04 16:35:09.881067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:35:09.881067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:09.881067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:35:09.881067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:09.881067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:09.881067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:09.881067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:35:09.881067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:35:09.881067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac53ca0d-94da-45a3-bd53-f013b5b61d51 could not be found. Aug 04 16:35:09.881067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:35:09.888851 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bf208937-b773-4008-a0b0-20c3f88955f2 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Returning 404 to user: Instance ac53ca0d-94da-45a3-bd53-f013b5b61d51 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:35:09.890803 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bf208937-b773-4008-a0b0-20c3f88955f2 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51" status: 404 len: 111 microversion: 2.1 time: 0.070703 Aug 04 16:35:09.892014 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 364/724] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:35:09 2022] DELETE /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:35:09.898415 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f9d6162b-6d53-4358-8fb4-11d6f5c95683 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:09.899348 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f9d6162b-6d53-4358-8fb4-11d6f5c95683 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: b61f1675-928c-4591-8213-474c2bc174be] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:09.935085 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f9d6162b-6d53-4358-8fb4-11d6f5c95683 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:09.936562 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f9d6162b-6d53-4358-8fb4-11d6f5c95683 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:09.937648 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f9d6162b-6d53-4358-8fb4-11d6f5c95683 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:09.938335 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f9d6162b-6d53-4358-8fb4-11d6f5c95683 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:10.163484 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-704cd4e6-155d-4522-8db3-32d035ee2c37 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:10.173654 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-704cd4e6-155d-4522-8db3-32d035ee2c37 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1475 microversion: 2.1 time: 0.471276 Aug 04 16:35:10.181095 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 361/725] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:09 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1475 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:10.229958 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-36965329-68c0-48e4-846a-e6dfcacceeb4 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:10.232629 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-36965329-68c0-48e4-846a-e6dfcacceeb4 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:10.252344 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-36965329-68c0-48e4-846a-e6dfcacceeb4 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:10.254433 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-36965329-68c0-48e4-846a-e6dfcacceeb4 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:10.258859 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-36965329-68c0-48e4-846a-e6dfcacceeb4 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:10.259615 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-36965329-68c0-48e4-846a-e6dfcacceeb4 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:10.319962 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:35:10.536166 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-36965329-68c0-48e4-846a-e6dfcacceeb4 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:10.550990 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-36965329-68c0-48e4-846a-e6dfcacceeb4 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:10.556227 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f9d6162b-6d53-4358-8fb4-11d6f5c95683 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:10.558770 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-36965329-68c0-48e4-846a-e6dfcacceeb4 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:10.565651 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f9d6162b-6d53-4358-8fb4-11d6f5c95683 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:10.571876 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f9d6162b-6d53-4358-8fb4-11d6f5c95683 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:10.575349 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f9d6162b-6d53-4358-8fb4-11d6f5c95683 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be" status: 200 len: 1567 microversion: 2.25 time: 0.681749 Aug 04 16:35:10.578530 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 365/726] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:09 2022] GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be => generated 1567 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:10.585486 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-36965329-68c0-48e4-846a-e6dfcacceeb4 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1446 microversion: 2.75 time: 0.386322 Aug 04 16:35:10.612988 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 362/727] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:10 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1446 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:10.613491 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7a54ab6f-c52f-4f4e-b840-3c959b1e0586 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:10.613491 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7a54ab6f-c52f-4f4e-b840-3c959b1e0586 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] [instance: ac53ca0d-94da-45a3-bd53-f013b5b61d51] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:10.640874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7a54ab6f-c52f-4f4e-b840-3c959b1e0586 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:10.641610 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7a54ab6f-c52f-4f4e-b840-3c959b1e0586 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:10.642972 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7a54ab6f-c52f-4f4e-b840-3c959b1e0586 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:10.643408 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7a54ab6f-c52f-4f4e-b840-3c959b1e0586 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:10.676536 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-7a54ab6f-c52f-4f4e-b840-3c959b1e0586 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] HTTP exception thrown: Instance ac53ca0d-94da-45a3-bd53-f013b5b61d51 could not be found. Aug 04 16:35:10.678752 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7a54ab6f-c52f-4f4e-b840-3c959b1e0586 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Request method failure captured: Aug 04 16:35:10.678752 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51 HTTP/1.1 Aug 04 16:35:10.678752 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:35:10.678752 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:35:10.678752 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:35:10.678752 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:35:10.678752 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:35:10.678752 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:35:10.678752 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:35:10.678752 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:35:10.678752 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_SRb208r6TufvSTFYVXwyj3DTtXZ8jpzunXKKjMOHyUs9L_C2dDHOjfAJrnLCso0jrhuGhfBgNREQORB1aujt4F5Tri2XO2GAkgJem82YirkLqG7yvzOz41SmvKBzV6LvJVPtkiFmgyV5IoYWxq6Z3N-2SdIC5DGPqTU82sr_zsHrY Aug 04 16:35:10.678752 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:35:10.678752 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:35:10.678752 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:35:10.678752 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:35:10.678752 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:35:10.678752 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:35:10.678752 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 5cd96a8c91974b8ba7919d5349f380ee Aug 04 16:35:10.678752 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-651926315 Aug 04 16:35:10.678752 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:35:10.678752 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:35:10.680110 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5cd96a8c91974b8ba7919d5349f380ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5cd96a8c91974b8ba7919d5349f380ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5cd96a8c91974b8ba7919d5349f380ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5cd96a8c91974b8ba7919d5349f380ee"}]}] Aug 04 16:35:10.680110 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-651926315 Aug 04 16:35:10.680110 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 5cd96a8c91974b8ba7919d5349f380ee Aug 04 16:35:10.680110 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-651926315 Aug 04 16:35:10.680110 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersWithSpecificFlavorTestJSON-651926315-project Aug 04 16:35:10.680110 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:35:10.680110 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:35:10.680110 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 7a427fb7481d4799a83729910f33b01b Aug 04 16:35:10.680110 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-651926315-project Aug 04 16:35:10.680110 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:35:10.680110 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance ac53ca0d-94da-45a3-bd53-f013b5b61d51 could not be found. Aug 04 16:35:10.680110 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'ac53ca0d-94da-45a3-bd53-f013b5b61d51'} Aug 04 16:35:10.680846 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:35:10.680846 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:10.680846 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:35:10.680846 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:35:10.680846 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:35:10.680846 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:35:10.680846 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:35:10.680846 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:35:10.680846 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:35:10.680846 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:35:10.680846 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac53ca0d-94da-45a3-bd53-f013b5b61d51 could not be found. Aug 04 16:35:10.680846 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:35:10.680846 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:10.680846 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:35:10.680846 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:10.680846 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:10.680846 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:10.680846 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:35:10.680846 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:35:10.680846 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:35:10.682078 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:35:10.682078 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:35:10.682078 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:35:10.682078 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:35:10.682078 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:35:10.682078 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:35:10.682078 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:35:10.682078 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac53ca0d-94da-45a3-bd53-f013b5b61d51 could not be found. Aug 04 16:35:10.682078 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:35:10.682078 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:10.682078 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:35:10.682078 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:10.682078 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:10.682078 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:10.682078 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:35:10.682078 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:35:10.682078 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac53ca0d-94da-45a3-bd53-f013b5b61d51 could not be found. Aug 04 16:35:10.682078 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:35:10.686787 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7a54ab6f-c52f-4f4e-b840-3c959b1e0586 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] Returning 404 to user: Instance ac53ca0d-94da-45a3-bd53-f013b5b61d51 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:35:10.689984 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7a54ab6f-c52f-4f4e-b840-3c959b1e0586 tempest-ServersWithSpecificFlavorTestJSON-651926315 tempest-ServersWithSpecificFlavorTestJSON-651926315-project] 10.222.0.23 "GET /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51" status: 404 len: 111 microversion: 2.1 time: 0.101747 Aug 04 16:35:10.692759 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 366/728] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:10 2022] GET /compute/v2.1/servers/ac53ca0d-94da-45a3-bd53-f013b5b61d51 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:35:10.725060 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c3c23e59-dd28-44aa-b9e4-3101c604b9e2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:10.725707 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c3c23e59-dd28-44aa-b9e4-3101c604b9e2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: a80ed729-9d91-4fba-a785-77d5aeacb767] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:10.739339 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3c23e59-dd28-44aa-b9e4-3101c604b9e2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:10.739849 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3c23e59-dd28-44aa-b9e4-3101c604b9e2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:10.744511 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3c23e59-dd28-44aa-b9e4-3101c604b9e2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:10.745057 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3c23e59-dd28-44aa-b9e4-3101c604b9e2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:10.845818 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5ec3c421-1222-49ad-a70a-c0c22c93e336 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:10.846634 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5ec3c421-1222-49ad-a70a-c0c22c93e336 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 2d2e5f9c-c00d-46b1-b55c-b2bda4428946] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:10.857228 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ec3c421-1222-49ad-a70a-c0c22c93e336 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:10.858980 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ec3c421-1222-49ad-a70a-c0c22c93e336 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:10.862169 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ec3c421-1222-49ad-a70a-c0c22c93e336 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:10.862931 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ec3c421-1222-49ad-a70a-c0c22c93e336 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:11.193248 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c3c23e59-dd28-44aa-b9e4-3101c604b9e2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:11.214722 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c3c23e59-dd28-44aa-b9e4-3101c604b9e2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767" status: 200 len: 1503 microversion: 2.1 time: 0.491931 Aug 04 16:35:11.215569 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 363/729] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:10 2022] GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767 => generated 1503 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:11.228830 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bb9c78f6-b03d-438f-ac2b-ee20e54fe753 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:11.231447 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bb9c78f6-b03d-438f-ac2b-ee20e54fe753 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:11.240219 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5ec3c421-1222-49ad-a70a-c0c22c93e336 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a732f446814c9fa080979bef241023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f22de02d3e4db281f6372e8191b95f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:11.246815 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bb9c78f6-b03d-438f-ac2b-ee20e54fe753 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:11.247255 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bb9c78f6-b03d-438f-ac2b-ee20e54fe753 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:11.252989 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5ec3c421-1222-49ad-a70a-c0c22c93e336 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "GET /compute/v2.1/servers/2d2e5f9c-c00d-46b1-b55c-b2bda4428946" status: 200 len: 1323 microversion: 2.1 time: 0.411487 Aug 04 16:35:11.257488 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 367/730] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:10 2022] GET /compute/v2.1/servers/2d2e5f9c-c00d-46b1-b55c-b2bda4428946 => generated 1323 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:11.263089 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bb9c78f6-b03d-438f-ac2b-ee20e54fe753 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:11.263610 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bb9c78f6-b03d-438f-ac2b-ee20e54fe753 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:11.417319 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-6a6c638f-830a-47c8-9d58-99b197eb4f09 req-8e95d306-1f7f-404f-a55b-5e9e5297b300 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d2e5f9c-c00d-46b1-b55c-b2bda4428946", "tag": "7b107fe2-9d03-469a-b39d-9bb9814ca01a"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:11.457320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-6a6c638f-830a-47c8-9d58-99b197eb4f09 req-8e95d306-1f7f-404f-a55b-5e9e5297b300 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:11.457320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-6a6c638f-830a-47c8-9d58-99b197eb4f09 req-8e95d306-1f7f-404f-a55b-5e9e5297b300 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:11.493133 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-6a6c638f-830a-47c8-9d58-99b197eb4f09 req-8e95d306-1f7f-404f-a55b-5e9e5297b300 service nova] Creating event network-changed:7b107fe2-9d03-469a-b39d-9bb9814ca01a for instance 2d2e5f9c-c00d-46b1-b55c-b2bda4428946 on n-h2-846466-12 Aug 04 16:35:11.504190 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-6a6c638f-830a-47c8-9d58-99b197eb4f09 req-8e95d306-1f7f-404f-a55b-5e9e5297b300 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091488 Aug 04 16:35:11.505641 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 368/731] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:35:11.624621 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:35:11.633253 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f1c81ea6-bccd-4c4f-88a7-abc1deab32e3 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:11.634062 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f1c81ea6-bccd-4c4f-88a7-abc1deab32e3 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:11.657478 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f1c81ea6-bccd-4c4f-88a7-abc1deab32e3 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:11.658541 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f1c81ea6-bccd-4c4f-88a7-abc1deab32e3 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:11.662175 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f1c81ea6-bccd-4c4f-88a7-abc1deab32e3 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:11.662631 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f1c81ea6-bccd-4c4f-88a7-abc1deab32e3 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:11.713421 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:35:11.984918 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f1c81ea6-bccd-4c4f-88a7-abc1deab32e3 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:12.010131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f1c81ea6-bccd-4c4f-88a7-abc1deab32e3 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:12.011655 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f1c81ea6-bccd-4c4f-88a7-abc1deab32e3 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:12.025393 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bb9c78f6-b03d-438f-ac2b-ee20e54fe753 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:12.031515 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f1c81ea6-bccd-4c4f-88a7-abc1deab32e3 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1446 microversion: 2.75 time: 0.408022 Aug 04 16:35:12.041992 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 369/732] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:11 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1446 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:12.044986 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bb9c78f6-b03d-438f-ac2b-ee20e54fe753 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1475 microversion: 2.1 time: 0.828306 Aug 04 16:35:12.045821 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 364/733] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:11 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1475 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:12.068636 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-492ae142-089e-461d-9d3c-e05f01b10703 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:12.072137 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-492ae142-089e-461d-9d3c-e05f01b10703 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: b61f1675-928c-4591-8213-474c2bc174be] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:12.090959 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-492ae142-089e-461d-9d3c-e05f01b10703 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:12.094003 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-492ae142-089e-461d-9d3c-e05f01b10703 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:12.098628 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-492ae142-089e-461d-9d3c-e05f01b10703 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:12.099068 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-492ae142-089e-461d-9d3c-e05f01b10703 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:12.256774 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7b8838a7-35d1-4910-acd2-1952d981e218 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:12.264641 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7b8838a7-35d1-4910-acd2-1952d981e218 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: a80ed729-9d91-4fba-a785-77d5aeacb767] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:12.274847 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b8838a7-35d1-4910-acd2-1952d981e218 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:12.278743 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b8838a7-35d1-4910-acd2-1952d981e218 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:12.279902 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b8838a7-35d1-4910-acd2-1952d981e218 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:12.280565 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b8838a7-35d1-4910-acd2-1952d981e218 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:12.848924 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-492ae142-089e-461d-9d3c-e05f01b10703 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:12.869159 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-492ae142-089e-461d-9d3c-e05f01b10703 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:12.881215 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7b8838a7-35d1-4910-acd2-1952d981e218 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:12.909404 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-492ae142-089e-461d-9d3c-e05f01b10703 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:12.910876 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-492ae142-089e-461d-9d3c-e05f01b10703 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be" status: 200 len: 1557 microversion: 2.25 time: 0.867317 Aug 04 16:35:12.911474 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 370/734] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:12 2022] GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be => generated 1557 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:12.913218 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7b8838a7-35d1-4910-acd2-1952d981e218 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767" status: 200 len: 1503 microversion: 2.1 time: 0.662366 Aug 04 16:35:12.919710 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 365/735] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:12 2022] GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767 => generated 1503 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:12.937104 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4f0a4940-d349-4e7e-aed9-52235ee2bc30 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:12.941102 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4f0a4940-d349-4e7e-aed9-52235ee2bc30 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 2d2e5f9c-c00d-46b1-b55c-b2bda4428946] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:12.947551 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1d58a45a-49b1-476a-b75f-78d0f462d088 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Calling method '.version_select at 0x7f7e8447c0d0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:12.961725 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4f0a4940-d349-4e7e-aed9-52235ee2bc30 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:12.962702 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4f0a4940-d349-4e7e-aed9-52235ee2bc30 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:12.963604 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4f0a4940-d349-4e7e-aed9-52235ee2bc30 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:12.965754 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4f0a4940-d349-4e7e-aed9-52235ee2bc30 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:12.968738 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1d58a45a-49b1-476a-b75f-78d0f462d088 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:12.971661 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1d58a45a-49b1-476a-b75f-78d0f462d088 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:13.040172 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1d58a45a-49b1-476a-b75f-78d0f462d088 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 1962 microversion: 2.25 time: 0.105692 Aug 04 16:35:13.051292 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 366/736] 10.222.0.23 () {60 vars in 1184 bytes} [Thu Aug 4 16:35:12 2022] GET /compute/v2.1/os-migrations => generated 1962 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:35:13.057681 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-97b6cb4f-95a0-4709-9609-3a60add154f2 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:13.082127 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-97b6cb4f-95a0-4709-9609-3a60add154f2 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] [instance: b61f1675-928c-4591-8213-474c2bc174be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:13.090548 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-97b6cb4f-95a0-4709-9609-3a60add154f2 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:13.091350 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-97b6cb4f-95a0-4709-9609-3a60add154f2 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:13.092352 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-97b6cb4f-95a0-4709-9609-3a60add154f2 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:13.092984 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-97b6cb4f-95a0-4709-9609-3a60add154f2 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:13.677816 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-97b6cb4f-95a0-4709-9609-3a60add154f2 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lazy-loading 'services' on Instance uuid b61f1675-928c-4591-8213-474c2bc174be {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:35:13.688315 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4f0a4940-d349-4e7e-aed9-52235ee2bc30 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a732f446814c9fa080979bef241023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f22de02d3e4db281f6372e8191b95f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:13.697308 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4f0a4940-d349-4e7e-aed9-52235ee2bc30 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "GET /compute/v2.1/servers/2d2e5f9c-c00d-46b1-b55c-b2bda4428946" status: 200 len: 1323 microversion: 2.1 time: 0.777559 Aug 04 16:35:13.697919 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 371/737] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:12 2022] GET /compute/v2.1/servers/2d2e5f9c-c00d-46b1-b55c-b2bda4428946 => generated 1323 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:13.716819 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-64a1bfb3-fd05-4e6a-bdf3-8127d01c0adc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:13.717221 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-64a1bfb3-fd05-4e6a-bdf3-8127d01c0adc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:13.756003 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-64a1bfb3-fd05-4e6a-bdf3-8127d01c0adc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:13.756469 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-64a1bfb3-fd05-4e6a-bdf3-8127d01c0adc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:13.757296 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-64a1bfb3-fd05-4e6a-bdf3-8127d01c0adc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:13.757714 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-64a1bfb3-fd05-4e6a-bdf3-8127d01c0adc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:13.931377 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-97b6cb4f-95a0-4709-9609-3a60add154f2 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be" status: 200 len: 2052 microversion: 2.25 time: 0.877208 Aug 04 16:35:13.951882 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 367/738] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:13 2022] GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be => generated 2052 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:13.975360 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ec9ce6ad-749a-4e01-87fa-697e32260412 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:13.976034 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ec9ce6ad-749a-4e01-87fa-697e32260412 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:13.993821 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec9ce6ad-749a-4e01-87fa-697e32260412 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:13.997960 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec9ce6ad-749a-4e01-87fa-697e32260412 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:14.000553 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec9ce6ad-749a-4e01-87fa-697e32260412 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:14.008574 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec9ce6ad-749a-4e01-87fa-697e32260412 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:14.221123 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ec9ce6ad-749a-4e01-87fa-697e32260412 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:14.241511 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ec9ce6ad-749a-4e01-87fa-697e32260412 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:14.243631 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ec9ce6ad-749a-4e01-87fa-697e32260412 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:14.257103 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ec9ce6ad-749a-4e01-87fa-697e32260412 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1446 microversion: 2.75 time: 0.304177 Aug 04 16:35:14.273693 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 368/739] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:13 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1446 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:14.289525 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-82fcccec-df75-49ce-8008-2adfaa0b10ee tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:14.293852 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-82fcccec-df75-49ce-8008-2adfaa0b10ee tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: a80ed729-9d91-4fba-a785-77d5aeacb767] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:14.310501 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-82fcccec-df75-49ce-8008-2adfaa0b10ee tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:14.310932 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-82fcccec-df75-49ce-8008-2adfaa0b10ee tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:14.311923 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-82fcccec-df75-49ce-8008-2adfaa0b10ee tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:14.312520 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-82fcccec-df75-49ce-8008-2adfaa0b10ee tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:14.386795 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-64a1bfb3-fd05-4e6a-bdf3-8127d01c0adc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:14.399397 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-64a1bfb3-fd05-4e6a-bdf3-8127d01c0adc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1475 microversion: 2.1 time: 0.686568 Aug 04 16:35:14.399998 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 372/740] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:13 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1475 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:14.413224 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-5cfb79b2-ab42-41fb-a225-101020341f85 req-6fe0a72e-8fb4-43b8-84ef-6cd72522988e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a80ed729-9d91-4fba-a785-77d5aeacb767", "name": "network-vif-unplugged", "status": "completed", "tag": "79848b85-9a77-47be-a4af-fb28446f2cd4"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:14.446623 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-5cfb79b2-ab42-41fb-a225-101020341f85 req-6fe0a72e-8fb4-43b8-84ef-6cd72522988e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:14.447122 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-5cfb79b2-ab42-41fb-a225-101020341f85 req-6fe0a72e-8fb4-43b8-84ef-6cd72522988e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:14.469237 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-5cfb79b2-ab42-41fb-a225-101020341f85 req-6fe0a72e-8fb4-43b8-84ef-6cd72522988e service nova] Creating event network-vif-unplugged:79848b85-9a77-47be-a4af-fb28446f2cd4 for instance a80ed729-9d91-4fba-a785-77d5aeacb767 on n-h1-846466-12 Aug 04 16:35:14.475140 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-5cfb79b2-ab42-41fb-a225-101020341f85 req-6fe0a72e-8fb4-43b8-84ef-6cd72522988e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073958 Aug 04 16:35:14.479827 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 373/741] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:35:14.500346 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cec2971c-8e6d-45e7-b14b-7ef5f0fd781d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-329202685", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "2ab6e0fe-802f-4938-8f6b-adfd35fddb62"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:14.586938 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-cec2971c-8e6d-45e7-b14b-7ef5f0fd781d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] validate_networks() for [('2ab6e0fe-802f-4938-8f6b-adfd35fddb62', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:35:15.347008 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-82fcccec-df75-49ce-8008-2adfaa0b10ee tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:15.363429 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-82fcccec-df75-49ce-8008-2adfaa0b10ee tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767" status: 200 len: 1503 microversion: 2.1 time: 1.088295 Aug 04 16:35:15.364928 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 369/742] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:14 2022] GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767 => generated 1503 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:15.381408 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2046a0d9-ad68-49a2-8c63-e9a14beeae68 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:15.383083 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2046a0d9-ad68-49a2-8c63-e9a14beeae68 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 2d2e5f9c-c00d-46b1-b55c-b2bda4428946] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:15.394880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2046a0d9-ad68-49a2-8c63-e9a14beeae68 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:15.397227 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2046a0d9-ad68-49a2-8c63-e9a14beeae68 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:15.403800 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2046a0d9-ad68-49a2-8c63-e9a14beeae68 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:15.404613 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2046a0d9-ad68-49a2-8c63-e9a14beeae68 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:16.238973 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2046a0d9-ad68-49a2-8c63-e9a14beeae68 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a732f446814c9fa080979bef241023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f22de02d3e4db281f6372e8191b95f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:16.272016 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2046a0d9-ad68-49a2-8c63-e9a14beeae68 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "GET /compute/v2.1/servers/2d2e5f9c-c00d-46b1-b55c-b2bda4428946" status: 200 len: 1323 microversion: 2.1 time: 0.905271 Aug 04 16:35:16.275145 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 370/743] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:15 2022] GET /compute/v2.1/servers/2d2e5f9c-c00d-46b1-b55c-b2bda4428946 => generated 1323 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:16.445837 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1bd982fe-09b2-47a0-82c5-f70df65b66e3 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Action: 'create', calling method: .version_select at 0x7f7e843fe700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1803435318", "description": "tempest-description-507343732"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:16.770564 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-cec2971c-8e6d-45e7-b14b-7ef5f0fd781d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:35:16.771919 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-cec2971c-8e6d-45e7-b14b-7ef5f0fd781d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:35:16.772594 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-cec2971c-8e6d-45e7-b14b-7ef5f0fd781d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:35:16.773149 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-cec2971c-8e6d-45e7-b14b-7ef5f0fd781d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:35:16.774341 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-cec2971c-8e6d-45e7-b14b-7ef5f0fd781d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:35:16.797515 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cec2971c-8e6d-45e7-b14b-7ef5f0fd781d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:16.798428 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cec2971c-8e6d-45e7-b14b-7ef5f0fd781d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:16.806313 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cec2971c-8e6d-45e7-b14b-7ef5f0fd781d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:16.808241 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cec2971c-8e6d-45e7-b14b-7ef5f0fd781d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:16.855554 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-cec2971c-8e6d-45e7-b14b-7ef5f0fd781d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Getting quotas for project e96e3e6168ec421da0cac9eaa8849255. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:35:16.869213 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-cec2971c-8e6d-45e7-b14b-7ef5f0fd781d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Getting quotas for user 5bf98871e1344215bd667945e6881320 and project e96e3e6168ec421da0cac9eaa8849255. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:35:16.895644 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cec2971c-8e6d-45e7-b14b-7ef5f0fd781d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:35:16.900763 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cec2971c-8e6d-45e7-b14b-7ef5f0fd781d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 6017510a-e331-424a-843d-54b980b999fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:35:17.000793 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cec2971c-8e6d-45e7-b14b-7ef5f0fd781d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.513191 Aug 04 16:35:17.005161 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 374/744] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Aug 4 16:35:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2524 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 16:35:17.015621 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c3825937-5cef-4050-a554-b73f8d640f2d tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:17.020492 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c3825937-5cef-4050-a554-b73f8d640f2d tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:17.037124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c3825937-5cef-4050-a554-b73f8d640f2d tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:17.037933 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c3825937-5cef-4050-a554-b73f8d640f2d tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:17.038929 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c3825937-5cef-4050-a554-b73f8d640f2d tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:17.039546 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c3825937-5cef-4050-a554-b73f8d640f2d tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:17.199279 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c3825937-5cef-4050-a554-b73f8d640f2d tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:17.215996 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c3825937-5cef-4050-a554-b73f8d640f2d tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:17.225374 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1bd982fe-09b2-47a0-82c5-f70df65b66e3 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.948850 Aug 04 16:35:17.226174 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 371/745] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Aug 4 16:35:16 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:35:17.229848 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c3825937-5cef-4050-a554-b73f8d640f2d tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:17.234926 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2490595b-e612-4312-b71b-4181a199d383 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:17.236724 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2490595b-e612-4312-b71b-4181a199d383 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:17.238460 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c3825937-5cef-4050-a554-b73f8d640f2d tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1446 microversion: 2.75 time: 0.231029 Aug 04 16:35:17.243964 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 375/746] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:17 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1446 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:17.252953 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b4abf82a-593c-4d61-b03c-61b7764474a5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:17.254767 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b4abf82a-593c-4d61-b03c-61b7764474a5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: a80ed729-9d91-4fba-a785-77d5aeacb767] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:17.271516 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2490595b-e612-4312-b71b-4181a199d383 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:17.271959 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2490595b-e612-4312-b71b-4181a199d383 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:17.274097 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2490595b-e612-4312-b71b-4181a199d383 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:17.274550 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2490595b-e612-4312-b71b-4181a199d383 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:17.275477 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b4abf82a-593c-4d61-b03c-61b7764474a5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:17.275915 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b4abf82a-593c-4d61-b03c-61b7764474a5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:17.276674 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b4abf82a-593c-4d61-b03c-61b7764474a5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:17.280515 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b4abf82a-593c-4d61-b03c-61b7764474a5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:17.613785 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b4abf82a-593c-4d61-b03c-61b7764474a5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:17.637636 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b4abf82a-593c-4d61-b03c-61b7764474a5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767" status: 200 len: 1503 microversion: 2.1 time: 0.390416 Aug 04 16:35:17.641380 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 376/747] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:17 2022] GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767 => generated 1503 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:17.655742 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-fe16f3ee-853f-46e3-9c57-f7b9145b7c41 req-3f321916-e7d6-4dfd-a12d-8953e9c78b13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a80ed729-9d91-4fba-a785-77d5aeacb767", "tag": "79848b85-9a77-47be-a4af-fb28446f2cd4"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:17.686157 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-fe16f3ee-853f-46e3-9c57-f7b9145b7c41 req-3f321916-e7d6-4dfd-a12d-8953e9c78b13 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:17.686933 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-fe16f3ee-853f-46e3-9c57-f7b9145b7c41 req-3f321916-e7d6-4dfd-a12d-8953e9c78b13 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:17.706949 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2490595b-e612-4312-b71b-4181a199d383 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:17.716406 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-fe16f3ee-853f-46e3-9c57-f7b9145b7c41 req-3f321916-e7d6-4dfd-a12d-8953e9c78b13 service nova] Creating event network-changed:79848b85-9a77-47be-a4af-fb28446f2cd4 for instance a80ed729-9d91-4fba-a785-77d5aeacb767 on n-h1-846466-12 Aug 04 16:35:17.718550 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2490595b-e612-4312-b71b-4181a199d383 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1475 microversion: 2.1 time: 0.491157 Aug 04 16:35:17.719136 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 372/748] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:17 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1475 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:17.739655 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-fe16f3ee-853f-46e3-9c57-f7b9145b7c41 req-3f321916-e7d6-4dfd-a12d-8953e9c78b13 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092180 Aug 04 16:35:17.739900 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-173f9c1c-dcc0-4e1a-ab4f-e0fda51bc0e6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:17.740515 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-173f9c1c-dcc0-4e1a-ab4f-e0fda51bc0e6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 6017510a-e331-424a-843d-54b980b999fb] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:17.741467 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 377/749] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:35:17.768829 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-93f6b492-cc7f-4d8b-a21a-dc942d193234 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Action: 'create', calling method: .version_select at 0x7f7e84e33820>, body: {"security_group_rule": {"parent_group_id": "cdc4f91d-fc99-475d-b32b-f68c7631f3ed", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:17.929161 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-173f9c1c-dcc0-4e1a-ab4f-e0fda51bc0e6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:17.940399 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-173f9c1c-dcc0-4e1a-ab4f-e0fda51bc0e6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:17.945164 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-173f9c1c-dcc0-4e1a-ab4f-e0fda51bc0e6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:17.947736 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-173f9c1c-dcc0-4e1a-ab4f-e0fda51bc0e6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb" status: 200 len: 1261 microversion: 2.25 time: 0.227655 Aug 04 16:35:17.949227 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 373/750] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:17 2022] GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb => generated 1261 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:17.953949 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-aaa64762-9050-4712-9177-66cd8f669f00 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:17.954830 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-aaa64762-9050-4712-9177-66cd8f669f00 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 2d2e5f9c-c00d-46b1-b55c-b2bda4428946] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:17.962110 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aaa64762-9050-4712-9177-66cd8f669f00 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:17.962764 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aaa64762-9050-4712-9177-66cd8f669f00 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:17.963803 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aaa64762-9050-4712-9177-66cd8f669f00 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:17.964375 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aaa64762-9050-4712-9177-66cd8f669f00 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:18.311544 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-93f6b492-cc7f-4d8b-a21a-dc942d193234 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.568560 Aug 04 16:35:18.311984 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 378/751] 10.222.0.23 () {60 vars in 1195 bytes} [Thu Aug 4 16:35:17 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:35:18.319867 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c8605d09-7d5f-4efe-85ed-2cfbdee29210 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:18.319867 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c8605d09-7d5f-4efe-85ed-2cfbdee29210 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:18.340065 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c8605d09-7d5f-4efe-85ed-2cfbdee29210 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:18.340733 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c8605d09-7d5f-4efe-85ed-2cfbdee29210 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:18.341727 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c8605d09-7d5f-4efe-85ed-2cfbdee29210 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:18.344685 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c8605d09-7d5f-4efe-85ed-2cfbdee29210 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:18.413647 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-aaa64762-9050-4712-9177-66cd8f669f00 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a732f446814c9fa080979bef241023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f22de02d3e4db281f6372e8191b95f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:18.427514 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-aaa64762-9050-4712-9177-66cd8f669f00 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "GET /compute/v2.1/servers/2d2e5f9c-c00d-46b1-b55c-b2bda4428946" status: 200 len: 1323 microversion: 2.1 time: 0.477149 Aug 04 16:35:18.429379 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 374/752] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:17 2022] GET /compute/v2.1/servers/2d2e5f9c-c00d-46b1-b55c-b2bda4428946 => generated 1323 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:18.455462 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3abef4b5-1472-47fb-a797-9703c7da5644 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Action: 'create', calling method: .version_select at 0x7f7e8447d8b0>, body: {"security_group_rule": {"parent_group_id": "cdc4f91d-fc99-475d-b32b-f68c7631f3ed", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:18.485883 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c8605d09-7d5f-4efe-85ed-2cfbdee29210 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:18.499747 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c8605d09-7d5f-4efe-85ed-2cfbdee29210 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:18.501351 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c8605d09-7d5f-4efe-85ed-2cfbdee29210 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:18.516613 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c8605d09-7d5f-4efe-85ed-2cfbdee29210 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1446 microversion: 2.75 time: 0.203565 Aug 04 16:35:18.517400 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 379/753] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:18 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1446 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:18.625272 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-3abef4b5-1472-47fb-a797-9703c7da5644 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] HTTP exception thrown: This rule already exists in group cdc4f91d-fc99-475d-b32b-f68c7631f3ed Aug 04 16:35:18.640722 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3abef4b5-1472-47fb-a797-9703c7da5644 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Request method failure captured: Aug 04 16:35:18.640722 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 04 16:35:18.640722 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:35:18.640722 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:35:18.640722 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:35:18.640722 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 138 Aug 04 16:35:18.640722 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:35:18.640722 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:35:18.640722 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:35:18.640722 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:35:18.640722 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_VCMgl-Ujx4xn8LJn2DlERaWZr_hUMfCBdT0WGd_U2j7gcCj2GdzZnw3lP8rk7pChqM7-xc8SlsGHqLKnyt6petZMVQk942zLRN1CUkj1xEAqxPVjpLHzjCE6qbRVB9l84WA8hcx4s8OvG_vxLMmzreFIkQZtSe6QwCramDqD0jXCc Aug 04 16:35:18.640722 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:35:18.640722 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:35:18.640722 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:35:18.640722 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:35:18.640722 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:35:18.640722 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:35:18.640722 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: dc4b4bcf09f74030a1ad54a165bd6b70 Aug 04 16:35:18.640722 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1094474337 Aug 04 16:35:18.640722 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:35:18.640722 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:35:18.642738 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc4b4bcf09f74030a1ad54a165bd6b70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dc4b4bcf09f74030a1ad54a165bd6b70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc4b4bcf09f74030a1ad54a165bd6b70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dc4b4bcf09f74030a1ad54a165bd6b70"}]}] Aug 04 16:35:18.642738 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1094474337 Aug 04 16:35:18.642738 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: dc4b4bcf09f74030a1ad54a165bd6b70 Aug 04 16:35:18.642738 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1094474337 Aug 04 16:35:18.642738 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project Aug 04 16:35:18.642738 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:35:18.642738 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:35:18.642738 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: ad637558f9c142d8a386735193915eab Aug 04 16:35:18.642738 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project Aug 04 16:35:18.642738 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:35:18.642738 n-d-846466-12 devstack@n-api.service[126125]: {"security_group_rule": {"parent_group_id": "cdc4f91d-fc99-475d-b32b-f68c7631f3ed", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 04 16:35:18.642738 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:35:18.643625 n-d-846466-12 devstack@n-api.service[126125]: exception: This rule already exists in group cdc4f91d-fc99-475d-b32b-f68c7631f3ed Aug 04 16:35:18.643625 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'cdc4f91d-fc99-475d-b32b-f68c7631f3ed', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 04 16:35:18.643625 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:35:18.643625 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:18.643625 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 04 16:35:18.643625 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 04 16:35:18.643625 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 04 16:35:18.643625 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 04 16:35:18.643625 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group cdc4f91d-fc99-475d-b32b-f68c7631f3ed Aug 04 16:35:18.643625 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:18.643625 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:18.643625 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:18.643625 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:18.643625 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:18.643625 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:18.643625 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:35:18.643625 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:35:18.643625 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:35:18.643625 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:35:18.643625 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:35:18.645203 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:35:18.645203 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 04 16:35:18.645203 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 16:35:18.645203 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group cdc4f91d-fc99-475d-b32b-f68c7631f3ed Aug 04 16:35:18.645203 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:18.645203 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:18.645203 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:18.645203 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:18.645203 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:18.645203 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:18.645203 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:35:18.645203 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:35:18.645203 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group cdc4f91d-fc99-475d-b32b-f68c7631f3ed Aug 04 16:35:18.645203 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:18.648347 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3abef4b5-1472-47fb-a797-9703c7da5644 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Returning 400 to user: This rule already exists in group cdc4f91d-fc99-475d-b32b-f68c7631f3ed {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:35:18.649437 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3abef4b5-1472-47fb-a797-9703c7da5644 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.218920 Aug 04 16:35:18.650630 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 375/754] 10.222.0.23 () {60 vars in 1195 bytes} [Thu Aug 4 16:35:18 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 220 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:35:18.662141 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e22f72ae-7afd-4485-9167-730fd4714c9e tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Calling method '.version_select at 0x7f7e84e33f70>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:18.668300 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-47690694-6c62-4843-b568-7740e7ce4973 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:18.670004 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-47690694-6c62-4843-b568-7740e7ce4973 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: a80ed729-9d91-4fba-a785-77d5aeacb767] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:18.681765 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-47690694-6c62-4843-b568-7740e7ce4973 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:18.682610 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-47690694-6c62-4843-b568-7740e7ce4973 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:18.683598 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-47690694-6c62-4843-b568-7740e7ce4973 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:18.685600 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-47690694-6c62-4843-b568-7740e7ce4973 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:18.691716 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=100 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:35:19.094163 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-47690694-6c62-4843-b568-7740e7ce4973 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:19.103968 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e22f72ae-7afd-4485-9167-730fd4714c9e tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-group-rules/342f8a2c-b338-43e2-9d37-596bf74216f7" status: 202 len: 0 microversion: 2.1 time: 0.449080 Aug 04 16:35:19.105197 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 380/755] 10.222.0.23 () {58 vars in 1287 bytes} [Thu Aug 4 16:35:18 2022] DELETE /compute/v2.1/os-security-group-rules/342f8a2c-b338-43e2-9d37-596bf74216f7 => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:35:19.106386 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-47690694-6c62-4843-b568-7740e7ce4973 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767" status: 200 len: 1503 microversion: 2.1 time: 0.443135 Aug 04 16:35:19.107146 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 376/756] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:18 2022] GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767 => generated 1503 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:19.117619 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e29384f4-90f1-465a-b2d8-e0cfccce39c7 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:19.119482 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e29384f4-90f1-465a-b2d8-e0cfccce39c7 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 6017510a-e331-424a-843d-54b980b999fb] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:19.122843 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d0631c74-3bd8-4866-8165-9eb50d7da1af tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:19.123455 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d0631c74-3bd8-4866-8165-9eb50d7da1af tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:19.139674 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d0631c74-3bd8-4866-8165-9eb50d7da1af tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:19.140512 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d0631c74-3bd8-4866-8165-9eb50d7da1af tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:19.141387 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d0631c74-3bd8-4866-8165-9eb50d7da1af tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:19.141874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d0631c74-3bd8-4866-8165-9eb50d7da1af tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:19.142629 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e29384f4-90f1-465a-b2d8-e0cfccce39c7 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:19.143833 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e29384f4-90f1-465a-b2d8-e0cfccce39c7 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:19.145887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e29384f4-90f1-465a-b2d8-e0cfccce39c7 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:19.145887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e29384f4-90f1-465a-b2d8-e0cfccce39c7 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:19.248529 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e29384f4-90f1-465a-b2d8-e0cfccce39c7 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:19.258190 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e29384f4-90f1-465a-b2d8-e0cfccce39c7 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:19.267815 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e29384f4-90f1-465a-b2d8-e0cfccce39c7 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:19.270625 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e29384f4-90f1-465a-b2d8-e0cfccce39c7 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb" status: 200 len: 1313 microversion: 2.25 time: 0.161745 Aug 04 16:35:19.271212 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 377/757] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:19 2022] GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:19.294442 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9beae11f-55bc-4c8b-b308-1b5ea8a74ed7 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Action: 'create', calling method: .version_select at 0x7f7e8443b4c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1604835163", "description": "tempest-description-1937617554"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:19.467465 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d0631c74-3bd8-4866-8165-9eb50d7da1af tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:19.481741 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d0631c74-3bd8-4866-8165-9eb50d7da1af tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1475 microversion: 2.1 time: 0.373418 Aug 04 16:35:19.482371 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 381/758] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:19 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1475 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:19.503857 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-94870395-c97a-4fdc-9ec3-1efc3206f805 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:19.504597 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-94870395-c97a-4fdc-9ec3-1efc3206f805 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 2d2e5f9c-c00d-46b1-b55c-b2bda4428946] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:19.523441 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-94870395-c97a-4fdc-9ec3-1efc3206f805 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:19.523890 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-94870395-c97a-4fdc-9ec3-1efc3206f805 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:19.525056 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-94870395-c97a-4fdc-9ec3-1efc3206f805 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:19.528515 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-94870395-c97a-4fdc-9ec3-1efc3206f805 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:19.575346 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9beae11f-55bc-4c8b-b308-1b5ea8a74ed7 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.302829 Aug 04 16:35:19.577895 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 378/759] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Aug 4 16:35:19 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:35:19.590308 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3aab8148-832b-4e3e-bb9b-22732d4f543c tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:19.593314 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3aab8148-832b-4e3e-bb9b-22732d4f543c tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:19.608370 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3aab8148-832b-4e3e-bb9b-22732d4f543c tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:19.608990 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3aab8148-832b-4e3e-bb9b-22732d4f543c tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:19.609851 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3aab8148-832b-4e3e-bb9b-22732d4f543c tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:19.610772 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3aab8148-832b-4e3e-bb9b-22732d4f543c tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:19.701214 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3aab8148-832b-4e3e-bb9b-22732d4f543c tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:19.717900 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3aab8148-832b-4e3e-bb9b-22732d4f543c tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:19.719687 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3aab8148-832b-4e3e-bb9b-22732d4f543c tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:19.728235 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3aab8148-832b-4e3e-bb9b-22732d4f543c tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1446 microversion: 2.75 time: 0.149173 Aug 04 16:35:19.729498 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 379/760] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:19 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1446 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:19.736416 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-111448c2-1eda-4152-bd0b-f9e179abbabc tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Action: 'create', calling method: .version_select at 0x7f7e843bbca0>, body: {"security_group_rule": {"parent_group_id": "460b886d-4e4f-4691-ab1c-9f2cff15147b", "ip_protocol": "tcp", "from_port": 991888475, "to_port": 22}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:19.911346 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-111448c2-1eda-4152-bd0b-f9e179abbabc tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] HTTP exception thrown: Invalid port range 991888475:22. Former value cannot be greater than the later Aug 04 16:35:19.913596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-111448c2-1eda-4152-bd0b-f9e179abbabc tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Request method failure captured: Aug 04 16:35:19.913596 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 04 16:35:19.913596 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:35:19.913596 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:35:19.913596 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:35:19.913596 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 145 Aug 04 16:35:19.913596 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:35:19.913596 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:35:19.913596 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:35:19.913596 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:35:19.913596 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_VCMgl-Ujx4xn8LJn2DlERaWZr_hUMfCBdT0WGd_U2j7gcCj2GdzZnw3lP8rk7pChqM7-xc8SlsGHqLKnyt6petZMVQk942zLRN1CUkj1xEAqxPVjpLHzjCE6qbRVB9l84WA8hcx4s8OvG_vxLMmzreFIkQZtSe6QwCramDqD0jXCc Aug 04 16:35:19.913596 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:35:19.913596 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:35:19.913596 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:35:19.913596 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:35:19.913596 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:35:19.913596 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:35:19.913596 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: dc4b4bcf09f74030a1ad54a165bd6b70 Aug 04 16:35:19.913596 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1094474337 Aug 04 16:35:19.913596 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:35:19.913596 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:35:19.915064 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc4b4bcf09f74030a1ad54a165bd6b70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dc4b4bcf09f74030a1ad54a165bd6b70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc4b4bcf09f74030a1ad54a165bd6b70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dc4b4bcf09f74030a1ad54a165bd6b70"}]}] Aug 04 16:35:19.915064 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1094474337 Aug 04 16:35:19.915064 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: dc4b4bcf09f74030a1ad54a165bd6b70 Aug 04 16:35:19.915064 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1094474337 Aug 04 16:35:19.915064 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project Aug 04 16:35:19.915064 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:35:19.915064 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:35:19.915064 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: ad637558f9c142d8a386735193915eab Aug 04 16:35:19.915064 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project Aug 04 16:35:19.915064 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:35:19.915064 n-d-846466-12 devstack@n-api.service[126125]: {"security_group_rule": {"parent_group_id": "460b886d-4e4f-4691-ab1c-9f2cff15147b", "ip_protocol": "tcp", "from_port": 991888475, "to_port": 22}} Aug 04 16:35:19.915064 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:35:19.915824 n-d-846466-12 devstack@n-api.service[126125]: exception: Invalid port range 991888475:22. Former value cannot be greater than the later Aug 04 16:35:19.915824 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'body': {'security_group_rule': {'parent_group_id': '460b886d-4e4f-4691-ab1c-9f2cff15147b', 'ip_protocol': 'tcp', 'from_port': 991888475, 'to_port': 22}}} Aug 04 16:35:19.915824 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:35:19.915824 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:19.915824 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 04 16:35:19.915824 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 04 16:35:19.915824 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 04 16:35:19.915824 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 04 16:35:19.915824 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 04 16:35:19.915824 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 04 16:35:19.915824 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 04 16:35:19.915824 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 04 16:35:19.915824 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 991888475:22. Former value cannot be greater than the later Aug 04 16:35:19.915824 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:19.915824 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:19.915824 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:19.915824 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:19.915824 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:19.915824 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:19.917036 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:35:19.917036 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:35:19.917036 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:35:19.917036 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:35:19.917036 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:35:19.917036 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:35:19.917036 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 04 16:35:19.917036 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 16:35:19.917036 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 991888475:22. Former value cannot be greater than the later Aug 04 16:35:19.917036 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:19.917036 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:19.917036 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:19.917036 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:19.917036 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:19.917036 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:19.917036 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:35:19.917036 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:35:19.917036 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 991888475:22. Former value cannot be greater than the later Aug 04 16:35:19.917036 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:19.920705 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-111448c2-1eda-4152-bd0b-f9e179abbabc tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Returning 400 to user: Invalid port range 991888475:22. Former value cannot be greater than the later {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:35:19.920993 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-94870395-c97a-4fdc-9ec3-1efc3206f805 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a732f446814c9fa080979bef241023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f22de02d3e4db281f6372e8191b95f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:19.922466 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-111448c2-1eda-4152-bd0b-f9e179abbabc tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.191531 Aug 04 16:35:19.923767 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 380/761] 10.222.0.23 () {60 vars in 1195 bytes} [Thu Aug 4 16:35:19 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 193 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:35:19.927876 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:35:19.934290 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e2610646-7f03-41c2-a1eb-a6ad04a4a52f tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Action: 'create', calling method: .version_select at 0x7f7e8443b040>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-778073909", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:19.936099 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-94870395-c97a-4fdc-9ec3-1efc3206f805 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "GET /compute/v2.1/servers/2d2e5f9c-c00d-46b1-b55c-b2bda4428946" status: 200 len: 1323 microversion: 2.1 time: 0.444718 Aug 04 16:35:19.937389 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 382/762] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:19 2022] GET /compute/v2.1/servers/2d2e5f9c-c00d-46b1-b55c-b2bda4428946 => generated 1323 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:19.937818 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-e2610646-7f03-41c2-a1eb-a6ad04a4a52f tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] HTTP exception thrown: Security group id should be uuid Aug 04 16:35:19.939741 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e2610646-7f03-41c2-a1eb-a6ad04a4a52f tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Request method failure captured: Aug 04 16:35:19.939741 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 04 16:35:19.939741 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:35:19.939741 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:35:19.939741 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:35:19.939741 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 130 Aug 04 16:35:19.939741 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:35:19.939741 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:35:19.939741 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:35:19.939741 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:35:19.939741 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_VCMgl-Ujx4xn8LJn2DlERaWZr_hUMfCBdT0WGd_U2j7gcCj2GdzZnw3lP8rk7pChqM7-xc8SlsGHqLKnyt6petZMVQk942zLRN1CUkj1xEAqxPVjpLHzjCE6qbRVB9l84WA8hcx4s8OvG_vxLMmzreFIkQZtSe6QwCramDqD0jXCc Aug 04 16:35:19.939741 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:35:19.939741 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:35:19.939741 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:35:19.939741 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:35:19.939741 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:35:19.939741 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:35:19.939741 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: dc4b4bcf09f74030a1ad54a165bd6b70 Aug 04 16:35:19.939741 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1094474337 Aug 04 16:35:19.939741 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:35:19.939741 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:35:19.941088 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc4b4bcf09f74030a1ad54a165bd6b70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dc4b4bcf09f74030a1ad54a165bd6b70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc4b4bcf09f74030a1ad54a165bd6b70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dc4b4bcf09f74030a1ad54a165bd6b70"}]}] Aug 04 16:35:19.941088 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1094474337 Aug 04 16:35:19.941088 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: dc4b4bcf09f74030a1ad54a165bd6b70 Aug 04 16:35:19.941088 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1094474337 Aug 04 16:35:19.941088 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project Aug 04 16:35:19.941088 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:35:19.941088 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:35:19.941088 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: ad637558f9c142d8a386735193915eab Aug 04 16:35:19.941088 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project Aug 04 16:35:19.941088 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:35:19.941088 n-d-846466-12 devstack@n-api.service[126125]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-778073909", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 04 16:35:19.941088 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:35:19.941088 n-d-846466-12 devstack@n-api.service[126125]: exception: Security group id should be uuid Aug 04 16:35:19.941946 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-778073909', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 04 16:35:19.941946 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:35:19.941946 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:19.941946 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 04 16:35:19.941946 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 04 16:35:19.941946 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 04 16:35:19.941946 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 04 16:35:19.941946 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 04 16:35:19.941946 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:19.941946 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:19.941946 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:19.941946 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:19.941946 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:19.941946 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:19.941946 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:35:19.941946 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:35:19.941946 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:35:19.941946 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:35:19.941946 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:35:19.941946 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:35:19.943151 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 04 16:35:19.943151 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 16:35:19.943151 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 04 16:35:19.943151 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:19.943151 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:19.943151 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:19.943151 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:19.943151 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:19.943151 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:19.943151 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:35:19.943151 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:35:19.943151 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 04 16:35:19.943151 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:19.943151 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e2610646-7f03-41c2-a1eb-a6ad04a4a52f tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Returning 400 to user: Security group id should be uuid {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:35:19.943151 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e2610646-7f03-41c2-a1eb-a6ad04a4a52f tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.012069 Aug 04 16:35:19.949947 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 381/763] 10.222.0.23 () {60 vars in 1195 bytes} [Thu Aug 4 16:35:19 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 16:35:19.957555 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a898d292-0a58-49f2-b00f-3f35b21f48b0 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Action: 'create', calling method: .version_select at 0x7f7e84e33a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1326604978", "description": "tempest-description-1126730348"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:20.134593 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d29557d2-201e-491a-87ed-4a6b4d7c6d13 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:20.135223 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d29557d2-201e-491a-87ed-4a6b4d7c6d13 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: a80ed729-9d91-4fba-a785-77d5aeacb767] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:20.153145 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d29557d2-201e-491a-87ed-4a6b4d7c6d13 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:20.153808 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d29557d2-201e-491a-87ed-4a6b4d7c6d13 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:20.156598 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d29557d2-201e-491a-87ed-4a6b4d7c6d13 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:20.157199 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d29557d2-201e-491a-87ed-4a6b4d7c6d13 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:20.290920 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a898d292-0a58-49f2-b00f-3f35b21f48b0 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.339145 Aug 04 16:35:20.292394 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 383/764] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Aug 4 16:35:19 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:35:20.328363 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6201bddf-e8b8-476d-adc9-ce8b09d898a2 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:20.337574 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6201bddf-e8b8-476d-adc9-ce8b09d898a2 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 6017510a-e331-424a-843d-54b980b999fb] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:20.351791 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6201bddf-e8b8-476d-adc9-ce8b09d898a2 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:20.352769 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6201bddf-e8b8-476d-adc9-ce8b09d898a2 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:20.354208 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6201bddf-e8b8-476d-adc9-ce8b09d898a2 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:20.354704 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6201bddf-e8b8-476d-adc9-ce8b09d898a2 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:20.714912 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d29557d2-201e-491a-87ed-4a6b4d7c6d13 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:20.764041 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d29557d2-201e-491a-87ed-4a6b4d7c6d13 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767" status: 200 len: 1503 microversion: 2.1 time: 0.634076 Aug 04 16:35:20.791808 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 382/765] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:20 2022] GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767 => generated 1503 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:20.821870 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-57391b6e-8412-449f-af0f-b9a145b20ced tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Action: 'create', calling method: .version_select at 0x7f7e8443b8b0>, body: {"security_group_rule": {"parent_group_id": "8fd7f457-2a2d-4a7b-9042-7b3315399017", "ip_protocol": "tempest-999-809044948", "from_port": 22, "to_port": 22}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:20.930274 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6201bddf-e8b8-476d-adc9-ce8b09d898a2 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:20.945486 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6201bddf-e8b8-476d-adc9-ce8b09d898a2 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:20.947711 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6201bddf-e8b8-476d-adc9-ce8b09d898a2 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:20.949103 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6201bddf-e8b8-476d-adc9-ce8b09d898a2 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb" status: 200 len: 1321 microversion: 2.25 time: 0.655279 Aug 04 16:35:20.955407 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 384/766] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:20 2022] GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb => generated 1321 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:20.972834 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6d7589d3-854a-48c7-bf9e-8fc21c47bb15 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:20.973491 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6d7589d3-854a-48c7-bf9e-8fc21c47bb15 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:20.989630 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d7589d3-854a-48c7-bf9e-8fc21c47bb15 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:20.990073 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d7589d3-854a-48c7-bf9e-8fc21c47bb15 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:20.992681 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d7589d3-854a-48c7-bf9e-8fc21c47bb15 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:20.995681 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d7589d3-854a-48c7-bf9e-8fc21c47bb15 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:21.288583 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-57391b6e-8412-449f-af0f-b9a145b20ced tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] HTTP exception thrown: Invalid IP protocol tempest-999-809044948. Aug 04 16:35:21.297032 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-57391b6e-8412-449f-af0f-b9a145b20ced tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Request method failure captured: Aug 04 16:35:21.297032 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 04 16:35:21.297032 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:35:21.297032 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:35:21.297032 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:35:21.297032 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 156 Aug 04 16:35:21.297032 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:35:21.297032 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:35:21.297032 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:35:21.297032 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:35:21.297032 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_VCMgl-Ujx4xn8LJn2DlERaWZr_hUMfCBdT0WGd_U2j7gcCj2GdzZnw3lP8rk7pChqM7-xc8SlsGHqLKnyt6petZMVQk942zLRN1CUkj1xEAqxPVjpLHzjCE6qbRVB9l84WA8hcx4s8OvG_vxLMmzreFIkQZtSe6QwCramDqD0jXCc Aug 04 16:35:21.297032 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:35:21.297032 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:35:21.297032 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:35:21.297032 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:35:21.297032 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:35:21.297032 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:35:21.297032 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: dc4b4bcf09f74030a1ad54a165bd6b70 Aug 04 16:35:21.297032 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1094474337 Aug 04 16:35:21.297032 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:35:21.297032 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:35:21.299282 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc4b4bcf09f74030a1ad54a165bd6b70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dc4b4bcf09f74030a1ad54a165bd6b70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc4b4bcf09f74030a1ad54a165bd6b70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dc4b4bcf09f74030a1ad54a165bd6b70"}]}] Aug 04 16:35:21.299282 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1094474337 Aug 04 16:35:21.299282 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: dc4b4bcf09f74030a1ad54a165bd6b70 Aug 04 16:35:21.299282 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1094474337 Aug 04 16:35:21.299282 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project Aug 04 16:35:21.299282 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:35:21.299282 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:35:21.299282 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: ad637558f9c142d8a386735193915eab Aug 04 16:35:21.299282 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project Aug 04 16:35:21.299282 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:35:21.299282 n-d-846466-12 devstack@n-api.service[126125]: {"security_group_rule": {"parent_group_id": "8fd7f457-2a2d-4a7b-9042-7b3315399017", "ip_protocol": "tempest-999-809044948", "from_port": 22, "to_port": 22}} Aug 04 16:35:21.299282 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:35:21.300109 n-d-846466-12 devstack@n-api.service[126125]: exception: Invalid IP protocol tempest-999-809044948. Aug 04 16:35:21.300109 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'body': {'security_group_rule': {'parent_group_id': '8fd7f457-2a2d-4a7b-9042-7b3315399017', 'ip_protocol': 'tempest-999-809044948', 'from_port': 22, 'to_port': 22}}} Aug 04 16:35:21.300109 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:35:21.300109 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:21.300109 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 04 16:35:21.300109 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 04 16:35:21.300109 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 04 16:35:21.300109 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 04 16:35:21.300109 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 04 16:35:21.300109 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 04 16:35:21.300109 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 04 16:35:21.300109 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 04 16:35:21.300109 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-809044948. Aug 04 16:35:21.300109 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:21.300109 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:21.300109 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:21.300109 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:21.300109 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:21.300109 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:21.301263 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:35:21.301263 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:35:21.301263 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:35:21.301263 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:35:21.301263 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:35:21.301263 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:35:21.301263 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 04 16:35:21.301263 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 16:35:21.301263 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-809044948. Aug 04 16:35:21.301263 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:21.301263 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:21.301263 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:21.301263 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:21.301263 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:21.301263 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:21.301263 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:35:21.301263 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:35:21.301263 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-809044948. Aug 04 16:35:21.301263 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:21.307074 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-57391b6e-8412-449f-af0f-b9a145b20ced tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Returning 400 to user: Invalid IP protocol tempest-999-809044948. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:35:21.308296 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-57391b6e-8412-449f-af0f-b9a145b20ced tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.515396 Aug 04 16:35:21.309220 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 383/767] 10.222.0.23 () {60 vars in 1195 bytes} [Thu Aug 4 16:35:20 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 517 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 16:35:21.332703 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-3398c831-da75-4a75-a229-75f5fd696363 req-fc85219a-b03e-4c9a-8393-3b3e126c02b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d2e5f9c-c00d-46b1-b55c-b2bda4428946", "name": "network-vif-plugged", "status": "completed", "tag": "7b107fe2-9d03-469a-b39d-9bb9814ca01a"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:21.368734 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-3398c831-da75-4a75-a229-75f5fd696363 req-fc85219a-b03e-4c9a-8393-3b3e126c02b4 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:21.369473 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-3398c831-da75-4a75-a229-75f5fd696363 req-fc85219a-b03e-4c9a-8393-3b3e126c02b4 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:21.384587 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-3398c831-da75-4a75-a229-75f5fd696363 req-fc85219a-b03e-4c9a-8393-3b3e126c02b4 service nova] Creating event network-vif-plugged:7b107fe2-9d03-469a-b39d-9bb9814ca01a for instance 2d2e5f9c-c00d-46b1-b55c-b2bda4428946 on n-h2-846466-12 Aug 04 16:35:21.393585 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-3398c831-da75-4a75-a229-75f5fd696363 req-fc85219a-b03e-4c9a-8393-3b3e126c02b4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080058 Aug 04 16:35:21.404305 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 384/768] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:35:21.418023 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2ecbd166-68df-4bc7-99b8-a6ed537364bd tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:21.419328 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2ecbd166-68df-4bc7-99b8-a6ed537364bd tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:21.430824 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2ecbd166-68df-4bc7-99b8-a6ed537364bd tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:21.431609 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2ecbd166-68df-4bc7-99b8-a6ed537364bd tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:21.434449 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2ecbd166-68df-4bc7-99b8-a6ed537364bd tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:21.435165 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2ecbd166-68df-4bc7-99b8-a6ed537364bd tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:21.857680 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2ecbd166-68df-4bc7-99b8-a6ed537364bd tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:21.874090 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2ecbd166-68df-4bc7-99b8-a6ed537364bd tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:21.879175 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2ecbd166-68df-4bc7-99b8-a6ed537364bd tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:21.885510 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6d7589d3-854a-48c7-bf9e-8fc21c47bb15 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:21.897703 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2ecbd166-68df-4bc7-99b8-a6ed537364bd tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1446 microversion: 2.75 time: 0.485636 Aug 04 16:35:21.899541 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 385/769] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:21 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1446 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:21.917042 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1066e1d6-5ddd-4f90-ad53-0af9596a60ee tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:21.918174 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1066e1d6-5ddd-4f90-ad53-0af9596a60ee tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 2d2e5f9c-c00d-46b1-b55c-b2bda4428946] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:21.922956 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6d7589d3-854a-48c7-bf9e-8fc21c47bb15 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1475 microversion: 2.1 time: 0.964133 Aug 04 16:35:21.923777 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 385/770] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:20 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1475 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:21.935802 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1066e1d6-5ddd-4f90-ad53-0af9596a60ee tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:21.936621 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1066e1d6-5ddd-4f90-ad53-0af9596a60ee tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:21.937846 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1066e1d6-5ddd-4f90-ad53-0af9596a60ee tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:21.938545 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1066e1d6-5ddd-4f90-ad53-0af9596a60ee tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:21.951296 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1764e565-7bd7-4d93-a142-e9235563a3e0 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Action: 'create', calling method: .version_select at 0x7f7e84e8bca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1581077550", "description": "tempest-description-1837857628"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:22.964596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1066e1d6-5ddd-4f90-ad53-0af9596a60ee tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a732f446814c9fa080979bef241023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f22de02d3e4db281f6372e8191b95f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:22.973954 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1066e1d6-5ddd-4f90-ad53-0af9596a60ee tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "GET /compute/v2.1/servers/2d2e5f9c-c00d-46b1-b55c-b2bda4428946" status: 200 len: 1323 microversion: 2.1 time: 1.072869 Aug 04 16:35:22.992909 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 386/771] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:21 2022] GET /compute/v2.1/servers/2d2e5f9c-c00d-46b1-b55c-b2bda4428946 => generated 1323 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:23.005950 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-77737b06-d02d-44c9-b8ac-86a18174481a tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:23.007194 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-77737b06-d02d-44c9-b8ac-86a18174481a tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: a80ed729-9d91-4fba-a785-77d5aeacb767] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:23.023100 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-77737b06-d02d-44c9-b8ac-86a18174481a tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:23.023905 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-77737b06-d02d-44c9-b8ac-86a18174481a tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:23.024846 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-77737b06-d02d-44c9-b8ac-86a18174481a tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:23.027320 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-77737b06-d02d-44c9-b8ac-86a18174481a tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:23.691237 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1764e565-7bd7-4d93-a142-e9235563a3e0 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.751067 Aug 04 16:35:23.692174 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 386/772] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Aug 4 16:35:21 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:35:23.697117 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4357a346-cc9c-4201-9138-5b5af561603f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:23.697974 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4357a346-cc9c-4201-9138-5b5af561603f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 6017510a-e331-424a-843d-54b980b999fb] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:23.712771 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4357a346-cc9c-4201-9138-5b5af561603f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:23.713474 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4357a346-cc9c-4201-9138-5b5af561603f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:23.714517 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4357a346-cc9c-4201-9138-5b5af561603f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:23.718183 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4357a346-cc9c-4201-9138-5b5af561603f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:23.869135 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4357a346-cc9c-4201-9138-5b5af561603f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:23.877827 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4357a346-cc9c-4201-9138-5b5af561603f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:23.879389 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4357a346-cc9c-4201-9138-5b5af561603f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:23.880607 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4357a346-cc9c-4201-9138-5b5af561603f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb" status: 200 len: 1319 microversion: 2.25 time: 0.187126 Aug 04 16:35:23.881106 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 387/773] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:23 2022] GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:23.907654 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-05fde970-6227-4ef7-b6b6-8c58105702b2 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:23.908794 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-05fde970-6227-4ef7-b6b6-8c58105702b2 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:23.917569 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-05fde970-6227-4ef7-b6b6-8c58105702b2 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:23.918268 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-05fde970-6227-4ef7-b6b6-8c58105702b2 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:23.919203 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-05fde970-6227-4ef7-b6b6-8c58105702b2 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:23.919801 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-05fde970-6227-4ef7-b6b6-8c58105702b2 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:24.200351 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-77737b06-d02d-44c9-b8ac-86a18174481a tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:24.217973 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-77737b06-d02d-44c9-b8ac-86a18174481a tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767" status: 200 len: 1503 microversion: 2.1 time: 1.223471 Aug 04 16:35:24.219901 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 387/774] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:22 2022] GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767 => generated 1503 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:24.231404 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9391c913-8915-43cd-b3eb-21aa6464d1a9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:24.231951 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9391c913-8915-43cd-b3eb-21aa6464d1a9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:24.254602 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9391c913-8915-43cd-b3eb-21aa6464d1a9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:24.254920 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9391c913-8915-43cd-b3eb-21aa6464d1a9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:24.255932 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9391c913-8915-43cd-b3eb-21aa6464d1a9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:24.256537 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9391c913-8915-43cd-b3eb-21aa6464d1a9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:24.285056 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-05fde970-6227-4ef7-b6b6-8c58105702b2 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:24.296881 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-05fde970-6227-4ef7-b6b6-8c58105702b2 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:24.305990 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-05fde970-6227-4ef7-b6b6-8c58105702b2 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:24.320375 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-05fde970-6227-4ef7-b6b6-8c58105702b2 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1446 microversion: 2.75 time: 0.425357 Aug 04 16:35:24.323627 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 388/775] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:23 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1446 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:24.332076 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fe750309-0d28-48f5-b970-ce812d202149 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Action: 'create', calling method: .version_select at 0x7f7e84e8bd30>, body: {"security_group_rule": {"parent_group_id": "43839822-5e8c-4c06-a7c1-c12c29923efe", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:24.888324 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-fe750309-0d28-48f5-b970-ce812d202149 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 04 16:35:24.892139 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fe750309-0d28-48f5-b970-ce812d202149 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Request method failure captured: Aug 04 16:35:24.892139 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 04 16:35:24.892139 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:35:24.892139 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:35:24.892139 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:35:24.892139 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 138 Aug 04 16:35:24.892139 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:35:24.892139 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:35:24.892139 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:35:24.892139 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:35:24.892139 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_VCMgl-Ujx4xn8LJn2DlERaWZr_hUMfCBdT0WGd_U2j7gcCj2GdzZnw3lP8rk7pChqM7-xc8SlsGHqLKnyt6petZMVQk942zLRN1CUkj1xEAqxPVjpLHzjCE6qbRVB9l84WA8hcx4s8OvG_vxLMmzreFIkQZtSe6QwCramDqD0jXCc Aug 04 16:35:24.892139 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:35:24.892139 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:35:24.892139 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:35:24.892139 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:35:24.892139 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:35:24.892139 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:35:24.892139 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: dc4b4bcf09f74030a1ad54a165bd6b70 Aug 04 16:35:24.892139 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1094474337 Aug 04 16:35:24.892139 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:35:24.892139 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:35:24.893669 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc4b4bcf09f74030a1ad54a165bd6b70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dc4b4bcf09f74030a1ad54a165bd6b70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc4b4bcf09f74030a1ad54a165bd6b70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dc4b4bcf09f74030a1ad54a165bd6b70"}]}] Aug 04 16:35:24.893669 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1094474337 Aug 04 16:35:24.893669 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: dc4b4bcf09f74030a1ad54a165bd6b70 Aug 04 16:35:24.893669 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1094474337 Aug 04 16:35:24.893669 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project Aug 04 16:35:24.893669 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:35:24.893669 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:35:24.893669 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: ad637558f9c142d8a386735193915eab Aug 04 16:35:24.893669 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project Aug 04 16:35:24.893669 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 16:35:24.893669 n-d-846466-12 devstack@n-api.service[126126]: {"security_group_rule": {"parent_group_id": "43839822-5e8c-4c06-a7c1-c12c29923efe", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 04 16:35:24.893669 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:35:24.894592 n-d-846466-12 devstack@n-api.service[126126]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 04 16:35:24.894592 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'body': {'security_group_rule': {'parent_group_id': '43839822-5e8c-4c06-a7c1-c12c29923efe', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 04 16:35:24.894592 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:35:24.894592 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:24.894592 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 04 16:35:24.894592 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 04 16:35:24.894592 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 04 16:35:24.894592 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 04 16:35:24.894592 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 04 16:35:24.894592 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 04 16:35:24.894592 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 04 16:35:24.894592 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 04 16:35:24.894592 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 04 16:35:24.894592 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:35:24.894592 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:24.894592 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:35:24.894592 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:24.894592 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:24.894592 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:24.895965 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:35:24.895965 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:35:24.895965 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:35:24.895965 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:35:24.895965 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:35:24.895965 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:35:24.895965 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 04 16:35:24.895965 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 16:35:24.895965 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 04 16:35:24.895965 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:35:24.895965 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:24.895965 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:35:24.895965 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:24.895965 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:24.895965 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:24.895965 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:35:24.895965 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:35:24.895965 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 04 16:35:24.895965 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:35:24.902775 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fe750309-0d28-48f5-b970-ce812d202149 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:35:24.903831 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fe750309-0d28-48f5-b970-ce812d202149 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.578952 Aug 04 16:35:24.904596 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 389/776] 10.222.0.23 () {60 vars in 1195 bytes} [Thu Aug 4 16:35:24 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 580 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:35:24.915187 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2a6b80e1-1085-41ff-aba2-a4abee3d08c4 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:24.916050 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2a6b80e1-1085-41ff-aba2-a4abee3d08c4 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 2d2e5f9c-c00d-46b1-b55c-b2bda4428946] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:24.935874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a6b80e1-1085-41ff-aba2-a4abee3d08c4 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:24.937512 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a6b80e1-1085-41ff-aba2-a4abee3d08c4 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:24.939414 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a6b80e1-1085-41ff-aba2-a4abee3d08c4 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:24.940270 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a6b80e1-1085-41ff-aba2-a4abee3d08c4 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:25.079782 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9391c913-8915-43cd-b3eb-21aa6464d1a9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:25.099149 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9391c913-8915-43cd-b3eb-21aa6464d1a9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1474 microversion: 2.1 time: 0.875566 Aug 04 16:35:25.102556 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 388/777] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:24 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1474 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:25.117498 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-7241479d-19a6-4826-9556-3eb2401dda02 req-5a2bfdff-e0ff-4075-8322-d0451a90e1ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a33abce-4d0a-4919-94db-28cea706d412", "name": "network-vif-unplugged", "status": "completed", "tag": "e1d80942-af44-4bef-a238-f9fca1aa7ddf"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:25.162851 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7241479d-19a6-4826-9556-3eb2401dda02 req-5a2bfdff-e0ff-4075-8322-d0451a90e1ed service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:25.166018 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7241479d-19a6-4826-9556-3eb2401dda02 req-5a2bfdff-e0ff-4075-8322-d0451a90e1ed service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:25.189215 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-7241479d-19a6-4826-9556-3eb2401dda02 req-5a2bfdff-e0ff-4075-8322-d0451a90e1ed service nova] Creating event network-vif-unplugged:e1d80942-af44-4bef-a238-f9fca1aa7ddf for instance 5a33abce-4d0a-4919-94db-28cea706d412 on n-h2-846466-12 Aug 04 16:35:25.205100 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [req-7241479d-19a6-4826-9556-3eb2401dda02 req-5a2bfdff-e0ff-4075-8322-d0451a90e1ed service nova] Instance 5a33abce-4d0a-4919-94db-28cea706d412 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 16:35:25.230403 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-7241479d-19a6-4826-9556-3eb2401dda02 req-5a2bfdff-e0ff-4075-8322-d0451a90e1ed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125845 Aug 04 16:35:25.231310 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 389/778] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:35:25.254017 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7f213bfc-4282-436f-8c18-9884e54fcc96 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:25.254731 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7f213bfc-4282-436f-8c18-9884e54fcc96 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 6017510a-e331-424a-843d-54b980b999fb] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:25.298505 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7f213bfc-4282-436f-8c18-9884e54fcc96 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:25.299136 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7f213bfc-4282-436f-8c18-9884e54fcc96 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:25.299946 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7f213bfc-4282-436f-8c18-9884e54fcc96 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:25.300381 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7f213bfc-4282-436f-8c18-9884e54fcc96 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:25.700613 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2a6b80e1-1085-41ff-aba2-a4abee3d08c4 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a732f446814c9fa080979bef241023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f22de02d3e4db281f6372e8191b95f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:25.708437 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2a6b80e1-1085-41ff-aba2-a4abee3d08c4 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "GET /compute/v2.1/servers/2d2e5f9c-c00d-46b1-b55c-b2bda4428946" status: 200 len: 1520 microversion: 2.1 time: 0.802623 Aug 04 16:35:25.717650 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 390/779] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:24 2022] GET /compute/v2.1/servers/2d2e5f9c-c00d-46b1-b55c-b2bda4428946 => generated 1520 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:25.723026 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5cb305e3-3ffd-4064-b243-cc53e94decc6 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Action: 'create', calling method: .version_select at 0x7f7e84e37430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-180170080", "description": "tempest-description-839643939"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:25.885349 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7f213bfc-4282-436f-8c18-9884e54fcc96 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:25.902405 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7f213bfc-4282-436f-8c18-9884e54fcc96 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:25.904549 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7f213bfc-4282-436f-8c18-9884e54fcc96 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:25.906018 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7f213bfc-4282-436f-8c18-9884e54fcc96 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb" status: 200 len: 1361 microversion: 2.25 time: 0.673378 Aug 04 16:35:25.908364 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 390/780] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:25 2022] GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb => generated 1361 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:25.914430 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5dbdaaf9-3660-4e2b-9ca0-c56883193960 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:25.915317 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5dbdaaf9-3660-4e2b-9ca0-c56883193960 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: a80ed729-9d91-4fba-a785-77d5aeacb767] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:25.928777 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5dbdaaf9-3660-4e2b-9ca0-c56883193960 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:25.929587 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5dbdaaf9-3660-4e2b-9ca0-c56883193960 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:25.930708 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5dbdaaf9-3660-4e2b-9ca0-c56883193960 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:25.931522 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5dbdaaf9-3660-4e2b-9ca0-c56883193960 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:26.502721 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5dbdaaf9-3660-4e2b-9ca0-c56883193960 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:26.518188 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5dbdaaf9-3660-4e2b-9ca0-c56883193960 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767" status: 200 len: 1503 microversion: 2.1 time: 0.607905 Aug 04 16:35:26.518958 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 391/781] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:25 2022] GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767 => generated 1503 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:26.527846 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d6f82f93-ba53-4375-9432-a978101ac208 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:26.529726 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d6f82f93-ba53-4375-9432-a978101ac208 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:26.545541 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d6f82f93-ba53-4375-9432-a978101ac208 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:26.546633 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d6f82f93-ba53-4375-9432-a978101ac208 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:26.548225 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d6f82f93-ba53-4375-9432-a978101ac208 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:26.548980 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d6f82f93-ba53-4375-9432-a978101ac208 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:26.724819 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5cb305e3-3ffd-4064-b243-cc53e94decc6 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.005971 Aug 04 16:35:26.729141 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 391/782] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Aug 4 16:35:25 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:35:26.736718 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5e1c5b50-0244-4e9a-9309-0457299c2e84 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Action: 'action', calling method: .version_select at 0x7f7e876deca0>, body: {"addFloatingIp": {"address": "172.25.6.68"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:26.740940 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5e1c5b50-0244-4e9a-9309-0457299c2e84 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 35b3ee83-f946-4c4c-bff9-80b8bd368788] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:26.752008 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e1c5b50-0244-4e9a-9309-0457299c2e84 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:26.752702 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e1c5b50-0244-4e9a-9309-0457299c2e84 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:26.768867 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e1c5b50-0244-4e9a-9309-0457299c2e84 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:26.773815 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e1c5b50-0244-4e9a-9309-0457299c2e84 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:26.781486 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d6f82f93-ba53-4375-9432-a978101ac208 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:26.807565 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d6f82f93-ba53-4375-9432-a978101ac208 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:26.810025 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d6f82f93-ba53-4375-9432-a978101ac208 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:26.819079 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d6f82f93-ba53-4375-9432-a978101ac208 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1452 microversion: 2.75 time: 0.297876 Aug 04 16:35:26.820064 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 392/783] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:26 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1452 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:26.828007 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-190a4ed3-4510-424b-95f1-da2f964933c7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:26.829086 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-190a4ed3-4510-424b-95f1-da2f964933c7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:26.839849 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-190a4ed3-4510-424b-95f1-da2f964933c7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:26.840799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-190a4ed3-4510-424b-95f1-da2f964933c7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:26.842024 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-190a4ed3-4510-424b-95f1-da2f964933c7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:26.842754 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-190a4ed3-4510-424b-95f1-da2f964933c7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:26.858135 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:35:26.886469 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:35:26.905740 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e1c5b50-0244-4e9a-9309-0457299c2e84 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Acquired lock "refresh_cache-35b3ee83-f946-4c4c-bff9-80b8bd368788" {{(pid=126126) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 16:35:27.372713 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-190a4ed3-4510-424b-95f1-da2f964933c7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:27.391269 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-190a4ed3-4510-424b-95f1-da2f964933c7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1474 microversion: 2.1 time: 0.569766 Aug 04 16:35:27.405315 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 393/784] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:26 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1474 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:27.444761 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e8f433c1-0930-485e-b942-34cb3c3cbde9 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Action: 'create', calling method: .version_select at 0x7f7e844ade50>, body: {"security_group_rule": {"parent_group_id": "71bde338-ef9f-4c6a-a985-927d05016445", "ip_protocol": "tcp", "from_port": 22, "to_port": 375930012}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:27.914742 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-e8f433c1-0930-485e-b942-34cb3c3cbde9 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] HTTP exception thrown: Invalid port range 22:375930012. Valid TCP ports should be between 1-65535 Aug 04 16:35:27.917725 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e8f433c1-0930-485e-b942-34cb3c3cbde9 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Request method failure captured: Aug 04 16:35:27.917725 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 04 16:35:27.917725 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:35:27.917725 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:35:27.917725 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:35:27.917725 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 145 Aug 04 16:35:27.917725 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:35:27.917725 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:35:27.917725 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:35:27.917725 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:35:27.917725 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_VCMgl-Ujx4xn8LJn2DlERaWZr_hUMfCBdT0WGd_U2j7gcCj2GdzZnw3lP8rk7pChqM7-xc8SlsGHqLKnyt6petZMVQk942zLRN1CUkj1xEAqxPVjpLHzjCE6qbRVB9l84WA8hcx4s8OvG_vxLMmzreFIkQZtSe6QwCramDqD0jXCc Aug 04 16:35:27.917725 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:35:27.917725 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:35:27.917725 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:35:27.917725 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:35:27.917725 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:35:27.917725 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:35:27.917725 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: dc4b4bcf09f74030a1ad54a165bd6b70 Aug 04 16:35:27.917725 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1094474337 Aug 04 16:35:27.917725 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:35:27.917725 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:35:27.919686 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc4b4bcf09f74030a1ad54a165bd6b70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dc4b4bcf09f74030a1ad54a165bd6b70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc4b4bcf09f74030a1ad54a165bd6b70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dc4b4bcf09f74030a1ad54a165bd6b70"}]}] Aug 04 16:35:27.919686 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1094474337 Aug 04 16:35:27.919686 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: dc4b4bcf09f74030a1ad54a165bd6b70 Aug 04 16:35:27.919686 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1094474337 Aug 04 16:35:27.919686 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project Aug 04 16:35:27.919686 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:35:27.919686 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:35:27.919686 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: ad637558f9c142d8a386735193915eab Aug 04 16:35:27.919686 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project Aug 04 16:35:27.919686 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:35:27.919686 n-d-846466-12 devstack@n-api.service[126125]: {"security_group_rule": {"parent_group_id": "71bde338-ef9f-4c6a-a985-927d05016445", "ip_protocol": "tcp", "from_port": 22, "to_port": 375930012}} Aug 04 16:35:27.919686 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:35:27.921107 n-d-846466-12 devstack@n-api.service[126125]: exception: Invalid port range 22:375930012. Valid TCP ports should be between 1-65535 Aug 04 16:35:27.921107 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'body': {'security_group_rule': {'parent_group_id': '71bde338-ef9f-4c6a-a985-927d05016445', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 375930012}}} Aug 04 16:35:27.921107 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:35:27.921107 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:27.921107 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 04 16:35:27.921107 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 04 16:35:27.921107 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 04 16:35:27.921107 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 04 16:35:27.921107 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 04 16:35:27.921107 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 04 16:35:27.921107 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 04 16:35:27.921107 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 04 16:35:27.921107 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:375930012. Valid TCP ports should be between 1-65535 Aug 04 16:35:27.921107 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:27.921107 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:27.921107 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:27.921107 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:27.921107 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:27.921107 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:27.922303 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:35:27.922303 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:35:27.922303 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:35:27.922303 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:35:27.922303 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:35:27.922303 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:35:27.922303 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 04 16:35:27.922303 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 16:35:27.922303 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:375930012. Valid TCP ports should be between 1-65535 Aug 04 16:35:27.922303 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:27.922303 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:27.922303 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:27.922303 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:27.922303 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:27.922303 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:27.922303 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:35:27.922303 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:35:27.922303 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:375930012. Valid TCP ports should be between 1-65535 Aug 04 16:35:27.922303 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:27.923804 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e8f433c1-0930-485e-b942-34cb3c3cbde9 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Returning 400 to user: Invalid port range 22:375930012. Valid TCP ports should be between 1-65535 {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:35:27.923804 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e8f433c1-0930-485e-b942-34cb3c3cbde9 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.507580 Aug 04 16:35:27.923804 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 394/785] 10.222.0.23 () {60 vars in 1195 bytes} [Thu Aug 4 16:35:27 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 515 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:35:27.941583 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5487145b-edd6-4a00-9c15-0e509e27468b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:27.942589 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5487145b-edd6-4a00-9c15-0e509e27468b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 6017510a-e331-424a-843d-54b980b999fb] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:27.959022 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:35:27.968205 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5487145b-edd6-4a00-9c15-0e509e27468b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:27.968916 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5487145b-edd6-4a00-9c15-0e509e27468b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:27.970726 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5487145b-edd6-4a00-9c15-0e509e27468b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:27.971681 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5487145b-edd6-4a00-9c15-0e509e27468b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:29.175478 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5487145b-edd6-4a00-9c15-0e509e27468b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:29.187493 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5487145b-edd6-4a00-9c15-0e509e27468b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:29.189596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5487145b-edd6-4a00-9c15-0e509e27468b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:29.191027 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5487145b-edd6-4a00-9c15-0e509e27468b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb" status: 200 len: 1361 microversion: 2.25 time: 1.256541 Aug 04 16:35:29.192771 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 395/786] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:27 2022] GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb => generated 1361 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:29.198149 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-ea365c1a-2d3c-4bd3-98aa-659e0bde48b4 req-bad5859c-2c7a-4b5c-b88f-b30d6299f66f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a33abce-4d0a-4919-94db-28cea706d412", "tag": "e1d80942-af44-4bef-a238-f9fca1aa7ddf"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:29.221102 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-ea365c1a-2d3c-4bd3-98aa-659e0bde48b4 req-bad5859c-2c7a-4b5c-b88f-b30d6299f66f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:29.221932 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-ea365c1a-2d3c-4bd3-98aa-659e0bde48b4 req-bad5859c-2c7a-4b5c-b88f-b30d6299f66f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:29.238798 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-ea365c1a-2d3c-4bd3-98aa-659e0bde48b4 req-bad5859c-2c7a-4b5c-b88f-b30d6299f66f service nova] Creating event network-changed:e1d80942-af44-4bef-a238-f9fca1aa7ddf for instance 5a33abce-4d0a-4919-94db-28cea706d412 on n-h2-846466-12 Aug 04 16:35:29.259213 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [req-ea365c1a-2d3c-4bd3-98aa-659e0bde48b4 req-bad5859c-2c7a-4b5c-b88f-b30d6299f66f service nova] Instance 5a33abce-4d0a-4919-94db-28cea706d412 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 16:35:29.287178 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-ea365c1a-2d3c-4bd3-98aa-659e0bde48b4 req-bad5859c-2c7a-4b5c-b88f-b30d6299f66f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092834 Aug 04 16:35:29.291334 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 396/787] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:35:29.298516 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-875be409-0b52-447a-95bf-fb94108103de tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:29.300745 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-875be409-0b52-447a-95bf-fb94108103de tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: a80ed729-9d91-4fba-a785-77d5aeacb767] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:29.308183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-875be409-0b52-447a-95bf-fb94108103de tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:29.308987 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-875be409-0b52-447a-95bf-fb94108103de tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:29.310195 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-875be409-0b52-447a-95bf-fb94108103de tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:29.310843 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-875be409-0b52-447a-95bf-fb94108103de tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:30.012389 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-875be409-0b52-447a-95bf-fb94108103de tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:30.023238 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-875be409-0b52-447a-95bf-fb94108103de tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767" status: 200 len: 1503 microversion: 2.1 time: 0.729482 Aug 04 16:35:30.025595 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 397/788] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:29 2022] GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767 => generated 1503 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:30.033449 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4cc1f4e0-1589-4771-baa2-621b0825656b tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:30.034341 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4cc1f4e0-1589-4771-baa2-621b0825656b tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:30.042441 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4cc1f4e0-1589-4771-baa2-621b0825656b tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:30.043317 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4cc1f4e0-1589-4771-baa2-621b0825656b tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:30.044529 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4cc1f4e0-1589-4771-baa2-621b0825656b tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:30.045208 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4cc1f4e0-1589-4771-baa2-621b0825656b tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:30.344824 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4cc1f4e0-1589-4771-baa2-621b0825656b tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:30.355372 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4cc1f4e0-1589-4771-baa2-621b0825656b tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:30.356880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4cc1f4e0-1589-4771-baa2-621b0825656b tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:30.366920 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=100 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:35:30.371858 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4cc1f4e0-1589-4771-baa2-621b0825656b tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1437 microversion: 2.75 time: 0.344914 Aug 04 16:35:30.373560 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 398/789] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:30 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1437 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:30.379767 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d0f0a6c3-8cd3-4f71-93c7-c7720ad2c682 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Action: 'create', calling method: .version_select at 0x7f7e84cf79d0>, body: {"security_group_rule": {"parent_group_id": "a5560463-6adc-46b3-827d-8110908ae018", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:30.543353 n-d-846466-12 devstack@n-api.service[126125]: DEBUG neutronclient.v2_0.client [None req-d0f0a6c3-8cd3-4f71-93c7-c7720ad2c682 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a5560463-6adc-46b3-827d-8110908ae018 does not exist", "detail": ""}} {{(pid=126125) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:35:30.543353 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.security_group_api [None req-d0f0a6c3-8cd3-4f71-93c7-c7720ad2c682 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Neutron security group a5560463-6adc-46b3-827d-8110908ae018 not found {{(pid=126125) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 16:35:30.543353 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-d0f0a6c3-8cd3-4f71-93c7-c7720ad2c682 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] HTTP exception thrown: Security group a5560463-6adc-46b3-827d-8110908ae018 does not exist Aug 04 16:35:30.543353 n-d-846466-12 devstack@n-api.service[126125]: Neutron server returns request_ids: ['req-40332242-60dd-47bc-a27d-482e5cb34d41'] Aug 04 16:35:30.545564 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d0f0a6c3-8cd3-4f71-93c7-c7720ad2c682 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Request method failure captured: Aug 04 16:35:30.545564 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 04 16:35:30.545564 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:35:30.545564 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:35:30.545564 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:35:30.545564 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 138 Aug 04 16:35:30.545564 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:35:30.545564 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:35:30.545564 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:35:30.545564 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:35:30.545564 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_VCMgl-Ujx4xn8LJn2DlERaWZr_hUMfCBdT0WGd_U2j7gcCj2GdzZnw3lP8rk7pChqM7-xc8SlsGHqLKnyt6petZMVQk942zLRN1CUkj1xEAqxPVjpLHzjCE6qbRVB9l84WA8hcx4s8OvG_vxLMmzreFIkQZtSe6QwCramDqD0jXCc Aug 04 16:35:30.545564 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:35:30.545564 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:35:30.545564 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:35:30.545564 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:35:30.545564 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:35:30.545564 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:35:30.545564 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: dc4b4bcf09f74030a1ad54a165bd6b70 Aug 04 16:35:30.545564 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1094474337 Aug 04 16:35:30.545564 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:35:30.545564 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:35:30.546896 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc4b4bcf09f74030a1ad54a165bd6b70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dc4b4bcf09f74030a1ad54a165bd6b70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc4b4bcf09f74030a1ad54a165bd6b70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dc4b4bcf09f74030a1ad54a165bd6b70"}]}] Aug 04 16:35:30.546896 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1094474337 Aug 04 16:35:30.546896 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: dc4b4bcf09f74030a1ad54a165bd6b70 Aug 04 16:35:30.546896 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1094474337 Aug 04 16:35:30.546896 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project Aug 04 16:35:30.546896 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:35:30.546896 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:35:30.546896 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: ad637558f9c142d8a386735193915eab Aug 04 16:35:30.546896 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project Aug 04 16:35:30.546896 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:35:30.546896 n-d-846466-12 devstack@n-api.service[126125]: {"security_group_rule": {"parent_group_id": "a5560463-6adc-46b3-827d-8110908ae018", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 04 16:35:30.546896 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:35:30.548059 n-d-846466-12 devstack@n-api.service[126125]: exception: Security group a5560463-6adc-46b3-827d-8110908ae018 does not exist Aug 04 16:35:30.548059 n-d-846466-12 devstack@n-api.service[126125]: Neutron server returns request_ids: ['req-40332242-60dd-47bc-a27d-482e5cb34d41'] Aug 04 16:35:30.548059 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a5560463-6adc-46b3-827d-8110908ae018', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 04 16:35:30.548059 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:35:30.548059 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:30.548059 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 16:35:30.548059 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 16:35:30.548059 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:35:30.548059 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:35:30.548059 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 16:35:30.548059 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 16:35:30.548059 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:35:30.548059 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:35:30.548059 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 16:35:30.548059 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 16:35:30.548059 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:35:30.548059 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:35:30.548059 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:35:30.548059 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:35:30.549239 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:35:30.549239 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:35:30.549239 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:35:30.549239 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:35:30.549239 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:35:30.549239 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:35:30.549239 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:35:30.549239 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:35:30.549239 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:35:30.549239 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:35:30.549239 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a5560463-6adc-46b3-827d-8110908ae018 does not exist Aug 04 16:35:30.549239 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40332242-60dd-47bc-a27d-482e5cb34d41'] Aug 04 16:35:30.549239 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:30.549239 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:30.549239 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:30.549239 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:30.549239 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 04 16:35:30.549239 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 04 16:35:30.549239 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 16:35:30.550443 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 16:35:30.550443 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a5560463-6adc-46b3-827d-8110908ae018 does not exist Aug 04 16:35:30.550443 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40332242-60dd-47bc-a27d-482e5cb34d41'] Aug 04 16:35:30.550443 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:30.550443 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:30.550443 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:30.550443 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:30.550443 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:30.550443 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:30.550443 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:35:30.550443 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:35:30.550443 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:35:30.550443 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:35:30.550443 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:35:30.550443 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:35:30.550443 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 04 16:35:30.550443 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 16:35:30.550443 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a5560463-6adc-46b3-827d-8110908ae018 does not exist Aug 04 16:35:30.550443 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40332242-60dd-47bc-a27d-482e5cb34d41'] Aug 04 16:35:30.550443 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:30.552345 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:30.552345 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:30.552345 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:30.552345 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:30.552345 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:30.552345 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:35:30.552345 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:35:30.552345 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a5560463-6adc-46b3-827d-8110908ae018 does not exist Aug 04 16:35:30.552345 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40332242-60dd-47bc-a27d-482e5cb34d41'] Aug 04 16:35:30.552345 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:30.552345 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d0f0a6c3-8cd3-4f71-93c7-c7720ad2c682 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Returning 404 to user: Security group a5560463-6adc-46b3-827d-8110908ae018 does not exist Aug 04 16:35:30.552345 n-d-846466-12 devstack@n-api.service[126125]: Neutron server returns request_ids: ['req-40332242-60dd-47bc-a27d-482e5cb34d41'] {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:35:30.552345 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d0f0a6c3-8cd3-4f71-93c7-c7720ad2c682 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.172354 Aug 04 16:35:30.553552 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 399/790] 10.222.0.23 () {60 vars in 1195 bytes} [Thu Aug 4 16:35:30 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:35:30.560081 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6719c573-85ad-40aa-b680-7e9b09ce7e8a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:30.560298 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6719c573-85ad-40aa-b680-7e9b09ce7e8a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:30.568576 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6719c573-85ad-40aa-b680-7e9b09ce7e8a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:30.569034 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6719c573-85ad-40aa-b680-7e9b09ce7e8a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:30.569925 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6719c573-85ad-40aa-b680-7e9b09ce7e8a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:30.570368 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6719c573-85ad-40aa-b680-7e9b09ce7e8a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:30.575704 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=100 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:35:31.239264 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6719c573-85ad-40aa-b680-7e9b09ce7e8a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:31.249159 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6719c573-85ad-40aa-b680-7e9b09ce7e8a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1474 microversion: 2.1 time: 0.699592 Aug 04 16:35:31.250404 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 400/791] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:30 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1474 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:31.256765 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0d29f96a-7f20-465d-8d4b-bf73592d42d6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:31.257935 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0d29f96a-7f20-465d-8d4b-bf73592d42d6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 6017510a-e331-424a-843d-54b980b999fb] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:31.271725 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0d29f96a-7f20-465d-8d4b-bf73592d42d6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:31.272205 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0d29f96a-7f20-465d-8d4b-bf73592d42d6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:31.273043 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0d29f96a-7f20-465d-8d4b-bf73592d42d6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:31.273417 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0d29f96a-7f20-465d-8d4b-bf73592d42d6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:31.592925 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0d29f96a-7f20-465d-8d4b-bf73592d42d6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:31.602123 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0d29f96a-7f20-465d-8d4b-bf73592d42d6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:31.603715 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0d29f96a-7f20-465d-8d4b-bf73592d42d6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:31.604807 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0d29f96a-7f20-465d-8d4b-bf73592d42d6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb" status: 200 len: 1361 microversion: 2.25 time: 0.352533 Aug 04 16:35:31.605589 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 401/792] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:31 2022] GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb => generated 1361 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:31.638544 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-5e1c5b50-0244-4e9a-9309-0457299c2e84 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 35b3ee83-f946-4c4c-bff9-80b8bd368788] Building network info cache for instance {{(pid=126126) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 16:35:31.831289 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a084b296-09f1-4c9d-8a61-8f47c6e51664 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:31.834992 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a084b296-09f1-4c9d-8a61-8f47c6e51664 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:31.842019 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a084b296-09f1-4c9d-8a61-8f47c6e51664 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:31.842692 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a084b296-09f1-4c9d-8a61-8f47c6e51664 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:31.843812 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a084b296-09f1-4c9d-8a61-8f47c6e51664 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:31.844733 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a084b296-09f1-4c9d-8a61-8f47c6e51664 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:31.935632 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-a084b296-09f1-4c9d-8a61-8f47c6e51664 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:35:31.935969 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-a084b296-09f1-4c9d-8a61-8f47c6e51664 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:35:31.936769 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-a084b296-09f1-4c9d-8a61-8f47c6e51664 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:35:31.937175 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-a084b296-09f1-4c9d-8a61-8f47c6e51664 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:35:31.937756 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-a084b296-09f1-4c9d-8a61-8f47c6e51664 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:35:32.018766 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a084b296-09f1-4c9d-8a61-8f47c6e51664 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:32.036794 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a084b296-09f1-4c9d-8a61-8f47c6e51664 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:32.037449 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a084b296-09f1-4c9d-8a61-8f47c6e51664 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:32.038561 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a084b296-09f1-4c9d-8a61-8f47c6e51664 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:32.039246 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a084b296-09f1-4c9d-8a61-8f47c6e51664 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:32.166092 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-a084b296-09f1-4c9d-8a61-8f47c6e51664 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lazy-loading 'services' on Instance uuid effb9df8-4005-4b3b-a58e-41b5ba36b5c5 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:35:32.184499 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a084b296-09f1-4c9d-8a61-8f47c6e51664 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5/action" status: 202 len: 1942 microversion: 2.75 time: 0.577668 Aug 04 16:35:32.185163 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 402/793] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Aug 4 16:35:31 2022] POST /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5/action => generated 1942 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 04 16:35:32.298539 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-5e1c5b50-0244-4e9a-9309-0457299c2e84 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 35b3ee83-f946-4c4c-bff9-80b8bd368788] Updating instance_info_cache with network_info: [{"id": "88be3f31-89a1-4c97-bc28-c49392694bb7", "address": "fa:16:3e:a9:1c:6b", "network": {"id": "ce185855-ad88-40d0-ad8d-f7db4d7f58b9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1029059546-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "25f22de02d3e4db281f6372e8191b95f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap88be3f31-89", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126126) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 16:35:32.314669 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-767a8de4-ca66-457b-934e-ef6bf6204627 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1556200560", "id": 426018522, "os-flavor-access:is_public": "False"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:32.316635 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e1c5b50-0244-4e9a-9309-0457299c2e84 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Releasing lock "refresh_cache-35b3ee83-f946-4c4c-bff9-80b8bd368788" {{(pid=126126) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 16:35:32.317608 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5e1c5b50-0244-4e9a-9309-0457299c2e84 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "POST /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788/action" status: 202 len: 0 microversion: 2.1 time: 5.587154 Aug 04 16:35:32.322023 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 392/794] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:35:26 2022] POST /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788/action => generated 0 bytes in 5588 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 04 16:35:32.322217 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:35:32.322217 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:35:32.325888 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3abf06d5-591b-41a1-971d-be4c9c10d895 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Calling method '.version_select at 0x7f7e84e33820>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:32.337027 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-767a8de4-ca66-457b-934e-ef6bf6204627 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.150770 Aug 04 16:35:32.345157 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 403/795] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:35:32 2022] POST /compute/v2.1/flavors => generated 436 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:35:32.345157 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8bad44b6-ae84-4541-be49-f73636e1be16 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:32.345157 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8bad44b6-ae84-4541-be49-f73636e1be16 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: a80ed729-9d91-4fba-a785-77d5aeacb767] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:32.347576 n-d-846466-12 devstack@n-api.service[126126]: DEBUG neutronclient.v2_0.client [None req-3abf06d5-591b-41a1-971d-be4c9c10d895 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 2b531ace-4651-4053-a97f-904d6dbc373a does not exist", "detail": ""}} {{(pid=126126) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:35:32.348184 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.security_group_api [None req-3abf06d5-591b-41a1-971d-be4c9c10d895 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Neutron security group rule 2b531ace-4651-4053-a97f-904d6dbc373a not found {{(pid=126126) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 04 16:35:32.349113 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-3abf06d5-591b-41a1-971d-be4c9c10d895 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] HTTP exception thrown: Security group rule 2b531ace-4651-4053-a97f-904d6dbc373a does not exist Aug 04 16:35:32.349113 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-03b4900a-44a5-418b-8e59-1b80a5c0033c'] Aug 04 16:35:32.352659 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8bad44b6-ae84-4541-be49-f73636e1be16 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:32.353007 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3abf06d5-591b-41a1-971d-be4c9c10d895 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Request method failure captured: Aug 04 16:35:32.353007 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/os-security-group-rules/2b531ace-4651-4053-a97f-904d6dbc373a HTTP/1.1 Aug 04 16:35:32.353007 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:35:32.353007 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:35:32.353007 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:35:32.353007 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:35:32.353007 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:35:32.353007 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:35:32.353007 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:35:32.353007 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:35:32.353007 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_VCMgl-Ujx4xn8LJn2DlERaWZr_hUMfCBdT0WGd_U2j7gcCj2GdzZnw3lP8rk7pChqM7-xc8SlsGHqLKnyt6petZMVQk942zLRN1CUkj1xEAqxPVjpLHzjCE6qbRVB9l84WA8hcx4s8OvG_vxLMmzreFIkQZtSe6QwCramDqD0jXCc Aug 04 16:35:32.353007 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:35:32.353007 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:35:32.353007 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:35:32.353007 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:35:32.353007 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:35:32.353007 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:35:32.353007 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: dc4b4bcf09f74030a1ad54a165bd6b70 Aug 04 16:35:32.353007 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1094474337 Aug 04 16:35:32.353007 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:35:32.353007 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:35:32.354623 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc4b4bcf09f74030a1ad54a165bd6b70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dc4b4bcf09f74030a1ad54a165bd6b70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc4b4bcf09f74030a1ad54a165bd6b70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dc4b4bcf09f74030a1ad54a165bd6b70"}]}] Aug 04 16:35:32.354623 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1094474337 Aug 04 16:35:32.354623 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: dc4b4bcf09f74030a1ad54a165bd6b70 Aug 04 16:35:32.354623 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1094474337 Aug 04 16:35:32.354623 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project Aug 04 16:35:32.354623 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:35:32.354623 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:35:32.354623 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: ad637558f9c142d8a386735193915eab Aug 04 16:35:32.354623 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project Aug 04 16:35:32.354623 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:35:32.354623 n-d-846466-12 devstack@n-api.service[126126]: exception: Security group rule 2b531ace-4651-4053-a97f-904d6dbc373a does not exist Aug 04 16:35:32.354623 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-03b4900a-44a5-418b-8e59-1b80a5c0033c'] Aug 04 16:35:32.355541 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '2b531ace-4651-4053-a97f-904d6dbc373a'} Aug 04 16:35:32.355541 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:35:32.355541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:32.355541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 04 16:35:32.355541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 04 16:35:32.355541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:35:32.355541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:35:32.355541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 04 16:35:32.355541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 04 16:35:32.355541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:35:32.355541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:35:32.355541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 16:35:32.355541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 16:35:32.355541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:35:32.355541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:35:32.355541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:35:32.355541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:35:32.355541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:35:32.355541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:35:32.357207 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:35:32.357207 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:35:32.357207 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:35:32.357207 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:35:32.357207 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:35:32.357207 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:35:32.357207 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:35:32.357207 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:35:32.357207 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 2b531ace-4651-4053-a97f-904d6dbc373a does not exist Aug 04 16:35:32.357207 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-03b4900a-44a5-418b-8e59-1b80a5c0033c'] Aug 04 16:35:32.357207 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:35:32.357207 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:32.357207 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:35:32.357207 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:32.357207 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 04 16:35:32.357207 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 04 16:35:32.357207 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 04 16:35:32.357207 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 16:35:32.360199 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 2b531ace-4651-4053-a97f-904d6dbc373a does not exist Aug 04 16:35:32.360199 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-03b4900a-44a5-418b-8e59-1b80a5c0033c'] Aug 04 16:35:32.360199 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:35:32.360199 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:32.360199 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:35:32.360199 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:32.360199 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:32.360199 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:32.360199 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:35:32.360199 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:35:32.360199 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:35:32.360199 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:35:32.360199 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:35:32.360199 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:35:32.360199 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 04 16:35:32.360199 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 16:35:32.360199 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 2b531ace-4651-4053-a97f-904d6dbc373a does not exist Aug 04 16:35:32.360199 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-03b4900a-44a5-418b-8e59-1b80a5c0033c'] Aug 04 16:35:32.360199 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:35:32.360199 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:32.361869 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:35:32.361869 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:32.361869 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:32.361869 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:32.361869 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:35:32.361869 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:35:32.361869 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 2b531ace-4651-4053-a97f-904d6dbc373a does not exist Aug 04 16:35:32.361869 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-03b4900a-44a5-418b-8e59-1b80a5c0033c'] Aug 04 16:35:32.361869 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:35:32.361869 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3abf06d5-591b-41a1-971d-be4c9c10d895 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Returning 404 to user: Security group rule 2b531ace-4651-4053-a97f-904d6dbc373a does not exist Aug 04 16:35:32.361869 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-03b4900a-44a5-418b-8e59-1b80a5c0033c'] {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:35:32.362700 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8bad44b6-ae84-4541-be49-f73636e1be16 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:32.362796 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3abf06d5-591b-41a1-971d-be4c9c10d895 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-group-rules/2b531ace-4651-4053-a97f-904d6dbc373a" status: 404 len: 199 microversion: 2.1 time: 0.035327 Aug 04 16:35:32.362904 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8bad44b6-ae84-4541-be49-f73636e1be16 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:32.362904 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8bad44b6-ae84-4541-be49-f73636e1be16 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:32.363074 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 393/796] 10.222.0.23 () {58 vars in 1287 bytes} [Thu Aug 4 16:35:32 2022] DELETE /compute/v2.1/os-security-group-rules/2b531ace-4651-4053-a97f-904d6dbc373a => generated 199 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:35:32.364391 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-68a11935-b1b7-4535-a3ae-0b6f76e429fd req-3f5ea5c6-57ec-487f-bdc3-c30ae5684085 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6017510a-e331-424a-843d-54b980b999fb", "tag": "d7e532ef-c5a8-4d48-bb77-3ffca7d01087"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:32.381436 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-68a11935-b1b7-4535-a3ae-0b6f76e429fd req-3f5ea5c6-57ec-487f-bdc3-c30ae5684085 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:32.381874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-68a11935-b1b7-4535-a3ae-0b6f76e429fd req-3f5ea5c6-57ec-487f-bdc3-c30ae5684085 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:32.396475 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-68a11935-b1b7-4535-a3ae-0b6f76e429fd req-3f5ea5c6-57ec-487f-bdc3-c30ae5684085 service nova] Creating event network-changed:d7e532ef-c5a8-4d48-bb77-3ffca7d01087 for instance 6017510a-e331-424a-843d-54b980b999fb on n-h1-846466-12 Aug 04 16:35:32.402046 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-68a11935-b1b7-4535-a3ae-0b6f76e429fd req-3f5ea5c6-57ec-487f-bdc3-c30ae5684085 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041673 Aug 04 16:35:32.402820 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 394/797] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:35:32.562986 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-38ff4361-7d57-4606-abdd-3a6662a26b1d tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Action: 'create', calling method: .version_select at 0x7f7e84e33c10>, body: {"keypair": {"name": "tempest-keypair-764030730", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSNL2d0Ft0uENfHVKHAMG+wzSz3uzbiB/H0o+lCiItZjywP/KUEuSqrJ9DEjvAeVqHjvTSfRywE7/uHsL1Wxa5Vai4jd8EPxU5NW6okGy7FHT2YRopfgnplYCkL+w2KNA=="}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:32.581073 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-38ff4361-7d57-4606-abdd-3a6662a26b1d tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Getting quotas for project 5fa4a23e6e71405f82347cd1cbbe3f84. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:35:32.587247 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-38ff4361-7d57-4606-abdd-3a6662a26b1d tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Getting quotas for user 3fd5f11c99c841c4a7e7af4d7a4a5d4c and project 5fa4a23e6e71405f82347cd1cbbe3f84. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:35:32.619425 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-38ff4361-7d57-4606-abdd-3a6662a26b1d tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.215031 Aug 04 16:35:32.626228 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 395/798] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 16:35:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:35:32.627395 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f19a718b-ce35-45d7-859d-0875368f9ee9 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:32.627395 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f19a718b-ce35-45d7-859d-0875368f9ee9 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:32.642585 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f19a718b-ce35-45d7-859d-0875368f9ee9 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:32.642585 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f19a718b-ce35-45d7-859d-0875368f9ee9 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:32.643370 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f19a718b-ce35-45d7-859d-0875368f9ee9 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:32.643775 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f19a718b-ce35-45d7-859d-0875368f9ee9 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:32.652070 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8bad44b6-ae84-4541-be49-f73636e1be16 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:32.662440 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8bad44b6-ae84-4541-be49-f73636e1be16 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767" status: 200 len: 1478 microversion: 2.1 time: 0.323038 Aug 04 16:35:32.663518 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 404/799] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:32 2022] GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767 => generated 1478 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:32.677241 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-399ae9b1-83fe-4564-b3e7-ea1da24ff1a7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:32.686519 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-399ae9b1-83fe-4564-b3e7-ea1da24ff1a7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:32.704057 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-399ae9b1-83fe-4564-b3e7-ea1da24ff1a7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:32.704392 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-399ae9b1-83fe-4564-b3e7-ea1da24ff1a7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:32.705191 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-399ae9b1-83fe-4564-b3e7-ea1da24ff1a7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:32.705649 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-399ae9b1-83fe-4564-b3e7-ea1da24ff1a7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:32.903410 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-f19a718b-ce35-45d7-859d-0875368f9ee9 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lazy-loading 'services' on Instance uuid effb9df8-4005-4b3b-a58e-41b5ba36b5c5 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:35:32.930287 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f19a718b-ce35-45d7-859d-0875368f9ee9 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1929 microversion: 2.75 time: 0.308433 Aug 04 16:35:32.931638 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 396/800] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:32 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1929 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:32.937256 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2ac455a0-c938-4fde-93ee-1614682cb78b tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.68"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:32.947046 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2ac455a0-c938-4fde-93ee-1614682cb78b tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 2d2e5f9c-c00d-46b1-b55c-b2bda4428946] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:32.947717 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ac455a0-c938-4fde-93ee-1614682cb78b tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:32.948294 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ac455a0-c938-4fde-93ee-1614682cb78b tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:32.949517 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ac455a0-c938-4fde-93ee-1614682cb78b tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:32.950105 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ac455a0-c938-4fde-93ee-1614682cb78b tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:33.013000 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ac455a0-c938-4fde-93ee-1614682cb78b tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Acquired lock "refresh_cache-2d2e5f9c-c00d-46b1-b55c-b2bda4428946" {{(pid=126126) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 16:35:33.240668 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-399ae9b1-83fe-4564-b3e7-ea1da24ff1a7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:33.254553 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-399ae9b1-83fe-4564-b3e7-ea1da24ff1a7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1472 microversion: 2.1 time: 0.589549 Aug 04 16:35:33.273559 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 405/801] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:32 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1472 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:33.285082 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1abb5207-af7b-431a-bd03-b591b92c9555 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f9a357362d2743aaafc5e3c57512c311"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:33.291807 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:35:33.291807 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:35:33.404811 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1abb5207-af7b-431a-bd03-b591b92c9555 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/426018522/action" status: 200 len: 96 microversion: 2.1 time: 0.124838 Aug 04 16:35:33.405807 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 406/802] 10.222.0.23 () {60 vars in 1197 bytes} [Thu Aug 4 16:35:33 2022] POST /compute/v2.1/flavors/426018522/action => generated 96 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:35:33.414094 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3fed1d62-89ad-4d77-bce1-f0f99b17f67e tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Calling method '.version_select at 0x7f7e844f0a60>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:34.530958 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3fed1d62-89ad-4d77-bce1-f0f99b17f67e tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/71bde338-ef9f-4c6a-a985-927d05016445" status: 202 len: 0 microversion: 2.1 time: 1.123866 Aug 04 16:35:34.536382 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 407/803] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:35:33 2022] DELETE /compute/v2.1/os-security-groups/71bde338-ef9f-4c6a-a985-927d05016445 => generated 0 bytes in 1125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:35:34.538168 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a2efb50c-313a-4b4b-aedb-ba3937c6db2a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:34.538810 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a2efb50c-313a-4b4b-aedb-ba3937c6db2a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 6017510a-e331-424a-843d-54b980b999fb] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:34.545193 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a2efb50c-313a-4b4b-aedb-ba3937c6db2a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:34.545672 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a2efb50c-313a-4b4b-aedb-ba3937c6db2a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:34.546620 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a2efb50c-313a-4b4b-aedb-ba3937c6db2a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:34.547078 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a2efb50c-313a-4b4b-aedb-ba3937c6db2a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:34.799759 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a2efb50c-313a-4b4b-aedb-ba3937c6db2a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:34.808514 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a2efb50c-313a-4b4b-aedb-ba3937c6db2a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:34.810053 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a2efb50c-313a-4b4b-aedb-ba3937c6db2a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:34.811185 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a2efb50c-313a-4b4b-aedb-ba3937c6db2a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb" status: 200 len: 1361 microversion: 2.25 time: 0.277984 Aug 04 16:35:34.811746 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 408/804] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:34 2022] GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb => generated 1361 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:34.816663 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-79452af3-417c-4cb5-9d1f-325f3b3c0753 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Calling method '.version_select at 0x7f7e8452d3a0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:34.821574 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-79452af3-417c-4cb5-9d1f-325f3b3c0753 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:34.822186 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-79452af3-417c-4cb5-9d1f-325f3b3c0753 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:34.833545 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-79452af3-417c-4cb5-9d1f-325f3b3c0753 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 1576 microversion: 2.1 time: 0.020528 Aug 04 16:35:34.841353 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 409/805] 10.222.0.23 () {58 vars in 1143 bytes} [Thu Aug 4 16:35:34 2022] GET /compute/v2.1/os-migrations => generated 1576 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:34.841353 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-28f26203-4c46-434a-b333-3a267ddabca4 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f9a357362d2743aaafc5e3c57512c311"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:34.841874 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:35:34.841874 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:35:34.910410 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-28f26203-4c46-434a-b333-3a267ddabca4 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] HTTP exception thrown: Flavor access already exists for flavor 35 and project f9a357362d2743aaafc5e3c57512c311 combination. Aug 04 16:35:34.922492 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-28f26203-4c46-434a-b333-3a267ddabca4 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] Request method failure captured: Aug 04 16:35:34.922492 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/flavors/426018522/action HTTP/1.1 Aug 04 16:35:34.922492 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:35:34.922492 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:35:34.922492 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:35:34.922492 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 67 Aug 04 16:35:34.922492 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:35:34.922492 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:35:34.922492 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:35:34.922492 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:35:34.922492 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_VRfJ6Ed0F3TJwmIBt35GFrAAkEEf_dhjKN8sIGDUK4LxhZtwNXrjznF7xCdLfdgFUPdCykmskFYalbsr-WLPYWUyT93FDgtCANk97uS0PuMDuVq9Izkm7I9stEECx85bvuae_Vqy9arGHjuIxtdH8aemplnTNoEL39wjspDF3ylBg Aug 04 16:35:34.922492 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:35:34.922492 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:35:34.922492 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:35:34.922492 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:35:34.922492 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:35:34.922492 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:35:34.922492 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 3c8b2fe0abd34a8ea766e5df55f8efd0 Aug 04 16:35:34.922492 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-958940071 Aug 04 16:35:34.922492 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader,admin Aug 04 16:35:34.922492 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader,admin Aug 04 16:35:34.924536 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c8b2fe0abd34a8ea766e5df55f8efd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3c8b2fe0abd34a8ea766e5df55f8efd0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c8b2fe0abd34a8ea766e5df55f8efd0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3c8b2fe0abd34a8ea766e5df55f8efd0"}]}] Aug 04 16:35:34.924536 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-958940071 Aug 04 16:35:34.924536 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 3c8b2fe0abd34a8ea766e5df55f8efd0 Aug 04 16:35:34.924536 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-958940071 Aug 04 16:35:34.924536 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin Aug 04 16:35:34.924536 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:35:34.924536 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:35:34.924536 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 402db49c379f4792a5c74af8181f0721 Aug 04 16:35:34.924536 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin Aug 04 16:35:34.924536 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:35:34.924536 n-d-846466-12 devstack@n-api.service[126125]: {"addTenantAccess": {"tenant": "f9a357362d2743aaafc5e3c57512c311"}} Aug 04 16:35:34.924536 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:35:34.925494 n-d-846466-12 devstack@n-api.service[126125]: exception: Flavor access already exists for flavor 35 and project f9a357362d2743aaafc5e3c57512c311 combination. Aug 04 16:35:34.925494 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '426018522', 'body': {'addTenantAccess': {'tenant': 'f9a357362d2743aaafc5e3c57512c311'}}} Aug 04 16:35:34.925494 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:35:34.925494 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:34.925494 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 16:35:34.925494 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 04 16:35:34.925494 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 16:35:34.925494 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 04 16:35:34.925494 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 16:35:34.925494 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 04 16:35:34.925494 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 16:35:34.925494 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 04 16:35:34.925494 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 16:35:34.925494 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 16:35:34.925494 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 16:35:34.925494 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result.read() Aug 04 16:35:34.925494 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 16:35:34.925494 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 04 16:35:34.926832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 16:35:34.926832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 04 16:35:34.926832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 16:35:34.926832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 04 16:35:34.926832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 16:35:34.926832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 04 16:35:34.926832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '35-f9a357362d2743aaafc5e3c57512c311' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 04 16:35:34.926832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:34.926832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 04 16:35:34.926832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:34.926832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:34.926832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 04 16:35:34.926832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 04 16:35:34.926832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 04 16:35:34.926832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi session.flush() Aug 04 16:35:34.926832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 16:35:34.926832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 04 16:35:34.926832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 16:35:34.926832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 04 16:35:34.928201 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 16:35:34.928201 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 04 16:35:34.928201 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 16:35:34.928201 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception Aug 04 16:35:34.928201 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 16:35:34.928201 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 04 16:35:34.928201 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 16:35:34.928201 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 04 16:35:34.928201 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 16:35:34.928201 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 04 16:35:34.928201 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 16:35:34.928201 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 04 16:35:34.928201 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 04 16:35:34.928201 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 04 16:35:34.928201 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 16:35:34.928201 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 16:35:34.928201 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 16:35:34.928201 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 04 16:35:34.929756 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 16:35:34.929756 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 04 16:35:34.929756 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 16:35:34.929756 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 04 16:35:34.929756 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 16:35:34.929756 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 16:35:34.929756 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 16:35:34.929756 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception Aug 04 16:35:34.929756 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 16:35:34.929756 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 04 16:35:34.929756 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 16:35:34.929756 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 04 16:35:34.929756 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 16:35:34.929756 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 04 16:35:34.929756 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 16:35:34.929756 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 04 16:35:34.929756 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 16:35:34.929756 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 16:35:34.932302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 16:35:34.932302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result.read() Aug 04 16:35:34.932302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 16:35:34.932302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 04 16:35:34.932302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 16:35:34.932302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 04 16:35:34.932302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 16:35:34.932302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 04 16:35:34.932302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 16:35:34.932302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 04 16:35:34.932302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '35-f9a357362d2743aaafc5e3c57512c311' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 04 16:35:34.932302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 04 16:35:34.932302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 4, 16, 35, 34, 904932), 'updated_at': None, 'flavor_id': 35, 'project_id': 'f9a357362d2743aaafc5e3c57512c311'}] Aug 04 16:35:34.932302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 16:35:34.932302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:34.932302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:34.932302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:34.935327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:34.935327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 04 16:35:34.935327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 04 16:35:34.935327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 04 16:35:34.935327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 04 16:35:34.935327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 04 16:35:34.935327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 04 16:35:34.935327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 04 16:35:34.935327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 04 16:35:34.935327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 04 16:35:34.935327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 04 16:35:34.935327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:35:34.935327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:35:34.935327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 04 16:35:34.935327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 04 16:35:34.935327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 35 and project f9a357362d2743aaafc5e3c57512c311 combination. Aug 04 16:35:34.935327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:34.935327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:34.935327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:34.937871 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:34.937871 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:34.937871 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:34.937871 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:35:34.937871 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:35:34.937871 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:35:34.937871 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:35:34.937871 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:35:34.937871 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:35:34.937871 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 04 16:35:34.937871 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 04 16:35:34.937871 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 35 and project f9a357362d2743aaafc5e3c57512c311 combination. Aug 04 16:35:34.937871 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:34.937871 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:34.937871 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:34.937871 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:34.937871 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:34.937871 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:34.937871 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:35:34.937871 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:35:34.940787 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 35 and project f9a357362d2743aaafc5e3c57512c311 combination. Aug 04 16:35:34.940787 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:34.940787 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-28f26203-4c46-434a-b333-3a267ddabca4 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] Returning 409 to user: Flavor access already exists for flavor 35 and project f9a357362d2743aaafc5e3c57512c311 combination. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:35:34.940787 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-28f26203-4c46-434a-b333-3a267ddabca4 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/426018522/action" status: 409 len: 152 microversion: 2.1 time: 0.088774 Aug 04 16:35:34.940787 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 410/806] 10.222.0.23 () {60 vars in 1197 bytes} [Thu Aug 4 16:35:34 2022] POST /compute/v2.1/flavors/426018522/action => generated 152 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:35:34.940787 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8d066779-34e6-44cb-a638-48a73eb2b0c8 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:34.941635 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8d066779-34e6-44cb-a638-48a73eb2b0c8 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:34.942261 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8d066779-34e6-44cb-a638-48a73eb2b0c8 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:34.942703 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8d066779-34e6-44cb-a638-48a73eb2b0c8 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:34.943482 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8d066779-34e6-44cb-a638-48a73eb2b0c8 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:34.943912 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8d066779-34e6-44cb-a638-48a73eb2b0c8 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:35.059989 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-8d066779-34e6-44cb-a638-48a73eb2b0c8 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lazy-loading 'services' on Instance uuid effb9df8-4005-4b3b-a58e-41b5ba36b5c5 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:35:35.080904 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8d066779-34e6-44cb-a638-48a73eb2b0c8 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1929 microversion: 2.75 time: 0.151389 Aug 04 16:35:35.082134 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 411/807] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:34 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1929 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:35.087110 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-401f12df-55e8-4471-accb-ee0c911a603d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:35.087957 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-401f12df-55e8-4471-accb-ee0c911a603d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:35.094196 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-401f12df-55e8-4471-accb-ee0c911a603d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:35.094872 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-401f12df-55e8-4471-accb-ee0c911a603d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:35.095818 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-401f12df-55e8-4471-accb-ee0c911a603d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:35.096411 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-401f12df-55e8-4471-accb-ee0c911a603d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:35.314602 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-401f12df-55e8-4471-accb-ee0c911a603d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:35.325236 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-401f12df-55e8-4471-accb-ee0c911a603d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1469 microversion: 2.1 time: 0.241867 Aug 04 16:35:35.325827 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 412/808] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:35 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1469 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:35.331153 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-66c7d2a2-5842-4317-a04d-9f2367fbf2f0 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1856671147", "imageRef": "9a881e86-de59-497b-9ec9-ef9066713375", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "09215036-03eb-40d3-9192-fe45f20bb806"}], "security_groups": [{"name": "tempest-securitygroup--458457367"}], "key_name": "tempest-keypair-764030730", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:35.516687 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-66c7d2a2-5842-4317-a04d-9f2367fbf2f0 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] validate_networks() for [('09215036-03eb-40d3-9192-fe45f20bb806', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:35:36.193056 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-66c7d2a2-5842-4317-a04d-9f2367fbf2f0 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:35:36.193682 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-66c7d2a2-5842-4317-a04d-9f2367fbf2f0 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:35:36.194015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-66c7d2a2-5842-4317-a04d-9f2367fbf2f0 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:35:36.194422 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-66c7d2a2-5842-4317-a04d-9f2367fbf2f0 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:35:36.194822 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-66c7d2a2-5842-4317-a04d-9f2367fbf2f0 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:35:36.204178 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-66c7d2a2-5842-4317-a04d-9f2367fbf2f0 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:36.205007 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-66c7d2a2-5842-4317-a04d-9f2367fbf2f0 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:36.206174 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-66c7d2a2-5842-4317-a04d-9f2367fbf2f0 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:36.207013 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-66c7d2a2-5842-4317-a04d-9f2367fbf2f0 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:36.212331 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.network.neutron [None req-2ac455a0-c938-4fde-93ee-1614682cb78b tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 2d2e5f9c-c00d-46b1-b55c-b2bda4428946] re-assign floating IP 172.25.6.68 from instance 35b3ee83-f946-4c4c-bff9-80b8bd368788 Aug 04 16:35:36.225700 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-66c7d2a2-5842-4317-a04d-9f2367fbf2f0 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Getting quotas for project 5fa4a23e6e71405f82347cd1cbbe3f84. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:35:36.230772 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-66c7d2a2-5842-4317-a04d-9f2367fbf2f0 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Getting quotas for user 3fd5f11c99c841c4a7e7af4d7a4a5d4c and project 5fa4a23e6e71405f82347cd1cbbe3f84. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:35:36.251824 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-66c7d2a2-5842-4317-a04d-9f2367fbf2f0 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:35:36.255037 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-66c7d2a2-5842-4317-a04d-9f2367fbf2f0 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] [instance: 2503f8ac-e7f9-432d-8b3b-271d1a179572] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a881e86-de59-497b-9ec9-ef9066713375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:35:36.274899 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-2ac455a0-c938-4fde-93ee-1614682cb78b tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 35b3ee83-f946-4c4c-bff9-80b8bd368788] Building network info cache for instance {{(pid=126126) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 16:35:36.329536 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-66c7d2a2-5842-4317-a04d-9f2367fbf2f0 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.002330 Aug 04 16:35:36.330713 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 413/809] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:35:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:35:36.336257 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-bdabb194-e021-4a4c-9967-4cb7f4e5857c req-e73f72e3-fdb8-46b9-b826-d5ea22e781cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35b3ee83-f946-4c4c-bff9-80b8bd368788", "tag": "88be3f31-89a1-4c97-bc28-c49392694bb7"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:36.348697 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-bdabb194-e021-4a4c-9967-4cb7f4e5857c req-e73f72e3-fdb8-46b9-b826-d5ea22e781cf service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:36.349299 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-bdabb194-e021-4a4c-9967-4cb7f4e5857c req-e73f72e3-fdb8-46b9-b826-d5ea22e781cf service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:36.364875 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-bdabb194-e021-4a4c-9967-4cb7f4e5857c req-e73f72e3-fdb8-46b9-b826-d5ea22e781cf service nova] Creating event network-changed:88be3f31-89a1-4c97-bc28-c49392694bb7 for instance 35b3ee83-f946-4c4c-bff9-80b8bd368788 on n-h1-846466-12 Aug 04 16:35:36.372589 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-bdabb194-e021-4a4c-9967-4cb7f4e5857c req-e73f72e3-fdb8-46b9-b826-d5ea22e781cf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040087 Aug 04 16:35:36.373610 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 414/810] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:35:36.381409 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0a2206ee-9e70-4e9e-9cac-f3c588f5e637 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Calling method '.version_select at 0x7f7e8452df70>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:37.255135 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0a2206ee-9e70-4e9e-9cac-f3c588f5e637 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/43839822-5e8c-4c06-a7c1-c12c29923efe" status: 202 len: 0 microversion: 2.1 time: 0.879361 Aug 04 16:35:37.256087 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-2ac455a0-c938-4fde-93ee-1614682cb78b tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 35b3ee83-f946-4c4c-bff9-80b8bd368788] Updating instance_info_cache with network_info: [{"id": "88be3f31-89a1-4c97-bc28-c49392694bb7", "address": "fa:16:3e:a9:1c:6b", "network": {"id": "ce185855-ad88-40d0-ad8d-f7db4d7f58b9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1029059546-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "25f22de02d3e4db281f6372e8191b95f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap88be3f31-89", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126126) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 16:35:37.259065 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 415/811] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:35:36 2022] DELETE /compute/v2.1/os-security-groups/43839822-5e8c-4c06-a7c1-c12c29923efe => generated 0 bytes in 885 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:35:37.278094 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-903a81c9-f36c-4b26-ad7a-f2772dfe1936 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:37.278836 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-903a81c9-f36c-4b26-ad7a-f2772dfe1936 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] [instance: a80ed729-9d91-4fba-a785-77d5aeacb767] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:37.280085 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-2ac455a0-c938-4fde-93ee-1614682cb78b tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 2d2e5f9c-c00d-46b1-b55c-b2bda4428946] Building network info cache for instance {{(pid=126126) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 16:35:37.288438 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-903a81c9-f36c-4b26-ad7a-f2772dfe1936 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:37.289087 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-903a81c9-f36c-4b26-ad7a-f2772dfe1936 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:37.290277 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-903a81c9-f36c-4b26-ad7a-f2772dfe1936 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:37.290890 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-903a81c9-f36c-4b26-ad7a-f2772dfe1936 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:37.538973 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-903a81c9-f36c-4b26-ad7a-f2772dfe1936 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767" status: 200 len: 1631 microversion: 2.1 time: 0.278566 Aug 04 16:35:37.540346 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 416/812] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:37 2022] GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767 => generated 1631 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:37.546751 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d699b37c-838d-4c97-b66a-28e7974bcbc8 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "f9a357362d2743aaafc5e3c57512c311"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:37.550082 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:35:37.550082 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:35:37.635620 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d699b37c-838d-4c97-b66a-28e7974bcbc8 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/426018522/action" status: 200 len: 21 microversion: 2.1 time: 0.093648 Aug 04 16:35:37.637255 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 417/813] 10.222.0.23 () {60 vars in 1197 bytes} [Thu Aug 4 16:35:37 2022] POST /compute/v2.1/flavors/426018522/action => generated 21 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:35:37.642801 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-f1164f20-8d76-4dc4-9d12-0c1de22bc59c req-3f7b0462-1063-417a-afd2-c8b42985b9ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6017510a-e331-424a-843d-54b980b999fb", "name": "network-vif-plugged", "status": "completed", "tag": "d7e532ef-c5a8-4d48-bb77-3ffca7d01087"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:37.655586 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-f1164f20-8d76-4dc4-9d12-0c1de22bc59c req-3f7b0462-1063-417a-afd2-c8b42985b9ad service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:37.656328 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-f1164f20-8d76-4dc4-9d12-0c1de22bc59c req-3f7b0462-1063-417a-afd2-c8b42985b9ad service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:37.669567 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-f1164f20-8d76-4dc4-9d12-0c1de22bc59c req-3f7b0462-1063-417a-afd2-c8b42985b9ad service nova] Creating event network-vif-plugged:d7e532ef-c5a8-4d48-bb77-3ffca7d01087 for instance 6017510a-e331-424a-843d-54b980b999fb on n-h1-846466-12 Aug 04 16:35:37.675349 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-f1164f20-8d76-4dc4-9d12-0c1de22bc59c req-3f7b0462-1063-417a-afd2-c8b42985b9ad service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036490 Aug 04 16:35:37.675933 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 418/814] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:35:37.682214 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-12fdf9bc-2d94-4bf2-9a0a-fbf900e0b6d5 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:37.683177 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-12fdf9bc-2d94-4bf2-9a0a-fbf900e0b6d5 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:37.692613 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-12fdf9bc-2d94-4bf2-9a0a-fbf900e0b6d5 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:37.693428 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-12fdf9bc-2d94-4bf2-9a0a-fbf900e0b6d5 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:37.694652 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-12fdf9bc-2d94-4bf2-9a0a-fbf900e0b6d5 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:37.695271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-12fdf9bc-2d94-4bf2-9a0a-fbf900e0b6d5 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:37.804936 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-12fdf9bc-2d94-4bf2-9a0a-fbf900e0b6d5 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "POST /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412/action" status: 204 len: 0 microversion: 2.1 time: 0.127174 Aug 04 16:35:37.809560 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 419/815] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:35:37 2022] POST /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412/action => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:35:37.817754 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b10c72b8-37a9-484a-937b-063dc95b2a89 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:37.818679 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b10c72b8-37a9-484a-937b-063dc95b2a89 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 6017510a-e331-424a-843d-54b980b999fb] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:37.827106 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b10c72b8-37a9-484a-937b-063dc95b2a89 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:37.827708 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b10c72b8-37a9-484a-937b-063dc95b2a89 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:37.828503 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b10c72b8-37a9-484a-937b-063dc95b2a89 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:37.829315 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b10c72b8-37a9-484a-937b-063dc95b2a89 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:38.437162 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b10c72b8-37a9-484a-937b-063dc95b2a89 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:38.448279 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b10c72b8-37a9-484a-937b-063dc95b2a89 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:38.450325 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b10c72b8-37a9-484a-937b-063dc95b2a89 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:38.452501 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b10c72b8-37a9-484a-937b-063dc95b2a89 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb" status: 200 len: 1361 microversion: 2.25 time: 0.641313 Aug 04 16:35:38.453863 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 420/816] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:37 2022] GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb => generated 1361 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:38.474128 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-796768b4-2a3a-4b65-b6fc-2349ed4addc5 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:38.480551 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-796768b4-2a3a-4b65-b6fc-2349ed4addc5 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:38.494422 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-796768b4-2a3a-4b65-b6fc-2349ed4addc5 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:38.497399 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-796768b4-2a3a-4b65-b6fc-2349ed4addc5 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:38.499054 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-796768b4-2a3a-4b65-b6fc-2349ed4addc5 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:38.501716 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-796768b4-2a3a-4b65-b6fc-2349ed4addc5 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:38.512415 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:35:38.650668 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-796768b4-2a3a-4b65-b6fc-2349ed4addc5 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lazy-loading 'services' on Instance uuid effb9df8-4005-4b3b-a58e-41b5ba36b5c5 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:35:38.668603 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-796768b4-2a3a-4b65-b6fc-2349ed4addc5 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1929 microversion: 2.75 time: 0.213083 Aug 04 16:35:38.669556 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 421/817] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:38 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1929 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:38.674431 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f3c1fcc4-98e0-4493-bba4-957e8b1b9720 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:38.675055 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f3c1fcc4-98e0-4493-bba4-957e8b1b9720 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] [instance: 2503f8ac-e7f9-432d-8b3b-271d1a179572] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:38.681034 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3c1fcc4-98e0-4493-bba4-957e8b1b9720 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:38.681515 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3c1fcc4-98e0-4493-bba4-957e8b1b9720 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:38.682432 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3c1fcc4-98e0-4493-bba4-957e8b1b9720 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:38.683009 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3c1fcc4-98e0-4493-bba4-957e8b1b9720 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:38.792396 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f3c1fcc4-98e0-4493-bba4-957e8b1b9720 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5f11c99c841c4a7e7af4d7a4a5d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa4a23e6e71405f82347cd1cbbe3f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:38.801575 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f3c1fcc4-98e0-4493-bba4-957e8b1b9720 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] 10.222.0.23 "GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572" status: 200 len: 1303 microversion: 2.1 time: 0.130905 Aug 04 16:35:38.802760 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 422/818] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:38 2022] GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572 => generated 1303 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:38.808452 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-41f85cff-e9c7-4e9d-bbf4-8f121fc1f1c9 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Calling method '.version_select at 0x7f7e84660550>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:38.838933 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-2ac455a0-c938-4fde-93ee-1614682cb78b tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 2d2e5f9c-c00d-46b1-b55c-b2bda4428946] Updating instance_info_cache with network_info: [{"id": "7b107fe2-9d03-469a-b39d-9bb9814ca01a", "address": "fa:16:3e:4d:21:18", "network": {"id": "ce185855-ad88-40d0-ad8d-f7db4d7f58b9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1029059546-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "25f22de02d3e4db281f6372e8191b95f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7b107fe2-9d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126126) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 16:35:38.870127 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ac455a0-c938-4fde-93ee-1614682cb78b tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Releasing lock "refresh_cache-2d2e5f9c-c00d-46b1-b55c-b2bda4428946" {{(pid=126126) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 16:35:38.871150 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2ac455a0-c938-4fde-93ee-1614682cb78b tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "POST /compute/v2.1/servers/2d2e5f9c-c00d-46b1-b55c-b2bda4428946/action" status: 202 len: 0 microversion: 2.1 time: 5.938069 Aug 04 16:35:38.872451 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 397/819] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:35:32 2022] POST /compute/v2.1/servers/2d2e5f9c-c00d-46b1-b55c-b2bda4428946/action => generated 0 bytes in 5940 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 04 16:35:38.879806 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fa6b1637-e8e5-4a73-b078-3efe37093e81 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Action: 'create', calling method: .version_select at 0x7f7e850164c0>, body: {"keypair": {"name": "tempest-keypair-249141778", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAurP9HwQ6d9OTHlt49OmFlChDlE5uubXc5jdnyBUJOOX+VIOiw6QkqMGMbGtpnJYKP3ZXC8f5PKyNfa3wjPpEvxLcp4ZUG/IJFfl/EkiWp+do2P6/lhZTi6YPUEgIfHMQ=="}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:38.897203 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:35:38.912764 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-fa6b1637-e8e5-4a73-b078-3efe37093e81 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Getting quotas for project 82b3a898ed4b4e0a82ae35830cb00ca9. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:35:38.919135 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-fa6b1637-e8e5-4a73-b078-3efe37093e81 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Getting quotas for user 51b742cff6a948d0883501917706f66e and project 82b3a898ed4b4e0a82ae35830cb00ca9. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:35:38.953766 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fa6b1637-e8e5-4a73-b078-3efe37093e81 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.079344 Aug 04 16:35:38.957473 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 398/820] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 16:35:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:35:38.963786 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c787e27a-024f-49a4-99c3-7d094b53c925 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:38.964826 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:35:38.964826 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:35:39.008676 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c787e27a-024f-49a4-99c3-7d094b53c925 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/426018522" status: 202 len: 0 microversion: 2.1 time: 0.049358 Aug 04 16:35:39.010025 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 399/821] 10.222.0.23 () {58 vars in 1158 bytes} [Thu Aug 4 16:35:38 2022] DELETE /compute/v2.1/flavors/426018522 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:35:39.020805 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8b2008d5-5227-48a6-bdec-8cb23fd310ed tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:39.021565 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8b2008d5-5227-48a6-bdec-8cb23fd310ed tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:39.034269 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8b2008d5-5227-48a6-bdec-8cb23fd310ed tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:39.034692 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8b2008d5-5227-48a6-bdec-8cb23fd310ed tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:39.035733 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8b2008d5-5227-48a6-bdec-8cb23fd310ed tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:39.036372 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8b2008d5-5227-48a6-bdec-8cb23fd310ed tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:39.205751 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-41f85cff-e9c7-4e9d-bbf4-8f121fc1f1c9 tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/8fd7f457-2a2d-4a7b-9042-7b3315399017" status: 202 len: 0 microversion: 2.1 time: 0.400649 Aug 04 16:35:39.208119 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 423/822] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:35:38 2022] DELETE /compute/v2.1/os-security-groups/8fd7f457-2a2d-4a7b-9042-7b3315399017 => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:35:39.219852 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-b9d56907-4de0-4ec1-8f38-0029823e58d8 req-1f6a136b-b503-43e7-92ea-f8c5aa287746 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35b3ee83-f946-4c4c-bff9-80b8bd368788", "tag": "88be3f31-89a1-4c97-bc28-c49392694bb7"}, {"name": "network-changed", "server_uuid": "2d2e5f9c-c00d-46b1-b55c-b2bda4428946", "tag": "7b107fe2-9d03-469a-b39d-9bb9814ca01a"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:39.275176 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-b9d56907-4de0-4ec1-8f38-0029823e58d8 req-1f6a136b-b503-43e7-92ea-f8c5aa287746 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:39.275916 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-b9d56907-4de0-4ec1-8f38-0029823e58d8 req-1f6a136b-b503-43e7-92ea-f8c5aa287746 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:39.307255 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-b9d56907-4de0-4ec1-8f38-0029823e58d8 req-1f6a136b-b503-43e7-92ea-f8c5aa287746 service nova] Creating event network-changed:88be3f31-89a1-4c97-bc28-c49392694bb7 for instance 35b3ee83-f946-4c4c-bff9-80b8bd368788 on n-h1-846466-12 Aug 04 16:35:39.308076 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-b9d56907-4de0-4ec1-8f38-0029823e58d8 req-1f6a136b-b503-43e7-92ea-f8c5aa287746 service nova] Creating event network-changed:7b107fe2-9d03-469a-b39d-9bb9814ca01a for instance 2d2e5f9c-c00d-46b1-b55c-b2bda4428946 on n-h2-846466-12 Aug 04 16:35:39.319281 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-b9d56907-4de0-4ec1-8f38-0029823e58d8 req-1f6a136b-b503-43e7-92ea-f8c5aa287746 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.109343 Aug 04 16:35:39.320263 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 424/823] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:35:39.327741 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0e612031-8e59-4739-b621-5d0f9a61e2ca tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Action: 'action', calling method: .version_select at 0x7f7e878630d0>, body: {"removeFloatingIp": {"address": "172.25.6.68"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:39.732828 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0e612031-8e59-4739-b621-5d0f9a61e2ca tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 2d2e5f9c-c00d-46b1-b55c-b2bda4428946] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:39.743619 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0e612031-8e59-4739-b621-5d0f9a61e2ca tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:39.744261 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0e612031-8e59-4739-b621-5d0f9a61e2ca tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:39.745183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0e612031-8e59-4739-b621-5d0f9a61e2ca tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:39.745681 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0e612031-8e59-4739-b621-5d0f9a61e2ca tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:39.769926 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8b2008d5-5227-48a6-bdec-8cb23fd310ed tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:39.780391 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8b2008d5-5227-48a6-bdec-8cb23fd310ed tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1469 microversion: 2.1 time: 0.769155 Aug 04 16:35:39.787387 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 400/824] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:39 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1469 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:39.792873 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b1a2eaf6-acfc-49c8-9e90-d0f48d6ee0b4 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:39.841340 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b1a2eaf6-acfc-49c8-9e90-d0f48d6ee0b4 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050793 Aug 04 16:35:39.843142 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 401/825] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:35:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:39.849066 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-926d79b1-139b-44b1-b90f-d7d0b330994f tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Calling method '.version_select at 0x7f7e85016160>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:40.424938 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-0e612031-8e59-4739-b621-5d0f9a61e2ca tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] HTTP exception thrown: Floating IP 172.25.6.68 is not associated with instance 35b3ee83-f946-4c4c-bff9-80b8bd368788. Aug 04 16:35:40.427436 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0e612031-8e59-4739-b621-5d0f9a61e2ca tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Request method failure captured: Aug 04 16:35:40.427436 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788/action HTTP/1.1 Aug 04 16:35:40.427436 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:35:40.427436 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:35:40.427436 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:35:40.427436 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 48 Aug 04 16:35:40.427436 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:35:40.427436 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:35:40.427436 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:35:40.427436 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:35:40.427436 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_UW_vmQLiuSt0eBCsEw9pRigB8Wp3k1tvQoUkUoSlkWWcI-0jGNt8uWyhkyi--vPz_SJm7uiN9TnHnRdRK97zZDM9tscOMEONyE5nyr_gaZe-LmoYakXKibUwT2cmNooZz8oMxbh1NoUWWNUGNYU8ByOSpYG8GK3MkeyckBIMZl3rw Aug 04 16:35:40.427436 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:35:40.427436 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:35:40.427436 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:35:40.427436 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:35:40.427436 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:35:40.427436 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:35:40.427436 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 25f22de02d3e4db281f6372e8191b95f Aug 04 16:35:40.427436 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-910288468 Aug 04 16:35:40.427436 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:35:40.427436 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:35:40.429198 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25f22de02d3e4db281f6372e8191b95f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_25f22de02d3e4db281f6372e8191b95f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25f22de02d3e4db281f6372e8191b95f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/25f22de02d3e4db281f6372e8191b95f"}]}] Aug 04 16:35:40.429198 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-910288468 Aug 04 16:35:40.429198 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 25f22de02d3e4db281f6372e8191b95f Aug 04 16:35:40.429198 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-910288468 Aug 04 16:35:40.429198 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-FloatingIPsAssociationTestJSON-910288468-project Aug 04 16:35:40.429198 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:35:40.429198 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:35:40.429198 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: b4a732f446814c9fa080979bef241023 Aug 04 16:35:40.429198 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-910288468-project Aug 04 16:35:40.429198 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:35:40.429198 n-d-846466-12 devstack@n-api.service[126125]: {"removeFloatingIp": {"address": "172.25.6.68"}} Aug 04 16:35:40.429198 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:35:40.429198 n-d-846466-12 devstack@n-api.service[126125]: exception: Floating IP 172.25.6.68 is not associated with instance 35b3ee83-f946-4c4c-bff9-80b8bd368788. Aug 04 16:35:40.430639 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '35b3ee83-f946-4c4c-bff9-80b8bd368788', 'body': {'removeFloatingIp': {'address': '172.25.6.68'}}} Aug 04 16:35:40.430639 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:35:40.430639 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:40.430639 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:40.430639 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:40.430639 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:35:40.430639 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:35:40.430639 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:35:40.430639 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:35:40.430639 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:35:40.430639 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:35:40.430639 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:35:40.430639 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:35:40.430639 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 04 16:35:40.430639 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 16:35:40.430639 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.6.68 is not associated with instance 35b3ee83-f946-4c4c-bff9-80b8bd368788. Aug 04 16:35:40.430639 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:40.430639 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:40.430639 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:40.430639 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:40.432085 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:40.432085 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:40.432085 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:35:40.432085 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:35:40.432085 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.6.68 is not associated with instance 35b3ee83-f946-4c4c-bff9-80b8bd368788. Aug 04 16:35:40.432085 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:40.432085 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0e612031-8e59-4739-b621-5d0f9a61e2ca tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Returning 409 to user: Floating IP 172.25.6.68 is not associated with instance 35b3ee83-f946-4c4c-bff9-80b8bd368788. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:35:40.432085 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0e612031-8e59-4739-b621-5d0f9a61e2ca tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "POST /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788/action" status: 409 len: 145 microversion: 2.1 time: 1.107377 Aug 04 16:35:40.432085 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 425/826] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:35:39 2022] POST /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788/action => generated 145 bytes in 1109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:35:40.440729 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d1bbc023-1808-45d1-82d5-360f887bd429 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:40.441398 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d1bbc023-1808-45d1-82d5-360f887bd429 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 6017510a-e331-424a-843d-54b980b999fb] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:40.451026 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d1bbc023-1808-45d1-82d5-360f887bd429 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:40.456359 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d1bbc023-1808-45d1-82d5-360f887bd429 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:40.457806 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d1bbc023-1808-45d1-82d5-360f887bd429 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:40.459961 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d1bbc023-1808-45d1-82d5-360f887bd429 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:40.548951 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-926d79b1-139b-44b1-b90f-d7d0b330994f tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/460b886d-4e4f-4691-ab1c-9f2cff15147b" status: 202 len: 0 microversion: 2.1 time: 0.704209 Aug 04 16:35:40.549578 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 402/827] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:35:39 2022] DELETE /compute/v2.1/os-security-groups/460b886d-4e4f-4691-ab1c-9f2cff15147b => generated 0 bytes in 706 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:35:40.554503 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-461b9a4d-f6a9-436f-819c-9b9aea9d41ab tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:40.555274 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-461b9a4d-f6a9-436f-819c-9b9aea9d41ab tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:40.574610 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-461b9a4d-f6a9-436f-819c-9b9aea9d41ab tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:40.575162 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-461b9a4d-f6a9-436f-819c-9b9aea9d41ab tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:40.575864 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-461b9a4d-f6a9-436f-819c-9b9aea9d41ab tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:40.576300 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-461b9a4d-f6a9-436f-819c-9b9aea9d41ab tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:40.760776 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-461b9a4d-f6a9-436f-819c-9b9aea9d41ab tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lazy-loading 'services' on Instance uuid effb9df8-4005-4b3b-a58e-41b5ba36b5c5 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:35:40.783469 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-461b9a4d-f6a9-436f-819c-9b9aea9d41ab tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1929 microversion: 2.75 time: 0.232431 Aug 04 16:35:40.783959 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 403/828] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:40 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1929 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:40.789513 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-8b86e68a-c625-417d-8d87-39d5890ab5c0 req-a9e41b1f-d06c-4265-b6c3-58afd2b7dc66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a33abce-4d0a-4919-94db-28cea706d412", "name": "network-vif-plugged", "status": "completed", "tag": "e1d80942-af44-4bef-a238-f9fca1aa7ddf"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:40.803701 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-8b86e68a-c625-417d-8d87-39d5890ab5c0 req-a9e41b1f-d06c-4265-b6c3-58afd2b7dc66 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:40.804754 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-8b86e68a-c625-417d-8d87-39d5890ab5c0 req-a9e41b1f-d06c-4265-b6c3-58afd2b7dc66 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:40.822817 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-8b86e68a-c625-417d-8d87-39d5890ab5c0 req-a9e41b1f-d06c-4265-b6c3-58afd2b7dc66 service nova] Creating event network-vif-plugged:e1d80942-af44-4bef-a238-f9fca1aa7ddf for instance 5a33abce-4d0a-4919-94db-28cea706d412 on n-h2-846466-12 Aug 04 16:35:40.836188 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [req-8b86e68a-c625-417d-8d87-39d5890ab5c0 req-a9e41b1f-d06c-4265-b6c3-58afd2b7dc66 service nova] Instance 5a33abce-4d0a-4919-94db-28cea706d412 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126126) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 16:35:40.853824 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-8b86e68a-c625-417d-8d87-39d5890ab5c0 req-a9e41b1f-d06c-4265-b6c3-58afd2b7dc66 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068059 Aug 04 16:35:40.859463 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 404/829] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:35:40.867177 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f377f886-b0ac-4c9c-b3a1-a0f3c0588299 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:40.868199 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f377f886-b0ac-4c9c-b3a1-a0f3c0588299 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] [instance: 2503f8ac-e7f9-432d-8b3b-271d1a179572] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:40.881360 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f377f886-b0ac-4c9c-b3a1-a0f3c0588299 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:40.882745 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f377f886-b0ac-4c9c-b3a1-a0f3c0588299 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:40.883919 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f377f886-b0ac-4c9c-b3a1-a0f3c0588299 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:40.884529 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f377f886-b0ac-4c9c-b3a1-a0f3c0588299 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:41.065912 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d1bbc023-1808-45d1-82d5-360f887bd429 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:41.078203 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d1bbc023-1808-45d1-82d5-360f887bd429 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:41.087256 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d1bbc023-1808-45d1-82d5-360f887bd429 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:41.088439 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d1bbc023-1808-45d1-82d5-360f887bd429 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb" status: 200 len: 1361 microversion: 2.25 time: 0.657884 Aug 04 16:35:41.089173 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 426/830] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:40 2022] GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb => generated 1361 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:41.113079 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bc33b50d-8651-486d-805c-fc912114fb60 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2043703451", "id": 873955349, "os-flavor-access:is_public": "True"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:41.128723 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:35:41.128723 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:35:41.143764 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f377f886-b0ac-4c9c-b3a1-a0f3c0588299 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5f11c99c841c4a7e7af4d7a4a5d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa4a23e6e71405f82347cd1cbbe3f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:41.156136 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bc33b50d-8651-486d-805c-fc912114fb60 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.049013 Aug 04 16:35:41.158030 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 427/831] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:35:41 2022] POST /compute/v2.1/flavors => generated 435 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:35:41.164842 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f377f886-b0ac-4c9c-b3a1-a0f3c0588299 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] 10.222.0.23 "GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572" status: 200 len: 1303 microversion: 2.1 time: 0.302992 Aug 04 16:35:41.165871 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 405/832] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:40 2022] GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572 => generated 1303 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:41.170583 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-21b77818-32dd-4742-8e63-289fc61db836 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.68"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:41.176616 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e6787c08-d28a-48a6-a91b-37e3690acc2b tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] Calling method '.version_select at 0x7f7e850aa310>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:41.430374 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-21b77818-32dd-4742-8e63-289fc61db836 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 2d2e5f9c-c00d-46b1-b55c-b2bda4428946] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:41.437782 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-21b77818-32dd-4742-8e63-289fc61db836 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:41.438914 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-21b77818-32dd-4742-8e63-289fc61db836 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:41.439789 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-21b77818-32dd-4742-8e63-289fc61db836 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:41.442501 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-21b77818-32dd-4742-8e63-289fc61db836 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:41.750179 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e6787c08-d28a-48a6-a91b-37e3690acc2b tempest-SecurityGroupRulesNegativeTestJSON-1094474337 tempest-SecurityGroupRulesNegativeTestJSON-1094474337-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/cdc4f91d-fc99-475d-b32b-f68c7631f3ed" status: 202 len: 0 microversion: 2.1 time: 0.583072 Aug 04 16:35:41.751029 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 406/833] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:35:41 2022] DELETE /compute/v2.1/os-security-groups/cdc4f91d-fc99-475d-b32b-f68c7631f3ed => generated 0 bytes in 585 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:35:41.756280 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-90506850-3760-4737-bc98-05d32b3e515f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:41.757115 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-90506850-3760-4737-bc98-05d32b3e515f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:41.775318 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-90506850-3760-4737-bc98-05d32b3e515f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:41.776052 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-90506850-3760-4737-bc98-05d32b3e515f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:41.776989 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-90506850-3760-4737-bc98-05d32b3e515f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:41.777623 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-90506850-3760-4737-bc98-05d32b3e515f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:41.823391 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=3,nova_cell1:RELEASE=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:35:41.945955 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-21b77818-32dd-4742-8e63-289fc61db836 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Acquired lock "refresh_cache-2d2e5f9c-c00d-46b1-b55c-b2bda4428946" {{(pid=126125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 16:35:42.159882 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-90506850-3760-4737-bc98-05d32b3e515f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:42.170426 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-90506850-3760-4737-bc98-05d32b3e515f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1469 microversion: 2.1 time: 0.418190 Aug 04 16:35:42.174061 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 407/834] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:41 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1469 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:42.184889 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b8d6d2af-2e04-46bb-b727-bb33de21c883 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:42.189171 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:35:42.189171 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:35:42.204560 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-b8d6d2af-2e04-46bb-b727-bb33de21c883 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 04 16:35:42.205039 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b8d6d2af-2e04-46bb-b727-bb33de21c883 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] Request method failure captured: Aug 04 16:35:42.205039 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/flavors/873955349/os-flavor-access HTTP/1.1 Aug 04 16:35:42.205039 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:35:42.205039 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:35:42.205039 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:35:42.205039 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:35:42.205039 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:35:42.205039 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:35:42.205039 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:35:42.205039 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:35:42.205039 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_VRfJ6Ed0F3TJwmIBt35GFrAAkEEf_dhjKN8sIGDUK4LxhZtwNXrjznF7xCdLfdgFUPdCykmskFYalbsr-WLPYWUyT93FDgtCANk97uS0PuMDuVq9Izkm7I9stEECx85bvuae_Vqy9arGHjuIxtdH8aemplnTNoEL39wjspDF3ylBg Aug 04 16:35:42.205039 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:35:42.205039 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:35:42.205039 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:35:42.205039 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:35:42.205039 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:35:42.205039 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:35:42.205039 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 3c8b2fe0abd34a8ea766e5df55f8efd0 Aug 04 16:35:42.205039 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-958940071 Aug 04 16:35:42.205039 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader,admin Aug 04 16:35:42.205039 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader,admin Aug 04 16:35:42.207135 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c8b2fe0abd34a8ea766e5df55f8efd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3c8b2fe0abd34a8ea766e5df55f8efd0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c8b2fe0abd34a8ea766e5df55f8efd0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3c8b2fe0abd34a8ea766e5df55f8efd0"}]}] Aug 04 16:35:42.207135 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-958940071 Aug 04 16:35:42.207135 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 3c8b2fe0abd34a8ea766e5df55f8efd0 Aug 04 16:35:42.207135 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-958940071 Aug 04 16:35:42.207135 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin Aug 04 16:35:42.207135 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:35:42.207135 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:35:42.207135 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 402db49c379f4792a5c74af8181f0721 Aug 04 16:35:42.207135 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin Aug 04 16:35:42.207135 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:35:42.207135 n-d-846466-12 devstack@n-api.service[126126]: exception: Access list not available for public flavors. Aug 04 16:35:42.207135 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'flavor_id': '873955349'} Aug 04 16:35:42.208144 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:35:42.208144 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:42.208144 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:42.208144 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:42.208144 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:35:42.208144 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:35:42.208144 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:35:42.208144 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:35:42.208144 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 04 16:35:42.208144 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 16:35:42.208144 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 04 16:35:42.208144 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:35:42.208144 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:42.208144 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:35:42.208144 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:42.208144 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:42.208144 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:42.208144 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:35:42.208144 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:35:42.208144 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 04 16:35:42.208144 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:35:42.215236 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b8d6d2af-2e04-46bb-b727-bb33de21c883 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:35:42.215236 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b8d6d2af-2e04-46bb-b727-bb33de21c883 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/873955349/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.036016 Aug 04 16:35:42.215236 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 408/835] 10.222.0.23 () {58 vars in 1206 bytes} [Thu Aug 4 16:35:42 2022] GET /compute/v2.1/flavors/873955349/os-flavor-access => generated 91 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:35:42.225526 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-15e7e672-3883-4244-a4b7-1b6323c4cc11 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1916660570", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "b9488b95-3e40-4213-8fe1-ea17248f446a"}], "security_groups": [{"name": "tempest-securitygroup--2071296569"}], "key_name": "tempest-keypair-249141778", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:42.506836 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-15e7e672-3883-4244-a4b7-1b6323c4cc11 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] validate_networks() for [('b9488b95-3e40-4213-8fe1-ea17248f446a', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:35:43.731047 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-21b77818-32dd-4742-8e63-289fc61db836 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 2d2e5f9c-c00d-46b1-b55c-b2bda4428946] Building network info cache for instance {{(pid=126125) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 16:35:43.851643 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-15e7e672-3883-4244-a4b7-1b6323c4cc11 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:35:43.852707 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-15e7e672-3883-4244-a4b7-1b6323c4cc11 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:35:43.853376 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-15e7e672-3883-4244-a4b7-1b6323c4cc11 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:35:43.854723 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-15e7e672-3883-4244-a4b7-1b6323c4cc11 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:35:43.855297 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-15e7e672-3883-4244-a4b7-1b6323c4cc11 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:35:43.876608 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-15e7e672-3883-4244-a4b7-1b6323c4cc11 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:43.877503 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-15e7e672-3883-4244-a4b7-1b6323c4cc11 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:43.878912 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-15e7e672-3883-4244-a4b7-1b6323c4cc11 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:43.879585 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-15e7e672-3883-4244-a4b7-1b6323c4cc11 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:43.919481 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-15e7e672-3883-4244-a4b7-1b6323c4cc11 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Getting quotas for project 82b3a898ed4b4e0a82ae35830cb00ca9. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:35:43.937620 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-15e7e672-3883-4244-a4b7-1b6323c4cc11 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Getting quotas for user 51b742cff6a948d0883501917706f66e and project 82b3a898ed4b4e0a82ae35830cb00ca9. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:35:43.988894 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-15e7e672-3883-4244-a4b7-1b6323c4cc11 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:35:43.991798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-15e7e672-3883-4244-a4b7-1b6323c4cc11 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:35:44.127573 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-15e7e672-3883-4244-a4b7-1b6323c4cc11 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.915084 Aug 04 16:35:44.133898 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 409/836] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:35:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 1916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:35:44.133898 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b150739e-4acb-40eb-9377-4478492a46eb tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:44.146102 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b150739e-4acb-40eb-9377-4478492a46eb tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:44.181268 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b150739e-4acb-40eb-9377-4478492a46eb tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:44.181970 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b150739e-4acb-40eb-9377-4478492a46eb tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:44.182929 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b150739e-4acb-40eb-9377-4478492a46eb tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:44.183384 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b150739e-4acb-40eb-9377-4478492a46eb tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:44.468242 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-b150739e-4acb-40eb-9377-4478492a46eb tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lazy-loading 'services' on Instance uuid effb9df8-4005-4b3b-a58e-41b5ba36b5c5 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:35:44.511870 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b150739e-4acb-40eb-9377-4478492a46eb tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1929 microversion: 2.75 time: 0.382109 Aug 04 16:35:44.512467 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 410/837] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:44 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1929 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:44.527772 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-db5032aa-35f4-43a0-a5b6-14a99b963f33 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:44.529150 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-db5032aa-35f4-43a0-a5b6-14a99b963f33 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 6017510a-e331-424a-843d-54b980b999fb] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:44.538498 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db5032aa-35f4-43a0-a5b6-14a99b963f33 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:44.538498 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db5032aa-35f4-43a0-a5b6-14a99b963f33 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:44.549197 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db5032aa-35f4-43a0-a5b6-14a99b963f33 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:44.549898 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db5032aa-35f4-43a0-a5b6-14a99b963f33 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:45.028631 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-db5032aa-35f4-43a0-a5b6-14a99b963f33 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:45.052087 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-db5032aa-35f4-43a0-a5b6-14a99b963f33 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:45.054436 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-db5032aa-35f4-43a0-a5b6-14a99b963f33 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:45.055770 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-db5032aa-35f4-43a0-a5b6-14a99b963f33 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb" status: 200 len: 1361 microversion: 2.25 time: 0.541273 Aug 04 16:35:45.069305 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 411/838] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:44 2022] GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb => generated 1361 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:45.069305 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-130ddef5-5f8a-4519-9d99-d0fb70a452c1 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:45.069305 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-130ddef5-5f8a-4519-9d99-d0fb70a452c1 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] [instance: 2503f8ac-e7f9-432d-8b3b-271d1a179572] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:45.077163 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-130ddef5-5f8a-4519-9d99-d0fb70a452c1 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:45.077617 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-130ddef5-5f8a-4519-9d99-d0fb70a452c1 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:45.078816 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-130ddef5-5f8a-4519-9d99-d0fb70a452c1 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:45.097577 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-130ddef5-5f8a-4519-9d99-d0fb70a452c1 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:45.153503 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-21b77818-32dd-4742-8e63-289fc61db836 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 2d2e5f9c-c00d-46b1-b55c-b2bda4428946] Updating instance_info_cache with network_info: [{"id": "7b107fe2-9d03-469a-b39d-9bb9814ca01a", "address": "fa:16:3e:4d:21:18", "network": {"id": "ce185855-ad88-40d0-ad8d-f7db4d7f58b9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1029059546-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "25f22de02d3e4db281f6372e8191b95f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7b107fe2-9d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126125) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 16:35:45.177772 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-21b77818-32dd-4742-8e63-289fc61db836 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Releasing lock "refresh_cache-2d2e5f9c-c00d-46b1-b55c-b2bda4428946" {{(pid=126125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 16:35:45.179119 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-21b77818-32dd-4742-8e63-289fc61db836 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "POST /compute/v2.1/servers/2d2e5f9c-c00d-46b1-b55c-b2bda4428946/action" status: 202 len: 0 microversion: 2.1 time: 4.019919 Aug 04 16:35:45.179967 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 428/839] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:35:41 2022] POST /compute/v2.1/servers/2d2e5f9c-c00d-46b1-b55c-b2bda4428946/action => generated 0 bytes in 4021 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 04 16:35:45.185727 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-56b7097c-bfdb-4404-93fa-95b8cee4c81c tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:45.187040 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:35:45.187040 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:35:45.231947 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-56b7097c-bfdb-4404-93fa-95b8cee4c81c tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/873955349" status: 202 len: 0 microversion: 2.1 time: 0.050501 Aug 04 16:35:45.233266 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 429/840] 10.222.0.23 () {58 vars in 1158 bytes} [Thu Aug 4 16:35:45 2022] DELETE /compute/v2.1/flavors/873955349 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:35:45.240084 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d475f9e7-c3d2-4aa5-8688-3fe74daf40a7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:45.245015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d475f9e7-c3d2-4aa5-8688-3fe74daf40a7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:45.248991 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:DELETE=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:35:45.263399 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d475f9e7-c3d2-4aa5-8688-3fe74daf40a7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:45.266829 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d475f9e7-c3d2-4aa5-8688-3fe74daf40a7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:45.267930 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d475f9e7-c3d2-4aa5-8688-3fe74daf40a7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:45.268635 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d475f9e7-c3d2-4aa5-8688-3fe74daf40a7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:45.313129 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-130ddef5-5f8a-4519-9d99-d0fb70a452c1 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5f11c99c841c4a7e7af4d7a4a5d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa4a23e6e71405f82347cd1cbbe3f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:45.328708 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-130ddef5-5f8a-4519-9d99-d0fb70a452c1 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] 10.222.0.23 "GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572" status: 200 len: 1303 microversion: 2.1 time: 0.270737 Aug 04 16:35:45.329673 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 412/841] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:45 2022] GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572 => generated 1303 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:45.346863 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-18902999-ae57-4e0c-932a-d7969cdaae20 req-b1f2c6b4-5f38-4aaf-b5ce-9bfb4e06e832 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d2e5f9c-c00d-46b1-b55c-b2bda4428946", "tag": "7b107fe2-9d03-469a-b39d-9bb9814ca01a"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:45.408760 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-18902999-ae57-4e0c-932a-d7969cdaae20 req-b1f2c6b4-5f38-4aaf-b5ce-9bfb4e06e832 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:45.424868 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-18902999-ae57-4e0c-932a-d7969cdaae20 req-b1f2c6b4-5f38-4aaf-b5ce-9bfb4e06e832 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:45.469477 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-18902999-ae57-4e0c-932a-d7969cdaae20 req-b1f2c6b4-5f38-4aaf-b5ce-9bfb4e06e832 service nova] Creating event network-changed:7b107fe2-9d03-469a-b39d-9bb9814ca01a for instance 2d2e5f9c-c00d-46b1-b55c-b2bda4428946 on n-h2-846466-12 Aug 04 16:35:45.481815 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-18902999-ae57-4e0c-932a-d7969cdaae20 req-b1f2c6b4-5f38-4aaf-b5ce-9bfb4e06e832 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143856 Aug 04 16:35:45.487217 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 413/842] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:35:45.503577 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-64c3af2f-817a-44dd-9bb4-c5f51155b27d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:45.505846 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-64c3af2f-817a-44dd-9bb4-c5f51155b27d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:45.525258 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-64c3af2f-817a-44dd-9bb4-c5f51155b27d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:45.527677 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-64c3af2f-817a-44dd-9bb4-c5f51155b27d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:45.529836 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-64c3af2f-817a-44dd-9bb4-c5f51155b27d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:45.533072 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-64c3af2f-817a-44dd-9bb4-c5f51155b27d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:46.009831 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-64c3af2f-817a-44dd-9bb4-c5f51155b27d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:46.034569 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-64c3af2f-817a-44dd-9bb4-c5f51155b27d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159" status: 200 len: 1238 microversion: 2.1 time: 0.541558 Aug 04 16:35:46.059320 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 414/843] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:45 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159 => generated 1238 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:46.073197 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-164702f9-b73e-4bce-ad0b-af2fd475a52b tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:46.076766 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-164702f9-b73e-4bce-ad0b-af2fd475a52b tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 2d2e5f9c-c00d-46b1-b55c-b2bda4428946] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:46.108580 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-164702f9-b73e-4bce-ad0b-af2fd475a52b tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:46.110571 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-164702f9-b73e-4bce-ad0b-af2fd475a52b tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:46.113884 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-164702f9-b73e-4bce-ad0b-af2fd475a52b tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:46.117426 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-164702f9-b73e-4bce-ad0b-af2fd475a52b tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:46.186599 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-164702f9-b73e-4bce-ad0b-af2fd475a52b tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 2d2e5f9c-c00d-46b1-b55c-b2bda4428946] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:35:46.216646 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:35:46.239568 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:35:46.337200 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-164702f9-b73e-4bce-ad0b-af2fd475a52b tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2d2e5f9c-c00d-46b1-b55c-b2bda4428946" status: 204 len: 0 microversion: 2.1 time: 0.275341 Aug 04 16:35:46.342581 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 415/844] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:35:46 2022] DELETE /compute/v2.1/servers/2d2e5f9c-c00d-46b1-b55c-b2bda4428946 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:35:46.352251 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0810c4e0-e387-46ca-850a-f002b15531f6 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:46.421854 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0810c4e0-e387-46ca-850a-f002b15531f6 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.081524 Aug 04 16:35:46.423538 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d475f9e7-c3d2-4aa5-8688-3fe74daf40a7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:46.444183 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 416/845] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:35:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:46.444727 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d475f9e7-c3d2-4aa5-8688-3fe74daf40a7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1469 microversion: 2.1 time: 1.208058 Aug 04 16:35:46.445841 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 430/846] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:45 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1469 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:46.461033 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4c0ad6b8-8f4b-47bc-a96a-d3d1329357f2 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:46.462112 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cfad0983-0ae7-4bb4-8d5b-44e5ec72a099 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:46.463038 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cfad0983-0ae7-4bb4-8d5b-44e5ec72a099 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 6017510a-e331-424a-843d-54b980b999fb] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:46.463314 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4c0ad6b8-8f4b-47bc-a96a-d3d1329357f2 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:46.470239 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4c0ad6b8-8f4b-47bc-a96a-d3d1329357f2 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:46.470655 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4c0ad6b8-8f4b-47bc-a96a-d3d1329357f2 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:46.471445 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4c0ad6b8-8f4b-47bc-a96a-d3d1329357f2 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:46.471882 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4c0ad6b8-8f4b-47bc-a96a-d3d1329357f2 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:46.480641 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cfad0983-0ae7-4bb4-8d5b-44e5ec72a099 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:46.481525 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cfad0983-0ae7-4bb4-8d5b-44e5ec72a099 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:46.489986 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cfad0983-0ae7-4bb4-8d5b-44e5ec72a099 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:46.490964 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cfad0983-0ae7-4bb4-8d5b-44e5ec72a099 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:46.671528 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-4c0ad6b8-8f4b-47bc-a96a-d3d1329357f2 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lazy-loading 'services' on Instance uuid effb9df8-4005-4b3b-a58e-41b5ba36b5c5 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:35:46.708657 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4c0ad6b8-8f4b-47bc-a96a-d3d1329357f2 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1929 microversion: 2.75 time: 0.263173 Aug 04 16:35:46.712480 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 417/847] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:46 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1929 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:46.717485 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f39d7be9-829d-4349-8e20-28251f5ccc64 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.68"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:46.720094 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f39d7be9-829d-4349-8e20-28251f5ccc64 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 35b3ee83-f946-4c4c-bff9-80b8bd368788] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:46.731592 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f39d7be9-829d-4349-8e20-28251f5ccc64 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:46.732038 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f39d7be9-829d-4349-8e20-28251f5ccc64 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:46.732854 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f39d7be9-829d-4349-8e20-28251f5ccc64 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:46.733310 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f39d7be9-829d-4349-8e20-28251f5ccc64 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:46.820318 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f39d7be9-829d-4349-8e20-28251f5ccc64 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Acquired lock "refresh_cache-35b3ee83-f946-4c4c-bff9-80b8bd368788" {{(pid=126126) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 16:35:46.935998 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cfad0983-0ae7-4bb4-8d5b-44e5ec72a099 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:46.945876 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cfad0983-0ae7-4bb4-8d5b-44e5ec72a099 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:46.947401 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cfad0983-0ae7-4bb4-8d5b-44e5ec72a099 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:46.948775 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cfad0983-0ae7-4bb4-8d5b-44e5ec72a099 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb" status: 200 len: 1556 microversion: 2.25 time: 0.499454 Aug 04 16:35:46.949567 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 431/848] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:46 2022] GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb => generated 1556 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:46.954861 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-14f0058a-0143-4e4a-830a-b72549a5239b tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:46.955863 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-14f0058a-0143-4e4a-830a-b72549a5239b tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] [instance: 2503f8ac-e7f9-432d-8b3b-271d1a179572] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:46.964985 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14f0058a-0143-4e4a-830a-b72549a5239b tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:46.965687 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14f0058a-0143-4e4a-830a-b72549a5239b tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:46.966757 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14f0058a-0143-4e4a-830a-b72549a5239b tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:46.967243 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14f0058a-0143-4e4a-830a-b72549a5239b tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:47.094660 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-14f0058a-0143-4e4a-830a-b72549a5239b tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5f11c99c841c4a7e7af4d7a4a5d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa4a23e6e71405f82347cd1cbbe3f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:47.107873 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-14f0058a-0143-4e4a-830a-b72549a5239b tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] 10.222.0.23 "GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572" status: 200 len: 1303 microversion: 2.1 time: 0.156533 Aug 04 16:35:47.110589 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 432/849] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:46 2022] GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572 => generated 1303 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:47.118583 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5c9ad851-6ef9-42d6-825f-51814f0468b9 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1660975907", "id": 2078211021, "os-flavor-access:is_public": "False"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:47.122511 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:35:47.122511 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:35:47.147453 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5c9ad851-6ef9-42d6-825f-51814f0468b9 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.034628 Aug 04 16:35:47.148655 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 433/850] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:35:47 2022] POST /compute/v2.1/flavors => generated 439 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:35:47.153927 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3daa02b5-6806-4e26-858a-06c81d222f0f tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:47.155373 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3daa02b5-6806-4e26-858a-06c81d222f0f tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] [instance: 6017510a-e331-424a-843d-54b980b999fb] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:47.164710 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3daa02b5-6806-4e26-858a-06c81d222f0f tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:47.165173 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3daa02b5-6806-4e26-858a-06c81d222f0f tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:47.166258 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3daa02b5-6806-4e26-858a-06c81d222f0f tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:47.166756 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3daa02b5-6806-4e26-858a-06c81d222f0f tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:48.158312 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-3daa02b5-6806-4e26-858a-06c81d222f0f tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lazy-loading 'services' on Instance uuid 6017510a-e331-424a-843d-54b980b999fb {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:35:48.204147 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3daa02b5-6806-4e26-858a-06c81d222f0f tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb" status: 200 len: 2050 microversion: 2.25 time: 1.054154 Aug 04 16:35:48.205766 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 434/851] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:47 2022] GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb => generated 2050 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:48.214002 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bbed3889-a5bd-436e-be2e-52bb6e603e84 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:48.215655 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bbed3889-a5bd-436e-be2e-52bb6e603e84 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:48.223773 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bbed3889-a5bd-436e-be2e-52bb6e603e84 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:48.224224 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bbed3889-a5bd-436e-be2e-52bb6e603e84 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:48.227586 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bbed3889-a5bd-436e-be2e-52bb6e603e84 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:48.228215 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bbed3889-a5bd-436e-be2e-52bb6e603e84 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:48.750669 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bbed3889-a5bd-436e-be2e-52bb6e603e84 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:48.770221 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bbed3889-a5bd-436e-be2e-52bb6e603e84 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159" status: 200 len: 1292 microversion: 2.1 time: 0.561776 Aug 04 16:35:48.771259 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 435/852] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:48 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159 => generated 1292 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:49.089062 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-78410d3f-ecc6-4621-a061-f6c395287d35 tempest-FlavorsAccessNegativeTestJSON-257011144 tempest-FlavorsAccessNegativeTestJSON-257011144-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f9a357362d2743aaafc5e3c57512c311"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:49.093795 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:35:49.093795 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:35:49.097100 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-78410d3f-ecc6-4621-a061-f6c395287d35 tempest-FlavorsAccessNegativeTestJSON-257011144 tempest-FlavorsAccessNegativeTestJSON-257011144-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '1287fec0e2ae4abab37dd336f4e22d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a357362d2743aaafc5e3c57512c311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:49.099724 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-78410d3f-ecc6-4621-a061-f6c395287d35 tempest-FlavorsAccessNegativeTestJSON-257011144 tempest-FlavorsAccessNegativeTestJSON-257011144-project] Request method failure captured: Aug 04 16:35:49.099724 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/flavors/2078211021/action HTTP/1.1 Aug 04 16:35:49.099724 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:35:49.099724 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:35:49.099724 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:35:49.099724 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 67 Aug 04 16:35:49.099724 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:35:49.099724 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:35:49.099724 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:35:49.099724 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:35:49.099724 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_VQbyMdaQd0hQfbo9U6xK8M2a4YLZ0Ip6Tf6ox1x9BhhxeVbs_Mw0ujwt97mdUVozVhKa_wvsFVnz0NAdjmoyzw2jfQy-oZZzKPD38vFAzwH4cyyLy4zge2kyDTnUsn7akyMHQJPGUTujwssCeDaWJ2hs_F0CjtaYlBYIAzPph7tew Aug 04 16:35:49.099724 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:35:49.099724 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:35:49.099724 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:35:49.099724 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:35:49.099724 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:35:49.099724 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:35:49.099724 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: f9a357362d2743aaafc5e3c57512c311 Aug 04 16:35:49.099724 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-257011144 Aug 04 16:35:49.099724 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:35:49.099724 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:35:49.101147 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f9a357362d2743aaafc5e3c57512c311"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f9a357362d2743aaafc5e3c57512c311"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f9a357362d2743aaafc5e3c57512c311"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f9a357362d2743aaafc5e3c57512c311"}]}] Aug 04 16:35:49.101147 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-257011144 Aug 04 16:35:49.101147 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: f9a357362d2743aaafc5e3c57512c311 Aug 04 16:35:49.101147 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-257011144 Aug 04 16:35:49.101147 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-FlavorsAccessNegativeTestJSON-257011144-project Aug 04 16:35:49.101147 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:35:49.101147 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:35:49.101147 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 1287fec0e2ae4abab37dd336f4e22d41 Aug 04 16:35:49.101147 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-257011144-project Aug 04 16:35:49.101147 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:35:49.101147 n-d-846466-12 devstack@n-api.service[126125]: {"addTenantAccess": {"tenant": "f9a357362d2743aaafc5e3c57512c311"}} Aug 04 16:35:49.101147 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:35:49.101978 n-d-846466-12 devstack@n-api.service[126125]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 04 16:35:49.101978 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '2078211021', 'body': {'addTenantAccess': {'tenant': 'f9a357362d2743aaafc5e3c57512c311'}}} Aug 04 16:35:49.101978 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:35:49.101978 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:49.101978 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:49.101978 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:49.101978 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:35:49.101978 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:35:49.101978 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:35:49.101978 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:35:49.101978 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:35:49.101978 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:35:49.101978 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 04 16:35:49.101978 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 04 16:35:49.101978 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:35:49.101978 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:35:49.101978 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:35:49.101978 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:35:49.101978 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:35:49.103247 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:35:49.103247 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:35:49.103247 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:35:49.103247 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:35:49.103247 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:35:49.103247 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:35:49.103247 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:35:49.103247 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:35:49.103247 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:35:49.103247 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 04 16:35:49.103247 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:49.103247 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:49.103247 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:49.103247 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:49.103247 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:49.103247 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:49.103247 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:35:49.103247 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:35:49.103247 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 04 16:35:49.103247 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:49.108146 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-78410d3f-ecc6-4621-a061-f6c395287d35 tempest-FlavorsAccessNegativeTestJSON-257011144 tempest-FlavorsAccessNegativeTestJSON-257011144-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:35:49.110108 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-78410d3f-ecc6-4621-a061-f6c395287d35 tempest-FlavorsAccessNegativeTestJSON-257011144 tempest-FlavorsAccessNegativeTestJSON-257011144-project] 10.222.0.23 "POST /compute/v2.1/flavors/2078211021/action" status: 403 len: 130 microversion: 2.1 time: 0.336972 Aug 04 16:35:49.112378 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 436/853] 10.222.0.23 () {60 vars in 1200 bytes} [Thu Aug 4 16:35:48 2022] POST /compute/v2.1/flavors/2078211021/action => generated 130 bytes in 340 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:35:49.120285 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-23fcaf13-1542-40cf-a79a-028e8e193f5f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:49.121133 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-23fcaf13-1542-40cf-a79a-028e8e193f5f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:49.135575 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-23fcaf13-1542-40cf-a79a-028e8e193f5f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:49.136008 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-23fcaf13-1542-40cf-a79a-028e8e193f5f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:49.137983 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-23fcaf13-1542-40cf-a79a-028e8e193f5f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:49.138602 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-23fcaf13-1542-40cf-a79a-028e8e193f5f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:49.839337 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-23fcaf13-1542-40cf-a79a-028e8e193f5f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:49.856475 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-23fcaf13-1542-40cf-a79a-028e8e193f5f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1469 microversion: 2.1 time: 0.742107 Aug 04 16:35:49.857132 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 437/854] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:49 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1469 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:49.877890 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7d598dcc-5a69-4cb2-a31a-b9b8f277d4e6 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:49.878591 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7d598dcc-5a69-4cb2-a31a-b9b8f277d4e6 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:49.885081 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d598dcc-5a69-4cb2-a31a-b9b8f277d4e6 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:49.885550 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d598dcc-5a69-4cb2-a31a-b9b8f277d4e6 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:49.886605 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d598dcc-5a69-4cb2-a31a-b9b8f277d4e6 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:49.887102 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d598dcc-5a69-4cb2-a31a-b9b8f277d4e6 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:50.133821 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-7d598dcc-5a69-4cb2-a31a-b9b8f277d4e6 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lazy-loading 'services' on Instance uuid effb9df8-4005-4b3b-a58e-41b5ba36b5c5 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:35:50.161841 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7d598dcc-5a69-4cb2-a31a-b9b8f277d4e6 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1929 microversion: 2.75 time: 0.290328 Aug 04 16:35:50.165629 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 438/855] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:49 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1929 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:50.174042 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f9617d53-960d-4e1b-be46-889aafb79e48 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:50.174667 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f9617d53-960d-4e1b-be46-889aafb79e48 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] [instance: 2503f8ac-e7f9-432d-8b3b-271d1a179572] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:50.182266 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9617d53-960d-4e1b-be46-889aafb79e48 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:50.182711 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9617d53-960d-4e1b-be46-889aafb79e48 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:50.183529 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9617d53-960d-4e1b-be46-889aafb79e48 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:50.183964 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9617d53-960d-4e1b-be46-889aafb79e48 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:50.620894 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f9617d53-960d-4e1b-be46-889aafb79e48 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5f11c99c841c4a7e7af4d7a4a5d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa4a23e6e71405f82347cd1cbbe3f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:50.640056 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f9617d53-960d-4e1b-be46-889aafb79e48 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] 10.222.0.23 "GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572" status: 200 len: 1370 microversion: 2.1 time: 0.472524 Aug 04 16:35:50.653318 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 439/856] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:50 2022] GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572 => generated 1370 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:50.653318 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9d797198-214f-449c-b504-68b5abad0ac9 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:50.653318 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9d797198-214f-449c-b504-68b5abad0ac9 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] [instance: 6017510a-e331-424a-843d-54b980b999fb] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:50.658826 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9d797198-214f-449c-b504-68b5abad0ac9 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:50.659251 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9d797198-214f-449c-b504-68b5abad0ac9 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:50.660087 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9d797198-214f-449c-b504-68b5abad0ac9 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:50.660563 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9d797198-214f-449c-b504-68b5abad0ac9 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:51.446303 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-9d797198-214f-449c-b504-68b5abad0ac9 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lazy-loading 'services' on Instance uuid 6017510a-e331-424a-843d-54b980b999fb {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:35:51.470707 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9d797198-214f-449c-b504-68b5abad0ac9 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb" status: 200 len: 2050 microversion: 2.25 time: 0.827729 Aug 04 16:35:51.471357 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 440/857] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:50 2022] GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb => generated 2050 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:51.476010 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cff56ba7-0287-4d2e-81bd-7f347f5874ba tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:51.477039 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:35:51.477039 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:35:51.497642 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cff56ba7-0287-4d2e-81bd-7f347f5874ba tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/2078211021" status: 202 len: 0 microversion: 2.1 time: 0.024938 Aug 04 16:35:51.498879 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 441/858] 10.222.0.23 () {58 vars in 1161 bytes} [Thu Aug 4 16:35:51 2022] DELETE /compute/v2.1/flavors/2078211021 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:35:51.503897 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-d08c9c03-bf20-4b14-8145-0c2806d5f249 req-dba50739-3a3e-4837-9ace-81eec16d55ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b359364c-f234-4d01-9c08-e6df8a21f159", "tag": "490cb30e-cef0-49db-a9ae-179c72d887af"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:51.515186 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-d08c9c03-bf20-4b14-8145-0c2806d5f249 req-dba50739-3a3e-4837-9ace-81eec16d55ac service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:51.516134 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-d08c9c03-bf20-4b14-8145-0c2806d5f249 req-dba50739-3a3e-4837-9ace-81eec16d55ac service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:51.529124 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-d08c9c03-bf20-4b14-8145-0c2806d5f249 req-dba50739-3a3e-4837-9ace-81eec16d55ac service nova] Creating event network-changed:490cb30e-cef0-49db-a9ae-179c72d887af for instance b359364c-f234-4d01-9c08-e6df8a21f159 on n-h1-846466-12 Aug 04 16:35:51.535101 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-d08c9c03-bf20-4b14-8145-0c2806d5f249 req-dba50739-3a3e-4837-9ace-81eec16d55ac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034693 Aug 04 16:35:51.536710 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 442/859] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:35:51.542014 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bb93391a-3ef7-4684-a399-d7378316d1e8 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:51.542959 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bb93391a-3ef7-4684-a399-d7378316d1e8 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:51.551187 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bb93391a-3ef7-4684-a399-d7378316d1e8 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:51.551910 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bb93391a-3ef7-4684-a399-d7378316d1e8 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:51.552856 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bb93391a-3ef7-4684-a399-d7378316d1e8 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:51.553467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bb93391a-3ef7-4684-a399-d7378316d1e8 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:51.575153 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:35:51.949875 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-f39d7be9-829d-4349-8e20-28251f5ccc64 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 35b3ee83-f946-4c4c-bff9-80b8bd368788] Building network info cache for instance {{(pid=126126) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 16:35:52.085170 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bb93391a-3ef7-4684-a399-d7378316d1e8 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:52.096433 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bb93391a-3ef7-4684-a399-d7378316d1e8 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159" status: 200 len: 1360 microversion: 2.1 time: 0.558269 Aug 04 16:35:52.097014 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 443/860] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:51 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159 => generated 1360 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:52.107854 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b38d8817-8b14-46b2-afcc-60a85425ce27 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:52.108457 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b38d8817-8b14-46b2-afcc-60a85425ce27 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:52.114957 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b38d8817-8b14-46b2-afcc-60a85425ce27 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:52.115398 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b38d8817-8b14-46b2-afcc-60a85425ce27 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:52.116178 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b38d8817-8b14-46b2-afcc-60a85425ce27 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:52.116605 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b38d8817-8b14-46b2-afcc-60a85425ce27 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:52.732319 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b38d8817-8b14-46b2-afcc-60a85425ce27 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:52.750674 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b38d8817-8b14-46b2-afcc-60a85425ce27 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1461 microversion: 2.1 time: 0.651772 Aug 04 16:35:52.752212 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 444/861] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:52 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1461 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:52.758887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b6312e56-6ad0-453e-bc12-2cb3765b0ceb tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:52.759784 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b6312e56-6ad0-453e-bc12-2cb3765b0ceb tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:52.773273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b6312e56-6ad0-453e-bc12-2cb3765b0ceb tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:52.776129 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b6312e56-6ad0-453e-bc12-2cb3765b0ceb tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:52.777192 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b6312e56-6ad0-453e-bc12-2cb3765b0ceb tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:52.782866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b6312e56-6ad0-453e-bc12-2cb3765b0ceb tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:52.935628 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-b6312e56-6ad0-453e-bc12-2cb3765b0ceb tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lazy-loading 'services' on Instance uuid effb9df8-4005-4b3b-a58e-41b5ba36b5c5 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:35:52.958043 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b6312e56-6ad0-453e-bc12-2cb3765b0ceb tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1929 microversion: 2.75 time: 0.204397 Aug 04 16:35:52.973906 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 445/862] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:52 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1929 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:52.985945 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-ff9d24b2-57e8-417b-82d0-6821c4d1ac18 req-e8742dff-eaed-4407-bfb6-076c787be227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d2e5f9c-c00d-46b1-b55c-b2bda4428946", "name": "network-vif-deleted", "tag": "7b107fe2-9d03-469a-b39d-9bb9814ca01a"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:52.998703 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-ff9d24b2-57e8-417b-82d0-6821c4d1ac18 req-e8742dff-eaed-4407-bfb6-076c787be227 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:52.999719 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-ff9d24b2-57e8-417b-82d0-6821c4d1ac18 req-e8742dff-eaed-4407-bfb6-076c787be227 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:53.015635 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-ff9d24b2-57e8-417b-82d0-6821c4d1ac18 req-e8742dff-eaed-4407-bfb6-076c787be227 service nova] Creating event network-vif-deleted:7b107fe2-9d03-469a-b39d-9bb9814ca01a for instance 2d2e5f9c-c00d-46b1-b55c-b2bda4428946 on n-h2-846466-12 Aug 04 16:35:53.027014 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-ff9d24b2-57e8-417b-82d0-6821c4d1ac18 req-e8742dff-eaed-4407-bfb6-076c787be227 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051303 Aug 04 16:35:53.028623 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 446/863] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:35:53.036843 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-227cd3ac-a3b4-42a9-9427-ddf6699de96c tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:53.039961 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:35:53.039961 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:35:53.041744 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-227cd3ac-a3b4-42a9-9427-ddf6699de96c tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:53.045959 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-227cd3ac-a3b4-42a9-9427-ddf6699de96c tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:53.047902 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-227cd3ac-a3b4-42a9-9427-ddf6699de96c tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:53.047902 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-227cd3ac-a3b4-42a9-9427-ddf6699de96c tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:53.088572 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-227cd3ac-a3b4-42a9-9427-ddf6699de96c tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.058384 Aug 04 16:35:53.097079 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 447/864] 10.222.0.23 () {60 vars in 1217 bytes} [Thu Aug 4 16:35:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:35:53.106500 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8d3c2f53-47a2-4fe4-adb8-677183817440 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:53.135627 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8d3c2f53-47a2-4fe4-adb8-677183817440 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037001 Aug 04 16:35:53.150565 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 448/865] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:35:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:53.156031 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8bad2022-127d-45fa-a5ac-0c4481c4d83a tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:53.156988 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8bad2022-127d-45fa-a5ac-0c4481c4d83a tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] [instance: 2503f8ac-e7f9-432d-8b3b-271d1a179572] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:53.164694 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8bad2022-127d-45fa-a5ac-0c4481c4d83a tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:53.165164 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8bad2022-127d-45fa-a5ac-0c4481c4d83a tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:53.166033 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8bad2022-127d-45fa-a5ac-0c4481c4d83a tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:53.166443 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8bad2022-127d-45fa-a5ac-0c4481c4d83a tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:53.194615 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-f39d7be9-829d-4349-8e20-28251f5ccc64 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 35b3ee83-f946-4c4c-bff9-80b8bd368788] Updating instance_info_cache with network_info: [{"id": "88be3f31-89a1-4c97-bc28-c49392694bb7", "address": "fa:16:3e:a9:1c:6b", "network": {"id": "ce185855-ad88-40d0-ad8d-f7db4d7f58b9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1029059546-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "25f22de02d3e4db281f6372e8191b95f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap88be3f31-89", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126126) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 16:35:53.220285 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f39d7be9-829d-4349-8e20-28251f5ccc64 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Releasing lock "refresh_cache-35b3ee83-f946-4c4c-bff9-80b8bd368788" {{(pid=126126) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 16:35:53.221167 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f39d7be9-829d-4349-8e20-28251f5ccc64 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "POST /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788/action" status: 202 len: 0 microversion: 2.1 time: 6.507626 Aug 04 16:35:53.222197 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 418/866] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:35:46 2022] POST /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788/action => generated 0 bytes in 6509 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 04 16:35:53.229158 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-be532be8-0276-49df-b692-47dad6ef74da tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:53.232103 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-be532be8-0276-49df-b692-47dad6ef74da tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:53.255760 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be532be8-0276-49df-b692-47dad6ef74da tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:53.256417 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be532be8-0276-49df-b692-47dad6ef74da tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:53.259035 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be532be8-0276-49df-b692-47dad6ef74da tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:53.259680 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be532be8-0276-49df-b692-47dad6ef74da tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:53.463391 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8bad2022-127d-45fa-a5ac-0c4481c4d83a tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5f11c99c841c4a7e7af4d7a4a5d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa4a23e6e71405f82347cd1cbbe3f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:53.481049 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8bad2022-127d-45fa-a5ac-0c4481c4d83a tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] 10.222.0.23 "GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572" status: 200 len: 1370 microversion: 2.1 time: 0.329664 Aug 04 16:35:53.482938 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 449/867] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:53 2022] GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572 => generated 1370 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:53.491060 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-aa61c0c6-9cdd-4eb6-b4ed-2c61d96e8f3a tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:53.499715 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-aa61c0c6-9cdd-4eb6-b4ed-2c61d96e8f3a tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] [instance: 6017510a-e331-424a-843d-54b980b999fb] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:53.528661 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aa61c0c6-9cdd-4eb6-b4ed-2c61d96e8f3a tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:53.529469 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aa61c0c6-9cdd-4eb6-b4ed-2c61d96e8f3a tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:53.533697 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aa61c0c6-9cdd-4eb6-b4ed-2c61d96e8f3a tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:53.537990 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aa61c0c6-9cdd-4eb6-b4ed-2c61d96e8f3a tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:53.610657 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-be532be8-0276-49df-b692-47dad6ef74da tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1614 microversion: 2.1 time: 0.385117 Aug 04 16:35:53.618849 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 419/868] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:53 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1614 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:53.640201 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3f87aa69-1801-4516-b483-5d45633c71c3 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:53.640965 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3f87aa69-1801-4516-b483-5d45633c71c3 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:53.650862 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3f87aa69-1801-4516-b483-5d45633c71c3 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:53.651296 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3f87aa69-1801-4516-b483-5d45633c71c3 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:53.652063 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3f87aa69-1801-4516-b483-5d45633c71c3 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:53.652486 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3f87aa69-1801-4516-b483-5d45633c71c3 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:53.709564 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-aa61c0c6-9cdd-4eb6-b4ed-2c61d96e8f3a tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb/action" status: 202 len: 0 microversion: 2.25 time: 0.221964 Aug 04 16:35:53.711431 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 450/869] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Aug 4 16:35:53 2022] POST /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:35:53.717467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d9797bf1-9243-4286-97c8-93358a63b8f4 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1593011657", "id": 1373042996, "os-flavor-access:is_public": "False"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:53.722880 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:35:53.722880 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:35:53.751285 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d9797bf1-9243-4286-97c8-93358a63b8f4 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.038343 Aug 04 16:35:53.752772 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 451/870] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:35:53 2022] POST /compute/v2.1/flavors => generated 439 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:35:53.758493 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0ea4bf87-757f-4a7b-ae45-a6facaaf0061 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Calling method '.version_select at 0x7f7e8453fb80>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:53.895734 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:35:53.968407 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=14 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:35:53.992344 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3f87aa69-1801-4516-b483-5d45633c71c3 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:54.003507 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3f87aa69-1801-4516-b483-5d45633c71c3 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159" status: 200 len: 1360 microversion: 2.1 time: 0.381882 Aug 04 16:35:54.005044 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 420/871] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:53 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159 => generated 1360 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:54.010046 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-842ab4df-287a-4a21-a44b-cdbaa8640e94 tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Calling method '.version_select at 0x7f7e84e961f0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:54.014316 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-842ab4df-287a-4a21-a44b-cdbaa8640e94 tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:54.015093 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-842ab4df-287a-4a21-a44b-cdbaa8640e94 tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:54.028814 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-842ab4df-287a-4a21-a44b-cdbaa8640e94 tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 1577 microversion: 2.1 time: 0.019980 Aug 04 16:35:54.031636 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 421/872] 10.222.0.23 () {58 vars in 1143 bytes} [Thu Aug 4 16:35:54 2022] GET /compute/v2.1/os-migrations => generated 1577 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:54.040068 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9f9d5902-d34d-4a3f-a5ad-b964434e5cec tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:54.041016 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9f9d5902-d34d-4a3f-a5ad-b964434e5cec tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] [instance: 6017510a-e331-424a-843d-54b980b999fb] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:54.051581 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f9d5902-d34d-4a3f-a5ad-b964434e5cec tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:54.052847 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f9d5902-d34d-4a3f-a5ad-b964434e5cec tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:54.053872 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f9d5902-d34d-4a3f-a5ad-b964434e5cec tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:54.054479 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f9d5902-d34d-4a3f-a5ad-b964434e5cec tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:54.115400 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0ea4bf87-757f-4a7b-ae45-a6facaaf0061 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/2b59746f-75e9-4d14-a960-669d6441c72c" status: 200 len: 184 microversion: 2.1 time: 0.360903 Aug 04 16:35:54.115988 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 452/873] 10.222.0.23 () {58 vars in 1260 bytes} [Thu Aug 4 16:35:53 2022] GET /compute/v2.1/os-floating-ips/2b59746f-75e9-4d14-a960-669d6441c72c => generated 184 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:35:54.121726 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-66ee110f-f640-489f-8ce8-a5eab90536fa tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f9a357362d2743aaafc5e3c57512c311"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:54.126442 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:35:54.126442 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:35:54.265157 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-9f9d5902-d34d-4a3f-a5ad-b964434e5cec tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lazy-loading 'services' on Instance uuid 6017510a-e331-424a-843d-54b980b999fb {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:35:54.283100 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9f9d5902-d34d-4a3f-a5ad-b964434e5cec tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb" status: 200 len: 2055 microversion: 2.25 time: 0.248073 Aug 04 16:35:54.284171 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 422/874] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:54 2022] GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb => generated 2055 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:54.290158 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5799d2f8-4590-464f-86aa-7a3ec710f500 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:54.290886 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5799d2f8-4590-464f-86aa-7a3ec710f500 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:54.299233 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5799d2f8-4590-464f-86aa-7a3ec710f500 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:54.300142 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5799d2f8-4590-464f-86aa-7a3ec710f500 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:54.301845 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5799d2f8-4590-464f-86aa-7a3ec710f500 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:54.302969 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5799d2f8-4590-464f-86aa-7a3ec710f500 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:54.399550 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-5799d2f8-4590-464f-86aa-7a3ec710f500 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lazy-loading 'services' on Instance uuid effb9df8-4005-4b3b-a58e-41b5ba36b5c5 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:35:54.424155 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5799d2f8-4590-464f-86aa-7a3ec710f500 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1929 microversion: 2.75 time: 0.138636 Aug 04 16:35:54.425236 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 423/875] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:54 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1929 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:54.431521 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-32a8662b-8bad-488a-a60e-31a4f5267204 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Action: 'action', calling method: .version_select at 0x7f7e878630d0>, body: {"removeFloatingIp": {"address": "172.25.6.68"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:54.502878 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-66ee110f-f640-489f-8ce8-a5eab90536fa tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1373042996/action" status: 200 len: 97 microversion: 2.1 time: 0.385301 Aug 04 16:35:54.503704 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 453/876] 10.222.0.23 () {60 vars in 1200 bytes} [Thu Aug 4 16:35:54 2022] POST /compute/v2.1/flavors/1373042996/action => generated 97 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:35:54.516164 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-60b9e402-05c0-47a1-8ea8-a6a05ab973d9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1546116613", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:54.588277 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-60b9e402-05c0-47a1-8ea8-a6a05ab973d9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] validate_networks() for None {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:35:54.639043 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-32a8662b-8bad-488a-a60e-31a4f5267204 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 35b3ee83-f946-4c4c-bff9-80b8bd368788] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:54.646092 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-32a8662b-8bad-488a-a60e-31a4f5267204 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:54.646546 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-32a8662b-8bad-488a-a60e-31a4f5267204 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:54.647329 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-32a8662b-8bad-488a-a60e-31a4f5267204 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:54.647764 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-32a8662b-8bad-488a-a60e-31a4f5267204 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:54.673985 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:35:55.030802 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-60b9e402-05c0-47a1-8ea8-a6a05ab973d9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:35:55.031461 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-60b9e402-05c0-47a1-8ea8-a6a05ab973d9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:35:55.032627 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-60b9e402-05c0-47a1-8ea8-a6a05ab973d9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:35:55.033096 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-60b9e402-05c0-47a1-8ea8-a6a05ab973d9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:35:55.033561 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-60b9e402-05c0-47a1-8ea8-a6a05ab973d9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:35:55.037127 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-32a8662b-8bad-488a-a60e-31a4f5267204 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Acquired lock "refresh_cache-35b3ee83-f946-4c4c-bff9-80b8bd368788" {{(pid=126126) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 16:35:55.051481 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-60b9e402-05c0-47a1-8ea8-a6a05ab973d9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:55.054089 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-60b9e402-05c0-47a1-8ea8-a6a05ab973d9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:55.055709 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-60b9e402-05c0-47a1-8ea8-a6a05ab973d9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:55.056136 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-60b9e402-05c0-47a1-8ea8-a6a05ab973d9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:55.082590 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-60b9e402-05c0-47a1-8ea8-a6a05ab973d9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Getting quotas for project c456fd996bb544478bdb39c6a7ca04a6. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:35:55.088384 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-60b9e402-05c0-47a1-8ea8-a6a05ab973d9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Getting quotas for user 6e582cea96b64285b4232b96162a274c and project c456fd996bb544478bdb39c6a7ca04a6. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:35:55.102531 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-60b9e402-05c0-47a1-8ea8-a6a05ab973d9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:35:55.105264 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-60b9e402-05c0-47a1-8ea8-a6a05ab973d9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:35:55.174151 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-60b9e402-05c0-47a1-8ea8-a6a05ab973d9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.662530 Aug 04 16:35:55.175343 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 454/877] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:35:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:35:55.182392 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f9cdb4d8-686d-447a-af17-85c66828e013 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:55.183216 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f9cdb4d8-686d-447a-af17-85c66828e013 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] [instance: 2503f8ac-e7f9-432d-8b3b-271d1a179572] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:55.192837 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9cdb4d8-686d-447a-af17-85c66828e013 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:55.193566 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9cdb4d8-686d-447a-af17-85c66828e013 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:55.194426 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9cdb4d8-686d-447a-af17-85c66828e013 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:55.194860 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9cdb4d8-686d-447a-af17-85c66828e013 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:55.695032 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f9cdb4d8-686d-447a-af17-85c66828e013 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5f11c99c841c4a7e7af4d7a4a5d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa4a23e6e71405f82347cd1cbbe3f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:55.708241 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f9cdb4d8-686d-447a-af17-85c66828e013 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] 10.222.0.23 "GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572" status: 200 len: 1370 microversion: 2.1 time: 0.529981 Aug 04 16:35:55.714408 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 455/878] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:55 2022] GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572 => generated 1370 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:55.726922 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-54a5998e-edcf-4c21-b856-de5a124d2f36 tempest-FlavorsAccessNegativeTestJSON-257011144 tempest-FlavorsAccessNegativeTestJSON-257011144-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "f9a357362d2743aaafc5e3c57512c311"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:55.729951 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:35:55.729951 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:35:55.735397 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-54a5998e-edcf-4c21-b856-de5a124d2f36 tempest-FlavorsAccessNegativeTestJSON-257011144 tempest-FlavorsAccessNegativeTestJSON-257011144-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '1287fec0e2ae4abab37dd336f4e22d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a357362d2743aaafc5e3c57512c311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:55.740826 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-54a5998e-edcf-4c21-b856-de5a124d2f36 tempest-FlavorsAccessNegativeTestJSON-257011144 tempest-FlavorsAccessNegativeTestJSON-257011144-project] Request method failure captured: Aug 04 16:35:55.740826 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/flavors/1373042996/action HTTP/1.1 Aug 04 16:35:55.740826 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:35:55.740826 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:35:55.740826 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:35:55.740826 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 70 Aug 04 16:35:55.740826 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:35:55.740826 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:35:55.740826 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:35:55.740826 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:35:55.740826 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_VQbyMdaQd0hQfbo9U6xK8M2a4YLZ0Ip6Tf6ox1x9BhhxeVbs_Mw0ujwt97mdUVozVhKa_wvsFVnz0NAdjmoyzw2jfQy-oZZzKPD38vFAzwH4cyyLy4zge2kyDTnUsn7akyMHQJPGUTujwssCeDaWJ2hs_F0CjtaYlBYIAzPph7tew Aug 04 16:35:55.740826 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:35:55.740826 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:35:55.740826 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:35:55.740826 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:35:55.740826 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:35:55.740826 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:35:55.740826 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: f9a357362d2743aaafc5e3c57512c311 Aug 04 16:35:55.740826 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-257011144 Aug 04 16:35:55.740826 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:35:55.740826 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:35:55.742487 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f9a357362d2743aaafc5e3c57512c311"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f9a357362d2743aaafc5e3c57512c311"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f9a357362d2743aaafc5e3c57512c311"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f9a357362d2743aaafc5e3c57512c311"}]}] Aug 04 16:35:55.742487 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-257011144 Aug 04 16:35:55.742487 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: f9a357362d2743aaafc5e3c57512c311 Aug 04 16:35:55.742487 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-257011144 Aug 04 16:35:55.742487 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-FlavorsAccessNegativeTestJSON-257011144-project Aug 04 16:35:55.742487 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:35:55.742487 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:35:55.742487 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 1287fec0e2ae4abab37dd336f4e22d41 Aug 04 16:35:55.742487 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-257011144-project Aug 04 16:35:55.742487 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:35:55.742487 n-d-846466-12 devstack@n-api.service[126125]: {"removeTenantAccess": {"tenant": "f9a357362d2743aaafc5e3c57512c311"}} Aug 04 16:35:55.742487 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:35:55.743418 n-d-846466-12 devstack@n-api.service[126125]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 04 16:35:55.743418 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '1373042996', 'body': {'removeTenantAccess': {'tenant': 'f9a357362d2743aaafc5e3c57512c311'}}} Aug 04 16:35:55.743418 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:35:55.743418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:55.743418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:55.743418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:55.743418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:35:55.743418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:35:55.743418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:35:55.743418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:35:55.743418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:35:55.743418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:35:55.743418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 04 16:35:55.743418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi context.can( Aug 04 16:35:55.743418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:35:55.743418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:35:55.743418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:35:55.743418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:35:55.743418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:35:55.743418 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:35:55.744890 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:35:55.744890 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:35:55.744890 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:35:55.744890 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:35:55.744890 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:35:55.744890 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:35:55.744890 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:35:55.744890 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:35:55.744890 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 04 16:35:55.744890 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:55.744890 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:55.744890 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:55.744890 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:55.744890 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:55.744890 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:55.744890 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:35:55.744890 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:35:55.744890 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 04 16:35:55.744890 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:55.748340 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-54a5998e-edcf-4c21-b856-de5a124d2f36 tempest-FlavorsAccessNegativeTestJSON-257011144 tempest-FlavorsAccessNegativeTestJSON-257011144-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:35:55.755359 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-54a5998e-edcf-4c21-b856-de5a124d2f36 tempest-FlavorsAccessNegativeTestJSON-257011144 tempest-FlavorsAccessNegativeTestJSON-257011144-project] 10.222.0.23 "POST /compute/v2.1/flavors/1373042996/action" status: 403 len: 133 microversion: 2.1 time: 0.039528 Aug 04 16:35:55.761536 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 456/879] 10.222.0.23 () {60 vars in 1200 bytes} [Thu Aug 4 16:35:55 2022] POST /compute/v2.1/flavors/1373042996/action => generated 133 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:35:55.772598 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-170a0a25-1a3b-4285-b0dc-befc94b6ceb8 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:55.781540 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-170a0a25-1a3b-4285-b0dc-befc94b6ceb8 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:55.797835 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-170a0a25-1a3b-4285-b0dc-befc94b6ceb8 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:55.798296 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-170a0a25-1a3b-4285-b0dc-befc94b6ceb8 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:55.807032 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-170a0a25-1a3b-4285-b0dc-befc94b6ceb8 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:55.807493 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-170a0a25-1a3b-4285-b0dc-befc94b6ceb8 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:56.059466 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-170a0a25-1a3b-4285-b0dc-befc94b6ceb8 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:56.074617 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-170a0a25-1a3b-4285-b0dc-befc94b6ceb8 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159" status: 200 len: 1360 microversion: 2.1 time: 0.310657 Aug 04 16:35:56.075298 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 457/880] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:55 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159 => generated 1360 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:56.095833 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-5939df41-6b8a-41e6-8a75-5abc8d1afe54 req-22118671-b761-4b50-8c12-0a46a24cc4f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2503f8ac-e7f9-432d-8b3b-271d1a179572", "tag": "69ff9322-6be1-4474-843b-3eaa1b1520b2"}, {"name": "network-changed", "server_uuid": "35b3ee83-f946-4c4c-bff9-80b8bd368788", "tag": "88be3f31-89a1-4c97-bc28-c49392694bb7"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:56.109517 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-5939df41-6b8a-41e6-8a75-5abc8d1afe54 req-22118671-b761-4b50-8c12-0a46a24cc4f6 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:56.110486 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-5939df41-6b8a-41e6-8a75-5abc8d1afe54 req-22118671-b761-4b50-8c12-0a46a24cc4f6 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:56.128014 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-5939df41-6b8a-41e6-8a75-5abc8d1afe54 req-22118671-b761-4b50-8c12-0a46a24cc4f6 service nova] Creating event network-changed:69ff9322-6be1-4474-843b-3eaa1b1520b2 for instance 2503f8ac-e7f9-432d-8b3b-271d1a179572 on n-h1-846466-12 Aug 04 16:35:56.128782 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-5939df41-6b8a-41e6-8a75-5abc8d1afe54 req-22118671-b761-4b50-8c12-0a46a24cc4f6 service nova] Creating event network-changed:88be3f31-89a1-4c97-bc28-c49392694bb7 for instance 35b3ee83-f946-4c4c-bff9-80b8bd368788 on n-h1-846466-12 Aug 04 16:35:56.138089 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-5939df41-6b8a-41e6-8a75-5abc8d1afe54 req-22118671-b761-4b50-8c12-0a46a24cc4f6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.046852 Aug 04 16:35:56.139376 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 458/881] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:35:56.146123 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6b8a6885-5ba7-4f20-a3f9-7d81ccd6cab8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:56.147219 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6b8a6885-5ba7-4f20-a3f9-7d81ccd6cab8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:56.160938 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6b8a6885-5ba7-4f20-a3f9-7d81ccd6cab8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:56.162161 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6b8a6885-5ba7-4f20-a3f9-7d81ccd6cab8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:56.163546 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6b8a6885-5ba7-4f20-a3f9-7d81ccd6cab8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:56.164154 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6b8a6885-5ba7-4f20-a3f9-7d81ccd6cab8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:56.607671 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6b8a6885-5ba7-4f20-a3f9-7d81ccd6cab8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:56.619557 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6b8a6885-5ba7-4f20-a3f9-7d81ccd6cab8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1209 microversion: 2.1 time: 0.478153 Aug 04 16:35:56.622586 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 459/882] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:56 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1209 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:56.633029 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dce39593-3192-46f5-b75b-1b81979c7cd1 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:56.633662 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dce39593-3192-46f5-b75b-1b81979c7cd1 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] [instance: 6017510a-e331-424a-843d-54b980b999fb] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:56.643752 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dce39593-3192-46f5-b75b-1b81979c7cd1 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:56.644556 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dce39593-3192-46f5-b75b-1b81979c7cd1 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:56.645721 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dce39593-3192-46f5-b75b-1b81979c7cd1 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:56.646315 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dce39593-3192-46f5-b75b-1b81979c7cd1 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:56.943888 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-32a8662b-8bad-488a-a60e-31a4f5267204 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 35b3ee83-f946-4c4c-bff9-80b8bd368788] Building network info cache for instance {{(pid=126126) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 16:35:57.104319 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-dce39593-3192-46f5-b75b-1b81979c7cd1 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lazy-loading 'services' on Instance uuid 6017510a-e331-424a-843d-54b980b999fb {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:35:57.123567 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dce39593-3192-46f5-b75b-1b81979c7cd1 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb" status: 200 len: 2035 microversion: 2.25 time: 0.498990 Aug 04 16:35:57.124241 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 460/883] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:56 2022] GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb => generated 2035 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:57.129488 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a8a62b47-b670-475d-bd41-3ccc9ad6a349 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:57.130351 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a8a62b47-b670-475d-bd41-3ccc9ad6a349 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:57.137114 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8a62b47-b670-475d-bd41-3ccc9ad6a349 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:57.137887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8a62b47-b670-475d-bd41-3ccc9ad6a349 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:57.138863 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8a62b47-b670-475d-bd41-3ccc9ad6a349 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:57.139855 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8a62b47-b670-475d-bd41-3ccc9ad6a349 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:57.334058 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-a8a62b47-b670-475d-bd41-3ccc9ad6a349 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lazy-loading 'services' on Instance uuid effb9df8-4005-4b3b-a58e-41b5ba36b5c5 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:35:57.374174 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a8a62b47-b670-475d-bd41-3ccc9ad6a349 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1929 microversion: 2.75 time: 0.248342 Aug 04 16:35:57.377037 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 461/884] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:57 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1929 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:57.385375 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4f4e5e86-553d-4ec9-bdc7-ef344733f35e tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "f9a357362d2743aaafc5e3c57512c311"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:57.395812 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:35:57.395812 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:35:57.505720 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4f4e5e86-553d-4ec9-bdc7-ef344733f35e tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1373042996/action" status: 200 len: 21 microversion: 2.1 time: 0.126411 Aug 04 16:35:57.513211 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 462/885] 10.222.0.23 () {60 vars in 1200 bytes} [Thu Aug 4 16:35:57 2022] POST /compute/v2.1/flavors/1373042996/action => generated 21 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:35:57.629412 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4d9d4a5b-1e20-4fe1-9e2c-444aa515edd3 tempest-SecurityGroupsNegativeTestJSON-811881905 tempest-SecurityGroupsNegativeTestJSON-811881905-project] Calling method '.version_select at 0x7f7e84630d30>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:57.723873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG neutronclient.v2_0.client [None req-4d9d4a5b-1e20-4fe1-9e2c-444aa515edd3 tempest-SecurityGroupsNegativeTestJSON-811881905 tempest-SecurityGroupsNegativeTestJSON-811881905-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 249fe3b0-cf10-4569-a40d-fca5f6dae782 does not exist", "detail": ""}} {{(pid=126125) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:35:57.724864 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.security_group_api [None req-4d9d4a5b-1e20-4fe1-9e2c-444aa515edd3 tempest-SecurityGroupsNegativeTestJSON-811881905 tempest-SecurityGroupsNegativeTestJSON-811881905-project] Neutron security group 249fe3b0-cf10-4569-a40d-fca5f6dae782 not found {{(pid=126125) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 16:35:57.726276 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-4d9d4a5b-1e20-4fe1-9e2c-444aa515edd3 tempest-SecurityGroupsNegativeTestJSON-811881905 tempest-SecurityGroupsNegativeTestJSON-811881905-project] HTTP exception thrown: Security group 249fe3b0-cf10-4569-a40d-fca5f6dae782 does not exist Aug 04 16:35:57.726276 n-d-846466-12 devstack@n-api.service[126125]: Neutron server returns request_ids: ['req-6df43651-7dfe-48a9-b11b-2b64bc5efa19'] Aug 04 16:35:57.729343 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4d9d4a5b-1e20-4fe1-9e2c-444aa515edd3 tempest-SecurityGroupsNegativeTestJSON-811881905 tempest-SecurityGroupsNegativeTestJSON-811881905-project] Request method failure captured: Aug 04 16:35:57.729343 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/os-security-groups/249fe3b0-cf10-4569-a40d-fca5f6dae782 HTTP/1.1 Aug 04 16:35:57.729343 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:35:57.729343 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:35:57.729343 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:35:57.729343 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:35:57.729343 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:35:57.729343 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:35:57.729343 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:35:57.729343 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:35:57.729343 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_Vseji8B8Rl2E32nZSRxkNYPo8-o8J6mb5UYfJvmIGNhth8CyXHk8VENF4Ve2bIEVkSDOb53102gSYxJ6C2FUzq42L42BSdMBc3h0I760K_rtIroaecrnnQk1Kd5mJcZldXUVTNh0ekzsk3RhF8d_1h2K8cP9xX8x5U6IBy3VO44Mk Aug 04 16:35:57.729343 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:35:57.729343 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:35:57.729343 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:35:57.729343 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:35:57.729343 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:35:57.729343 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:35:57.729343 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 679329d2ec6c4f6b86ec6fe6a24c5c63 Aug 04 16:35:57.729343 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-811881905 Aug 04 16:35:57.729343 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:35:57.729343 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:35:57.731120 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/679329d2ec6c4f6b86ec6fe6a24c5c63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_679329d2ec6c4f6b86ec6fe6a24c5c63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/679329d2ec6c4f6b86ec6fe6a24c5c63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/679329d2ec6c4f6b86ec6fe6a24c5c63"}]}] Aug 04 16:35:57.731120 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-811881905 Aug 04 16:35:57.731120 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 679329d2ec6c4f6b86ec6fe6a24c5c63 Aug 04 16:35:57.731120 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-811881905 Aug 04 16:35:57.731120 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-SecurityGroupsNegativeTestJSON-811881905-project Aug 04 16:35:57.731120 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:35:57.731120 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:35:57.731120 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 141899892c244420928f0672fe384013 Aug 04 16:35:57.731120 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-811881905-project Aug 04 16:35:57.731120 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:35:57.731120 n-d-846466-12 devstack@n-api.service[126125]: exception: Security group 249fe3b0-cf10-4569-a40d-fca5f6dae782 does not exist Aug 04 16:35:57.731120 n-d-846466-12 devstack@n-api.service[126125]: Neutron server returns request_ids: ['req-6df43651-7dfe-48a9-b11b-2b64bc5efa19'] Aug 04 16:35:57.731120 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '249fe3b0-cf10-4569-a40d-fca5f6dae782'} Aug 04 16:35:57.732129 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:35:57.732129 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:57.732129 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 16:35:57.732129 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 16:35:57.732129 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:35:57.732129 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:35:57.732129 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 16:35:57.732129 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 16:35:57.732129 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:35:57.732129 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:35:57.732129 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 16:35:57.732129 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 16:35:57.732129 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:35:57.732129 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:35:57.732129 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:35:57.732129 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:35:57.732129 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:35:57.732129 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:35:57.732129 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:35:57.733774 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:35:57.733774 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:35:57.733774 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:35:57.733774 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:35:57.733774 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:35:57.733774 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:35:57.733774 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:35:57.733774 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 249fe3b0-cf10-4569-a40d-fca5f6dae782 does not exist Aug 04 16:35:57.733774 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6df43651-7dfe-48a9-b11b-2b64bc5efa19'] Aug 04 16:35:57.733774 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:57.733774 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:57.733774 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:57.733774 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:57.733774 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 04 16:35:57.733774 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 16:35:57.733774 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 16:35:57.733774 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 16:35:57.733774 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 249fe3b0-cf10-4569-a40d-fca5f6dae782 does not exist Aug 04 16:35:57.735802 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6df43651-7dfe-48a9-b11b-2b64bc5efa19'] Aug 04 16:35:57.735802 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:57.735802 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:57.735802 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:57.735802 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:57.735802 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:57.735802 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:57.735802 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:35:57.735802 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:35:57.735802 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:35:57.735802 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:35:57.735802 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:35:57.735802 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:35:57.735802 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 04 16:35:57.735802 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 16:35:57.735802 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 249fe3b0-cf10-4569-a40d-fca5f6dae782 does not exist Aug 04 16:35:57.735802 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6df43651-7dfe-48a9-b11b-2b64bc5efa19'] Aug 04 16:35:57.735802 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:57.735802 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:57.735802 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:57.735802 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:57.737479 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:57.737479 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:57.737479 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:35:57.737479 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:35:57.737479 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 249fe3b0-cf10-4569-a40d-fca5f6dae782 does not exist Aug 04 16:35:57.737479 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6df43651-7dfe-48a9-b11b-2b64bc5efa19'] Aug 04 16:35:57.737479 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:57.742107 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4d9d4a5b-1e20-4fe1-9e2c-444aa515edd3 tempest-SecurityGroupsNegativeTestJSON-811881905 tempest-SecurityGroupsNegativeTestJSON-811881905-project] Returning 404 to user: Security group 249fe3b0-cf10-4569-a40d-fca5f6dae782 does not exist Aug 04 16:35:57.742107 n-d-846466-12 devstack@n-api.service[126125]: Neutron server returns request_ids: ['req-6df43651-7dfe-48a9-b11b-2b64bc5efa19'] {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:35:57.743469 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4d9d4a5b-1e20-4fe1-9e2c-444aa515edd3 tempest-SecurityGroupsNegativeTestJSON-811881905 tempest-SecurityGroupsNegativeTestJSON-811881905-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/249fe3b0-cf10-4569-a40d-fca5f6dae782" status: 404 len: 194 microversion: 2.1 time: 0.228919 Aug 04 16:35:57.744441 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 463/886] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:35:57 2022] DELETE /compute/v2.1/os-security-groups/249fe3b0-cf10-4569-a40d-fca5f6dae782 => generated 194 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:35:57.751779 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-885a9b7e-8e5f-4e60-915e-cc29ef75b6e0 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:57.752633 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-885a9b7e-8e5f-4e60-915e-cc29ef75b6e0 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] [instance: 2503f8ac-e7f9-432d-8b3b-271d1a179572] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:57.760542 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-885a9b7e-8e5f-4e60-915e-cc29ef75b6e0 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:57.761428 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-885a9b7e-8e5f-4e60-915e-cc29ef75b6e0 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:57.762373 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-885a9b7e-8e5f-4e60-915e-cc29ef75b6e0 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:57.762958 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-885a9b7e-8e5f-4e60-915e-cc29ef75b6e0 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:58.237248 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-885a9b7e-8e5f-4e60-915e-cc29ef75b6e0 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5f11c99c841c4a7e7af4d7a4a5d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa4a23e6e71405f82347cd1cbbe3f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:58.253468 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-885a9b7e-8e5f-4e60-915e-cc29ef75b6e0 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] 10.222.0.23 "GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572" status: 200 len: 1370 microversion: 2.1 time: 0.506594 Aug 04 16:35:58.268124 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 464/887] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:57 2022] GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572 => generated 1370 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:58.286967 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c347e33e-35b1-47fa-afa9-2e35e8012c28 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:58.287616 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c347e33e-35b1-47fa-afa9-2e35e8012c28 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:58.290544 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:DELETE=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:35:58.298142 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c347e33e-35b1-47fa-afa9-2e35e8012c28 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:58.298811 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c347e33e-35b1-47fa-afa9-2e35e8012c28 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:58.299760 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c347e33e-35b1-47fa-afa9-2e35e8012c28 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:58.300389 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c347e33e-35b1-47fa-afa9-2e35e8012c28 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:58.774674 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-32a8662b-8bad-488a-a60e-31a4f5267204 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 35b3ee83-f946-4c4c-bff9-80b8bd368788] Updating instance_info_cache with network_info: [{"id": "88be3f31-89a1-4c97-bc28-c49392694bb7", "address": "fa:16:3e:a9:1c:6b", "network": {"id": "ce185855-ad88-40d0-ad8d-f7db4d7f58b9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1029059546-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "25f22de02d3e4db281f6372e8191b95f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap88be3f31-89", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126126) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 16:35:58.788743 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-32a8662b-8bad-488a-a60e-31a4f5267204 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Releasing lock "refresh_cache-35b3ee83-f946-4c4c-bff9-80b8bd368788" {{(pid=126126) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 16:35:58.789953 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-32a8662b-8bad-488a-a60e-31a4f5267204 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "POST /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788/action" status: 202 len: 0 microversion: 2.1 time: 4.363587 Aug 04 16:35:58.790905 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 424/888] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:35:54 2022] POST /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788/action => generated 0 bytes in 4365 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 04 16:35:58.796554 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c347e33e-35b1-47fa-afa9-2e35e8012c28 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:58.803218 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c2328e60-7d73-4286-b2be-cced9b8a6d52 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-846466-12", "block_migration": "auto"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:58.805903 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c2328e60-7d73-4286-b2be-cced9b8a6d52 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] [instance: 6017510a-e331-424a-843d-54b980b999fb] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:58.806466 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c347e33e-35b1-47fa-afa9-2e35e8012c28 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159" status: 200 len: 1360 microversion: 2.1 time: 0.536428 Aug 04 16:35:58.807257 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 465/889] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:58 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159 => generated 1360 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:58.813253 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-842a1746-621b-4c89-a833-89e936aa399d tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:58.814093 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:35:58.814093 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:35:58.825886 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c2328e60-7d73-4286-b2be-cced9b8a6d52 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:58.826302 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c2328e60-7d73-4286-b2be-cced9b8a6d52 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:58.827291 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c2328e60-7d73-4286-b2be-cced9b8a6d52 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:58.827679 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c2328e60-7d73-4286-b2be-cced9b8a6d52 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:58.834588 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-842a1746-621b-4c89-a833-89e936aa399d tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1373042996" status: 202 len: 0 microversion: 2.1 time: 0.025860 Aug 04 16:35:58.835236 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 466/890] 10.222.0.23 () {58 vars in 1161 bytes} [Thu Aug 4 16:35:58 2022] DELETE /compute/v2.1/flavors/1373042996 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:35:58.840942 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-109eca46-f849-424f-89d9-8e6742422429 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:58.841757 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-109eca46-f849-424f-89d9-8e6742422429 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:58.849827 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-109eca46-f849-424f-89d9-8e6742422429 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:58.850706 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-109eca46-f849-424f-89d9-8e6742422429 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:58.851718 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-109eca46-f849-424f-89d9-8e6742422429 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:58.852408 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-109eca46-f849-424f-89d9-8e6742422429 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:58.855073 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-c2328e60-7d73-4286-b2be-cced9b8a6d52 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lazy-loading 'flavor' on Instance uuid 6017510a-e331-424a-843d-54b980b999fb {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:35:58.868668 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c2328e60-7d73-4286-b2be-cced9b8a6d52 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] [instance: 6017510a-e331-424a-843d-54b980b999fb] Going to try to live migrate instance to n-h2-846466-12 {{(pid=126126) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 16:35:58.957223 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-109eca46-f849-424f-89d9-8e6742422429 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:35:58.965227 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-109eca46-f849-424f-89d9-8e6742422429 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1271 microversion: 2.1 time: 0.128581 Aug 04 16:35:58.967264 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 467/891] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:35:58 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1271 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:58.973338 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6639f153-d927-42e9-bdf1-486a7464c060 tempest-SecurityGroupsNegativeTestJSON-811881905 tempest-SecurityGroupsNegativeTestJSON-811881905-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004926 Aug 04 16:35:58.974337 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 468/892] 10.222.0.23 () {58 vars in 1164 bytes} [Thu Aug 4 16:35:58 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 16:35:58.982785 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-e85fd7e5-485e-4ae0-b08b-50dddca6c82d req-d6bc6905-ec93-43fc-8e93-b45e6aa41078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b359364c-f234-4d01-9c08-e6df8a21f159", "name": "network-vif-plugged", "status": "completed", "tag": "490cb30e-cef0-49db-a9ae-179c72d887af"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:58.995156 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-e85fd7e5-485e-4ae0-b08b-50dddca6c82d req-d6bc6905-ec93-43fc-8e93-b45e6aa41078 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:58.995511 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-e85fd7e5-485e-4ae0-b08b-50dddca6c82d req-d6bc6905-ec93-43fc-8e93-b45e6aa41078 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:59.009022 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-e85fd7e5-485e-4ae0-b08b-50dddca6c82d req-d6bc6905-ec93-43fc-8e93-b45e6aa41078 service nova] Creating event network-vif-plugged:490cb30e-cef0-49db-a9ae-179c72d887af for instance b359364c-f234-4d01-9c08-e6df8a21f159 on n-h1-846466-12 Aug 04 16:35:59.014980 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-e85fd7e5-485e-4ae0-b08b-50dddca6c82d req-d6bc6905-ec93-43fc-8e93-b45e6aa41078 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038802 Aug 04 16:35:59.016485 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 469/893] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:35:59.023765 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6e3780c2-4673-4ece-b093-fcc5aebaae78 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:59.024873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6e3780c2-4673-4ece-b093-fcc5aebaae78 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:59.033323 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6e3780c2-4673-4ece-b093-fcc5aebaae78 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:59.034055 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6e3780c2-4673-4ece-b093-fcc5aebaae78 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:59.035010 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6e3780c2-4673-4ece-b093-fcc5aebaae78 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:59.035719 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6e3780c2-4673-4ece-b093-fcc5aebaae78 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:59.061856 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:35:59.258139 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-6e3780c2-4673-4ece-b093-fcc5aebaae78 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lazy-loading 'services' on Instance uuid effb9df8-4005-4b3b-a58e-41b5ba36b5c5 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:35:59.322034 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6e3780c2-4673-4ece-b093-fcc5aebaae78 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1929 microversion: 2.75 time: 0.303969 Aug 04 16:35:59.339090 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 470/894] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:35:59 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1929 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:35:59.356483 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-6295f892-9602-4f29-9f58-8d47d9f67313 req-35e7e95b-bdb6-4feb-83a0-34c49bb76e4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35b3ee83-f946-4c4c-bff9-80b8bd368788", "tag": "88be3f31-89a1-4c97-bc28-c49392694bb7"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:35:59.374420 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6295f892-9602-4f29-9f58-8d47d9f67313 req-35e7e95b-bdb6-4feb-83a0-34c49bb76e4d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:59.375174 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6295f892-9602-4f29-9f58-8d47d9f67313 req-35e7e95b-bdb6-4feb-83a0-34c49bb76e4d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:59.396660 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-6295f892-9602-4f29-9f58-8d47d9f67313 req-35e7e95b-bdb6-4feb-83a0-34c49bb76e4d service nova] Creating event network-changed:88be3f31-89a1-4c97-bc28-c49392694bb7 for instance 35b3ee83-f946-4c4c-bff9-80b8bd368788 on n-h1-846466-12 Aug 04 16:35:59.406891 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-6295f892-9602-4f29-9f58-8d47d9f67313 req-35e7e95b-bdb6-4feb-83a0-34c49bb76e4d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066310 Aug 04 16:35:59.408245 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 471/895] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:35:59.420924 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ded8aab7-b0f2-4a64-9e1d-1aedcf017226 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:59.421746 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ded8aab7-b0f2-4a64-9e1d-1aedcf017226 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 2d2e5f9c-c00d-46b1-b55c-b2bda4428946] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:35:59.443547 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ded8aab7-b0f2-4a64-9e1d-1aedcf017226 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:59.444015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ded8aab7-b0f2-4a64-9e1d-1aedcf017226 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:59.444825 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ded8aab7-b0f2-4a64-9e1d-1aedcf017226 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:35:59.445263 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ded8aab7-b0f2-4a64-9e1d-1aedcf017226 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:35:59.482215 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-ded8aab7-b0f2-4a64-9e1d-1aedcf017226 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] HTTP exception thrown: Instance 2d2e5f9c-c00d-46b1-b55c-b2bda4428946 could not be found. Aug 04 16:35:59.484766 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ded8aab7-b0f2-4a64-9e1d-1aedcf017226 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Request method failure captured: Aug 04 16:35:59.484766 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/servers/2d2e5f9c-c00d-46b1-b55c-b2bda4428946 HTTP/1.1 Aug 04 16:35:59.484766 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:35:59.484766 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:35:59.484766 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:35:59.484766 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:35:59.484766 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:35:59.484766 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:35:59.484766 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:35:59.484766 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:35:59.484766 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_UW_vmQLiuSt0eBCsEw9pRigB8Wp3k1tvQoUkUoSlkWWcI-0jGNt8uWyhkyi--vPz_SJm7uiN9TnHnRdRK97zZDM9tscOMEONyE5nyr_gaZe-LmoYakXKibUwT2cmNooZz8oMxbh1NoUWWNUGNYU8ByOSpYG8GK3MkeyckBIMZl3rw Aug 04 16:35:59.484766 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:35:59.484766 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:35:59.484766 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:35:59.484766 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:35:59.484766 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:35:59.484766 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:35:59.484766 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 25f22de02d3e4db281f6372e8191b95f Aug 04 16:35:59.484766 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-910288468 Aug 04 16:35:59.484766 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:35:59.484766 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:35:59.486432 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25f22de02d3e4db281f6372e8191b95f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_25f22de02d3e4db281f6372e8191b95f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25f22de02d3e4db281f6372e8191b95f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/25f22de02d3e4db281f6372e8191b95f"}]}] Aug 04 16:35:59.486432 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-910288468 Aug 04 16:35:59.486432 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 25f22de02d3e4db281f6372e8191b95f Aug 04 16:35:59.486432 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-910288468 Aug 04 16:35:59.486432 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-FloatingIPsAssociationTestJSON-910288468-project Aug 04 16:35:59.486432 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:35:59.486432 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:35:59.486432 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: b4a732f446814c9fa080979bef241023 Aug 04 16:35:59.486432 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-910288468-project Aug 04 16:35:59.486432 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:35:59.486432 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 2d2e5f9c-c00d-46b1-b55c-b2bda4428946 could not be found. Aug 04 16:35:59.486432 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '2d2e5f9c-c00d-46b1-b55c-b2bda4428946'} Aug 04 16:35:59.487255 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:35:59.487255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:59.487255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:35:59.487255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:35:59.487255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:35:59.487255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:35:59.487255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:35:59.487255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:35:59.487255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:35:59.487255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:35:59.487255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d2e5f9c-c00d-46b1-b55c-b2bda4428946 could not be found. Aug 04 16:35:59.487255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:59.487255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:59.487255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:59.487255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:59.487255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:59.487255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:59.487255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:35:59.487255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:35:59.487255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:35:59.488523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:35:59.488523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:35:59.488523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:35:59.488523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:35:59.488523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:35:59.488523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:35:59.488523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:35:59.488523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:35:59.488523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:35:59.488523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d2e5f9c-c00d-46b1-b55c-b2bda4428946 could not be found. Aug 04 16:35:59.488523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:59.488523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:35:59.488523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:59.488523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:35:59.488523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:35:59.488523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:35:59.488523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:35:59.488523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:35:59.488523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d2e5f9c-c00d-46b1-b55c-b2bda4428946 could not be found. Aug 04 16:35:59.488523 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:35:59.492416 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ded8aab7-b0f2-4a64-9e1d-1aedcf017226 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Returning 404 to user: Instance 2d2e5f9c-c00d-46b1-b55c-b2bda4428946 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:35:59.494000 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ded8aab7-b0f2-4a64-9e1d-1aedcf017226 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2d2e5f9c-c00d-46b1-b55c-b2bda4428946" status: 404 len: 111 microversion: 2.1 time: 0.081053 Aug 04 16:35:59.495152 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 472/896] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:35:59 2022] DELETE /compute/v2.1/servers/2d2e5f9c-c00d-46b1-b55c-b2bda4428946 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:35:59.507472 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8491c44e-71c2-4d58-902a-452b6e68d2ca tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:35:59.559177 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8491c44e-71c2-4d58-902a-452b6e68d2ca tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062619 Aug 04 16:35:59.560156 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 473/897] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:35:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:35:59.565563 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c6f69fc2-14de-4061-9805-999af56757ca tempest-SecurityGroupsNegativeTestJSON-811881905 tempest-SecurityGroupsNegativeTestJSON-811881905-project] Calling method '.version_select at 0x7f7e8479e1f0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:00.719847 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c6f69fc2-14de-4061-9805-999af56757ca tempest-SecurityGroupsNegativeTestJSON-811881905 tempest-SecurityGroupsNegativeTestJSON-811881905-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 1.158321 Aug 04 16:36:00.723627 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 474/898] 10.222.0.23 () {58 vars in 1158 bytes} [Thu Aug 4 16:35:59 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:36:00.730634 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c98d6ace-ff51-4ba9-9fc6-acd1fd968d65 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:00.731411 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c98d6ace-ff51-4ba9-9fc6-acd1fd968d65 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] [instance: 2503f8ac-e7f9-432d-8b3b-271d1a179572] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:00.740003 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c98d6ace-ff51-4ba9-9fc6-acd1fd968d65 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:00.740590 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c98d6ace-ff51-4ba9-9fc6-acd1fd968d65 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:00.741619 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c98d6ace-ff51-4ba9-9fc6-acd1fd968d65 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:00.742124 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c98d6ace-ff51-4ba9-9fc6-acd1fd968d65 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:01.156201 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c98d6ace-ff51-4ba9-9fc6-acd1fd968d65 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5f11c99c841c4a7e7af4d7a4a5d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa4a23e6e71405f82347cd1cbbe3f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:01.165567 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c98d6ace-ff51-4ba9-9fc6-acd1fd968d65 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] 10.222.0.23 "GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572" status: 200 len: 1370 microversion: 2.1 time: 0.440164 Aug 04 16:36:01.170592 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 475/899] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:00 2022] GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572 => generated 1370 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:01.171845 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e4484605-9517-4aa8-8b96-3629ca2b11b4 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:01.172698 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e4484605-9517-4aa8-8b96-3629ca2b11b4 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 2d2e5f9c-c00d-46b1-b55c-b2bda4428946] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:01.179624 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e4484605-9517-4aa8-8b96-3629ca2b11b4 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:01.180088 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e4484605-9517-4aa8-8b96-3629ca2b11b4 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:01.180887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e4484605-9517-4aa8-8b96-3629ca2b11b4 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:01.181407 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e4484605-9517-4aa8-8b96-3629ca2b11b4 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:01.199813 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-e4484605-9517-4aa8-8b96-3629ca2b11b4 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] HTTP exception thrown: Instance 2d2e5f9c-c00d-46b1-b55c-b2bda4428946 could not be found. Aug 04 16:36:01.202074 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e4484605-9517-4aa8-8b96-3629ca2b11b4 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Request method failure captured: Aug 04 16:36:01.202074 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/2d2e5f9c-c00d-46b1-b55c-b2bda4428946 HTTP/1.1 Aug 04 16:36:01.202074 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:36:01.202074 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:36:01.202074 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:36:01.202074 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:36:01.202074 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:36:01.202074 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:36:01.202074 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:36:01.202074 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:36:01.202074 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_UW_vmQLiuSt0eBCsEw9pRigB8Wp3k1tvQoUkUoSlkWWcI-0jGNt8uWyhkyi--vPz_SJm7uiN9TnHnRdRK97zZDM9tscOMEONyE5nyr_gaZe-LmoYakXKibUwT2cmNooZz8oMxbh1NoUWWNUGNYU8ByOSpYG8GK3MkeyckBIMZl3rw Aug 04 16:36:01.202074 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:36:01.202074 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:36:01.202074 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:36:01.202074 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:36:01.202074 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:36:01.202074 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:36:01.202074 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 25f22de02d3e4db281f6372e8191b95f Aug 04 16:36:01.202074 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-910288468 Aug 04 16:36:01.202074 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:36:01.202074 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:36:01.203703 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25f22de02d3e4db281f6372e8191b95f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_25f22de02d3e4db281f6372e8191b95f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25f22de02d3e4db281f6372e8191b95f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/25f22de02d3e4db281f6372e8191b95f"}]}] Aug 04 16:36:01.203703 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-910288468 Aug 04 16:36:01.203703 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 25f22de02d3e4db281f6372e8191b95f Aug 04 16:36:01.203703 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-910288468 Aug 04 16:36:01.203703 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-FloatingIPsAssociationTestJSON-910288468-project Aug 04 16:36:01.203703 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:36:01.203703 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:36:01.203703 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: b4a732f446814c9fa080979bef241023 Aug 04 16:36:01.203703 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-910288468-project Aug 04 16:36:01.203703 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:36:01.203703 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 2d2e5f9c-c00d-46b1-b55c-b2bda4428946 could not be found. Aug 04 16:36:01.203703 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '2d2e5f9c-c00d-46b1-b55c-b2bda4428946'} Aug 04 16:36:01.204636 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:36:01.204636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:36:01.204636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:36:01.204636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:36:01.204636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:36:01.204636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:36:01.204636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:36:01.204636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:36:01.204636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:36:01.204636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:36:01.204636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d2e5f9c-c00d-46b1-b55c-b2bda4428946 could not be found. Aug 04 16:36:01.204636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:36:01.204636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:36:01.204636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:36:01.204636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:36:01.204636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:36:01.204636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:36:01.204636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:36:01.204636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:36:01.204636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:36:01.206138 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:36:01.206138 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:36:01.206138 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:36:01.206138 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:36:01.206138 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:36:01.206138 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:36:01.206138 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:36:01.206138 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d2e5f9c-c00d-46b1-b55c-b2bda4428946 could not be found. Aug 04 16:36:01.206138 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:36:01.206138 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:36:01.206138 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:36:01.206138 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:36:01.206138 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:36:01.206138 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:36:01.206138 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:36:01.206138 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:36:01.206138 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d2e5f9c-c00d-46b1-b55c-b2bda4428946 could not be found. Aug 04 16:36:01.206138 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:36:01.209196 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e4484605-9517-4aa8-8b96-3629ca2b11b4 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Returning 404 to user: Instance 2d2e5f9c-c00d-46b1-b55c-b2bda4428946 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:36:01.210933 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e4484605-9517-4aa8-8b96-3629ca2b11b4 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "GET /compute/v2.1/servers/2d2e5f9c-c00d-46b1-b55c-b2bda4428946" status: 404 len: 111 microversion: 2.1 time: 0.043201 Aug 04 16:36:01.212083 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 476/900] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:01 2022] GET /compute/v2.1/servers/2d2e5f9c-c00d-46b1-b55c-b2bda4428946 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:36:01.219000 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4f9de9d4-3d85-4ed5-99ed-c33ac15acdc5 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1102156038", "id": 314721578, "os-flavor-access:is_public": "False"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:01.222593 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:36:01.222593 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:36:01.251583 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4f9de9d4-3d85-4ed5-99ed-c33ac15acdc5 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.037982 Aug 04 16:36:01.252526 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 477/901] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:36:01 2022] POST /compute/v2.1/flavors => generated 436 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:36:01.257674 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-14182310-8fee-48c2-9aef-b218ff201e12 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:01.258559 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-14182310-8fee-48c2-9aef-b218ff201e12 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:01.280006 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14182310-8fee-48c2-9aef-b218ff201e12 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:01.280927 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14182310-8fee-48c2-9aef-b218ff201e12 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:01.282592 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14182310-8fee-48c2-9aef-b218ff201e12 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:01.283450 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14182310-8fee-48c2-9aef-b218ff201e12 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:01.310080 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c2328e60-7d73-4286-b2be-cced9b8a6d52 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb/action" status: 202 len: 0 microversion: 2.25 time: 2.517614 Aug 04 16:36:01.311372 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 425/902] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Aug 4 16:35:58 2022] POST /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb/action => generated 0 bytes in 2520 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:36:01.318514 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5c0d00da-b98f-4035-853f-205a2a78fd20 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:01.319485 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5c0d00da-b98f-4035-853f-205a2a78fd20 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:01.336290 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5c0d00da-b98f-4035-853f-205a2a78fd20 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:01.336996 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5c0d00da-b98f-4035-853f-205a2a78fd20 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:01.338057 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5c0d00da-b98f-4035-853f-205a2a78fd20 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:01.338664 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5c0d00da-b98f-4035-853f-205a2a78fd20 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:01.852509 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-14182310-8fee-48c2-9aef-b218ff201e12 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:01.873425 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-14182310-8fee-48c2-9aef-b218ff201e12 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159" status: 200 len: 1543 microversion: 2.1 time: 0.619435 Aug 04 16:36:01.886374 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 478/903] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:01 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159 => generated 1543 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:01.899048 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-aaf450f5-f198-4bcb-b6b2-a6e8708971d2 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:01.899969 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-aaf450f5-f198-4bcb-b6b2-a6e8708971d2 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:01.917104 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aaf450f5-f198-4bcb-b6b2-a6e8708971d2 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:01.917845 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aaf450f5-f198-4bcb-b6b2-a6e8708971d2 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:01.918826 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aaf450f5-f198-4bcb-b6b2-a6e8708971d2 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:01.919421 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aaf450f5-f198-4bcb-b6b2-a6e8708971d2 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:01.966111 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5c0d00da-b98f-4035-853f-205a2a78fd20 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:01.976948 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5c0d00da-b98f-4035-853f-205a2a78fd20 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1313 microversion: 2.1 time: 0.663601 Aug 04 16:36:01.979082 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 426/904] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:01 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1313 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:01.985536 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e347c624-1ba6-4d21-b039-d7090c73040f tempest-SecurityGroupsNegativeTestJSON-811881905 tempest-SecurityGroupsNegativeTestJSON-811881905-project] Calling method '.version_select at 0x7f7e84d065e0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:02.038456 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-aaf450f5-f198-4bcb-b6b2-a6e8708971d2 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lazy-loading 'services' on Instance uuid effb9df8-4005-4b3b-a58e-41b5ba36b5c5 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:36:02.063956 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-aaf450f5-f198-4bcb-b6b2-a6e8708971d2 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1929 microversion: 2.75 time: 0.172143 Aug 04 16:36:02.065313 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 479/905] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:36:01 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1929 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:36:02.070531 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-4177585f-4c19-4127-95d4-6d342400b717 req-a0331de8-284f-4a9c-836e-2884fcd141f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2503f8ac-e7f9-432d-8b3b-271d1a179572", "name": "network-vif-plugged", "status": "completed", "tag": "69ff9322-6be1-4474-843b-3eaa1b1520b2"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:02.110348 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-4177585f-4c19-4127-95d4-6d342400b717 req-a0331de8-284f-4a9c-836e-2884fcd141f4 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:02.110795 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-4177585f-4c19-4127-95d4-6d342400b717 req-a0331de8-284f-4a9c-836e-2884fcd141f4 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:02.142406 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-4177585f-4c19-4127-95d4-6d342400b717 req-a0331de8-284f-4a9c-836e-2884fcd141f4 service nova] Creating event network-vif-plugged:69ff9322-6be1-4474-843b-3eaa1b1520b2 for instance 2503f8ac-e7f9-432d-8b3b-271d1a179572 on n-h1-846466-12 Aug 04 16:36:02.150889 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-4177585f-4c19-4127-95d4-6d342400b717 req-a0331de8-284f-4a9c-836e-2884fcd141f4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083994 Aug 04 16:36:02.155951 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 480/906] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:36:02.169478 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c4bf34ce-3c98-4e19-acd7-8f727d9b9f61 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Calling method '.version_select at 0x7f7e844aff70>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:02.677676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG neutronclient.v2_0.client [None req-e347c624-1ba6-4d21-b039-d7090c73040f tempest-SecurityGroupsNegativeTestJSON-811881905 tempest-SecurityGroupsNegativeTestJSON-811881905-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=126126) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:36:02.679576 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-e347c624-1ba6-4d21-b039-d7090c73040f tempest-SecurityGroupsNegativeTestJSON-811881905 tempest-SecurityGroupsNegativeTestJSON-811881905-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 04 16:36:02.679576 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-774a529a-aa80-4bf9-b892-e4e479b92e86'] Aug 04 16:36:02.681995 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e347c624-1ba6-4d21-b039-d7090c73040f tempest-SecurityGroupsNegativeTestJSON-811881905 tempest-SecurityGroupsNegativeTestJSON-811881905-project] Request method failure captured: Aug 04 16:36:02.681995 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/os-security-groups/d3458cad-a4d5-4927-bc80-2697f98a9c45 HTTP/1.1 Aug 04 16:36:02.681995 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:36:02.681995 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:36:02.681995 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:36:02.681995 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:36:02.681995 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:36:02.681995 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:36:02.681995 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:36:02.681995 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:36:02.681995 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_Vseji8B8Rl2E32nZSRxkNYPo8-o8J6mb5UYfJvmIGNhth8CyXHk8VENF4Ve2bIEVkSDOb53102gSYxJ6C2FUzq42L42BSdMBc3h0I760K_rtIroaecrnnQk1Kd5mJcZldXUVTNh0ekzsk3RhF8d_1h2K8cP9xX8x5U6IBy3VO44Mk Aug 04 16:36:02.681995 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:36:02.681995 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:36:02.681995 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:36:02.681995 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:36:02.681995 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:36:02.681995 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:36:02.681995 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 679329d2ec6c4f6b86ec6fe6a24c5c63 Aug 04 16:36:02.681995 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-811881905 Aug 04 16:36:02.681995 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:36:02.681995 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:36:02.683591 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/679329d2ec6c4f6b86ec6fe6a24c5c63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_679329d2ec6c4f6b86ec6fe6a24c5c63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/679329d2ec6c4f6b86ec6fe6a24c5c63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/679329d2ec6c4f6b86ec6fe6a24c5c63"}]}] Aug 04 16:36:02.683591 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-811881905 Aug 04 16:36:02.683591 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 679329d2ec6c4f6b86ec6fe6a24c5c63 Aug 04 16:36:02.683591 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-811881905 Aug 04 16:36:02.683591 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-SecurityGroupsNegativeTestJSON-811881905-project Aug 04 16:36:02.683591 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:36:02.683591 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:36:02.683591 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 141899892c244420928f0672fe384013 Aug 04 16:36:02.683591 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-811881905-project Aug 04 16:36:02.683591 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:36:02.683591 n-d-846466-12 devstack@n-api.service[126126]: exception: Insufficient rights for removing default security group. Aug 04 16:36:02.683591 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-774a529a-aa80-4bf9-b892-e4e479b92e86'] Aug 04 16:36:02.683591 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'd3458cad-a4d5-4927-bc80-2697f98a9c45'} Aug 04 16:36:02.684490 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:36:02.684490 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:36:02.684490 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 04 16:36:02.684490 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 04 16:36:02.684490 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:36:02.684490 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:36:02.684490 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 04 16:36:02.684490 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 04 16:36:02.684490 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:36:02.684490 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:36:02.684490 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 04 16:36:02.684490 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 04 16:36:02.684490 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:36:02.684490 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:36:02.684490 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:36:02.684490 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:36:02.684490 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:36:02.684490 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:36:02.684490 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:36:02.686206 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:36:02.686206 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:36:02.686206 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:36:02.686206 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:36:02.686206 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:36:02.686206 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:36:02.686206 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:36:02.686206 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 04 16:36:02.686206 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-774a529a-aa80-4bf9-b892-e4e479b92e86'] Aug 04 16:36:02.686206 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:36:02.686206 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:36:02.686206 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:36:02.686206 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:36:02.686206 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 04 16:36:02.686206 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 04 16:36:02.686206 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 04 16:36:02.686206 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 04 16:36:02.686206 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 04 16:36:02.686206 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-774a529a-aa80-4bf9-b892-e4e479b92e86'] Aug 04 16:36:02.688856 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:36:02.688856 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:36:02.688856 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:36:02.688856 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:36:02.688856 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:36:02.688856 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:36:02.688856 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:36:02.688856 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:36:02.688856 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:36:02.688856 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:36:02.688856 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:36:02.688856 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:36:02.688856 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 04 16:36:02.688856 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 16:36:02.688856 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 04 16:36:02.688856 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-774a529a-aa80-4bf9-b892-e4e479b92e86'] Aug 04 16:36:02.688856 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:36:02.688856 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:36:02.688856 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:36:02.688856 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:36:02.688856 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:36:02.691775 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:36:02.691775 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:36:02.691775 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:36:02.691775 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 04 16:36:02.691775 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-774a529a-aa80-4bf9-b892-e4e479b92e86'] Aug 04 16:36:02.691775 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:36:02.691775 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e347c624-1ba6-4d21-b039-d7090c73040f tempest-SecurityGroupsNegativeTestJSON-811881905 tempest-SecurityGroupsNegativeTestJSON-811881905-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 04 16:36:02.691775 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-774a529a-aa80-4bf9-b892-e4e479b92e86'] {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:36:02.691775 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e347c624-1ba6-4d21-b039-d7090c73040f tempest-SecurityGroupsNegativeTestJSON-811881905 tempest-SecurityGroupsNegativeTestJSON-811881905-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/d3458cad-a4d5-4927-bc80-2697f98a9c45" status: 400 len: 182 microversion: 2.1 time: 0.703270 Aug 04 16:36:02.691775 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 427/907] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:36:01 2022] DELETE /compute/v2.1/os-security-groups/d3458cad-a4d5-4927-bc80-2697f98a9c45 => generated 182 bytes in 704 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:36:02.693150 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bffdb2f4-37be-4afe-a0f6-9d39b2c6513d tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e3a0933b67db4bb89a018ed57c06415e"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:02.693150 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:36:02.693150 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:36:02.766517 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:36:02.774246 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-bffdb2f4-37be-4afe-a0f6-9d39b2c6513d tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] HTTP exception thrown: Flavor access not found for 39 / e3a0933b67db4bb89a018ed57c06415e combination. Aug 04 16:36:02.776319 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bffdb2f4-37be-4afe-a0f6-9d39b2c6513d tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] Request method failure captured: Aug 04 16:36:02.776319 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/flavors/314721578/action HTTP/1.1 Aug 04 16:36:02.776319 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:36:02.776319 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:36:02.776319 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:36:02.776319 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 70 Aug 04 16:36:02.776319 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:36:02.776319 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:36:02.776319 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:36:02.776319 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:36:02.776319 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_VRfJ6Ed0F3TJwmIBt35GFrAAkEEf_dhjKN8sIGDUK4LxhZtwNXrjznF7xCdLfdgFUPdCykmskFYalbsr-WLPYWUyT93FDgtCANk97uS0PuMDuVq9Izkm7I9stEECx85bvuae_Vqy9arGHjuIxtdH8aemplnTNoEL39wjspDF3ylBg Aug 04 16:36:02.776319 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:36:02.776319 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:36:02.776319 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:36:02.776319 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:36:02.776319 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:36:02.776319 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:36:02.776319 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 3c8b2fe0abd34a8ea766e5df55f8efd0 Aug 04 16:36:02.776319 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-958940071 Aug 04 16:36:02.776319 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader,admin Aug 04 16:36:02.776319 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader,admin Aug 04 16:36:02.778057 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c8b2fe0abd34a8ea766e5df55f8efd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3c8b2fe0abd34a8ea766e5df55f8efd0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c8b2fe0abd34a8ea766e5df55f8efd0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3c8b2fe0abd34a8ea766e5df55f8efd0"}]}] Aug 04 16:36:02.778057 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-958940071 Aug 04 16:36:02.778057 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 3c8b2fe0abd34a8ea766e5df55f8efd0 Aug 04 16:36:02.778057 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-958940071 Aug 04 16:36:02.778057 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin Aug 04 16:36:02.778057 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:36:02.778057 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:36:02.778057 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 402db49c379f4792a5c74af8181f0721 Aug 04 16:36:02.778057 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin Aug 04 16:36:02.778057 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 16:36:02.778057 n-d-846466-12 devstack@n-api.service[126126]: {"removeTenantAccess": {"tenant": "e3a0933b67db4bb89a018ed57c06415e"}} Aug 04 16:36:02.778057 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:36:02.778900 n-d-846466-12 devstack@n-api.service[126126]: exception: Flavor access not found for 39 / e3a0933b67db4bb89a018ed57c06415e combination. Aug 04 16:36:02.778900 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '314721578', 'body': {'removeTenantAccess': {'tenant': 'e3a0933b67db4bb89a018ed57c06415e'}}} Aug 04 16:36:02.778900 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:36:02.778900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:36:02.778900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 04 16:36:02.778900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 04 16:36:02.778900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 04 16:36:02.778900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 04 16:36:02.778900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 04 16:36:02.778900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 04 16:36:02.778900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 04 16:36:02.778900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 04 16:36:02.778900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 04 16:36:02.778900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 04 16:36:02.778900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:36:02.778900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:36:02.778900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 04 16:36:02.778900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 04 16:36:02.780924 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 39 / e3a0933b67db4bb89a018ed57c06415e combination. Aug 04 16:36:02.780924 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:36:02.780924 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:36:02.780924 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:36:02.780924 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:36:02.780924 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:36:02.780924 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:36:02.780924 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:36:02.780924 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:36:02.780924 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:36:02.780924 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:36:02.780924 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:36:02.780924 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:36:02.780924 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 04 16:36:02.780924 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:36:02.780924 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 39 / e3a0933b67db4bb89a018ed57c06415e combination. Aug 04 16:36:02.780924 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:36:02.780924 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:36:02.780924 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:36:02.780924 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:36:02.782343 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:36:02.782343 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:36:02.782343 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:36:02.782343 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:36:02.782343 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 39 / e3a0933b67db4bb89a018ed57c06415e combination. Aug 04 16:36:02.782343 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:36:02.782343 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bffdb2f4-37be-4afe-a0f6-9d39b2c6513d tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] Returning 404 to user: Flavor access not found for 39 / e3a0933b67db4bb89a018ed57c06415e combination. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:36:02.782343 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bffdb2f4-37be-4afe-a0f6-9d39b2c6513d tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/314721578/action" status: 404 len: 124 microversion: 2.1 time: 0.092234 Aug 04 16:36:02.782343 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 428/908] 10.222.0.23 () {60 vars in 1197 bytes} [Thu Aug 4 16:36:02 2022] POST /compute/v2.1/flavors/314721578/action => generated 124 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:36:02.789533 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cdf7c600-ba3b-4118-9f59-299f486456ce tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:02.790158 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cdf7c600-ba3b-4118-9f59-299f486456ce tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 6017510a-e331-424a-843d-54b980b999fb] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:02.799091 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cdf7c600-ba3b-4118-9f59-299f486456ce tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:02.799491 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cdf7c600-ba3b-4118-9f59-299f486456ce tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:02.800274 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cdf7c600-ba3b-4118-9f59-299f486456ce tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:02.800694 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cdf7c600-ba3b-4118-9f59-299f486456ce tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:03.452055 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cdf7c600-ba3b-4118-9f59-299f486456ce tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:03.461810 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cdf7c600-ba3b-4118-9f59-299f486456ce tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:03.463531 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cdf7c600-ba3b-4118-9f59-299f486456ce tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:03.464823 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cdf7c600-ba3b-4118-9f59-299f486456ce tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb" status: 200 len: 1566 microversion: 2.25 time: 0.685563 Aug 04 16:36:03.465753 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 429/909] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:36:02 2022] GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb => generated 1566 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:36:03.471311 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-a1bf695a-ff91-45ca-a2e1-5f8d99a3021d req-c2cb88e5-5479-4dc1-8af5-f4b07555cce2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8305b506-e5ac-4e19-97ea-4530d4ec87c1", "tag": "88499859-554c-4372-a84a-c0c261083f9b"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:03.481919 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a1bf695a-ff91-45ca-a2e1-5f8d99a3021d req-c2cb88e5-5479-4dc1-8af5-f4b07555cce2 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:03.482376 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a1bf695a-ff91-45ca-a2e1-5f8d99a3021d req-c2cb88e5-5479-4dc1-8af5-f4b07555cce2 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:03.495080 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-a1bf695a-ff91-45ca-a2e1-5f8d99a3021d req-c2cb88e5-5479-4dc1-8af5-f4b07555cce2 service nova] Creating event network-changed:88499859-554c-4372-a84a-c0c261083f9b for instance 8305b506-e5ac-4e19-97ea-4530d4ec87c1 on n-h2-846466-12 Aug 04 16:36:03.500522 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-a1bf695a-ff91-45ca-a2e1-5f8d99a3021d req-c2cb88e5-5479-4dc1-8af5-f4b07555cce2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033371 Aug 04 16:36:03.501609 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 430/910] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:36:03.506816 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d7a25bd9-a56c-40dd-8883-8999c199ac43 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:03.507387 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d7a25bd9-a56c-40dd-8883-8999c199ac43 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:03.513989 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d7a25bd9-a56c-40dd-8883-8999c199ac43 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:03.514929 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d7a25bd9-a56c-40dd-8883-8999c199ac43 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:03.516081 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d7a25bd9-a56c-40dd-8883-8999c199ac43 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:03.516955 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d7a25bd9-a56c-40dd-8883-8999c199ac43 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:03.655079 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d7a25bd9-a56c-40dd-8883-8999c199ac43 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.152181 Aug 04 16:36:03.655926 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 431/911] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Aug 4 16:36:03 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159/os-interface => generated 284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:36:03.663111 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f83a107e-999b-4142-a90e-19a028a51aaf tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:03.664542 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f83a107e-999b-4142-a90e-19a028a51aaf tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] [instance: 2503f8ac-e7f9-432d-8b3b-271d1a179572] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:03.671352 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f83a107e-999b-4142-a90e-19a028a51aaf tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:03.672635 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f83a107e-999b-4142-a90e-19a028a51aaf tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:03.673483 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f83a107e-999b-4142-a90e-19a028a51aaf tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:03.673920 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f83a107e-999b-4142-a90e-19a028a51aaf tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:03.890546 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f83a107e-999b-4142-a90e-19a028a51aaf tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5f11c99c841c4a7e7af4d7a4a5d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa4a23e6e71405f82347cd1cbbe3f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:03.904304 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f83a107e-999b-4142-a90e-19a028a51aaf tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] 10.222.0.23 "GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572" status: 200 len: 1556 microversion: 2.1 time: 0.247057 Aug 04 16:36:03.906447 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 432/912] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:03 2022] GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572 => generated 1556 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:03.912402 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2e4e99ab-da3e-4d00-b844-f2bb955032e1 tempest-SecurityGroupsNegativeTestJSON-811881905 tempest-SecurityGroupsNegativeTestJSON-811881905-project] Calling method '.version_select at 0x7f7e872c39d0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:03.964455 n-d-846466-12 devstack@n-api.service[126126]: DEBUG neutronclient.v2_0.client [None req-2e4e99ab-da3e-4d00-b844-f2bb955032e1 tempest-SecurityGroupsNegativeTestJSON-811881905 tempest-SecurityGroupsNegativeTestJSON-811881905-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group be06773b-0216-42f7-845d-720dacf73709 does not exist", "detail": ""}} {{(pid=126126) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:36:03.965275 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.security_group_api [None req-2e4e99ab-da3e-4d00-b844-f2bb955032e1 tempest-SecurityGroupsNegativeTestJSON-811881905 tempest-SecurityGroupsNegativeTestJSON-811881905-project] Neutron security group be06773b-0216-42f7-845d-720dacf73709 not found {{(pid=126126) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 16:36:03.965962 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-2e4e99ab-da3e-4d00-b844-f2bb955032e1 tempest-SecurityGroupsNegativeTestJSON-811881905 tempest-SecurityGroupsNegativeTestJSON-811881905-project] HTTP exception thrown: Security group be06773b-0216-42f7-845d-720dacf73709 does not exist Aug 04 16:36:03.965962 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-22a12b5b-5459-436a-a596-b64dacc114a7'] Aug 04 16:36:03.968973 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2e4e99ab-da3e-4d00-b844-f2bb955032e1 tempest-SecurityGroupsNegativeTestJSON-811881905 tempest-SecurityGroupsNegativeTestJSON-811881905-project] Request method failure captured: Aug 04 16:36:03.968973 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/os-security-groups/be06773b-0216-42f7-845d-720dacf73709 HTTP/1.1 Aug 04 16:36:03.968973 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:36:03.968973 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:36:03.968973 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:36:03.968973 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:36:03.968973 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:36:03.968973 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:36:03.968973 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:36:03.968973 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:36:03.968973 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_Vseji8B8Rl2E32nZSRxkNYPo8-o8J6mb5UYfJvmIGNhth8CyXHk8VENF4Ve2bIEVkSDOb53102gSYxJ6C2FUzq42L42BSdMBc3h0I760K_rtIroaecrnnQk1Kd5mJcZldXUVTNh0ekzsk3RhF8d_1h2K8cP9xX8x5U6IBy3VO44Mk Aug 04 16:36:03.968973 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:36:03.968973 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:36:03.968973 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:36:03.968973 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:36:03.968973 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:36:03.968973 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:36:03.968973 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 679329d2ec6c4f6b86ec6fe6a24c5c63 Aug 04 16:36:03.968973 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-811881905 Aug 04 16:36:03.968973 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:36:03.968973 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:36:03.970736 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/679329d2ec6c4f6b86ec6fe6a24c5c63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_679329d2ec6c4f6b86ec6fe6a24c5c63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/679329d2ec6c4f6b86ec6fe6a24c5c63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/679329d2ec6c4f6b86ec6fe6a24c5c63"}]}] Aug 04 16:36:03.970736 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-811881905 Aug 04 16:36:03.970736 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 679329d2ec6c4f6b86ec6fe6a24c5c63 Aug 04 16:36:03.970736 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-811881905 Aug 04 16:36:03.970736 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-SecurityGroupsNegativeTestJSON-811881905-project Aug 04 16:36:03.970736 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:36:03.970736 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:36:03.970736 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 141899892c244420928f0672fe384013 Aug 04 16:36:03.970736 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-811881905-project Aug 04 16:36:03.970736 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:36:03.970736 n-d-846466-12 devstack@n-api.service[126126]: exception: Security group be06773b-0216-42f7-845d-720dacf73709 does not exist Aug 04 16:36:03.970736 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-22a12b5b-5459-436a-a596-b64dacc114a7'] Aug 04 16:36:03.970736 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'be06773b-0216-42f7-845d-720dacf73709'} Aug 04 16:36:03.971577 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:36:03.971577 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:36:03.971577 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 16:36:03.971577 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 16:36:03.971577 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:36:03.971577 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:36:03.971577 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 16:36:03.971577 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 16:36:03.971577 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:36:03.971577 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:36:03.971577 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 16:36:03.971577 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 16:36:03.971577 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:36:03.971577 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:36:03.971577 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:36:03.971577 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:36:03.971577 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:36:03.971577 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:36:03.971577 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:36:03.972759 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:36:03.972759 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:36:03.972759 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:36:03.972759 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:36:03.972759 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:36:03.972759 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:36:03.972759 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:36:03.972759 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group be06773b-0216-42f7-845d-720dacf73709 does not exist Aug 04 16:36:03.972759 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22a12b5b-5459-436a-a596-b64dacc114a7'] Aug 04 16:36:03.972759 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:36:03.972759 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:36:03.972759 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:36:03.972759 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:36:03.972759 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 04 16:36:03.972759 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 16:36:03.972759 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 16:36:03.972759 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 16:36:03.972759 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group be06773b-0216-42f7-845d-720dacf73709 does not exist Aug 04 16:36:03.974047 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22a12b5b-5459-436a-a596-b64dacc114a7'] Aug 04 16:36:03.974047 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:36:03.974047 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:36:03.974047 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:36:03.974047 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:36:03.974047 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:36:03.974047 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:36:03.974047 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:36:03.974047 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:36:03.974047 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:36:03.974047 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:36:03.974047 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:36:03.974047 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:36:03.974047 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 04 16:36:03.974047 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 16:36:03.974047 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group be06773b-0216-42f7-845d-720dacf73709 does not exist Aug 04 16:36:03.974047 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22a12b5b-5459-436a-a596-b64dacc114a7'] Aug 04 16:36:03.974047 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:36:03.974047 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:36:03.974047 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:36:03.974047 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:36:03.975577 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:36:03.975577 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:36:03.975577 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:36:03.975577 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:36:03.975577 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group be06773b-0216-42f7-845d-720dacf73709 does not exist Aug 04 16:36:03.975577 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22a12b5b-5459-436a-a596-b64dacc114a7'] Aug 04 16:36:03.975577 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:36:03.975577 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2e4e99ab-da3e-4d00-b844-f2bb955032e1 tempest-SecurityGroupsNegativeTestJSON-811881905 tempest-SecurityGroupsNegativeTestJSON-811881905-project] Returning 404 to user: Security group be06773b-0216-42f7-845d-720dacf73709 does not exist Aug 04 16:36:03.975577 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-22a12b5b-5459-436a-a596-b64dacc114a7'] {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:36:03.975577 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2e4e99ab-da3e-4d00-b844-f2bb955032e1 tempest-SecurityGroupsNegativeTestJSON-811881905 tempest-SecurityGroupsNegativeTestJSON-811881905-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/be06773b-0216-42f7-845d-720dacf73709" status: 404 len: 194 microversion: 2.1 time: 0.062922 Aug 04 16:36:03.975577 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 433/913] 10.222.0.23 () {58 vars in 1269 bytes} [Thu Aug 4 16:36:03 2022] GET /compute/v2.1/os-security-groups/be06773b-0216-42f7-845d-720dacf73709 => generated 194 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:36:03.985546 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7052e50f-db54-4bc6-9c1f-0c6799af2e88 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:03.986450 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:36:03.986450 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:36:03.995692 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c4bf34ce-3c98-4e19-acd7-8f727d9b9f61 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/2b59746f-75e9-4d14-a960-669d6441c72c" status: 202 len: 0 microversion: 2.1 time: 1.837664 Aug 04 16:36:03.996289 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 481/914] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Aug 4 16:36:02 2022] DELETE /compute/v2.1/os-floating-ips/2b59746f-75e9-4d14-a960-669d6441c72c => generated 0 bytes in 1840 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:36:04.002947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-794d3507-cf65-438d-83e6-687ee92054e8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:04.003679 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-794d3507-cf65-438d-83e6-687ee92054e8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:04.011467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-794d3507-cf65-438d-83e6-687ee92054e8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:04.012002 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-794d3507-cf65-438d-83e6-687ee92054e8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:04.012894 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-794d3507-cf65-438d-83e6-687ee92054e8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:04.014054 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-794d3507-cf65-438d-83e6-687ee92054e8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:04.017084 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7052e50f-db54-4bc6-9c1f-0c6799af2e88 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/314721578" status: 202 len: 0 microversion: 2.1 time: 0.044260 Aug 04 16:36:04.017954 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 434/915] 10.222.0.23 () {58 vars in 1158 bytes} [Thu Aug 4 16:36:03 2022] DELETE /compute/v2.1/flavors/314721578 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:36:04.023378 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3da6c69c-dcd7-4e3c-bc4c-4e4454a7ff59 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:04.024122 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3da6c69c-dcd7-4e3c-bc4c-4e4454a7ff59 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:04.030631 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3da6c69c-dcd7-4e3c-bc4c-4e4454a7ff59 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:04.031259 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3da6c69c-dcd7-4e3c-bc4c-4e4454a7ff59 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:04.032264 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3da6c69c-dcd7-4e3c-bc4c-4e4454a7ff59 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:04.032790 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3da6c69c-dcd7-4e3c-bc4c-4e4454a7ff59 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:04.130332 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-3da6c69c-dcd7-4e3c-bc4c-4e4454a7ff59 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lazy-loading 'services' on Instance uuid effb9df8-4005-4b3b-a58e-41b5ba36b5c5 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:36:04.150707 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3da6c69c-dcd7-4e3c-bc4c-4e4454a7ff59 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1929 microversion: 2.75 time: 0.131420 Aug 04 16:36:04.151454 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 435/916] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:36:04 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1929 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:36:04.157485 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a59bc6df-944d-4c0c-86eb-c865acc4d3b3 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:04.158359 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a59bc6df-944d-4c0c-86eb-c865acc4d3b3 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] [instance: 2503f8ac-e7f9-432d-8b3b-271d1a179572] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:04.177240 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a59bc6df-944d-4c0c-86eb-c865acc4d3b3 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:04.178103 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a59bc6df-944d-4c0c-86eb-c865acc4d3b3 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:04.179134 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a59bc6df-944d-4c0c-86eb-c865acc4d3b3 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:04.179825 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a59bc6df-944d-4c0c-86eb-c865acc4d3b3 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:04.275575 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-794d3507-cf65-438d-83e6-687ee92054e8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:04.284663 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-794d3507-cf65-438d-83e6-687ee92054e8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1313 microversion: 2.1 time: 0.286923 Aug 04 16:36:04.285690 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 482/917] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:03 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:04.293728 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0720ec98-5414-447a-b0aa-ea245fbb9f70 tempest-SecurityGroupsNegativeTestJSON-811881905 tempest-SecurityGroupsNegativeTestJSON-811881905-project] Action: 'update', calling method: .version_select at 0x7f7e8492d790>, body: {"security_group": {"name": "tempest-sg-216243377", "description": "tempest-description-1514581491"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:04.338033 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a59bc6df-944d-4c0c-86eb-c865acc4d3b3 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] 10.222.0.23 "GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.184971 Aug 04 16:36:04.351796 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 436/918] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Aug 4 16:36:04 2022] GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572/os-interface => generated 285 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:36:04.352404 n-d-846466-12 devstack@n-api.service[126125]: DEBUG neutronclient.v2_0.client [None req-0720ec98-5414-447a-b0aa-ea245fbb9f70 tempest-SecurityGroupsNegativeTestJSON-811881905 tempest-SecurityGroupsNegativeTestJSON-811881905-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group de0c11d6-e434-45e0-bb04-6e6d0feea182 does not exist", "detail": ""}} {{(pid=126125) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:36:04.352404 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.security_group_api [None req-0720ec98-5414-447a-b0aa-ea245fbb9f70 tempest-SecurityGroupsNegativeTestJSON-811881905 tempest-SecurityGroupsNegativeTestJSON-811881905-project] Neutron security group de0c11d6-e434-45e0-bb04-6e6d0feea182 not found {{(pid=126125) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 16:36:04.352404 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-0720ec98-5414-447a-b0aa-ea245fbb9f70 tempest-SecurityGroupsNegativeTestJSON-811881905 tempest-SecurityGroupsNegativeTestJSON-811881905-project] HTTP exception thrown: Security group de0c11d6-e434-45e0-bb04-6e6d0feea182 does not exist Aug 04 16:36:04.352404 n-d-846466-12 devstack@n-api.service[126125]: Neutron server returns request_ids: ['req-4c974c15-b3da-4a74-904a-09700b6b7768'] Aug 04 16:36:04.352404 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0720ec98-5414-447a-b0aa-ea245fbb9f70 tempest-SecurityGroupsNegativeTestJSON-811881905 tempest-SecurityGroupsNegativeTestJSON-811881905-project] Request method failure captured: Aug 04 16:36:04.352404 n-d-846466-12 devstack@n-api.service[126125]: request: PUT /compute/v2.1/os-security-groups/de0c11d6-e434-45e0-bb04-6e6d0feea182 HTTP/1.1 Aug 04 16:36:04.352404 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:36:04.352404 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:36:04.352404 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:36:04.352404 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 101 Aug 04 16:36:04.352404 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:36:04.352404 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:36:04.352404 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:36:04.352404 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:36:04.354929 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_Vseji8B8Rl2E32nZSRxkNYPo8-o8J6mb5UYfJvmIGNhth8CyXHk8VENF4Ve2bIEVkSDOb53102gSYxJ6C2FUzq42L42BSdMBc3h0I760K_rtIroaecrnnQk1Kd5mJcZldXUVTNh0ekzsk3RhF8d_1h2K8cP9xX8x5U6IBy3VO44Mk Aug 04 16:36:04.354929 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:36:04.354929 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:36:04.354929 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:36:04.354929 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:36:04.354929 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:36:04.354929 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:36:04.354929 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 679329d2ec6c4f6b86ec6fe6a24c5c63 Aug 04 16:36:04.354929 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-811881905 Aug 04 16:36:04.354929 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:36:04.354929 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:36:04.354929 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/679329d2ec6c4f6b86ec6fe6a24c5c63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_679329d2ec6c4f6b86ec6fe6a24c5c63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/679329d2ec6c4f6b86ec6fe6a24c5c63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/679329d2ec6c4f6b86ec6fe6a24c5c63"}]}] Aug 04 16:36:04.354929 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-811881905 Aug 04 16:36:04.354929 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 679329d2ec6c4f6b86ec6fe6a24c5c63 Aug 04 16:36:04.354929 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-811881905 Aug 04 16:36:04.356791 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-SecurityGroupsNegativeTestJSON-811881905-project Aug 04 16:36:04.356791 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:36:04.356791 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:36:04.356791 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 141899892c244420928f0672fe384013 Aug 04 16:36:04.356791 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-811881905-project Aug 04 16:36:04.356791 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:36:04.356791 n-d-846466-12 devstack@n-api.service[126125]: {"security_group": {"name": "tempest-sg-216243377", "description": "tempest-description-1514581491"}} Aug 04 16:36:04.356791 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:36:04.356791 n-d-846466-12 devstack@n-api.service[126125]: exception: Security group de0c11d6-e434-45e0-bb04-6e6d0feea182 does not exist Aug 04 16:36:04.356791 n-d-846466-12 devstack@n-api.service[126125]: Neutron server returns request_ids: ['req-4c974c15-b3da-4a74-904a-09700b6b7768'] Aug 04 16:36:04.356791 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'de0c11d6-e434-45e0-bb04-6e6d0feea182', 'body': {'security_group': {'name': 'tempest-sg-216243377', 'description': 'tempest-description-1514581491'}}} Aug 04 16:36:04.356791 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:36:04.356791 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:36:04.356791 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 16:36:04.356791 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 16:36:04.356791 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:36:04.356791 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:36:04.356791 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 16:36:04.356791 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 16:36:04.356791 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:36:04.356791 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:36:04.356791 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 16:36:04.356791 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 16:36:04.359598 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:36:04.359598 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:36:04.359598 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:36:04.359598 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:36:04.359598 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:36:04.359598 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:36:04.359598 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:36:04.359598 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:36:04.359598 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:36:04.359598 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:36:04.359598 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:36:04.359598 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:36:04.359598 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:36:04.359598 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:36:04.359598 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group de0c11d6-e434-45e0-bb04-6e6d0feea182 does not exist Aug 04 16:36:04.359598 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c974c15-b3da-4a74-904a-09700b6b7768'] Aug 04 16:36:04.359598 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:36:04.359598 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:36:04.359598 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:36:04.367000 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:36:04.367000 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 04 16:36:04.367000 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 16:36:04.367000 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 16:36:04.367000 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 16:36:04.367000 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group de0c11d6-e434-45e0-bb04-6e6d0feea182 does not exist Aug 04 16:36:04.367000 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c974c15-b3da-4a74-904a-09700b6b7768'] Aug 04 16:36:04.367000 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:36:04.367000 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:36:04.367000 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:36:04.367000 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:36:04.367000 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:36:04.367000 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:36:04.367000 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:36:04.367000 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:36:04.367000 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:36:04.367000 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:36:04.367000 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:36:04.367000 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:36:04.367000 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 04 16:36:04.371891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 16:36:04.371891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group de0c11d6-e434-45e0-bb04-6e6d0feea182 does not exist Aug 04 16:36:04.371891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c974c15-b3da-4a74-904a-09700b6b7768'] Aug 04 16:36:04.371891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:36:04.371891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:36:04.371891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:36:04.371891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:36:04.371891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:36:04.371891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:36:04.371891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:36:04.371891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:36:04.371891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group de0c11d6-e434-45e0-bb04-6e6d0feea182 does not exist Aug 04 16:36:04.371891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c974c15-b3da-4a74-904a-09700b6b7768'] Aug 04 16:36:04.371891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:36:04.371891 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0720ec98-5414-447a-b0aa-ea245fbb9f70 tempest-SecurityGroupsNegativeTestJSON-811881905 tempest-SecurityGroupsNegativeTestJSON-811881905-project] Returning 404 to user: Security group de0c11d6-e434-45e0-bb04-6e6d0feea182 does not exist Aug 04 16:36:04.371891 n-d-846466-12 devstack@n-api.service[126125]: Neutron server returns request_ids: ['req-4c974c15-b3da-4a74-904a-09700b6b7768'] {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:36:04.375664 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0720ec98-5414-447a-b0aa-ea245fbb9f70 tempest-SecurityGroupsNegativeTestJSON-811881905 tempest-SecurityGroupsNegativeTestJSON-811881905-project] 10.222.0.23 "PUT /compute/v2.1/os-security-groups/de0c11d6-e434-45e0-bb04-6e6d0feea182" status: 404 len: 194 microversion: 2.1 time: 0.066261 Aug 04 16:36:04.376242 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c9f5e2a8-9dfa-4d8c-a9a2-421ec1aa0648 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:04.376242 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c9f5e2a8-9dfa-4d8c-a9a2-421ec1aa0648 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 35b3ee83-f946-4c4c-bff9-80b8bd368788] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:04.377428 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 483/919] 10.222.0.23 () {60 vars in 1290 bytes} [Thu Aug 4 16:36:04 2022] PUT /compute/v2.1/os-security-groups/de0c11d6-e434-45e0-bb04-6e6d0feea182 => generated 194 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:36:04.377428 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bca403da-0b9e-4eb1-bd39-bf78b89fd218 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:04.386882 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9f5e2a8-9dfa-4d8c-a9a2-421ec1aa0648 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:04.387626 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9f5e2a8-9dfa-4d8c-a9a2-421ec1aa0648 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:04.391262 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bca403da-0b9e-4eb1-bd39-bf78b89fd218 tempest-FlavorsAccessNegativeTestJSON-958940071 tempest-FlavorsAccessNegativeTestJSON-958940071-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029092 Aug 04 16:36:04.391728 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9f5e2a8-9dfa-4d8c-a9a2-421ec1aa0648 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:04.392468 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 484/920] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:36:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:04.392702 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9f5e2a8-9dfa-4d8c-a9a2-421ec1aa0648 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:04.466376 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c9f5e2a8-9dfa-4d8c-a9a2-421ec1aa0648 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 35b3ee83-f946-4c4c-bff9-80b8bd368788] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:36:04.489594 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-59e1f9ca-c265-49ea-8374-2a4c59a74c2e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:04.490355 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-59e1f9ca-c265-49ea-8374-2a4c59a74c2e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 6017510a-e331-424a-843d-54b980b999fb] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:04.501832 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-59e1f9ca-c265-49ea-8374-2a4c59a74c2e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:04.502809 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-59e1f9ca-c265-49ea-8374-2a4c59a74c2e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:04.504402 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-59e1f9ca-c265-49ea-8374-2a4c59a74c2e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:04.505173 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-59e1f9ca-c265-49ea-8374-2a4c59a74c2e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:04.635247 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c9f5e2a8-9dfa-4d8c-a9a2-421ec1aa0648 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "DELETE /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788" status: 204 len: 0 microversion: 2.1 time: 0.293380 Aug 04 16:36:04.636710 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 437/921] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:36:04 2022] DELETE /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:36:04.653483 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-99fb3101-89ff-4460-ae74-77ea3c269325 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:04.655024 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-99fb3101-89ff-4460-ae74-77ea3c269325 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 35b3ee83-f946-4c4c-bff9-80b8bd368788] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:04.666853 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-99fb3101-89ff-4460-ae74-77ea3c269325 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:04.667263 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-99fb3101-89ff-4460-ae74-77ea3c269325 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:04.669638 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-99fb3101-89ff-4460-ae74-77ea3c269325 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:04.671701 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-99fb3101-89ff-4460-ae74-77ea3c269325 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:04.911259 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-59e1f9ca-c265-49ea-8374-2a4c59a74c2e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:04.926845 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-59e1f9ca-c265-49ea-8374-2a4c59a74c2e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:04.929926 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-59e1f9ca-c265-49ea-8374-2a4c59a74c2e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:04.931903 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-59e1f9ca-c265-49ea-8374-2a4c59a74c2e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb" status: 200 len: 1566 microversion: 2.25 time: 0.447419 Aug 04 16:36:04.945984 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 485/922] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:36:04 2022] GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb => generated 1566 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:36:05.015869 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-99fb3101-89ff-4460-ae74-77ea3c269325 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a732f446814c9fa080979bef241023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f22de02d3e4db281f6372e8191b95f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:05.024398 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-99fb3101-89ff-4460-ae74-77ea3c269325 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "GET /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788" status: 200 len: 1527 microversion: 2.1 time: 0.381851 Aug 04 16:36:05.025224 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 438/923] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:04 2022] GET /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788 => generated 1527 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:05.183095 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-39147a06-31a8-4bee-9fe7-2607c240f829 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:05.183920 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-39147a06-31a8-4bee-9fe7-2607c240f829 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:05.186281 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:36:05.187324 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:36:05.194531 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-39147a06-31a8-4bee-9fe7-2607c240f829 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:05.195131 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-39147a06-31a8-4bee-9fe7-2607c240f829 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:05.196043 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-39147a06-31a8-4bee-9fe7-2607c240f829 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:05.196583 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-39147a06-31a8-4bee-9fe7-2607c240f829 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:05.297081 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-39147a06-31a8-4bee-9fe7-2607c240f829 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lazy-loading 'services' on Instance uuid effb9df8-4005-4b3b-a58e-41b5ba36b5c5 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:36:05.309881 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3709c145-8718-46f1-9cb2-4b8189c2987b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:05.310568 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3709c145-8718-46f1-9cb2-4b8189c2987b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:05.319301 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3709c145-8718-46f1-9cb2-4b8189c2987b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:05.319920 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3709c145-8718-46f1-9cb2-4b8189c2987b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:05.320742 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3709c145-8718-46f1-9cb2-4b8189c2987b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:05.322180 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-39147a06-31a8-4bee-9fe7-2607c240f829 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1929 microversion: 2.75 time: 0.143212 Aug 04 16:36:05.323778 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 486/924] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:36:05 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1929 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:36:05.335141 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3709c145-8718-46f1-9cb2-4b8189c2987b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:05.763717 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3709c145-8718-46f1-9cb2-4b8189c2987b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:05.787922 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3709c145-8718-46f1-9cb2-4b8189c2987b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1313 microversion: 2.1 time: 0.482866 Aug 04 16:36:05.789816 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 439/925] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:05 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1313 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:05.927024 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-df4496e6-3afa-4c28-995f-b6a351268fa6 req-3394a7b9-3744-47c6-ad15-2359bdea3a88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b359364c-f234-4d01-9c08-e6df8a21f159", "tag": "490cb30e-cef0-49db-a9ae-179c72d887af"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:05.956776 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-244063de-a289-4c4a-b0af-abf6344aabe7 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:05.957531 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-244063de-a289-4c4a-b0af-abf6344aabe7 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 6017510a-e331-424a-843d-54b980b999fb] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:05.958529 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-df4496e6-3afa-4c28-995f-b6a351268fa6 req-3394a7b9-3744-47c6-ad15-2359bdea3a88 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:05.959157 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-df4496e6-3afa-4c28-995f-b6a351268fa6 req-3394a7b9-3744-47c6-ad15-2359bdea3a88 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:05.967484 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-244063de-a289-4c4a-b0af-abf6344aabe7 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:05.968217 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-244063de-a289-4c4a-b0af-abf6344aabe7 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:05.969166 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-244063de-a289-4c4a-b0af-abf6344aabe7 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:05.969787 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-244063de-a289-4c4a-b0af-abf6344aabe7 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:05.980418 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-df4496e6-3afa-4c28-995f-b6a351268fa6 req-3394a7b9-3744-47c6-ad15-2359bdea3a88 service nova] Creating event network-changed:490cb30e-cef0-49db-a9ae-179c72d887af for instance b359364c-f234-4d01-9c08-e6df8a21f159 on n-h1-846466-12 Aug 04 16:36:05.985998 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-df4496e6-3afa-4c28-995f-b6a351268fa6 req-3394a7b9-3744-47c6-ad15-2359bdea3a88 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062773 Aug 04 16:36:05.986893 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 487/926] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:36:06.046218 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-949b7b02-5f1a-40a0-84d5-f512c6d3f2a8 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:06.047585 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-949b7b02-5f1a-40a0-84d5-f512c6d3f2a8 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 35b3ee83-f946-4c4c-bff9-80b8bd368788] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:06.054620 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-949b7b02-5f1a-40a0-84d5-f512c6d3f2a8 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:06.055341 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-949b7b02-5f1a-40a0-84d5-f512c6d3f2a8 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:06.056333 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-949b7b02-5f1a-40a0-84d5-f512c6d3f2a8 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:06.056921 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-949b7b02-5f1a-40a0-84d5-f512c6d3f2a8 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:06.629036 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-244063de-a289-4c4a-b0af-abf6344aabe7 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:06.711043 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-244063de-a289-4c4a-b0af-abf6344aabe7 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:06.717555 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-244063de-a289-4c4a-b0af-abf6344aabe7 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:06.724504 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-244063de-a289-4c4a-b0af-abf6344aabe7 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb" status: 200 len: 1566 microversion: 2.25 time: 0.772220 Aug 04 16:36:06.728419 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 440/927] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:36:05 2022] GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb => generated 1566 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:36:06.741745 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ec590fc2-9436-4aa1-a99c-c1cf33274c26 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:06.745605 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ec590fc2-9436-4aa1-a99c-c1cf33274c26 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:06.770237 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ec590fc2-9436-4aa1-a99c-c1cf33274c26 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:06.770955 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ec590fc2-9436-4aa1-a99c-c1cf33274c26 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:06.772699 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ec590fc2-9436-4aa1-a99c-c1cf33274c26 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:06.773266 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ec590fc2-9436-4aa1-a99c-c1cf33274c26 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:06.893127 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=4,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:36:07.208244 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-949b7b02-5f1a-40a0-84d5-f512c6d3f2a8 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a732f446814c9fa080979bef241023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f22de02d3e4db281f6372e8191b95f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:07.282644 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-949b7b02-5f1a-40a0-84d5-f512c6d3f2a8 tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "GET /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788" status: 200 len: 1527 microversion: 2.1 time: 1.240657 Aug 04 16:36:07.290163 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 488/928] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:06 2022] GET /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788 => generated 1527 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:07.315398 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c0185484-d932-444e-a137-d59e25c86782 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:07.320560 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c0185484-d932-444e-a137-d59e25c86782 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:07.346592 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0185484-d932-444e-a137-d59e25c86782 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:07.350780 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0185484-d932-444e-a137-d59e25c86782 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:07.352315 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0185484-d932-444e-a137-d59e25c86782 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:07.356232 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0185484-d932-444e-a137-d59e25c86782 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:07.543275 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-ec590fc2-9436-4aa1-a99c-c1cf33274c26 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lazy-loading 'services' on Instance uuid effb9df8-4005-4b3b-a58e-41b5ba36b5c5 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:36:07.627626 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ec590fc2-9436-4aa1-a99c-c1cf33274c26 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1935 microversion: 2.75 time: 0.892559 Aug 04 16:36:07.634798 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 441/929] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:36:06 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1935 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:36:07.655126 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-01ee94a9-6904-4ec7-b467-332f2291bc8e req-d703bacb-f618-4eb4-af08-49c29cef0ecb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2503f8ac-e7f9-432d-8b3b-271d1a179572", "tag": "69ff9322-6be1-4474-843b-3eaa1b1520b2"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:07.747918 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-01ee94a9-6904-4ec7-b467-332f2291bc8e req-d703bacb-f618-4eb4-af08-49c29cef0ecb service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:07.757620 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-01ee94a9-6904-4ec7-b467-332f2291bc8e req-d703bacb-f618-4eb4-af08-49c29cef0ecb service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:07.841621 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-01ee94a9-6904-4ec7-b467-332f2291bc8e req-d703bacb-f618-4eb4-af08-49c29cef0ecb service nova] Creating event network-changed:69ff9322-6be1-4474-843b-3eaa1b1520b2 for instance 2503f8ac-e7f9-432d-8b3b-271d1a179572 on n-h1-846466-12 Aug 04 16:36:07.852117 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-01ee94a9-6904-4ec7-b467-332f2291bc8e req-d703bacb-f618-4eb4-af08-49c29cef0ecb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.215521 Aug 04 16:36:07.856604 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 442/930] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:36:07.875534 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3a1fbbe2-61d6-45d0-b4b2-e9aeaf1c0af3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:07.876282 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3a1fbbe2-61d6-45d0-b4b2-e9aeaf1c0af3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 6017510a-e331-424a-843d-54b980b999fb] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:07.894386 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a1fbbe2-61d6-45d0-b4b2-e9aeaf1c0af3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:07.894841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a1fbbe2-61d6-45d0-b4b2-e9aeaf1c0af3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:07.895629 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a1fbbe2-61d6-45d0-b4b2-e9aeaf1c0af3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:07.896061 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a1fbbe2-61d6-45d0-b4b2-e9aeaf1c0af3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:08.584744 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c0185484-d932-444e-a137-d59e25c86782 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:08.636431 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c0185484-d932-444e-a137-d59e25c86782 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1313 microversion: 2.1 time: 1.343586 Aug 04 16:36:08.637463 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 489/931] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:07 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1313 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:08.647769 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-2cd048d7-d226-4424-80e4-42ca89a2ff09 req-c74f21ba-2559-41c5-9cca-a9aebc0b0e64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b3ee83-f946-4c4c-bff9-80b8bd368788", "name": "network-vif-deleted", "tag": "88be3f31-89a1-4c97-bc28-c49392694bb7"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:08.665887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-2cd048d7-d226-4424-80e4-42ca89a2ff09 req-c74f21ba-2559-41c5-9cca-a9aebc0b0e64 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:08.666337 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-2cd048d7-d226-4424-80e4-42ca89a2ff09 req-c74f21ba-2559-41c5-9cca-a9aebc0b0e64 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:08.691866 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-2cd048d7-d226-4424-80e4-42ca89a2ff09 req-c74f21ba-2559-41c5-9cca-a9aebc0b0e64 service nova] Creating event network-vif-deleted:88be3f31-89a1-4c97-bc28-c49392694bb7 for instance 35b3ee83-f946-4c4c-bff9-80b8bd368788 on n-h1-846466-12 Aug 04 16:36:08.697993 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-2cd048d7-d226-4424-80e4-42ca89a2ff09 req-c74f21ba-2559-41c5-9cca-a9aebc0b0e64 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058977 Aug 04 16:36:08.699240 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 490/932] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:36:08.707548 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2927ae3c-24cf-4744-88fa-57af1968d84a tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:08.709523 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2927ae3c-24cf-4744-88fa-57af1968d84a tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] [instance: 35b3ee83-f946-4c4c-bff9-80b8bd368788] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:08.719930 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2927ae3c-24cf-4744-88fa-57af1968d84a tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:08.720703 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2927ae3c-24cf-4744-88fa-57af1968d84a tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:08.721772 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2927ae3c-24cf-4744-88fa-57af1968d84a tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:08.722408 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2927ae3c-24cf-4744-88fa-57af1968d84a tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:08.746095 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-2927ae3c-24cf-4744-88fa-57af1968d84a tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] HTTP exception thrown: Instance 35b3ee83-f946-4c4c-bff9-80b8bd368788 could not be found. Aug 04 16:36:08.761055 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2927ae3c-24cf-4744-88fa-57af1968d84a tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Request method failure captured: Aug 04 16:36:08.761055 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788 HTTP/1.1 Aug 04 16:36:08.761055 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:36:08.761055 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:36:08.761055 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:36:08.761055 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:36:08.761055 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:36:08.761055 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:36:08.761055 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:36:08.761055 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:36:08.761055 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_UW_vmQLiuSt0eBCsEw9pRigB8Wp3k1tvQoUkUoSlkWWcI-0jGNt8uWyhkyi--vPz_SJm7uiN9TnHnRdRK97zZDM9tscOMEONyE5nyr_gaZe-LmoYakXKibUwT2cmNooZz8oMxbh1NoUWWNUGNYU8ByOSpYG8GK3MkeyckBIMZl3rw Aug 04 16:36:08.761055 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:36:08.761055 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:36:08.761055 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:36:08.761055 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:36:08.761055 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:36:08.761055 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:36:08.761055 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 25f22de02d3e4db281f6372e8191b95f Aug 04 16:36:08.761055 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-910288468 Aug 04 16:36:08.761055 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:36:08.761055 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:36:08.762873 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25f22de02d3e4db281f6372e8191b95f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_25f22de02d3e4db281f6372e8191b95f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25f22de02d3e4db281f6372e8191b95f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/25f22de02d3e4db281f6372e8191b95f"}]}] Aug 04 16:36:08.762873 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-910288468 Aug 04 16:36:08.762873 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 25f22de02d3e4db281f6372e8191b95f Aug 04 16:36:08.762873 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-910288468 Aug 04 16:36:08.762873 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-FloatingIPsAssociationTestJSON-910288468-project Aug 04 16:36:08.762873 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:36:08.762873 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:36:08.762873 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: b4a732f446814c9fa080979bef241023 Aug 04 16:36:08.762873 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-910288468-project Aug 04 16:36:08.762873 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:36:08.762873 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 35b3ee83-f946-4c4c-bff9-80b8bd368788 could not be found. Aug 04 16:36:08.762873 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '35b3ee83-f946-4c4c-bff9-80b8bd368788'} Aug 04 16:36:08.763796 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:36:08.763796 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:36:08.763796 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:36:08.763796 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:36:08.763796 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:36:08.763796 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:36:08.763796 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:36:08.763796 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:36:08.763796 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:36:08.763796 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:36:08.763796 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35b3ee83-f946-4c4c-bff9-80b8bd368788 could not be found. Aug 04 16:36:08.763796 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:36:08.763796 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:36:08.763796 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:36:08.763796 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:36:08.763796 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:36:08.763796 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:36:08.763796 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:36:08.763796 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:36:08.763796 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:36:08.766554 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:36:08.766554 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:36:08.766554 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:36:08.766554 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:36:08.766554 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:36:08.766554 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:36:08.766554 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:36:08.766554 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35b3ee83-f946-4c4c-bff9-80b8bd368788 could not be found. Aug 04 16:36:08.766554 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:36:08.766554 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:36:08.766554 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:36:08.766554 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:36:08.766554 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:36:08.766554 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:36:08.766554 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:36:08.766554 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:36:08.766554 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35b3ee83-f946-4c4c-bff9-80b8bd368788 could not be found. Aug 04 16:36:08.766554 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:36:08.769664 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2927ae3c-24cf-4744-88fa-57af1968d84a tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] Returning 404 to user: Instance 35b3ee83-f946-4c4c-bff9-80b8bd368788 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:36:08.769664 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2927ae3c-24cf-4744-88fa-57af1968d84a tempest-FloatingIPsAssociationTestJSON-910288468 tempest-FloatingIPsAssociationTestJSON-910288468-project] 10.222.0.23 "GET /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788" status: 404 len: 111 microversion: 2.1 time: 0.068751 Aug 04 16:36:08.774304 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 491/933] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:08 2022] GET /compute/v2.1/servers/35b3ee83-f946-4c4c-bff9-80b8bd368788 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:36:08.780768 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-671a97a9-fe65-4026-9157-bda7a29d7920 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:08.782189 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-671a97a9-fe65-4026-9157-bda7a29d7920 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:08.796988 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-671a97a9-fe65-4026-9157-bda7a29d7920 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:08.797571 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-671a97a9-fe65-4026-9157-bda7a29d7920 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:08.799062 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-671a97a9-fe65-4026-9157-bda7a29d7920 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:08.799886 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-671a97a9-fe65-4026-9157-bda7a29d7920 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:09.030101 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3a1fbbe2-61d6-45d0-b4b2-e9aeaf1c0af3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:09.040851 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3a1fbbe2-61d6-45d0-b4b2-e9aeaf1c0af3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:09.043146 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3a1fbbe2-61d6-45d0-b4b2-e9aeaf1c0af3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:09.044908 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3a1fbbe2-61d6-45d0-b4b2-e9aeaf1c0af3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb" status: 200 len: 1566 microversion: 2.25 time: 1.179197 Aug 04 16:36:09.046037 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 443/934] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:36:07 2022] GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb => generated 1566 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:36:09.095695 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-cc3c40b7-946e-4472-b55a-ad2192b165fd req-cfc7a337-fac0-4a0e-adac-b5266ac7d728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8305b506-e5ac-4e19-97ea-4530d4ec87c1", "name": "network-vif-plugged", "status": "completed", "tag": "88499859-554c-4372-a84a-c0c261083f9b"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:09.110362 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-cc3c40b7-946e-4472-b55a-ad2192b165fd req-cfc7a337-fac0-4a0e-adac-b5266ac7d728 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:09.110803 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-cc3c40b7-946e-4472-b55a-ad2192b165fd req-cfc7a337-fac0-4a0e-adac-b5266ac7d728 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:09.132844 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-cc3c40b7-946e-4472-b55a-ad2192b165fd req-cfc7a337-fac0-4a0e-adac-b5266ac7d728 service nova] Creating event network-vif-plugged:88499859-554c-4372-a84a-c0c261083f9b for instance 8305b506-e5ac-4e19-97ea-4530d4ec87c1 on n-h2-846466-12 Aug 04 16:36:09.139288 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-cc3c40b7-946e-4472-b55a-ad2192b165fd req-cfc7a337-fac0-4a0e-adac-b5266ac7d728 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048161 Aug 04 16:36:09.140912 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 444/935] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:36:09.295348 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-671a97a9-fe65-4026-9157-bda7a29d7920 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lazy-loading 'services' on Instance uuid effb9df8-4005-4b3b-a58e-41b5ba36b5c5 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:36:09.345227 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-671a97a9-fe65-4026-9157-bda7a29d7920 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1935 microversion: 2.75 time: 0.572012 Aug 04 16:36:09.347104 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 492/936] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:36:08 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1935 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:36:09.668545 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-52d6a998-7222-4ec5-86c2-874d3095f46e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:09.669701 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-52d6a998-7222-4ec5-86c2-874d3095f46e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:09.679641 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-52d6a998-7222-4ec5-86c2-874d3095f46e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:09.681123 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-52d6a998-7222-4ec5-86c2-874d3095f46e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:09.682200 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-52d6a998-7222-4ec5-86c2-874d3095f46e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:09.683442 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-52d6a998-7222-4ec5-86c2-874d3095f46e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:09.926128 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-3171dd5a-b5e5-4360-af11-9f0e2ecba936 req-4161c6fc-6acb-489c-8776-d0db4ce65784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6017510a-e331-424a-843d-54b980b999fb", "name": "network-vif-unplugged", "status": "completed", "tag": "d7e532ef-c5a8-4d48-bb77-3ffca7d01087"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:09.954474 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-3171dd5a-b5e5-4360-af11-9f0e2ecba936 req-4161c6fc-6acb-489c-8776-d0db4ce65784 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:09.955372 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-3171dd5a-b5e5-4360-af11-9f0e2ecba936 req-4161c6fc-6acb-489c-8776-d0db4ce65784 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:09.993094 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-3171dd5a-b5e5-4360-af11-9f0e2ecba936 req-4161c6fc-6acb-489c-8776-d0db4ce65784 service nova] Creating event network-vif-unplugged:d7e532ef-c5a8-4d48-bb77-3ffca7d01087 for instance 6017510a-e331-424a-843d-54b980b999fb on n-h1-846466-12 Aug 04 16:36:10.011048 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-3171dd5a-b5e5-4360-af11-9f0e2ecba936 req-4161c6fc-6acb-489c-8776-d0db4ce65784 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089433 Aug 04 16:36:10.013783 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 493/937] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:36:10.108841 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-91840d55-8cd4-4700-ba59-c4f481e15ffc tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:10.120401 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-91840d55-8cd4-4700-ba59-c4f481e15ffc tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 6017510a-e331-424a-843d-54b980b999fb] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:10.152836 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-91840d55-8cd4-4700-ba59-c4f481e15ffc tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:10.154276 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-91840d55-8cd4-4700-ba59-c4f481e15ffc tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:10.159127 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-91840d55-8cd4-4700-ba59-c4f481e15ffc tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:10.162389 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-91840d55-8cd4-4700-ba59-c4f481e15ffc tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:10.251958 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-52d6a998-7222-4ec5-86c2-874d3095f46e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:10.262463 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-52d6a998-7222-4ec5-86c2-874d3095f46e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1313 microversion: 2.1 time: 0.601305 Aug 04 16:36:10.263825 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 445/938] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:09 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1313 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:10.373193 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2af69e4a-d6b9-4fe8-b1f7-0c321305c962 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:10.373852 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2af69e4a-d6b9-4fe8-b1f7-0c321305c962 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:10.385014 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2af69e4a-d6b9-4fe8-b1f7-0c321305c962 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:10.387768 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2af69e4a-d6b9-4fe8-b1f7-0c321305c962 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:10.388758 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2af69e4a-d6b9-4fe8-b1f7-0c321305c962 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:10.389212 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2af69e4a-d6b9-4fe8-b1f7-0c321305c962 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:10.594585 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-2af69e4a-d6b9-4fe8-b1f7-0c321305c962 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] Lazy-loading 'services' on Instance uuid effb9df8-4005-4b3b-a58e-41b5ba36b5c5 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:36:10.673556 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-91840d55-8cd4-4700-ba59-c4f481e15ffc tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:10.697182 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2af69e4a-d6b9-4fe8-b1f7-0c321305c962 tempest-ServersAdmin275Test-2064589024 tempest-ServersAdmin275Test-2064589024-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1920 microversion: 2.75 time: 0.326115 Aug 04 16:36:10.697923 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-91840d55-8cd4-4700-ba59-c4f481e15ffc tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:10.698260 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 446/939] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:36:10 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1920 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:36:10.702004 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-91840d55-8cd4-4700-ba59-c4f481e15ffc tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:10.703989 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-91840d55-8cd4-4700-ba59-c4f481e15ffc tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb" status: 200 len: 1566 microversion: 2.25 time: 0.619249 Aug 04 16:36:10.704961 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 494/940] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:36:10 2022] GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb => generated 1566 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:36:10.751794 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6c06433f-ae26-4dbc-a429-e19ddbb9e764 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:10.752297 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6c06433f-ae26-4dbc-a429-e19ddbb9e764 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:10.768049 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c06433f-ae26-4dbc-a429-e19ddbb9e764 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:10.768494 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c06433f-ae26-4dbc-a429-e19ddbb9e764 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:10.769316 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c06433f-ae26-4dbc-a429-e19ddbb9e764 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:10.772049 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c06433f-ae26-4dbc-a429-e19ddbb9e764 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:10.823704 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6c06433f-ae26-4dbc-a429-e19ddbb9e764 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:36:10.948794 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6c06433f-ae26-4dbc-a429-e19ddbb9e764 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] 10.222.0.23 "DELETE /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 204 len: 0 microversion: 2.75 time: 0.201631 Aug 04 16:36:10.955320 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 447/941] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Aug 4 16:36:10 2022] DELETE /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 16:36:10.972800 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-10bb54dc-7306-45f9-adc9-a540b5c56ea7 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:10.975943 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-10bb54dc-7306-45f9-adc9-a540b5c56ea7 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:10.998128 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-10bb54dc-7306-45f9-adc9-a540b5c56ea7 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:10.998589 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-10bb54dc-7306-45f9-adc9-a540b5c56ea7 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:11.003803 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-10bb54dc-7306-45f9-adc9-a540b5c56ea7 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:11.004571 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-10bb54dc-7306-45f9-adc9-a540b5c56ea7 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:11.147790 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-10bb54dc-7306-45f9-adc9-a540b5c56ea7 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:11.163672 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-10bb54dc-7306-45f9-adc9-a540b5c56ea7 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:11.165563 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-10bb54dc-7306-45f9-adc9-a540b5c56ea7 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:11.182352 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-10bb54dc-7306-45f9-adc9-a540b5c56ea7 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1443 microversion: 2.75 time: 0.225407 Aug 04 16:36:11.183566 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 495/942] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:36:10 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1443 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:36:11.303276 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bc14e7cc-c93c-4a80-b9fc-3c4f23032185 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:11.307353 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bc14e7cc-c93c-4a80-b9fc-3c4f23032185 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:11.328538 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bc14e7cc-c93c-4a80-b9fc-3c4f23032185 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:11.330390 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bc14e7cc-c93c-4a80-b9fc-3c4f23032185 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:11.336306 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bc14e7cc-c93c-4a80-b9fc-3c4f23032185 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:11.337603 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bc14e7cc-c93c-4a80-b9fc-3c4f23032185 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:11.727585 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7da9a305-857b-4df1-8413-0302f1d3e95b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:11.728585 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7da9a305-857b-4df1-8413-0302f1d3e95b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 6017510a-e331-424a-843d-54b980b999fb] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:11.737105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7da9a305-857b-4df1-8413-0302f1d3e95b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:11.737924 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7da9a305-857b-4df1-8413-0302f1d3e95b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:11.738937 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7da9a305-857b-4df1-8413-0302f1d3e95b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:11.739906 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7da9a305-857b-4df1-8413-0302f1d3e95b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:12.244426 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bc14e7cc-c93c-4a80-b9fc-3c4f23032185 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:12.256095 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bc14e7cc-c93c-4a80-b9fc-3c4f23032185 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1462 microversion: 2.1 time: 0.965351 Aug 04 16:36:12.258404 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 448/943] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:11 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1462 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:12.273761 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-77fe6161-44f0-4258-b340-4c98a287505b req-e099a797-7b49-4100-a900-c64925cd1767 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6017510a-e331-424a-843d-54b980b999fb", "tag": "d7e532ef-c5a8-4d48-bb77-3ffca7d01087"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:12.297628 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-77fe6161-44f0-4258-b340-4c98a287505b req-e099a797-7b49-4100-a900-c64925cd1767 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:12.299866 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-77fe6161-44f0-4258-b340-4c98a287505b req-e099a797-7b49-4100-a900-c64925cd1767 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:12.320611 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-77fe6161-44f0-4258-b340-4c98a287505b req-e099a797-7b49-4100-a900-c64925cd1767 service nova] Creating event network-changed:d7e532ef-c5a8-4d48-bb77-3ffca7d01087 for instance 6017510a-e331-424a-843d-54b980b999fb on n-h1-846466-12 Aug 04 16:36:12.325786 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-77fe6161-44f0-4258-b340-4c98a287505b req-e099a797-7b49-4100-a900-c64925cd1767 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065846 Aug 04 16:36:12.326478 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 449/944] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:36:12.332270 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-733294a2-0aa8-404a-b3ea-dd37caba3db5 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:12.333367 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-733294a2-0aa8-404a-b3ea-dd37caba3db5 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:12.340796 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-733294a2-0aa8-404a-b3ea-dd37caba3db5 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:12.341687 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-733294a2-0aa8-404a-b3ea-dd37caba3db5 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:12.342693 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-733294a2-0aa8-404a-b3ea-dd37caba3db5 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:12.343530 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-733294a2-0aa8-404a-b3ea-dd37caba3db5 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:12.396937 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7da9a305-857b-4df1-8413-0302f1d3e95b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:12.408167 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7da9a305-857b-4df1-8413-0302f1d3e95b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:12.410611 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7da9a305-857b-4df1-8413-0302f1d3e95b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:12.411839 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7da9a305-857b-4df1-8413-0302f1d3e95b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb" status: 200 len: 1566 microversion: 2.25 time: 0.688487 Aug 04 16:36:12.412640 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 496/945] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:36:11 2022] GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb => generated 1566 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:36:12.417646 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-781f5924-cf9f-4678-aeb9-ce631e1dc2f0 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:12.420613 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-781f5924-cf9f-4678-aeb9-ce631e1dc2f0 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:12.431731 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-781f5924-cf9f-4678-aeb9-ce631e1dc2f0 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:12.432361 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-781f5924-cf9f-4678-aeb9-ce631e1dc2f0 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:12.433530 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-781f5924-cf9f-4678-aeb9-ce631e1dc2f0 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:12.434419 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-781f5924-cf9f-4678-aeb9-ce631e1dc2f0 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:12.469268 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-733294a2-0aa8-404a-b3ea-dd37caba3db5 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:12.487305 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-733294a2-0aa8-404a-b3ea-dd37caba3db5 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:12.489931 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-733294a2-0aa8-404a-b3ea-dd37caba3db5 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:12.498045 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-733294a2-0aa8-404a-b3ea-dd37caba3db5 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1443 microversion: 2.75 time: 0.169195 Aug 04 16:36:12.513376 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 450/946] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:36:12 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1443 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:36:12.525971 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=100 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:36:12.613768 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-781f5924-cf9f-4678-aeb9-ce631e1dc2f0 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:12.625331 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-781f5924-cf9f-4678-aeb9-ce631e1dc2f0 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Old instance type m1.heat2, new instance type m1.heat {{(pid=126125) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 16:36:12.642261 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-781f5924-cf9f-4678-aeb9-ce631e1dc2f0 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:36:12.642688 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-781f5924-cf9f-4678-aeb9-ce631e1dc2f0 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:36:12.643777 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-781f5924-cf9f-4678-aeb9-ce631e1dc2f0 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:36:12.645760 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-781f5924-cf9f-4678-aeb9-ce631e1dc2f0 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:36:12.647911 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-781f5924-cf9f-4678-aeb9-ce631e1dc2f0 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:36:12.870917 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-781f5924-cf9f-4678-aeb9-ce631e1dc2f0 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "POST /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1/action" status: 202 len: 0 microversion: 2.1 time: 0.456874 Aug 04 16:36:12.881368 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 497/947] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:36:12 2022] POST /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:36:12.886970 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-75ce96c0-32bd-4a03-a8da-69c44bc4c2f4 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:12.888087 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-75ce96c0-32bd-4a03-a8da-69c44bc4c2f4 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:12.907860 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-75ce96c0-32bd-4a03-a8da-69c44bc4c2f4 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:12.908549 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-75ce96c0-32bd-4a03-a8da-69c44bc4c2f4 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:12.911127 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-75ce96c0-32bd-4a03-a8da-69c44bc4c2f4 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:12.913965 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-75ce96c0-32bd-4a03-a8da-69c44bc4c2f4 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:13.337367 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-75ce96c0-32bd-4a03-a8da-69c44bc4c2f4 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:13.372344 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-75ce96c0-32bd-4a03-a8da-69c44bc4c2f4 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1471 microversion: 2.1 time: 0.489643 Aug 04 16:36:13.391165 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 451/948] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:12 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1471 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:13.438052 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-aaa70d24-b6c8-4468-908f-a37738ad7ca1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:13.438806 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-aaa70d24-b6c8-4468-908f-a37738ad7ca1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 6017510a-e331-424a-843d-54b980b999fb] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:13.457945 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aaa70d24-b6c8-4468-908f-a37738ad7ca1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:13.457945 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aaa70d24-b6c8-4468-908f-a37738ad7ca1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:13.457945 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aaa70d24-b6c8-4468-908f-a37738ad7ca1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:13.458330 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aaa70d24-b6c8-4468-908f-a37738ad7ca1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:13.533463 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-978b094c-984d-47de-a3cc-56bc5d62ca72 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:13.533463 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-978b094c-984d-47de-a3cc-56bc5d62ca72 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:13.536582 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-978b094c-984d-47de-a3cc-56bc5d62ca72 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:13.537079 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-978b094c-984d-47de-a3cc-56bc5d62ca72 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:13.542284 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-978b094c-984d-47de-a3cc-56bc5d62ca72 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:13.542743 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-978b094c-984d-47de-a3cc-56bc5d62ca72 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:13.726393 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-978b094c-984d-47de-a3cc-56bc5d62ca72 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:13.742887 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-978b094c-984d-47de-a3cc-56bc5d62ca72 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:13.746825 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-978b094c-984d-47de-a3cc-56bc5d62ca72 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:13.761041 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-978b094c-984d-47de-a3cc-56bc5d62ca72 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1443 microversion: 2.75 time: 0.239443 Aug 04 16:36:13.774768 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 452/949] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:36:13 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1443 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:36:13.892054 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-aaa70d24-b6c8-4468-908f-a37738ad7ca1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:13.901693 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-aaa70d24-b6c8-4468-908f-a37738ad7ca1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:13.903546 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-aaa70d24-b6c8-4468-908f-a37738ad7ca1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:13.911016 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-aaa70d24-b6c8-4468-908f-a37738ad7ca1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb" status: 200 len: 1566 microversion: 2.25 time: 0.477506 Aug 04 16:36:13.912103 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 498/950] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:36:13 2022] GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb => generated 1566 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:36:14.414530 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d9e60262-4347-4662-ba7a-49483148b4f2 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:14.414530 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d9e60262-4347-4662-ba7a-49483148b4f2 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:14.431291 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d9e60262-4347-4662-ba7a-49483148b4f2 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:14.441721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d9e60262-4347-4662-ba7a-49483148b4f2 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:14.442503 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d9e60262-4347-4662-ba7a-49483148b4f2 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:14.448273 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d9e60262-4347-4662-ba7a-49483148b4f2 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:14.797859 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dbbb637b-bb53-4813-bd04-55353c66092b tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:14.799269 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dbbb637b-bb53-4813-bd04-55353c66092b tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:14.824800 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dbbb637b-bb53-4813-bd04-55353c66092b tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:14.828480 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dbbb637b-bb53-4813-bd04-55353c66092b tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:14.829659 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dbbb637b-bb53-4813-bd04-55353c66092b tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:14.830578 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dbbb637b-bb53-4813-bd04-55353c66092b tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:14.942894 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d9e60262-4347-4662-ba7a-49483148b4f2 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:14.951536 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d9e60262-4347-4662-ba7a-49483148b4f2 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1471 microversion: 2.1 time: 0.543903 Aug 04 16:36:14.954716 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 453/951] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:14 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1471 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:36:14.960576 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f94e5683-d68c-40aa-bc82-4891deccaa66 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:14.961557 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f94e5683-d68c-40aa-bc82-4891deccaa66 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 6017510a-e331-424a-843d-54b980b999fb] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:14.975279 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dbbb637b-bb53-4813-bd04-55353c66092b tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:14.975956 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dbbb637b-bb53-4813-bd04-55353c66092b tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:14.976478 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-dbbb637b-bb53-4813-bd04-55353c66092b tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lazy-loading 'fault' on Instance uuid effb9df8-4005-4b3b-a58e-41b5ba36b5c5 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:36:14.982654 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f94e5683-d68c-40aa-bc82-4891deccaa66 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:14.987448 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f94e5683-d68c-40aa-bc82-4891deccaa66 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:14.993081 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f94e5683-d68c-40aa-bc82-4891deccaa66 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:14.994453 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f94e5683-d68c-40aa-bc82-4891deccaa66 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:15.089827 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dbbb637b-bb53-4813-bd04-55353c66092b tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:15.098463 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dbbb637b-bb53-4813-bd04-55353c66092b tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:15.101987 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dbbb637b-bb53-4813-bd04-55353c66092b tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf14182a3e94485395968d3fb3f4d97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17b02d81b3c4cb59e0e48ca9af08e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:15.109712 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dbbb637b-bb53-4813-bd04-55353c66092b tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 200 len: 1448 microversion: 2.75 time: 0.315896 Aug 04 16:36:15.110576 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 499/952] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:36:14 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 1448 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:36:15.363317 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f94e5683-d68c-40aa-bc82-4891deccaa66 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:15.377546 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f94e5683-d68c-40aa-bc82-4891deccaa66 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:15.384053 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f94e5683-d68c-40aa-bc82-4891deccaa66 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:15.385258 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f94e5683-d68c-40aa-bc82-4891deccaa66 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb" status: 200 len: 1566 microversion: 2.25 time: 0.429302 Aug 04 16:36:15.391557 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 454/953] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:36:14 2022] GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb => generated 1566 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:36:15.611015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2a4a33d9-a20f-4f63-9326-a14e30d8a92b tempest-AZV2TestJSON-1278925928 tempest-AZV2TestJSON-1278925928-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:15.612651 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2a4a33d9-a20f-4f63-9326-a14e30d8a92b tempest-AZV2TestJSON-1278925928 tempest-AZV2TestJSON-1278925928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:15.615198 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2a4a33d9-a20f-4f63-9326-a14e30d8a92b tempest-AZV2TestJSON-1278925928 tempest-AZV2TestJSON-1278925928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:15.615198 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2a4a33d9-a20f-4f63-9326-a14e30d8a92b tempest-AZV2TestJSON-1278925928 tempest-AZV2TestJSON-1278925928-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:15.615198 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2a4a33d9-a20f-4f63-9326-a14e30d8a92b tempest-AZV2TestJSON-1278925928 tempest-AZV2TestJSON-1278925928-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:15.679017 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2a4a33d9-a20f-4f63-9326-a14e30d8a92b tempest-AZV2TestJSON-1278925928 tempest-AZV2TestJSON-1278925928-project] 10.222.0.23 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.567099 Aug 04 16:36:15.680168 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 500/954] 10.222.0.23 () {58 vars in 1164 bytes} [Thu Aug 4 16:36:15 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:36:15.974216 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-89107ae1-4464-4e53-a670-e3a7159319eb tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:15.974792 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-89107ae1-4464-4e53-a670-e3a7159319eb tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:15.989341 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-89107ae1-4464-4e53-a670-e3a7159319eb tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:15.989780 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-89107ae1-4464-4e53-a670-e3a7159319eb tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:15.990690 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-89107ae1-4464-4e53-a670-e3a7159319eb tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:15.991119 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-89107ae1-4464-4e53-a670-e3a7159319eb tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:15.993110 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5a5abbad-8978-475a-ae30-8a2eea5cf657 tempest-HypervisorAdminV228Test-911872108 tempest-HypervisorAdminV228Test-911872108-project-admin] Calling method '.version_select at 0x7f7e850aaf70>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:15.994067 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:36:15.994067 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:36:15.995303 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a5abbad-8978-475a-ae30-8a2eea5cf657 tempest-HypervisorAdminV228Test-911872108 tempest-HypervisorAdminV228Test-911872108-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:15.995936 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a5abbad-8978-475a-ae30-8a2eea5cf657 tempest-HypervisorAdminV228Test-911872108 tempest-HypervisorAdminV228Test-911872108-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:16.016097 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a5abbad-8978-475a-ae30-8a2eea5cf657 tempest-HypervisorAdminV228Test-911872108 tempest-HypervisorAdminV228Test-911872108-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:16.016537 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a5abbad-8978-475a-ae30-8a2eea5cf657 tempest-HypervisorAdminV228Test-911872108 tempest-HypervisorAdminV228Test-911872108-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:16.028857 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a5abbad-8978-475a-ae30-8a2eea5cf657 tempest-HypervisorAdminV228Test-911872108 tempest-HypervisorAdminV228Test-911872108-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:16.029819 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a5abbad-8978-475a-ae30-8a2eea5cf657 tempest-HypervisorAdminV228Test-911872108 tempest-HypervisorAdminV228Test-911872108-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:16.039076 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5a5abbad-8978-475a-ae30-8a2eea5cf657 tempest-HypervisorAdminV228Test-911872108 tempest-HypervisorAdminV228Test-911872108-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.275386 Aug 04 16:36:16.040665 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 455/955] 10.222.0.23 () {60 vars in 1187 bytes} [Thu Aug 4 16:36:15 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:36:16.057481 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bddbdd30-d03c-4b9a-83c9-130e439a9af8 tempest-HypervisorAdminV228Test-911872108 tempest-HypervisorAdminV228Test-911872108-project-admin] Calling method '.version_select at 0x7f7e84c96430>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:16.058435 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:36:16.058435 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:36:16.059758 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bddbdd30-d03c-4b9a-83c9-130e439a9af8 tempest-HypervisorAdminV228Test-911872108 tempest-HypervisorAdminV228Test-911872108-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:16.060596 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bddbdd30-d03c-4b9a-83c9-130e439a9af8 tempest-HypervisorAdminV228Test-911872108 tempest-HypervisorAdminV228Test-911872108-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:16.074965 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bddbdd30-d03c-4b9a-83c9-130e439a9af8 tempest-HypervisorAdminV228Test-911872108 tempest-HypervisorAdminV228Test-911872108-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:16.075487 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bddbdd30-d03c-4b9a-83c9-130e439a9af8 tempest-HypervisorAdminV228Test-911872108 tempest-HypervisorAdminV228Test-911872108-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:16.100338 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bddbdd30-d03c-4b9a-83c9-130e439a9af8 tempest-HypervisorAdminV228Test-911872108 tempest-HypervisorAdminV228Test-911872108-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.048285 Aug 04 16:36:16.101364 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 456/956] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Aug 4 16:36:16 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:36:16.145964 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d893c367-b603-4c3d-b7d7-994174b660d1 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:16.148140 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d893c367-b603-4c3d-b7d7-994174b660d1 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] [instance: effb9df8-4005-4b3b-a58e-41b5ba36b5c5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:16.172568 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d893c367-b603-4c3d-b7d7-994174b660d1 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:16.177819 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d893c367-b603-4c3d-b7d7-994174b660d1 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:16.181737 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d893c367-b603-4c3d-b7d7-994174b660d1 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:16.183026 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d893c367-b603-4c3d-b7d7-994174b660d1 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:16.217899 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-d893c367-b603-4c3d-b7d7-994174b660d1 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] HTTP exception thrown: Instance effb9df8-4005-4b3b-a58e-41b5ba36b5c5 could not be found. Aug 04 16:36:16.223510 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d893c367-b603-4c3d-b7d7-994174b660d1 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Request method failure captured: Aug 04 16:36:16.223510 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 HTTP/1.1 Aug 04 16:36:16.223510 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:36:16.223510 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:36:16.223510 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:36:16.223510 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:36:16.223510 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:36:16.223510 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:36:16.223510 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:36:16.223510 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:36:16.223510 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_Ul7jJIV_8NeiQtWWwOU3quryLhka-vrwOTH4jVTU5P4XNo30ZhO8mCUIBU-5a-9QY8tabCMtu_1-vmEV39wrybkApv5HRH9kFSAZT_7dQjKeQHD7VSGukzo9J-U_WKHk4ecUnwzMaIzhSKU-5ill_U1QtkuHr7bO4uU-fpuALDx-4 Aug 04 16:36:16.223510 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:36:16.223510 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:36:16.223510 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:36:16.223510 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:36:16.223510 n-d-846466-12 devstack@n-api.service[126126]: X-Openstack-Nova-Api-Version: 2.75 Aug 04 16:36:16.223510 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:36:16.223510 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:36:16.223510 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: b17b02d81b3c4cb59e0e48ca9af08e3b Aug 04 16:36:16.223510 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersAdmin275Test-2122747267 Aug 04 16:36:16.223510 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:36:16.223510 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:36:16.224999 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b17b02d81b3c4cb59e0e48ca9af08e3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b17b02d81b3c4cb59e0e48ca9af08e3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b17b02d81b3c4cb59e0e48ca9af08e3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b17b02d81b3c4cb59e0e48ca9af08e3b"}]}] Aug 04 16:36:16.224999 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersAdmin275Test-2122747267 Aug 04 16:36:16.224999 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: b17b02d81b3c4cb59e0e48ca9af08e3b Aug 04 16:36:16.224999 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersAdmin275Test-2122747267 Aug 04 16:36:16.224999 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersAdmin275Test-2122747267-project Aug 04 16:36:16.224999 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:36:16.224999 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:36:16.224999 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: cf14182a3e94485395968d3fb3f4d97a Aug 04 16:36:16.224999 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersAdmin275Test-2122747267-project Aug 04 16:36:16.224999 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:36:16.224999 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance effb9df8-4005-4b3b-a58e-41b5ba36b5c5 could not be found. Aug 04 16:36:16.224999 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'effb9df8-4005-4b3b-a58e-41b5ba36b5c5'} Aug 04 16:36:16.226350 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:36:16.226350 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:36:16.226350 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:36:16.226350 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:36:16.226350 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:36:16.226350 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:36:16.226350 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:36:16.226350 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:36:16.226350 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:36:16.226350 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:36:16.226350 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance effb9df8-4005-4b3b-a58e-41b5ba36b5c5 could not be found. Aug 04 16:36:16.226350 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:36:16.226350 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:36:16.226350 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:36:16.226350 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:36:16.226350 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:36:16.226350 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:36:16.226350 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:36:16.226350 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:36:16.226350 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:36:16.228007 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:36:16.228007 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:36:16.228007 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:36:16.228007 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:36:16.228007 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:36:16.228007 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:36:16.228007 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:36:16.228007 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance effb9df8-4005-4b3b-a58e-41b5ba36b5c5 could not be found. Aug 04 16:36:16.228007 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:36:16.228007 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:36:16.228007 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:36:16.228007 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:36:16.228007 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:36:16.228007 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:36:16.228007 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:36:16.228007 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:36:16.228007 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance effb9df8-4005-4b3b-a58e-41b5ba36b5c5 could not be found. Aug 04 16:36:16.228007 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:36:16.232328 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d893c367-b603-4c3d-b7d7-994174b660d1 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] Returning 404 to user: Instance effb9df8-4005-4b3b-a58e-41b5ba36b5c5 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:36:16.234933 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d893c367-b603-4c3d-b7d7-994174b660d1 tempest-ServersAdmin275Test-2122747267 tempest-ServersAdmin275Test-2122747267-project] 10.222.0.23 "GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5" status: 404 len: 111 microversion: 2.75 time: 0.102184 Aug 04 16:36:16.238050 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 457/957] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:36:16 2022] GET /compute/v2.1/servers/effb9df8-4005-4b3b-a58e-41b5ba36b5c5 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:36:16.413662 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2903409a-b2ad-48df-b66e-130a11aba3e9 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:16.415168 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2903409a-b2ad-48df-b66e-130a11aba3e9 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 6017510a-e331-424a-843d-54b980b999fb] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:16.433666 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2903409a-b2ad-48df-b66e-130a11aba3e9 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:16.434140 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2903409a-b2ad-48df-b66e-130a11aba3e9 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:16.438796 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2903409a-b2ad-48df-b66e-130a11aba3e9 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:16.440698 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2903409a-b2ad-48df-b66e-130a11aba3e9 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:16.794470 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-89107ae1-4464-4e53-a670-e3a7159319eb tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:16.809653 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-89107ae1-4464-4e53-a670-e3a7159319eb tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1471 microversion: 2.1 time: 0.839126 Aug 04 16:36:16.814647 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 501/958] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:15 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1471 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:17.711783 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2903409a-b2ad-48df-b66e-130a11aba3e9 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:17.721998 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:36:17.725141 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2903409a-b2ad-48df-b66e-130a11aba3e9 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:17.730466 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2903409a-b2ad-48df-b66e-130a11aba3e9 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:17.735088 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2903409a-b2ad-48df-b66e-130a11aba3e9 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb" status: 200 len: 1566 microversion: 2.25 time: 1.326219 Aug 04 16:36:17.738855 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 458/959] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:36:16 2022] GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb => generated 1566 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:36:17.838302 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-348b91e7-6687-4e1a-830a-3cbb9f3aa9dc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:17.839909 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-348b91e7-6687-4e1a-830a-3cbb9f3aa9dc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:17.849705 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-348b91e7-6687-4e1a-830a-3cbb9f3aa9dc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:17.850934 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-348b91e7-6687-4e1a-830a-3cbb9f3aa9dc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:17.852237 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-348b91e7-6687-4e1a-830a-3cbb9f3aa9dc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:17.852928 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-348b91e7-6687-4e1a-830a-3cbb9f3aa9dc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:18.208539 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-348b91e7-6687-4e1a-830a-3cbb9f3aa9dc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:18.233212 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-348b91e7-6687-4e1a-830a-3cbb9f3aa9dc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1471 microversion: 2.1 time: 0.399922 Aug 04 16:36:18.260674 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 502/960] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:17 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1471 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:36:18.762556 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0fe65bd6-d17b-4941-8fd2-8250123017c5 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:18.765257 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0fe65bd6-d17b-4941-8fd2-8250123017c5 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 6017510a-e331-424a-843d-54b980b999fb] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:18.787182 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0fe65bd6-d17b-4941-8fd2-8250123017c5 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:18.789161 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0fe65bd6-d17b-4941-8fd2-8250123017c5 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:18.791597 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0fe65bd6-d17b-4941-8fd2-8250123017c5 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:18.793246 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0fe65bd6-d17b-4941-8fd2-8250123017c5 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:19.265803 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-15be7709-5b72-4922-92d5-cc0dbff7a74d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:19.265803 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-15be7709-5b72-4922-92d5-cc0dbff7a74d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:19.272376 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-15be7709-5b72-4922-92d5-cc0dbff7a74d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:19.272954 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-15be7709-5b72-4922-92d5-cc0dbff7a74d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:19.273629 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-15be7709-5b72-4922-92d5-cc0dbff7a74d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:19.274075 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-15be7709-5b72-4922-92d5-cc0dbff7a74d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:19.293955 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0fe65bd6-d17b-4941-8fd2-8250123017c5 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:19.306794 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0fe65bd6-d17b-4941-8fd2-8250123017c5 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:19.308617 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0fe65bd6-d17b-4941-8fd2-8250123017c5 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:19.310741 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0fe65bd6-d17b-4941-8fd2-8250123017c5 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb" status: 200 len: 1566 microversion: 2.25 time: 0.556333 Aug 04 16:36:19.327755 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 459/961] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:36:18 2022] GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb => generated 1566 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:36:19.557135 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-15be7709-5b72-4922-92d5-cc0dbff7a74d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:19.572961 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-15be7709-5b72-4922-92d5-cc0dbff7a74d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1476 microversion: 2.1 time: 0.316334 Aug 04 16:36:19.590562 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 503/962] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:19 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1476 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:20.337110 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f426dfc1-4065-4dc1-9599-3dd7dd1e97fd tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:20.338023 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f426dfc1-4065-4dc1-9599-3dd7dd1e97fd tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 6017510a-e331-424a-843d-54b980b999fb] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:20.354537 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f426dfc1-4065-4dc1-9599-3dd7dd1e97fd tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:20.354984 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f426dfc1-4065-4dc1-9599-3dd7dd1e97fd tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:20.358489 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f426dfc1-4065-4dc1-9599-3dd7dd1e97fd tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:20.359322 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f426dfc1-4065-4dc1-9599-3dd7dd1e97fd tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:20.597596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7ff806ce-10ba-4563-8ad5-da976b1ca427 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:20.598241 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7ff806ce-10ba-4563-8ad5-da976b1ca427 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:20.612789 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ff806ce-10ba-4563-8ad5-da976b1ca427 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:20.613227 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ff806ce-10ba-4563-8ad5-da976b1ca427 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:20.614025 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ff806ce-10ba-4563-8ad5-da976b1ca427 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:20.614447 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ff806ce-10ba-4563-8ad5-da976b1ca427 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:20.660697 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f426dfc1-4065-4dc1-9599-3dd7dd1e97fd tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:20.676225 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f426dfc1-4065-4dc1-9599-3dd7dd1e97fd tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:20.682611 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f426dfc1-4065-4dc1-9599-3dd7dd1e97fd tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:20.684957 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f426dfc1-4065-4dc1-9599-3dd7dd1e97fd tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb" status: 200 len: 1541 microversion: 2.25 time: 0.352559 Aug 04 16:36:20.685573 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 460/963] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:36:20 2022] GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb => generated 1541 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:36:20.711412 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a29ce7ad-10eb-4c6b-95e8-3e24a2a33a14 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Calling method '.version_select at 0x7f7e84c8dee0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:20.715621 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a29ce7ad-10eb-4c6b-95e8-3e24a2a33a14 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:20.717270 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a29ce7ad-10eb-4c6b-95e8-3e24a2a33a14 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:20.744112 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a29ce7ad-10eb-4c6b-95e8-3e24a2a33a14 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 2565 microversion: 2.25 time: 0.041401 Aug 04 16:36:20.746237 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 461/964] 10.222.0.23 () {60 vars in 1184 bytes} [Thu Aug 4 16:36:20 2022] GET /compute/v2.1/os-migrations => generated 2565 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:36:20.763723 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-60819e60-7305-44dd-8214-7e62cefab2e7 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:20.766023 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-60819e60-7305-44dd-8214-7e62cefab2e7 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] [instance: 6017510a-e331-424a-843d-54b980b999fb] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:20.778589 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-60819e60-7305-44dd-8214-7e62cefab2e7 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:20.778589 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-60819e60-7305-44dd-8214-7e62cefab2e7 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:20.779392 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-60819e60-7305-44dd-8214-7e62cefab2e7 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:20.779784 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-60819e60-7305-44dd-8214-7e62cefab2e7 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:20.917344 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7ff806ce-10ba-4563-8ad5-da976b1ca427 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:20.934253 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7ff806ce-10ba-4563-8ad5-da976b1ca427 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1476 microversion: 2.1 time: 0.342302 Aug 04 16:36:20.934873 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 504/965] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:20 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1476 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:21.026760 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-60819e60-7305-44dd-8214-7e62cefab2e7 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lazy-loading 'services' on Instance uuid 6017510a-e331-424a-843d-54b980b999fb {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:36:21.071969 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-60819e60-7305-44dd-8214-7e62cefab2e7 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb" status: 200 len: 2035 microversion: 2.25 time: 0.311104 Aug 04 16:36:21.072931 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 462/966] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:36:20 2022] GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb => generated 2035 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:36:21.107380 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cbbb3e56-d028-47fa-9bb2-cf3f47f09210 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Action: 'create', calling method: .version_select at 0x7f7e84d4bc10>, body: {"keypair": {"name": "tempest-keypair-604521346", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPL/XMqMQHWvEBm4e8pTOSvQI0+ko7wAt+Ju+yqRYht4PXDaH60CcFdhmSboaTlQzK2s31UNzjZ7z2k0t5KRc8XADNwFccCNsKJpIwC7lZUz+4BSUL5cvFspQ6i8MNdKFg=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:21.120431 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:36:21.169574 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-cbbb3e56-d028-47fa-9bb2-cf3f47f09210 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Getting quotas for project e96e3e6168ec421da0cac9eaa8849255. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:36:21.190686 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-cbbb3e56-d028-47fa-9bb2-cf3f47f09210 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Getting quotas for user 5bf98871e1344215bd667945e6881320 and project e96e3e6168ec421da0cac9eaa8849255. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:36:21.235864 n-d-846466-12 devstack@n-api.service[126125]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cbbb3e56-d028-47fa-9bb2-cf3f47f09210 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [7901653b-d177-4be8-a7d9-f7b86b4b6ebf] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 16:36:21.960550 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-14e86199-2323-4f63-a6c7-51d4307abc20 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:21.961877 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-14e86199-2323-4f63-a6c7-51d4307abc20 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:21.984678 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-14e86199-2323-4f63-a6c7-51d4307abc20 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:21.985128 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-14e86199-2323-4f63-a6c7-51d4307abc20 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:21.986052 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-14e86199-2323-4f63-a6c7-51d4307abc20 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:21.986483 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-14e86199-2323-4f63-a6c7-51d4307abc20 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:22.271263 n-d-846466-12 devstack@n-api.service[126125]: INFO oslo.messaging._drivers.impl_rabbit [None req-cbbb3e56-d028-47fa-9bb2-cf3f47f09210 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [7901653b-d177-4be8-a7d9-f7b86b4b6ebf] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 34760. Aug 04 16:36:22.319926 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cbbb3e56-d028-47fa-9bb2-cf3f47f09210 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 1.216913 Aug 04 16:36:22.325361 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 505/967] 10.222.0.23 () {62 vars in 1200 bytes} [Thu Aug 4 16:36:21 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1218 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 16:36:22.353487 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-14e86199-2323-4f63-a6c7-51d4307abc20 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:22.368973 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-14e86199-2323-4f63-a6c7-51d4307abc20 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1476 microversion: 2.1 time: 0.412295 Aug 04 16:36:22.370001 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 463/968] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:21 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1476 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:22.750710 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1d56424d-c0c2-45e8-9aa3-07c4a5602a8d tempest-HypervisorAdminV253TestBase-1077783929 tempest-HypervisorAdminV253TestBase-1077783929-project-admin] Calling method '.version_select at 0x7f7e84903280>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:22.753887 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:36:22.753887 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:36:22.755255 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1d56424d-c0c2-45e8-9aa3-07c4a5602a8d tempest-HypervisorAdminV253TestBase-1077783929 tempest-HypervisorAdminV253TestBase-1077783929-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:22.755726 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1d56424d-c0c2-45e8-9aa3-07c4a5602a8d tempest-HypervisorAdminV253TestBase-1077783929 tempest-HypervisorAdminV253TestBase-1077783929-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:22.785681 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1d56424d-c0c2-45e8-9aa3-07c4a5602a8d tempest-HypervisorAdminV253TestBase-1077783929 tempest-HypervisorAdminV253TestBase-1077783929-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:22.785681 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1d56424d-c0c2-45e8-9aa3-07c4a5602a8d tempest-HypervisorAdminV253TestBase-1077783929 tempest-HypervisorAdminV253TestBase-1077783929-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:22.814508 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1d56424d-c0c2-45e8-9aa3-07c4a5602a8d tempest-HypervisorAdminV253TestBase-1077783929 tempest-HypervisorAdminV253TestBase-1077783929-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:22.815655 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1d56424d-c0c2-45e8-9aa3-07c4a5602a8d tempest-HypervisorAdminV253TestBase-1077783929 tempest-HypervisorAdminV253TestBase-1077783929-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:22.836257 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1d56424d-c0c2-45e8-9aa3-07c4a5602a8d tempest-HypervisorAdminV253TestBase-1077783929 tempest-HypervisorAdminV253TestBase-1077783929-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:22.836889 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1d56424d-c0c2-45e8-9aa3-07c4a5602a8d tempest-HypervisorAdminV253TestBase-1077783929 tempest-HypervisorAdminV253TestBase-1077783929-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:22.878772 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1d56424d-c0c2-45e8-9aa3-07c4a5602a8d tempest-HypervisorAdminV253TestBase-1077783929 tempest-HypervisorAdminV253TestBase-1077783929-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:22.879223 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1d56424d-c0c2-45e8-9aa3-07c4a5602a8d tempest-HypervisorAdminV253TestBase-1077783929 tempest-HypervisorAdminV253TestBase-1077783929-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:22.893176 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1d56424d-c0c2-45e8-9aa3-07c4a5602a8d tempest-HypervisorAdminV253TestBase-1077783929 tempest-HypervisorAdminV253TestBase-1077783929-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2235 microversion: 2.53 time: 0.570243 Aug 04 16:36:22.894628 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 506/969] 10.222.0.23 () {60 vars in 1243 bytes} [Thu Aug 4 16:36:22 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2235 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:36:22.913129 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0838f7c7-91aa-43a4-a552-0d04bb50a9cb tempest-HypervisorAdminV253TestBase-1077783929 tempest-HypervisorAdminV253TestBase-1077783929-project-admin] Calling method '.version_select at 0x7f7e84fcc280>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:22.917753 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:36:22.917753 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:36:22.919758 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0838f7c7-91aa-43a4-a552-0d04bb50a9cb tempest-HypervisorAdminV253TestBase-1077783929 tempest-HypervisorAdminV253TestBase-1077783929-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:22.920452 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0838f7c7-91aa-43a4-a552-0d04bb50a9cb tempest-HypervisorAdminV253TestBase-1077783929 tempest-HypervisorAdminV253TestBase-1077783929-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:22.941716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0838f7c7-91aa-43a4-a552-0d04bb50a9cb tempest-HypervisorAdminV253TestBase-1077783929 tempest-HypervisorAdminV253TestBase-1077783929-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:22.942490 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0838f7c7-91aa-43a4-a552-0d04bb50a9cb tempest-HypervisorAdminV253TestBase-1077783929 tempest-HypervisorAdminV253TestBase-1077783929-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:22.985105 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=4,nova_api:UPDATE=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:36:22.987794 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0838f7c7-91aa-43a4-a552-0d04bb50a9cb tempest-HypervisorAdminV253TestBase-1077783929 tempest-HypervisorAdminV253TestBase-1077783929-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:22.988434 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0838f7c7-91aa-43a4-a552-0d04bb50a9cb tempest-HypervisorAdminV253TestBase-1077783929 tempest-HypervisorAdminV253TestBase-1077783929-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:23.007173 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0838f7c7-91aa-43a4-a552-0d04bb50a9cb tempest-HypervisorAdminV253TestBase-1077783929 tempest-HypervisorAdminV253TestBase-1077783929-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:23.008082 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0838f7c7-91aa-43a4-a552-0d04bb50a9cb tempest-HypervisorAdminV253TestBase-1077783929 tempest-HypervisorAdminV253TestBase-1077783929-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:23.046099 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0838f7c7-91aa-43a4-a552-0d04bb50a9cb tempest-HypervisorAdminV253TestBase-1077783929 tempest-HypervisorAdminV253TestBase-1077783929-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:23.046648 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0838f7c7-91aa-43a4-a552-0d04bb50a9cb tempest-HypervisorAdminV253TestBase-1077783929 tempest-HypervisorAdminV253TestBase-1077783929-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:23.054701 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0838f7c7-91aa-43a4-a552-0d04bb50a9cb tempest-HypervisorAdminV253TestBase-1077783929 tempest-HypervisorAdminV253TestBase-1077783929-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 925 microversion: 2.53 time: 0.146639 Aug 04 16:36:23.055960 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 464/970] 10.222.0.23 () {60 vars in 1222 bytes} [Thu Aug 4 16:36:22 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 925 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:36:23.062752 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b66de8da-6ea8-4214-b3e1-6e58220de7a1 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1915778739", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:23.070972 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3ddf7f30-443e-4dd0-81cb-758aab8f4a02 tempest-HypervisorAdminV253TestBase-1077783929 tempest-HypervisorAdminV253TestBase-1077783929-project-admin] Calling method '.version_select at 0x7f7e84c96700>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:23.074356 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:36:23.074356 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:36:23.075855 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ddf7f30-443e-4dd0-81cb-758aab8f4a02 tempest-HypervisorAdminV253TestBase-1077783929 tempest-HypervisorAdminV253TestBase-1077783929-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:23.075855 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ddf7f30-443e-4dd0-81cb-758aab8f4a02 tempest-HypervisorAdminV253TestBase-1077783929 tempest-HypervisorAdminV253TestBase-1077783929-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:23.095310 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ddf7f30-443e-4dd0-81cb-758aab8f4a02 tempest-HypervisorAdminV253TestBase-1077783929 tempest-HypervisorAdminV253TestBase-1077783929-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:23.096074 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ddf7f30-443e-4dd0-81cb-758aab8f4a02 tempest-HypervisorAdminV253TestBase-1077783929 tempest-HypervisorAdminV253TestBase-1077783929-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:23.106048 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3ddf7f30-443e-4dd0-81cb-758aab8f4a02 tempest-HypervisorAdminV253TestBase-1077783929 tempest-HypervisorAdminV253TestBase-1077783929-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/06821a12-74bc-4195-8ef2-bbcfd535e75e" status: 200 len: 794 microversion: 2.53 time: 0.039140 Aug 04 16:36:23.109339 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 465/971] 10.222.0.23 () {60 vars in 1298 bytes} [Thu Aug 4 16:36:23 2022] GET /compute/v2.1/os-hypervisors/06821a12-74bc-4195-8ef2-bbcfd535e75e => generated 794 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:36:23.143684 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-b66de8da-6ea8-4214-b3e1-6e58220de7a1 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] validate_networks() for None {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:36:23.414729 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-943cd361-b634-4b72-a36d-a864a8f8e853 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:23.418037 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-943cd361-b634-4b72-a36d-a864a8f8e853 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:23.451501 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-943cd361-b634-4b72-a36d-a864a8f8e853 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:23.455116 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-943cd361-b634-4b72-a36d-a864a8f8e853 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:23.456523 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-943cd361-b634-4b72-a36d-a864a8f8e853 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:23.459205 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-943cd361-b634-4b72-a36d-a864a8f8e853 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:23.558891 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b66de8da-6ea8-4214-b3e1-6e58220de7a1 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:36:23.559425 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b66de8da-6ea8-4214-b3e1-6e58220de7a1 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:36:23.559818 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b66de8da-6ea8-4214-b3e1-6e58220de7a1 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:36:23.560512 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b66de8da-6ea8-4214-b3e1-6e58220de7a1 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:36:23.560797 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b66de8da-6ea8-4214-b3e1-6e58220de7a1 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:36:23.582376 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b66de8da-6ea8-4214-b3e1-6e58220de7a1 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:23.582836 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b66de8da-6ea8-4214-b3e1-6e58220de7a1 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:23.585680 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b66de8da-6ea8-4214-b3e1-6e58220de7a1 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:23.586188 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b66de8da-6ea8-4214-b3e1-6e58220de7a1 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:23.634593 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-b66de8da-6ea8-4214-b3e1-6e58220de7a1 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Getting quotas for project e30203a3cbb44c4ab36bcfa28662444d. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:36:23.650878 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-b66de8da-6ea8-4214-b3e1-6e58220de7a1 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Getting quotas for user ff4590a95e924aa3a08e823ef1d6d18c and project e30203a3cbb44c4ab36bcfa28662444d. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:36:23.692863 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b66de8da-6ea8-4214-b3e1-6e58220de7a1 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:36:23.702017 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b66de8da-6ea8-4214-b3e1-6e58220de7a1 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] [instance: e80e720e-cc06-40d9-b65e-02eca0e4f7d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:36:23.758447 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-943cd361-b634-4b72-a36d-a864a8f8e853 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:23.773554 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-943cd361-b634-4b72-a36d-a864a8f8e853 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1476 microversion: 2.1 time: 0.381081 Aug 04 16:36:23.790912 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 466/972] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:23 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1476 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:36:23.805085 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b66de8da-6ea8-4214-b3e1-6e58220de7a1 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.835894 Aug 04 16:36:23.815000 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 507/973] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:36:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 16:36:23.820974 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-66dd15f4-5131-49a0-bead-b14d510fd9e8 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:23.822350 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-66dd15f4-5131-49a0-bead-b14d510fd9e8 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] [instance: e80e720e-cc06-40d9-b65e-02eca0e4f7d8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:23.936962 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-66dd15f4-5131-49a0-bead-b14d510fd9e8 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4590a95e924aa3a08e823ef1d6d18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30203a3cbb44c4ab36bcfa28662444d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:23.951462 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-66dd15f4-5131-49a0-bead-b14d510fd9e8 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] 10.222.0.23 "GET /compute/v2.1/servers/e80e720e-cc06-40d9-b65e-02eca0e4f7d8" status: 200 len: 1214 microversion: 2.1 time: 0.134261 Aug 04 16:36:23.953094 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 467/974] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:23 2022] GET /compute/v2.1/servers/e80e720e-cc06-40d9-b65e-02eca0e4f7d8 => generated 1214 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:24.797768 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4d8f0cf3-527b-4324-ad3c-47ea01253ffc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:24.799212 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4d8f0cf3-527b-4324-ad3c-47ea01253ffc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:24.819101 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d8f0cf3-527b-4324-ad3c-47ea01253ffc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:24.819549 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d8f0cf3-527b-4324-ad3c-47ea01253ffc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:24.820337 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d8f0cf3-527b-4324-ad3c-47ea01253ffc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:24.820765 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d8f0cf3-527b-4324-ad3c-47ea01253ffc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:24.972806 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-70fd2603-25b8-4ba4-bca8-c2481a9aa739 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:24.973567 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-70fd2603-25b8-4ba4-bca8-c2481a9aa739 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] [instance: e80e720e-cc06-40d9-b65e-02eca0e4f7d8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:24.987818 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70fd2603-25b8-4ba4-bca8-c2481a9aa739 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:24.989509 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70fd2603-25b8-4ba4-bca8-c2481a9aa739 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:24.992594 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70fd2603-25b8-4ba4-bca8-c2481a9aa739 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:24.993248 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70fd2603-25b8-4ba4-bca8-c2481a9aa739 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:25.182613 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-70fd2603-25b8-4ba4-bca8-c2481a9aa739 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4590a95e924aa3a08e823ef1d6d18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30203a3cbb44c4ab36bcfa28662444d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:25.191090 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-70fd2603-25b8-4ba4-bca8-c2481a9aa739 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] 10.222.0.23 "GET /compute/v2.1/servers/e80e720e-cc06-40d9-b65e-02eca0e4f7d8" status: 200 len: 1210 microversion: 2.1 time: 0.222117 Aug 04 16:36:25.196214 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 468/975] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:24 2022] GET /compute/v2.1/servers/e80e720e-cc06-40d9-b65e-02eca0e4f7d8 => generated 1210 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:36:25.403278 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4d8f0cf3-527b-4324-ad3c-47ea01253ffc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:25.440129 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4d8f0cf3-527b-4324-ad3c-47ea01253ffc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1476 microversion: 2.1 time: 0.644087 Aug 04 16:36:25.442655 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 508/976] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:24 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1476 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:26.222916 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a07b16da-cc13-4fe8-af57-c8572102ce2a tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:26.224113 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a07b16da-cc13-4fe8-af57-c8572102ce2a tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] [instance: e80e720e-cc06-40d9-b65e-02eca0e4f7d8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:26.245722 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a07b16da-cc13-4fe8-af57-c8572102ce2a tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:26.248328 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a07b16da-cc13-4fe8-af57-c8572102ce2a tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:26.250230 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a07b16da-cc13-4fe8-af57-c8572102ce2a tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:26.253524 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a07b16da-cc13-4fe8-af57-c8572102ce2a tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:26.380259 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-960ab8ad-d3c3-446d-8d64-f657d56d550f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1103769245", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "2ab6e0fe-802f-4938-8f6b-adfd35fddb62"}], "security_groups": [{"name": "tempest-securitygroup--1145980446"}], "key_name": "tempest-keypair-604521346", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:26.609608 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a07b16da-cc13-4fe8-af57-c8572102ce2a tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4590a95e924aa3a08e823ef1d6d18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30203a3cbb44c4ab36bcfa28662444d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:26.627357 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a07b16da-cc13-4fe8-af57-c8572102ce2a tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] 10.222.0.23 "GET /compute/v2.1/servers/e80e720e-cc06-40d9-b65e-02eca0e4f7d8" status: 200 len: 1272 microversion: 2.1 time: 0.408811 Aug 04 16:36:26.628366 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 469/977] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:26 2022] GET /compute/v2.1/servers/e80e720e-cc06-40d9-b65e-02eca0e4f7d8 => generated 1272 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:26.647205 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fd8263ee-8570-4721-8f37-2b9dee5c49d4 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:26.652855 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fd8263ee-8570-4721-8f37-2b9dee5c49d4 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:26.664139 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fd8263ee-8570-4721-8f37-2b9dee5c49d4 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:26.664841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fd8263ee-8570-4721-8f37-2b9dee5c49d4 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:26.665950 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fd8263ee-8570-4721-8f37-2b9dee5c49d4 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:26.666610 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fd8263ee-8570-4721-8f37-2b9dee5c49d4 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:26.768275 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-960ab8ad-d3c3-446d-8d64-f657d56d550f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] validate_networks() for [('2ab6e0fe-802f-4938-8f6b-adfd35fddb62', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:36:27.449547 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fd8263ee-8570-4721-8f37-2b9dee5c49d4 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:27.471255 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fd8263ee-8570-4721-8f37-2b9dee5c49d4 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1476 microversion: 2.1 time: 0.841129 Aug 04 16:36:27.473752 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 470/978] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:26 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1476 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:27.650127 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-150bd8aa-9356-40e4-a4c4-a077de178bb6 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:27.650741 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-150bd8aa-9356-40e4-a4c4-a077de178bb6 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] [instance: e80e720e-cc06-40d9-b65e-02eca0e4f7d8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:27.661406 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-150bd8aa-9356-40e4-a4c4-a077de178bb6 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:27.661842 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-150bd8aa-9356-40e4-a4c4-a077de178bb6 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:27.665030 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-150bd8aa-9356-40e4-a4c4-a077de178bb6 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:27.667152 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-150bd8aa-9356-40e4-a4c4-a077de178bb6 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:28.489311 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-150bd8aa-9356-40e4-a4c4-a077de178bb6 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4590a95e924aa3a08e823ef1d6d18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30203a3cbb44c4ab36bcfa28662444d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:28.524193 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-150bd8aa-9356-40e4-a4c4-a077de178bb6 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] 10.222.0.23 "GET /compute/v2.1/servers/e80e720e-cc06-40d9-b65e-02eca0e4f7d8" status: 200 len: 1272 microversion: 2.1 time: 0.878394 Aug 04 16:36:28.524832 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 471/979] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:27 2022] GET /compute/v2.1/servers/e80e720e-cc06-40d9-b65e-02eca0e4f7d8 => generated 1272 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:36:28.588923 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-94942438-3948-4572-863b-0c7f7d2faace tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:28.590341 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-94942438-3948-4572-863b-0c7f7d2faace tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:28.609181 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-94942438-3948-4572-863b-0c7f7d2faace tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:28.610091 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-94942438-3948-4572-863b-0c7f7d2faace tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:28.611499 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-94942438-3948-4572-863b-0c7f7d2faace tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:28.612274 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-94942438-3948-4572-863b-0c7f7d2faace tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:29.284275 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-94942438-3948-4572-863b-0c7f7d2faace tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:29.292770 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-94942438-3948-4572-863b-0c7f7d2faace tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1476 microversion: 2.1 time: 0.748434 Aug 04 16:36:29.293612 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 472/980] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:28 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1476 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:29.558001 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a3fb27bc-5287-4c00-909f-fed0638f9817 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:29.559617 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a3fb27bc-5287-4c00-909f-fed0638f9817 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] [instance: e80e720e-cc06-40d9-b65e-02eca0e4f7d8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:29.572433 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a3fb27bc-5287-4c00-909f-fed0638f9817 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:29.572883 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a3fb27bc-5287-4c00-909f-fed0638f9817 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:29.573716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a3fb27bc-5287-4c00-909f-fed0638f9817 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:29.574150 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a3fb27bc-5287-4c00-909f-fed0638f9817 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:29.598191 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-960ab8ad-d3c3-446d-8d64-f657d56d550f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:36:29.599403 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-960ab8ad-d3c3-446d-8d64-f657d56d550f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:36:29.600300 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-960ab8ad-d3c3-446d-8d64-f657d56d550f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:36:29.600879 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-960ab8ad-d3c3-446d-8d64-f657d56d550f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:36:29.601649 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-960ab8ad-d3c3-446d-8d64-f657d56d550f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:36:29.624801 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-960ab8ad-d3c3-446d-8d64-f657d56d550f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:29.625242 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-960ab8ad-d3c3-446d-8d64-f657d56d550f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:29.633096 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-960ab8ad-d3c3-446d-8d64-f657d56d550f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:29.635673 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-960ab8ad-d3c3-446d-8d64-f657d56d550f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:29.705369 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-960ab8ad-d3c3-446d-8d64-f657d56d550f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Getting quotas for project e96e3e6168ec421da0cac9eaa8849255. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:36:29.733917 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-960ab8ad-d3c3-446d-8d64-f657d56d550f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Getting quotas for user 5bf98871e1344215bd667945e6881320 and project e96e3e6168ec421da0cac9eaa8849255. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:36:29.817691 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-960ab8ad-d3c3-446d-8d64-f657d56d550f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:36:29.820165 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-960ab8ad-d3c3-446d-8d64-f657d56d550f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:36:29.958406 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-960ab8ad-d3c3-446d-8d64-f657d56d550f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 3.582129 Aug 04 16:36:29.959900 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 509/981] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Aug 4 16:36:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 3584 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 04 16:36:29.982443 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c8fe251e-b99e-4f25-90b5-5af02a0efce5 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:29.984027 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c8fe251e-b99e-4f25-90b5-5af02a0efce5 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:30.162448 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c8fe251e-b99e-4f25-90b5-5af02a0efce5 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:30.171730 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c8fe251e-b99e-4f25-90b5-5af02a0efce5 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:30.180483 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c8fe251e-b99e-4f25-90b5-5af02a0efce5 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:30.181978 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c8fe251e-b99e-4f25-90b5-5af02a0efce5 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 1285 microversion: 2.25 time: 0.205783 Aug 04 16:36:30.184874 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 510/982] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:36:29 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 1285 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:36:30.318453 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-261a7de0-64d6-4dde-a651-acfa9d0a350d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:30.319072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-261a7de0-64d6-4dde-a651-acfa9d0a350d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:30.335415 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-261a7de0-64d6-4dde-a651-acfa9d0a350d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:30.335856 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-261a7de0-64d6-4dde-a651-acfa9d0a350d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:30.336654 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-261a7de0-64d6-4dde-a651-acfa9d0a350d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:30.337095 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-261a7de0-64d6-4dde-a651-acfa9d0a350d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:30.370019 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a3fb27bc-5287-4c00-909f-fed0638f9817 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4590a95e924aa3a08e823ef1d6d18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30203a3cbb44c4ab36bcfa28662444d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:30.381487 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a3fb27bc-5287-4c00-909f-fed0638f9817 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] 10.222.0.23 "GET /compute/v2.1/servers/e80e720e-cc06-40d9-b65e-02eca0e4f7d8" status: 200 len: 1314 microversion: 2.1 time: 0.833903 Aug 04 16:36:30.384644 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 473/983] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:29 2022] GET /compute/v2.1/servers/e80e720e-cc06-40d9-b65e-02eca0e4f7d8 => generated 1314 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:36:30.852394 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-261a7de0-64d6-4dde-a651-acfa9d0a350d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:30.872147 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-261a7de0-64d6-4dde-a651-acfa9d0a350d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1476 microversion: 2.1 time: 0.556454 Aug 04 16:36:30.874749 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 511/984] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:30 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1476 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:36:31.212315 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3e650224-f8af-4f2a-91f9-ca5a6aa3b4ac tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:31.214112 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3e650224-f8af-4f2a-91f9-ca5a6aa3b4ac tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:31.225604 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3e650224-f8af-4f2a-91f9-ca5a6aa3b4ac tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:31.227189 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3e650224-f8af-4f2a-91f9-ca5a6aa3b4ac tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:31.228938 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3e650224-f8af-4f2a-91f9-ca5a6aa3b4ac tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:31.231339 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3e650224-f8af-4f2a-91f9-ca5a6aa3b4ac tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:31.383052 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-273d12b6-7ddc-4396-9542-782c6d72fc0b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-380446762", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:31.422357 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3e650224-f8af-4f2a-91f9-ca5a6aa3b4ac tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:31.444868 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3e650224-f8af-4f2a-91f9-ca5a6aa3b4ac tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:31.451169 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3e650224-f8af-4f2a-91f9-ca5a6aa3b4ac tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:31.455655 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3e650224-f8af-4f2a-91f9-ca5a6aa3b4ac tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 1337 microversion: 2.25 time: 0.247075 Aug 04 16:36:31.458608 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 512/985] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:36:31 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 1337 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:36:31.474647 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e40878b1-c69b-4fc8-82bc-fb1b67dc6ba9 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:31.476854 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e40878b1-c69b-4fc8-82bc-fb1b67dc6ba9 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] [instance: e80e720e-cc06-40d9-b65e-02eca0e4f7d8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:31.490467 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-273d12b6-7ddc-4396-9542-782c6d72fc0b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] validate_networks() for [('ae4e4fd4-6cd4-4458-b6a4-6a319728f4a0', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:36:31.527486 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e40878b1-c69b-4fc8-82bc-fb1b67dc6ba9 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:31.529476 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e40878b1-c69b-4fc8-82bc-fb1b67dc6ba9 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:31.530847 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e40878b1-c69b-4fc8-82bc-fb1b67dc6ba9 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:31.531665 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e40878b1-c69b-4fc8-82bc-fb1b67dc6ba9 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:32.155678 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e40878b1-c69b-4fc8-82bc-fb1b67dc6ba9 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4590a95e924aa3a08e823ef1d6d18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30203a3cbb44c4ab36bcfa28662444d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:32.177882 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e40878b1-c69b-4fc8-82bc-fb1b67dc6ba9 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] 10.222.0.23 "GET /compute/v2.1/servers/e80e720e-cc06-40d9-b65e-02eca0e4f7d8" status: 200 len: 1314 microversion: 2.1 time: 0.717005 Aug 04 16:36:32.179506 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 513/986] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:31 2022] GET /compute/v2.1/servers/e80e720e-cc06-40d9-b65e-02eca0e4f7d8 => generated 1314 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:32.204316 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7201564f-db43-48dc-80df-102bd0011315 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:32.210111 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7201564f-db43-48dc-80df-102bd0011315 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:32.219633 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7201564f-db43-48dc-80df-102bd0011315 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:32.220615 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7201564f-db43-48dc-80df-102bd0011315 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:32.222863 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7201564f-db43-48dc-80df-102bd0011315 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:32.223559 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7201564f-db43-48dc-80df-102bd0011315 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:32.433953 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-273d12b6-7ddc-4396-9542-782c6d72fc0b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:36:32.434948 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-273d12b6-7ddc-4396-9542-782c6d72fc0b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:36:32.435735 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-273d12b6-7ddc-4396-9542-782c6d72fc0b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:36:32.436529 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-273d12b6-7ddc-4396-9542-782c6d72fc0b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:36:32.437640 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-273d12b6-7ddc-4396-9542-782c6d72fc0b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:36:32.447671 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-273d12b6-7ddc-4396-9542-782c6d72fc0b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:32.448297 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-273d12b6-7ddc-4396-9542-782c6d72fc0b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:32.449415 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-273d12b6-7ddc-4396-9542-782c6d72fc0b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:32.450099 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-273d12b6-7ddc-4396-9542-782c6d72fc0b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:32.472540 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-273d12b6-7ddc-4396-9542-782c6d72fc0b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Getting quotas for project 20d035e0adc640c8a3ceb832275d0ea7. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:36:32.489797 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-273d12b6-7ddc-4396-9542-782c6d72fc0b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Getting quotas for user a88db264b2c94f699e015a8617150b45 and project 20d035e0adc640c8a3ceb832275d0ea7. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:36:32.525414 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-273d12b6-7ddc-4396-9542-782c6d72fc0b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:36:32.531045 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-273d12b6-7ddc-4396-9542-782c6d72fc0b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: 532ec916-2768-43e0-a912-791fb4b5d9ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:36:32.626791 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-273d12b6-7ddc-4396-9542-782c6d72fc0b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.446836 Aug 04 16:36:32.633647 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 474/987] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:36:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 1450 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:36:32.642348 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f37f6aee-f485-441a-9cb3-b1d584464b09 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:32.644995 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f37f6aee-f485-441a-9cb3-b1d584464b09 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:32.656092 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f37f6aee-f485-441a-9cb3-b1d584464b09 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:32.659274 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f37f6aee-f485-441a-9cb3-b1d584464b09 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:32.663929 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f37f6aee-f485-441a-9cb3-b1d584464b09 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:32.665522 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f37f6aee-f485-441a-9cb3-b1d584464b09 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:32.845760 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7201564f-db43-48dc-80df-102bd0011315 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:32.853699 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:36:32.862134 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7201564f-db43-48dc-80df-102bd0011315 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1476 microversion: 2.1 time: 0.679827 Aug 04 16:36:32.873463 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 514/988] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:32 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1476 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:32.873463 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-f63c82c5-49f5-48ce-86f4-8a299e79aebd req-c3b6660d-f267-40a8-b4c3-52109de920bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e80e720e-cc06-40d9-b65e-02eca0e4f7d8", "tag": "5f18bbd6-8f30-496d-9e64-85d1f9cc4514"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:32.881376 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f37f6aee-f485-441a-9cb3-b1d584464b09 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:32.897343 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-f63c82c5-49f5-48ce-86f4-8a299e79aebd req-c3b6660d-f267-40a8-b4c3-52109de920bc service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:32.897795 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-f63c82c5-49f5-48ce-86f4-8a299e79aebd req-c3b6660d-f267-40a8-b4c3-52109de920bc service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:32.899203 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f37f6aee-f485-441a-9cb3-b1d584464b09 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:32.900743 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f37f6aee-f485-441a-9cb3-b1d584464b09 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:32.901941 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f37f6aee-f485-441a-9cb3-b1d584464b09 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 1343 microversion: 2.25 time: 0.266780 Aug 04 16:36:32.919478 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 475/989] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:36:32 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 1343 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:36:32.923049 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-f63c82c5-49f5-48ce-86f4-8a299e79aebd req-c3b6660d-f267-40a8-b4c3-52109de920bc service nova] Creating event network-changed:5f18bbd6-8f30-496d-9e64-85d1f9cc4514 for instance e80e720e-cc06-40d9-b65e-02eca0e4f7d8 on n-h1-846466-12 Aug 04 16:36:32.931619 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-df6b86b0-5cca-448b-81c8-4ea49576c63c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:32.932173 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-df6b86b0-5cca-448b-81c8-4ea49576c63c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: 532ec916-2768-43e0-a912-791fb4b5d9ea] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:32.937294 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-f63c82c5-49f5-48ce-86f4-8a299e79aebd req-c3b6660d-f267-40a8-b4c3-52109de920bc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072289 Aug 04 16:36:32.942859 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 515/990] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:36:33.068048 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cf0cd19f-77cb-4912-ac5c-8f23ba86cc6b tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Action: 'create', calling method: .version_select at 0x7f7e848d1d30>, body: {"keypair": {"name": "tempest-keypair-640652626", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDV72rV66f/VA2M7E/j3PvvXeMw4Dqf2cCRzNBsWZYsJCPRvH0bD1KEylkyGpw4DpnB0fbmBf8YXqV4NfrrM9fjoA6YQuSOQnA9k56N3ffy1Uu/3MsjPeBmqGnI5Jyk5KQ=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:33.101246 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-df6b86b0-5cca-448b-81c8-4ea49576c63c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:33.109676 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-df6b86b0-5cca-448b-81c8-4ea49576c63c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea" status: 200 len: 1221 microversion: 2.1 time: 0.188725 Aug 04 16:36:33.114873 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 476/991] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:32 2022] GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea => generated 1221 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:33.116671 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-cf0cd19f-77cb-4912-ac5c-8f23ba86cc6b tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Getting quotas for project 4b5527cc7c4944c7898b64308f13b850. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:36:33.128147 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-cf0cd19f-77cb-4912-ac5c-8f23ba86cc6b tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Getting quotas for user 23645970a9a24e94b10b8578bb30b37e and project 4b5527cc7c4944c7898b64308f13b850. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:36:33.183656 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2f227ac3-d13d-4edd-a032-32fc4572c4f4 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1685838860", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:33.206899 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cf0cd19f-77cb-4912-ac5c-8f23ba86cc6b tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.260707 Aug 04 16:36:33.208631 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 516/992] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 16:36:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:36:33.215245 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9fa988c3-dff6-460e-b868-bf48832208e9 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:33.216570 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9fa988c3-dff6-460e-b868-bf48832208e9 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] [instance: e80e720e-cc06-40d9-b65e-02eca0e4f7d8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:33.229451 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9fa988c3-dff6-460e-b868-bf48832208e9 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:33.234194 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9fa988c3-dff6-460e-b868-bf48832208e9 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:33.235198 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9fa988c3-dff6-460e-b868-bf48832208e9 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:33.235804 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9fa988c3-dff6-460e-b868-bf48832208e9 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:33.303000 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-2f227ac3-d13d-4edd-a032-32fc4572c4f4 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] validate_networks() for [('ae4e4fd4-6cd4-4458-b6a4-6a319728f4a0', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:36:34.646704 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9fa988c3-dff6-460e-b868-bf48832208e9 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4590a95e924aa3a08e823ef1d6d18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30203a3cbb44c4ab36bcfa28662444d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:34.658462 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9fa988c3-dff6-460e-b868-bf48832208e9 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] 10.222.0.23 "GET /compute/v2.1/servers/e80e720e-cc06-40d9-b65e-02eca0e4f7d8" status: 200 len: 1314 microversion: 2.1 time: 1.448405 Aug 04 16:36:34.659230 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 517/993] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:33 2022] GET /compute/v2.1/servers/e80e720e-cc06-40d9-b65e-02eca0e4f7d8 => generated 1314 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:34.697889 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-48c9e789-2817-4fb0-a43f-e067e26cc619 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:34.698522 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-48c9e789-2817-4fb0-a43f-e067e26cc619 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:34.716634 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-48c9e789-2817-4fb0-a43f-e067e26cc619 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:34.717188 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-48c9e789-2817-4fb0-a43f-e067e26cc619 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:34.722795 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-48c9e789-2817-4fb0-a43f-e067e26cc619 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:34.723250 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-48c9e789-2817-4fb0-a43f-e067e26cc619 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:35.297306 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-48c9e789-2817-4fb0-a43f-e067e26cc619 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:35.316161 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-48c9e789-2817-4fb0-a43f-e067e26cc619 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1476 microversion: 2.1 time: 0.632035 Aug 04 16:36:35.317111 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 518/994] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:34 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1476 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:35.321955 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2e172bf9-a0c7-4562-bae2-010e87a24a1a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:35.322568 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2e172bf9-a0c7-4562-bae2-010e87a24a1a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:35.333588 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e172bf9-a0c7-4562-bae2-010e87a24a1a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:35.334051 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e172bf9-a0c7-4562-bae2-010e87a24a1a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:35.335059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e172bf9-a0c7-4562-bae2-010e87a24a1a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:35.335495 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e172bf9-a0c7-4562-bae2-010e87a24a1a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:35.553689 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-2f227ac3-d13d-4edd-a032-32fc4572c4f4 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:36:35.554312 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-2f227ac3-d13d-4edd-a032-32fc4572c4f4 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:36:35.555344 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-2f227ac3-d13d-4edd-a032-32fc4572c4f4 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:36:35.556070 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-2f227ac3-d13d-4edd-a032-32fc4572c4f4 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:36:35.556745 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-2f227ac3-d13d-4edd-a032-32fc4572c4f4 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:36:35.570013 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f227ac3-d13d-4edd-a032-32fc4572c4f4 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:35.570912 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f227ac3-d13d-4edd-a032-32fc4572c4f4 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:35.572253 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f227ac3-d13d-4edd-a032-32fc4572c4f4 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:35.577515 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f227ac3-d13d-4edd-a032-32fc4572c4f4 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:35.628665 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-2f227ac3-d13d-4edd-a032-32fc4572c4f4 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Getting quotas for project 20d035e0adc640c8a3ceb832275d0ea7. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:36:35.637425 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-2f227ac3-d13d-4edd-a032-32fc4572c4f4 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Getting quotas for user a88db264b2c94f699e015a8617150b45 and project 20d035e0adc640c8a3ceb832275d0ea7. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:36:35.657005 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2f227ac3-d13d-4edd-a032-32fc4572c4f4 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:36:35.662048 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2f227ac3-d13d-4edd-a032-32fc4572c4f4 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: d238b9f3-e25b-4864-8b27-d53054d76082] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:36:35.724638 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2f227ac3-d13d-4edd-a032-32fc4572c4f4 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.545742 Aug 04 16:36:35.725772 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 477/995] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:36:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 2547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 16:36:35.732815 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a83cbf20-dea0-43a7-921e-6c4061f606c1 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:35.735420 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a83cbf20-dea0-43a7-921e-6c4061f606c1 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] [instance: e80e720e-cc06-40d9-b65e-02eca0e4f7d8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:35.745084 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a83cbf20-dea0-43a7-921e-6c4061f606c1 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:35.745989 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a83cbf20-dea0-43a7-921e-6c4061f606c1 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:35.747382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a83cbf20-dea0-43a7-921e-6c4061f606c1 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:35.748157 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a83cbf20-dea0-43a7-921e-6c4061f606c1 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:35.753848 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=100 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:36:35.890237 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2e172bf9-a0c7-4562-bae2-010e87a24a1a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:35.898982 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2e172bf9-a0c7-4562-bae2-010e87a24a1a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:35.907230 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2e172bf9-a0c7-4562-bae2-010e87a24a1a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:35.908714 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2e172bf9-a0c7-4562-bae2-010e87a24a1a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 1411 microversion: 2.25 time: 0.590591 Aug 04 16:36:35.909537 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 519/996] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:36:35 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 1411 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:36:35.925625 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-579114be-f00e-4655-864b-927cbdac3609 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:35.926486 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-579114be-f00e-4655-864b-927cbdac3609 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: d238b9f3-e25b-4864-8b27-d53054d76082] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:36.332851 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-579114be-f00e-4655-864b-927cbdac3609 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:36.340722 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-579114be-f00e-4655-864b-927cbdac3609 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082" status: 200 len: 1222 microversion: 2.1 time: 0.422709 Aug 04 16:36:36.341330 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 520/997] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:35 2022] GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082 => generated 1222 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:36.364101 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b83a56fe-2a49-48db-9c58-b00f4296fb73 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:36.364926 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b83a56fe-2a49-48db-9c58-b00f4296fb73 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:36.388405 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b83a56fe-2a49-48db-9c58-b00f4296fb73 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:36.396307 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b83a56fe-2a49-48db-9c58-b00f4296fb73 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:36.397569 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b83a56fe-2a49-48db-9c58-b00f4296fb73 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:36.398036 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b83a56fe-2a49-48db-9c58-b00f4296fb73 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:36.698744 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a83cbf20-dea0-43a7-921e-6c4061f606c1 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4590a95e924aa3a08e823ef1d6d18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30203a3cbb44c4ab36bcfa28662444d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:36.715358 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a83cbf20-dea0-43a7-921e-6c4061f606c1 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] 10.222.0.23 "GET /compute/v2.1/servers/e80e720e-cc06-40d9-b65e-02eca0e4f7d8" status: 200 len: 1314 microversion: 2.1 time: 0.988433 Aug 04 16:36:36.716306 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 478/998] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:35 2022] GET /compute/v2.1/servers/e80e720e-cc06-40d9-b65e-02eca0e4f7d8 => generated 1314 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:36.935358 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-726ef66f-5390-44bc-80bb-c567466e84bd tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:36.936290 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-726ef66f-5390-44bc-80bb-c567466e84bd tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:36.951784 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-726ef66f-5390-44bc-80bb-c567466e84bd tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:36.952513 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-726ef66f-5390-44bc-80bb-c567466e84bd tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:36.953606 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-726ef66f-5390-44bc-80bb-c567466e84bd tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:36.954359 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-726ef66f-5390-44bc-80bb-c567466e84bd tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:37.150976 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b83a56fe-2a49-48db-9c58-b00f4296fb73 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:37.164329 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b83a56fe-2a49-48db-9c58-b00f4296fb73 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1476 microversion: 2.1 time: 0.814943 Aug 04 16:36:37.165699 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 521/999] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:36 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1476 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:37.367466 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9c81d726-0910-40df-b9e0-e8def674b6b7 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:37.368460 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9c81d726-0910-40df-b9e0-e8def674b6b7 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: d238b9f3-e25b-4864-8b27-d53054d76082] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:37.379439 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c81d726-0910-40df-b9e0-e8def674b6b7 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:37.384869 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c81d726-0910-40df-b9e0-e8def674b6b7 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:37.386467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c81d726-0910-40df-b9e0-e8def674b6b7 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:37.391133 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c81d726-0910-40df-b9e0-e8def674b6b7 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:37.530385 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-726ef66f-5390-44bc-80bb-c567466e84bd tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:37.547029 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-726ef66f-5390-44bc-80bb-c567466e84bd tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:37.548966 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-726ef66f-5390-44bc-80bb-c567466e84bd tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:37.550375 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-726ef66f-5390-44bc-80bb-c567466e84bd tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 1411 microversion: 2.25 time: 0.619183 Aug 04 16:36:37.551566 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 479/1000] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:36:36 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 1411 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:36:37.697045 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9c81d726-0910-40df-b9e0-e8def674b6b7 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:37.736971 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b602dd29-6c07-45de-9b33-6b1b774cb89d tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:37.737600 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b602dd29-6c07-45de-9b33-6b1b774cb89d tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] [instance: e80e720e-cc06-40d9-b65e-02eca0e4f7d8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:37.741829 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9c81d726-0910-40df-b9e0-e8def674b6b7 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082" status: 200 len: 1274 microversion: 2.1 time: 0.381282 Aug 04 16:36:37.753328 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 522/1001] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:37 2022] GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082 => generated 1274 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:36:37.756038 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b602dd29-6c07-45de-9b33-6b1b774cb89d tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:37.756686 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b602dd29-6c07-45de-9b33-6b1b774cb89d tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:37.765979 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b602dd29-6c07-45de-9b33-6b1b774cb89d tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:37.766767 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b602dd29-6c07-45de-9b33-6b1b774cb89d tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:37.837945 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-a5904a44-f4ec-402f-8e7e-23695e75e238 req-4fae234c-4c61-408a-a4f8-34feec333055 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5021f3f8-aa8b-4c94-8846-fdd1081135f5", "tag": "0ac743e2-4fd8-459b-98e6-2cd3c20f4ed6"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:37.865792 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-a5904a44-f4ec-402f-8e7e-23695e75e238 req-4fae234c-4c61-408a-a4f8-34feec333055 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:37.868285 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-a5904a44-f4ec-402f-8e7e-23695e75e238 req-4fae234c-4c61-408a-a4f8-34feec333055 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:37.909869 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-a5904a44-f4ec-402f-8e7e-23695e75e238 req-4fae234c-4c61-408a-a4f8-34feec333055 service nova] Creating event network-changed:0ac743e2-4fd8-459b-98e6-2cd3c20f4ed6 for instance 5021f3f8-aa8b-4c94-8846-fdd1081135f5 on n-h1-846466-12 Aug 04 16:36:37.917149 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-a5904a44-f4ec-402f-8e7e-23695e75e238 req-4fae234c-4c61-408a-a4f8-34feec333055 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088137 Aug 04 16:36:37.919421 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 523/1002] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:36:38.193646 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d8d38732-036f-4c4d-8fd5-1527e89cb955 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:38.195568 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d8d38732-036f-4c4d-8fd5-1527e89cb955 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:38.209041 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d8d38732-036f-4c4d-8fd5-1527e89cb955 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:38.214142 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d8d38732-036f-4c4d-8fd5-1527e89cb955 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:38.221510 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d8d38732-036f-4c4d-8fd5-1527e89cb955 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:38.224955 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d8d38732-036f-4c4d-8fd5-1527e89cb955 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:38.706786 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b602dd29-6c07-45de-9b33-6b1b774cb89d tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4590a95e924aa3a08e823ef1d6d18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30203a3cbb44c4ab36bcfa28662444d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:38.715846 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b602dd29-6c07-45de-9b33-6b1b774cb89d tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] 10.222.0.23 "GET /compute/v2.1/servers/e80e720e-cc06-40d9-b65e-02eca0e4f7d8" status: 200 len: 1314 microversion: 2.1 time: 0.983185 Aug 04 16:36:38.739744 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 480/1003] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:37 2022] GET /compute/v2.1/servers/e80e720e-cc06-40d9-b65e-02eca0e4f7d8 => generated 1314 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:36:38.746904 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e526b00c-e278-460e-a3f0-e50b8bd5ba03 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:38.747780 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e526b00c-e278-460e-a3f0-e50b8bd5ba03 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:38.755499 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e526b00c-e278-460e-a3f0-e50b8bd5ba03 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:38.756160 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e526b00c-e278-460e-a3f0-e50b8bd5ba03 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:38.757142 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e526b00c-e278-460e-a3f0-e50b8bd5ba03 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:38.757797 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e526b00c-e278-460e-a3f0-e50b8bd5ba03 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:39.662119 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d8d38732-036f-4c4d-8fd5-1527e89cb955 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:39.666375 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:36:39.687482 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d8d38732-036f-4c4d-8fd5-1527e89cb955 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1476 microversion: 2.1 time: 1.503212 Aug 04 16:36:39.688118 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 524/1004] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:38 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1476 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:39.696022 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e526b00c-e278-460e-a3f0-e50b8bd5ba03 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:39.715775 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5738493a-23fb-4f08-86a0-934dc6b32396 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:39.716660 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5738493a-23fb-4f08-86a0-934dc6b32396 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: d238b9f3-e25b-4864-8b27-d53054d76082] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:39.718475 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e526b00c-e278-460e-a3f0-e50b8bd5ba03 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:39.723653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e526b00c-e278-460e-a3f0-e50b8bd5ba03 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:39.725172 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e526b00c-e278-460e-a3f0-e50b8bd5ba03 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 1411 microversion: 2.25 time: 0.984294 Aug 04 16:36:39.726664 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:36:39.729871 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 481/1005] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:36:38 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 1411 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:36:39.741018 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5738493a-23fb-4f08-86a0-934dc6b32396 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:39.741799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5738493a-23fb-4f08-86a0-934dc6b32396 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:39.742952 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5738493a-23fb-4f08-86a0-934dc6b32396 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:39.743542 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5738493a-23fb-4f08-86a0-934dc6b32396 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:39.753945 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fffd7b89-a939-4045-8ebd-28f1977ae491 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:39.755206 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fffd7b89-a939-4045-8ebd-28f1977ae491 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] [instance: e80e720e-cc06-40d9-b65e-02eca0e4f7d8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:39.766766 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fffd7b89-a939-4045-8ebd-28f1977ae491 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:39.769492 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fffd7b89-a939-4045-8ebd-28f1977ae491 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:39.770490 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fffd7b89-a939-4045-8ebd-28f1977ae491 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:39.771145 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fffd7b89-a939-4045-8ebd-28f1977ae491 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:39.960539 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5738493a-23fb-4f08-86a0-934dc6b32396 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:39.970664 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5738493a-23fb-4f08-86a0-934dc6b32396 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082" status: 200 len: 1280 microversion: 2.1 time: 0.280561 Aug 04 16:36:39.986310 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 525/1006] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:39 2022] GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082 => generated 1280 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:40.097815 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-53052ec9-d603-4671-8578-35421a78af7f tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1948174636", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "c15511a6-c820-42c7-a327-7e19eb06873f"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:40.169378 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-53052ec9-d603-4671-8578-35421a78af7f tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] validate_networks() for [('c15511a6-c820-42c7-a327-7e19eb06873f', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:36:40.356508 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fffd7b89-a939-4045-8ebd-28f1977ae491 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4590a95e924aa3a08e823ef1d6d18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30203a3cbb44c4ab36bcfa28662444d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:40.365514 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fffd7b89-a939-4045-8ebd-28f1977ae491 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] 10.222.0.23 "GET /compute/v2.1/servers/e80e720e-cc06-40d9-b65e-02eca0e4f7d8" status: 200 len: 1314 microversion: 2.1 time: 0.617024 Aug 04 16:36:40.373821 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 482/1007] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:39 2022] GET /compute/v2.1/servers/e80e720e-cc06-40d9-b65e-02eca0e4f7d8 => generated 1314 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:36:40.381727 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-88ef1fd7-f9c6-4060-8a18-6a2a5d43897d req-5ed0690f-8ba7-4852-b40d-91a0d685e79e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e80e720e-cc06-40d9-b65e-02eca0e4f7d8", "name": "network-vif-plugged", "status": "completed", "tag": "5f18bbd6-8f30-496d-9e64-85d1f9cc4514"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:40.393990 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-88ef1fd7-f9c6-4060-8a18-6a2a5d43897d req-5ed0690f-8ba7-4852-b40d-91a0d685e79e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:40.394422 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-88ef1fd7-f9c6-4060-8a18-6a2a5d43897d req-5ed0690f-8ba7-4852-b40d-91a0d685e79e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:40.410899 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-88ef1fd7-f9c6-4060-8a18-6a2a5d43897d req-5ed0690f-8ba7-4852-b40d-91a0d685e79e service nova] Creating event network-vif-plugged:5f18bbd6-8f30-496d-9e64-85d1f9cc4514 for instance e80e720e-cc06-40d9-b65e-02eca0e4f7d8 on n-h1-846466-12 Aug 04 16:36:40.419264 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-88ef1fd7-f9c6-4060-8a18-6a2a5d43897d req-5ed0690f-8ba7-4852-b40d-91a0d685e79e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043615 Aug 04 16:36:40.420736 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 483/1008] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:36:40.426717 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a6dcb0a7-ccbc-4990-bff1-9f02d802eec1 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:40.427425 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a6dcb0a7-ccbc-4990-bff1-9f02d802eec1 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:40.468444 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6dcb0a7-ccbc-4990-bff1-9f02d802eec1 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:40.471379 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6dcb0a7-ccbc-4990-bff1-9f02d802eec1 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:40.482732 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6dcb0a7-ccbc-4990-bff1-9f02d802eec1 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:40.483825 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6dcb0a7-ccbc-4990-bff1-9f02d802eec1 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:40.964195 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a6dcb0a7-ccbc-4990-bff1-9f02d802eec1 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159" status: 200 len: 1814 microversion: 2.1 time: 0.541536 Aug 04 16:36:40.975519 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 484/1009] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:40 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159 => generated 1814 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:40.975519 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-85c170db-c3bc-4454-9a3d-04d55e0e4658 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:40.975519 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-85c170db-c3bc-4454-9a3d-04d55e0e4658 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:40.978595 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-85c170db-c3bc-4454-9a3d-04d55e0e4658 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:40.979320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-85c170db-c3bc-4454-9a3d-04d55e0e4658 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:40.980333 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-85c170db-c3bc-4454-9a3d-04d55e0e4658 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:40.981197 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-85c170db-c3bc-4454-9a3d-04d55e0e4658 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:41.560397 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-85c170db-c3bc-4454-9a3d-04d55e0e4658 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:41.580911 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-85c170db-c3bc-4454-9a3d-04d55e0e4658 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1476 microversion: 2.1 time: 0.607252 Aug 04 16:36:41.582425 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 485/1010] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:40 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1476 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:41.597273 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-61c11bcd-4352-4979-907d-c5c8b2ce770c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:41.598411 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-61c11bcd-4352-4979-907d-c5c8b2ce770c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:41.607167 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-61c11bcd-4352-4979-907d-c5c8b2ce770c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:41.608478 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-61c11bcd-4352-4979-907d-c5c8b2ce770c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:41.609726 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-61c11bcd-4352-4979-907d-c5c8b2ce770c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:41.610467 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-61c11bcd-4352-4979-907d-c5c8b2ce770c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:41.833466 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-53052ec9-d603-4671-8578-35421a78af7f tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:36:41.834613 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-53052ec9-d603-4671-8578-35421a78af7f tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:36:41.835434 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-53052ec9-d603-4671-8578-35421a78af7f tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:36:41.836370 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-53052ec9-d603-4671-8578-35421a78af7f tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:36:41.836998 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-53052ec9-d603-4671-8578-35421a78af7f tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:36:41.861022 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-53052ec9-d603-4671-8578-35421a78af7f tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:41.861934 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-53052ec9-d603-4671-8578-35421a78af7f tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:41.865240 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-53052ec9-d603-4671-8578-35421a78af7f tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:41.866207 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-53052ec9-d603-4671-8578-35421a78af7f tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:41.929988 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-53052ec9-d603-4671-8578-35421a78af7f tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Getting quotas for project a64446d297d1407d888376ebd3642216. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:36:41.938507 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-53052ec9-d603-4671-8578-35421a78af7f tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Getting quotas for user a2b193211a2243bc90299e112dd3cc26 and project a64446d297d1407d888376ebd3642216. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:36:41.956376 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-53052ec9-d603-4671-8578-35421a78af7f tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:36:41.958670 n-d-846466-12 devstack@n-api.service[126125]: WARNING nova.utils [None req-53052ec9-d603-4671-8578-35421a78af7f tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1948174636 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-194817463 Aug 04 16:36:41.959480 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-53052ec9-d603-4671-8578-35421a78af7f tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] [instance: 4057c3fd-7edb-499b-8623-012b46ebd651] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:36:42.070133 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-53052ec9-d603-4671-8578-35421a78af7f tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.043115 Aug 04 16:36:42.071609 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 526/1011] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:36:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 16:36:42.079634 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9bae292c-0872-43b0-8fe9-e4ac20427f53 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:42.083896 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:36:42.083896 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:36:42.086429 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9bae292c-0872-43b0-8fe9-e4ac20427f53 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:42.087311 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9bae292c-0872-43b0-8fe9-e4ac20427f53 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:42.088596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9bae292c-0872-43b0-8fe9-e4ac20427f53 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:42.089255 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9bae292c-0872-43b0-8fe9-e4ac20427f53 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:42.129546 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9bae292c-0872-43b0-8fe9-e4ac20427f53 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.056372 Aug 04 16:36:42.130371 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 527/1012] 10.222.0.23 () {58 vars in 1176 bytes} [Thu Aug 4 16:36:42 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:36:42.135736 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ddcc7edf-d73e-4af8-b70d-800500df4321 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:42.136721 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ddcc7edf-d73e-4af8-b70d-800500df4321 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: d238b9f3-e25b-4864-8b27-d53054d76082] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:42.147739 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ddcc7edf-d73e-4af8-b70d-800500df4321 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:42.148568 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ddcc7edf-d73e-4af8-b70d-800500df4321 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:42.149636 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ddcc7edf-d73e-4af8-b70d-800500df4321 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:42.150368 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ddcc7edf-d73e-4af8-b70d-800500df4321 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:42.221791 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-61c11bcd-4352-4979-907d-c5c8b2ce770c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:42.242084 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-61c11bcd-4352-4979-907d-c5c8b2ce770c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:42.243789 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-61c11bcd-4352-4979-907d-c5c8b2ce770c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:42.244942 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-61c11bcd-4352-4979-907d-c5c8b2ce770c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 1411 microversion: 2.25 time: 0.658885 Aug 04 16:36:42.271093 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 486/1013] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:36:41 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 1411 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:36:42.289182 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-80bd76b5-2f16-431e-ad01-1c79bf355d58 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:42.290313 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-80bd76b5-2f16-431e-ad01-1c79bf355d58 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] [instance: e80e720e-cc06-40d9-b65e-02eca0e4f7d8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:42.297187 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-80bd76b5-2f16-431e-ad01-1c79bf355d58 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:42.297917 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-80bd76b5-2f16-431e-ad01-1c79bf355d58 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:42.298940 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-80bd76b5-2f16-431e-ad01-1c79bf355d58 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:42.299593 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-80bd76b5-2f16-431e-ad01-1c79bf355d58 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:43.610255 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ddcc7edf-d73e-4af8-b70d-800500df4321 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:43.618574 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ddcc7edf-d73e-4af8-b70d-800500df4321 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082" status: 200 len: 1322 microversion: 2.1 time: 1.487044 Aug 04 16:36:43.629312 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 528/1014] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:42 2022] GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082 => generated 1322 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:43.629312 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-40b24ae8-c462-434f-84ca-84245ec5c42d tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-446708282", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "77d41bd0-6fdd-4627-91d6-916527e4ba1a"}], "security_groups": [{"name": "tempest-securitygroup--1958677761"}], "key_name": "tempest-keypair-640652626", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:43.642861 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-80bd76b5-2f16-431e-ad01-1c79bf355d58 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4590a95e924aa3a08e823ef1d6d18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30203a3cbb44c4ab36bcfa28662444d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:43.656768 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-80bd76b5-2f16-431e-ad01-1c79bf355d58 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] 10.222.0.23 "GET /compute/v2.1/servers/e80e720e-cc06-40d9-b65e-02eca0e4f7d8" status: 200 len: 1463 microversion: 2.1 time: 1.383586 Aug 04 16:36:43.657396 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 487/1015] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:42 2022] GET /compute/v2.1/servers/e80e720e-cc06-40d9-b65e-02eca0e4f7d8 => generated 1463 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:43.663151 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3ab4d0af-7de0-4175-9e87-5c253906bd41 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:43.664011 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3ab4d0af-7de0-4175-9e87-5c253906bd41 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] [instance: 4057c3fd-7edb-499b-8623-012b46ebd651] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:43.725054 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ab4d0af-7de0-4175-9e87-5c253906bd41 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:43.727409 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ab4d0af-7de0-4175-9e87-5c253906bd41 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:43.736189 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ab4d0af-7de0-4175-9e87-5c253906bd41 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:43.741960 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ab4d0af-7de0-4175-9e87-5c253906bd41 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:44.230607 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3ab4d0af-7de0-4175-9e87-5c253906bd41 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b193211a2243bc90299e112dd3cc26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64446d297d1407d888376ebd3642216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:44.240474 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-40b24ae8-c462-434f-84ca-84245ec5c42d tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] validate_networks() for [('77d41bd0-6fdd-4627-91d6-916527e4ba1a', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:36:44.265033 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3ab4d0af-7de0-4175-9e87-5c253906bd41 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] 10.222.0.23 "GET /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651" status: 200 len: 1284 microversion: 2.1 time: 0.604671 Aug 04 16:36:44.267161 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 488/1016] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:43 2022] GET /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651 => generated 1284 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:44.303519 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cf4d7b5f-0b6b-4f24-b712-5fab2ba6577f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:44.304221 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cf4d7b5f-0b6b-4f24-b712-5fab2ba6577f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:44.319774 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf4d7b5f-0b6b-4f24-b712-5fab2ba6577f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:44.320632 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf4d7b5f-0b6b-4f24-b712-5fab2ba6577f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:44.322090 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf4d7b5f-0b6b-4f24-b712-5fab2ba6577f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:44.324854 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf4d7b5f-0b6b-4f24-b712-5fab2ba6577f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:44.893046 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cf4d7b5f-0b6b-4f24-b712-5fab2ba6577f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:44.917733 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cf4d7b5f-0b6b-4f24-b712-5fab2ba6577f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1476 microversion: 2.1 time: 0.629158 Aug 04 16:36:44.919490 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 489/1017] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:44 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1476 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:44.927972 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-55ed3498-6f33-49d2-8543-ac8970d8068b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:44.928810 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-55ed3498-6f33-49d2-8543-ac8970d8068b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:44.939207 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-55ed3498-6f33-49d2-8543-ac8970d8068b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:44.939954 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-55ed3498-6f33-49d2-8543-ac8970d8068b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:44.942161 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-55ed3498-6f33-49d2-8543-ac8970d8068b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:44.943219 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-55ed3498-6f33-49d2-8543-ac8970d8068b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:45.475684 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-55ed3498-6f33-49d2-8543-ac8970d8068b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:45.490936 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-55ed3498-6f33-49d2-8543-ac8970d8068b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:45.493053 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-55ed3498-6f33-49d2-8543-ac8970d8068b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:45.494582 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-55ed3498-6f33-49d2-8543-ac8970d8068b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 1411 microversion: 2.25 time: 0.573356 Aug 04 16:36:45.495081 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 490/1018] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:36:44 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 1411 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:36:45.598746 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=4 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:36:45.651434 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=16 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:36:45.745374 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5d2114bf-2dd7-4b6a-9631-ee8a25b25fd6 tempest-TenantUsagesTestJSON-27584092 tempest-TenantUsagesTestJSON-27584092-project-admin] Calling method '.version_select at 0x7f7e84c8d700>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:45.761804 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5d2114bf-2dd7-4b6a-9631-ee8a25b25fd6 tempest-TenantUsagesTestJSON-27584092 tempest-TenantUsagesTestJSON-27584092-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:45.763369 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5d2114bf-2dd7-4b6a-9631-ee8a25b25fd6 tempest-TenantUsagesTestJSON-27584092 tempest-TenantUsagesTestJSON-27584092-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:45.825027 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5d2114bf-2dd7-4b6a-9631-ee8a25b25fd6 tempest-TenantUsagesTestJSON-27584092 tempest-TenantUsagesTestJSON-27584092-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:45.826167 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5d2114bf-2dd7-4b6a-9631-ee8a25b25fd6 tempest-TenantUsagesTestJSON-27584092 tempest-TenantUsagesTestJSON-27584092-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:45.850869 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5d2114bf-2dd7-4b6a-9631-ee8a25b25fd6 tempest-TenantUsagesTestJSON-27584092 tempest-TenantUsagesTestJSON-27584092-project-admin] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage/e30203a3cbb44c4ab36bcfa28662444d?start=2022-08-03T16%3A36%3A43.673916&end=2022-08-05T16%3A36%3A43.673916" status: 200 len: 643 microversion: 2.1 time: 0.354128 Aug 04 16:36:45.851859 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 491/1019] 10.222.0.23 () {58 vars in 1412 bytes} [Thu Aug 4 16:36:45 2022] GET /compute/v2.1/os-simple-tenant-usage/e30203a3cbb44c4ab36bcfa28662444d?start=2022-08-03T16%3A36%3A43.673916&end=2022-08-05T16%3A36%3A43.673916 => generated 643 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:36:45.857752 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-60d650b7-17e6-4d55-90fa-0506a6e6da98 req-b356d293-fce6-4fe9-903b-004aa671937d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "532ec916-2768-43e0-a912-791fb4b5d9ea", "tag": "f3a840a0-b3e2-44fd-a731-6cfafffd7f6e"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:45.870453 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-60d650b7-17e6-4d55-90fa-0506a6e6da98 req-b356d293-fce6-4fe9-903b-004aa671937d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:45.871170 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-60d650b7-17e6-4d55-90fa-0506a6e6da98 req-b356d293-fce6-4fe9-903b-004aa671937d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:45.885363 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=31 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:36:45.890724 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-60d650b7-17e6-4d55-90fa-0506a6e6da98 req-b356d293-fce6-4fe9-903b-004aa671937d service nova] Creating event network-changed:f3a840a0-b3e2-44fd-a731-6cfafffd7f6e for instance 532ec916-2768-43e0-a912-791fb4b5d9ea on n-h2-846466-12 Aug 04 16:36:45.893361 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-40b24ae8-c462-434f-84ca-84245ec5c42d tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Getting quotas for project 4b5527cc7c4944c7898b64308f13b850. Resources: dict_keys(['metadata_items']) {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:36:45.898024 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-60d650b7-17e6-4d55-90fa-0506a6e6da98 req-b356d293-fce6-4fe9-903b-004aa671937d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044282 Aug 04 16:36:45.899628 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 492/1020] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:36:45.911468 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-8eda4322-f655-40fe-a5d4-f4ddd5e5342e req-dc0b29de-83e5-4990-9073-549eb20cb591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5021f3f8-aa8b-4c94-8846-fdd1081135f5", "name": "network-vif-plugged", "status": "completed", "tag": "0ac743e2-4fd8-459b-98e6-2cd3c20f4ed6"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:45.924356 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-8eda4322-f655-40fe-a5d4-f4ddd5e5342e req-dc0b29de-83e5-4990-9073-549eb20cb591 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:45.924785 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-8eda4322-f655-40fe-a5d4-f4ddd5e5342e req-dc0b29de-83e5-4990-9073-549eb20cb591 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:45.930375 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-40b24ae8-c462-434f-84ca-84245ec5c42d tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Getting quotas for user 23645970a9a24e94b10b8578bb30b37e and project 4b5527cc7c4944c7898b64308f13b850. Resources: dict_keys(['metadata_items']) {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:36:45.942428 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-8eda4322-f655-40fe-a5d4-f4ddd5e5342e req-dc0b29de-83e5-4990-9073-549eb20cb591 service nova] Creating event network-vif-plugged:0ac743e2-4fd8-459b-98e6-2cd3c20f4ed6 for instance 5021f3f8-aa8b-4c94-8846-fdd1081135f5 on n-h1-846466-12 Aug 04 16:36:45.950457 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-8eda4322-f655-40fe-a5d4-f4ddd5e5342e req-dc0b29de-83e5-4990-9073-549eb20cb591 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048845 Aug 04 16:36:45.952849 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 493/1021] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:36:45.963691 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-11c883e4-e309-45cb-8f7b-9f388c208cae tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:45.964281 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-11c883e4-e309-45cb-8f7b-9f388c208cae tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: d238b9f3-e25b-4864-8b27-d53054d76082] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:45.974562 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-11c883e4-e309-45cb-8f7b-9f388c208cae tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:45.975404 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-11c883e4-e309-45cb-8f7b-9f388c208cae tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:45.976738 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-11c883e4-e309-45cb-8f7b-9f388c208cae tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:45.977400 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-11c883e4-e309-45cb-8f7b-9f388c208cae tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:46.005790 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-40b24ae8-c462-434f-84ca-84245ec5c42d tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:36:46.007283 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-40b24ae8-c462-434f-84ca-84245ec5c42d tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:36:46.008235 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-40b24ae8-c462-434f-84ca-84245ec5c42d tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:36:46.008663 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-40b24ae8-c462-434f-84ca-84245ec5c42d tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:36:46.010311 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-40b24ae8-c462-434f-84ca-84245ec5c42d tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:36:46.027104 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-40b24ae8-c462-434f-84ca-84245ec5c42d tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:46.027850 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-40b24ae8-c462-434f-84ca-84245ec5c42d tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:46.028919 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-40b24ae8-c462-434f-84ca-84245ec5c42d tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:46.029743 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-40b24ae8-c462-434f-84ca-84245ec5c42d tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:46.084047 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-40b24ae8-c462-434f-84ca-84245ec5c42d tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Getting quotas for project 4b5527cc7c4944c7898b64308f13b850. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:36:46.096041 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-40b24ae8-c462-434f-84ca-84245ec5c42d tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Getting quotas for user 23645970a9a24e94b10b8578bb30b37e and project 4b5527cc7c4944c7898b64308f13b850. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:36:46.136129 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-40b24ae8-c462-434f-84ca-84245ec5c42d tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:36:46.153596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-40b24ae8-c462-434f-84ca-84245ec5c42d tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] [instance: 2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:36:46.233590 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-40b24ae8-c462-434f-84ca-84245ec5c42d tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.612882 Aug 04 16:36:46.234526 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 529/1022] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:36:43 2022] POST /compute/v2.1/servers => generated 409 bytes in 2614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:36:46.239799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dc15ff4d-7086-4f02-a066-b54ccbf71576 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:46.240644 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dc15ff4d-7086-4f02-a066-b54ccbf71576 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] [instance: 4057c3fd-7edb-499b-8623-012b46ebd651] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:46.256324 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dc15ff4d-7086-4f02-a066-b54ccbf71576 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:46.257040 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dc15ff4d-7086-4f02-a066-b54ccbf71576 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:46.257947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dc15ff4d-7086-4f02-a066-b54ccbf71576 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:46.259549 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dc15ff4d-7086-4f02-a066-b54ccbf71576 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:46.488518 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dc15ff4d-7086-4f02-a066-b54ccbf71576 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b193211a2243bc90299e112dd3cc26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64446d297d1407d888376ebd3642216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:46.514797 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dc15ff4d-7086-4f02-a066-b54ccbf71576 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] 10.222.0.23 "GET /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651" status: 200 len: 1290 microversion: 2.1 time: 0.278123 Aug 04 16:36:46.519877 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 530/1023] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:46 2022] GET /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651 => generated 1290 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:46.528635 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b1d880bc-15a8-436b-820b-db1feb56748e tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Calling method '.version_select at 0x7f7e848d1ee0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:46.554967 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b1d880bc-15a8-436b-820b-db1feb56748e tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:46.555864 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b1d880bc-15a8-436b-820b-db1feb56748e tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:46.585783 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b1d880bc-15a8-436b-820b-db1feb56748e tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:46.598001 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b1d880bc-15a8-436b-820b-db1feb56748e tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:46.624430 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b1d880bc-15a8-436b-820b-db1feb56748e tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage/e30203a3cbb44c4ab36bcfa28662444d?start=2022-08-03T16%3A36%3A43.673916&end=2022-08-05T16%3A36%3A43.673916" status: 200 len: 695 microversion: 2.1 time: 0.102775 Aug 04 16:36:46.625104 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 531/1024] 10.222.0.23 () {58 vars in 1412 bytes} [Thu Aug 4 16:36:46 2022] GET /compute/v2.1/os-simple-tenant-usage/e30203a3cbb44c4ab36bcfa28662444d?start=2022-08-03T16%3A36%3A43.673916&end=2022-08-05T16%3A36%3A43.673916 => generated 695 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:36:46.641591 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ce674a1e-31c8-47e1-a349-ed75d96fc0b0 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:46.641591 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ce674a1e-31c8-47e1-a349-ed75d96fc0b0 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:46.641591 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ce674a1e-31c8-47e1-a349-ed75d96fc0b0 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:46.641591 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ce674a1e-31c8-47e1-a349-ed75d96fc0b0 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:46.642392 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ce674a1e-31c8-47e1-a349-ed75d96fc0b0 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:46.642554 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ce674a1e-31c8-47e1-a349-ed75d96fc0b0 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:46.916311 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-11c883e4-e309-45cb-8f7b-9f388c208cae tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:46.941992 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-11c883e4-e309-45cb-8f7b-9f388c208cae tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082" status: 200 len: 1322 microversion: 2.1 time: 0.987256 Aug 04 16:36:46.945780 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 494/1025] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:45 2022] GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082 => generated 1322 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:46.961730 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-89fad345-54f2-4ae6-bfc4-8a0dd50ba562 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:46.979158 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-89fad345-54f2-4ae6-bfc4-8a0dd50ba562 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] [instance: 2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:46.998168 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:36:47.229250 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-89fad345-54f2-4ae6-bfc4-8a0dd50ba562 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23645970a9a24e94b10b8578bb30b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5527cc7c4944c7898b64308f13b850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:47.237509 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-89fad345-54f2-4ae6-bfc4-8a0dd50ba562 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] 10.222.0.23 "GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88" status: 200 len: 1276 microversion: 2.1 time: 0.289690 Aug 04 16:36:47.238754 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 495/1026] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:46 2022] GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88 => generated 1276 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:47.244449 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dc1b92eb-b259-4273-b5d6-d727cacc36ee tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:47.245559 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-dc1b92eb-b259-4273-b5d6-d727cacc36ee tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:47.253990 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dc1b92eb-b259-4273-b5d6-d727cacc36ee tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:47.254717 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dc1b92eb-b259-4273-b5d6-d727cacc36ee tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:47.255896 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dc1b92eb-b259-4273-b5d6-d727cacc36ee tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:47.256585 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dc1b92eb-b259-4273-b5d6-d727cacc36ee tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:47.936975 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ce674a1e-31c8-47e1-a349-ed75d96fc0b0 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:47.953209 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ce674a1e-31c8-47e1-a349-ed75d96fc0b0 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1476 microversion: 2.1 time: 1.326684 Aug 04 16:36:47.954652 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 532/1027] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:46 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1476 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:47.961980 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a5ec6cba-806a-453e-adfe-838215aaeec6 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1735b12c-ddc8-46cf-8e16-8f9a5abedb28"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:47.965322 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a5ec6cba-806a-453e-adfe-838215aaeec6 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] [instance: 2503f8ac-e7f9-432d-8b3b-271d1a179572] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:47.976580 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a5ec6cba-806a-453e-adfe-838215aaeec6 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:47.977331 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a5ec6cba-806a-453e-adfe-838215aaeec6 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:47.978386 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a5ec6cba-806a-453e-adfe-838215aaeec6 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:47.979177 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a5ec6cba-806a-453e-adfe-838215aaeec6 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:48.179232 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-dc1b92eb-b259-4273-b5d6-d727cacc36ee tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:48.195551 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-dc1b92eb-b259-4273-b5d6-d727cacc36ee tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:48.201139 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-dc1b92eb-b259-4273-b5d6-d727cacc36ee tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:48.204888 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dc1b92eb-b259-4273-b5d6-d727cacc36ee tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 1411 microversion: 2.25 time: 0.963506 Aug 04 16:36:48.218004 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 496/1028] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:36:47 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 1411 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:36:48.225327 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7e209b1b-0f14-4aae-a608-c025e18238de tempest-TenantUsagesTestJSON-27584092 tempest-TenantUsagesTestJSON-27584092-project-admin] Calling method '.version_select at 0x7f7e84e33ee0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:48.238370 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7e209b1b-0f14-4aae-a608-c025e18238de tempest-TenantUsagesTestJSON-27584092 tempest-TenantUsagesTestJSON-27584092-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:48.238834 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7e209b1b-0f14-4aae-a608-c025e18238de tempest-TenantUsagesTestJSON-27584092 tempest-TenantUsagesTestJSON-27584092-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:48.265858 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7e209b1b-0f14-4aae-a608-c025e18238de tempest-TenantUsagesTestJSON-27584092 tempest-TenantUsagesTestJSON-27584092-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:48.266304 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7e209b1b-0f14-4aae-a608-c025e18238de tempest-TenantUsagesTestJSON-27584092 tempest-TenantUsagesTestJSON-27584092-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:48.357237 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7e209b1b-0f14-4aae-a608-c025e18238de tempest-TenantUsagesTestJSON-27584092 tempest-TenantUsagesTestJSON-27584092-project-admin] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-03T16%3A36%3A43.673916&end=2022-08-05T16%3A36%3A43.673916&detailed=1" status: 200 len: 12474 microversion: 2.1 time: 0.144822 Aug 04 16:36:48.358620 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 497/1029] 10.222.0.23 () {58 vars in 1335 bytes} [Thu Aug 4 16:36:48 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-03T16%3A36%3A43.673916&end=2022-08-05T16%3A36%3A43.673916&detailed=1 => generated 12474 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:36:48.364020 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7c804c42-2535-400f-a01e-d87fbb274526 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b0418ca-d403-44e8-bc86-ba50f88fd65a", "device": "/dev/xvdb"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:48.367534 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7c804c42-2535-400f-a01e-d87fbb274526 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:48.375502 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7c804c42-2535-400f-a01e-d87fbb274526 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:48.376251 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7c804c42-2535-400f-a01e-d87fbb274526 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:48.377242 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7c804c42-2535-400f-a01e-d87fbb274526 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:48.378122 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7c804c42-2535-400f-a01e-d87fbb274526 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:48.850993 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:36:49.054049 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a5ec6cba-806a-453e-adfe-838215aaeec6 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] 10.222.0.23 "POST /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.097099 Aug 04 16:36:49.056487 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 533/1030] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Aug 4 16:36:47 2022] POST /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572/os-volume_attachments => generated 194 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:36:49.072744 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a079ead7-aab2-4c8a-be72-ffda59e4b72b tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:49.074096 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a079ead7-aab2-4c8a-be72-ffda59e4b72b tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] [instance: 4057c3fd-7edb-499b-8623-012b46ebd651] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:49.096312 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a079ead7-aab2-4c8a-be72-ffda59e4b72b tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:49.097414 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a079ead7-aab2-4c8a-be72-ffda59e4b72b tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:49.099033 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a079ead7-aab2-4c8a-be72-ffda59e4b72b tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:49.100212 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a079ead7-aab2-4c8a-be72-ffda59e4b72b tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:49.273184 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7c804c42-2535-400f-a01e-d87fbb274526 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "POST /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.911773 Aug 04 16:36:49.280187 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 498/1031] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Aug 4 16:36:48 2022] POST /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159/os-volume_attachments => generated 194 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:36:49.287107 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fa28907d-4393-473d-9bca-8b4206e5b472 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:49.288484 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fa28907d-4393-473d-9bca-8b4206e5b472 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: d238b9f3-e25b-4864-8b27-d53054d76082] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:49.305392 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fa28907d-4393-473d-9bca-8b4206e5b472 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:49.306182 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fa28907d-4393-473d-9bca-8b4206e5b472 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:49.307685 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fa28907d-4393-473d-9bca-8b4206e5b472 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:49.308584 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fa28907d-4393-473d-9bca-8b4206e5b472 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:49.363888 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a079ead7-aab2-4c8a-be72-ffda59e4b72b tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b193211a2243bc90299e112dd3cc26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64446d297d1407d888376ebd3642216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:49.384128 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a079ead7-aab2-4c8a-be72-ffda59e4b72b tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] 10.222.0.23 "GET /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651" status: 200 len: 1332 microversion: 2.1 time: 0.325002 Aug 04 16:36:49.386293 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 534/1032] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:49 2022] GET /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651 => generated 1332 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:49.394934 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-0464723c-9b2f-45ae-a54f-a320ffc38855 req-db9be77c-d5ce-4efc-9f18-052099ca5e56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d238b9f3-e25b-4864-8b27-d53054d76082", "tag": "b5861496-5180-45d9-b61a-84944c746263"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:49.412951 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-0464723c-9b2f-45ae-a54f-a320ffc38855 req-db9be77c-d5ce-4efc-9f18-052099ca5e56 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:49.413626 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-0464723c-9b2f-45ae-a54f-a320ffc38855 req-db9be77c-d5ce-4efc-9f18-052099ca5e56 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:49.429212 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-0464723c-9b2f-45ae-a54f-a320ffc38855 req-db9be77c-d5ce-4efc-9f18-052099ca5e56 service nova] Creating event network-changed:b5861496-5180-45d9-b61a-84944c746263 for instance d238b9f3-e25b-4864-8b27-d53054d76082 on n-h1-846466-12 Aug 04 16:36:49.436332 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-0464723c-9b2f-45ae-a54f-a320ffc38855 req-db9be77c-d5ce-4efc-9f18-052099ca5e56 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048292 Aug 04 16:36:49.437125 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 535/1033] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:36:49.443138 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0cdb5d10-815e-4b7c-86c9-ae48d7a2a26c tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:49.443868 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0cdb5d10-815e-4b7c-86c9-ae48d7a2a26c tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] [instance: 2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:49.451702 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0cdb5d10-815e-4b7c-86c9-ae48d7a2a26c tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:49.452282 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0cdb5d10-815e-4b7c-86c9-ae48d7a2a26c tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:49.452941 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0cdb5d10-815e-4b7c-86c9-ae48d7a2a26c tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:49.453400 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0cdb5d10-815e-4b7c-86c9-ae48d7a2a26c tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:49.551826 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0cdb5d10-815e-4b7c-86c9-ae48d7a2a26c tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23645970a9a24e94b10b8578bb30b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5527cc7c4944c7898b64308f13b850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:49.555237 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:36:49.559387 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fa28907d-4393-473d-9bca-8b4206e5b472 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:49.567022 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0cdb5d10-815e-4b7c-86c9-ae48d7a2a26c tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] 10.222.0.23 "GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88" status: 200 len: 1334 microversion: 2.1 time: 0.128004 Aug 04 16:36:49.567709 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fa28907d-4393-473d-9bca-8b4206e5b472 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082" status: 200 len: 1322 microversion: 2.1 time: 0.291053 Aug 04 16:36:49.568477 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 536/1034] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:49 2022] GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88 => generated 1334 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:49.577804 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 499/1035] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:49 2022] GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082 => generated 1322 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:49.578289 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4370f9f1-acc6-4d24-8699-8cce6db4f952 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:49.589314 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4370f9f1-acc6-4d24-8699-8cce6db4f952 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] [instance: e80e720e-cc06-40d9-b65e-02eca0e4f7d8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:49.594394 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4370f9f1-acc6-4d24-8699-8cce6db4f952 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:49.595186 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4370f9f1-acc6-4d24-8699-8cce6db4f952 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:49.596900 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4370f9f1-acc6-4d24-8699-8cce6db4f952 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:49.597721 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4370f9f1-acc6-4d24-8699-8cce6db4f952 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:49.599362 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9a76f51a-6ad1-4590-b366-fa1f3a25dd15 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:49.600017 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9a76f51a-6ad1-4590-b366-fa1f3a25dd15 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:49.607393 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9a76f51a-6ad1-4590-b366-fa1f3a25dd15 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:49.607849 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9a76f51a-6ad1-4590-b366-fa1f3a25dd15 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:49.609024 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9a76f51a-6ad1-4590-b366-fa1f3a25dd15 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:49.609689 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9a76f51a-6ad1-4590-b366-fa1f3a25dd15 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:49.656524 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4370f9f1-acc6-4d24-8699-8cce6db4f952 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] [instance: e80e720e-cc06-40d9-b65e-02eca0e4f7d8] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:36:49.748044 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4370f9f1-acc6-4d24-8699-8cce6db4f952 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e80e720e-cc06-40d9-b65e-02eca0e4f7d8" status: 204 len: 0 microversion: 2.1 time: 0.178086 Aug 04 16:36:49.748757 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 537/1036] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:36:49 2022] DELETE /compute/v2.1/servers/e80e720e-cc06-40d9-b65e-02eca0e4f7d8 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:36:49.755026 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6f13f0d3-42e9-41f1-a8a0-046d4db088f5 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:49.755719 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6f13f0d3-42e9-41f1-a8a0-046d4db088f5 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:49.762414 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6f13f0d3-42e9-41f1-a8a0-046d4db088f5 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:49.762853 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6f13f0d3-42e9-41f1-a8a0-046d4db088f5 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:49.764093 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6f13f0d3-42e9-41f1-a8a0-046d4db088f5 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:49.764542 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6f13f0d3-42e9-41f1-a8a0-046d4db088f5 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:49.796609 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9a76f51a-6ad1-4590-b366-fa1f3a25dd15 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:49.806114 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9a76f51a-6ad1-4590-b366-fa1f3a25dd15 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1476 microversion: 2.1 time: 0.214312 Aug 04 16:36:49.806782 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 500/1037] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:49 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1476 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:49.813085 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dc14c8c5-e23a-447c-9798-0282473c5e74 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:49.816953 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-dc14c8c5-e23a-447c-9798-0282473c5e74 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] [instance: e80e720e-cc06-40d9-b65e-02eca0e4f7d8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:49.825719 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dc14c8c5-e23a-447c-9798-0282473c5e74 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:49.826288 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dc14c8c5-e23a-447c-9798-0282473c5e74 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:49.828086 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dc14c8c5-e23a-447c-9798-0282473c5e74 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:49.828545 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dc14c8c5-e23a-447c-9798-0282473c5e74 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:49.983334 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6f13f0d3-42e9-41f1-a8a0-046d4db088f5 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:49.993440 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6f13f0d3-42e9-41f1-a8a0-046d4db088f5 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:49.995287 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6f13f0d3-42e9-41f1-a8a0-046d4db088f5 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:49.996775 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6f13f0d3-42e9-41f1-a8a0-046d4db088f5 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 1607 microversion: 2.25 time: 0.246719 Aug 04 16:36:49.997544 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 538/1038] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:36:49 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 1607 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:36:50.021657 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8b3d29eb-f051-407f-9e1c-8d5594fe62ef tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:50.022406 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8b3d29eb-f051-407f-9e1c-8d5594fe62ef tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:50.031463 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8b3d29eb-f051-407f-9e1c-8d5594fe62ef tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:50.031962 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8b3d29eb-f051-407f-9e1c-8d5594fe62ef tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:50.032792 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8b3d29eb-f051-407f-9e1c-8d5594fe62ef tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:50.033231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8b3d29eb-f051-407f-9e1c-8d5594fe62ef tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:50.166164 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8b3d29eb-f051-407f-9e1c-8d5594fe62ef tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.149410 Aug 04 16:36:50.168030 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 539/1039] 10.222.0.23 () {60 vars in 1316 bytes} [Thu Aug 4 16:36:50 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5/os-interface => generated 285 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 16:36:50.169783 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-dc14c8c5-e23a-447c-9798-0282473c5e74 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4590a95e924aa3a08e823ef1d6d18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30203a3cbb44c4ab36bcfa28662444d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:50.178639 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dc14c8c5-e23a-447c-9798-0282473c5e74 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] 10.222.0.23 "GET /compute/v2.1/servers/e80e720e-cc06-40d9-b65e-02eca0e4f7d8" status: 200 len: 1469 microversion: 2.1 time: 0.370512 Aug 04 16:36:50.179461 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 501/1040] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:49 2022] GET /compute/v2.1/servers/e80e720e-cc06-40d9-b65e-02eca0e4f7d8 => generated 1469 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:50.413136 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-96456739-ce97-4244-8f07-d53da1862a6d tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:50.416150 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-96456739-ce97-4244-8f07-d53da1862a6d tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] [instance: 4057c3fd-7edb-499b-8623-012b46ebd651] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:50.430887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-96456739-ce97-4244-8f07-d53da1862a6d tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:50.432462 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-96456739-ce97-4244-8f07-d53da1862a6d tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:50.434253 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-96456739-ce97-4244-8f07-d53da1862a6d tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:50.435532 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-96456739-ce97-4244-8f07-d53da1862a6d tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:50.591178 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-99dda586-3dd6-40a7-b92c-d5ee55484f40 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:50.592578 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-99dda586-3dd6-40a7-b92c-d5ee55484f40 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] [instance: 2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:50.601930 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-99dda586-3dd6-40a7-b92c-d5ee55484f40 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:50.602660 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-99dda586-3dd6-40a7-b92c-d5ee55484f40 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:50.603725 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-99dda586-3dd6-40a7-b92c-d5ee55484f40 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:50.604366 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-99dda586-3dd6-40a7-b92c-d5ee55484f40 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:50.777355 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-99dda586-3dd6-40a7-b92c-d5ee55484f40 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23645970a9a24e94b10b8578bb30b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5527cc7c4944c7898b64308f13b850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:50.785500 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-99dda586-3dd6-40a7-b92c-d5ee55484f40 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] 10.222.0.23 "GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88" status: 200 len: 1334 microversion: 2.1 time: 0.199411 Aug 04 16:36:50.786080 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 502/1041] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:50 2022] GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88 => generated 1334 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:50.791087 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7315903b-ea84-45e4-bf7e-a795f2d3627f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:50.791856 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7315903b-ea84-45e4-bf7e-a795f2d3627f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: d238b9f3-e25b-4864-8b27-d53054d76082] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:50.807014 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7315903b-ea84-45e4-bf7e-a795f2d3627f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:50.807506 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7315903b-ea84-45e4-bf7e-a795f2d3627f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:50.808422 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7315903b-ea84-45e4-bf7e-a795f2d3627f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:50.809170 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7315903b-ea84-45e4-bf7e-a795f2d3627f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:50.940738 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-96456739-ce97-4244-8f07-d53da1862a6d tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b193211a2243bc90299e112dd3cc26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64446d297d1407d888376ebd3642216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:50.954345 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-96456739-ce97-4244-8f07-d53da1862a6d tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] 10.222.0.23 "GET /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651" status: 200 len: 1332 microversion: 2.1 time: 0.550491 Aug 04 16:36:50.955757 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 540/1042] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:50 2022] GET /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651 => generated 1332 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:50.963862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e71164d6-a2a7-4e42-8e0b-97832bc2f3d7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:50.964984 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e71164d6-a2a7-4e42-8e0b-97832bc2f3d7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:50.975398 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e71164d6-a2a7-4e42-8e0b-97832bc2f3d7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:50.976034 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e71164d6-a2a7-4e42-8e0b-97832bc2f3d7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:50.977401 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e71164d6-a2a7-4e42-8e0b-97832bc2f3d7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:50.978155 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e71164d6-a2a7-4e42-8e0b-97832bc2f3d7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:51.350545 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7315903b-ea84-45e4-bf7e-a795f2d3627f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:51.359628 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7315903b-ea84-45e4-bf7e-a795f2d3627f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082" status: 200 len: 1322 microversion: 2.1 time: 0.572449 Aug 04 16:36:51.360261 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 503/1043] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:50 2022] GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082 => generated 1322 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:51.364876 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-393ad2c1-9459-4bf7-9e02-8116b2423573 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:51.366175 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-393ad2c1-9459-4bf7-9e02-8116b2423573 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] [instance: e80e720e-cc06-40d9-b65e-02eca0e4f7d8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:51.372689 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-393ad2c1-9459-4bf7-9e02-8116b2423573 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:51.373670 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-393ad2c1-9459-4bf7-9e02-8116b2423573 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:51.374840 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-393ad2c1-9459-4bf7-9e02-8116b2423573 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:51.374840 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-393ad2c1-9459-4bf7-9e02-8116b2423573 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:52.150449 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e71164d6-a2a7-4e42-8e0b-97832bc2f3d7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:52.168655 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e71164d6-a2a7-4e42-8e0b-97832bc2f3d7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1475 microversion: 2.1 time: 1.211410 Aug 04 16:36:52.169481 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 541/1044] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:50 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1475 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:52.174531 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-b45386db-b320-4bf7-a049-f9bb51e06f82 req-a9dc6e93-5cf1-400f-82dd-96f45c06b7c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "532ec916-2768-43e0-a912-791fb4b5d9ea", "name": "network-vif-plugged", "status": "completed", "tag": "f3a840a0-b3e2-44fd-a731-6cfafffd7f6e"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:52.208070 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-b45386db-b320-4bf7-a049-f9bb51e06f82 req-a9dc6e93-5cf1-400f-82dd-96f45c06b7c2 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:52.208514 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-b45386db-b320-4bf7-a049-f9bb51e06f82 req-a9dc6e93-5cf1-400f-82dd-96f45c06b7c2 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:52.237924 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-b45386db-b320-4bf7-a049-f9bb51e06f82 req-a9dc6e93-5cf1-400f-82dd-96f45c06b7c2 service nova] Creating event network-vif-plugged:f3a840a0-b3e2-44fd-a731-6cfafffd7f6e for instance 532ec916-2768-43e0-a912-791fb4b5d9ea on n-h2-846466-12 Aug 04 16:36:52.277509 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-b45386db-b320-4bf7-a049-f9bb51e06f82 req-a9dc6e93-5cf1-400f-82dd-96f45c06b7c2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106475 Aug 04 16:36:52.278139 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 542/1045] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:36:52.297514 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2e007655-cf05-49c7-b99a-5a8dc885130a tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:52.302484 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2e007655-cf05-49c7-b99a-5a8dc885130a tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] [instance: 2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:52.331429 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e007655-cf05-49c7-b99a-5a8dc885130a tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:52.337804 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e007655-cf05-49c7-b99a-5a8dc885130a tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:52.345115 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e007655-cf05-49c7-b99a-5a8dc885130a tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:52.346169 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e007655-cf05-49c7-b99a-5a8dc885130a tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:52.767872 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-393ad2c1-9459-4bf7-9e02-8116b2423573 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4590a95e924aa3a08e823ef1d6d18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30203a3cbb44c4ab36bcfa28662444d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:52.779393 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-393ad2c1-9459-4bf7-9e02-8116b2423573 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] 10.222.0.23 "GET /compute/v2.1/servers/e80e720e-cc06-40d9-b65e-02eca0e4f7d8" status: 200 len: 1469 microversion: 2.1 time: 1.417929 Aug 04 16:36:52.780178 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 504/1046] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:51 2022] GET /compute/v2.1/servers/e80e720e-cc06-40d9-b65e-02eca0e4f7d8 => generated 1469 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:52.786315 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2e007655-cf05-49c7-b99a-5a8dc885130a tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23645970a9a24e94b10b8578bb30b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5527cc7c4944c7898b64308f13b850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:52.803895 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2e007655-cf05-49c7-b99a-5a8dc885130a tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] 10.222.0.23 "GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88" status: 200 len: 1334 microversion: 2.1 time: 0.519991 Aug 04 16:36:52.817030 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 543/1047] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:52 2022] GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88 => generated 1334 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:52.823430 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-771e14db-0f8d-4534-963f-b423dff2d795 req-f45aad15-2ccb-4d46-8bb8-bfef174581f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8305b506-e5ac-4e19-97ea-4530d4ec87c1", "name": "network-vif-unplugged", "status": "completed", "tag": "88499859-554c-4372-a84a-c0c261083f9b"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:52.831911 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8c936496-6abe-4041-8fdc-e555c6d371c9 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:52.833508 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8c936496-6abe-4041-8fdc-e555c6d371c9 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] [instance: 4057c3fd-7edb-499b-8623-012b46ebd651] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:52.845003 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-771e14db-0f8d-4534-963f-b423dff2d795 req-f45aad15-2ccb-4d46-8bb8-bfef174581f4 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:52.845507 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-771e14db-0f8d-4534-963f-b423dff2d795 req-f45aad15-2ccb-4d46-8bb8-bfef174581f4 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:52.854410 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8c936496-6abe-4041-8fdc-e555c6d371c9 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:52.855304 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8c936496-6abe-4041-8fdc-e555c6d371c9 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:52.857878 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8c936496-6abe-4041-8fdc-e555c6d371c9 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:52.858854 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8c936496-6abe-4041-8fdc-e555c6d371c9 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:52.869314 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-771e14db-0f8d-4534-963f-b423dff2d795 req-f45aad15-2ccb-4d46-8bb8-bfef174581f4 service nova] Creating event network-vif-unplugged:88499859-554c-4372-a84a-c0c261083f9b for instance 8305b506-e5ac-4e19-97ea-4530d4ec87c1 on n-h1-846466-12 Aug 04 16:36:52.889041 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [req-771e14db-0f8d-4534-963f-b423dff2d795 req-f45aad15-2ccb-4d46-8bb8-bfef174581f4 service nova] Instance 8305b506-e5ac-4e19-97ea-4530d4ec87c1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126126) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 16:36:52.908534 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-771e14db-0f8d-4534-963f-b423dff2d795 req-f45aad15-2ccb-4d46-8bb8-bfef174581f4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126403 Aug 04 16:36:52.909781 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 505/1048] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:36:52.917633 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a4f5a8ed-5b7b-4192-a546-1c649f7540ed tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:52.918977 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a4f5a8ed-5b7b-4192-a546-1c649f7540ed tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: d238b9f3-e25b-4864-8b27-d53054d76082] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:52.927227 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a4f5a8ed-5b7b-4192-a546-1c649f7540ed tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:52.927701 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a4f5a8ed-5b7b-4192-a546-1c649f7540ed tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:52.928917 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a4f5a8ed-5b7b-4192-a546-1c649f7540ed tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:52.929487 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a4f5a8ed-5b7b-4192-a546-1c649f7540ed tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:53.613569 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8c936496-6abe-4041-8fdc-e555c6d371c9 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b193211a2243bc90299e112dd3cc26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64446d297d1407d888376ebd3642216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:53.631601 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8c936496-6abe-4041-8fdc-e555c6d371c9 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] 10.222.0.23 "GET /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651" status: 200 len: 1332 microversion: 2.1 time: 0.812816 Aug 04 16:36:53.633050 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 544/1049] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:52 2022] GET /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651 => generated 1332 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:53.644250 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a25fdb73-859b-49b9-a364-a4ddb507664b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:53.646601 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a25fdb73-859b-49b9-a364-a4ddb507664b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:53.663122 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a25fdb73-859b-49b9-a364-a4ddb507664b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:53.663846 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a25fdb73-859b-49b9-a364-a4ddb507664b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:53.665088 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a25fdb73-859b-49b9-a364-a4ddb507664b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:53.666130 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a25fdb73-859b-49b9-a364-a4ddb507664b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:53.721083 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a4f5a8ed-5b7b-4192-a546-1c649f7540ed tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:53.734913 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a4f5a8ed-5b7b-4192-a546-1c649f7540ed tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082" status: 200 len: 1322 microversion: 2.1 time: 0.820009 Aug 04 16:36:53.749848 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 506/1050] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:52 2022] GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082 => generated 1322 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:53.809233 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-328107f3-4c92-4f02-879f-825c5cb690ed tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:53.810144 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-328107f3-4c92-4f02-879f-825c5cb690ed tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] [instance: e80e720e-cc06-40d9-b65e-02eca0e4f7d8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:53.816433 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-328107f3-4c92-4f02-879f-825c5cb690ed tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:53.817232 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-328107f3-4c92-4f02-879f-825c5cb690ed tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:53.818198 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-328107f3-4c92-4f02-879f-825c5cb690ed tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:53.819018 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-328107f3-4c92-4f02-879f-825c5cb690ed tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:54.236043 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a25fdb73-859b-49b9-a364-a4ddb507664b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:54.254656 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a25fdb73-859b-49b9-a364-a4ddb507664b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1473 microversion: 2.1 time: 0.619791 Aug 04 16:36:54.255979 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 545/1051] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:53 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1473 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:54.274453 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bc7794d0-f42e-42d8-93c7-35642f2d09b7 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:54.275527 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bc7794d0-f42e-42d8-93c7-35642f2d09b7 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] [instance: 2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:54.282645 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bc7794d0-f42e-42d8-93c7-35642f2d09b7 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:54.283573 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bc7794d0-f42e-42d8-93c7-35642f2d09b7 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:54.285558 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bc7794d0-f42e-42d8-93c7-35642f2d09b7 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:54.286255 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bc7794d0-f42e-42d8-93c7-35642f2d09b7 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:54.864402 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bc7794d0-f42e-42d8-93c7-35642f2d09b7 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23645970a9a24e94b10b8578bb30b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5527cc7c4944c7898b64308f13b850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:54.880071 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bc7794d0-f42e-42d8-93c7-35642f2d09b7 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] 10.222.0.23 "GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88" status: 200 len: 1334 microversion: 2.1 time: 0.610519 Aug 04 16:36:54.882025 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 546/1052] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:54 2022] GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88 => generated 1334 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:54.894467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-83b2f23e-ad7c-4dc6-a9e9-60a4bae42b5e req-609759c1-3613-4d3f-be97-2490b7257abc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d238b9f3-e25b-4864-8b27-d53054d76082", "name": "network-vif-plugged", "status": "completed", "tag": "b5861496-5180-45d9-b61a-84944c746263"}, {"server_uuid": "e80e720e-cc06-40d9-b65e-02eca0e4f7d8", "name": "network-vif-unplugged", "status": "completed", "tag": "5f18bbd6-8f30-496d-9e64-85d1f9cc4514"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:54.934585 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-83b2f23e-ad7c-4dc6-a9e9-60a4bae42b5e req-609759c1-3613-4d3f-be97-2490b7257abc service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:54.935108 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-83b2f23e-ad7c-4dc6-a9e9-60a4bae42b5e req-609759c1-3613-4d3f-be97-2490b7257abc service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:54.961447 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-83b2f23e-ad7c-4dc6-a9e9-60a4bae42b5e req-609759c1-3613-4d3f-be97-2490b7257abc service nova] Creating event network-vif-plugged:b5861496-5180-45d9-b61a-84944c746263 for instance d238b9f3-e25b-4864-8b27-d53054d76082 on n-h1-846466-12 Aug 04 16:36:54.962002 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-83b2f23e-ad7c-4dc6-a9e9-60a4bae42b5e req-609759c1-3613-4d3f-be97-2490b7257abc service nova] Creating event network-vif-unplugged:5f18bbd6-8f30-496d-9e64-85d1f9cc4514 for instance e80e720e-cc06-40d9-b65e-02eca0e4f7d8 on n-h1-846466-12 Aug 04 16:36:54.980136 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-83b2f23e-ad7c-4dc6-a9e9-60a4bae42b5e req-609759c1-3613-4d3f-be97-2490b7257abc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.089192 Aug 04 16:36:54.982538 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 547/1053] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:36:55.000879 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-328107f3-4c92-4f02-879f-825c5cb690ed tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4590a95e924aa3a08e823ef1d6d18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30203a3cbb44c4ab36bcfa28662444d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:55.003176 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-52867713-3fdc-4a40-a3e8-506b8db469c7 req-a3c5b8fb-adc3-47da-b70c-57b4b3effd1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4057c3fd-7edb-499b-8623-012b46ebd651", "tag": "4b8c1725-1b11-419e-ba1a-40030b1080ba"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:55.014318 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-328107f3-4c92-4f02-879f-825c5cb690ed tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] 10.222.0.23 "GET /compute/v2.1/servers/e80e720e-cc06-40d9-b65e-02eca0e4f7d8" status: 200 len: 1469 microversion: 2.1 time: 1.204653 Aug 04 16:36:55.030520 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 507/1054] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:53 2022] GET /compute/v2.1/servers/e80e720e-cc06-40d9-b65e-02eca0e4f7d8 => generated 1469 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:36:55.031962 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-52867713-3fdc-4a40-a3e8-506b8db469c7 req-a3c5b8fb-adc3-47da-b70c-57b4b3effd1f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:55.033489 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-52867713-3fdc-4a40-a3e8-506b8db469c7 req-a3c5b8fb-adc3-47da-b70c-57b4b3effd1f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:55.044284 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-51495414-5f6c-49f6-9ed6-44942d086c77 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:55.045726 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-51495414-5f6c-49f6-9ed6-44942d086c77 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] [instance: 4057c3fd-7edb-499b-8623-012b46ebd651] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:55.053803 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-51495414-5f6c-49f6-9ed6-44942d086c77 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:55.054659 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-51495414-5f6c-49f6-9ed6-44942d086c77 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:55.055767 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-51495414-5f6c-49f6-9ed6-44942d086c77 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:55.057223 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-51495414-5f6c-49f6-9ed6-44942d086c77 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:55.068811 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-52867713-3fdc-4a40-a3e8-506b8db469c7 req-a3c5b8fb-adc3-47da-b70c-57b4b3effd1f service nova] Creating event network-changed:4b8c1725-1b11-419e-ba1a-40030b1080ba for instance 4057c3fd-7edb-499b-8623-012b46ebd651 on n-h2-846466-12 Aug 04 16:36:55.083284 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-52867713-3fdc-4a40-a3e8-506b8db469c7 req-a3c5b8fb-adc3-47da-b70c-57b4b3effd1f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096227 Aug 04 16:36:55.086549 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 548/1055] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:36:55.110987 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7cb14835-cd4d-49da-8c2a-980675f788da tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:55.113227 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7cb14835-cd4d-49da-8c2a-980675f788da tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: d238b9f3-e25b-4864-8b27-d53054d76082] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:55.166952 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7cb14835-cd4d-49da-8c2a-980675f788da tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:55.169887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7cb14835-cd4d-49da-8c2a-980675f788da tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:55.173492 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7cb14835-cd4d-49da-8c2a-980675f788da tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:55.178254 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7cb14835-cd4d-49da-8c2a-980675f788da tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:55.976717 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-51495414-5f6c-49f6-9ed6-44942d086c77 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b193211a2243bc90299e112dd3cc26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64446d297d1407d888376ebd3642216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:55.990572 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-51495414-5f6c-49f6-9ed6-44942d086c77 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] 10.222.0.23 "GET /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651" status: 200 len: 1332 microversion: 2.1 time: 0.956857 Aug 04 16:36:56.000339 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 508/1056] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:55 2022] GET /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651 => generated 1332 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:56.012001 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-e9f19f25-7e4e-4cae-ba0f-5b4624453b3d req-52b6bf27-33c4-45d8-8b2d-94592a47731e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8305b506-e5ac-4e19-97ea-4530d4ec87c1", "tag": "88499859-554c-4372-a84a-c0c261083f9b"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:56.024935 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-e9f19f25-7e4e-4cae-ba0f-5b4624453b3d req-52b6bf27-33c4-45d8-8b2d-94592a47731e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:56.025704 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-e9f19f25-7e4e-4cae-ba0f-5b4624453b3d req-52b6bf27-33c4-45d8-8b2d-94592a47731e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:56.036003 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7cb14835-cd4d-49da-8c2a-980675f788da tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:56.045422 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-e9f19f25-7e4e-4cae-ba0f-5b4624453b3d req-52b6bf27-33c4-45d8-8b2d-94592a47731e service nova] Creating event network-changed:88499859-554c-4372-a84a-c0c261083f9b for instance 8305b506-e5ac-4e19-97ea-4530d4ec87c1 on n-h1-846466-12 Aug 04 16:36:56.053098 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [req-e9f19f25-7e4e-4cae-ba0f-5b4624453b3d req-52b6bf27-33c4-45d8-8b2d-94592a47731e service nova] Instance 8305b506-e5ac-4e19-97ea-4530d4ec87c1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126126) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 16:36:56.054011 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7cb14835-cd4d-49da-8c2a-980675f788da tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082" status: 200 len: 1322 microversion: 2.1 time: 0.959560 Aug 04 16:36:56.054917 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 549/1057] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:55 2022] GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082 => generated 1322 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:56.067393 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2437c945-55cf-48b3-805b-b35d846c0814 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:56.068331 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2437c945-55cf-48b3-805b-b35d846c0814 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:56.081656 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2437c945-55cf-48b3-805b-b35d846c0814 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:56.083678 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-e9f19f25-7e4e-4cae-ba0f-5b4624453b3d req-52b6bf27-33c4-45d8-8b2d-94592a47731e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078573 Aug 04 16:36:56.084483 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2437c945-55cf-48b3-805b-b35d846c0814 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:56.086253 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2437c945-55cf-48b3-805b-b35d846c0814 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:56.086571 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 509/1058] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:36:56.108305 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2437c945-55cf-48b3-805b-b35d846c0814 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:56.122225 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a54f3b12-7808-4057-9441-ab3136e925dd tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:56.123220 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a54f3b12-7808-4057-9441-ab3136e925dd tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] [instance: 2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:56.148305 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=9 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:36:56.159610 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a54f3b12-7808-4057-9441-ab3136e925dd tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:56.160353 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a54f3b12-7808-4057-9441-ab3136e925dd tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:56.161510 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a54f3b12-7808-4057-9441-ab3136e925dd tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:56.162177 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a54f3b12-7808-4057-9441-ab3136e925dd tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:56.581026 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=8 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:36:56.653198 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a54f3b12-7808-4057-9441-ab3136e925dd tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23645970a9a24e94b10b8578bb30b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5527cc7c4944c7898b64308f13b850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:56.670650 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a54f3b12-7808-4057-9441-ab3136e925dd tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] 10.222.0.23 "GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88" status: 200 len: 1402 microversion: 2.1 time: 0.563540 Aug 04 16:36:56.671635 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 510/1059] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:56 2022] GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88 => generated 1402 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:56.680474 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-52595412-cfcb-478d-96ea-495aadce0ea6 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:56.695197 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-52595412-cfcb-478d-96ea-495aadce0ea6 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] [instance: e80e720e-cc06-40d9-b65e-02eca0e4f7d8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:56.707921 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-52595412-cfcb-478d-96ea-495aadce0ea6 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:56.708774 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-52595412-cfcb-478d-96ea-495aadce0ea6 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:56.709924 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-52595412-cfcb-478d-96ea-495aadce0ea6 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:56.711351 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-52595412-cfcb-478d-96ea-495aadce0ea6 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:56.772200 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-52595412-cfcb-478d-96ea-495aadce0ea6 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:56.772958 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-52595412-cfcb-478d-96ea-495aadce0ea6 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:56.773614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-52595412-cfcb-478d-96ea-495aadce0ea6 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lazy-loading 'fault' on Instance uuid e80e720e-cc06-40d9-b65e-02eca0e4f7d8 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:36:56.902483 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2437c945-55cf-48b3-805b-b35d846c0814 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:56.920889 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2437c945-55cf-48b3-805b-b35d846c0814 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1470 microversion: 2.1 time: 0.864361 Aug 04 16:36:56.925769 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 550/1060] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:56 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1470 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:56.955521 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dfafb554-8d89-40ea-927f-9f182997f560 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:56.956220 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dfafb554-8d89-40ea-927f-9f182997f560 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:56.967052 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dfafb554-8d89-40ea-927f-9f182997f560 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:56.975591 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dfafb554-8d89-40ea-927f-9f182997f560 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:56.976843 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dfafb554-8d89-40ea-927f-9f182997f560 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:56.977518 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dfafb554-8d89-40ea-927f-9f182997f560 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:57.047453 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-52595412-cfcb-478d-96ea-495aadce0ea6 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4590a95e924aa3a08e823ef1d6d18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30203a3cbb44c4ab36bcfa28662444d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:57.091422 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-52595412-cfcb-478d-96ea-495aadce0ea6 tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] 10.222.0.23 "GET /compute/v2.1/servers/e80e720e-cc06-40d9-b65e-02eca0e4f7d8" status: 200 len: 1304 microversion: 2.1 time: 0.417280 Aug 04 16:36:57.096093 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 511/1061] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:56 2022] GET /compute/v2.1/servers/e80e720e-cc06-40d9-b65e-02eca0e4f7d8 => generated 1304 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:57.112906 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ddf01ac9-240b-4e44-aa4a-fc8a36a8ae91 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:57.116614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ddf01ac9-240b-4e44-aa4a-fc8a36a8ae91 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] [instance: 4057c3fd-7edb-499b-8623-012b46ebd651] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:57.122580 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dfafb554-8d89-40ea-927f-9f182997f560 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "POST /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1/action" status: 204 len: 0 microversion: 2.1 time: 0.171883 Aug 04 16:36:57.123482 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 551/1062] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:36:56 2022] POST /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1/action => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 16:36:57.138942 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-17954a73-b1a8-4248-80cf-619e07ac17bf tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:57.146901 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-17954a73-b1a8-4248-80cf-619e07ac17bf tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: d238b9f3-e25b-4864-8b27-d53054d76082] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:57.159378 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:36:57.166311 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ddf01ac9-240b-4e44-aa4a-fc8a36a8ae91 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:57.170232 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ddf01ac9-240b-4e44-aa4a-fc8a36a8ae91 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:57.176222 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-17954a73-b1a8-4248-80cf-619e07ac17bf tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:57.177375 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ddf01ac9-240b-4e44-aa4a-fc8a36a8ae91 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:57.178219 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-17954a73-b1a8-4248-80cf-619e07ac17bf tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:57.179719 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-17954a73-b1a8-4248-80cf-619e07ac17bf tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:57.181081 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ddf01ac9-240b-4e44-aa4a-fc8a36a8ae91 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:57.187847 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-17954a73-b1a8-4248-80cf-619e07ac17bf tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:57.348265 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:36:58.063086 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-17954a73-b1a8-4248-80cf-619e07ac17bf tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:58.067561 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:36:58.075306 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-17954a73-b1a8-4248-80cf-619e07ac17bf tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082" status: 200 len: 1517 microversion: 2.1 time: 0.946098 Aug 04 16:36:58.083735 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 552/1063] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:57 2022] GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082 => generated 1517 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:58.089865 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ffe8544f-de1b-4156-bedf-c5d49dd22c37 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:58.091850 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ffe8544f-de1b-4156-bedf-c5d49dd22c37 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:58.105703 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ffe8544f-de1b-4156-bedf-c5d49dd22c37 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:58.106622 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ffe8544f-de1b-4156-bedf-c5d49dd22c37 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:58.108836 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ffe8544f-de1b-4156-bedf-c5d49dd22c37 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:58.109666 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ffe8544f-de1b-4156-bedf-c5d49dd22c37 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:58.153161 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ddf01ac9-240b-4e44-aa4a-fc8a36a8ae91 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b193211a2243bc90299e112dd3cc26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64446d297d1407d888376ebd3642216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:58.170558 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ddf01ac9-240b-4e44-aa4a-fc8a36a8ae91 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] 10.222.0.23 "GET /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651" status: 200 len: 1332 microversion: 2.1 time: 1.071099 Aug 04 16:36:58.171509 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 512/1064] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:57 2022] GET /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651 => generated 1332 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:58.176343 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-9592e430-82d1-49ec-9892-2e3765d8237b req-23dfe27c-2c91-48e1-8dd1-3679787cedb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5021f3f8-aa8b-4c94-8846-fdd1081135f5", "tag": "0ac743e2-4fd8-459b-98e6-2cd3c20f4ed6"}, {"server_uuid": "e80e720e-cc06-40d9-b65e-02eca0e4f7d8", "name": "network-vif-deleted", "tag": "5f18bbd6-8f30-496d-9e64-85d1f9cc4514"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:58.200175 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-9592e430-82d1-49ec-9892-2e3765d8237b req-23dfe27c-2c91-48e1-8dd1-3679787cedb9 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:58.201143 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-9592e430-82d1-49ec-9892-2e3765d8237b req-23dfe27c-2c91-48e1-8dd1-3679787cedb9 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:58.221659 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-9592e430-82d1-49ec-9892-2e3765d8237b req-23dfe27c-2c91-48e1-8dd1-3679787cedb9 service nova] Creating event network-changed:0ac743e2-4fd8-459b-98e6-2cd3c20f4ed6 for instance 5021f3f8-aa8b-4c94-8846-fdd1081135f5 on n-h1-846466-12 Aug 04 16:36:58.222515 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-9592e430-82d1-49ec-9892-2e3765d8237b req-23dfe27c-2c91-48e1-8dd1-3679787cedb9 service nova] Creating event network-vif-deleted:5f18bbd6-8f30-496d-9e64-85d1f9cc4514 for instance e80e720e-cc06-40d9-b65e-02eca0e4f7d8 on n-h1-846466-12 Aug 04 16:36:58.232083 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-9592e430-82d1-49ec-9892-2e3765d8237b req-23dfe27c-2c91-48e1-8dd1-3679787cedb9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.058851 Aug 04 16:36:58.234910 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 513/1065] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:36:58.254829 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-56918af2-e50b-44c2-8e6b-b61d1c5d64ae tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:58.255915 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-56918af2-e50b-44c2-8e6b-b61d1c5d64ae tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] [instance: 2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:58.264347 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-56918af2-e50b-44c2-8e6b-b61d1c5d64ae tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:58.265255 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-56918af2-e50b-44c2-8e6b-b61d1c5d64ae tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:58.266436 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-56918af2-e50b-44c2-8e6b-b61d1c5d64ae tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:58.267157 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-56918af2-e50b-44c2-8e6b-b61d1c5d64ae tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:58.268008 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=4 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:36:59.553265 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ffe8544f-de1b-4156-bedf-c5d49dd22c37 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:59.568052 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ffe8544f-de1b-4156-bedf-c5d49dd22c37 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1470 microversion: 2.1 time: 1.482341 Aug 04 16:36:59.569502 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 553/1066] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:58 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1470 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:59.578867 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4fc857d5-6fc6-4c51-bad5-c66b7d75ee4b tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:59.580368 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4fc857d5-6fc6-4c51-bad5-c66b7d75ee4b tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] [instance: e80e720e-cc06-40d9-b65e-02eca0e4f7d8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:59.585764 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-56918af2-e50b-44c2-8e6b-b61d1c5d64ae tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23645970a9a24e94b10b8578bb30b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5527cc7c4944c7898b64308f13b850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:36:59.591601 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4fc857d5-6fc6-4c51-bad5-c66b7d75ee4b tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:59.592336 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4fc857d5-6fc6-4c51-bad5-c66b7d75ee4b tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:59.593773 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4fc857d5-6fc6-4c51-bad5-c66b7d75ee4b tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:59.594941 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4fc857d5-6fc6-4c51-bad5-c66b7d75ee4b tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:59.601804 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-56918af2-e50b-44c2-8e6b-b61d1c5d64ae tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] 10.222.0.23 "GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88" status: 200 len: 1402 microversion: 2.1 time: 1.365006 Aug 04 16:36:59.603220 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 514/1067] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:58 2022] GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88 => generated 1402 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:36:59.614644 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5bc28ea3-8693-48c4-b52d-f36f041da4db tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:59.620323 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5bc28ea3-8693-48c4-b52d-f36f041da4db tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: d238b9f3-e25b-4864-8b27-d53054d76082] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:59.630145 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-4fc857d5-6fc6-4c51-bad5-c66b7d75ee4b tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] HTTP exception thrown: Instance e80e720e-cc06-40d9-b65e-02eca0e4f7d8 could not be found. Aug 04 16:36:59.631724 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5bc28ea3-8693-48c4-b52d-f36f041da4db tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:59.632614 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4fc857d5-6fc6-4c51-bad5-c66b7d75ee4b tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Request method failure captured: Aug 04 16:36:59.632614 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/e80e720e-cc06-40d9-b65e-02eca0e4f7d8 HTTP/1.1 Aug 04 16:36:59.632614 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:36:59.632614 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:36:59.632614 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:36:59.632614 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:36:59.632614 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:36:59.632614 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:36:59.632614 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:36:59.632614 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:36:59.632614 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_WFhjycDqOCd7PWjyzG2RMVzZoGKB41M3-8Zb-Iv6OFPtpXM2dXCM0l61uJpw5NPl4pmUMigEYMiCzOEQ8bpgJ7YH1j5IGEmm6wSHd7idbdJKU1lLhlPOmSFzlrfKOPNFAg0qdlpbQ5prLShAgh0RA7RAn1HYeuVVKv4aPp06K1yzs Aug 04 16:36:59.632614 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:36:59.632614 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:36:59.632614 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:36:59.632614 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:36:59.632614 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:36:59.632614 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:36:59.632614 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: e30203a3cbb44c4ab36bcfa28662444d Aug 04 16:36:59.632614 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-TenantUsagesTestJSON-763180303 Aug 04 16:36:59.632614 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:36:59.632614 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:36:59.634422 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e30203a3cbb44c4ab36bcfa28662444d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e30203a3cbb44c4ab36bcfa28662444d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e30203a3cbb44c4ab36bcfa28662444d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e30203a3cbb44c4ab36bcfa28662444d"}]}] Aug 04 16:36:59.634422 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-TenantUsagesTestJSON-763180303 Aug 04 16:36:59.634422 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: e30203a3cbb44c4ab36bcfa28662444d Aug 04 16:36:59.634422 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-TenantUsagesTestJSON-763180303 Aug 04 16:36:59.634422 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-TenantUsagesTestJSON-763180303-project Aug 04 16:36:59.634422 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:36:59.634422 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:36:59.634422 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: ff4590a95e924aa3a08e823ef1d6d18c Aug 04 16:36:59.634422 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-TenantUsagesTestJSON-763180303-project Aug 04 16:36:59.634422 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:36:59.634422 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance e80e720e-cc06-40d9-b65e-02eca0e4f7d8 could not be found. Aug 04 16:36:59.634422 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'e80e720e-cc06-40d9-b65e-02eca0e4f7d8'} Aug 04 16:36:59.635425 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:36:59.635425 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:36:59.635425 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:36:59.635425 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:36:59.635425 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:36:59.635425 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:36:59.635425 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:36:59.635425 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:36:59.635425 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:36:59.635425 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:36:59.635425 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e80e720e-cc06-40d9-b65e-02eca0e4f7d8 could not be found. Aug 04 16:36:59.635425 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:36:59.635425 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:36:59.635425 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:36:59.635425 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:36:59.635425 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:36:59.635425 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:36:59.635425 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:36:59.635425 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:36:59.635425 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:36:59.637203 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:36:59.637203 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:36:59.637203 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:36:59.637203 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:36:59.637203 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:36:59.637203 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:36:59.637203 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:36:59.637203 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e80e720e-cc06-40d9-b65e-02eca0e4f7d8 could not be found. Aug 04 16:36:59.637203 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:36:59.637203 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:36:59.637203 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:36:59.637203 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:36:59.637203 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:36:59.637203 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:36:59.637203 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:36:59.637203 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:36:59.637203 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e80e720e-cc06-40d9-b65e-02eca0e4f7d8 could not be found. Aug 04 16:36:59.637203 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:36:59.640831 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5bc28ea3-8693-48c4-b52d-f36f041da4db tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:59.640831 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5bc28ea3-8693-48c4-b52d-f36f041da4db tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:59.640831 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5bc28ea3-8693-48c4-b52d-f36f041da4db tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:59.641362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4fc857d5-6fc6-4c51-bad5-c66b7d75ee4b tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] Returning 404 to user: Instance e80e720e-cc06-40d9-b65e-02eca0e4f7d8 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:36:59.641544 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4fc857d5-6fc6-4c51-bad5-c66b7d75ee4b tempest-TenantUsagesTestJSON-763180303 tempest-TenantUsagesTestJSON-763180303-project] 10.222.0.23 "GET /compute/v2.1/servers/e80e720e-cc06-40d9-b65e-02eca0e4f7d8" status: 404 len: 111 microversion: 2.1 time: 0.069972 Aug 04 16:36:59.642341 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 554/1068] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:59 2022] GET /compute/v2.1/servers/e80e720e-cc06-40d9-b65e-02eca0e4f7d8 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:36:59.655804 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-6ea5e93b-d072-4373-b8d0-677f2e826539 req-6eb3c257-2e20-4932-9913-fb00e5a39294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8305b506-e5ac-4e19-97ea-4530d4ec87c1", "name": "network-vif-plugged", "status": "completed", "tag": "88499859-554c-4372-a84a-c0c261083f9b"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:36:59.668382 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6ea5e93b-d072-4373-b8d0-677f2e826539 req-6eb3c257-2e20-4932-9913-fb00e5a39294 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:59.669305 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6ea5e93b-d072-4373-b8d0-677f2e826539 req-6eb3c257-2e20-4932-9913-fb00e5a39294 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:59.689590 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-6ea5e93b-d072-4373-b8d0-677f2e826539 req-6eb3c257-2e20-4932-9913-fb00e5a39294 service nova] Creating event network-vif-plugged:88499859-554c-4372-a84a-c0c261083f9b for instance 8305b506-e5ac-4e19-97ea-4530d4ec87c1 on n-h1-846466-12 Aug 04 16:36:59.690394 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:36:59.698456 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [req-6ea5e93b-d072-4373-b8d0-677f2e826539 req-6eb3c257-2e20-4932-9913-fb00e5a39294 service nova] Instance 8305b506-e5ac-4e19-97ea-4530d4ec87c1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 16:36:59.699485 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-5bc28ea3-8693-48c4-b52d-f36f041da4db tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lazy-loading 'flavor' on Instance uuid d238b9f3-e25b-4864-8b27-d53054d76082 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:36:59.714155 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-6ea5e93b-d072-4373-b8d0-677f2e826539 req-6eb3c257-2e20-4932-9913-fb00e5a39294 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063612 Aug 04 16:36:59.716949 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 555/1069] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:36:59.724577 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ca1a2569-d486-4199-876f-73c961119870 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:59.725768 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ca1a2569-d486-4199-876f-73c961119870 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] [instance: 4057c3fd-7edb-499b-8623-012b46ebd651] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:59.734880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ca1a2569-d486-4199-876f-73c961119870 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:59.736296 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ca1a2569-d486-4199-876f-73c961119870 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:59.737574 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ca1a2569-d486-4199-876f-73c961119870 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:59.739383 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ca1a2569-d486-4199-876f-73c961119870 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:59.917092 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5bc28ea3-8693-48c4-b52d-f36f041da4db tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "POST /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082/action" status: 200 len: 32 microversion: 2.1 time: 0.311513 Aug 04 16:36:59.917879 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 515/1070] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:36:59 2022] POST /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082/action => generated 32 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:36:59.931459 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a7f40b98-7e5e-48d1-9564-ce0536daf918 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:36:59.932688 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a7f40b98-7e5e-48d1-9564-ce0536daf918 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: d238b9f3-e25b-4864-8b27-d53054d76082] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:36:59.943090 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a7f40b98-7e5e-48d1-9564-ce0536daf918 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:59.945152 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a7f40b98-7e5e-48d1-9564-ce0536daf918 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:36:59.946469 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a7f40b98-7e5e-48d1-9564-ce0536daf918 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:36:59.947080 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a7f40b98-7e5e-48d1-9564-ce0536daf918 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:00.541516 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a7f40b98-7e5e-48d1-9564-ce0536daf918 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:00.550049 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a7f40b98-7e5e-48d1-9564-ce0536daf918 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082" status: 200 len: 1523 microversion: 2.1 time: 0.624235 Aug 04 16:37:00.556282 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 516/1071] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:59 2022] GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082 => generated 1523 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:00.564010 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-d77c3e6a-4a56-4a09-b289-2e1ea979ca7a req-54504827-718a-421f-90f9-9dc99fad3cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88", "tag": "04a72ae1-98a2-4e1f-9e4c-91b9c892ac34"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:00.591956 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ca1a2569-d486-4199-876f-73c961119870 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b193211a2243bc90299e112dd3cc26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64446d297d1407d888376ebd3642216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:00.592687 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-d77c3e6a-4a56-4a09-b289-2e1ea979ca7a req-54504827-718a-421f-90f9-9dc99fad3cc5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:00.593821 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-d77c3e6a-4a56-4a09-b289-2e1ea979ca7a req-54504827-718a-421f-90f9-9dc99fad3cc5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:00.600672 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ca1a2569-d486-4199-876f-73c961119870 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] 10.222.0.23 "GET /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651" status: 200 len: 1332 microversion: 2.1 time: 0.881885 Aug 04 16:37:00.607198 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 556/1072] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:36:59 2022] GET /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651 => generated 1332 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:00.615843 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-d77c3e6a-4a56-4a09-b289-2e1ea979ca7a req-54504827-718a-421f-90f9-9dc99fad3cc5 service nova] Creating event network-changed:04a72ae1-98a2-4e1f-9e4c-91b9c892ac34 for instance 2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88 on n-h1-846466-12 Aug 04 16:37:00.616422 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-85456d4c-f006-4cd6-9f5b-a490f8a95853 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:00.619340 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-85456d4c-f006-4cd6-9f5b-a490f8a95853 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:00.630933 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-d77c3e6a-4a56-4a09-b289-2e1ea979ca7a req-54504827-718a-421f-90f9-9dc99fad3cc5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071959 Aug 04 16:37:00.632159 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 517/1073] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:37:00.634470 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-85456d4c-f006-4cd6-9f5b-a490f8a95853 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:00.642873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-85456d4c-f006-4cd6-9f5b-a490f8a95853 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:00.643777 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-85456d4c-f006-4cd6-9f5b-a490f8a95853 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:00.644302 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-85456d4c-f006-4cd6-9f5b-a490f8a95853 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:00.646744 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-88ab2798-8fd3-4051-ae3a-54a40410f594 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:00.647772 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-88ab2798-8fd3-4051-ae3a-54a40410f594 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] [instance: 2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:00.660577 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-88ab2798-8fd3-4051-ae3a-54a40410f594 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:00.661830 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-88ab2798-8fd3-4051-ae3a-54a40410f594 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:00.663363 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-88ab2798-8fd3-4051-ae3a-54a40410f594 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:00.664413 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-88ab2798-8fd3-4051-ae3a-54a40410f594 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:01.991092 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-85456d4c-f006-4cd6-9f5b-a490f8a95853 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:02.015536 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-85456d4c-f006-4cd6-9f5b-a490f8a95853 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1470 microversion: 2.1 time: 1.406779 Aug 04 16:37:02.021450 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 557/1074] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:00 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1470 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:02.034902 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9c53bfef-aa46-46a1-a362-fac59deb6daa tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:02.035302 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-88ab2798-8fd3-4051-ae3a-54a40410f594 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23645970a9a24e94b10b8578bb30b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5527cc7c4944c7898b64308f13b850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:02.036090 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9c53bfef-aa46-46a1-a362-fac59deb6daa tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: d238b9f3-e25b-4864-8b27-d53054d76082] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:02.050599 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c53bfef-aa46-46a1-a362-fac59deb6daa tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:02.051138 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-88ab2798-8fd3-4051-ae3a-54a40410f594 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] 10.222.0.23 "GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88" status: 200 len: 1402 microversion: 2.1 time: 1.411464 Aug 04 16:37:02.051712 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c53bfef-aa46-46a1-a362-fac59deb6daa tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:02.052896 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c53bfef-aa46-46a1-a362-fac59deb6daa tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:02.053577 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c53bfef-aa46-46a1-a362-fac59deb6daa tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:02.065984 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 518/1075] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:00 2022] GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88 => generated 1402 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:02.084900 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-247310c7-1aee-44e3-b566-91e60e6980ae tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:02.086662 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-247310c7-1aee-44e3-b566-91e60e6980ae tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] [instance: 4057c3fd-7edb-499b-8623-012b46ebd651] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:02.103938 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-247310c7-1aee-44e3-b566-91e60e6980ae tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:02.105389 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-247310c7-1aee-44e3-b566-91e60e6980ae tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:02.107078 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-247310c7-1aee-44e3-b566-91e60e6980ae tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:02.108508 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-247310c7-1aee-44e3-b566-91e60e6980ae tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:03.085551 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9c53bfef-aa46-46a1-a362-fac59deb6daa tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:03.105196 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9c53bfef-aa46-46a1-a362-fac59deb6daa tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082" status: 200 len: 1523 microversion: 2.1 time: 1.081999 Aug 04 16:37:03.120610 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 558/1076] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:02 2022] GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082 => generated 1523 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:03.126194 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1f86a3fd-d037-4846-8a4d-3f548dd169ad tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:03.126994 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1f86a3fd-d037-4846-8a4d-3f548dd169ad tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:03.134654 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f86a3fd-d037-4846-8a4d-3f548dd169ad tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:03.137115 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f86a3fd-d037-4846-8a4d-3f548dd169ad tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:03.139451 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f86a3fd-d037-4846-8a4d-3f548dd169ad tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:03.142074 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-247310c7-1aee-44e3-b566-91e60e6980ae tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b193211a2243bc90299e112dd3cc26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64446d297d1407d888376ebd3642216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:03.142957 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f86a3fd-d037-4846-8a4d-3f548dd169ad tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:03.168571 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-247310c7-1aee-44e3-b566-91e60e6980ae tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] 10.222.0.23 "GET /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651" status: 200 len: 1332 microversion: 2.1 time: 1.099929 Aug 04 16:37:03.200138 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 519/1077] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:02 2022] GET /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651 => generated 1332 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:03.224669 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0c4507b1-a438-4664-8e59-bacb968694d6 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:03.232420 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0c4507b1-a438-4664-8e59-bacb968694d6 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] [instance: 2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:03.269788 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c4507b1-a438-4664-8e59-bacb968694d6 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:03.270964 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c4507b1-a438-4664-8e59-bacb968694d6 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:03.274225 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c4507b1-a438-4664-8e59-bacb968694d6 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:03.274505 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c4507b1-a438-4664-8e59-bacb968694d6 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:03.629018 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1f86a3fd-d037-4846-8a4d-3f548dd169ad tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:03.647990 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1f86a3fd-d037-4846-8a4d-3f548dd169ad tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1470 microversion: 2.1 time: 0.525840 Aug 04 16:37:03.649674 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 559/1078] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:03 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1470 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:03.662013 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-6bacd50c-f0ef-49e6-9c75-3989ff019573 req-01e63039-d93c-4892-b311-c915a610c238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4057c3fd-7edb-499b-8623-012b46ebd651", "name": "network-vif-plugged", "status": "completed", "tag": "4b8c1725-1b11-419e-ba1a-40030b1080ba"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:03.683235 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0c4507b1-a438-4664-8e59-bacb968694d6 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23645970a9a24e94b10b8578bb30b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5527cc7c4944c7898b64308f13b850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:03.697673 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6bacd50c-f0ef-49e6-9c75-3989ff019573 req-01e63039-d93c-4892-b311-c915a610c238 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:03.698380 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6bacd50c-f0ef-49e6-9c75-3989ff019573 req-01e63039-d93c-4892-b311-c915a610c238 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:03.705587 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0c4507b1-a438-4664-8e59-bacb968694d6 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] 10.222.0.23 "GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88" status: 200 len: 1402 microversion: 2.1 time: 0.501159 Aug 04 16:37:03.708013 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 520/1079] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:03 2022] GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88 => generated 1402 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:03.718578 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-6bacd50c-f0ef-49e6-9c75-3989ff019573 req-01e63039-d93c-4892-b311-c915a610c238 service nova] Creating event network-vif-plugged:4b8c1725-1b11-419e-ba1a-40030b1080ba for instance 4057c3fd-7edb-499b-8623-012b46ebd651 on n-h2-846466-12 Aug 04 16:37:03.724664 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-6bacd50c-f0ef-49e6-9c75-3989ff019573 req-01e63039-d93c-4892-b311-c915a610c238 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072528 Aug 04 16:37:03.728502 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 560/1080] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:37:04.082782 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-79430699-fb53-4d47-a1dd-4758c7b25d6b tempest-AbsoluteLimitsTestJSON-1685148124 tempest-AbsoluteLimitsTestJSON-1685148124-project] Calling method '.version_select at 0x7f7e851cf4c0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:04.130694 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5b1f7945-cc9b-4dd1-9f5c-e2ec821b2e96 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:04.132168 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5b1f7945-cc9b-4dd1-9f5c-e2ec821b2e96 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: d238b9f3-e25b-4864-8b27-d53054d76082] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:04.136052 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-79430699-fb53-4d47-a1dd-4758c7b25d6b tempest-AbsoluteLimitsTestJSON-1685148124 tempest-AbsoluteLimitsTestJSON-1685148124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:04.136853 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-79430699-fb53-4d47-a1dd-4758c7b25d6b tempest-AbsoluteLimitsTestJSON-1685148124 tempest-AbsoluteLimitsTestJSON-1685148124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:04.140817 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5b1f7945-cc9b-4dd1-9f5c-e2ec821b2e96 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:04.142365 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5b1f7945-cc9b-4dd1-9f5c-e2ec821b2e96 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:04.143587 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5b1f7945-cc9b-4dd1-9f5c-e2ec821b2e96 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:04.144284 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5b1f7945-cc9b-4dd1-9f5c-e2ec821b2e96 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:04.151929 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-79430699-fb53-4d47-a1dd-4758c7b25d6b tempest-AbsoluteLimitsTestJSON-1685148124 tempest-AbsoluteLimitsTestJSON-1685148124-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:04.152740 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-79430699-fb53-4d47-a1dd-4758c7b25d6b tempest-AbsoluteLimitsTestJSON-1685148124 tempest-AbsoluteLimitsTestJSON-1685148124-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:04.271753 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-79430699-fb53-4d47-a1dd-4758c7b25d6b tempest-AbsoluteLimitsTestJSON-1685148124 tempest-AbsoluteLimitsTestJSON-1685148124-project] 10.222.0.23 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.381414 Aug 04 16:37:04.272376 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 521/1081] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Aug 4 16:37:03 2022] GET /compute/v2.1/limits => generated 511 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:37:04.280963 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7c4fc180-8cec-4548-87e3-0ef33795ce79 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:04.284995 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7c4fc180-8cec-4548-87e3-0ef33795ce79 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] [instance: 4057c3fd-7edb-499b-8623-012b46ebd651] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:04.312042 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7c4fc180-8cec-4548-87e3-0ef33795ce79 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:04.312785 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7c4fc180-8cec-4548-87e3-0ef33795ce79 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:04.313821 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7c4fc180-8cec-4548-87e3-0ef33795ce79 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:04.314459 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7c4fc180-8cec-4548-87e3-0ef33795ce79 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:04.619349 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5b1f7945-cc9b-4dd1-9f5c-e2ec821b2e96 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:04.641410 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5b1f7945-cc9b-4dd1-9f5c-e2ec821b2e96 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082" status: 200 len: 1523 microversion: 2.1 time: 0.516102 Aug 04 16:37:04.665874 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 561/1082] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:04 2022] GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082 => generated 1523 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:37:04.686639 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4580daef-b4ba-47d4-b6e9-93d24632fdb8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:04.687667 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4580daef-b4ba-47d4-b6e9-93d24632fdb8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:04.704852 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4580daef-b4ba-47d4-b6e9-93d24632fdb8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:04.706097 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4580daef-b4ba-47d4-b6e9-93d24632fdb8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:04.707311 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4580daef-b4ba-47d4-b6e9-93d24632fdb8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:04.707840 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4580daef-b4ba-47d4-b6e9-93d24632fdb8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:04.917044 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7c4fc180-8cec-4548-87e3-0ef33795ce79 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b193211a2243bc90299e112dd3cc26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64446d297d1407d888376ebd3642216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:04.930884 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7c4fc180-8cec-4548-87e3-0ef33795ce79 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] 10.222.0.23 "GET /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651" status: 200 len: 1332 microversion: 2.1 time: 0.657381 Aug 04 16:37:04.932094 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 522/1083] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:04 2022] GET /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651 => generated 1332 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:04.955267 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-651d9ddc-bc7f-45b9-9f64-1360a004d6ae tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:04.956551 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-651d9ddc-bc7f-45b9-9f64-1360a004d6ae tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] [instance: 2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:04.967683 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-651d9ddc-bc7f-45b9-9f64-1360a004d6ae tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:04.969850 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-651d9ddc-bc7f-45b9-9f64-1360a004d6ae tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:04.971871 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-651d9ddc-bc7f-45b9-9f64-1360a004d6ae tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:04.972710 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-651d9ddc-bc7f-45b9-9f64-1360a004d6ae tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:05.132579 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4580daef-b4ba-47d4-b6e9-93d24632fdb8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:05.149187 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4580daef-b4ba-47d4-b6e9-93d24632fdb8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1462 microversion: 2.1 time: 0.480947 Aug 04 16:37:05.151077 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 562/1084] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:04 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1462 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:05.188315 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7e9565db-4ffc-4755-be32-70d09d901148 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:05.189523 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7e9565db-4ffc-4755-be32-70d09d901148 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:05.200984 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7e9565db-4ffc-4755-be32-70d09d901148 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:05.201914 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7e9565db-4ffc-4755-be32-70d09d901148 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:05.203403 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7e9565db-4ffc-4755-be32-70d09d901148 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:05.204471 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7e9565db-4ffc-4755-be32-70d09d901148 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:05.490220 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-651d9ddc-bc7f-45b9-9f64-1360a004d6ae tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23645970a9a24e94b10b8578bb30b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5527cc7c4944c7898b64308f13b850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:05.501086 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-651d9ddc-bc7f-45b9-9f64-1360a004d6ae tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] 10.222.0.23 "GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88" status: 200 len: 1402 microversion: 2.1 time: 0.567199 Aug 04 16:37:05.502299 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 523/1085] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:04 2022] GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88 => generated 1402 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:05.564670 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7e9565db-4ffc-4755-be32-70d09d901148 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:05.583158 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7e9565db-4ffc-4755-be32-70d09d901148 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1462 microversion: 2.1 time: 0.402249 Aug 04 16:37:05.584821 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 563/1086] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:05 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1462 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:05.613525 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-70d0c8cf-5b17-4e42-9ad5-570783eb522b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Action: 'create', calling method: .version_select at 0x7f7e84b6f0d0>, body: {"keypair": {"name": "tempest-keypair-342868325", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdxqfKjgeBF503GNSw6BDw09hNrJFwgyiuIhBfjcpopXmvEsKma0kZCmKyCewLeH4SfdQcgf4vt1juLDScplAakMvABdlMPVTC+eNYZK9AqXy/AyHiWlQUXbwr3VplYGg=="}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:05.643996 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-70d0c8cf-5b17-4e42-9ad5-570783eb522b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Getting quotas for project c456fd996bb544478bdb39c6a7ca04a6. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:37:05.654903 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-70d0c8cf-5b17-4e42-9ad5-570783eb522b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Getting quotas for user 6e582cea96b64285b4232b96162a274c and project c456fd996bb544478bdb39c6a7ca04a6. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:37:05.693076 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-03a2fbbc-eac9-46e2-9afb-8fe030090db3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:05.694736 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-03a2fbbc-eac9-46e2-9afb-8fe030090db3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: d238b9f3-e25b-4864-8b27-d53054d76082] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:05.701902 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-70d0c8cf-5b17-4e42-9ad5-570783eb522b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.094969 Aug 04 16:37:05.703392 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 524/1087] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 16:37:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:37:05.707342 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-03a2fbbc-eac9-46e2-9afb-8fe030090db3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:05.708527 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-03a2fbbc-eac9-46e2-9afb-8fe030090db3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:05.710209 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-03a2fbbc-eac9-46e2-9afb-8fe030090db3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:05.711487 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-03a2fbbc-eac9-46e2-9afb-8fe030090db3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:05.961980 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-756c4f32-9362-403b-af2b-852f7c45c6bf tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:05.962753 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-756c4f32-9362-403b-af2b-852f7c45c6bf tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] [instance: 4057c3fd-7edb-499b-8623-012b46ebd651] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:05.975718 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-756c4f32-9362-403b-af2b-852f7c45c6bf tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:05.977910 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-756c4f32-9362-403b-af2b-852f7c45c6bf tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:05.979754 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-756c4f32-9362-403b-af2b-852f7c45c6bf tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:05.980158 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-756c4f32-9362-403b-af2b-852f7c45c6bf tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:06.098703 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-03a2fbbc-eac9-46e2-9afb-8fe030090db3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:06.163632 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-03a2fbbc-eac9-46e2-9afb-8fe030090db3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082" status: 200 len: 1523 microversion: 2.1 time: 0.478739 Aug 04 16:37:06.167183 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 564/1088] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:05 2022] GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082 => generated 1523 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:37:06.528927 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-46af817b-5f34-4f45-babe-a3e61a6acbc9 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:06.530289 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-46af817b-5f34-4f45-babe-a3e61a6acbc9 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] [instance: 2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:06.541020 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46af817b-5f34-4f45-babe-a3e61a6acbc9 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:06.541779 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46af817b-5f34-4f45-babe-a3e61a6acbc9 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:06.543488 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46af817b-5f34-4f45-babe-a3e61a6acbc9 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:06.544448 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46af817b-5f34-4f45-babe-a3e61a6acbc9 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:06.585589 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-756c4f32-9362-403b-af2b-852f7c45c6bf tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b193211a2243bc90299e112dd3cc26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64446d297d1407d888376ebd3642216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:06.603632 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-756c4f32-9362-403b-af2b-852f7c45c6bf tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] 10.222.0.23 "GET /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651" status: 200 len: 1536 microversion: 2.1 time: 0.646868 Aug 04 16:37:06.613346 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 525/1089] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:05 2022] GET /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651 => generated 1536 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:37:06.644902 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fd1d0a11-ef76-41e1-a0f5-77b11cddb515 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Action: 'create', calling method: .version_select at 0x7f7e854e0940>, body: {"pool": "7059c2bd-3196-46e8-9859-a9efe4fcb75b"} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:07.349787 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-46af817b-5f34-4f45-babe-a3e61a6acbc9 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23645970a9a24e94b10b8578bb30b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5527cc7c4944c7898b64308f13b850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:07.384357 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-46af817b-5f34-4f45-babe-a3e61a6acbc9 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] 10.222.0.23 "GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88" status: 200 len: 1402 microversion: 2.1 time: 0.858503 Aug 04 16:37:07.385807 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 565/1090] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:06 2022] GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88 => generated 1402 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:07.396245 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9a439c1a-3d5b-4a17-a0c6-78db772a62fa tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:07.397419 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9a439c1a-3d5b-4a17-a0c6-78db772a62fa tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: d238b9f3-e25b-4864-8b27-d53054d76082] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:07.411991 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9a439c1a-3d5b-4a17-a0c6-78db772a62fa tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:07.412821 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9a439c1a-3d5b-4a17-a0c6-78db772a62fa tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:07.414385 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9a439c1a-3d5b-4a17-a0c6-78db772a62fa tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:07.416073 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9a439c1a-3d5b-4a17-a0c6-78db772a62fa tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:08.418501 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9a439c1a-3d5b-4a17-a0c6-78db772a62fa tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:08.443842 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9a439c1a-3d5b-4a17-a0c6-78db772a62fa tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082" status: 200 len: 1523 microversion: 2.1 time: 1.055936 Aug 04 16:37:08.445730 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 566/1091] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:07 2022] GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082 => generated 1523 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:08.457713 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-79656809-7009-4351-86f7-8607a3127a43 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:08.459552 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-79656809-7009-4351-86f7-8607a3127a43 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] [instance: 2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:08.479380 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-79656809-7009-4351-86f7-8607a3127a43 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:08.480770 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-79656809-7009-4351-86f7-8607a3127a43 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:08.482919 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-79656809-7009-4351-86f7-8607a3127a43 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:08.484090 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-79656809-7009-4351-86f7-8607a3127a43 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:08.886431 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-79656809-7009-4351-86f7-8607a3127a43 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23645970a9a24e94b10b8578bb30b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5527cc7c4944c7898b64308f13b850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:08.897469 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-79656809-7009-4351-86f7-8607a3127a43 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] 10.222.0.23 "GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88" status: 200 len: 1402 microversion: 2.1 time: 0.449552 Aug 04 16:37:08.911108 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 567/1092] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:08 2022] GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88 => generated 1402 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:08.918790 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-88fb1dba-f2ca-497b-bc14-f510fcd35279 req-c08b5866-2d65-4394-9f5c-5d94e2d66f13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88", "name": "network-vif-plugged", "status": "completed", "tag": "04a72ae1-98a2-4e1f-9e4c-91b9c892ac34"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:08.932403 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-88fb1dba-f2ca-497b-bc14-f510fcd35279 req-c08b5866-2d65-4394-9f5c-5d94e2d66f13 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:08.933202 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-88fb1dba-f2ca-497b-bc14-f510fcd35279 req-c08b5866-2d65-4394-9f5c-5d94e2d66f13 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:08.957608 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-88fb1dba-f2ca-497b-bc14-f510fcd35279 req-c08b5866-2d65-4394-9f5c-5d94e2d66f13 service nova] Creating event network-vif-plugged:04a72ae1-98a2-4e1f-9e4c-91b9c892ac34 for instance 2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88 on n-h1-846466-12 Aug 04 16:37:08.968324 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-88fb1dba-f2ca-497b-bc14-f510fcd35279 req-c08b5866-2d65-4394-9f5c-5d94e2d66f13 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054473 Aug 04 16:37:08.969646 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 568/1093] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:37:09.480739 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e9e60c10-afd4-434d-9e17-7d62afe64a26 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:09.483233 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e9e60c10-afd4-434d-9e17-7d62afe64a26 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: d238b9f3-e25b-4864-8b27-d53054d76082] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:09.517741 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e9e60c10-afd4-434d-9e17-7d62afe64a26 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:09.518803 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e9e60c10-afd4-434d-9e17-7d62afe64a26 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:09.521607 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e9e60c10-afd4-434d-9e17-7d62afe64a26 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:09.537624 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e9e60c10-afd4-434d-9e17-7d62afe64a26 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:09.958358 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e9e60c10-afd4-434d-9e17-7d62afe64a26 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:09.974870 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e9e60c10-afd4-434d-9e17-7d62afe64a26 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082" status: 200 len: 1523 microversion: 2.1 time: 0.506686 Aug 04 16:37:09.976985 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 569/1094] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:09 2022] GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082 => generated 1523 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:37:09.985133 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e4e1c23b-07cc-42e9-ba55-c1d43eae9132 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:09.985826 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e4e1c23b-07cc-42e9-ba55-c1d43eae9132 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] [instance: 2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:09.999528 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e4e1c23b-07cc-42e9-ba55-c1d43eae9132 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:10.001329 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e4e1c23b-07cc-42e9-ba55-c1d43eae9132 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:10.004187 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e4e1c23b-07cc-42e9-ba55-c1d43eae9132 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:10.005030 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e4e1c23b-07cc-42e9-ba55-c1d43eae9132 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:10.334183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e4e1c23b-07cc-42e9-ba55-c1d43eae9132 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23645970a9a24e94b10b8578bb30b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5527cc7c4944c7898b64308f13b850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:10.355079 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e4e1c23b-07cc-42e9-ba55-c1d43eae9132 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] 10.222.0.23 "GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88" status: 200 len: 1402 microversion: 2.1 time: 0.376898 Aug 04 16:37:10.357155 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 570/1095] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:09 2022] GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88 => generated 1402 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:10.433984 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9996e6f2-d3a5-47f7-a9a1-9599a121e87f tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Calling method '.version_select at 0x7f7e84da5e50>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:10.438624 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9996e6f2-d3a5-47f7-a9a1-9599a121e87f tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:10.439271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9996e6f2-d3a5-47f7-a9a1-9599a121e87f tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:10.451323 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9996e6f2-d3a5-47f7-a9a1-9599a121e87f tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 2362 microversion: 2.1 time: 0.023318 Aug 04 16:37:10.452474 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 571/1096] 10.222.0.23 () {58 vars in 1143 bytes} [Thu Aug 4 16:37:10 2022] GET /compute/v2.1/os-migrations => generated 2362 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:37:10.489943 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4481de81-3ced-4dc6-a5f4-86bf3c33879e tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:10.500288 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4481de81-3ced-4dc6-a5f4-86bf3c33879e tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015853 Aug 04 16:37:10.501250 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 572/1097] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Aug 4 16:37:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:37:10.524957 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-148d31fc-7835-4d19-b453-00df3157ac0c tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1110634771", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:10.530180 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:37:10.530180 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:37:10.571798 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-148d31fc-7835-4d19-b453-00df3157ac0c tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.055907 Aug 04 16:37:10.575767 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 573/1098] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Aug 4 16:37:10 2022] POST /compute/v2.1/flavors => generated 499 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:37:10.598020 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-db477e99-a3ad-4710-9de2-39f368620953 tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:10.622107 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-db477e99-a3ad-4710-9de2-39f368620953 tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.023556 Aug 04 16:37:10.623415 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 574/1099] 10.222.0.23 () {58 vars in 1182 bytes} [Thu Aug 4 16:37:10 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:37:10.871246 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d1dd1893-7acd-409c-8f8e-398f396a1e23 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:10.872445 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d1dd1893-7acd-409c-8f8e-398f396a1e23 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:10.893335 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d1dd1893-7acd-409c-8f8e-398f396a1e23 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:10.905796 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d1dd1893-7acd-409c-8f8e-398f396a1e23 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:10.907661 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d1dd1893-7acd-409c-8f8e-398f396a1e23 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:10.908890 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d1dd1893-7acd-409c-8f8e-398f396a1e23 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:10.960453 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=100 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:37:11.350028 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fd1d0a11-ef76-41e1-a0f5-77b11cddb515 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.708616 Aug 04 16:37:11.352180 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 526/1100] 10.222.0.23 () {60 vars in 1170 bytes} [Thu Aug 4 16:37:06 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:37:11.365903 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8c3a21f9-5722-401c-8d57-66cdbf508858 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1950744971", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "122f0b88-a4cb-4b77-ba53-504a7ce87bd0"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:11.442827 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d1dd1893-7acd-409c-8f8e-398f396a1e23 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159" status: 200 len: 1860 microversion: 2.1 time: 0.580962 Aug 04 16:37:11.443614 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 575/1101] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:10 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159 => generated 1860 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:11.464262 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-8c3a21f9-5722-401c-8d57-66cdbf508858 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] validate_networks() for None {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:37:11.467250 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-654e9141-ad26-45d2-887e-a26cf29dd92c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:11.468602 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-654e9141-ad26-45d2-887e-a26cf29dd92c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: d238b9f3-e25b-4864-8b27-d53054d76082] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:11.479527 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-654e9141-ad26-45d2-887e-a26cf29dd92c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:11.480828 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-654e9141-ad26-45d2-887e-a26cf29dd92c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:11.481921 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-654e9141-ad26-45d2-887e-a26cf29dd92c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:11.482740 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-654e9141-ad26-45d2-887e-a26cf29dd92c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:11.861546 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-654e9141-ad26-45d2-887e-a26cf29dd92c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:11.885749 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-654e9141-ad26-45d2-887e-a26cf29dd92c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082" status: 200 len: 1523 microversion: 2.1 time: 0.428278 Aug 04 16:37:11.886787 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 576/1102] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:11 2022] GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082 => generated 1523 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:11.896522 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1f6f1ecd-f4d1-4f34-b9b6-dbce47f384d8 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Action: 'action', calling method: .version_select at 0x7f7e876deca0>, body: {"addFloatingIp": {"address": "172.25.6.96"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:11.901644 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1f6f1ecd-f4d1-4f34-b9b6-dbce47f384d8 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] [instance: 4057c3fd-7edb-499b-8623-012b46ebd651] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:11.922749 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f6f1ecd-f4d1-4f34-b9b6-dbce47f384d8 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:11.923903 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f6f1ecd-f4d1-4f34-b9b6-dbce47f384d8 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:11.925542 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f6f1ecd-f4d1-4f34-b9b6-dbce47f384d8 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:11.926672 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f6f1ecd-f4d1-4f34-b9b6-dbce47f384d8 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:11.972433 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-8c3a21f9-5722-401c-8d57-66cdbf508858 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:37:11.974188 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-8c3a21f9-5722-401c-8d57-66cdbf508858 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:37:11.975184 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-8c3a21f9-5722-401c-8d57-66cdbf508858 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:37:11.975976 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-8c3a21f9-5722-401c-8d57-66cdbf508858 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:37:11.976957 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-8c3a21f9-5722-401c-8d57-66cdbf508858 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:37:11.986717 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f6f1ecd-f4d1-4f34-b9b6-dbce47f384d8 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Acquired lock "refresh_cache-4057c3fd-7edb-499b-8623-012b46ebd651" {{(pid=126125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 16:37:11.998799 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8c3a21f9-5722-401c-8d57-66cdbf508858 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:11.999566 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8c3a21f9-5722-401c-8d57-66cdbf508858 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:12.001076 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8c3a21f9-5722-401c-8d57-66cdbf508858 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:12.002140 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8c3a21f9-5722-401c-8d57-66cdbf508858 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:12.053833 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-8c3a21f9-5722-401c-8d57-66cdbf508858 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Getting quotas for project c456fd996bb544478bdb39c6a7ca04a6. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:37:12.066909 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-8c3a21f9-5722-401c-8d57-66cdbf508858 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Getting quotas for user 6e582cea96b64285b4232b96162a274c and project c456fd996bb544478bdb39c6a7ca04a6. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:37:12.102838 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8c3a21f9-5722-401c-8d57-66cdbf508858 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:37:12.115142 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8c3a21f9-5722-401c-8d57-66cdbf508858 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:37:12.212194 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8c3a21f9-5722-401c-8d57-66cdbf508858 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.857990 Aug 04 16:37:12.213714 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 527/1103] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:37:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:37:12.220491 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-39d81be7-9e2c-4419-b714-a4657c18dd4a tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:12.221600 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-39d81be7-9e2c-4419-b714-a4657c18dd4a tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] [instance: 2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:12.233661 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39d81be7-9e2c-4419-b714-a4657c18dd4a tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:12.234413 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39d81be7-9e2c-4419-b714-a4657c18dd4a tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:12.236065 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39d81be7-9e2c-4419-b714-a4657c18dd4a tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:12.236711 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39d81be7-9e2c-4419-b714-a4657c18dd4a tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:12.884762 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-39d81be7-9e2c-4419-b714-a4657c18dd4a tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23645970a9a24e94b10b8578bb30b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5527cc7c4944c7898b64308f13b850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:12.917410 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-39d81be7-9e2c-4419-b714-a4657c18dd4a tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] 10.222.0.23 "GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88" status: 200 len: 1589 microversion: 2.1 time: 0.701796 Aug 04 16:37:12.918867 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 528/1104] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:12 2022] GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88 => generated 1589 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:12.924645 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b228dba4-fb5d-4313-b52e-47877d3ae5da tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-846466-12", "block_migration": true, "disk_over_commit": false}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:12.928074 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b228dba4-fb5d-4313-b52e-47877d3ae5da tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:12.936210 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b228dba4-fb5d-4313-b52e-47877d3ae5da tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:12.936986 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b228dba4-fb5d-4313-b52e-47877d3ae5da tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:12.938060 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b228dba4-fb5d-4313-b52e-47877d3ae5da tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:12.938815 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b228dba4-fb5d-4313-b52e-47877d3ae5da tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:12.974211 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-b228dba4-fb5d-4313-b52e-47877d3ae5da tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lazy-loading 'flavor' on Instance uuid b359364c-f234-4d01-9c08-e6df8a21f159 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:37:12.990407 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b228dba4-fb5d-4313-b52e-47877d3ae5da tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Going to try to live migrate instance to n-h2-846466-12 {{(pid=126126) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 16:37:14.983340 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-1f6f1ecd-f4d1-4f34-b9b6-dbce47f384d8 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] [instance: 4057c3fd-7edb-499b-8623-012b46ebd651] Building network info cache for instance {{(pid=126125) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 16:37:15.960235 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b228dba4-fb5d-4313-b52e-47877d3ae5da tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159/action" status: 202 len: 0 microversion: 2.1 time: 3.039822 Aug 04 16:37:15.963960 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 529/1105] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:37:12 2022] POST /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159/action => generated 0 bytes in 3043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:37:15.975232 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b81dfc62-b4ee-4209-8537-33e2a7e6d7ee tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:15.981264 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b81dfc62-b4ee-4209-8537-33e2a7e6d7ee tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:16.007542 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:37:16.028873 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b81dfc62-b4ee-4209-8537-33e2a7e6d7ee tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:16.033636 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b81dfc62-b4ee-4209-8537-33e2a7e6d7ee tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:16.037896 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b81dfc62-b4ee-4209-8537-33e2a7e6d7ee tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:16.042744 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b81dfc62-b4ee-4209-8537-33e2a7e6d7ee tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:16.790594 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b81dfc62-b4ee-4209-8537-33e2a7e6d7ee tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:16.814300 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b81dfc62-b4ee-4209-8537-33e2a7e6d7ee tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1337 microversion: 2.1 time: 0.848619 Aug 04 16:37:16.816955 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 530/1106] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:15 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1337 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:16.826250 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-23fa6451-b982-45c6-a7d8-2ada95c0da5e tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:16.829609 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-23fa6451-b982-45c6-a7d8-2ada95c0da5e tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] [instance: 2503f8ac-e7f9-432d-8b3b-271d1a179572] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:16.844902 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-23fa6451-b982-45c6-a7d8-2ada95c0da5e tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:16.845696 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-23fa6451-b982-45c6-a7d8-2ada95c0da5e tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:16.847067 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-23fa6451-b982-45c6-a7d8-2ada95c0da5e tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:16.847812 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-23fa6451-b982-45c6-a7d8-2ada95c0da5e tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:16.915096 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-23fa6451-b982-45c6-a7d8-2ada95c0da5e tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] 10.222.0.23 "GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096188 Aug 04 16:37:16.915979 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 531/1107] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 16:37:16 2022] GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:37:16.923586 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c521c147-ec68-4458-ad8d-05195c754e00 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:16.925065 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c521c147-ec68-4458-ad8d-05195c754e00 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: d238b9f3-e25b-4864-8b27-d53054d76082] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:16.938040 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c521c147-ec68-4458-ad8d-05195c754e00 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:16.939695 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c521c147-ec68-4458-ad8d-05195c754e00 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:16.941400 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c521c147-ec68-4458-ad8d-05195c754e00 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:16.942256 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c521c147-ec68-4458-ad8d-05195c754e00 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:16.953650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:37:17.412217 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-1f6f1ecd-f4d1-4f34-b9b6-dbce47f384d8 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] [instance: 4057c3fd-7edb-499b-8623-012b46ebd651] Updating instance_info_cache with network_info: [{"id": "4b8c1725-1b11-419e-ba1a-40030b1080ba", "address": "fa:16:3e:a7:74:32", "network": {"id": "c15511a6-c820-42c7-a327-7e19eb06873f", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1809180170-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a64446d297d1407d888376ebd3642216", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4b8c1725-1b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126125) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 16:37:17.498793 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f6f1ecd-f4d1-4f34-b9b6-dbce47f384d8 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Releasing lock "refresh_cache-4057c3fd-7edb-499b-8623-012b46ebd651" {{(pid=126125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 16:37:17.508011 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1f6f1ecd-f4d1-4f34-b9b6-dbce47f384d8 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] 10.222.0.23 "POST /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651/action" status: 202 len: 0 microversion: 2.1 time: 5.618829 Aug 04 16:37:17.522888 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 577/1108] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:37:11 2022] POST /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651/action => generated 0 bytes in 5632 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 04 16:37:17.539457 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-df547315-f27b-47aa-a956-e44c07e4159d tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:17.540505 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-df547315-f27b-47aa-a956-e44c07e4159d tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] [instance: 2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:17.563373 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c521c147-ec68-4458-ad8d-05195c754e00 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:17.564374 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df547315-f27b-47aa-a956-e44c07e4159d tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:17.569691 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df547315-f27b-47aa-a956-e44c07e4159d tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:17.574304 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df547315-f27b-47aa-a956-e44c07e4159d tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:17.575898 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df547315-f27b-47aa-a956-e44c07e4159d tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:17.585319 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c521c147-ec68-4458-ad8d-05195c754e00 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082" status: 200 len: 1523 microversion: 2.1 time: 0.667796 Aug 04 16:37:17.586760 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 532/1109] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:16 2022] GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082 => generated 1523 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:17.592352 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-9f4efc62-9fb4-47c7-91ae-78eeb79c0501 req-38718c6e-100f-4e63-a60e-95ffa8501e0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4057c3fd-7edb-499b-8623-012b46ebd651", "tag": "4b8c1725-1b11-419e-ba1a-40030b1080ba"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:17.613752 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-9f4efc62-9fb4-47c7-91ae-78eeb79c0501 req-38718c6e-100f-4e63-a60e-95ffa8501e0b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:17.614763 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-9f4efc62-9fb4-47c7-91ae-78eeb79c0501 req-38718c6e-100f-4e63-a60e-95ffa8501e0b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:17.639772 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-9f4efc62-9fb4-47c7-91ae-78eeb79c0501 req-38718c6e-100f-4e63-a60e-95ffa8501e0b service nova] Creating event network-changed:4b8c1725-1b11-419e-ba1a-40030b1080ba for instance 4057c3fd-7edb-499b-8623-012b46ebd651 on n-h2-846466-12 Aug 04 16:37:17.653820 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-9f4efc62-9fb4-47c7-91ae-78eeb79c0501 req-38718c6e-100f-4e63-a60e-95ffa8501e0b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065518 Aug 04 16:37:17.655905 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 533/1110] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:37:17.668696 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-795db45e-f6ce-40c1-909b-ce97401a9fe4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:17.673606 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-795db45e-f6ce-40c1-909b-ce97401a9fe4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:17.685837 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-795db45e-f6ce-40c1-909b-ce97401a9fe4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:17.686387 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-795db45e-f6ce-40c1-909b-ce97401a9fe4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:17.687264 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-795db45e-f6ce-40c1-909b-ce97401a9fe4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:17.688081 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-795db45e-f6ce-40c1-909b-ce97401a9fe4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:17.900073 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-df547315-f27b-47aa-a956-e44c07e4159d tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] 10.222.0.23 "GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.365460 Aug 04 16:37:17.903580 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 578/1111] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Aug 4 16:37:17 2022] GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88/os-interface => generated 284 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:37:18.213850 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-303ceb97-e430-4fa2-9879-c7c42fdd3549 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Action: 'create', calling method: .version_select at 0x7f7e8413a1f0>, body: {"keypair": {"name": "tempest-keypair-1611701469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBinmrnz37zS1Uh1c5T4KEFheaBV8UCsXeGfKp7z4B6aVG2kBGNO+d+9iNTpICAHfREOmier9KlLP7teq2k3DNOBa+U9OkS5qWDrZjZ3TKmWnGYrCirjX8Fd+pTUYc3NQ=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:18.282724 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-303ceb97-e430-4fa2-9879-c7c42fdd3549 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Getting quotas for project be487ee187864a0987113d1248a873ae. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:37:18.297304 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-303ceb97-e430-4fa2-9879-c7c42fdd3549 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Getting quotas for user c55bcf6e18a94d9781f840cb05a23abf and project be487ee187864a0987113d1248a873ae. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:37:18.339166 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-303ceb97-e430-4fa2-9879-c7c42fdd3549 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.430718 Aug 04 16:37:18.340204 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 579/1112] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 16:37:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:37:18.353043 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4aa90ccd-4b08-4052-8716-6466ea9eff94 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:18.354137 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4aa90ccd-4b08-4052-8716-6466ea9eff94 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] [instance: 2503f8ac-e7f9-432d-8b3b-271d1a179572] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:18.369464 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4aa90ccd-4b08-4052-8716-6466ea9eff94 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:18.370753 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4aa90ccd-4b08-4052-8716-6466ea9eff94 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:18.372497 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4aa90ccd-4b08-4052-8716-6466ea9eff94 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:18.373241 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4aa90ccd-4b08-4052-8716-6466ea9eff94 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:18.420179 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-795db45e-f6ce-40c1-909b-ce97401a9fe4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:18.443225 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-795db45e-f6ce-40c1-909b-ce97401a9fe4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159" status: 200 len: 1717 microversion: 2.1 time: 0.785177 Aug 04 16:37:18.450951 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 534/1113] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:17 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159 => generated 1717 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:18.470855 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f7da5003-13e4-493d-9d7b-3bcb0308bb90 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Action: 'create', calling method: .version_select at 0x7f7e84be78b0>, body: {"pool": "7059c2bd-3196-46e8-9859-a9efe4fcb75b"} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:18.575810 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-4aa90ccd-4b08-4052-8716-6466ea9eff94 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lazy-loading 'services' on Instance uuid 2503f8ac-e7f9-432d-8b3b-271d1a179572 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:37:18.722480 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4aa90ccd-4b08-4052-8716-6466ea9eff94 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572/os-volume_attachments/1735b12c-ddc8-46cf-8e16-8f9a5abedb28" status: 202 len: 0 microversion: 2.1 time: 0.378693 Aug 04 16:37:18.723227 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 580/1114] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Aug 4 16:37:18 2022] DELETE /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572/os-volume_attachments/1735b12c-ddc8-46cf-8e16-8f9a5abedb28 => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:37:18.741337 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ca390853-24c4-412a-b5c2-537266e80c78 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:18.742754 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ca390853-24c4-412a-b5c2-537266e80c78 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:18.761681 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ca390853-24c4-412a-b5c2-537266e80c78 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:18.762606 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ca390853-24c4-412a-b5c2-537266e80c78 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:18.764124 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ca390853-24c4-412a-b5c2-537266e80c78 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:18.764748 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ca390853-24c4-412a-b5c2-537266e80c78 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:19.711324 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ca390853-24c4-412a-b5c2-537266e80c78 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:19.728791 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ca390853-24c4-412a-b5c2-537266e80c78 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1379 microversion: 2.1 time: 1.002214 Aug 04 16:37:19.744398 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 581/1115] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:18 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1379 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:19.750659 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d9ca0559-6343-46c0-ae72-a6a8fb80cec4 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:19.751609 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d9ca0559-6343-46c0-ae72-a6a8fb80cec4 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: d238b9f3-e25b-4864-8b27-d53054d76082] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:19.783439 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d9ca0559-6343-46c0-ae72-a6a8fb80cec4 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:19.784224 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d9ca0559-6343-46c0-ae72-a6a8fb80cec4 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:19.785461 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d9ca0559-6343-46c0-ae72-a6a8fb80cec4 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:19.786083 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d9ca0559-6343-46c0-ae72-a6a8fb80cec4 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:20.791518 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d9ca0559-6343-46c0-ae72-a6a8fb80cec4 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:20.826720 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d9ca0559-6343-46c0-ae72-a6a8fb80cec4 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082" status: 200 len: 1523 microversion: 2.1 time: 1.082764 Aug 04 16:37:20.834801 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 582/1116] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:19 2022] GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082 => generated 1523 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:20.885875 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f56a82c4-3ccb-464e-8bb5-70b008e7ca29 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:20.898933 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f56a82c4-3ccb-464e-8bb5-70b008e7ca29 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:20.926362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f56a82c4-3ccb-464e-8bb5-70b008e7ca29 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:20.930021 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f56a82c4-3ccb-464e-8bb5-70b008e7ca29 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:20.932008 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f56a82c4-3ccb-464e-8bb5-70b008e7ca29 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:20.933113 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f56a82c4-3ccb-464e-8bb5-70b008e7ca29 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:22.024455 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=4 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:37:22.083058 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=12 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:37:22.118109 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f56a82c4-3ccb-464e-8bb5-70b008e7ca29 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:22.132185 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f56a82c4-3ccb-464e-8bb5-70b008e7ca29 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159" status: 200 len: 1717 microversion: 2.1 time: 1.264890 Aug 04 16:37:22.133653 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 583/1117] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:20 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159 => generated 1717 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:22.141687 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-96360ad9-2826-418f-822c-b295ca0a5f8b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:22.142472 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-96360ad9-2826-418f-822c-b295ca0a5f8b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:22.151889 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-96360ad9-2826-418f-822c-b295ca0a5f8b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:22.152663 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-96360ad9-2826-418f-822c-b295ca0a5f8b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:22.154346 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-96360ad9-2826-418f-822c-b295ca0a5f8b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:22.154986 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-96360ad9-2826-418f-822c-b295ca0a5f8b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:22.960736 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-96360ad9-2826-418f-822c-b295ca0a5f8b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:22.980605 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-96360ad9-2826-418f-822c-b295ca0a5f8b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1379 microversion: 2.1 time: 0.845090 Aug 04 16:37:22.982390 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 584/1118] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:22 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1379 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:22.997900 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fe8e4864-58ee-4a48-8fbe-351f4a5e80d6 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-756876235", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f68c1ad4-f878-4b9d-81cd-0074ed756adf"}], "security_groups": [{"name": "tempest-securitygroup--1861173129"}], "key_name": "tempest-keypair-1611701469", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:23.296860 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-fe8e4864-58ee-4a48-8fbe-351f4a5e80d6 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] validate_networks() for [('f68c1ad4-f878-4b9d-81cd-0074ed756adf', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:37:24.047904 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f7da5003-13e4-493d-9d7b-3bcb0308bb90 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.584843 Aug 04 16:37:24.049547 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 535/1119] 10.222.0.23 () {60 vars in 1170 bytes} [Thu Aug 4 16:37:18 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:37:24.060956 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-1384acad-f4bf-4340-8e7f-6bf9ce7f923e req-7009963c-176d-4e9d-aa95-8de624c846cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1430483-b3f7-473b-80f9-15beb90cfc33", "tag": "e435043b-4bd0-4a6c-98b0-1115388413c6"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:24.083092 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-1384acad-f4bf-4340-8e7f-6bf9ce7f923e req-7009963c-176d-4e9d-aa95-8de624c846cc service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:24.085460 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-1384acad-f4bf-4340-8e7f-6bf9ce7f923e req-7009963c-176d-4e9d-aa95-8de624c846cc service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:24.114999 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-1384acad-f4bf-4340-8e7f-6bf9ce7f923e req-7009963c-176d-4e9d-aa95-8de624c846cc service nova] Creating event network-changed:e435043b-4bd0-4a6c-98b0-1115388413c6 for instance d1430483-b3f7-473b-80f9-15beb90cfc33 on n-h2-846466-12 Aug 04 16:37:24.124230 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-1384acad-f4bf-4340-8e7f-6bf9ce7f923e req-7009963c-176d-4e9d-aa95-8de624c846cc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072455 Aug 04 16:37:24.128131 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 536/1120] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:37:24.134419 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-14633df0-c671-4596-91b0-6225a894f285 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:24.135144 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-14633df0-c671-4596-91b0-6225a894f285 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: d238b9f3-e25b-4864-8b27-d53054d76082] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:24.143024 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-14633df0-c671-4596-91b0-6225a894f285 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:24.143455 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-14633df0-c671-4596-91b0-6225a894f285 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:24.144434 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-14633df0-c671-4596-91b0-6225a894f285 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:24.144599 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-fe8e4864-58ee-4a48-8fbe-351f4a5e80d6 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Getting quotas for project be487ee187864a0987113d1248a873ae. Resources: dict_keys(['metadata_items']) {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:37:24.145051 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-14633df0-c671-4596-91b0-6225a894f285 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:24.153232 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-fe8e4864-58ee-4a48-8fbe-351f4a5e80d6 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Getting quotas for user c55bcf6e18a94d9781f840cb05a23abf and project be487ee187864a0987113d1248a873ae. Resources: dict_keys(['metadata_items']) {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:37:24.171857 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-fe8e4864-58ee-4a48-8fbe-351f4a5e80d6 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:37:24.173365 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-fe8e4864-58ee-4a48-8fbe-351f4a5e80d6 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:37:24.174106 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-fe8e4864-58ee-4a48-8fbe-351f4a5e80d6 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:37:24.174693 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-fe8e4864-58ee-4a48-8fbe-351f4a5e80d6 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:37:24.175324 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-fe8e4864-58ee-4a48-8fbe-351f4a5e80d6 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:37:24.187390 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fe8e4864-58ee-4a48-8fbe-351f4a5e80d6 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:24.187837 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fe8e4864-58ee-4a48-8fbe-351f4a5e80d6 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:24.188648 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fe8e4864-58ee-4a48-8fbe-351f4a5e80d6 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:24.189085 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fe8e4864-58ee-4a48-8fbe-351f4a5e80d6 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:24.214122 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-fe8e4864-58ee-4a48-8fbe-351f4a5e80d6 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Getting quotas for project be487ee187864a0987113d1248a873ae. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:37:24.222891 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-fe8e4864-58ee-4a48-8fbe-351f4a5e80d6 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Getting quotas for user c55bcf6e18a94d9781f840cb05a23abf and project be487ee187864a0987113d1248a873ae. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:37:24.257651 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fe8e4864-58ee-4a48-8fbe-351f4a5e80d6 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:37:24.260806 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fe8e4864-58ee-4a48-8fbe-351f4a5e80d6 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] [instance: 121a11b7-b8e0-4232-a03b-1399ef2d387f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:37:24.306101 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:37:24.344397 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fe8e4864-58ee-4a48-8fbe-351f4a5e80d6 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.358946 Aug 04 16:37:24.349646 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 585/1121] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:37:22 2022] POST /compute/v2.1/servers => generated 407 bytes in 1366 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:37:24.355890 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8c53fd60-beb4-4786-9ee8-8368da353153 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:24.358049 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8c53fd60-beb4-4786-9ee8-8368da353153 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:24.365851 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8c53fd60-beb4-4786-9ee8-8368da353153 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:24.366843 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8c53fd60-beb4-4786-9ee8-8368da353153 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:24.368027 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8c53fd60-beb4-4786-9ee8-8368da353153 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:24.368885 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8c53fd60-beb4-4786-9ee8-8368da353153 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:24.596409 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-14633df0-c671-4596-91b0-6225a894f285 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:24.606491 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-14633df0-c671-4596-91b0-6225a894f285 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082" status: 200 len: 1523 microversion: 2.1 time: 0.477029 Aug 04 16:37:24.624001 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 537/1122] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:24 2022] GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082 => generated 1523 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:24.644850 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-60268f30-b698-4b20-b8c9-8f88baf02f01 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:24.649876 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-60268f30-b698-4b20-b8c9-8f88baf02f01 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] [instance: 2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:24.663406 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-60268f30-b698-4b20-b8c9-8f88baf02f01 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:24.666170 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-60268f30-b698-4b20-b8c9-8f88baf02f01 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:24.667183 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-60268f30-b698-4b20-b8c9-8f88baf02f01 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:24.667688 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-60268f30-b698-4b20-b8c9-8f88baf02f01 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:24.944491 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8c53fd60-beb4-4786-9ee8-8368da353153 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:24.987788 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8c53fd60-beb4-4786-9ee8-8368da353153 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159" status: 200 len: 1717 microversion: 2.1 time: 0.636240 Aug 04 16:37:24.989229 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 586/1123] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:24 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159 => generated 1717 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:25.005502 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-32fd2437-e639-47e7-a673-039feff97256 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:25.007303 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-32fd2437-e639-47e7-a673-039feff97256 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:25.030485 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-32fd2437-e639-47e7-a673-039feff97256 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:25.031607 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-32fd2437-e639-47e7-a673-039feff97256 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:25.034157 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-32fd2437-e639-47e7-a673-039feff97256 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:25.037989 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-32fd2437-e639-47e7-a673-039feff97256 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:25.459875 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-60268f30-b698-4b20-b8c9-8f88baf02f01 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23645970a9a24e94b10b8578bb30b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5527cc7c4944c7898b64308f13b850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:25.474241 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-60268f30-b698-4b20-b8c9-8f88baf02f01 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] 10.222.0.23 "GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88" status: 200 len: 1589 microversion: 2.1 time: 0.848723 Aug 04 16:37:25.474999 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 538/1124] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:24 2022] GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88 => generated 1589 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:25.484996 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e5619a2b-c1ac-4f38-a213-268cf463a331 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.103"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:25.496320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e5619a2b-c1ac-4f38-a213-268cf463a331 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] [instance: 4057c3fd-7edb-499b-8623-012b46ebd651] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:25.513725 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5619a2b-c1ac-4f38-a213-268cf463a331 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:25.514157 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5619a2b-c1ac-4f38-a213-268cf463a331 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:25.515432 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5619a2b-c1ac-4f38-a213-268cf463a331 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:25.515869 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5619a2b-c1ac-4f38-a213-268cf463a331 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:25.559425 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5619a2b-c1ac-4f38-a213-268cf463a331 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Acquired lock "refresh_cache-4057c3fd-7edb-499b-8623-012b46ebd651" {{(pid=126126) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 16:37:25.704182 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-32fd2437-e639-47e7-a673-039feff97256 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:25.732194 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-32fd2437-e639-47e7-a673-039feff97256 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1379 microversion: 2.1 time: 0.739141 Aug 04 16:37:25.736750 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 587/1125] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:24 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1379 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:25.747973 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1f7df9c4-c308-493e-91c6-d9d79761bb53 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:25.750484 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1f7df9c4-c308-493e-91c6-d9d79761bb53 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] [instance: 121a11b7-b8e0-4232-a03b-1399ef2d387f] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:25.765510 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f7df9c4-c308-493e-91c6-d9d79761bb53 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:25.767317 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f7df9c4-c308-493e-91c6-d9d79761bb53 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:25.769054 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f7df9c4-c308-493e-91c6-d9d79761bb53 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:25.770199 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f7df9c4-c308-493e-91c6-d9d79761bb53 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:25.929697 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1f7df9c4-c308-493e-91c6-d9d79761bb53 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c55bcf6e18a94d9781f840cb05a23abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be487ee187864a0987113d1248a873ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:25.944112 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1f7df9c4-c308-493e-91c6-d9d79761bb53 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] 10.222.0.23 "GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f" status: 200 len: 1321 microversion: 2.1 time: 0.205227 Aug 04 16:37:25.946266 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 588/1126] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:25 2022] GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:25.955262 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a3103251-a380-41ea-a13b-5c98c5a0cddd tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:25.956875 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a3103251-a380-41ea-a13b-5c98c5a0cddd tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: d238b9f3-e25b-4864-8b27-d53054d76082] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:25.970075 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a3103251-a380-41ea-a13b-5c98c5a0cddd tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:25.970506 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a3103251-a380-41ea-a13b-5c98c5a0cddd tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:25.971476 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a3103251-a380-41ea-a13b-5c98c5a0cddd tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:25.972076 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a3103251-a380-41ea-a13b-5c98c5a0cddd tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:26.967140 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a3103251-a380-41ea-a13b-5c98c5a0cddd tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:26.977362 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a3103251-a380-41ea-a13b-5c98c5a0cddd tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082" status: 200 len: 1523 microversion: 2.1 time: 1.029540 Aug 04 16:37:26.978427 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 589/1127] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:25 2022] GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082 => generated 1523 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:26.995544 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9aaf8210-3a2e-4ce5-8705-32613e634e30 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:26.996141 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9aaf8210-3a2e-4ce5-8705-32613e634e30 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:27.004239 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9aaf8210-3a2e-4ce5-8705-32613e634e30 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:27.004683 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9aaf8210-3a2e-4ce5-8705-32613e634e30 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:27.005678 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9aaf8210-3a2e-4ce5-8705-32613e634e30 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:27.006270 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9aaf8210-3a2e-4ce5-8705-32613e634e30 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:27.045648 n-d-846466-12 devstack@n-api.service[126126]: DEBUG neutronclient.v2_0.client [None req-e5619a2b-c1ac-4f38-a213-268cf463a331 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.6.103 (d933a2dd-c73e-478b-bc50-943a7212e44a) with port 4b8c1725-1b11-419e-ba1a-40030b1080ba using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 7059c2bd-3196-46e8-9859-a9efe4fcb75b.", "detail": ""}} {{(pid=126126) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:37:27.047252 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5619a2b-c1ac-4f38-a213-268cf463a331 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Releasing lock "refresh_cache-4057c3fd-7edb-499b-8623-012b46ebd651" {{(pid=126126) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 16:37:27.048791 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-e5619a2b-c1ac-4f38-a213-268cf463a331 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] HTTP exception thrown: Cannot associate floating IP 172.25.6.103 (d933a2dd-c73e-478b-bc50-943a7212e44a) with port 4b8c1725-1b11-419e-ba1a-40030b1080ba using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 7059c2bd-3196-46e8-9859-a9efe4fcb75b. Aug 04 16:37:27.048791 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-c9b5764d-26da-404d-9719-1a0b426f1c9e'] Aug 04 16:37:27.055938 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e5619a2b-c1ac-4f38-a213-268cf463a331 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Request method failure captured: Aug 04 16:37:27.055938 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651/action HTTP/1.1 Aug 04 16:37:27.055938 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:37:27.055938 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:37:27.055938 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:37:27.055938 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 46 Aug 04 16:37:27.055938 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:37:27.055938 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:37:27.055938 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:37:27.055938 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:37:27.055938 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_WXeR5P1378OpHSUhHA08p94oJyeqJjq9Rmn76J7sY4kRTwpoEdr5yQ8C9d4ilK1F15kmT2fGPk_HGKgT0bbobQ-UCWVQWrl6b4Gkq67PPkdS6nm2t_cDvvwvN49YM27zBpMwpLUv089VgbOr3xyQjXpCMsSrNl7CuLtGkn9EPKJuA Aug 04 16:37:27.055938 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:37:27.055938 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:37:27.055938 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:37:27.055938 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:37:27.055938 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:37:27.055938 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:37:27.055938 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: a64446d297d1407d888376ebd3642216 Aug 04 16:37:27.055938 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 Aug 04 16:37:27.055938 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:37:27.055938 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:37:27.057817 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a64446d297d1407d888376ebd3642216"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a64446d297d1407d888376ebd3642216"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a64446d297d1407d888376ebd3642216"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a64446d297d1407d888376ebd3642216"}]}] Aug 04 16:37:27.057817 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 Aug 04 16:37:27.057817 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: a64446d297d1407d888376ebd3642216 Aug 04 16:37:27.057817 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 Aug 04 16:37:27.057817 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project Aug 04 16:37:27.057817 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:37:27.057817 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:37:27.057817 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: a2b193211a2243bc90299e112dd3cc26 Aug 04 16:37:27.057817 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project Aug 04 16:37:27.057817 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 16:37:27.057817 n-d-846466-12 devstack@n-api.service[126126]: {"addFloatingIp": {"address": "172.25.6.103"}} Aug 04 16:37:27.057817 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:37:27.058849 n-d-846466-12 devstack@n-api.service[126126]: exception: Cannot associate floating IP 172.25.6.103 (d933a2dd-c73e-478b-bc50-943a7212e44a) with port 4b8c1725-1b11-419e-ba1a-40030b1080ba using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 7059c2bd-3196-46e8-9859-a9efe4fcb75b. Aug 04 16:37:27.058849 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-c9b5764d-26da-404d-9719-1a0b426f1c9e'] Aug 04 16:37:27.058849 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '4057c3fd-7edb-499b-8623-012b46ebd651', 'body': {'addFloatingIp': {'address': '172.25.6.103'}}} Aug 04 16:37:27.058849 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:37:27.058849 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:37:27.058849 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Aug 04 16:37:27.058849 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 04 16:37:27.058849 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:37:27.058849 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:37:27.058849 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 04 16:37:27.058849 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 04 16:37:27.058849 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:37:27.058849 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:37:27.058849 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 04 16:37:27.058849 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 04 16:37:27.058849 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:37:27.058849 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:37:27.060376 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 04 16:37:27.060376 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 04 16:37:27.060376 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:37:27.060376 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:37:27.060376 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:37:27.060376 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:37:27.060376 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:37:27.060376 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:37:27.060376 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:37:27.060376 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:37:27.060376 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:37:27.060376 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:37:27.060376 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:37:27.060376 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:37:27.060376 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:37:27.060376 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:37:27.062969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.6.103 (d933a2dd-c73e-478b-bc50-943a7212e44a) with port 4b8c1725-1b11-419e-ba1a-40030b1080ba using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 7059c2bd-3196-46e8-9859-a9efe4fcb75b. Aug 04 16:37:27.062969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9b5764d-26da-404d-9719-1a0b426f1c9e'] Aug 04 16:37:27.062969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:37:27.062969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:37:27.062969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:37:27.062969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:37:27.062969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 04 16:37:27.062969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 04 16:37:27.062969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 04 16:37:27.062969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 04 16:37:27.062969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Aug 04 16:37:27.062969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 04 16:37:27.062969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.6.103 (d933a2dd-c73e-478b-bc50-943a7212e44a) with port 4b8c1725-1b11-419e-ba1a-40030b1080ba using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 7059c2bd-3196-46e8-9859-a9efe4fcb75b. Aug 04 16:37:27.062969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9b5764d-26da-404d-9719-1a0b426f1c9e'] Aug 04 16:37:27.062969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:37:27.062969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:37:27.064964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:37:27.064964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:37:27.064964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:37:27.064964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:37:27.064964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:37:27.064964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:37:27.064964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:37:27.064964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:37:27.064964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:37:27.064964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:37:27.064964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:37:27.064964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:37:27.064964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 04 16:37:27.064964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 16:37:27.064964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.6.103 (d933a2dd-c73e-478b-bc50-943a7212e44a) with port 4b8c1725-1b11-419e-ba1a-40030b1080ba using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 7059c2bd-3196-46e8-9859-a9efe4fcb75b. Aug 04 16:37:27.064964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9b5764d-26da-404d-9719-1a0b426f1c9e'] Aug 04 16:37:27.064964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:37:27.064964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:37:27.067742 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:37:27.067742 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:37:27.067742 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:37:27.067742 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:37:27.067742 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:37:27.067742 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:37:27.067742 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.6.103 (d933a2dd-c73e-478b-bc50-943a7212e44a) with port 4b8c1725-1b11-419e-ba1a-40030b1080ba using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 7059c2bd-3196-46e8-9859-a9efe4fcb75b. Aug 04 16:37:27.067742 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9b5764d-26da-404d-9719-1a0b426f1c9e'] Aug 04 16:37:27.067742 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:37:27.067742 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e5619a2b-c1ac-4f38-a213-268cf463a331 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Returning 400 to user: Cannot associate floating IP 172.25.6.103 (d933a2dd-c73e-478b-bc50-943a7212e44a) with port 4b8c1725-1b11-419e-ba1a-40030b1080ba using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 7059c2bd-3196-46e8-9859-a9efe4fcb75b. Aug 04 16:37:27.067742 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-c9b5764d-26da-404d-9719-1a0b426f1c9e'] {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:37:27.069117 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e5619a2b-c1ac-4f38-a213-268cf463a331 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] 10.222.0.23 "POST /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651/action" status: 400 len: 381 microversion: 2.1 time: 1.590965 Aug 04 16:37:27.070085 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 539/1128] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:37:25 2022] POST /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651/action => generated 381 bytes in 1595 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:37:27.081155 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-67a1b4a0-94b0-4e81-a653-6d99f85bc902 req-1d3f0fc7-7111-4c00-81e6-33aeb3a4da62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88", "tag": "04a72ae1-98a2-4e1f-9e4c-91b9c892ac34"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:27.102160 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-67a1b4a0-94b0-4e81-a653-6d99f85bc902 req-1d3f0fc7-7111-4c00-81e6-33aeb3a4da62 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:27.103395 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-67a1b4a0-94b0-4e81-a653-6d99f85bc902 req-1d3f0fc7-7111-4c00-81e6-33aeb3a4da62 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:27.124702 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-67a1b4a0-94b0-4e81-a653-6d99f85bc902 req-1d3f0fc7-7111-4c00-81e6-33aeb3a4da62 service nova] Creating event network-changed:04a72ae1-98a2-4e1f-9e4c-91b9c892ac34 for instance 2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88 on n-h1-846466-12 Aug 04 16:37:27.135539 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-67a1b4a0-94b0-4e81-a653-6d99f85bc902 req-1d3f0fc7-7111-4c00-81e6-33aeb3a4da62 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061581 Aug 04 16:37:27.138515 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 540/1129] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:37:27.151811 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0ff8cb31-0597-4871-96c8-13061b5f984f tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:27.157458 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0ff8cb31-0597-4871-96c8-13061b5f984f tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] [instance: 2503f8ac-e7f9-432d-8b3b-271d1a179572] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:27.173223 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0ff8cb31-0597-4871-96c8-13061b5f984f tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:27.174437 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0ff8cb31-0597-4871-96c8-13061b5f984f tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:27.175812 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0ff8cb31-0597-4871-96c8-13061b5f984f tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:27.176793 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0ff8cb31-0597-4871-96c8-13061b5f984f tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:27.239300 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0ff8cb31-0597-4871-96c8-13061b5f984f tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] 10.222.0.23 "GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.098108 Aug 04 16:37:27.240860 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 541/1130] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 16:37:27 2022] GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572/os-volume_attachments => generated 25 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:37:27.273912 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-43918cd6-b4d5-48d0-9a53-21a61675d8dd tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:27.274986 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-43918cd6-b4d5-48d0-9a53-21a61675d8dd tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:27.294980 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-43918cd6-b4d5-48d0-9a53-21a61675d8dd tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:27.296156 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-43918cd6-b4d5-48d0-9a53-21a61675d8dd tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:27.298070 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-43918cd6-b4d5-48d0-9a53-21a61675d8dd tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:27.301316 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-43918cd6-b4d5-48d0-9a53-21a61675d8dd tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:27.387778 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9aaf8210-3a2e-4ce5-8705-32613e634e30 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:27.404952 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9aaf8210-3a2e-4ce5-8705-32613e634e30 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159" status: 200 len: 1717 microversion: 2.1 time: 0.413410 Aug 04 16:37:27.405976 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 590/1131] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:26 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159 => generated 1717 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:27.414692 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-87c1f5b9-892c-4ccd-8fc7-5a6095b1ca7a tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:27.418383 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-87c1f5b9-892c-4ccd-8fc7-5a6095b1ca7a tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] [instance: 121a11b7-b8e0-4232-a03b-1399ef2d387f] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:27.451821 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-87c1f5b9-892c-4ccd-8fc7-5a6095b1ca7a tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:27.452627 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-87c1f5b9-892c-4ccd-8fc7-5a6095b1ca7a tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:27.454540 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-87c1f5b9-892c-4ccd-8fc7-5a6095b1ca7a tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:27.455314 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-87c1f5b9-892c-4ccd-8fc7-5a6095b1ca7a tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:27.646066 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-87c1f5b9-892c-4ccd-8fc7-5a6095b1ca7a tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c55bcf6e18a94d9781f840cb05a23abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be487ee187864a0987113d1248a873ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:27.673995 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-87c1f5b9-892c-4ccd-8fc7-5a6095b1ca7a tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] 10.222.0.23 "GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f" status: 200 len: 1327 microversion: 2.1 time: 0.264375 Aug 04 16:37:27.679954 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 591/1132] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:27 2022] GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f => generated 1327 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:27.694398 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fa3e0230-3b95-4235-a446-3c3d46adf7a0 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Calling method '.version_select at 0x7f7e841ae670>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:28.098249 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-43918cd6-b4d5-48d0-9a53-21a61675d8dd tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:28.112691 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-43918cd6-b4d5-48d0-9a53-21a61675d8dd tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1379 microversion: 2.1 time: 0.870565 Aug 04 16:37:28.119997 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 542/1133] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:27 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1379 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:28.132604 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bcf9f965-57b0-4c5e-83a8-ed9ff96b70fc tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:28.136890 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bcf9f965-57b0-4c5e-83a8-ed9ff96b70fc tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] [instance: 2503f8ac-e7f9-432d-8b3b-271d1a179572] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:28.159055 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bcf9f965-57b0-4c5e-83a8-ed9ff96b70fc tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:28.161833 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bcf9f965-57b0-4c5e-83a8-ed9ff96b70fc tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:28.163311 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bcf9f965-57b0-4c5e-83a8-ed9ff96b70fc tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:28.164219 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bcf9f965-57b0-4c5e-83a8-ed9ff96b70fc tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:28.245306 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bcf9f965-57b0-4c5e-83a8-ed9ff96b70fc tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] 10.222.0.23 "GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.123019 Aug 04 16:37:28.247458 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 543/1134] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 16:37:28 2022] GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572/os-volume_attachments => generated 25 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:37:28.276819 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f7b78b8a-7120-4f82-a0a2-b4033e373f41 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:28.278059 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f7b78b8a-7120-4f82-a0a2-b4033e373f41 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: d238b9f3-e25b-4864-8b27-d53054d76082] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:28.298343 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f7b78b8a-7120-4f82-a0a2-b4033e373f41 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:28.299514 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f7b78b8a-7120-4f82-a0a2-b4033e373f41 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:28.301258 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f7b78b8a-7120-4f82-a0a2-b4033e373f41 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:28.302397 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f7b78b8a-7120-4f82-a0a2-b4033e373f41 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:29.233336 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f7b78b8a-7120-4f82-a0a2-b4033e373f41 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:29.247779 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f7b78b8a-7120-4f82-a0a2-b4033e373f41 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082" status: 200 len: 1523 microversion: 2.1 time: 0.997849 Aug 04 16:37:29.249720 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 544/1135] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:28 2022] GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082 => generated 1523 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:29.265498 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e956f188-47dc-460e-bfa6-a0994d445914 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:29.266815 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e956f188-47dc-460e-bfa6-a0994d445914 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] [instance: 2503f8ac-e7f9-432d-8b3b-271d1a179572] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:29.281919 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e956f188-47dc-460e-bfa6-a0994d445914 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:29.283479 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e956f188-47dc-460e-bfa6-a0994d445914 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:29.285142 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e956f188-47dc-460e-bfa6-a0994d445914 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:29.286173 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e956f188-47dc-460e-bfa6-a0994d445914 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:29.350694 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e956f188-47dc-460e-bfa6-a0994d445914 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] [instance: 2503f8ac-e7f9-432d-8b3b-271d1a179572] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:37:29.545928 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e956f188-47dc-460e-bfa6-a0994d445914 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572" status: 204 len: 0 microversion: 2.1 time: 0.289953 Aug 04 16:37:29.549966 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 545/1136] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:37:29 2022] DELETE /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:37:29.567493 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-22407872-294b-41ac-96cb-46e66fb63c4a tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:29.568277 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-22407872-294b-41ac-96cb-46e66fb63c4a tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:29.579494 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-22407872-294b-41ac-96cb-46e66fb63c4a tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:29.580433 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-22407872-294b-41ac-96cb-46e66fb63c4a tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:29.583370 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-22407872-294b-41ac-96cb-46e66fb63c4a tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:29.583370 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-22407872-294b-41ac-96cb-46e66fb63c4a tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:30.204301 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-22407872-294b-41ac-96cb-46e66fb63c4a tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:30.220685 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-22407872-294b-41ac-96cb-46e66fb63c4a tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159" status: 200 len: 1717 microversion: 2.1 time: 0.664105 Aug 04 16:37:30.223279 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 546/1137] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:29 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159 => generated 1717 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:30.232726 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-25df65e8-3122-434f-8a8e-e35532fc8917 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:30.234198 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-25df65e8-3122-434f-8a8e-e35532fc8917 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] [instance: 121a11b7-b8e0-4232-a03b-1399ef2d387f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:30.258761 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-25df65e8-3122-434f-8a8e-e35532fc8917 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:30.260066 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-25df65e8-3122-434f-8a8e-e35532fc8917 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:30.276430 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-25df65e8-3122-434f-8a8e-e35532fc8917 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:30.277699 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-25df65e8-3122-434f-8a8e-e35532fc8917 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:30.820737 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-25df65e8-3122-434f-8a8e-e35532fc8917 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c55bcf6e18a94d9781f840cb05a23abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be487ee187864a0987113d1248a873ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:30.836650 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-25df65e8-3122-434f-8a8e-e35532fc8917 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] 10.222.0.23 "GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f" status: 200 len: 1395 microversion: 2.1 time: 0.611069 Aug 04 16:37:30.837939 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 547/1138] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:30 2022] GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f => generated 1395 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:30.849033 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d18b3cc7-b0c2-4494-93f9-d088a1994856 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:30.850829 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d18b3cc7-b0c2-4494-93f9-d088a1994856 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:30.865925 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d18b3cc7-b0c2-4494-93f9-d088a1994856 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:30.867298 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d18b3cc7-b0c2-4494-93f9-d088a1994856 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:30.868810 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d18b3cc7-b0c2-4494-93f9-d088a1994856 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:30.869972 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d18b3cc7-b0c2-4494-93f9-d088a1994856 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:31.311051 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fa3e0230-3b95-4235-a446-3c3d46adf7a0 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/d933a2dd-c73e-478b-bc50-943a7212e44a" status: 202 len: 0 microversion: 2.1 time: 3.627165 Aug 04 16:37:31.319672 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 592/1139] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Aug 4 16:37:27 2022] DELETE /compute/v2.1/os-floating-ips/d933a2dd-c73e-478b-bc50-943a7212e44a => generated 0 bytes in 3638 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:37:31.325218 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-84b27539-c4c2-495d-8689-73ee9a78eb5f tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:31.330163 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-84b27539-c4c2-495d-8689-73ee9a78eb5f tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] [instance: 2503f8ac-e7f9-432d-8b3b-271d1a179572] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:31.338379 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-84b27539-c4c2-495d-8689-73ee9a78eb5f tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:31.339196 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-84b27539-c4c2-495d-8689-73ee9a78eb5f tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:31.341874 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-84b27539-c4c2-495d-8689-73ee9a78eb5f tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:31.342501 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-84b27539-c4c2-495d-8689-73ee9a78eb5f tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:31.593809 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d18b3cc7-b0c2-4494-93f9-d088a1994856 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:31.611233 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d18b3cc7-b0c2-4494-93f9-d088a1994856 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1379 microversion: 2.1 time: 0.769843 Aug 04 16:37:31.629480 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 548/1140] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:30 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1379 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:31.629480 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-c3e11aba-59a7-4a46-94e7-3eaf02e8df18 req-85087e3b-034e-4a41-b13e-25fd5cd45245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1430483-b3f7-473b-80f9-15beb90cfc33", "name": "network-vif-plugged", "status": "completed", "tag": "e435043b-4bd0-4a6c-98b0-1115388413c6"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:31.642566 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-c3e11aba-59a7-4a46-94e7-3eaf02e8df18 req-85087e3b-034e-4a41-b13e-25fd5cd45245 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:31.643312 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-c3e11aba-59a7-4a46-94e7-3eaf02e8df18 req-85087e3b-034e-4a41-b13e-25fd5cd45245 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:31.670997 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-c3e11aba-59a7-4a46-94e7-3eaf02e8df18 req-85087e3b-034e-4a41-b13e-25fd5cd45245 service nova] Creating event network-vif-plugged:e435043b-4bd0-4a6c-98b0-1115388413c6 for instance d1430483-b3f7-473b-80f9-15beb90cfc33 on n-h2-846466-12 Aug 04 16:37:31.677219 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-c3e11aba-59a7-4a46-94e7-3eaf02e8df18 req-85087e3b-034e-4a41-b13e-25fd5cd45245 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062355 Aug 04 16:37:31.680672 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 549/1141] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:37:31.687662 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-77114ef7-0029-4a7d-adb9-63f21f6b8b76 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:31.688367 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-77114ef7-0029-4a7d-adb9-63f21f6b8b76 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: d238b9f3-e25b-4864-8b27-d53054d76082] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:31.708851 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-77114ef7-0029-4a7d-adb9-63f21f6b8b76 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:31.711679 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-77114ef7-0029-4a7d-adb9-63f21f6b8b76 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:31.713921 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-77114ef7-0029-4a7d-adb9-63f21f6b8b76 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:31.716702 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-77114ef7-0029-4a7d-adb9-63f21f6b8b76 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:31.798942 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-84b27539-c4c2-495d-8689-73ee9a78eb5f tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5f11c99c841c4a7e7af4d7a4a5d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa4a23e6e71405f82347cd1cbbe3f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:31.803467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:37:31.820129 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-84b27539-c4c2-495d-8689-73ee9a78eb5f tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] 10.222.0.23 "GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572" status: 200 len: 1680 microversion: 2.1 time: 0.498903 Aug 04 16:37:31.821693 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 593/1142] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:31 2022] GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572 => generated 1680 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:31.831268 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f63adf3a-a08a-49e5-ad42-16deb69a7fd6 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:31.832792 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f63adf3a-a08a-49e5-ad42-16deb69a7fd6 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:31.863617 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f63adf3a-a08a-49e5-ad42-16deb69a7fd6 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:31.864894 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f63adf3a-a08a-49e5-ad42-16deb69a7fd6 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:31.869178 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f63adf3a-a08a-49e5-ad42-16deb69a7fd6 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:31.870254 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f63adf3a-a08a-49e5-ad42-16deb69a7fd6 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:32.421829 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-77114ef7-0029-4a7d-adb9-63f21f6b8b76 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:32.437044 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-77114ef7-0029-4a7d-adb9-63f21f6b8b76 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082" status: 200 len: 1523 microversion: 2.1 time: 0.754687 Aug 04 16:37:32.439125 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 550/1143] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:31 2022] GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082 => generated 1523 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:32.448960 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5502faee-7fe3-4114-ab15-fb5c75ca6520 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:32.451697 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5502faee-7fe3-4114-ab15-fb5c75ca6520 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:32.467680 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5502faee-7fe3-4114-ab15-fb5c75ca6520 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:32.468331 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5502faee-7fe3-4114-ab15-fb5c75ca6520 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:32.469776 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5502faee-7fe3-4114-ab15-fb5c75ca6520 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:32.470947 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5502faee-7fe3-4114-ab15-fb5c75ca6520 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:32.476614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:37:32.506761 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-f63adf3a-a08a-49e5-ad42-16deb69a7fd6 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lazy-loading 'services' on Instance uuid 5021f3f8-aa8b-4c94-8846-fdd1081135f5 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:37:32.539183 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f63adf3a-a08a-49e5-ad42-16deb69a7fd6 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 2347 microversion: 2.25 time: 0.715229 Aug 04 16:37:32.540263 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 594/1144] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:37:31 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 2347 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:37:32.550034 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1e15182f-593d-4d0c-9d5e-4c1176528138 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.96"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:32.956515 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5502faee-7fe3-4114-ab15-fb5c75ca6520 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:32.970147 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5502faee-7fe3-4114-ab15-fb5c75ca6520 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159" status: 200 len: 1717 microversion: 2.1 time: 0.529081 Aug 04 16:37:32.985805 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 551/1145] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:32 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159 => generated 1717 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:33.000183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1e15182f-593d-4d0c-9d5e-4c1176528138 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] [instance: 4057c3fd-7edb-499b-8623-012b46ebd651] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:33.003508 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f885b7d8-5b67-43f1-a39b-f361a0f5f255 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:33.004652 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f885b7d8-5b67-43f1-a39b-f361a0f5f255 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] [instance: 121a11b7-b8e0-4232-a03b-1399ef2d387f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:33.021703 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f885b7d8-5b67-43f1-a39b-f361a0f5f255 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:33.022620 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f885b7d8-5b67-43f1-a39b-f361a0f5f255 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:33.023786 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1e15182f-593d-4d0c-9d5e-4c1176528138 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:33.024059 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f885b7d8-5b67-43f1-a39b-f361a0f5f255 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:33.024721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f885b7d8-5b67-43f1-a39b-f361a0f5f255 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:33.024896 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1e15182f-593d-4d0c-9d5e-4c1176528138 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:33.026388 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1e15182f-593d-4d0c-9d5e-4c1176528138 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:33.027697 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1e15182f-593d-4d0c-9d5e-4c1176528138 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:33.647977 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f885b7d8-5b67-43f1-a39b-f361a0f5f255 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c55bcf6e18a94d9781f840cb05a23abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be487ee187864a0987113d1248a873ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:33.661041 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f885b7d8-5b67-43f1-a39b-f361a0f5f255 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] 10.222.0.23 "GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f" status: 200 len: 1395 microversion: 2.1 time: 0.673163 Aug 04 16:37:33.662500 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 552/1146] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:32 2022] GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f => generated 1395 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:33.670795 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2eb9fe6a-581f-4da8-b995-b6d64b20e7c6 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:33.675692 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:37:33.675692 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:37:33.677790 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2eb9fe6a-581f-4da8-b995-b6d64b20e7c6 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:33.678292 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2eb9fe6a-581f-4da8-b995-b6d64b20e7c6 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:33.679914 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2eb9fe6a-581f-4da8-b995-b6d64b20e7c6 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:33.680679 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2eb9fe6a-581f-4da8-b995-b6d64b20e7c6 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:33.726107 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2eb9fe6a-581f-4da8-b995-b6d64b20e7c6 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.061988 Aug 04 16:37:33.731908 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 553/1147] 10.222.0.23 () {60 vars in 1217 bytes} [Thu Aug 4 16:37:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:37:33.734495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4946dac3-24a9-4837-9999-118ea96c4558 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:33.734666 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1e15182f-593d-4d0c-9d5e-4c1176528138 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Acquired lock "refresh_cache-4057c3fd-7edb-499b-8623-012b46ebd651" {{(pid=126125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 16:37:33.735410 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4946dac3-24a9-4837-9999-118ea96c4558 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:33.749779 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4946dac3-24a9-4837-9999-118ea96c4558 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:33.750534 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4946dac3-24a9-4837-9999-118ea96c4558 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:33.751869 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4946dac3-24a9-4837-9999-118ea96c4558 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:33.752774 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4946dac3-24a9-4837-9999-118ea96c4558 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:34.199883 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:37:34.232575 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=14 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:37:34.307453 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4946dac3-24a9-4837-9999-118ea96c4558 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:34.338192 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4946dac3-24a9-4837-9999-118ea96c4558 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1379 microversion: 2.1 time: 0.608820 Aug 04 16:37:34.340392 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 554/1148] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:33 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1379 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:34.353510 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5a677f5b-188d-4bcd-a387-8bdf46d0654b tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:34.354809 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5a677f5b-188d-4bcd-a387-8bdf46d0654b tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] [instance: 2503f8ac-e7f9-432d-8b3b-271d1a179572] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:34.369576 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a677f5b-188d-4bcd-a387-8bdf46d0654b tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:34.370493 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a677f5b-188d-4bcd-a387-8bdf46d0654b tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:34.372572 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a677f5b-188d-4bcd-a387-8bdf46d0654b tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:34.374025 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a677f5b-188d-4bcd-a387-8bdf46d0654b tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:34.881669 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5a677f5b-188d-4bcd-a387-8bdf46d0654b tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5f11c99c841c4a7e7af4d7a4a5d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa4a23e6e71405f82347cd1cbbe3f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:34.934861 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5a677f5b-188d-4bcd-a387-8bdf46d0654b tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] 10.222.0.23 "GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572" status: 200 len: 1613 microversion: 2.1 time: 0.589926 Aug 04 16:37:34.962762 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 555/1149] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:34 2022] GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572 => generated 1613 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:34.989241 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-4e93a054-4d80-4a6d-857a-7cc2b5111a72 req-c6291102-1338-4d89-98e4-894db796ec5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "121a11b7-b8e0-4232-a03b-1399ef2d387f", "tag": "c9ddc57c-cecd-45c7-8bc9-495ab0624e7e"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:35.018802 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-4e93a054-4d80-4a6d-857a-7cc2b5111a72 req-c6291102-1338-4d89-98e4-894db796ec5c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:35.039773 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-4e93a054-4d80-4a6d-857a-7cc2b5111a72 req-c6291102-1338-4d89-98e4-894db796ec5c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:35.090721 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-4e93a054-4d80-4a6d-857a-7cc2b5111a72 req-c6291102-1338-4d89-98e4-894db796ec5c service nova] Creating event network-changed:c9ddc57c-cecd-45c7-8bc9-495ab0624e7e for instance 121a11b7-b8e0-4232-a03b-1399ef2d387f on n-h2-846466-12 Aug 04 16:37:35.110660 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-4e93a054-4d80-4a6d-857a-7cc2b5111a72 req-c6291102-1338-4d89-98e4-894db796ec5c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153301 Aug 04 16:37:35.126479 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 556/1150] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:37:35.147141 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9a86a5f4-c929-4a0a-95bc-81bf58ce9b50 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:35.149243 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9a86a5f4-c929-4a0a-95bc-81bf58ce9b50 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: d238b9f3-e25b-4864-8b27-d53054d76082] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:35.164424 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9a86a5f4-c929-4a0a-95bc-81bf58ce9b50 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:35.170234 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9a86a5f4-c929-4a0a-95bc-81bf58ce9b50 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:35.173650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9a86a5f4-c929-4a0a-95bc-81bf58ce9b50 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:35.177126 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9a86a5f4-c929-4a0a-95bc-81bf58ce9b50 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:35.876160 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9a86a5f4-c929-4a0a-95bc-81bf58ce9b50 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:35.900118 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9a86a5f4-c929-4a0a-95bc-81bf58ce9b50 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082" status: 200 len: 1503 microversion: 2.1 time: 0.769540 Aug 04 16:37:35.901200 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 557/1151] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:35 2022] GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082 => generated 1503 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:35.924130 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-21178332-035b-4ff3-897a-0b660b67190e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:35.925331 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-21178332-035b-4ff3-897a-0b660b67190e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:35.945710 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-21178332-035b-4ff3-897a-0b660b67190e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:35.951050 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-21178332-035b-4ff3-897a-0b660b67190e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:35.952516 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-21178332-035b-4ff3-897a-0b660b67190e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:35.953329 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-21178332-035b-4ff3-897a-0b660b67190e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:36.325334 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-1e15182f-593d-4d0c-9d5e-4c1176528138 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] [instance: 4057c3fd-7edb-499b-8623-012b46ebd651] Building network info cache for instance {{(pid=126125) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 16:37:36.346618 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-21178332-035b-4ff3-897a-0b660b67190e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:36.372484 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-21178332-035b-4ff3-897a-0b660b67190e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159" status: 200 len: 1717 microversion: 2.1 time: 0.467351 Aug 04 16:37:36.374142 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 558/1152] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:35 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159 => generated 1717 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:36.384893 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-db3bce84-7db0-4217-b978-f34eb2e5985c tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:36.386701 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-db3bce84-7db0-4217-b978-f34eb2e5985c tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] [instance: 121a11b7-b8e0-4232-a03b-1399ef2d387f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:36.412326 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db3bce84-7db0-4217-b978-f34eb2e5985c tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:36.413853 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db3bce84-7db0-4217-b978-f34eb2e5985c tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:36.414821 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db3bce84-7db0-4217-b978-f34eb2e5985c tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:36.415403 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db3bce84-7db0-4217-b978-f34eb2e5985c tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:36.880020 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-db3bce84-7db0-4217-b978-f34eb2e5985c tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c55bcf6e18a94d9781f840cb05a23abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be487ee187864a0987113d1248a873ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:36.890972 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-db3bce84-7db0-4217-b978-f34eb2e5985c tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] 10.222.0.23 "GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f" status: 200 len: 1395 microversion: 2.1 time: 0.514854 Aug 04 16:37:36.892594 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 559/1153] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:36 2022] GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f => generated 1395 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:36.898972 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4bfadf89-e9f5-4c67-a806-8874b8415575 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:36.899909 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4bfadf89-e9f5-4c67-a806-8874b8415575 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:36.909223 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4bfadf89-e9f5-4c67-a806-8874b8415575 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:36.910188 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4bfadf89-e9f5-4c67-a806-8874b8415575 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:36.911210 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4bfadf89-e9f5-4c67-a806-8874b8415575 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:36.911840 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4bfadf89-e9f5-4c67-a806-8874b8415575 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:37.506233 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4bfadf89-e9f5-4c67-a806-8874b8415575 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:37.521786 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4bfadf89-e9f5-4c67-a806-8874b8415575 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1529 microversion: 2.1 time: 0.626962 Aug 04 16:37:37.523146 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 560/1154] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:36 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1529 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:37.532619 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2f63fc1f-bcf3-45b9-8b64-569bd36e2a37 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:37.533891 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2f63fc1f-bcf3-45b9-8b64-569bd36e2a37 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: 532ec916-2768-43e0-a912-791fb4b5d9ea] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:37.547929 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f63fc1f-bcf3-45b9-8b64-569bd36e2a37 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:37.560114 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f63fc1f-bcf3-45b9-8b64-569bd36e2a37 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:37.562225 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f63fc1f-bcf3-45b9-8b64-569bd36e2a37 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:37.563028 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f63fc1f-bcf3-45b9-8b64-569bd36e2a37 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:37.796114 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-1e15182f-593d-4d0c-9d5e-4c1176528138 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] [instance: 4057c3fd-7edb-499b-8623-012b46ebd651] Updating instance_info_cache with network_info: [{"id": "4b8c1725-1b11-419e-ba1a-40030b1080ba", "address": "fa:16:3e:a7:74:32", "network": {"id": "c15511a6-c820-42c7-a327-7e19eb06873f", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1809180170-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a64446d297d1407d888376ebd3642216", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4b8c1725-1b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126125) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 16:37:37.815863 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1e15182f-593d-4d0c-9d5e-4c1176528138 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Releasing lock "refresh_cache-4057c3fd-7edb-499b-8623-012b46ebd651" {{(pid=126125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 16:37:37.817366 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1e15182f-593d-4d0c-9d5e-4c1176528138 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] 10.222.0.23 "POST /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651/action" status: 202 len: 0 microversion: 2.1 time: 5.275574 Aug 04 16:37:37.818763 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 595/1155] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:37:32 2022] POST /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651/action => generated 0 bytes in 5278 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 04 16:37:37.826266 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7932d095-eaf5-40c4-8a71-d06b70ba1a8e tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:37.827701 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7932d095-eaf5-40c4-8a71-d06b70ba1a8e tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] [instance: 2503f8ac-e7f9-432d-8b3b-271d1a179572] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:37.836606 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7932d095-eaf5-40c4-8a71-d06b70ba1a8e tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:37.837111 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7932d095-eaf5-40c4-8a71-d06b70ba1a8e tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:37.838333 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7932d095-eaf5-40c4-8a71-d06b70ba1a8e tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:37.838953 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7932d095-eaf5-40c4-8a71-d06b70ba1a8e tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:37.849737 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2f63fc1f-bcf3-45b9-8b64-569bd36e2a37 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:37.861160 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2f63fc1f-bcf3-45b9-8b64-569bd36e2a37 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea" status: 200 len: 1515 microversion: 2.1 time: 0.336159 Aug 04 16:37:37.865350 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 561/1156] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:37 2022] GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea => generated 1515 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:37.867134 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-7932d095-eaf5-40c4-8a71-d06b70ba1a8e tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] HTTP exception thrown: Instance 2503f8ac-e7f9-432d-8b3b-271d1a179572 could not be found. Aug 04 16:37:37.869056 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7932d095-eaf5-40c4-8a71-d06b70ba1a8e tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Request method failure captured: Aug 04 16:37:37.869056 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572 HTTP/1.1 Aug 04 16:37:37.869056 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:37:37.869056 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:37:37.869056 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:37:37.869056 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:37:37.869056 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:37:37.869056 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:37:37.869056 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:37:37.869056 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:37:37.869056 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_UkhV8rFKd-hpPT2QLD9lQ5k7kh_djktndGnJpVWrnqRjEXqfWnJq1oKBZG8f2yj1x5-54ox6dVWGFOjfjsJcq1OP04aJgTYKdZFqbwYGpp-yXRZpuKX_bEVN-o5PrRwb3VRH5L9nDWcApqMNcr7ECLjIQlxGdP9fPFY9O5MhyXG_4 Aug 04 16:37:37.869056 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:37:37.869056 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:37:37.869056 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:37:37.869056 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:37:37.869056 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:37:37.869056 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:37:37.869056 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 5fa4a23e6e71405f82347cd1cbbe3f84 Aug 04 16:37:37.869056 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-867178745 Aug 04 16:37:37.869056 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:37:37.869056 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:37:37.870730 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5fa4a23e6e71405f82347cd1cbbe3f84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5fa4a23e6e71405f82347cd1cbbe3f84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5fa4a23e6e71405f82347cd1cbbe3f84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5fa4a23e6e71405f82347cd1cbbe3f84"}]}] Aug 04 16:37:37.870730 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-867178745 Aug 04 16:37:37.870730 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 5fa4a23e6e71405f82347cd1cbbe3f84 Aug 04 16:37:37.870730 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-867178745 Aug 04 16:37:37.870730 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-AttachSCSIVolumeTestJSON-867178745-project Aug 04 16:37:37.870730 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:37:37.870730 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:37:37.870730 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 3fd5f11c99c841c4a7e7af4d7a4a5d4c Aug 04 16:37:37.870730 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-867178745-project Aug 04 16:37:37.870730 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:37:37.870730 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 2503f8ac-e7f9-432d-8b3b-271d1a179572 could not be found. Aug 04 16:37:37.870730 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '2503f8ac-e7f9-432d-8b3b-271d1a179572'} Aug 04 16:37:37.872438 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:37:37.872438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:37:37.872438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:37:37.872438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:37:37.872438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:37:37.872438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:37:37.872438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:37:37.872438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:37:37.872438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:37:37.872438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:37:37.872438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2503f8ac-e7f9-432d-8b3b-271d1a179572 could not be found. Aug 04 16:37:37.872438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:37:37.872438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:37:37.872438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:37:37.872438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:37:37.872438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:37:37.872438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:37:37.872438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:37:37.872438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:37:37.872438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:37:37.874346 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:37:37.874346 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:37:37.874346 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:37:37.874346 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:37:37.874346 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:37:37.874346 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:37:37.874346 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:37:37.874346 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2503f8ac-e7f9-432d-8b3b-271d1a179572 could not be found. Aug 04 16:37:37.874346 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:37:37.874346 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:37:37.874346 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:37:37.874346 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:37:37.874346 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:37:37.874346 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:37:37.874346 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:37:37.874346 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:37:37.874346 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2503f8ac-e7f9-432d-8b3b-271d1a179572 could not be found. Aug 04 16:37:37.874346 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:37:37.876932 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7932d095-eaf5-40c4-8a71-d06b70ba1a8e tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Returning 404 to user: Instance 2503f8ac-e7f9-432d-8b3b-271d1a179572 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:37:37.878035 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7932d095-eaf5-40c4-8a71-d06b70ba1a8e tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] 10.222.0.23 "GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572" status: 404 len: 111 microversion: 2.1 time: 0.057743 Aug 04 16:37:37.878256 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a1adaa43-f9e2-46b3-94cc-d27be9b61eea tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2680b72e-fe51-44ec-89de-4370640ad7d5", "device": "/dev/xvdb"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:37.879322 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 596/1157] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:37 2022] GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:37:37.884616 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-6ec5d806-b050-4d87-b78e-414261bafcf3 req-af504b39-0ddc-46f0-abec-14f6ea567ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2503f8ac-e7f9-432d-8b3b-271d1a179572", "name": "network-vif-deleted", "tag": "69ff9322-6be1-4474-843b-3eaa1b1520b2"}, {"name": "network-changed", "server_uuid": "4057c3fd-7edb-499b-8623-012b46ebd651", "tag": "4b8c1725-1b11-419e-ba1a-40030b1080ba"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:37.890426 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a1adaa43-f9e2-46b3-94cc-d27be9b61eea tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:37.899727 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6ec5d806-b050-4d87-b78e-414261bafcf3 req-af504b39-0ddc-46f0-abec-14f6ea567ab6 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:37.900168 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6ec5d806-b050-4d87-b78e-414261bafcf3 req-af504b39-0ddc-46f0-abec-14f6ea567ab6 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:37.901612 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a1adaa43-f9e2-46b3-94cc-d27be9b61eea tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:37.902599 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a1adaa43-f9e2-46b3-94cc-d27be9b61eea tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:37.903899 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a1adaa43-f9e2-46b3-94cc-d27be9b61eea tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:37.905091 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a1adaa43-f9e2-46b3-94cc-d27be9b61eea tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:37.923218 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-6ec5d806-b050-4d87-b78e-414261bafcf3 req-af504b39-0ddc-46f0-abec-14f6ea567ab6 service nova] Creating event network-vif-deleted:69ff9322-6be1-4474-843b-3eaa1b1520b2 for instance 2503f8ac-e7f9-432d-8b3b-271d1a179572 on n-h1-846466-12 Aug 04 16:37:37.924077 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-6ec5d806-b050-4d87-b78e-414261bafcf3 req-af504b39-0ddc-46f0-abec-14f6ea567ab6 service nova] Creating event network-changed:4b8c1725-1b11-419e-ba1a-40030b1080ba for instance 4057c3fd-7edb-499b-8623-012b46ebd651 on n-h2-846466-12 Aug 04 16:37:37.945788 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-6ec5d806-b050-4d87-b78e-414261bafcf3 req-af504b39-0ddc-46f0-abec-14f6ea567ab6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.063861 Aug 04 16:37:37.954593 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 597/1158] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:37:37.962268 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-14b90959-db5c-4167-90fb-d26a4f6ef7b7 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:37.963205 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-14b90959-db5c-4167-90fb-d26a4f6ef7b7 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:37.973032 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14b90959-db5c-4167-90fb-d26a4f6ef7b7 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:37.973931 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14b90959-db5c-4167-90fb-d26a4f6ef7b7 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:37.975034 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14b90959-db5c-4167-90fb-d26a4f6ef7b7 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:37.975846 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14b90959-db5c-4167-90fb-d26a4f6ef7b7 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:38.179749 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-14b90959-db5c-4167-90fb-d26a4f6ef7b7 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:38.190067 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-14b90959-db5c-4167-90fb-d26a4f6ef7b7 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159" status: 200 len: 1717 microversion: 2.1 time: 0.234261 Aug 04 16:37:38.190843 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 598/1159] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:37 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159 => generated 1717 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:38.197977 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b2b0ba05-dd29-417a-b43e-9743f04134d2 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:38.198854 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b2b0ba05-dd29-417a-b43e-9743f04134d2 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:38.208203 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2b0ba05-dd29-417a-b43e-9743f04134d2 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:38.208838 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2b0ba05-dd29-417a-b43e-9743f04134d2 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:38.209813 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2b0ba05-dd29-417a-b43e-9743f04134d2 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:38.210332 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2b0ba05-dd29-417a-b43e-9743f04134d2 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:38.290514 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a1adaa43-f9e2-46b3-94cc-d27be9b61eea tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "POST /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.426021 Aug 04 16:37:38.291708 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 562/1160] 10.222.0.23 () {62 vars in 1364 bytes} [Thu Aug 4 16:37:37 2022] POST /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5/os-volume_attachments => generated 194 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:37:38.304995 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8f2f4fbd-6d57-415b-8ad3-37db043410bf tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Calling method '.version_select at 0x7f7e84a99ca0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:38.567468 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b2b0ba05-dd29-417a-b43e-9743f04134d2 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:38.582198 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b2b0ba05-dd29-417a-b43e-9743f04134d2 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1529 microversion: 2.1 time: 0.389918 Aug 04 16:37:38.583053 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 599/1161] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:38 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1529 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:38.595166 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-37473750-7a22-4710-84e7-eb924d47f8b4 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Calling method '.version_select at 0x7f7e841baca0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:38.634221 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-37473750-7a22-4710-84e7-eb924d47f8b4 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-764030730" status: 202 len: 0 microversion: 2.1 time: 0.049188 Aug 04 16:37:38.635493 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 600/1162] 10.222.0.23 () {58 vars in 1218 bytes} [Thu Aug 4 16:37:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-764030730 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:37:38.649206 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c048defc-6d1f-454a-885a-50d1b8d96ae0 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:38.652661 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c048defc-6d1f-454a-885a-50d1b8d96ae0 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: 25a1545e-1e56-461e-b9b6-882993f8954e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:38.661167 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-c048defc-6d1f-454a-885a-50d1b8d96ae0 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] HTTP exception thrown: Instance 25a1545e-1e56-461e-b9b6-882993f8954e could not be found. Aug 04 16:37:38.667470 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c048defc-6d1f-454a-885a-50d1b8d96ae0 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Request method failure captured: Aug 04 16:37:38.667470 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers/25a1545e-1e56-461e-b9b6-882993f8954e/action HTTP/1.1 Aug 04 16:37:38.667470 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:37:38.667470 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:37:38.667470 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:37:38.667470 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 14 Aug 04 16:37:38.667470 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:37:38.667470 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:37:38.667470 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:37:38.667470 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:37:38.667470 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_WOXTtiEFJuJx9g__PLaEpNUIG8cY9V5mucnrPgRej9fIBvkSBrLUaGoaJ38CVyDNzSj9GoE7BQp1yVztL27iI-fLZMpYZtLbyWcNlftj-zWFhGEyvOQOtE9rUW6LzioxrRHRZoV1uxRI3_TSQwte9NfcDMr3FTg447dmciw2wFA7M Aug 04 16:37:38.667470 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:37:38.667470 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:37:38.667470 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:37:38.667470 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:37:38.667470 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:37:38.667470 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:37:38.667470 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 20d035e0adc640c8a3ceb832275d0ea7 Aug 04 16:37:38.667470 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1842533046 Aug 04 16:37:38.667470 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:37:38.667470 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:37:38.677008 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20d035e0adc640c8a3ceb832275d0ea7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_20d035e0adc640c8a3ceb832275d0ea7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20d035e0adc640c8a3ceb832275d0ea7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/20d035e0adc640c8a3ceb832275d0ea7"}]}] Aug 04 16:37:38.677008 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1842533046 Aug 04 16:37:38.677008 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 20d035e0adc640c8a3ceb832275d0ea7 Aug 04 16:37:38.677008 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1842533046 Aug 04 16:37:38.677008 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerRescueNegativeTestJSON-1842533046-project Aug 04 16:37:38.677008 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:37:38.677008 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:37:38.677008 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: a88db264b2c94f699e015a8617150b45 Aug 04 16:37:38.677008 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1842533046-project Aug 04 16:37:38.677008 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:37:38.677008 n-d-846466-12 devstack@n-api.service[126125]: {"rescue": {}} Aug 04 16:37:38.677008 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:37:38.677008 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 25a1545e-1e56-461e-b9b6-882993f8954e could not be found. Aug 04 16:37:38.678951 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '25a1545e-1e56-461e-b9b6-882993f8954e', 'body': {'rescue': {}}} Aug 04 16:37:38.678951 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:37:38.678951 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:37:38.678951 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:37:38.678951 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:37:38.678951 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:37:38.678951 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:37:38.678951 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 16:37:38.678951 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 16:37:38.678951 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25a1545e-1e56-461e-b9b6-882993f8954e could not be found. Aug 04 16:37:38.678951 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:37:38.678951 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:37:38.678951 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:37:38.678951 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:37:38.678951 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:37:38.678951 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:37:38.678951 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:37:38.678951 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:37:38.678951 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:37:38.678951 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:37:38.682007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:37:38.682007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:37:38.682007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 04 16:37:38.682007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 04 16:37:38.682007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:37:38.682007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:37:38.682007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25a1545e-1e56-461e-b9b6-882993f8954e could not be found. Aug 04 16:37:38.682007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:37:38.682007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:37:38.682007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:37:38.682007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:37:38.682007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:37:38.682007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:37:38.682007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:37:38.682007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:37:38.682007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25a1545e-1e56-461e-b9b6-882993f8954e could not be found. Aug 04 16:37:38.682007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:37:38.684605 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c048defc-6d1f-454a-885a-50d1b8d96ae0 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Returning 404 to user: Instance 25a1545e-1e56-461e-b9b6-882993f8954e could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:37:38.684605 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c048defc-6d1f-454a-885a-50d1b8d96ae0 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "POST /compute/v2.1/servers/25a1545e-1e56-461e-b9b6-882993f8954e/action" status: 404 len: 111 microversion: 2.1 time: 0.032630 Aug 04 16:37:38.684605 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 601/1163] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:37:38 2022] POST /compute/v2.1/servers/25a1545e-1e56-461e-b9b6-882993f8954e/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:37:38.684605 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e30f9f38-6625-4d44-b0fa-bec7c2e6dae2 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:38.684605 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e30f9f38-6625-4d44-b0fa-bec7c2e6dae2 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] [instance: 121a11b7-b8e0-4232-a03b-1399ef2d387f] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:38.692307 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e30f9f38-6625-4d44-b0fa-bec7c2e6dae2 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:38.693054 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e30f9f38-6625-4d44-b0fa-bec7c2e6dae2 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:38.694193 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e30f9f38-6625-4d44-b0fa-bec7c2e6dae2 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:38.694824 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e30f9f38-6625-4d44-b0fa-bec7c2e6dae2 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:39.094939 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e30f9f38-6625-4d44-b0fa-bec7c2e6dae2 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c55bcf6e18a94d9781f840cb05a23abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be487ee187864a0987113d1248a873ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:39.117828 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e30f9f38-6625-4d44-b0fa-bec7c2e6dae2 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] 10.222.0.23 "GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f" status: 200 len: 1395 microversion: 2.1 time: 0.445052 Aug 04 16:37:39.119616 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 602/1164] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:38 2022] GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f => generated 1395 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:39.155223 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2c5a67b4-a33e-4a9b-9e54-eb8396c53726 tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:39.158178 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:37:39.158178 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:37:39.199096 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2c5a67b4-a33e-4a9b-9e54-eb8396c53726 tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/122f0b88-a4cb-4b77-ba53-504a7ce87bd0" status: 202 len: 0 microversion: 2.1 time: 0.060462 Aug 04 16:37:39.207176 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 603/1165] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:37:39 2022] DELETE /compute/v2.1/flavors/122f0b88-a4cb-4b77-ba53-504a7ce87bd0 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:37:39.219880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-377e8ef4-4ede-4399-aea1-a863e55449f6 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:39.221670 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-377e8ef4-4ede-4399-aea1-a863e55449f6 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: 532ec916-2768-43e0-a912-791fb4b5d9ea] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:39.239571 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-377e8ef4-4ede-4399-aea1-a863e55449f6 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:39.241865 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-377e8ef4-4ede-4399-aea1-a863e55449f6 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:39.245440 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-377e8ef4-4ede-4399-aea1-a863e55449f6 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:39.248963 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-377e8ef4-4ede-4399-aea1-a863e55449f6 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:39.421069 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-377e8ef4-4ede-4399-aea1-a863e55449f6 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "POST /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea/action" status: 202 len: 0 microversion: 2.1 time: 0.211354 Aug 04 16:37:39.422291 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 604/1166] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:37:39 2022] POST /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:37:39.445531 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c43c1851-1f38-4a77-a660-1c3adf349ee2 tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:39.531596 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c43c1851-1f38-4a77-a660-1c3adf349ee2 tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.104798 Aug 04 16:37:39.532566 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 605/1167] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:37:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:39.552674 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2ced0fae-a2e1-42df-a561-8c13f41f3ec4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:39.555041 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2ced0fae-a2e1-42df-a561-8c13f41f3ec4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:39.583109 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2ced0fae-a2e1-42df-a561-8c13f41f3ec4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:39.584239 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2ced0fae-a2e1-42df-a561-8c13f41f3ec4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:39.585916 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2ced0fae-a2e1-42df-a561-8c13f41f3ec4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:39.589755 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2ced0fae-a2e1-42df-a561-8c13f41f3ec4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:40.354111 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8f2f4fbd-6d57-415b-8ad3-37db043410bf tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/80498b80-fa8a-4495-b0db-33dc16d15290" status: 202 len: 0 microversion: 2.1 time: 2.056559 Aug 04 16:37:40.356358 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 563/1168] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Aug 4 16:37:38 2022] DELETE /compute/v2.1/os-floating-ips/80498b80-fa8a-4495-b0db-33dc16d15290 => generated 0 bytes in 2064 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:37:40.384941 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9af3fba1-626d-48d5-a7a4-7c4a32dcefd5 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:40.391719 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9af3fba1-626d-48d5-a7a4-7c4a32dcefd5 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: 532ec916-2768-43e0-a912-791fb4b5d9ea] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:40.435110 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9af3fba1-626d-48d5-a7a4-7c4a32dcefd5 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:40.435746 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9af3fba1-626d-48d5-a7a4-7c4a32dcefd5 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:40.436675 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9af3fba1-626d-48d5-a7a4-7c4a32dcefd5 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:40.438430 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9af3fba1-626d-48d5-a7a4-7c4a32dcefd5 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:40.501555 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2ced0fae-a2e1-42df-a561-8c13f41f3ec4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:40.532891 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2ced0fae-a2e1-42df-a561-8c13f41f3ec4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159" status: 200 len: 1717 microversion: 2.1 time: 0.993353 Aug 04 16:37:40.534348 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 606/1169] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:39 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159 => generated 1717 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:40.574339 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2bc51798-f0f5-4739-b413-3effe60857d1 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:40.578650 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2bc51798-f0f5-4739-b413-3effe60857d1 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:40.589757 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2bc51798-f0f5-4739-b413-3effe60857d1 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:40.590502 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2bc51798-f0f5-4739-b413-3effe60857d1 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:40.592093 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2bc51798-f0f5-4739-b413-3effe60857d1 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:40.593003 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2bc51798-f0f5-4739-b413-3effe60857d1 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:40.661015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2bc51798-f0f5-4739-b413-3effe60857d1 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:40.687327 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2bc51798-f0f5-4739-b413-3effe60857d1 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Old instance type tempest-test_resize_flavor_-1110634771, new instance type m1.heat {{(pid=126125) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 16:37:40.703679 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-2bc51798-f0f5-4739-b413-3effe60857d1 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:37:40.705158 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-2bc51798-f0f5-4739-b413-3effe60857d1 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:37:40.706460 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-2bc51798-f0f5-4739-b413-3effe60857d1 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:37:40.707033 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-2bc51798-f0f5-4739-b413-3effe60857d1 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:37:40.708008 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-2bc51798-f0f5-4739-b413-3effe60857d1 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:37:40.851406 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2bc51798-f0f5-4739-b413-3effe60857d1 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "POST /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33/action" status: 202 len: 0 microversion: 2.1 time: 0.303597 Aug 04 16:37:40.858626 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 607/1170] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:37:40 2022] POST /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:37:40.878628 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5236135c-dc00-466e-97be-f563c71133fa tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:40.878628 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5236135c-dc00-466e-97be-f563c71133fa tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] [instance: 121a11b7-b8e0-4232-a03b-1399ef2d387f] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:40.885421 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5236135c-dc00-466e-97be-f563c71133fa tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:40.885421 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5236135c-dc00-466e-97be-f563c71133fa tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:40.885421 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5236135c-dc00-466e-97be-f563c71133fa tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:40.885421 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5236135c-dc00-466e-97be-f563c71133fa tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:41.979970 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9af3fba1-626d-48d5-a7a4-7c4a32dcefd5 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:42.012844 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9af3fba1-626d-48d5-a7a4-7c4a32dcefd5 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea" status: 200 len: 1500 microversion: 2.1 time: 1.654390 Aug 04 16:37:42.020272 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 564/1171] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:40 2022] GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea => generated 1500 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:42.048749 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bdca3b5f-fbf5-42ff-9f6f-5756ee1deb46 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:42.066591 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bdca3b5f-fbf5-42ff-9f6f-5756ee1deb46 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Request method failure captured: Aug 04 16:37:42.066591 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651/action HTTP/1.1 Aug 04 16:37:42.066591 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:37:42.066591 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:37:42.066591 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:37:42.066591 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 34 Aug 04 16:37:42.066591 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:37:42.066591 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:37:42.066591 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:37:42.066591 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:37:42.066591 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_WXeR5P1378OpHSUhHA08p94oJyeqJjq9Rmn76J7sY4kRTwpoEdr5yQ8C9d4ilK1F15kmT2fGPk_HGKgT0bbobQ-UCWVQWrl6b4Gkq67PPkdS6nm2t_cDvvwvN49YM27zBpMwpLUv089VgbOr3xyQjXpCMsSrNl7CuLtGkn9EPKJuA Aug 04 16:37:42.066591 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:37:42.066591 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:37:42.066591 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:37:42.066591 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:37:42.066591 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:37:42.066591 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:37:42.066591 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: a64446d297d1407d888376ebd3642216 Aug 04 16:37:42.066591 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 Aug 04 16:37:42.066591 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:37:42.066591 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:37:42.068031 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a64446d297d1407d888376ebd3642216"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a64446d297d1407d888376ebd3642216"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a64446d297d1407d888376ebd3642216"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a64446d297d1407d888376ebd3642216"}]}] Aug 04 16:37:42.068031 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 Aug 04 16:37:42.068031 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: a64446d297d1407d888376ebd3642216 Aug 04 16:37:42.068031 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 Aug 04 16:37:42.068031 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project Aug 04 16:37:42.068031 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:37:42.068031 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:37:42.068031 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: a2b193211a2243bc90299e112dd3cc26 Aug 04 16:37:42.068031 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project Aug 04 16:37:42.068031 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 16:37:42.068031 n-d-846466-12 devstack@n-api.service[126126]: {"addFloatingIp": {"address": ""}} Aug 04 16:37:42.068031 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:37:42.068031 n-d-846466-12 devstack@n-api.service[126126]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 04 16:37:42.068859 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '4057c3fd-7edb-499b-8623-012b46ebd651', 'body': {'addFloatingIp': {'address': ''}}} Aug 04 16:37:42.068859 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:37:42.068859 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:37:42.068859 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:37:42.068859 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:37:42.068859 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:37:42.068859 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:37:42.068859 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 04 16:37:42.068859 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:37:42.068859 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 04 16:37:42.068859 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 04 16:37:42.068859 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:37:42.068859 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 04 16:37:42.068859 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi '' Aug 04 16:37:42.068859 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:37:42.068859 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:37:42.068859 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:37:42.068859 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:37:42.068859 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:37:42.068859 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:37:42.068859 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:37:42.068859 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:37:42.070359 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:37:42.070359 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:37:42.070359 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:37:42.070359 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:37:42.070359 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 16:37:42.070359 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 16:37:42.070359 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:37:42.070359 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:37:42.070359 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:37:42.070359 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:37:42.070359 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 04 16:37:42.070359 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:37:42.070359 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:37:42.070359 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:37:42.070359 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:37:42.070359 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:37:42.070359 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:37:42.070359 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:37:42.070359 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:37:42.071570 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 04 16:37:42.071570 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:37:42.071570 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bdca3b5f-fbf5-42ff-9f6f-5756ee1deb46 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:37:42.071570 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bdca3b5f-fbf5-42ff-9f6f-5756ee1deb46 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] 10.222.0.23 "POST /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651/action" status: 400 len: 142 microversion: 2.1 time: 0.046487 Aug 04 16:37:42.071570 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 565/1172] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:37:42 2022] POST /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651/action => generated 142 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:37:42.090887 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-06d969a6-b454-433f-9e74-a94b6539df53 req-0132d6ed-be08-4d51-b524-9a0b0510ddf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b359364c-f234-4d01-9c08-e6df8a21f159", "name": "network-vif-unplugged", "status": "completed", "tag": "490cb30e-cef0-49db-a9ae-179c72d887af"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:42.126813 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5236135c-dc00-466e-97be-f563c71133fa tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c55bcf6e18a94d9781f840cb05a23abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be487ee187864a0987113d1248a873ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:42.143351 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5236135c-dc00-466e-97be-f563c71133fa tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] 10.222.0.23 "GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f" status: 200 len: 1395 microversion: 2.1 time: 1.281542 Aug 04 16:37:42.144094 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 608/1173] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:40 2022] GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f => generated 1395 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:42.154304 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-06d969a6-b454-433f-9e74-a94b6539df53 req-0132d6ed-be08-4d51-b524-9a0b0510ddf9 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:42.155422 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-06d969a6-b454-433f-9e74-a94b6539df53 req-0132d6ed-be08-4d51-b524-9a0b0510ddf9 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:42.165764 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-335de681-be11-46db-81e5-23837c910789 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:42.166497 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-335de681-be11-46db-81e5-23837c910789 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:42.186685 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-06d969a6-b454-433f-9e74-a94b6539df53 req-0132d6ed-be08-4d51-b524-9a0b0510ddf9 service nova] Creating event network-vif-unplugged:490cb30e-cef0-49db-a9ae-179c72d887af for instance b359364c-f234-4d01-9c08-e6df8a21f159 on n-h1-846466-12 Aug 04 16:37:42.199501 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-335de681-be11-46db-81e5-23837c910789 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:42.201735 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-06d969a6-b454-433f-9e74-a94b6539df53 req-0132d6ed-be08-4d51-b524-9a0b0510ddf9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130137 Aug 04 16:37:42.205579 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-335de681-be11-46db-81e5-23837c910789 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:42.207352 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-335de681-be11-46db-81e5-23837c910789 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:42.210664 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 566/1174] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:37:42.213956 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-335de681-be11-46db-81e5-23837c910789 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:42.231543 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-39e8dc47-e4a2-4761-9720-e12f376ef127 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:42.237852 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-39e8dc47-e4a2-4761-9720-e12f376ef127 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:42.270496 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39e8dc47-e4a2-4761-9720-e12f376ef127 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:42.271267 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39e8dc47-e4a2-4761-9720-e12f376ef127 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:42.272710 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39e8dc47-e4a2-4761-9720-e12f376ef127 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:42.277069 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39e8dc47-e4a2-4761-9720-e12f376ef127 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:42.619628 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-335de681-be11-46db-81e5-23837c910789 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:42.629610 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-335de681-be11-46db-81e5-23837c910789 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1538 microversion: 2.1 time: 0.484177 Aug 04 16:37:42.633970 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 609/1175] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:42 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1538 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:42.644042 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9ad5960c-d226-4148-89f3-a6d74bb266d6 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:42.659067 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9ad5960c-d226-4148-89f3-a6d74bb266d6 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: 532ec916-2768-43e0-a912-791fb4b5d9ea] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:42.670283 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9ad5960c-d226-4148-89f3-a6d74bb266d6 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:42.674266 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9ad5960c-d226-4148-89f3-a6d74bb266d6 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:42.676576 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9ad5960c-d226-4148-89f3-a6d74bb266d6 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:42.677240 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9ad5960c-d226-4148-89f3-a6d74bb266d6 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:42.733784 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-9ad5960c-d226-4148-89f3-a6d74bb266d6 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lazy-loading 'flavor' on Instance uuid 532ec916-2768-43e0-a912-791fb4b5d9ea {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:37:42.861194 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-9ad5960c-d226-4148-89f3-a6d74bb266d6 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] HTTP exception thrown: Cannot 'rescue' instance 532ec916-2768-43e0-a912-791fb4b5d9ea while it is in vm_state paused Aug 04 16:37:42.874754 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9ad5960c-d226-4148-89f3-a6d74bb266d6 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Request method failure captured: Aug 04 16:37:42.874754 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea/action HTTP/1.1 Aug 04 16:37:42.874754 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:37:42.874754 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:37:42.874754 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:37:42.874754 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 14 Aug 04 16:37:42.874754 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:37:42.874754 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:37:42.874754 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:37:42.874754 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:37:42.874754 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_WOXTtiEFJuJx9g__PLaEpNUIG8cY9V5mucnrPgRej9fIBvkSBrLUaGoaJ38CVyDNzSj9GoE7BQp1yVztL27iI-fLZMpYZtLbyWcNlftj-zWFhGEyvOQOtE9rUW6LzioxrRHRZoV1uxRI3_TSQwte9NfcDMr3FTg447dmciw2wFA7M Aug 04 16:37:42.874754 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:37:42.874754 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:37:42.874754 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:37:42.874754 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:37:42.874754 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:37:42.874754 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:37:42.874754 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 20d035e0adc640c8a3ceb832275d0ea7 Aug 04 16:37:42.874754 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1842533046 Aug 04 16:37:42.874754 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:37:42.874754 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:37:42.876397 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20d035e0adc640c8a3ceb832275d0ea7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_20d035e0adc640c8a3ceb832275d0ea7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20d035e0adc640c8a3ceb832275d0ea7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/20d035e0adc640c8a3ceb832275d0ea7"}]}] Aug 04 16:37:42.876397 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1842533046 Aug 04 16:37:42.876397 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 20d035e0adc640c8a3ceb832275d0ea7 Aug 04 16:37:42.876397 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1842533046 Aug 04 16:37:42.876397 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerRescueNegativeTestJSON-1842533046-project Aug 04 16:37:42.876397 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:37:42.876397 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:37:42.876397 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: a88db264b2c94f699e015a8617150b45 Aug 04 16:37:42.876397 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1842533046-project Aug 04 16:37:42.876397 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:37:42.876397 n-d-846466-12 devstack@n-api.service[126125]: {"rescue": {}} Aug 04 16:37:42.876397 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:37:42.876397 n-d-846466-12 devstack@n-api.service[126125]: exception: Cannot 'rescue' instance 532ec916-2768-43e0-a912-791fb4b5d9ea while it is in vm_state paused Aug 04 16:37:42.877794 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '532ec916-2768-43e0-a912-791fb4b5d9ea', 'body': {'rescue': {}}} Aug 04 16:37:42.877794 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:37:42.877794 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:37:42.877794 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 04 16:37:42.877794 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 04 16:37:42.877794 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 04 16:37:42.877794 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 16:37:42.877794 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 16:37:42.877794 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 16:37:42.877794 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 16:37:42.877794 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 16:37:42.877794 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 532ec916-2768-43e0-a912-791fb4b5d9ea in vm_state paused. Cannot rescue while the instance is in this state. Aug 04 16:37:42.877794 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:37:42.877794 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:37:42.877794 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:37:42.877794 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:37:42.877794 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:37:42.877794 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:37:42.877794 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:37:42.877794 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:37:42.879591 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:37:42.879591 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:37:42.879591 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:37:42.879591 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:37:42.879591 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 04 16:37:42.879591 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 04 16:37:42.879591 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 16:37:42.879591 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 16:37:42.879591 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 532ec916-2768-43e0-a912-791fb4b5d9ea while it is in vm_state paused Aug 04 16:37:42.879591 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:37:42.879591 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:37:42.879591 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:37:42.879591 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:37:42.879591 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:37:42.879591 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:37:42.879591 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:37:42.879591 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:37:42.879591 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 532ec916-2768-43e0-a912-791fb4b5d9ea while it is in vm_state paused Aug 04 16:37:42.879591 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:37:42.880812 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9ad5960c-d226-4148-89f3-a6d74bb266d6 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Returning 409 to user: Cannot 'rescue' instance 532ec916-2768-43e0-a912-791fb4b5d9ea while it is in vm_state paused {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:37:42.880812 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9ad5960c-d226-4148-89f3-a6d74bb266d6 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "POST /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea/action" status: 409 len: 144 microversion: 2.1 time: 0.244588 Aug 04 16:37:42.885241 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 610/1176] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:37:42 2022] POST /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea/action => generated 144 bytes in 250 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:37:42.895409 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c897ad57-0c47-4292-9d1a-39d8bd8c735d tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:42.898059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c897ad57-0c47-4292-9d1a-39d8bd8c735d tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] [instance: 4057c3fd-7edb-499b-8623-012b46ebd651] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:42.916179 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c897ad57-0c47-4292-9d1a-39d8bd8c735d tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:42.917598 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c897ad57-0c47-4292-9d1a-39d8bd8c735d tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:42.919171 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c897ad57-0c47-4292-9d1a-39d8bd8c735d tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:42.920798 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c897ad57-0c47-4292-9d1a-39d8bd8c735d tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:42.931230 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-39e8dc47-e4a2-4761-9720-e12f376ef127 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:42.960063 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-39e8dc47-e4a2-4761-9720-e12f376ef127 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159" status: 200 len: 1717 microversion: 2.1 time: 0.746776 Aug 04 16:37:42.963208 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c897ad57-0c47-4292-9d1a-39d8bd8c735d tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Acquired lock "refresh_cache-4057c3fd-7edb-499b-8623-012b46ebd651" {{(pid=126125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 16:37:42.969806 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 567/1177] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:42 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159 => generated 1717 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:42.977535 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9babbc31-332b-4bf9-8b2c-71e92f273ace tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:42.978427 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9babbc31-332b-4bf9-8b2c-71e92f273ace tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: 532ec916-2768-43e0-a912-791fb4b5d9ea] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:42.987016 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9babbc31-332b-4bf9-8b2c-71e92f273ace tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:42.988535 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9babbc31-332b-4bf9-8b2c-71e92f273ace tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:42.989897 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9babbc31-332b-4bf9-8b2c-71e92f273ace tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:42.990607 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9babbc31-332b-4bf9-8b2c-71e92f273ace tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:43.174238 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9babbc31-332b-4bf9-8b2c-71e92f273ace tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "POST /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea/action" status: 202 len: 0 microversion: 2.1 time: 0.200593 Aug 04 16:37:43.179933 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 568/1178] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:37:42 2022] POST /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:37:43.188306 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e2bedc3e-5552-4160-89f3-8489dea6f92b tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:43.190122 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e2bedc3e-5552-4160-89f3-8489dea6f92b tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] [instance: 121a11b7-b8e0-4232-a03b-1399ef2d387f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:43.226102 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e2bedc3e-5552-4160-89f3-8489dea6f92b tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:43.227138 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e2bedc3e-5552-4160-89f3-8489dea6f92b tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:43.229503 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e2bedc3e-5552-4160-89f3-8489dea6f92b tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:43.236077 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e2bedc3e-5552-4160-89f3-8489dea6f92b tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:43.249261 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c897ad57-0c47-4292-9d1a-39d8bd8c735d tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Releasing lock "refresh_cache-4057c3fd-7edb-499b-8623-012b46ebd651" {{(pid=126125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 16:37:43.252631 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-c897ad57-0c47-4292-9d1a-39d8bd8c735d tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] HTTP exception thrown: floating IP not found Aug 04 16:37:43.256229 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c897ad57-0c47-4292-9d1a-39d8bd8c735d tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Request method failure captured: Aug 04 16:37:43.256229 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651/action HTTP/1.1 Aug 04 16:37:43.256229 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:37:43.256229 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:37:43.256229 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:37:43.256229 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 41 Aug 04 16:37:43.256229 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:37:43.256229 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:37:43.256229 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:37:43.256229 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:37:43.256229 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_WXeR5P1378OpHSUhHA08p94oJyeqJjq9Rmn76J7sY4kRTwpoEdr5yQ8C9d4ilK1F15kmT2fGPk_HGKgT0bbobQ-UCWVQWrl6b4Gkq67PPkdS6nm2t_cDvvwvN49YM27zBpMwpLUv089VgbOr3xyQjXpCMsSrNl7CuLtGkn9EPKJuA Aug 04 16:37:43.256229 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:37:43.256229 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:37:43.256229 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:37:43.256229 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:37:43.256229 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:37:43.256229 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:37:43.256229 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: a64446d297d1407d888376ebd3642216 Aug 04 16:37:43.256229 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 Aug 04 16:37:43.256229 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:37:43.256229 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:37:43.258884 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a64446d297d1407d888376ebd3642216"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a64446d297d1407d888376ebd3642216"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a64446d297d1407d888376ebd3642216"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a64446d297d1407d888376ebd3642216"}]}] Aug 04 16:37:43.258884 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 Aug 04 16:37:43.258884 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: a64446d297d1407d888376ebd3642216 Aug 04 16:37:43.258884 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 Aug 04 16:37:43.258884 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project Aug 04 16:37:43.258884 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:37:43.258884 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:37:43.258884 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: a2b193211a2243bc90299e112dd3cc26 Aug 04 16:37:43.258884 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project Aug 04 16:37:43.258884 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:37:43.258884 n-d-846466-12 devstack@n-api.service[126125]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 04 16:37:43.258884 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:37:43.258884 n-d-846466-12 devstack@n-api.service[126125]: exception: floating IP not found Aug 04 16:37:43.260415 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '4057c3fd-7edb-499b-8623-012b46ebd651', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 04 16:37:43.260415 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:37:43.260415 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:37:43.260415 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 04 16:37:43.260415 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 04 16:37:43.260415 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 04 16:37:43.260415 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 04 16:37:43.260415 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Aug 04 16:37:43.260415 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 04 16:37:43.260415 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 04 16:37:43.260415 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 04 16:37:43.260415 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 04 16:37:43.260415 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:37:43.260415 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:37:43.260415 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:37:43.260415 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:37:43.260415 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:37:43.260415 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:37:43.260415 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:37:43.264121 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:37:43.264121 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:37:43.264121 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:37:43.264121 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:37:43.264121 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:37:43.264121 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:37:43.264121 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:37:43.264121 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 04 16:37:43.264121 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 16:37:43.264121 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 04 16:37:43.264121 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:37:43.264121 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:37:43.264121 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:37:43.264121 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:37:43.264121 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:37:43.264121 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:37:43.264121 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:37:43.264121 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:37:43.264121 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 04 16:37:43.264121 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:37:43.270765 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c897ad57-0c47-4292-9d1a-39d8bd8c735d tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Returning 404 to user: floating IP not found {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:37:43.270765 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c897ad57-0c47-4292-9d1a-39d8bd8c735d tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] 10.222.0.23 "POST /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651/action" status: 404 len: 67 microversion: 2.1 time: 0.381945 Aug 04 16:37:43.273396 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 611/1179] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:37:42 2022] POST /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651/action => generated 67 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:37:43.286732 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e93f0988-a6d5-4b4a-a77f-901ebc9d1785 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:43.288278 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e93f0988-a6d5-4b4a-a77f-901ebc9d1785 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: 532ec916-2768-43e0-a912-791fb4b5d9ea] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:43.308479 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e93f0988-a6d5-4b4a-a77f-901ebc9d1785 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:43.309451 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e93f0988-a6d5-4b4a-a77f-901ebc9d1785 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:43.313836 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e93f0988-a6d5-4b4a-a77f-901ebc9d1785 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:43.315755 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e93f0988-a6d5-4b4a-a77f-901ebc9d1785 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:43.322389 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:37:43.363218 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:37:43.655403 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e2bedc3e-5552-4160-89f3-8489dea6f92b tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c55bcf6e18a94d9781f840cb05a23abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be487ee187864a0987113d1248a873ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:43.689102 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e2bedc3e-5552-4160-89f3-8489dea6f92b tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] 10.222.0.23 "GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f" status: 200 len: 1395 microversion: 2.1 time: 0.506548 Aug 04 16:37:43.691285 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 569/1180] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:43 2022] GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f => generated 1395 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:43.694849 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e93f0988-a6d5-4b4a-a77f-901ebc9d1785 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:43.704738 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ba319043-42b3-4fc3-b9f4-e53e5c2c7237 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:43.712270 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e93f0988-a6d5-4b4a-a77f-901ebc9d1785 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea" status: 200 len: 1507 microversion: 2.1 time: 0.436563 Aug 04 16:37:43.714489 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 612/1181] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:43 2022] GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea => generated 1507 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:43.724978 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-e2b9759e-4a97-45be-972f-1957c2425ba3 req-7aeb80af-5cf3-41d8-843d-4999fdf0abf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "121a11b7-b8e0-4232-a03b-1399ef2d387f", "name": "network-vif-plugged", "status": "completed", "tag": "c9ddc57c-cecd-45c7-8bc9-495ab0624e7e"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:43.735278 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:37:43.745091 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-e2b9759e-4a97-45be-972f-1957c2425ba3 req-7aeb80af-5cf3-41d8-843d-4999fdf0abf4 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:43.746013 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-e2b9759e-4a97-45be-972f-1957c2425ba3 req-7aeb80af-5cf3-41d8-843d-4999fdf0abf4 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:43.762623 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-e2b9759e-4a97-45be-972f-1957c2425ba3 req-7aeb80af-5cf3-41d8-843d-4999fdf0abf4 service nova] Creating event network-vif-plugged:c9ddc57c-cecd-45c7-8bc9-495ab0624e7e for instance 121a11b7-b8e0-4232-a03b-1399ef2d387f on n-h2-846466-12 Aug 04 16:37:43.768780 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-e2b9759e-4a97-45be-972f-1957c2425ba3 req-7aeb80af-5cf3-41d8-843d-4999fdf0abf4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051273 Aug 04 16:37:43.770085 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 613/1182] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:37:43.777447 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2cffca95-af9e-4378-bbaf-021230567606 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:43.778329 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2cffca95-af9e-4378-bbaf-021230567606 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:43.785928 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2cffca95-af9e-4378-bbaf-021230567606 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:43.786550 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2cffca95-af9e-4378-bbaf-021230567606 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:43.787512 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2cffca95-af9e-4378-bbaf-021230567606 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:43.788071 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2cffca95-af9e-4378-bbaf-021230567606 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:43.827706 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-ba319043-42b3-4fc3-b9f4-e53e5c2c7237 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 04 16:37:43.831024 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ba319043-42b3-4fc3-b9f4-e53e5c2c7237 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Request method failure captured: Aug 04 16:37:43.831024 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651/action HTTP/1.1 Aug 04 16:37:43.831024 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:37:43.831024 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:37:43.831024 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:37:43.831024 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 44 Aug 04 16:37:43.831024 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:37:43.831024 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:37:43.831024 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:37:43.831024 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:37:43.831024 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_WXeR5P1378OpHSUhHA08p94oJyeqJjq9Rmn76J7sY4kRTwpoEdr5yQ8C9d4ilK1F15kmT2fGPk_HGKgT0bbobQ-UCWVQWrl6b4Gkq67PPkdS6nm2t_cDvvwvN49YM27zBpMwpLUv089VgbOr3xyQjXpCMsSrNl7CuLtGkn9EPKJuA Aug 04 16:37:43.831024 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:37:43.831024 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:37:43.831024 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:37:43.831024 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:37:43.831024 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:37:43.831024 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:37:43.831024 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: a64446d297d1407d888376ebd3642216 Aug 04 16:37:43.831024 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 Aug 04 16:37:43.831024 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:37:43.831024 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:37:43.834069 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a64446d297d1407d888376ebd3642216"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a64446d297d1407d888376ebd3642216"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a64446d297d1407d888376ebd3642216"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a64446d297d1407d888376ebd3642216"}]}] Aug 04 16:37:43.834069 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 Aug 04 16:37:43.834069 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: a64446d297d1407d888376ebd3642216 Aug 04 16:37:43.834069 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 Aug 04 16:37:43.834069 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project Aug 04 16:37:43.834069 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:37:43.834069 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:37:43.834069 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: a2b193211a2243bc90299e112dd3cc26 Aug 04 16:37:43.834069 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project Aug 04 16:37:43.834069 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 16:37:43.834069 n-d-846466-12 devstack@n-api.service[126126]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 04 16:37:43.834069 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:37:43.834069 n-d-846466-12 devstack@n-api.service[126126]: exception: Floating IP not found for address 0.0.0.0. Aug 04 16:37:43.835884 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '4057c3fd-7edb-499b-8623-012b46ebd651', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 04 16:37:43.835884 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:37:43.835884 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:37:43.835884 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 04 16:37:43.835884 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 04 16:37:43.835884 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Aug 04 16:37:43.835884 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 04 16:37:43.835884 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 04 16:37:43.835884 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 04 16:37:43.835884 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 04 16:37:43.835884 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:37:43.835884 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:37:43.835884 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:37:43.835884 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:37:43.835884 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:37:43.835884 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:37:43.835884 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:37:43.835884 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:37:43.835884 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:37:43.838696 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:37:43.838696 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:37:43.838696 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:37:43.838696 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:37:43.838696 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:37:43.838696 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 04 16:37:43.838696 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 04 16:37:43.838696 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 04 16:37:43.838696 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 04 16:37:43.838696 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 04 16:37:43.838696 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:37:43.838696 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:37:43.838696 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:37:43.838696 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:37:43.838696 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:37:43.838696 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:37:43.838696 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:37:43.838696 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:37:43.838696 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 04 16:37:43.838696 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:37:43.845652 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ba319043-42b3-4fc3-b9f4-e53e5c2c7237 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:37:43.845652 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ba319043-42b3-4fc3-b9f4-e53e5c2c7237 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] 10.222.0.23 "POST /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651/action" status: 404 len: 88 microversion: 2.1 time: 0.150975 Aug 04 16:37:43.846354 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 570/1183] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:37:43 2022] POST /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651/action => generated 88 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:37:43.855042 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-eccbfd0d-d58d-40d7-bd4a-3479bb492603 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:43.855666 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-eccbfd0d-d58d-40d7-bd4a-3479bb492603 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] [instance: 4057c3fd-7edb-499b-8623-012b46ebd651] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:43.864356 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eccbfd0d-d58d-40d7-bd4a-3479bb492603 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:43.864941 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eccbfd0d-d58d-40d7-bd4a-3479bb492603 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:43.865907 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eccbfd0d-d58d-40d7-bd4a-3479bb492603 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:43.866455 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eccbfd0d-d58d-40d7-bd4a-3479bb492603 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:43.917161 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-eccbfd0d-d58d-40d7-bd4a-3479bb492603 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] [instance: 4057c3fd-7edb-499b-8623-012b46ebd651] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:37:44.031388 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-eccbfd0d-d58d-40d7-bd4a-3479bb492603 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651" status: 204 len: 0 microversion: 2.1 time: 0.179958 Aug 04 16:37:44.035501 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 571/1184] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:37:43 2022] DELETE /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:37:44.039763 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-65b93613-7043-4352-a9fb-3b213f08020d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:44.040787 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-65b93613-7043-4352-a9fb-3b213f08020d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:44.048985 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65b93613-7043-4352-a9fb-3b213f08020d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:44.049652 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65b93613-7043-4352-a9fb-3b213f08020d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:44.050614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65b93613-7043-4352-a9fb-3b213f08020d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:44.051161 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65b93613-7043-4352-a9fb-3b213f08020d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:44.194084 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2cffca95-af9e-4378-bbaf-021230567606 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:44.207203 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2cffca95-af9e-4378-bbaf-021230567606 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1538 microversion: 2.1 time: 0.435551 Aug 04 16:37:44.208114 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 614/1185] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:43 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1538 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:44.222549 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-440a86e0-d0c5-4d2e-8f54-f4261a0eeea4 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:44.223468 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-440a86e0-d0c5-4d2e-8f54-f4261a0eeea4 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] [instance: 4057c3fd-7edb-499b-8623-012b46ebd651] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:44.239695 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-440a86e0-d0c5-4d2e-8f54-f4261a0eeea4 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:44.240958 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-440a86e0-d0c5-4d2e-8f54-f4261a0eeea4 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:44.254774 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-440a86e0-d0c5-4d2e-8f54-f4261a0eeea4 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:44.255766 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-440a86e0-d0c5-4d2e-8f54-f4261a0eeea4 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:44.261874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-65b93613-7043-4352-a9fb-3b213f08020d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:44.272754 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-65b93613-7043-4352-a9fb-3b213f08020d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159" status: 200 len: 1717 microversion: 2.1 time: 0.238404 Aug 04 16:37:44.273071 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 572/1186] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:44 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159 => generated 1717 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:44.278983 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-f57c9a2b-b7c8-4d8e-871e-ed85e099489c req-6f2df7a0-fc02-480f-ade8-29f8fdbbc894 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b359364c-f234-4d01-9c08-e6df8a21f159", "tag": "490cb30e-cef0-49db-a9ae-179c72d887af"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:44.301222 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f57c9a2b-b7c8-4d8e-871e-ed85e099489c req-6f2df7a0-fc02-480f-ade8-29f8fdbbc894 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:44.301570 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f57c9a2b-b7c8-4d8e-871e-ed85e099489c req-6f2df7a0-fc02-480f-ade8-29f8fdbbc894 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:44.320872 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-f57c9a2b-b7c8-4d8e-871e-ed85e099489c req-6f2df7a0-fc02-480f-ade8-29f8fdbbc894 service nova] Creating event network-changed:490cb30e-cef0-49db-a9ae-179c72d887af for instance b359364c-f234-4d01-9c08-e6df8a21f159 on n-h1-846466-12 Aug 04 16:37:44.327327 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-f57c9a2b-b7c8-4d8e-871e-ed85e099489c req-6f2df7a0-fc02-480f-ade8-29f8fdbbc894 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052933 Aug 04 16:37:44.332470 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 573/1187] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:37:44.698933 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-440a86e0-d0c5-4d2e-8f54-f4261a0eeea4 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b193211a2243bc90299e112dd3cc26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64446d297d1407d888376ebd3642216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:44.715286 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a0fca746-00c9-4116-805e-c1331bc7fb6c tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:44.716147 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a0fca746-00c9-4116-805e-c1331bc7fb6c tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] [instance: 121a11b7-b8e0-4232-a03b-1399ef2d387f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:44.724908 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-440a86e0-d0c5-4d2e-8f54-f4261a0eeea4 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] 10.222.0.23 "GET /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651" status: 200 len: 1542 microversion: 2.1 time: 0.510837 Aug 04 16:37:44.725625 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 615/1188] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:44 2022] GET /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651 => generated 1542 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:44.726570 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a0fca746-00c9-4116-805e-c1331bc7fb6c tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:44.727018 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a0fca746-00c9-4116-805e-c1331bc7fb6c tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:44.727801 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a0fca746-00c9-4116-805e-c1331bc7fb6c tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:44.729721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a0fca746-00c9-4116-805e-c1331bc7fb6c tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:44.754196 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-02b0f872-da1f-4186-8d1b-a92e8a67e31b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:44.755595 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-02b0f872-da1f-4186-8d1b-a92e8a67e31b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: 532ec916-2768-43e0-a912-791fb4b5d9ea] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:44.767548 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02b0f872-da1f-4186-8d1b-a92e8a67e31b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:44.768629 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02b0f872-da1f-4186-8d1b-a92e8a67e31b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:44.770267 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02b0f872-da1f-4186-8d1b-a92e8a67e31b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:44.772416 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02b0f872-da1f-4186-8d1b-a92e8a67e31b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:45.175314 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-02b0f872-da1f-4186-8d1b-a92e8a67e31b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:45.178495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a0fca746-00c9-4116-805e-c1331bc7fb6c tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c55bcf6e18a94d9781f840cb05a23abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be487ee187864a0987113d1248a873ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:45.192317 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-02b0f872-da1f-4186-8d1b-a92e8a67e31b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea" status: 200 len: 1515 microversion: 2.1 time: 0.459351 Aug 04 16:37:45.194917 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 616/1189] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:44 2022] GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea => generated 1515 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:45.203688 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a0fca746-00c9-4116-805e-c1331bc7fb6c tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] 10.222.0.23 "GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f" status: 200 len: 1395 microversion: 2.1 time: 0.492412 Aug 04 16:37:45.217640 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 574/1190] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:44 2022] GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f => generated 1395 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:37:45.248058 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cb4aa32b-150d-4112-a422-27cf74b05074 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:45.250234 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cb4aa32b-150d-4112-a422-27cf74b05074 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:45.263355 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cb4aa32b-150d-4112-a422-27cf74b05074 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:45.265419 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cb4aa32b-150d-4112-a422-27cf74b05074 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:45.267233 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cb4aa32b-150d-4112-a422-27cf74b05074 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:45.268341 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cb4aa32b-150d-4112-a422-27cf74b05074 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:45.316635 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d46ac53a-2eee-4761-b15c-82ec50aa77c0 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:45.319120 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d46ac53a-2eee-4761-b15c-82ec50aa77c0 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:45.343556 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d46ac53a-2eee-4761-b15c-82ec50aa77c0 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:45.344853 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d46ac53a-2eee-4761-b15c-82ec50aa77c0 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:45.346895 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d46ac53a-2eee-4761-b15c-82ec50aa77c0 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:45.348987 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d46ac53a-2eee-4761-b15c-82ec50aa77c0 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:45.878490 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cb4aa32b-150d-4112-a422-27cf74b05074 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:45.894183 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cb4aa32b-150d-4112-a422-27cf74b05074 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1538 microversion: 2.1 time: 0.651554 Aug 04 16:37:45.896293 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 617/1191] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:45 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1538 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:37:45.904681 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d46ac53a-2eee-4761-b15c-82ec50aa77c0 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:45.924565 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e74857fe-7c78-4981-b964-c45e9dabf82e tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:45.925842 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e74857fe-7c78-4981-b964-c45e9dabf82e tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] [instance: 4057c3fd-7edb-499b-8623-012b46ebd651] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:45.933425 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d46ac53a-2eee-4761-b15c-82ec50aa77c0 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159" status: 200 len: 1717 microversion: 2.1 time: 0.625438 Aug 04 16:37:45.936390 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 575/1192] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:45 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159 => generated 1717 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:45.944471 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e74857fe-7c78-4981-b964-c45e9dabf82e tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:45.945960 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e74857fe-7c78-4981-b964-c45e9dabf82e tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:45.947656 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e74857fe-7c78-4981-b964-c45e9dabf82e tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:45.949198 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e74857fe-7c78-4981-b964-c45e9dabf82e tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:46.243393 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1de953fa-3ea2-4797-878c-ca6412ede491 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:46.245677 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1de953fa-3ea2-4797-878c-ca6412ede491 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] [instance: 121a11b7-b8e0-4232-a03b-1399ef2d387f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:46.250597 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:37:46.265251 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1de953fa-3ea2-4797-878c-ca6412ede491 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:46.266281 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1de953fa-3ea2-4797-878c-ca6412ede491 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:46.268109 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1de953fa-3ea2-4797-878c-ca6412ede491 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:46.269191 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1de953fa-3ea2-4797-878c-ca6412ede491 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:46.493753 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e74857fe-7c78-4981-b964-c45e9dabf82e tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b193211a2243bc90299e112dd3cc26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64446d297d1407d888376ebd3642216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:46.516218 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e74857fe-7c78-4981-b964-c45e9dabf82e tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] 10.222.0.23 "GET /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651" status: 200 len: 1542 microversion: 2.1 time: 0.617935 Aug 04 16:37:46.517488 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 618/1193] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:45 2022] GET /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651 => generated 1542 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:46.644501 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1de953fa-3ea2-4797-878c-ca6412ede491 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c55bcf6e18a94d9781f840cb05a23abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be487ee187864a0987113d1248a873ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:46.654738 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1de953fa-3ea2-4797-878c-ca6412ede491 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] 10.222.0.23 "GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f" status: 200 len: 1395 microversion: 2.1 time: 0.420699 Aug 04 16:37:46.656310 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 576/1194] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:46 2022] GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f => generated 1395 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:46.943885 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fcebedfd-0fe3-4b5c-a0b1-4a019c80bebc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:46.954143 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fcebedfd-0fe3-4b5c-a0b1-4a019c80bebc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:46.999117 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-df20929a-0e9a-42c1-ba67-666df7e3e483 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:47.006005 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-df20929a-0e9a-42c1-ba67-666df7e3e483 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:47.024663 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fcebedfd-0fe3-4b5c-a0b1-4a019c80bebc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:47.026275 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fcebedfd-0fe3-4b5c-a0b1-4a019c80bebc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:47.034429 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fcebedfd-0fe3-4b5c-a0b1-4a019c80bebc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:47.036028 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fcebedfd-0fe3-4b5c-a0b1-4a019c80bebc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:47.051686 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-df20929a-0e9a-42c1-ba67-666df7e3e483 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:47.052457 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-df20929a-0e9a-42c1-ba67-666df7e3e483 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:47.064748 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-df20929a-0e9a-42c1-ba67-666df7e3e483 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:47.065627 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-df20929a-0e9a-42c1-ba67-666df7e3e483 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:47.601265 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-df20929a-0e9a-42c1-ba67-666df7e3e483 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:47.621274 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-df20929a-0e9a-42c1-ba67-666df7e3e483 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159" status: 200 len: 1717 microversion: 2.1 time: 0.631980 Aug 04 16:37:47.638630 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 577/1195] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:46 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159 => generated 1717 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:47.646416 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f619d18b-b87b-4442-a7df-30f09a87af99 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:47.649082 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f619d18b-b87b-4442-a7df-30f09a87af99 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] [instance: 4057c3fd-7edb-499b-8623-012b46ebd651] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:47.675765 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f619d18b-b87b-4442-a7df-30f09a87af99 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:47.677967 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f619d18b-b87b-4442-a7df-30f09a87af99 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:47.679038 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f619d18b-b87b-4442-a7df-30f09a87af99 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:47.681985 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f619d18b-b87b-4442-a7df-30f09a87af99 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:47.713844 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fcebedfd-0fe3-4b5c-a0b1-4a019c80bebc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:47.728890 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fcebedfd-0fe3-4b5c-a0b1-4a019c80bebc tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1538 microversion: 2.1 time: 0.791442 Aug 04 16:37:47.730340 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 619/1196] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:46 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1538 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:47.736511 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-158f3c86-6af1-42f5-851b-b3ea5be15f48 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:47.737513 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-158f3c86-6af1-42f5-851b-b3ea5be15f48 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] [instance: 121a11b7-b8e0-4232-a03b-1399ef2d387f] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:47.750494 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-158f3c86-6af1-42f5-851b-b3ea5be15f48 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:47.751608 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-158f3c86-6af1-42f5-851b-b3ea5be15f48 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:47.752751 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-158f3c86-6af1-42f5-851b-b3ea5be15f48 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:47.755575 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-158f3c86-6af1-42f5-851b-b3ea5be15f48 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:47.994721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f619d18b-b87b-4442-a7df-30f09a87af99 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b193211a2243bc90299e112dd3cc26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64446d297d1407d888376ebd3642216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:48.017983 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f619d18b-b87b-4442-a7df-30f09a87af99 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] 10.222.0.23 "GET /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651" status: 200 len: 1500 microversion: 2.1 time: 0.375325 Aug 04 16:37:48.035365 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 578/1197] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:47 2022] GET /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651 => generated 1500 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:48.062829 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-550e28f8-315e-4551-a850-62df915f43a1 req-6ee32034-6ad2-4928-a29c-f0cb5874d6c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4057c3fd-7edb-499b-8623-012b46ebd651", "name": "network-vif-deleted", "tag": "4b8c1725-1b11-419e-ba1a-40030b1080ba"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:48.108047 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-550e28f8-315e-4551-a850-62df915f43a1 req-6ee32034-6ad2-4928-a29c-f0cb5874d6c0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:48.111607 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-550e28f8-315e-4551-a850-62df915f43a1 req-6ee32034-6ad2-4928-a29c-f0cb5874d6c0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:48.178398 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-550e28f8-315e-4551-a850-62df915f43a1 req-6ee32034-6ad2-4928-a29c-f0cb5874d6c0 service nova] Creating event network-vif-deleted:4b8c1725-1b11-419e-ba1a-40030b1080ba for instance 4057c3fd-7edb-499b-8623-012b46ebd651 on n-h2-846466-12 Aug 04 16:37:48.201661 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-550e28f8-315e-4551-a850-62df915f43a1 req-6ee32034-6ad2-4928-a29c-f0cb5874d6c0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163597 Aug 04 16:37:48.211173 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 579/1198] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:37:48.391290 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-158f3c86-6af1-42f5-851b-b3ea5be15f48 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c55bcf6e18a94d9781f840cb05a23abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be487ee187864a0987113d1248a873ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:48.407965 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-158f3c86-6af1-42f5-851b-b3ea5be15f48 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] 10.222.0.23 "GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f" status: 200 len: 1395 microversion: 2.1 time: 0.675792 Aug 04 16:37:48.408902 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 620/1199] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:47 2022] GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f => generated 1395 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:48.669673 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a7e9f69a-9320-47ce-a409-7ca8223a8c3c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:48.670344 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a7e9f69a-9320-47ce-a409-7ca8223a8c3c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:48.677547 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a7e9f69a-9320-47ce-a409-7ca8223a8c3c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:48.678410 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a7e9f69a-9320-47ce-a409-7ca8223a8c3c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:48.679468 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a7e9f69a-9320-47ce-a409-7ca8223a8c3c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:48.680179 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a7e9f69a-9320-47ce-a409-7ca8223a8c3c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:48.763364 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a5a6668c-d9a6-4605-a7d1-31f2ffdcaed2 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:48.764204 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a5a6668c-d9a6-4605-a7d1-31f2ffdcaed2 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:48.772704 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a5a6668c-d9a6-4605-a7d1-31f2ffdcaed2 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:48.773449 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a5a6668c-d9a6-4605-a7d1-31f2ffdcaed2 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:48.774288 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a5a6668c-d9a6-4605-a7d1-31f2ffdcaed2 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:48.774872 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a5a6668c-d9a6-4605-a7d1-31f2ffdcaed2 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:49.001450 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a7e9f69a-9320-47ce-a409-7ca8223a8c3c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:49.015233 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a7e9f69a-9320-47ce-a409-7ca8223a8c3c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159" status: 200 len: 1717 microversion: 2.1 time: 0.350648 Aug 04 16:37:49.022635 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 580/1200] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:48 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159 => generated 1717 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:37:49.058706 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0c633f30-2a32-4eda-8e11-21eb7c73c5ab tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:49.059858 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0c633f30-2a32-4eda-8e11-21eb7c73c5ab tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] [instance: 4057c3fd-7edb-499b-8623-012b46ebd651] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:49.074202 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c633f30-2a32-4eda-8e11-21eb7c73c5ab tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:49.076403 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c633f30-2a32-4eda-8e11-21eb7c73c5ab tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:49.077893 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c633f30-2a32-4eda-8e11-21eb7c73c5ab tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:49.078927 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c633f30-2a32-4eda-8e11-21eb7c73c5ab tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:49.127774 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c633f30-2a32-4eda-8e11-21eb7c73c5ab tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:49.128806 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c633f30-2a32-4eda-8e11-21eb7c73c5ab tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:49.129637 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-0c633f30-2a32-4eda-8e11-21eb7c73c5ab tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lazy-loading 'fault' on Instance uuid 4057c3fd-7edb-499b-8623-012b46ebd651 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:37:49.131015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a5a6668c-d9a6-4605-a7d1-31f2ffdcaed2 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:49.162296 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a5a6668c-d9a6-4605-a7d1-31f2ffdcaed2 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1543 microversion: 2.1 time: 0.404496 Aug 04 16:37:49.162923 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 621/1201] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:48 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1543 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:49.225009 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0c633f30-2a32-4eda-8e11-21eb7c73c5ab tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b193211a2243bc90299e112dd3cc26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64446d297d1407d888376ebd3642216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:49.234763 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0c633f30-2a32-4eda-8e11-21eb7c73c5ab tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] 10.222.0.23 "GET /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651" status: 200 len: 1322 microversion: 2.1 time: 0.181346 Aug 04 16:37:49.244294 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 581/1202] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:49 2022] GET /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:37:49.436793 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-978955e6-7721-418a-9e24-cd5f02cd12e3 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:49.437993 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-978955e6-7721-418a-9e24-cd5f02cd12e3 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] [instance: 121a11b7-b8e0-4232-a03b-1399ef2d387f] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:49.446860 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-978955e6-7721-418a-9e24-cd5f02cd12e3 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:49.447494 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-978955e6-7721-418a-9e24-cd5f02cd12e3 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:49.448749 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-978955e6-7721-418a-9e24-cd5f02cd12e3 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:49.449389 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-978955e6-7721-418a-9e24-cd5f02cd12e3 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:49.650586 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7f44aacb-cb18-4585-afc5-ac22b03730fb tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:49.652134 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7f44aacb-cb18-4585-afc5-ac22b03730fb tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] [instance: 2503f8ac-e7f9-432d-8b3b-271d1a179572] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:49.663054 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f44aacb-cb18-4585-afc5-ac22b03730fb tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:49.663592 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f44aacb-cb18-4585-afc5-ac22b03730fb tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:49.664452 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f44aacb-cb18-4585-afc5-ac22b03730fb tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:49.665116 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f44aacb-cb18-4585-afc5-ac22b03730fb tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:49.692157 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-978955e6-7721-418a-9e24-cd5f02cd12e3 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c55bcf6e18a94d9781f840cb05a23abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be487ee187864a0987113d1248a873ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:49.700226 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-7f44aacb-cb18-4585-afc5-ac22b03730fb tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] HTTP exception thrown: Instance 2503f8ac-e7f9-432d-8b3b-271d1a179572 could not be found. Aug 04 16:37:49.704161 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-978955e6-7721-418a-9e24-cd5f02cd12e3 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] 10.222.0.23 "GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f" status: 200 len: 1576 microversion: 2.1 time: 0.271884 Aug 04 16:37:49.705260 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7f44aacb-cb18-4585-afc5-ac22b03730fb tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Request method failure captured: Aug 04 16:37:49.705260 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572 HTTP/1.1 Aug 04 16:37:49.705260 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:37:49.705260 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:37:49.705260 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:37:49.705260 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:37:49.705260 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:37:49.705260 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:37:49.705260 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:37:49.705260 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:37:49.705260 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_UkhV8rFKd-hpPT2QLD9lQ5k7kh_djktndGnJpVWrnqRjEXqfWnJq1oKBZG8f2yj1x5-54ox6dVWGFOjfjsJcq1OP04aJgTYKdZFqbwYGpp-yXRZpuKX_bEVN-o5PrRwb3VRH5L9nDWcApqMNcr7ECLjIQlxGdP9fPFY9O5MhyXG_4 Aug 04 16:37:49.705260 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:37:49.705260 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:37:49.705260 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:37:49.705260 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:37:49.705260 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:37:49.705260 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:37:49.705260 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 5fa4a23e6e71405f82347cd1cbbe3f84 Aug 04 16:37:49.705260 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-867178745 Aug 04 16:37:49.705260 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:37:49.705260 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:37:49.706988 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5fa4a23e6e71405f82347cd1cbbe3f84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5fa4a23e6e71405f82347cd1cbbe3f84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5fa4a23e6e71405f82347cd1cbbe3f84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5fa4a23e6e71405f82347cd1cbbe3f84"}]}] Aug 04 16:37:49.706988 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-867178745 Aug 04 16:37:49.706988 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 5fa4a23e6e71405f82347cd1cbbe3f84 Aug 04 16:37:49.706988 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-867178745 Aug 04 16:37:49.706988 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-AttachSCSIVolumeTestJSON-867178745-project Aug 04 16:37:49.706988 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:37:49.706988 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:37:49.706988 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 3fd5f11c99c841c4a7e7af4d7a4a5d4c Aug 04 16:37:49.706988 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-867178745-project Aug 04 16:37:49.706988 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:37:49.706988 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 2503f8ac-e7f9-432d-8b3b-271d1a179572 could not be found. Aug 04 16:37:49.706988 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '2503f8ac-e7f9-432d-8b3b-271d1a179572'} Aug 04 16:37:49.707964 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:37:49.707964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:37:49.707964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:37:49.707964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:37:49.707964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:37:49.707964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:37:49.707964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:37:49.707964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:37:49.707964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:37:49.707964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:37:49.707964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2503f8ac-e7f9-432d-8b3b-271d1a179572 could not be found. Aug 04 16:37:49.707964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:37:49.707964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:37:49.707964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:37:49.707964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:37:49.707964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:37:49.707964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:37:49.707964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:37:49.707964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:37:49.707964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:37:49.709387 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:37:49.709387 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:37:49.709387 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:37:49.709387 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:37:49.709387 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:37:49.709387 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:37:49.709387 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:37:49.709387 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:37:49.709387 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:37:49.709387 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2503f8ac-e7f9-432d-8b3b-271d1a179572 could not be found. Aug 04 16:37:49.709387 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:37:49.709387 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:37:49.709387 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:37:49.709387 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:37:49.709387 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:37:49.709387 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:37:49.709387 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:37:49.709387 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:37:49.709387 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2503f8ac-e7f9-432d-8b3b-271d1a179572 could not be found. Aug 04 16:37:49.709387 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:37:49.710816 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7f44aacb-cb18-4585-afc5-ac22b03730fb tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Returning 404 to user: Instance 2503f8ac-e7f9-432d-8b3b-271d1a179572 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:37:49.710816 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7f44aacb-cb18-4585-afc5-ac22b03730fb tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572" status: 404 len: 111 microversion: 2.1 time: 0.063490 Aug 04 16:37:49.712050 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 622/1203] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:49 2022] GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f => generated 1576 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:37:49.714579 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 582/1204] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:37:49 2022] DELETE /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:37:49.729197 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e57f961f-fca1-40f5-adb6-deb180e80c23 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:49.730139 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e57f961f-fca1-40f5-adb6-deb180e80c23 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] [instance: 2503f8ac-e7f9-432d-8b3b-271d1a179572] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:49.742556 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e57f961f-fca1-40f5-adb6-deb180e80c23 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:49.746226 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e57f961f-fca1-40f5-adb6-deb180e80c23 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:49.747521 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e57f961f-fca1-40f5-adb6-deb180e80c23 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:49.748212 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e57f961f-fca1-40f5-adb6-deb180e80c23 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:49.756837 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0c315584-e91e-486d-925f-89d745aa1d67 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:49.763344 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0c315584-e91e-486d-925f-89d745aa1d67 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: 532ec916-2768-43e0-a912-791fb4b5d9ea] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:49.765118 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-e57f961f-fca1-40f5-adb6-deb180e80c23 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] HTTP exception thrown: Instance 2503f8ac-e7f9-432d-8b3b-271d1a179572 could not be found. Aug 04 16:37:49.766993 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e57f961f-fca1-40f5-adb6-deb180e80c23 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Request method failure captured: Aug 04 16:37:49.766993 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572 HTTP/1.1 Aug 04 16:37:49.766993 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:37:49.766993 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:37:49.766993 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:37:49.766993 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:37:49.766993 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:37:49.766993 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:37:49.766993 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:37:49.766993 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:37:49.766993 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_UkhV8rFKd-hpPT2QLD9lQ5k7kh_djktndGnJpVWrnqRjEXqfWnJq1oKBZG8f2yj1x5-54ox6dVWGFOjfjsJcq1OP04aJgTYKdZFqbwYGpp-yXRZpuKX_bEVN-o5PrRwb3VRH5L9nDWcApqMNcr7ECLjIQlxGdP9fPFY9O5MhyXG_4 Aug 04 16:37:49.766993 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:37:49.766993 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:37:49.766993 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:37:49.766993 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:37:49.766993 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:37:49.766993 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:37:49.766993 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 5fa4a23e6e71405f82347cd1cbbe3f84 Aug 04 16:37:49.766993 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-867178745 Aug 04 16:37:49.766993 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:37:49.766993 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:37:49.769828 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5fa4a23e6e71405f82347cd1cbbe3f84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5fa4a23e6e71405f82347cd1cbbe3f84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5fa4a23e6e71405f82347cd1cbbe3f84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5fa4a23e6e71405f82347cd1cbbe3f84"}]}] Aug 04 16:37:49.769828 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-867178745 Aug 04 16:37:49.769828 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 5fa4a23e6e71405f82347cd1cbbe3f84 Aug 04 16:37:49.769828 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-867178745 Aug 04 16:37:49.769828 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-AttachSCSIVolumeTestJSON-867178745-project Aug 04 16:37:49.769828 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:37:49.769828 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:37:49.769828 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 3fd5f11c99c841c4a7e7af4d7a4a5d4c Aug 04 16:37:49.769828 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-867178745-project Aug 04 16:37:49.769828 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:37:49.769828 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 2503f8ac-e7f9-432d-8b3b-271d1a179572 could not be found. Aug 04 16:37:49.769828 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '2503f8ac-e7f9-432d-8b3b-271d1a179572'} Aug 04 16:37:49.771388 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:37:49.771388 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:37:49.771388 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:37:49.771388 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:37:49.771388 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:37:49.771388 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:37:49.771388 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:37:49.771388 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:37:49.771388 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:37:49.771388 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:37:49.771388 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2503f8ac-e7f9-432d-8b3b-271d1a179572 could not be found. Aug 04 16:37:49.771388 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:37:49.771388 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:37:49.771388 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:37:49.771388 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:37:49.771388 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:37:49.771388 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:37:49.771388 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:37:49.771388 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:37:49.771388 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:37:49.774082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:37:49.774082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:37:49.774082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:37:49.774082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:37:49.774082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:37:49.774082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:37:49.774082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:37:49.774082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2503f8ac-e7f9-432d-8b3b-271d1a179572 could not be found. Aug 04 16:37:49.774082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:37:49.774082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:37:49.774082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:37:49.774082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:37:49.774082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:37:49.774082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:37:49.774082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:37:49.774082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:37:49.774082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2503f8ac-e7f9-432d-8b3b-271d1a179572 could not be found. Aug 04 16:37:49.774082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:37:49.776710 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e57f961f-fca1-40f5-adb6-deb180e80c23 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] Returning 404 to user: Instance 2503f8ac-e7f9-432d-8b3b-271d1a179572 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:37:49.776710 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e57f961f-fca1-40f5-adb6-deb180e80c23 tempest-AttachSCSIVolumeTestJSON-867178745 tempest-AttachSCSIVolumeTestJSON-867178745-project] 10.222.0.23 "GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572" status: 404 len: 111 microversion: 2.1 time: 0.054506 Aug 04 16:37:49.776710 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 623/1205] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:49 2022] GET /compute/v2.1/servers/2503f8ac-e7f9-432d-8b3b-271d1a179572 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:37:49.782474 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-937d65b2-3fb6-46ab-8166-ff1a8e9c7821 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:49.782474 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-937d65b2-3fb6-46ab-8166-ff1a8e9c7821 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] [instance: 121a11b7-b8e0-4232-a03b-1399ef2d387f] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:49.790004 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-937d65b2-3fb6-46ab-8166-ff1a8e9c7821 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:49.790611 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-937d65b2-3fb6-46ab-8166-ff1a8e9c7821 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:49.791296 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c315584-e91e-486d-925f-89d745aa1d67 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:49.791667 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-937d65b2-3fb6-46ab-8166-ff1a8e9c7821 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:49.792236 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-937d65b2-3fb6-46ab-8166-ff1a8e9c7821 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:49.793992 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c315584-e91e-486d-925f-89d745aa1d67 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:49.795815 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c315584-e91e-486d-925f-89d745aa1d67 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:49.796879 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c315584-e91e-486d-925f-89d745aa1d67 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:49.889950 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-0c315584-e91e-486d-925f-89d745aa1d67 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lazy-loading 'flavor' on Instance uuid 532ec916-2768-43e0-a912-791fb4b5d9ea {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:37:49.972092 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-937d65b2-3fb6-46ab-8166-ff1a8e9c7821 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] 10.222.0.23 "GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.197179 Aug 04 16:37:49.973431 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 624/1206] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Aug 4 16:37:49 2022] GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f/os-interface => generated 285 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:37:50.048276 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-08da6c18-155f-41e7-b6b6-e4c3c60382c6 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:50.053093 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-08da6c18-155f-41e7-b6b6-e4c3c60382c6 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:50.075286 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-08da6c18-155f-41e7-b6b6-e4c3c60382c6 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:50.075862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-08da6c18-155f-41e7-b6b6-e4c3c60382c6 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:50.077948 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-08da6c18-155f-41e7-b6b6-e4c3c60382c6 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:50.078389 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-08da6c18-155f-41e7-b6b6-e4c3c60382c6 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:50.106841 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0c315584-e91e-486d-925f-89d745aa1d67 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "POST /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea/action" status: 200 len: 32 microversion: 2.1 time: 0.355919 Aug 04 16:37:50.110543 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 583/1207] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:37:49 2022] POST /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea/action => generated 32 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:37:50.136782 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4b44e912-fae0-455a-8543-3893abc543e8 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:50.142845 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4b44e912-fae0-455a-8543-3893abc543e8 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: 532ec916-2768-43e0-a912-791fb4b5d9ea] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:50.160700 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b44e912-fae0-455a-8543-3893abc543e8 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:50.162222 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b44e912-fae0-455a-8543-3893abc543e8 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:50.164365 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b44e912-fae0-455a-8543-3893abc543e8 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:50.165394 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b44e912-fae0-455a-8543-3893abc543e8 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:50.613575 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4b44e912-fae0-455a-8543-3893abc543e8 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:50.628138 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4b44e912-fae0-455a-8543-3893abc543e8 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea" status: 200 len: 1521 microversion: 2.1 time: 0.510771 Aug 04 16:37:50.628961 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 584/1208] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:50 2022] GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea => generated 1521 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:37:50.633558 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-532d2cb3-1a38-42cc-b8ae-bf3f0ff64266 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:50.634159 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-532d2cb3-1a38-42cc-b8ae-bf3f0ff64266 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:50.664859 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-532d2cb3-1a38-42cc-b8ae-bf3f0ff64266 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:50.665333 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-532d2cb3-1a38-42cc-b8ae-bf3f0ff64266 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:50.666158 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-532d2cb3-1a38-42cc-b8ae-bf3f0ff64266 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:50.666573 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-532d2cb3-1a38-42cc-b8ae-bf3f0ff64266 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:50.681405 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:37:50.903515 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-08da6c18-155f-41e7-b6b6-e4c3c60382c6 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:50.912381 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-08da6c18-155f-41e7-b6b6-e4c3c60382c6 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159" status: 200 len: 1717 microversion: 2.1 time: 0.877142 Aug 04 16:37:50.918456 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 625/1209] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:50 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159 => generated 1717 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:50.937215 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f087980b-fcb2-438b-9caf-1c303668123e tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:50.937862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f087980b-fcb2-438b-9caf-1c303668123e tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] [instance: 4057c3fd-7edb-499b-8623-012b46ebd651] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:50.944924 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f087980b-fcb2-438b-9caf-1c303668123e tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:50.945407 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f087980b-fcb2-438b-9caf-1c303668123e tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:50.946185 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f087980b-fcb2-438b-9caf-1c303668123e tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:50.946616 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f087980b-fcb2-438b-9caf-1c303668123e tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:50.979943 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-f087980b-fcb2-438b-9caf-1c303668123e tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] HTTP exception thrown: Instance 4057c3fd-7edb-499b-8623-012b46ebd651 could not be found. Aug 04 16:37:50.981800 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f087980b-fcb2-438b-9caf-1c303668123e tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Request method failure captured: Aug 04 16:37:50.981800 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651 HTTP/1.1 Aug 04 16:37:50.981800 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:37:50.981800 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:37:50.981800 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:37:50.981800 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:37:50.981800 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:37:50.981800 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:37:50.981800 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:37:50.981800 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:37:50.981800 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_WXeR5P1378OpHSUhHA08p94oJyeqJjq9Rmn76J7sY4kRTwpoEdr5yQ8C9d4ilK1F15kmT2fGPk_HGKgT0bbobQ-UCWVQWrl6b4Gkq67PPkdS6nm2t_cDvvwvN49YM27zBpMwpLUv089VgbOr3xyQjXpCMsSrNl7CuLtGkn9EPKJuA Aug 04 16:37:50.981800 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:37:50.981800 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:37:50.981800 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:37:50.981800 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:37:50.981800 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:37:50.981800 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:37:50.981800 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: a64446d297d1407d888376ebd3642216 Aug 04 16:37:50.981800 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 Aug 04 16:37:50.981800 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:37:50.981800 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:37:50.983367 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a64446d297d1407d888376ebd3642216"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a64446d297d1407d888376ebd3642216"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a64446d297d1407d888376ebd3642216"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a64446d297d1407d888376ebd3642216"}]}] Aug 04 16:37:50.983367 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 Aug 04 16:37:50.983367 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: a64446d297d1407d888376ebd3642216 Aug 04 16:37:50.983367 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 Aug 04 16:37:50.983367 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project Aug 04 16:37:50.983367 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:37:50.983367 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:37:50.983367 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: a2b193211a2243bc90299e112dd3cc26 Aug 04 16:37:50.983367 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project Aug 04 16:37:50.983367 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:37:50.983367 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 4057c3fd-7edb-499b-8623-012b46ebd651 could not be found. Aug 04 16:37:50.984198 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '4057c3fd-7edb-499b-8623-012b46ebd651'} Aug 04 16:37:50.984198 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:37:50.984198 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:37:50.984198 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:37:50.984198 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:37:50.984198 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:37:50.984198 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:37:50.984198 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:37:50.984198 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:37:50.984198 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:37:50.984198 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:37:50.984198 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4057c3fd-7edb-499b-8623-012b46ebd651 could not be found. Aug 04 16:37:50.984198 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:37:50.984198 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:37:50.984198 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:37:50.984198 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:37:50.984198 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:37:50.984198 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:37:50.984198 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:37:50.984198 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:37:50.985706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:37:50.985706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:37:50.985706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:37:50.985706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:37:50.985706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:37:50.985706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:37:50.985706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:37:50.985706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:37:50.985706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4057c3fd-7edb-499b-8623-012b46ebd651 could not be found. Aug 04 16:37:50.985706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:37:50.985706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:37:50.985706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:37:50.985706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:37:50.985706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:37:50.985706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:37:50.985706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:37:50.985706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:37:50.985706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4057c3fd-7edb-499b-8623-012b46ebd651 could not be found. Aug 04 16:37:50.985706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:37:50.990147 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f087980b-fcb2-438b-9caf-1c303668123e tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] Returning 404 to user: Instance 4057c3fd-7edb-499b-8623-012b46ebd651 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:37:50.990147 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f087980b-fcb2-438b-9caf-1c303668123e tempest-FloatingIPsAssociationNegativeTestJSON-2063475448 tempest-FloatingIPsAssociationNegativeTestJSON-2063475448-project] 10.222.0.23 "GET /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651" status: 404 len: 111 microversion: 2.1 time: 0.063238 Aug 04 16:37:50.997766 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 626/1210] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:50 2022] GET /compute/v2.1/servers/4057c3fd-7edb-499b-8623-012b46ebd651 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:37:51.660025 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-04d59ec8-5c3b-4eb8-89c7-cdc922c1ac12 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:51.661209 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-04d59ec8-5c3b-4eb8-89c7-cdc922c1ac12 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: 532ec916-2768-43e0-a912-791fb4b5d9ea] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:51.671191 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-04d59ec8-5c3b-4eb8-89c7-cdc922c1ac12 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:51.673165 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-04d59ec8-5c3b-4eb8-89c7-cdc922c1ac12 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:51.677131 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-04d59ec8-5c3b-4eb8-89c7-cdc922c1ac12 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:51.678599 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-04d59ec8-5c3b-4eb8-89c7-cdc922c1ac12 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:51.926695 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-532d2cb3-1a38-42cc-b8ae-bf3f0ff64266 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:51.941636 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-532d2cb3-1a38-42cc-b8ae-bf3f0ff64266 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1543 microversion: 2.1 time: 1.311568 Aug 04 16:37:51.942256 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 585/1211] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:50 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1543 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:51.949322 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-38098967-8123-48d1-9495-1aa6ad256d86 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:51.950202 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-38098967-8123-48d1-9495-1aa6ad256d86 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:51.956954 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-38098967-8123-48d1-9495-1aa6ad256d86 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:51.957524 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-38098967-8123-48d1-9495-1aa6ad256d86 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:51.958514 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-38098967-8123-48d1-9495-1aa6ad256d86 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:51.959115 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-38098967-8123-48d1-9495-1aa6ad256d86 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:52.501067 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-04d59ec8-5c3b-4eb8-89c7-cdc922c1ac12 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:52.512736 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-04d59ec8-5c3b-4eb8-89c7-cdc922c1ac12 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea" status: 200 len: 1521 microversion: 2.1 time: 0.857111 Aug 04 16:37:52.516557 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 627/1212] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:51 2022] GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea => generated 1521 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:37:52.588983 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-38098967-8123-48d1-9495-1aa6ad256d86 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:52.600491 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-38098967-8123-48d1-9495-1aa6ad256d86 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159" status: 200 len: 1717 microversion: 2.1 time: 0.655536 Aug 04 16:37:52.601927 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 586/1213] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:51 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159 => generated 1717 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:52.985692 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fa915de5-448a-49fd-add0-6049fe74ec44 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:52.986826 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fa915de5-448a-49fd-add0-6049fe74ec44 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:53.007840 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fa915de5-448a-49fd-add0-6049fe74ec44 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:53.008538 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fa915de5-448a-49fd-add0-6049fe74ec44 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:53.009817 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fa915de5-448a-49fd-add0-6049fe74ec44 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:53.010425 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fa915de5-448a-49fd-add0-6049fe74ec44 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:53.548797 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e14de516-a1d1-4dbe-9fe7-b3d41f349ee1 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:53.550876 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e14de516-a1d1-4dbe-9fe7-b3d41f349ee1 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: 532ec916-2768-43e0-a912-791fb4b5d9ea] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:53.564789 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e14de516-a1d1-4dbe-9fe7-b3d41f349ee1 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:53.565804 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e14de516-a1d1-4dbe-9fe7-b3d41f349ee1 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:53.567236 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e14de516-a1d1-4dbe-9fe7-b3d41f349ee1 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:53.568317 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e14de516-a1d1-4dbe-9fe7-b3d41f349ee1 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:53.715898 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fa915de5-448a-49fd-add0-6049fe74ec44 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:53.734160 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fa915de5-448a-49fd-add0-6049fe74ec44 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1543 microversion: 2.1 time: 0.766522 Aug 04 16:37:53.735884 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 628/1214] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:52 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1543 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:53.745231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7a40c7ca-08c3-4835-b4ba-ff44d317b9a5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:53.746983 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7a40c7ca-08c3-4835-b4ba-ff44d317b9a5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:53.758929 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a40c7ca-08c3-4835-b4ba-ff44d317b9a5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:53.760219 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a40c7ca-08c3-4835-b4ba-ff44d317b9a5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:53.761824 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a40c7ca-08c3-4835-b4ba-ff44d317b9a5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:53.762713 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a40c7ca-08c3-4835-b4ba-ff44d317b9a5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:54.607093 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e14de516-a1d1-4dbe-9fe7-b3d41f349ee1 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:54.639595 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e14de516-a1d1-4dbe-9fe7-b3d41f349ee1 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea" status: 200 len: 1521 microversion: 2.1 time: 1.094535 Aug 04 16:37:54.643436 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 587/1215] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:53 2022] GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea => generated 1521 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:37:54.767903 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7a40c7ca-08c3-4835-b4ba-ff44d317b9a5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:54.777079 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7a40c7ca-08c3-4835-b4ba-ff44d317b9a5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159" status: 200 len: 1717 microversion: 2.1 time: 1.038998 Aug 04 16:37:54.784870 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-aa76b226-6cd0-4a00-ba9c-f1d41755ff45 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:54.788911 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-aa76b226-6cd0-4a00-ba9c-f1d41755ff45 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:54.790331 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 629/1216] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:53 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159 => generated 1717 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:54.824609 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aa76b226-6cd0-4a00-ba9c-f1d41755ff45 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:54.825996 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aa76b226-6cd0-4a00-ba9c-f1d41755ff45 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:54.827781 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aa76b226-6cd0-4a00-ba9c-f1d41755ff45 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:54.828911 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aa76b226-6cd0-4a00-ba9c-f1d41755ff45 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:55.199954 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5ce0fc5b-a28b-4e8a-9eae-c60084c27a62 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:55.200674 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5ce0fc5b-a28b-4e8a-9eae-c60084c27a62 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] [instance: 121a11b7-b8e0-4232-a03b-1399ef2d387f] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:55.207296 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:37:55.213487 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ce0fc5b-a28b-4e8a-9eae-c60084c27a62 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:55.214051 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ce0fc5b-a28b-4e8a-9eae-c60084c27a62 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:55.226303 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ce0fc5b-a28b-4e8a-9eae-c60084c27a62 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:55.226758 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ce0fc5b-a28b-4e8a-9eae-c60084c27a62 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:55.516757 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-aa76b226-6cd0-4a00-ba9c-f1d41755ff45 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:55.551186 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-aa76b226-6cd0-4a00-ba9c-f1d41755ff45 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1543 microversion: 2.1 time: 0.792375 Aug 04 16:37:55.552092 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 588/1217] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:54 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1543 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:37:55.647166 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5ce0fc5b-a28b-4e8a-9eae-c60084c27a62 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c55bcf6e18a94d9781f840cb05a23abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be487ee187864a0987113d1248a873ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:55.665915 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5ce0fc5b-a28b-4e8a-9eae-c60084c27a62 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] 10.222.0.23 "GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f" status: 200 len: 1576 microversion: 2.1 time: 0.469468 Aug 04 16:37:55.687894 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 630/1218] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:55 2022] GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f => generated 1576 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:55.697165 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8a7622ca-2bde-4122-a1f6-5e51cfd421a5 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:55.702528 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8a7622ca-2bde-4122-a1f6-5e51cfd421a5 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: 532ec916-2768-43e0-a912-791fb4b5d9ea] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:55.718682 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8a7622ca-2bde-4122-a1f6-5e51cfd421a5 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:55.720372 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8a7622ca-2bde-4122-a1f6-5e51cfd421a5 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:55.724805 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8a7622ca-2bde-4122-a1f6-5e51cfd421a5 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:55.725689 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8a7622ca-2bde-4122-a1f6-5e51cfd421a5 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:55.763869 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-d688bd68-f443-4afc-9919-b3a4652aebcb req-cd6f7863-6a8e-4341-9014-517e87528fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "121a11b7-b8e0-4232-a03b-1399ef2d387f", "tag": "c9ddc57c-cecd-45c7-8bc9-495ab0624e7e"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:55.779413 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=100 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:37:55.798258 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-d688bd68-f443-4afc-9919-b3a4652aebcb req-cd6f7863-6a8e-4341-9014-517e87528fc0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:55.799548 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-d688bd68-f443-4afc-9919-b3a4652aebcb req-cd6f7863-6a8e-4341-9014-517e87528fc0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:55.820576 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-d688bd68-f443-4afc-9919-b3a4652aebcb req-cd6f7863-6a8e-4341-9014-517e87528fc0 service nova] Creating event network-changed:c9ddc57c-cecd-45c7-8bc9-495ab0624e7e for instance 121a11b7-b8e0-4232-a03b-1399ef2d387f on n-h2-846466-12 Aug 04 16:37:55.828078 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-d688bd68-f443-4afc-9919-b3a4652aebcb req-cd6f7863-6a8e-4341-9014-517e87528fc0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.273780 Aug 04 16:37:55.829393 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 589/1219] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:37:55.840178 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-92babbcf-cbe6-4cae-a1dd-1379018a234b tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:55.840661 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-92babbcf-cbe6-4cae-a1dd-1379018a234b tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:55.847946 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-92babbcf-cbe6-4cae-a1dd-1379018a234b tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:55.848391 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-92babbcf-cbe6-4cae-a1dd-1379018a234b tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:55.849200 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-92babbcf-cbe6-4cae-a1dd-1379018a234b tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:55.849660 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-92babbcf-cbe6-4cae-a1dd-1379018a234b tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:56.428230 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-92babbcf-cbe6-4cae-a1dd-1379018a234b tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:56.437554 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-92babbcf-cbe6-4cae-a1dd-1379018a234b tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159" status: 200 len: 1717 microversion: 2.1 time: 0.606437 Aug 04 16:37:56.438160 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 590/1220] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:55 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159 => generated 1717 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:56.460871 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8a7622ca-2bde-4122-a1f6-5e51cfd421a5 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:56.477591 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8a7622ca-2bde-4122-a1f6-5e51cfd421a5 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea" status: 200 len: 1521 microversion: 2.1 time: 0.787367 Aug 04 16:37:56.478051 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 631/1221] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:55 2022] GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea => generated 1521 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:56.494893 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a805c5e9-b258-4a57-9e25-aa4c6c4fdfd0 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:56.495755 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a805c5e9-b258-4a57-9e25-aa4c6c4fdfd0 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:56.511167 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a805c5e9-b258-4a57-9e25-aa4c6c4fdfd0 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:56.514850 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a805c5e9-b258-4a57-9e25-aa4c6c4fdfd0 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:56.515727 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a805c5e9-b258-4a57-9e25-aa4c6c4fdfd0 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:56.516166 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a805c5e9-b258-4a57-9e25-aa4c6c4fdfd0 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:56.590321 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a6396349-f4ab-4d44-94f9-c948d74d06ac tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:56.591040 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a6396349-f4ab-4d44-94f9-c948d74d06ac tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:56.597913 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6396349-f4ab-4d44-94f9-c948d74d06ac tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:56.598447 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6396349-f4ab-4d44-94f9-c948d74d06ac tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:56.599333 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6396349-f4ab-4d44-94f9-c948d74d06ac tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:56.599815 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6396349-f4ab-4d44-94f9-c948d74d06ac tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:57.113044 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-a805c5e9-b258-4a57-9e25-aa4c6c4fdfd0 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lazy-loading 'services' on Instance uuid 5021f3f8-aa8b-4c94-8846-fdd1081135f5 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:37:57.151790 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a6396349-f4ab-4d44-94f9-c948d74d06ac tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:57.156322 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a805c5e9-b258-4a57-9e25-aa4c6c4fdfd0 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 2425 microversion: 2.25 time: 0.676950 Aug 04 16:37:57.160434 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a6396349-f4ab-4d44-94f9-c948d74d06ac tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1543 microversion: 2.1 time: 0.574303 Aug 04 16:37:57.176606 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 591/1222] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:37:56 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 2425 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:37:57.180606 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 632/1223] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:56 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1543 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:37:57.191344 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b885b193-eb67-4627-9a8a-4b4eb06627fc tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-846466-12", "block_migration": "auto"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:37:57.196494 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b885b193-eb67-4627-9a8a-4b4eb06627fc tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:57.211789 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b885b193-eb67-4627-9a8a-4b4eb06627fc tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:57.212792 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b885b193-eb67-4627-9a8a-4b4eb06627fc tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:57.214942 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b885b193-eb67-4627-9a8a-4b4eb06627fc tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:57.216079 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b885b193-eb67-4627-9a8a-4b4eb06627fc tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:57.265350 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-b885b193-eb67-4627-9a8a-4b4eb06627fc tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lazy-loading 'flavor' on Instance uuid 5021f3f8-aa8b-4c94-8846-fdd1081135f5 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:37:57.282349 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b885b193-eb67-4627-9a8a-4b4eb06627fc tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Going to try to live migrate instance to n-h2-846466-12 {{(pid=126126) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 16:37:57.460681 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9a1ef28f-8293-41af-9b2a-0084e8c057f5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:57.461871 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9a1ef28f-8293-41af-9b2a-0084e8c057f5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:57.470436 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9a1ef28f-8293-41af-9b2a-0084e8c057f5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:57.471461 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9a1ef28f-8293-41af-9b2a-0084e8c057f5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:57.472396 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9a1ef28f-8293-41af-9b2a-0084e8c057f5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:57.473193 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9a1ef28f-8293-41af-9b2a-0084e8c057f5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:58.223094 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9a1ef28f-8293-41af-9b2a-0084e8c057f5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:58.233198 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9a1ef28f-8293-41af-9b2a-0084e8c057f5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159" status: 200 len: 1717 microversion: 2.1 time: 0.777115 Aug 04 16:37:58.248813 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 633/1224] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:57 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159 => generated 1717 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:37:58.254569 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d59325e4-5f1c-4e46-8ae8-3b7d7d3f2354 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:58.255599 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d59325e4-5f1c-4e46-8ae8-3b7d7d3f2354 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: 532ec916-2768-43e0-a912-791fb4b5d9ea] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:58.263389 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d59325e4-5f1c-4e46-8ae8-3b7d7d3f2354 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:58.264178 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d59325e4-5f1c-4e46-8ae8-3b7d7d3f2354 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:58.265241 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d59325e4-5f1c-4e46-8ae8-3b7d7d3f2354 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:58.265909 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d59325e4-5f1c-4e46-8ae8-3b7d7d3f2354 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:58.777567 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d59325e4-5f1c-4e46-8ae8-3b7d7d3f2354 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:58.832335 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d59325e4-5f1c-4e46-8ae8-3b7d7d3f2354 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea" status: 200 len: 1521 microversion: 2.1 time: 0.554950 Aug 04 16:37:58.833557 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 634/1225] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:58 2022] GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea => generated 1521 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:37:58.855348 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-23965eaa-0cc5-40db-9b65-33ebc2119dbe tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:58.878795 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-23965eaa-0cc5-40db-9b65-33ebc2119dbe tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '23645970a9a24e94b10b8578bb30b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5527cc7c4944c7898b64308f13b850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:37:58.882990 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-23965eaa-0cc5-40db-9b65-33ebc2119dbe tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Searching by: {'deleted': False, 'project_id': '4b5527cc7c4944c7898b64308f13b850'} {{(pid=126125) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:37:58.937672 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-23965eaa-0cc5-40db-9b65-33ebc2119dbe tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:58.938937 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-23965eaa-0cc5-40db-9b65-33ebc2119dbe tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:58.943807 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-23965eaa-0cc5-40db-9b65-33ebc2119dbe tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:58.947156 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-23965eaa-0cc5-40db-9b65-33ebc2119dbe tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:59.307262 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.multi_cell_list [None req-23965eaa-0cc5-40db-9b65-33ebc2119dbe tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:37:59.743307 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b885b193-eb67-4627-9a8a-4b4eb06627fc tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5/action" status: 202 len: 0 microversion: 2.25 time: 2.562936 Aug 04 16:37:59.745881 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 592/1226] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Aug 4 16:37:57 2022] POST /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5/action => generated 0 bytes in 2568 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:37:59.788307 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dd5ffb19-1e28-4da2-9d9b-d9d91f379652 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:59.792912 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-dd5ffb19-1e28-4da2-9d9b-d9d91f379652 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:59.830485 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd5ffb19-1e28-4da2-9d9b-d9d91f379652 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:59.831838 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd5ffb19-1e28-4da2-9d9b-d9d91f379652 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:59.834383 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd5ffb19-1e28-4da2-9d9b-d9d91f379652 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:59.839174 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd5ffb19-1e28-4da2-9d9b-d9d91f379652 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:59.879174 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-23965eaa-0cc5-40db-9b65-33ebc2119dbe tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 1.043990 Aug 04 16:37:59.880166 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 635/1227] 10.222.0.23 () {58 vars in 1125 bytes} [Thu Aug 4 16:37:58 2022] GET /compute/v2.1/servers => generated 339 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:37:59.886429 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-001c94e9-db40-4968-9fbe-bce3b26d7da5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:37:59.887041 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-001c94e9-db40-4968-9fbe-bce3b26d7da5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:37:59.897541 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-001c94e9-db40-4968-9fbe-bce3b26d7da5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:59.898268 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-001c94e9-db40-4968-9fbe-bce3b26d7da5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:37:59.899201 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-001c94e9-db40-4968-9fbe-bce3b26d7da5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:37:59.899636 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-001c94e9-db40-4968-9fbe-bce3b26d7da5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:00.306197 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-001c94e9-db40-4968-9fbe-bce3b26d7da5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:00.332849 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-001c94e9-db40-4968-9fbe-bce3b26d7da5 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159" status: 200 len: 1707 microversion: 2.1 time: 0.450565 Aug 04 16:38:00.357948 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 636/1228] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:59 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159 => generated 1707 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:00.365335 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-dd5ffb19-1e28-4da2-9d9b-d9d91f379652 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:00.367358 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0d7d01bc-8d40-45e5-a6f5-6836d29529e1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:00.368590 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0d7d01bc-8d40-45e5-a6f5-6836d29529e1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:00.382434 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0d7d01bc-8d40-45e5-a6f5-6836d29529e1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:00.383196 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0d7d01bc-8d40-45e5-a6f5-6836d29529e1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:00.384645 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0d7d01bc-8d40-45e5-a6f5-6836d29529e1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:00.385456 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0d7d01bc-8d40-45e5-a6f5-6836d29529e1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:00.390918 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dd5ffb19-1e28-4da2-9d9b-d9d91f379652 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1543 microversion: 2.1 time: 0.624854 Aug 04 16:38:00.391536 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 593/1229] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:37:59 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1543 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:00.396880 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3be00cf1-79f4-4169-9af3-684f9cdc75ae tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:00.397513 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3be00cf1-79f4-4169-9af3-684f9cdc75ae tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: 532ec916-2768-43e0-a912-791fb4b5d9ea] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:00.405255 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3be00cf1-79f4-4169-9af3-684f9cdc75ae tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:00.406077 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3be00cf1-79f4-4169-9af3-684f9cdc75ae tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:00.407084 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3be00cf1-79f4-4169-9af3-684f9cdc75ae tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:00.407701 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3be00cf1-79f4-4169-9af3-684f9cdc75ae tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:00.770164 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0d7d01bc-8d40-45e5-a6f5-6836d29529e1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:00.783533 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0d7d01bc-8d40-45e5-a6f5-6836d29529e1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:00.785085 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0d7d01bc-8d40-45e5-a6f5-6836d29529e1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:00.788119 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0d7d01bc-8d40-45e5-a6f5-6836d29529e1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 1814 microversion: 2.25 time: 0.425611 Aug 04 16:38:00.788711 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 637/1230] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:38:00 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 1814 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:38:00.794740 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-02dee7db-fc8a-49cb-92fa-8fa4b2d4a743 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:00.800510 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-02dee7db-fc8a-49cb-92fa-8fa4b2d4a743 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '23645970a9a24e94b10b8578bb30b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5527cc7c4944c7898b64308f13b850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:00.801310 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-02dee7db-fc8a-49cb-92fa-8fa4b2d4a743 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Searching by: {'deleted': False, 'project_id': '4b5527cc7c4944c7898b64308f13b850'} {{(pid=126125) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:38:00.807717 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02dee7db-fc8a-49cb-92fa-8fa4b2d4a743 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:00.808000 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02dee7db-fc8a-49cb-92fa-8fa4b2d4a743 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:00.808745 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02dee7db-fc8a-49cb-92fa-8fa4b2d4a743 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:00.809244 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02dee7db-fc8a-49cb-92fa-8fa4b2d4a743 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:00.828273 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3be00cf1-79f4-4169-9af3-684f9cdc75ae tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:00.847053 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3be00cf1-79f4-4169-9af3-684f9cdc75ae tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea" status: 200 len: 1521 microversion: 2.1 time: 0.453969 Aug 04 16:38:00.847908 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 594/1231] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:00 2022] GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea => generated 1521 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:00.864050 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-be3bf53c-abd7-4677-8123-7d885d74d56e tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Calling method '.version_select at 0x7f7e84af1310>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:00.868010 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be3bf53c-abd7-4677-8123-7d885d74d56e tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:00.868726 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be3bf53c-abd7-4677-8123-7d885d74d56e tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:00.886222 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-be3bf53c-abd7-4677-8123-7d885d74d56e tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 3532 microversion: 2.1 time: 0.025826 Aug 04 16:38:00.892227 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 595/1232] 10.222.0.23 () {58 vars in 1143 bytes} [Thu Aug 4 16:38:00 2022] GET /compute/v2.1/os-migrations => generated 3532 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:00.919934 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1400bff7-8731-42a7-a2ce-b13753183e15 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:00.921261 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1400bff7-8731-42a7-a2ce-b13753183e15 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:00.933019 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1400bff7-8731-42a7-a2ce-b13753183e15 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:00.934477 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1400bff7-8731-42a7-a2ce-b13753183e15 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:00.936132 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1400bff7-8731-42a7-a2ce-b13753183e15 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:00.937213 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1400bff7-8731-42a7-a2ce-b13753183e15 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:00.987507 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.multi_cell_list [None req-02dee7db-fc8a-49cb-92fa-8fa4b2d4a743 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:38:01.084101 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-02dee7db-fc8a-49cb-92fa-8fa4b2d4a743 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23645970a9a24e94b10b8578bb30b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5527cc7c4944c7898b64308f13b850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:01.093063 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02dee7db-fc8a-49cb-92fa-8fa4b2d4a743 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:01.093667 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02dee7db-fc8a-49cb-92fa-8fa4b2d4a743 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:01.540661 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1400bff7-8731-42a7-a2ce-b13753183e15 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159" status: 200 len: 1860 microversion: 2.1 time: 0.627683 Aug 04 16:38:01.541680 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 596/1233] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:00 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159 => generated 1860 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:01.564839 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b67c95d6-64cb-46a4-960a-5a4344fde0e7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:01.566078 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b67c95d6-64cb-46a4-960a-5a4344fde0e7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:01.585905 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b67c95d6-64cb-46a4-960a-5a4344fde0e7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:01.586331 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b67c95d6-64cb-46a4-960a-5a4344fde0e7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:01.590516 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b67c95d6-64cb-46a4-960a-5a4344fde0e7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:01.591032 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b67c95d6-64cb-46a4-960a-5a4344fde0e7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:01.646535 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-02dee7db-fc8a-49cb-92fa-8fa4b2d4a743 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.856525 Aug 04 16:38:01.662211 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 638/1234] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:38:00 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:01.673151 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4972deb3-d998-486c-af54-bc84b6e83195 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:01.673893 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4972deb3-d998-486c-af54-bc84b6e83195 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:01.681977 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4972deb3-d998-486c-af54-bc84b6e83195 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:01.682736 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4972deb3-d998-486c-af54-bc84b6e83195 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:01.684008 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4972deb3-d998-486c-af54-bc84b6e83195 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:01.684865 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4972deb3-d998-486c-af54-bc84b6e83195 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:01.981391 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b67c95d6-64cb-46a4-960a-5a4344fde0e7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:02.004486 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b67c95d6-64cb-46a4-960a-5a4344fde0e7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1543 microversion: 2.1 time: 0.453180 Aug 04 16:38:02.005303 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 597/1235] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:01 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1543 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:02.010603 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cc82af14-3624-4940-88fc-f85c03587d24 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:02.028214 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cc82af14-3624-4940-88fc-f85c03587d24 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021479 Aug 04 16:38:02.033365 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 598/1236] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Aug 4 16:38:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:38:02.038987 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-44a3ab8a-6212-43a4-9e82-e8465396f115 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:02.048124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-44a3ab8a-6212-43a4-9e82-e8465396f115 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:02.062109 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-44a3ab8a-6212-43a4-9e82-e8465396f115 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:02.064956 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-44a3ab8a-6212-43a4-9e82-e8465396f115 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:02.067178 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-44a3ab8a-6212-43a4-9e82-e8465396f115 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:02.069237 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-44a3ab8a-6212-43a4-9e82-e8465396f115 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:02.101792 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4972deb3-d998-486c-af54-bc84b6e83195 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159" status: 200 len: 1860 microversion: 2.1 time: 0.437858 Aug 04 16:38:02.110725 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 639/1237] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:01 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159 => generated 1860 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:02.122498 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c717d4a4-c2c8-4577-a0b6-0959d22b1db3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:02.123975 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c717d4a4-c2c8-4577-a0b6-0959d22b1db3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: 532ec916-2768-43e0-a912-791fb4b5d9ea] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:02.134159 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c717d4a4-c2c8-4577-a0b6-0959d22b1db3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:02.146109 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c717d4a4-c2c8-4577-a0b6-0959d22b1db3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:02.147502 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c717d4a4-c2c8-4577-a0b6-0959d22b1db3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:02.148127 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c717d4a4-c2c8-4577-a0b6-0959d22b1db3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:02.584313 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c717d4a4-c2c8-4577-a0b6-0959d22b1db3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:02.594522 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c717d4a4-c2c8-4577-a0b6-0959d22b1db3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea" status: 200 len: 1521 microversion: 2.1 time: 0.482343 Aug 04 16:38:02.601869 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 640/1238] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:02 2022] GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea => generated 1521 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:02.610926 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-44a3ab8a-6212-43a4-9e82-e8465396f115 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:02.623879 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3663bf54-8c04-4842-9218-400eba56a016 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:02.625231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3663bf54-8c04-4842-9218-400eba56a016 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:02.628827 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-44a3ab8a-6212-43a4-9e82-e8465396f115 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:02.639334 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-44a3ab8a-6212-43a4-9e82-e8465396f115 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:02.640649 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-44a3ab8a-6212-43a4-9e82-e8465396f115 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 1814 microversion: 2.25 time: 0.605886 Aug 04 16:38:02.641237 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 599/1239] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:38:02 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 1814 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:38:02.654366 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7ecd79cf-b0d4-4844-a127-4d4960fdb194 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:02.655273 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7ecd79cf-b0d4-4844-a127-4d4960fdb194 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] [instance: 2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:02.669894 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7ecd79cf-b0d4-4844-a127-4d4960fdb194 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:02.676610 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3663bf54-8c04-4842-9218-400eba56a016 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:02.678063 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7ecd79cf-b0d4-4844-a127-4d4960fdb194 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:02.678563 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3663bf54-8c04-4842-9218-400eba56a016 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:02.679302 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7ecd79cf-b0d4-4844-a127-4d4960fdb194 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:02.679850 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7ecd79cf-b0d4-4844-a127-4d4960fdb194 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:02.681180 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3663bf54-8c04-4842-9218-400eba56a016 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:02.683280 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3663bf54-8c04-4842-9218-400eba56a016 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:02.744009 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7ecd79cf-b0d4-4844-a127-4d4960fdb194 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] [instance: 2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:38:02.832771 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:38:02.981104 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-3663bf54-8c04-4842-9218-400eba56a016 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lazy-loading 'services' on Instance uuid b359364c-f234-4d01-9c08-e6df8a21f159 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:38:02.996510 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7ecd79cf-b0d4-4844-a127-4d4960fdb194 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88" status: 204 len: 0 microversion: 2.1 time: 0.353063 Aug 04 16:38:02.997679 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 600/1240] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:38:02 2022] DELETE /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:38:03.013549 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-00063eee-8355-49c9-9f3c-a502964495e9 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:03.014855 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-00063eee-8355-49c9-9f3c-a502964495e9 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] [instance: 2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:03.043684 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-00063eee-8355-49c9-9f3c-a502964495e9 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:03.044472 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-00063eee-8355-49c9-9f3c-a502964495e9 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:03.045864 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-00063eee-8355-49c9-9f3c-a502964495e9 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:03.051891 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-00063eee-8355-49c9-9f3c-a502964495e9 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:03.194365 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3663bf54-8c04-4842-9218-400eba56a016 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159/os-volume_attachments/8b0418ca-d403-44e8-bc86-ba50f88fd65a" status: 202 len: 0 microversion: 2.1 time: 0.590475 Aug 04 16:38:03.201259 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 641/1241] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Aug 4 16:38:02 2022] DELETE /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159/os-volume_attachments/8b0418ca-d403-44e8-bc86-ba50f88fd65a => generated 0 bytes in 599 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:38:03.226395 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-53cee5f9-7402-4ff0-b82a-af7827923635 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:03.228392 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-53cee5f9-7402-4ff0-b82a-af7827923635 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:03.251431 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-53cee5f9-7402-4ff0-b82a-af7827923635 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:03.253303 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-53cee5f9-7402-4ff0-b82a-af7827923635 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:03.265483 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-53cee5f9-7402-4ff0-b82a-af7827923635 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:03.266733 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-53cee5f9-7402-4ff0-b82a-af7827923635 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:03.934982 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-00063eee-8355-49c9-9f3c-a502964495e9 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23645970a9a24e94b10b8578bb30b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5527cc7c4944c7898b64308f13b850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:03.957269 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-00063eee-8355-49c9-9f3c-a502964495e9 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] 10.222.0.23 "GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88" status: 200 len: 1713 microversion: 2.1 time: 0.952258 Aug 04 16:38:03.959043 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 601/1242] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:03 2022] GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88 => generated 1713 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:38:03.977403 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-53cee5f9-7402-4ff0-b82a-af7827923635 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:03.986894 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7e574bdd-a840-4443-8f58-4eb860996fad tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:03.996310 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7e574bdd-a840-4443-8f58-4eb860996fad tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:04.007143 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-53cee5f9-7402-4ff0-b82a-af7827923635 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1543 microversion: 2.1 time: 0.803556 Aug 04 16:38:04.025199 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 642/1243] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:03 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1543 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:04.041452 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7e574bdd-a840-4443-8f58-4eb860996fad tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:04.042518 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-14c3866a-0940-4083-a794-d4b2b3467ece tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:04.043154 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-14c3866a-0940-4083-a794-d4b2b3467ece tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: 532ec916-2768-43e0-a912-791fb4b5d9ea] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:04.043874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7e574bdd-a840-4443-8f58-4eb860996fad tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:04.045677 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7e574bdd-a840-4443-8f58-4eb860996fad tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:04.048077 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7e574bdd-a840-4443-8f58-4eb860996fad tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:04.056946 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14c3866a-0940-4083-a794-d4b2b3467ece tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:04.059339 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14c3866a-0940-4083-a794-d4b2b3467ece tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:04.060499 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14c3866a-0940-4083-a794-d4b2b3467ece tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:04.061118 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14c3866a-0940-4083-a794-d4b2b3467ece tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:04.200646 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7e574bdd-a840-4443-8f58-4eb860996fad tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.239269 Aug 04 16:38:04.203561 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 602/1244] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 16:38:03 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159/os-volume_attachments => generated 197 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:38:04.219019 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ade1ea4b-8ad2-41d7-b997-9baaed895999 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:04.222751 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ade1ea4b-8ad2-41d7-b997-9baaed895999 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:04.240062 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ade1ea4b-8ad2-41d7-b997-9baaed895999 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:04.241751 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ade1ea4b-8ad2-41d7-b997-9baaed895999 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:04.243814 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ade1ea4b-8ad2-41d7-b997-9baaed895999 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:04.244281 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ade1ea4b-8ad2-41d7-b997-9baaed895999 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:05.107405 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ade1ea4b-8ad2-41d7-b997-9baaed895999 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:05.119393 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ade1ea4b-8ad2-41d7-b997-9baaed895999 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:05.127545 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ade1ea4b-8ad2-41d7-b997-9baaed895999 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:05.130528 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ade1ea4b-8ad2-41d7-b997-9baaed895999 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 1814 microversion: 2.25 time: 0.924894 Aug 04 16:38:05.136422 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 603/1245] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:38:04 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 1814 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:38:05.143709 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d84e2250-62b5-4447-b79b-f3393c7a9b93 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:05.153182 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d84e2250-62b5-4447-b79b-f3393c7a9b93 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] [instance: 2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:05.166726 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d84e2250-62b5-4447-b79b-f3393c7a9b93 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:05.167520 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d84e2250-62b5-4447-b79b-f3393c7a9b93 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:05.168686 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d84e2250-62b5-4447-b79b-f3393c7a9b93 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:05.169516 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d84e2250-62b5-4447-b79b-f3393c7a9b93 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:05.262971 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-14c3866a-0940-4083-a794-d4b2b3467ece tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:05.291426 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-14c3866a-0940-4083-a794-d4b2b3467ece tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea" status: 200 len: 1521 microversion: 2.1 time: 1.263485 Aug 04 16:38:05.293578 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 643/1246] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:04 2022] GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea => generated 1521 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:05.306634 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-75337960-ddfa-47bb-8536-4e3f88b0f4b5 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:05.308523 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-75337960-ddfa-47bb-8536-4e3f88b0f4b5 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:05.323402 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-75337960-ddfa-47bb-8536-4e3f88b0f4b5 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:05.324813 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-75337960-ddfa-47bb-8536-4e3f88b0f4b5 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:05.326592 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-75337960-ddfa-47bb-8536-4e3f88b0f4b5 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:05.327785 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-75337960-ddfa-47bb-8536-4e3f88b0f4b5 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:05.661199 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d84e2250-62b5-4447-b79b-f3393c7a9b93 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23645970a9a24e94b10b8578bb30b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5527cc7c4944c7898b64308f13b850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:05.678739 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d84e2250-62b5-4447-b79b-f3393c7a9b93 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] 10.222.0.23 "GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88" status: 200 len: 1713 microversion: 2.1 time: 0.540506 Aug 04 16:38:05.698485 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 604/1247] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:05 2022] GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88 => generated 1713 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:05.720421 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ee9d138b-af11-469d-9854-13b3a7b8d752 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:05.725151 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ee9d138b-af11-469d-9854-13b3a7b8d752 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:05.740901 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ee9d138b-af11-469d-9854-13b3a7b8d752 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:05.742154 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ee9d138b-af11-469d-9854-13b3a7b8d752 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:05.743998 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ee9d138b-af11-469d-9854-13b3a7b8d752 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:05.745259 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ee9d138b-af11-469d-9854-13b3a7b8d752 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:05.796466 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ee9d138b-af11-469d-9854-13b3a7b8d752 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095680 Aug 04 16:38:05.797830 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 605/1248] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 16:38:05 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:38:05.919962 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-75337960-ddfa-47bb-8536-4e3f88b0f4b5 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:05.941162 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-75337960-ddfa-47bb-8536-4e3f88b0f4b5 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1543 microversion: 2.1 time: 0.644784 Aug 04 16:38:05.943410 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 644/1249] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:05 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1543 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:06.180264 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bca34240-1113-40f7-9fe8-4c374d86b543 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:06.181760 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bca34240-1113-40f7-9fe8-4c374d86b543 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:06.190156 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bca34240-1113-40f7-9fe8-4c374d86b543 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:06.191004 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bca34240-1113-40f7-9fe8-4c374d86b543 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:06.192206 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bca34240-1113-40f7-9fe8-4c374d86b543 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:06.192903 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bca34240-1113-40f7-9fe8-4c374d86b543 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:06.336042 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-83d15b83-0b36-41f1-bdaf-3862d1b3bc68 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:06.338066 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-83d15b83-0b36-41f1-bdaf-3862d1b3bc68 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: 532ec916-2768-43e0-a912-791fb4b5d9ea] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:06.354036 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-83d15b83-0b36-41f1-bdaf-3862d1b3bc68 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:06.356721 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-83d15b83-0b36-41f1-bdaf-3862d1b3bc68 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:06.359602 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-83d15b83-0b36-41f1-bdaf-3862d1b3bc68 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:06.363019 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-83d15b83-0b36-41f1-bdaf-3862d1b3bc68 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:07.516029 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-83d15b83-0b36-41f1-bdaf-3862d1b3bc68 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:07.536555 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-83d15b83-0b36-41f1-bdaf-3862d1b3bc68 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea" status: 200 len: 1521 microversion: 2.1 time: 1.204619 Aug 04 16:38:07.554853 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 645/1250] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:06 2022] GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea => generated 1521 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:07.588739 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ab9638b9-5e7e-467a-8728-a7d47ee244d1 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:07.594357 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ab9638b9-5e7e-467a-8728-a7d47ee244d1 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] [instance: 2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:07.607982 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab9638b9-5e7e-467a-8728-a7d47ee244d1 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:07.609173 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab9638b9-5e7e-467a-8728-a7d47ee244d1 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:07.611630 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab9638b9-5e7e-467a-8728-a7d47ee244d1 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:07.613140 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab9638b9-5e7e-467a-8728-a7d47ee244d1 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:07.674285 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:38:08.009591 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ab9638b9-5e7e-467a-8728-a7d47ee244d1 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23645970a9a24e94b10b8578bb30b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5527cc7c4944c7898b64308f13b850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:08.030659 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ab9638b9-5e7e-467a-8728-a7d47ee244d1 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] 10.222.0.23 "GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88" status: 200 len: 1645 microversion: 2.1 time: 0.473129 Aug 04 16:38:08.032671 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 646/1251] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:07 2022] GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88 => generated 1645 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:08.044381 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d04c954a-8193-4ec8-afbb-1b7af6ec5f68 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:08.049929 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d04c954a-8193-4ec8-afbb-1b7af6ec5f68 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:08.067826 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d04c954a-8193-4ec8-afbb-1b7af6ec5f68 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:08.069047 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d04c954a-8193-4ec8-afbb-1b7af6ec5f68 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:08.072510 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d04c954a-8193-4ec8-afbb-1b7af6ec5f68 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:08.074065 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d04c954a-8193-4ec8-afbb-1b7af6ec5f68 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:08.127061 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bca34240-1113-40f7-9fe8-4c374d86b543 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:08.140272 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bca34240-1113-40f7-9fe8-4c374d86b543 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:08.158059 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bca34240-1113-40f7-9fe8-4c374d86b543 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:08.165726 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bca34240-1113-40f7-9fe8-4c374d86b543 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 1814 microversion: 2.25 time: 1.990020 Aug 04 16:38:08.166766 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 606/1252] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:38:06 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 1814 bytes in 1992 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:38:08.180107 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9e60e8a6-ea80-491c-91d6-64230e232524 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:08.185167 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9e60e8a6-ea80-491c-91d6-64230e232524 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:08.191032 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d04c954a-8193-4ec8-afbb-1b7af6ec5f68 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155878 Aug 04 16:38:08.204191 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 647/1253] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 16:38:08 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:38:08.211786 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e60e8a6-ea80-491c-91d6-64230e232524 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:08.212634 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e60e8a6-ea80-491c-91d6-64230e232524 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:08.217693 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e60e8a6-ea80-491c-91d6-64230e232524 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:08.220926 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e60e8a6-ea80-491c-91d6-64230e232524 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:08.597734 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e12f159d-4692-4d2e-9bb6-2de51e5e1ff3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:08.600490 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e12f159d-4692-4d2e-9bb6-2de51e5e1ff3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: 532ec916-2768-43e0-a912-791fb4b5d9ea] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:08.622700 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e12f159d-4692-4d2e-9bb6-2de51e5e1ff3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:08.626509 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e12f159d-4692-4d2e-9bb6-2de51e5e1ff3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:08.642851 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e12f159d-4692-4d2e-9bb6-2de51e5e1ff3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:08.648648 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e12f159d-4692-4d2e-9bb6-2de51e5e1ff3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:09.309428 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9e60e8a6-ea80-491c-91d6-64230e232524 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:09.321545 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9e60e8a6-ea80-491c-91d6-64230e232524 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1543 microversion: 2.1 time: 1.146868 Aug 04 16:38:09.325778 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 607/1254] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:08 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1543 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:09.334733 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-03d4c9e7-dd3f-4d87-ae79-35388f58b2d5 req-8cf1c720-f95f-4b4f-9521-9b9ce3999a23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88", "name": "network-vif-deleted", "tag": "04a72ae1-98a2-4e1f-9e4c-91b9c892ac34"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:38:09.368633 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-03d4c9e7-dd3f-4d87-ae79-35388f58b2d5 req-8cf1c720-f95f-4b4f-9521-9b9ce3999a23 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:09.369795 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-03d4c9e7-dd3f-4d87-ae79-35388f58b2d5 req-8cf1c720-f95f-4b4f-9521-9b9ce3999a23 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:09.406711 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-03d4c9e7-dd3f-4d87-ae79-35388f58b2d5 req-8cf1c720-f95f-4b4f-9521-9b9ce3999a23 service nova] Creating event network-vif-deleted:04a72ae1-98a2-4e1f-9e4c-91b9c892ac34 for instance 2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88 on n-h1-846466-12 Aug 04 16:38:09.450898 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-03d4c9e7-dd3f-4d87-ae79-35388f58b2d5 req-8cf1c720-f95f-4b4f-9521-9b9ce3999a23 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123104 Aug 04 16:38:09.460481 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 608/1255] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:38:09.476775 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-86a29846-bea8-46d0-b38e-be0ff5f34519 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:09.477528 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-86a29846-bea8-46d0-b38e-be0ff5f34519 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] [instance: 2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:09.506676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-86a29846-bea8-46d0-b38e-be0ff5f34519 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:09.513374 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-86a29846-bea8-46d0-b38e-be0ff5f34519 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:09.516550 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-86a29846-bea8-46d0-b38e-be0ff5f34519 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:09.517486 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-86a29846-bea8-46d0-b38e-be0ff5f34519 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:09.620559 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-86a29846-bea8-46d0-b38e-be0ff5f34519 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:09.621389 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-86a29846-bea8-46d0-b38e-be0ff5f34519 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:09.622068 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-86a29846-bea8-46d0-b38e-be0ff5f34519 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lazy-loading 'fault' on Instance uuid 2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:38:09.708499 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e12f159d-4692-4d2e-9bb6-2de51e5e1ff3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:09.738976 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e12f159d-4692-4d2e-9bb6-2de51e5e1ff3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea" status: 200 len: 1521 microversion: 2.1 time: 1.162943 Aug 04 16:38:09.741983 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 648/1256] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:08 2022] GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea => generated 1521 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:09.772357 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2f244137-4b09-42cb-af32-71d945992faa tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:09.779442 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2f244137-4b09-42cb-af32-71d945992faa tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:09.828794 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2f244137-4b09-42cb-af32-71d945992faa tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:09.835875 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2f244137-4b09-42cb-af32-71d945992faa tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:09.838768 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2f244137-4b09-42cb-af32-71d945992faa tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:09.844202 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2f244137-4b09-42cb-af32-71d945992faa tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:09.866287 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-86a29846-bea8-46d0-b38e-be0ff5f34519 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23645970a9a24e94b10b8578bb30b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5527cc7c4944c7898b64308f13b850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:09.888988 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-86a29846-bea8-46d0-b38e-be0ff5f34519 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] 10.222.0.23 "GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88" status: 200 len: 1366 microversion: 2.1 time: 0.427044 Aug 04 16:38:09.889720 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 609/1257] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:09 2022] GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88 => generated 1366 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:09.909462 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-807197d8-1699-469a-97db-1e43e8cf97f4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:09.924303 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-807197d8-1699-469a-97db-1e43e8cf97f4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:09.954706 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-807197d8-1699-469a-97db-1e43e8cf97f4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:09.955523 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-807197d8-1699-469a-97db-1e43e8cf97f4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:09.956575 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-807197d8-1699-469a-97db-1e43e8cf97f4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:09.957268 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-807197d8-1699-469a-97db-1e43e8cf97f4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:10.015920 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-807197d8-1699-469a-97db-1e43e8cf97f4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112419 Aug 04 16:38:10.019185 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 610/1258] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 16:38:09 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:38:10.365850 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b63ae6a7-c79d-42e6-96d1-f05bc35459a1 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:10.367788 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b63ae6a7-c79d-42e6-96d1-f05bc35459a1 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:10.386216 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b63ae6a7-c79d-42e6-96d1-f05bc35459a1 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:10.387171 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b63ae6a7-c79d-42e6-96d1-f05bc35459a1 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:10.394722 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b63ae6a7-c79d-42e6-96d1-f05bc35459a1 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:10.395463 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b63ae6a7-c79d-42e6-96d1-f05bc35459a1 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:10.622943 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2f244137-4b09-42cb-af32-71d945992faa tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:10.637224 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2f244137-4b09-42cb-af32-71d945992faa tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:10.639557 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2f244137-4b09-42cb-af32-71d945992faa tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:10.645140 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2f244137-4b09-42cb-af32-71d945992faa tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 1814 microversion: 2.25 time: 0.900871 Aug 04 16:38:10.646180 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 649/1259] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:38:09 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 1814 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:38:10.766198 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-07d4e74d-464b-4bff-84a5-ae2b1ace64f8 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:10.767832 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-07d4e74d-464b-4bff-84a5-ae2b1ace64f8 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: 532ec916-2768-43e0-a912-791fb4b5d9ea] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:10.783385 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-07d4e74d-464b-4bff-84a5-ae2b1ace64f8 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:10.795997 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-07d4e74d-464b-4bff-84a5-ae2b1ace64f8 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:10.797906 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-07d4e74d-464b-4bff-84a5-ae2b1ace64f8 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:10.802340 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-07d4e74d-464b-4bff-84a5-ae2b1ace64f8 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:10.914489 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:38:11.080033 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:38:11.283688 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b63ae6a7-c79d-42e6-96d1-f05bc35459a1 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:11.327764 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b63ae6a7-c79d-42e6-96d1-f05bc35459a1 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1543 microversion: 2.1 time: 0.965722 Aug 04 16:38:11.332272 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 611/1260] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:10 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1543 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:11.361776 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7190f2f3-3b65-43a9-ac55-61e853439b00 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:11.366601 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7190f2f3-3b65-43a9-ac55-61e853439b00 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] [instance: 2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:11.396756 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7190f2f3-3b65-43a9-ac55-61e853439b00 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:11.397779 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7190f2f3-3b65-43a9-ac55-61e853439b00 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:11.399342 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7190f2f3-3b65-43a9-ac55-61e853439b00 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:11.400316 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7190f2f3-3b65-43a9-ac55-61e853439b00 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:11.462376 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-7190f2f3-3b65-43a9-ac55-61e853439b00 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] HTTP exception thrown: Instance 2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88 could not be found. Aug 04 16:38:11.471717 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7190f2f3-3b65-43a9-ac55-61e853439b00 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Request method failure captured: Aug 04 16:38:11.471717 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88 HTTP/1.1 Aug 04 16:38:11.471717 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:38:11.471717 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:38:11.471717 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:38:11.471717 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:38:11.471717 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:38:11.471717 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:38:11.471717 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:38:11.471717 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:38:11.471717 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_WQxLjVcQvqqhh9wsJBC5spJK4dIcysVoo262pgcmHNj8MSCa69fz9VG4AzbN1UYwO6ewdxPT0wCaKguCCdYmk41r7NhvUZIlM_tTdG3X70mShV6IUarjtbRTiqHvz1i4iCnZHHIdhO6XDWCLOIZDfL9qUWXw9QfnNY4ku7Aj1kuHA Aug 04 16:38:11.471717 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:38:11.471717 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:38:11.471717 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:38:11.471717 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:38:11.471717 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:38:11.471717 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:38:11.471717 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 4b5527cc7c4944c7898b64308f13b850 Aug 04 16:38:11.471717 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersTestManualDisk-60351057 Aug 04 16:38:11.471717 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:38:11.471717 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:38:11.474894 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b5527cc7c4944c7898b64308f13b850"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4b5527cc7c4944c7898b64308f13b850"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b5527cc7c4944c7898b64308f13b850"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4b5527cc7c4944c7898b64308f13b850"}]}] Aug 04 16:38:11.474894 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersTestManualDisk-60351057 Aug 04 16:38:11.474894 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 4b5527cc7c4944c7898b64308f13b850 Aug 04 16:38:11.474894 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersTestManualDisk-60351057 Aug 04 16:38:11.474894 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersTestManualDisk-60351057-project Aug 04 16:38:11.474894 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:38:11.474894 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:38:11.474894 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 23645970a9a24e94b10b8578bb30b37e Aug 04 16:38:11.474894 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersTestManualDisk-60351057-project Aug 04 16:38:11.474894 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:38:11.474894 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88 could not be found. Aug 04 16:38:11.474894 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88'} Aug 04 16:38:11.476460 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:38:11.476460 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:38:11.476460 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:38:11.476460 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:38:11.476460 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:38:11.476460 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:38:11.476460 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:38:11.476460 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:38:11.476460 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:38:11.476460 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:38:11.476460 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88 could not be found. Aug 04 16:38:11.476460 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:38:11.476460 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:38:11.476460 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:38:11.476460 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:38:11.476460 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:38:11.476460 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:38:11.476460 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:38:11.476460 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:38:11.476460 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:38:11.482329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:38:11.482329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:38:11.482329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:38:11.482329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:38:11.482329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:38:11.482329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:38:11.482329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:38:11.482329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88 could not be found. Aug 04 16:38:11.482329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:38:11.482329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:38:11.482329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:38:11.482329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:38:11.482329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:38:11.482329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:38:11.482329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:38:11.482329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:38:11.482329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88 could not be found. Aug 04 16:38:11.482329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:38:11.489447 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-07d4e74d-464b-4bff-84a5-ae2b1ace64f8 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:11.490223 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7190f2f3-3b65-43a9-ac55-61e853439b00 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Returning 404 to user: Instance 2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:38:11.494175 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7190f2f3-3b65-43a9-ac55-61e853439b00 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] 10.222.0.23 "GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88" status: 404 len: 111 microversion: 2.1 time: 0.158935 Aug 04 16:38:11.502507 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 612/1261] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:11 2022] GET /compute/v2.1/servers/2d6fb43d-8168-41aa-90d4-cfdb3c8ddd88 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:38:11.519595 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-07d4e74d-464b-4bff-84a5-ae2b1ace64f8 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea" status: 200 len: 1521 microversion: 2.1 time: 0.757257 Aug 04 16:38:11.524140 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 650/1262] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:10 2022] GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea => generated 1521 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:38:11.531827 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bbdab71b-960b-4edd-a542-a3ccbec6df87 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:11.540407 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bbdab71b-960b-4edd-a542-a3ccbec6df87 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:11.554334 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ce7f2b8d-d377-4312-90f7-2589e43e5625 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] Calling method '.version_select at 0x7f7e8421fca0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:11.569361 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bbdab71b-960b-4edd-a542-a3ccbec6df87 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:11.570685 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bbdab71b-960b-4edd-a542-a3ccbec6df87 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:11.573768 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bbdab71b-960b-4edd-a542-a3ccbec6df87 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:11.576248 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bbdab71b-960b-4edd-a542-a3ccbec6df87 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:11.641749 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ce7f2b8d-d377-4312-90f7-2589e43e5625 tempest-ServersTestManualDisk-60351057 tempest-ServersTestManualDisk-60351057-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-640652626" status: 202 len: 0 microversion: 2.1 time: 0.113819 Aug 04 16:38:11.648369 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 651/1263] 10.222.0.23 () {58 vars in 1218 bytes} [Thu Aug 4 16:38:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-640652626 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:38:11.684832 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bbdab71b-960b-4edd-a542-a3ccbec6df87 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.177797 Aug 04 16:38:11.691320 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 613/1264] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 16:38:11 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:38:11.699908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b8f3435f-ddc6-40b9-b02e-2438f627579d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:11.703007 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b8f3435f-ddc6-40b9-b02e-2438f627579d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:11.775373 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8f3435f-ddc6-40b9-b02e-2438f627579d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:11.780077 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8f3435f-ddc6-40b9-b02e-2438f627579d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:11.784708 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8f3435f-ddc6-40b9-b02e-2438f627579d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:11.794654 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8f3435f-ddc6-40b9-b02e-2438f627579d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:12.130974 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-30fb6196-0d4d-405e-9bba-6b56a55d89b3 tempest-AbsoluteLimitsNegativeTestJSON-264923128 tempest-AbsoluteLimitsNegativeTestJSON-264923128-project] Calling method '.version_select at 0x7f7e84a3d310>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:12.180326 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-30fb6196-0d4d-405e-9bba-6b56a55d89b3 tempest-AbsoluteLimitsNegativeTestJSON-264923128 tempest-AbsoluteLimitsNegativeTestJSON-264923128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:12.181497 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-30fb6196-0d4d-405e-9bba-6b56a55d89b3 tempest-AbsoluteLimitsNegativeTestJSON-264923128 tempest-AbsoluteLimitsNegativeTestJSON-264923128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:12.188462 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-30fb6196-0d4d-405e-9bba-6b56a55d89b3 tempest-AbsoluteLimitsNegativeTestJSON-264923128 tempest-AbsoluteLimitsNegativeTestJSON-264923128-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:12.189386 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-30fb6196-0d4d-405e-9bba-6b56a55d89b3 tempest-AbsoluteLimitsNegativeTestJSON-264923128 tempest-AbsoluteLimitsNegativeTestJSON-264923128-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:12.306618 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-30fb6196-0d4d-405e-9bba-6b56a55d89b3 tempest-AbsoluteLimitsNegativeTestJSON-264923128 tempest-AbsoluteLimitsNegativeTestJSON-264923128-project] 10.222.0.23 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.602172 Aug 04 16:38:12.323690 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 614/1265] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Aug 4 16:38:11 2022] GET /compute/v2.1/limits => generated 511 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:38:12.372572 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b58b79cd-917a-4bd2-bfe9-ee5d19f956be tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:12.374165 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b58b79cd-917a-4bd2-bfe9-ee5d19f956be tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:12.390587 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b58b79cd-917a-4bd2-bfe9-ee5d19f956be tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:12.394102 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b58b79cd-917a-4bd2-bfe9-ee5d19f956be tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:12.396293 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b58b79cd-917a-4bd2-bfe9-ee5d19f956be tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:12.398841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b58b79cd-917a-4bd2-bfe9-ee5d19f956be tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:13.157456 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b8f3435f-ddc6-40b9-b02e-2438f627579d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:13.206081 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b58b79cd-917a-4bd2-bfe9-ee5d19f956be tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:13.208696 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b8f3435f-ddc6-40b9-b02e-2438f627579d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:13.214350 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b8f3435f-ddc6-40b9-b02e-2438f627579d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:13.217576 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b58b79cd-917a-4bd2-bfe9-ee5d19f956be tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1543 microversion: 2.1 time: 0.849333 Aug 04 16:38:13.219263 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 615/1266] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:12 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1543 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:38:13.225845 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d8171a88-8d23-488a-bfac-a8c97151b475 tempest-AbsoluteLimitsNegativeTestJSON-264923128 tempest-AbsoluteLimitsNegativeTestJSON-264923128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-886675799", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:38:13.226112 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b8f3435f-ddc6-40b9-b02e-2438f627579d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 1814 microversion: 2.25 time: 1.539353 Aug 04 16:38:13.247010 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 652/1267] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:38:11 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 1814 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:38:13.308869 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-63dd9786-9f43-47d5-834b-8f78b1df5097 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:13.317644 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-63dd9786-9f43-47d5-834b-8f78b1df5097 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: 532ec916-2768-43e0-a912-791fb4b5d9ea] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:13.342072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-63dd9786-9f43-47d5-834b-8f78b1df5097 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:13.345817 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-63dd9786-9f43-47d5-834b-8f78b1df5097 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:13.347131 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-63dd9786-9f43-47d5-834b-8f78b1df5097 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:13.347801 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-63dd9786-9f43-47d5-834b-8f78b1df5097 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:13.405048 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-d8171a88-8d23-488a-bfac-a8c97151b475 tempest-AbsoluteLimitsNegativeTestJSON-264923128 tempest-AbsoluteLimitsNegativeTestJSON-264923128-project] validate_networks() for None {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:38:13.831283 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-63dd9786-9f43-47d5-834b-8f78b1df5097 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:13.856683 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-63dd9786-9f43-47d5-834b-8f78b1df5097 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea" status: 200 len: 1521 microversion: 2.1 time: 0.607885 Aug 04 16:38:13.860401 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 653/1268] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:13 2022] GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea => generated 1521 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:13.879221 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f2dba99b-8f12-4ec0-a5aa-cd8599bdab6b tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:13.882071 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f2dba99b-8f12-4ec0-a5aa-cd8599bdab6b tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:13.895258 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f2dba99b-8f12-4ec0-a5aa-cd8599bdab6b tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:13.895874 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f2dba99b-8f12-4ec0-a5aa-cd8599bdab6b tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:13.896840 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f2dba99b-8f12-4ec0-a5aa-cd8599bdab6b tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:13.897693 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f2dba99b-8f12-4ec0-a5aa-cd8599bdab6b tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:13.954273 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f2dba99b-8f12-4ec0-a5aa-cd8599bdab6b tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091408 Aug 04 16:38:13.955363 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 654/1269] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 16:38:13 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:38:14.109547 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-d8171a88-8d23-488a-bfac-a8c97151b475 tempest-AbsoluteLimitsNegativeTestJSON-264923128 tempest-AbsoluteLimitsNegativeTestJSON-264923128-project] Getting quotas for project 563d5066ec8e491fba2610fff978a70f. Resources: dict_keys(['metadata_items']) {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:38:14.122991 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-d8171a88-8d23-488a-bfac-a8c97151b475 tempest-AbsoluteLimitsNegativeTestJSON-264923128 tempest-AbsoluteLimitsNegativeTestJSON-264923128-project] Getting quotas for user aa72947bca2142e1b1652923fe98437f and project 563d5066ec8e491fba2610fff978a70f. Resources: dict_keys(['metadata_items']) {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:38:14.131874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:38:14.157035 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-d8171a88-8d23-488a-bfac-a8c97151b475 tempest-AbsoluteLimitsNegativeTestJSON-264923128 tempest-AbsoluteLimitsNegativeTestJSON-264923128-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 04 16:38:14.162254 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d8171a88-8d23-488a-bfac-a8c97151b475 tempest-AbsoluteLimitsNegativeTestJSON-264923128 tempest-AbsoluteLimitsNegativeTestJSON-264923128-project] Request method failure captured: Aug 04 16:38:14.162254 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 16:38:14.162254 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:38:14.162254 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:38:14.162254 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:38:14.162254 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 1751 Aug 04 16:38:14.162254 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:38:14.162254 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:38:14.162254 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:38:14.162254 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:38:14.162254 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_XziUnmZJ_vGeTEsg2Rw6xLGjs2TtN8GpqgDAuWZ8zCN4oP6lLtUhdk2815QKjWkfNHXvk6up8ZOCXEu4gyAW-e4ZtX3FgD4W4Wytniaujx21VZiKmy9mYxIu6O3tsE5wfSyv599gWg-is9d3N9I0icR3FilYao9ZKMhjCKCRNaBIE Aug 04 16:38:14.162254 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:38:14.162254 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:38:14.162254 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:38:14.162254 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:38:14.162254 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:38:14.162254 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:38:14.162254 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 563d5066ec8e491fba2610fff978a70f Aug 04 16:38:14.162254 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-264923128 Aug 04 16:38:14.162254 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:38:14.162254 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:38:14.162254 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/563d5066ec8e491fba2610fff978a70f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_563d5066ec8e491fba2610fff978a70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/563d5066ec8e491fba2610fff978a70f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/563d5066ec8e491fba2610fff978a70f"}]}] Aug 04 16:38:14.162254 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-264923128 Aug 04 16:38:14.162254 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 563d5066ec8e491fba2610fff978a70f Aug 04 16:38:14.162254 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-264923128 Aug 04 16:38:14.162254 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-264923128-project Aug 04 16:38:14.162254 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:38:14.162254 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:38:14.162254 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: aa72947bca2142e1b1652923fe98437f Aug 04 16:38:14.162254 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-264923128-project Aug 04 16:38:14.162254 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 16:38:14.162254 n-d-846466-12 devstack@n-api.service[126126]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-886675799", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 04 16:38:14.162254 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:38:14.162254 n-d-846466-12 devstack@n-api.service[126126]: exception: Maximum number of metadata items exceeds 128 Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-886675799', 'imageRef': '58d80c01-1581-4a2f-bbb0-c2eaf1affa00', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 464, in _check_metadata_properties_quota Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1004, in _checks_for_create_and_rebuild Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 471, in _check_metadata_properties_quota Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:38:14.168843 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:38:14.176061 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:38:14.176061 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 16:38:14.176061 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 04 16:38:14.176061 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 04 16:38:14.176061 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 04 16:38:14.176061 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:38:14.176061 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:38:14.176061 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:38:14.176061 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:38:14.176061 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:38:14.176061 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:38:14.176061 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:38:14.176061 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:38:14.176061 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 04 16:38:14.176061 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:38:14.178801 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d8171a88-8d23-488a-bfac-a8c97151b475 tempest-AbsoluteLimitsNegativeTestJSON-264923128 tempest-AbsoluteLimitsNegativeTestJSON-264923128-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:38:14.179791 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d8171a88-8d23-488a-bfac-a8c97151b475 tempest-AbsoluteLimitsNegativeTestJSON-264923128 tempest-AbsoluteLimitsNegativeTestJSON-264923128-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.957693 Aug 04 16:38:14.181431 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 616/1270] 10.222.0.23 () {60 vars in 1148 bytes} [Thu Aug 4 16:38:13 2022] POST /compute/v2.1/servers => generated 87 bytes in 961 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:38:14.265539 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-afb9fce0-9ea6-4e30-b887-9661beaee280 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:14.266329 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-afb9fce0-9ea6-4e30-b887-9661beaee280 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:14.280740 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7aebeced-6102-455a-a176-8a40a346c22b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:14.281695 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-afb9fce0-9ea6-4e30-b887-9661beaee280 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:14.285015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-afb9fce0-9ea6-4e30-b887-9661beaee280 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:14.286543 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7aebeced-6102-455a-a176-8a40a346c22b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:14.289255 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-afb9fce0-9ea6-4e30-b887-9661beaee280 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:14.289885 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-afb9fce0-9ea6-4e30-b887-9661beaee280 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:14.319378 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7aebeced-6102-455a-a176-8a40a346c22b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:14.330767 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7aebeced-6102-455a-a176-8a40a346c22b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:14.332621 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7aebeced-6102-455a-a176-8a40a346c22b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:14.334109 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7aebeced-6102-455a-a176-8a40a346c22b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:15.045599 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7aebeced-6102-455a-a176-8a40a346c22b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:15.068700 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-afb9fce0-9ea6-4e30-b887-9661beaee280 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:15.096060 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7aebeced-6102-455a-a176-8a40a346c22b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:15.116913 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7aebeced-6102-455a-a176-8a40a346c22b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:15.120901 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7aebeced-6102-455a-a176-8a40a346c22b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 1814 microversion: 2.25 time: 0.848026 Aug 04 16:38:15.122706 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-afb9fce0-9ea6-4e30-b887-9661beaee280 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1542 microversion: 2.1 time: 0.870235 Aug 04 16:38:15.128034 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 655/1271] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:14 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1542 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:38:15.132413 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 617/1272] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:38:14 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 1814 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:38:15.153061 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fb55604e-9781-4c00-9867-d268ed6c9d09 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:15.155797 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2d6f27c5-c3b7-452f-af66-0cbb70ec7f5c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:15.158089 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fb55604e-9781-4c00-9867-d268ed6c9d09 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: 532ec916-2768-43e0-a912-791fb4b5d9ea] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:15.165049 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2d6f27c5-c3b7-452f-af66-0cbb70ec7f5c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:15.180822 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fb55604e-9781-4c00-9867-d268ed6c9d09 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:15.186445 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fb55604e-9781-4c00-9867-d268ed6c9d09 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:15.192975 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fb55604e-9781-4c00-9867-d268ed6c9d09 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:15.194577 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fb55604e-9781-4c00-9867-d268ed6c9d09 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:15.199518 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2d6f27c5-c3b7-452f-af66-0cbb70ec7f5c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:15.200779 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2d6f27c5-c3b7-452f-af66-0cbb70ec7f5c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:15.202346 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2d6f27c5-c3b7-452f-af66-0cbb70ec7f5c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:15.204647 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2d6f27c5-c3b7-452f-af66-0cbb70ec7f5c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:15.362288 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2d6f27c5-c3b7-452f-af66-0cbb70ec7f5c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.227253 Aug 04 16:38:15.375923 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 618/1273] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 16:38:15 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159/os-volume_attachments => generated 25 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:38:15.743942 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-84f8cf37-d679-49b0-870e-674c4b4002da req-687f060b-ef21-472f-8fb4-483485c73202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1430483-b3f7-473b-80f9-15beb90cfc33", "name": "network-vif-unplugged", "status": "completed", "tag": "e435043b-4bd0-4a6c-98b0-1115388413c6"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:38:15.801087 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-84f8cf37-d679-49b0-870e-674c4b4002da req-687f060b-ef21-472f-8fb4-483485c73202 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:15.802150 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-84f8cf37-d679-49b0-870e-674c4b4002da req-687f060b-ef21-472f-8fb4-483485c73202 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:15.850907 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-84f8cf37-d679-49b0-870e-674c4b4002da req-687f060b-ef21-472f-8fb4-483485c73202 service nova] Creating event network-vif-unplugged:e435043b-4bd0-4a6c-98b0-1115388413c6 for instance d1430483-b3f7-473b-80f9-15beb90cfc33 on n-h1-846466-12 Aug 04 16:38:15.874972 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:38:15.878696 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [req-84f8cf37-d679-49b0-870e-674c4b4002da req-687f060b-ef21-472f-8fb4-483485c73202 service nova] Instance d1430483-b3f7-473b-80f9-15beb90cfc33 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126126) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 16:38:15.938940 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-84f8cf37-d679-49b0-870e-674c4b4002da req-687f060b-ef21-472f-8fb4-483485c73202 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.201964 Aug 04 16:38:15.947810 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 619/1274] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:38:16.171409 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-62a5614b-4cdd-4b46-840b-860a24c58259 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:16.175465 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-62a5614b-4cdd-4b46-840b-860a24c58259 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:16.206190 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-62a5614b-4cdd-4b46-840b-860a24c58259 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:16.207636 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-62a5614b-4cdd-4b46-840b-860a24c58259 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:16.209484 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-62a5614b-4cdd-4b46-840b-860a24c58259 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:16.210636 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-62a5614b-4cdd-4b46-840b-860a24c58259 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:16.758505 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fb55604e-9781-4c00-9867-d268ed6c9d09 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:16.805031 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fb55604e-9781-4c00-9867-d268ed6c9d09 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea" status: 200 len: 1501 microversion: 2.1 time: 1.673761 Aug 04 16:38:16.827450 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 656/1275] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:15 2022] GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea => generated 1501 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:16.854141 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3906c3ec-21da-4c41-81bc-6f1285e7b010 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:16.878442 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3906c3ec-21da-4c41-81bc-6f1285e7b010 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:16.898246 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3906c3ec-21da-4c41-81bc-6f1285e7b010 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:16.899783 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3906c3ec-21da-4c41-81bc-6f1285e7b010 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:16.902523 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3906c3ec-21da-4c41-81bc-6f1285e7b010 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:16.903903 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3906c3ec-21da-4c41-81bc-6f1285e7b010 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:17.928351 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-62a5614b-4cdd-4b46-840b-860a24c58259 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:17.977327 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-62a5614b-4cdd-4b46-840b-860a24c58259 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1542 microversion: 2.1 time: 1.814213 Aug 04 16:38:17.981598 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 620/1276] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:16 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1542 bytes in 1821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:38:18.008616 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fc2cefb8-df01-4511-8cb6-c10a5db59cfe tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52803b71-1d57-42a7-831e-e50555ef6e53"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:38:18.021125 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fc2cefb8-df01-4511-8cb6-c10a5db59cfe tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: 532ec916-2768-43e0-a912-791fb4b5d9ea] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:18.067173 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fc2cefb8-df01-4511-8cb6-c10a5db59cfe tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:18.067975 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fc2cefb8-df01-4511-8cb6-c10a5db59cfe tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:18.069451 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fc2cefb8-df01-4511-8cb6-c10a5db59cfe tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:18.070191 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fc2cefb8-df01-4511-8cb6-c10a5db59cfe tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:18.152067 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-fc2cefb8-df01-4511-8cb6-c10a5db59cfe tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] HTTP exception thrown: Cannot 'attach_volume' instance 532ec916-2768-43e0-a912-791fb4b5d9ea while it is in vm_state rescued Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fc2cefb8-df01-4511-8cb6-c10a5db59cfe tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Request method failure captured: Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea/os-volume_attachments HTTP/1.1 Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 74 Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_WOXTtiEFJuJx9g__PLaEpNUIG8cY9V5mucnrPgRej9fIBvkSBrLUaGoaJ38CVyDNzSj9GoE7BQp1yVztL27iI-fLZMpYZtLbyWcNlftj-zWFhGEyvOQOtE9rUW6LzioxrRHRZoV1uxRI3_TSQwte9NfcDMr3FTg447dmciw2wFA7M Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 20d035e0adc640c8a3ceb832275d0ea7 Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1842533046 Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20d035e0adc640c8a3ceb832275d0ea7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_20d035e0adc640c8a3ceb832275d0ea7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20d035e0adc640c8a3ceb832275d0ea7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/20d035e0adc640c8a3ceb832275d0ea7"}]}] Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1842533046 Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 20d035e0adc640c8a3ceb832275d0ea7 Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1842533046 Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServerRescueNegativeTestJSON-1842533046-project Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: a88db264b2c94f699e015a8617150b45 Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1842533046-project Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: {"volumeAttachment": {"volumeId": "52803b71-1d57-42a7-831e-e50555ef6e53"}} Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: exception: Cannot 'attach_volume' instance 532ec916-2768-43e0-a912-791fb4b5d9ea while it is in vm_state rescued Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'server_id': '532ec916-2768-43e0-a912-791fb4b5d9ea', 'body': {'volumeAttachment': {'volumeId': '52803b71-1d57-42a7-831e-e50555ef6e53'}}} Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 532ec916-2768-43e0-a912-791fb4b5d9ea in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 04 16:38:18.159691 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 16:38:18.163943 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 16:38:18.163943 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 16:38:18.163943 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 532ec916-2768-43e0-a912-791fb4b5d9ea while it is in vm_state rescued Aug 04 16:38:18.163943 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:38:18.163943 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:38:18.163943 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:38:18.163943 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:38:18.163943 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:38:18.163943 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:38:18.163943 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:38:18.163943 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:38:18.163943 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 532ec916-2768-43e0-a912-791fb4b5d9ea while it is in vm_state rescued Aug 04 16:38:18.163943 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:38:18.166756 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fc2cefb8-df01-4511-8cb6-c10a5db59cfe tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Returning 409 to user: Cannot 'attach_volume' instance 532ec916-2768-43e0-a912-791fb4b5d9ea while it is in vm_state rescued {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:38:18.168983 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fc2cefb8-df01-4511-8cb6-c10a5db59cfe tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "POST /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.183049 Aug 04 16:38:18.175645 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 621/1277] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Aug 4 16:38:17 2022] POST /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea/os-volume_attachments => generated 152 bytes in 189 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:38:18.184042 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6b3bde14-8687-4a85-ab6d-569f1f10cf15 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:38:18.184917 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6b3bde14-8687-4a85-ab6d-569f1f10cf15 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: 532ec916-2768-43e0-a912-791fb4b5d9ea] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:18.208112 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6b3bde14-8687-4a85-ab6d-569f1f10cf15 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:18.209022 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6b3bde14-8687-4a85-ab6d-569f1f10cf15 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:18.210605 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6b3bde14-8687-4a85-ab6d-569f1f10cf15 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:18.211459 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6b3bde14-8687-4a85-ab6d-569f1f10cf15 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:18.480325 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6b3bde14-8687-4a85-ab6d-569f1f10cf15 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "POST /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea/action" status: 202 len: 0 microversion: 2.1 time: 0.302330 Aug 04 16:38:18.481252 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 622/1278] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:38:18 2022] POST /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 16:38:18.511473 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6bae5221-9655-468b-88a2-c274df30adf3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:18.512806 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6bae5221-9655-468b-88a2-c274df30adf3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: 532ec916-2768-43e0-a912-791fb4b5d9ea] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:18.518526 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3906c3ec-21da-4c41-81bc-6f1285e7b010 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:18.536438 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6bae5221-9655-468b-88a2-c274df30adf3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:18.538177 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6bae5221-9655-468b-88a2-c274df30adf3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:18.539170 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6bae5221-9655-468b-88a2-c274df30adf3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:18.539626 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6bae5221-9655-468b-88a2-c274df30adf3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:18.575794 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3906c3ec-21da-4c41-81bc-6f1285e7b010 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:18.592556 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3906c3ec-21da-4c41-81bc-6f1285e7b010 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:18.598368 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3906c3ec-21da-4c41-81bc-6f1285e7b010 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 1814 microversion: 2.25 time: 1.767923 Aug 04 16:38:18.631182 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 657/1279] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:38:16 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 1814 bytes in 1803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:38:18.662861 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-fb1c4251-2f2d-4730-acb5-c0b11acd503f req-46fc8935-1d57-431c-8d2e-55dbc805e1f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1430483-b3f7-473b-80f9-15beb90cfc33", "tag": "e435043b-4bd0-4a6c-98b0-1115388413c6"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:38:18.687908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-fb1c4251-2f2d-4730-acb5-c0b11acd503f req-46fc8935-1d57-431c-8d2e-55dbc805e1f2 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:18.689386 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-fb1c4251-2f2d-4730-acb5-c0b11acd503f req-46fc8935-1d57-431c-8d2e-55dbc805e1f2 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:18.728253 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-fb1c4251-2f2d-4730-acb5-c0b11acd503f req-46fc8935-1d57-431c-8d2e-55dbc805e1f2 service nova] Creating event network-changed:e435043b-4bd0-4a6c-98b0-1115388413c6 for instance d1430483-b3f7-473b-80f9-15beb90cfc33 on n-h1-846466-12 Aug 04 16:38:18.748627 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [req-fb1c4251-2f2d-4730-acb5-c0b11acd503f req-46fc8935-1d57-431c-8d2e-55dbc805e1f2 service nova] Instance d1430483-b3f7-473b-80f9-15beb90cfc33 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 16:38:18.782269 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-fb1c4251-2f2d-4730-acb5-c0b11acd503f req-46fc8935-1d57-431c-8d2e-55dbc805e1f2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148160 Aug 04 16:38:18.783852 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 658/1280] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:38:19.007000 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-216df400-bacc-46fc-81d2-1957e614627b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:19.007978 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-216df400-bacc-46fc-81d2-1957e614627b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:19.048259 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-216df400-bacc-46fc-81d2-1957e614627b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:19.048952 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-216df400-bacc-46fc-81d2-1957e614627b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:19.049874 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-216df400-bacc-46fc-81d2-1957e614627b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:19.050339 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-216df400-bacc-46fc-81d2-1957e614627b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:19.785573 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6bae5221-9655-468b-88a2-c274df30adf3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:19.801575 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6bae5221-9655-468b-88a2-c274df30adf3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea" status: 200 len: 1509 microversion: 2.1 time: 1.308295 Aug 04 16:38:19.802167 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 623/1281] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:18 2022] GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea => generated 1509 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:19.807412 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8fc9df84-fa6d-4eda-a3aa-c3c146eb22d0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:19.807948 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8fc9df84-fa6d-4eda-a3aa-c3c146eb22d0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:19.858497 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8fc9df84-fa6d-4eda-a3aa-c3c146eb22d0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:19.862019 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8fc9df84-fa6d-4eda-a3aa-c3c146eb22d0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:19.863199 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8fc9df84-fa6d-4eda-a3aa-c3c146eb22d0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:19.863835 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8fc9df84-fa6d-4eda-a3aa-c3c146eb22d0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:20.146258 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-216df400-bacc-46fc-81d2-1957e614627b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:20.176101 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-216df400-bacc-46fc-81d2-1957e614627b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1542 microversion: 2.1 time: 1.175647 Aug 04 16:38:20.180659 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 659/1282] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:18 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1542 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:20.839392 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-60ff46f5-ee54-4ab2-a24c-73a8313769d7 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:20.840511 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-60ff46f5-ee54-4ab2-a24c-73a8313769d7 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: 532ec916-2768-43e0-a912-791fb4b5d9ea] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:20.842276 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8fc9df84-fa6d-4eda-a3aa-c3c146eb22d0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:20.851022 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-60ff46f5-ee54-4ab2-a24c-73a8313769d7 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:20.851768 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-60ff46f5-ee54-4ab2-a24c-73a8313769d7 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:20.852831 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-60ff46f5-ee54-4ab2-a24c-73a8313769d7 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:20.853587 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-60ff46f5-ee54-4ab2-a24c-73a8313769d7 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:20.860583 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8fc9df84-fa6d-4eda-a3aa-c3c146eb22d0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:20.863167 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8fc9df84-fa6d-4eda-a3aa-c3c146eb22d0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:20.865407 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8fc9df84-fa6d-4eda-a3aa-c3c146eb22d0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 1814 microversion: 2.25 time: 1.061917 Aug 04 16:38:20.867521 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 624/1283] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:38:19 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 1814 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:38:21.202521 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7b4071f2-ef78-4890-a89f-4ab1ef32be27 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:21.204738 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7b4071f2-ef78-4890-a89f-4ab1ef32be27 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:21.229525 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b4071f2-ef78-4890-a89f-4ab1ef32be27 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:21.237435 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b4071f2-ef78-4890-a89f-4ab1ef32be27 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:21.238983 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b4071f2-ef78-4890-a89f-4ab1ef32be27 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:21.240058 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b4071f2-ef78-4890-a89f-4ab1ef32be27 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:21.867306 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-60ff46f5-ee54-4ab2-a24c-73a8313769d7 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:21.894982 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-60ff46f5-ee54-4ab2-a24c-73a8313769d7 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea" status: 200 len: 1509 microversion: 2.1 time: 1.067695 Aug 04 16:38:21.905178 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 660/1284] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:20 2022] GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea => generated 1509 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:22.218074 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:38:22.295835 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-41e40765-d1cd-467a-a0ac-d7f8c04880df tempest-FloatingIPsNegativeTestJSON-1488841468 tempest-FloatingIPsNegativeTestJSON-1488841468-project] Calling method '.version_select at 0x7f7e84033b80>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:22.404267 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7b4071f2-ef78-4890-a89f-4ab1ef32be27 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:22.429886 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7b4071f2-ef78-4890-a89f-4ab1ef32be27 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1542 microversion: 2.1 time: 1.234403 Aug 04 16:38:22.461996 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 625/1285] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:21 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1542 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:38:22.484766 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b6ca14fa-45f9-459e-9d2e-667326879325 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:22.493212 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b6ca14fa-45f9-459e-9d2e-667326879325 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:22.524873 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b6ca14fa-45f9-459e-9d2e-667326879325 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:22.526180 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b6ca14fa-45f9-459e-9d2e-667326879325 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:22.532973 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b6ca14fa-45f9-459e-9d2e-667326879325 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:22.533862 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b6ca14fa-45f9-459e-9d2e-667326879325 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:22.603680 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-41e40765-d1cd-467a-a0ac-d7f8c04880df tempest-FloatingIPsNegativeTestJSON-1488841468 tempest-FloatingIPsNegativeTestJSON-1488841468-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.695842 Aug 04 16:38:22.607228 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 661/1286] 10.222.0.23 () {58 vars in 1149 bytes} [Thu Aug 4 16:38:21 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:38:22.623168 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ba6d2aac-51e0-416d-988f-64bab10f48f1 tempest-FloatingIPsNegativeTestJSON-1488841468 tempest-FloatingIPsNegativeTestJSON-1488841468-project] Action: 'create', calling method: .version_select at 0x7f7e841b4a60>, body: {"pool": "non_exist_pool"} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:38:22.732667 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-ba6d2aac-51e0-416d-988f-64bab10f48f1 tempest-FloatingIPsNegativeTestJSON-1488841468 tempest-FloatingIPsNegativeTestJSON-1488841468-project] HTTP exception thrown: Floating IP pool not found. Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ba6d2aac-51e0-416d-988f-64bab10f48f1 tempest-FloatingIPsNegativeTestJSON-1488841468 tempest-FloatingIPsNegativeTestJSON-1488841468-project] Request method failure captured: Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 26 Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_X9C-gs5zcvpEvMLD2OlBNvFH47ijvyNeREue3xITy8zuI6jBKGit1pcvbcEVW3bD5lUkVpxRPud8gGg-JbFBxlh1pcRVW0wDMYmLaxz3GxPdy7g9aph2PYYzyMwJM6XnFSHFXCuhdT7kChbmdxkWSfgiVbeuwWk0JHWpssOkihzx0 Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 35f4ceb274334666a2830d33bd022d5f Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1488841468 Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/35f4ceb274334666a2830d33bd022d5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_35f4ceb274334666a2830d33bd022d5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/35f4ceb274334666a2830d33bd022d5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/35f4ceb274334666a2830d33bd022d5f"}]}] Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1488841468 Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 35f4ceb274334666a2830d33bd022d5f Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1488841468 Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-FloatingIPsNegativeTestJSON-1488841468-project Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 223a12a1091548aa9bed7a670f2e8958 Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1488841468-project Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: {"pool": "non_exist_pool"} Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: exception: Floating IP pool not found. Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:38:22.734680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:38:22.740349 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 04 16:38:22.740349 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:38:22.740349 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ba6d2aac-51e0-416d-988f-64bab10f48f1 tempest-FloatingIPsNegativeTestJSON-1488841468 tempest-FloatingIPsNegativeTestJSON-1488841468-project] Returning 404 to user: Floating IP pool not found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:38:22.741219 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ba6d2aac-51e0-416d-988f-64bab10f48f1 tempest-FloatingIPsNegativeTestJSON-1488841468 tempest-FloatingIPsNegativeTestJSON-1488841468-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.122497 Aug 04 16:38:22.742376 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 662/1287] 10.222.0.23 () {60 vars in 1170 bytes} [Thu Aug 4 16:38:22 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:38:22.757211 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cd0c7235-aff8-49ad-a7c0-7501eb23bfe3 tempest-FloatingIPsNegativeTestJSON-1488841468 tempest-FloatingIPsNegativeTestJSON-1488841468-project] Calling method '.version_select at 0x7f7e841581f0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:22.956711 n-d-846466-12 devstack@n-api.service[126125]: DEBUG neutronclient.v2_0.client [None req-cd0c7235-aff8-49ad-a7c0-7501eb23bfe3 tempest-FloatingIPsNegativeTestJSON-1488841468 tempest-FloatingIPsNegativeTestJSON-1488841468-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f7703db8-d337-41ef-8297-70e157cf5daa could not be found", "detail": ""}} {{(pid=126125) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:38:22.958570 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-cd0c7235-aff8-49ad-a7c0-7501eb23bfe3 tempest-FloatingIPsNegativeTestJSON-1488841468 tempest-FloatingIPsNegativeTestJSON-1488841468-project] HTTP exception thrown: Floating IP not found for ID f7703db8-d337-41ef-8297-70e157cf5daa Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cd0c7235-aff8-49ad-a7c0-7501eb23bfe3 tempest-FloatingIPsNegativeTestJSON-1488841468 tempest-FloatingIPsNegativeTestJSON-1488841468-project] Request method failure captured: Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/os-floating-ips/f7703db8-d337-41ef-8297-70e157cf5daa HTTP/1.1 Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_X9C-gs5zcvpEvMLD2OlBNvFH47ijvyNeREue3xITy8zuI6jBKGit1pcvbcEVW3bD5lUkVpxRPud8gGg-JbFBxlh1pcRVW0wDMYmLaxz3GxPdy7g9aph2PYYzyMwJM6XnFSHFXCuhdT7kChbmdxkWSfgiVbeuwWk0JHWpssOkihzx0 Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 35f4ceb274334666a2830d33bd022d5f Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1488841468 Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/35f4ceb274334666a2830d33bd022d5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_35f4ceb274334666a2830d33bd022d5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/35f4ceb274334666a2830d33bd022d5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/35f4ceb274334666a2830d33bd022d5f"}]}] Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1488841468 Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 35f4ceb274334666a2830d33bd022d5f Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1488841468 Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-FloatingIPsNegativeTestJSON-1488841468-project Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 223a12a1091548aa9bed7a670f2e8958 Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1488841468-project Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: exception: Floating IP not found for ID f7703db8-d337-41ef-8297-70e157cf5daa Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'f7703db8-d337-41ef-8297-70e157cf5daa'} Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP f7703db8-d337-41ef-8297-70e157cf5daa could not be found Aug 04 16:38:22.961168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0d04c319-bbd1-41bc-9924-fccf14ceb678'] Aug 04 16:38:22.965696 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:38:22.965696 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:38:22.965696 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:38:22.965696 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:38:22.965696 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 04 16:38:22.965696 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 04 16:38:22.965696 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 04 16:38:22.965696 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 04 16:38:22.965696 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID f7703db8-d337-41ef-8297-70e157cf5daa. Aug 04 16:38:22.965696 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:38:22.965696 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:38:22.965696 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:38:22.965696 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:38:22.965696 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:38:22.965696 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:38:22.965696 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:38:22.965696 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:38:22.965696 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:38:22.965696 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:38:22.965696 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:38:22.965696 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:38:22.965696 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 04 16:38:22.965696 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 16:38:22.965696 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID f7703db8-d337-41ef-8297-70e157cf5daa Aug 04 16:38:22.965696 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:38:22.965696 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:38:22.965696 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:38:22.965696 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:38:22.965696 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:38:22.965696 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:38:22.965696 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:38:22.965696 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:38:22.965696 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID f7703db8-d337-41ef-8297-70e157cf5daa Aug 04 16:38:22.965696 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:38:22.969334 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cd0c7235-aff8-49ad-a7c0-7501eb23bfe3 tempest-FloatingIPsNegativeTestJSON-1488841468 tempest-FloatingIPsNegativeTestJSON-1488841468-project] Returning 404 to user: Floating IP not found for ID f7703db8-d337-41ef-8297-70e157cf5daa {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:38:22.970442 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cd0c7235-aff8-49ad-a7c0-7501eb23bfe3 tempest-FloatingIPsNegativeTestJSON-1488841468 tempest-FloatingIPsNegativeTestJSON-1488841468-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/f7703db8-d337-41ef-8297-70e157cf5daa" status: 404 len: 111 microversion: 2.1 time: 0.222301 Aug 04 16:38:22.971598 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 663/1288] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Aug 4 16:38:22 2022] DELETE /compute/v2.1/os-floating-ips/f7703db8-d337-41ef-8297-70e157cf5daa => generated 111 bytes in 224 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:38:22.982067 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-864eaea0-8b0f-4a96-bfc9-f835e4a8f01f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:22.987395 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-864eaea0-8b0f-4a96-bfc9-f835e4a8f01f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: 532ec916-2768-43e0-a912-791fb4b5d9ea] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:23.002635 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-864eaea0-8b0f-4a96-bfc9-f835e4a8f01f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:23.003435 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-864eaea0-8b0f-4a96-bfc9-f835e4a8f01f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:23.008701 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-864eaea0-8b0f-4a96-bfc9-f835e4a8f01f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:23.009408 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-864eaea0-8b0f-4a96-bfc9-f835e4a8f01f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:23.785812 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b6ca14fa-45f9-459e-9d2e-667326879325 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:23.805191 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b6ca14fa-45f9-459e-9d2e-667326879325 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:23.807617 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b6ca14fa-45f9-459e-9d2e-667326879325 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:23.809462 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b6ca14fa-45f9-459e-9d2e-667326879325 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 1814 microversion: 2.25 time: 1.345280 Aug 04 16:38:23.813652 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 626/1289] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:38:22 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 1814 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:38:23.823056 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5e4f18a9-07f0-482c-b82e-8cf2f3103b09 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:23.824054 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5e4f18a9-07f0-482c-b82e-8cf2f3103b09 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:23.840542 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e4f18a9-07f0-482c-b82e-8cf2f3103b09 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:23.841274 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e4f18a9-07f0-482c-b82e-8cf2f3103b09 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:23.842350 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e4f18a9-07f0-482c-b82e-8cf2f3103b09 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:23.844517 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e4f18a9-07f0-482c-b82e-8cf2f3103b09 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:24.140400 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:38:24.895586 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-864eaea0-8b0f-4a96-bfc9-f835e4a8f01f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:24.929814 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-864eaea0-8b0f-4a96-bfc9-f835e4a8f01f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea" status: 200 len: 1509 microversion: 2.1 time: 1.956223 Aug 04 16:38:24.935264 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 664/1290] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:22 2022] GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea => generated 1509 bytes in 1963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:24.965716 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cc61a876-ac01-447f-b688-b7e7801298ba tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:24.967656 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cc61a876-ac01-447f-b688-b7e7801298ba tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:24.989365 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cc61a876-ac01-447f-b688-b7e7801298ba tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:24.991700 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cc61a876-ac01-447f-b688-b7e7801298ba tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:24.992664 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cc61a876-ac01-447f-b688-b7e7801298ba tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:24.993891 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cc61a876-ac01-447f-b688-b7e7801298ba tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:25.398510 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5e4f18a9-07f0-482c-b82e-8cf2f3103b09 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:25.412089 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5e4f18a9-07f0-482c-b82e-8cf2f3103b09 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1471 microversion: 2.1 time: 1.594651 Aug 04 16:38:25.416465 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 627/1291] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:23 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1471 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:25.435138 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-086573b4-0df2-4c1e-b53b-a343f587d8d8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:38:25.436186 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-086573b4-0df2-4c1e-b53b-a343f587d8d8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:25.451938 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-086573b4-0df2-4c1e-b53b-a343f587d8d8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:25.452779 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-086573b4-0df2-4c1e-b53b-a343f587d8d8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:25.454294 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-086573b4-0df2-4c1e-b53b-a343f587d8d8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:25.456908 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-086573b4-0df2-4c1e-b53b-a343f587d8d8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:25.552679 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-086573b4-0df2-4c1e-b53b-a343f587d8d8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:25.553588 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-086573b4-0df2-4c1e-b53b-a343f587d8d8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:25.555679 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-086573b4-0df2-4c1e-b53b-a343f587d8d8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:25.556556 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-086573b4-0df2-4c1e-b53b-a343f587d8d8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:25.646774 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cc61a876-ac01-447f-b688-b7e7801298ba tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:25.706136 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cc61a876-ac01-447f-b688-b7e7801298ba tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:25.715059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cc61a876-ac01-447f-b688-b7e7801298ba tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:25.726437 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cc61a876-ac01-447f-b688-b7e7801298ba tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 1814 microversion: 2.25 time: 0.782594 Aug 04 16:38:25.733514 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 665/1292] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:38:24 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 1814 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:38:25.743492 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-086573b4-0df2-4c1e-b53b-a343f587d8d8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Getting quotas for project c456fd996bb544478bdb39c6a7ca04a6. Resources: {'ram', 'cores'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:38:25.758323 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-086573b4-0df2-4c1e-b53b-a343f587d8d8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Getting quotas for user 6e582cea96b64285b4232b96162a274c and project c456fd996bb544478bdb39c6a7ca04a6. Resources: {'ram', 'cores'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:38:25.956293 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8bbb5b60-558b-41ca-9921-54bbdc247652 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:25.957938 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8bbb5b60-558b-41ca-9921-54bbdc247652 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: 532ec916-2768-43e0-a912-791fb4b5d9ea] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:25.974218 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:38:25.979830 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8bbb5b60-558b-41ca-9921-54bbdc247652 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:25.980926 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8bbb5b60-558b-41ca-9921-54bbdc247652 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:25.984715 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8bbb5b60-558b-41ca-9921-54bbdc247652 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:25.986288 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8bbb5b60-558b-41ca-9921-54bbdc247652 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:26.175102 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-086573b4-0df2-4c1e-b53b-a343f587d8d8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "POST /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33/action" status: 202 len: 0 microversion: 2.1 time: 0.737696 Aug 04 16:38:26.180423 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 628/1293] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:38:25 2022] POST /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33/action => generated 0 bytes in 751 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 16:38:26.220082 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-230f572b-2222-45a4-bb70-fcca29e4fe30 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:26.224542 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-230f572b-2222-45a4-bb70-fcca29e4fe30 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:26.247812 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-230f572b-2222-45a4-bb70-fcca29e4fe30 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:26.250970 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-230f572b-2222-45a4-bb70-fcca29e4fe30 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:26.252087 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-230f572b-2222-45a4-bb70-fcca29e4fe30 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:26.255323 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-230f572b-2222-45a4-bb70-fcca29e4fe30 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:27.529484 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-230f572b-2222-45a4-bb70-fcca29e4fe30 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:27.541013 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-230f572b-2222-45a4-bb70-fcca29e4fe30 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1470 microversion: 2.1 time: 1.354141 Aug 04 16:38:27.557544 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 629/1294] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:26 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1470 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:38:27.561645 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0504f03c-0535-48f1-b6f7-1d928fd16b7c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:27.562258 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0504f03c-0535-48f1-b6f7-1d928fd16b7c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:27.577937 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8bbb5b60-558b-41ca-9921-54bbdc247652 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:27.579160 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0504f03c-0535-48f1-b6f7-1d928fd16b7c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:27.579612 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0504f03c-0535-48f1-b6f7-1d928fd16b7c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:27.580435 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0504f03c-0535-48f1-b6f7-1d928fd16b7c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:27.580866 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0504f03c-0535-48f1-b6f7-1d928fd16b7c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:27.626512 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8bbb5b60-558b-41ca-9921-54bbdc247652 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea" status: 200 len: 1515 microversion: 2.1 time: 1.671158 Aug 04 16:38:27.630397 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 666/1295] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:25 2022] GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea => generated 1515 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:28.474496 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0504f03c-0535-48f1-b6f7-1d928fd16b7c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:28.490090 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0504f03c-0535-48f1-b6f7-1d928fd16b7c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:28.492099 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0504f03c-0535-48f1-b6f7-1d928fd16b7c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:28.500620 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0504f03c-0535-48f1-b6f7-1d928fd16b7c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 1814 microversion: 2.25 time: 0.954644 Aug 04 16:38:28.502226 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 630/1296] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:38:27 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 1814 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:38:28.589252 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ac0b992e-809e-4022-9158-9c78422b61b9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:28.590092 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ac0b992e-809e-4022-9158-9c78422b61b9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:28.616445 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ac0b992e-809e-4022-9158-9c78422b61b9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:28.618307 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ac0b992e-809e-4022-9158-9c78422b61b9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:28.623418 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ac0b992e-809e-4022-9158-9c78422b61b9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:28.625465 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ac0b992e-809e-4022-9158-9c78422b61b9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:28.761235 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=100 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:38:29.551041 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f0ea6586-b637-482d-8e69-9d7a73a0141b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:29.552327 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f0ea6586-b637-482d-8e69-9d7a73a0141b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:29.568245 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f0ea6586-b637-482d-8e69-9d7a73a0141b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:29.574723 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f0ea6586-b637-482d-8e69-9d7a73a0141b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:29.576041 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f0ea6586-b637-482d-8e69-9d7a73a0141b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:29.576661 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f0ea6586-b637-482d-8e69-9d7a73a0141b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:29.723792 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ac0b992e-809e-4022-9158-9c78422b61b9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:29.738093 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ac0b992e-809e-4022-9158-9c78422b61b9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1470 microversion: 2.1 time: 1.153546 Aug 04 16:38:29.750552 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 667/1297] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:28 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1470 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:29.925216 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-c2297c46-12fc-4ab9-b726-d10a511ba4a0 req-a8083838-ddc5-4679-b79d-e40184c7ecbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1430483-b3f7-473b-80f9-15beb90cfc33", "name": "network-vif-plugged", "status": "completed", "tag": "e435043b-4bd0-4a6c-98b0-1115388413c6"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:38:29.944371 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-c2297c46-12fc-4ab9-b726-d10a511ba4a0 req-a8083838-ddc5-4679-b79d-e40184c7ecbe service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:29.944961 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-c2297c46-12fc-4ab9-b726-d10a511ba4a0 req-a8083838-ddc5-4679-b79d-e40184c7ecbe service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:29.976872 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-c2297c46-12fc-4ab9-b726-d10a511ba4a0 req-a8083838-ddc5-4679-b79d-e40184c7ecbe service nova] Creating event network-vif-plugged:e435043b-4bd0-4a6c-98b0-1115388413c6 for instance d1430483-b3f7-473b-80f9-15beb90cfc33 on n-h1-846466-12 Aug 04 16:38:29.988526 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [req-c2297c46-12fc-4ab9-b726-d10a511ba4a0 req-a8083838-ddc5-4679-b79d-e40184c7ecbe service nova] Instance d1430483-b3f7-473b-80f9-15beb90cfc33 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 16:38:30.012853 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-c2297c46-12fc-4ab9-b726-d10a511ba4a0 req-a8083838-ddc5-4679-b79d-e40184c7ecbe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.260349 Aug 04 16:38:30.017562 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 668/1298] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:38:30.573724 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f0ea6586-b637-482d-8e69-9d7a73a0141b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:30.601460 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f0ea6586-b637-482d-8e69-9d7a73a0141b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:30.610448 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f0ea6586-b637-482d-8e69-9d7a73a0141b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:30.613532 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f0ea6586-b637-482d-8e69-9d7a73a0141b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 1814 microversion: 2.25 time: 1.067063 Aug 04 16:38:30.616718 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 631/1299] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:38:29 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 1814 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:38:30.815738 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f109366a-cbd4-41ac-9165-86eb1e2a77b5 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:30.817997 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f109366a-cbd4-41ac-9165-86eb1e2a77b5 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:30.833982 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f109366a-cbd4-41ac-9165-86eb1e2a77b5 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:30.836348 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f109366a-cbd4-41ac-9165-86eb1e2a77b5 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:30.838395 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f109366a-cbd4-41ac-9165-86eb1e2a77b5 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:30.840096 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f109366a-cbd4-41ac-9165-86eb1e2a77b5 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:31.666185 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7f05dfe7-5ed9-402e-9dfa-e3053c613b1e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:31.671021 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7f05dfe7-5ed9-402e-9dfa-e3053c613b1e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:31.695769 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f05dfe7-5ed9-402e-9dfa-e3053c613b1e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:31.702787 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f05dfe7-5ed9-402e-9dfa-e3053c613b1e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:31.707946 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f05dfe7-5ed9-402e-9dfa-e3053c613b1e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:31.713693 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f05dfe7-5ed9-402e-9dfa-e3053c613b1e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:32.454598 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f109366a-cbd4-41ac-9165-86eb1e2a77b5 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:32.464773 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f109366a-cbd4-41ac-9165-86eb1e2a77b5 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1470 microversion: 2.1 time: 1.690916 Aug 04 16:38:32.478946 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 669/1300] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:30 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1470 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:32.486839 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3df1e7ca-7e4e-423f-b3d9-16894d9c19c0 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Action: 'create', calling method: .version_select at 0x7f7e841c9700>, body: {"keypair": {"name": "tempest-keypair-2052337991", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgJyLd9bnBJRzm/fvQxvpVbxCPHNh8+Qp2zKst7Tx0DoQ+eaQobeeoPZoI+fPHppsDtrDOTjuT3mAL0e+YE3gcYSE7ycZ8It19m8Sa2DeZstcUY5K8WM9rmOFv9z65fVg=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:38:32.514289 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-3df1e7ca-7e4e-423f-b3d9-16894d9c19c0 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Getting quotas for project 20d035e0adc640c8a3ceb832275d0ea7. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:38:32.523688 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-3df1e7ca-7e4e-423f-b3d9-16894d9c19c0 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Getting quotas for user a88db264b2c94f699e015a8617150b45 and project 20d035e0adc640c8a3ceb832275d0ea7. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:38:32.541345 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7f05dfe7-5ed9-402e-9dfa-e3053c613b1e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:32.547261 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:38:32.570523 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7f05dfe7-5ed9-402e-9dfa-e3053c613b1e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:32.578243 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7f05dfe7-5ed9-402e-9dfa-e3053c613b1e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:32.581647 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7f05dfe7-5ed9-402e-9dfa-e3053c613b1e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 1814 microversion: 2.25 time: 0.927174 Aug 04 16:38:32.584065 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 632/1301] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:38:31 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 1814 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:38:32.599119 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3df1e7ca-7e4e-423f-b3d9-16894d9c19c0 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.122297 Aug 04 16:38:32.613117 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 670/1302] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 16:38:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:38:33.487680 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1b3bdc2c-fad1-42b4-8553-cae6ea02f036 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:33.488317 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1b3bdc2c-fad1-42b4-8553-cae6ea02f036 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:33.502938 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1b3bdc2c-fad1-42b4-8553-cae6ea02f036 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:33.503783 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1b3bdc2c-fad1-42b4-8553-cae6ea02f036 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:33.505214 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1b3bdc2c-fad1-42b4-8553-cae6ea02f036 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:33.506421 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1b3bdc2c-fad1-42b4-8553-cae6ea02f036 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:33.640135 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-153f03e4-a194-4737-838a-05cfe02f4a5b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:33.642627 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-153f03e4-a194-4737-838a-05cfe02f4a5b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:33.665602 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-153f03e4-a194-4737-838a-05cfe02f4a5b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:33.667063 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-153f03e4-a194-4737-838a-05cfe02f4a5b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:33.669049 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-153f03e4-a194-4737-838a-05cfe02f4a5b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:33.670145 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-153f03e4-a194-4737-838a-05cfe02f4a5b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:34.744716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1b3bdc2c-fad1-42b4-8553-cae6ea02f036 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:34.785114 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1b3bdc2c-fad1-42b4-8553-cae6ea02f036 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1470 microversion: 2.1 time: 1.295648 Aug 04 16:38:34.788812 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 633/1303] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:33 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1470 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:34.814580 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5288da83-d45b-45f1-9ac6-303fe9db66fe tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:34.836118 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5288da83-d45b-45f1-9ac6-303fe9db66fe tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c55bcf6e18a94d9781f840cb05a23abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be487ee187864a0987113d1248a873ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:34.836836 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5288da83-d45b-45f1-9ac6-303fe9db66fe tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Searching by: {'deleted': False, 'project_id': 'be487ee187864a0987113d1248a873ae'} {{(pid=126126) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:38:34.850186 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5288da83-d45b-45f1-9ac6-303fe9db66fe tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:34.850919 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5288da83-d45b-45f1-9ac6-303fe9db66fe tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:34.851744 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5288da83-d45b-45f1-9ac6-303fe9db66fe tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:34.852168 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5288da83-d45b-45f1-9ac6-303fe9db66fe tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:35.064604 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-153f03e4-a194-4737-838a-05cfe02f4a5b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:35.126783 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.multi_cell_list [None req-5288da83-d45b-45f1-9ac6-303fe9db66fe tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126126) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:38:35.155476 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-153f03e4-a194-4737-838a-05cfe02f4a5b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:35.167379 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-153f03e4-a194-4737-838a-05cfe02f4a5b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:35.169831 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-153f03e4-a194-4737-838a-05cfe02f4a5b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 1814 microversion: 2.25 time: 1.542106 Aug 04 16:38:35.195863 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 671/1304] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:38:33 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 1814 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:38:35.234182 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-31aa392f-fc22-4f87-b295-a0d4ac50300b req-2f955a52-522e-46d0-9517-a14bf6b646b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5021f3f8-aa8b-4c94-8846-fdd1081135f5", "name": "network-vif-unplugged", "status": "completed", "tag": "0ac743e2-4fd8-459b-98e6-2cd3c20f4ed6"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:38:35.335223 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-31aa392f-fc22-4f87-b295-a0d4ac50300b req-2f955a52-522e-46d0-9517-a14bf6b646b2 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:35.338072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-31aa392f-fc22-4f87-b295-a0d4ac50300b req-2f955a52-522e-46d0-9517-a14bf6b646b2 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:35.394083 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-31aa392f-fc22-4f87-b295-a0d4ac50300b req-2f955a52-522e-46d0-9517-a14bf6b646b2 service nova] Creating event network-vif-unplugged:0ac743e2-4fd8-459b-98e6-2cd3c20f4ed6 for instance 5021f3f8-aa8b-4c94-8846-fdd1081135f5 on n-h1-846466-12 Aug 04 16:38:35.413643 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-31aa392f-fc22-4f87-b295-a0d4ac50300b req-2f955a52-522e-46d0-9517-a14bf6b646b2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.214280 Aug 04 16:38:35.419015 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 672/1305] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:38:35.481347 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5288da83-d45b-45f1-9ac6-303fe9db66fe tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.683149 Aug 04 16:38:35.485589 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 634/1306] 10.222.0.23 () {58 vars in 1125 bytes} [Thu Aug 4 16:38:34 2022] GET /compute/v2.1/servers => generated 333 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:38:35.501518 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a10584e6-4f62-4b3e-95fe-47630196359d tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:35.515854 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a10584e6-4f62-4b3e-95fe-47630196359d tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c55bcf6e18a94d9781f840cb05a23abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be487ee187864a0987113d1248a873ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:35.516902 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a10584e6-4f62-4b3e-95fe-47630196359d tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Searching by: {'deleted': False, 'project_id': 'be487ee187864a0987113d1248a873ae'} {{(pid=126125) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:38:35.523471 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a10584e6-4f62-4b3e-95fe-47630196359d tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:35.528443 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a10584e6-4f62-4b3e-95fe-47630196359d tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:35.529642 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a10584e6-4f62-4b3e-95fe-47630196359d tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:35.530216 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a10584e6-4f62-4b3e-95fe-47630196359d tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:35.600752 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.multi_cell_list [None req-a10584e6-4f62-4b3e-95fe-47630196359d tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:38:35.708695 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a10584e6-4f62-4b3e-95fe-47630196359d tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c55bcf6e18a94d9781f840cb05a23abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be487ee187864a0987113d1248a873ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:35.722278 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a10584e6-4f62-4b3e-95fe-47630196359d tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:35.722803 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a10584e6-4f62-4b3e-95fe-47630196359d tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:35.808604 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-283f38ee-2fbe-465e-b2c0-108afbad6b9f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:35.810005 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-283f38ee-2fbe-465e-b2c0-108afbad6b9f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:35.829082 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-283f38ee-2fbe-465e-b2c0-108afbad6b9f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:35.829989 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-283f38ee-2fbe-465e-b2c0-108afbad6b9f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:35.831037 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-283f38ee-2fbe-465e-b2c0-108afbad6b9f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:35.831732 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-283f38ee-2fbe-465e-b2c0-108afbad6b9f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:36.382794 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a10584e6-4f62-4b3e-95fe-47630196359d tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 0.886932 Aug 04 16:38:36.400568 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 673/1307] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:38:35 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:38:36.400568 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-60ee5152-d055-46b8-8789-e335bbef0f1a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:36.402459 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-60ee5152-d055-46b8-8789-e335bbef0f1a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:36.417899 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-60ee5152-d055-46b8-8789-e335bbef0f1a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:36.419669 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-60ee5152-d055-46b8-8789-e335bbef0f1a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:36.424033 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-60ee5152-d055-46b8-8789-e335bbef0f1a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:36.424738 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-60ee5152-d055-46b8-8789-e335bbef0f1a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:37.519226 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-283f38ee-2fbe-465e-b2c0-108afbad6b9f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:37.535624 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-283f38ee-2fbe-465e-b2c0-108afbad6b9f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1536 microversion: 2.1 time: 1.731041 Aug 04 16:38:37.569585 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 635/1308] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:35 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1536 bytes in 1752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:38:37.583839 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1473e697-63a7-4aaa-966a-cd88e641619a tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:37.632210 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1473e697-63a7-4aaa-966a-cd88e641619a tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.060189 Aug 04 16:38:37.650901 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 636/1309] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Aug 4 16:38:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:38:37.664281 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-a34c2796-3efd-4399-b8f2-06411220a4c2 req-681bbbb3-8509-41ac-81b0-4ef2fa754c5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1430483-b3f7-473b-80f9-15beb90cfc33", "name": "network-vif-unplugged", "status": "completed", "tag": "e435043b-4bd0-4a6c-98b0-1115388413c6"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:38:37.701716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a34c2796-3efd-4399-b8f2-06411220a4c2 req-681bbbb3-8509-41ac-81b0-4ef2fa754c5f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:37.705552 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a34c2796-3efd-4399-b8f2-06411220a4c2 req-681bbbb3-8509-41ac-81b0-4ef2fa754c5f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:37.740889 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-60ee5152-d055-46b8-8789-e335bbef0f1a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:37.755845 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-60ee5152-d055-46b8-8789-e335bbef0f1a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:37.759571 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-a34c2796-3efd-4399-b8f2-06411220a4c2 req-681bbbb3-8509-41ac-81b0-4ef2fa754c5f service nova] Creating event network-vif-unplugged:e435043b-4bd0-4a6c-98b0-1115388413c6 for instance d1430483-b3f7-473b-80f9-15beb90cfc33 on n-h2-846466-12 Aug 04 16:38:37.765961 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-60ee5152-d055-46b8-8789-e335bbef0f1a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:37.770101 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-60ee5152-d055-46b8-8789-e335bbef0f1a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 1814 microversion: 2.25 time: 1.385217 Aug 04 16:38:37.778035 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 674/1310] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:38:36 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 1814 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:38:37.838252 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [req-a34c2796-3efd-4399-b8f2-06411220a4c2 req-681bbbb3-8509-41ac-81b0-4ef2fa754c5f service nova] Instance d1430483-b3f7-473b-80f9-15beb90cfc33 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126126) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 16:38:37.902678 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-a34c2796-3efd-4399-b8f2-06411220a4c2 req-681bbbb3-8509-41ac-81b0-4ef2fa754c5f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.244789 Aug 04 16:38:37.908146 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 637/1311] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:38:37.993988 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-36ec492e-5e02-4f67-8d5c-0015078f034f tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:37.994672 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-36ec492e-5e02-4f67-8d5c-0015078f034f tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] [instance: 121a11b7-b8e0-4232-a03b-1399ef2d387f] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:38.014537 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-36ec492e-5e02-4f67-8d5c-0015078f034f tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:38.023786 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-36ec492e-5e02-4f67-8d5c-0015078f034f tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:38.024956 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-36ec492e-5e02-4f67-8d5c-0015078f034f tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:38.026366 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-36ec492e-5e02-4f67-8d5c-0015078f034f tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:38.192567 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-36ec492e-5e02-4f67-8d5c-0015078f034f tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] [instance: 121a11b7-b8e0-4232-a03b-1399ef2d387f] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:38:38.620956 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c8bfc8d8-9878-47c6-b06f-64c64caa253b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:38.623402 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c8bfc8d8-9878-47c6-b06f-64c64caa253b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:38.661219 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c8bfc8d8-9878-47c6-b06f-64c64caa253b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:38.663877 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c8bfc8d8-9878-47c6-b06f-64c64caa253b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:38.670681 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c8bfc8d8-9878-47c6-b06f-64c64caa253b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:38.672552 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c8bfc8d8-9878-47c6-b06f-64c64caa253b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:38.714524 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-36ec492e-5e02-4f67-8d5c-0015078f034f tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] 10.222.0.23 "DELETE /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f" status: 204 len: 0 microversion: 2.1 time: 0.725641 Aug 04 16:38:38.718383 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 675/1312] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:38:37 2022] DELETE /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f => generated 0 bytes in 730 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:38:38.737993 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-15a849eb-594a-4f6c-a2bd-65fe5dbb7605 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:38.741646 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-15a849eb-594a-4f6c-a2bd-65fe5dbb7605 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] [instance: 121a11b7-b8e0-4232-a03b-1399ef2d387f] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:38.759500 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-15a849eb-594a-4f6c-a2bd-65fe5dbb7605 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:38.762531 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-15a849eb-594a-4f6c-a2bd-65fe5dbb7605 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:38.765069 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-15a849eb-594a-4f6c-a2bd-65fe5dbb7605 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:38.769086 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-15a849eb-594a-4f6c-a2bd-65fe5dbb7605 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:39.870620 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c8bfc8d8-9878-47c6-b06f-64c64caa253b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:39.944903 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c8bfc8d8-9878-47c6-b06f-64c64caa253b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1536 microversion: 2.1 time: 1.345393 Aug 04 16:38:39.960024 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 638/1313] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:38 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1536 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:39.966690 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ce9d39e6-7741-45cb-b2b0-713f67b9bdc0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:39.974328 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ce9d39e6-7741-45cb-b2b0-713f67b9bdc0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:39.989913 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ce9d39e6-7741-45cb-b2b0-713f67b9bdc0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:39.990769 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ce9d39e6-7741-45cb-b2b0-713f67b9bdc0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:39.991853 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ce9d39e6-7741-45cb-b2b0-713f67b9bdc0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:39.992475 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ce9d39e6-7741-45cb-b2b0-713f67b9bdc0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:40.324699 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-15a849eb-594a-4f6c-a2bd-65fe5dbb7605 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c55bcf6e18a94d9781f840cb05a23abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be487ee187864a0987113d1248a873ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:40.389967 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-15a849eb-594a-4f6c-a2bd-65fe5dbb7605 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] 10.222.0.23 "GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f" status: 200 len: 1701 microversion: 2.1 time: 1.665443 Aug 04 16:38:40.422509 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 676/1314] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:38 2022] GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f => generated 1701 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:40.454383 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-6ef3acb4-6793-423e-a42a-5aa214e8aae0 req-9c5b5d84-99fc-461d-a98f-20ea3bc1f9c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5021f3f8-aa8b-4c94-8846-fdd1081135f5", "tag": "0ac743e2-4fd8-459b-98e6-2cd3c20f4ed6"}, {"name": "network-changed", "server_uuid": "d1430483-b3f7-473b-80f9-15beb90cfc33", "tag": "e435043b-4bd0-4a6c-98b0-1115388413c6"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:38:40.518317 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6ef3acb4-6793-423e-a42a-5aa214e8aae0 req-9c5b5d84-99fc-461d-a98f-20ea3bc1f9c8 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:40.524217 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6ef3acb4-6793-423e-a42a-5aa214e8aae0 req-9c5b5d84-99fc-461d-a98f-20ea3bc1f9c8 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:40.603848 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-6ef3acb4-6793-423e-a42a-5aa214e8aae0 req-9c5b5d84-99fc-461d-a98f-20ea3bc1f9c8 service nova] Creating event network-changed:0ac743e2-4fd8-459b-98e6-2cd3c20f4ed6 for instance 5021f3f8-aa8b-4c94-8846-fdd1081135f5 on n-h1-846466-12 Aug 04 16:38:40.604811 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-6ef3acb4-6793-423e-a42a-5aa214e8aae0 req-9c5b5d84-99fc-461d-a98f-20ea3bc1f9c8 service nova] Creating event network-changed:e435043b-4bd0-4a6c-98b0-1115388413c6 for instance d1430483-b3f7-473b-80f9-15beb90cfc33 on n-h2-846466-12 Aug 04 16:38:40.639524 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [req-6ef3acb4-6793-423e-a42a-5aa214e8aae0 req-9c5b5d84-99fc-461d-a98f-20ea3bc1f9c8 service nova] Instance d1430483-b3f7-473b-80f9-15beb90cfc33 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 16:38:40.715295 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-6ef3acb4-6793-423e-a42a-5aa214e8aae0 req-9c5b5d84-99fc-461d-a98f-20ea3bc1f9c8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.286106 Aug 04 16:38:40.723368 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 677/1315] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:38:41.014625 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bf676247-5ea1-44c3-bb67-13b2e02ab125 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:41.015363 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bf676247-5ea1-44c3-bb67-13b2e02ab125 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:41.050155 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf676247-5ea1-44c3-bb67-13b2e02ab125 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:41.050155 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf676247-5ea1-44c3-bb67-13b2e02ab125 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:41.051278 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf676247-5ea1-44c3-bb67-13b2e02ab125 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:41.051715 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf676247-5ea1-44c3-bb67-13b2e02ab125 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:41.828587 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ce9d39e6-7741-45cb-b2b0-713f67b9bdc0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:41.855188 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ce9d39e6-7741-45cb-b2b0-713f67b9bdc0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:41.857210 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ce9d39e6-7741-45cb-b2b0-713f67b9bdc0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:41.858473 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ce9d39e6-7741-45cb-b2b0-713f67b9bdc0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 1814 microversion: 2.25 time: 1.896003 Aug 04 16:38:41.859634 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 639/1316] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:38:39 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 1814 bytes in 1898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:38:41.865790 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dbb6fb35-0818-442f-bb54-dacf14a1090b tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:41.866417 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-dbb6fb35-0818-442f-bb54-dacf14a1090b tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] [instance: 121a11b7-b8e0-4232-a03b-1399ef2d387f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:41.886524 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dbb6fb35-0818-442f-bb54-dacf14a1090b tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:41.887305 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dbb6fb35-0818-442f-bb54-dacf14a1090b tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:41.888140 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dbb6fb35-0818-442f-bb54-dacf14a1090b tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:41.888582 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dbb6fb35-0818-442f-bb54-dacf14a1090b tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:42.616624 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-dbb6fb35-0818-442f-bb54-dacf14a1090b tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c55bcf6e18a94d9781f840cb05a23abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be487ee187864a0987113d1248a873ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:42.627936 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dbb6fb35-0818-442f-bb54-dacf14a1090b tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] 10.222.0.23 "GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f" status: 200 len: 1701 microversion: 2.1 time: 0.766814 Aug 04 16:38:42.642879 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 640/1317] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:41 2022] GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f => generated 1701 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:42.651507 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b619e31c-a05c-4351-a86a-3ffe28905cf0 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1617123449", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae4e4fd4-6cd4-4458-b6a4-6a319728f4a0"}], "security_groups": [{"name": "tempest-securitygroup--511311923"}], "key_name": "tempest-keypair-2052337991", "user_data": "}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:38:43.306729 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-b619e31c-a05c-4351-a86a-3ffe28905cf0 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] validate_networks() for [('ae4e4fd4-6cd4-4458-b6a4-6a319728f4a0', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:38:43.534522 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bf676247-5ea1-44c3-bb67-13b2e02ab125 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:43.559298 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bf676247-5ea1-44c3-bb67-13b2e02ab125 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1536 microversion: 2.1 time: 2.549341 Aug 04 16:38:43.562056 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 678/1318] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:41 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1536 bytes in 2554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:43.573945 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-31ae0757-2378-44e6-8414-9a6bfc75c2f0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:43.575080 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-31ae0757-2378-44e6-8414-9a6bfc75c2f0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:43.590763 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-31ae0757-2378-44e6-8414-9a6bfc75c2f0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:43.606705 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-31ae0757-2378-44e6-8414-9a6bfc75c2f0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:43.609619 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-31ae0757-2378-44e6-8414-9a6bfc75c2f0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:43.611209 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-31ae0757-2378-44e6-8414-9a6bfc75c2f0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:44.958295 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=5 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:38:45.101007 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-31ae0757-2378-44e6-8414-9a6bfc75c2f0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:45.139238 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-31ae0757-2378-44e6-8414-9a6bfc75c2f0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:45.141067 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-31ae0757-2378-44e6-8414-9a6bfc75c2f0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:45.142478 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-31ae0757-2378-44e6-8414-9a6bfc75c2f0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 1814 microversion: 2.25 time: 1.578759 Aug 04 16:38:45.143089 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 679/1319] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:38:43 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 1814 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:38:45.153517 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:38:45.441316 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-afbf09c1-d0e8-4913-b875-be468fabb93b tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] Action: 'create', calling method: .version_select at 0x7f7e846d65e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1750997336", "description": "tempest-description-50764591"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:38:45.556229 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:38:45.705521 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:38:47.523181 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-afbf09c1-d0e8-4913-b875-be468fabb93b tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 2.377292 Aug 04 16:38:47.527738 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 680/1320] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Aug 4 16:38:45 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 2383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:38:47.545381 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dfc3c651-0f77-463f-82d1-65373792214f tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:47.550171 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dfc3c651-0f77-463f-82d1-65373792214f tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] [instance: 121a11b7-b8e0-4232-a03b-1399ef2d387f] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:47.589806 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dfc3c651-0f77-463f-82d1-65373792214f tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:47.595959 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dfc3c651-0f77-463f-82d1-65373792214f tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:47.599937 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dfc3c651-0f77-463f-82d1-65373792214f tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:47.601157 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dfc3c651-0f77-463f-82d1-65373792214f tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:48.354530 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dfc3c651-0f77-463f-82d1-65373792214f tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c55bcf6e18a94d9781f840cb05a23abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be487ee187864a0987113d1248a873ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:48.384518 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dfc3c651-0f77-463f-82d1-65373792214f tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] 10.222.0.23 "GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f" status: 200 len: 1633 microversion: 2.1 time: 0.845587 Aug 04 16:38:48.386345 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 681/1321] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:47 2022] GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f => generated 1633 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:48.400384 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-956af464-afdf-4383-9c12-fa2dfb92fcf6 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:48.400999 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-956af464-afdf-4383-9c12-fa2dfb92fcf6 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:48.433133 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-956af464-afdf-4383-9c12-fa2dfb92fcf6 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:48.433650 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-956af464-afdf-4383-9c12-fa2dfb92fcf6 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:48.438154 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-956af464-afdf-4383-9c12-fa2dfb92fcf6 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:48.439845 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-956af464-afdf-4383-9c12-fa2dfb92fcf6 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:48.902013 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-b619e31c-a05c-4351-a86a-3ffe28905cf0 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:38:48.902873 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-b619e31c-a05c-4351-a86a-3ffe28905cf0 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:38:48.908000 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-b619e31c-a05c-4351-a86a-3ffe28905cf0 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:38:48.912716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-b619e31c-a05c-4351-a86a-3ffe28905cf0 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:38:48.916061 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-b619e31c-a05c-4351-a86a-3ffe28905cf0 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:38:48.986409 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b619e31c-a05c-4351-a86a-3ffe28905cf0 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:48.987158 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b619e31c-a05c-4351-a86a-3ffe28905cf0 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:48.998091 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b619e31c-a05c-4351-a86a-3ffe28905cf0 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:48.998929 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b619e31c-a05c-4351-a86a-3ffe28905cf0 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:49.147954 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-b619e31c-a05c-4351-a86a-3ffe28905cf0 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Getting quotas for project 20d035e0adc640c8a3ceb832275d0ea7. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:38:49.184310 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-b619e31c-a05c-4351-a86a-3ffe28905cf0 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Getting quotas for user a88db264b2c94f699e015a8617150b45 and project 20d035e0adc640c8a3ceb832275d0ea7. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:38:49.213589 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b619e31c-a05c-4351-a86a-3ffe28905cf0 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:38:49.220905 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b619e31c-a05c-4351-a86a-3ffe28905cf0 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:38:49.513844 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b619e31c-a05c-4351-a86a-3ffe28905cf0 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 6.864434 Aug 04 16:38:49.528229 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 641/1322] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:38:42 2022] POST /compute/v2.1/servers => generated 408 bytes in 6884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:38:49.549794 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-3c0667f9-6507-4ed9-bc58-3aeafb6f6717 req-0880dd54-c89b-46dc-aeaf-ab6499cd13c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "121a11b7-b8e0-4232-a03b-1399ef2d387f", "name": "network-vif-unplugged", "status": "completed", "tag": "c9ddc57c-cecd-45c7-8bc9-495ab0624e7e"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:38:49.613458 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-3c0667f9-6507-4ed9-bc58-3aeafb6f6717 req-0880dd54-c89b-46dc-aeaf-ab6499cd13c6 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:49.619795 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-3c0667f9-6507-4ed9-bc58-3aeafb6f6717 req-0880dd54-c89b-46dc-aeaf-ab6499cd13c6 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:49.700091 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-3c0667f9-6507-4ed9-bc58-3aeafb6f6717 req-0880dd54-c89b-46dc-aeaf-ab6499cd13c6 service nova] Creating event network-vif-unplugged:c9ddc57c-cecd-45c7-8bc9-495ab0624e7e for instance 121a11b7-b8e0-4232-a03b-1399ef2d387f on n-h2-846466-12 Aug 04 16:38:49.732775 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-3c0667f9-6507-4ed9-bc58-3aeafb6f6717 req-0880dd54-c89b-46dc-aeaf-ab6499cd13c6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.194157 Aug 04 16:38:49.741408 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 642/1323] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:38:49.756946 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c8e60edc-3245-4f7f-abf7-10d81ee344b3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:49.758742 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c8e60edc-3245-4f7f-abf7-10d81ee344b3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:49.787683 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c8e60edc-3245-4f7f-abf7-10d81ee344b3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:49.793883 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c8e60edc-3245-4f7f-abf7-10d81ee344b3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:49.795251 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c8e60edc-3245-4f7f-abf7-10d81ee344b3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:49.796167 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c8e60edc-3245-4f7f-abf7-10d81ee344b3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:50.837843 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-956af464-afdf-4383-9c12-fa2dfb92fcf6 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:50.859672 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-956af464-afdf-4383-9c12-fa2dfb92fcf6 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1536 microversion: 2.1 time: 2.469300 Aug 04 16:38:50.860743 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 682/1324] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:48 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1536 bytes in 2474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:50.880356 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2c64c56c-258b-4826-90e8-d0b9536397f2 tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] Action: 'create', calling method: .version_select at 0x7f7e848c4040>, body: {"security_group_rule": {"parent_group_id": "595ee6d8-415f-4c03-ac01-1ce4ddd0637b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:38:51.943697 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c8e60edc-3245-4f7f-abf7-10d81ee344b3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:51.971143 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c8e60edc-3245-4f7f-abf7-10d81ee344b3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:51.979357 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c8e60edc-3245-4f7f-abf7-10d81ee344b3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:51.985814 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c8e60edc-3245-4f7f-abf7-10d81ee344b3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 1814 microversion: 2.25 time: 2.241214 Aug 04 16:38:51.995632 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 643/1325] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:38:49 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 1814 bytes in 2253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:38:52.039961 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-eae418fc-a917-4e0b-9e56-4422e0ed4580 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:52.040839 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-eae418fc-a917-4e0b-9e56-4422e0ed4580 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] [instance: 121a11b7-b8e0-4232-a03b-1399ef2d387f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:52.084732 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eae418fc-a917-4e0b-9e56-4422e0ed4580 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:52.085579 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eae418fc-a917-4e0b-9e56-4422e0ed4580 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:52.086450 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eae418fc-a917-4e0b-9e56-4422e0ed4580 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:52.086939 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eae418fc-a917-4e0b-9e56-4422e0ed4580 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:52.667017 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-eae418fc-a917-4e0b-9e56-4422e0ed4580 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c55bcf6e18a94d9781f840cb05a23abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be487ee187864a0987113d1248a873ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:52.693050 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-eae418fc-a917-4e0b-9e56-4422e0ed4580 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] 10.222.0.23 "GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f" status: 200 len: 1633 microversion: 2.1 time: 0.696151 Aug 04 16:38:52.695159 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 644/1326] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:51 2022] GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f => generated 1633 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:52.702005 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a01f2748-23ca-4c02-aa9c-e3832522a79e tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:52.702950 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a01f2748-23ca-4c02-aa9c-e3832522a79e tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:52.725100 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a01f2748-23ca-4c02-aa9c-e3832522a79e tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:52.725986 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a01f2748-23ca-4c02-aa9c-e3832522a79e tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:52.728067 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a01f2748-23ca-4c02-aa9c-e3832522a79e tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:52.728520 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a01f2748-23ca-4c02-aa9c-e3832522a79e tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:53.231506 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a01f2748-23ca-4c02-aa9c-e3832522a79e tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:53.250405 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a01f2748-23ca-4c02-aa9c-e3832522a79e tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727" status: 200 len: 1304 microversion: 2.1 time: 0.549652 Aug 04 16:38:53.255236 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 645/1327] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:52 2022] GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727 => generated 1304 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:53.277712 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e30128d8-ab48-4c58-8a00-c8ce16ab7cdc tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] Calling method '.version_select at 0x7f7e84a88160>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:53.458750 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e30128d8-ab48-4c58-8a00-c8ce16ab7cdc tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] 10.222.0.23 "GET /compute/v2.1/images/47cba8b4-7f12-46ea-8ecf-aaa9964b6868" status: 200 len: 636 microversion: 2.1 time: 0.198030 Aug 04 16:38:53.460579 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 646/1328] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:38:53 2022] GET /compute/v2.1/images/47cba8b4-7f12-46ea-8ecf-aaa9964b6868 => generated 636 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:38:53.510021 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-038931f4-c428-4379-ae99-5795e9a1fa99 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:53.520938 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-038931f4-c428-4379-ae99-5795e9a1fa99 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:53.580295 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-038931f4-c428-4379-ae99-5795e9a1fa99 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:53.586181 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-038931f4-c428-4379-ae99-5795e9a1fa99 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:53.590113 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-038931f4-c428-4379-ae99-5795e9a1fa99 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:53.597580 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-038931f4-c428-4379-ae99-5795e9a1fa99 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:55.478440 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2c64c56c-258b-4826-90e8-d0b9536397f2 tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 4.614565 Aug 04 16:38:55.479223 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 683/1329] 10.222.0.23 () {60 vars in 1195 bytes} [Thu Aug 4 16:38:50 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 4616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:38:55.485754 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-07d62916-afcc-4332-b4ba-3ffbe23ffbc1 req-cd646fab-1d61-4383-9ddf-dd2861ea53a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "121a11b7-b8e0-4232-a03b-1399ef2d387f", "name": "network-vif-deleted", "tag": "c9ddc57c-cecd-45c7-8bc9-495ab0624e7e"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:38:55.515300 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-038931f4-c428-4379-ae99-5795e9a1fa99 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:55.540635 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-07d62916-afcc-4332-b4ba-3ffbe23ffbc1 req-cd646fab-1d61-4383-9ddf-dd2861ea53a3 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:55.541130 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-07d62916-afcc-4332-b4ba-3ffbe23ffbc1 req-cd646fab-1d61-4383-9ddf-dd2861ea53a3 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:55.561958 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-038931f4-c428-4379-ae99-5795e9a1fa99 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1529 microversion: 2.1 time: 2.092634 Aug 04 16:38:55.565187 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 647/1330] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:53 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1529 bytes in 2101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:55.583280 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f06d09aa-48bf-4f12-843a-a24b65abab7e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:55.584836 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f06d09aa-48bf-4f12-843a-a24b65abab7e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:55.595930 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-07d62916-afcc-4332-b4ba-3ffbe23ffbc1 req-cd646fab-1d61-4383-9ddf-dd2861ea53a3 service nova] Creating event network-vif-deleted:c9ddc57c-cecd-45c7-8bc9-495ab0624e7e for instance 121a11b7-b8e0-4232-a03b-1399ef2d387f on n-h2-846466-12 Aug 04 16:38:55.612587 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-07d62916-afcc-4332-b4ba-3ffbe23ffbc1 req-cd646fab-1d61-4383-9ddf-dd2861ea53a3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129132 Aug 04 16:38:55.614661 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 684/1331] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:38:55.633005 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ef1138d0-dee5-4649-82eb-e2d08f3f03c1 tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] Action: 'update_all', calling method: .version_select at 0x7f7e84194e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:38:55.645068 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f06d09aa-48bf-4f12-843a-a24b65abab7e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:55.645603 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f06d09aa-48bf-4f12-843a-a24b65abab7e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:55.648514 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f06d09aa-48bf-4f12-843a-a24b65abab7e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:55.654047 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f06d09aa-48bf-4f12-843a-a24b65abab7e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:55.830468 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-ef1138d0-dee5-4649-82eb-e2d08f3f03c1 tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] Getting quotas for project 70f61cda639b4b57994c1ba18adeea2c. Resources: dict_keys(['metadata_items']) {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:38:55.845520 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-ef1138d0-dee5-4649-82eb-e2d08f3f03c1 tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] Getting quotas for user 188dd705204c4fe38f2ddf5d65f7ef39 and project 70f61cda639b4b57994c1ba18adeea2c. Resources: dict_keys(['metadata_items']) {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:38:56.603141 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ef1138d0-dee5-4649-82eb-e2d08f3f03c1 tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] 10.222.0.23 "PUT /compute/v2.1/images/47cba8b4-7f12-46ea-8ecf-aaa9964b6868/metadata" status: 200 len: 61 microversion: 2.1 time: 0.984508 Aug 04 16:38:56.608367 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 685/1332] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Aug 4 16:38:55 2022] PUT /compute/v2.1/images/47cba8b4-7f12-46ea-8ecf-aaa9964b6868/metadata => generated 61 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:38:56.616981 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4c514ed8-2b55-4b07-a97b-61bac009bfff tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:56.626559 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4c514ed8-2b55-4b07-a97b-61bac009bfff tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] [instance: 121a11b7-b8e0-4232-a03b-1399ef2d387f] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:56.643020 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:38:56.661957 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4c514ed8-2b55-4b07-a97b-61bac009bfff tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:56.664705 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4c514ed8-2b55-4b07-a97b-61bac009bfff tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:56.668123 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4c514ed8-2b55-4b07-a97b-61bac009bfff tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:56.669223 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4c514ed8-2b55-4b07-a97b-61bac009bfff tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:56.697056 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-4c514ed8-2b55-4b07-a97b-61bac009bfff tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] HTTP exception thrown: Instance 121a11b7-b8e0-4232-a03b-1399ef2d387f could not be found. Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4c514ed8-2b55-4b07-a97b-61bac009bfff tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Request method failure captured: Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f HTTP/1.1 Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_W8V9-YEgJ7dZBISW0dh4DyATiPsgi1DPnUdk686Pf4iBZKCBCyqtAjbYlnpbM3mXgC477T2govDlc-yLYdoiZpZGvQwxxm7UfA7pdUjUi9aMz4TyJC4eK7LLs3LgcOVO9259v4vxo7gwajQUlcDSkZQuADRhVPvBYW0zgAlLV91KY Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: be487ee187864a0987113d1248a873ae Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersTestJSON-2048055781 Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/be487ee187864a0987113d1248a873ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_be487ee187864a0987113d1248a873ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/be487ee187864a0987113d1248a873ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/be487ee187864a0987113d1248a873ae"}]}] Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersTestJSON-2048055781 Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: be487ee187864a0987113d1248a873ae Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersTestJSON-2048055781 Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersTestJSON-2048055781-project Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: c55bcf6e18a94d9781f840cb05a23abf Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersTestJSON-2048055781-project Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 121a11b7-b8e0-4232-a03b-1399ef2d387f could not be found. Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '121a11b7-b8e0-4232-a03b-1399ef2d387f'} Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 121a11b7-b8e0-4232-a03b-1399ef2d387f could not be found. Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 121a11b7-b8e0-4232-a03b-1399ef2d387f could not be found. Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:38:56.700297 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:38:56.707630 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:38:56.707630 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:38:56.707630 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:38:56.707630 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:38:56.707630 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:38:56.707630 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 121a11b7-b8e0-4232-a03b-1399ef2d387f could not be found. Aug 04 16:38:56.707630 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:38:56.719032 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4c514ed8-2b55-4b07-a97b-61bac009bfff tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Returning 404 to user: Instance 121a11b7-b8e0-4232-a03b-1399ef2d387f could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:38:56.720509 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4c514ed8-2b55-4b07-a97b-61bac009bfff tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] 10.222.0.23 "GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f" status: 404 len: 111 microversion: 2.1 time: 0.114573 Aug 04 16:38:56.721527 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 686/1333] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:56 2022] GET /compute/v2.1/servers/121a11b7-b8e0-4232-a03b-1399ef2d387f => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:38:56.762856 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1cbab64a-c04a-46f7-a11b-f790a3388cb8 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:56.767884 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1cbab64a-c04a-46f7-a11b-f790a3388cb8 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:56.799025 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1cbab64a-c04a-46f7-a11b-f790a3388cb8 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:56.800524 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1cbab64a-c04a-46f7-a11b-f790a3388cb8 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:56.804363 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1cbab64a-c04a-46f7-a11b-f790a3388cb8 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:56.806341 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1cbab64a-c04a-46f7-a11b-f790a3388cb8 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:57.039943 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f06d09aa-48bf-4f12-843a-a24b65abab7e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:57.073176 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f06d09aa-48bf-4f12-843a-a24b65abab7e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:57.076991 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f06d09aa-48bf-4f12-843a-a24b65abab7e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:57.084344 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f06d09aa-48bf-4f12-843a-a24b65abab7e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 1814 microversion: 2.25 time: 1.513901 Aug 04 16:38:57.107494 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 648/1334] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:38:55 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 1814 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:38:57.144590 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-51b37f34-3639-462d-a8d7-37d15b2ad54a req-4c9b6ecc-ee16-4d4c-808c-c055e198f5c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1430483-b3f7-473b-80f9-15beb90cfc33", "name": "network-vif-plugged", "status": "completed", "tag": "e435043b-4bd0-4a6c-98b0-1115388413c6"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:38:57.214446 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-51b37f34-3639-462d-a8d7-37d15b2ad54a req-4c9b6ecc-ee16-4d4c-808c-c055e198f5c6 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:57.221450 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-51b37f34-3639-462d-a8d7-37d15b2ad54a req-4c9b6ecc-ee16-4d4c-808c-c055e198f5c6 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:57.299633 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-51b37f34-3639-462d-a8d7-37d15b2ad54a req-4c9b6ecc-ee16-4d4c-808c-c055e198f5c6 service nova] Creating event network-vif-plugged:e435043b-4bd0-4a6c-98b0-1115388413c6 for instance d1430483-b3f7-473b-80f9-15beb90cfc33 on n-h2-846466-12 Aug 04 16:38:57.344955 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-51b37f34-3639-462d-a8d7-37d15b2ad54a req-4c9b6ecc-ee16-4d4c-808c-c055e198f5c6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.230233 Aug 04 16:38:57.347071 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 649/1335] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:38:57.353380 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1369e34a-d1d0-4dbf-9a0f-112f296715bb tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] Action: 'create', calling method: .version_select at 0x7f7e849e2ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1074833849", "description": "tempest-description-550920726"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:38:58.032493 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1cbab64a-c04a-46f7-a11b-f790a3388cb8 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:58.045980 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1cbab64a-c04a-46f7-a11b-f790a3388cb8 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727" status: 200 len: 1371 microversion: 2.1 time: 1.320280 Aug 04 16:38:58.046627 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 687/1336] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:56 2022] GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727 => generated 1371 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:58.070808 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-18330157-fde1-425f-bf19-d37e183247aa tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:58.071619 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-18330157-fde1-425f-bf19-d37e183247aa tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:58.097663 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-18330157-fde1-425f-bf19-d37e183247aa tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:58.098119 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-18330157-fde1-425f-bf19-d37e183247aa tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:58.098968 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-18330157-fde1-425f-bf19-d37e183247aa tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:58.099488 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-18330157-fde1-425f-bf19-d37e183247aa tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:58.124140 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:38:58.530240 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1369e34a-d1d0-4dbf-9a0f-112f296715bb tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.181078 Aug 04 16:38:58.532138 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 650/1337] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Aug 4 16:38:57 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:38:58.543708 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2085f7b3-52f8-4a60-a6cf-070cf32e2836 tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] Calling method '.version_select at 0x7f7e849dadc0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:58.595488 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-18330157-fde1-425f-bf19-d37e183247aa tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:58.607432 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-18330157-fde1-425f-bf19-d37e183247aa tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1529 microversion: 2.1 time: 0.557749 Aug 04 16:38:58.608674 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 688/1338] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:58 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1529 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:38:58.614359 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5cd2a66b-3b31-475a-ae30-3b2df7604967 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] Calling method '.version_select at 0x7f7e84d8b4c0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:58.650021 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5cd2a66b-3b31-475a-ae30-3b2df7604967 tempest-ServersTestJSON-2048055781 tempest-ServersTestJSON-2048055781-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1611701469" status: 202 len: 0 microversion: 2.1 time: 0.039042 Aug 04 16:38:58.651799 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 689/1339] 10.222.0.23 () {58 vars in 1221 bytes} [Thu Aug 4 16:38:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1611701469 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:38:59.086054 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:38:59.188579 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2085f7b3-52f8-4a60-a6cf-070cf32e2836 tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] 10.222.0.23 "DELETE /compute/v2.1/images/47cba8b4-7f12-46ea-8ecf-aaa9964b6868/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.654859 Aug 04 16:38:59.189158 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 651/1340] 10.222.0.23 () {58 vars in 1296 bytes} [Thu Aug 4 16:38:58 2022] DELETE /compute/v2.1/images/47cba8b4-7f12-46ea-8ecf-aaa9964b6868/metadata/os_version => generated 0 bytes in 656 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:38:59.199846 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d1410751-b88f-43a8-a8d2-1a2556bb8873 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:59.200898 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d1410751-b88f-43a8-a8d2-1a2556bb8873 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:38:59.203381 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:38:59.210972 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d1410751-b88f-43a8-a8d2-1a2556bb8873 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:59.212475 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d1410751-b88f-43a8-a8d2-1a2556bb8873 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:59.213657 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d1410751-b88f-43a8-a8d2-1a2556bb8873 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:59.214590 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d1410751-b88f-43a8-a8d2-1a2556bb8873 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:59.300539 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-1777e1aa-acf4-4e0b-96e2-adf51086359a req-c0d2ab2c-cfc9-4420-a938-0a795d8c084d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c83347-17c8-4872-ae95-36497fd7a727", "tag": "6c385fdf-9a65-4ff1-871c-2cc8e59eef38"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:38:59.315237 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-1777e1aa-acf4-4e0b-96e2-adf51086359a req-c0d2ab2c-cfc9-4420-a938-0a795d8c084d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:38:59.316207 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-1777e1aa-acf4-4e0b-96e2-adf51086359a req-c0d2ab2c-cfc9-4420-a938-0a795d8c084d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:38:59.330390 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-1777e1aa-acf4-4e0b-96e2-adf51086359a req-c0d2ab2c-cfc9-4420-a938-0a795d8c084d service nova] Creating event network-changed:6c385fdf-9a65-4ff1-871c-2cc8e59eef38 for instance b0c83347-17c8-4872-ae95-36497fd7a727 on n-h1-846466-12 Aug 04 16:38:59.338499 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-1777e1aa-acf4-4e0b-96e2-adf51086359a req-c0d2ab2c-cfc9-4420-a938-0a795d8c084d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.684891 Aug 04 16:38:59.339468 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 690/1341] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:38:59.345637 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1b42b310-c1ce-4ca3-9d24-77bacd34f5b9 tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] Action: 'create', calling method: .version_select at 0x7f7e841d9a60>, body: {"security_group_rule": {"parent_group_id": "41b4f4b1-6c24-4004-875f-c853ace0fcc0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:38:59.875297 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d1410751-b88f-43a8-a8d2-1a2556bb8873 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:59.908037 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d1410751-b88f-43a8-a8d2-1a2556bb8873 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:59.909664 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d1410751-b88f-43a8-a8d2-1a2556bb8873 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:38:59.916875 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d1410751-b88f-43a8-a8d2-1a2556bb8873 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 1814 microversion: 2.25 time: 0.725384 Aug 04 16:38:59.918572 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 652/1342] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:38:59 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 1814 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:38:59.928704 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5e7c121b-f5f3-4edb-8b1d-7bf828bc4dd8 tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:38:59.933198 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:38:59.933198 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:38:59.961054 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-5e7c121b-f5f3-4edb-8b1d-7bf828bc4dd8 tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] HTTP exception thrown: Flavor 122f0b88-a4cb-4b77-ba53-504a7ce87bd0 could not be found. Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5e7c121b-f5f3-4edb-8b1d-7bf828bc4dd8 tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Request method failure captured: Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/flavors/122f0b88-a4cb-4b77-ba53-504a7ce87bd0 HTTP/1.1 Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_UOOtYzXzBuURWY4OrDmFTHMenFuRPUDQ1XvlnrWAhiPX0s4NZx0ID5nuohOB0cuatkIXjm5juHswEdg0ZOetCESWdEA3cMdxDWasgPK9ICKx63LVqvJMihxxzdUFvqLtjVb6khLc6JqMQpKfemOPUT4qVJ4ndstI1T_BdbeXPkiG4 Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 2cf192b7f3924c32b45bb63e397ea6ac Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-MigrationsAdminTest-499433933 Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader,admin Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader,admin Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2cf192b7f3924c32b45bb63e397ea6ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2cf192b7f3924c32b45bb63e397ea6ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2cf192b7f3924c32b45bb63e397ea6ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2cf192b7f3924c32b45bb63e397ea6ac"}]}] Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-MigrationsAdminTest-499433933 Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 2cf192b7f3924c32b45bb63e397ea6ac Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-MigrationsAdminTest-499433933 Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-MigrationsAdminTest-499433933-project-admin Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 59e7b930d8b34ffbaa2c13974ca024cd Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-MigrationsAdminTest-499433933-project-admin Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: exception: Flavor 122f0b88-a4cb-4b77-ba53-504a7ce87bd0 could not be found. Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '122f0b88-a4cb-4b77-ba53-504a7ce87bd0'} Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 122f0b88-a4cb-4b77-ba53-504a7ce87bd0 could not be found. Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 122f0b88-a4cb-4b77-ba53-504a7ce87bd0 could not be found. Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:38:59.973198 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:38:59.989096 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:38:59.989096 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:38:59.989096 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:38:59.989096 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:38:59.989096 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:38:59.989096 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:38:59.989096 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 122f0b88-a4cb-4b77-ba53-504a7ce87bd0 could not be found. Aug 04 16:38:59.989096 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:38:59.989096 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5e7c121b-f5f3-4edb-8b1d-7bf828bc4dd8 tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Returning 404 to user: Flavor 122f0b88-a4cb-4b77-ba53-504a7ce87bd0 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:38:59.990683 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5e7c121b-f5f3-4edb-8b1d-7bf828bc4dd8 tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/122f0b88-a4cb-4b77-ba53-504a7ce87bd0" status: 404 len: 109 microversion: 2.1 time: 0.068895 Aug 04 16:38:59.990683 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 653/1343] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:38:59 2022] DELETE /compute/v2.1/flavors/122f0b88-a4cb-4b77-ba53-504a7ce87bd0 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:39:00.018400 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-445e72dd-e34b-4faa-ae8e-595908cf9f9f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:00.019415 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-445e72dd-e34b-4faa-ae8e-595908cf9f9f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:00.032353 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-445e72dd-e34b-4faa-ae8e-595908cf9f9f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:00.033196 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-445e72dd-e34b-4faa-ae8e-595908cf9f9f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:00.034321 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-445e72dd-e34b-4faa-ae8e-595908cf9f9f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:00.034970 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-445e72dd-e34b-4faa-ae8e-595908cf9f9f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:00.376731 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1b42b310-c1ce-4ca3-9d24-77bacd34f5b9 tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.036104 Aug 04 16:39:00.378042 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 691/1344] 10.222.0.23 () {60 vars in 1195 bytes} [Thu Aug 4 16:38:59 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:39:00.385645 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ed7f4b4e-556d-41b0-93b5-fb24d3b9cd04 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1708146490", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "b9488b95-3e40-4213-8fe1-ea17248f446a"}], "block_device_mapping_v2": [{"uuid": "880c3a9a-0503-4e3d-a55a-53556a3f46f3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:39:00.490585 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-445e72dd-e34b-4faa-ae8e-595908cf9f9f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:00.505246 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-445e72dd-e34b-4faa-ae8e-595908cf9f9f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727" status: 200 len: 1371 microversion: 2.1 time: 0.501663 Aug 04 16:39:00.508794 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 654/1345] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:38:59 2022] GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727 => generated 1371 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:00.514019 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-ed7f4b4e-556d-41b0-93b5-fb24d3b9cd04 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] validate_networks() for [('b9488b95-3e40-4213-8fe1-ea17248f446a', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:39:00.518800 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8525b18c-a1cd-42b8-807f-88196e53c8bd tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] Calling method '.version_select at 0x7f7e84841550>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:00.608120 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8525b18c-a1cd-42b8-807f-88196e53c8bd tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] 10.222.0.23 "GET /compute/v2.1/images/47cba8b4-7f12-46ea-8ecf-aaa9964b6868/metadata" status: 200 len: 37 microversion: 2.1 time: 0.097378 Aug 04 16:39:00.609804 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 655/1346] 10.222.0.23 () {58 vars in 1260 bytes} [Thu Aug 4 16:39:00 2022] GET /compute/v2.1/images/47cba8b4-7f12-46ea-8ecf-aaa9964b6868/metadata => generated 37 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:39:00.620084 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-96068b8e-609f-4dcb-946b-cc7fbdf3a1c6 tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] Action: 'create', calling method: .version_select at 0x7f7e849ec9d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-70852758", "description": "tempest-description-25907207"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:39:01.150100 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-96068b8e-609f-4dcb-946b-cc7fbdf3a1c6 tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.537647 Aug 04 16:39:01.160923 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 656/1347] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Aug 4 16:39:00 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:39:01.167110 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6f9a291a-4044-4637-9a84-189ad6dd6a4e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1643536690", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:39:01.281726 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-6f9a291a-4044-4637-9a84-189ad6dd6a4e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] validate_networks() for None {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:39:02.654086 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-ed7f4b4e-556d-41b0-93b5-fb24d3b9cd04 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:39:02.654927 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-ed7f4b4e-556d-41b0-93b5-fb24d3b9cd04 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:39:02.655398 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-ed7f4b4e-556d-41b0-93b5-fb24d3b9cd04 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:39:02.655821 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-ed7f4b4e-556d-41b0-93b5-fb24d3b9cd04 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:39:02.656237 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-ed7f4b4e-556d-41b0-93b5-fb24d3b9cd04 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:39:02.672378 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ed7f4b4e-556d-41b0-93b5-fb24d3b9cd04 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:02.672823 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ed7f4b4e-556d-41b0-93b5-fb24d3b9cd04 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:02.676331 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ed7f4b4e-556d-41b0-93b5-fb24d3b9cd04 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:02.679045 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ed7f4b4e-556d-41b0-93b5-fb24d3b9cd04 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:02.730154 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-6f9a291a-4044-4637-9a84-189ad6dd6a4e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:39:02.730773 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-6f9a291a-4044-4637-9a84-189ad6dd6a4e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:39:02.732257 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-6f9a291a-4044-4637-9a84-189ad6dd6a4e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:39:02.732432 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-6f9a291a-4044-4637-9a84-189ad6dd6a4e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:39:02.734773 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-6f9a291a-4044-4637-9a84-189ad6dd6a4e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:39:02.754349 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-ed7f4b4e-556d-41b0-93b5-fb24d3b9cd04 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Getting quotas for project 82b3a898ed4b4e0a82ae35830cb00ca9. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:39:02.762123 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-ed7f4b4e-556d-41b0-93b5-fb24d3b9cd04 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Getting quotas for user 51b742cff6a948d0883501917706f66e and project 82b3a898ed4b4e0a82ae35830cb00ca9. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:39:02.762539 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6f9a291a-4044-4637-9a84-189ad6dd6a4e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:02.763984 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6f9a291a-4044-4637-9a84-189ad6dd6a4e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:02.764937 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6f9a291a-4044-4637-9a84-189ad6dd6a4e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:02.767554 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6f9a291a-4044-4637-9a84-189ad6dd6a4e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:02.833781 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-6f9a291a-4044-4637-9a84-189ad6dd6a4e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Getting quotas for project c456fd996bb544478bdb39c6a7ca04a6. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:39:02.844411 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-6f9a291a-4044-4637-9a84-189ad6dd6a4e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Getting quotas for user 6e582cea96b64285b4232b96162a274c and project c456fd996bb544478bdb39c6a7ca04a6. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:39:02.876906 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ed7f4b4e-556d-41b0-93b5-fb24d3b9cd04 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:39:02.879829 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ed7f4b4e-556d-41b0-93b5-fb24d3b9cd04 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: 637703de-2520-4512-bf57-9b811b7769d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='880c3a9a-0503-4e3d-a55a-53556a3f46f3',volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:39:02.881769 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6f9a291a-4044-4637-9a84-189ad6dd6a4e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:39:02.884448 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6f9a291a-4044-4637-9a84-189ad6dd6a4e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:39:02.986510 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6f9a291a-4044-4637-9a84-189ad6dd6a4e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.824098 Aug 04 16:39:02.988857 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 657/1348] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:39:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:39:03.014198 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bdbe8f8c-96aa-4b20-931f-23e1acd828cc tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] Action: 'update_all', calling method: .version_select at 0x7f7e849ec700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:39:03.180991 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-bdbe8f8c-96aa-4b20-931f-23e1acd828cc tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] Getting quotas for project 70f61cda639b4b57994c1ba18adeea2c. Resources: dict_keys(['metadata_items']) {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:39:03.204723 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-bdbe8f8c-96aa-4b20-931f-23e1acd828cc tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] Getting quotas for user 188dd705204c4fe38f2ddf5d65f7ef39 and project 70f61cda639b4b57994c1ba18adeea2c. Resources: dict_keys(['metadata_items']) {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:39:03.371649 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ed7f4b4e-556d-41b0-93b5-fb24d3b9cd04 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.992213 Aug 04 16:39:03.372340 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 692/1349] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:39:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:39:03.396000 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6dc9ce05-a489-4b98-8fef-32c114489b5e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:03.397086 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6dc9ce05-a489-4b98-8fef-32c114489b5e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:03.452646 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6dc9ce05-a489-4b98-8fef-32c114489b5e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:03.453105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6dc9ce05-a489-4b98-8fef-32c114489b5e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:03.464598 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6dc9ce05-a489-4b98-8fef-32c114489b5e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:03.468838 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6dc9ce05-a489-4b98-8fef-32c114489b5e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:03.768628 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bdbe8f8c-96aa-4b20-931f-23e1acd828cc tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] 10.222.0.23 "PUT /compute/v2.1/images/47cba8b4-7f12-46ea-8ecf-aaa9964b6868/metadata" status: 200 len: 61 microversion: 2.1 time: 0.777748 Aug 04 16:39:03.771742 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 658/1350] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Aug 4 16:39:02 2022] PUT /compute/v2.1/images/47cba8b4-7f12-46ea-8ecf-aaa9964b6868/metadata => generated 61 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:39:03.791708 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8d6b175d-225d-4b7a-994e-af0ae478282d tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] Action: 'create', calling method: .version_select at 0x7f7e84a25310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-38505600", "description": "tempest-description-1842327025"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:39:04.097885 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6dc9ce05-a489-4b98-8fef-32c114489b5e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:04.119542 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6dc9ce05-a489-4b98-8fef-32c114489b5e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:04.121181 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6dc9ce05-a489-4b98-8fef-32c114489b5e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:04.133441 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6dc9ce05-a489-4b98-8fef-32c114489b5e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 1804 microversion: 2.25 time: 0.758142 Aug 04 16:39:04.135969 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 693/1351] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:39:03 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 1804 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:39:04.149653 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-53dc6aee-cee9-4ad3-8ffd-1b55592b18ab tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:04.158404 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-53dc6aee-cee9-4ad3-8ffd-1b55592b18ab tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:04.173192 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-53dc6aee-cee9-4ad3-8ffd-1b55592b18ab tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:04.182176 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-53dc6aee-cee9-4ad3-8ffd-1b55592b18ab tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:04.183422 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-53dc6aee-cee9-4ad3-8ffd-1b55592b18ab tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:04.184255 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-53dc6aee-cee9-4ad3-8ffd-1b55592b18ab tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:04.654944 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8d6b175d-225d-4b7a-994e-af0ae478282d tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.879742 Aug 04 16:39:04.664293 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 659/1352] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Aug 4 16:39:03 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:39:04.671141 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-91fa3132-851c-4fb7-b525-5c03c65ab0bf req-0a2fd77b-3636-4599-a2d1-37231efca784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c83347-17c8-4872-ae95-36497fd7a727", "name": "network-vif-plugged", "status": "completed", "tag": "6c385fdf-9a65-4ff1-871c-2cc8e59eef38"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:39:04.692208 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-91fa3132-851c-4fb7-b525-5c03c65ab0bf req-0a2fd77b-3636-4599-a2d1-37231efca784 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:04.693877 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-91fa3132-851c-4fb7-b525-5c03c65ab0bf req-0a2fd77b-3636-4599-a2d1-37231efca784 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:04.700568 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=93 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:39:04.715795 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-53dc6aee-cee9-4ad3-8ffd-1b55592b18ab tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:04.724668 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-53dc6aee-cee9-4ad3-8ffd-1b55592b18ab tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727" status: 200 len: 1371 microversion: 2.1 time: 0.586814 Aug 04 16:39:04.734411 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 694/1353] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:04 2022] GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727 => generated 1371 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:04.740624 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e8a445b6-ff0c-4fff-b6b4-89fa5b69eaac tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:04.741250 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e8a445b6-ff0c-4fff-b6b4-89fa5b69eaac tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:04.744710 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-91fa3132-851c-4fb7-b525-5c03c65ab0bf req-0a2fd77b-3636-4599-a2d1-37231efca784 service nova] Creating event network-vif-plugged:6c385fdf-9a65-4ff1-871c-2cc8e59eef38 for instance b0c83347-17c8-4872-ae95-36497fd7a727 on n-h1-846466-12 Aug 04 16:39:04.766831 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-91fa3132-851c-4fb7-b525-5c03c65ab0bf req-0a2fd77b-3636-4599-a2d1-37231efca784 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100652 Aug 04 16:39:04.772664 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e8a445b6-ff0c-4fff-b6b4-89fa5b69eaac tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:04.773150 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 660/1354] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:39:04.778239 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e8a445b6-ff0c-4fff-b6b4-89fa5b69eaac tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:04.779447 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e8a445b6-ff0c-4fff-b6b4-89fa5b69eaac tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:04.780066 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e8a445b6-ff0c-4fff-b6b4-89fa5b69eaac tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:04.790944 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ea252ff9-5c75-4b91-9e75-b3f3eff6414e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:04.791652 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ea252ff9-5c75-4b91-9e75-b3f3eff6414e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:04.813474 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea252ff9-5c75-4b91-9e75-b3f3eff6414e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:04.813931 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea252ff9-5c75-4b91-9e75-b3f3eff6414e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:04.814733 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea252ff9-5c75-4b91-9e75-b3f3eff6414e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:04.832729 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea252ff9-5c75-4b91-9e75-b3f3eff6414e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:05.178501 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ea252ff9-5c75-4b91-9e75-b3f3eff6414e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:05.181790 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e8a445b6-ff0c-4fff-b6b4-89fa5b69eaac tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:05.188232 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ea252ff9-5c75-4b91-9e75-b3f3eff6414e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 200 len: 1151 microversion: 2.1 time: 0.412736 Aug 04 16:39:05.188826 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 661/1355] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:04 2022] GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 1151 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:05.200769 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c34662b4-1387-4895-b669-35a1c1774440 tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] Calling method '.version_select at 0x7f7e849da9d0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:05.212234 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e8a445b6-ff0c-4fff-b6b4-89fa5b69eaac tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1217 microversion: 2.1 time: 0.471083 Aug 04 16:39:05.212988 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 695/1356] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:04 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1217 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:05.223142 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2e8acee7-9449-4a88-bfeb-fcc98586a15a tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Calling method '.version_select at 0x7f7e841caee0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:05.227451 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e8acee7-9449-4a88-bfeb-fcc98586a15a tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:05.227901 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e8acee7-9449-4a88-bfeb-fcc98586a15a tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:05.275583 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c34662b4-1387-4895-b669-35a1c1774440 tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] 10.222.0.23 "GET /compute/v2.1/images/47cba8b4-7f12-46ea-8ecf-aaa9964b6868/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.085568 Aug 04 16:39:05.276202 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 662/1357] 10.222.0.23 () {58 vars in 1290 bytes} [Thu Aug 4 16:39:05 2022] GET /compute/v2.1/images/47cba8b4-7f12-46ea-8ecf-aaa9964b6868/metadata/os_distro => generated 33 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:39:05.287928 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2e8acee7-9449-4a88-bfeb-fcc98586a15a tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 3837 microversion: 2.25 time: 0.073685 Aug 04 16:39:05.295589 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 696/1358] 10.222.0.23 () {60 vars in 1184 bytes} [Thu Aug 4 16:39:05 2022] GET /compute/v2.1/os-migrations => generated 3837 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:39:05.303407 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8d3ba13f-8b3d-4653-8cec-7e46fdacdc79 tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] Action: 'create', calling method: .version_select at 0x7f7e84af1040>, body: {"security_group_rule": {"parent_group_id": "66330365-7f7f-4521-a79d-bbcf4a99f01b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "7e5adb17-87e0-443c-b6c9-b71afbd1f4ff"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:39:05.310244 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-475dd730-06d5-4fca-a615-ae5e69af2f20 tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] Action: 'update_all', calling method: .version_select at 0x7f7e841ba820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:39:05.415745 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-475dd730-06d5-4fca-a615-ae5e69af2f20 tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] Getting quotas for project 70f61cda639b4b57994c1ba18adeea2c. Resources: dict_keys(['metadata_items']) {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:39:05.422510 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-475dd730-06d5-4fca-a615-ae5e69af2f20 tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] Getting quotas for user 188dd705204c4fe38f2ddf5d65f7ef39 and project 70f61cda639b4b57994c1ba18adeea2c. Resources: dict_keys(['metadata_items']) {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:39:05.647046 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-475dd730-06d5-4fca-a615-ae5e69af2f20 tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] 10.222.0.23 "PUT /compute/v2.1/images/47cba8b4-7f12-46ea-8ecf-aaa9964b6868/metadata" status: 200 len: 61 microversion: 2.1 time: 0.349709 Aug 04 16:39:05.648055 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 697/1359] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Aug 4 16:39:05 2022] PUT /compute/v2.1/images/47cba8b4-7f12-46ea-8ecf-aaa9964b6868/metadata => generated 61 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:39:05.654405 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-364205ad-a551-4c3e-8543-fceffdc717cc tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:05.656926 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-364205ad-a551-4c3e-8543-fceffdc717cc tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:05.664673 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-364205ad-a551-4c3e-8543-fceffdc717cc tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:05.682267 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-364205ad-a551-4c3e-8543-fceffdc717cc tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:05.684863 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-364205ad-a551-4c3e-8543-fceffdc717cc tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:05.686540 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-364205ad-a551-4c3e-8543-fceffdc717cc tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:06.671910 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-364205ad-a551-4c3e-8543-fceffdc717cc tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lazy-loading 'services' on Instance uuid 5021f3f8-aa8b-4c94-8846-fdd1081135f5 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:39:06.711693 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-364205ad-a551-4c3e-8543-fceffdc717cc tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 2425 microversion: 2.25 time: 1.061230 Aug 04 16:39:06.712786 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 698/1360] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:39:05 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 2425 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:39:06.725165 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b4c0915d-d295-4f8e-838c-b09520fddc03 tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] Calling method '.version_select at 0x7f7e8413aaf0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:06.795461 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b4c0915d-d295-4f8e-838c-b09520fddc03 tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] 10.222.0.23 "GET /compute/v2.1/images/47cba8b4-7f12-46ea-8ecf-aaa9964b6868/metadata" status: 200 len: 61 microversion: 2.1 time: 0.081456 Aug 04 16:39:06.796051 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 699/1361] 10.222.0.23 () {58 vars in 1260 bytes} [Thu Aug 4 16:39:06 2022] GET /compute/v2.1/images/47cba8b4-7f12-46ea-8ecf-aaa9964b6868/metadata => generated 61 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:39:06.816811 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-535207b3-6404-4102-ac48-81a9f4a6718b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:06.820873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-535207b3-6404-4102-ac48-81a9f4a6718b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:06.837071 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-535207b3-6404-4102-ac48-81a9f4a6718b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:06.838782 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-535207b3-6404-4102-ac48-81a9f4a6718b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:06.841132 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-535207b3-6404-4102-ac48-81a9f4a6718b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:06.842311 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-535207b3-6404-4102-ac48-81a9f4a6718b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:07.800855 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8d3ba13f-8b3d-4653-8cec-7e46fdacdc79 tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 329 microversion: 2.1 time: 2.510706 Aug 04 16:39:07.817413 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 663/1362] 10.222.0.23 () {60 vars in 1195 bytes} [Thu Aug 4 16:39:05 2022] POST /compute/v2.1/os-security-group-rules => generated 329 bytes in 2540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:39:07.829955 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3b7a1df8-d0b5-4549-b431-b3d80bae94c7 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:07.831442 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3b7a1df8-d0b5-4549-b431-b3d80bae94c7 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:07.873251 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b7a1df8-d0b5-4549-b431-b3d80bae94c7 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:07.877418 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b7a1df8-d0b5-4549-b431-b3d80bae94c7 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:07.879477 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b7a1df8-d0b5-4549-b431-b3d80bae94c7 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:07.883112 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b7a1df8-d0b5-4549-b431-b3d80bae94c7 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:07.995937 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-535207b3-6404-4102-ac48-81a9f4a6718b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:08.027858 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-535207b3-6404-4102-ac48-81a9f4a6718b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727" status: 200 len: 1565 microversion: 2.1 time: 1.228509 Aug 04 16:39:08.040143 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 700/1363] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:06 2022] GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727 => generated 1565 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:08.067010 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4eda047c-e923-4d8b-8028-0435edb905af tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:08.071997 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4eda047c-e923-4d8b-8028-0435edb905af tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:08.103188 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4eda047c-e923-4d8b-8028-0435edb905af tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:08.106585 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4eda047c-e923-4d8b-8028-0435edb905af tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:08.108709 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4eda047c-e923-4d8b-8028-0435edb905af tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:08.112596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4eda047c-e923-4d8b-8028-0435edb905af tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:08.212797 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3b7a1df8-d0b5-4549-b431-b3d80bae94c7 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:08.287296 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3b7a1df8-d0b5-4549-b431-b3d80bae94c7 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 200 len: 1169 microversion: 2.1 time: 0.462083 Aug 04 16:39:08.288634 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 664/1364] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:07 2022] GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 1169 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:08.306382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1b7e8935-510e-40e2-978d-f0a0fb3c3f73 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:08.310366 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1b7e8935-510e-40e2-978d-f0a0fb3c3f73 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:08.327125 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1b7e8935-510e-40e2-978d-f0a0fb3c3f73 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:08.327733 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1b7e8935-510e-40e2-978d-f0a0fb3c3f73 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:08.328600 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1b7e8935-510e-40e2-978d-f0a0fb3c3f73 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:08.329114 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1b7e8935-510e-40e2-978d-f0a0fb3c3f73 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:08.550874 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4eda047c-e923-4d8b-8028-0435edb905af tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:08.567095 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4eda047c-e923-4d8b-8028-0435edb905af tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1271 microversion: 2.1 time: 0.524772 Aug 04 16:39:08.568186 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 701/1365] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:08 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1271 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:08.575971 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c96357af-8498-44de-aca3-a76efc1985f5 tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] Action: 'update_all', calling method: .version_select at 0x7f7e848e5160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:39:08.680762 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-c96357af-8498-44de-aca3-a76efc1985f5 tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] Getting quotas for project 70f61cda639b4b57994c1ba18adeea2c. Resources: dict_keys(['metadata_items']) {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:39:08.704269 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-c96357af-8498-44de-aca3-a76efc1985f5 tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] Getting quotas for user 188dd705204c4fe38f2ddf5d65f7ef39 and project 70f61cda639b4b57994c1ba18adeea2c. Resources: dict_keys(['metadata_items']) {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:39:09.016234 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c96357af-8498-44de-aca3-a76efc1985f5 tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] 10.222.0.23 "PUT /compute/v2.1/images/47cba8b4-7f12-46ea-8ecf-aaa9964b6868/metadata" status: 200 len: 61 microversion: 2.1 time: 0.446579 Aug 04 16:39:09.026163 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 702/1366] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Aug 4 16:39:08 2022] PUT /compute/v2.1/images/47cba8b4-7f12-46ea-8ecf-aaa9964b6868/metadata => generated 61 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:39:09.032345 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-43e74d8f-6ed9-493d-8d41-4f514485afea tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] Action: 'create', calling method: .version_select at 0x7f7e841c9670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1885574209", "description": "tempest-description-243943807"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:39:09.320241 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-1b7e8935-510e-40e2-978d-f0a0fb3c3f73 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lazy-loading 'services' on Instance uuid 5021f3f8-aa8b-4c94-8846-fdd1081135f5 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:39:09.352950 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1b7e8935-510e-40e2-978d-f0a0fb3c3f73 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 2425 microversion: 2.25 time: 1.061501 Aug 04 16:39:09.378507 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 665/1367] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:39:08 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 2425 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:39:09.389091 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-458b61cc-db8c-4cc2-96b6-845435555446 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:09.391469 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-458b61cc-db8c-4cc2-96b6-845435555446 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:09.401082 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-458b61cc-db8c-4cc2-96b6-845435555446 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:09.402010 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-458b61cc-db8c-4cc2-96b6-845435555446 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:09.403188 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-458b61cc-db8c-4cc2-96b6-845435555446 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:09.404038 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-458b61cc-db8c-4cc2-96b6-845435555446 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:09.686925 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-458b61cc-db8c-4cc2-96b6-845435555446 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.306976 Aug 04 16:39:09.695256 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 666/1368] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Aug 4 16:39:09 2022] GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727/os-interface => generated 284 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:39:09.706257 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-52d6ba7f-87bf-4411-97c8-a895b6126c2a tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] Action: 'update_all', calling method: .version_select at 0x7f7e8484c940>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:39:09.848050 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-52d6ba7f-87bf-4411-97c8-a895b6126c2a tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] Getting quotas for project 70f61cda639b4b57994c1ba18adeea2c. Resources: dict_keys(['metadata_items']) {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:39:09.854395 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-52d6ba7f-87bf-4411-97c8-a895b6126c2a tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] Getting quotas for user 188dd705204c4fe38f2ddf5d65f7ef39 and project 70f61cda639b4b57994c1ba18adeea2c. Resources: dict_keys(['metadata_items']) {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:39:10.433026 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-43e74d8f-6ed9-493d-8d41-4f514485afea tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.404561 Aug 04 16:39:10.436795 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 703/1369] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Aug 4 16:39:09 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:39:10.470879 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3691f77b-4863-4595-805e-585d244bf49d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:10.482194 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3691f77b-4863-4595-805e-585d244bf49d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:10.531981 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3691f77b-4863-4595-805e-585d244bf49d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:10.532765 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3691f77b-4863-4595-805e-585d244bf49d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:10.534522 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3691f77b-4863-4595-805e-585d244bf49d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:10.535811 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3691f77b-4863-4595-805e-585d244bf49d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:10.774183 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-52d6ba7f-87bf-4411-97c8-a895b6126c2a tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] 10.222.0.23 "PUT /compute/v2.1/images/47cba8b4-7f12-46ea-8ecf-aaa9964b6868/metadata" status: 200 len: 64 microversion: 2.1 time: 1.077496 Aug 04 16:39:10.780709 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 667/1370] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Aug 4 16:39:09 2022] PUT /compute/v2.1/images/47cba8b4-7f12-46ea-8ecf-aaa9964b6868/metadata => generated 64 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:39:10.787295 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-65427832-27ff-4257-bb81-6b55af93c3e5 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:10.787803 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-65427832-27ff-4257-bb81-6b55af93c3e5 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:10.805687 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65427832-27ff-4257-bb81-6b55af93c3e5 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:10.806149 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65427832-27ff-4257-bb81-6b55af93c3e5 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:10.806977 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65427832-27ff-4257-bb81-6b55af93c3e5 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:10.811529 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65427832-27ff-4257-bb81-6b55af93c3e5 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:11.294974 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-65427832-27ff-4257-bb81-6b55af93c3e5 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lazy-loading 'services' on Instance uuid 5021f3f8-aa8b-4c94-8846-fdd1081135f5 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:39:11.685133 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-65427832-27ff-4257-bb81-6b55af93c3e5 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5/os-volume_attachments/2680b72e-fe51-44ec-89de-4370640ad7d5" status: 202 len: 0 microversion: 2.25 time: 0.902435 Aug 04 16:39:11.693576 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 668/1371] 10.222.0.23 () {60 vars in 1457 bytes} [Thu Aug 4 16:39:10 2022] DELETE /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5/os-volume_attachments/2680b72e-fe51-44ec-89de-4370640ad7d5 => generated 0 bytes in 912 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:39:11.720901 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7fc6dce1-97d0-46a6-bfe9-7a3c1fca7149 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:11.722841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7fc6dce1-97d0-46a6-bfe9-7a3c1fca7149 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:11.740922 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7fc6dce1-97d0-46a6-bfe9-7a3c1fca7149 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:11.747583 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7fc6dce1-97d0-46a6-bfe9-7a3c1fca7149 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:11.748891 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7fc6dce1-97d0-46a6-bfe9-7a3c1fca7149 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:11.749748 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7fc6dce1-97d0-46a6-bfe9-7a3c1fca7149 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:11.781042 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3691f77b-4863-4595-805e-585d244bf49d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:11.795038 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3691f77b-4863-4595-805e-585d244bf49d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 200 len: 1211 microversion: 2.1 time: 1.356091 Aug 04 16:39:11.812888 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 704/1372] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:10 2022] GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 1211 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:11.830573 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f9114d84-8f59-4195-b1bb-c9a53339aacd tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] Action: 'create', calling method: .version_select at 0x7f7e848e53a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1043571294", "description": "tempest-description-1948747131"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:39:12.581096 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7fc6dce1-97d0-46a6-bfe9-7a3c1fca7149 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:12.612645 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7fc6dce1-97d0-46a6-bfe9-7a3c1fca7149 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1313 microversion: 2.1 time: 0.912189 Aug 04 16:39:12.617918 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 669/1373] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:11 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1313 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:12.638211 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-76e01215-07a0-45ca-bfd5-3106a7a46ca9 tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] Calling method '.version_select at 0x7f7e84a308b0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:12.715660 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:39:12.753731 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-76e01215-07a0-45ca-bfd5-3106a7a46ca9 tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] 10.222.0.23 "GET /compute/v2.1/images/47cba8b4-7f12-46ea-8ecf-aaa9964b6868/metadata" status: 200 len: 64 microversion: 2.1 time: 0.133483 Aug 04 16:39:12.755359 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 670/1374] 10.222.0.23 () {58 vars in 1260 bytes} [Thu Aug 4 16:39:12 2022] GET /compute/v2.1/images/47cba8b4-7f12-46ea-8ecf-aaa9964b6868/metadata => generated 64 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:39:12.762123 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ab47e9ae-0e34-4a30-915f-696b80e6d4e1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:12.766853 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ab47e9ae-0e34-4a30-915f-696b80e6d4e1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:12.776948 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ab47e9ae-0e34-4a30-915f-696b80e6d4e1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:12.777806 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ab47e9ae-0e34-4a30-915f-696b80e6d4e1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:12.779604 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ab47e9ae-0e34-4a30-915f-696b80e6d4e1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:12.780919 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ab47e9ae-0e34-4a30-915f-696b80e6d4e1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:12.814878 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:39:12.847884 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ab47e9ae-0e34-4a30-915f-696b80e6d4e1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.090292 Aug 04 16:39:12.849947 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 671/1375] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Aug 4 16:39:12 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:39:12.856694 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0086a41b-2f54-4347-9a6d-c0d0e066484f tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] Action: 'update_all', calling method: .version_select at 0x7f7e8498aee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:39:12.990578 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-0086a41b-2f54-4347-9a6d-c0d0e066484f tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] Getting quotas for project 70f61cda639b4b57994c1ba18adeea2c. Resources: dict_keys(['metadata_items']) {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:39:13.007482 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-0086a41b-2f54-4347-9a6d-c0d0e066484f tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] Getting quotas for user 188dd705204c4fe38f2ddf5d65f7ef39 and project 70f61cda639b4b57994c1ba18adeea2c. Resources: dict_keys(['metadata_items']) {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:39:13.604862 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0086a41b-2f54-4347-9a6d-c0d0e066484f tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] 10.222.0.23 "PUT /compute/v2.1/images/47cba8b4-7f12-46ea-8ecf-aaa9964b6868/metadata" status: 200 len: 61 microversion: 2.1 time: 0.751230 Aug 04 16:39:13.605928 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 672/1376] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Aug 4 16:39:12 2022] PUT /compute/v2.1/images/47cba8b4-7f12-46ea-8ecf-aaa9964b6868/metadata => generated 61 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:39:13.611427 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fa2122ba-5cd6-40f0-9728-eb0a0ef0675d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:13.614887 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fa2122ba-5cd6-40f0-9728-eb0a0ef0675d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:13.635626 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fa2122ba-5cd6-40f0-9728-eb0a0ef0675d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:13.638401 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fa2122ba-5cd6-40f0-9728-eb0a0ef0675d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:13.640014 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fa2122ba-5cd6-40f0-9728-eb0a0ef0675d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:13.641192 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fa2122ba-5cd6-40f0-9728-eb0a0ef0675d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:14.373183 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f9114d84-8f59-4195-b1bb-c9a53339aacd tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 2.557560 Aug 04 16:39:14.377458 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 705/1377] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Aug 4 16:39:11 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 2564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:39:14.391815 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4faef187-d329-4d13-a222-6ee81d63b558 tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] Action: 'update', calling method: .version_select at 0x7f7e8413a8b0>, body: {"meta": {"os_version": "alt"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:39:14.565800 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-4faef187-d329-4d13-a222-6ee81d63b558 tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] Getting quotas for project 70f61cda639b4b57994c1ba18adeea2c. Resources: dict_keys(['metadata_items']) {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:39:14.579495 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-4faef187-d329-4d13-a222-6ee81d63b558 tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] Getting quotas for user 188dd705204c4fe38f2ddf5d65f7ef39 and project 70f61cda639b4b57994c1ba18adeea2c. Resources: dict_keys(['metadata_items']) {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:39:14.889017 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fa2122ba-5cd6-40f0-9728-eb0a0ef0675d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:14.915797 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fa2122ba-5cd6-40f0-9728-eb0a0ef0675d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 200 len: 1211 microversion: 2.1 time: 1.308149 Aug 04 16:39:14.922579 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 673/1378] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:13 2022] GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 1211 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:14.931590 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-bc5d26c7-4baf-47c0-8b51-4e7cd59ee118 req-2a086fd9-3e7e-4193-81d8-04b474ae9090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c83347-17c8-4872-ae95-36497fd7a727", "tag": "6c385fdf-9a65-4ff1-871c-2cc8e59eef38"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:39:14.974045 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-bc5d26c7-4baf-47c0-8b51-4e7cd59ee118 req-2a086fd9-3e7e-4193-81d8-04b474ae9090 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:14.975020 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-bc5d26c7-4baf-47c0-8b51-4e7cd59ee118 req-2a086fd9-3e7e-4193-81d8-04b474ae9090 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:15.030198 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-bc5d26c7-4baf-47c0-8b51-4e7cd59ee118 req-2a086fd9-3e7e-4193-81d8-04b474ae9090 service nova] Creating event network-changed:6c385fdf-9a65-4ff1-871c-2cc8e59eef38 for instance b0c83347-17c8-4872-ae95-36497fd7a727 on n-h1-846466-12 Aug 04 16:39:15.051575 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-bc5d26c7-4baf-47c0-8b51-4e7cd59ee118 req-2a086fd9-3e7e-4193-81d8-04b474ae9090 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124208 Aug 04 16:39:15.054914 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 674/1379] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:39:15.073259 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b7479178-9bdb-4ef6-a530-8543f73d128e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:15.080353 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b7479178-9bdb-4ef6-a530-8543f73d128e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:15.107462 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7479178-9bdb-4ef6-a530-8543f73d128e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:15.110199 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7479178-9bdb-4ef6-a530-8543f73d128e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:15.111653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7479178-9bdb-4ef6-a530-8543f73d128e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:15.117610 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7479178-9bdb-4ef6-a530-8543f73d128e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:15.439823 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4faef187-d329-4d13-a222-6ee81d63b558 tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] 10.222.0.23 "PUT /compute/v2.1/images/47cba8b4-7f12-46ea-8ecf-aaa9964b6868/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 1.059454 Aug 04 16:39:15.440706 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 706/1380] 10.222.0.23 () {60 vars in 1313 bytes} [Thu Aug 4 16:39:14 2022] PUT /compute/v2.1/images/47cba8b4-7f12-46ea-8ecf-aaa9964b6868/metadata/os_version => generated 31 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:39:15.451314 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c1a50b63-af47-4f78-ba1f-a72cec7f7672 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:15.465240 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c1a50b63-af47-4f78-ba1f-a72cec7f7672 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:15.472703 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c1a50b63-af47-4f78-ba1f-a72cec7f7672 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:15.474439 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c1a50b63-af47-4f78-ba1f-a72cec7f7672 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:15.475809 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c1a50b63-af47-4f78-ba1f-a72cec7f7672 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:15.476464 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c1a50b63-af47-4f78-ba1f-a72cec7f7672 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:15.762671 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b7479178-9bdb-4ef6-a530-8543f73d128e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:15.774865 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b7479178-9bdb-4ef6-a530-8543f73d128e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1313 microversion: 2.1 time: 0.717619 Aug 04 16:39:15.776407 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c1a50b63-af47-4f78-ba1f-a72cec7f7672 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.328377 Aug 04 16:39:15.778281 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 707/1381] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Aug 4 16:39:15 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5/os-volume_attachments => generated 197 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:39:15.790251 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bb3c05f6-9d7d-4b27-8b40-2b15fa8adf9d tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] Action: 'create', calling method: .version_select at 0x7f7e847123a0>, body: {"security_group_rule": {"parent_group_id": "92f6fb31-304d-43a8-95d4-3ef31fc02d1f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "669675eb-dce1-4afd-9a99-774378ebe8b7"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:39:15.790775 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 675/1382] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:15 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1313 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:15.801404 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-942e483c-ea77-47c2-b9cf-3764a2666e67 tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] Calling method '.version_select at 0x7f7e849ecc10>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:15.878649 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-942e483c-ea77-47c2-b9cf-3764a2666e67 tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] 10.222.0.23 "GET /compute/v2.1/images/47cba8b4-7f12-46ea-8ecf-aaa9964b6868/metadata" status: 200 len: 58 microversion: 2.1 time: 0.086128 Aug 04 16:39:15.885607 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 676/1383] 10.222.0.23 () {58 vars in 1260 bytes} [Thu Aug 4 16:39:15 2022] GET /compute/v2.1/images/47cba8b4-7f12-46ea-8ecf-aaa9964b6868/metadata => generated 58 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:39:15.898749 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-037eae0a-fe0e-42a5-acc3-40a754c7420a req-98715fc6-30c2-42a4-9a2c-e804d01db92e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89ab07c4-6179-48f5-9ac4-053c6070ed42", "tag": "ffbb5a20-fa64-4e0b-8e0b-f2163a520c8f"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:39:15.904607 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:39:15.936927 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-037eae0a-fe0e-42a5-acc3-40a754c7420a req-98715fc6-30c2-42a4-9a2c-e804d01db92e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:15.939188 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-037eae0a-fe0e-42a5-acc3-40a754c7420a req-98715fc6-30c2-42a4-9a2c-e804d01db92e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:15.968478 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-037eae0a-fe0e-42a5-acc3-40a754c7420a req-98715fc6-30c2-42a4-9a2c-e804d01db92e service nova] Creating event network-changed:ffbb5a20-fa64-4e0b-8e0b-f2163a520c8f for instance 89ab07c4-6179-48f5-9ac4-053c6070ed42 on n-h2-846466-12 Aug 04 16:39:15.980971 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-037eae0a-fe0e-42a5-acc3-40a754c7420a req-98715fc6-30c2-42a4-9a2c-e804d01db92e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098873 Aug 04 16:39:15.982034 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 677/1384] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:39:15.989151 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-917058d3-6b59-441b-bcb6-b9f376d51ee7 tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] Action: 'update_all', calling method: .version_select at 0x7f7e847e4280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:39:16.093386 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-917058d3-6b59-441b-bcb6-b9f376d51ee7 tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] Getting quotas for project 70f61cda639b4b57994c1ba18adeea2c. Resources: dict_keys(['metadata_items']) {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:39:16.107155 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-917058d3-6b59-441b-bcb6-b9f376d51ee7 tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] Getting quotas for user 188dd705204c4fe38f2ddf5d65f7ef39 and project 70f61cda639b4b57994c1ba18adeea2c. Resources: dict_keys(['metadata_items']) {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:39:16.542903 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-917058d3-6b59-441b-bcb6-b9f376d51ee7 tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] 10.222.0.23 "PUT /compute/v2.1/images/47cba8b4-7f12-46ea-8ecf-aaa9964b6868/metadata" status: 200 len: 61 microversion: 2.1 time: 0.559098 Aug 04 16:39:16.543668 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 678/1385] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Aug 4 16:39:15 2022] PUT /compute/v2.1/images/47cba8b4-7f12-46ea-8ecf-aaa9964b6868/metadata => generated 61 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:39:16.549768 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1d864209-21c5-45e2-b038-d907f5f77ee1 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:16.551685 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1d864209-21c5-45e2-b038-d907f5f77ee1 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:16.560942 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d864209-21c5-45e2-b038-d907f5f77ee1 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:16.561943 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d864209-21c5-45e2-b038-d907f5f77ee1 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:16.563539 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d864209-21c5-45e2-b038-d907f5f77ee1 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:16.564730 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d864209-21c5-45e2-b038-d907f5f77ee1 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:17.387569 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1d864209-21c5-45e2-b038-d907f5f77ee1 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:17.402266 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1d864209-21c5-45e2-b038-d907f5f77ee1 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 200 len: 1211 microversion: 2.1 time: 0.855325 Aug 04 16:39:17.403517 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 679/1386] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:16 2022] GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 1211 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:17.421194 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4236f209-be27-47f3-8ad5-a04fe818e2a3 tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] Action: 'create', calling method: .version_select at 0x7f7e849daca0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:39:17.600592 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-4236f209-be27-47f3-8ad5-a04fe818e2a3 tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] Getting quotas for project 70f61cda639b4b57994c1ba18adeea2c. Resources: dict_keys(['metadata_items']) {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:39:17.632526 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-4236f209-be27-47f3-8ad5-a04fe818e2a3 tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] Getting quotas for user 188dd705204c4fe38f2ddf5d65f7ef39 and project 70f61cda639b4b57994c1ba18adeea2c. Resources: dict_keys(['metadata_items']) {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:39:17.896818 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bb3c05f6-9d7d-4b27-8b40-2b15fa8adf9d tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 2.116583 Aug 04 16:39:17.898700 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 708/1387] 10.222.0.23 () {60 vars in 1195 bytes} [Thu Aug 4 16:39:15 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 2119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:39:18.189743 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2fa7de2a-ac00-46ed-ac04-e74221ef6389 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:18.193620 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2fa7de2a-ac00-46ed-ac04-e74221ef6389 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:18.213164 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2fa7de2a-ac00-46ed-ac04-e74221ef6389 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:18.213957 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2fa7de2a-ac00-46ed-ac04-e74221ef6389 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:18.216085 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2fa7de2a-ac00-46ed-ac04-e74221ef6389 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:18.216720 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2fa7de2a-ac00-46ed-ac04-e74221ef6389 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:18.292724 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2fa7de2a-ac00-46ed-ac04-e74221ef6389 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.392521 Aug 04 16:39:18.304751 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 709/1388] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Aug 4 16:39:17 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5/os-volume_attachments => generated 197 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:39:18.319610 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-acd5230f-4a79-431b-b6b9-b3a5ff8e5f4a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:18.325649 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-acd5230f-4a79-431b-b6b9-b3a5ff8e5f4a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:18.354176 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-acd5230f-4a79-431b-b6b9-b3a5ff8e5f4a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:18.356530 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-acd5230f-4a79-431b-b6b9-b3a5ff8e5f4a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:18.361065 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-acd5230f-4a79-431b-b6b9-b3a5ff8e5f4a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:18.365459 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-acd5230f-4a79-431b-b6b9-b3a5ff8e5f4a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:18.442460 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4236f209-be27-47f3-8ad5-a04fe818e2a3 tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] 10.222.0.23 "POST /compute/v2.1/images/47cba8b4-7f12-46ea-8ecf-aaa9964b6868/metadata" status: 200 len: 85 microversion: 2.1 time: 1.036104 Aug 04 16:39:18.443836 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 680/1389] 10.222.0.23 () {60 vars in 1281 bytes} [Thu Aug 4 16:39:17 2022] POST /compute/v2.1/images/47cba8b4-7f12-46ea-8ecf-aaa9964b6868/metadata => generated 85 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:39:18.452584 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c43315ee-2485-4eaa-b926-6ef63d9695ec tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] Calling method '.version_select at 0x7f7e84790dc0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:18.858043 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-acd5230f-4a79-431b-b6b9-b3a5ff8e5f4a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:18.886198 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-acd5230f-4a79-431b-b6b9-b3a5ff8e5f4a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1313 microversion: 2.1 time: 0.579291 Aug 04 16:39:18.888380 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 710/1390] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:18 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1313 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:18.985543 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-ccc1d7c7-9799-44b9-af94-976981cd0655 req-164b0781-3c2b-4233-80e3-478bcf1cf955 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "637703de-2520-4512-bf57-9b811b7769d4", "tag": "1568bcc2-0017-4817-883a-43e4096677ac"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:39:19.030627 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-ccc1d7c7-9799-44b9-af94-976981cd0655 req-164b0781-3c2b-4233-80e3-478bcf1cf955 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:19.031166 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-ccc1d7c7-9799-44b9-af94-976981cd0655 req-164b0781-3c2b-4233-80e3-478bcf1cf955 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:19.079600 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-ccc1d7c7-9799-44b9-af94-976981cd0655 req-164b0781-3c2b-4233-80e3-478bcf1cf955 service nova] Creating event network-changed:1568bcc2-0017-4817-883a-43e4096677ac for instance 637703de-2520-4512-bf57-9b811b7769d4 on n-h2-846466-12 Aug 04 16:39:19.110318 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-ccc1d7c7-9799-44b9-af94-976981cd0655 req-164b0781-3c2b-4233-80e3-478bcf1cf955 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154649 Aug 04 16:39:19.112510 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 711/1391] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:39:19.125206 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-95d4966c-6500-401d-a240-6725274b96bc tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:19.126646 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-95d4966c-6500-401d-a240-6725274b96bc tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:19.137851 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-95d4966c-6500-401d-a240-6725274b96bc tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:19.138735 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-95d4966c-6500-401d-a240-6725274b96bc tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:19.139926 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-95d4966c-6500-401d-a240-6725274b96bc tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:19.140658 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-95d4966c-6500-401d-a240-6725274b96bc tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:19.219709 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c43315ee-2485-4eaa-b926-6ef63d9695ec tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/669675eb-dce1-4afd-9a99-774378ebe8b7" status: 202 len: 0 microversion: 2.1 time: 0.773169 Aug 04 16:39:19.220666 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 681/1392] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:39:18 2022] DELETE /compute/v2.1/os-security-groups/669675eb-dce1-4afd-9a99-774378ebe8b7 => generated 0 bytes in 776 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:39:19.229199 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6ddb2115-b995-4769-afb8-8b844bfdb67b tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] Calling method '.version_select at 0x7f7e8479cb80>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:19.360064 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6ddb2115-b995-4769-afb8-8b844bfdb67b tempest-ImagesMetadataTestJSON-586091802 tempest-ImagesMetadataTestJSON-586091802-project] 10.222.0.23 "GET /compute/v2.1/images/47cba8b4-7f12-46ea-8ecf-aaa9964b6868/metadata" status: 200 len: 85 microversion: 2.1 time: 0.137282 Aug 04 16:39:19.360281 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 682/1393] 10.222.0.23 () {58 vars in 1260 bytes} [Thu Aug 4 16:39:19 2022] GET /compute/v2.1/images/47cba8b4-7f12-46ea-8ecf-aaa9964b6868/metadata => generated 85 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:39:19.372584 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7e2548b1-8bae-4447-b285-5f5f9e1c7cfd tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] Calling method '.version_select at 0x7f7e849da4c0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:19.605260 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7e2548b1-8bae-4447-b285-5f5f9e1c7cfd tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/92f6fb31-304d-43a8-95d4-3ef31fc02d1f" status: 200 len: 247 microversion: 2.1 time: 0.242965 Aug 04 16:39:19.606008 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 683/1394] 10.222.0.23 () {58 vars in 1269 bytes} [Thu Aug 4 16:39:19 2022] GET /compute/v2.1/os-security-groups/92f6fb31-304d-43a8-95d4-3ef31fc02d1f => generated 247 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:39:19.612109 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7b0d3f44-a8ad-408d-a74b-37621c537578 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:19.618110 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7b0d3f44-a8ad-408d-a74b-37621c537578 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:19.638400 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b0d3f44-a8ad-408d-a74b-37621c537578 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:19.638848 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b0d3f44-a8ad-408d-a74b-37621c537578 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:19.639662 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b0d3f44-a8ad-408d-a74b-37621c537578 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:19.640429 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b0d3f44-a8ad-408d-a74b-37621c537578 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:19.750165 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7b0d3f44-a8ad-408d-a74b-37621c537578 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.143128 Aug 04 16:39:19.760296 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 684/1395] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Aug 4 16:39:19 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:39:19.801599 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e665788f-6232-4279-9978-1a86d0d0be50 tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] Action: 'create', calling method: .version_select at 0x7f7e847e4430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2025629156", "description": "tempest-description-453895182"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:39:20.451270 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-95d4966c-6500-401d-a240-6725274b96bc tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:20.467000 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-95d4966c-6500-401d-a240-6725274b96bc tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 200 len: 1211 microversion: 2.1 time: 1.352083 Aug 04 16:39:20.473719 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 712/1396] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:19 2022] GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 1211 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:20.490422 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f0b6f626-6e18-47a4-83cf-59b4080888f4 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:20.491162 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f0b6f626-6e18-47a4-83cf-59b4080888f4 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:20.515460 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f0b6f626-6e18-47a4-83cf-59b4080888f4 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:20.518607 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f0b6f626-6e18-47a4-83cf-59b4080888f4 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:20.519473 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f0b6f626-6e18-47a4-83cf-59b4080888f4 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:20.519945 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f0b6f626-6e18-47a4-83cf-59b4080888f4 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:20.954482 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e665788f-6232-4279-9978-1a86d0d0be50 tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.191400 Aug 04 16:39:20.955299 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 685/1397] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Aug 4 16:39:19 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:39:20.960820 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-aa62eee9-b2fb-4ce1-bad7-b458151c39f6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:20.968859 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-aa62eee9-b2fb-4ce1-bad7-b458151c39f6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:20.997456 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aa62eee9-b2fb-4ce1-bad7-b458151c39f6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:20.997928 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aa62eee9-b2fb-4ce1-bad7-b458151c39f6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:21.004028 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aa62eee9-b2fb-4ce1-bad7-b458151c39f6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:21.004764 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aa62eee9-b2fb-4ce1-bad7-b458151c39f6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:21.062279 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-aa62eee9-b2fb-4ce1-bad7-b458151c39f6 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.106063 Aug 04 16:39:21.072978 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 686/1398] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Aug 4 16:39:20 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:39:21.078391 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-45c6e57b-93da-4a87-b77b-cfac19bca089 tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] Action: 'create', calling method: .version_select at 0x7f7e84b470d0>, body: {"security_group_rule": {"parent_group_id": "36a69d7a-4081-4583-b364-8c14b6db4c6f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:39:22.402662 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f0b6f626-6e18-47a4-83cf-59b4080888f4 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:22.432375 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f0b6f626-6e18-47a4-83cf-59b4080888f4 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1313 microversion: 2.1 time: 1.957066 Aug 04 16:39:22.474596 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 713/1399] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:20 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1313 bytes in 2000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:22.501182 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3dd841a1-dc39-47ff-af14-ab9c91b94b0e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:22.512810 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3dd841a1-dc39-47ff-af14-ab9c91b94b0e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:22.541695 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3dd841a1-dc39-47ff-af14-ab9c91b94b0e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:22.542782 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3dd841a1-dc39-47ff-af14-ab9c91b94b0e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:22.546793 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3dd841a1-dc39-47ff-af14-ab9c91b94b0e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:22.547866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3dd841a1-dc39-47ff-af14-ab9c91b94b0e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:23.700439 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3dd841a1-dc39-47ff-af14-ab9c91b94b0e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:23.740195 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3dd841a1-dc39-47ff-af14-ab9c91b94b0e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 200 len: 1211 microversion: 2.1 time: 1.260761 Aug 04 16:39:23.770071 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 714/1400] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:22 2022] GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 1211 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:23.780314 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3acf0451-1530-42c2-9fa4-3ea6b3a5ed2c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:23.790858 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3acf0451-1530-42c2-9fa4-3ea6b3a5ed2c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:23.817587 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3acf0451-1530-42c2-9fa4-3ea6b3a5ed2c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:23.818821 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3acf0451-1530-42c2-9fa4-3ea6b3a5ed2c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:23.820648 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3acf0451-1530-42c2-9fa4-3ea6b3a5ed2c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:23.833106 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3acf0451-1530-42c2-9fa4-3ea6b3a5ed2c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:23.946870 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3acf0451-1530-42c2-9fa4-3ea6b3a5ed2c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.174705 Aug 04 16:39:23.948256 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 715/1401] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Aug 4 16:39:23 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5/os-volume_attachments => generated 25 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:24.320019 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-45c6e57b-93da-4a87-b77b-cfac19bca089 tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 3.244836 Aug 04 16:39:24.321545 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 687/1402] 10.222.0.23 () {60 vars in 1195 bytes} [Thu Aug 4 16:39:21 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 3247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:39:24.335090 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f2d6e13a-5c78-4d6b-8d50-6fd1b14b71ef tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] Action: 'create', calling method: .version_select at 0x7f7e8484c430>, body: {"security_group_rule": {"parent_group_id": "36a69d7a-4081-4583-b364-8c14b6db4c6f", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:39:24.599767 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=22 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:39:24.749682 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-837fe7f7-9bd6-41ca-a97f-412bc7a6322d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:24.752847 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-837fe7f7-9bd6-41ca-a97f-412bc7a6322d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:24.778555 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-837fe7f7-9bd6-41ca-a97f-412bc7a6322d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:24.779023 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-837fe7f7-9bd6-41ca-a97f-412bc7a6322d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:24.780093 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-837fe7f7-9bd6-41ca-a97f-412bc7a6322d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:24.789040 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-837fe7f7-9bd6-41ca-a97f-412bc7a6322d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:24.885558 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=100 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:39:25.380677 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f2d6e13a-5c78-4d6b-8d50-6fd1b14b71ef tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.050044 Aug 04 16:39:25.389672 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 688/1403] 10.222.0.23 () {60 vars in 1195 bytes} [Thu Aug 4 16:39:24 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:39:25.401213 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-baf6420c-681f-4895-b251-8f947517d463 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:25.401955 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-baf6420c-681f-4895-b251-8f947517d463 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:25.439383 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-baf6420c-681f-4895-b251-8f947517d463 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:25.442350 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-baf6420c-681f-4895-b251-8f947517d463 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:25.450116 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-baf6420c-681f-4895-b251-8f947517d463 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:25.452136 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-baf6420c-681f-4895-b251-8f947517d463 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:25.514945 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-837fe7f7-9bd6-41ca-a97f-412bc7a6322d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:25.542479 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-837fe7f7-9bd6-41ca-a97f-412bc7a6322d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1313 microversion: 2.1 time: 1.591362 Aug 04 16:39:25.582075 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 716/1404] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:23 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1313 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:25.600694 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4f936e86-94fd-4d01-a2de-cc813f654603 tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] Calling method '.version_select at 0x7f7e84643160>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:25.826321 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4f936e86-94fd-4d01-a2de-cc813f654603 tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/36a69d7a-4081-4583-b364-8c14b6db4c6f" status: 200 len: 664 microversion: 2.1 time: 0.239925 Aug 04 16:39:25.827017 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 717/1405] 10.222.0.23 () {58 vars in 1269 bytes} [Thu Aug 4 16:39:25 2022] GET /compute/v2.1/os-security-groups/36a69d7a-4081-4583-b364-8c14b6db4c6f => generated 664 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:39:25.840371 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-94b5488f-cfe3-4df8-916b-169d2e698b56 tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] Calling method '.version_select at 0x7f7e841c9280>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:25.920467 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-baf6420c-681f-4895-b251-8f947517d463 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:25.953604 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-baf6420c-681f-4895-b251-8f947517d463 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 200 len: 1211 microversion: 2.1 time: 0.554098 Aug 04 16:39:25.958858 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 689/1406] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:25 2022] GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 1211 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:26.227313 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-94b5488f-cfe3-4df8-916b-169d2e698b56 tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-group-rules/17ce595f-ddd7-4556-a712-ad9b008ae859" status: 202 len: 0 microversion: 2.1 time: 0.390794 Aug 04 16:39:26.228811 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 718/1407] 10.222.0.23 () {58 vars in 1287 bytes} [Thu Aug 4 16:39:25 2022] DELETE /compute/v2.1/os-security-group-rules/17ce595f-ddd7-4556-a712-ad9b008ae859 => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 16:39:26.238674 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dfd6068b-383b-45e7-bc3c-2e9c9da11160 tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] Calling method '.version_select at 0x7f7e8484c280>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:26.585165 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fcaa2d98-66ba-4ac0-be2e-9df16dfe3bc1 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:26.587038 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fcaa2d98-66ba-4ac0-be2e-9df16dfe3bc1 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:26.631455 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fcaa2d98-66ba-4ac0-be2e-9df16dfe3bc1 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:26.636051 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fcaa2d98-66ba-4ac0-be2e-9df16dfe3bc1 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:26.646006 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fcaa2d98-66ba-4ac0-be2e-9df16dfe3bc1 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:26.646747 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fcaa2d98-66ba-4ac0-be2e-9df16dfe3bc1 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:26.914542 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dfd6068b-383b-45e7-bc3c-2e9c9da11160 tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/36a69d7a-4081-4583-b364-8c14b6db4c6f" status: 202 len: 0 microversion: 2.1 time: 0.679262 Aug 04 16:39:26.920536 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 690/1408] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:39:26 2022] DELETE /compute/v2.1/os-security-groups/36a69d7a-4081-4583-b364-8c14b6db4c6f => generated 0 bytes in 685 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:39:27.027539 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fcaa2d98-66ba-4ac0-be2e-9df16dfe3bc1 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:27.041585 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fcaa2d98-66ba-4ac0-be2e-9df16dfe3bc1 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1313 microversion: 2.1 time: 0.460677 Aug 04 16:39:27.047328 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 719/1409] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:26 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1313 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:27.063375 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-42594600-fc11-4667-838a-050b2308b7e0 tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] Calling method '.version_select at 0x7f7e77f873a0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:27.115250 n-d-846466-12 devstack@n-api.service[126125]: DEBUG neutronclient.v2_0.client [None req-42594600-fc11-4667-838a-050b2308b7e0 tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 669675eb-dce1-4afd-9a99-774378ebe8b7 does not exist", "detail": ""}} {{(pid=126125) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:39:27.116375 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.security_group_api [None req-42594600-fc11-4667-838a-050b2308b7e0 tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] Neutron security group 669675eb-dce1-4afd-9a99-774378ebe8b7 not found {{(pid=126125) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 16:39:27.118186 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-42594600-fc11-4667-838a-050b2308b7e0 tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] HTTP exception thrown: Security group 669675eb-dce1-4afd-9a99-774378ebe8b7 does not exist Aug 04 16:39:27.118186 n-d-846466-12 devstack@n-api.service[126125]: Neutron server returns request_ids: ['req-3a72b4f9-f87f-417a-a7f6-1ff055556adb'] Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-42594600-fc11-4667-838a-050b2308b7e0 tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] Request method failure captured: Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/os-security-groups/669675eb-dce1-4afd-9a99-774378ebe8b7 HTTP/1.1 Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_YTi7E4S1UBP03i4ISwoSQjQdJB_XOjA6Mdd7Qt_BnaLSK-ghU7k_kqU7SgPsmEyCN8nAVQlZQac9SnnAPJ0gJqD4R2ap7hfSgSWXsRi81Row6lpdTs8Tf-_1WFwXzcs_-wRio6fcg0ur7_CAnU_kdYbxxRhKfdWwnCdF3gQwhj94k Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 83eee30cc38d4b609fd773ad900638c6 Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1406360788 Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/83eee30cc38d4b609fd773ad900638c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_83eee30cc38d4b609fd773ad900638c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/83eee30cc38d4b609fd773ad900638c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/83eee30cc38d4b609fd773ad900638c6"}]}] Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1406360788 Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 83eee30cc38d4b609fd773ad900638c6 Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1406360788 Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-SecurityGroupRulesTestJSON-1406360788-project Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 950a55e5d00a49b7a5b3084a7b0f6d64 Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1406360788-project Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: exception: Security group 669675eb-dce1-4afd-9a99-774378ebe8b7 does not exist Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: Neutron server returns request_ids: ['req-3a72b4f9-f87f-417a-a7f6-1ff055556adb'] Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '669675eb-dce1-4afd-9a99-774378ebe8b7'} Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:39:27.121516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 669675eb-dce1-4afd-9a99-774378ebe8b7 does not exist Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a72b4f9-f87f-417a-a7f6-1ff055556adb'] Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 669675eb-dce1-4afd-9a99-774378ebe8b7 does not exist Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a72b4f9-f87f-417a-a7f6-1ff055556adb'] Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 669675eb-dce1-4afd-9a99-774378ebe8b7 does not exist Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a72b4f9-f87f-417a-a7f6-1ff055556adb'] Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 669675eb-dce1-4afd-9a99-774378ebe8b7 does not exist Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a72b4f9-f87f-417a-a7f6-1ff055556adb'] Aug 04 16:39:27.127601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:39:27.132137 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-42594600-fc11-4667-838a-050b2308b7e0 tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] Returning 404 to user: Security group 669675eb-dce1-4afd-9a99-774378ebe8b7 does not exist Aug 04 16:39:27.132137 n-d-846466-12 devstack@n-api.service[126125]: Neutron server returns request_ids: ['req-3a72b4f9-f87f-417a-a7f6-1ff055556adb'] {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:39:27.133708 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-42594600-fc11-4667-838a-050b2308b7e0 tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/669675eb-dce1-4afd-9a99-774378ebe8b7" status: 404 len: 194 microversion: 2.1 time: 0.084192 Aug 04 16:39:27.133708 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 720/1410] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:39:27 2022] DELETE /compute/v2.1/os-security-groups/669675eb-dce1-4afd-9a99-774378ebe8b7 => generated 194 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:39:27.151347 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-313ec7d0-4e47-4d30-a0ba-4b7560f3a9a3 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:27.161424 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-313ec7d0-4e47-4d30-a0ba-4b7560f3a9a3 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:27.161424 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:39:27.186809 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-313ec7d0-4e47-4d30-a0ba-4b7560f3a9a3 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:27.187411 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-313ec7d0-4e47-4d30-a0ba-4b7560f3a9a3 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:27.188319 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-313ec7d0-4e47-4d30-a0ba-4b7560f3a9a3 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:27.194868 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-313ec7d0-4e47-4d30-a0ba-4b7560f3a9a3 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:27.272423 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fc90b834-9cfd-4cba-b855-a77007573a00 tempest-ListImagesTestJSON-1611135180 tempest-ListImagesTestJSON-1611135180-project] Calling method '.version_select at 0x7f7e848971f0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:27.528355 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-313ec7d0-4e47-4d30-a0ba-4b7560f3a9a3 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:27.540626 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-313ec7d0-4e47-4d30-a0ba-4b7560f3a9a3 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 200 len: 1211 microversion: 2.1 time: 0.405865 Aug 04 16:39:27.541957 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 721/1411] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:27 2022] GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 1211 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:27.563010 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-945a29ac-85e1-403d-8216-2be7fa63ae44 tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] Calling method '.version_select at 0x7f7e8413b9d0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:27.721007 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=26 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:39:28.103321 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-945a29ac-85e1-403d-8216-2be7fa63ae44 tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/92f6fb31-304d-43a8-95d4-3ef31fc02d1f" status: 202 len: 0 microversion: 2.1 time: 0.559076 Aug 04 16:39:28.112143 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 722/1412] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:39:27 2022] DELETE /compute/v2.1/os-security-groups/92f6fb31-304d-43a8-95d4-3ef31fc02d1f => generated 0 bytes in 569 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:39:28.246292 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9112c4a1-f2e3-48fe-9187-3a1523de5192 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-433947506", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "e7239615-9bcd-4c90-9e7e-58b8edceae23"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:39:35.438979 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=25 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:39:35.944930 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:39:37.533767 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=14 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:39:38.304955 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:39:43.345852 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-9112c4a1-f2e3-48fe-9187-3a1523de5192 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] validate_networks() for [('e7239615-9bcd-4c90-9e7e-58b8edceae23', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:39:43.351722 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fc90b834-9cfd-4cba-b855-a77007573a00 tempest-ListImagesTestJSON-1611135180 tempest-ListImagesTestJSON-1611135180-project] 10.222.0.23 "GET /compute/v2.1/images/58d80c01-1581-4a2f-bbb0-c2eaf1affa00" status: 200 len: 784 microversion: 2.1 time: 16.431396 Aug 04 16:39:43.352723 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 691/1413] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:39:26 2022] GET /compute/v2.1/images/58d80c01-1581-4a2f-bbb0-c2eaf1affa00 => generated 784 bytes in 16434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:39:43.357875 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-4177c19a-5e8c-4bcc-a94f-c9bda391e0e4 req-e379ce9a-677d-43cd-a92b-aa87a04f6f7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89ab07c4-6179-48f5-9ac4-053c6070ed42", "name": "network-vif-plugged", "status": "completed", "tag": "ffbb5a20-fa64-4e0b-8e0b-f2163a520c8f"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:39:43.369275 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-4177c19a-5e8c-4bcc-a94f-c9bda391e0e4 req-e379ce9a-677d-43cd-a92b-aa87a04f6f7e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:43.369755 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-4177c19a-5e8c-4bcc-a94f-c9bda391e0e4 req-e379ce9a-677d-43cd-a92b-aa87a04f6f7e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:43.383068 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-4177c19a-5e8c-4bcc-a94f-c9bda391e0e4 req-e379ce9a-677d-43cd-a92b-aa87a04f6f7e service nova] Creating event network-vif-plugged:ffbb5a20-fa64-4e0b-8e0b-f2163a520c8f for instance 89ab07c4-6179-48f5-9ac4-053c6070ed42 on n-h2-846466-12 Aug 04 16:39:43.390414 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-4177c19a-5e8c-4bcc-a94f-c9bda391e0e4 req-e379ce9a-677d-43cd-a92b-aa87a04f6f7e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035703 Aug 04 16:39:43.391059 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 692/1414] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:39:43.408937 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-58e031bd-42dd-4db8-82c9-562fd636965b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:43.410363 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-58e031bd-42dd-4db8-82c9-562fd636965b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:43.418384 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58e031bd-42dd-4db8-82c9-562fd636965b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:43.419143 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58e031bd-42dd-4db8-82c9-562fd636965b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:43.420064 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58e031bd-42dd-4db8-82c9-562fd636965b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:43.420776 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58e031bd-42dd-4db8-82c9-562fd636965b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:43.916617 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-58e031bd-42dd-4db8-82c9-562fd636965b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:43.931882 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-58e031bd-42dd-4db8-82c9-562fd636965b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1313 microversion: 2.1 time: 0.539049 Aug 04 16:39:43.949933 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 693/1415] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:43 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1313 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:43.949933 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1af0e8d4-f167-44ac-9a07-86b2c7ee9719 tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] Calling method '.version_select at 0x7f7e847815e0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:44.593249 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-9112c4a1-f2e3-48fe-9187-3a1523de5192 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:39:44.595036 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-9112c4a1-f2e3-48fe-9187-3a1523de5192 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:39:44.596142 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-9112c4a1-f2e3-48fe-9187-3a1523de5192 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:39:44.597163 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-9112c4a1-f2e3-48fe-9187-3a1523de5192 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:39:44.598188 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-9112c4a1-f2e3-48fe-9187-3a1523de5192 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:39:44.614697 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9112c4a1-f2e3-48fe-9187-3a1523de5192 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:44.615452 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9112c4a1-f2e3-48fe-9187-3a1523de5192 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:44.617218 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9112c4a1-f2e3-48fe-9187-3a1523de5192 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:44.618135 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9112c4a1-f2e3-48fe-9187-3a1523de5192 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:44.644661 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1af0e8d4-f167-44ac-9a07-86b2c7ee9719 tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/7e5adb17-87e0-443c-b6c9-b71afbd1f4ff" status: 202 len: 0 microversion: 2.1 time: 0.710178 Aug 04 16:39:44.646395 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 694/1416] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:39:43 2022] DELETE /compute/v2.1/os-security-groups/7e5adb17-87e0-443c-b6c9-b71afbd1f4ff => generated 0 bytes in 713 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:39:44.653772 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a6454a44-2a85-4716-809e-6d7ccd875da2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:44.655117 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a6454a44-2a85-4716-809e-6d7ccd875da2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:44.664795 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-9112c4a1-f2e3-48fe-9187-3a1523de5192 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Getting quotas for project 96c9f886e560427b9b2f4c46984e0c2c. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:39:44.672785 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6454a44-2a85-4716-809e-6d7ccd875da2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:44.673226 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6454a44-2a85-4716-809e-6d7ccd875da2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:44.674501 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6454a44-2a85-4716-809e-6d7ccd875da2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:44.675150 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6454a44-2a85-4716-809e-6d7ccd875da2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:44.680524 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-9112c4a1-f2e3-48fe-9187-3a1523de5192 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Getting quotas for user d289c1a9217f4edb967e8bc60a29ea4e and project 96c9f886e560427b9b2f4c46984e0c2c. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:39:44.708259 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9112c4a1-f2e3-48fe-9187-3a1523de5192 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:39:44.714173 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9112c4a1-f2e3-48fe-9187-3a1523de5192 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] [instance: b1cd2844-77ab-41e5-82e5-a954081001f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:39:44.820205 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9112c4a1-f2e3-48fe-9187-3a1523de5192 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 16.705410 Aug 04 16:39:44.821976 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 723/1417] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Aug 4 16:39:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 16709 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 16:39:44.829113 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-02b5711e-a15f-4675-bed8-acfd4893fafe tempest-ListImagesTestJSON-1611135180 tempest-ListImagesTestJSON-1611135180-project] Calling method '.version_select at 0x7f7e841ca670>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:45.006228 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-02b5711e-a15f-4675-bed8-acfd4893fafe tempest-ListImagesTestJSON-1611135180 tempest-ListImagesTestJSON-1611135180-project] 10.222.0.23 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.180039 Aug 04 16:39:45.008173 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 724/1418] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Aug 4 16:39:44 2022] GET /compute/v2.1/images => generated 445 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:39:45.018819 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-04a5e44a-6227-4bcb-9b89-ff091dda8518 tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] Calling method '.version_select at 0x7f7e848e53a0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:45.384931 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a6454a44-2a85-4716-809e-6d7ccd875da2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:45.419645 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a6454a44-2a85-4716-809e-6d7ccd875da2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 200 len: 1199 microversion: 2.1 time: 0.771240 Aug 04 16:39:45.446172 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 695/1419] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:44 2022] GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 1199 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:45.456814 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0388a17c-ecea-46bc-8ba1-1af6c01d3da4 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:45.456814 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0388a17c-ecea-46bc-8ba1-1af6c01d3da4 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] [instance: b1cd2844-77ab-41e5-82e5-a954081001f0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:45.592054 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0388a17c-ecea-46bc-8ba1-1af6c01d3da4 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:45.601511 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0388a17c-ecea-46bc-8ba1-1af6c01d3da4 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:45.603441 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0388a17c-ecea-46bc-8ba1-1af6c01d3da4 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:45.605148 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0388a17c-ecea-46bc-8ba1-1af6c01d3da4 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0" status: 200 len: 1258 microversion: 2.21 time: 0.157928 Aug 04 16:39:45.606009 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 696/1420] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:39:45 2022] GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:39:45.611045 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cedca022-ea94-4440-a895-aaaeff826562 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:45.611825 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cedca022-ea94-4440-a895-aaaeff826562 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:45.618853 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cedca022-ea94-4440-a895-aaaeff826562 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:45.619618 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cedca022-ea94-4440-a895-aaaeff826562 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:45.620536 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cedca022-ea94-4440-a895-aaaeff826562 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:45.621141 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cedca022-ea94-4440-a895-aaaeff826562 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:45.854548 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-04a5e44a-6227-4bcb-9b89-ff091dda8518 tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/66330365-7f7f-4521-a79d-bbcf4a99f01b" status: 202 len: 0 microversion: 2.1 time: 0.844712 Aug 04 16:39:45.857723 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 725/1421] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:39:45 2022] DELETE /compute/v2.1/os-security-groups/66330365-7f7f-4521-a79d-bbcf4a99f01b => generated 0 bytes in 849 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:39:45.866670 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-95676558-f73a-4594-a2e2-563cccc06eb0 tempest-ListImagesTestJSON-1611135180 tempest-ListImagesTestJSON-1611135180-project] Calling method '.version_select at 0x7f7e84158790>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:45.957916 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cedca022-ea94-4440-a895-aaaeff826562 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:45.985246 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cedca022-ea94-4440-a895-aaaeff826562 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1462 microversion: 2.1 time: 0.377701 Aug 04 16:39:45.987215 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 697/1422] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:45 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1462 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:45.996699 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-545208bd-f5fa-45d2-aa5a-c729bdffbd7e tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "466ea028-925a-4b89-ab4d-77b5ed0bc0f1"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:39:46.001586 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-545208bd-f5fa-45d2-aa5a-c729bdffbd7e tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:46.015788 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-545208bd-f5fa-45d2-aa5a-c729bdffbd7e tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:46.018131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-545208bd-f5fa-45d2-aa5a-c729bdffbd7e tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:46.019495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-545208bd-f5fa-45d2-aa5a-c729bdffbd7e tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:46.021657 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-545208bd-f5fa-45d2-aa5a-c729bdffbd7e tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:46.027266 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-95676558-f73a-4594-a2e2-563cccc06eb0 tempest-ListImagesTestJSON-1611135180 tempest-ListImagesTestJSON-1611135180-project] 10.222.0.23 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.165198 Aug 04 16:39:46.028930 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 726/1423] 10.222.0.23 () {58 vars in 1143 bytes} [Thu Aug 4 16:39:45 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:39:46.038025 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-6c9268f7-7cf8-4afc-9549-700798c8aa48 req-16150944-a556-40d8-ab04-0dfe3576c1a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "637703de-2520-4512-bf57-9b811b7769d4", "name": "network-vif-plugged", "status": "completed", "tag": "1568bcc2-0017-4817-883a-43e4096677ac"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:39:46.089074 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6c9268f7-7cf8-4afc-9549-700798c8aa48 req-16150944-a556-40d8-ab04-0dfe3576c1a0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:46.089558 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6c9268f7-7cf8-4afc-9549-700798c8aa48 req-16150944-a556-40d8-ab04-0dfe3576c1a0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:46.129950 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-6c9268f7-7cf8-4afc-9549-700798c8aa48 req-16150944-a556-40d8-ab04-0dfe3576c1a0 service nova] Creating event network-vif-plugged:1568bcc2-0017-4817-883a-43e4096677ac for instance 637703de-2520-4512-bf57-9b811b7769d4 on n-h2-846466-12 Aug 04 16:39:46.139772 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-6c9268f7-7cf8-4afc-9549-700798c8aa48 req-16150944-a556-40d8-ab04-0dfe3576c1a0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107996 Aug 04 16:39:46.141222 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 727/1424] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:39:46.172182 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d213b171-3ae2-48c7-983f-83cba0a80fe2 tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] Calling method '.version_select at 0x7f7e848e51f0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:46.828677 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-545208bd-f5fa-45d2-aa5a-c729bdffbd7e tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "POST /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.835066 Aug 04 16:39:46.845447 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 698/1425] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Aug 4 16:39:45 2022] POST /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727/os-volume_attachments => generated 194 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:39:46.883745 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e1b642d4-b0ce-4670-b8e3-d2631ba852ba tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:46.884923 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e1b642d4-b0ce-4670-b8e3-d2631ba852ba tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:46.914431 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e1b642d4-b0ce-4670-b8e3-d2631ba852ba tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:46.918550 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e1b642d4-b0ce-4670-b8e3-d2631ba852ba tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:46.924386 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e1b642d4-b0ce-4670-b8e3-d2631ba852ba tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:46.925947 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e1b642d4-b0ce-4670-b8e3-d2631ba852ba tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:46.996499 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d213b171-3ae2-48c7-983f-83cba0a80fe2 tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/41b4f4b1-6c24-4004-875f-c853ace0fcc0" status: 202 len: 0 microversion: 2.1 time: 0.838933 Aug 04 16:39:47.005549 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 728/1426] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:39:46 2022] DELETE /compute/v2.1/os-security-groups/41b4f4b1-6c24-4004-875f-c853ace0fcc0 => generated 0 bytes in 862 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:39:47.032378 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4cb3dd37-9cf3-4cac-80ec-735d883b49b2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:47.034586 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4cb3dd37-9cf3-4cac-80ec-735d883b49b2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:47.075341 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4cb3dd37-9cf3-4cac-80ec-735d883b49b2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:47.076430 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4cb3dd37-9cf3-4cac-80ec-735d883b49b2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:47.079734 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4cb3dd37-9cf3-4cac-80ec-735d883b49b2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:47.085614 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4cb3dd37-9cf3-4cac-80ec-735d883b49b2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:47.381497 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e1b642d4-b0ce-4670-b8e3-d2631ba852ba tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1615 microversion: 2.1 time: 0.533295 Aug 04 16:39:47.388923 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 699/1427] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:46 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1615 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:47.410730 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-275e2922-9520-404f-8ca0-f778bb73cdf0 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:47.411883 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-275e2922-9520-404f-8ca0-f778bb73cdf0 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] [instance: b1cd2844-77ab-41e5-82e5-a954081001f0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:47.431552 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-275e2922-9520-404f-8ca0-f778bb73cdf0 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:47.434049 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-275e2922-9520-404f-8ca0-f778bb73cdf0 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:47.436569 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-275e2922-9520-404f-8ca0-f778bb73cdf0 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:47.438450 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-275e2922-9520-404f-8ca0-f778bb73cdf0 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:47.635344 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4cb3dd37-9cf3-4cac-80ec-735d883b49b2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:47.660774 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4cb3dd37-9cf3-4cac-80ec-735d883b49b2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 200 len: 1199 microversion: 2.1 time: 0.652746 Aug 04 16:39:47.666957 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 729/1428] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:47 2022] GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 1199 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:47.682187 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b6767b97-76bb-48ba-8e6a-aeff0c37ec61 tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] Calling method '.version_select at 0x7f7e847bd4c0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:47.792344 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-275e2922-9520-404f-8ca0-f778bb73cdf0 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:47.826901 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-275e2922-9520-404f-8ca0-f778bb73cdf0 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:47.831053 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-275e2922-9520-404f-8ca0-f778bb73cdf0 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:47.838905 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-275e2922-9520-404f-8ca0-f778bb73cdf0 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0" status: 200 len: 1316 microversion: 2.21 time: 0.447575 Aug 04 16:39:47.843624 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 700/1429] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:39:47 2022] GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0 => generated 1316 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:39:47.861486 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ffc91408-2a7f-4568-b9d0-31b3bcbab96c tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:39:47.866706 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ffc91408-2a7f-4568-b9d0-31b3bcbab96c tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:47.908971 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ffc91408-2a7f-4568-b9d0-31b3bcbab96c tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:47.912009 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ffc91408-2a7f-4568-b9d0-31b3bcbab96c tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:47.914027 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ffc91408-2a7f-4568-b9d0-31b3bcbab96c tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:47.915186 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ffc91408-2a7f-4568-b9d0-31b3bcbab96c tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:48.005784 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ffc91408-2a7f-4568-b9d0-31b3bcbab96c tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '59e7b930d8b34ffbaa2c13974ca024cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf192b7f3924c32b45bb63e397ea6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:48.007707 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ffc91408-2a7f-4568-b9d0-31b3bcbab96c tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] flavor_id is None. Assuming migration. {{(pid=126126) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 04 16:39:48.008668 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ffc91408-2a7f-4568-b9d0-31b3bcbab96c tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=126126) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 16:39:48.345461 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b6767b97-76bb-48ba-8e6a-aeff0c37ec61 tempest-SecurityGroupRulesTestJSON-1406360788 tempest-SecurityGroupRulesTestJSON-1406360788-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/595ee6d8-415f-4c03-ac01-1ce4ddd0637b" status: 202 len: 0 microversion: 2.1 time: 0.675918 Aug 04 16:39:48.348881 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 730/1430] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:39:47 2022] DELETE /compute/v2.1/os-security-groups/595ee6d8-415f-4c03-ac01-1ce4ddd0637b => generated 0 bytes in 681 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:39:48.415718 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ffc91408-2a7f-4568-b9d0-31b3bcbab96c tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42/action" status: 202 len: 0 microversion: 2.1 time: 0.568714 Aug 04 16:39:48.420903 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 701/1431] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:39:47 2022] POST /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42/action => generated 0 bytes in 576 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:39:48.499766 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c2037afb-a2d0-46cf-8d29-d9cd1b982900 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:48.502932 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c2037afb-a2d0-46cf-8d29-d9cd1b982900 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:48.547294 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2037afb-a2d0-46cf-8d29-d9cd1b982900 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:48.551304 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2037afb-a2d0-46cf-8d29-d9cd1b982900 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:48.557379 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2037afb-a2d0-46cf-8d29-d9cd1b982900 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:48.560104 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2037afb-a2d0-46cf-8d29-d9cd1b982900 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:48.712058 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c40692fd-4a40-4135-a740-ed3c296d0243 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:48.713674 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c40692fd-4a40-4135-a740-ed3c296d0243 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:48.741201 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c40692fd-4a40-4135-a740-ed3c296d0243 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:48.746419 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c40692fd-4a40-4135-a740-ed3c296d0243 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:48.750242 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c40692fd-4a40-4135-a740-ed3c296d0243 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:48.753646 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c40692fd-4a40-4135-a740-ed3c296d0243 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:49.054182 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c40692fd-4a40-4135-a740-ed3c296d0243 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:49.071930 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c2037afb-a2d0-46cf-8d29-d9cd1b982900 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:49.082823 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c40692fd-4a40-4135-a740-ed3c296d0243 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 200 len: 1383 microversion: 2.1 time: 0.377306 Aug 04 16:39:49.086230 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c2037afb-a2d0-46cf-8d29-d9cd1b982900 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1471 microversion: 2.1 time: 0.651712 Aug 04 16:39:49.104103 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 731/1432] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:48 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1471 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:49.104995 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 702/1433] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:48 2022] GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 1383 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:49.113498 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-491ef27e-37a8-451e-93b5-fe68d762deea tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:49.114153 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-491ef27e-37a8-451e-93b5-fe68d762deea tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] [instance: b1cd2844-77ab-41e5-82e5-a954081001f0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:49.137260 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-491ef27e-37a8-451e-93b5-fe68d762deea tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:49.138431 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-491ef27e-37a8-451e-93b5-fe68d762deea tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:49.140246 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-491ef27e-37a8-451e-93b5-fe68d762deea tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:49.142466 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-491ef27e-37a8-451e-93b5-fe68d762deea tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:49.338508 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-491ef27e-37a8-451e-93b5-fe68d762deea tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:49.375594 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-491ef27e-37a8-451e-93b5-fe68d762deea tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:49.383451 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-491ef27e-37a8-451e-93b5-fe68d762deea tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:49.391740 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-491ef27e-37a8-451e-93b5-fe68d762deea tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0" status: 200 len: 1316 microversion: 2.21 time: 0.286502 Aug 04 16:39:49.393241 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 732/1434] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:39:49 2022] GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0 => generated 1316 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:39:49.887870 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-34ee743b-6cb7-4087-b231-fe746bb49d67 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:49.893749 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-34ee743b-6cb7-4087-b231-fe746bb49d67 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:49.928577 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-34ee743b-6cb7-4087-b231-fe746bb49d67 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:49.933661 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-34ee743b-6cb7-4087-b231-fe746bb49d67 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:49.935477 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-34ee743b-6cb7-4087-b231-fe746bb49d67 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:49.942382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-34ee743b-6cb7-4087-b231-fe746bb49d67 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:50.177018 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6c93beb4-66b8-4ffd-b0c3-5a3fd0180d2f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:50.180603 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6c93beb4-66b8-4ffd-b0c3-5a3fd0180d2f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:50.225094 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6c93beb4-66b8-4ffd-b0c3-5a3fd0180d2f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:50.226918 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6c93beb4-66b8-4ffd-b0c3-5a3fd0180d2f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:50.230051 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6c93beb4-66b8-4ffd-b0c3-5a3fd0180d2f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:50.233051 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6c93beb4-66b8-4ffd-b0c3-5a3fd0180d2f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:50.807736 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-34ee743b-6cb7-4087-b231-fe746bb49d67 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 200 len: 1536 microversion: 2.1 time: 1.696753 Aug 04 16:39:50.808391 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 703/1435] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:49 2022] GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 1536 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:50.827802 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-51d53748-1960-4275-ac77-ae345fea217a tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:50.828412 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-51d53748-1960-4275-ac77-ae345fea217a tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] [instance: b1cd2844-77ab-41e5-82e5-a954081001f0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:50.846740 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-51d53748-1960-4275-ac77-ae345fea217a tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:50.847187 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-51d53748-1960-4275-ac77-ae345fea217a tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:50.847990 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-51d53748-1960-4275-ac77-ae345fea217a tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:50.848425 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-51d53748-1960-4275-ac77-ae345fea217a tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:51.112885 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6c93beb4-66b8-4ffd-b0c3-5a3fd0180d2f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:51.128077 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6c93beb4-66b8-4ffd-b0c3-5a3fd0180d2f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1471 microversion: 2.1 time: 0.992972 Aug 04 16:39:51.149056 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 733/1436] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:50 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1471 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:51.160359 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-82685dea-3adf-4cf5-8253-54c83714285f tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:51.160993 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-82685dea-3adf-4cf5-8253-54c83714285f tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:51.202097 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-82685dea-3adf-4cf5-8253-54c83714285f tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:51.205207 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-82685dea-3adf-4cf5-8253-54c83714285f tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:51.206032 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-82685dea-3adf-4cf5-8253-54c83714285f tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:51.206481 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-82685dea-3adf-4cf5-8253-54c83714285f tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:51.278682 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-51d53748-1960-4275-ac77-ae345fea217a tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:51.290553 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-51d53748-1960-4275-ac77-ae345fea217a tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:51.295872 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-51d53748-1960-4275-ac77-ae345fea217a tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:51.298189 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-51d53748-1960-4275-ac77-ae345fea217a tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0" status: 200 len: 1358 microversion: 2.21 time: 0.474759 Aug 04 16:39:51.299352 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 704/1437] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:39:50 2022] GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0 => generated 1358 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:39:51.564532 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-82685dea-3adf-4cf5-8253-54c83714285f tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 200 len: 1536 microversion: 2.1 time: 0.413494 Aug 04 16:39:51.565786 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 734/1438] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:51 2022] GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 1536 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:51.596782 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9322e794-5544-49a0-828f-389efb6b28e4 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:51.601110 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:39:51.601110 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:39:51.608389 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9322e794-5544-49a0-828f-389efb6b28e4 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:51.616013 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9322e794-5544-49a0-828f-389efb6b28e4 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:51.623332 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9322e794-5544-49a0-828f-389efb6b28e4 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:51.624180 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9322e794-5544-49a0-828f-389efb6b28e4 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:51.705611 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9322e794-5544-49a0-828f-389efb6b28e4 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.115596 Aug 04 16:39:51.706560 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 705/1439] 10.222.0.23 () {58 vars in 1176 bytes} [Thu Aug 4 16:39:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:39:51.720514 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-193e20c3-f432-4e4d-a689-698afe084ad7 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-846466-12", "block_migration": false, "disk_over_commit": false}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:39:51.723559 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-193e20c3-f432-4e4d-a689-698afe084ad7 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:51.731378 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-193e20c3-f432-4e4d-a689-698afe084ad7 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:51.731848 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-193e20c3-f432-4e4d-a689-698afe084ad7 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:51.732825 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-193e20c3-f432-4e4d-a689-698afe084ad7 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:51.733267 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-193e20c3-f432-4e4d-a689-698afe084ad7 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:51.781841 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-193e20c3-f432-4e4d-a689-698afe084ad7 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lazy-loading 'flavor' on Instance uuid 637703de-2520-4512-bf57-9b811b7769d4 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:39:51.806332 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-193e20c3-f432-4e4d-a689-698afe084ad7 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Going to try to live migrate instance to n-h1-846466-12 {{(pid=126125) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 16:39:52.160789 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-29611acf-93f7-444e-9946-d9826fbdd5b7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:52.161744 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-29611acf-93f7-444e-9946-d9826fbdd5b7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:52.193439 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-29611acf-93f7-444e-9946-d9826fbdd5b7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:52.194344 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-29611acf-93f7-444e-9946-d9826fbdd5b7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:52.198419 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-29611acf-93f7-444e-9946-d9826fbdd5b7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:52.202494 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-29611acf-93f7-444e-9946-d9826fbdd5b7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:52.703367 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-29611acf-93f7-444e-9946-d9826fbdd5b7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:52.748824 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-29611acf-93f7-444e-9946-d9826fbdd5b7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1471 microversion: 2.1 time: 0.593404 Aug 04 16:39:52.774437 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 706/1440] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:52 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1471 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:39:52.784012 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-efc8227c-7825-4524-b765-4ceb84b924df tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:52.788453 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-efc8227c-7825-4524-b765-4ceb84b924df tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] [instance: b1cd2844-77ab-41e5-82e5-a954081001f0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:52.807817 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-efc8227c-7825-4524-b765-4ceb84b924df tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:52.822624 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-efc8227c-7825-4524-b765-4ceb84b924df tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:52.827768 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-efc8227c-7825-4524-b765-4ceb84b924df tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:52.831376 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-efc8227c-7825-4524-b765-4ceb84b924df tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:53.197840 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-efc8227c-7825-4524-b765-4ceb84b924df tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:53.217243 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-efc8227c-7825-4524-b765-4ceb84b924df tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:53.226213 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-efc8227c-7825-4524-b765-4ceb84b924df tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:53.232367 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-efc8227c-7825-4524-b765-4ceb84b924df tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0" status: 200 len: 1358 microversion: 2.21 time: 0.455973 Aug 04 16:39:53.234447 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 707/1441] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:39:52 2022] GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0 => generated 1358 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:39:53.777010 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fd15c01c-4513-4b64-b44c-ab8af5d82e7f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:53.777701 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fd15c01c-4513-4b64-b44c-ab8af5d82e7f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:53.788365 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fd15c01c-4513-4b64-b44c-ab8af5d82e7f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:53.793573 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fd15c01c-4513-4b64-b44c-ab8af5d82e7f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:53.794898 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fd15c01c-4513-4b64-b44c-ab8af5d82e7f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:53.795350 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fd15c01c-4513-4b64-b44c-ab8af5d82e7f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:54.362697 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fd15c01c-4513-4b64-b44c-ab8af5d82e7f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:54.378860 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:39:54.389044 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fd15c01c-4513-4b64-b44c-ab8af5d82e7f tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1471 microversion: 2.1 time: 0.617452 Aug 04 16:39:54.396146 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 708/1442] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:53 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1471 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:54.410240 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8762a798-00b2-4b69-b239-d903fd05e735 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:54.415743 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8762a798-00b2-4b69-b239-d903fd05e735 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] [instance: b1cd2844-77ab-41e5-82e5-a954081001f0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:54.423120 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8762a798-00b2-4b69-b239-d903fd05e735 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:54.424123 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8762a798-00b2-4b69-b239-d903fd05e735 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:54.425463 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8762a798-00b2-4b69-b239-d903fd05e735 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:54.426227 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8762a798-00b2-4b69-b239-d903fd05e735 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:54.642015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:39:54.694307 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:39:54.752498 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8762a798-00b2-4b69-b239-d903fd05e735 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:54.765720 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8762a798-00b2-4b69-b239-d903fd05e735 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:54.768375 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8762a798-00b2-4b69-b239-d903fd05e735 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:54.770592 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8762a798-00b2-4b69-b239-d903fd05e735 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0" status: 200 len: 1358 microversion: 2.21 time: 0.372533 Aug 04 16:39:54.772253 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 709/1443] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:39:54 2022] GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0 => generated 1358 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:39:55.364833 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-82a9f6d3-864a-416a-b479-fe6a1abe7e07 req-919b13fe-edb5-434a-b0e6-3396670c6d14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1cd2844-77ab-41e5-82e5-a954081001f0", "tag": "45ea1a02-cd11-4988-8894-26ea3b68e90a"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:39:55.392923 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-82a9f6d3-864a-416a-b479-fe6a1abe7e07 req-919b13fe-edb5-434a-b0e6-3396670c6d14 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:55.394650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-82a9f6d3-864a-416a-b479-fe6a1abe7e07 req-919b13fe-edb5-434a-b0e6-3396670c6d14 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:55.431226 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-82a9f6d3-864a-416a-b479-fe6a1abe7e07 req-919b13fe-edb5-434a-b0e6-3396670c6d14 service nova] Creating event network-changed:45ea1a02-cd11-4988-8894-26ea3b68e90a for instance b1cd2844-77ab-41e5-82e5-a954081001f0 on n-h1-846466-12 Aug 04 16:39:55.450093 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-82a9f6d3-864a-416a-b479-fe6a1abe7e07 req-919b13fe-edb5-434a-b0e6-3396670c6d14 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089832 Aug 04 16:39:55.457789 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 710/1444] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:39:55.485032 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-63342ae5-45b6-401b-8024-6685a7564b29 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:55.490178 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-63342ae5-45b6-401b-8024-6685a7564b29 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:55.517901 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63342ae5-45b6-401b-8024-6685a7564b29 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:55.520952 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63342ae5-45b6-401b-8024-6685a7564b29 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:55.523755 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63342ae5-45b6-401b-8024-6685a7564b29 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:55.525454 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63342ae5-45b6-401b-8024-6685a7564b29 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:55.617269 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:39:56.420817 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-193e20c3-f432-4e4d-a689-698afe084ad7 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4/action" status: 202 len: 0 microversion: 2.1 time: 4.704292 Aug 04 16:39:56.422332 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 735/1445] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:39:51 2022] POST /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4/action => generated 0 bytes in 4707 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:39:56.465240 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1dcb0126-5043-4fa2-a67b-f570e7e519a5 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:56.470090 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1dcb0126-5043-4fa2-a67b-f570e7e519a5 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] [instance: b1cd2844-77ab-41e5-82e5-a954081001f0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:56.510509 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-63342ae5-45b6-401b-8024-6685a7564b29 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:56.515613 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1dcb0126-5043-4fa2-a67b-f570e7e519a5 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:56.518341 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1dcb0126-5043-4fa2-a67b-f570e7e519a5 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:56.519840 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1dcb0126-5043-4fa2-a67b-f570e7e519a5 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:56.529372 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1dcb0126-5043-4fa2-a67b-f570e7e519a5 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:56.543576 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-63342ae5-45b6-401b-8024-6685a7564b29 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1471 microversion: 2.1 time: 1.082217 Aug 04 16:39:56.547012 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 711/1446] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:55 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1471 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:56.596996 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e6fc53a2-f43f-4c74-8699-5c9a81ba24b3 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:56.606391 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e6fc53a2-f43f-4c74-8699-5c9a81ba24b3 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:56.661179 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e6fc53a2-f43f-4c74-8699-5c9a81ba24b3 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:56.668406 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e6fc53a2-f43f-4c74-8699-5c9a81ba24b3 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:56.677256 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e6fc53a2-f43f-4c74-8699-5c9a81ba24b3 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:56.685495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e6fc53a2-f43f-4c74-8699-5c9a81ba24b3 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:57.093345 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1dcb0126-5043-4fa2-a67b-f570e7e519a5 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:57.111308 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1dcb0126-5043-4fa2-a67b-f570e7e519a5 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:57.114092 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1dcb0126-5043-4fa2-a67b-f570e7e519a5 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:57.120573 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1dcb0126-5043-4fa2-a67b-f570e7e519a5 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0" status: 200 len: 1358 microversion: 2.21 time: 0.696125 Aug 04 16:39:57.127637 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 736/1447] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:39:56 2022] GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0 => generated 1358 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:39:57.591273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-acfc20d5-6e68-417d-8eb9-1ebdd5cf5b2b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:57.593328 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-acfc20d5-6e68-417d-8eb9-1ebdd5cf5b2b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:57.608556 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-acfc20d5-6e68-417d-8eb9-1ebdd5cf5b2b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:57.609983 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-acfc20d5-6e68-417d-8eb9-1ebdd5cf5b2b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:57.611077 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-acfc20d5-6e68-417d-8eb9-1ebdd5cf5b2b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:57.614702 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-acfc20d5-6e68-417d-8eb9-1ebdd5cf5b2b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:57.842343 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e6fc53a2-f43f-4c74-8699-5c9a81ba24b3 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:57.862300 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e6fc53a2-f43f-4c74-8699-5c9a81ba24b3 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 200 len: 1393 microversion: 2.1 time: 1.308275 Aug 04 16:39:57.863484 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 712/1448] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:56 2022] GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 1393 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:58.004617 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-acfc20d5-6e68-417d-8eb9-1ebdd5cf5b2b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:58.015552 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-acfc20d5-6e68-417d-8eb9-1ebdd5cf5b2b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1476 microversion: 2.1 time: 0.430402 Aug 04 16:39:58.026838 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 737/1449] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:57 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1476 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:39:58.176597 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-88780447-75f5-40ff-a22e-77f6058606f6 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:58.178743 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-88780447-75f5-40ff-a22e-77f6058606f6 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] [instance: b1cd2844-77ab-41e5-82e5-a954081001f0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:58.207834 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-88780447-75f5-40ff-a22e-77f6058606f6 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:58.217756 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-88780447-75f5-40ff-a22e-77f6058606f6 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:58.219596 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-88780447-75f5-40ff-a22e-77f6058606f6 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:58.220836 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-88780447-75f5-40ff-a22e-77f6058606f6 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:58.644595 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-88780447-75f5-40ff-a22e-77f6058606f6 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:58.672840 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-88780447-75f5-40ff-a22e-77f6058606f6 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:58.686955 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-88780447-75f5-40ff-a22e-77f6058606f6 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:58.689418 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-88780447-75f5-40ff-a22e-77f6058606f6 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0" status: 200 len: 1358 microversion: 2.21 time: 0.520468 Aug 04 16:39:58.701320 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 713/1450] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:39:58 2022] GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0 => generated 1358 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:39:58.886148 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-13f9b4ec-72a1-43ab-8c6c-065643120218 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:58.887068 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-13f9b4ec-72a1-43ab-8c6c-065643120218 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:58.905807 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-13f9b4ec-72a1-43ab-8c6c-065643120218 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:58.906493 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-13f9b4ec-72a1-43ab-8c6c-065643120218 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:58.907447 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-13f9b4ec-72a1-43ab-8c6c-065643120218 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:58.909177 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-13f9b4ec-72a1-43ab-8c6c-065643120218 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:59.068350 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1112b3a6-7437-4ab3-8507-e285d38cd583 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:59.069588 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1112b3a6-7437-4ab3-8507-e285d38cd583 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:59.098267 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1112b3a6-7437-4ab3-8507-e285d38cd583 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:59.102292 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1112b3a6-7437-4ab3-8507-e285d38cd583 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:59.103755 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1112b3a6-7437-4ab3-8507-e285d38cd583 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:59.110284 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1112b3a6-7437-4ab3-8507-e285d38cd583 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:59.350497 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-13f9b4ec-72a1-43ab-8c6c-065643120218 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:59.383266 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-13f9b4ec-72a1-43ab-8c6c-065643120218 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 200 len: 1393 microversion: 2.1 time: 0.502417 Aug 04 16:39:59.385372 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 738/1451] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:58 2022] GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 1393 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:59.480074 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1112b3a6-7437-4ab3-8507-e285d38cd583 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:39:59.539751 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1112b3a6-7437-4ab3-8507-e285d38cd583 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1476 microversion: 2.1 time: 0.479293 Aug 04 16:39:59.542107 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 714/1452] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:39:59 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1476 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:39:59.758325 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4c7a75c6-eecf-464d-83b2-890d92ef8ba4 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:39:59.760175 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4c7a75c6-eecf-464d-83b2-890d92ef8ba4 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] [instance: b1cd2844-77ab-41e5-82e5-a954081001f0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:39:59.783150 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4c7a75c6-eecf-464d-83b2-890d92ef8ba4 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:59.786869 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4c7a75c6-eecf-464d-83b2-890d92ef8ba4 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:39:59.791035 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4c7a75c6-eecf-464d-83b2-890d92ef8ba4 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:39:59.792218 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4c7a75c6-eecf-464d-83b2-890d92ef8ba4 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:00.422421 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4507c611-9e30-4082-a986-8561dc5686aa tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:00.424778 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4507c611-9e30-4082-a986-8561dc5686aa tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:00.464795 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4507c611-9e30-4082-a986-8561dc5686aa tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:00.468901 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4507c611-9e30-4082-a986-8561dc5686aa tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:00.472849 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4507c611-9e30-4082-a986-8561dc5686aa tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:00.478488 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4507c611-9e30-4082-a986-8561dc5686aa tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:01.657326 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:40:01.827952 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4c7a75c6-eecf-464d-83b2-890d92ef8ba4 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:01.837308 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4c7a75c6-eecf-464d-83b2-890d92ef8ba4 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:01.858742 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4c7a75c6-eecf-464d-83b2-890d92ef8ba4 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:01.871722 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4c7a75c6-eecf-464d-83b2-890d92ef8ba4 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0" status: 200 len: 1358 microversion: 2.21 time: 2.127214 Aug 04 16:40:01.874409 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 739/1453] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:39:59 2022] GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0 => generated 1358 bytes in 2137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:40:01.920429 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b970b759-9620-4b4a-84e9-77514fb46ad0 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:01.921721 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b970b759-9620-4b4a-84e9-77514fb46ad0 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:01.954213 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b970b759-9620-4b4a-84e9-77514fb46ad0 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:01.954684 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b970b759-9620-4b4a-84e9-77514fb46ad0 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:01.955635 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b970b759-9620-4b4a-84e9-77514fb46ad0 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:01.956067 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b970b759-9620-4b4a-84e9-77514fb46ad0 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:01.976562 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4507c611-9e30-4082-a986-8561dc5686aa tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:02.017611 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4507c611-9e30-4082-a986-8561dc5686aa tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 200 len: 1393 microversion: 2.1 time: 1.602455 Aug 04 16:40:02.034135 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 715/1454] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:00 2022] GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 1393 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:40:02.064636 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e9da9a7c-3912-4386-b8cf-9bd2f6df3e60 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1961022841", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "2ab6e0fe-802f-4938-8f6b-adfd35fddb62"}], "block_device_mapping_v2": [{"uuid": "e003f6b3-9959-43e0-a2fc-a7a3ab0cc0dd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:40:02.313328 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-e9da9a7c-3912-4386-b8cf-9bd2f6df3e60 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] validate_networks() for [('2ab6e0fe-802f-4938-8f6b-adfd35fddb62', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:40:02.498448 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b970b759-9620-4b4a-84e9-77514fb46ad0 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:02.525241 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b970b759-9620-4b4a-84e9-77514fb46ad0 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1476 microversion: 2.1 time: 0.647191 Aug 04 16:40:02.532837 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 740/1455] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:01 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1476 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:02.926800 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a22f3ca2-1cab-40ea-843b-fa1b44f0f3ae tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:02.930141 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a22f3ca2-1cab-40ea-843b-fa1b44f0f3ae tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] [instance: b1cd2844-77ab-41e5-82e5-a954081001f0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:02.959186 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a22f3ca2-1cab-40ea-843b-fa1b44f0f3ae tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:02.972407 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a22f3ca2-1cab-40ea-843b-fa1b44f0f3ae tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:02.975428 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a22f3ca2-1cab-40ea-843b-fa1b44f0f3ae tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:02.976771 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a22f3ca2-1cab-40ea-843b-fa1b44f0f3ae tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:03.950961 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a22f3ca2-1cab-40ea-843b-fa1b44f0f3ae tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:04.018936 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a22f3ca2-1cab-40ea-843b-fa1b44f0f3ae tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:04.028923 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a22f3ca2-1cab-40ea-843b-fa1b44f0f3ae tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:04.032078 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a22f3ca2-1cab-40ea-843b-fa1b44f0f3ae tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0" status: 200 len: 1358 microversion: 2.21 time: 1.113688 Aug 04 16:40:04.042589 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 741/1456] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:40:02 2022] GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0 => generated 1358 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:40:04.074541 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b851c604-43f2-45ef-9a8b-7d99c4e71cdc tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:04.081440 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b851c604-43f2-45ef-9a8b-7d99c4e71cdc tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:04.115069 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b851c604-43f2-45ef-9a8b-7d99c4e71cdc tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:04.118569 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b851c604-43f2-45ef-9a8b-7d99c4e71cdc tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:04.122070 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b851c604-43f2-45ef-9a8b-7d99c4e71cdc tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:04.125258 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b851c604-43f2-45ef-9a8b-7d99c4e71cdc tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:04.672444 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b851c604-43f2-45ef-9a8b-7d99c4e71cdc tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:04.683424 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b851c604-43f2-45ef-9a8b-7d99c4e71cdc tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 200 len: 1393 microversion: 2.1 time: 0.632329 Aug 04 16:40:04.698783 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 742/1457] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:04 2022] GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 1393 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:04.705975 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-e9da9a7c-3912-4386-b8cf-9bd2f6df3e60 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:40:04.706714 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-e9da9a7c-3912-4386-b8cf-9bd2f6df3e60 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:40:04.707343 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7026277d-dca2-41db-a73e-c43e863be511 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:04.707562 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-e9da9a7c-3912-4386-b8cf-9bd2f6df3e60 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:40:04.709890 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7026277d-dca2-41db-a73e-c43e863be511 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:04.710136 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-e9da9a7c-3912-4386-b8cf-9bd2f6df3e60 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:40:04.710756 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-e9da9a7c-3912-4386-b8cf-9bd2f6df3e60 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:40:04.717896 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7026277d-dca2-41db-a73e-c43e863be511 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:04.719672 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7026277d-dca2-41db-a73e-c43e863be511 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:04.720828 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7026277d-dca2-41db-a73e-c43e863be511 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:04.721544 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7026277d-dca2-41db-a73e-c43e863be511 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:04.750623 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e9da9a7c-3912-4386-b8cf-9bd2f6df3e60 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:04.756706 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e9da9a7c-3912-4386-b8cf-9bd2f6df3e60 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:04.758590 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e9da9a7c-3912-4386-b8cf-9bd2f6df3e60 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:04.759940 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e9da9a7c-3912-4386-b8cf-9bd2f6df3e60 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:04.853139 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-e9da9a7c-3912-4386-b8cf-9bd2f6df3e60 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Getting quotas for project e96e3e6168ec421da0cac9eaa8849255. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:40:04.871882 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-e9da9a7c-3912-4386-b8cf-9bd2f6df3e60 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Getting quotas for user 5bf98871e1344215bd667945e6881320 and project e96e3e6168ec421da0cac9eaa8849255. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:40:05.060259 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e9da9a7c-3912-4386-b8cf-9bd2f6df3e60 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:40:05.063545 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e9da9a7c-3912-4386-b8cf-9bd2f6df3e60 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e003f6b3-9959-43e0-a2fc-a7a3ab0cc0dd',volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:40:05.408982 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7026277d-dca2-41db-a73e-c43e863be511 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:05.417761 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:40:05.422390 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7026277d-dca2-41db-a73e-c43e863be511 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1476 microversion: 2.1 time: 0.721963 Aug 04 16:40:05.434431 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 743/1458] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:04 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1476 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:05.451657 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-bac0bfc2-b425-48eb-8935-6274e7b7f213 req-8c2ab44d-a2b1-400d-b300-0bad49f958ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1cd2844-77ab-41e5-82e5-a954081001f0", "name": "network-vif-plugged", "status": "completed", "tag": "45ea1a02-cd11-4988-8894-26ea3b68e90a"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:40:05.466739 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e9da9a7c-3912-4386-b8cf-9bd2f6df3e60 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.430393 Aug 04 16:40:05.467883 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 716/1459] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Aug 4 16:40:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 3433 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 16:40:05.478542 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9f75fd2a-e973-4c99-b8bc-b3b62caff064 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:05.487510 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9f75fd2a-e973-4c99-b8bc-b3b62caff064 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] [instance: b1cd2844-77ab-41e5-82e5-a954081001f0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:05.505444 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-bac0bfc2-b425-48eb-8935-6274e7b7f213 req-8c2ab44d-a2b1-400d-b300-0bad49f958ac service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:05.506960 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-bac0bfc2-b425-48eb-8935-6274e7b7f213 req-8c2ab44d-a2b1-400d-b300-0bad49f958ac service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:05.550092 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:40:05.555231 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-bac0bfc2-b425-48eb-8935-6274e7b7f213 req-8c2ab44d-a2b1-400d-b300-0bad49f958ac service nova] Creating event network-vif-plugged:45ea1a02-cd11-4988-8894-26ea3b68e90a for instance b1cd2844-77ab-41e5-82e5-a954081001f0 on n-h1-846466-12 Aug 04 16:40:05.572406 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f75fd2a-e973-4c99-b8bc-b3b62caff064 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:05.575218 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f75fd2a-e973-4c99-b8bc-b3b62caff064 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:05.577530 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f75fd2a-e973-4c99-b8bc-b3b62caff064 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:05.585467 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f75fd2a-e973-4c99-b8bc-b3b62caff064 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:05.589934 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-bac0bfc2-b425-48eb-8935-6274e7b7f213 req-8c2ab44d-a2b1-400d-b300-0bad49f958ac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152848 Aug 04 16:40:05.590489 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 744/1460] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:40:05.651807 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c1b094c9-0cd7-4cf2-b311-5cc5fb32caaa tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:05.654466 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c1b094c9-0cd7-4cf2-b311-5cc5fb32caaa tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:06.390883 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c1b094c9-0cd7-4cf2-b311-5cc5fb32caaa tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:06.406376 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c1b094c9-0cd7-4cf2-b311-5cc5fb32caaa tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:06.413674 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c1b094c9-0cd7-4cf2-b311-5cc5fb32caaa tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:06.429627 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c1b094c9-0cd7-4cf2-b311-5cc5fb32caaa tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1104 microversion: 2.25 time: 0.827336 Aug 04 16:40:06.432460 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 745/1461] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:40:05 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1104 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:40:06.445544 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5c8bcf2a-aa95-4972-913e-4d775e44110d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:06.445544 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5c8bcf2a-aa95-4972-913e-4d775e44110d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:06.489127 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5c8bcf2a-aa95-4972-913e-4d775e44110d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:06.490051 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5c8bcf2a-aa95-4972-913e-4d775e44110d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:06.494314 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5c8bcf2a-aa95-4972-913e-4d775e44110d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:06.495312 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5c8bcf2a-aa95-4972-913e-4d775e44110d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:06.746292 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9f75fd2a-e973-4c99-b8bc-b3b62caff064 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:06.760424 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9f75fd2a-e973-4c99-b8bc-b3b62caff064 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:06.780045 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9f75fd2a-e973-4c99-b8bc-b3b62caff064 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:06.781580 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9f75fd2a-e973-4c99-b8bc-b3b62caff064 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0" status: 200 len: 1358 microversion: 2.21 time: 1.312267 Aug 04 16:40:06.785471 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 717/1462] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:40:05 2022] GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0 => generated 1358 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:40:06.791936 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a51429c4-f3bc-4598-85b0-1753aece7657 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:06.809252 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a51429c4-f3bc-4598-85b0-1753aece7657 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:06.844620 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a51429c4-f3bc-4598-85b0-1753aece7657 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:06.850085 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a51429c4-f3bc-4598-85b0-1753aece7657 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:06.854373 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a51429c4-f3bc-4598-85b0-1753aece7657 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:06.858471 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a51429c4-f3bc-4598-85b0-1753aece7657 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:07.768910 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5c8bcf2a-aa95-4972-913e-4d775e44110d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:07.786079 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5c8bcf2a-aa95-4972-913e-4d775e44110d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 200 len: 1393 microversion: 2.1 time: 1.347207 Aug 04 16:40:07.801371 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 746/1463] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:06 2022] GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 1393 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:07.808634 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bfcb834a-e680-4f81-bc30-7c57d1ef25db tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:07.810262 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bfcb834a-e680-4f81-bc30-7c57d1ef25db tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:07.829149 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bfcb834a-e680-4f81-bc30-7c57d1ef25db tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:07.829404 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a51429c4-f3bc-4598-85b0-1753aece7657 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:07.830627 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bfcb834a-e680-4f81-bc30-7c57d1ef25db tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:07.831695 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bfcb834a-e680-4f81-bc30-7c57d1ef25db tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:07.838214 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bfcb834a-e680-4f81-bc30-7c57d1ef25db tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:07.845156 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a51429c4-f3bc-4598-85b0-1753aece7657 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1476 microversion: 2.1 time: 1.057968 Aug 04 16:40:07.847680 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 718/1464] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:06 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1476 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:07.871377 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5a28a168-eb67-45fa-8990-00727659871d tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:07.873087 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5a28a168-eb67-45fa-8990-00727659871d tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] [instance: b1cd2844-77ab-41e5-82e5-a954081001f0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:07.902403 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a28a168-eb67-45fa-8990-00727659871d tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:07.905735 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a28a168-eb67-45fa-8990-00727659871d tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:07.909972 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a28a168-eb67-45fa-8990-00727659871d tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:07.912061 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a28a168-eb67-45fa-8990-00727659871d tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:08.173005 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bfcb834a-e680-4f81-bc30-7c57d1ef25db tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:08.190265 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bfcb834a-e680-4f81-bc30-7c57d1ef25db tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:08.194131 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bfcb834a-e680-4f81-bc30-7c57d1ef25db tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:08.207035 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bfcb834a-e680-4f81-bc30-7c57d1ef25db tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1185 microversion: 2.25 time: 0.403517 Aug 04 16:40:08.228875 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 747/1465] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:40:07 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1185 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:40:08.387263 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ae7681d7-dcb6-4ab5-b072-71c68e18cdab tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:40:08.398231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ae7681d7-dcb6-4ab5-b072-71c68e18cdab tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:08.428711 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:40:08.434387 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ae7681d7-dcb6-4ab5-b072-71c68e18cdab tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:08.440964 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ae7681d7-dcb6-4ab5-b072-71c68e18cdab tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:08.445328 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ae7681d7-dcb6-4ab5-b072-71c68e18cdab tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:08.450629 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ae7681d7-dcb6-4ab5-b072-71c68e18cdab tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:08.658474 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-ae7681d7-dcb6-4ab5-b072-71c68e18cdab tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lazy-loading 'flavor' on Instance uuid b0c83347-17c8-4872-ae95-36497fd7a727 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:40:08.804125 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5a28a168-eb67-45fa-8990-00727659871d tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:08.821170 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5a28a168-eb67-45fa-8990-00727659871d tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:08.831803 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5a28a168-eb67-45fa-8990-00727659871d tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:08.840844 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5a28a168-eb67-45fa-8990-00727659871d tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0" status: 200 len: 1358 microversion: 2.21 time: 0.981784 Aug 04 16:40:08.841727 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 719/1466] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:40:07 2022] GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0 => generated 1358 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:40:08.877944 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e8c9a9d1-553f-4e5d-b8a0-343025f38747 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:08.878609 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e8c9a9d1-553f-4e5d-b8a0-343025f38747 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:08.906716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e8c9a9d1-553f-4e5d-b8a0-343025f38747 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:08.907174 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e8c9a9d1-553f-4e5d-b8a0-343025f38747 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:08.907986 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e8c9a9d1-553f-4e5d-b8a0-343025f38747 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:08.908425 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e8c9a9d1-553f-4e5d-b8a0-343025f38747 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:09.212937 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ae7681d7-dcb6-4ab5-b072-71c68e18cdab tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "POST /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727/action" status: 200 len: 32 microversion: 2.1 time: 0.833083 Aug 04 16:40:09.221980 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 748/1467] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:40:08 2022] POST /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727/action => generated 32 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 16:40:09.242726 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d7701227-3ad0-4db5-8d23-32c66191be94 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:09.243502 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d7701227-3ad0-4db5-8d23-32c66191be94 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:09.296684 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d7701227-3ad0-4db5-8d23-32c66191be94 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:09.299692 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d7701227-3ad0-4db5-8d23-32c66191be94 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:09.308026 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d7701227-3ad0-4db5-8d23-32c66191be94 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:09.310938 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d7701227-3ad0-4db5-8d23-32c66191be94 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:10.214022 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e8c9a9d1-553f-4e5d-b8a0-343025f38747 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:10.227376 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e8c9a9d1-553f-4e5d-b8a0-343025f38747 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 200 len: 1393 microversion: 2.1 time: 1.371751 Aug 04 16:40:10.228052 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 720/1468] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:08 2022] GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 1393 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:10.250533 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c249d4cb-0d12-4777-b80e-10d116a7f00c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:10.262461 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c249d4cb-0d12-4777-b80e-10d116a7f00c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:10.270296 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c249d4cb-0d12-4777-b80e-10d116a7f00c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:10.271117 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c249d4cb-0d12-4777-b80e-10d116a7f00c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:10.273384 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c249d4cb-0d12-4777-b80e-10d116a7f00c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:10.274105 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c249d4cb-0d12-4777-b80e-10d116a7f00c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:10.671424 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d7701227-3ad0-4db5-8d23-32c66191be94 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:10.688859 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d7701227-3ad0-4db5-8d23-32c66191be94 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1476 microversion: 2.1 time: 1.451167 Aug 04 16:40:10.689579 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 749/1469] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:09 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1476 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:10.700525 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b36338b4-c0e3-4bea-ade6-8f47e4377589 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:10.711080 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b36338b4-c0e3-4bea-ade6-8f47e4377589 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:10.736105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b36338b4-c0e3-4bea-ade6-8f47e4377589 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:10.739399 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b36338b4-c0e3-4bea-ade6-8f47e4377589 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:10.740654 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b36338b4-c0e3-4bea-ade6-8f47e4377589 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:10.741865 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b36338b4-c0e3-4bea-ade6-8f47e4377589 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:11.200364 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b36338b4-c0e3-4bea-ade6-8f47e4377589 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:11.232076 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b36338b4-c0e3-4bea-ade6-8f47e4377589 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:11.253784 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b36338b4-c0e3-4bea-ade6-8f47e4377589 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:11.256875 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b36338b4-c0e3-4bea-ade6-8f47e4377589 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1251 microversion: 2.25 time: 0.565897 Aug 04 16:40:11.270421 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 750/1470] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:40:10 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1251 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:40:11.295532 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c42412db-3ea2-42bd-a22f-3bff706eae83 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:11.297299 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c42412db-3ea2-42bd-a22f-3bff706eae83 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] [instance: b1cd2844-77ab-41e5-82e5-a954081001f0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:11.324636 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c42412db-3ea2-42bd-a22f-3bff706eae83 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:11.339090 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c42412db-3ea2-42bd-a22f-3bff706eae83 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:11.340725 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c42412db-3ea2-42bd-a22f-3bff706eae83 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:11.342517 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c42412db-3ea2-42bd-a22f-3bff706eae83 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:11.558937 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c249d4cb-0d12-4777-b80e-10d116a7f00c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:11.573607 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c249d4cb-0d12-4777-b80e-10d116a7f00c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727" status: 200 len: 1735 microversion: 2.1 time: 1.326865 Aug 04 16:40:11.582720 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 721/1471] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:10 2022] GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727 => generated 1735 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:11.598238 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9fd1c974-0467-4c1f-bad3-705b4f5c2fb2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:11.605808 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9fd1c974-0467-4c1f-bad3-705b4f5c2fb2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:11.620755 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9fd1c974-0467-4c1f-bad3-705b4f5c2fb2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:11.621984 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9fd1c974-0467-4c1f-bad3-705b4f5c2fb2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:11.623067 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9fd1c974-0467-4c1f-bad3-705b4f5c2fb2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:11.624378 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9fd1c974-0467-4c1f-bad3-705b4f5c2fb2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:12.325081 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c42412db-3ea2-42bd-a22f-3bff706eae83 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:12.338523 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c42412db-3ea2-42bd-a22f-3bff706eae83 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:12.348180 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c42412db-3ea2-42bd-a22f-3bff706eae83 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:12.352519 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c42412db-3ea2-42bd-a22f-3bff706eae83 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0" status: 200 len: 1551 microversion: 2.21 time: 1.071489 Aug 04 16:40:12.361203 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 751/1472] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:40:11 2022] GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0 => generated 1551 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:40:12.380682 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-72c01496-dd5c-4834-8220-36265cff8e0e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:12.388475 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-72c01496-dd5c-4834-8220-36265cff8e0e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:12.406054 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-72c01496-dd5c-4834-8220-36265cff8e0e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:12.407534 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-72c01496-dd5c-4834-8220-36265cff8e0e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:12.410191 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-72c01496-dd5c-4834-8220-36265cff8e0e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:12.411114 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-72c01496-dd5c-4834-8220-36265cff8e0e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:13.027828 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9fd1c974-0467-4c1f-bad3-705b4f5c2fb2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:13.082196 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9fd1c974-0467-4c1f-bad3-705b4f5c2fb2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 200 len: 1393 microversion: 2.1 time: 1.484778 Aug 04 16:40:13.085572 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 722/1473] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:11 2022] GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 1393 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:13.117055 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-be168314-5163-4a33-9d8b-0b3e0b87f674 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:13.133971 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-be168314-5163-4a33-9d8b-0b3e0b87f674 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:13.150574 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be168314-5163-4a33-9d8b-0b3e0b87f674 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:13.174008 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be168314-5163-4a33-9d8b-0b3e0b87f674 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:13.175323 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be168314-5163-4a33-9d8b-0b3e0b87f674 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:13.176106 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be168314-5163-4a33-9d8b-0b3e0b87f674 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:13.717935 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-be168314-5163-4a33-9d8b-0b3e0b87f674 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:13.731571 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-72c01496-dd5c-4834-8220-36265cff8e0e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:13.741000 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-be168314-5163-4a33-9d8b-0b3e0b87f674 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:13.744653 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-72c01496-dd5c-4834-8220-36265cff8e0e tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1476 microversion: 2.1 time: 1.380980 Aug 04 16:40:13.745261 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 752/1474] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:12 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1476 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:13.747042 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-be168314-5163-4a33-9d8b-0b3e0b87f674 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:13.749996 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-be168314-5163-4a33-9d8b-0b3e0b87f674 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1251 microversion: 2.25 time: 0.649811 Aug 04 16:40:13.757718 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1246298c-1699-422c-816b-b943db75a0a6 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:13.759003 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1246298c-1699-422c-816b-b943db75a0a6 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] [instance: b1cd2844-77ab-41e5-82e5-a954081001f0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:13.762485 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 723/1475] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:40:13 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1251 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:40:13.772187 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1246298c-1699-422c-816b-b943db75a0a6 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:13.774771 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1246298c-1699-422c-816b-b943db75a0a6 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:13.777342 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1246298c-1699-422c-816b-b943db75a0a6 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:13.786734 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1246298c-1699-422c-816b-b943db75a0a6 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:13.791355 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9b0abb36-3bd5-4a77-b5e1-165b342066ad tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:13.792420 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9b0abb36-3bd5-4a77-b5e1-165b342066ad tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:13.804635 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9b0abb36-3bd5-4a77-b5e1-165b342066ad tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:13.805581 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9b0abb36-3bd5-4a77-b5e1-165b342066ad tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:13.807386 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9b0abb36-3bd5-4a77-b5e1-165b342066ad tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:13.808512 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9b0abb36-3bd5-4a77-b5e1-165b342066ad tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:13.839335 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1246298c-1699-422c-816b-b943db75a0a6 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] [instance: b1cd2844-77ab-41e5-82e5-a954081001f0] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:40:14.033555 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1246298c-1699-422c-816b-b943db75a0a6 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0" status: 204 len: 0 microversion: 2.21 time: 0.286759 Aug 04 16:40:14.045021 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 753/1476] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Aug 4 16:40:13 2022] DELETE /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 16:40:14.057055 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-487bedbc-9acd-4e96-ab89-c88ffe392c0a tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:14.061325 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-487bedbc-9acd-4e96-ab89-c88ffe392c0a tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] [instance: b1cd2844-77ab-41e5-82e5-a954081001f0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:14.081811 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-487bedbc-9acd-4e96-ab89-c88ffe392c0a tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:14.082263 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-487bedbc-9acd-4e96-ab89-c88ffe392c0a tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:14.083104 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-487bedbc-9acd-4e96-ab89-c88ffe392c0a tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:14.083579 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-487bedbc-9acd-4e96-ab89-c88ffe392c0a tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:14.797084 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:40:14.820490 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9b0abb36-3bd5-4a77-b5e1-165b342066ad tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:14.875203 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9b0abb36-3bd5-4a77-b5e1-165b342066ad tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727" status: 200 len: 1735 microversion: 2.1 time: 1.106740 Aug 04 16:40:14.882860 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 724/1477] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:13 2022] GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727 => generated 1735 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:14.908489 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-096d6929-c19b-4bb4-a51d-64a80564eb3e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:14.911300 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-096d6929-c19b-4bb4-a51d-64a80564eb3e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:14.934573 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:40:14.945769 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-487bedbc-9acd-4e96-ab89-c88ffe392c0a tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:14.967135 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-096d6929-c19b-4bb4-a51d-64a80564eb3e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:14.967677 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-096d6929-c19b-4bb4-a51d-64a80564eb3e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:14.970117 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-096d6929-c19b-4bb4-a51d-64a80564eb3e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:14.970559 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-096d6929-c19b-4bb4-a51d-64a80564eb3e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:14.972509 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-487bedbc-9acd-4e96-ab89-c88ffe392c0a tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:14.975913 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-487bedbc-9acd-4e96-ab89-c88ffe392c0a tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:14.984370 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-487bedbc-9acd-4e96-ab89-c88ffe392c0a tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0" status: 200 len: 1557 microversion: 2.21 time: 0.931020 Aug 04 16:40:14.986534 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 754/1478] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:40:14 2022] GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0 => generated 1557 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:40:15.252373 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5df7c5af-bd43-4aa5-bff8-9ec2bb0b9f15 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Action: 'create', calling method: .version_select at 0x7f7e84660430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-704475454", "description": "tempest-description-446539020"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:40:15.799664 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-096d6929-c19b-4bb4-a51d-64a80564eb3e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:15.824394 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-096d6929-c19b-4bb4-a51d-64a80564eb3e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 200 len: 1393 microversion: 2.1 time: 0.935761 Aug 04 16:40:15.825719 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 725/1479] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:14 2022] GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 1393 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:15.831739 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-86e6fa4b-cb6e-4e0e-88e8-ac5e726e4243 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:15.832635 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-86e6fa4b-cb6e-4e0e-88e8-ac5e726e4243 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:15.860316 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-86e6fa4b-cb6e-4e0e-88e8-ac5e726e4243 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:15.865586 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-86e6fa4b-cb6e-4e0e-88e8-ac5e726e4243 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:15.866890 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-86e6fa4b-cb6e-4e0e-88e8-ac5e726e4243 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:15.874280 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-86e6fa4b-cb6e-4e0e-88e8-ac5e726e4243 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:16.405713 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:40:17.276743 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5df7c5af-bd43-4aa5-bff8-9ec2bb0b9f15 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 2.284575 Aug 04 16:40:17.280710 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 755/1480] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Aug 4 16:40:14 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 2294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:40:17.293696 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9adaf74f-60ba-4497-b44f-d9209da1b7d2 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:17.294867 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9adaf74f-60ba-4497-b44f-d9209da1b7d2 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:17.391854 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9adaf74f-60ba-4497-b44f-d9209da1b7d2 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:17.393998 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9adaf74f-60ba-4497-b44f-d9209da1b7d2 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:17.399456 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9adaf74f-60ba-4497-b44f-d9209da1b7d2 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:17.400796 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9adaf74f-60ba-4497-b44f-d9209da1b7d2 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:17.494232 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-86e6fa4b-cb6e-4e0e-88e8-ac5e726e4243 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:17.535546 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=100 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:40:17.558803 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-86e6fa4b-cb6e-4e0e-88e8-ac5e726e4243 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1476 microversion: 2.1 time: 1.727805 Aug 04 16:40:17.566872 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 726/1481] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:15 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1476 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:17.601005 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-74bedc95-6175-4a76-9406-e4474cd4d586 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:17.610087 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-74bedc95-6175-4a76-9406-e4474cd4d586 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:17.632541 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-74bedc95-6175-4a76-9406-e4474cd4d586 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:17.642421 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-74bedc95-6175-4a76-9406-e4474cd4d586 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:17.643628 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-74bedc95-6175-4a76-9406-e4474cd4d586 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:17.650154 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-74bedc95-6175-4a76-9406-e4474cd4d586 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:18.485060 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9adaf74f-60ba-4497-b44f-d9209da1b7d2 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:18.499398 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9adaf74f-60ba-4497-b44f-d9209da1b7d2 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:18.504107 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9adaf74f-60ba-4497-b44f-d9209da1b7d2 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:18.509964 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9adaf74f-60ba-4497-b44f-d9209da1b7d2 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1293 microversion: 2.25 time: 1.227286 Aug 04 16:40:18.513189 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 756/1482] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:40:17 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1293 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:40:18.526876 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c3944157-75d4-4d64-97e8-d4471dca2b6e tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:18.528933 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c3944157-75d4-4d64-97e8-d4471dca2b6e tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] [instance: b1cd2844-77ab-41e5-82e5-a954081001f0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:18.551615 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3944157-75d4-4d64-97e8-d4471dca2b6e tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:18.552335 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3944157-75d4-4d64-97e8-d4471dca2b6e tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:18.553435 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3944157-75d4-4d64-97e8-d4471dca2b6e tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:18.555433 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3944157-75d4-4d64-97e8-d4471dca2b6e tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:18.578972 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-74bedc95-6175-4a76-9406-e4474cd4d586 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:18.626190 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-74bedc95-6175-4a76-9406-e4474cd4d586 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727" status: 200 len: 1735 microversion: 2.1 time: 1.055454 Aug 04 16:40:18.644029 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3944157-75d4-4d64-97e8-d4471dca2b6e tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:18.644362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3944157-75d4-4d64-97e8-d4471dca2b6e tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:18.645171 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-c3944157-75d4-4d64-97e8-d4471dca2b6e tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lazy-loading 'fault' on Instance uuid b1cd2844-77ab-41e5-82e5-a954081001f0 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:40:18.649832 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 727/1483] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:17 2022] GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727 => generated 1735 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:18.692094 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-72f5c7c2-4888-4373-b317-18330981e81f tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:18.693690 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-72f5c7c2-4888-4373-b317-18330981e81f tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:18.712342 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-72f5c7c2-4888-4373-b317-18330981e81f tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:18.713134 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-72f5c7c2-4888-4373-b317-18330981e81f tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:18.714604 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-72f5c7c2-4888-4373-b317-18330981e81f tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:18.721552 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-72f5c7c2-4888-4373-b317-18330981e81f tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:18.784089 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c3944157-75d4-4d64-97e8-d4471dca2b6e tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:18.793155 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c3944157-75d4-4d64-97e8-d4471dca2b6e tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:18.804443 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c3944157-75d4-4d64-97e8-d4471dca2b6e tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd289c1a9217f4edb967e8bc60a29ea4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c9f886e560427b9b2f4c46984e0c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:18.805928 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c3944157-75d4-4d64-97e8-d4471dca2b6e tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0" status: 200 len: 1348 microversion: 2.21 time: 0.291035 Aug 04 16:40:18.806547 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 757/1484] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:40:18 2022] GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0 => generated 1348 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:40:18.831772 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-72f74662-4a96-4192-8f31-66a0a7563aa1 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Action: 'create', calling method: .version_select at 0x7f7e8414d310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1924907579", "description": "tempest-description-1702523926"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:40:19.683813 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-72f5c7c2-4888-4373-b317-18330981e81f tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:19.747287 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-72f5c7c2-4888-4373-b317-18330981e81f tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 200 len: 1393 microversion: 2.1 time: 1.082811 Aug 04 16:40:19.753708 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 728/1485] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:18 2022] GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 1393 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:19.781061 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-9f9c8382-5ca5-41ab-8058-39ebfc362a79 req-604a84b0-0724-4f7f-ad4a-2166be82fead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1cd2844-77ab-41e5-82e5-a954081001f0", "name": "network-vif-deleted", "tag": "45ea1a02-cd11-4988-8894-26ea3b68e90a"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:40:19.841998 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-9f9c8382-5ca5-41ab-8058-39ebfc362a79 req-604a84b0-0724-4f7f-ad4a-2166be82fead service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:19.843814 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-9f9c8382-5ca5-41ab-8058-39ebfc362a79 req-604a84b0-0724-4f7f-ad4a-2166be82fead service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:19.873182 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-9f9c8382-5ca5-41ab-8058-39ebfc362a79 req-604a84b0-0724-4f7f-ad4a-2166be82fead service nova] Creating event network-vif-deleted:45ea1a02-cd11-4988-8894-26ea3b68e90a for instance b1cd2844-77ab-41e5-82e5-a954081001f0 on n-h1-846466-12 Aug 04 16:40:19.887055 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-9f9c8382-5ca5-41ab-8058-39ebfc362a79 req-604a84b0-0724-4f7f-ad4a-2166be82fead service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128803 Aug 04 16:40:19.888632 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 729/1486] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:40:19.905624 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-57b34dcd-4d78-49c7-9436-ba49536c6ae7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:19.909912 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-57b34dcd-4d78-49c7-9436-ba49536c6ae7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:19.935087 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-57b34dcd-4d78-49c7-9436-ba49536c6ae7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:19.940249 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-57b34dcd-4d78-49c7-9436-ba49536c6ae7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:19.942349 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-57b34dcd-4d78-49c7-9436-ba49536c6ae7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:19.943379 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-57b34dcd-4d78-49c7-9436-ba49536c6ae7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:20.610334 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-72f74662-4a96-4192-8f31-66a0a7563aa1 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.797998 Aug 04 16:40:20.611067 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 758/1487] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Aug 4 16:40:18 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:40:20.617706 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-605391f4-2d07-4109-99de-2e6c0ef1ba27 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:20.618337 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-605391f4-2d07-4109-99de-2e6c0ef1ba27 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:20.644222 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-605391f4-2d07-4109-99de-2e6c0ef1ba27 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:20.644720 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-605391f4-2d07-4109-99de-2e6c0ef1ba27 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:20.656948 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-605391f4-2d07-4109-99de-2e6c0ef1ba27 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:20.657533 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-605391f4-2d07-4109-99de-2e6c0ef1ba27 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:21.023857 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-57b34dcd-4d78-49c7-9436-ba49536c6ae7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:21.039338 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-57b34dcd-4d78-49c7-9436-ba49536c6ae7 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1475 microversion: 2.1 time: 1.147753 Aug 04 16:40:21.046292 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 730/1488] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:19 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1475 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:21.052695 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-63a539b2-579e-413b-a5bf-90b6f405ec0a tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:21.056404 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-63a539b2-579e-413b-a5bf-90b6f405ec0a tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:21.084206 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63a539b2-579e-413b-a5bf-90b6f405ec0a tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:21.084815 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63a539b2-579e-413b-a5bf-90b6f405ec0a tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:21.085940 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63a539b2-579e-413b-a5bf-90b6f405ec0a tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:21.098334 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63a539b2-579e-413b-a5bf-90b6f405ec0a tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:21.628881 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-605391f4-2d07-4109-99de-2e6c0ef1ba27 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:21.645321 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-63a539b2-579e-413b-a5bf-90b6f405ec0a tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:21.678329 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-63a539b2-579e-413b-a5bf-90b6f405ec0a tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727" status: 200 len: 1735 microversion: 2.1 time: 0.629055 Aug 04 16:40:21.681051 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-605391f4-2d07-4109-99de-2e6c0ef1ba27 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:21.683814 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 731/1489] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:21 2022] GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727 => generated 1735 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:21.696263 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-605391f4-2d07-4109-99de-2e6c0ef1ba27 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:21.699428 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-605391f4-2d07-4109-99de-2e6c0ef1ba27 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1293 microversion: 2.25 time: 1.087246 Aug 04 16:40:21.703598 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 759/1490] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:40:20 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1293 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:40:21.710150 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d9aa6f27-43b7-4d0f-a332-095539589c7f tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:21.713804 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d9aa6f27-43b7-4d0f-a332-095539589c7f tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] [instance: b1cd2844-77ab-41e5-82e5-a954081001f0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:21.735032 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c43544c7-403e-41df-b7bf-f5cc1fa7d69d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1712527712", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "e78934c4-9057-4f0d-9287-7793e16fb8f5"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:40:21.758344 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d9aa6f27-43b7-4d0f-a332-095539589c7f tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:21.759400 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d9aa6f27-43b7-4d0f-a332-095539589c7f tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:21.764241 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d9aa6f27-43b7-4d0f-a332-095539589c7f tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:21.770449 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d9aa6f27-43b7-4d0f-a332-095539589c7f tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:21.830676 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-d9aa6f27-43b7-4d0f-a332-095539589c7f tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] HTTP exception thrown: Instance b1cd2844-77ab-41e5-82e5-a954081001f0 could not be found. Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d9aa6f27-43b7-4d0f-a332-095539589c7f tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Request method failure captured: Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0 HTTP/1.1 Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_Y-zdGgPvRIu3PmrbNURUwIGISQ3l75Uy28Vvezi7uwiAFkXI8MI96hVwFvUoeVOwiNWf2mCY3egF6G01uja055qyqAcWGHY8nctK9X9kKpzrbQpoN-aFJDMWZiOO-em_tGx2btfm8NnWP9VKRD4OXG05VdNFEb5kvy_oQy8m0UBq8 Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: X-Openstack-Nova-Api-Version: 2.21 Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 96c9f886e560427b9b2f4c46984e0c2c Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-InstanceActionsV221TestJSON-767339296 Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96c9f886e560427b9b2f4c46984e0c2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_96c9f886e560427b9b2f4c46984e0c2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96c9f886e560427b9b2f4c46984e0c2c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/96c9f886e560427b9b2f4c46984e0c2c"}]}] Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-InstanceActionsV221TestJSON-767339296 Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 96c9f886e560427b9b2f4c46984e0c2c Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-767339296 Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-InstanceActionsV221TestJSON-767339296-project Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: d289c1a9217f4edb967e8bc60a29ea4e Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-InstanceActionsV221TestJSON-767339296-project Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance b1cd2844-77ab-41e5-82e5-a954081001f0 could not be found. Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'b1cd2844-77ab-41e5-82e5-a954081001f0'} Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1cd2844-77ab-41e5-82e5-a954081001f0 could not be found. Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1cd2844-77ab-41e5-82e5-a954081001f0 could not be found. Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:40:21.847095 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:40:21.856705 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:40:21.856705 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:40:21.856705 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:40:21.856705 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:40:21.856705 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:40:21.856705 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:40:21.856705 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1cd2844-77ab-41e5-82e5-a954081001f0 could not be found. Aug 04 16:40:21.856705 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:40:21.879268 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d9aa6f27-43b7-4d0f-a332-095539589c7f tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Returning 404 to user: Instance b1cd2844-77ab-41e5-82e5-a954081001f0 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:40:21.882032 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d9aa6f27-43b7-4d0f-a332-095539589c7f tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0" status: 404 len: 111 microversion: 2.21 time: 0.189438 Aug 04 16:40:21.883744 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 732/1491] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:40:21 2022] GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0 => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:40:21.919386 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c3924e79-ad80-4ccd-b427-3066113111c2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:21.927952 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c3924e79-ad80-4ccd-b427-3066113111c2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:21.962038 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c3924e79-ad80-4ccd-b427-3066113111c2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:21.962976 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c3924e79-ad80-4ccd-b427-3066113111c2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:21.973852 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c3924e79-ad80-4ccd-b427-3066113111c2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:21.975473 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-c43544c7-403e-41df-b7bf-f5cc1fa7d69d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] validate_networks() for [('e78934c4-9057-4f0d-9287-7793e16fb8f5', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:40:21.978146 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c3924e79-ad80-4ccd-b427-3066113111c2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:22.776552 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c3924e79-ad80-4ccd-b427-3066113111c2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:22.793399 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c3924e79-ad80-4ccd-b427-3066113111c2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 200 len: 1393 microversion: 2.1 time: 0.907711 Aug 04 16:40:22.800228 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 733/1492] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:21 2022] GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 1393 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:22.820077 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-078938ef-81c1-4f21-bff4-6ef5a5e5e570 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Calling method '.version_select at 0x7f7e84a99f70>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:22.820713 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-078938ef-81c1-4f21-bff4-6ef5a5e5e570 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] [instance: b1cd2844-77ab-41e5-82e5-a954081001f0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:22.846691 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-078938ef-81c1-4f21-bff4-6ef5a5e5e570 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:22.847158 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-078938ef-81c1-4f21-bff4-6ef5a5e5e570 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:22.848137 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-078938ef-81c1-4f21-bff4-6ef5a5e5e570 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:22.848588 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-078938ef-81c1-4f21-bff4-6ef5a5e5e570 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:23.160989 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-078938ef-81c1-4f21-bff4-6ef5a5e5e570 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.360700 Aug 04 16:40:23.162443 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 734/1493] 10.222.0.23 () {60 vars in 1337 bytes} [Thu Aug 4 16:40:22 2022] GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0/os-instance-actions => generated 611 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:40:23.177476 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-02ff6f92-2582-4363-b23a-14f3da18cbdc req-29aff4e6-8594-4e33-a217-3c5c0ea79d47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dfa867e-8758-47d0-9256-3c864b36e819", "tag": "251fa64f-5224-48c2-a585-f6377c372e04"}, {"server_uuid": "89ab07c4-6179-48f5-9ac4-053c6070ed42", "name": "network-vif-unplugged", "status": "completed", "tag": "ffbb5a20-fa64-4e0b-8e0b-f2163a520c8f"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:40:23.203514 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-02ff6f92-2582-4363-b23a-14f3da18cbdc req-29aff4e6-8594-4e33-a217-3c5c0ea79d47 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:23.217753 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-02ff6f92-2582-4363-b23a-14f3da18cbdc req-29aff4e6-8594-4e33-a217-3c5c0ea79d47 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:23.255053 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-02ff6f92-2582-4363-b23a-14f3da18cbdc req-29aff4e6-8594-4e33-a217-3c5c0ea79d47 service nova] Creating event network-changed:251fa64f-5224-48c2-a585-f6377c372e04 for instance 3dfa867e-8758-47d0-9256-3c864b36e819 on n-h1-846466-12 Aug 04 16:40:23.257730 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-02ff6f92-2582-4363-b23a-14f3da18cbdc req-29aff4e6-8594-4e33-a217-3c5c0ea79d47 service nova] Creating event network-vif-unplugged:ffbb5a20-fa64-4e0b-8e0b-f2163a520c8f for instance 89ab07c4-6179-48f5-9ac4-053c6070ed42 on n-h1-846466-12 Aug 04 16:40:23.271824 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [req-02ff6f92-2582-4363-b23a-14f3da18cbdc req-29aff4e6-8594-4e33-a217-3c5c0ea79d47 service nova] Instance 89ab07c4-6179-48f5-9ac4-053c6070ed42 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126126) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 16:40:23.303737 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-02ff6f92-2582-4363-b23a-14f3da18cbdc req-29aff4e6-8594-4e33-a217-3c5c0ea79d47 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.139089 Aug 04 16:40:23.308116 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 735/1494] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:40:23.335257 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-801acb93-4d6a-41cb-8c3c-fb7ec44a00ed tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:23.347996 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-801acb93-4d6a-41cb-8c3c-fb7ec44a00ed tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:23.378945 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-801acb93-4d6a-41cb-8c3c-fb7ec44a00ed tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:23.379949 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-801acb93-4d6a-41cb-8c3c-fb7ec44a00ed tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:23.383694 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-801acb93-4d6a-41cb-8c3c-fb7ec44a00ed tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:23.384643 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-801acb93-4d6a-41cb-8c3c-fb7ec44a00ed tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:25.737247 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-801acb93-4d6a-41cb-8c3c-fb7ec44a00ed tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:25.750923 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-801acb93-4d6a-41cb-8c3c-fb7ec44a00ed tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1475 microversion: 2.1 time: 2.439068 Aug 04 16:40:25.752017 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 736/1495] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:23 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1475 bytes in 2443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:25.759473 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8aee5c16-1d38-464a-b460-c00408069843 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:25.760568 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8aee5c16-1d38-464a-b460-c00408069843 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:25.770116 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8aee5c16-1d38-464a-b460-c00408069843 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:25.770841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8aee5c16-1d38-464a-b460-c00408069843 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:25.772283 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8aee5c16-1d38-464a-b460-c00408069843 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:25.773023 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8aee5c16-1d38-464a-b460-c00408069843 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:26.242627 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-c43544c7-403e-41df-b7bf-f5cc1fa7d69d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:40:26.244702 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-c43544c7-403e-41df-b7bf-f5cc1fa7d69d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:40:26.246446 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-c43544c7-403e-41df-b7bf-f5cc1fa7d69d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:40:26.247811 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-c43544c7-403e-41df-b7bf-f5cc1fa7d69d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:40:26.251048 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-c43544c7-403e-41df-b7bf-f5cc1fa7d69d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:40:26.324581 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c43544c7-403e-41df-b7bf-f5cc1fa7d69d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:26.325389 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c43544c7-403e-41df-b7bf-f5cc1fa7d69d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:26.326995 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c43544c7-403e-41df-b7bf-f5cc1fa7d69d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:26.328068 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c43544c7-403e-41df-b7bf-f5cc1fa7d69d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:26.376712 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:40:26.426374 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-c43544c7-403e-41df-b7bf-f5cc1fa7d69d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Getting quotas for project eb25e78b70ee48c99471d78e00e5949c. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:40:26.459791 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-c43544c7-403e-41df-b7bf-f5cc1fa7d69d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Getting quotas for user 23cc8f30e1f94ff0a520a071e5d81728 and project eb25e78b70ee48c99471d78e00e5949c. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:40:26.520325 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c43544c7-403e-41df-b7bf-f5cc1fa7d69d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:40:26.538336 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c43544c7-403e-41df-b7bf-f5cc1fa7d69d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: 95a1d0a6-3d88-4b0d-ba60-b1972539d2bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:40:26.723860 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c43544c7-403e-41df-b7bf-f5cc1fa7d69d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.016130 Aug 04 16:40:26.730864 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 760/1496] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:40:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 5024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:40:26.744567 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9bf10294-2847-450d-8276-3a1ac829c87c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:26.745708 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9bf10294-2847-450d-8276-3a1ac829c87c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:26.764790 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9bf10294-2847-450d-8276-3a1ac829c87c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:26.817470 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9bf10294-2847-450d-8276-3a1ac829c87c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:26.818880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9bf10294-2847-450d-8276-3a1ac829c87c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:26.819322 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9bf10294-2847-450d-8276-3a1ac829c87c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:26.914520 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8aee5c16-1d38-464a-b460-c00408069843 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:26.923944 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8aee5c16-1d38-464a-b460-c00408069843 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727" status: 200 len: 1735 microversion: 2.1 time: 1.170526 Aug 04 16:40:26.928311 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 737/1497] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:25 2022] GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727 => generated 1735 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:26.933887 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-6d66c488-81dd-42a3-b161-892b980db9f7 req-e7c77f11-5bab-4534-8f45-344cec1061a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "637703de-2520-4512-bf57-9b811b7769d4", "name": "network-vif-unplugged", "status": "completed", "tag": "1568bcc2-0017-4817-883a-43e4096677ac"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:40:26.973829 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-6d66c488-81dd-42a3-b161-892b980db9f7 req-e7c77f11-5bab-4534-8f45-344cec1061a8 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:26.974416 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-6d66c488-81dd-42a3-b161-892b980db9f7 req-e7c77f11-5bab-4534-8f45-344cec1061a8 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:27.013790 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-6d66c488-81dd-42a3-b161-892b980db9f7 req-e7c77f11-5bab-4534-8f45-344cec1061a8 service nova] Creating event network-vif-unplugged:1568bcc2-0017-4817-883a-43e4096677ac for instance 637703de-2520-4512-bf57-9b811b7769d4 on n-h2-846466-12 Aug 04 16:40:27.026266 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-6d66c488-81dd-42a3-b161-892b980db9f7 req-e7c77f11-5bab-4534-8f45-344cec1061a8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092952 Aug 04 16:40:27.027814 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 738/1498] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:40:27.042667 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d852d000-1c15-4598-a6ba-33edcc901cdd tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:27.044698 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d852d000-1c15-4598-a6ba-33edcc901cdd tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] [instance: b1cd2844-77ab-41e5-82e5-a954081001f0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:27.064075 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d852d000-1c15-4598-a6ba-33edcc901cdd tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:27.065647 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d852d000-1c15-4598-a6ba-33edcc901cdd tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:27.066791 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d852d000-1c15-4598-a6ba-33edcc901cdd tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:27.070650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d852d000-1c15-4598-a6ba-33edcc901cdd tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:27.126283 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-d852d000-1c15-4598-a6ba-33edcc901cdd tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] HTTP exception thrown: Instance b1cd2844-77ab-41e5-82e5-a954081001f0 could not be found. Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d852d000-1c15-4598-a6ba-33edcc901cdd tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Request method failure captured: Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0 HTTP/1.1 Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_Y-zdGgPvRIu3PmrbNURUwIGISQ3l75Uy28Vvezi7uwiAFkXI8MI96hVwFvUoeVOwiNWf2mCY3egF6G01uja055qyqAcWGHY8nctK9X9kKpzrbQpoN-aFJDMWZiOO-em_tGx2btfm8NnWP9VKRD4OXG05VdNFEb5kvy_oQy8m0UBq8 Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: X-Openstack-Nova-Api-Version: 2.21 Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 96c9f886e560427b9b2f4c46984e0c2c Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-InstanceActionsV221TestJSON-767339296 Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96c9f886e560427b9b2f4c46984e0c2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_96c9f886e560427b9b2f4c46984e0c2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96c9f886e560427b9b2f4c46984e0c2c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/96c9f886e560427b9b2f4c46984e0c2c"}]}] Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-InstanceActionsV221TestJSON-767339296 Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 96c9f886e560427b9b2f4c46984e0c2c Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-767339296 Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-InstanceActionsV221TestJSON-767339296-project Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: d289c1a9217f4edb967e8bc60a29ea4e Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-InstanceActionsV221TestJSON-767339296-project Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance b1cd2844-77ab-41e5-82e5-a954081001f0 could not be found. Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'b1cd2844-77ab-41e5-82e5-a954081001f0'} Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1cd2844-77ab-41e5-82e5-a954081001f0 could not be found. Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:40:27.128018 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:40:27.138756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1cd2844-77ab-41e5-82e5-a954081001f0 could not be found. Aug 04 16:40:27.138756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:40:27.138756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:40:27.138756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:40:27.138756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:40:27.138756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:40:27.138756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:40:27.138756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:40:27.138756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:40:27.138756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1cd2844-77ab-41e5-82e5-a954081001f0 could not be found. Aug 04 16:40:27.138756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:40:27.138756 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d852d000-1c15-4598-a6ba-33edcc901cdd tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Returning 404 to user: Instance b1cd2844-77ab-41e5-82e5-a954081001f0 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:40:27.138756 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d852d000-1c15-4598-a6ba-33edcc901cdd tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0" status: 404 len: 111 microversion: 2.21 time: 0.100464 Aug 04 16:40:27.138756 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 739/1499] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Aug 4 16:40:27 2022] DELETE /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:40:27.149565 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-140f2b9c-806a-45ac-85d3-1ac63d97ebf4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:27.150292 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-140f2b9c-806a-45ac-85d3-1ac63d97ebf4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:27.168347 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-140f2b9c-806a-45ac-85d3-1ac63d97ebf4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:27.168809 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-140f2b9c-806a-45ac-85d3-1ac63d97ebf4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:27.169651 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-140f2b9c-806a-45ac-85d3-1ac63d97ebf4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:27.170099 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-140f2b9c-806a-45ac-85d3-1ac63d97ebf4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:27.907611 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9bf10294-2847-450d-8276-3a1ac829c87c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:27.943569 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9bf10294-2847-450d-8276-3a1ac829c87c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:27.985792 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9bf10294-2847-450d-8276-3a1ac829c87c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:27.991022 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9bf10294-2847-450d-8276-3a1ac829c87c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1281 microversion: 2.25 time: 1.254903 Aug 04 16:40:27.992557 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 761/1500] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:40:26 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1281 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:40:28.038360 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-9a571b79-a20d-4ea5-9eb3-c2c7f0316155 req-4e711c03-64b2-4608-a1cb-1c50ec022285 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89ab07c4-6179-48f5-9ac4-053c6070ed42", "tag": "ffbb5a20-fa64-4e0b-8e0b-f2163a520c8f"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:40:28.082813 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-9a571b79-a20d-4ea5-9eb3-c2c7f0316155 req-4e711c03-64b2-4608-a1cb-1c50ec022285 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:28.085257 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-9a571b79-a20d-4ea5-9eb3-c2c7f0316155 req-4e711c03-64b2-4608-a1cb-1c50ec022285 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:28.130559 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-9a571b79-a20d-4ea5-9eb3-c2c7f0316155 req-4e711c03-64b2-4608-a1cb-1c50ec022285 service nova] Creating event network-changed:ffbb5a20-fa64-4e0b-8e0b-f2163a520c8f for instance 89ab07c4-6179-48f5-9ac4-053c6070ed42 on n-h1-846466-12 Aug 04 16:40:28.147112 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [req-9a571b79-a20d-4ea5-9eb3-c2c7f0316155 req-4e711c03-64b2-4608-a1cb-1c50ec022285 service nova] Instance 89ab07c4-6179-48f5-9ac4-053c6070ed42 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 16:40:28.218324 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-9a571b79-a20d-4ea5-9eb3-c2c7f0316155 req-4e711c03-64b2-4608-a1cb-1c50ec022285 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193090 Aug 04 16:40:28.224831 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 762/1501] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:40:28.253079 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6dac3b4f-612b-4354-916e-e7ae2f4e7b20 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:28.254856 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6dac3b4f-612b-4354-916e-e7ae2f4e7b20 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: 95a1d0a6-3d88-4b0d-ba60-b1972539d2bd] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:28.285359 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6dac3b4f-612b-4354-916e-e7ae2f4e7b20 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:28.287429 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-140f2b9c-806a-45ac-85d3-1ac63d97ebf4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:28.288894 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6dac3b4f-612b-4354-916e-e7ae2f4e7b20 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:28.290771 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6dac3b4f-612b-4354-916e-e7ae2f4e7b20 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:28.297314 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-140f2b9c-806a-45ac-85d3-1ac63d97ebf4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 200 len: 1393 microversion: 2.1 time: 1.160380 Aug 04 16:40:28.300088 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6dac3b4f-612b-4354-916e-e7ae2f4e7b20 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:28.306025 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 740/1502] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:27 2022] GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 1393 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:28.316319 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-473dadc0-3da2-4692-895c-7ab04a9cf65a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:28.323754 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-473dadc0-3da2-4692-895c-7ab04a9cf65a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:28.342411 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-473dadc0-3da2-4692-895c-7ab04a9cf65a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:28.343604 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-473dadc0-3da2-4692-895c-7ab04a9cf65a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:28.354583 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-473dadc0-3da2-4692-895c-7ab04a9cf65a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:28.359824 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-473dadc0-3da2-4692-895c-7ab04a9cf65a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:28.807410 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6dac3b4f-612b-4354-916e-e7ae2f4e7b20 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23cc8f30e1f94ff0a520a071e5d81728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb25e78b70ee48c99471d78e00e5949c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:28.871374 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6dac3b4f-612b-4354-916e-e7ae2f4e7b20 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd" status: 200 len: 1212 microversion: 2.1 time: 0.622276 Aug 04 16:40:28.872552 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 763/1503] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:28 2022] GET /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd => generated 1212 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:28.938032 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e709e228-69df-4b5d-8417-b39bc11e2c44 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:28.939930 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e709e228-69df-4b5d-8417-b39bc11e2c44 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] [instance: b1cd2844-77ab-41e5-82e5-a954081001f0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:28.974103 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e709e228-69df-4b5d-8417-b39bc11e2c44 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:28.977437 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e709e228-69df-4b5d-8417-b39bc11e2c44 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:28.978615 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e709e228-69df-4b5d-8417-b39bc11e2c44 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:28.979230 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e709e228-69df-4b5d-8417-b39bc11e2c44 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:29.050619 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-e709e228-69df-4b5d-8417-b39bc11e2c44 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] HTTP exception thrown: Instance b1cd2844-77ab-41e5-82e5-a954081001f0 could not be found. Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e709e228-69df-4b5d-8417-b39bc11e2c44 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Request method failure captured: Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0 HTTP/1.1 Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_Y-zdGgPvRIu3PmrbNURUwIGISQ3l75Uy28Vvezi7uwiAFkXI8MI96hVwFvUoeVOwiNWf2mCY3egF6G01uja055qyqAcWGHY8nctK9X9kKpzrbQpoN-aFJDMWZiOO-em_tGx2btfm8NnWP9VKRD4OXG05VdNFEb5kvy_oQy8m0UBq8 Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: X-Openstack-Nova-Api-Version: 2.21 Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 96c9f886e560427b9b2f4c46984e0c2c Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-InstanceActionsV221TestJSON-767339296 Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96c9f886e560427b9b2f4c46984e0c2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_96c9f886e560427b9b2f4c46984e0c2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96c9f886e560427b9b2f4c46984e0c2c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/96c9f886e560427b9b2f4c46984e0c2c"}]}] Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-InstanceActionsV221TestJSON-767339296 Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 96c9f886e560427b9b2f4c46984e0c2c Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-767339296 Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-InstanceActionsV221TestJSON-767339296-project Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: d289c1a9217f4edb967e8bc60a29ea4e Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-InstanceActionsV221TestJSON-767339296-project Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance b1cd2844-77ab-41e5-82e5-a954081001f0 could not be found. Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'b1cd2844-77ab-41e5-82e5-a954081001f0'} Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1cd2844-77ab-41e5-82e5-a954081001f0 could not be found. Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1cd2844-77ab-41e5-82e5-a954081001f0 could not be found. Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:40:29.057448 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:40:29.068154 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:40:29.068154 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:40:29.068154 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:40:29.068154 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:40:29.068154 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:40:29.068154 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:40:29.068154 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1cd2844-77ab-41e5-82e5-a954081001f0 could not be found. Aug 04 16:40:29.068154 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:40:29.068154 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e709e228-69df-4b5d-8417-b39bc11e2c44 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] Returning 404 to user: Instance b1cd2844-77ab-41e5-82e5-a954081001f0 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:40:29.071448 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e709e228-69df-4b5d-8417-b39bc11e2c44 tempest-InstanceActionsV221TestJSON-767339296 tempest-InstanceActionsV221TestJSON-767339296-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0" status: 404 len: 111 microversion: 2.21 time: 0.161859 Aug 04 16:40:29.077487 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 764/1504] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:40:28 2022] GET /compute/v2.1/servers/b1cd2844-77ab-41e5-82e5-a954081001f0 => generated 111 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:40:29.088179 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bf37e7bd-5596-4cd8-bad3-47fe527985e7 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:29.089920 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bf37e7bd-5596-4cd8-bad3-47fe527985e7 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:29.113546 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf37e7bd-5596-4cd8-bad3-47fe527985e7 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:29.117815 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf37e7bd-5596-4cd8-bad3-47fe527985e7 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:29.119182 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf37e7bd-5596-4cd8-bad3-47fe527985e7 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:29.125878 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf37e7bd-5596-4cd8-bad3-47fe527985e7 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:29.448442 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-473dadc0-3da2-4692-895c-7ab04a9cf65a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:29.458934 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-473dadc0-3da2-4692-895c-7ab04a9cf65a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1475 microversion: 2.1 time: 1.150727 Aug 04 16:40:29.474741 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 741/1505] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:28 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1475 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:29.480593 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d5a0f334-a126-4f03-81b4-5d613a109a7b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:29.481503 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d5a0f334-a126-4f03-81b4-5d613a109a7b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:29.488805 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d5a0f334-a126-4f03-81b4-5d613a109a7b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:29.495193 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d5a0f334-a126-4f03-81b4-5d613a109a7b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:29.497751 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d5a0f334-a126-4f03-81b4-5d613a109a7b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:29.506572 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d5a0f334-a126-4f03-81b4-5d613a109a7b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:30.369960 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bf37e7bd-5596-4cd8-bad3-47fe527985e7 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:30.386674 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bf37e7bd-5596-4cd8-bad3-47fe527985e7 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727" status: 200 len: 1735 microversion: 2.1 time: 1.304084 Aug 04 16:40:30.387645 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 765/1506] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:29 2022] GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727 => generated 1735 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:30.399021 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1b98db8b-c368-42cc-9e99-fdf37bf3a085 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:30.400149 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1b98db8b-c368-42cc-9e99-fdf37bf3a085 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:30.414553 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1b98db8b-c368-42cc-9e99-fdf37bf3a085 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:30.419147 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1b98db8b-c368-42cc-9e99-fdf37bf3a085 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:30.420553 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1b98db8b-c368-42cc-9e99-fdf37bf3a085 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:30.421423 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1b98db8b-c368-42cc-9e99-fdf37bf3a085 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:30.736645 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d5a0f334-a126-4f03-81b4-5d613a109a7b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:30.752540 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d5a0f334-a126-4f03-81b4-5d613a109a7b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:30.766484 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d5a0f334-a126-4f03-81b4-5d613a109a7b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:30.772004 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d5a0f334-a126-4f03-81b4-5d613a109a7b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1281 microversion: 2.25 time: 1.295681 Aug 04 16:40:30.780690 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 742/1507] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:40:29 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1281 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:40:30.806043 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-a9d58ed8-e530-46ee-884c-e85016b71965 req-0ef377cc-100e-48f0-8007-1edc9c6d2ec3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "637703de-2520-4512-bf57-9b811b7769d4", "tag": "1568bcc2-0017-4817-883a-43e4096677ac"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:40:30.823716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a9d58ed8-e530-46ee-884c-e85016b71965 req-0ef377cc-100e-48f0-8007-1edc9c6d2ec3 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:30.824315 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a9d58ed8-e530-46ee-884c-e85016b71965 req-0ef377cc-100e-48f0-8007-1edc9c6d2ec3 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:30.848512 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-a9d58ed8-e530-46ee-884c-e85016b71965 req-0ef377cc-100e-48f0-8007-1edc9c6d2ec3 service nova] Creating event network-changed:1568bcc2-0017-4817-883a-43e4096677ac for instance 637703de-2520-4512-bf57-9b811b7769d4 on n-h2-846466-12 Aug 04 16:40:30.870114 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-a9d58ed8-e530-46ee-884c-e85016b71965 req-0ef377cc-100e-48f0-8007-1edc9c6d2ec3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086141 Aug 04 16:40:30.875294 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 743/1508] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:40:30.900147 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4bb0b2b5-b525-4dbf-a417-54bb87cdf88f tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:30.907433 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4bb0b2b5-b525-4dbf-a417-54bb87cdf88f tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: 95a1d0a6-3d88-4b0d-ba60-b1972539d2bd] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:30.933038 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4bb0b2b5-b525-4dbf-a417-54bb87cdf88f tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:30.933724 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4bb0b2b5-b525-4dbf-a417-54bb87cdf88f tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:30.935713 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4bb0b2b5-b525-4dbf-a417-54bb87cdf88f tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:30.939128 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4bb0b2b5-b525-4dbf-a417-54bb87cdf88f tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:31.232891 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4bb0b2b5-b525-4dbf-a417-54bb87cdf88f tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23cc8f30e1f94ff0a520a071e5d81728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb25e78b70ee48c99471d78e00e5949c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:31.272992 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4bb0b2b5-b525-4dbf-a417-54bb87cdf88f tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd" status: 200 len: 1274 microversion: 2.1 time: 0.394949 Aug 04 16:40:31.278032 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 744/1509] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:30 2022] GET /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd => generated 1274 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:31.287942 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4c622a33-396c-4f03-bc89-1a9b33ed5974 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:31.289772 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4c622a33-396c-4f03-bc89-1a9b33ed5974 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:31.303739 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4c622a33-396c-4f03-bc89-1a9b33ed5974 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:31.306330 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4c622a33-396c-4f03-bc89-1a9b33ed5974 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:31.309356 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4c622a33-396c-4f03-bc89-1a9b33ed5974 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:31.310503 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4c622a33-396c-4f03-bc89-1a9b33ed5974 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:31.378597 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1b98db8b-c368-42cc-9e99-fdf37bf3a085 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:31.390275 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1b98db8b-c368-42cc-9e99-fdf37bf3a085 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 200 len: 1393 microversion: 2.1 time: 1.001194 Aug 04 16:40:31.395571 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 766/1510] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:30 2022] GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 1393 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:31.403458 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1cb37800-c00b-4b10-bb94-c81d6aa1669f tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Action: 'create', calling method: .version_select at 0x7f7e845fdf70>, body: {"keypair": {"name": "tempest-keypair-1046115166", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGjDAInFmAdTZXjelIGawPhIbU6fN6NIlCkSloZlCMuOQolXhCgKC7vuL+NO34UjvOcNFTbzoRKGFwYyGQuLrzZXfPLlx2ZdhQDSFXFBg5c4fAFuHcAqi2RjiHOMaPJfA=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:40:31.455130 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-1cb37800-c00b-4b10-bb94-c81d6aa1669f tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Getting quotas for project 6bfc77ffb53d4f53b5afc9d0b6313cf5. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:40:31.476036 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-1cb37800-c00b-4b10-bb94-c81d6aa1669f tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Getting quotas for user 5d3d49f848ba4735a2ed7b077d6789d5 and project 6bfc77ffb53d4f53b5afc9d0b6313cf5. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:40:31.530548 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1cb37800-c00b-4b10-bb94-c81d6aa1669f tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.133404 Aug 04 16:40:31.531438 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 767/1511] 10.222.0.23 () {62 vars in 1200 bytes} [Thu Aug 4 16:40:31 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 135 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 16:40:31.540434 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6b594976-3a5c-4310-8c92-446ae9aa3dbd tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:31.545815 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6b594976-3a5c-4310-8c92-446ae9aa3dbd tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:31.557411 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6b594976-3a5c-4310-8c92-446ae9aa3dbd tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:31.558193 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6b594976-3a5c-4310-8c92-446ae9aa3dbd tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:31.559215 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6b594976-3a5c-4310-8c92-446ae9aa3dbd tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:31.559839 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6b594976-3a5c-4310-8c92-446ae9aa3dbd tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:33.125342 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6b594976-3a5c-4310-8c92-446ae9aa3dbd tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:33.128135 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4c622a33-396c-4f03-bc89-1a9b33ed5974 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:33.150739 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4c622a33-396c-4f03-bc89-1a9b33ed5974 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1473 microversion: 2.1 time: 1.870606 Aug 04 16:40:33.152851 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 745/1512] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:31 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1473 bytes in 1874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:33.167024 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6b594976-3a5c-4310-8c92-446ae9aa3dbd tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727" status: 200 len: 1735 microversion: 2.1 time: 1.633046 Aug 04 16:40:33.168303 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 768/1513] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:31 2022] GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727 => generated 1735 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:33.179373 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1fb5ae85-671d-4cd5-b102-443173784223 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:33.180000 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1fb5ae85-671d-4cd5-b102-443173784223 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:33.195015 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1fb5ae85-671d-4cd5-b102-443173784223 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:33.195467 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1fb5ae85-671d-4cd5-b102-443173784223 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:33.196268 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1fb5ae85-671d-4cd5-b102-443173784223 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:33.196705 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1fb5ae85-671d-4cd5-b102-443173784223 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:33.232925 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3e9ec127-9dd9-420a-8f22-c11f0acecf7f tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Action: 'create', calling method: .version_select at 0x7f7e84522820>, body: {"keypair": {"name": "tempest-keypair-342563486", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnnQx8F+EnsmIsLlKmAakIVubRdJseO6qVK5cfY5K7xlqbDfciKJEM+/bZgqnWB6gqGQ3kEJnFTsuXJJJ+wKVKk4mNxSYPRtOMcaZ79hMA97MSjUiktEZzc5tUpCsO3HQ=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:40:33.252881 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-3e9ec127-9dd9-420a-8f22-c11f0acecf7f tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Getting quotas for project 547b33a8f5a344f788da917f3512be5f. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:40:33.259629 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-3e9ec127-9dd9-420a-8f22-c11f0acecf7f tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Getting quotas for user d3cd7076f4514ee89b0c4b2a586fe69e and project 547b33a8f5a344f788da917f3512be5f. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:40:33.306233 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3e9ec127-9dd9-420a-8f22-c11f0acecf7f tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.136068 Aug 04 16:40:33.316314 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 769/1514] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 16:40:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:40:33.328722 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4b3985a5-fc2c-4b05-b8b9-6e33fd5b452c tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:33.331632 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4b3985a5-fc2c-4b05-b8b9-6e33fd5b452c tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: 95a1d0a6-3d88-4b0d-ba60-b1972539d2bd] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:33.342271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4b3985a5-fc2c-4b05-b8b9-6e33fd5b452c tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:33.343637 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4b3985a5-fc2c-4b05-b8b9-6e33fd5b452c tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:33.344859 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4b3985a5-fc2c-4b05-b8b9-6e33fd5b452c tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:33.345880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4b3985a5-fc2c-4b05-b8b9-6e33fd5b452c tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:33.642611 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4b3985a5-fc2c-4b05-b8b9-6e33fd5b452c tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23cc8f30e1f94ff0a520a071e5d81728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb25e78b70ee48c99471d78e00e5949c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:33.671643 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4b3985a5-fc2c-4b05-b8b9-6e33fd5b452c tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd" status: 200 len: 1274 microversion: 2.1 time: 0.359436 Aug 04 16:40:33.677861 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 770/1515] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:33 2022] GET /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd => generated 1274 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:33.689832 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-31aec391-4683-458b-a9ab-21bb8f9425a2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:33.690824 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-31aec391-4683-458b-a9ab-21bb8f9425a2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:33.706890 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-31aec391-4683-458b-a9ab-21bb8f9425a2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:33.707843 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-31aec391-4683-458b-a9ab-21bb8f9425a2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:33.708869 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-31aec391-4683-458b-a9ab-21bb8f9425a2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:33.709747 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-31aec391-4683-458b-a9ab-21bb8f9425a2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:34.028123 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1fb5ae85-671d-4cd5-b102-443173784223 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:34.076657 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1fb5ae85-671d-4cd5-b102-443173784223 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:34.081910 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1fb5ae85-671d-4cd5-b102-443173784223 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:34.086376 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1fb5ae85-671d-4cd5-b102-443173784223 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1281 microversion: 2.25 time: 0.912551 Aug 04 16:40:34.090088 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 746/1516] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:40:33 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1281 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:40:34.175363 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7481b991-a4e7-4278-b14b-d2f81a835334 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:34.176079 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7481b991-a4e7-4278-b14b-d2f81a835334 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:34.190094 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7481b991-a4e7-4278-b14b-d2f81a835334 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:34.191736 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7481b991-a4e7-4278-b14b-d2f81a835334 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:34.194139 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7481b991-a4e7-4278-b14b-d2f81a835334 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:34.196632 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7481b991-a4e7-4278-b14b-d2f81a835334 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:34.260086 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=100 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:40:34.852252 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-31aec391-4683-458b-a9ab-21bb8f9425a2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:34.883620 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-31aec391-4683-458b-a9ab-21bb8f9425a2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 200 len: 1393 microversion: 2.1 time: 1.203636 Aug 04 16:40:34.884798 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 771/1517] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:33 2022] GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 1393 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:34.954562 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-55914ce2-8f44-4888-8c92-0e3bf5a10bd2 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:34.955378 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-55914ce2-8f44-4888-8c92-0e3bf5a10bd2 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:34.967394 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-55914ce2-8f44-4888-8c92-0e3bf5a10bd2 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:34.967887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-55914ce2-8f44-4888-8c92-0e3bf5a10bd2 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:34.968883 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-55914ce2-8f44-4888-8c92-0e3bf5a10bd2 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:34.980878 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-55914ce2-8f44-4888-8c92-0e3bf5a10bd2 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:35.574120 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7481b991-a4e7-4278-b14b-d2f81a835334 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:35.593899 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7481b991-a4e7-4278-b14b-d2f81a835334 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1470 microversion: 2.1 time: 1.421109 Aug 04 16:40:35.608979 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 747/1518] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:34 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1470 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:40:35.633253 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-86a6c0d6-3d5d-4665-9ce6-c84ce5bd9db2 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:35.634859 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-86a6c0d6-3d5d-4665-9ce6-c84ce5bd9db2 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: 95a1d0a6-3d88-4b0d-ba60-b1972539d2bd] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:35.643075 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=62 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:40:35.652809 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-86a6c0d6-3d5d-4665-9ce6-c84ce5bd9db2 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:35.654230 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-86a6c0d6-3d5d-4665-9ce6-c84ce5bd9db2 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:35.664435 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-86a6c0d6-3d5d-4665-9ce6-c84ce5bd9db2 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:35.667506 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-86a6c0d6-3d5d-4665-9ce6-c84ce5bd9db2 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:36.377717 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:40:36.392556 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-86a6c0d6-3d5d-4665-9ce6-c84ce5bd9db2 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23cc8f30e1f94ff0a520a071e5d81728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb25e78b70ee48c99471d78e00e5949c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:36.404951 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-86a6c0d6-3d5d-4665-9ce6-c84ce5bd9db2 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd" status: 200 len: 1274 microversion: 2.1 time: 0.776901 Aug 04 16:40:36.406149 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 748/1519] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:35 2022] GET /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd => generated 1274 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:36.415618 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-4bc31754-31f9-4848-bc5e-69acdc888bab req-56a3b38e-35b2-4ab3-a8bc-e2254e747453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89ab07c4-6179-48f5-9ac4-053c6070ed42", "name": "network-vif-plugged", "status": "completed", "tag": "ffbb5a20-fa64-4e0b-8e0b-f2163a520c8f"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:40:36.435594 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-4bc31754-31f9-4848-bc5e-69acdc888bab req-56a3b38e-35b2-4ab3-a8bc-e2254e747453 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:36.436382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-4bc31754-31f9-4848-bc5e-69acdc888bab req-56a3b38e-35b2-4ab3-a8bc-e2254e747453 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:36.455341 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-4bc31754-31f9-4848-bc5e-69acdc888bab req-56a3b38e-35b2-4ab3-a8bc-e2254e747453 service nova] Creating event network-vif-plugged:ffbb5a20-fa64-4e0b-8e0b-f2163a520c8f for instance 89ab07c4-6179-48f5-9ac4-053c6070ed42 on n-h1-846466-12 Aug 04 16:40:36.464236 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [req-4bc31754-31f9-4848-bc5e-69acdc888bab req-56a3b38e-35b2-4ab3-a8bc-e2254e747453 service nova] Instance 89ab07c4-6179-48f5-9ac4-053c6070ed42 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126126) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 16:40:36.479614 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-4bc31754-31f9-4848-bc5e-69acdc888bab req-56a3b38e-35b2-4ab3-a8bc-e2254e747453 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071636 Aug 04 16:40:36.480891 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 749/1520] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:40:36.482464 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-55914ce2-8f44-4888-8c92-0e3bf5a10bd2 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:36.488718 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f499ad06-8ea5-40d6-b511-d0665151952c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:36.490016 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f499ad06-8ea5-40d6-b511-d0665151952c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:36.499235 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f499ad06-8ea5-40d6-b511-d0665151952c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:36.500034 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f499ad06-8ea5-40d6-b511-d0665151952c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:36.501156 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f499ad06-8ea5-40d6-b511-d0665151952c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:36.502095 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f499ad06-8ea5-40d6-b511-d0665151952c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:36.512660 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-55914ce2-8f44-4888-8c92-0e3bf5a10bd2 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727" status: 200 len: 1735 microversion: 2.1 time: 1.572432 Aug 04 16:40:36.526547 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 772/1521] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:34 2022] GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727 => generated 1735 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:36.547409 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a444d7c4-b8f1-45d2-9c66-1f63bb2c43b3 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:40:36.551205 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a444d7c4-b8f1-45d2-9c66-1f63bb2c43b3 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:36.567883 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a444d7c4-b8f1-45d2-9c66-1f63bb2c43b3 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:36.569711 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a444d7c4-b8f1-45d2-9c66-1f63bb2c43b3 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:36.571636 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a444d7c4-b8f1-45d2-9c66-1f63bb2c43b3 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:36.574825 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a444d7c4-b8f1-45d2-9c66-1f63bb2c43b3 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:36.855696 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a444d7c4-b8f1-45d2-9c66-1f63bb2c43b3 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "POST /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42/action" status: 202 len: 0 microversion: 2.1 time: 0.326112 Aug 04 16:40:36.858093 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 773/1522] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:40:36 2022] POST /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:40:36.903160 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cdd4e3a3-aea0-4b20-866e-497b5575c52c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:36.907912 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cdd4e3a3-aea0-4b20-866e-497b5575c52c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:36.939936 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cdd4e3a3-aea0-4b20-866e-497b5575c52c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:36.941084 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cdd4e3a3-aea0-4b20-866e-497b5575c52c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:36.955607 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cdd4e3a3-aea0-4b20-866e-497b5575c52c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:36.956973 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cdd4e3a3-aea0-4b20-866e-497b5575c52c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:37.484791 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f499ad06-8ea5-40d6-b511-d0665151952c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:37.507473 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f499ad06-8ea5-40d6-b511-d0665151952c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:37.511941 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f499ad06-8ea5-40d6-b511-d0665151952c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:37.514864 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f499ad06-8ea5-40d6-b511-d0665151952c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1281 microversion: 2.25 time: 1.031571 Aug 04 16:40:37.516860 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 750/1523] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:40:36 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1281 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:40:37.526359 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-30d71d48-2a56-4f18-ac3e-4acbcfb09932 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:37.528149 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-30d71d48-2a56-4f18-ac3e-4acbcfb09932 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:37.550894 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-30d71d48-2a56-4f18-ac3e-4acbcfb09932 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:37.551867 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-30d71d48-2a56-4f18-ac3e-4acbcfb09932 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:37.553261 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-30d71d48-2a56-4f18-ac3e-4acbcfb09932 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:37.554026 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-30d71d48-2a56-4f18-ac3e-4acbcfb09932 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:37.985591 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cdd4e3a3-aea0-4b20-866e-497b5575c52c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:38.001367 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cdd4e3a3-aea0-4b20-866e-497b5575c52c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 200 len: 1383 microversion: 2.1 time: 1.138871 Aug 04 16:40:38.002911 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 774/1524] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:36 2022] GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 1383 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:38.010116 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6246cf1c-bee4-410d-8c38-ea3b9e68c01b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:38.011608 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6246cf1c-bee4-410d-8c38-ea3b9e68c01b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: 95a1d0a6-3d88-4b0d-ba60-b1972539d2bd] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:38.024734 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6246cf1c-bee4-410d-8c38-ea3b9e68c01b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:38.025192 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6246cf1c-bee4-410d-8c38-ea3b9e68c01b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:38.026086 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6246cf1c-bee4-410d-8c38-ea3b9e68c01b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:38.026539 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6246cf1c-bee4-410d-8c38-ea3b9e68c01b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:38.197389 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-30d71d48-2a56-4f18-ac3e-4acbcfb09932 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:38.209359 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-30d71d48-2a56-4f18-ac3e-4acbcfb09932 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1469 microversion: 2.1 time: 0.690273 Aug 04 16:40:38.210448 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 751/1525] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:37 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1469 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:38.232597 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-504113ea-43c7-4c00-8df3-1ad6025c7f5c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:38.237591 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-504113ea-43c7-4c00-8df3-1ad6025c7f5c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:38.269531 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-504113ea-43c7-4c00-8df3-1ad6025c7f5c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:38.270325 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-504113ea-43c7-4c00-8df3-1ad6025c7f5c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:38.271468 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-504113ea-43c7-4c00-8df3-1ad6025c7f5c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:38.272106 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-504113ea-43c7-4c00-8df3-1ad6025c7f5c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:38.590184 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6246cf1c-bee4-410d-8c38-ea3b9e68c01b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23cc8f30e1f94ff0a520a071e5d81728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb25e78b70ee48c99471d78e00e5949c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:38.607816 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6246cf1c-bee4-410d-8c38-ea3b9e68c01b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd" status: 200 len: 1316 microversion: 2.1 time: 0.602769 Aug 04 16:40:38.628716 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 775/1526] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:38 2022] GET /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd => generated 1316 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:38.647522 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9833f48d-1136-427d-8be9-eac64aa50bcf tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Calling method '.version_select at 0x7f7e84158160>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:38.655468 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9833f48d-1136-427d-8be9-eac64aa50bcf tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:38.658165 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9833f48d-1136-427d-8be9-eac64aa50bcf tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:38.687553 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9833f48d-1136-427d-8be9-eac64aa50bcf tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 4319 microversion: 2.1 time: 0.056476 Aug 04 16:40:38.689459 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 776/1527] 10.222.0.23 () {58 vars in 1143 bytes} [Thu Aug 4 16:40:38 2022] GET /compute/v2.1/os-migrations => generated 4319 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:38.698912 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5e343a7d-403a-4900-adad-906f7664d4b3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:38.700653 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5e343a7d-403a-4900-adad-906f7664d4b3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:38.704706 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:40:38.716044 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5e343a7d-403a-4900-adad-906f7664d4b3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:38.717403 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5e343a7d-403a-4900-adad-906f7664d4b3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:38.719317 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5e343a7d-403a-4900-adad-906f7664d4b3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:38.720744 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5e343a7d-403a-4900-adad-906f7664d4b3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:38.809105 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-504113ea-43c7-4c00-8df3-1ad6025c7f5c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:38.825025 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-504113ea-43c7-4c00-8df3-1ad6025c7f5c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727" status: 200 len: 1735 microversion: 2.1 time: 0.600387 Aug 04 16:40:38.826459 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 752/1528] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:38 2022] GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727 => generated 1735 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:38.835462 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-fea275b8-60aa-4c5d-9a41-3267207a2aa5 req-cb05f984-ef34-43e8-b867-36e63a61d9a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dfa867e-8758-47d0-9256-3c864b36e819", "name": "network-vif-plugged", "status": "completed", "tag": "251fa64f-5224-48c2-a585-f6377c372e04"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:40:38.858591 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-fea275b8-60aa-4c5d-9a41-3267207a2aa5 req-cb05f984-ef34-43e8-b867-36e63a61d9a1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:38.860698 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-fea275b8-60aa-4c5d-9a41-3267207a2aa5 req-cb05f984-ef34-43e8-b867-36e63a61d9a1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:38.884502 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-fea275b8-60aa-4c5d-9a41-3267207a2aa5 req-cb05f984-ef34-43e8-b867-36e63a61d9a1 service nova] Creating event network-vif-plugged:251fa64f-5224-48c2-a585-f6377c372e04 for instance 3dfa867e-8758-47d0-9256-3c864b36e819 on n-h1-846466-12 Aug 04 16:40:38.894163 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-fea275b8-60aa-4c5d-9a41-3267207a2aa5 req-cb05f984-ef34-43e8-b867-36e63a61d9a1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065307 Aug 04 16:40:38.896084 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 753/1529] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:40:38.906460 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7dd8dc17-1f8b-42bc-86f7-93bac275a259 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:38.908136 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7dd8dc17-1f8b-42bc-86f7-93bac275a259 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:38.919725 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7dd8dc17-1f8b-42bc-86f7-93bac275a259 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:38.920953 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7dd8dc17-1f8b-42bc-86f7-93bac275a259 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:38.922953 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7dd8dc17-1f8b-42bc-86f7-93bac275a259 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:38.923992 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7dd8dc17-1f8b-42bc-86f7-93bac275a259 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:39.301651 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5e343a7d-403a-4900-adad-906f7664d4b3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:39.345572 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5e343a7d-403a-4900-adad-906f7664d4b3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:39.353568 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5e343a7d-403a-4900-adad-906f7664d4b3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:39.356594 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5e343a7d-403a-4900-adad-906f7664d4b3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1281 microversion: 2.25 time: 0.664820 Aug 04 16:40:39.361962 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 777/1530] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:40:38 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1281 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:40:39.375485 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f4fe422b-f2e1-43ad-af46-47b992863cf9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:39.379708 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f4fe422b-f2e1-43ad-af46-47b992863cf9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:39.399849 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f4fe422b-f2e1-43ad-af46-47b992863cf9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:39.400340 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f4fe422b-f2e1-43ad-af46-47b992863cf9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:39.401183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f4fe422b-f2e1-43ad-af46-47b992863cf9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:39.401654 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f4fe422b-f2e1-43ad-af46-47b992863cf9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:39.461642 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7dd8dc17-1f8b-42bc-86f7-93bac275a259 tempest-LiveMigrationTest-405720638 tempest-LiveMigrationTest-405720638-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 200 len: 1536 microversion: 2.1 time: 0.563563 Aug 04 16:40:39.473858 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 754/1531] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:38 2022] GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 1536 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:39.510871 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-611fd152-44b8-4358-a307-789a86cffba4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:39.511719 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-611fd152-44b8-4358-a307-789a86cffba4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:39.518673 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-611fd152-44b8-4358-a307-789a86cffba4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:39.519118 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-611fd152-44b8-4358-a307-789a86cffba4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:39.520175 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-611fd152-44b8-4358-a307-789a86cffba4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:39.520612 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-611fd152-44b8-4358-a307-789a86cffba4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:39.556514 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-611fd152-44b8-4358-a307-789a86cffba4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:40:39.729760 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-611fd152-44b8-4358-a307-789a86cffba4 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "DELETE /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 204 len: 0 microversion: 2.1 time: 0.221871 Aug 04 16:40:39.736756 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 755/1532] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:40:39 2022] DELETE /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:40:39.748159 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e28acd49-41e0-4211-ba6d-174f0ff4ef2c tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:39.750200 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e28acd49-41e0-4211-ba6d-174f0ff4ef2c tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: 95a1d0a6-3d88-4b0d-ba60-b1972539d2bd] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:39.779317 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e28acd49-41e0-4211-ba6d-174f0ff4ef2c tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:39.780944 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e28acd49-41e0-4211-ba6d-174f0ff4ef2c tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:39.783703 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e28acd49-41e0-4211-ba6d-174f0ff4ef2c tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:39.784659 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e28acd49-41e0-4211-ba6d-174f0ff4ef2c tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:40.147118 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f4fe422b-f2e1-43ad-af46-47b992863cf9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:40.155646 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f4fe422b-f2e1-43ad-af46-47b992863cf9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1469 microversion: 2.1 time: 0.791196 Aug 04 16:40:40.156316 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 778/1533] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:39 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1469 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:40.191881 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2623fa13-1548-4096-9f29-21615cb37809 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:40.197632 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2623fa13-1548-4096-9f29-21615cb37809 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:40.228171 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2623fa13-1548-4096-9f29-21615cb37809 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:40.229991 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2623fa13-1548-4096-9f29-21615cb37809 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:40.232789 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2623fa13-1548-4096-9f29-21615cb37809 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:40.236943 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2623fa13-1548-4096-9f29-21615cb37809 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:40.252816 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e28acd49-41e0-4211-ba6d-174f0ff4ef2c tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23cc8f30e1f94ff0a520a071e5d81728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb25e78b70ee48c99471d78e00e5949c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:40.262907 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e28acd49-41e0-4211-ba6d-174f0ff4ef2c tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd" status: 200 len: 1316 microversion: 2.1 time: 0.523417 Aug 04 16:40:40.269565 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 756/1534] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:39 2022] GET /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd => generated 1316 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:40.280915 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cbbed8da-58ed-4a14-9345-fcc958d5834b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:40.285762 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:40:40.286103 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cbbed8da-58ed-4a14-9345-fcc958d5834b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:40.312426 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cbbed8da-58ed-4a14-9345-fcc958d5834b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:40.313377 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cbbed8da-58ed-4a14-9345-fcc958d5834b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:40.321392 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cbbed8da-58ed-4a14-9345-fcc958d5834b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:40.328021 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cbbed8da-58ed-4a14-9345-fcc958d5834b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:41.477885 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2623fa13-1548-4096-9f29-21615cb37809 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:41.492698 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2623fa13-1548-4096-9f29-21615cb37809 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 200 len: 1389 microversion: 2.1 time: 1.309764 Aug 04 16:40:41.493458 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 779/1535] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:40 2022] GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 1389 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:41.499976 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cbbed8da-58ed-4a14-9345-fcc958d5834b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:41.511898 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cbbed8da-58ed-4a14-9345-fcc958d5834b tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727" status: 200 len: 1735 microversion: 2.1 time: 1.234983 Aug 04 16:40:41.519790 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 757/1536] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:40 2022] GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727 => generated 1735 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:41.522244 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3fcee40e-b9fc-4257-a86a-14a0db385f9f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:41.523143 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3fcee40e-b9fc-4257-a86a-14a0db385f9f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:41.533627 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d516e136-2007-4be4-92dd-ba842333535b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:41.534388 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d516e136-2007-4be4-92dd-ba842333535b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:41.536958 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3fcee40e-b9fc-4257-a86a-14a0db385f9f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:41.541089 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3fcee40e-b9fc-4257-a86a-14a0db385f9f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:41.544261 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3fcee40e-b9fc-4257-a86a-14a0db385f9f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:41.544794 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3fcee40e-b9fc-4257-a86a-14a0db385f9f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:41.548196 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d516e136-2007-4be4-92dd-ba842333535b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:41.549075 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d516e136-2007-4be4-92dd-ba842333535b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:41.550200 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d516e136-2007-4be4-92dd-ba842333535b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:41.551106 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d516e136-2007-4be4-92dd-ba842333535b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:42.004108 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d516e136-2007-4be4-92dd-ba842333535b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:42.034719 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d516e136-2007-4be4-92dd-ba842333535b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1469 microversion: 2.1 time: 0.511739 Aug 04 16:40:42.039851 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3fcee40e-b9fc-4257-a86a-14a0db385f9f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:42.041677 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 758/1537] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:41 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1469 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:42.047566 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ee3dc35d-2abe-402e-8706-a70023f9902d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:42.048185 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ee3dc35d-2abe-402e-8706-a70023f9902d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: 95a1d0a6-3d88-4b0d-ba60-b1972539d2bd] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:42.060582 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ee3dc35d-2abe-402e-8706-a70023f9902d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:42.061027 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ee3dc35d-2abe-402e-8706-a70023f9902d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:42.062344 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ee3dc35d-2abe-402e-8706-a70023f9902d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:42.062634 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ee3dc35d-2abe-402e-8706-a70023f9902d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:42.082795 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3fcee40e-b9fc-4257-a86a-14a0db385f9f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:42.084556 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3fcee40e-b9fc-4257-a86a-14a0db385f9f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:42.085806 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3fcee40e-b9fc-4257-a86a-14a0db385f9f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1281 microversion: 2.25 time: 0.590974 Aug 04 16:40:42.086399 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 780/1538] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:40:41 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1281 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:40:42.101046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-503f2148-0903-434a-b575-414832366b39 req-60f6b34d-3971-4488-8147-6f87c3efb276 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95a1d0a6-3d88-4b0d-ba60-b1972539d2bd", "tag": "a6403208-7435-4b06-b55d-2373bc1a3cd3"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:40:42.128131 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-503f2148-0903-434a-b575-414832366b39 req-60f6b34d-3971-4488-8147-6f87c3efb276 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:42.128572 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-503f2148-0903-434a-b575-414832366b39 req-60f6b34d-3971-4488-8147-6f87c3efb276 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:42.153115 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-503f2148-0903-434a-b575-414832366b39 req-60f6b34d-3971-4488-8147-6f87c3efb276 service nova] Creating event network-changed:a6403208-7435-4b06-b55d-2373bc1a3cd3 for instance 95a1d0a6-3d88-4b0d-ba60-b1972539d2bd on n-h1-846466-12 Aug 04 16:40:42.171335 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-503f2148-0903-434a-b575-414832366b39 req-60f6b34d-3971-4488-8147-6f87c3efb276 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082422 Aug 04 16:40:42.172896 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 781/1539] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:40:42.187892 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9fd19960-2074-4022-9e7a-5348b5bdda25 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-653668809", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "fedf2581-e3af-467c-ae4c-2c7a018745db"}, {"port": "a2483ca6-cccd-4bc5-82a5-0870eb4a915c", "tag": "port-1"}, {"port": "372f96d2-ee11-4947-bb71-af596393f831", "tag": "port-2"}, {"uuid": "b96a6e07-372e-4f1d-b6d3-8e16f043574e", "tag": "net-1"}, {"uuid": "b96a6e07-372e-4f1d-b6d3-8e16f043574e"}, {"uuid": "cbbe1961-f57d-4803-ad23-42468eefadc8", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "cbbe1961-f57d-4803-ad23-42468eefadc8", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "db395c52-c134-4d46-a278-3f3919ab13bb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "f03ffcba-1dc5-4ce3-8169-a1fcf5c95212", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "74db1645-3aa9-45ae-b6ff-15488e757a34", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--320830947"}], "key_name": "tempest-keypair-1046115166", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:40:42.692536 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-9fd19960-2074-4022-9e7a-5348b5bdda25 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] validate_networks() for [('fedf2581-e3af-467c-ae4c-2c7a018745db', None, None, None, None, None), (None, None, 'a2483ca6-cccd-4bc5-82a5-0870eb4a915c', None, None, None), (None, None, '372f96d2-ee11-4947-bb71-af596393f831', None, None, None), ('b96a6e07-372e-4f1d-b6d3-8e16f043574e', None, None, None, None, None), ('b96a6e07-372e-4f1d-b6d3-8e16f043574e', None, None, None, None, None), ('cbbe1961-f57d-4803-ad23-42468eefadc8', '10.2.2.100', None, None, None, None), ('cbbe1961-f57d-4803-ad23-42468eefadc8', '10.2.2.200', None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:40:42.714440 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ee3dc35d-2abe-402e-8706-a70023f9902d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23cc8f30e1f94ff0a520a071e5d81728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb25e78b70ee48c99471d78e00e5949c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:42.727219 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ee3dc35d-2abe-402e-8706-a70023f9902d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd" status: 200 len: 1316 microversion: 2.1 time: 0.684050 Aug 04 16:40:42.736062 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 759/1540] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:42 2022] GET /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd => generated 1316 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:42.764493 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4b1d2dbb-2f61-4c40-8dc2-cf3c18b65108 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:42.766339 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4b1d2dbb-2f61-4c40-8dc2-cf3c18b65108 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:42.815394 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b1d2dbb-2f61-4c40-8dc2-cf3c18b65108 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:42.820814 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b1d2dbb-2f61-4c40-8dc2-cf3c18b65108 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:42.823974 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b1d2dbb-2f61-4c40-8dc2-cf3c18b65108 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:42.829849 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b1d2dbb-2f61-4c40-8dc2-cf3c18b65108 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:43.273887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=14 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:40:43.303372 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4b1d2dbb-2f61-4c40-8dc2-cf3c18b65108 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:43.343047 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4b1d2dbb-2f61-4c40-8dc2-cf3c18b65108 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 200 len: 1347 microversion: 2.1 time: 0.604564 Aug 04 16:40:43.370085 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 760/1541] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:42 2022] GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 1347 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:43.410026 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4b95097c-5b77-432c-b78e-5f640bb05931 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:43.426563 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4b95097c-5b77-432c-b78e-5f640bb05931 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:43.501629 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b95097c-5b77-432c-b78e-5f640bb05931 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:43.502703 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b95097c-5b77-432c-b78e-5f640bb05931 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:43.504227 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b95097c-5b77-432c-b78e-5f640bb05931 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:43.505034 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b95097c-5b77-432c-b78e-5f640bb05931 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:44.379001 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4b95097c-5b77-432c-b78e-5f640bb05931 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:44.419142 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4b95097c-5b77-432c-b78e-5f640bb05931 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727" status: 200 len: 1715 microversion: 2.1 time: 1.044419 Aug 04 16:40:44.425454 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 761/1542] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:43 2022] GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727 => generated 1715 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:44.490028 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-df481be7-d1dd-4c78-b285-3824ffab8795 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:44.491012 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-df481be7-d1dd-4c78-b285-3824ffab8795 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:44.512315 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-df481be7-d1dd-4c78-b285-3824ffab8795 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:44.513068 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-df481be7-d1dd-4c78-b285-3824ffab8795 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:44.514729 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-df481be7-d1dd-4c78-b285-3824ffab8795 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:44.515518 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-df481be7-d1dd-4c78-b285-3824ffab8795 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:45.057706 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-df481be7-d1dd-4c78-b285-3824ffab8795 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:45.081424 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-df481be7-d1dd-4c78-b285-3824ffab8795 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1469 microversion: 2.1 time: 0.650460 Aug 04 16:40:45.094838 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 762/1543] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:44 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1469 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:45.102495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-91ce114b-24a1-4b73-bd4f-f3768aa2841d req-2cd22a0c-1e9c-462f-8dd1-767a3c02107c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "637703de-2520-4512-bf57-9b811b7769d4", "name": "network-vif-deleted", "tag": "1568bcc2-0017-4817-883a-43e4096677ac"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:40:45.122273 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-91ce114b-24a1-4b73-bd4f-f3768aa2841d req-2cd22a0c-1e9c-462f-8dd1-767a3c02107c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:45.123408 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-91ce114b-24a1-4b73-bd4f-f3768aa2841d req-2cd22a0c-1e9c-462f-8dd1-767a3c02107c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:45.133900 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:40:45.148732 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-91ce114b-24a1-4b73-bd4f-f3768aa2841d req-2cd22a0c-1e9c-462f-8dd1-767a3c02107c service nova] Creating event network-vif-deleted:1568bcc2-0017-4817-883a-43e4096677ac for instance 637703de-2520-4512-bf57-9b811b7769d4 on n-h1-846466-12 Aug 04 16:40:45.156172 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-91ce114b-24a1-4b73-bd4f-f3768aa2841d req-2cd22a0c-1e9c-462f-8dd1-767a3c02107c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059602 Aug 04 16:40:45.157725 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 763/1544] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:40:45.166417 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7ed7fbf3-fb05-49a4-82c9-a473a42a30c4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:45.167386 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7ed7fbf3-fb05-49a4-82c9-a473a42a30c4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:45.174383 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7ed7fbf3-fb05-49a4-82c9-a473a42a30c4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:45.175162 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7ed7fbf3-fb05-49a4-82c9-a473a42a30c4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:45.176539 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7ed7fbf3-fb05-49a4-82c9-a473a42a30c4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:45.177315 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7ed7fbf3-fb05-49a4-82c9-a473a42a30c4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:45.531296 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7ed7fbf3-fb05-49a4-82c9-a473a42a30c4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:45.560007 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7ed7fbf3-fb05-49a4-82c9-a473a42a30c4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:45.576688 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7ed7fbf3-fb05-49a4-82c9-a473a42a30c4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:45.579296 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7ed7fbf3-fb05-49a4-82c9-a473a42a30c4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1477 microversion: 2.25 time: 0.419807 Aug 04 16:40:45.585396 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 764/1545] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:40:45 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1477 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:40:45.597491 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-22076106-6587-41fa-bfa0-72acb0d49634 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:45.606245 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-22076106-6587-41fa-bfa0-72acb0d49634 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: 95a1d0a6-3d88-4b0d-ba60-b1972539d2bd] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:45.620327 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-22076106-6587-41fa-bfa0-72acb0d49634 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:45.621484 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-22076106-6587-41fa-bfa0-72acb0d49634 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:45.622655 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-22076106-6587-41fa-bfa0-72acb0d49634 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:45.623307 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-22076106-6587-41fa-bfa0-72acb0d49634 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:46.236379 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-22076106-6587-41fa-bfa0-72acb0d49634 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23cc8f30e1f94ff0a520a071e5d81728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb25e78b70ee48c99471d78e00e5949c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:46.274638 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-22076106-6587-41fa-bfa0-72acb0d49634 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd" status: 200 len: 1316 microversion: 2.1 time: 0.692525 Aug 04 16:40:46.283402 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 765/1546] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:45 2022] GET /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd => generated 1316 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:46.300008 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6c9cf841-3793-40e3-84b5-217dda999235 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:46.302733 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6c9cf841-3793-40e3-84b5-217dda999235 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:46.324630 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c9cf841-3793-40e3-84b5-217dda999235 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:46.329518 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c9cf841-3793-40e3-84b5-217dda999235 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:46.333112 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c9cf841-3793-40e3-84b5-217dda999235 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:46.340058 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c9cf841-3793-40e3-84b5-217dda999235 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:46.634990 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6c9cf841-3793-40e3-84b5-217dda999235 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:46.679384 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6c9cf841-3793-40e3-84b5-217dda999235 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 200 len: 1184 microversion: 2.1 time: 0.383447 Aug 04 16:40:46.684116 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 766/1547] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:46 2022] GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 1184 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:46.714806 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-53c61a2f-348a-4d93-aed5-ccbebaba3d55 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:46.720917 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-53c61a2f-348a-4d93-aed5-ccbebaba3d55 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:46.751142 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-53c61a2f-348a-4d93-aed5-ccbebaba3d55 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:46.782803 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-53c61a2f-348a-4d93-aed5-ccbebaba3d55 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:46.787788 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-53c61a2f-348a-4d93-aed5-ccbebaba3d55 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:46.788270 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-53c61a2f-348a-4d93-aed5-ccbebaba3d55 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:47.054919 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-53c61a2f-348a-4d93-aed5-ccbebaba3d55 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] HTTP exception thrown: Cannot 'detach_volume' instance b0c83347-17c8-4872-ae95-36497fd7a727 while it is in vm_state rescued Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-53c61a2f-348a-4d93-aed5-ccbebaba3d55 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Request method failure captured: Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727/os-volume_attachments/466ea028-925a-4b89-ab4d-77b5ed0bc0f1 HTTP/1.1 Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_WOXTtiEFJuJx9g__PLaEpNUIG8cY9V5mucnrPgRej9fIBvkSBrLUaGoaJ38CVyDNzSj9GoE7BQp1yVztL27iI-fLZMpYZtLbyWcNlftj-zWFhGEyvOQOtE9rUW6LzioxrRHRZoV1uxRI3_TSQwte9NfcDMr3FTg447dmciw2wFA7M Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 20d035e0adc640c8a3ceb832275d0ea7 Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1842533046 Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20d035e0adc640c8a3ceb832275d0ea7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_20d035e0adc640c8a3ceb832275d0ea7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20d035e0adc640c8a3ceb832275d0ea7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/20d035e0adc640c8a3ceb832275d0ea7"}]}] Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1842533046 Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 20d035e0adc640c8a3ceb832275d0ea7 Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1842533046 Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServerRescueNegativeTestJSON-1842533046-project Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: a88db264b2c94f699e015a8617150b45 Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1842533046-project Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: exception: Cannot 'detach_volume' instance b0c83347-17c8-4872-ae95-36497fd7a727 while it is in vm_state rescued Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'server_id': 'b0c83347-17c8-4872-ae95-36497fd7a727', 'id': '466ea028-925a-4b89-ab4d-77b5ed0bc0f1'} Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b0c83347-17c8-4872-ae95-36497fd7a727 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance b0c83347-17c8-4872-ae95-36497fd7a727 while it is in vm_state rescued Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:40:47.060389 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:40:47.070752 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:40:47.070752 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:40:47.070752 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:40:47.070752 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:40:47.070752 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance b0c83347-17c8-4872-ae95-36497fd7a727 while it is in vm_state rescued Aug 04 16:40:47.070752 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:40:47.075094 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-53c61a2f-348a-4d93-aed5-ccbebaba3d55 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Returning 409 to user: Cannot 'detach_volume' instance b0c83347-17c8-4872-ae95-36497fd7a727 while it is in vm_state rescued {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:40:47.078479 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-53c61a2f-348a-4d93-aed5-ccbebaba3d55 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727/os-volume_attachments/466ea028-925a-4b89-ab4d-77b5ed0bc0f1" status: 409 len: 152 microversion: 2.1 time: 0.388455 Aug 04 16:40:47.082791 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 767/1548] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Aug 4 16:40:46 2022] DELETE /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727/os-volume_attachments/466ea028-925a-4b89-ab4d-77b5ed0bc0f1 => generated 152 bytes in 397 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:40:47.096440 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-e1e12c61-f681-466c-86a7-c8f8153d423c req-72283344-d2eb-48ef-b96c-40843de5791f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89ab07c4-6179-48f5-9ac4-053c6070ed42", "name": "network-vif-unplugged", "status": "completed", "tag": "ffbb5a20-fa64-4e0b-8e0b-f2163a520c8f"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:40:47.133184 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-e1e12c61-f681-466c-86a7-c8f8153d423c req-72283344-d2eb-48ef-b96c-40843de5791f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:47.135251 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-e1e12c61-f681-466c-86a7-c8f8153d423c req-72283344-d2eb-48ef-b96c-40843de5791f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:47.171355 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-e1e12c61-f681-466c-86a7-c8f8153d423c req-72283344-d2eb-48ef-b96c-40843de5791f service nova] Creating event network-vif-unplugged:ffbb5a20-fa64-4e0b-8e0b-f2163a520c8f for instance 89ab07c4-6179-48f5-9ac4-053c6070ed42 on n-h2-846466-12 Aug 04 16:40:47.187572 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [req-e1e12c61-f681-466c-86a7-c8f8153d423c req-72283344-d2eb-48ef-b96c-40843de5791f service nova] Instance 89ab07c4-6179-48f5-9ac4-053c6070ed42 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126126) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 16:40:47.217963 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-e1e12c61-f681-466c-86a7-c8f8153d423c req-72283344-d2eb-48ef-b96c-40843de5791f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.131601 Aug 04 16:40:47.219986 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 768/1549] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:40:47.678977 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-52b70a3e-f3d7-4062-859d-ae6e04ed867f tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:47.681442 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-52b70a3e-f3d7-4062-859d-ae6e04ed867f tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:47.689195 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-52b70a3e-f3d7-4062-859d-ae6e04ed867f tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:47.689950 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-52b70a3e-f3d7-4062-859d-ae6e04ed867f tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:47.693663 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-52b70a3e-f3d7-4062-859d-ae6e04ed867f tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:47.694555 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-52b70a3e-f3d7-4062-859d-ae6e04ed867f tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:48.747610 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-52b70a3e-f3d7-4062-859d-ae6e04ed867f tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lazy-loading 'services' on Instance uuid 3dfa867e-8758-47d0-9256-3c864b36e819 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:40:48.777662 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-52b70a3e-f3d7-4062-859d-ae6e04ed867f tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1972 microversion: 2.25 time: 1.553562 Aug 04 16:40:48.778532 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 769/1550] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:40:47 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1972 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:40:48.784971 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4faab24c-546c-4fbf-98f1-ee565b3c2f7a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:48.792642 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4faab24c-546c-4fbf-98f1-ee565b3c2f7a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:48.810233 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4faab24c-546c-4fbf-98f1-ee565b3c2f7a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:48.811005 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4faab24c-546c-4fbf-98f1-ee565b3c2f7a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:48.811984 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4faab24c-546c-4fbf-98f1-ee565b3c2f7a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:48.818367 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4faab24c-546c-4fbf-98f1-ee565b3c2f7a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:49.548777 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4faab24c-546c-4fbf-98f1-ee565b3c2f7a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:49.577849 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4faab24c-546c-4fbf-98f1-ee565b3c2f7a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1469 microversion: 2.1 time: 0.797931 Aug 04 16:40:49.582095 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 770/1551] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:48 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1469 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:49.603066 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-42aad408-49ff-4103-bd9b-5ea69d102e22 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:40:49.608739 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-42aad408-49ff-4103-bd9b-5ea69d102e22 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:49.630755 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-42aad408-49ff-4103-bd9b-5ea69d102e22 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:49.633719 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-42aad408-49ff-4103-bd9b-5ea69d102e22 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:49.637665 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-42aad408-49ff-4103-bd9b-5ea69d102e22 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:49.639143 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-42aad408-49ff-4103-bd9b-5ea69d102e22 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:49.816482 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-42aad408-49ff-4103-bd9b-5ea69d102e22 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "POST /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727/action" status: 202 len: 0 microversion: 2.1 time: 0.230130 Aug 04 16:40:49.817375 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 771/1552] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:40:49 2022] POST /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:40:49.838605 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-47a82929-86fe-4094-8fb1-04f35efd31d3 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:49.839524 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-47a82929-86fe-4094-8fb1-04f35efd31d3 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: 95a1d0a6-3d88-4b0d-ba60-b1972539d2bd] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:49.862673 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-47a82929-86fe-4094-8fb1-04f35efd31d3 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:49.863435 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-47a82929-86fe-4094-8fb1-04f35efd31d3 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:49.866604 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-47a82929-86fe-4094-8fb1-04f35efd31d3 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:49.867101 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-47a82929-86fe-4094-8fb1-04f35efd31d3 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:50.765906 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-47a82929-86fe-4094-8fb1-04f35efd31d3 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23cc8f30e1f94ff0a520a071e5d81728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb25e78b70ee48c99471d78e00e5949c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:50.790346 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-47a82929-86fe-4094-8fb1-04f35efd31d3 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd" status: 200 len: 1316 microversion: 2.1 time: 0.966099 Aug 04 16:40:50.796414 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 772/1553] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:49 2022] GET /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd => generated 1316 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:50.801655 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-92fa0e94-935d-4ac6-8c37-2749f065e472 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:50.803055 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-92fa0e94-935d-4ac6-8c37-2749f065e472 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:50.835415 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-92fa0e94-935d-4ac6-8c37-2749f065e472 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:50.836338 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-92fa0e94-935d-4ac6-8c37-2749f065e472 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:50.837620 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-92fa0e94-935d-4ac6-8c37-2749f065e472 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:50.838412 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-92fa0e94-935d-4ac6-8c37-2749f065e472 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:51.292995 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-92fa0e94-935d-4ac6-8c37-2749f065e472 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:51.313853 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-92fa0e94-935d-4ac6-8c37-2749f065e472 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 200 len: 1184 microversion: 2.1 time: 0.509092 Aug 04 16:40:51.327893 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 773/1554] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:50 2022] GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 1184 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:51.335982 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e41ba389-478e-4a68-9936-dcaa09d93411 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:51.337133 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e41ba389-478e-4a68-9936-dcaa09d93411 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:51.376646 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e41ba389-478e-4a68-9936-dcaa09d93411 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:51.377503 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e41ba389-478e-4a68-9936-dcaa09d93411 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:51.378949 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e41ba389-478e-4a68-9936-dcaa09d93411 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:51.391140 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e41ba389-478e-4a68-9936-dcaa09d93411 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:52.159060 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-e41ba389-478e-4a68-9936-dcaa09d93411 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lazy-loading 'services' on Instance uuid 3dfa867e-8758-47d0-9256-3c864b36e819 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:40:52.159723 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=11 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:40:52.193873 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e41ba389-478e-4a68-9936-dcaa09d93411 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1972 microversion: 2.25 time: 0.863855 Aug 04 16:40:52.206159 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 774/1555] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:40:51 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1972 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:40:52.212184 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-e479dacf-6e09-447a-a79f-198d32b4150a req-cfd58246-00a7-4063-997d-490226492268 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89ab07c4-6179-48f5-9ac4-053c6070ed42", "tag": "ffbb5a20-fa64-4e0b-8e0b-f2163a520c8f"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:40:52.240607 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-e479dacf-6e09-447a-a79f-198d32b4150a req-cfd58246-00a7-4063-997d-490226492268 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:52.248033 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-e479dacf-6e09-447a-a79f-198d32b4150a req-cfd58246-00a7-4063-997d-490226492268 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:52.281891 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-e479dacf-6e09-447a-a79f-198d32b4150a req-cfd58246-00a7-4063-997d-490226492268 service nova] Creating event network-changed:ffbb5a20-fa64-4e0b-8e0b-f2163a520c8f for instance 89ab07c4-6179-48f5-9ac4-053c6070ed42 on n-h2-846466-12 Aug 04 16:40:52.303286 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [req-e479dacf-6e09-447a-a79f-198d32b4150a req-cfd58246-00a7-4063-997d-490226492268 service nova] Instance 89ab07c4-6179-48f5-9ac4-053c6070ed42 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126126) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 16:40:52.328136 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-e479dacf-6e09-447a-a79f-198d32b4150a req-cfd58246-00a7-4063-997d-490226492268 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120149 Aug 04 16:40:52.329830 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 775/1556] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:40:52.336243 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-53e64483-5eca-4f36-80f1-7189f5a19ab1 req-43920e1f-650a-444e-a128-279da194ed6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a1d0a6-3d88-4b0d-ba60-b1972539d2bd", "name": "network-vif-plugged", "status": "completed", "tag": "a6403208-7435-4b06-b55d-2373bc1a3cd3"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:40:52.347330 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-53e64483-5eca-4f36-80f1-7189f5a19ab1 req-43920e1f-650a-444e-a128-279da194ed6c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:52.348462 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-53e64483-5eca-4f36-80f1-7189f5a19ab1 req-43920e1f-650a-444e-a128-279da194ed6c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:52.370177 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-53e64483-5eca-4f36-80f1-7189f5a19ab1 req-43920e1f-650a-444e-a128-279da194ed6c service nova] Creating event network-vif-plugged:a6403208-7435-4b06-b55d-2373bc1a3cd3 for instance 95a1d0a6-3d88-4b0d-ba60-b1972539d2bd on n-h1-846466-12 Aug 04 16:40:52.376643 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-53e64483-5eca-4f36-80f1-7189f5a19ab1 req-43920e1f-650a-444e-a128-279da194ed6c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044935 Aug 04 16:40:52.377617 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 776/1557] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:40:52.389610 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0d50cb8b-8428-4b03-83f5-cef1c421d3f9 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:52.391027 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0d50cb8b-8428-4b03-83f5-cef1c421d3f9 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:52.419830 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-9fd19960-2074-4022-9e7a-5348b5bdda25 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:40:52.420407 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0d50cb8b-8428-4b03-83f5-cef1c421d3f9 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:52.420881 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-9fd19960-2074-4022-9e7a-5348b5bdda25 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:40:52.421933 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-9fd19960-2074-4022-9e7a-5348b5bdda25 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:40:52.422099 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0d50cb8b-8428-4b03-83f5-cef1c421d3f9 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:52.423145 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0d50cb8b-8428-4b03-83f5-cef1c421d3f9 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:52.424037 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0d50cb8b-8428-4b03-83f5-cef1c421d3f9 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:52.425112 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-9fd19960-2074-4022-9e7a-5348b5bdda25 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:40:52.432857 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-9fd19960-2074-4022-9e7a-5348b5bdda25 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:40:52.490920 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9fd19960-2074-4022-9e7a-5348b5bdda25 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:52.495898 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9fd19960-2074-4022-9e7a-5348b5bdda25 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:52.503375 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9fd19960-2074-4022-9e7a-5348b5bdda25 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:52.504855 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9fd19960-2074-4022-9e7a-5348b5bdda25 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:52.600385 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-9fd19960-2074-4022-9e7a-5348b5bdda25 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Getting quotas for project 6bfc77ffb53d4f53b5afc9d0b6313cf5. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:40:52.619455 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-9fd19960-2074-4022-9e7a-5348b5bdda25 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Getting quotas for user 5d3d49f848ba4735a2ed7b077d6789d5 and project 6bfc77ffb53d4f53b5afc9d0b6313cf5. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:40:52.912319 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0d50cb8b-8428-4b03-83f5-cef1c421d3f9 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:52.922952 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0d50cb8b-8428-4b03-83f5-cef1c421d3f9 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727" status: 200 len: 1723 microversion: 2.1 time: 0.538943 Aug 04 16:40:52.924018 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 777/1558] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:52 2022] GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727 => generated 1723 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:52.937928 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dc2425d0-8664-42b4-b700-c44ab6db01d3 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:52.938667 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-dc2425d0-8664-42b4-b700-c44ab6db01d3 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:52.949697 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dc2425d0-8664-42b4-b700-c44ab6db01d3 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:52.950783 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dc2425d0-8664-42b4-b700-c44ab6db01d3 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:52.951796 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dc2425d0-8664-42b4-b700-c44ab6db01d3 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:52.952455 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dc2425d0-8664-42b4-b700-c44ab6db01d3 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:53.171434 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-dc2425d0-8664-42b4-b700-c44ab6db01d3 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:53.189444 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dc2425d0-8664-42b4-b700-c44ab6db01d3 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1469 microversion: 2.1 time: 0.264024 Aug 04 16:40:53.206064 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 778/1559] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:52 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1469 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:53.210449 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9fd19960-2074-4022-9e7a-5348b5bdda25 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:40:53.215264 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9fd19960-2074-4022-9e7a-5348b5bdda25 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='db395c52-c134-4d46-a278-3f3919ab13bb',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='f03ffcba-1dc5-4ce3-8169-a1fcf5c95212',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='74db1645-3aa9-45ae-b6ff-15488e757a34',volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:40:53.218661 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b18f0045-aee2-40bf-a17d-4fc329ab22b9 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:53.220114 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b18f0045-aee2-40bf-a17d-4fc329ab22b9 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: 95a1d0a6-3d88-4b0d-ba60-b1972539d2bd] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:53.237983 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b18f0045-aee2-40bf-a17d-4fc329ab22b9 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:53.238581 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b18f0045-aee2-40bf-a17d-4fc329ab22b9 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:53.240807 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b18f0045-aee2-40bf-a17d-4fc329ab22b9 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:53.242867 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b18f0045-aee2-40bf-a17d-4fc329ab22b9 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:53.855510 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b18f0045-aee2-40bf-a17d-4fc329ab22b9 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23cc8f30e1f94ff0a520a071e5d81728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb25e78b70ee48c99471d78e00e5949c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:53.868571 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b18f0045-aee2-40bf-a17d-4fc329ab22b9 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd" status: 200 len: 1316 microversion: 2.1 time: 0.657918 Aug 04 16:40:53.885540 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 779/1560] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:53 2022] GET /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd => generated 1316 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:53.891769 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8b783d95-1c73-4abe-aa06-2f6d5f7fd7d1 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:53.904001 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:40:53.904001 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:40:53.918263 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8b783d95-1c73-4abe-aa06-2f6d5f7fd7d1 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:53.920159 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8b783d95-1c73-4abe-aa06-2f6d5f7fd7d1 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:53.921236 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8b783d95-1c73-4abe-aa06-2f6d5f7fd7d1 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:53.926069 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8b783d95-1c73-4abe-aa06-2f6d5f7fd7d1 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:53.997047 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:40:54.051589 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8b783d95-1c73-4abe-aa06-2f6d5f7fd7d1 tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.166287 Aug 04 16:40:54.067976 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 780/1561] 10.222.0.23 () {60 vars in 1217 bytes} [Thu Aug 4 16:40:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:40:54.079521 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4b4efe67-8731-4e9a-a6a3-902bffe844e2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:54.080233 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4b4efe67-8731-4e9a-a6a3-902bffe844e2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:54.097262 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b4efe67-8731-4e9a-a6a3-902bffe844e2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:54.098320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b4efe67-8731-4e9a-a6a3-902bffe844e2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:54.102718 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b4efe67-8731-4e9a-a6a3-902bffe844e2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:54.103628 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b4efe67-8731-4e9a-a6a3-902bffe844e2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:54.138873 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9fd19960-2074-4022-9e7a-5348b5bdda25 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 11.963534 Aug 04 16:40:54.148467 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 782/1562] 10.222.0.23 () {62 vars in 1189 bytes} [Thu Aug 4 16:40:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 11974 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 16:40:54.155175 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5026c931-7361-4929-b167-0290f02ec25f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:54.158654 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5026c931-7361-4929-b167-0290f02ec25f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:54.179160 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5026c931-7361-4929-b167-0290f02ec25f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:54.181688 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5026c931-7361-4929-b167-0290f02ec25f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:54.182873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5026c931-7361-4929-b167-0290f02ec25f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:54.184486 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5026c931-7361-4929-b167-0290f02ec25f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:54.186896 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b4efe67-8731-4e9a-a6a3-902bffe844e2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:54.187434 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b4efe67-8731-4e9a-a6a3-902bffe844e2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:54.193897 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-4b4efe67-8731-4e9a-a6a3-902bffe844e2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lazy-loading 'fault' on Instance uuid 637703de-2520-4512-bf57-9b811b7769d4 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:40:54.347924 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4b4efe67-8731-4e9a-a6a3-902bffe844e2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:54.366272 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4b4efe67-8731-4e9a-a6a3-902bffe844e2 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 200 len: 1189 microversion: 2.1 time: 0.297787 Aug 04 16:40:54.368003 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 781/1563] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:54 2022] GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 1189 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:54.388522 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c9df7697-c624-49e4-b114-0b2afa955e2d tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-846466-12", "block_migration": "auto"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:40:54.399901 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c9df7697-c624-49e4-b114-0b2afa955e2d tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:54.417175 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9df7697-c624-49e4-b114-0b2afa955e2d tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:54.422505 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9df7697-c624-49e4-b114-0b2afa955e2d tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:54.426157 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9df7697-c624-49e4-b114-0b2afa955e2d tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:54.426727 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9df7697-c624-49e4-b114-0b2afa955e2d tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:54.515047 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-c9df7697-c624-49e4-b114-0b2afa955e2d tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lazy-loading 'flavor' on Instance uuid 3dfa867e-8758-47d0-9256-3c864b36e819 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:40:54.555922 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c9df7697-c624-49e4-b114-0b2afa955e2d tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Going to try to live migrate instance to n-h2-846466-12 {{(pid=126126) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 16:40:54.796182 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5026c931-7361-4929-b167-0290f02ec25f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:54.815144 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5026c931-7361-4929-b167-0290f02ec25f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727" status: 200 len: 1723 microversion: 2.1 time: 0.664990 Aug 04 16:40:54.827551 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 783/1564] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:54 2022] GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727 => generated 1723 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:54.837636 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-08dbdbd6-cf68-4585-afc1-7772bdd826f0 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:54.838326 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-08dbdbd6-cf68-4585-afc1-7772bdd826f0 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:55.445364 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-08dbdbd6-cf68-4585-afc1-7772bdd826f0 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:55.491539 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-08dbdbd6-cf68-4585-afc1-7772bdd826f0 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:55.496580 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-08dbdbd6-cf68-4585-afc1-7772bdd826f0 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:55.510904 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-08dbdbd6-cf68-4585-afc1-7772bdd826f0 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1285 microversion: 2.32 time: 0.665286 Aug 04 16:40:55.533506 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 784/1565] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:40:54 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1285 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:40:55.551774 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8fa6dfbb-2cf9-45e7-9757-56e306174e61 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:55.552572 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8fa6dfbb-2cf9-45e7-9757-56e306174e61 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:55.597321 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8fa6dfbb-2cf9-45e7-9757-56e306174e61 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:55.601659 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8fa6dfbb-2cf9-45e7-9757-56e306174e61 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:55.604210 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8fa6dfbb-2cf9-45e7-9757-56e306174e61 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:55.604676 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8fa6dfbb-2cf9-45e7-9757-56e306174e61 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:56.025163 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8fa6dfbb-2cf9-45e7-9757-56e306174e61 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:56.040993 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8fa6dfbb-2cf9-45e7-9757-56e306174e61 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1462 microversion: 2.1 time: 0.506033 Aug 04 16:40:56.055942 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 785/1566] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:55 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1462 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:56.087290 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d6639f9e-3959-4599-8101-b7c15c24a93b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:56.090546 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d6639f9e-3959-4599-8101-b7c15c24a93b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: 95a1d0a6-3d88-4b0d-ba60-b1972539d2bd] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:56.114154 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d6639f9e-3959-4599-8101-b7c15c24a93b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:56.115232 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d6639f9e-3959-4599-8101-b7c15c24a93b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:56.117735 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d6639f9e-3959-4599-8101-b7c15c24a93b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:56.118749 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d6639f9e-3959-4599-8101-b7c15c24a93b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:56.619100 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d6639f9e-3959-4599-8101-b7c15c24a93b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23cc8f30e1f94ff0a520a071e5d81728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb25e78b70ee48c99471d78e00e5949c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:56.683647 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d6639f9e-3959-4599-8101-b7c15c24a93b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd" status: 200 len: 1504 microversion: 2.1 time: 0.622243 Aug 04 16:40:56.688966 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 786/1567] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:56 2022] GET /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd => generated 1504 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:56.742547 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-15dc5381-0b35-41c8-864b-77226ff4a124 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:56.744125 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-15dc5381-0b35-41c8-864b-77226ff4a124 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: 637703de-2520-4512-bf57-9b811b7769d4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:56.766131 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-15dc5381-0b35-41c8-864b-77226ff4a124 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:56.767153 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-15dc5381-0b35-41c8-864b-77226ff4a124 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:56.768995 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-15dc5381-0b35-41c8-864b-77226ff4a124 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:56.769711 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-15dc5381-0b35-41c8-864b-77226ff4a124 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:56.799387 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-15dc5381-0b35-41c8-864b-77226ff4a124 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] HTTP exception thrown: Instance 637703de-2520-4512-bf57-9b811b7769d4 could not be found. Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-15dc5381-0b35-41c8-864b-77226ff4a124 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Request method failure captured: Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 HTTP/1.1 Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_TPS6aZuKxMYL7CvYdF5h6eTzUUfuaynC642KfGogzjdTdN7-PawOFY-6_UEI3Y985iNqxJBN1SEbOCosjMlSANhdnevytUzMwNwPy5JAn6DdbkBJqMxeFRLQMHuPIcsN7nNO7aDzKbnNDUgez5GVgbgfz5kz_J_E0BJY1XEX6dRy8 Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 82b3a898ed4b4e0a82ae35830cb00ca9 Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-LiveMigrationTest-403086797 Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/82b3a898ed4b4e0a82ae35830cb00ca9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_82b3a898ed4b4e0a82ae35830cb00ca9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/82b3a898ed4b4e0a82ae35830cb00ca9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/82b3a898ed4b4e0a82ae35830cb00ca9"}]}] Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-LiveMigrationTest-403086797 Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 82b3a898ed4b4e0a82ae35830cb00ca9 Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-LiveMigrationTest-403086797 Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-LiveMigrationTest-403086797-project Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 51b742cff6a948d0883501917706f66e Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-LiveMigrationTest-403086797-project Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 637703de-2520-4512-bf57-9b811b7769d4 could not be found. Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '637703de-2520-4512-bf57-9b811b7769d4'} Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 637703de-2520-4512-bf57-9b811b7769d4 could not be found. Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 637703de-2520-4512-bf57-9b811b7769d4 could not be found. Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:40:56.803441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:40:56.808657 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:40:56.808657 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:40:56.808657 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:40:56.808657 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:40:56.808657 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:40:56.808657 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 637703de-2520-4512-bf57-9b811b7769d4 could not be found. Aug 04 16:40:56.808657 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:40:56.823761 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-15dc5381-0b35-41c8-864b-77226ff4a124 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Returning 404 to user: Instance 637703de-2520-4512-bf57-9b811b7769d4 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:40:56.825075 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-15dc5381-0b35-41c8-864b-77226ff4a124 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4" status: 404 len: 111 microversion: 2.1 time: 0.131761 Aug 04 16:40:56.826237 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 787/1568] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:56 2022] GET /compute/v2.1/servers/637703de-2520-4512-bf57-9b811b7769d4 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:40:56.831706 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d065486b-61b2-48aa-8c4f-b4a0816b898d tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:56.832694 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d065486b-61b2-48aa-8c4f-b4a0816b898d tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:56.855797 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d065486b-61b2-48aa-8c4f-b4a0816b898d tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:56.856247 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d065486b-61b2-48aa-8c4f-b4a0816b898d tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:56.857304 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d065486b-61b2-48aa-8c4f-b4a0816b898d tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:56.857966 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d065486b-61b2-48aa-8c4f-b4a0816b898d tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:57.280769 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d065486b-61b2-48aa-8c4f-b4a0816b898d tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:40:57.313499 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d065486b-61b2-48aa-8c4f-b4a0816b898d tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727" status: 200 len: 1729 microversion: 2.1 time: 0.485470 Aug 04 16:40:57.326640 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 788/1569] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:56 2022] GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727 => generated 1729 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:57.338956 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fe8d58a1-b7d5-4567-b12d-09c273212292 tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:57.339927 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fe8d58a1-b7d5-4567-b12d-09c273212292 tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:57.361527 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fe8d58a1-b7d5-4567-b12d-09c273212292 tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:57.362319 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fe8d58a1-b7d5-4567-b12d-09c273212292 tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:57.364698 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fe8d58a1-b7d5-4567-b12d-09c273212292 tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:57.366068 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fe8d58a1-b7d5-4567-b12d-09c273212292 tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:57.921935 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fe8d58a1-b7d5-4567-b12d-09c273212292 tempest-MigrationsAdminTest-499433933 tempest-MigrationsAdminTest-499433933-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1615 microversion: 2.1 time: 0.594007 Aug 04 16:40:57.936815 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 789/1570] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:40:57 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1615 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:40:57.964415 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-03136498-1a24-44e2-86ab-d157631aa7fb tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:40:57.971833 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-03136498-1a24-44e2-86ab-d157631aa7fb tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:40:58.021381 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-03136498-1a24-44e2-86ab-d157631aa7fb tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:58.022294 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-03136498-1a24-44e2-86ab-d157631aa7fb tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:58.026486 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-03136498-1a24-44e2-86ab-d157631aa7fb tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:40:58.032658 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-03136498-1a24-44e2-86ab-d157631aa7fb tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:40:59.989385 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-03136498-1a24-44e2-86ab-d157631aa7fb tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:00.013725 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-03136498-1a24-44e2-86ab-d157631aa7fb tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:00.015905 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-03136498-1a24-44e2-86ab-d157631aa7fb tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:00.018262 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-03136498-1a24-44e2-86ab-d157631aa7fb tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1593 microversion: 2.32 time: 2.078389 Aug 04 16:41:00.034745 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 790/1571] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:40:57 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1593 bytes in 2097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:00.040714 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-26de7fab-f7b1-456f-9455-b9acd5bffa3b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-704475454"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:00.041624 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-26de7fab-f7b1-456f-9455-b9acd5bffa3b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: 95a1d0a6-3d88-4b0d-ba60-b1972539d2bd] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:00.053962 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-26de7fab-f7b1-456f-9455-b9acd5bffa3b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:00.054845 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-26de7fab-f7b1-456f-9455-b9acd5bffa3b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:00.058257 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-26de7fab-f7b1-456f-9455-b9acd5bffa3b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:00.063950 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-26de7fab-f7b1-456f-9455-b9acd5bffa3b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:00.824342 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.network.security_group_api [None req-26de7fab-f7b1-456f-9455-b9acd5bffa3b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Adding security group 26fe7344-0b29-43f4-8ca4-b71316c8dded to port a6403208-7435-4b06-b55d-2373bc1a3cd3 Aug 04 16:41:01.037011 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c9df7697-c624-49e4-b114-0b2afa955e2d tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819/action" status: 202 len: 0 microversion: 2.25 time: 6.667626 Aug 04 16:41:01.037924 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 782/1572] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Aug 4 16:40:54 2022] POST /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819/action => generated 0 bytes in 6669 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:41:01.043286 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a29fabbb-470a-4b45-a8a2-d64a5d56a9fa tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:01.044624 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a29fabbb-470a-4b45-a8a2-d64a5d56a9fa tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:01.068177 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a29fabbb-470a-4b45-a8a2-d64a5d56a9fa tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:01.068673 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a29fabbb-470a-4b45-a8a2-d64a5d56a9fa tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:01.069517 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a29fabbb-470a-4b45-a8a2-d64a5d56a9fa tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:01.069951 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a29fabbb-470a-4b45-a8a2-d64a5d56a9fa tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:01.426065 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a29fabbb-470a-4b45-a8a2-d64a5d56a9fa tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.378046 Aug 04 16:41:01.429966 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 783/1573] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Aug 4 16:41:01 2022] GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727/os-interface => generated 284 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:01.448704 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-54dd99ba-a424-4567-b5d7-de2d5b90bdd9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:01.449213 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-54dd99ba-a424-4567-b5d7-de2d5b90bdd9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:01.485944 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-54dd99ba-a424-4567-b5d7-de2d5b90bdd9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:01.486396 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-54dd99ba-a424-4567-b5d7-de2d5b90bdd9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:01.487219 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-54dd99ba-a424-4567-b5d7-de2d5b90bdd9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:01.487640 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-54dd99ba-a424-4567-b5d7-de2d5b90bdd9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:01.585583 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-54dd99ba-a424-4567-b5d7-de2d5b90bdd9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:41:01.834733 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-54dd99ba-a424-4567-b5d7-de2d5b90bdd9 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "DELETE /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 204 len: 0 microversion: 2.1 time: 0.401029 Aug 04 16:41:01.838213 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 784/1574] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:41:01 2022] DELETE /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:41:02.118050 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dc6ae9fe-909d-45f0-816c-e5cd4920dab0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Action: 'create', calling method: .version_select at 0x7f7e84bec4c0>, body: {"keypair": {"name": "tempest-keypair-496783257", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCuWVuwzyjuyE6Whj2Q3zP5Adojmay65i7tFv2hT+kbN6RF/nzdwdC0G2rp0npZvH46Q793HMOPmCr5KyJJvR93758bPmJVqA84vSN8ENwjbo80bzCY9xDjjQFSm7ZjAag=="}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:02.193384 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-dc6ae9fe-909d-45f0-816c-e5cd4920dab0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Getting quotas for project 96ce955c9158463e9e98c53b99c581ec. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:41:02.223378 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-dc6ae9fe-909d-45f0-816c-e5cd4920dab0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Getting quotas for user 438d083dc9e74b2f8970455505791250 and project 96ce955c9158463e9e98c53b99c581ec. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:41:02.288914 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:41:02.313986 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dc6ae9fe-909d-45f0-816c-e5cd4920dab0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.467117 Aug 04 16:41:02.315165 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 785/1575] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 16:41:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:02.330885 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-a1f8720b-b320-4078-94b9-e1c5cb2a7be8 req-037dfab0-675f-483f-9f05-9eb6c814c0e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89ab07c4-6179-48f5-9ac4-053c6070ed42", "name": "network-vif-plugged", "status": "completed", "tag": "ffbb5a20-fa64-4e0b-8e0b-f2163a520c8f"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:02.352696 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a1f8720b-b320-4078-94b9-e1c5cb2a7be8 req-037dfab0-675f-483f-9f05-9eb6c814c0e8 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:02.355443 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a1f8720b-b320-4078-94b9-e1c5cb2a7be8 req-037dfab0-675f-483f-9f05-9eb6c814c0e8 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:02.389453 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-a1f8720b-b320-4078-94b9-e1c5cb2a7be8 req-037dfab0-675f-483f-9f05-9eb6c814c0e8 service nova] Creating event network-vif-plugged:ffbb5a20-fa64-4e0b-8e0b-f2163a520c8f for instance 89ab07c4-6179-48f5-9ac4-053c6070ed42 on n-h2-846466-12 Aug 04 16:41:02.411204 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-a1f8720b-b320-4078-94b9-e1c5cb2a7be8 req-037dfab0-675f-483f-9f05-9eb6c814c0e8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094184 Aug 04 16:41:02.414284 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 786/1576] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:02.430704 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fd46642f-9f5c-407b-960c-3ba0f5b36403 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:02.434584 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fd46642f-9f5c-407b-960c-3ba0f5b36403 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:02.452193 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fd46642f-9f5c-407b-960c-3ba0f5b36403 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:02.453320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fd46642f-9f5c-407b-960c-3ba0f5b36403 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:02.457507 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fd46642f-9f5c-407b-960c-3ba0f5b36403 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:02.458607 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fd46642f-9f5c-407b-960c-3ba0f5b36403 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:02.552713 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:41:03.737818 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-26de7fab-f7b1-456f-9455-b9acd5bffa3b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "POST /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd/action" status: 202 len: 0 microversion: 2.1 time: 3.701508 Aug 04 16:41:03.739307 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 791/1577] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:41:00 2022] POST /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd/action => generated 0 bytes in 3704 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:41:03.744536 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-73bfb591-2c27-4b74-891d-bcda9d17b8b4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:03.745954 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-73bfb591-2c27-4b74-891d-bcda9d17b8b4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:03.768064 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-73bfb591-2c27-4b74-891d-bcda9d17b8b4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:03.776845 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-73bfb591-2c27-4b74-891d-bcda9d17b8b4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:03.779790 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-73bfb591-2c27-4b74-891d-bcda9d17b8b4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:03.787389 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-73bfb591-2c27-4b74-891d-bcda9d17b8b4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:03.972311 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:41:05.481733 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=8 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:41:05.666954 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fd46642f-9f5c-407b-960c-3ba0f5b36403 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:05.699649 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fd46642f-9f5c-407b-960c-3ba0f5b36403 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:05.701917 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fd46642f-9f5c-407b-960c-3ba0f5b36403 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:05.709888 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fd46642f-9f5c-407b-960c-3ba0f5b36403 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1660 microversion: 2.32 time: 3.290008 Aug 04 16:41:05.712961 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 787/1578] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:02 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1660 bytes in 3298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:05.728418 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-87d309bc-ac10-4327-9eb0-2d4956a28e1b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:05.746564 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-87d309bc-ac10-4327-9eb0-2d4956a28e1b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:05.779789 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-87d309bc-ac10-4327-9eb0-2d4956a28e1b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:05.780784 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-87d309bc-ac10-4327-9eb0-2d4956a28e1b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:05.781519 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-87d309bc-ac10-4327-9eb0-2d4956a28e1b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:05.783427 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-87d309bc-ac10-4327-9eb0-2d4956a28e1b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:05.793541 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-73bfb591-2c27-4b74-891d-bcda9d17b8b4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:05.829929 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-73bfb591-2c27-4b74-891d-bcda9d17b8b4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:05.832192 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-73bfb591-2c27-4b74-891d-bcda9d17b8b4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:05.836488 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-73bfb591-2c27-4b74-891d-bcda9d17b8b4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1487 microversion: 2.25 time: 2.093785 Aug 04 16:41:05.841012 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 792/1579] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:03 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1487 bytes in 2101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:05.846478 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0415a239-0baf-412d-b680-3bf642852e9d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1924907579"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:05.851296 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0415a239-0baf-412d-b680-3bf642852e9d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: 95a1d0a6-3d88-4b0d-ba60-b1972539d2bd] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:05.865017 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0415a239-0baf-412d-b680-3bf642852e9d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:05.868240 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0415a239-0baf-412d-b680-3bf642852e9d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:05.869534 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0415a239-0baf-412d-b680-3bf642852e9d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:05.871185 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0415a239-0baf-412d-b680-3bf642852e9d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:06.820873 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-87d309bc-ac10-4327-9eb0-2d4956a28e1b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:06.840581 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-87d309bc-ac10-4327-9eb0-2d4956a28e1b tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 200 len: 1468 microversion: 2.1 time: 1.119431 Aug 04 16:41:06.850896 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 788/1580] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:41:05 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 1468 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:41:06.863113 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-bf017b50-df1d-4db5-953d-27f8b8d88793 req-76cc5a9c-158d-4ac2-bed2-a1202566603c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95a1d0a6-3d88-4b0d-ba60-b1972539d2bd", "tag": "a6403208-7435-4b06-b55d-2373bc1a3cd3"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:06.910502 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-bf017b50-df1d-4db5-953d-27f8b8d88793 req-76cc5a9c-158d-4ac2-bed2-a1202566603c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:06.915962 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-bf017b50-df1d-4db5-953d-27f8b8d88793 req-76cc5a9c-158d-4ac2-bed2-a1202566603c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:06.974300 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.network.security_group_api [None req-0415a239-0baf-412d-b680-3bf642852e9d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Adding security group b84e1c25-dbc9-4bdf-9a4e-f79d71f521ff to port a6403208-7435-4b06-b55d-2373bc1a3cd3 Aug 04 16:41:06.979022 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-bf017b50-df1d-4db5-953d-27f8b8d88793 req-76cc5a9c-158d-4ac2-bed2-a1202566603c service nova] Creating event network-changed:a6403208-7435-4b06-b55d-2373bc1a3cd3 for instance 95a1d0a6-3d88-4b0d-ba60-b1972539d2bd on n-h1-846466-12 Aug 04 16:41:06.991608 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-bf017b50-df1d-4db5-953d-27f8b8d88793 req-76cc5a9c-158d-4ac2-bed2-a1202566603c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140225 Aug 04 16:41:06.993860 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 789/1581] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:07.014498 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-717ef7e5-f137-4bf9-a86e-0a8d4260aea0 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:07.017441 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-717ef7e5-f137-4bf9-a86e-0a8d4260aea0 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:07.035993 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-717ef7e5-f137-4bf9-a86e-0a8d4260aea0 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:07.038031 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-717ef7e5-f137-4bf9-a86e-0a8d4260aea0 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:07.040362 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-717ef7e5-f137-4bf9-a86e-0a8d4260aea0 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:07.042428 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-717ef7e5-f137-4bf9-a86e-0a8d4260aea0 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:09.373663 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-717ef7e5-f137-4bf9-a86e-0a8d4260aea0 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:09.460728 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-717ef7e5-f137-4bf9-a86e-0a8d4260aea0 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:09.483771 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-717ef7e5-f137-4bf9-a86e-0a8d4260aea0 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:09.493646 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-717ef7e5-f137-4bf9-a86e-0a8d4260aea0 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1660 microversion: 2.32 time: 2.490974 Aug 04 16:41:09.523077 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 790/1582] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:06 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1660 bytes in 2523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:09.567285 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b5215741-3378-476e-855c-628a311cff03 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:09.571369 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b5215741-3378-476e-855c-628a311cff03 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:09.603831 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b5215741-3378-476e-855c-628a311cff03 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:09.605195 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b5215741-3378-476e-855c-628a311cff03 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:09.610299 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b5215741-3378-476e-855c-628a311cff03 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:09.611845 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b5215741-3378-476e-855c-628a311cff03 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:10.835923 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b5215741-3378-476e-855c-628a311cff03 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:10.904768 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0415a239-0baf-412d-b680-3bf642852e9d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "POST /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd/action" status: 202 len: 0 microversion: 2.1 time: 5.062090 Aug 04 16:41:10.906301 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 793/1583] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:41:05 2022] POST /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd/action => generated 0 bytes in 5064 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:41:10.918596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-952de30d-5d3b-41cb-a491-ee67d7d10bf7 req-aca309d8-ba18-4a05-91e1-7579c83ed061 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c83347-17c8-4872-ae95-36497fd7a727", "tag": "6c385fdf-9a65-4ff1-871c-2cc8e59eef38"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:10.920845 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b5215741-3378-476e-855c-628a311cff03 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:10.941556 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b5215741-3378-476e-855c-628a311cff03 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:10.959743 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b5215741-3378-476e-855c-628a311cff03 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1487 microversion: 2.25 time: 1.407132 Aug 04 16:41:10.963114 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 791/1584] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:09 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1487 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:10.985638 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:41:10.990140 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-952de30d-5d3b-41cb-a491-ee67d7d10bf7 req-aca309d8-ba18-4a05-91e1-7579c83ed061 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:10.993188 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ad4f65ee-1d13-47b0-adc2-b233ffdfe76a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:11.007083 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ad4f65ee-1d13-47b0-adc2-b233ffdfe76a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 89ab07c4-6179-48f5-9ac4-053c6070ed42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:11.008194 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-952de30d-5d3b-41cb-a491-ee67d7d10bf7 req-aca309d8-ba18-4a05-91e1-7579c83ed061 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:11.040258 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad4f65ee-1d13-47b0-adc2-b233ffdfe76a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:11.048084 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad4f65ee-1d13-47b0-adc2-b233ffdfe76a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:11.050161 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad4f65ee-1d13-47b0-adc2-b233ffdfe76a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:11.051552 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad4f65ee-1d13-47b0-adc2-b233ffdfe76a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:11.109921 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-952de30d-5d3b-41cb-a491-ee67d7d10bf7 req-aca309d8-ba18-4a05-91e1-7579c83ed061 service nova] Creating event network-changed:6c385fdf-9a65-4ff1-871c-2cc8e59eef38 for instance b0c83347-17c8-4872-ae95-36497fd7a727 on n-h1-846466-12 Aug 04 16:41:11.171332 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-ad4f65ee-1d13-47b0-adc2-b233ffdfe76a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] HTTP exception thrown: Instance 89ab07c4-6179-48f5-9ac4-053c6070ed42 could not be found. Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ad4f65ee-1d13-47b0-adc2-b233ffdfe76a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Request method failure captured: Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 HTTP/1.1 Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_UNjyrdUtTWtUOVfvm9QCW4-h1rMjjcmnLuFclAR379GwHgC9qkbHaVs91LVnb5xlIDnCR7AfJ7Y7lX8rND5VAEY3XelUoM35o-NGXV_btI6qgXx2jm_QiZeT_LP2XvfNkriTBvHPg1CBc3ThfmjCpC6UQ0aHUMHnzoDunnCk8HwjE Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: c456fd996bb544478bdb39c6a7ca04a6 Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-MigrationsAdminTest-574448974 Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c456fd996bb544478bdb39c6a7ca04a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c456fd996bb544478bdb39c6a7ca04a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c456fd996bb544478bdb39c6a7ca04a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c456fd996bb544478bdb39c6a7ca04a6"}]}] Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-MigrationsAdminTest-574448974 Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: c456fd996bb544478bdb39c6a7ca04a6 Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-MigrationsAdminTest-574448974 Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-MigrationsAdminTest-574448974-project Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 6e582cea96b64285b4232b96162a274c Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-MigrationsAdminTest-574448974-project Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 89ab07c4-6179-48f5-9ac4-053c6070ed42 could not be found. Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '89ab07c4-6179-48f5-9ac4-053c6070ed42'} Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89ab07c4-6179-48f5-9ac4-053c6070ed42 could not be found. Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89ab07c4-6179-48f5-9ac4-053c6070ed42 could not be found. Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:41:11.181465 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:41:11.210077 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:11.210077 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:41:11.210077 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:41:11.210077 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:41:11.210077 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:41:11.210077 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89ab07c4-6179-48f5-9ac4-053c6070ed42 could not be found. Aug 04 16:41:11.210077 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:41:11.210077 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ad4f65ee-1d13-47b0-adc2-b233ffdfe76a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Returning 404 to user: Instance 89ab07c4-6179-48f5-9ac4-053c6070ed42 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:41:11.210077 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ad4f65ee-1d13-47b0-adc2-b233ffdfe76a tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42" status: 404 len: 111 microversion: 2.1 time: 0.223272 Aug 04 16:41:11.210077 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 792/1585] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:41:10 2022] GET /compute/v2.1/servers/89ab07c4-6179-48f5-9ac4-053c6070ed42 => generated 111 bytes in 233 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:41:11.235566 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-57a68c48-924c-4795-912e-79e5bf3e4f65 req-a09afbc2-ace2-4d00-91fb-17bf900a2fda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89ab07c4-6179-48f5-9ac4-053c6070ed42", "name": "network-vif-deleted", "tag": "ffbb5a20-fa64-4e0b-8e0b-f2163a520c8f"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:11.267519 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-952de30d-5d3b-41cb-a491-ee67d7d10bf7 req-aca309d8-ba18-4a05-91e1-7579c83ed061 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.349601 Aug 04 16:41:11.274231 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 794/1586] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:11.282240 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-57a68c48-924c-4795-912e-79e5bf3e4f65 req-a09afbc2-ace2-4d00-91fb-17bf900a2fda service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:11.282685 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-57a68c48-924c-4795-912e-79e5bf3e4f65 req-a09afbc2-ace2-4d00-91fb-17bf900a2fda service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:11.327131 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-14905bd7-3136-46d4-bde1-da66143feb74 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:11.331624 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-14905bd7-3136-46d4-bde1-da66143feb74 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:11.345266 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-57a68c48-924c-4795-912e-79e5bf3e4f65 req-a09afbc2-ace2-4d00-91fb-17bf900a2fda service nova] Creating event network-vif-deleted:ffbb5a20-fa64-4e0b-8e0b-f2163a520c8f for instance 89ab07c4-6179-48f5-9ac4-053c6070ed42 on n-h2-846466-12 Aug 04 16:41:11.363410 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-57a68c48-924c-4795-912e-79e5bf3e4f65 req-a09afbc2-ace2-4d00-91fb-17bf900a2fda service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160888 Aug 04 16:41:11.363671 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14905bd7-3136-46d4-bde1-da66143feb74 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:11.364830 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14905bd7-3136-46d4-bde1-da66143feb74 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:11.365053 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 793/1587] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:11.367536 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14905bd7-3136-46d4-bde1-da66143feb74 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:11.369209 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14905bd7-3136-46d4-bde1-da66143feb74 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:11.389825 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-40194220-af38-4f65-bbf4-d39013efb8c0 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:11.399512 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-40194220-af38-4f65-bbf4-d39013efb8c0 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: 95a1d0a6-3d88-4b0d-ba60-b1972539d2bd] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:11.417553 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-40194220-af38-4f65-bbf4-d39013efb8c0 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:11.420257 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-40194220-af38-4f65-bbf4-d39013efb8c0 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:11.423372 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-40194220-af38-4f65-bbf4-d39013efb8c0 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:11.425676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-40194220-af38-4f65-bbf4-d39013efb8c0 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:11.916430 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-14905bd7-3136-46d4-bde1-da66143feb74 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:11.938135 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-14905bd7-3136-46d4-bde1-da66143feb74 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:11.944925 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-14905bd7-3136-46d4-bde1-da66143feb74 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:11.947138 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-14905bd7-3136-46d4-bde1-da66143feb74 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1706 microversion: 2.32 time: 0.663723 Aug 04 16:41:11.962241 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 795/1588] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:11 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1706 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:11.967337 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e3052bda-05fe-4c16-87ea-9b2718bf0742 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:11.973621 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e3052bda-05fe-4c16-87ea-9b2718bf0742 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:12.012776 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3052bda-05fe-4c16-87ea-9b2718bf0742 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:12.017496 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3052bda-05fe-4c16-87ea-9b2718bf0742 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:12.021205 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3052bda-05fe-4c16-87ea-9b2718bf0742 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:12.022464 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3052bda-05fe-4c16-87ea-9b2718bf0742 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:12.116009 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e3052bda-05fe-4c16-87ea-9b2718bf0742 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:41:12.271997 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=4 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:41:12.425530 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-40194220-af38-4f65-bbf4-d39013efb8c0 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 1.059206 Aug 04 16:41:12.426294 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 794/1589] 10.222.0.23 () {58 vars in 1293 bytes} [Thu Aug 4 16:41:11 2022] GET /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd/os-security-groups => generated 1157 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:41:12.431663 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3ead119e-e61c-45d5-bfb9-b3a19690867d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:12.432432 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3ead119e-e61c-45d5-bfb9-b3a19690867d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:12.437056 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e3052bda-05fe-4c16-87ea-9b2718bf0742 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 204 len: 0 microversion: 2.1 time: 0.483405 Aug 04 16:41:12.442382 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 796/1590] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:41:11 2022] DELETE /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:41:12.455565 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-efab1e28-89ec-4d79-8898-244253223c6c tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:12.456420 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-efab1e28-89ec-4d79-8898-244253223c6c tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:12.460050 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ead119e-e61c-45d5-bfb9-b3a19690867d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:12.460920 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ead119e-e61c-45d5-bfb9-b3a19690867d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:12.462415 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ead119e-e61c-45d5-bfb9-b3a19690867d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:12.464139 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-efab1e28-89ec-4d79-8898-244253223c6c tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:12.464707 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-efab1e28-89ec-4d79-8898-244253223c6c tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:12.465662 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-efab1e28-89ec-4d79-8898-244253223c6c tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:12.465953 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ead119e-e61c-45d5-bfb9-b3a19690867d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:12.466305 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-efab1e28-89ec-4d79-8898-244253223c6c tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:13.526309 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-efab1e28-89ec-4d79-8898-244253223c6c tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:13.535133 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-efab1e28-89ec-4d79-8898-244253223c6c tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1535 microversion: 2.1 time: 1.091012 Aug 04 16:41:13.549606 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 797/1591] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:41:12 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1535 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:41:13.564066 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5168bbb5-8cb1-4ccb-9e58-1373e2c47519 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Action: 'create', calling method: .version_select at 0x7f7e8413b0d0>, body: {"security_group": {"name": " tempest-securitygroup -2088243384 ", "description": "tempest-description-2135350008"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:13.598339 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3ead119e-e61c-45d5-bfb9-b3a19690867d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:13.616280 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3ead119e-e61c-45d5-bfb9-b3a19690867d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:13.616885 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3ead119e-e61c-45d5-bfb9-b3a19690867d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:13.619022 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3ead119e-e61c-45d5-bfb9-b3a19690867d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1487 microversion: 2.25 time: 1.190805 Aug 04 16:41:13.641468 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 795/1592] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:12 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1487 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:13.650350 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-90caf686-5ca3-4c64-936d-9e190f65acf2 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:13.652602 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-90caf686-5ca3-4c64-936d-9e190f65acf2 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:13.661738 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-90caf686-5ca3-4c64-936d-9e190f65acf2 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:13.662200 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-90caf686-5ca3-4c64-936d-9e190f65acf2 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:13.663018 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-90caf686-5ca3-4c64-936d-9e190f65acf2 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:13.663464 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-90caf686-5ca3-4c64-936d-9e190f65acf2 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:14.568242 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-90caf686-5ca3-4c64-936d-9e190f65acf2 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:14.604864 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-90caf686-5ca3-4c64-936d-9e190f65acf2 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:14.609785 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-90caf686-5ca3-4c64-936d-9e190f65acf2 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:14.615359 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-90caf686-5ca3-4c64-936d-9e190f65acf2 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1706 microversion: 2.32 time: 0.971192 Aug 04 16:41:14.618825 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 796/1593] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:13 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1706 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:14.634096 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-2cf6a31a-1ea6-442f-814f-34ecc3ebb722 req-7bbbcd7d-118b-4d06-aded-e2b06ddfcab8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c83347-17c8-4872-ae95-36497fd7a727", "tag": "6c385fdf-9a65-4ff1-871c-2cc8e59eef38"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:14.664231 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-2cf6a31a-1ea6-442f-814f-34ecc3ebb722 req-7bbbcd7d-118b-4d06-aded-e2b06ddfcab8 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:14.664791 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-2cf6a31a-1ea6-442f-814f-34ecc3ebb722 req-7bbbcd7d-118b-4d06-aded-e2b06ddfcab8 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:14.704703 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-2cf6a31a-1ea6-442f-814f-34ecc3ebb722 req-7bbbcd7d-118b-4d06-aded-e2b06ddfcab8 service nova] Creating event network-changed:6c385fdf-9a65-4ff1-871c-2cc8e59eef38 for instance b0c83347-17c8-4872-ae95-36497fd7a727 on n-h1-846466-12 Aug 04 16:41:14.715097 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-2cf6a31a-1ea6-442f-814f-34ecc3ebb722 req-7bbbcd7d-118b-4d06-aded-e2b06ddfcab8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094668 Aug 04 16:41:14.720208 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 797/1594] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:14.738104 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-c8a97be3-39a8-48dc-8b9b-8beb64301f9e req-9049c0a3-dd67-4f0a-989e-c9fe36709f74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95a1d0a6-3d88-4b0d-ba60-b1972539d2bd", "tag": "a6403208-7435-4b06-b55d-2373bc1a3cd3"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:14.768681 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-c8a97be3-39a8-48dc-8b9b-8beb64301f9e req-9049c0a3-dd67-4f0a-989e-c9fe36709f74 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:14.769414 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-c8a97be3-39a8-48dc-8b9b-8beb64301f9e req-9049c0a3-dd67-4f0a-989e-c9fe36709f74 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:14.806424 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-c8a97be3-39a8-48dc-8b9b-8beb64301f9e req-9049c0a3-dd67-4f0a-989e-c9fe36709f74 service nova] Creating event network-changed:a6403208-7435-4b06-b55d-2373bc1a3cd3 for instance 95a1d0a6-3d88-4b0d-ba60-b1972539d2bd on n-h1-846466-12 Aug 04 16:41:14.823319 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-c8a97be3-39a8-48dc-8b9b-8beb64301f9e req-9049c0a3-dd67-4f0a-989e-c9fe36709f74 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097647 Aug 04 16:41:14.827117 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 798/1595] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:14.841191 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-506edbe3-85e5-4a05-a73e-b37874919800 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:14.842341 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-506edbe3-85e5-4a05-a73e-b37874919800 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:14.863700 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-506edbe3-85e5-4a05-a73e-b37874919800 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:14.867476 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-506edbe3-85e5-4a05-a73e-b37874919800 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:14.868984 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-506edbe3-85e5-4a05-a73e-b37874919800 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:14.872427 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-506edbe3-85e5-4a05-a73e-b37874919800 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:14.888864 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:41:15.422333 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5168bbb5-8cb1-4ccb-9e58-1373e2c47519 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 1.872352 Aug 04 16:41:15.423089 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 798/1596] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Aug 4 16:41:13 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 1874 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:15.430482 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-156e8215-4c16-43eb-ab57-67215f69788d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:15.431576 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-156e8215-4c16-43eb-ab57-67215f69788d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:15.454688 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-156e8215-4c16-43eb-ab57-67215f69788d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:15.458271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-156e8215-4c16-43eb-ab57-67215f69788d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:15.459478 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-156e8215-4c16-43eb-ab57-67215f69788d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:15.465087 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-156e8215-4c16-43eb-ab57-67215f69788d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:15.539643 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-156e8215-4c16-43eb-ab57-67215f69788d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:41:15.733973 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:41:15.820367 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-156e8215-4c16-43eb-ab57-67215f69788d tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159" status: 204 len: 0 microversion: 2.1 time: 0.395548 Aug 04 16:41:15.825091 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 799/1597] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:41:15 2022] DELETE /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:41:15.836333 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7d4d0fbf-bb6b-402b-8863-02efa80ec88d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:15.839153 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7d4d0fbf-bb6b-402b-8863-02efa80ec88d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:15.859035 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d4d0fbf-bb6b-402b-8863-02efa80ec88d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:15.859505 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d4d0fbf-bb6b-402b-8863-02efa80ec88d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:15.863489 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d4d0fbf-bb6b-402b-8863-02efa80ec88d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:15.866808 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d4d0fbf-bb6b-402b-8863-02efa80ec88d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:15.978931 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-506edbe3-85e5-4a05-a73e-b37874919800 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:15.993443 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-506edbe3-85e5-4a05-a73e-b37874919800 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1535 microversion: 2.1 time: 1.164570 Aug 04 16:41:15.998439 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 799/1598] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:41:14 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1535 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:41:16.005007 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7b795aa0-4005-4743-9dab-f6acda49d530 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '.version_select at 0x7f7e84fcc550>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:16.367275 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7b795aa0-4005-4743-9dab-f6acda49d530 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/0fcf40ae-f583-49f9-996d-0a6b171ed7e0" status: 200 len: 224 microversion: 2.1 time: 0.367200 Aug 04 16:41:16.370450 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 800/1599] 10.222.0.23 () {58 vars in 1269 bytes} [Thu Aug 4 16:41:15 2022] GET /compute/v2.1/os-security-groups/0fcf40ae-f583-49f9-996d-0a6b171ed7e0 => generated 224 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:16.387534 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0f06a7e5-e1f6-455f-8b27-308b28554a63 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:16.392845 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0f06a7e5-e1f6-455f-8b27-308b28554a63 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:16.407559 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0f06a7e5-e1f6-455f-8b27-308b28554a63 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:16.408284 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0f06a7e5-e1f6-455f-8b27-308b28554a63 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:16.409346 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0f06a7e5-e1f6-455f-8b27-308b28554a63 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:16.409964 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0f06a7e5-e1f6-455f-8b27-308b28554a63 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:17.912538 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7d4d0fbf-bb6b-402b-8863-02efa80ec88d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:17.927571 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7d4d0fbf-bb6b-402b-8863-02efa80ec88d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:17.934519 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7d4d0fbf-bb6b-402b-8863-02efa80ec88d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:17.943593 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7d4d0fbf-bb6b-402b-8863-02efa80ec88d tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1487 microversion: 2.25 time: 2.118954 Aug 04 16:41:17.944493 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 800/1600] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:15 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1487 bytes in 2121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:17.963837 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d4c0c6e9-dfcd-4bc0-b18f-d521abf54a9c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:17.975307 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d4c0c6e9-dfcd-4bc0-b18f-d521abf54a9c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:17.995220 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d4c0c6e9-dfcd-4bc0-b18f-d521abf54a9c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:17.996192 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d4c0c6e9-dfcd-4bc0-b18f-d521abf54a9c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:17.998019 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d4c0c6e9-dfcd-4bc0-b18f-d521abf54a9c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:18.001007 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d4c0c6e9-dfcd-4bc0-b18f-d521abf54a9c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:18.572641 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0f06a7e5-e1f6-455f-8b27-308b28554a63 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:18.594479 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0f06a7e5-e1f6-455f-8b27-308b28554a63 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:18.598089 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0f06a7e5-e1f6-455f-8b27-308b28554a63 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:18.605449 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0f06a7e5-e1f6-455f-8b27-308b28554a63 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1752 microversion: 2.32 time: 2.221182 Aug 04 16:41:18.609074 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 801/1601] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:16 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1752 bytes in 2227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:18.620547 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6abe0d32-23ba-4e39-a62d-4aebb9531883 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '.version_select at 0x7f7e84b6fa60>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:18.654225 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d4c0c6e9-dfcd-4bc0-b18f-d521abf54a9c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:18.663847 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d4c0c6e9-dfcd-4bc0-b18f-d521abf54a9c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159" status: 200 len: 1599 microversion: 2.1 time: 0.704808 Aug 04 16:41:18.670145 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 801/1602] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:41:17 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159 => generated 1599 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:41:18.686274 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-28df9c90-474a-4186-a1ea-8c37fd7b54e2 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:18.691243 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-28df9c90-474a-4186-a1ea-8c37fd7b54e2 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:18.722913 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-28df9c90-474a-4186-a1ea-8c37fd7b54e2 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:18.725731 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-28df9c90-474a-4186-a1ea-8c37fd7b54e2 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:18.728469 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-28df9c90-474a-4186-a1ea-8c37fd7b54e2 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:18.730340 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-28df9c90-474a-4186-a1ea-8c37fd7b54e2 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:18.970709 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-28df9c90-474a-4186-a1ea-8c37fd7b54e2 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:18.984403 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-28df9c90-474a-4186-a1ea-8c37fd7b54e2 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 200 len: 1493 microversion: 2.1 time: 0.312709 Aug 04 16:41:18.993932 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 802/1603] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:41:18 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 1493 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:41:18.999721 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-36a4038b-f8dd-42f4-9d65-100b19ecc7d6 req-f00a82ba-431a-40e2-bfea-59f09298abd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b359364c-f234-4d01-9c08-e6df8a21f159", "name": "network-vif-deleted", "tag": "490cb30e-cef0-49db-a9ae-179c72d887af"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:19.025324 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-36a4038b-f8dd-42f4-9d65-100b19ecc7d6 req-f00a82ba-431a-40e2-bfea-59f09298abd7 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:19.026213 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-36a4038b-f8dd-42f4-9d65-100b19ecc7d6 req-f00a82ba-431a-40e2-bfea-59f09298abd7 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:19.106898 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-36a4038b-f8dd-42f4-9d65-100b19ecc7d6 req-f00a82ba-431a-40e2-bfea-59f09298abd7 service nova] Creating event network-vif-deleted:490cb30e-cef0-49db-a9ae-179c72d887af for instance b359364c-f234-4d01-9c08-e6df8a21f159 on n-h2-846466-12 Aug 04 16:41:19.119150 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-36a4038b-f8dd-42f4-9d65-100b19ecc7d6 req-f00a82ba-431a-40e2-bfea-59f09298abd7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123256 Aug 04 16:41:19.120687 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 803/1604] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:19.137331 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-1a626584-ddbc-475f-bc63-0b28a546bee7 req-614e83ed-dec6-45e8-9415-f683cc33befa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1430483-b3f7-473b-80f9-15beb90cfc33", "name": "network-vif-deleted", "tag": "e435043b-4bd0-4a6c-98b0-1115388413c6"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:19.157221 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-1a626584-ddbc-475f-bc63-0b28a546bee7 req-614e83ed-dec6-45e8-9415-f683cc33befa service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:19.158532 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-1a626584-ddbc-475f-bc63-0b28a546bee7 req-614e83ed-dec6-45e8-9415-f683cc33befa service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:19.173338 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-1a626584-ddbc-475f-bc63-0b28a546bee7 req-614e83ed-dec6-45e8-9415-f683cc33befa service nova] Creating event network-vif-deleted:e435043b-4bd0-4a6c-98b0-1115388413c6 for instance d1430483-b3f7-473b-80f9-15beb90cfc33 on n-h2-846466-12 Aug 04 16:41:19.181170 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-1a626584-ddbc-475f-bc63-0b28a546bee7 req-614e83ed-dec6-45e8-9415-f683cc33befa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057928 Aug 04 16:41:19.183008 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 804/1605] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:19.193584 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ced116ca-043c-4746-9c49-0f8bffd57e96 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:19.196295 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ced116ca-043c-4746-9c49-0f8bffd57e96 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:19.207640 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ced116ca-043c-4746-9c49-0f8bffd57e96 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:19.208709 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ced116ca-043c-4746-9c49-0f8bffd57e96 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:19.210237 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ced116ca-043c-4746-9c49-0f8bffd57e96 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:19.210996 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ced116ca-043c-4746-9c49-0f8bffd57e96 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:20.016826 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ced116ca-043c-4746-9c49-0f8bffd57e96 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:20.049812 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ced116ca-043c-4746-9c49-0f8bffd57e96 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:20.058676 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ced116ca-043c-4746-9c49-0f8bffd57e96 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:20.066304 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ced116ca-043c-4746-9c49-0f8bffd57e96 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1487 microversion: 2.25 time: 0.881323 Aug 04 16:41:20.067845 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 805/1606] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:19 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1487 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:20.101934 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c6f2d03a-e286-407a-9ff4-7ee7125a01d8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1661451796", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fcd939fe-a897-44ae-b0c2-2548006a8cea"}], "security_groups": [{"name": "tempest-securitygroup--531478322"}], "key_name": "tempest-keypair-496783257", "user_data": "}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:20.531552 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-c6f2d03a-e286-407a-9ff4-7ee7125a01d8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] validate_networks() for [('fcd939fe-a897-44ae-b0c2-2548006a8cea', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:41:20.914462 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6abe0d32-23ba-4e39-a62d-4aebb9531883 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/0fcf40ae-f583-49f9-996d-0a6b171ed7e0" status: 202 len: 0 microversion: 2.1 time: 2.303334 Aug 04 16:41:20.921956 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 802/1607] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:41:18 2022] DELETE /compute/v2.1/os-security-groups/0fcf40ae-f583-49f9-996d-0a6b171ed7e0 => generated 0 bytes in 2312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:41:20.933475 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-731a057a-6241-495c-876c-49f0417d3cc0 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:20.935119 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-731a057a-6241-495c-876c-49f0417d3cc0 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:20.948538 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-731a057a-6241-495c-876c-49f0417d3cc0 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:20.949874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-731a057a-6241-495c-876c-49f0417d3cc0 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:20.951693 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-731a057a-6241-495c-876c-49f0417d3cc0 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:20.952978 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-731a057a-6241-495c-876c-49f0417d3cc0 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:21.738997 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-731a057a-6241-495c-876c-49f0417d3cc0 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:21.766617 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-731a057a-6241-495c-876c-49f0417d3cc0 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:21.773811 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-731a057a-6241-495c-876c-49f0417d3cc0 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:21.777032 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-731a057a-6241-495c-876c-49f0417d3cc0 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1752 microversion: 2.32 time: 0.851999 Aug 04 16:41:21.779121 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 803/1608] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:20 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1752 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:21.806222 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cf9d27f7-f369-49b3-b371-07d419d99717 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:21.808946 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cf9d27f7-f369-49b3-b371-07d419d99717 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: b359364c-f234-4d01-9c08-e6df8a21f159] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:21.825708 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf9d27f7-f369-49b3-b371-07d419d99717 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:21.827517 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf9d27f7-f369-49b3-b371-07d419d99717 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:21.830512 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf9d27f7-f369-49b3-b371-07d419d99717 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:21.832488 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf9d27f7-f369-49b3-b371-07d419d99717 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:21.866150 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-cf9d27f7-f369-49b3-b371-07d419d99717 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] HTTP exception thrown: Instance b359364c-f234-4d01-9c08-e6df8a21f159 could not be found. Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cf9d27f7-f369-49b3-b371-07d419d99717 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Request method failure captured: Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159 HTTP/1.1 Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_TPS6aZuKxMYL7CvYdF5h6eTzUUfuaynC642KfGogzjdTdN7-PawOFY-6_UEI3Y985iNqxJBN1SEbOCosjMlSANhdnevytUzMwNwPy5JAn6DdbkBJqMxeFRLQMHuPIcsN7nNO7aDzKbnNDUgez5GVgbgfz5kz_J_E0BJY1XEX6dRy8 Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 82b3a898ed4b4e0a82ae35830cb00ca9 Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-LiveMigrationTest-403086797 Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/82b3a898ed4b4e0a82ae35830cb00ca9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_82b3a898ed4b4e0a82ae35830cb00ca9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/82b3a898ed4b4e0a82ae35830cb00ca9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/82b3a898ed4b4e0a82ae35830cb00ca9"}]}] Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-LiveMigrationTest-403086797 Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 82b3a898ed4b4e0a82ae35830cb00ca9 Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-LiveMigrationTest-403086797 Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-LiveMigrationTest-403086797-project Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 51b742cff6a948d0883501917706f66e Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-LiveMigrationTest-403086797-project Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance b359364c-f234-4d01-9c08-e6df8a21f159 could not be found. Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'b359364c-f234-4d01-9c08-e6df8a21f159'} Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b359364c-f234-4d01-9c08-e6df8a21f159 could not be found. Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b359364c-f234-4d01-9c08-e6df8a21f159 could not be found. Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:41:21.868131 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:41:21.875847 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:21.875847 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:41:21.875847 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:41:21.875847 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:41:21.875847 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:41:21.875847 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b359364c-f234-4d01-9c08-e6df8a21f159 could not be found. Aug 04 16:41:21.875847 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:41:21.875847 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cf9d27f7-f369-49b3-b371-07d419d99717 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Returning 404 to user: Instance b359364c-f234-4d01-9c08-e6df8a21f159 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:41:21.886125 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cf9d27f7-f369-49b3-b371-07d419d99717 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159" status: 404 len: 111 microversion: 2.1 time: 0.093260 Aug 04 16:41:21.886125 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 804/1609] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:41:21 2022] GET /compute/v2.1/servers/b359364c-f234-4d01-9c08-e6df8a21f159 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:41:21.888350 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ca5b8ed0-853f-473b-a1b7-a6d5f5a72644 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:21.889163 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ca5b8ed0-853f-473b-a1b7-a6d5f5a72644 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: d1430483-b3f7-473b-80f9-15beb90cfc33] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:21.902527 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ca5b8ed0-853f-473b-a1b7-a6d5f5a72644 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:21.903341 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ca5b8ed0-853f-473b-a1b7-a6d5f5a72644 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:21.904888 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ca5b8ed0-853f-473b-a1b7-a6d5f5a72644 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:21.905882 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ca5b8ed0-853f-473b-a1b7-a6d5f5a72644 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:21.942825 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-ca5b8ed0-853f-473b-a1b7-a6d5f5a72644 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] HTTP exception thrown: Instance d1430483-b3f7-473b-80f9-15beb90cfc33 could not be found. Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ca5b8ed0-853f-473b-a1b7-a6d5f5a72644 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Request method failure captured: Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 HTTP/1.1 Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_UNjyrdUtTWtUOVfvm9QCW4-h1rMjjcmnLuFclAR379GwHgC9qkbHaVs91LVnb5xlIDnCR7AfJ7Y7lX8rND5VAEY3XelUoM35o-NGXV_btI6qgXx2jm_QiZeT_LP2XvfNkriTBvHPg1CBc3ThfmjCpC6UQ0aHUMHnzoDunnCk8HwjE Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: c456fd996bb544478bdb39c6a7ca04a6 Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-MigrationsAdminTest-574448974 Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c456fd996bb544478bdb39c6a7ca04a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c456fd996bb544478bdb39c6a7ca04a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c456fd996bb544478bdb39c6a7ca04a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c456fd996bb544478bdb39c6a7ca04a6"}]}] Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-MigrationsAdminTest-574448974 Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: c456fd996bb544478bdb39c6a7ca04a6 Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-MigrationsAdminTest-574448974 Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-MigrationsAdminTest-574448974-project Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 6e582cea96b64285b4232b96162a274c Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-MigrationsAdminTest-574448974-project Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance d1430483-b3f7-473b-80f9-15beb90cfc33 could not be found. Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'd1430483-b3f7-473b-80f9-15beb90cfc33'} Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1430483-b3f7-473b-80f9-15beb90cfc33 could not be found. Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1430483-b3f7-473b-80f9-15beb90cfc33 could not be found. Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:41:21.945795 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:41:21.953126 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:21.953126 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:41:21.953126 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:41:21.953126 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:41:21.953126 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:41:21.953126 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1430483-b3f7-473b-80f9-15beb90cfc33 could not be found. Aug 04 16:41:21.953126 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:41:21.955921 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ca5b8ed0-853f-473b-a1b7-a6d5f5a72644 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Returning 404 to user: Instance d1430483-b3f7-473b-80f9-15beb90cfc33 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:41:21.957148 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ca5b8ed0-853f-473b-a1b7-a6d5f5a72644 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33" status: 404 len: 111 microversion: 2.1 time: 0.077411 Aug 04 16:41:21.958346 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 805/1610] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:41:21 2022] GET /compute/v2.1/servers/d1430483-b3f7-473b-80f9-15beb90cfc33 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:41:21.963667 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f4f2007c-a172-434d-9769-e0669f252564 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '.version_select at 0x7f7e84a77160>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:22.054948 n-d-846466-12 devstack@n-api.service[126126]: DEBUG neutronclient.v2_0.client [None req-f4f2007c-a172-434d-9769-e0669f252564 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0fcf40ae-f583-49f9-996d-0a6b171ed7e0 does not exist", "detail": ""}} {{(pid=126126) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:41:22.056103 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.security_group_api [None req-f4f2007c-a172-434d-9769-e0669f252564 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Neutron security group 0fcf40ae-f583-49f9-996d-0a6b171ed7e0 not found {{(pid=126126) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 16:41:22.057485 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-f4f2007c-a172-434d-9769-e0669f252564 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] HTTP exception thrown: Security group 0fcf40ae-f583-49f9-996d-0a6b171ed7e0 does not exist Aug 04 16:41:22.057485 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-e861ed37-1d6b-46aa-96c4-f8f936d590d6'] Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f4f2007c-a172-434d-9769-e0669f252564 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Request method failure captured: Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/os-security-groups/0fcf40ae-f583-49f9-996d-0a6b171ed7e0 HTTP/1.1 Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_ZtqC96HabeWwNgyZnNmoMaRGEyMmVaUiLu9hLAQojAZCETOMBNx13l8QKIShQoX65FgHvzAm8VK7NKftXhvS9Bem6sccV9Ryn6Golur8wBQf_N6ajaCoRyYDB8mHggg2hJ4dz1CI18qnEF5I50zAGclpa2ng4xjm4gsGO8OQL5bTg Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: eb25e78b70ee48c99471d78e00e5949c Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb25e78b70ee48c99471d78e00e5949c"}]}] Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: eb25e78b70ee48c99471d78e00e5949c Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-SecurityGroupsTestJSON-886514065-project Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 23cc8f30e1f94ff0a520a071e5d81728 Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-SecurityGroupsTestJSON-886514065-project Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: exception: Security group 0fcf40ae-f583-49f9-996d-0a6b171ed7e0 does not exist Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-e861ed37-1d6b-46aa-96c4-f8f936d590d6'] Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '0fcf40ae-f583-49f9-996d-0a6b171ed7e0'} Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:41:22.061958 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0fcf40ae-f583-49f9-996d-0a6b171ed7e0 does not exist Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e861ed37-1d6b-46aa-96c4-f8f936d590d6'] Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0fcf40ae-f583-49f9-996d-0a6b171ed7e0 does not exist Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e861ed37-1d6b-46aa-96c4-f8f936d590d6'] Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0fcf40ae-f583-49f9-996d-0a6b171ed7e0 does not exist Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e861ed37-1d6b-46aa-96c4-f8f936d590d6'] Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0fcf40ae-f583-49f9-996d-0a6b171ed7e0 does not exist Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e861ed37-1d6b-46aa-96c4-f8f936d590d6'] Aug 04 16:41:22.074200 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:41:22.086154 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f4f2007c-a172-434d-9769-e0669f252564 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Returning 404 to user: Security group 0fcf40ae-f583-49f9-996d-0a6b171ed7e0 does not exist Aug 04 16:41:22.086154 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-e861ed37-1d6b-46aa-96c4-f8f936d590d6'] {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:41:22.089559 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f4f2007c-a172-434d-9769-e0669f252564 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/0fcf40ae-f583-49f9-996d-0a6b171ed7e0" status: 404 len: 194 microversion: 2.1 time: 0.119340 Aug 04 16:41:22.092234 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 806/1611] 10.222.0.23 () {58 vars in 1269 bytes} [Thu Aug 4 16:41:21 2022] GET /compute/v2.1/os-security-groups/0fcf40ae-f583-49f9-996d-0a6b171ed7e0 => generated 194 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:41:22.104251 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c4d88091-d5a3-4a8e-99b3-9579c7ae9ef3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:22.106649 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c4d88091-d5a3-4a8e-99b3-9579c7ae9ef3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:22.118764 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-c6f2d03a-e286-407a-9ff4-7ee7125a01d8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:41:22.120447 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-c6f2d03a-e286-407a-9ff4-7ee7125a01d8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:41:22.121509 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-c6f2d03a-e286-407a-9ff4-7ee7125a01d8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:41:22.122422 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4d88091-d5a3-4a8e-99b3-9579c7ae9ef3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:22.123832 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4d88091-d5a3-4a8e-99b3-9579c7ae9ef3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:22.124576 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-c6f2d03a-e286-407a-9ff4-7ee7125a01d8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:41:22.125214 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4d88091-d5a3-4a8e-99b3-9579c7ae9ef3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:22.125532 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-c6f2d03a-e286-407a-9ff4-7ee7125a01d8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:41:22.126192 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4d88091-d5a3-4a8e-99b3-9579c7ae9ef3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:22.139795 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c6f2d03a-e286-407a-9ff4-7ee7125a01d8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:22.152460 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c6f2d03a-e286-407a-9ff4-7ee7125a01d8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:22.153875 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c6f2d03a-e286-407a-9ff4-7ee7125a01d8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:22.156466 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c6f2d03a-e286-407a-9ff4-7ee7125a01d8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:22.211911 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-c6f2d03a-e286-407a-9ff4-7ee7125a01d8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Getting quotas for project 96ce955c9158463e9e98c53b99c581ec. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:41:22.226672 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-c6f2d03a-e286-407a-9ff4-7ee7125a01d8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Getting quotas for user 438d083dc9e74b2f8970455505791250 and project 96ce955c9158463e9e98c53b99c581ec. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:41:22.279830 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c6f2d03a-e286-407a-9ff4-7ee7125a01d8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:41:22.285056 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c6f2d03a-e286-407a-9ff4-7ee7125a01d8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:41:22.379874 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c6f2d03a-e286-407a-9ff4-7ee7125a01d8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.294050 Aug 04 16:41:22.391910 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 806/1612] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:41:20 2022] POST /compute/v2.1/servers => generated 408 bytes in 2323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:41:22.401089 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f61ef7e1-90e5-4c1c-ab33-7c0f49f7cc80 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '.version_select at 0x7f7e84522b80>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:22.440861 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f61ef7e1-90e5-4c1c-ab33-7c0f49f7cc80 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-249141778" status: 202 len: 0 microversion: 2.1 time: 0.046769 Aug 04 16:41:22.448622 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 807/1613] 10.222.0.23 () {58 vars in 1218 bytes} [Thu Aug 4 16:41:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-249141778 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:41:22.451858 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-08e7fd8d-29e7-4650-9b10-09daa0f510be tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '.version_select at 0x7f7e84779940>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:22.472874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c4d88091-d5a3-4a8e-99b3-9579c7ae9ef3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:22.485524 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-08e7fd8d-29e7-4650-9b10-09daa0f510be tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-342868325" status: 202 len: 0 microversion: 2.1 time: 0.038719 Aug 04 16:41:22.487276 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 808/1614] 10.222.0.23 () {58 vars in 1218 bytes} [Thu Aug 4 16:41:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-342868325 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:41:22.492063 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c4d88091-d5a3-4a8e-99b3-9579c7ae9ef3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:22.494650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c4d88091-d5a3-4a8e-99b3-9579c7ae9ef3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:22.496263 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cc9690c0-ab21-48ed-a387-b48db733b3c2 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Action: 'create', calling method: .version_select at 0x7f7e77ff7940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-677751353", "description": "tempest-description-1270959082"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:22.500656 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c4d88091-d5a3-4a8e-99b3-9579c7ae9ef3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1487 microversion: 2.25 time: 0.406428 Aug 04 16:41:22.501732 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 807/1615] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:22 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1487 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:22.506983 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4bc140d7-3e46-4a19-87e8-1b3581703c56 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:22.519132 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4bc140d7-3e46-4a19-87e8-1b3581703c56 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:22.764940 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4bc140d7-3e46-4a19-87e8-1b3581703c56 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:22.792549 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4bc140d7-3e46-4a19-87e8-1b3581703c56 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1238 microversion: 2.1 time: 0.286363 Aug 04 16:41:22.795928 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 808/1616] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:41:22 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1238 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:41:22.835096 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2fbb2efa-6618-4ade-b3ea-8b07146df189 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:22.837886 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2fbb2efa-6618-4ade-b3ea-8b07146df189 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:22.871301 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2fbb2efa-6618-4ade-b3ea-8b07146df189 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:22.872884 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2fbb2efa-6618-4ade-b3ea-8b07146df189 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:22.877075 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2fbb2efa-6618-4ade-b3ea-8b07146df189 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:22.879369 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2fbb2efa-6618-4ade-b3ea-8b07146df189 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:23.692493 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cc9690c0-ab21-48ed-a387-b48db733b3c2 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.203420 Aug 04 16:41:23.693363 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 809/1617] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Aug 4 16:41:22 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:23.714600 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c59ef344-8d23-4946-9f71-2025c7b771b1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:23.717417 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c59ef344-8d23-4946-9f71-2025c7b771b1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:23.732741 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c59ef344-8d23-4946-9f71-2025c7b771b1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:23.736570 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c59ef344-8d23-4946-9f71-2025c7b771b1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:23.738131 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c59ef344-8d23-4946-9f71-2025c7b771b1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:23.738892 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c59ef344-8d23-4946-9f71-2025c7b771b1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:24.060104 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2fbb2efa-6618-4ade-b3ea-8b07146df189 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:24.092912 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2fbb2efa-6618-4ade-b3ea-8b07146df189 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:24.097000 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2fbb2efa-6618-4ade-b3ea-8b07146df189 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:24.099949 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2fbb2efa-6618-4ade-b3ea-8b07146df189 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1798 microversion: 2.32 time: 1.277401 Aug 04 16:41:24.114036 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 809/1618] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:22 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1798 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:24.137308 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-24123120-8ca9-4843-8239-3073b33785a8 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Action: 'create', calling method: .version_select at 0x7f7e84ba5280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1676336726", "description": "tempest-description-1668214299"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:24.434125 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c59ef344-8d23-4946-9f71-2025c7b771b1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:24.447141 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c59ef344-8d23-4946-9f71-2025c7b771b1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:24.449510 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c59ef344-8d23-4946-9f71-2025c7b771b1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:24.451078 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c59ef344-8d23-4946-9f71-2025c7b771b1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1487 microversion: 2.25 time: 0.747501 Aug 04 16:41:24.452248 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 810/1619] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:23 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1487 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:24.458321 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-87e678db-221d-4a03-9e93-3ed5228fb9c2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:24.459845 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-87e678db-221d-4a03-9e93-3ed5228fb9c2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:24.484809 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-87e678db-221d-4a03-9e93-3ed5228fb9c2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:24.488058 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-87e678db-221d-4a03-9e93-3ed5228fb9c2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:24.501637 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-87e678db-221d-4a03-9e93-3ed5228fb9c2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:24.538307 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-87e678db-221d-4a03-9e93-3ed5228fb9c2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:24.836604 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-87e678db-221d-4a03-9e93-3ed5228fb9c2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:24.851954 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-87e678db-221d-4a03-9e93-3ed5228fb9c2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1298 microversion: 2.1 time: 0.398298 Aug 04 16:41:24.852927 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 811/1620] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:41:24 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1298 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:41:24.863574 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6314ac8c-fdfd-4494-9598-42b33d744e6c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:24.870104 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6314ac8c-fdfd-4494-9598-42b33d744e6c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: a80ed729-9d91-4fba-a785-77d5aeacb767] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:24.881715 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6314ac8c-fdfd-4494-9598-42b33d744e6c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:24.882679 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6314ac8c-fdfd-4494-9598-42b33d744e6c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:24.883739 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6314ac8c-fdfd-4494-9598-42b33d744e6c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:24.884380 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6314ac8c-fdfd-4494-9598-42b33d744e6c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:24.918938 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6314ac8c-fdfd-4494-9598-42b33d744e6c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: a80ed729-9d91-4fba-a785-77d5aeacb767] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:41:25.023507 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6314ac8c-fdfd-4494-9598-42b33d744e6c tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767" status: 204 len: 0 microversion: 2.1 time: 0.166201 Aug 04 16:41:25.028386 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 812/1621] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:41:24 2022] DELETE /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:41:25.043840 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d3b8f79d-9353-496e-a944-3c2133f7a25f tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:25.045557 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d3b8f79d-9353-496e-a944-3c2133f7a25f tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: a80ed729-9d91-4fba-a785-77d5aeacb767] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:25.059978 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d3b8f79d-9353-496e-a944-3c2133f7a25f tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:25.062012 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d3b8f79d-9353-496e-a944-3c2133f7a25f tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:25.063713 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d3b8f79d-9353-496e-a944-3c2133f7a25f tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:25.064127 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d3b8f79d-9353-496e-a944-3c2133f7a25f tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:25.262722 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-24123120-8ca9-4843-8239-3073b33785a8 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.146192 Aug 04 16:41:25.267856 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 810/1622] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Aug 4 16:41:24 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:25.276814 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-06cf7891-18ea-412e-9744-d2cf68b78ab1 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:25.278446 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-06cf7891-18ea-412e-9744-d2cf68b78ab1 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:25.289470 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-06cf7891-18ea-412e-9744-d2cf68b78ab1 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:25.289909 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-06cf7891-18ea-412e-9744-d2cf68b78ab1 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:25.290904 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-06cf7891-18ea-412e-9744-d2cf68b78ab1 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:25.291509 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-06cf7891-18ea-412e-9744-d2cf68b78ab1 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:26.204121 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d3b8f79d-9353-496e-a944-3c2133f7a25f tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:26.225234 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d3b8f79d-9353-496e-a944-3c2133f7a25f tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767" status: 200 len: 1484 microversion: 2.1 time: 1.189709 Aug 04 16:41:26.226880 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 813/1623] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:41:25 2022] GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767 => generated 1484 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:41:26.237146 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0e2b5e00-ad31-44d0-b765-c155553e5cb1 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Action: 'create', calling method: .version_select at 0x7f7e872eb790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1606409204", "description": "tempest-description-2064756852"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:26.443474 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-06cf7891-18ea-412e-9744-d2cf68b78ab1 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:26.455633 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-06cf7891-18ea-412e-9744-d2cf68b78ab1 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:26.457193 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-06cf7891-18ea-412e-9744-d2cf68b78ab1 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:26.458969 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-06cf7891-18ea-412e-9744-d2cf68b78ab1 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1844 microversion: 2.32 time: 1.189511 Aug 04 16:41:26.459519 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 811/1624] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:25 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1844 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:26.469597 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ba5da657-61b0-4757-a3aa-4da886a1c7b4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:26.472224 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ba5da657-61b0-4757-a3aa-4da886a1c7b4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:26.487613 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ba5da657-61b0-4757-a3aa-4da886a1c7b4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:26.489445 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ba5da657-61b0-4757-a3aa-4da886a1c7b4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:26.492128 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ba5da657-61b0-4757-a3aa-4da886a1c7b4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:26.494132 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ba5da657-61b0-4757-a3aa-4da886a1c7b4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:27.467977 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ba5da657-61b0-4757-a3aa-4da886a1c7b4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:27.489140 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ba5da657-61b0-4757-a3aa-4da886a1c7b4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:27.493028 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ba5da657-61b0-4757-a3aa-4da886a1c7b4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:27.495816 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ba5da657-61b0-4757-a3aa-4da886a1c7b4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1487 microversion: 2.25 time: 1.034862 Aug 04 16:41:27.517999 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 812/1625] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:26 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1487 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:27.520199 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0e2b5e00-ad31-44d0-b765-c155553e5cb1 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.290992 Aug 04 16:41:27.520889 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 814/1626] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Aug 4 16:41:26 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:27.526284 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9c45af25-844c-4d34-823a-dafb31985902 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:27.526792 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9c45af25-844c-4d34-823a-dafb31985902 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:27.537763 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c00afa39-5d43-4467-8eb3-2bde6d9989fd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:27.539339 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c00afa39-5d43-4467-8eb3-2bde6d9989fd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:27.540724 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c45af25-844c-4d34-823a-dafb31985902 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:27.541815 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c45af25-844c-4d34-823a-dafb31985902 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:27.543492 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c45af25-844c-4d34-823a-dafb31985902 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:27.544513 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c45af25-844c-4d34-823a-dafb31985902 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:27.552048 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c00afa39-5d43-4467-8eb3-2bde6d9989fd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:27.552847 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c00afa39-5d43-4467-8eb3-2bde6d9989fd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:27.554396 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c00afa39-5d43-4467-8eb3-2bde6d9989fd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:27.555099 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c00afa39-5d43-4467-8eb3-2bde6d9989fd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:27.612741 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9c45af25-844c-4d34-823a-dafb31985902 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:41:27.719084 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c00afa39-5d43-4467-8eb3-2bde6d9989fd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:27.731957 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c00afa39-5d43-4467-8eb3-2bde6d9989fd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1296 microversion: 2.1 time: 0.212452 Aug 04 16:41:27.736678 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 813/1627] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:41:27 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1296 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:41:27.747100 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3296026e-1f10-4634-b34d-6905964a0e5e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1141058405", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "946b5c3e-88b1-454c-aaf1-32c242620141"}], "security_groups": [{"name": "tempest-securitygroup--1112662269"}], "key_name": "tempest-keypair-342563486", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "1a416a5d-bde1-4c79-afbf-67ac742ae6f8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:27.804803 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9c45af25-844c-4d34-823a-dafb31985902 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 204 len: 0 microversion: 2.1 time: 0.281537 Aug 04 16:41:27.807774 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 815/1628] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:41:27 2022] DELETE /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:41:27.906005 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-665c29a5-41bc-4d74-bd07-b9fae1192726 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:27.907910 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-665c29a5-41bc-4d74-bd07-b9fae1192726 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: a80ed729-9d91-4fba-a785-77d5aeacb767] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:27.925274 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-665c29a5-41bc-4d74-bd07-b9fae1192726 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:27.927053 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-665c29a5-41bc-4d74-bd07-b9fae1192726 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:27.931440 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-665c29a5-41bc-4d74-bd07-b9fae1192726 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:27.932790 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-665c29a5-41bc-4d74-bd07-b9fae1192726 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:28.188244 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-665c29a5-41bc-4d74-bd07-b9fae1192726 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:28.219638 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-665c29a5-41bc-4d74-bd07-b9fae1192726 tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767" status: 200 len: 1442 microversion: 2.1 time: 0.370150 Aug 04 16:41:28.225898 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 816/1629] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:41:27 2022] GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767 => generated 1442 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:41:28.238098 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-18b1eb00-b1fd-499b-81d4-4f283241810f tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:28.239231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-18b1eb00-b1fd-499b-81d4-4f283241810f tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:28.264966 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-18b1eb00-b1fd-499b-81d4-4f283241810f tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:28.266523 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-18b1eb00-b1fd-499b-81d4-4f283241810f tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:28.269562 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-18b1eb00-b1fd-499b-81d4-4f283241810f tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:28.270837 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-18b1eb00-b1fd-499b-81d4-4f283241810f tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:28.434832 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-3296026e-1f10-4634-b34d-6905964a0e5e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] validate_networks() for [('946b5c3e-88b1-454c-aaf1-32c242620141', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:41:28.912045 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-18b1eb00-b1fd-499b-81d4-4f283241810f tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:28.980592 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-18b1eb00-b1fd-499b-81d4-4f283241810f tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:28.983272 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-18b1eb00-b1fd-499b-81d4-4f283241810f tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:28.987249 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-18b1eb00-b1fd-499b-81d4-4f283241810f tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1844 microversion: 2.32 time: 0.759249 Aug 04 16:41:29.026888 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 817/1630] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:28 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1844 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:29.056434 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d1af782e-2234-44ae-a4da-1bd27955501d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '.version_select at 0x7f7e84cf79d0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:30.695718 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d1af782e-2234-44ae-a4da-1bd27955501d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups" status: 200 len: 1834 microversion: 2.1 time: 1.657714 Aug 04 16:41:30.706277 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 818/1631] 10.222.0.23 () {58 vars in 1158 bytes} [Thu Aug 4 16:41:29 2022] GET /compute/v2.1/os-security-groups => generated 1834 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:41:30.712882 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-188b56f1-4cbe-4c41-ad2a-e8039fc27306 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:30.713899 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-188b56f1-4cbe-4c41-ad2a-e8039fc27306 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:30.723469 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-188b56f1-4cbe-4c41-ad2a-e8039fc27306 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:30.724337 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-188b56f1-4cbe-4c41-ad2a-e8039fc27306 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:30.725473 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-188b56f1-4cbe-4c41-ad2a-e8039fc27306 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:30.726146 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-188b56f1-4cbe-4c41-ad2a-e8039fc27306 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:30.778099 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-188b56f1-4cbe-4c41-ad2a-e8039fc27306 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:30.778671 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-188b56f1-4cbe-4c41-ad2a-e8039fc27306 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:30.779335 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-188b56f1-4cbe-4c41-ad2a-e8039fc27306 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lazy-loading 'fault' on Instance uuid 8305b506-e5ac-4e19-97ea-4530d4ec87c1 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:41:31.013426 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-188b56f1-4cbe-4c41-ad2a-e8039fc27306 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:31.017481 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:41:31.027670 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-188b56f1-4cbe-4c41-ad2a-e8039fc27306 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 200 len: 1303 microversion: 2.1 time: 0.319489 Aug 04 16:41:31.029114 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 819/1632] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:41:30 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 1303 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:41:31.034205 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-451e0b70-2683-443e-ac82-941c7bbdd767 req-b6b1573d-5b56-4d87-a1c0-a492f3ae1c6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09e1b482-0372-4270-ac25-6d3349aca31e", "tag": "80b3b8c3-3818-4e0b-9096-8ce22a3ec0f3"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:31.053735 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-451e0b70-2683-443e-ac82-941c7bbdd767 req-b6b1573d-5b56-4d87-a1c0-a492f3ae1c6e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:31.054597 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-451e0b70-2683-443e-ac82-941c7bbdd767 req-b6b1573d-5b56-4d87-a1c0-a492f3ae1c6e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:31.069948 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-451e0b70-2683-443e-ac82-941c7bbdd767 req-b6b1573d-5b56-4d87-a1c0-a492f3ae1c6e service nova] Creating event network-changed:80b3b8c3-3818-4e0b-9096-8ce22a3ec0f3 for instance 09e1b482-0372-4270-ac25-6d3349aca31e on n-h2-846466-12 Aug 04 16:41:31.072984 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-3296026e-1f10-4634-b34d-6905964a0e5e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Getting quotas for project 547b33a8f5a344f788da917f3512be5f. Resources: dict_keys(['metadata_items']) {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:41:31.076992 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-451e0b70-2683-443e-ac82-941c7bbdd767 req-b6b1573d-5b56-4d87-a1c0-a492f3ae1c6e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046094 Aug 04 16:41:31.077813 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 820/1633] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:31.084797 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f555a462-7542-4296-bd51-96fdb71c9b39 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:31.086569 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f555a462-7542-4296-bd51-96fdb71c9b39 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:31.086715 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-3296026e-1f10-4634-b34d-6905964a0e5e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Getting quotas for user d3cd7076f4514ee89b0c4b2a586fe69e and project 547b33a8f5a344f788da917f3512be5f. Resources: dict_keys(['metadata_items']) {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:41:31.095350 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f555a462-7542-4296-bd51-96fdb71c9b39 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:31.096213 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f555a462-7542-4296-bd51-96fdb71c9b39 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:31.097340 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f555a462-7542-4296-bd51-96fdb71c9b39 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:31.098017 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f555a462-7542-4296-bd51-96fdb71c9b39 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:31.112995 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-3296026e-1f10-4634-b34d-6905964a0e5e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:41:31.113457 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-3296026e-1f10-4634-b34d-6905964a0e5e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:41:31.113936 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-3296026e-1f10-4634-b34d-6905964a0e5e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:41:31.114409 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-3296026e-1f10-4634-b34d-6905964a0e5e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:41:31.114829 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-3296026e-1f10-4634-b34d-6905964a0e5e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:41:31.148421 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3296026e-1f10-4634-b34d-6905964a0e5e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:31.148871 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3296026e-1f10-4634-b34d-6905964a0e5e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:31.149715 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3296026e-1f10-4634-b34d-6905964a0e5e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:31.150373 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3296026e-1f10-4634-b34d-6905964a0e5e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:31.176831 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-3296026e-1f10-4634-b34d-6905964a0e5e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Getting quotas for project 547b33a8f5a344f788da917f3512be5f. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:41:31.183231 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-3296026e-1f10-4634-b34d-6905964a0e5e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Getting quotas for user d3cd7076f4514ee89b0c4b2a586fe69e and project 547b33a8f5a344f788da917f3512be5f. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:41:31.275987 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3296026e-1f10-4634-b34d-6905964a0e5e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:41:31.278461 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3296026e-1f10-4634-b34d-6905964a0e5e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] [instance: b7f869cc-6c2f-4f4c-aa03-b39ed943c47b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1a416a5d-bde1-4c79-afbf-67ac742ae6f8',volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:41:31.463102 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3296026e-1f10-4634-b34d-6905964a0e5e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.724702 Aug 04 16:41:31.464175 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 814/1634] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:41:27 2022] POST /compute/v2.1/servers => generated 407 bytes in 3727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:41:31.469138 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-30d0d02e-cad5-4fda-81e1-c619f89c24cb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:31.469840 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-30d0d02e-cad5-4fda-81e1-c619f89c24cb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:31.477986 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-30d0d02e-cad5-4fda-81e1-c619f89c24cb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:31.478709 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-30d0d02e-cad5-4fda-81e1-c619f89c24cb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:31.479704 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-30d0d02e-cad5-4fda-81e1-c619f89c24cb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:31.480361 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-30d0d02e-cad5-4fda-81e1-c619f89c24cb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:31.976777 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f555a462-7542-4296-bd51-96fdb71c9b39 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:31.992278 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f555a462-7542-4296-bd51-96fdb71c9b39 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:31.995405 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f555a462-7542-4296-bd51-96fdb71c9b39 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:31.997852 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f555a462-7542-4296-bd51-96fdb71c9b39 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1487 microversion: 2.25 time: 0.918344 Aug 04 16:41:31.999666 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 821/1635] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:31 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1487 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:32.005690 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f66e286c-4530-40a3-a34e-2fab683c4f4f tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:32.006925 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f66e286c-4530-40a3-a34e-2fab683c4f4f tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: a80ed729-9d91-4fba-a785-77d5aeacb767] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:32.018276 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f66e286c-4530-40a3-a34e-2fab683c4f4f tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:32.019261 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f66e286c-4530-40a3-a34e-2fab683c4f4f tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:32.020425 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f66e286c-4530-40a3-a34e-2fab683c4f4f tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:32.021445 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f66e286c-4530-40a3-a34e-2fab683c4f4f tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:32.051798 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-f66e286c-4530-40a3-a34e-2fab683c4f4f tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] HTTP exception thrown: Instance a80ed729-9d91-4fba-a785-77d5aeacb767 could not be found. Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f66e286c-4530-40a3-a34e-2fab683c4f4f tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Request method failure captured: Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767 HTTP/1.1 Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_TPS6aZuKxMYL7CvYdF5h6eTzUUfuaynC642KfGogzjdTdN7-PawOFY-6_UEI3Y985iNqxJBN1SEbOCosjMlSANhdnevytUzMwNwPy5JAn6DdbkBJqMxeFRLQMHuPIcsN7nNO7aDzKbnNDUgez5GVgbgfz5kz_J_E0BJY1XEX6dRy8 Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 82b3a898ed4b4e0a82ae35830cb00ca9 Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-LiveMigrationTest-403086797 Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/82b3a898ed4b4e0a82ae35830cb00ca9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_82b3a898ed4b4e0a82ae35830cb00ca9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/82b3a898ed4b4e0a82ae35830cb00ca9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/82b3a898ed4b4e0a82ae35830cb00ca9"}]}] Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-LiveMigrationTest-403086797 Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 82b3a898ed4b4e0a82ae35830cb00ca9 Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-LiveMigrationTest-403086797 Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-LiveMigrationTest-403086797-project Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 51b742cff6a948d0883501917706f66e Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-LiveMigrationTest-403086797-project Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance a80ed729-9d91-4fba-a785-77d5aeacb767 could not be found. Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'a80ed729-9d91-4fba-a785-77d5aeacb767'} Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a80ed729-9d91-4fba-a785-77d5aeacb767 could not be found. Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a80ed729-9d91-4fba-a785-77d5aeacb767 could not be found. Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:41:32.053901 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:32.059340 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:32.059340 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:41:32.059340 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:41:32.059340 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:41:32.059340 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:41:32.059340 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a80ed729-9d91-4fba-a785-77d5aeacb767 could not be found. Aug 04 16:41:32.059340 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:32.059340 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f66e286c-4530-40a3-a34e-2fab683c4f4f tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Returning 404 to user: Instance a80ed729-9d91-4fba-a785-77d5aeacb767 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:41:32.059340 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f66e286c-4530-40a3-a34e-2fab683c4f4f tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767" status: 404 len: 111 microversion: 2.1 time: 0.054144 Aug 04 16:41:32.059340 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 822/1636] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:41:32 2022] GET /compute/v2.1/servers/a80ed729-9d91-4fba-a785-77d5aeacb767 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:41:32.061426 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0a859d48-ee25-4e61-a6f4-071d63d80b2c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:32.062180 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0a859d48-ee25-4e61-a6f4-071d63d80b2c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:32.071154 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0a859d48-ee25-4e61-a6f4-071d63d80b2c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:32.071802 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0a859d48-ee25-4e61-a6f4-071d63d80b2c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:32.072973 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0a859d48-ee25-4e61-a6f4-071d63d80b2c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:32.073611 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0a859d48-ee25-4e61-a6f4-071d63d80b2c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:32.108297 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-30d0d02e-cad5-4fda-81e1-c619f89c24cb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:32.121036 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-30d0d02e-cad5-4fda-81e1-c619f89c24cb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1363 microversion: 2.1 time: 0.655516 Aug 04 16:41:32.122433 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 815/1637] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:41:31 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1363 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:41:32.132508 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-00021bb6-17b6-4aa8-82a8-3e3396cbc821 req-0fd9eef9-41e7-40d8-8f37-1128514db4ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8305b506-e5ac-4e19-97ea-4530d4ec87c1", "name": "network-vif-deleted", "tag": "88499859-554c-4372-a84a-c0c261083f9b"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:32.144791 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-00021bb6-17b6-4aa8-82a8-3e3396cbc821 req-0fd9eef9-41e7-40d8-8f37-1128514db4ab service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:32.145880 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-00021bb6-17b6-4aa8-82a8-3e3396cbc821 req-0fd9eef9-41e7-40d8-8f37-1128514db4ab service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:32.162429 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-00021bb6-17b6-4aa8-82a8-3e3396cbc821 req-0fd9eef9-41e7-40d8-8f37-1128514db4ab service nova] Creating event network-vif-deleted:88499859-554c-4372-a84a-c0c261083f9b for instance 8305b506-e5ac-4e19-97ea-4530d4ec87c1 on n-h1-846466-12 Aug 04 16:41:32.168240 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-00021bb6-17b6-4aa8-82a8-3e3396cbc821 req-0fd9eef9-41e7-40d8-8f37-1128514db4ab service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044129 Aug 04 16:41:32.169593 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 816/1638] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:32.176204 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9112b775-6989-4dfd-b235-1bbd7ad9d8a6 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '.version_select at 0x7f7e84e33790>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:32.185328 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:41:32.250696 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:41:33.132817 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0a859d48-ee25-4e61-a6f4-071d63d80b2c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:33.181988 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0a859d48-ee25-4e61-a6f4-071d63d80b2c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:33.189770 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0a859d48-ee25-4e61-a6f4-071d63d80b2c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:33.192720 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0a859d48-ee25-4e61-a6f4-071d63d80b2c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1865 microversion: 2.32 time: 1.134604 Aug 04 16:41:33.195970 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 823/1639] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:32 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1865 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:33.209072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ad0456d6-2ceb-4c5e-b6a0-d9bf62a19a26 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:33.211085 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ad0456d6-2ceb-4c5e-b6a0-d9bf62a19a26 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] [instance: b7f869cc-6c2f-4f4c-aa03-b39ed943c47b] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:33.226538 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad0456d6-2ceb-4c5e-b6a0-d9bf62a19a26 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:33.227833 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad0456d6-2ceb-4c5e-b6a0-d9bf62a19a26 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:33.229731 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad0456d6-2ceb-4c5e-b6a0-d9bf62a19a26 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:33.233876 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad0456d6-2ceb-4c5e-b6a0-d9bf62a19a26 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:33.402096 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ad0456d6-2ceb-4c5e-b6a0-d9bf62a19a26 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cd7076f4514ee89b0c4b2a586fe69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547b33a8f5a344f788da917f3512be5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:33.440082 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ad0456d6-2ceb-4c5e-b6a0-d9bf62a19a26 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] 10.222.0.23 "GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b" status: 200 len: 1227 microversion: 2.1 time: 0.236126 Aug 04 16:41:33.441206 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 824/1640] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:41:33 2022] GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b => generated 1227 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:41:33.471741 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-52db3d63-2f6a-4cba-be05-59fb92d37507 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:33.477414 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-52db3d63-2f6a-4cba-be05-59fb92d37507 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 8305b506-e5ac-4e19-97ea-4530d4ec87c1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:33.491770 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=4,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:41:33.495087 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-52db3d63-2f6a-4cba-be05-59fb92d37507 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:33.497561 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-52db3d63-2f6a-4cba-be05-59fb92d37507 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:33.499947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-52db3d63-2f6a-4cba-be05-59fb92d37507 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:33.501908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-52db3d63-2f6a-4cba-be05-59fb92d37507 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:33.541075 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-52db3d63-2f6a-4cba-be05-59fb92d37507 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] HTTP exception thrown: Instance 8305b506-e5ac-4e19-97ea-4530d4ec87c1 could not be found. Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-52db3d63-2f6a-4cba-be05-59fb92d37507 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Request method failure captured: Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 HTTP/1.1 Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_UNjyrdUtTWtUOVfvm9QCW4-h1rMjjcmnLuFclAR379GwHgC9qkbHaVs91LVnb5xlIDnCR7AfJ7Y7lX8rND5VAEY3XelUoM35o-NGXV_btI6qgXx2jm_QiZeT_LP2XvfNkriTBvHPg1CBc3ThfmjCpC6UQ0aHUMHnzoDunnCk8HwjE Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: c456fd996bb544478bdb39c6a7ca04a6 Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-MigrationsAdminTest-574448974 Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c456fd996bb544478bdb39c6a7ca04a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c456fd996bb544478bdb39c6a7ca04a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c456fd996bb544478bdb39c6a7ca04a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c456fd996bb544478bdb39c6a7ca04a6"}]}] Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-MigrationsAdminTest-574448974 Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: c456fd996bb544478bdb39c6a7ca04a6 Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-MigrationsAdminTest-574448974 Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-MigrationsAdminTest-574448974-project Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 6e582cea96b64285b4232b96162a274c Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-MigrationsAdminTest-574448974-project Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 8305b506-e5ac-4e19-97ea-4530d4ec87c1 could not be found. Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '8305b506-e5ac-4e19-97ea-4530d4ec87c1'} Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8305b506-e5ac-4e19-97ea-4530d4ec87c1 could not be found. Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8305b506-e5ac-4e19-97ea-4530d4ec87c1 could not be found. Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:41:33.544252 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:33.552743 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:33.552743 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:41:33.552743 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:41:33.552743 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:41:33.552743 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:41:33.552743 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8305b506-e5ac-4e19-97ea-4530d4ec87c1 could not be found. Aug 04 16:41:33.552743 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:33.552743 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-52db3d63-2f6a-4cba-be05-59fb92d37507 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Returning 404 to user: Instance 8305b506-e5ac-4e19-97ea-4530d4ec87c1 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:41:33.552743 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-52db3d63-2f6a-4cba-be05-59fb92d37507 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1" status: 404 len: 111 microversion: 2.1 time: 0.103984 Aug 04 16:41:33.552743 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 825/1641] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:41:33 2022] GET /compute/v2.1/servers/8305b506-e5ac-4e19-97ea-4530d4ec87c1 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:41:33.563158 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a2b0cc9e-50e1-4f72-ba8b-8955feed94da tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:33.564368 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a2b0cc9e-50e1-4f72-ba8b-8955feed94da tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: f23a3c47-f725-4ad2-b88d-b972ff4b2ee9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:33.584883 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a2b0cc9e-50e1-4f72-ba8b-8955feed94da tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:33.585936 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a2b0cc9e-50e1-4f72-ba8b-8955feed94da tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:33.589654 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a2b0cc9e-50e1-4f72-ba8b-8955feed94da tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:33.591675 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a2b0cc9e-50e1-4f72-ba8b-8955feed94da tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:33.657325 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a2b0cc9e-50e1-4f72-ba8b-8955feed94da tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: f23a3c47-f725-4ad2-b88d-b972ff4b2ee9] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:41:33.858917 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9112b775-6989-4dfd-b235-1bbd7ad9d8a6 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/f906bc12-1520-4c1e-ac50-ef902af656f0" status: 202 len: 0 microversion: 2.1 time: 1.687299 Aug 04 16:41:33.863635 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 817/1642] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:41:32 2022] DELETE /compute/v2.1/os-security-groups/f906bc12-1520-4c1e-ac50-ef902af656f0 => generated 0 bytes in 1693 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:41:33.872102 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-519d6f30-d9c7-4073-b838-95fcdfc1754e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:33.874001 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a2b0cc9e-50e1-4f72-ba8b-8955feed94da tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9" status: 204 len: 0 microversion: 2.1 time: 0.321296 Aug 04 16:41:33.874382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-519d6f30-d9c7-4073-b838-95fcdfc1754e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:33.878687 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:41:33.880371 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 826/1643] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:41:33 2022] DELETE /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:41:33.897706 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-28ec3b90-e28a-443e-82f0-7847b22a06f0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:33.898839 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-28ec3b90-e28a-443e-82f0-7847b22a06f0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:33.899754 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-519d6f30-d9c7-4073-b838-95fcdfc1754e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:33.900349 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-519d6f30-d9c7-4073-b838-95fcdfc1754e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:33.908791 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-519d6f30-d9c7-4073-b838-95fcdfc1754e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:33.909469 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-519d6f30-d9c7-4073-b838-95fcdfc1754e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:33.931981 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-28ec3b90-e28a-443e-82f0-7847b22a06f0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:33.932767 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-28ec3b90-e28a-443e-82f0-7847b22a06f0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:33.934369 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-28ec3b90-e28a-443e-82f0-7847b22a06f0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:33.935113 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-28ec3b90-e28a-443e-82f0-7847b22a06f0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:34.729564 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-519d6f30-d9c7-4073-b838-95fcdfc1754e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:34.751401 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-519d6f30-d9c7-4073-b838-95fcdfc1754e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:34.756281 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-519d6f30-d9c7-4073-b838-95fcdfc1754e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:34.760014 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-519d6f30-d9c7-4073-b838-95fcdfc1754e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1487 microversion: 2.25 time: 0.894483 Aug 04 16:41:34.778654 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 818/1644] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:33 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1487 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:34.802917 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-ab7e93c6-539f-4da5-bae9-8243b36f5deb req-050c0132-7fa6-4ee5-9d32-c0a74ca90d74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a80ed729-9d91-4fba-a785-77d5aeacb767", "name": "network-vif-deleted", "tag": "79848b85-9a77-47be-a4af-fb28446f2cd4"}, {"name": "network-changed", "server_uuid": "09e1b482-0372-4270-ac25-6d3349aca31e", "tag": "a2483ca6-cccd-4bc5-82a5-0870eb4a915c"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:34.819238 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-28ec3b90-e28a-443e-82f0-7847b22a06f0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:34.836007 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-ab7e93c6-539f-4da5-bae9-8243b36f5deb req-050c0132-7fa6-4ee5-9d32-c0a74ca90d74 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:34.836469 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-ab7e93c6-539f-4da5-bae9-8243b36f5deb req-050c0132-7fa6-4ee5-9d32-c0a74ca90d74 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:34.854080 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-ab7e93c6-539f-4da5-bae9-8243b36f5deb req-050c0132-7fa6-4ee5-9d32-c0a74ca90d74 service nova] Creating event network-vif-deleted:79848b85-9a77-47be-a4af-fb28446f2cd4 for instance a80ed729-9d91-4fba-a785-77d5aeacb767 on n-h2-846466-12 Aug 04 16:41:34.854592 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-ab7e93c6-539f-4da5-bae9-8243b36f5deb req-050c0132-7fa6-4ee5-9d32-c0a74ca90d74 service nova] Creating event network-changed:a2483ca6-cccd-4bc5-82a5-0870eb4a915c for instance 09e1b482-0372-4270-ac25-6d3349aca31e on n-h2-846466-12 Aug 04 16:41:34.865261 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-28ec3b90-e28a-443e-82f0-7847b22a06f0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1363 microversion: 2.1 time: 0.979142 Aug 04 16:41:34.865550 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-ab7e93c6-539f-4da5-bae9-8243b36f5deb req-050c0132-7fa6-4ee5-9d32-c0a74ca90d74 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.076831 Aug 04 16:41:34.867356 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 819/1645] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:34.874774 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4334849f-8033-47bf-8654-addf570b0cd8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:34.875689 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4334849f-8033-47bf-8654-addf570b0cd8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:34.883760 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4334849f-8033-47bf-8654-addf570b0cd8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:34.884531 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4334849f-8033-47bf-8654-addf570b0cd8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:34.885597 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4334849f-8033-47bf-8654-addf570b0cd8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:34.886219 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4334849f-8033-47bf-8654-addf570b0cd8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:34.909516 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 827/1646] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:41:33 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1363 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:41:34.922940 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4334849f-8033-47bf-8654-addf570b0cd8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:41:34.928872 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e073df6b-ff33-4731-9194-042483835887 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '.version_select at 0x7f7e84779c10>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:35.056502 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4334849f-8033-47bf-8654-addf570b0cd8 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 204 len: 0 microversion: 2.1 time: 0.187242 Aug 04 16:41:35.059205 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 820/1647] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:41:34 2022] DELETE /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:41:35.079467 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d53261be-95df-4cd5-9e32-0fdb64df08df tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:35.080223 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d53261be-95df-4cd5-9e32-0fdb64df08df tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: f23a3c47-f725-4ad2-b88d-b972ff4b2ee9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:35.096699 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d53261be-95df-4cd5-9e32-0fdb64df08df tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:35.097506 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d53261be-95df-4cd5-9e32-0fdb64df08df tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:35.100235 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d53261be-95df-4cd5-9e32-0fdb64df08df tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:35.101146 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d53261be-95df-4cd5-9e32-0fdb64df08df tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:35.386878 n-d-846466-12 devstack@n-api.service[126125]: DEBUG neutronclient.v2_0.client [None req-e073df6b-ff33-4731-9194-042483835887 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f906bc12-1520-4c1e-ac50-ef902af656f0 does not exist", "detail": ""}} {{(pid=126125) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:41:35.389900 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.security_group_api [None req-e073df6b-ff33-4731-9194-042483835887 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Neutron security group f906bc12-1520-4c1e-ac50-ef902af656f0 not found {{(pid=126125) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 16:41:35.390842 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-e073df6b-ff33-4731-9194-042483835887 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] HTTP exception thrown: Security group f906bc12-1520-4c1e-ac50-ef902af656f0 does not exist Aug 04 16:41:35.390842 n-d-846466-12 devstack@n-api.service[126125]: Neutron server returns request_ids: ['req-780eebd6-46ae-4caf-8a89-8f924a270c23'] Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e073df6b-ff33-4731-9194-042483835887 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Request method failure captured: Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/os-security-groups/f906bc12-1520-4c1e-ac50-ef902af656f0 HTTP/1.1 Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_ZtqC96HabeWwNgyZnNmoMaRGEyMmVaUiLu9hLAQojAZCETOMBNx13l8QKIShQoX65FgHvzAm8VK7NKftXhvS9Bem6sccV9Ryn6Golur8wBQf_N6ajaCoRyYDB8mHggg2hJ4dz1CI18qnEF5I50zAGclpa2ng4xjm4gsGO8OQL5bTg Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: eb25e78b70ee48c99471d78e00e5949c Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb25e78b70ee48c99471d78e00e5949c"}]}] Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: eb25e78b70ee48c99471d78e00e5949c Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-SecurityGroupsTestJSON-886514065-project Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 23cc8f30e1f94ff0a520a071e5d81728 Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-SecurityGroupsTestJSON-886514065-project Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: exception: Security group f906bc12-1520-4c1e-ac50-ef902af656f0 does not exist Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: Neutron server returns request_ids: ['req-780eebd6-46ae-4caf-8a89-8f924a270c23'] Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'f906bc12-1520-4c1e-ac50-ef902af656f0'} Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:41:35.399470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f906bc12-1520-4c1e-ac50-ef902af656f0 does not exist Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-780eebd6-46ae-4caf-8a89-8f924a270c23'] Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f906bc12-1520-4c1e-ac50-ef902af656f0 does not exist Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-780eebd6-46ae-4caf-8a89-8f924a270c23'] Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f906bc12-1520-4c1e-ac50-ef902af656f0 does not exist Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-780eebd6-46ae-4caf-8a89-8f924a270c23'] Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f906bc12-1520-4c1e-ac50-ef902af656f0 does not exist Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-780eebd6-46ae-4caf-8a89-8f924a270c23'] Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e073df6b-ff33-4731-9194-042483835887 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Returning 404 to user: Security group f906bc12-1520-4c1e-ac50-ef902af656f0 does not exist Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: Neutron server returns request_ids: ['req-780eebd6-46ae-4caf-8a89-8f924a270c23'] {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:41:35.404931 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e073df6b-ff33-4731-9194-042483835887 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/f906bc12-1520-4c1e-ac50-ef902af656f0" status: 404 len: 194 microversion: 2.1 time: 0.488663 Aug 04 16:41:35.411581 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 828/1648] 10.222.0.23 () {58 vars in 1269 bytes} [Thu Aug 4 16:41:34 2022] GET /compute/v2.1/os-security-groups/f906bc12-1520-4c1e-ac50-ef902af656f0 => generated 194 bytes in 500 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:41:35.431264 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b09407e7-e1c8-4179-baf3-6028adffd7e1 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:35.432831 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b09407e7-e1c8-4179-baf3-6028adffd7e1 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:35.447795 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b09407e7-e1c8-4179-baf3-6028adffd7e1 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:35.449391 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b09407e7-e1c8-4179-baf3-6028adffd7e1 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:35.450535 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b09407e7-e1c8-4179-baf3-6028adffd7e1 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:35.451838 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b09407e7-e1c8-4179-baf3-6028adffd7e1 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:36.109342 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d53261be-95df-4cd5-9e32-0fdb64df08df tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b742cff6a948d0883501917706f66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b3a898ed4b4e0a82ae35830cb00ca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:36.147809 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d53261be-95df-4cd5-9e32-0fdb64df08df tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9" status: 200 len: 1500 microversion: 2.1 time: 1.086554 Aug 04 16:41:36.179060 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 821/1649] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:41:35 2022] GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 => generated 1500 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:41:36.200354 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-864e7415-c9dd-476d-bdef-fb8bf4808d0a tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:36.202102 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-864e7415-c9dd-476d-bdef-fb8bf4808d0a tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] [instance: b7f869cc-6c2f-4f4c-aa03-b39ed943c47b] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:36.232281 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-864e7415-c9dd-476d-bdef-fb8bf4808d0a tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:36.233639 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-864e7415-c9dd-476d-bdef-fb8bf4808d0a tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:36.240290 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-864e7415-c9dd-476d-bdef-fb8bf4808d0a tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:36.243417 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-864e7415-c9dd-476d-bdef-fb8bf4808d0a tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:36.397431 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b09407e7-e1c8-4179-baf3-6028adffd7e1 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:36.425147 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b09407e7-e1c8-4179-baf3-6028adffd7e1 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:36.432934 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b09407e7-e1c8-4179-baf3-6028adffd7e1 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:36.447793 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b09407e7-e1c8-4179-baf3-6028adffd7e1 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1886 microversion: 2.32 time: 1.033775 Aug 04 16:41:36.449512 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 829/1650] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:35 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1886 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:36.458171 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-c7baf9cf-0e6d-4fa6-aba9-b0ad98ab6e9d req-0e69d530-d67b-4b22-8ce8-80befe96f9e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dfa867e-8758-47d0-9256-3c864b36e819", "name": "network-vif-unplugged", "status": "completed", "tag": "251fa64f-5224-48c2-a585-f6377c372e04"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:36.502146 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-c7baf9cf-0e6d-4fa6-aba9-b0ad98ab6e9d req-0e69d530-d67b-4b22-8ce8-80befe96f9e5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:36.503211 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-c7baf9cf-0e6d-4fa6-aba9-b0ad98ab6e9d req-0e69d530-d67b-4b22-8ce8-80befe96f9e5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:36.535118 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-c7baf9cf-0e6d-4fa6-aba9-b0ad98ab6e9d req-0e69d530-d67b-4b22-8ce8-80befe96f9e5 service nova] Creating event network-vif-unplugged:251fa64f-5224-48c2-a585-f6377c372e04 for instance 3dfa867e-8758-47d0-9256-3c864b36e819 on n-h1-846466-12 Aug 04 16:41:36.548157 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-c7baf9cf-0e6d-4fa6-aba9-b0ad98ab6e9d req-0e69d530-d67b-4b22-8ce8-80befe96f9e5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096789 Aug 04 16:41:36.553526 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 830/1651] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:36.569628 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e5b20996-8d98-45e1-833c-19ac85998545 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:36.570761 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e5b20996-8d98-45e1-833c-19ac85998545 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:36.582569 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e5b20996-8d98-45e1-833c-19ac85998545 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:36.583468 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e5b20996-8d98-45e1-833c-19ac85998545 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:36.584572 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e5b20996-8d98-45e1-833c-19ac85998545 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:36.585264 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e5b20996-8d98-45e1-833c-19ac85998545 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:36.780258 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-864e7415-c9dd-476d-bdef-fb8bf4808d0a tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cd7076f4514ee89b0c4b2a586fe69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547b33a8f5a344f788da917f3512be5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:36.790263 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-864e7415-c9dd-476d-bdef-fb8bf4808d0a tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] 10.222.0.23 "GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b" status: 200 len: 1305 microversion: 2.1 time: 0.609527 Aug 04 16:41:36.805394 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 822/1652] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:41:36 2022] GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b => generated 1305 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:41:36.805394 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c779cbbd-19d2-43e6-8f01-50b2f3eb272b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '.version_select at 0x7f7e84e62b80>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:37.392258 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e5b20996-8d98-45e1-833c-19ac85998545 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e582cea96b64285b4232b96162a274c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c456fd996bb544478bdb39c6a7ca04a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:37.416799 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e5b20996-8d98-45e1-833c-19ac85998545 tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 200 len: 1467 microversion: 2.1 time: 0.856041 Aug 04 16:41:37.418055 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 831/1653] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:41:36 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 1467 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:41:37.439804 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-004b02e2-a6a3-4c5c-ac16-0fe4d8d28685 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:37.442135 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-004b02e2-a6a3-4c5c-ac16-0fe4d8d28685 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:37.475696 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-004b02e2-a6a3-4c5c-ac16-0fe4d8d28685 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:37.482207 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-004b02e2-a6a3-4c5c-ac16-0fe4d8d28685 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:37.486487 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-004b02e2-a6a3-4c5c-ac16-0fe4d8d28685 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:37.487118 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-004b02e2-a6a3-4c5c-ac16-0fe4d8d28685 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:38.796227 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-004b02e2-a6a3-4c5c-ac16-0fe4d8d28685 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:38.806480 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c779cbbd-19d2-43e6-8f01-50b2f3eb272b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/e406980e-85f8-416c-b8ba-fac4eb4d9411" status: 202 len: 0 microversion: 2.1 time: 2.006993 Aug 04 16:41:38.807291 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 823/1654] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:41:36 2022] DELETE /compute/v2.1/os-security-groups/e406980e-85f8-416c-b8ba-fac4eb4d9411 => generated 0 bytes in 2008 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:41:38.812743 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-74a345b6-8cd3-42bc-b094-fce578182ed3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:38.813423 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-74a345b6-8cd3-42bc-b094-fce578182ed3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:38.825238 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-004b02e2-a6a3-4c5c-ac16-0fe4d8d28685 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:38.834877 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-004b02e2-a6a3-4c5c-ac16-0fe4d8d28685 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:38.838458 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-004b02e2-a6a3-4c5c-ac16-0fe4d8d28685 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1487 microversion: 2.25 time: 1.408208 Aug 04 16:41:38.842706 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 832/1655] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:37 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1487 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:38.857057 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-392aeda8-3419-4126-816b-bb89e52c8000 req-154ba5bf-01d5-4a6b-8de6-a4accb128a2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c62ae02-0f30-43e1-a005-89dcb8122d4e", "tag": "93c46fa1-3978-4529-9c01-36e6a216c294"}, {"name": "network-changed", "server_uuid": "09e1b482-0372-4270-ac25-6d3349aca31e", "tag": "372f96d2-ee11-4947-bb71-af596393f831"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:38.864582 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-74a345b6-8cd3-42bc-b094-fce578182ed3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:38.864582 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-74a345b6-8cd3-42bc-b094-fce578182ed3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:38.865407 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-74a345b6-8cd3-42bc-b094-fce578182ed3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:38.865855 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-74a345b6-8cd3-42bc-b094-fce578182ed3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:38.890016 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-392aeda8-3419-4126-816b-bb89e52c8000 req-154ba5bf-01d5-4a6b-8de6-a4accb128a2c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:38.892664 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-392aeda8-3419-4126-816b-bb89e52c8000 req-154ba5bf-01d5-4a6b-8de6-a4accb128a2c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:38.917579 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:41:38.925712 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-392aeda8-3419-4126-816b-bb89e52c8000 req-154ba5bf-01d5-4a6b-8de6-a4accb128a2c service nova] Creating event network-changed:93c46fa1-3978-4529-9c01-36e6a216c294 for instance 0c62ae02-0f30-43e1-a005-89dcb8122d4e on n-h1-846466-12 Aug 04 16:41:38.927396 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-392aeda8-3419-4126-816b-bb89e52c8000 req-154ba5bf-01d5-4a6b-8de6-a4accb128a2c service nova] Creating event network-changed:372f96d2-ee11-4947-bb71-af596393f831 for instance 09e1b482-0372-4270-ac25-6d3349aca31e on n-h2-846466-12 Aug 04 16:41:38.949757 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-392aeda8-3419-4126-816b-bb89e52c8000 req-154ba5bf-01d5-4a6b-8de6-a4accb128a2c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.104283 Aug 04 16:41:38.951676 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 833/1656] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:38.980224 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-28bff73d-7008-44fd-b84a-0becd630de1e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:38.985173 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-28bff73d-7008-44fd-b84a-0becd630de1e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] [instance: f23a3c47-f725-4ad2-b88d-b972ff4b2ee9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:39.009973 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-28bff73d-7008-44fd-b84a-0becd630de1e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:39.011016 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-28bff73d-7008-44fd-b84a-0becd630de1e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:39.012496 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-28bff73d-7008-44fd-b84a-0becd630de1e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:39.013267 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-28bff73d-7008-44fd-b84a-0becd630de1e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:39.057384 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-28bff73d-7008-44fd-b84a-0becd630de1e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] HTTP exception thrown: Instance f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 could not be found. Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-28bff73d-7008-44fd-b84a-0becd630de1e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Request method failure captured: Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 HTTP/1.1 Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_TPS6aZuKxMYL7CvYdF5h6eTzUUfuaynC642KfGogzjdTdN7-PawOFY-6_UEI3Y985iNqxJBN1SEbOCosjMlSANhdnevytUzMwNwPy5JAn6DdbkBJqMxeFRLQMHuPIcsN7nNO7aDzKbnNDUgez5GVgbgfz5kz_J_E0BJY1XEX6dRy8 Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 82b3a898ed4b4e0a82ae35830cb00ca9 Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-LiveMigrationTest-403086797 Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/82b3a898ed4b4e0a82ae35830cb00ca9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_82b3a898ed4b4e0a82ae35830cb00ca9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/82b3a898ed4b4e0a82ae35830cb00ca9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/82b3a898ed4b4e0a82ae35830cb00ca9"}]}] Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-LiveMigrationTest-403086797 Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 82b3a898ed4b4e0a82ae35830cb00ca9 Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-LiveMigrationTest-403086797 Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-LiveMigrationTest-403086797-project Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 51b742cff6a948d0883501917706f66e Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-LiveMigrationTest-403086797-project Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 could not be found. Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'f23a3c47-f725-4ad2-b88d-b972ff4b2ee9'} Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 could not be found. Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 could not be found. Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:41:39.063478 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:39.074044 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:39.074044 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:41:39.074044 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:41:39.074044 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:41:39.074044 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:41:39.074044 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 could not be found. Aug 04 16:41:39.074044 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:39.078665 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-28bff73d-7008-44fd-b84a-0becd630de1e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] Returning 404 to user: Instance f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:41:39.081155 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-28bff73d-7008-44fd-b84a-0becd630de1e tempest-LiveMigrationTest-403086797 tempest-LiveMigrationTest-403086797-project] 10.222.0.23 "GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9" status: 404 len: 111 microversion: 2.1 time: 0.126582 Aug 04 16:41:39.082595 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 834/1657] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:41:38 2022] GET /compute/v2.1/servers/f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:41:39.093484 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a24548b6-e494-47d3-a38f-332fb4b6c395 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:39.094449 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a24548b6-e494-47d3-a38f-332fb4b6c395 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:39.114076 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a24548b6-e494-47d3-a38f-332fb4b6c395 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:39.117092 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a24548b6-e494-47d3-a38f-332fb4b6c395 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:39.120052 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a24548b6-e494-47d3-a38f-332fb4b6c395 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:39.122025 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a24548b6-e494-47d3-a38f-332fb4b6c395 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:40.132899 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-74a345b6-8cd3-42bc-b094-fce578182ed3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:40.157631 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-74a345b6-8cd3-42bc-b094-fce578182ed3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1363 microversion: 2.1 time: 1.349044 Aug 04 16:41:40.159670 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 824/1658] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:41:38 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1363 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:41:40.173108 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-487c5733-86b1-433a-99fe-5a17317397e5 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:40.176489 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-487c5733-86b1-433a-99fe-5a17317397e5 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] [instance: b7f869cc-6c2f-4f4c-aa03-b39ed943c47b] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:40.195009 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-487c5733-86b1-433a-99fe-5a17317397e5 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:40.195540 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-487c5733-86b1-433a-99fe-5a17317397e5 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:40.196236 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-487c5733-86b1-433a-99fe-5a17317397e5 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:40.202803 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-487c5733-86b1-433a-99fe-5a17317397e5 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:40.211046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a24548b6-e494-47d3-a38f-332fb4b6c395 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:40.266343 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a24548b6-e494-47d3-a38f-332fb4b6c395 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:40.273642 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a24548b6-e494-47d3-a38f-332fb4b6c395 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:40.275959 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a24548b6-e494-47d3-a38f-332fb4b6c395 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1874 microversion: 2.32 time: 1.190169 Aug 04 16:41:40.282204 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 835/1659] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:39 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1874 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:40.296311 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2bca05f1-eb06-4fa1-9376-c8a3042d2237 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:40.299148 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2bca05f1-eb06-4fa1-9376-c8a3042d2237 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:40.316238 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2bca05f1-eb06-4fa1-9376-c8a3042d2237 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:40.316682 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2bca05f1-eb06-4fa1-9376-c8a3042d2237 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:40.320720 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2bca05f1-eb06-4fa1-9376-c8a3042d2237 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:40.321501 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2bca05f1-eb06-4fa1-9376-c8a3042d2237 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:40.511195 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-2bca05f1-eb06-4fa1-9376-c8a3042d2237 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lazy-loading 'services' on Instance uuid b0c83347-17c8-4872-ae95-36497fd7a727 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:41:40.682854 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2bca05f1-eb06-4fa1-9376-c8a3042d2237 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727/os-volume_attachments/466ea028-925a-4b89-ab4d-77b5ed0bc0f1" status: 202 len: 0 microversion: 2.1 time: 0.396542 Aug 04 16:41:40.686088 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 836/1660] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Aug 4 16:41:40 2022] DELETE /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727/os-volume_attachments/466ea028-925a-4b89-ab4d-77b5ed0bc0f1 => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:41:40.702462 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e250edcb-4fb8-4f0f-ae51-3e6fb8f3597d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:40.704344 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e250edcb-4fb8-4f0f-ae51-3e6fb8f3597d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] [instance: 5a33abce-4d0a-4919-94db-28cea706d412] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:40.718167 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e250edcb-4fb8-4f0f-ae51-3e6fb8f3597d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:40.719664 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e250edcb-4fb8-4f0f-ae51-3e6fb8f3597d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:40.721714 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e250edcb-4fb8-4f0f-ae51-3e6fb8f3597d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:40.722954 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e250edcb-4fb8-4f0f-ae51-3e6fb8f3597d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:40.766583 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-e250edcb-4fb8-4f0f-ae51-3e6fb8f3597d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] HTTP exception thrown: Instance 5a33abce-4d0a-4919-94db-28cea706d412 could not be found. Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e250edcb-4fb8-4f0f-ae51-3e6fb8f3597d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Request method failure captured: Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 HTTP/1.1 Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_UNjyrdUtTWtUOVfvm9QCW4-h1rMjjcmnLuFclAR379GwHgC9qkbHaVs91LVnb5xlIDnCR7AfJ7Y7lX8rND5VAEY3XelUoM35o-NGXV_btI6qgXx2jm_QiZeT_LP2XvfNkriTBvHPg1CBc3ThfmjCpC6UQ0aHUMHnzoDunnCk8HwjE Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: c456fd996bb544478bdb39c6a7ca04a6 Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-MigrationsAdminTest-574448974 Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c456fd996bb544478bdb39c6a7ca04a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c456fd996bb544478bdb39c6a7ca04a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c456fd996bb544478bdb39c6a7ca04a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c456fd996bb544478bdb39c6a7ca04a6"}]}] Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-MigrationsAdminTest-574448974 Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: c456fd996bb544478bdb39c6a7ca04a6 Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-MigrationsAdminTest-574448974 Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-MigrationsAdminTest-574448974-project Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 6e582cea96b64285b4232b96162a274c Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-MigrationsAdminTest-574448974-project Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 5a33abce-4d0a-4919-94db-28cea706d412 could not be found. Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '5a33abce-4d0a-4919-94db-28cea706d412'} Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a33abce-4d0a-4919-94db-28cea706d412 could not be found. Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a33abce-4d0a-4919-94db-28cea706d412 could not be found. Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:41:40.772162 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:40.779497 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:40.779497 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:41:40.779497 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:41:40.779497 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:41:40.779497 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:41:40.779497 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a33abce-4d0a-4919-94db-28cea706d412 could not be found. Aug 04 16:41:40.779497 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:40.788116 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e250edcb-4fb8-4f0f-ae51-3e6fb8f3597d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] Returning 404 to user: Instance 5a33abce-4d0a-4919-94db-28cea706d412 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:41:40.792604 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e250edcb-4fb8-4f0f-ae51-3e6fb8f3597d tempest-MigrationsAdminTest-574448974 tempest-MigrationsAdminTest-574448974-project] 10.222.0.23 "GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412" status: 404 len: 111 microversion: 2.1 time: 0.102196 Aug 04 16:41:40.794598 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 837/1661] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:41:40 2022] GET /compute/v2.1/servers/5a33abce-4d0a-4919-94db-28cea706d412 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:41:40.811958 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-0be1b499-fda5-4be4-ad6f-5b144bd847ba req-2d1b6b46-d5c0-462b-8635-cef8af5121a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dfa867e-8758-47d0-9256-3c864b36e819", "tag": "251fa64f-5224-48c2-a585-f6377c372e04"}, {"server_uuid": "5a33abce-4d0a-4919-94db-28cea706d412", "name": "network-vif-deleted", "tag": "e1d80942-af44-4bef-a238-f9fca1aa7ddf"}, {"name": "network-changed", "server_uuid": "b7f869cc-6c2f-4f4c-aa03-b39ed943c47b", "tag": "6eab9e47-2e8f-463d-8fd3-42f3c27b7f18"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:40.842337 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-0be1b499-fda5-4be4-ad6f-5b144bd847ba req-2d1b6b46-d5c0-462b-8635-cef8af5121a7 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:40.844125 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-0be1b499-fda5-4be4-ad6f-5b144bd847ba req-2d1b6b46-d5c0-462b-8635-cef8af5121a7 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:40.890453 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-0be1b499-fda5-4be4-ad6f-5b144bd847ba req-2d1b6b46-d5c0-462b-8635-cef8af5121a7 service nova] Creating event network-changed:251fa64f-5224-48c2-a585-f6377c372e04 for instance 3dfa867e-8758-47d0-9256-3c864b36e819 on n-h1-846466-12 Aug 04 16:41:40.893435 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-0be1b499-fda5-4be4-ad6f-5b144bd847ba req-2d1b6b46-d5c0-462b-8635-cef8af5121a7 service nova] Creating event network-vif-deleted:e1d80942-af44-4bef-a238-f9fca1aa7ddf for instance 5a33abce-4d0a-4919-94db-28cea706d412 on n-h2-846466-12 Aug 04 16:41:40.898294 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-0be1b499-fda5-4be4-ad6f-5b144bd847ba req-2d1b6b46-d5c0-462b-8635-cef8af5121a7 service nova] Creating event network-changed:6eab9e47-2e8f-463d-8fd3-42f3c27b7f18 for instance b7f869cc-6c2f-4f4c-aa03-b39ed943c47b on n-h1-846466-12 Aug 04 16:41:40.925089 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-0be1b499-fda5-4be4-ad6f-5b144bd847ba req-2d1b6b46-d5c0-462b-8635-cef8af5121a7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.127141 Aug 04 16:41:40.928173 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 838/1662] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:40.940648 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-61027d81-ba53-4e85-ae66-8f81e26e0238 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '.version_select at 0x7f7e847791f0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:41.110853 n-d-846466-12 devstack@n-api.service[126125]: DEBUG neutronclient.v2_0.client [None req-61027d81-ba53-4e85-ae66-8f81e26e0238 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e406980e-85f8-416c-b8ba-fac4eb4d9411 does not exist", "detail": ""}} {{(pid=126125) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:41:41.111894 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.security_group_api [None req-61027d81-ba53-4e85-ae66-8f81e26e0238 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Neutron security group e406980e-85f8-416c-b8ba-fac4eb4d9411 not found {{(pid=126125) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 16:41:41.112660 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-61027d81-ba53-4e85-ae66-8f81e26e0238 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] HTTP exception thrown: Security group e406980e-85f8-416c-b8ba-fac4eb4d9411 does not exist Aug 04 16:41:41.112660 n-d-846466-12 devstack@n-api.service[126125]: Neutron server returns request_ids: ['req-c51b0f3a-2d43-4b16-9348-0a1f80385ff1'] Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-61027d81-ba53-4e85-ae66-8f81e26e0238 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Request method failure captured: Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/os-security-groups/e406980e-85f8-416c-b8ba-fac4eb4d9411 HTTP/1.1 Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_ZtqC96HabeWwNgyZnNmoMaRGEyMmVaUiLu9hLAQojAZCETOMBNx13l8QKIShQoX65FgHvzAm8VK7NKftXhvS9Bem6sccV9Ryn6Golur8wBQf_N6ajaCoRyYDB8mHggg2hJ4dz1CI18qnEF5I50zAGclpa2ng4xjm4gsGO8OQL5bTg Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: eb25e78b70ee48c99471d78e00e5949c Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb25e78b70ee48c99471d78e00e5949c"}]}] Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: eb25e78b70ee48c99471d78e00e5949c Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-SecurityGroupsTestJSON-886514065-project Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 23cc8f30e1f94ff0a520a071e5d81728 Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-SecurityGroupsTestJSON-886514065-project Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: exception: Security group e406980e-85f8-416c-b8ba-fac4eb4d9411 does not exist Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: Neutron server returns request_ids: ['req-c51b0f3a-2d43-4b16-9348-0a1f80385ff1'] Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'e406980e-85f8-416c-b8ba-fac4eb4d9411'} Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:41:41.116440 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e406980e-85f8-416c-b8ba-fac4eb4d9411 does not exist Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c51b0f3a-2d43-4b16-9348-0a1f80385ff1'] Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e406980e-85f8-416c-b8ba-fac4eb4d9411 does not exist Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c51b0f3a-2d43-4b16-9348-0a1f80385ff1'] Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e406980e-85f8-416c-b8ba-fac4eb4d9411 does not exist Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c51b0f3a-2d43-4b16-9348-0a1f80385ff1'] Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e406980e-85f8-416c-b8ba-fac4eb4d9411 does not exist Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c51b0f3a-2d43-4b16-9348-0a1f80385ff1'] Aug 04 16:41:41.123062 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:41.127776 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-61027d81-ba53-4e85-ae66-8f81e26e0238 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Returning 404 to user: Security group e406980e-85f8-416c-b8ba-fac4eb4d9411 does not exist Aug 04 16:41:41.127776 n-d-846466-12 devstack@n-api.service[126125]: Neutron server returns request_ids: ['req-c51b0f3a-2d43-4b16-9348-0a1f80385ff1'] {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:41:41.128714 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-61027d81-ba53-4e85-ae66-8f81e26e0238 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/e406980e-85f8-416c-b8ba-fac4eb4d9411" status: 404 len: 194 microversion: 2.1 time: 0.196869 Aug 04 16:41:41.133995 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 839/1663] 10.222.0.23 () {58 vars in 1269 bytes} [Thu Aug 4 16:41:40 2022] GET /compute/v2.1/os-security-groups/e406980e-85f8-416c-b8ba-fac4eb4d9411 => generated 194 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:41:41.148578 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ac6bfd68-2ece-42b2-b887-6553fb980aea tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:41.150516 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ac6bfd68-2ece-42b2-b887-6553fb980aea tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:41.160975 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:41:41.163744 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ac6bfd68-2ece-42b2-b887-6553fb980aea tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:41.165146 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ac6bfd68-2ece-42b2-b887-6553fb980aea tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:41.167060 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ac6bfd68-2ece-42b2-b887-6553fb980aea tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:41.167765 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ac6bfd68-2ece-42b2-b887-6553fb980aea tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:41.194062 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=12 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:41:41.248934 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-487c5733-86b1-433a-99fe-5a17317397e5 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cd7076f4514ee89b0c4b2a586fe69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547b33a8f5a344f788da917f3512be5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:41.279410 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-487c5733-86b1-433a-99fe-5a17317397e5 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] 10.222.0.23 "GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b" status: 200 len: 1305 microversion: 2.1 time: 1.112951 Aug 04 16:41:41.284524 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 825/1664] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:41:40 2022] GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b => generated 1305 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:41:41.301600 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-843da5e6-74d8-459e-9be8-e325ee3e1665 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:41.306247 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-843da5e6-74d8-459e-9be8-e325ee3e1665 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:41.336028 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-843da5e6-74d8-459e-9be8-e325ee3e1665 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:41.339827 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-843da5e6-74d8-459e-9be8-e325ee3e1665 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:41.345799 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-843da5e6-74d8-459e-9be8-e325ee3e1665 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:41.351825 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-843da5e6-74d8-459e-9be8-e325ee3e1665 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:41.475859 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-843da5e6-74d8-459e-9be8-e325ee3e1665 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.189247 Aug 04 16:41:41.489786 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 826/1665] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 16:41:41 2022] GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727/os-volume_attachments => generated 197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:41.498863 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-5b929b53-acfa-419c-9577-76aa2cf43664 req-42bda9fc-c48d-4ee2-bc50-7ba8c18555e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23a3c47-f725-4ad2-b88d-b972ff4b2ee9", "name": "network-vif-deleted", "tag": "77a7f0dd-2800-4d07-92d9-a10d97d83794"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:41.517917 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-5b929b53-acfa-419c-9577-76aa2cf43664 req-42bda9fc-c48d-4ee2-bc50-7ba8c18555e5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:41.519863 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-5b929b53-acfa-419c-9577-76aa2cf43664 req-42bda9fc-c48d-4ee2-bc50-7ba8c18555e5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:41.571060 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-5b929b53-acfa-419c-9577-76aa2cf43664 req-42bda9fc-c48d-4ee2-bc50-7ba8c18555e5 service nova] Creating event network-vif-deleted:77a7f0dd-2800-4d07-92d9-a10d97d83794 for instance f23a3c47-f725-4ad2-b88d-b972ff4b2ee9 on n-h2-846466-12 Aug 04 16:41:41.588220 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-5b929b53-acfa-419c-9577-76aa2cf43664 req-42bda9fc-c48d-4ee2-bc50-7ba8c18555e5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096055 Aug 04 16:41:41.590109 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 827/1666] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:41.605319 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-619b3d61-9830-4d4e-944f-0b8570804352 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '.version_select at 0x7f7e84d6a310>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:41.625144 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ac6bfd68-2ece-42b2-b887-6553fb980aea tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:41.644885 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ac6bfd68-2ece-42b2-b887-6553fb980aea tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:41.648980 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ac6bfd68-2ece-42b2-b887-6553fb980aea tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:41.655939 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ac6bfd68-2ece-42b2-b887-6553fb980aea tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1487 microversion: 2.25 time: 0.520563 Aug 04 16:41:41.669469 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 840/1667] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:41 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1487 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:41.670325 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-35efa59d-5c4c-4d0f-95a9-95d9578b3058 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:41.671276 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-35efa59d-5c4c-4d0f-95a9-95d9578b3058 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:41.711471 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-35efa59d-5c4c-4d0f-95a9-95d9578b3058 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:41.712267 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-35efa59d-5c4c-4d0f-95a9-95d9578b3058 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:41.721760 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-35efa59d-5c4c-4d0f-95a9-95d9578b3058 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:41.722376 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-35efa59d-5c4c-4d0f-95a9-95d9578b3058 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:41.794826 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:41:42.648212 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-35efa59d-5c4c-4d0f-95a9-95d9578b3058 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:42.667653 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-35efa59d-5c4c-4d0f-95a9-95d9578b3058 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1363 microversion: 2.1 time: 1.003738 Aug 04 16:41:42.670530 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 841/1668] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:41:41 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1363 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:41:42.687415 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-9e0378c4-7d8b-4401-919d-bfc3fadd209e req-09e3cee5-0360-43cf-8660-58406e3fd6db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c62ae02-0f30-43e1-a005-89dcb8122d4e", "name": "network-vif-plugged", "status": "completed", "tag": "93c46fa1-3978-4529-9c01-36e6a216c294"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:42.706141 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-9e0378c4-7d8b-4401-919d-bfc3fadd209e req-09e3cee5-0360-43cf-8660-58406e3fd6db service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:42.707308 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-9e0378c4-7d8b-4401-919d-bfc3fadd209e req-09e3cee5-0360-43cf-8660-58406e3fd6db service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:42.726905 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-9e0378c4-7d8b-4401-919d-bfc3fadd209e req-09e3cee5-0360-43cf-8660-58406e3fd6db service nova] Creating event network-vif-plugged:93c46fa1-3978-4529-9c01-36e6a216c294 for instance 0c62ae02-0f30-43e1-a005-89dcb8122d4e on n-h1-846466-12 Aug 04 16:41:42.735702 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-9e0378c4-7d8b-4401-919d-bfc3fadd209e req-09e3cee5-0360-43cf-8660-58406e3fd6db service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062662 Aug 04 16:41:42.737545 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 842/1669] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:42.747059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-57d8fddb-a7ec-4bf7-a6a0-a9659aec4539 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:42.748417 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-57d8fddb-a7ec-4bf7-a6a0-a9659aec4539 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:42.764846 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-57d8fddb-a7ec-4bf7-a6a0-a9659aec4539 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:42.765685 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-57d8fddb-a7ec-4bf7-a6a0-a9659aec4539 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:42.766776 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-57d8fddb-a7ec-4bf7-a6a0-a9659aec4539 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:42.767357 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-57d8fddb-a7ec-4bf7-a6a0-a9659aec4539 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:43.581157 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-619b3d61-9830-4d4e-944f-0b8570804352 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/37a7d6ab-171d-4b5c-a953-31cb528228df" status: 202 len: 0 microversion: 2.1 time: 1.988770 Aug 04 16:41:43.583112 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 828/1670] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:41:41 2022] DELETE /compute/v2.1/os-security-groups/37a7d6ab-171d-4b5c-a953-31cb528228df => generated 0 bytes in 1992 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:41:43.592092 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-285cd860-3616-441a-a4f4-fa1558be8085 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:43.593643 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-285cd860-3616-441a-a4f4-fa1558be8085 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] [instance: b7f869cc-6c2f-4f4c-aa03-b39ed943c47b] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:43.622099 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-285cd860-3616-441a-a4f4-fa1558be8085 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:43.626953 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-285cd860-3616-441a-a4f4-fa1558be8085 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:43.634080 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-285cd860-3616-441a-a4f4-fa1558be8085 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:43.638688 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-285cd860-3616-441a-a4f4-fa1558be8085 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:43.702760 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-57d8fddb-a7ec-4bf7-a6a0-a9659aec4539 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:43.788324 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-57d8fddb-a7ec-4bf7-a6a0-a9659aec4539 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:43.799842 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-57d8fddb-a7ec-4bf7-a6a0-a9659aec4539 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:43.806679 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-57d8fddb-a7ec-4bf7-a6a0-a9659aec4539 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1874 microversion: 2.32 time: 1.066918 Aug 04 16:41:43.812206 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 843/1671] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:42 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1874 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:43.837197 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c9534a1c-2cd7-42bc-9ae9-ace4b68a5815 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:43.848161 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c9534a1c-2cd7-42bc-9ae9-ace4b68a5815 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:43.878032 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c9534a1c-2cd7-42bc-9ae9-ace4b68a5815 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:43.882125 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c9534a1c-2cd7-42bc-9ae9-ace4b68a5815 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:43.886344 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c9534a1c-2cd7-42bc-9ae9-ace4b68a5815 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:43.890097 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c9534a1c-2cd7-42bc-9ae9-ace4b68a5815 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:44.046552 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c9534a1c-2cd7-42bc-9ae9-ace4b68a5815 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.229512 Aug 04 16:41:44.066400 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 844/1672] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 16:41:43 2022] GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727/os-volume_attachments => generated 197 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:44.079973 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dc2a3ce1-2ca4-429f-8ce7-9c94165d9a7e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:44.090207 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dc2a3ce1-2ca4-429f-8ce7-9c94165d9a7e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:44.115634 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dc2a3ce1-2ca4-429f-8ce7-9c94165d9a7e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:44.117256 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dc2a3ce1-2ca4-429f-8ce7-9c94165d9a7e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:44.122220 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dc2a3ce1-2ca4-429f-8ce7-9c94165d9a7e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:44.124225 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dc2a3ce1-2ca4-429f-8ce7-9c94165d9a7e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:44.832442 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dc2a3ce1-2ca4-429f-8ce7-9c94165d9a7e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:44.846327 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dc2a3ce1-2ca4-429f-8ce7-9c94165d9a7e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:44.851240 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dc2a3ce1-2ca4-429f-8ce7-9c94165d9a7e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:44.857039 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dc2a3ce1-2ca4-429f-8ce7-9c94165d9a7e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1487 microversion: 2.25 time: 0.787049 Aug 04 16:41:44.859798 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 845/1673] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:44 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1487 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:44.883104 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d7d131d3-c518-4ea0-a734-3146978bf039 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '.version_select at 0x7f7e77d7e5e0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:44.961969 n-d-846466-12 devstack@n-api.service[126125]: DEBUG neutronclient.v2_0.client [None req-d7d131d3-c518-4ea0-a734-3146978bf039 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 37a7d6ab-171d-4b5c-a953-31cb528228df does not exist", "detail": ""}} {{(pid=126125) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:41:44.963978 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.security_group_api [None req-d7d131d3-c518-4ea0-a734-3146978bf039 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Neutron security group 37a7d6ab-171d-4b5c-a953-31cb528228df not found {{(pid=126125) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 16:41:44.965312 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-d7d131d3-c518-4ea0-a734-3146978bf039 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] HTTP exception thrown: Security group 37a7d6ab-171d-4b5c-a953-31cb528228df does not exist Aug 04 16:41:44.965312 n-d-846466-12 devstack@n-api.service[126125]: Neutron server returns request_ids: ['req-ba5bc202-7e5b-4b79-b7a3-9d3e371d6638'] Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d7d131d3-c518-4ea0-a734-3146978bf039 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Request method failure captured: Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/os-security-groups/37a7d6ab-171d-4b5c-a953-31cb528228df HTTP/1.1 Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_ZtqC96HabeWwNgyZnNmoMaRGEyMmVaUiLu9hLAQojAZCETOMBNx13l8QKIShQoX65FgHvzAm8VK7NKftXhvS9Bem6sccV9Ryn6Golur8wBQf_N6ajaCoRyYDB8mHggg2hJ4dz1CI18qnEF5I50zAGclpa2ng4xjm4gsGO8OQL5bTg Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: eb25e78b70ee48c99471d78e00e5949c Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb25e78b70ee48c99471d78e00e5949c"}]}] Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: eb25e78b70ee48c99471d78e00e5949c Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-SecurityGroupsTestJSON-886514065-project Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 23cc8f30e1f94ff0a520a071e5d81728 Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-SecurityGroupsTestJSON-886514065-project Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: exception: Security group 37a7d6ab-171d-4b5c-a953-31cb528228df does not exist Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: Neutron server returns request_ids: ['req-ba5bc202-7e5b-4b79-b7a3-9d3e371d6638'] Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '37a7d6ab-171d-4b5c-a953-31cb528228df'} Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:41:44.970842 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 37a7d6ab-171d-4b5c-a953-31cb528228df does not exist Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ba5bc202-7e5b-4b79-b7a3-9d3e371d6638'] Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 37a7d6ab-171d-4b5c-a953-31cb528228df does not exist Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ba5bc202-7e5b-4b79-b7a3-9d3e371d6638'] Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 37a7d6ab-171d-4b5c-a953-31cb528228df does not exist Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ba5bc202-7e5b-4b79-b7a3-9d3e371d6638'] Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 37a7d6ab-171d-4b5c-a953-31cb528228df does not exist Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ba5bc202-7e5b-4b79-b7a3-9d3e371d6638'] Aug 04 16:41:44.975965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:41:44.988636 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d7d131d3-c518-4ea0-a734-3146978bf039 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Returning 404 to user: Security group 37a7d6ab-171d-4b5c-a953-31cb528228df does not exist Aug 04 16:41:44.988636 n-d-846466-12 devstack@n-api.service[126125]: Neutron server returns request_ids: ['req-ba5bc202-7e5b-4b79-b7a3-9d3e371d6638'] {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:41:44.990939 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d7d131d3-c518-4ea0-a734-3146978bf039 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/37a7d6ab-171d-4b5c-a953-31cb528228df" status: 404 len: 194 microversion: 2.1 time: 0.129391 Aug 04 16:41:44.992120 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 846/1674] 10.222.0.23 () {58 vars in 1269 bytes} [Thu Aug 4 16:41:44 2022] GET /compute/v2.1/os-security-groups/37a7d6ab-171d-4b5c-a953-31cb528228df => generated 194 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:41:45.003637 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-424f81d3-1e99-427d-90b2-7f2315158f34 req-2de57595-eb92-4121-a2ce-4fa18862ddb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09e1b482-0372-4270-ac25-6d3349aca31e", "tag": "a55a1fc3-452c-4f78-8499-e76e8bdb7750"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:45.056583 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-424f81d3-1e99-427d-90b2-7f2315158f34 req-2de57595-eb92-4121-a2ce-4fa18862ddb1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:45.060866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-424f81d3-1e99-427d-90b2-7f2315158f34 req-2de57595-eb92-4121-a2ce-4fa18862ddb1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:45.105710 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-424f81d3-1e99-427d-90b2-7f2315158f34 req-2de57595-eb92-4121-a2ce-4fa18862ddb1 service nova] Creating event network-changed:a55a1fc3-452c-4f78-8499-e76e8bdb7750 for instance 09e1b482-0372-4270-ac25-6d3349aca31e on n-h2-846466-12 Aug 04 16:41:45.127799 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-424f81d3-1e99-427d-90b2-7f2315158f34 req-2de57595-eb92-4121-a2ce-4fa18862ddb1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132924 Aug 04 16:41:45.140070 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 847/1675] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:45.168892 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-285cd860-3616-441a-a4f4-fa1558be8085 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cd7076f4514ee89b0c4b2a586fe69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547b33a8f5a344f788da917f3512be5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:45.196377 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-285cd860-3616-441a-a4f4-fa1558be8085 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] 10.222.0.23 "GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b" status: 200 len: 1305 microversion: 2.1 time: 1.610429 Aug 04 16:41:45.200260 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2d8a1675-24ac-47f0-b3dc-159ece4f7963 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:45.201473 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 829/1676] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:41:43 2022] GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b => generated 1305 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:41:45.202915 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2d8a1675-24ac-47f0-b3dc-159ece4f7963 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:45.212016 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e008df15-f618-4062-a1ab-1523c7a85368 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:45.213772 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e008df15-f618-4062-a1ab-1523c7a85368 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:45.220218 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d8a1675-24ac-47f0-b3dc-159ece4f7963 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:45.223567 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d8a1675-24ac-47f0-b3dc-159ece4f7963 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:45.224615 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d8a1675-24ac-47f0-b3dc-159ece4f7963 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:45.225574 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d8a1675-24ac-47f0-b3dc-159ece4f7963 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:45.228021 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e008df15-f618-4062-a1ab-1523c7a85368 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:45.228829 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e008df15-f618-4062-a1ab-1523c7a85368 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:45.230684 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e008df15-f618-4062-a1ab-1523c7a85368 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:45.231959 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e008df15-f618-4062-a1ab-1523c7a85368 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:46.831259 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2d8a1675-24ac-47f0-b3dc-159ece4f7963 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:46.840318 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2d8a1675-24ac-47f0-b3dc-159ece4f7963 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1550 microversion: 2.1 time: 1.692904 Aug 04 16:41:46.840931 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 848/1677] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:41:45 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1550 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:41:46.881477 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-984402fb-e014-40bd-8f6e-d512a9e0bb4b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '.version_select at 0x7f7e8409fca0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:46.883031 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e008df15-f618-4062-a1ab-1523c7a85368 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:46.917962 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e008df15-f618-4062-a1ab-1523c7a85368 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:46.922304 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e008df15-f618-4062-a1ab-1523c7a85368 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:46.925793 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e008df15-f618-4062-a1ab-1523c7a85368 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1874 microversion: 2.32 time: 1.722179 Aug 04 16:41:46.927843 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 830/1678] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:45 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1874 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:46.935735 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2e8de2a4-9329-40a7-8b25-79347991a539 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:46.938882 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2e8de2a4-9329-40a7-8b25-79347991a539 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:46.948658 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2e8de2a4-9329-40a7-8b25-79347991a539 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:46.950382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2e8de2a4-9329-40a7-8b25-79347991a539 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:46.951918 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2e8de2a4-9329-40a7-8b25-79347991a539 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:46.952548 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2e8de2a4-9329-40a7-8b25-79347991a539 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:46.993218 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2e8de2a4-9329-40a7-8b25-79347991a539 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062704 Aug 04 16:41:46.998983 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 831/1679] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 16:41:46 2022] GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:47.027370 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0c77cdcd-d210-42f0-8dff-fc55cede77a4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:47.028739 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0c77cdcd-d210-42f0-8dff-fc55cede77a4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:47.045717 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c77cdcd-d210-42f0-8dff-fc55cede77a4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:47.051678 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c77cdcd-d210-42f0-8dff-fc55cede77a4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:47.052765 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c77cdcd-d210-42f0-8dff-fc55cede77a4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:47.053214 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c77cdcd-d210-42f0-8dff-fc55cede77a4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:47.988958 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0c77cdcd-d210-42f0-8dff-fc55cede77a4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:48.025436 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0c77cdcd-d210-42f0-8dff-fc55cede77a4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:48.039953 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0c77cdcd-d210-42f0-8dff-fc55cede77a4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:48.042671 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0c77cdcd-d210-42f0-8dff-fc55cede77a4 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1487 microversion: 2.25 time: 1.041326 Aug 04 16:41:48.047057 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 832/1680] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:46 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1487 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:48.083478 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b09ec89d-9ab5-44f2-8c9f-e5724b4ad1e7 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:48.086820 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b09ec89d-9ab5-44f2-8c9f-e5724b4ad1e7 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] [instance: b7f869cc-6c2f-4f4c-aa03-b39ed943c47b] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:48.099948 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b09ec89d-9ab5-44f2-8c9f-e5724b4ad1e7 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:48.101149 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b09ec89d-9ab5-44f2-8c9f-e5724b4ad1e7 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:48.102579 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b09ec89d-9ab5-44f2-8c9f-e5724b4ad1e7 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:48.103380 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b09ec89d-9ab5-44f2-8c9f-e5724b4ad1e7 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:48.779531 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-984402fb-e014-40bd-8f6e-d512a9e0bb4b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 1.917005 Aug 04 16:41:48.781718 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 849/1681] 10.222.0.23 () {58 vars in 1158 bytes} [Thu Aug 4 16:41:46 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 1940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:41:48.803199 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d34bebb3-d513-4e7d-a621-0fcc239216e8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:48.804870 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d34bebb3-d513-4e7d-a621-0fcc239216e8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:48.813647 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d34bebb3-d513-4e7d-a621-0fcc239216e8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:48.815671 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d34bebb3-d513-4e7d-a621-0fcc239216e8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:48.817545 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d34bebb3-d513-4e7d-a621-0fcc239216e8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:48.818906 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d34bebb3-d513-4e7d-a621-0fcc239216e8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:48.963937 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b09ec89d-9ab5-44f2-8c9f-e5724b4ad1e7 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cd7076f4514ee89b0c4b2a586fe69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547b33a8f5a344f788da917f3512be5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:48.981830 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b09ec89d-9ab5-44f2-8c9f-e5724b4ad1e7 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] 10.222.0.23 "GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b" status: 200 len: 1305 microversion: 2.1 time: 0.925714 Aug 04 16:41:48.997887 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 833/1682] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:41:48 2022] GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b => generated 1305 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:41:49.021093 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-6ca2695c-baff-467f-a47a-544aee0c324e req-c39c9e5d-0393-4f1a-9f43-a77bf1042598 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09e1b482-0372-4270-ac25-6d3349aca31e", "tag": "c03b3426-9b13-43b4-8130-95a9515f9f8a"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:49.041870 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-6ca2695c-baff-467f-a47a-544aee0c324e req-c39c9e5d-0393-4f1a-9f43-a77bf1042598 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:49.043084 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-6ca2695c-baff-467f-a47a-544aee0c324e req-c39c9e5d-0393-4f1a-9f43-a77bf1042598 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:49.075766 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-6ca2695c-baff-467f-a47a-544aee0c324e req-c39c9e5d-0393-4f1a-9f43-a77bf1042598 service nova] Creating event network-changed:c03b3426-9b13-43b4-8130-95a9515f9f8a for instance 09e1b482-0372-4270-ac25-6d3349aca31e on n-h2-846466-12 Aug 04 16:41:49.088143 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-6ca2695c-baff-467f-a47a-544aee0c324e req-c39c9e5d-0393-4f1a-9f43-a77bf1042598 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087004 Aug 04 16:41:49.090759 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 834/1683] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:49.099140 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1fc89c57-5e98-4859-ba5d-c25d52cd4157 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:49.100253 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1fc89c57-5e98-4859-ba5d-c25d52cd4157 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:49.117769 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1fc89c57-5e98-4859-ba5d-c25d52cd4157 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:49.119107 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1fc89c57-5e98-4859-ba5d-c25d52cd4157 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:49.120841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1fc89c57-5e98-4859-ba5d-c25d52cd4157 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:49.122215 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1fc89c57-5e98-4859-ba5d-c25d52cd4157 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:49.153484 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d34bebb3-d513-4e7d-a621-0fcc239216e8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.368102 Aug 04 16:41:49.154676 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 850/1684] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Aug 4 16:41:48 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/os-interface => generated 284 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:49.166241 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7d61fcb8-8392-4e51-92e4-fcd0386380db tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:49.188908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7d61fcb8-8392-4e51-92e4-fcd0386380db tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:49.214059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d61fcb8-8392-4e51-92e4-fcd0386380db tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:49.215467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d61fcb8-8392-4e51-92e4-fcd0386380db tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:49.217624 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d61fcb8-8392-4e51-92e4-fcd0386380db tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:49.218915 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d61fcb8-8392-4e51-92e4-fcd0386380db tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:49.286777 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7d61fcb8-8392-4e51-92e4-fcd0386380db tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128001 Aug 04 16:41:49.291281 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 851/1685] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 16:41:49 2022] GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:49.573161 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d994f85a-0424-44fb-bf7c-b05588c59e20 tempest-QuotasAdminTestV257-771497903 tempest-QuotasAdminTestV257-771497903-project-admin] Action: 'update', calling method: .version_select at 0x7f7e77cc1820>, body: {"quota_set": {"ram": "5120"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:49.756339 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d994f85a-0424-44fb-bf7c-b05588c59e20 tempest-QuotasAdminTestV257-771497903 tempest-QuotasAdminTestV257-771497903-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:49.757742 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d994f85a-0424-44fb-bf7c-b05588c59e20 tempest-QuotasAdminTestV257-771497903 tempest-QuotasAdminTestV257-771497903-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:49.759695 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d994f85a-0424-44fb-bf7c-b05588c59e20 tempest-QuotasAdminTestV257-771497903 tempest-QuotasAdminTestV257-771497903-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:49.760998 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d994f85a-0424-44fb-bf7c-b05588c59e20 tempest-QuotasAdminTestV257-771497903 tempest-QuotasAdminTestV257-771497903-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:49.898535 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d994f85a-0424-44fb-bf7c-b05588c59e20 tempest-QuotasAdminTestV257-771497903 tempest-QuotasAdminTestV257-771497903-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/9287bef5e09643838eb24be3d9425852" status: 200 len: 148 microversion: 2.57 time: 0.604752 Aug 04 16:41:49.904791 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 852/1686] 10.222.0.23 () {62 vars in 1303 bytes} [Thu Aug 4 16:41:49 2022] PUT /compute/v2.1/os-quota-sets/9287bef5e09643838eb24be3d9425852 => generated 148 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:41:49.921779 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-959178e2-cc22-4651-9cc0-70ec0d49693e tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Action: 'create', calling method: .version_select at 0x7f7e77cc18b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-94813427", "description": "tempest-description-2103482984"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:50.505096 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1fc89c57-5e98-4859-ba5d-c25d52cd4157 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:50.536559 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1fc89c57-5e98-4859-ba5d-c25d52cd4157 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:50.544796 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1fc89c57-5e98-4859-ba5d-c25d52cd4157 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:50.547851 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1fc89c57-5e98-4859-ba5d-c25d52cd4157 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1874 microversion: 2.32 time: 1.455139 Aug 04 16:41:50.549630 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 835/1687] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:49 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1874 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:50.566865 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-777c561b-389f-4c43-a931-26d663cca49b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:50.569013 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-777c561b-389f-4c43-a931-26d663cca49b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:50.584316 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-777c561b-389f-4c43-a931-26d663cca49b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:50.587271 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-777c561b-389f-4c43-a931-26d663cca49b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:50.589639 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-777c561b-389f-4c43-a931-26d663cca49b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:50.591297 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-777c561b-389f-4c43-a931-26d663cca49b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:51.390000 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-959178e2-cc22-4651-9cc0-70ec0d49693e tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.479877 Aug 04 16:41:51.391990 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 853/1688] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Aug 4 16:41:49 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:51.397541 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d8512317-20fc-4337-9343-e8bc96468cb4 tempest-QuotasAdminTestV257-771497903 tempest-QuotasAdminTestV257-771497903-project-admin] Calling method '.version_select at 0x7f7e77cc1310>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:51.534472 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d8512317-20fc-4337-9343-e8bc96468cb4 tempest-QuotasAdminTestV257-771497903 tempest-QuotasAdminTestV257-771497903-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:51.538725 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d8512317-20fc-4337-9343-e8bc96468cb4 tempest-QuotasAdminTestV257-771497903 tempest-QuotasAdminTestV257-771497903-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:51.540781 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d8512317-20fc-4337-9343-e8bc96468cb4 tempest-QuotasAdminTestV257-771497903 tempest-QuotasAdminTestV257-771497903-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:51.543932 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d8512317-20fc-4337-9343-e8bc96468cb4 tempest-QuotasAdminTestV257-771497903 tempest-QuotasAdminTestV257-771497903-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:51.667024 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-777c561b-389f-4c43-a931-26d663cca49b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:51.675502 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d8512317-20fc-4337-9343-e8bc96468cb4 tempest-QuotasAdminTestV257-771497903 tempest-QuotasAdminTestV257-771497903-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/9287bef5e09643838eb24be3d9425852/detail" status: 200 len: 463 microversion: 2.57 time: 0.279555 Aug 04 16:41:51.679171 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 854/1689] 10.222.0.23 () {60 vars in 1304 bytes} [Thu Aug 4 16:41:51 2022] GET /compute/v2.1/os-quota-sets/9287bef5e09643838eb24be3d9425852/detail => generated 463 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:41:51.704308 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-860de92b-c40f-4c2a-8f63-68f039deabab tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:51.717885 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-860de92b-c40f-4c2a-8f63-68f039deabab tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] [instance: b7f869cc-6c2f-4f4c-aa03-b39ed943c47b] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:51.722279 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-777c561b-389f-4c43-a931-26d663cca49b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:51.738625 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-777c561b-389f-4c43-a931-26d663cca49b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:51.747500 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-777c561b-389f-4c43-a931-26d663cca49b tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1487 microversion: 2.25 time: 1.195307 Aug 04 16:41:51.748591 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 836/1690] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:50 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1487 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:51.761568 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-860de92b-c40f-4c2a-8f63-68f039deabab tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:51.763159 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-860de92b-c40f-4c2a-8f63-68f039deabab tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:51.770698 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-860de92b-c40f-4c2a-8f63-68f039deabab tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:51.772405 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-860de92b-c40f-4c2a-8f63-68f039deabab tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:51.776785 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9927a76f-86c3-4434-8a0c-a397006f6c79 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:51.796249 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9927a76f-86c3-4434-8a0c-a397006f6c79 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:51.838681 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9927a76f-86c3-4434-8a0c-a397006f6c79 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:51.839454 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9927a76f-86c3-4434-8a0c-a397006f6c79 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:51.849120 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9927a76f-86c3-4434-8a0c-a397006f6c79 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:51.850494 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9927a76f-86c3-4434-8a0c-a397006f6c79 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:52.039179 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9927a76f-86c3-4434-8a0c-a397006f6c79 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.280045 Aug 04 16:41:52.040263 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 837/1691] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 16:41:51 2022] GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727/os-volume_attachments => generated 197 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:52.054293 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f914aa19-4a4c-412b-a64b-f8a8f9dccd7d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Action: 'create', calling method: .version_select at 0x7f7e84c8d820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-755691357", "description": "tempest-description-1980208369"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:52.784293 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-860de92b-c40f-4c2a-8f63-68f039deabab tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cd7076f4514ee89b0c4b2a586fe69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547b33a8f5a344f788da917f3512be5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:52.802952 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-860de92b-c40f-4c2a-8f63-68f039deabab tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] 10.222.0.23 "GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b" status: 200 len: 1293 microversion: 2.1 time: 1.119752 Aug 04 16:41:52.809842 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 855/1692] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:41:51 2022] GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b => generated 1293 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:41:52.846246 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-a9e0f666-317d-4481-a816-3f6823cde8db req-84328562-9cb3-4cd5-9ad4-3d42beebe72b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09e1b482-0372-4270-ac25-6d3349aca31e", "tag": "c5e38244-ed96-4228-beb9-52ba893cf961"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:52.892841 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-a9e0f666-317d-4481-a816-3f6823cde8db req-84328562-9cb3-4cd5-9ad4-3d42beebe72b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:52.894817 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-a9e0f666-317d-4481-a816-3f6823cde8db req-84328562-9cb3-4cd5-9ad4-3d42beebe72b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:52.923920 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-a9e0f666-317d-4481-a816-3f6823cde8db req-84328562-9cb3-4cd5-9ad4-3d42beebe72b service nova] Creating event network-changed:c5e38244-ed96-4228-beb9-52ba893cf961 for instance 09e1b482-0372-4270-ac25-6d3349aca31e on n-h2-846466-12 Aug 04 16:41:52.939490 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-a9e0f666-317d-4481-a816-3f6823cde8db req-84328562-9cb3-4cd5-9ad4-3d42beebe72b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114246 Aug 04 16:41:52.940877 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 856/1693] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:52.952513 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bce11ed5-079c-4302-bdae-d9bdac32aff8 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:52.956927 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bce11ed5-079c-4302-bdae-d9bdac32aff8 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:52.978574 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bce11ed5-079c-4302-bdae-d9bdac32aff8 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:52.979307 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bce11ed5-079c-4302-bdae-d9bdac32aff8 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:52.980436 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bce11ed5-079c-4302-bdae-d9bdac32aff8 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:52.981066 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bce11ed5-079c-4302-bdae-d9bdac32aff8 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:53.611195 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f914aa19-4a4c-412b-a64b-f8a8f9dccd7d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.563318 Aug 04 16:41:53.613334 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 838/1694] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Aug 4 16:41:52 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:53.630743 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-7b4dc536-4d37-46cb-832b-ecc5988a5874 req-e772b071-290b-49ff-97e5-28d03b295a7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c62ae02-0f30-43e1-a005-89dcb8122d4e", "tag": "93c46fa1-3978-4529-9c01-36e6a216c294"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:53.654167 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-7b4dc536-4d37-46cb-832b-ecc5988a5874 req-e772b071-290b-49ff-97e5-28d03b295a7b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:53.655675 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-7b4dc536-4d37-46cb-832b-ecc5988a5874 req-e772b071-290b-49ff-97e5-28d03b295a7b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:53.684859 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-7b4dc536-4d37-46cb-832b-ecc5988a5874 req-e772b071-290b-49ff-97e5-28d03b295a7b service nova] Creating event network-changed:93c46fa1-3978-4529-9c01-36e6a216c294 for instance 0c62ae02-0f30-43e1-a005-89dcb8122d4e on n-h1-846466-12 Aug 04 16:41:53.701370 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-7b4dc536-4d37-46cb-832b-ecc5988a5874 req-e772b071-290b-49ff-97e5-28d03b295a7b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086250 Aug 04 16:41:53.702575 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 839/1695] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:53.720067 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-45bdec6d-3129-4dd9-9d53-ff28a9411db1 tempest-QuotasAdminTestV257-771497903 tempest-QuotasAdminTestV257-771497903-project-admin] Action: 'update', calling method: .version_select at 0x7f7e84e33280>, body: {"quota_set": {"ram": "2048"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:53.955763 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-45bdec6d-3129-4dd9-9d53-ff28a9411db1 tempest-QuotasAdminTestV257-771497903 tempest-QuotasAdminTestV257-771497903-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:53.956225 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-45bdec6d-3129-4dd9-9d53-ff28a9411db1 tempest-QuotasAdminTestV257-771497903 tempest-QuotasAdminTestV257-771497903-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:53.957312 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-45bdec6d-3129-4dd9-9d53-ff28a9411db1 tempest-QuotasAdminTestV257-771497903 tempest-QuotasAdminTestV257-771497903-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:53.959891 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-45bdec6d-3129-4dd9-9d53-ff28a9411db1 tempest-QuotasAdminTestV257-771497903 tempest-QuotasAdminTestV257-771497903-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:54.070232 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-45bdec6d-3129-4dd9-9d53-ff28a9411db1 tempest-QuotasAdminTestV257-771497903 tempest-QuotasAdminTestV257-771497903-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:54.072897 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-45bdec6d-3129-4dd9-9d53-ff28a9411db1 tempest-QuotasAdminTestV257-771497903 tempest-QuotasAdminTestV257-771497903-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:54.076206 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-45bdec6d-3129-4dd9-9d53-ff28a9411db1 tempest-QuotasAdminTestV257-771497903 tempest-QuotasAdminTestV257-771497903-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:54.079137 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-45bdec6d-3129-4dd9-9d53-ff28a9411db1 tempest-QuotasAdminTestV257-771497903 tempest-QuotasAdminTestV257-771497903-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:54.351644 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-45bdec6d-3129-4dd9-9d53-ff28a9411db1 tempest-QuotasAdminTestV257-771497903 tempest-QuotasAdminTestV257-771497903-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/9287bef5e09643838eb24be3d9425852?user_id=f6e778c74ca64ff682472248c1c41c7c" status: 200 len: 148 microversion: 2.57 time: 0.647401 Aug 04 16:41:54.352761 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 840/1696] 10.222.0.23 () {62 vars in 1384 bytes} [Thu Aug 4 16:41:53 2022] PUT /compute/v2.1/os-quota-sets/9287bef5e09643838eb24be3d9425852?user_id=f6e778c74ca64ff682472248c1c41c7c => generated 148 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:41:54.366461 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bc8701b2-a5ce-4faf-a3e3-8ca587a57358 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:54.367222 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bc8701b2-a5ce-4faf-a3e3-8ca587a57358 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:54.392314 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bc8701b2-a5ce-4faf-a3e3-8ca587a57358 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:54.392770 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bc8701b2-a5ce-4faf-a3e3-8ca587a57358 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:54.393632 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bc8701b2-a5ce-4faf-a3e3-8ca587a57358 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:54.394066 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bc8701b2-a5ce-4faf-a3e3-8ca587a57358 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:55.361062 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bce11ed5-079c-4302-bdae-d9bdac32aff8 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:55.383450 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bce11ed5-079c-4302-bdae-d9bdac32aff8 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:55.388725 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bce11ed5-079c-4302-bdae-d9bdac32aff8 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:55.395150 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bce11ed5-079c-4302-bdae-d9bdac32aff8 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1874 microversion: 2.32 time: 2.449306 Aug 04 16:41:55.399934 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 857/1697] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:52 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1874 bytes in 2458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:55.412805 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1a6ef748-6b61-41cd-b964-c853e3c942df tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:55.418129 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1a6ef748-6b61-41cd-b964-c853e3c942df tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:55.440095 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1a6ef748-6b61-41cd-b964-c853e3c942df tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:55.441531 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1a6ef748-6b61-41cd-b964-c853e3c942df tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:55.445569 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1a6ef748-6b61-41cd-b964-c853e3c942df tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:55.447023 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1a6ef748-6b61-41cd-b964-c853e3c942df tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:55.492885 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bc8701b2-a5ce-4faf-a3e3-8ca587a57358 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:55.511340 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1a6ef748-6b61-41cd-b964-c853e3c942df tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107297 Aug 04 16:41:55.513744 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 858/1698] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 16:41:55 2022] GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:55.515221 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bc8701b2-a5ce-4faf-a3e3-8ca587a57358 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:55.516791 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bc8701b2-a5ce-4faf-a3e3-8ca587a57358 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:55.518218 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bc8701b2-a5ce-4faf-a3e3-8ca587a57358 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1487 microversion: 2.25 time: 1.164294 Aug 04 16:41:55.524964 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6606edf7-09c5-4f2a-b276-a78ebe591fc3 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:55.526556 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6606edf7-09c5-4f2a-b276-a78ebe591fc3 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] [instance: b7f869cc-6c2f-4f4c-aa03-b39ed943c47b] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:55.530077 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 841/1699] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:54 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1487 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:55.540785 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f2a3f780-bbd1-4a19-bde6-a2eecea45051 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-392523499", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "e78934c4-9057-4f0d-9287-7793e16fb8f5"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:55.546480 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6606edf7-09c5-4f2a-b276-a78ebe591fc3 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:55.547214 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6606edf7-09c5-4f2a-b276-a78ebe591fc3 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:55.554473 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6606edf7-09c5-4f2a-b276-a78ebe591fc3 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:55.555231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6606edf7-09c5-4f2a-b276-a78ebe591fc3 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:55.609357 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-f2a3f780-bbd1-4a19-bde6-a2eecea45051 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] validate_networks() for [('e78934c4-9057-4f0d-9287-7793e16fb8f5', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:41:56.134818 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6606edf7-09c5-4f2a-b276-a78ebe591fc3 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cd7076f4514ee89b0c4b2a586fe69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547b33a8f5a344f788da917f3512be5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:56.188985 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6606edf7-09c5-4f2a-b276-a78ebe591fc3 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] 10.222.0.23 "GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b" status: 200 len: 1293 microversion: 2.1 time: 0.671930 Aug 04 16:41:56.215168 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 859/1700] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:41:55 2022] GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b => generated 1293 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:41:56.236706 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9e400014-22cd-4f90-9e39-1bc8b63fd808 tempest-QuotasAdminTestV257-771497903 tempest-QuotasAdminTestV257-771497903-project-admin] Calling method '.version_select at 0x7f7e8447d310>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:56.501570 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9e400014-22cd-4f90-9e39-1bc8b63fd808 tempest-QuotasAdminTestV257-771497903 tempest-QuotasAdminTestV257-771497903-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/9287bef5e09643838eb24be3d9425852?user_id=f6e778c74ca64ff682472248c1c41c7c" status: 200 len: 190 microversion: 2.57 time: 0.282156 Aug 04 16:41:56.503938 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 860/1701] 10.222.0.23 () {60 vars in 1364 bytes} [Thu Aug 4 16:41:56 2022] GET /compute/v2.1/os-quota-sets/9287bef5e09643838eb24be3d9425852?user_id=f6e778c74ca64ff682472248c1c41c7c => generated 190 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:41:56.537904 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-715607b0-9185-4018-9885-ed69f0c22718 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:56.544130 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-715607b0-9185-4018-9885-ed69f0c22718 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:56.591115 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-715607b0-9185-4018-9885-ed69f0c22718 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:56.595186 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-715607b0-9185-4018-9885-ed69f0c22718 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:56.597157 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-715607b0-9185-4018-9885-ed69f0c22718 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:56.603089 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-715607b0-9185-4018-9885-ed69f0c22718 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:57.833714 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-715607b0-9185-4018-9885-ed69f0c22718 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:57.940767 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-715607b0-9185-4018-9885-ed69f0c22718 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:57.948321 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-715607b0-9185-4018-9885-ed69f0c22718 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:57.972750 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-715607b0-9185-4018-9885-ed69f0c22718 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1874 microversion: 2.32 time: 1.460617 Aug 04 16:41:57.974455 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 861/1702] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:56 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1874 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:58.000580 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b5477621-8f8a-4208-b02d-e7ac4e16c04e tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:58.010065 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b5477621-8f8a-4208-b02d-e7ac4e16c04e tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:58.031246 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b5477621-8f8a-4208-b02d-e7ac4e16c04e tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:58.032409 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b5477621-8f8a-4208-b02d-e7ac4e16c04e tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:58.036359 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b5477621-8f8a-4208-b02d-e7ac4e16c04e tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:58.039402 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b5477621-8f8a-4208-b02d-e7ac4e16c04e tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:58.118487 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b5477621-8f8a-4208-b02d-e7ac4e16c04e tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141491 Aug 04 16:41:58.120788 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 862/1703] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 16:41:57 2022] GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:58.130314 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-100757fb-45b5-4f96-815e-409d9ec80240 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:58.132428 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-100757fb-45b5-4f96-815e-409d9ec80240 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:58.151716 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-100757fb-45b5-4f96-815e-409d9ec80240 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:58.155112 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-100757fb-45b5-4f96-815e-409d9ec80240 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:58.155937 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-f2a3f780-bbd1-4a19-bde6-a2eecea45051 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:41:58.156709 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-f2a3f780-bbd1-4a19-bde6-a2eecea45051 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:41:58.158392 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-f2a3f780-bbd1-4a19-bde6-a2eecea45051 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:41:58.159166 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-f2a3f780-bbd1-4a19-bde6-a2eecea45051 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:41:58.160185 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-f2a3f780-bbd1-4a19-bde6-a2eecea45051 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:41:58.161304 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-100757fb-45b5-4f96-815e-409d9ec80240 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:58.162581 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-100757fb-45b5-4f96-815e-409d9ec80240 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:58.204187 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f2a3f780-bbd1-4a19-bde6-a2eecea45051 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:58.206298 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f2a3f780-bbd1-4a19-bde6-a2eecea45051 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:58.208418 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f2a3f780-bbd1-4a19-bde6-a2eecea45051 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:58.209619 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f2a3f780-bbd1-4a19-bde6-a2eecea45051 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:58.308137 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-f2a3f780-bbd1-4a19-bde6-a2eecea45051 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Getting quotas for project eb25e78b70ee48c99471d78e00e5949c. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:41:58.335805 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-f2a3f780-bbd1-4a19-bde6-a2eecea45051 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Getting quotas for user 23cc8f30e1f94ff0a520a071e5d81728 and project eb25e78b70ee48c99471d78e00e5949c. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:41:58.409526 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f2a3f780-bbd1-4a19-bde6-a2eecea45051 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:41:58.423917 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f2a3f780-bbd1-4a19-bde6-a2eecea45051 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: eaa061be-ec66-48b5-bc5f-f82e3513214f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:41:58.570345 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f2a3f780-bbd1-4a19-bde6-a2eecea45051 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.038957 Aug 04 16:41:58.571065 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 842/1704] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:41:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:41:58.601312 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-192ab688-13c8-46e6-b846-aaf90cdb86d1 req-ec875903-ed58-4c0f-aa6d-00e627383c61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09e1b482-0372-4270-ac25-6d3349aca31e", "tag": "535d6e32-66f9-49c7-b95a-15ae2962f14b"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:41:58.614793 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-100757fb-45b5-4f96-815e-409d9ec80240 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:58.623763 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-192ab688-13c8-46e6-b846-aaf90cdb86d1 req-ec875903-ed58-4c0f-aa6d-00e627383c61 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:58.624686 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-192ab688-13c8-46e6-b846-aaf90cdb86d1 req-ec875903-ed58-4c0f-aa6d-00e627383c61 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:58.640304 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-100757fb-45b5-4f96-815e-409d9ec80240 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:58.652418 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-192ab688-13c8-46e6-b846-aaf90cdb86d1 req-ec875903-ed58-4c0f-aa6d-00e627383c61 service nova] Creating event network-changed:535d6e32-66f9-49c7-b95a-15ae2962f14b for instance 09e1b482-0372-4270-ac25-6d3349aca31e on n-h2-846466-12 Aug 04 16:41:58.663333 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-100757fb-45b5-4f96-815e-409d9ec80240 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:58.664829 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-192ab688-13c8-46e6-b846-aaf90cdb86d1 req-ec875903-ed58-4c0f-aa6d-00e627383c61 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090136 Aug 04 16:41:58.671273 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-100757fb-45b5-4f96-815e-409d9ec80240 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1477 microversion: 2.25 time: 0.548024 Aug 04 16:41:58.683188 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 843/1705] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:41:58.688356 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 863/1706] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:58 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1477 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:58.695113 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-143fa6f5-466c-4dae-b923-83d527610906 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:58.696495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-143fa6f5-466c-4dae-b923-83d527610906 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] [instance: b7f869cc-6c2f-4f4c-aa03-b39ed943c47b] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:58.720800 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-143fa6f5-466c-4dae-b923-83d527610906 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:58.721636 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-32ca876c-8ea9-4c45-9cc5-d00a3ca9b4ee tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:58.722717 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-32ca876c-8ea9-4c45-9cc5-d00a3ca9b4ee tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: eaa061be-ec66-48b5-bc5f-f82e3513214f] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:58.723239 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-143fa6f5-466c-4dae-b923-83d527610906 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:58.725076 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-143fa6f5-466c-4dae-b923-83d527610906 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:58.725816 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-143fa6f5-466c-4dae-b923-83d527610906 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:59.067556 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-32ca876c-8ea9-4c45-9cc5-d00a3ca9b4ee tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23cc8f30e1f94ff0a520a071e5d81728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb25e78b70ee48c99471d78e00e5949c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:59.093842 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-32ca876c-8ea9-4c45-9cc5-d00a3ca9b4ee tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f" status: 200 len: 1215 microversion: 2.1 time: 0.385401 Aug 04 16:41:59.106212 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 864/1707] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:41:58 2022] GET /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f => generated 1215 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:41:59.165600 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b5e113d4-5720-4ed4-a8a2-d1a1c8c05e9b tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Calling method '.version_select at 0x7f7e77d36f70>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:59.175010 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b5e113d4-5720-4ed4-a8a2-d1a1c8c05e9b tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:59.175768 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b5e113d4-5720-4ed4-a8a2-d1a1c8c05e9b tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:59.233118 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b5e113d4-5720-4ed4-a8a2-d1a1c8c05e9b tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 1713 microversion: 2.25 time: 0.118137 Aug 04 16:41:59.274675 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 865/1708] 10.222.0.23 () {60 vars in 1184 bytes} [Thu Aug 4 16:41:59 2022] GET /compute/v2.1/os-migrations => generated 1713 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:41:59.296668 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f84f9dea-9f59-4a5b-a9c5-580cbc9e6881 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:59.314657 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f84f9dea-9f59-4a5b-a9c5-580cbc9e6881 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:59.347675 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-143fa6f5-466c-4dae-b923-83d527610906 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cd7076f4514ee89b0c4b2a586fe69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547b33a8f5a344f788da917f3512be5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:41:59.354940 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f84f9dea-9f59-4a5b-a9c5-580cbc9e6881 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:59.356262 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f84f9dea-9f59-4a5b-a9c5-580cbc9e6881 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:59.365912 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-143fa6f5-466c-4dae-b923-83d527610906 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] 10.222.0.23 "GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b" status: 200 len: 1293 microversion: 2.1 time: 0.679731 Aug 04 16:41:59.366301 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f84f9dea-9f59-4a5b-a9c5-580cbc9e6881 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:59.369875 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 844/1709] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:41:58 2022] GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b => generated 1293 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:41:59.370577 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f84f9dea-9f59-4a5b-a9c5-580cbc9e6881 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:59.381025 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3ecb86de-48a8-465e-9a14-d2ccb839d05d tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:59.389014 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3ecb86de-48a8-465e-9a14-d2ccb839d05d tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:59.413674 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ecb86de-48a8-465e-9a14-d2ccb839d05d tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:59.418733 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ecb86de-48a8-465e-9a14-d2ccb839d05d tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:59.420001 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ecb86de-48a8-465e-9a14-d2ccb839d05d tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:59.426400 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ecb86de-48a8-465e-9a14-d2ccb839d05d tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:59.503504 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3ecb86de-48a8-465e-9a14-d2ccb839d05d tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.127354 Aug 04 16:41:59.524330 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 845/1710] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 16:41:59 2022] GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727/os-volume_attachments => generated 25 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:41:59.549820 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e9e3994c-f15e-4d85-a65c-eb1630eb8fcf tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:41:59.555556 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e9e3994c-f15e-4d85-a65c-eb1630eb8fcf tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:41:59.572163 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e9e3994c-f15e-4d85-a65c-eb1630eb8fcf tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:59.572907 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e9e3994c-f15e-4d85-a65c-eb1630eb8fcf tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:41:59.576867 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e9e3994c-f15e-4d85-a65c-eb1630eb8fcf tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:41:59.577703 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e9e3994c-f15e-4d85-a65c-eb1630eb8fcf tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:00.050953 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f84f9dea-9f59-4a5b-a9c5-580cbc9e6881 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:00.099765 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f84f9dea-9f59-4a5b-a9c5-580cbc9e6881 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:00.103363 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f84f9dea-9f59-4a5b-a9c5-580cbc9e6881 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:00.114976 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f84f9dea-9f59-4a5b-a9c5-580cbc9e6881 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1874 microversion: 2.32 time: 0.829051 Aug 04 16:42:00.118627 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 866/1711] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:59 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1874 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:42:00.139038 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-69e92be6-2698-4f5a-a23e-122c0cfc7f2c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:00.148279 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-69e92be6-2698-4f5a-a23e-122c0cfc7f2c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: d238b9f3-e25b-4864-8b27-d53054d76082] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:00.152785 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:42:00.165005 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=100 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:42:00.178196 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-e9e3994c-f15e-4d85-a65c-eb1630eb8fcf tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] Lazy-loading 'services' on Instance uuid 3dfa867e-8758-47d0-9256-3c864b36e819 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:42:00.179364 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-69e92be6-2698-4f5a-a23e-122c0cfc7f2c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:00.180176 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-69e92be6-2698-4f5a-a23e-122c0cfc7f2c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:00.181214 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-69e92be6-2698-4f5a-a23e-122c0cfc7f2c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:00.181683 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-69e92be6-2698-4f5a-a23e-122c0cfc7f2c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:00.228134 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=100 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:42:00.245423 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e9e3994c-f15e-4d85-a65c-eb1630eb8fcf tempest-LiveAutoBlockMigrationV225Test-157947626 tempest-LiveAutoBlockMigrationV225Test-157947626-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1972 microversion: 2.25 time: 0.705881 Aug 04 16:42:00.265323 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-69e92be6-2698-4f5a-a23e-122c0cfc7f2c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] HTTP exception thrown: Cannot 'reboot' instance d238b9f3-e25b-4864-8b27-d53054d76082 while it is in vm_state rescued Aug 04 16:42:00.265685 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 846/1712] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:41:59 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1972 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-69e92be6-2698-4f5a-a23e-122c0cfc7f2c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Request method failure captured: Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082/action HTTP/1.1 Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 28 Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_WOXTtiEFJuJx9g__PLaEpNUIG8cY9V5mucnrPgRej9fIBvkSBrLUaGoaJ38CVyDNzSj9GoE7BQp1yVztL27iI-fLZMpYZtLbyWcNlftj-zWFhGEyvOQOtE9rUW6LzioxrRHRZoV1uxRI3_TSQwte9NfcDMr3FTg447dmciw2wFA7M Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 20d035e0adc640c8a3ceb832275d0ea7 Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1842533046 Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20d035e0adc640c8a3ceb832275d0ea7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_20d035e0adc640c8a3ceb832275d0ea7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20d035e0adc640c8a3ceb832275d0ea7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/20d035e0adc640c8a3ceb832275d0ea7"}]}] Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1842533046 Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 20d035e0adc640c8a3ceb832275d0ea7 Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1842533046 Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerRescueNegativeTestJSON-1842533046-project Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: a88db264b2c94f699e015a8617150b45 Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1842533046-project Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: {"reboot": {"type": "HARD"}} Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: exception: Cannot 'reboot' instance d238b9f3-e25b-4864-8b27-d53054d76082 while it is in vm_state rescued Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'd238b9f3-e25b-4864-8b27-d53054d76082', 'body': {'reboot': {'type': 'HARD'}}} Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3499, in reboot Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d238b9f3-e25b-4864-8b27-d53054d76082 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 16:42:00.265862 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 16:42:00.284518 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance d238b9f3-e25b-4864-8b27-d53054d76082 while it is in vm_state rescued Aug 04 16:42:00.284518 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:42:00.284518 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:42:00.284518 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:42:00.284518 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:42:00.284518 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:42:00.284518 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:42:00.284518 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:42:00.284518 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:42:00.284518 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance d238b9f3-e25b-4864-8b27-d53054d76082 while it is in vm_state rescued Aug 04 16:42:00.284518 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:42:00.284518 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-69e92be6-2698-4f5a-a23e-122c0cfc7f2c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Returning 409 to user: Cannot 'reboot' instance d238b9f3-e25b-4864-8b27-d53054d76082 while it is in vm_state rescued {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:42:00.284518 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-69e92be6-2698-4f5a-a23e-122c0cfc7f2c tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "POST /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082/action" status: 409 len: 145 microversion: 2.1 time: 0.149050 Aug 04 16:42:00.284518 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 867/1713] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:42:00 2022] POST /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082/action => generated 145 bytes in 161 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:42:00.286650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a881b477-6367-40bc-a838-cfea0c8fd804 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:00.286650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a881b477-6367-40bc-a838-cfea0c8fd804 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: eaa061be-ec66-48b5-bc5f-f82e3513214f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:00.304609 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7560a83d-a0f4-4d32-891c-59872ce01d5e tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:00.314637 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7560a83d-a0f4-4d32-891c-59872ce01d5e tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: d238b9f3-e25b-4864-8b27-d53054d76082] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:00.337727 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a881b477-6367-40bc-a838-cfea0c8fd804 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:00.338545 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a881b477-6367-40bc-a838-cfea0c8fd804 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:00.340105 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a881b477-6367-40bc-a838-cfea0c8fd804 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:00.340859 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a881b477-6367-40bc-a838-cfea0c8fd804 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:00.342639 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7560a83d-a0f4-4d32-891c-59872ce01d5e tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:00.344053 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7560a83d-a0f4-4d32-891c-59872ce01d5e tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:00.351795 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7560a83d-a0f4-4d32-891c-59872ce01d5e tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:00.354623 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7560a83d-a0f4-4d32-891c-59872ce01d5e tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:00.461057 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-7560a83d-a0f4-4d32-891c-59872ce01d5e tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] HTTP exception thrown: Cannot 'rebuild' instance d238b9f3-e25b-4864-8b27-d53054d76082 while it is in vm_state rescued Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7560a83d-a0f4-4d32-891c-59872ce01d5e tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Request method failure captured: Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082/action HTTP/1.1 Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 65 Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_WOXTtiEFJuJx9g__PLaEpNUIG8cY9V5mucnrPgRej9fIBvkSBrLUaGoaJ38CVyDNzSj9GoE7BQp1yVztL27iI-fLZMpYZtLbyWcNlftj-zWFhGEyvOQOtE9rUW6LzioxrRHRZoV1uxRI3_TSQwte9NfcDMr3FTg447dmciw2wFA7M Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 20d035e0adc640c8a3ceb832275d0ea7 Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1842533046 Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20d035e0adc640c8a3ceb832275d0ea7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_20d035e0adc640c8a3ceb832275d0ea7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20d035e0adc640c8a3ceb832275d0ea7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/20d035e0adc640c8a3ceb832275d0ea7"}]}] Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1842533046 Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 20d035e0adc640c8a3ceb832275d0ea7 Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1842533046 Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerRescueNegativeTestJSON-1842533046-project Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: a88db264b2c94f699e015a8617150b45 Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1842533046-project Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: {"rebuild": {"imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00"}} Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: exception: Cannot 'rebuild' instance d238b9f3-e25b-4864-8b27-d53054d76082 while it is in vm_state rescued Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'd238b9f3-e25b-4864-8b27-d53054d76082', 'body': {'rebuild': {'imageRef': '58d80c01-1581-4a2f-bbb0-c2eaf1affa00'}}} Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d238b9f3-e25b-4864-8b27-d53054d76082 in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:42:00.466168 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:42:00.475257 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:42:00.475257 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 04 16:42:00.475257 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 04 16:42:00.475257 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 16:42:00.475257 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 16:42:00.475257 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 16:42:00.475257 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance d238b9f3-e25b-4864-8b27-d53054d76082 while it is in vm_state rescued Aug 04 16:42:00.475257 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:42:00.475257 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:42:00.475257 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:42:00.475257 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:42:00.475257 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:42:00.475257 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:42:00.475257 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:42:00.475257 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:42:00.475257 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance d238b9f3-e25b-4864-8b27-d53054d76082 while it is in vm_state rescued Aug 04 16:42:00.475257 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:42:00.480939 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7560a83d-a0f4-4d32-891c-59872ce01d5e tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Returning 409 to user: Cannot 'rebuild' instance d238b9f3-e25b-4864-8b27-d53054d76082 while it is in vm_state rescued {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:42:00.482966 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7560a83d-a0f4-4d32-891c-59872ce01d5e tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "POST /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082/action" status: 409 len: 146 microversion: 2.1 time: 0.198388 Aug 04 16:42:00.484598 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 868/1714] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:42:00 2022] POST /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082/action => generated 146 bytes in 203 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:42:00.496703 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3ec387e4-9139-4f6f-a0ce-02acfad91ad8 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:00.497228 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3ec387e4-9139-4f6f-a0ce-02acfad91ad8 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:00.510058 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3ec387e4-9139-4f6f-a0ce-02acfad91ad8 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:00.510678 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3ec387e4-9139-4f6f-a0ce-02acfad91ad8 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:00.512222 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3ec387e4-9139-4f6f-a0ce-02acfad91ad8 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:00.513726 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3ec387e4-9139-4f6f-a0ce-02acfad91ad8 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:00.556587 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3ec387e4-9139-4f6f-a0ce-02acfad91ad8 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:42:00.751039 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a881b477-6367-40bc-a838-cfea0c8fd804 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23cc8f30e1f94ff0a520a071e5d81728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb25e78b70ee48c99471d78e00e5949c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:00.803078 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a881b477-6367-40bc-a838-cfea0c8fd804 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f" status: 200 len: 1267 microversion: 2.1 time: 0.545663 Aug 04 16:42:00.804160 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 847/1715] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:00 2022] GET /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f => generated 1267 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:00.842608 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-18a8376d-bf5b-49e1-a293-7b6c6ad5691e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:00.843950 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-18a8376d-bf5b-49e1-a293-7b6c6ad5691e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] [instance: b7f869cc-6c2f-4f4c-aa03-b39ed943c47b] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:00.853029 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3ec387e4-9139-4f6f-a0ce-02acfad91ad8 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 204 len: 0 microversion: 2.25 time: 0.363918 Aug 04 16:42:00.859296 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 869/1716] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Aug 4 16:42:00 2022] DELETE /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 16:42:00.870200 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-18a8376d-bf5b-49e1-a293-7b6c6ad5691e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:00.871332 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-18a8376d-bf5b-49e1-a293-7b6c6ad5691e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:00.873013 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-18a8376d-bf5b-49e1-a293-7b6c6ad5691e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:00.874215 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-18a8376d-bf5b-49e1-a293-7b6c6ad5691e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:00.875203 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0bcb49fa-bf51-477f-af57-cfaf1e870321 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:00.879534 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0bcb49fa-bf51-477f-af57-cfaf1e870321 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:00.905503 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0bcb49fa-bf51-477f-af57-cfaf1e870321 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:00.906688 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0bcb49fa-bf51-477f-af57-cfaf1e870321 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:00.909160 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0bcb49fa-bf51-477f-af57-cfaf1e870321 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:00.910275 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0bcb49fa-bf51-477f-af57-cfaf1e870321 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:00.981892 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0bcb49fa-bf51-477f-af57-cfaf1e870321 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:42:01.220553 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0bcb49fa-bf51-477f-af57-cfaf1e870321 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727" status: 204 len: 0 microversion: 2.1 time: 0.355711 Aug 04 16:42:01.224876 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 870/1717] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:42:00 2022] DELETE /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:42:01.254497 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-954f4b15-6373-4539-ba57-f84aacaa26d0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:01.260702 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-954f4b15-6373-4539-ba57-f84aacaa26d0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:01.305582 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-954f4b15-6373-4539-ba57-f84aacaa26d0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:01.309415 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-954f4b15-6373-4539-ba57-f84aacaa26d0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:01.313987 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-954f4b15-6373-4539-ba57-f84aacaa26d0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:01.315801 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-954f4b15-6373-4539-ba57-f84aacaa26d0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:01.597078 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:42:01.960862 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-18a8376d-bf5b-49e1-a293-7b6c6ad5691e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cd7076f4514ee89b0c4b2a586fe69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547b33a8f5a344f788da917f3512be5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:01.980885 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-18a8376d-bf5b-49e1-a293-7b6c6ad5691e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] 10.222.0.23 "GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b" status: 200 len: 1293 microversion: 2.1 time: 1.157793 Aug 04 16:42:01.983755 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 848/1718] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:00 2022] GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b => generated 1293 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:01.997619 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0cf5d9db-cb80-4250-9702-2e1c53aa6741 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:02.002184 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0cf5d9db-cb80-4250-9702-2e1c53aa6741 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:02.041995 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0cf5d9db-cb80-4250-9702-2e1c53aa6741 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:02.048285 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0cf5d9db-cb80-4250-9702-2e1c53aa6741 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:02.053682 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0cf5d9db-cb80-4250-9702-2e1c53aa6741 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:02.059603 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0cf5d9db-cb80-4250-9702-2e1c53aa6741 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:02.086449 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-954f4b15-6373-4539-ba57-f84aacaa26d0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:02.117711 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-954f4b15-6373-4539-ba57-f84aacaa26d0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:02.130862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-954f4b15-6373-4539-ba57-f84aacaa26d0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:02.133741 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-954f4b15-6373-4539-ba57-f84aacaa26d0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1483 microversion: 2.25 time: 0.905257 Aug 04 16:42:02.137930 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 871/1719] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:42:01 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1483 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:42:02.165182 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bde2a90c-22c4-4038-88ba-a311d6a4a88a tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:02.166928 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bde2a90c-22c4-4038-88ba-a311d6a4a88a tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:02.187643 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bde2a90c-22c4-4038-88ba-a311d6a4a88a tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:02.198486 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bde2a90c-22c4-4038-88ba-a311d6a4a88a tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:02.200356 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bde2a90c-22c4-4038-88ba-a311d6a4a88a tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:02.201507 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bde2a90c-22c4-4038-88ba-a311d6a4a88a tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:03.082175 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0cf5d9db-cb80-4250-9702-2e1c53aa6741 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:03.104321 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0cf5d9db-cb80-4250-9702-2e1c53aa6741 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:03.106424 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0cf5d9db-cb80-4250-9702-2e1c53aa6741 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:03.107964 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0cf5d9db-cb80-4250-9702-2e1c53aa6741 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1874 microversion: 2.32 time: 1.122653 Aug 04 16:42:03.113010 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 849/1720] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:42:01 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1874 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:42:03.134666 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-2b7b4856-9db2-4f1f-82d6-2b006e81e36d req-f1cc0f81-cc8d-446e-a476-b1f9f2a6e0c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7f869cc-6c2f-4f4c-aa03-b39ed943c47b", "name": "network-vif-plugged", "status": "completed", "tag": "6eab9e47-2e8f-463d-8fd3-42f3c27b7f18"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:03.161024 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:42:03.166143 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-2b7b4856-9db2-4f1f-82d6-2b006e81e36d req-f1cc0f81-cc8d-446e-a476-b1f9f2a6e0c9 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:03.170102 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-2b7b4856-9db2-4f1f-82d6-2b006e81e36d req-f1cc0f81-cc8d-446e-a476-b1f9f2a6e0c9 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:03.204066 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-2b7b4856-9db2-4f1f-82d6-2b006e81e36d req-f1cc0f81-cc8d-446e-a476-b1f9f2a6e0c9 service nova] Creating event network-vif-plugged:6eab9e47-2e8f-463d-8fd3-42f3c27b7f18 for instance b7f869cc-6c2f-4f4c-aa03-b39ed943c47b on n-h1-846466-12 Aug 04 16:42:03.229672 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-2b7b4856-9db2-4f1f-82d6-2b006e81e36d req-f1cc0f81-cc8d-446e-a476-b1f9f2a6e0c9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115025 Aug 04 16:42:03.231208 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 850/1721] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:42:03.240346 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2f8a81af-3dd9-4b85-b4c0-7ea0b0770f98 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:03.249634 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2f8a81af-3dd9-4b85-b4c0-7ea0b0770f98 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: eaa061be-ec66-48b5-bc5f-f82e3513214f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:03.273981 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f8a81af-3dd9-4b85-b4c0-7ea0b0770f98 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:03.274621 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f8a81af-3dd9-4b85-b4c0-7ea0b0770f98 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:03.275957 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f8a81af-3dd9-4b85-b4c0-7ea0b0770f98 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:03.276734 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f8a81af-3dd9-4b85-b4c0-7ea0b0770f98 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:03.333420 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bde2a90c-22c4-4038-88ba-a311d6a4a88a tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:03.350953 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bde2a90c-22c4-4038-88ba-a311d6a4a88a tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727" status: 200 len: 1689 microversion: 2.1 time: 1.205742 Aug 04 16:42:03.351573 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 872/1722] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:02 2022] GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727 => generated 1689 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:03.375894 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-9e1188b2-c7c4-4fd5-8a58-7c27da1c1c6c req-14f7a5bd-c58b-4ce3-8dcf-4813189d1fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dfa867e-8758-47d0-9256-3c864b36e819", "name": "network-vif-deleted", "tag": "251fa64f-5224-48c2-a585-f6377c372e04"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:03.388608 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-9e1188b2-c7c4-4fd5-8a58-7c27da1c1c6c req-14f7a5bd-c58b-4ce3-8dcf-4813189d1fb2 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:03.390024 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-9e1188b2-c7c4-4fd5-8a58-7c27da1c1c6c req-14f7a5bd-c58b-4ce3-8dcf-4813189d1fb2 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:03.404093 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-9e1188b2-c7c4-4fd5-8a58-7c27da1c1c6c req-14f7a5bd-c58b-4ce3-8dcf-4813189d1fb2 service nova] Creating event network-vif-deleted:251fa64f-5224-48c2-a585-f6377c372e04 for instance 3dfa867e-8758-47d0-9256-3c864b36e819 on n-h2-846466-12 Aug 04 16:42:03.409894 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-9e1188b2-c7c4-4fd5-8a58-7c27da1c1c6c req-14f7a5bd-c58b-4ce3-8dcf-4813189d1fb2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037844 Aug 04 16:42:03.411587 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 873/1723] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:42:03.421700 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-36866616-ef27-4602-80b8-37813e3142e2 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:03.423087 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-36866616-ef27-4602-80b8-37813e3142e2 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] [instance: b7f869cc-6c2f-4f4c-aa03-b39ed943c47b] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:03.432088 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-36866616-ef27-4602-80b8-37813e3142e2 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:03.432824 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-36866616-ef27-4602-80b8-37813e3142e2 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:03.433845 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-36866616-ef27-4602-80b8-37813e3142e2 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:03.434608 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-36866616-ef27-4602-80b8-37813e3142e2 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:03.526595 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2f8a81af-3dd9-4b85-b4c0-7ea0b0770f98 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23cc8f30e1f94ff0a520a071e5d81728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb25e78b70ee48c99471d78e00e5949c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:03.556586 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2f8a81af-3dd9-4b85-b4c0-7ea0b0770f98 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f" status: 200 len: 1273 microversion: 2.1 time: 0.323483 Aug 04 16:42:03.558044 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 851/1724] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:03 2022] GET /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f => generated 1273 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:03.567040 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8bf9a7e3-763f-4730-8c2a-f4ca313f8de0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:03.576281 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8bf9a7e3-763f-4730-8c2a-f4ca313f8de0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:03.584952 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8bf9a7e3-763f-4730-8c2a-f4ca313f8de0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:03.585525 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8bf9a7e3-763f-4730-8c2a-f4ca313f8de0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:03.586429 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8bf9a7e3-763f-4730-8c2a-f4ca313f8de0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:03.586967 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8bf9a7e3-763f-4730-8c2a-f4ca313f8de0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:03.711976 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8bf9a7e3-763f-4730-8c2a-f4ca313f8de0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:03.732498 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8bf9a7e3-763f-4730-8c2a-f4ca313f8de0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:03.735856 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8bf9a7e3-763f-4730-8c2a-f4ca313f8de0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:03.738223 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8bf9a7e3-763f-4730-8c2a-f4ca313f8de0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1266 microversion: 2.25 time: 0.177694 Aug 04 16:42:03.752695 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 852/1725] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:42:03 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:42:03.850825 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-36866616-ef27-4602-80b8-37813e3142e2 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cd7076f4514ee89b0c4b2a586fe69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547b33a8f5a344f788da917f3512be5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:03.870741 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-36866616-ef27-4602-80b8-37813e3142e2 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] 10.222.0.23 "GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b" status: 200 len: 1293 microversion: 2.1 time: 0.455744 Aug 04 16:42:03.874778 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 874/1726] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:03 2022] GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b => generated 1293 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:04.143709 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1b94ac32-3269-47bf-9394-c7c44d2e5725 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:04.152680 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1b94ac32-3269-47bf-9394-c7c44d2e5725 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:04.169214 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1b94ac32-3269-47bf-9394-c7c44d2e5725 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:04.170972 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1b94ac32-3269-47bf-9394-c7c44d2e5725 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:04.174333 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1b94ac32-3269-47bf-9394-c7c44d2e5725 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:04.175461 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1b94ac32-3269-47bf-9394-c7c44d2e5725 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:04.203097 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-600d373b-2382-4407-ad3c-b16b9ba01037 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1733850460", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:04.308537 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-600d373b-2382-4407-ad3c-b16b9ba01037 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] validate_networks() for None {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:42:05.527128 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1b94ac32-3269-47bf-9394-c7c44d2e5725 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:05.553033 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1b94ac32-3269-47bf-9394-c7c44d2e5725 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:05.569037 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1b94ac32-3269-47bf-9394-c7c44d2e5725 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:05.571882 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1b94ac32-3269-47bf-9394-c7c44d2e5725 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1874 microversion: 2.32 time: 1.438313 Aug 04 16:42:05.574139 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 875/1727] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:42:04 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1874 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:42:05.586037 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-edc14a0a-3cca-43e8-ad59-d21d5acf2227 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:05.593940 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-edc14a0a-3cca-43e8-ad59-d21d5acf2227 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:05.605361 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-edc14a0a-3cca-43e8-ad59-d21d5acf2227 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:05.606306 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-edc14a0a-3cca-43e8-ad59-d21d5acf2227 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:05.607439 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-edc14a0a-3cca-43e8-ad59-d21d5acf2227 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:05.608087 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-edc14a0a-3cca-43e8-ad59-d21d5acf2227 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:05.624628 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-600d373b-2382-4407-ad3c-b16b9ba01037 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:42:05.626841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-600d373b-2382-4407-ad3c-b16b9ba01037 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:42:05.628125 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-600d373b-2382-4407-ad3c-b16b9ba01037 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:42:05.629060 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-600d373b-2382-4407-ad3c-b16b9ba01037 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:42:05.629758 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-600d373b-2382-4407-ad3c-b16b9ba01037 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:42:05.654369 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-600d373b-2382-4407-ad3c-b16b9ba01037 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:05.655243 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-600d373b-2382-4407-ad3c-b16b9ba01037 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:05.659106 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-600d373b-2382-4407-ad3c-b16b9ba01037 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:05.659983 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-600d373b-2382-4407-ad3c-b16b9ba01037 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:05.706429 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-600d373b-2382-4407-ad3c-b16b9ba01037 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Getting quotas for project c1c1660ad79d489392261a78b5677be5. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:42:05.729055 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-600d373b-2382-4407-ad3c-b16b9ba01037 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Getting quotas for user 648fb8ee69e24f74bf694d0e99f04502 and project c1c1660ad79d489392261a78b5677be5. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:42:05.785720 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-600d373b-2382-4407-ad3c-b16b9ba01037 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:42:05.803291 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-600d373b-2382-4407-ad3c-b16b9ba01037 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:42:05.881548 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-600d373b-2382-4407-ad3c-b16b9ba01037 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.140912 Aug 04 16:42:05.882460 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 853/1728] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:42:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2143 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:42:05.888632 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3c126acb-ca76-4056-8151-74a83a313137 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:05.889693 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3c126acb-ca76-4056-8151-74a83a313137 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: eaa061be-ec66-48b5-bc5f-f82e3513214f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:05.916686 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3c126acb-ca76-4056-8151-74a83a313137 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:05.919758 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3c126acb-ca76-4056-8151-74a83a313137 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:05.935480 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3c126acb-ca76-4056-8151-74a83a313137 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:05.936565 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3c126acb-ca76-4056-8151-74a83a313137 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:07.316860 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-edc14a0a-3cca-43e8-ad59-d21d5acf2227 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:07.346817 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-edc14a0a-3cca-43e8-ad59-d21d5acf2227 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727" status: 200 len: 1689 microversion: 2.1 time: 1.770177 Aug 04 16:42:07.347769 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 876/1729] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:05 2022] GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727 => generated 1689 bytes in 1773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:07.383201 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-226b6c2a-69d0-46fd-b78e-307712b420ac tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:07.395363 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-226b6c2a-69d0-46fd-b78e-307712b420ac tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:07.423906 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-226b6c2a-69d0-46fd-b78e-307712b420ac tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:07.425176 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-226b6c2a-69d0-46fd-b78e-307712b420ac tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:07.426832 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-226b6c2a-69d0-46fd-b78e-307712b420ac tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:07.427608 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-226b6c2a-69d0-46fd-b78e-307712b420ac tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:07.536471 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3c126acb-ca76-4056-8151-74a83a313137 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23cc8f30e1f94ff0a520a071e5d81728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb25e78b70ee48c99471d78e00e5949c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:07.567443 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3c126acb-ca76-4056-8151-74a83a313137 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f" status: 200 len: 1315 microversion: 2.1 time: 1.683096 Aug 04 16:42:07.582798 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 854/1730] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:05 2022] GET /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f => generated 1315 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:07.607739 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b22b8b77-f033-4bc1-8c08-bcf0fc586286 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:07.609487 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b22b8b77-f033-4bc1-8c08-bcf0fc586286 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] [instance: b7f869cc-6c2f-4f4c-aa03-b39ed943c47b] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:07.621336 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b22b8b77-f033-4bc1-8c08-bcf0fc586286 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:07.622504 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b22b8b77-f033-4bc1-8c08-bcf0fc586286 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:07.624519 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b22b8b77-f033-4bc1-8c08-bcf0fc586286 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:07.625568 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b22b8b77-f033-4bc1-8c08-bcf0fc586286 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:07.737669 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-226b6c2a-69d0-46fd-b78e-307712b420ac tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:07.750467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-226b6c2a-69d0-46fd-b78e-307712b420ac tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:07.753274 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-226b6c2a-69d0-46fd-b78e-307712b420ac tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:07.759690 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-226b6c2a-69d0-46fd-b78e-307712b420ac tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1266 microversion: 2.25 time: 0.383487 Aug 04 16:42:07.760302 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 877/1731] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:42:07 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1266 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:42:07.772060 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1889cc7a-7623-47de-a2a3-af50d2318e0b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1053451785", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:07.909208 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-1889cc7a-7623-47de-a2a3-af50d2318e0b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] validate_networks() for None {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:42:08.051322 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b22b8b77-f033-4bc1-8c08-bcf0fc586286 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cd7076f4514ee89b0c4b2a586fe69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547b33a8f5a344f788da917f3512be5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:08.060404 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b22b8b77-f033-4bc1-8c08-bcf0fc586286 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] 10.222.0.23 "GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b" status: 200 len: 1483 microversion: 2.1 time: 0.475108 Aug 04 16:42:08.073611 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 855/1732] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:07 2022] GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b => generated 1483 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:08.075637 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-df0df677-2d50-464a-bb07-de7aa5a4aabd tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:08.075925 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-df0df677-2d50-464a-bb07-de7aa5a4aabd tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:08.092270 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-df0df677-2d50-464a-bb07-de7aa5a4aabd tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:08.092740 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-df0df677-2d50-464a-bb07-de7aa5a4aabd tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:08.093630 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-df0df677-2d50-464a-bb07-de7aa5a4aabd tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:08.094068 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-df0df677-2d50-464a-bb07-de7aa5a4aabd tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:08.985223 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-1889cc7a-7623-47de-a2a3-af50d2318e0b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:42:08.986296 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-1889cc7a-7623-47de-a2a3-af50d2318e0b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:42:08.993567 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-1889cc7a-7623-47de-a2a3-af50d2318e0b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:42:08.994173 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-1889cc7a-7623-47de-a2a3-af50d2318e0b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:42:08.994600 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-1889cc7a-7623-47de-a2a3-af50d2318e0b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:42:09.023648 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1889cc7a-7623-47de-a2a3-af50d2318e0b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:09.024086 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1889cc7a-7623-47de-a2a3-af50d2318e0b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:09.025541 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1889cc7a-7623-47de-a2a3-af50d2318e0b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:09.027786 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1889cc7a-7623-47de-a2a3-af50d2318e0b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:09.097820 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-1889cc7a-7623-47de-a2a3-af50d2318e0b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Getting quotas for project c1c1660ad79d489392261a78b5677be5. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:42:09.109065 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-1889cc7a-7623-47de-a2a3-af50d2318e0b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Getting quotas for user 648fb8ee69e24f74bf694d0e99f04502 and project c1c1660ad79d489392261a78b5677be5. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:42:09.154252 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1889cc7a-7623-47de-a2a3-af50d2318e0b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:42:09.156828 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1889cc7a-7623-47de-a2a3-af50d2318e0b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:42:09.282812 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1889cc7a-7623-47de-a2a3-af50d2318e0b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.521256 Aug 04 16:42:09.289439 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 878/1733] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:42:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:42:09.302796 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-923d5335-f9c7-4985-866b-e9b1a53d691c tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:09.303302 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-923d5335-f9c7-4985-866b-e9b1a53d691c tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] [instance: b7f869cc-6c2f-4f4c-aa03-b39ed943c47b] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:09.323848 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-923d5335-f9c7-4985-866b-e9b1a53d691c tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:09.324304 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-923d5335-f9c7-4985-866b-e9b1a53d691c tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:09.325145 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-923d5335-f9c7-4985-866b-e9b1a53d691c tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:09.331310 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-923d5335-f9c7-4985-866b-e9b1a53d691c tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:09.880413 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-df0df677-2d50-464a-bb07-de7aa5a4aabd tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:09.922349 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-df0df677-2d50-464a-bb07-de7aa5a4aabd tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:09.923945 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-df0df677-2d50-464a-bb07-de7aa5a4aabd tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:09.925270 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-df0df677-2d50-464a-bb07-de7aa5a4aabd tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1874 microversion: 2.32 time: 1.858138 Aug 04 16:42:09.925801 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 856/1734] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:42:08 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1874 bytes in 1859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:42:09.950109 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bec7944b-218e-40a3-99dc-515e14eb715a tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:09.950725 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bec7944b-218e-40a3-99dc-515e14eb715a tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:09.977684 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bec7944b-218e-40a3-99dc-515e14eb715a tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:09.978026 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bec7944b-218e-40a3-99dc-515e14eb715a tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:09.990478 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bec7944b-218e-40a3-99dc-515e14eb715a tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:09.994216 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bec7944b-218e-40a3-99dc-515e14eb715a tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:10.514090 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-923d5335-f9c7-4985-866b-e9b1a53d691c tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] 10.222.0.23 "GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b/os-interface" status: 200 len: 284 microversion: 2.1 time: 1.210183 Aug 04 16:42:10.518665 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 879/1735] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Aug 4 16:42:09 2022] GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b/os-interface => generated 284 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:42:10.519409 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bec7944b-218e-40a3-99dc-515e14eb715a tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:10.530123 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bec7944b-218e-40a3-99dc-515e14eb715a tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727" status: 200 len: 1622 microversion: 2.1 time: 0.583948 Aug 04 16:42:10.533656 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 857/1736] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:09 2022] GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727 => generated 1622 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:10.537090 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-80bdd61b-5f15-4edd-b930-fbaac2098a05 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:10.538910 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-80bdd61b-5f15-4edd-b930-fbaac2098a05 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: eaa061be-ec66-48b5-bc5f-f82e3513214f] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:10.544363 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5de2d565-00c4-4fd4-a827-73540ccab1ee tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:10.544999 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5de2d565-00c4-4fd4-a827-73540ccab1ee tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:10.555493 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5de2d565-00c4-4fd4-a827-73540ccab1ee tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:10.555961 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5de2d565-00c4-4fd4-a827-73540ccab1ee tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:10.556731 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5de2d565-00c4-4fd4-a827-73540ccab1ee tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:10.557170 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5de2d565-00c4-4fd4-a827-73540ccab1ee tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:10.563303 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-80bdd61b-5f15-4edd-b930-fbaac2098a05 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:10.564073 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-80bdd61b-5f15-4edd-b930-fbaac2098a05 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:10.567051 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-80bdd61b-5f15-4edd-b930-fbaac2098a05 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:10.569425 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-80bdd61b-5f15-4edd-b930-fbaac2098a05 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:11.602509 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5de2d565-00c4-4fd4-a827-73540ccab1ee tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:11.637171 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5de2d565-00c4-4fd4-a827-73540ccab1ee tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:11.650831 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5de2d565-00c4-4fd4-a827-73540ccab1ee tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:11.657139 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5de2d565-00c4-4fd4-a827-73540ccab1ee tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 200 len: 1266 microversion: 2.25 time: 1.117689 Aug 04 16:42:11.665354 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 858/1737] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:42:10 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 1266 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:42:11.677491 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-df5ea3d2-f4e1-4c0c-b9fe-8dd34b33133c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:11.681932 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-df5ea3d2-f4e1-4c0c-b9fe-8dd34b33133c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:11.708393 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-df5ea3d2-f4e1-4c0c-b9fe-8dd34b33133c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:11.710153 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-df5ea3d2-f4e1-4c0c-b9fe-8dd34b33133c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:11.711996 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-df5ea3d2-f4e1-4c0c-b9fe-8dd34b33133c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:11.713062 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-df5ea3d2-f4e1-4c0c-b9fe-8dd34b33133c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:12.287841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-df5ea3d2-f4e1-4c0c-b9fe-8dd34b33133c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:12.360462 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-df5ea3d2-f4e1-4c0c-b9fe-8dd34b33133c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1" status: 200 len: 1272 microversion: 2.1 time: 0.683504 Aug 04 16:42:12.365700 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 859/1738] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:11 2022] GET /compute/v2.1/servers/0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1 => generated 1272 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:12.443201 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-138f2dcb-e30e-4ebc-8312-f2dbacc33a64 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:12.448550 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-138f2dcb-e30e-4ebc-8312-f2dbacc33a64 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:12.467558 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-138f2dcb-e30e-4ebc-8312-f2dbacc33a64 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:12.468672 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-138f2dcb-e30e-4ebc-8312-f2dbacc33a64 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:12.473506 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-138f2dcb-e30e-4ebc-8312-f2dbacc33a64 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:12.474902 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-138f2dcb-e30e-4ebc-8312-f2dbacc33a64 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:12.666037 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-80bdd61b-5f15-4edd-b930-fbaac2098a05 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23cc8f30e1f94ff0a520a071e5d81728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb25e78b70ee48c99471d78e00e5949c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:12.679768 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-80bdd61b-5f15-4edd-b930-fbaac2098a05 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f" status: 200 len: 1315 microversion: 2.1 time: 2.159037 Aug 04 16:42:12.682144 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 880/1739] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:10 2022] GET /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f => generated 1315 bytes in 2162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:12.716379 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4d5e3334-92ef-46e8-a7fc-5d677ac7155d tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:12.718566 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4d5e3334-92ef-46e8-a7fc-5d677ac7155d tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:12.730513 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d5e3334-92ef-46e8-a7fc-5d677ac7155d tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:12.731403 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d5e3334-92ef-46e8-a7fc-5d677ac7155d tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:12.733040 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d5e3334-92ef-46e8-a7fc-5d677ac7155d tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:12.754135 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d5e3334-92ef-46e8-a7fc-5d677ac7155d tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:13.008771 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4d5e3334-92ef-46e8-a7fc-5d677ac7155d tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:13.024919 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4d5e3334-92ef-46e8-a7fc-5d677ac7155d tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727" status: 200 len: 1622 microversion: 2.1 time: 0.341176 Aug 04 16:42:13.025569 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 881/1740] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:12 2022] GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727 => generated 1622 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:13.043009 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-89313fd9-b83d-42b4-854e-5ff63dd5d953 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:13.043953 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-89313fd9-b83d-42b4-854e-5ff63dd5d953 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 3dfa867e-8758-47d0-9256-3c864b36e819] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:13.061418 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-89313fd9-b83d-42b4-854e-5ff63dd5d953 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:13.062308 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-89313fd9-b83d-42b4-854e-5ff63dd5d953 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:13.065775 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-89313fd9-b83d-42b4-854e-5ff63dd5d953 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:13.067436 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-89313fd9-b83d-42b4-854e-5ff63dd5d953 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:13.120095 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-89313fd9-b83d-42b4-854e-5ff63dd5d953 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] HTTP exception thrown: Instance 3dfa867e-8758-47d0-9256-3c864b36e819 could not be found. Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-89313fd9-b83d-42b4-854e-5ff63dd5d953 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Request method failure captured: Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 HTTP/1.1 Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_T8oUoBNAA61v2RnRrs8c4bpTvwAeh1Xh2-SDfnjTxF0abRt_8sDgSNwu37NeMxSvo67fTeBTqBiIUEkOVVQPlXrM9ANv4AzvwX7Fhu1rOiZexb93EzMYuX7tVqIVs6db86deIWkcIPjH2tE0Aa3E2HIpdALf4OW2FMJuAJ4__bRmY Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: X-Openstack-Nova-Api-Version: 2.25 Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: e96e3e6168ec421da0cac9eaa8849255 Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-770717492 Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e96e3e6168ec421da0cac9eaa8849255"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e96e3e6168ec421da0cac9eaa8849255"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e96e3e6168ec421da0cac9eaa8849255"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e96e3e6168ec421da0cac9eaa8849255"}]}] Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-770717492 Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: e96e3e6168ec421da0cac9eaa8849255 Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-770717492 Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-LiveAutoBlockMigrationV225Test-770717492-project Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 5bf98871e1344215bd667945e6881320 Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-770717492-project Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 3dfa867e-8758-47d0-9256-3c864b36e819 could not be found. Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '3dfa867e-8758-47d0-9256-3c864b36e819'} Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dfa867e-8758-47d0-9256-3c864b36e819 could not be found. Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dfa867e-8758-47d0-9256-3c864b36e819 could not be found. Aug 04 16:42:13.121852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:42:13.134396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:42:13.134396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:42:13.134396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:42:13.134396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:42:13.134396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:42:13.134396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:42:13.134396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:42:13.134396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dfa867e-8758-47d0-9256-3c864b36e819 could not be found. Aug 04 16:42:13.134396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:42:13.134396 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-89313fd9-b83d-42b4-854e-5ff63dd5d953 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Returning 404 to user: Instance 3dfa867e-8758-47d0-9256-3c864b36e819 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:42:13.134396 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-89313fd9-b83d-42b4-854e-5ff63dd5d953 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819" status: 404 len: 111 microversion: 2.25 time: 0.102546 Aug 04 16:42:13.134396 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 882/1741] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:42:13 2022] GET /compute/v2.1/servers/3dfa867e-8758-47d0-9256-3c864b36e819 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:42:13.409208 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ade5ae48-556f-4549-8d41-dbc0dcfb3630 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:13.410193 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ade5ae48-556f-4549-8d41-dbc0dcfb3630 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:13.444242 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ade5ae48-556f-4549-8d41-dbc0dcfb3630 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:13.445035 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ade5ae48-556f-4549-8d41-dbc0dcfb3630 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:13.456429 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ade5ae48-556f-4549-8d41-dbc0dcfb3630 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:13.471378 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ade5ae48-556f-4549-8d41-dbc0dcfb3630 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:13.810711 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ade5ae48-556f-4549-8d41-dbc0dcfb3630 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:13.814673 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:42:13.827009 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ade5ae48-556f-4549-8d41-dbc0dcfb3630 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1" status: 200 len: 1272 microversion: 2.1 time: 0.422834 Aug 04 16:42:13.842151 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 883/1742] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:13 2022] GET /compute/v2.1/servers/0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1 => generated 1272 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:42:13.861089 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-c482916b-6149-4a3b-a5c4-92b51c1bc8bc req-bd36933e-84ed-4ab8-8bc0-0593768cca3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c83347-17c8-4872-ae95-36497fd7a727", "name": "network-vif-deleted", "tag": "6c385fdf-9a65-4ff1-871c-2cc8e59eef38"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:13.886903 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-c482916b-6149-4a3b-a5c4-92b51c1bc8bc req-bd36933e-84ed-4ab8-8bc0-0593768cca3e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:13.888692 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-c482916b-6149-4a3b-a5c4-92b51c1bc8bc req-bd36933e-84ed-4ab8-8bc0-0593768cca3e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:13.970587 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-c482916b-6149-4a3b-a5c4-92b51c1bc8bc req-bd36933e-84ed-4ab8-8bc0-0593768cca3e service nova] Creating event network-vif-deleted:6c385fdf-9a65-4ff1-871c-2cc8e59eef38 for instance b0c83347-17c8-4872-ae95-36497fd7a727 on n-h1-846466-12 Aug 04 16:42:14.028508 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-c482916b-6149-4a3b-a5c4-92b51c1bc8bc req-bd36933e-84ed-4ab8-8bc0-0593768cca3e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164605 Aug 04 16:42:14.030440 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 884/1743] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:42:14.077343 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-138f2dcb-e30e-4ebc-8312-f2dbacc33a64 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:14.090524 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-44e5657b-2c00-4153-8214-467078ba81b5 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:14.098863 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-44e5657b-2c00-4153-8214-467078ba81b5 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: eaa061be-ec66-48b5-bc5f-f82e3513214f] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:14.154949 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-138f2dcb-e30e-4ebc-8312-f2dbacc33a64 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:14.156657 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-138f2dcb-e30e-4ebc-8312-f2dbacc33a64 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:14.158330 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-44e5657b-2c00-4153-8214-467078ba81b5 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:14.160102 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-44e5657b-2c00-4153-8214-467078ba81b5 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:14.163255 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-44e5657b-2c00-4153-8214-467078ba81b5 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:14.171564 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-138f2dcb-e30e-4ebc-8312-f2dbacc33a64 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1874 microversion: 2.32 time: 1.749237 Aug 04 16:42:14.172412 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-44e5657b-2c00-4153-8214-467078ba81b5 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:14.177728 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 860/1744] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:42:12 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1874 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:42:14.183345 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4ea0bacb-a0b4-4fcf-b143-5fe428837eb6 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:14.190915 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4ea0bacb-a0b4-4fcf-b143-5fe428837eb6 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:14.212085 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4ea0bacb-a0b4-4fcf-b143-5fe428837eb6 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:14.212849 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4ea0bacb-a0b4-4fcf-b143-5fe428837eb6 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:14.218216 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4ea0bacb-a0b4-4fcf-b143-5fe428837eb6 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:14.218871 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4ea0bacb-a0b4-4fcf-b143-5fe428837eb6 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:14.323067 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4ea0bacb-a0b4-4fcf-b143-5fe428837eb6 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:14.323979 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4ea0bacb-a0b4-4fcf-b143-5fe428837eb6 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:14.325202 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-4ea0bacb-a0b4-4fcf-b143-5fe428837eb6 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lazy-loading 'fault' on Instance uuid b0c83347-17c8-4872-ae95-36497fd7a727 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:42:14.462278 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4ea0bacb-a0b4-4fcf-b143-5fe428837eb6 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:14.471418 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4ea0bacb-a0b4-4fcf-b143-5fe428837eb6 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727" status: 200 len: 1336 microversion: 2.1 time: 0.292182 Aug 04 16:42:14.490508 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 861/1745] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:14 2022] GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727 => generated 1336 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:14.873759 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e269ae4d-8942-43af-9b1d-6dfa06f89fea tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:14.875101 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e269ae4d-8942-43af-9b1d-6dfa06f89fea tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:14.913136 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e269ae4d-8942-43af-9b1d-6dfa06f89fea tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:14.914712 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e269ae4d-8942-43af-9b1d-6dfa06f89fea tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:14.916432 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e269ae4d-8942-43af-9b1d-6dfa06f89fea tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:14.917523 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e269ae4d-8942-43af-9b1d-6dfa06f89fea tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:15.070742 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-44e5657b-2c00-4153-8214-467078ba81b5 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23cc8f30e1f94ff0a520a071e5d81728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb25e78b70ee48c99471d78e00e5949c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:15.102319 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-44e5657b-2c00-4153-8214-467078ba81b5 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f" status: 200 len: 1315 microversion: 2.1 time: 1.066985 Aug 04 16:42:15.109254 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 885/1746] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:14 2022] GET /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f => generated 1315 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:15.176741 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e269ae4d-8942-43af-9b1d-6dfa06f89fea tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:15.204104 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e269ae4d-8942-43af-9b1d-6dfa06f89fea tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1" status: 200 len: 1272 microversion: 2.1 time: 0.333836 Aug 04 16:42:15.205264 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 862/1747] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:14 2022] GET /compute/v2.1/servers/0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1 => generated 1272 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:15.232636 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ed00c162-5394-46d3-8b04-72f073d2a25b tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:15.233990 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ed00c162-5394-46d3-8b04-72f073d2a25b tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:15.263388 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ed00c162-5394-46d3-8b04-72f073d2a25b tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:15.264424 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ed00c162-5394-46d3-8b04-72f073d2a25b tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:15.271886 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ed00c162-5394-46d3-8b04-72f073d2a25b tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:15.273019 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ed00c162-5394-46d3-8b04-72f073d2a25b tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:15.537862 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-70896ef2-bfcd-4a5a-8e37-5cf1252b973f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:15.541669 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-70896ef2-bfcd-4a5a-8e37-5cf1252b973f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: b0c83347-17c8-4872-ae95-36497fd7a727] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:15.572911 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70896ef2-bfcd-4a5a-8e37-5cf1252b973f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:15.579313 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70896ef2-bfcd-4a5a-8e37-5cf1252b973f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:15.581361 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70896ef2-bfcd-4a5a-8e37-5cf1252b973f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:15.587721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70896ef2-bfcd-4a5a-8e37-5cf1252b973f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:15.644601 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-70896ef2-bfcd-4a5a-8e37-5cf1252b973f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] HTTP exception thrown: Instance b0c83347-17c8-4872-ae95-36497fd7a727 could not be found. Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-70896ef2-bfcd-4a5a-8e37-5cf1252b973f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Request method failure captured: Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727 HTTP/1.1 Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_WOXTtiEFJuJx9g__PLaEpNUIG8cY9V5mucnrPgRej9fIBvkSBrLUaGoaJ38CVyDNzSj9GoE7BQp1yVztL27iI-fLZMpYZtLbyWcNlftj-zWFhGEyvOQOtE9rUW6LzioxrRHRZoV1uxRI3_TSQwte9NfcDMr3FTg447dmciw2wFA7M Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 20d035e0adc640c8a3ceb832275d0ea7 Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1842533046 Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20d035e0adc640c8a3ceb832275d0ea7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_20d035e0adc640c8a3ceb832275d0ea7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20d035e0adc640c8a3ceb832275d0ea7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/20d035e0adc640c8a3ceb832275d0ea7"}]}] Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1842533046 Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 20d035e0adc640c8a3ceb832275d0ea7 Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1842533046 Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServerRescueNegativeTestJSON-1842533046-project Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: a88db264b2c94f699e015a8617150b45 Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1842533046-project Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance b0c83347-17c8-4872-ae95-36497fd7a727 could not be found. Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'b0c83347-17c8-4872-ae95-36497fd7a727'} Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c83347-17c8-4872-ae95-36497fd7a727 could not be found. Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c83347-17c8-4872-ae95-36497fd7a727 could not be found. Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:42:15.650267 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:42:15.655832 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:42:15.655832 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:42:15.655832 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:42:15.655832 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:42:15.655832 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:42:15.655832 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:42:15.655832 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c83347-17c8-4872-ae95-36497fd7a727 could not be found. Aug 04 16:42:15.655832 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:42:15.660062 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-70896ef2-bfcd-4a5a-8e37-5cf1252b973f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Returning 404 to user: Instance b0c83347-17c8-4872-ae95-36497fd7a727 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:42:15.664841 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-70896ef2-bfcd-4a5a-8e37-5cf1252b973f tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727" status: 404 len: 111 microversion: 2.1 time: 0.132355 Aug 04 16:42:15.666168 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 863/1748] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:15 2022] GET /compute/v2.1/servers/b0c83347-17c8-4872-ae95-36497fd7a727 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:42:15.676035 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f7b1500a-07dd-4c4a-9976-60b6b500794e tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '.version_select at 0x7f7e8498a430>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:15.696372 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=9 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:42:15.710838 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f7b1500a-07dd-4c4a-9976-60b6b500794e tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2052337991" status: 202 len: 0 microversion: 2.1 time: 0.038738 Aug 04 16:42:15.711442 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 864/1749] 10.222.0.23 () {58 vars in 1221 bytes} [Thu Aug 4 16:42:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2052337991 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 16:42:16.126637 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a9187e29-fe82-477e-bfde-cc5a8cfecaef tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:16.127479 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a9187e29-fe82-477e-bfde-cc5a8cfecaef tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: eaa061be-ec66-48b5-bc5f-f82e3513214f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:16.140096 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=24 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:42:16.144318 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a9187e29-fe82-477e-bfde-cc5a8cfecaef tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:16.149603 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a9187e29-fe82-477e-bfde-cc5a8cfecaef tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:16.155911 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a9187e29-fe82-477e-bfde-cc5a8cfecaef tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:16.157031 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a9187e29-fe82-477e-bfde-cc5a8cfecaef tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:17.144940 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a9187e29-fe82-477e-bfde-cc5a8cfecaef tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23cc8f30e1f94ff0a520a071e5d81728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb25e78b70ee48c99471d78e00e5949c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:17.156654 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ed00c162-5394-46d3-8b04-72f073d2a25b tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:17.191159 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=100 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:42:17.227525 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ed00c162-5394-46d3-8b04-72f073d2a25b tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:17.235970 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a9187e29-fe82-477e-bfde-cc5a8cfecaef tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f" status: 200 len: 1315 microversion: 2.1 time: 1.113983 Aug 04 16:42:17.238321 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ed00c162-5394-46d3-8b04-72f073d2a25b tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:17.239049 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 865/1750] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:16 2022] GET /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f => generated 1315 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:17.245162 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ed00c162-5394-46d3-8b04-72f073d2a25b tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1874 microversion: 2.32 time: 2.024073 Aug 04 16:42:17.264815 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 886/1751] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:42:15 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1874 bytes in 2044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:42:17.292633 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cd993249-d65a-4a75-942d-afb9a0be285a tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:17.296273 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cd993249-d65a-4a75-942d-afb9a0be285a tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:17.304632 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-a70f9976-8f41-4723-bbff-aba33cc5cd45 req-c5f9eaaa-aedd-4c1d-80fd-70e55513b36e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaa061be-ec66-48b5-bc5f-f82e3513214f", "tag": "c5f6f976-ffa2-45b4-a0f8-872e3215d5d6"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:17.334419 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cd993249-d65a-4a75-942d-afb9a0be285a tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:17.335702 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cd993249-d65a-4a75-942d-afb9a0be285a tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:17.337504 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cd993249-d65a-4a75-942d-afb9a0be285a tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:17.338544 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cd993249-d65a-4a75-942d-afb9a0be285a tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:17.351607 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-a70f9976-8f41-4723-bbff-aba33cc5cd45 req-c5f9eaaa-aedd-4c1d-80fd-70e55513b36e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:17.356352 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-a70f9976-8f41-4723-bbff-aba33cc5cd45 req-c5f9eaaa-aedd-4c1d-80fd-70e55513b36e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:17.395906 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-a70f9976-8f41-4723-bbff-aba33cc5cd45 req-c5f9eaaa-aedd-4c1d-80fd-70e55513b36e service nova] Creating event network-changed:c5f6f976-ffa2-45b4-a0f8-872e3215d5d6 for instance eaa061be-ec66-48b5-bc5f-f82e3513214f on n-h2-846466-12 Aug 04 16:42:17.415159 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-a70f9976-8f41-4723-bbff-aba33cc5cd45 req-c5f9eaaa-aedd-4c1d-80fd-70e55513b36e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120667 Aug 04 16:42:17.417554 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 887/1752] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:42:18.303575 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-542b8ff8-4c1c-450b-a0f7-d86cc201dd59 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:18.309904 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-542b8ff8-4c1c-450b-a0f7-d86cc201dd59 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: eaa061be-ec66-48b5-bc5f-f82e3513214f] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:18.348180 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-542b8ff8-4c1c-450b-a0f7-d86cc201dd59 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:18.351037 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-542b8ff8-4c1c-450b-a0f7-d86cc201dd59 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:18.355016 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-542b8ff8-4c1c-450b-a0f7-d86cc201dd59 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:18.355484 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-542b8ff8-4c1c-450b-a0f7-d86cc201dd59 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:18.355783 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cd993249-d65a-4a75-942d-afb9a0be285a tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:18.381795 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cd993249-d65a-4a75-942d-afb9a0be285a tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1" status: 200 len: 1314 microversion: 2.1 time: 1.140290 Aug 04 16:42:18.385971 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 866/1753] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:17 2022] GET /compute/v2.1/servers/0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1 => generated 1314 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:18.398689 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b950fb7f-0858-4a36-829f-092cf303544c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:18.414776 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b950fb7f-0858-4a36-829f-092cf303544c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:18.430535 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b950fb7f-0858-4a36-829f-092cf303544c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:18.442422 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b950fb7f-0858-4a36-829f-092cf303544c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:18.445104 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b950fb7f-0858-4a36-829f-092cf303544c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:18.446098 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b950fb7f-0858-4a36-829f-092cf303544c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:19.054028 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:42:19.134791 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=22 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:42:19.793394 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b950fb7f-0858-4a36-829f-092cf303544c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:19.833777 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b950fb7f-0858-4a36-829f-092cf303544c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:19.835987 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b950fb7f-0858-4a36-829f-092cf303544c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:19.838133 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b950fb7f-0858-4a36-829f-092cf303544c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1874 microversion: 2.32 time: 1.450534 Aug 04 16:42:19.840533 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 867/1754] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:42:18 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1874 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:42:19.850282 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-71c1a59c-c84d-4c69-b623-699e01a73833 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:19.851251 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-71c1a59c-c84d-4c69-b623-699e01a73833 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] [instance: b7f869cc-6c2f-4f4c-aa03-b39ed943c47b] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:19.866006 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-71c1a59c-c84d-4c69-b623-699e01a73833 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:19.871853 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-71c1a59c-c84d-4c69-b623-699e01a73833 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:19.873527 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-71c1a59c-c84d-4c69-b623-699e01a73833 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:19.874209 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-71c1a59c-c84d-4c69-b623-699e01a73833 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:20.013456 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-542b8ff8-4c1c-450b-a0f7-d86cc201dd59 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23cc8f30e1f94ff0a520a071e5d81728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb25e78b70ee48c99471d78e00e5949c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:20.046783 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-542b8ff8-4c1c-450b-a0f7-d86cc201dd59 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f" status: 200 len: 1315 microversion: 2.1 time: 1.764024 Aug 04 16:42:20.067708 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 888/1755] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:18 2022] GET /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f => generated 1315 bytes in 1774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:20.115502 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-bc2391ff-fe50-42f6-b945-1e78cc8a70fe req-0c0e50e9-8796-4b31-b45e-f9524b4a39b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7f869cc-6c2f-4f4c-aa03-b39ed943c47b", "tag": "6eab9e47-2e8f-463d-8fd3-42f3c27b7f18"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:20.303632 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-bc2391ff-fe50-42f6-b945-1e78cc8a70fe req-0c0e50e9-8796-4b31-b45e-f9524b4a39b1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:20.323632 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-bc2391ff-fe50-42f6-b945-1e78cc8a70fe req-0c0e50e9-8796-4b31-b45e-f9524b4a39b1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:20.327618 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-71c1a59c-c84d-4c69-b623-699e01a73833 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cd7076f4514ee89b0c4b2a586fe69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547b33a8f5a344f788da917f3512be5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:20.360622 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-71c1a59c-c84d-4c69-b623-699e01a73833 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] 10.222.0.23 "GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b" status: 200 len: 1483 microversion: 2.1 time: 0.515276 Aug 04 16:42:20.406603 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 868/1756] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:19 2022] GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b => generated 1483 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:20.436197 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6998ce90-58d4-4f09-8ad4-e625a69fb420 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:20.440836 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6998ce90-58d4-4f09-8ad4-e625a69fb420 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:20.445395 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-bc2391ff-fe50-42f6-b945-1e78cc8a70fe req-0c0e50e9-8796-4b31-b45e-f9524b4a39b1 service nova] Creating event network-changed:6eab9e47-2e8f-463d-8fd3-42f3c27b7f18 for instance b7f869cc-6c2f-4f4c-aa03-b39ed943c47b on n-h1-846466-12 Aug 04 16:42:20.478100 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6998ce90-58d4-4f09-8ad4-e625a69fb420 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:20.478568 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-bc2391ff-fe50-42f6-b945-1e78cc8a70fe req-0c0e50e9-8796-4b31-b45e-f9524b4a39b1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.405833 Aug 04 16:42:20.480026 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 889/1757] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:42:20.481211 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6998ce90-58d4-4f09-8ad4-e625a69fb420 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:20.490075 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6998ce90-58d4-4f09-8ad4-e625a69fb420 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:20.493626 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6998ce90-58d4-4f09-8ad4-e625a69fb420 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:20.677667 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e15ff11d-f0de-452b-a8e1-5185c08215be tempest-FloatingIPDetailsTestJSON-592891366 tempest-FloatingIPDetailsTestJSON-592891366-project] Action: 'create', calling method: .version_select at 0x7f7e8447cc10>, body: {"pool": null} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:23.790777 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6998ce90-58d4-4f09-8ad4-e625a69fb420 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:23.813148 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6998ce90-58d4-4f09-8ad4-e625a69fb420 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1" status: 200 len: 1314 microversion: 2.1 time: 3.409704 Aug 04 16:42:23.816184 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 869/1758] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:20 2022] GET /compute/v2.1/servers/0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1 => generated 1314 bytes in 3415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:23.828277 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-e6567425-9241-4abe-b774-9b14f98f0a87 req-064094fe-228c-42e3-bcf3-d6c4cbe2971f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97b80b04-533e-48b5-8595-9de81ed2c526", "tag": "1b245f3e-3f81-40cd-9523-09b35900d9ec"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:23.855467 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-e6567425-9241-4abe-b774-9b14f98f0a87 req-064094fe-228c-42e3-bcf3-d6c4cbe2971f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:23.857098 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-e6567425-9241-4abe-b774-9b14f98f0a87 req-064094fe-228c-42e3-bcf3-d6c4cbe2971f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:23.887626 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-e6567425-9241-4abe-b774-9b14f98f0a87 req-064094fe-228c-42e3-bcf3-d6c4cbe2971f service nova] Creating event network-changed:1b245f3e-3f81-40cd-9523-09b35900d9ec for instance 97b80b04-533e-48b5-8595-9de81ed2c526 on n-h1-846466-12 Aug 04 16:42:23.894736 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-e6567425-9241-4abe-b774-9b14f98f0a87 req-064094fe-228c-42e3-bcf3-d6c4cbe2971f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074957 Aug 04 16:42:23.896153 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 870/1759] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:42:23.915891 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-14af8361-7322-4361-87b6-cb460ed586ef tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:23.917728 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-14af8361-7322-4361-87b6-cb460ed586ef tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:23.935263 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-14af8361-7322-4361-87b6-cb460ed586ef tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:23.938053 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-14af8361-7322-4361-87b6-cb460ed586ef tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:23.939133 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-14af8361-7322-4361-87b6-cb460ed586ef tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:23.941035 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-14af8361-7322-4361-87b6-cb460ed586ef tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:25.534459 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-14af8361-7322-4361-87b6-cb460ed586ef tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:25.603555 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-14af8361-7322-4361-87b6-cb460ed586ef tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:25.607125 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-14af8361-7322-4361-87b6-cb460ed586ef tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:25.615505 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-14af8361-7322-4361-87b6-cb460ed586ef tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1874 microversion: 2.32 time: 1.717498 Aug 04 16:42:25.616391 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 871/1760] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:42:23 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1874 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:42:25.653319 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b886a724-746d-415c-93d2-f8b758a6120f tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:25.654923 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b886a724-746d-415c-93d2-f8b758a6120f tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: eaa061be-ec66-48b5-bc5f-f82e3513214f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:25.677892 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b886a724-746d-415c-93d2-f8b758a6120f tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:25.679269 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b886a724-746d-415c-93d2-f8b758a6120f tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:25.685367 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b886a724-746d-415c-93d2-f8b758a6120f tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:25.688698 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b886a724-746d-415c-93d2-f8b758a6120f tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:26.121364 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b886a724-746d-415c-93d2-f8b758a6120f tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23cc8f30e1f94ff0a520a071e5d81728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb25e78b70ee48c99471d78e00e5949c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:26.149155 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b886a724-746d-415c-93d2-f8b758a6120f tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f" status: 200 len: 1315 microversion: 2.1 time: 0.525712 Aug 04 16:42:26.166230 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 872/1761] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:25 2022] GET /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:26.173948 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-21e2d3ff-f7d5-4f97-aa04-163fb94b93f8 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:26.174887 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-21e2d3ff-f7d5-4f97-aa04-163fb94b93f8 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:26.185742 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-21e2d3ff-f7d5-4f97-aa04-163fb94b93f8 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:26.187479 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-21e2d3ff-f7d5-4f97-aa04-163fb94b93f8 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:26.189186 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-21e2d3ff-f7d5-4f97-aa04-163fb94b93f8 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:26.190289 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-21e2d3ff-f7d5-4f97-aa04-163fb94b93f8 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:26.232172 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-21e2d3ff-f7d5-4f97-aa04-163fb94b93f8 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:42:26.423814 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-21e2d3ff-f7d5-4f97-aa04-163fb94b93f8 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 204 len: 0 microversion: 2.25 time: 0.253654 Aug 04 16:42:26.430139 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 873/1762] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Aug 4 16:42:26 2022] DELETE /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 16:42:26.446206 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cb99fef4-be62-4c19-ba41-d017971cd30a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:26.446849 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cb99fef4-be62-4c19-ba41-d017971cd30a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:26.468529 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cb99fef4-be62-4c19-ba41-d017971cd30a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:26.469038 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cb99fef4-be62-4c19-ba41-d017971cd30a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:26.469844 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cb99fef4-be62-4c19-ba41-d017971cd30a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:26.470281 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cb99fef4-be62-4c19-ba41-d017971cd30a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:27.100170 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cb99fef4-be62-4c19-ba41-d017971cd30a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:27.110883 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cb99fef4-be62-4c19-ba41-d017971cd30a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.679036 Aug 04 16:42:27.111751 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 874/1763] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:26 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:27.135013 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-ac71d35a-9326-49d3-b315-7a9d15163277 req-c5d94fe7-ab73-412e-a751-cde740f264bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1", "tag": "cd1f78ee-36ca-482d-a581-52c60f0acd8a"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:27.157694 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-ac71d35a-9326-49d3-b315-7a9d15163277 req-c5d94fe7-ab73-412e-a751-cde740f264bc service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:27.158233 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-ac71d35a-9326-49d3-b315-7a9d15163277 req-c5d94fe7-ab73-412e-a751-cde740f264bc service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:27.177230 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-ac71d35a-9326-49d3-b315-7a9d15163277 req-c5d94fe7-ab73-412e-a751-cde740f264bc service nova] Creating event network-changed:cd1f78ee-36ca-482d-a581-52c60f0acd8a for instance 0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1 on n-h2-846466-12 Aug 04 16:42:27.184288 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-ac71d35a-9326-49d3-b315-7a9d15163277 req-c5d94fe7-ab73-412e-a751-cde740f264bc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056282 Aug 04 16:42:27.185345 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 875/1764] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:42:27.200071 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-fb5f298b-735b-41cf-a0e6-de2989acbf9d req-616b1348-d8fe-4ebc-8500-f8219108b63d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaa061be-ec66-48b5-bc5f-f82e3513214f", "name": "network-vif-plugged", "status": "completed", "tag": "c5f6f976-ffa2-45b4-a0f8-872e3215d5d6"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:27.214341 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-fb5f298b-735b-41cf-a0e6-de2989acbf9d req-616b1348-d8fe-4ebc-8500-f8219108b63d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:27.215015 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-fb5f298b-735b-41cf-a0e6-de2989acbf9d req-616b1348-d8fe-4ebc-8500-f8219108b63d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:27.234132 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-fb5f298b-735b-41cf-a0e6-de2989acbf9d req-616b1348-d8fe-4ebc-8500-f8219108b63d service nova] Creating event network-vif-plugged:c5f6f976-ffa2-45b4-a0f8-872e3215d5d6 for instance eaa061be-ec66-48b5-bc5f-f82e3513214f on n-h2-846466-12 Aug 04 16:42:27.252514 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-fb5f298b-735b-41cf-a0e6-de2989acbf9d req-616b1348-d8fe-4ebc-8500-f8219108b63d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061039 Aug 04 16:42:27.253492 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 876/1765] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:42:27.260858 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9e529323-1bfe-4ca1-8ee5-1a25b6cc2e86 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:27.262278 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9e529323-1bfe-4ca1-8ee5-1a25b6cc2e86 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:27.271763 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e529323-1bfe-4ca1-8ee5-1a25b6cc2e86 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:27.272621 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e529323-1bfe-4ca1-8ee5-1a25b6cc2e86 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:27.273685 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e529323-1bfe-4ca1-8ee5-1a25b6cc2e86 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:27.274926 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e529323-1bfe-4ca1-8ee5-1a25b6cc2e86 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:28.236355 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9e529323-1bfe-4ca1-8ee5-1a25b6cc2e86 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:28.284988 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9e529323-1bfe-4ca1-8ee5-1a25b6cc2e86 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1" status: 200 len: 1314 microversion: 2.1 time: 1.029489 Aug 04 16:42:28.287339 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 877/1766] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:27 2022] GET /compute/v2.1/servers/0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1 => generated 1314 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:28.322284 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-790c2267-4bb7-48e0-8e37-db55e6f4a2e0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:28.322647 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-790c2267-4bb7-48e0-8e37-db55e6f4a2e0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:28.334624 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-790c2267-4bb7-48e0-8e37-db55e6f4a2e0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:28.335591 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-790c2267-4bb7-48e0-8e37-db55e6f4a2e0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:28.337169 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-790c2267-4bb7-48e0-8e37-db55e6f4a2e0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:28.338066 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-790c2267-4bb7-48e0-8e37-db55e6f4a2e0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:29.177145 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e15ff11d-f0de-452b-a8e1-5185c08215be tempest-FloatingIPDetailsTestJSON-592891366 tempest-FloatingIPDetailsTestJSON-592891366-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 8.680954 Aug 04 16:42:29.186120 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-790c2267-4bb7-48e0-8e37-db55e6f4a2e0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:29.187709 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 890/1767] 10.222.0.23 () {60 vars in 1170 bytes} [Thu Aug 4 16:42:20 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 8693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:42:29.197365 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-790c2267-4bb7-48e0-8e37-db55e6f4a2e0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:29.199218 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9624d3ff-533e-49f1-b391-9d64216930ff tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:29.199533 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-790c2267-4bb7-48e0-8e37-db55e6f4a2e0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:29.200487 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9624d3ff-533e-49f1-b391-9d64216930ff tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:29.201204 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-790c2267-4bb7-48e0-8e37-db55e6f4a2e0 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 1732 microversion: 2.25 time: 0.897189 Aug 04 16:42:29.202125 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 878/1768] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:42:28 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 1732 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:42:29.207414 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e1c08e0c-044d-455b-9cdb-ad8ed7e75861 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:29.208371 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e1c08e0c-044d-455b-9cdb-ad8ed7e75861 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:29.216676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e1c08e0c-044d-455b-9cdb-ad8ed7e75861 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:29.216922 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9624d3ff-533e-49f1-b391-9d64216930ff tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:29.217487 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9624d3ff-533e-49f1-b391-9d64216930ff tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:29.218175 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e1c08e0c-044d-455b-9cdb-ad8ed7e75861 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:29.219279 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e1c08e0c-044d-455b-9cdb-ad8ed7e75861 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:29.219893 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e1c08e0c-044d-455b-9cdb-ad8ed7e75861 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:29.234279 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9624d3ff-533e-49f1-b391-9d64216930ff tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:29.235168 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9624d3ff-533e-49f1-b391-9d64216930ff tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:29.796936 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e1c08e0c-044d-455b-9cdb-ad8ed7e75861 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:29.825872 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e1c08e0c-044d-455b-9cdb-ad8ed7e75861 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.621971 Aug 04 16:42:29.831113 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 879/1769] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:29 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:29.840910 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9c808915-fd73-4598-ab74-0171de7bc74c tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:29.842554 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9c808915-fd73-4598-ab74-0171de7bc74c tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: eaa061be-ec66-48b5-bc5f-f82e3513214f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:29.856619 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9c808915-fd73-4598-ab74-0171de7bc74c tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:29.858185 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9c808915-fd73-4598-ab74-0171de7bc74c tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:29.860008 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9c808915-fd73-4598-ab74-0171de7bc74c tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:29.860789 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9c808915-fd73-4598-ab74-0171de7bc74c tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:29.888842 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9624d3ff-533e-49f1-b391-9d64216930ff tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:29.913047 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9624d3ff-533e-49f1-b391-9d64216930ff tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:29.917581 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9624d3ff-533e-49f1-b391-9d64216930ff tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:29.920203 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9624d3ff-533e-49f1-b391-9d64216930ff tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1874 microversion: 2.32 time: 0.730152 Aug 04 16:42:29.940722 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 891/1770] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:42:29 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1874 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:42:29.961746 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-257138e8-25e5-4966-8709-1c11bdaf2822 tempest-FloatingIPDetailsTestJSON-592891366 tempest-FloatingIPDetailsTestJSON-592891366-project] Action: 'create', calling method: .version_select at 0x7f7e77cc13a0>, body: {"pool": null} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:30.268733 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9c808915-fd73-4598-ab74-0171de7bc74c tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23cc8f30e1f94ff0a520a071e5d81728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb25e78b70ee48c99471d78e00e5949c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:30.285563 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9c808915-fd73-4598-ab74-0171de7bc74c tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f" status: 200 len: 1504 microversion: 2.1 time: 0.451907 Aug 04 16:42:30.287557 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 880/1771] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:29 2022] GET /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f => generated 1504 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:30.322904 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-55e4cad3-ebf0-43b9-bfc5-6464fd197464 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:30.327113 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-55e4cad3-ebf0-43b9-bfc5-6464fd197464 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:30.354499 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-55e4cad3-ebf0-43b9-bfc5-6464fd197464 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:30.355289 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-55e4cad3-ebf0-43b9-bfc5-6464fd197464 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:30.356561 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-55e4cad3-ebf0-43b9-bfc5-6464fd197464 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:30.357382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-55e4cad3-ebf0-43b9-bfc5-6464fd197464 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:30.934229 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-55e4cad3-ebf0-43b9-bfc5-6464fd197464 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:30.948443 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-55e4cad3-ebf0-43b9-bfc5-6464fd197464 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1" status: 200 len: 1314 microversion: 2.1 time: 0.646259 Aug 04 16:42:30.950737 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 881/1772] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:30 2022] GET /compute/v2.1/servers/0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1 => generated 1314 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:30.963287 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-4727ef2e-e6e5-48ec-a0f4-9276d437e6fd req-ffca737c-b375-4070-b0a6-317ebbfeac9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1", "name": "network-vif-plugged", "status": "completed", "tag": "cd1f78ee-36ca-482d-a581-52c60f0acd8a"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:30.984821 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-4727ef2e-e6e5-48ec-a0f4-9276d437e6fd req-ffca737c-b375-4070-b0a6-317ebbfeac9f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:30.986970 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-4727ef2e-e6e5-48ec-a0f4-9276d437e6fd req-ffca737c-b375-4070-b0a6-317ebbfeac9f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:31.010256 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-4727ef2e-e6e5-48ec-a0f4-9276d437e6fd req-ffca737c-b375-4070-b0a6-317ebbfeac9f service nova] Creating event network-vif-plugged:cd1f78ee-36ca-482d-a581-52c60f0acd8a for instance 0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1 on n-h2-846466-12 Aug 04 16:42:31.021544 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-4727ef2e-e6e5-48ec-a0f4-9276d437e6fd req-ffca737c-b375-4070-b0a6-317ebbfeac9f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067520 Aug 04 16:42:31.023835 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 882/1773] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:42:31.038130 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e4c0ad59-fcc8-4413-8ebc-e119e6644493 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:31.039671 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e4c0ad59-fcc8-4413-8ebc-e119e6644493 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:31.056756 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e4c0ad59-fcc8-4413-8ebc-e119e6644493 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:31.057536 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e4c0ad59-fcc8-4413-8ebc-e119e6644493 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:31.058883 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e4c0ad59-fcc8-4413-8ebc-e119e6644493 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:31.059602 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e4c0ad59-fcc8-4413-8ebc-e119e6644493 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:31.097547 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:42:31.661501 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e4c0ad59-fcc8-4413-8ebc-e119e6644493 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:31.680399 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e4c0ad59-fcc8-4413-8ebc-e119e6644493 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.653267 Aug 04 16:42:31.684496 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 883/1774] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:31 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:31.700773 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0b8d05c5-34c8-4b45-9dca-bb461d54127e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:31.701447 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0b8d05c5-34c8-4b45-9dca-bb461d54127e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:31.723308 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0b8d05c5-34c8-4b45-9dca-bb461d54127e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:31.724452 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0b8d05c5-34c8-4b45-9dca-bb461d54127e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:31.730229 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0b8d05c5-34c8-4b45-9dca-bb461d54127e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:31.731453 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0b8d05c5-34c8-4b45-9dca-bb461d54127e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:31.805880 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0b8d05c5-34c8-4b45-9dca-bb461d54127e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:31.806899 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0b8d05c5-34c8-4b45-9dca-bb461d54127e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:31.807661 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-0b8d05c5-34c8-4b45-9dca-bb461d54127e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lazy-loading 'fault' on Instance uuid 5021f3f8-aa8b-4c94-8846-fdd1081135f5 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:42:31.883532 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0b8d05c5-34c8-4b45-9dca-bb461d54127e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:31.901896 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0b8d05c5-34c8-4b45-9dca-bb461d54127e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:31.908048 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0b8d05c5-34c8-4b45-9dca-bb461d54127e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:31.919184 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0b8d05c5-34c8-4b45-9dca-bb461d54127e tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 200 len: 1375 microversion: 2.25 time: 0.221206 Aug 04 16:42:31.920465 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 884/1775] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:42:31 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 1375 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:42:31.929967 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e423879a-8d39-472f-9fe1-a072f7f2e875 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-94813427"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:31.937841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e423879a-8d39-472f-9fe1-a072f7f2e875 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: eaa061be-ec66-48b5-bc5f-f82e3513214f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:31.957716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e423879a-8d39-472f-9fe1-a072f7f2e875 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:31.958467 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e423879a-8d39-472f-9fe1-a072f7f2e875 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:31.959459 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e423879a-8d39-472f-9fe1-a072f7f2e875 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:31.960076 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e423879a-8d39-472f-9fe1-a072f7f2e875 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:32.512683 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.network.security_group_api [None req-e423879a-8d39-472f-9fe1-a072f7f2e875 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Adding security group 7137ef3c-fd39-40f7-8bfd-2f4381d1fd67 to port c5f6f976-ffa2-45b4-a0f8-872e3215d5d6 Aug 04 16:42:33.654246 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-257138e8-25e5-4966-8709-1c11bdaf2822 tempest-FloatingIPDetailsTestJSON-592891366 tempest-FloatingIPDetailsTestJSON-592891366-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.708596 Aug 04 16:42:33.655395 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 892/1776] 10.222.0.23 () {60 vars in 1170 bytes} [Thu Aug 4 16:42:29 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:42:33.663686 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-606b8871-7e48-42b3-9e09-aeab5f93223b req-30de33d0-f954-430c-9502-80a8c2598ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5021f3f8-aa8b-4c94-8846-fdd1081135f5", "name": "network-vif-deleted", "tag": "0ac743e2-4fd8-459b-98e6-2cd3c20f4ed6"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:33.700769 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:42:33.743750 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-606b8871-7e48-42b3-9e09-aeab5f93223b req-30de33d0-f954-430c-9502-80a8c2598ef0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:33.745774 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-606b8871-7e48-42b3-9e09-aeab5f93223b req-30de33d0-f954-430c-9502-80a8c2598ef0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:33.772079 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-606b8871-7e48-42b3-9e09-aeab5f93223b req-30de33d0-f954-430c-9502-80a8c2598ef0 service nova] Creating event network-vif-deleted:0ac743e2-4fd8-459b-98e6-2cd3c20f4ed6 for instance 5021f3f8-aa8b-4c94-8846-fdd1081135f5 on n-h2-846466-12 Aug 04 16:42:33.780201 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-606b8871-7e48-42b3-9e09-aeab5f93223b req-30de33d0-f954-430c-9502-80a8c2598ef0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122411 Aug 04 16:42:33.781605 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 893/1777] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:42:33.789033 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d28252c2-1f08-44d1-881d-179ab1036bc3 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:33.790884 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d28252c2-1f08-44d1-881d-179ab1036bc3 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:33.802100 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d28252c2-1f08-44d1-881d-179ab1036bc3 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:33.803076 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d28252c2-1f08-44d1-881d-179ab1036bc3 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:33.804631 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d28252c2-1f08-44d1-881d-179ab1036bc3 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:33.805544 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d28252c2-1f08-44d1-881d-179ab1036bc3 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:33.881061 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e423879a-8d39-472f-9fe1-a072f7f2e875 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "POST /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f/action" status: 202 len: 0 microversion: 2.1 time: 1.958942 Aug 04 16:42:33.882541 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 885/1778] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:42:31 2022] POST /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f/action => generated 0 bytes in 1961 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:42:33.896002 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a627fa82-e1f2-4d74-9a33-9bd1cdfbcacb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1495376560"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:33.900501 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a627fa82-e1f2-4d74-9a33-9bd1cdfbcacb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:33.922876 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:42:33.926497 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a627fa82-e1f2-4d74-9a33-9bd1cdfbcacb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:33.927516 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a627fa82-e1f2-4d74-9a33-9bd1cdfbcacb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:33.928863 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a627fa82-e1f2-4d74-9a33-9bd1cdfbcacb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:33.929665 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a627fa82-e1f2-4d74-9a33-9bd1cdfbcacb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:34.158054 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d28252c2-1f08-44d1-881d-179ab1036bc3 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:34.172205 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d28252c2-1f08-44d1-881d-179ab1036bc3 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:34.174709 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d28252c2-1f08-44d1-881d-179ab1036bc3 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:34.176469 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d28252c2-1f08-44d1-881d-179ab1036bc3 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1874 microversion: 2.32 time: 0.393112 Aug 04 16:42:34.190476 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 894/1779] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:42:33 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1874 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:42:34.201060 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0c492aae-290a-482b-93d5-8b1c1184b672 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:34.202072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0c492aae-290a-482b-93d5-8b1c1184b672 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:34.210086 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0c492aae-290a-482b-93d5-8b1c1184b672 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:34.210960 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0c492aae-290a-482b-93d5-8b1c1184b672 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:34.211958 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0c492aae-290a-482b-93d5-8b1c1184b672 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:34.212564 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0c492aae-290a-482b-93d5-8b1c1184b672 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:34.295761 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a627fa82-e1f2-4d74-9a33-9bd1cdfbcacb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action" status: 202 len: 0 microversion: 2.1 time: 0.406669 Aug 04 16:42:34.298608 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 886/1780] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:42:33 2022] POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 04 16:42:34.340498 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-599e57bb-0284-4594-bedf-5cabc3a7774f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:34.347317 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-599e57bb-0284-4594-bedf-5cabc3a7774f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 5021f3f8-aa8b-4c94-8846-fdd1081135f5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:34.368836 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-599e57bb-0284-4594-bedf-5cabc3a7774f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:34.369730 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-599e57bb-0284-4594-bedf-5cabc3a7774f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:34.371796 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-599e57bb-0284-4594-bedf-5cabc3a7774f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:34.372527 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-599e57bb-0284-4594-bedf-5cabc3a7774f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:34.396300 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-599e57bb-0284-4594-bedf-5cabc3a7774f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] HTTP exception thrown: Instance 5021f3f8-aa8b-4c94-8846-fdd1081135f5 could not be found. Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-599e57bb-0284-4594-bedf-5cabc3a7774f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Request method failure captured: Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 HTTP/1.1 Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_T8oUoBNAA61v2RnRrs8c4bpTvwAeh1Xh2-SDfnjTxF0abRt_8sDgSNwu37NeMxSvo67fTeBTqBiIUEkOVVQPlXrM9ANv4AzvwX7Fhu1rOiZexb93EzMYuX7tVqIVs6db86deIWkcIPjH2tE0Aa3E2HIpdALf4OW2FMJuAJ4__bRmY Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: X-Openstack-Nova-Api-Version: 2.25 Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: e96e3e6168ec421da0cac9eaa8849255 Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-770717492 Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e96e3e6168ec421da0cac9eaa8849255"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e96e3e6168ec421da0cac9eaa8849255"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e96e3e6168ec421da0cac9eaa8849255"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e96e3e6168ec421da0cac9eaa8849255"}]}] Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-770717492 Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: e96e3e6168ec421da0cac9eaa8849255 Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-770717492 Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-LiveAutoBlockMigrationV225Test-770717492-project Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 5bf98871e1344215bd667945e6881320 Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-770717492-project Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 5021f3f8-aa8b-4c94-8846-fdd1081135f5 could not be found. Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '5021f3f8-aa8b-4c94-8846-fdd1081135f5'} Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5021f3f8-aa8b-4c94-8846-fdd1081135f5 could not be found. Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5021f3f8-aa8b-4c94-8846-fdd1081135f5 could not be found. Aug 04 16:42:34.399525 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:42:34.410006 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:42:34.410006 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:42:34.410006 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:42:34.410006 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:42:34.410006 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:42:34.410006 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:42:34.410006 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:42:34.410006 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5021f3f8-aa8b-4c94-8846-fdd1081135f5 could not be found. Aug 04 16:42:34.410006 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:42:34.411755 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0c492aae-290a-482b-93d5-8b1c1184b672 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:34.414279 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-599e57bb-0284-4594-bedf-5cabc3a7774f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Returning 404 to user: Instance 5021f3f8-aa8b-4c94-8846-fdd1081135f5 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:42:34.415554 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0c492aae-290a-482b-93d5-8b1c1184b672 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1" status: 200 len: 1464 microversion: 2.1 time: 0.223301 Aug 04 16:42:34.416160 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-599e57bb-0284-4594-bedf-5cabc3a7774f tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5" status: 404 len: 111 microversion: 2.25 time: 0.114269 Aug 04 16:42:34.416521 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 895/1781] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:34 2022] GET /compute/v2.1/servers/0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1 => generated 1464 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:34.422906 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 887/1782] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:42:34 2022] GET /compute/v2.1/servers/5021f3f8-aa8b-4c94-8846-fdd1081135f5 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:42:34.431823 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-62e58233-5bbd-40df-958b-f79d9d08e87c tempest-FloatingIPDetailsTestJSON-592891366 tempest-FloatingIPDetailsTestJSON-592891366-project] Action: 'create', calling method: .version_select at 0x7f7e847ed8b0>, body: {"pool": null} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:34.456257 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-99808339-a839-4068-acea-e62676ea62dc req-579f41c1-64b9-4b4e-bf41-66aa155a8024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b80b04-533e-48b5-8595-9de81ed2c526", "name": "network-vif-plugged", "status": "completed", "tag": "1b245f3e-3f81-40cd-9523-09b35900d9ec"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:34.476104 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-99808339-a839-4068-acea-e62676ea62dc req-579f41c1-64b9-4b4e-bf41-66aa155a8024 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:34.476829 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-99808339-a839-4068-acea-e62676ea62dc req-579f41c1-64b9-4b4e-bf41-66aa155a8024 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:34.500950 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-99808339-a839-4068-acea-e62676ea62dc req-579f41c1-64b9-4b4e-bf41-66aa155a8024 service nova] Creating event network-vif-plugged:1b245f3e-3f81-40cd-9523-09b35900d9ec for instance 97b80b04-533e-48b5-8595-9de81ed2c526 on n-h1-846466-12 Aug 04 16:42:34.510480 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-99808339-a839-4068-acea-e62676ea62dc req-579f41c1-64b9-4b4e-bf41-66aa155a8024 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074363 Aug 04 16:42:34.511815 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 896/1783] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:42:34.523818 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4ae632c8-a2c5-4dd9-869c-df3f6fc1fef9 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '.version_select at 0x7f7e77d7ec10>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:34.988244 n-d-846466-12 devstack@n-api.service[126125]: DEBUG neutronclient.v2_0.client [None req-4ae632c8-a2c5-4dd9-869c-df3f6fc1fef9 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 7137ef3c-fd39-40f7-8bfd-2f4381d1fd67 in use.", "detail": ""}} {{(pid=126125) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:42:34.992039 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-4ae632c8-a2c5-4dd9-869c-df3f6fc1fef9 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] HTTP exception thrown: Security Group 7137ef3c-fd39-40f7-8bfd-2f4381d1fd67 in use. Aug 04 16:42:34.992039 n-d-846466-12 devstack@n-api.service[126125]: Neutron server returns request_ids: ['req-37ef6e99-e0d2-435c-b31d-9b4451e83bf5'] Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4ae632c8-a2c5-4dd9-869c-df3f6fc1fef9 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Request method failure captured: Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/os-security-groups/7137ef3c-fd39-40f7-8bfd-2f4381d1fd67 HTTP/1.1 Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_ZtqC96HabeWwNgyZnNmoMaRGEyMmVaUiLu9hLAQojAZCETOMBNx13l8QKIShQoX65FgHvzAm8VK7NKftXhvS9Bem6sccV9Ryn6Golur8wBQf_N6ajaCoRyYDB8mHggg2hJ4dz1CI18qnEF5I50zAGclpa2ng4xjm4gsGO8OQL5bTg Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: eb25e78b70ee48c99471d78e00e5949c Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb25e78b70ee48c99471d78e00e5949c"}]}] Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: eb25e78b70ee48c99471d78e00e5949c Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-SecurityGroupsTestJSON-886514065-project Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 23cc8f30e1f94ff0a520a071e5d81728 Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-SecurityGroupsTestJSON-886514065-project Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: exception: Security Group 7137ef3c-fd39-40f7-8bfd-2f4381d1fd67 in use. Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: Neutron server returns request_ids: ['req-37ef6e99-e0d2-435c-b31d-9b4451e83bf5'] Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '7137ef3c-fd39-40f7-8bfd-2f4381d1fd67'} Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:42:34.997347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 7137ef3c-fd39-40f7-8bfd-2f4381d1fd67 in use. Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-37ef6e99-e0d2-435c-b31d-9b4451e83bf5'] Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 7137ef3c-fd39-40f7-8bfd-2f4381d1fd67 in use. Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-37ef6e99-e0d2-435c-b31d-9b4451e83bf5'] Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 7137ef3c-fd39-40f7-8bfd-2f4381d1fd67 in use. Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-37ef6e99-e0d2-435c-b31d-9b4451e83bf5'] Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 7137ef3c-fd39-40f7-8bfd-2f4381d1fd67 in use. Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-37ef6e99-e0d2-435c-b31d-9b4451e83bf5'] Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4ae632c8-a2c5-4dd9-869c-df3f6fc1fef9 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Returning 400 to user: Security Group 7137ef3c-fd39-40f7-8bfd-2f4381d1fd67 in use. Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: Neutron server returns request_ids: ['req-37ef6e99-e0d2-435c-b31d-9b4451e83bf5'] {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:42:35.013545 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4ae632c8-a2c5-4dd9-869c-df3f6fc1fef9 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/7137ef3c-fd39-40f7-8bfd-2f4381d1fd67" status: 400 len: 185 microversion: 2.1 time: 0.498178 Aug 04 16:42:35.024689 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 897/1784] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:42:34 2022] DELETE /compute/v2.1/os-security-groups/7137ef3c-fd39-40f7-8bfd-2f4381d1fd67 => generated 185 bytes in 512 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:42:35.034070 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d4188104-3135-442b-9a5c-c589643b4570 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '.version_select at 0x7f7e77c8db80>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:35.077569 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d4188104-3135-442b-9a5c-c589643b4570 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-604521346" status: 204 len: 0 microversion: 2.25 time: 0.050535 Aug 04 16:42:35.078848 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 898/1785] 10.222.0.23 () {60 vars in 1259 bytes} [Thu Aug 4 16:42:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-604521346 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 16:42:35.091936 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cdc9a000-1b88-47f2-96ab-e2fd4e8dcda7 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:35.096978 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cdc9a000-1b88-47f2-96ab-e2fd4e8dcda7 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:35.119075 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cdc9a000-1b88-47f2-96ab-e2fd4e8dcda7 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:35.120777 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cdc9a000-1b88-47f2-96ab-e2fd4e8dcda7 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:35.125148 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cdc9a000-1b88-47f2-96ab-e2fd4e8dcda7 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:35.127514 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cdc9a000-1b88-47f2-96ab-e2fd4e8dcda7 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:35.568011 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cdc9a000-1b88-47f2-96ab-e2fd4e8dcda7 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:35.597044 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cdc9a000-1b88-47f2-96ab-e2fd4e8dcda7 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1314 microversion: 2.1 time: 0.516386 Aug 04 16:42:35.607185 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 899/1786] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:35 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:35.628163 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-983e95ad-1c8c-4a8c-b110-eb61a8c16f94 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:35.629829 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-983e95ad-1c8c-4a8c-b110-eb61a8c16f94 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: d238b9f3-e25b-4864-8b27-d53054d76082] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:35.653508 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-983e95ad-1c8c-4a8c-b110-eb61a8c16f94 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:35.659707 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-983e95ad-1c8c-4a8c-b110-eb61a8c16f94 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:35.662069 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-983e95ad-1c8c-4a8c-b110-eb61a8c16f94 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:35.666952 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-983e95ad-1c8c-4a8c-b110-eb61a8c16f94 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:35.786634 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-983e95ad-1c8c-4a8c-b110-eb61a8c16f94 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: d238b9f3-e25b-4864-8b27-d53054d76082] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:42:35.939751 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-983e95ad-1c8c-4a8c-b110-eb61a8c16f94 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082" status: 204 len: 0 microversion: 2.1 time: 0.329083 Aug 04 16:42:35.945483 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 900/1787] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:42:35 2022] DELETE /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:42:35.954000 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0ef21996-e0bd-4f2b-8ae6-ec73584b2fc9 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:35.959173 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0ef21996-e0bd-4f2b-8ae6-ec73584b2fc9 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: eaa061be-ec66-48b5-bc5f-f82e3513214f] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:35.973749 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ef21996-e0bd-4f2b-8ae6-ec73584b2fc9 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:35.974717 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ef21996-e0bd-4f2b-8ae6-ec73584b2fc9 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:35.976955 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ef21996-e0bd-4f2b-8ae6-ec73584b2fc9 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:35.977874 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ef21996-e0bd-4f2b-8ae6-ec73584b2fc9 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:36.178774 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0ef21996-e0bd-4f2b-8ae6-ec73584b2fc9 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "POST /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f/action" status: 202 len: 0 microversion: 2.1 time: 0.220947 Aug 04 16:42:36.181204 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 901/1788] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:42:35 2022] POST /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:42:36.190242 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1044b636-ef28-467d-8f80-d6fc124297c9 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:36.192090 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1044b636-ef28-467d-8f80-d6fc124297c9 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:36.215448 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1044b636-ef28-467d-8f80-d6fc124297c9 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:36.216497 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1044b636-ef28-467d-8f80-d6fc124297c9 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:36.217883 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1044b636-ef28-467d-8f80-d6fc124297c9 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:36.219858 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1044b636-ef28-467d-8f80-d6fc124297c9 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:36.668671 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1044b636-ef28-467d-8f80-d6fc124297c9 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:36.687162 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1044b636-ef28-467d-8f80-d6fc124297c9 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:36.688918 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1044b636-ef28-467d-8f80-d6fc124297c9 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:36.690234 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1044b636-ef28-467d-8f80-d6fc124297c9 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1874 microversion: 2.32 time: 0.507378 Aug 04 16:42:36.695227 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 902/1789] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:42:36 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1874 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:42:36.710791 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-f1cd779f-c362-4b40-9bc7-89f82c55ec5a req-b2b975d6-c164-41e4-95df-0dd24df94961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaa061be-ec66-48b5-bc5f-f82e3513214f", "tag": "c5f6f976-ffa2-45b4-a0f8-872e3215d5d6"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:36.742018 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-f1cd779f-c362-4b40-9bc7-89f82c55ec5a req-b2b975d6-c164-41e4-95df-0dd24df94961 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:36.743427 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-f1cd779f-c362-4b40-9bc7-89f82c55ec5a req-b2b975d6-c164-41e4-95df-0dd24df94961 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:36.763719 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-f1cd779f-c362-4b40-9bc7-89f82c55ec5a req-b2b975d6-c164-41e4-95df-0dd24df94961 service nova] Creating event network-changed:c5f6f976-ffa2-45b4-a0f8-872e3215d5d6 for instance eaa061be-ec66-48b5-bc5f-f82e3513214f on n-h2-846466-12 Aug 04 16:42:36.770412 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-f1cd779f-c362-4b40-9bc7-89f82c55ec5a req-b2b975d6-c164-41e4-95df-0dd24df94961 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071853 Aug 04 16:42:36.771721 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 903/1790] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:42:36.777483 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6829d7c0-816e-4e78-9618-84d2246b0047 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:36.778295 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6829d7c0-816e-4e78-9618-84d2246b0047 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: d238b9f3-e25b-4864-8b27-d53054d76082] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:36.787893 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6829d7c0-816e-4e78-9618-84d2246b0047 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:36.787893 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6829d7c0-816e-4e78-9618-84d2246b0047 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:36.789259 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6829d7c0-816e-4e78-9618-84d2246b0047 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:36.789259 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6829d7c0-816e-4e78-9618-84d2246b0047 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:37.357213 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6829d7c0-816e-4e78-9618-84d2246b0047 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:37.375238 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6829d7c0-816e-4e78-9618-84d2246b0047 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082" status: 200 len: 1509 microversion: 2.1 time: 0.601923 Aug 04 16:42:37.376524 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 904/1791] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:36 2022] GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082 => generated 1509 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:37.383240 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9f172492-d251-4c09-a1b9-2f0a02a0b477 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:37.384266 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9f172492-d251-4c09-a1b9-2f0a02a0b477 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: eaa061be-ec66-48b5-bc5f-f82e3513214f] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:37.401360 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9f172492-d251-4c09-a1b9-2f0a02a0b477 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:37.401878 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9f172492-d251-4c09-a1b9-2f0a02a0b477 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:37.404713 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9f172492-d251-4c09-a1b9-2f0a02a0b477 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:37.405634 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9f172492-d251-4c09-a1b9-2f0a02a0b477 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:37.990495 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9f172492-d251-4c09-a1b9-2f0a02a0b477 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23cc8f30e1f94ff0a520a071e5d81728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb25e78b70ee48c99471d78e00e5949c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:37.994300 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:42:38.000775 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9f172492-d251-4c09-a1b9-2f0a02a0b477 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f" status: 200 len: 1573 microversion: 2.1 time: 0.622996 Aug 04 16:42:38.011063 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 905/1792] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:37 2022] GET /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f => generated 1573 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:38.023209 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b7675547-e785-4cc5-a232-cdf754f0aae1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:38.024620 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b7675547-e785-4cc5-a232-cdf754f0aae1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 6017510a-e331-424a-843d-54b980b999fb] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:38.044559 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b7675547-e785-4cc5-a232-cdf754f0aae1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:38.045347 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b7675547-e785-4cc5-a232-cdf754f0aae1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:38.046824 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b7675547-e785-4cc5-a232-cdf754f0aae1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:38.047592 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b7675547-e785-4cc5-a232-cdf754f0aae1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:38.100016 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b7675547-e785-4cc5-a232-cdf754f0aae1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 6017510a-e331-424a-843d-54b980b999fb] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:42:38.204984 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b7675547-e785-4cc5-a232-cdf754f0aae1 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb" status: 204 len: 0 microversion: 2.25 time: 0.190345 Aug 04 16:42:38.205991 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 906/1793] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Aug 4 16:42:38 2022] DELETE /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 16:42:38.216747 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ce15778f-8084-4866-abd3-31070d09d814 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:38.218447 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ce15778f-8084-4866-abd3-31070d09d814 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:38.226891 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ce15778f-8084-4866-abd3-31070d09d814 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:38.227350 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ce15778f-8084-4866-abd3-31070d09d814 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:38.228169 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ce15778f-8084-4866-abd3-31070d09d814 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:38.228602 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ce15778f-8084-4866-abd3-31070d09d814 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:38.910015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ce15778f-8084-4866-abd3-31070d09d814 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:38.933647 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-62e58233-5bbd-40df-958b-f79d9d08e87c tempest-FloatingIPDetailsTestJSON-592891366 tempest-FloatingIPDetailsTestJSON-592891366-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.506927 Aug 04 16:42:38.934374 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 888/1794] 10.222.0.23 () {60 vars in 1170 bytes} [Thu Aug 4 16:42:34 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:42:38.951432 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7a3f8081-c434-440c-94c9-8431fbe2e23d tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:38.952638 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7a3f8081-c434-440c-94c9-8431fbe2e23d tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:38.952849 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ce15778f-8084-4866-abd3-31070d09d814 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1463 microversion: 2.1 time: 0.745115 Aug 04 16:42:38.965371 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 907/1795] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:38 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1463 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:38.966195 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2fe6edac-addc-46cf-b59b-f12f0eb13915 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:38.967136 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2fe6edac-addc-46cf-b59b-f12f0eb13915 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 6017510a-e331-424a-843d-54b980b999fb] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:38.980585 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2fe6edac-addc-46cf-b59b-f12f0eb13915 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:38.982202 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2fe6edac-addc-46cf-b59b-f12f0eb13915 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:38.984336 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2fe6edac-addc-46cf-b59b-f12f0eb13915 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:38.985728 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2fe6edac-addc-46cf-b59b-f12f0eb13915 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:39.007140 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7a3f8081-c434-440c-94c9-8431fbe2e23d tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:39.008700 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7a3f8081-c434-440c-94c9-8431fbe2e23d tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:39.009915 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7a3f8081-c434-440c-94c9-8431fbe2e23d tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:39.010417 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7a3f8081-c434-440c-94c9-8431fbe2e23d tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:40.187765 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2fe6edac-addc-46cf-b59b-f12f0eb13915 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:40.209094 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2fe6edac-addc-46cf-b59b-f12f0eb13915 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:40.214018 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2fe6edac-addc-46cf-b59b-f12f0eb13915 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:40.217381 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2fe6edac-addc-46cf-b59b-f12f0eb13915 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb" status: 200 len: 1547 microversion: 2.25 time: 1.261066 Aug 04 16:42:40.274389 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7a3f8081-c434-440c-94c9-8431fbe2e23d tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:40.286297 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 908/1796] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:42:38 2022] GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb => generated 1547 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:42:40.341603 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e870ed92-a264-4e20-8dd9-b59b528ed072 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:40.348665 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e870ed92-a264-4e20-8dd9-b59b528ed072 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: d238b9f3-e25b-4864-8b27-d53054d76082] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:40.365014 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7a3f8081-c434-440c-94c9-8431fbe2e23d tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:40.371845 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7a3f8081-c434-440c-94c9-8431fbe2e23d tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:40.381192 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7a3f8081-c434-440c-94c9-8431fbe2e23d tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1874 microversion: 2.32 time: 1.441669 Aug 04 16:42:40.383226 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e870ed92-a264-4e20-8dd9-b59b528ed072 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:40.384811 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 889/1797] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:42:38 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1874 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:42:40.386960 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e870ed92-a264-4e20-8dd9-b59b528ed072 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:40.390657 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e870ed92-a264-4e20-8dd9-b59b528ed072 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:40.397374 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e870ed92-a264-4e20-8dd9-b59b528ed072 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:40.407936 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b997fdf9-02cc-4ef5-8efd-b67f764088cf tempest-FloatingIPDetailsTestJSON-592891366 tempest-FloatingIPDetailsTestJSON-592891366-project] Action: 'create', calling method: .version_select at 0x7f7e84ac80d0>, body: {"pool": null} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:40.497052 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e870ed92-a264-4e20-8dd9-b59b528ed072 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:40.497763 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e870ed92-a264-4e20-8dd9-b59b528ed072 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:40.498716 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-e870ed92-a264-4e20-8dd9-b59b528ed072 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lazy-loading 'fault' on Instance uuid d238b9f3-e25b-4864-8b27-d53054d76082 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:42:40.884502 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e870ed92-a264-4e20-8dd9-b59b528ed072 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:40.911280 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e870ed92-a264-4e20-8dd9-b59b528ed072 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082" status: 200 len: 1312 microversion: 2.1 time: 0.620073 Aug 04 16:42:40.915512 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 909/1798] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:40 2022] GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082 => generated 1312 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:40.941955 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a8d576b4-17e7-436d-8f92-3c477b24b21b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:40.944852 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a8d576b4-17e7-436d-8f92-3c477b24b21b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: eaa061be-ec66-48b5-bc5f-f82e3513214f] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:40.964913 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8d576b4-17e7-436d-8f92-3c477b24b21b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:40.966538 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8d576b4-17e7-436d-8f92-3c477b24b21b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:40.968513 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8d576b4-17e7-436d-8f92-3c477b24b21b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:40.969863 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8d576b4-17e7-436d-8f92-3c477b24b21b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:41.841830 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a8d576b4-17e7-436d-8f92-3c477b24b21b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23cc8f30e1f94ff0a520a071e5d81728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb25e78b70ee48c99471d78e00e5949c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:41.856702 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a8d576b4-17e7-436d-8f92-3c477b24b21b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f" status: 200 len: 1571 microversion: 2.1 time: 0.934354 Aug 04 16:42:41.859867 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 910/1799] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:40 2022] GET /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f => generated 1571 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:41.873976 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-af66d99d-159e-40b3-acd6-65790aa5dc65 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1482273128", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "97b80b04-533e-48b5-8595-9de81ed2c526"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:42.063350 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-af66d99d-159e-40b3-acd6-65790aa5dc65 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] validate_networks() for None {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:42:42.837856 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-af66d99d-159e-40b3-acd6-65790aa5dc65 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:42:42.839224 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-af66d99d-159e-40b3-acd6-65790aa5dc65 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:42:42.840615 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-af66d99d-159e-40b3-acd6-65790aa5dc65 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:42:42.842109 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-af66d99d-159e-40b3-acd6-65790aa5dc65 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:42:42.844094 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-af66d99d-159e-40b3-acd6-65790aa5dc65 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:42:42.861200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-af66d99d-159e-40b3-acd6-65790aa5dc65 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:42.862452 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-af66d99d-159e-40b3-acd6-65790aa5dc65 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:42.868082 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-af66d99d-159e-40b3-acd6-65790aa5dc65 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:42.869380 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-af66d99d-159e-40b3-acd6-65790aa5dc65 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:42.910444 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-af66d99d-159e-40b3-acd6-65790aa5dc65 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Getting quotas for project c1c1660ad79d489392261a78b5677be5. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:42:42.925541 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-af66d99d-159e-40b3-acd6-65790aa5dc65 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Getting quotas for user 648fb8ee69e24f74bf694d0e99f04502 and project c1c1660ad79d489392261a78b5677be5. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:42:42.979853 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-af66d99d-159e-40b3-acd6-65790aa5dc65 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:42:42.984193 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-af66d99d-159e-40b3-acd6-65790aa5dc65 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 8ad2a63b-d522-4e78-9246-e6e0d3c554f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:42:43.087742 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-af66d99d-159e-40b3-acd6-65790aa5dc65 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.225688 Aug 04 16:42:43.089346 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 911/1800] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:42:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1229 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:42:43.099524 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-b70d0945-7f16-4724-9f15-28d5763fdafd req-d87a7be6-4956-4103-8741-365fd0e41782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d238b9f3-e25b-4864-8b27-d53054d76082", "name": "network-vif-deleted", "tag": "b5861496-5180-45d9-b61a-84944c746263"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:43.141462 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-b70d0945-7f16-4724-9f15-28d5763fdafd req-d87a7be6-4956-4103-8741-365fd0e41782 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:43.142563 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-b70d0945-7f16-4724-9f15-28d5763fdafd req-d87a7be6-4956-4103-8741-365fd0e41782 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:43.173131 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-b70d0945-7f16-4724-9f15-28d5763fdafd req-d87a7be6-4956-4103-8741-365fd0e41782 service nova] Creating event network-vif-deleted:b5861496-5180-45d9-b61a-84944c746263 for instance d238b9f3-e25b-4864-8b27-d53054d76082 on n-h1-846466-12 Aug 04 16:42:43.187373 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-b70d0945-7f16-4724-9f15-28d5763fdafd req-d87a7be6-4956-4103-8741-365fd0e41782 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095161 Aug 04 16:42:43.195579 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 912/1801] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:42:43.220861 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-158ca410-ec8a-46f4-8ff5-026db275e2e5 req-97624368-4ca9-4c31-a629-4088580c30ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c62ae02-0f30-43e1-a005-89dcb8122d4e", "name": "network-vif-plugged", "status": "completed", "tag": "93c46fa1-3978-4529-9c01-36e6a216c294"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:43.268227 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-158ca410-ec8a-46f4-8ff5-026db275e2e5 req-97624368-4ca9-4c31-a629-4088580c30ca service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:43.269331 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-158ca410-ec8a-46f4-8ff5-026db275e2e5 req-97624368-4ca9-4c31-a629-4088580c30ca service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:43.295136 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-158ca410-ec8a-46f4-8ff5-026db275e2e5 req-97624368-4ca9-4c31-a629-4088580c30ca service nova] Creating event network-vif-plugged:93c46fa1-3978-4529-9c01-36e6a216c294 for instance 0c62ae02-0f30-43e1-a005-89dcb8122d4e on n-h1-846466-12 Aug 04 16:42:43.311356 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-158ca410-ec8a-46f4-8ff5-026db275e2e5 req-97624368-4ca9-4c31-a629-4088580c30ca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107400 Aug 04 16:42:43.313485 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 913/1802] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:42:43.326122 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-035afeb9-437a-471e-90d3-c9890cba6e0a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:43.327729 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-035afeb9-437a-471e-90d3-c9890cba6e0a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: 6017510a-e331-424a-843d-54b980b999fb] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:43.340325 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-035afeb9-437a-471e-90d3-c9890cba6e0a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:43.342059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-035afeb9-437a-471e-90d3-c9890cba6e0a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:43.344061 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-035afeb9-437a-471e-90d3-c9890cba6e0a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:43.345137 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-035afeb9-437a-471e-90d3-c9890cba6e0a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:43.379046 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-035afeb9-437a-471e-90d3-c9890cba6e0a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] HTTP exception thrown: Instance 6017510a-e331-424a-843d-54b980b999fb could not be found. Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-035afeb9-437a-471e-90d3-c9890cba6e0a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Request method failure captured: Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb HTTP/1.1 Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_T8oUoBNAA61v2RnRrs8c4bpTvwAeh1Xh2-SDfnjTxF0abRt_8sDgSNwu37NeMxSvo67fTeBTqBiIUEkOVVQPlXrM9ANv4AzvwX7Fhu1rOiZexb93EzMYuX7tVqIVs6db86deIWkcIPjH2tE0Aa3E2HIpdALf4OW2FMJuAJ4__bRmY Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: X-Openstack-Nova-Api-Version: 2.25 Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: e96e3e6168ec421da0cac9eaa8849255 Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-770717492 Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e96e3e6168ec421da0cac9eaa8849255"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e96e3e6168ec421da0cac9eaa8849255"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e96e3e6168ec421da0cac9eaa8849255"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e96e3e6168ec421da0cac9eaa8849255"}]}] Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-770717492 Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: e96e3e6168ec421da0cac9eaa8849255 Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-770717492 Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-LiveAutoBlockMigrationV225Test-770717492-project Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 5bf98871e1344215bd667945e6881320 Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-770717492-project Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 6017510a-e331-424a-843d-54b980b999fb could not be found. Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '6017510a-e331-424a-843d-54b980b999fb'} Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6017510a-e331-424a-843d-54b980b999fb could not be found. Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6017510a-e331-424a-843d-54b980b999fb could not be found. Aug 04 16:42:43.383317 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:42:43.395192 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:42:43.395192 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:42:43.395192 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:42:43.395192 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:42:43.395192 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:42:43.395192 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:42:43.395192 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:42:43.395192 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6017510a-e331-424a-843d-54b980b999fb could not be found. Aug 04 16:42:43.395192 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:42:43.397252 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-035afeb9-437a-471e-90d3-c9890cba6e0a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Returning 404 to user: Instance 6017510a-e331-424a-843d-54b980b999fb could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:42:43.399120 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-035afeb9-437a-471e-90d3-c9890cba6e0a tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb" status: 404 len: 111 microversion: 2.25 time: 0.082816 Aug 04 16:42:43.400786 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 914/1803] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:42:43 2022] GET /compute/v2.1/servers/6017510a-e331-424a-843d-54b980b999fb => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:42:43.413684 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5ec43774-9a9d-4e65-aee4-e617ac75b672 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:43.415030 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5ec43774-9a9d-4e65-aee4-e617ac75b672 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:43.445671 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ec43774-9a9d-4e65-aee4-e617ac75b672 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:43.446398 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ec43774-9a9d-4e65-aee4-e617ac75b672 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:43.447728 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ec43774-9a9d-4e65-aee4-e617ac75b672 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:43.448689 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ec43774-9a9d-4e65-aee4-e617ac75b672 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:44.158909 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5ec43774-9a9d-4e65-aee4-e617ac75b672 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:44.205537 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5ec43774-9a9d-4e65-aee4-e617ac75b672 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:44.212153 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5ec43774-9a9d-4e65-aee4-e617ac75b672 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:44.216017 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5ec43774-9a9d-4e65-aee4-e617ac75b672 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1874 microversion: 2.32 time: 0.812054 Aug 04 16:42:44.216017 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 915/1804] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:42:43 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1874 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:42:44.240579 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-67306d0c-5ea7-41e6-9eed-6ba57567581e tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-755691357"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:44.244054 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-67306d0c-5ea7-41e6-9eed-6ba57567581e tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: eaa061be-ec66-48b5-bc5f-f82e3513214f] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:44.266865 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-67306d0c-5ea7-41e6-9eed-6ba57567581e tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:44.268726 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-67306d0c-5ea7-41e6-9eed-6ba57567581e tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:44.274453 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-67306d0c-5ea7-41e6-9eed-6ba57567581e tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:44.276451 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-67306d0c-5ea7-41e6-9eed-6ba57567581e tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:44.734624 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.network.security_group_api [None req-67306d0c-5ea7-41e6-9eed-6ba57567581e tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Adding security group 4510d3d4-1130-4925-a92a-866677ad2232 to port c5f6f976-ffa2-45b4-a0f8-872e3215d5d6 Aug 04 16:42:45.079081 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b997fdf9-02cc-4ef5-8efd-b67f764088cf tempest-FloatingIPDetailsTestJSON-592891366 tempest-FloatingIPDetailsTestJSON-592891366-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.690005 Aug 04 16:42:45.081648 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 890/1805] 10.222.0.23 () {60 vars in 1170 bytes} [Thu Aug 4 16:42:40 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:42:45.092772 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-594b67b9-4b61-4cfa-83e0-eeff9e3c2220 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:45.093872 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-594b67b9-4b61-4cfa-83e0-eeff9e3c2220 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: d238b9f3-e25b-4864-8b27-d53054d76082] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:45.108512 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-594b67b9-4b61-4cfa-83e0-eeff9e3c2220 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:45.112416 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-594b67b9-4b61-4cfa-83e0-eeff9e3c2220 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:45.117353 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-594b67b9-4b61-4cfa-83e0-eeff9e3c2220 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:45.118924 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-594b67b9-4b61-4cfa-83e0-eeff9e3c2220 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:45.169936 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-594b67b9-4b61-4cfa-83e0-eeff9e3c2220 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] HTTP exception thrown: Instance d238b9f3-e25b-4864-8b27-d53054d76082 could not be found. Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-594b67b9-4b61-4cfa-83e0-eeff9e3c2220 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Request method failure captured: Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082 HTTP/1.1 Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_WOXTtiEFJuJx9g__PLaEpNUIG8cY9V5mucnrPgRej9fIBvkSBrLUaGoaJ38CVyDNzSj9GoE7BQp1yVztL27iI-fLZMpYZtLbyWcNlftj-zWFhGEyvOQOtE9rUW6LzioxrRHRZoV1uxRI3_TSQwte9NfcDMr3FTg447dmciw2wFA7M Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 20d035e0adc640c8a3ceb832275d0ea7 Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1842533046 Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20d035e0adc640c8a3ceb832275d0ea7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_20d035e0adc640c8a3ceb832275d0ea7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20d035e0adc640c8a3ceb832275d0ea7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/20d035e0adc640c8a3ceb832275d0ea7"}]}] Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1842533046 Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 20d035e0adc640c8a3ceb832275d0ea7 Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1842533046 Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServerRescueNegativeTestJSON-1842533046-project Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: a88db264b2c94f699e015a8617150b45 Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1842533046-project Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance d238b9f3-e25b-4864-8b27-d53054d76082 could not be found. Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'd238b9f3-e25b-4864-8b27-d53054d76082'} Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d238b9f3-e25b-4864-8b27-d53054d76082 could not be found. Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d238b9f3-e25b-4864-8b27-d53054d76082 could not be found. Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:42:45.174934 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:42:45.180894 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:42:45.180894 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:42:45.180894 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:42:45.180894 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:42:45.180894 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:42:45.180894 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:42:45.180894 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d238b9f3-e25b-4864-8b27-d53054d76082 could not be found. Aug 04 16:42:45.180894 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:42:45.187953 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-594b67b9-4b61-4cfa-83e0-eeff9e3c2220 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Returning 404 to user: Instance d238b9f3-e25b-4864-8b27-d53054d76082 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:42:45.189476 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-594b67b9-4b61-4cfa-83e0-eeff9e3c2220 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082" status: 404 len: 111 microversion: 2.1 time: 0.106216 Aug 04 16:42:45.200515 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 891/1806] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:45 2022] GET /compute/v2.1/servers/d238b9f3-e25b-4864-8b27-d53054d76082 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:42:45.206846 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fd51e492-b037-4fc2-b1a8-b225fe0a5371 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:45.208826 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fd51e492-b037-4fc2-b1a8-b225fe0a5371 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 8ad2a63b-d522-4e78-9246-e6e0d3c554f8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:45.217418 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fd51e492-b037-4fc2-b1a8-b225fe0a5371 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:45.218217 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fd51e492-b037-4fc2-b1a8-b225fe0a5371 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:45.219253 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fd51e492-b037-4fc2-b1a8-b225fe0a5371 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:45.220765 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fd51e492-b037-4fc2-b1a8-b225fe0a5371 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:45.407096 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fd51e492-b037-4fc2-b1a8-b225fe0a5371 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:45.418550 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fd51e492-b037-4fc2-b1a8-b225fe0a5371 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad2a63b-d522-4e78-9246-e6e0d3c554f8" status: 200 len: 1284 microversion: 2.1 time: 0.216423 Aug 04 16:42:45.420572 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 892/1807] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:45 2022] GET /compute/v2.1/servers/8ad2a63b-d522-4e78-9246-e6e0d3c554f8 => generated 1284 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:45.442860 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-283a8153-1cc3-4b04-971d-1aa3f9ca051c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:45.443378 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-283a8153-1cc3-4b04-971d-1aa3f9ca051c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: b61f1675-928c-4591-8213-474c2bc174be] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:45.451339 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-283a8153-1cc3-4b04-971d-1aa3f9ca051c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:45.451963 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-283a8153-1cc3-4b04-971d-1aa3f9ca051c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:45.453077 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-283a8153-1cc3-4b04-971d-1aa3f9ca051c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:45.453975 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-283a8153-1cc3-4b04-971d-1aa3f9ca051c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:45.496189 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-283a8153-1cc3-4b04-971d-1aa3f9ca051c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: b61f1675-928c-4591-8213-474c2bc174be] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:42:45.621665 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-283a8153-1cc3-4b04-971d-1aa3f9ca051c tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be" status: 204 len: 0 microversion: 2.25 time: 0.197820 Aug 04 16:42:45.623109 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 893/1808] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Aug 4 16:42:45 2022] DELETE /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 16:42:45.630597 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b1970958-4180-49f4-8a48-1c69d45ec174 tempest-FloatingIPDetailsTestJSON-592891366 tempest-FloatingIPDetailsTestJSON-592891366-project] Calling method '.version_select at 0x7f7e84841e50>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:46.025353 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-67306d0c-5ea7-41e6-9eed-6ba57567581e tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "POST /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f/action" status: 202 len: 0 microversion: 2.1 time: 1.808595 Aug 04 16:42:46.027086 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 916/1809] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:42:44 2022] POST /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f/action => generated 0 bytes in 1811 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:42:46.034265 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4fe71bd9-9186-41ee-a7fa-b567eff22afb tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:46.035086 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4fe71bd9-9186-41ee-a7fa-b567eff22afb tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: 532ec916-2768-43e0-a912-791fb4b5d9ea] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:46.051630 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4fe71bd9-9186-41ee-a7fa-b567eff22afb tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:46.057485 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4fe71bd9-9186-41ee-a7fa-b567eff22afb tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:46.058673 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4fe71bd9-9186-41ee-a7fa-b567eff22afb tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:46.059292 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4fe71bd9-9186-41ee-a7fa-b567eff22afb tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:46.124295 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4fe71bd9-9186-41ee-a7fa-b567eff22afb tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: 532ec916-2768-43e0-a912-791fb4b5d9ea] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:42:46.215457 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b1970958-4180-49f4-8a48-1c69d45ec174 tempest-FloatingIPDetailsTestJSON-592891366 tempest-FloatingIPDetailsTestJSON-592891366-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/bb1412ca-e51f-4d49-b522-b5fa9a192615" status: 200 len: 141 microversion: 2.1 time: 0.590637 Aug 04 16:42:46.216106 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 894/1810] 10.222.0.23 () {58 vars in 1260 bytes} [Thu Aug 4 16:42:45 2022] GET /compute/v2.1/os-floating-ips/bb1412ca-e51f-4d49-b522-b5fa9a192615 => generated 141 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:42:46.223693 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-03330390-4543-4895-b92f-0f2ab23ee4d8 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:46.228923 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-03330390-4543-4895-b92f-0f2ab23ee4d8 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:46.249814 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03330390-4543-4895-b92f-0f2ab23ee4d8 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:46.251347 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03330390-4543-4895-b92f-0f2ab23ee4d8 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:46.254212 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03330390-4543-4895-b92f-0f2ab23ee4d8 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:46.254777 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03330390-4543-4895-b92f-0f2ab23ee4d8 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:46.357254 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4fe71bd9-9186-41ee-a7fa-b567eff22afb tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "DELETE /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea" status: 204 len: 0 microversion: 2.1 time: 0.326986 Aug 04 16:42:46.359564 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 917/1811] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:42:46 2022] DELETE /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:42:46.368221 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-fe625e99-cd95-4fcb-9e68-93213ffbbc66 req-b30a0ea0-0f10-4651-961d-894df7e1f4b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09e1b482-0372-4270-ac25-6d3349aca31e", "name": "network-vif-plugged", "status": "completed", "tag": "372f96d2-ee11-4947-bb71-af596393f831"}, {"server_uuid": "09e1b482-0372-4270-ac25-6d3349aca31e", "name": "network-vif-plugged", "status": "completed", "tag": "80b3b8c3-3818-4e0b-9096-8ce22a3ec0f3"}, {"server_uuid": "09e1b482-0372-4270-ac25-6d3349aca31e", "name": "network-vif-plugged", "status": "completed", "tag": "c5e38244-ed96-4228-beb9-52ba893cf961"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:46.386681 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-fe625e99-cd95-4fcb-9e68-93213ffbbc66 req-b30a0ea0-0f10-4651-961d-894df7e1f4b2 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:46.387516 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-fe625e99-cd95-4fcb-9e68-93213ffbbc66 req-b30a0ea0-0f10-4651-961d-894df7e1f4b2 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:46.404757 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-fe625e99-cd95-4fcb-9e68-93213ffbbc66 req-b30a0ea0-0f10-4651-961d-894df7e1f4b2 service nova] Creating event network-vif-plugged:372f96d2-ee11-4947-bb71-af596393f831 for instance 09e1b482-0372-4270-ac25-6d3349aca31e on n-h2-846466-12 Aug 04 16:42:46.405407 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-fe625e99-cd95-4fcb-9e68-93213ffbbc66 req-b30a0ea0-0f10-4651-961d-894df7e1f4b2 service nova] Creating event network-vif-plugged:80b3b8c3-3818-4e0b-9096-8ce22a3ec0f3 for instance 09e1b482-0372-4270-ac25-6d3349aca31e on n-h2-846466-12 Aug 04 16:42:46.405996 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-fe625e99-cd95-4fcb-9e68-93213ffbbc66 req-b30a0ea0-0f10-4651-961d-894df7e1f4b2 service nova] Creating event network-vif-plugged:c5e38244-ed96-4228-beb9-52ba893cf961 for instance 09e1b482-0372-4270-ac25-6d3349aca31e on n-h2-846466-12 Aug 04 16:42:46.412566 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-fe625e99-cd95-4fcb-9e68-93213ffbbc66 req-b30a0ea0-0f10-4651-961d-894df7e1f4b2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.050858 Aug 04 16:42:46.413933 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 918/1812] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:42:46.422197 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3fb616a6-c6c8-4836-9838-f2e60cd23df3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:46.423132 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3fb616a6-c6c8-4836-9838-f2e60cd23df3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: b61f1675-928c-4591-8213-474c2bc174be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:46.432719 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3fb616a6-c6c8-4836-9838-f2e60cd23df3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:46.433375 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3fb616a6-c6c8-4836-9838-f2e60cd23df3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:46.434556 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3fb616a6-c6c8-4836-9838-f2e60cd23df3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:46.435112 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3fb616a6-c6c8-4836-9838-f2e60cd23df3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:46.842441 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3fb616a6-c6c8-4836-9838-f2e60cd23df3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:46.861424 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-03330390-4543-4895-b92f-0f2ab23ee4d8 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:46.869311 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3fb616a6-c6c8-4836-9838-f2e60cd23df3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:46.873733 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3fb616a6-c6c8-4836-9838-f2e60cd23df3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf98871e1344215bd667945e6881320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96e3e6168ec421da0cac9eaa8849255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:46.877858 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3fb616a6-c6c8-4836-9838-f2e60cd23df3 tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be" status: 200 len: 1563 microversion: 2.25 time: 0.461981 Aug 04 16:42:46.879851 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 919/1813] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:42:46 2022] GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be => generated 1563 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:42:46.891209 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-e526dc6a-9646-4afd-af04-00af114cbf9e req-ae8f9798-90ca-41a4-8eab-f7864b64079b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6017510a-e331-424a-843d-54b980b999fb", "name": "network-vif-deleted", "tag": "d7e532ef-c5a8-4d48-bb77-3ffca7d01087"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:46.902633 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-03330390-4543-4895-b92f-0f2ab23ee4d8 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:46.912108 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-e526dc6a-9646-4afd-af04-00af114cbf9e req-ae8f9798-90ca-41a4-8eab-f7864b64079b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:46.913757 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-e526dc6a-9646-4afd-af04-00af114cbf9e req-ae8f9798-90ca-41a4-8eab-f7864b64079b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:46.914303 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-03330390-4543-4895-b92f-0f2ab23ee4d8 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:46.922735 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-03330390-4543-4895-b92f-0f2ab23ee4d8 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1874 microversion: 2.32 time: 0.704597 Aug 04 16:42:46.924343 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 895/1814] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:42:46 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1874 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:42:46.953345 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-e526dc6a-9646-4afd-af04-00af114cbf9e req-ae8f9798-90ca-41a4-8eab-f7864b64079b service nova] Creating event network-vif-deleted:d7e532ef-c5a8-4d48-bb77-3ffca7d01087 for instance 6017510a-e331-424a-843d-54b980b999fb on n-h2-846466-12 Aug 04 16:42:46.964052 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-e526dc6a-9646-4afd-af04-00af114cbf9e req-ae8f9798-90ca-41a4-8eab-f7864b64079b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074348 Aug 04 16:42:46.964052 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 920/1815] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:42:46.966151 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d6785ca1-2f74-4d66-a42a-36ce8808dce7 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '.version_select at 0x7f7e84a31ee0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:46.976292 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8ce9b0f6-3ecc-4609-b31b-b8a07d6f9132 tempest-FloatingIPDetailsTestJSON-592891366 tempest-FloatingIPDetailsTestJSON-592891366-project] Calling method '.version_select at 0x7f7e77c8d310>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:47.938304 n-d-846466-12 devstack@n-api.service[126126]: DEBUG neutronclient.v2_0.client [None req-d6785ca1-2f74-4d66-a42a-36ce8808dce7 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 4510d3d4-1130-4925-a92a-866677ad2232 in use.", "detail": ""}} {{(pid=126126) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:42:47.939659 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-d6785ca1-2f74-4d66-a42a-36ce8808dce7 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] HTTP exception thrown: Security Group 4510d3d4-1130-4925-a92a-866677ad2232 in use. Aug 04 16:42:47.939659 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-a571735c-8575-4ba9-87eb-3a4d301ed4ce'] Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d6785ca1-2f74-4d66-a42a-36ce8808dce7 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Request method failure captured: Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/os-security-groups/4510d3d4-1130-4925-a92a-866677ad2232 HTTP/1.1 Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_ZtqC96HabeWwNgyZnNmoMaRGEyMmVaUiLu9hLAQojAZCETOMBNx13l8QKIShQoX65FgHvzAm8VK7NKftXhvS9Bem6sccV9Ryn6Golur8wBQf_N6ajaCoRyYDB8mHggg2hJ4dz1CI18qnEF5I50zAGclpa2ng4xjm4gsGO8OQL5bTg Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: eb25e78b70ee48c99471d78e00e5949c Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb25e78b70ee48c99471d78e00e5949c"}]}] Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: eb25e78b70ee48c99471d78e00e5949c Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-SecurityGroupsTestJSON-886514065-project Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 23cc8f30e1f94ff0a520a071e5d81728 Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-SecurityGroupsTestJSON-886514065-project Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: exception: Security Group 4510d3d4-1130-4925-a92a-866677ad2232 in use. Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-a571735c-8575-4ba9-87eb-3a4d301ed4ce'] Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '4510d3d4-1130-4925-a92a-866677ad2232'} Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:42:47.954493 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 4510d3d4-1130-4925-a92a-866677ad2232 in use. Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a571735c-8575-4ba9-87eb-3a4d301ed4ce'] Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 4510d3d4-1130-4925-a92a-866677ad2232 in use. Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a571735c-8575-4ba9-87eb-3a4d301ed4ce'] Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 4510d3d4-1130-4925-a92a-866677ad2232 in use. Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a571735c-8575-4ba9-87eb-3a4d301ed4ce'] Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 4510d3d4-1130-4925-a92a-866677ad2232 in use. Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a571735c-8575-4ba9-87eb-3a4d301ed4ce'] Aug 04 16:42:47.971514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:42:47.985160 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d6785ca1-2f74-4d66-a42a-36ce8808dce7 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Returning 400 to user: Security Group 4510d3d4-1130-4925-a92a-866677ad2232 in use. Aug 04 16:42:47.985160 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-a571735c-8575-4ba9-87eb-3a4d301ed4ce'] {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:42:47.993624 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d6785ca1-2f74-4d66-a42a-36ce8808dce7 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/4510d3d4-1130-4925-a92a-866677ad2232" status: 400 len: 185 microversion: 2.1 time: 1.050072 Aug 04 16:42:48.003360 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 896/1816] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:42:46 2022] DELETE /compute/v2.1/os-security-groups/4510d3d4-1130-4925-a92a-866677ad2232 => generated 185 bytes in 1065 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:42:48.042248 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9ef9404b-3142-4c95-b0ae-b942190595a3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:48.044897 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9ef9404b-3142-4c95-b0ae-b942190595a3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: 532ec916-2768-43e0-a912-791fb4b5d9ea] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:48.060802 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9ef9404b-3142-4c95-b0ae-b942190595a3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:48.062270 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9ef9404b-3142-4c95-b0ae-b942190595a3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:48.065347 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9ef9404b-3142-4c95-b0ae-b942190595a3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:48.066995 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9ef9404b-3142-4c95-b0ae-b942190595a3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:48.531729 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9ef9404b-3142-4c95-b0ae-b942190595a3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:48.547683 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9ef9404b-3142-4c95-b0ae-b942190595a3 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea" status: 200 len: 1521 microversion: 2.1 time: 0.529109 Aug 04 16:42:48.548244 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 897/1817] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:48 2022] GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea => generated 1521 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:48.567863 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-15696f88-7a99-4d56-9e0d-e98d00bd9643 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:48.569001 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-15696f88-7a99-4d56-9e0d-e98d00bd9643 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 8ad2a63b-d522-4e78-9246-e6e0d3c554f8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:48.578818 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-15696f88-7a99-4d56-9e0d-e98d00bd9643 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:48.580057 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-15696f88-7a99-4d56-9e0d-e98d00bd9643 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:48.581342 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-15696f88-7a99-4d56-9e0d-e98d00bd9643 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:48.582029 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-15696f88-7a99-4d56-9e0d-e98d00bd9643 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:49.341355 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-15696f88-7a99-4d56-9e0d-e98d00bd9643 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:49.400349 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-15696f88-7a99-4d56-9e0d-e98d00bd9643 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad2a63b-d522-4e78-9246-e6e0d3c554f8" status: 200 len: 1314 microversion: 2.1 time: 0.849532 Aug 04 16:42:49.402626 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 898/1818] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:48 2022] GET /compute/v2.1/servers/8ad2a63b-d522-4e78-9246-e6e0d3c554f8 => generated 1314 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:49.419122 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-477d024c-d00b-4cd6-8182-04eb484f42bd req-1574dd30-f723-426d-a684-d1bba570d6eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b61f1675-928c-4591-8213-474c2bc174be", "name": "network-vif-deleted", "tag": "c6da17eb-62d8-4f32-b0fd-b4686bc2423e"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:49.443367 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-477d024c-d00b-4cd6-8182-04eb484f42bd req-1574dd30-f723-426d-a684-d1bba570d6eb service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:49.443809 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-477d024c-d00b-4cd6-8182-04eb484f42bd req-1574dd30-f723-426d-a684-d1bba570d6eb service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:49.466451 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-477d024c-d00b-4cd6-8182-04eb484f42bd req-1574dd30-f723-426d-a684-d1bba570d6eb service nova] Creating event network-vif-deleted:c6da17eb-62d8-4f32-b0fd-b4686bc2423e for instance b61f1675-928c-4591-8213-474c2bc174be on n-h1-846466-12 Aug 04 16:42:49.479283 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-477d024c-d00b-4cd6-8182-04eb484f42bd req-1574dd30-f723-426d-a684-d1bba570d6eb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074427 Aug 04 16:42:49.480643 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 899/1819] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:42:49.488706 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f06e9976-a9d1-4506-ab07-70e8531911da tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:49.490073 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f06e9976-a9d1-4506-ab07-70e8531911da tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] [instance: b61f1675-928c-4591-8213-474c2bc174be] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:49.499692 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f06e9976-a9d1-4506-ab07-70e8531911da tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:49.500463 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f06e9976-a9d1-4506-ab07-70e8531911da tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:49.501527 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f06e9976-a9d1-4506-ab07-70e8531911da tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:49.502208 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f06e9976-a9d1-4506-ab07-70e8531911da tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:49.525140 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-f06e9976-a9d1-4506-ab07-70e8531911da tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] HTTP exception thrown: Instance b61f1675-928c-4591-8213-474c2bc174be could not be found. Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f06e9976-a9d1-4506-ab07-70e8531911da tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Request method failure captured: Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be HTTP/1.1 Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_T8oUoBNAA61v2RnRrs8c4bpTvwAeh1Xh2-SDfnjTxF0abRt_8sDgSNwu37NeMxSvo67fTeBTqBiIUEkOVVQPlXrM9ANv4AzvwX7Fhu1rOiZexb93EzMYuX7tVqIVs6db86deIWkcIPjH2tE0Aa3E2HIpdALf4OW2FMJuAJ4__bRmY Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: X-Openstack-Nova-Api-Version: 2.25 Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: e96e3e6168ec421da0cac9eaa8849255 Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-770717492 Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e96e3e6168ec421da0cac9eaa8849255"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e96e3e6168ec421da0cac9eaa8849255"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e96e3e6168ec421da0cac9eaa8849255"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e96e3e6168ec421da0cac9eaa8849255"}]}] Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-770717492 Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: e96e3e6168ec421da0cac9eaa8849255 Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-770717492 Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-LiveAutoBlockMigrationV225Test-770717492-project Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 5bf98871e1344215bd667945e6881320 Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-770717492-project Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance b61f1675-928c-4591-8213-474c2bc174be could not be found. Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'b61f1675-928c-4591-8213-474c2bc174be'} Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b61f1675-928c-4591-8213-474c2bc174be could not be found. Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b61f1675-928c-4591-8213-474c2bc174be could not be found. Aug 04 16:42:49.527642 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:42:49.533417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:42:49.533417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:42:49.533417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:42:49.533417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:42:49.533417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:42:49.533417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:42:49.533417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:42:49.533417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b61f1675-928c-4591-8213-474c2bc174be could not be found. Aug 04 16:42:49.533417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:42:49.536659 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f06e9976-a9d1-4506-ab07-70e8531911da tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] Returning 404 to user: Instance b61f1675-928c-4591-8213-474c2bc174be could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:42:49.537954 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f06e9976-a9d1-4506-ab07-70e8531911da tempest-LiveAutoBlockMigrationV225Test-770717492 tempest-LiveAutoBlockMigrationV225Test-770717492-project] 10.222.0.23 "GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be" status: 404 len: 111 microversion: 2.25 time: 0.055583 Aug 04 16:42:49.539076 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 900/1820] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:42:49 2022] GET /compute/v2.1/servers/b61f1675-928c-4591-8213-474c2bc174be => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:42:49.544752 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6590854b-f9db-413f-a69a-74aa5e4abe60 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:49.546389 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6590854b-f9db-413f-a69a-74aa5e4abe60 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:49.559026 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6590854b-f9db-413f-a69a-74aa5e4abe60 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:49.560714 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6590854b-f9db-413f-a69a-74aa5e4abe60 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:49.562289 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6590854b-f9db-413f-a69a-74aa5e4abe60 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:49.563270 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6590854b-f9db-413f-a69a-74aa5e4abe60 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:50.185938 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6590854b-f9db-413f-a69a-74aa5e4abe60 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:50.208545 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6590854b-f9db-413f-a69a-74aa5e4abe60 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:50.211195 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6590854b-f9db-413f-a69a-74aa5e4abe60 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:50.218666 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6590854b-f9db-413f-a69a-74aa5e4abe60 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1874 microversion: 2.32 time: 0.678164 Aug 04 16:42:50.228944 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 901/1821] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:42:49 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1874 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:42:50.235084 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bfe8c632-f1a1-4091-ae2d-30328f64d67a tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:50.239156 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bfe8c632-f1a1-4091-ae2d-30328f64d67a tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: eaa061be-ec66-48b5-bc5f-f82e3513214f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:50.260561 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bfe8c632-f1a1-4091-ae2d-30328f64d67a tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:50.266291 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bfe8c632-f1a1-4091-ae2d-30328f64d67a tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:50.274724 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bfe8c632-f1a1-4091-ae2d-30328f64d67a tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:50.276791 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bfe8c632-f1a1-4091-ae2d-30328f64d67a tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:50.327605 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bfe8c632-f1a1-4091-ae2d-30328f64d67a tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: eaa061be-ec66-48b5-bc5f-f82e3513214f] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:42:50.377138 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:42:50.515925 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bfe8c632-f1a1-4091-ae2d-30328f64d67a tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "DELETE /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f" status: 204 len: 0 microversion: 2.1 time: 0.284336 Aug 04 16:42:50.525833 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 902/1822] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:42:50 2022] DELETE /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:42:50.548755 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-91a8f3c8-4f62-46f7-84c0-2f2471950014 req-ba069f7c-c3f5-4e9c-9aca-143dbb5db9e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09e1b482-0372-4270-ac25-6d3349aca31e", "name": "network-vif-plugged", "status": "completed", "tag": "c03b3426-9b13-43b4-8130-95a9515f9f8a"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:50.620336 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-91a8f3c8-4f62-46f7-84c0-2f2471950014 req-ba069f7c-c3f5-4e9c-9aca-143dbb5db9e6 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:50.627422 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-91a8f3c8-4f62-46f7-84c0-2f2471950014 req-ba069f7c-c3f5-4e9c-9aca-143dbb5db9e6 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:50.677015 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-91a8f3c8-4f62-46f7-84c0-2f2471950014 req-ba069f7c-c3f5-4e9c-9aca-143dbb5db9e6 service nova] Creating event network-vif-plugged:c03b3426-9b13-43b4-8130-95a9515f9f8a for instance 09e1b482-0372-4270-ac25-6d3349aca31e on n-h2-846466-12 Aug 04 16:42:50.690738 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-91a8f3c8-4f62-46f7-84c0-2f2471950014 req-ba069f7c-c3f5-4e9c-9aca-143dbb5db9e6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160890 Aug 04 16:42:50.691282 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 903/1823] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:42:50.701226 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-6347cade-f268-483d-b8e5-6d3e27814804 req-2e6e9355-6833-4d5b-b1fb-eaab1ce2a291 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaa061be-ec66-48b5-bc5f-f82e3513214f", "tag": "c5f6f976-ffa2-45b4-a0f8-872e3215d5d6"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:50.702515 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8ce9b0f6-3ecc-4609-b31b-b8a07d6f9132 tempest-FloatingIPDetailsTestJSON-592891366 tempest-FloatingIPDetailsTestJSON-592891366-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/bb1412ca-e51f-4d49-b522-b5fa9a192615" status: 202 len: 0 microversion: 2.1 time: 3.738271 Aug 04 16:42:50.704030 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 921/1824] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Aug 4 16:42:46 2022] DELETE /compute/v2.1/os-floating-ips/bb1412ca-e51f-4d49-b522-b5fa9a192615 => generated 0 bytes in 3743 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:42:50.730198 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-6347cade-f268-483d-b8e5-6d3e27814804 req-2e6e9355-6833-4d5b-b1fb-eaab1ce2a291 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:50.730645 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-6347cade-f268-483d-b8e5-6d3e27814804 req-2e6e9355-6833-4d5b-b1fb-eaab1ce2a291 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:50.731275 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-abd14b04-8624-497a-8759-b296eb721269 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:50.738832 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-abd14b04-8624-497a-8759-b296eb721269 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: 532ec916-2768-43e0-a912-791fb4b5d9ea] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:50.753372 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-6347cade-f268-483d-b8e5-6d3e27814804 req-2e6e9355-6833-4d5b-b1fb-eaab1ce2a291 service nova] Creating event network-changed:c5f6f976-ffa2-45b4-a0f8-872e3215d5d6 for instance eaa061be-ec66-48b5-bc5f-f82e3513214f on n-h2-846466-12 Aug 04 16:42:50.762263 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-abd14b04-8624-497a-8759-b296eb721269 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:50.770482 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-abd14b04-8624-497a-8759-b296eb721269 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:50.775240 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-abd14b04-8624-497a-8759-b296eb721269 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:50.776661 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-abd14b04-8624-497a-8759-b296eb721269 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:50.779216 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-6347cade-f268-483d-b8e5-6d3e27814804 req-2e6e9355-6833-4d5b-b1fb-eaab1ce2a291 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086385 Aug 04 16:42:50.780009 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 904/1825] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:42:50.786006 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c47bd33e-ffca-4db5-93ea-7d2c819dcc8b tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:50.791070 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c47bd33e-ffca-4db5-93ea-7d2c819dcc8b tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd3cd7076f4514ee89b0c4b2a586fe69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547b33a8f5a344f788da917f3512be5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:50.791908 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c47bd33e-ffca-4db5-93ea-7d2c819dcc8b tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Searching by: {'deleted': False, 'project_id': '547b33a8f5a344f788da917f3512be5f'} {{(pid=126126) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:42:50.816278 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c47bd33e-ffca-4db5-93ea-7d2c819dcc8b tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:50.816768 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c47bd33e-ffca-4db5-93ea-7d2c819dcc8b tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:50.817845 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c47bd33e-ffca-4db5-93ea-7d2c819dcc8b tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:50.818335 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c47bd33e-ffca-4db5-93ea-7d2c819dcc8b tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:50.881985 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.multi_cell_list [None req-c47bd33e-ffca-4db5-93ea-7d2c819dcc8b tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126126) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:42:50.946987 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c47bd33e-ffca-4db5-93ea-7d2c819dcc8b tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.165414 Aug 04 16:42:50.960492 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 905/1826] 10.222.0.23 () {58 vars in 1125 bytes} [Thu Aug 4 16:42:50 2022] GET /compute/v2.1/servers => generated 344 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:42:50.973257 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4e4db813-71de-4418-b577-162aae355eeb tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:50.985833 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4e4db813-71de-4418-b577-162aae355eeb tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 8ad2a63b-d522-4e78-9246-e6e0d3c554f8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:50.998977 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4e4db813-71de-4418-b577-162aae355eeb tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:51.006568 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4e4db813-71de-4418-b577-162aae355eeb tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:51.008505 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4e4db813-71de-4418-b577-162aae355eeb tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:51.011800 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4e4db813-71de-4418-b577-162aae355eeb tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:51.595703 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-abd14b04-8624-497a-8759-b296eb721269 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db264b2c94f699e015a8617150b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d035e0adc640c8a3ceb832275d0ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:51.618509 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-abd14b04-8624-497a-8759-b296eb721269 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea" status: 200 len: 1521 microversion: 2.1 time: 0.910601 Aug 04 16:42:51.621389 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 922/1827] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:50 2022] GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea => generated 1521 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:51.660195 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4e4db813-71de-4418-b577-162aae355eeb tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:51.664725 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1a6c69a4-025a-468e-b792-e69c3faed7b2 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:51.674227 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1a6c69a4-025a-468e-b792-e69c3faed7b2 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: eaa061be-ec66-48b5-bc5f-f82e3513214f] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:51.689050 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4e4db813-71de-4418-b577-162aae355eeb tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad2a63b-d522-4e78-9246-e6e0d3c554f8" status: 200 len: 1314 microversion: 2.1 time: 0.726809 Aug 04 16:42:51.692752 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 906/1828] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:50 2022] GET /compute/v2.1/servers/8ad2a63b-d522-4e78-9246-e6e0d3c554f8 => generated 1314 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:51.695407 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1a6c69a4-025a-468e-b792-e69c3faed7b2 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:51.695873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1a6c69a4-025a-468e-b792-e69c3faed7b2 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:51.696698 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1a6c69a4-025a-468e-b792-e69c3faed7b2 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:51.697138 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1a6c69a4-025a-468e-b792-e69c3faed7b2 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:51.714860 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-431b83c7-efe3-4b9b-980b-2ca953912045 tempest-FloatingIPDetailsTestJSON-592891366 tempest-FloatingIPDetailsTestJSON-592891366-project] Calling method '.version_select at 0x7f7e84a31040>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:52.665066 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-431b83c7-efe3-4b9b-980b-2ca953912045 tempest-FloatingIPDetailsTestJSON-592891366 tempest-FloatingIPDetailsTestJSON-592891366-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.970368 Aug 04 16:42:52.666566 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 907/1829] 10.222.0.23 () {58 vars in 1164 bytes} [Thu Aug 4 16:42:51 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:42:52.671731 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5058e8ff-1564-4adf-8b70-e5bfa213ae24 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:52.700796 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5058e8ff-1564-4adf-8b70-e5bfa213ae24 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd3cd7076f4514ee89b0c4b2a586fe69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547b33a8f5a344f788da917f3512be5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:52.702902 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5058e8ff-1564-4adf-8b70-e5bfa213ae24 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Searching by: {'deleted': False, 'project_id': '547b33a8f5a344f788da917f3512be5f'} {{(pid=126126) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:42:52.714179 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5058e8ff-1564-4adf-8b70-e5bfa213ae24 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:52.714907 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5058e8ff-1564-4adf-8b70-e5bfa213ae24 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:52.715966 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5058e8ff-1564-4adf-8b70-e5bfa213ae24 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:52.716596 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5058e8ff-1564-4adf-8b70-e5bfa213ae24 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:52.766145 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1a6c69a4-025a-468e-b792-e69c3faed7b2 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23cc8f30e1f94ff0a520a071e5d81728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb25e78b70ee48c99471d78e00e5949c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:52.779052 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1a6c69a4-025a-468e-b792-e69c3faed7b2 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f" status: 200 len: 1645 microversion: 2.1 time: 1.152013 Aug 04 16:42:52.795128 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 923/1830] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:51 2022] GET /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f => generated 1645 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:52.801338 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e67dd092-daed-4d8a-99e6-3e4aa595192a tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:52.808087 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e67dd092-daed-4d8a-99e6-3e4aa595192a tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:52.825817 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e67dd092-daed-4d8a-99e6-3e4aa595192a tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:52.828220 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e67dd092-daed-4d8a-99e6-3e4aa595192a tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:52.829708 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e67dd092-daed-4d8a-99e6-3e4aa595192a tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:52.830701 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e67dd092-daed-4d8a-99e6-3e4aa595192a tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:52.896917 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:42:52.902615 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:42:52.965169 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:42:52.992401 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.multi_cell_list [None req-5058e8ff-1564-4adf-8b70-e5bfa213ae24 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126126) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:42:53.230636 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5058e8ff-1564-4adf-8b70-e5bfa213ae24 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cd7076f4514ee89b0c4b2a586fe69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547b33a8f5a344f788da917f3512be5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:53.265691 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5058e8ff-1564-4adf-8b70-e5bfa213ae24 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:53.265691 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5058e8ff-1564-4adf-8b70-e5bfa213ae24 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:54.339600 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5058e8ff-1564-4adf-8b70-e5bfa213ae24 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 1.671667 Aug 04 16:42:54.340662 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 908/1831] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:42:52 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:54.345812 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3b212b17-515a-41f3-8c06-8c118bd989a5 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:54.347438 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3b212b17-515a-41f3-8c06-8c118bd989a5 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] [instance: 532ec916-2768-43e0-a912-791fb4b5d9ea] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:54.371005 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b212b17-515a-41f3-8c06-8c118bd989a5 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:54.381589 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e67dd092-daed-4d8a-99e6-3e4aa595192a tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:54.382228 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b212b17-515a-41f3-8c06-8c118bd989a5 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:54.382877 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b212b17-515a-41f3-8c06-8c118bd989a5 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:54.383314 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b212b17-515a-41f3-8c06-8c118bd989a5 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:54.414668 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-3b212b17-515a-41f3-8c06-8c118bd989a5 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] HTTP exception thrown: Instance 532ec916-2768-43e0-a912-791fb4b5d9ea could not be found. Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3b212b17-515a-41f3-8c06-8c118bd989a5 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Request method failure captured: Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea HTTP/1.1 Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_WOXTtiEFJuJx9g__PLaEpNUIG8cY9V5mucnrPgRej9fIBvkSBrLUaGoaJ38CVyDNzSj9GoE7BQp1yVztL27iI-fLZMpYZtLbyWcNlftj-zWFhGEyvOQOtE9rUW6LzioxrRHRZoV1uxRI3_TSQwte9NfcDMr3FTg447dmciw2wFA7M Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 20d035e0adc640c8a3ceb832275d0ea7 Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1842533046 Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20d035e0adc640c8a3ceb832275d0ea7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_20d035e0adc640c8a3ceb832275d0ea7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20d035e0adc640c8a3ceb832275d0ea7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/20d035e0adc640c8a3ceb832275d0ea7"}]}] Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1842533046 Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 20d035e0adc640c8a3ceb832275d0ea7 Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1842533046 Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServerRescueNegativeTestJSON-1842533046-project Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: a88db264b2c94f699e015a8617150b45 Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1842533046-project Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 532ec916-2768-43e0-a912-791fb4b5d9ea could not be found. Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '532ec916-2768-43e0-a912-791fb4b5d9ea'} Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 532ec916-2768-43e0-a912-791fb4b5d9ea could not be found. Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 532ec916-2768-43e0-a912-791fb4b5d9ea could not be found. Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:42:54.416423 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:42:54.421235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:42:54.421235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:42:54.421235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:42:54.421235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:42:54.421235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:42:54.421235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:42:54.421235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 532ec916-2768-43e0-a912-791fb4b5d9ea could not be found. Aug 04 16:42:54.421235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:42:54.421235 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3b212b17-515a-41f3-8c06-8c118bd989a5 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] Returning 404 to user: Instance 532ec916-2768-43e0-a912-791fb4b5d9ea could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:42:54.421961 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e67dd092-daed-4d8a-99e6-3e4aa595192a tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:54.426512 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3b212b17-515a-41f3-8c06-8c118bd989a5 tempest-ServerRescueNegativeTestJSON-1842533046 tempest-ServerRescueNegativeTestJSON-1842533046-project] 10.222.0.23 "GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea" status: 404 len: 111 microversion: 2.1 time: 0.084396 Aug 04 16:42:54.430797 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 909/1832] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:54 2022] GET /compute/v2.1/servers/532ec916-2768-43e0-a912-791fb4b5d9ea => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:42:54.431221 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e67dd092-daed-4d8a-99e6-3e4aa595192a tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:54.436638 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e67dd092-daed-4d8a-99e6-3e4aa595192a tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1874 microversion: 2.32 time: 1.634208 Aug 04 16:42:54.438660 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 924/1833] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:42:52 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1874 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:42:54.442203 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0789ec9d-0c13-4bf2-a875-3309b11047f2 tempest-FloatingIPDetailsTestJSON-592891366 tempest-FloatingIPDetailsTestJSON-592891366-project] Calling method '.version_select at 0x7f7e84bc4700>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:54.458505 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9860e1cc-59b4-4dbc-a8f9-96e826b75731 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:54.462799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9860e1cc-59b4-4dbc-a8f9-96e826b75731 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 8ad2a63b-d522-4e78-9246-e6e0d3c554f8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:54.494791 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9860e1cc-59b4-4dbc-a8f9-96e826b75731 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:54.496034 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9860e1cc-59b4-4dbc-a8f9-96e826b75731 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:54.498762 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9860e1cc-59b4-4dbc-a8f9-96e826b75731 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:54.503221 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9860e1cc-59b4-4dbc-a8f9-96e826b75731 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:55.951959 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9860e1cc-59b4-4dbc-a8f9-96e826b75731 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:55.972065 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9860e1cc-59b4-4dbc-a8f9-96e826b75731 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad2a63b-d522-4e78-9246-e6e0d3c554f8" status: 200 len: 1314 microversion: 2.1 time: 1.531438 Aug 04 16:42:55.986078 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 925/1834] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:54 2022] GET /compute/v2.1/servers/8ad2a63b-d522-4e78-9246-e6e0d3c554f8 => generated 1314 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:55.991584 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-dc0a392a-e9ed-4826-a015-e37d5749912f req-6a199664-59f7-4c2d-a92b-a557f043a8e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09e1b482-0372-4270-ac25-6d3349aca31e", "name": "network-vif-plugged", "status": "completed", "tag": "a55a1fc3-452c-4f78-8499-e76e8bdb7750"}, {"server_uuid": "09e1b482-0372-4270-ac25-6d3349aca31e", "name": "network-vif-plugged", "status": "completed", "tag": "a2483ca6-cccd-4bc5-82a5-0870eb4a915c"}, {"server_uuid": "09e1b482-0372-4270-ac25-6d3349aca31e", "name": "network-vif-plugged", "status": "completed", "tag": "535d6e32-66f9-49c7-b95a-15ae2962f14b"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:56.012534 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-dc0a392a-e9ed-4826-a015-e37d5749912f req-6a199664-59f7-4c2d-a92b-a557f043a8e7 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:56.018227 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-dc0a392a-e9ed-4826-a015-e37d5749912f req-6a199664-59f7-4c2d-a92b-a557f043a8e7 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:56.051708 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-dc0a392a-e9ed-4826-a015-e37d5749912f req-6a199664-59f7-4c2d-a92b-a557f043a8e7 service nova] Creating event network-vif-plugged:a55a1fc3-452c-4f78-8499-e76e8bdb7750 for instance 09e1b482-0372-4270-ac25-6d3349aca31e on n-h2-846466-12 Aug 04 16:42:56.052677 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-dc0a392a-e9ed-4826-a015-e37d5749912f req-6a199664-59f7-4c2d-a92b-a557f043a8e7 service nova] Creating event network-vif-plugged:a2483ca6-cccd-4bc5-82a5-0870eb4a915c for instance 09e1b482-0372-4270-ac25-6d3349aca31e on n-h2-846466-12 Aug 04 16:42:56.053705 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-dc0a392a-e9ed-4826-a015-e37d5749912f req-6a199664-59f7-4c2d-a92b-a557f043a8e7 service nova] Creating event network-vif-plugged:535d6e32-66f9-49c7-b95a-15ae2962f14b for instance 09e1b482-0372-4270-ac25-6d3349aca31e on n-h2-846466-12 Aug 04 16:42:56.067623 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-dc0a392a-e9ed-4826-a015-e37d5749912f req-6a199664-59f7-4c2d-a92b-a557f043a8e7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.079335 Aug 04 16:42:56.077141 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 926/1835] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:42:56.086977 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0789ec9d-0c13-4bf2-a875-3309b11047f2 tempest-FloatingIPDetailsTestJSON-592891366 tempest-FloatingIPDetailsTestJSON-592891366-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 1.657898 Aug 04 16:42:56.101387 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 910/1836] 10.222.0.23 () {58 vars in 1149 bytes} [Thu Aug 4 16:42:54 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:42:56.101387 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2152c3b3-c40b-436a-ac7a-2eb374c893cc tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:56.120941 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2152c3b3-c40b-436a-ac7a-2eb374c893cc tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: eaa061be-ec66-48b5-bc5f-f82e3513214f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:56.137550 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2152c3b3-c40b-436a-ac7a-2eb374c893cc tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:56.138587 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2152c3b3-c40b-436a-ac7a-2eb374c893cc tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:56.139515 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2152c3b3-c40b-436a-ac7a-2eb374c893cc tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:56.141625 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2152c3b3-c40b-436a-ac7a-2eb374c893cc tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:56.417783 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-3c9ab351-b57b-4b03-8eff-6d195806adae req-cec0625a-670a-4301-b3c6-2bef1bc86fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "532ec916-2768-43e0-a912-791fb4b5d9ea", "name": "network-vif-deleted", "tag": "f3a840a0-b3e2-44fd-a731-6cfafffd7f6e"}, {"name": "network-changed", "server_uuid": "8ad2a63b-d522-4e78-9246-e6e0d3c554f8", "tag": "61cddda4-3f06-46e6-a9ae-52b5d6f90428"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:56.438582 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:42:56.444371 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-3c9ab351-b57b-4b03-8eff-6d195806adae req-cec0625a-670a-4301-b3c6-2bef1bc86fd3 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:56.445736 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-3c9ab351-b57b-4b03-8eff-6d195806adae req-cec0625a-670a-4301-b3c6-2bef1bc86fd3 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:56.471513 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-3c9ab351-b57b-4b03-8eff-6d195806adae req-cec0625a-670a-4301-b3c6-2bef1bc86fd3 service nova] Creating event network-vif-deleted:f3a840a0-b3e2-44fd-a731-6cfafffd7f6e for instance 532ec916-2768-43e0-a912-791fb4b5d9ea on n-h2-846466-12 Aug 04 16:42:56.472259 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-3c9ab351-b57b-4b03-8eff-6d195806adae req-cec0625a-670a-4301-b3c6-2bef1bc86fd3 service nova] Creating event network-changed:61cddda4-3f06-46e6-a9ae-52b5d6f90428 for instance 8ad2a63b-d522-4e78-9246-e6e0d3c554f8 on n-h1-846466-12 Aug 04 16:42:56.496401 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-3c9ab351-b57b-4b03-8eff-6d195806adae req-cec0625a-670a-4301-b3c6-2bef1bc86fd3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.413383 Aug 04 16:42:56.498317 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 927/1837] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:42:56.505951 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0633fb5d-c5b4-4cc2-8b7a-135b9b3f0983 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:56.517266 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0633fb5d-c5b4-4cc2-8b7a-135b9b3f0983 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017257 Aug 04 16:42:56.518774 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 928/1838] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Aug 4 16:42:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:42:56.527006 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-151983de-283b-4dab-b438-e0fbf53c5e22 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:56.528273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-151983de-283b-4dab-b438-e0fbf53c5e22 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:56.544254 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-151983de-283b-4dab-b438-e0fbf53c5e22 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:56.544625 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-151983de-283b-4dab-b438-e0fbf53c5e22 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:56.546225 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-151983de-283b-4dab-b438-e0fbf53c5e22 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:56.547120 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-151983de-283b-4dab-b438-e0fbf53c5e22 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:57.664362 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2152c3b3-c40b-436a-ac7a-2eb374c893cc tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23cc8f30e1f94ff0a520a071e5d81728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb25e78b70ee48c99471d78e00e5949c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:57.704670 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2152c3b3-c40b-436a-ac7a-2eb374c893cc tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f" status: 200 len: 1645 microversion: 2.1 time: 1.610053 Aug 04 16:42:57.709506 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 911/1839] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:56 2022] GET /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f => generated 1645 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:57.733462 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-005ccef5-5bc7-4d00-8367-cde390c956ea tempest-FloatingIPDetailsTestJSON-592891366 tempest-FloatingIPDetailsTestJSON-592891366-project] Calling method '.version_select at 0x7f7e84a31160>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:57.885302 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-151983de-283b-4dab-b438-e0fbf53c5e22 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:57.904232 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-151983de-283b-4dab-b438-e0fbf53c5e22 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:57.906241 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-151983de-283b-4dab-b438-e0fbf53c5e22 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:57.908690 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-151983de-283b-4dab-b438-e0fbf53c5e22 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1874 microversion: 2.32 time: 1.388241 Aug 04 16:42:57.935554 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 929/1840] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:42:56 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1874 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:42:57.943553 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-af6add94-2972-4007-b471-7aeeb792cdd8 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:57.950875 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-af6add94-2972-4007-b471-7aeeb792cdd8 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] [instance: b7f869cc-6c2f-4f4c-aa03-b39ed943c47b] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:57.972341 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-af6add94-2972-4007-b471-7aeeb792cdd8 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:57.975015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-af6add94-2972-4007-b471-7aeeb792cdd8 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:57.981902 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-af6add94-2972-4007-b471-7aeeb792cdd8 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:57.982627 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-af6add94-2972-4007-b471-7aeeb792cdd8 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:58.064881 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-af6add94-2972-4007-b471-7aeeb792cdd8 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] [instance: b7f869cc-6c2f-4f4c-aa03-b39ed943c47b] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:42:58.383117 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-af6add94-2972-4007-b471-7aeeb792cdd8 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b" status: 204 len: 0 microversion: 2.1 time: 0.445812 Aug 04 16:42:58.384382 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 930/1841] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:42:57 2022] DELETE /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:42:58.390606 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9c9be196-c091-47e1-b30f-9d05b3faeb0d tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:58.402262 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9c9be196-c091-47e1-b30f-9d05b3faeb0d tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 8ad2a63b-d522-4e78-9246-e6e0d3c554f8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:58.410528 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c9be196-c091-47e1-b30f-9d05b3faeb0d tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:58.422161 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c9be196-c091-47e1-b30f-9d05b3faeb0d tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:58.423346 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c9be196-c091-47e1-b30f-9d05b3faeb0d tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:58.423953 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c9be196-c091-47e1-b30f-9d05b3faeb0d tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:59.191493 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9c9be196-c091-47e1-b30f-9d05b3faeb0d tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:59.205132 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9c9be196-c091-47e1-b30f-9d05b3faeb0d tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad2a63b-d522-4e78-9246-e6e0d3c554f8" status: 200 len: 1314 microversion: 2.1 time: 0.814006 Aug 04 16:42:59.209030 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 931/1842] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:58 2022] GET /compute/v2.1/servers/8ad2a63b-d522-4e78-9246-e6e0d3c554f8 => generated 1314 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:59.220985 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-769d628c-f0b9-4b9c-963d-f88f6735e3a6 req-303e8a67-00fe-462a-a975-490c09e3a69a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaa061be-ec66-48b5-bc5f-f82e3513214f", "name": "network-vif-unplugged", "status": "completed", "tag": "c5f6f976-ffa2-45b4-a0f8-872e3215d5d6"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:59.287443 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-769d628c-f0b9-4b9c-963d-f88f6735e3a6 req-303e8a67-00fe-462a-a975-490c09e3a69a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:59.288657 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-769d628c-f0b9-4b9c-963d-f88f6735e3a6 req-303e8a67-00fe-462a-a975-490c09e3a69a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:59.312963 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-769d628c-f0b9-4b9c-963d-f88f6735e3a6 req-303e8a67-00fe-462a-a975-490c09e3a69a service nova] Creating event network-vif-unplugged:c5f6f976-ffa2-45b4-a0f8-872e3215d5d6 for instance eaa061be-ec66-48b5-bc5f-f82e3513214f on n-h2-846466-12 Aug 04 16:42:59.322561 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-769d628c-f0b9-4b9c-963d-f88f6735e3a6 req-303e8a67-00fe-462a-a975-490c09e3a69a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104627 Aug 04 16:42:59.340987 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 932/1843] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:42:59.359907 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ab7587ad-aced-42ba-bf32-4e8630b997d3 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:59.361273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ab7587ad-aced-42ba-bf32-4e8630b997d3 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] [instance: b7f869cc-6c2f-4f4c-aa03-b39ed943c47b] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:42:59.391692 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab7587ad-aced-42ba-bf32-4e8630b997d3 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:59.392987 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab7587ad-aced-42ba-bf32-4e8630b997d3 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:59.396244 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab7587ad-aced-42ba-bf32-4e8630b997d3 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:59.398223 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab7587ad-aced-42ba-bf32-4e8630b997d3 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:59.850878 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ab7587ad-aced-42ba-bf32-4e8630b997d3 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cd7076f4514ee89b0c4b2a586fe69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547b33a8f5a344f788da917f3512be5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:42:59.887590 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ab7587ad-aced-42ba-bf32-4e8630b997d3 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] 10.222.0.23 "GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b" status: 200 len: 1607 microversion: 2.1 time: 0.542750 Aug 04 16:42:59.893471 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 933/1844] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:59 2022] GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b => generated 1607 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:42:59.902821 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-0bb0cc7a-203e-4954-8219-16eb852ffd80 req-bb56c48a-7d75-489f-a21f-4202e62b0010 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaa061be-ec66-48b5-bc5f-f82e3513214f", "name": "network-vif-deleted", "tag": "c5f6f976-ffa2-45b4-a0f8-872e3215d5d6"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:42:59.944547 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-0bb0cc7a-203e-4954-8219-16eb852ffd80 req-bb56c48a-7d75-489f-a21f-4202e62b0010 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:42:59.945437 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-0bb0cc7a-203e-4954-8219-16eb852ffd80 req-bb56c48a-7d75-489f-a21f-4202e62b0010 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:42:59.984722 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-0bb0cc7a-203e-4954-8219-16eb852ffd80 req-bb56c48a-7d75-489f-a21f-4202e62b0010 service nova] Creating event network-vif-deleted:c5f6f976-ffa2-45b4-a0f8-872e3215d5d6 for instance eaa061be-ec66-48b5-bc5f-f82e3513214f on n-h2-846466-12 Aug 04 16:42:59.987764 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-0bb0cc7a-203e-4954-8219-16eb852ffd80 req-bb56c48a-7d75-489f-a21f-4202e62b0010 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092322 Aug 04 16:42:59.989449 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 934/1845] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:42:59.995360 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-87ebee29-83b8-405f-8953-b0873284f5c1 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:42:59.996066 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-87ebee29-83b8-405f-8953-b0873284f5c1 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: eaa061be-ec66-48b5-bc5f-f82e3513214f] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:00.004161 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-87ebee29-83b8-405f-8953-b0873284f5c1 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:00.004620 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-87ebee29-83b8-405f-8953-b0873284f5c1 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:00.005469 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-87ebee29-83b8-405f-8953-b0873284f5c1 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:00.005898 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-87ebee29-83b8-405f-8953-b0873284f5c1 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:00.025315 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-87ebee29-83b8-405f-8953-b0873284f5c1 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] HTTP exception thrown: Instance eaa061be-ec66-48b5-bc5f-f82e3513214f could not be found. Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-87ebee29-83b8-405f-8953-b0873284f5c1 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Request method failure captured: Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f HTTP/1.1 Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_ZtqC96HabeWwNgyZnNmoMaRGEyMmVaUiLu9hLAQojAZCETOMBNx13l8QKIShQoX65FgHvzAm8VK7NKftXhvS9Bem6sccV9Ryn6Golur8wBQf_N6ajaCoRyYDB8mHggg2hJ4dz1CI18qnEF5I50zAGclpa2ng4xjm4gsGO8OQL5bTg Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: eb25e78b70ee48c99471d78e00e5949c Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb25e78b70ee48c99471d78e00e5949c"}]}] Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: eb25e78b70ee48c99471d78e00e5949c Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-SecurityGroupsTestJSON-886514065-project Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 23cc8f30e1f94ff0a520a071e5d81728 Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-SecurityGroupsTestJSON-886514065-project Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance eaa061be-ec66-48b5-bc5f-f82e3513214f could not be found. Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'eaa061be-ec66-48b5-bc5f-f82e3513214f'} Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaa061be-ec66-48b5-bc5f-f82e3513214f could not be found. Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaa061be-ec66-48b5-bc5f-f82e3513214f could not be found. Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:43:00.027095 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:43:00.031846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:00.031846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:43:00.031846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:43:00.031846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:43:00.031846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:43:00.031846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaa061be-ec66-48b5-bc5f-f82e3513214f could not be found. Aug 04 16:43:00.031846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:43:00.031846 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-87ebee29-83b8-405f-8953-b0873284f5c1 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Returning 404 to user: Instance eaa061be-ec66-48b5-bc5f-f82e3513214f could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:43:00.031846 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-87ebee29-83b8-405f-8953-b0873284f5c1 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f" status: 404 len: 111 microversion: 2.1 time: 0.037630 Aug 04 16:43:00.031846 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 935/1846] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:42:59 2022] GET /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:43:00.035913 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7d4d15e6-944a-439c-bdae-0dc53bda1b12 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:00.036767 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7d4d15e6-944a-439c-bdae-0dc53bda1b12 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:00.052451 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d4d15e6-944a-439c-bdae-0dc53bda1b12 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:00.053197 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d4d15e6-944a-439c-bdae-0dc53bda1b12 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:00.054619 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d4d15e6-944a-439c-bdae-0dc53bda1b12 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:00.055566 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d4d15e6-944a-439c-bdae-0dc53bda1b12 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:01.292260 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7d4d15e6-944a-439c-bdae-0dc53bda1b12 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:01.310074 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7d4d15e6-944a-439c-bdae-0dc53bda1b12 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:01.315488 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7d4d15e6-944a-439c-bdae-0dc53bda1b12 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:01.318005 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7d4d15e6-944a-439c-bdae-0dc53bda1b12 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 2827 microversion: 2.32 time: 1.286851 Aug 04 16:43:01.337831 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 936/1847] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:43:00 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 2827 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:43:01.344887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f2703696-550d-4b36-946e-65f98edfe470 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '.version_select at 0x7f7e77cc1280>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:02.414443 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f2703696-550d-4b36-946e-65f98edfe470 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/7137ef3c-fd39-40f7-8bfd-2f4381d1fd67" status: 202 len: 0 microversion: 2.1 time: 1.075127 Aug 04 16:43:02.416380 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 937/1848] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:43:01 2022] DELETE /compute/v2.1/os-security-groups/7137ef3c-fd39-40f7-8bfd-2f4381d1fd67 => generated 0 bytes in 1078 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:43:02.422277 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0dc6e56b-cd4b-426d-a807-65d998edf227 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:02.423199 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0dc6e56b-cd4b-426d-a807-65d998edf227 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 8ad2a63b-d522-4e78-9246-e6e0d3c554f8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:02.449376 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0dc6e56b-cd4b-426d-a807-65d998edf227 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:02.453082 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0dc6e56b-cd4b-426d-a807-65d998edf227 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:02.456362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0dc6e56b-cd4b-426d-a807-65d998edf227 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:02.458225 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0dc6e56b-cd4b-426d-a807-65d998edf227 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:02.649110 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-005ccef5-5bc7-4d00-8367-cde390c956ea tempest-FloatingIPDetailsTestJSON-592891366 tempest-FloatingIPDetailsTestJSON-592891366-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/fd5de321-d8a9-493d-998f-e7e502f63bbc" status: 202 len: 0 microversion: 2.1 time: 4.936828 Aug 04 16:43:02.650261 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 912/1849] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Aug 4 16:42:57 2022] DELETE /compute/v2.1/os-floating-ips/fd5de321-d8a9-493d-998f-e7e502f63bbc => generated 0 bytes in 4940 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:43:02.658920 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-af7c18c5-f455-4662-8148-7b4bcf9b7498 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:02.665160 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-af7c18c5-f455-4662-8148-7b4bcf9b7498 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] [instance: b7f869cc-6c2f-4f4c-aa03-b39ed943c47b] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:02.703546 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-af7c18c5-f455-4662-8148-7b4bcf9b7498 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:02.704301 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-af7c18c5-f455-4662-8148-7b4bcf9b7498 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:02.705566 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-af7c18c5-f455-4662-8148-7b4bcf9b7498 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:02.706178 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-af7c18c5-f455-4662-8148-7b4bcf9b7498 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:02.802513 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=4 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:43:03.224083 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:43:03.872524 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0dc6e56b-cd4b-426d-a807-65d998edf227 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:03.874895 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-af7c18c5-f455-4662-8148-7b4bcf9b7498 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cd7076f4514ee89b0c4b2a586fe69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547b33a8f5a344f788da917f3512be5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:03.887947 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-af7c18c5-f455-4662-8148-7b4bcf9b7498 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] 10.222.0.23 "GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b" status: 200 len: 1607 microversion: 2.1 time: 1.232397 Aug 04 16:43:03.889271 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 913/1850] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:02 2022] GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b => generated 1607 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:03.897677 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-27f37e6b-9156-40f2-8f66-83eb1122f304 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:03.900162 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0dc6e56b-cd4b-426d-a807-65d998edf227 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad2a63b-d522-4e78-9246-e6e0d3c554f8" status: 200 len: 1314 microversion: 2.1 time: 1.481934 Aug 04 16:43:03.904576 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-27f37e6b-9156-40f2-8f66-83eb1122f304 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:03.906897 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 938/1851] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:02 2022] GET /compute/v2.1/servers/8ad2a63b-d522-4e78-9246-e6e0d3c554f8 => generated 1314 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:03.917090 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-27f37e6b-9156-40f2-8f66-83eb1122f304 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:03.917876 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-27f37e6b-9156-40f2-8f66-83eb1122f304 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:03.918904 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-27f37e6b-9156-40f2-8f66-83eb1122f304 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:03.919849 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-27f37e6b-9156-40f2-8f66-83eb1122f304 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:03.923470 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-f26d01de-3d17-460a-bca2-53ba7e900f29 req-0cc810ae-aefd-4a7b-9ee2-ec7ddfe9365d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ad2a63b-d522-4e78-9246-e6e0d3c554f8", "name": "network-vif-plugged", "status": "completed", "tag": "61cddda4-3f06-46e6-a9ae-52b5d6f90428"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:43:03.945955 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-f26d01de-3d17-460a-bca2-53ba7e900f29 req-0cc810ae-aefd-4a7b-9ee2-ec7ddfe9365d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:03.946697 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-f26d01de-3d17-460a-bca2-53ba7e900f29 req-0cc810ae-aefd-4a7b-9ee2-ec7ddfe9365d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:03.963825 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-f26d01de-3d17-460a-bca2-53ba7e900f29 req-0cc810ae-aefd-4a7b-9ee2-ec7ddfe9365d service nova] Creating event network-vif-plugged:61cddda4-3f06-46e6-a9ae-52b5d6f90428 for instance 8ad2a63b-d522-4e78-9246-e6e0d3c554f8 on n-h1-846466-12 Aug 04 16:43:03.979469 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-f26d01de-3d17-460a-bca2-53ba7e900f29 req-0cc810ae-aefd-4a7b-9ee2-ec7ddfe9365d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070417 Aug 04 16:43:03.980388 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 939/1852] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:43:03.989097 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e9938c67-0b8e-49ac-b19a-8e06b8a5c4c5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:03.990204 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e9938c67-0b8e-49ac-b19a-8e06b8a5c4c5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:03.998304 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e9938c67-0b8e-49ac-b19a-8e06b8a5c4c5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:03.999050 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e9938c67-0b8e-49ac-b19a-8e06b8a5c4c5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:04.000102 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e9938c67-0b8e-49ac-b19a-8e06b8a5c4c5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:04.000733 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e9938c67-0b8e-49ac-b19a-8e06b8a5c4c5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:04.125397 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-27f37e6b-9156-40f2-8f66-83eb1122f304 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.234649 Aug 04 16:43:04.126571 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 914/1853] 10.222.0.23 () {60 vars in 1316 bytes} [Thu Aug 4 16:43:03 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e/os-interface => generated 1832 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:43:04.143230 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-aeab5476-67a5-48c6-9141-15776b05d369 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '.version_select at 0x7f7e84ba55e0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:04.451610 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e9938c67-0b8e-49ac-b19a-8e06b8a5c4c5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:04.466895 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e9938c67-0b8e-49ac-b19a-8e06b8a5c4c5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.484825 Aug 04 16:43:04.471679 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 940/1854] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:03 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:04.477654 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c7204d10-bf4f-4ed0-ab6c-ef844d6e79d6 tempest-FloatingIPDetailsTestJSON-592891366 tempest-FloatingIPDetailsTestJSON-592891366-project] Calling method '.version_select at 0x7f7e77cae940>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:04.874395 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-aeab5476-67a5-48c6-9141-15776b05d369 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/4510d3d4-1130-4925-a92a-866677ad2232" status: 202 len: 0 microversion: 2.1 time: 0.735859 Aug 04 16:43:04.875243 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 915/1855] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:43:04 2022] DELETE /compute/v2.1/os-security-groups/4510d3d4-1130-4925-a92a-866677ad2232 => generated 0 bytes in 738 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:43:04.889265 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-33c2c6bf-7147-405b-a59b-d17beba349d1 req-e03078d6-c2a3-4b83-89bb-788f7993cc6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7f869cc-6c2f-4f4c-aa03-b39ed943c47b", "name": "network-vif-deleted", "tag": "6eab9e47-2e8f-463d-8fd3-42f3c27b7f18"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:43:04.903121 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:43:04.928568 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-33c2c6bf-7147-405b-a59b-d17beba349d1 req-e03078d6-c2a3-4b83-89bb-788f7993cc6d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:04.932720 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-33c2c6bf-7147-405b-a59b-d17beba349d1 req-e03078d6-c2a3-4b83-89bb-788f7993cc6d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:04.973847 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-33c2c6bf-7147-405b-a59b-d17beba349d1 req-e03078d6-c2a3-4b83-89bb-788f7993cc6d service nova] Creating event network-vif-deleted:6eab9e47-2e8f-463d-8fd3-42f3c27b7f18 for instance b7f869cc-6c2f-4f4c-aa03-b39ed943c47b on n-h1-846466-12 Aug 04 16:43:04.986771 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-33c2c6bf-7147-405b-a59b-d17beba349d1 req-e03078d6-c2a3-4b83-89bb-788f7993cc6d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107130 Aug 04 16:43:04.990524 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 916/1856] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:43:05.001242 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4d827881-0235-45f0-b929-32f9719e6bc7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1733198967"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:43:05.008431 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4d827881-0235-45f0-b929-32f9719e6bc7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:05.028809 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4d827881-0235-45f0-b929-32f9719e6bc7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:05.034978 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4d827881-0235-45f0-b929-32f9719e6bc7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:05.036190 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4d827881-0235-45f0-b929-32f9719e6bc7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:05.037406 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4d827881-0235-45f0-b929-32f9719e6bc7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:05.470223 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4d827881-0235-45f0-b929-32f9719e6bc7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action" status: 202 len: 0 microversion: 2.1 time: 0.477495 Aug 04 16:43:05.471270 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 917/1857] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:43:04 2022] POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action => generated 0 bytes in 480 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 04 16:43:05.486824 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-eab22fa4-2e9c-4e8b-a3b5-eb9d0280d279 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Action: 'create', calling method: .version_select at 0x7f7e84ba5310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1889693343", "description": "tempest-description-1551493424"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:43:06.611203 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c7204d10-bf4f-4ed0-ab6c-ef844d6e79d6 tempest-FloatingIPDetailsTestJSON-592891366 tempest-FloatingIPDetailsTestJSON-592891366-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/de337aed-16e7-4d16-83a5-4b5a91e84421" status: 202 len: 0 microversion: 2.1 time: 2.137767 Aug 04 16:43:06.612037 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 941/1858] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Aug 4 16:43:04 2022] DELETE /compute/v2.1/os-floating-ips/de337aed-16e7-4d16-83a5-4b5a91e84421 => generated 0 bytes in 2140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:43:06.621861 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5b8b58a3-f696-4014-bca9-a55a90b016c4 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:06.622737 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5b8b58a3-f696-4014-bca9-a55a90b016c4 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] [instance: b7f869cc-6c2f-4f4c-aa03-b39ed943c47b] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:06.643303 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5b8b58a3-f696-4014-bca9-a55a90b016c4 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:06.646421 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5b8b58a3-f696-4014-bca9-a55a90b016c4 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:06.648409 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-eab22fa4-2e9c-4e8b-a3b5-eb9d0280d279 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.165938 Aug 04 16:43:06.649091 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 918/1859] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Aug 4 16:43:05 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:43:06.652800 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5b8b58a3-f696-4014-bca9-a55a90b016c4 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:06.653912 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5b8b58a3-f696-4014-bca9-a55a90b016c4 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:06.655653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-caeeb56c-731f-4079-811c-8e642139fa03 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:06.656959 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-caeeb56c-731f-4079-811c-8e642139fa03 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 8ad2a63b-d522-4e78-9246-e6e0d3c554f8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:06.673249 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-caeeb56c-731f-4079-811c-8e642139fa03 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:06.674538 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-caeeb56c-731f-4079-811c-8e642139fa03 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:06.680349 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-caeeb56c-731f-4079-811c-8e642139fa03 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:06.681888 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-caeeb56c-731f-4079-811c-8e642139fa03 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:06.821861 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5b8b58a3-f696-4014-bca9-a55a90b016c4 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cd7076f4514ee89b0c4b2a586fe69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547b33a8f5a344f788da917f3512be5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:06.857707 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5b8b58a3-f696-4014-bca9-a55a90b016c4 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] 10.222.0.23 "GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b" status: 200 len: 1252 microversion: 2.1 time: 0.240354 Aug 04 16:43:06.858524 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 942/1860] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:06 2022] GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b => generated 1252 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:06.883191 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-03fd29c8-06cb-41cf-ad4d-ef07171a0dcf req-0ad48d63-2c46-43c6-b8c8-b7707888d00f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7f869cc-6c2f-4f4c-aa03-b39ed943c47b", "name": "network-vif-unplugged", "status": "completed", "tag": "6eab9e47-2e8f-463d-8fd3-42f3c27b7f18"}, {"server_uuid": "0c62ae02-0f30-43e1-a005-89dcb8122d4e", "name": "network-vif-unplugged", "status": "completed", "tag": "93c46fa1-3978-4529-9c01-36e6a216c294"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:43:06.934947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-03fd29c8-06cb-41cf-ad4d-ef07171a0dcf req-0ad48d63-2c46-43c6-b8c8-b7707888d00f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:06.936176 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-03fd29c8-06cb-41cf-ad4d-ef07171a0dcf req-0ad48d63-2c46-43c6-b8c8-b7707888d00f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:06.985757 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-03fd29c8-06cb-41cf-ad4d-ef07171a0dcf req-0ad48d63-2c46-43c6-b8c8-b7707888d00f service nova] Creating event network-vif-unplugged:6eab9e47-2e8f-463d-8fd3-42f3c27b7f18 for instance b7f869cc-6c2f-4f4c-aa03-b39ed943c47b on n-h1-846466-12 Aug 04 16:43:06.987214 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-03fd29c8-06cb-41cf-ad4d-ef07171a0dcf req-0ad48d63-2c46-43c6-b8c8-b7707888d00f service nova] Creating event network-vif-unplugged:93c46fa1-3978-4529-9c01-36e6a216c294 for instance 0c62ae02-0f30-43e1-a005-89dcb8122d4e on n-h1-846466-12 Aug 04 16:43:07.004426 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-03fd29c8-06cb-41cf-ad4d-ef07171a0dcf req-0ad48d63-2c46-43c6-b8c8-b7707888d00f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.137924 Aug 04 16:43:07.014190 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 943/1861] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:43:07.027517 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f8a8cb41-b4fb-4e4d-8124-27c4629ac3a2 tempest-FloatingIPDetailsTestJSON-592891366 tempest-FloatingIPDetailsTestJSON-592891366-project] Calling method '.version_select at 0x7f7e77cab820>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:07.043842 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-caeeb56c-731f-4079-811c-8e642139fa03 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:07.069233 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-caeeb56c-731f-4079-811c-8e642139fa03 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad2a63b-d522-4e78-9246-e6e0d3c554f8" status: 200 len: 1464 microversion: 2.1 time: 0.417942 Aug 04 16:43:07.070687 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 919/1862] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:06 2022] GET /compute/v2.1/servers/8ad2a63b-d522-4e78-9246-e6e0d3c554f8 => generated 1464 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:07.094015 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2ad030bb-c07d-4e55-9cd3-a7cd6f4cd606 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Action: 'update', calling method: .version_select at 0x7f7e84897280>, body: {"security_group": {"name": "tempest-sg-hth-636877136", "description": "tempest-description-hth-365654918"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:43:07.955346 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2ad030bb-c07d-4e55-9cd3-a7cd6f4cd606 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "PUT /compute/v2.1/os-security-groups/52fcc6d7-fbe7-4a48-b8d9-81259a5fa7be" status: 200 len: 216 microversion: 2.1 time: 0.871861 Aug 04 16:43:07.956359 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 920/1863] 10.222.0.23 () {60 vars in 1290 bytes} [Thu Aug 4 16:43:07 2022] PUT /compute/v2.1/os-security-groups/52fcc6d7-fbe7-4a48-b8d9-81259a5fa7be => generated 216 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:43:08.222800 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-92ebbc9b-d894-4927-b8c7-de7de9e67d3d tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:08.233437 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-92ebbc9b-d894-4927-b8c7-de7de9e67d3d tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Searching by: {'deleted': False, 'project_id': 'd7505c2c3b5f43e9bee9778a86e05237'} {{(pid=126126) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:43:08.247034 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-92ebbc9b-d894-4927-b8c7-de7de9e67d3d tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:08.248097 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-92ebbc9b-d894-4927-b8c7-de7de9e67d3d tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:08.252069 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-92ebbc9b-d894-4927-b8c7-de7de9e67d3d tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:08.252676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-92ebbc9b-d894-4927-b8c7-de7de9e67d3d tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:08.302017 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-92ebbc9b-d894-4927-b8c7-de7de9e67d3d tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.339735 Aug 04 16:43:08.304058 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 921/1864] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:43:07 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:43:08.313894 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fc185729-9a1c-4b13-b724-8c86ce248128 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:08.315099 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fc185729-9a1c-4b13-b724-8c86ce248128 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] [instance: b7f869cc-6c2f-4f4c-aa03-b39ed943c47b] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:08.327439 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fc185729-9a1c-4b13-b724-8c86ce248128 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:08.329106 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fc185729-9a1c-4b13-b724-8c86ce248128 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:08.330666 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fc185729-9a1c-4b13-b724-8c86ce248128 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:08.331638 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fc185729-9a1c-4b13-b724-8c86ce248128 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:08.450526 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fc185729-9a1c-4b13-b724-8c86ce248128 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cd7076f4514ee89b0c4b2a586fe69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547b33a8f5a344f788da917f3512be5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:08.462866 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fc185729-9a1c-4b13-b724-8c86ce248128 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] 10.222.0.23 "GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b" status: 200 len: 1252 microversion: 2.1 time: 0.157276 Aug 04 16:43:08.465373 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 922/1865] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:08 2022] GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b => generated 1252 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:08.473212 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a7dd1f19-8fcb-40e2-94d8-a120285cf703 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '.version_select at 0x7f7e8498a430>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:08.569330 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a7dd1f19-8fcb-40e2-94d8-a120285cf703 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/52fcc6d7-fbe7-4a48-b8d9-81259a5fa7be" status: 200 len: 216 microversion: 2.1 time: 0.102422 Aug 04 16:43:08.571744 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 923/1866] 10.222.0.23 () {58 vars in 1269 bytes} [Thu Aug 4 16:43:08 2022] GET /compute/v2.1/os-security-groups/52fcc6d7-fbe7-4a48-b8d9-81259a5fa7be => generated 216 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:43:08.579496 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-37930dcd-31d3-4c71-ada4-cb273d7a66b4 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:08.597925 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-37930dcd-31d3-4c71-ada4-cb273d7a66b4 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Searching by: {'deleted': False} {{(pid=126126) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:43:08.607936 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-37930dcd-31d3-4c71-ada4-cb273d7a66b4 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:08.608756 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-37930dcd-31d3-4c71-ada4-cb273d7a66b4 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:08.610841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-37930dcd-31d3-4c71-ada4-cb273d7a66b4 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:08.612747 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-37930dcd-31d3-4c71-ada4-cb273d7a66b4 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:08.784092 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f8a8cb41-b4fb-4e4d-8124-27c4629ac3a2 tempest-FloatingIPDetailsTestJSON-592891366 tempest-FloatingIPDetailsTestJSON-592891366-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/ee889eda-7f3e-4db8-90c3-59957a87ae7f" status: 202 len: 0 microversion: 2.1 time: 1.767586 Aug 04 16:43:08.786087 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 944/1867] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Aug 4 16:43:07 2022] DELETE /compute/v2.1/os-floating-ips/ee889eda-7f3e-4db8-90c3-59957a87ae7f => generated 0 bytes in 1771 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:43:08.791925 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e98727eb-5bb4-4573-96bd-066b98de60f4 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '.version_select at 0x7f7e77cae550>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:08.807077 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.multi_cell_list [None req-37930dcd-31d3-4c71-ada4-cb273d7a66b4 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=126126) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:43:08.959091 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-37930dcd-31d3-4c71-ada4-cb273d7a66b4 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:08.960290 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-37930dcd-31d3-4c71-ada4-cb273d7a66b4 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:11.313109 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-37930dcd-31d3-4c71-ada4-cb273d7a66b4 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 12666 microversion: 2.1 time: 2.739066 Aug 04 16:43:11.314092 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 924/1868] 10.222.0.23 () {58 vars in 1171 bytes} [Thu Aug 4 16:43:08 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 12666 bytes in 2742 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:43:11.339593 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-97c4e333-0db2-4998-8dd5-ac146037261d req-a7a61eed-a718-4518-a839-29ef41694856 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09e1b482-0372-4270-ac25-6d3349aca31e", "tag": "80b3b8c3-3818-4e0b-9096-8ce22a3ec0f3"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:43:11.409479 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-97c4e333-0db2-4998-8dd5-ac146037261d req-a7a61eed-a718-4518-a839-29ef41694856 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:11.415683 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-97c4e333-0db2-4998-8dd5-ac146037261d req-a7a61eed-a718-4518-a839-29ef41694856 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:11.475657 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-97c4e333-0db2-4998-8dd5-ac146037261d req-a7a61eed-a718-4518-a839-29ef41694856 service nova] Creating event network-changed:80b3b8c3-3818-4e0b-9096-8ce22a3ec0f3 for instance 09e1b482-0372-4270-ac25-6d3349aca31e on n-h2-846466-12 Aug 04 16:43:11.492310 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-97c4e333-0db2-4998-8dd5-ac146037261d req-a7a61eed-a718-4518-a839-29ef41694856 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174944 Aug 04 16:43:11.495846 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 925/1869] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:43:11.510879 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6e29b4d4-e4c2-43eb-9e4b-db339ed0a7dc tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:11.515712 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6e29b4d4-e4c2-43eb-9e4b-db339ed0a7dc tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] [instance: b7f869cc-6c2f-4f4c-aa03-b39ed943c47b] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:11.539842 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e29b4d4-e4c2-43eb-9e4b-db339ed0a7dc tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:11.540520 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e29b4d4-e4c2-43eb-9e4b-db339ed0a7dc tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:11.547243 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e29b4d4-e4c2-43eb-9e4b-db339ed0a7dc tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:11.547783 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e29b4d4-e4c2-43eb-9e4b-db339ed0a7dc tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:12.636076 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e98727eb-5bb4-4573-96bd-066b98de60f4 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/52fcc6d7-fbe7-4a48-b8d9-81259a5fa7be" status: 202 len: 0 microversion: 2.1 time: 3.848351 Aug 04 16:43:12.640493 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 945/1870] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:43:08 2022] DELETE /compute/v2.1/os-security-groups/52fcc6d7-fbe7-4a48-b8d9-81259a5fa7be => generated 0 bytes in 3853 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:43:12.645649 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cc5ee769-e17b-4e64-8dc4-c45368733c7d tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:12.651053 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cc5ee769-e17b-4e64-8dc4-c45368733c7d tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Searching by: {'deleted': False, 'project_id': 'd7505c2c3b5f43e9bee9778a86e05237'} {{(pid=126125) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:43:12.692074 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cc5ee769-e17b-4e64-8dc4-c45368733c7d tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:12.699051 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cc5ee769-e17b-4e64-8dc4-c45368733c7d tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:12.699976 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cc5ee769-e17b-4e64-8dc4-c45368733c7d tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:12.700417 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cc5ee769-e17b-4e64-8dc4-c45368733c7d tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:12.716910 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6e29b4d4-e4c2-43eb-9e4b-db339ed0a7dc tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cd7076f4514ee89b0c4b2a586fe69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547b33a8f5a344f788da917f3512be5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:12.730356 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6e29b4d4-e4c2-43eb-9e4b-db339ed0a7dc tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] 10.222.0.23 "GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b" status: 200 len: 1252 microversion: 2.1 time: 1.230293 Aug 04 16:43:12.743375 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 926/1871] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:11 2022] GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b => generated 1252 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:12.766011 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-16696351-cabb-47e9-b7f9-9167675a3693 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:12.770121 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-16696351-cabb-47e9-b7f9-9167675a3693 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: eaa061be-ec66-48b5-bc5f-f82e3513214f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:12.798907 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-16696351-cabb-47e9-b7f9-9167675a3693 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:12.801966 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-16696351-cabb-47e9-b7f9-9167675a3693 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:12.810392 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-16696351-cabb-47e9-b7f9-9167675a3693 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:12.811307 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-16696351-cabb-47e9-b7f9-9167675a3693 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:12.824729 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:43:12.846217 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cc5ee769-e17b-4e64-8dc4-c45368733c7d tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?tenant_id=c1c1660ad79d489392261a78b5677be5" status: 200 len: 15 microversion: 2.1 time: 0.204065 Aug 04 16:43:12.855533 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 946/1872] 10.222.0.23 () {58 vars in 1231 bytes} [Thu Aug 4 16:43:12 2022] GET /compute/v2.1/servers/detail?tenant_id=c1c1660ad79d489392261a78b5677be5 => generated 15 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:43:12.879573 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7f767160-94d1-4e81-af3a-ae440d56efaf tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:12.926832 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7f767160-94d1-4e81-af3a-ae440d56efaf tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Searching by: {'tenant_id': 'c1c1660ad79d489392261a78b5677be5', 'deleted': False} {{(pid=126125) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:43:12.947633 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-16696351-cabb-47e9-b7f9-9167675a3693 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] HTTP exception thrown: Instance eaa061be-ec66-48b5-bc5f-f82e3513214f could not be found. Aug 04 16:43:12.959898 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7f767160-94d1-4e81-af3a-ae440d56efaf tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:12.963234 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7f767160-94d1-4e81-af3a-ae440d56efaf tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-16696351-cabb-47e9-b7f9-9167675a3693 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Request method failure captured: Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f HTTP/1.1 Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_ZtqC96HabeWwNgyZnNmoMaRGEyMmVaUiLu9hLAQojAZCETOMBNx13l8QKIShQoX65FgHvzAm8VK7NKftXhvS9Bem6sccV9Ryn6Golur8wBQf_N6ajaCoRyYDB8mHggg2hJ4dz1CI18qnEF5I50zAGclpa2ng4xjm4gsGO8OQL5bTg Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: eb25e78b70ee48c99471d78e00e5949c Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb25e78b70ee48c99471d78e00e5949c"}]}] Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: eb25e78b70ee48c99471d78e00e5949c Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-SecurityGroupsTestJSON-886514065-project Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 23cc8f30e1f94ff0a520a071e5d81728 Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-SecurityGroupsTestJSON-886514065-project Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance eaa061be-ec66-48b5-bc5f-f82e3513214f could not be found. Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'eaa061be-ec66-48b5-bc5f-f82e3513214f'} Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaa061be-ec66-48b5-bc5f-f82e3513214f could not be found. Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:43:12.963615 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:43:12.969067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaa061be-ec66-48b5-bc5f-f82e3513214f could not be found. Aug 04 16:43:12.969067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:12.969067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:43:12.969067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:12.969067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:12.969067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:43:12.969067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:43:12.969067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:43:12.969067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:43:12.969067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaa061be-ec66-48b5-bc5f-f82e3513214f could not be found. Aug 04 16:43:12.969067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:12.969067 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-16696351-cabb-47e9-b7f9-9167675a3693 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Returning 404 to user: Instance eaa061be-ec66-48b5-bc5f-f82e3513214f could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:43:12.973345 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7f767160-94d1-4e81-af3a-ae440d56efaf tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:12.973345 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7f767160-94d1-4e81-af3a-ae440d56efaf tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:13.002231 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-16696351-cabb-47e9-b7f9-9167675a3693 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "DELETE /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f" status: 404 len: 111 microversion: 2.1 time: 0.224805 Aug 04 16:43:13.006077 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 927/1873] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:43:12 2022] DELETE /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f => generated 111 bytes in 259 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:43:13.018817 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.multi_cell_list [None req-7f767160-94d1-4e81-af3a-ae440d56efaf tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:43:13.028834 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4b844e85-8b22-487b-94dd-9c5fd1f8f6ff tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:13.036481 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4b844e85-8b22-487b-94dd-9c5fd1f8f6ff tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: eaa061be-ec66-48b5-bc5f-f82e3513214f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:13.068667 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b844e85-8b22-487b-94dd-9c5fd1f8f6ff tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:13.074161 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b844e85-8b22-487b-94dd-9c5fd1f8f6ff tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:13.075568 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b844e85-8b22-487b-94dd-9c5fd1f8f6ff tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:13.076035 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b844e85-8b22-487b-94dd-9c5fd1f8f6ff tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:13.081532 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7f767160-94d1-4e81-af3a-ae440d56efaf tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:13.082603 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7f767160-94d1-4e81-af3a-ae440d56efaf tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:13.132265 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-4b844e85-8b22-487b-94dd-9c5fd1f8f6ff tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] HTTP exception thrown: Instance eaa061be-ec66-48b5-bc5f-f82e3513214f could not be found. Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4b844e85-8b22-487b-94dd-9c5fd1f8f6ff tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Request method failure captured: Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f HTTP/1.1 Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_ZtqC96HabeWwNgyZnNmoMaRGEyMmVaUiLu9hLAQojAZCETOMBNx13l8QKIShQoX65FgHvzAm8VK7NKftXhvS9Bem6sccV9Ryn6Golur8wBQf_N6ajaCoRyYDB8mHggg2hJ4dz1CI18qnEF5I50zAGclpa2ng4xjm4gsGO8OQL5bTg Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: eb25e78b70ee48c99471d78e00e5949c Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb25e78b70ee48c99471d78e00e5949c"}]}] Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: eb25e78b70ee48c99471d78e00e5949c Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-SecurityGroupsTestJSON-886514065-project Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 23cc8f30e1f94ff0a520a071e5d81728 Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-SecurityGroupsTestJSON-886514065-project Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance eaa061be-ec66-48b5-bc5f-f82e3513214f could not be found. Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'eaa061be-ec66-48b5-bc5f-f82e3513214f'} Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaa061be-ec66-48b5-bc5f-f82e3513214f could not be found. Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaa061be-ec66-48b5-bc5f-f82e3513214f could not be found. Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:43:13.150591 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:13.204021 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:13.204021 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:43:13.204021 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:43:13.204021 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:43:13.204021 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:43:13.204021 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaa061be-ec66-48b5-bc5f-f82e3513214f could not be found. Aug 04 16:43:13.204021 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:13.204021 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4b844e85-8b22-487b-94dd-9c5fd1f8f6ff tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Returning 404 to user: Instance eaa061be-ec66-48b5-bc5f-f82e3513214f could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:43:13.204021 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4b844e85-8b22-487b-94dd-9c5fd1f8f6ff tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f" status: 404 len: 111 microversion: 2.1 time: 0.140621 Aug 04 16:43:13.204021 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 928/1874] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:13 2022] GET /compute/v2.1/servers/eaa061be-ec66-48b5-bc5f-f82e3513214f => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:43:13.204021 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4b1311cf-5c3d-4ecd-a2d0-582f1133ec8b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '.version_select at 0x7f7e89c8baf0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:13.316674 n-d-846466-12 devstack@n-api.service[126126]: DEBUG neutronclient.v2_0.client [None req-4b1311cf-5c3d-4ecd-a2d0-582f1133ec8b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4510d3d4-1130-4925-a92a-866677ad2232 does not exist", "detail": ""}} {{(pid=126126) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:43:13.317313 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.security_group_api [None req-4b1311cf-5c3d-4ecd-a2d0-582f1133ec8b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Neutron security group 4510d3d4-1130-4925-a92a-866677ad2232 not found {{(pid=126126) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 16:43:13.317845 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-4b1311cf-5c3d-4ecd-a2d0-582f1133ec8b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] HTTP exception thrown: Security group 4510d3d4-1130-4925-a92a-866677ad2232 does not exist Aug 04 16:43:13.317845 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-d82abca2-5d61-4376-867d-989423f72dec'] Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4b1311cf-5c3d-4ecd-a2d0-582f1133ec8b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Request method failure captured: Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/os-security-groups/4510d3d4-1130-4925-a92a-866677ad2232 HTTP/1.1 Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_ZtqC96HabeWwNgyZnNmoMaRGEyMmVaUiLu9hLAQojAZCETOMBNx13l8QKIShQoX65FgHvzAm8VK7NKftXhvS9Bem6sccV9Ryn6Golur8wBQf_N6ajaCoRyYDB8mHggg2hJ4dz1CI18qnEF5I50zAGclpa2ng4xjm4gsGO8OQL5bTg Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: eb25e78b70ee48c99471d78e00e5949c Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb25e78b70ee48c99471d78e00e5949c"}]}] Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: eb25e78b70ee48c99471d78e00e5949c Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-SecurityGroupsTestJSON-886514065-project Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 23cc8f30e1f94ff0a520a071e5d81728 Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-SecurityGroupsTestJSON-886514065-project Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: exception: Security group 4510d3d4-1130-4925-a92a-866677ad2232 does not exist Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-d82abca2-5d61-4376-867d-989423f72dec'] Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '4510d3d4-1130-4925-a92a-866677ad2232'} Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:43:13.319768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4510d3d4-1130-4925-a92a-866677ad2232 does not exist Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d82abca2-5d61-4376-867d-989423f72dec'] Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4510d3d4-1130-4925-a92a-866677ad2232 does not exist Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d82abca2-5d61-4376-867d-989423f72dec'] Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4510d3d4-1130-4925-a92a-866677ad2232 does not exist Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d82abca2-5d61-4376-867d-989423f72dec'] Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4510d3d4-1130-4925-a92a-866677ad2232 does not exist Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d82abca2-5d61-4376-867d-989423f72dec'] Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4b1311cf-5c3d-4ecd-a2d0-582f1133ec8b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Returning 404 to user: Security group 4510d3d4-1130-4925-a92a-866677ad2232 does not exist Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-d82abca2-5d61-4376-867d-989423f72dec'] {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:43:13.322561 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4b1311cf-5c3d-4ecd-a2d0-582f1133ec8b tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/4510d3d4-1130-4925-a92a-866677ad2232" status: 404 len: 194 microversion: 2.1 time: 0.154638 Aug 04 16:43:13.327066 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 929/1875] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:43:13 2022] DELETE /compute/v2.1/os-security-groups/4510d3d4-1130-4925-a92a-866677ad2232 => generated 194 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:43:13.334561 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b124c0b5-b7ed-458d-b84e-6ce1d1ba3b27 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '.version_select at 0x7f7e84841f70>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:13.417710 n-d-846466-12 devstack@n-api.service[126126]: DEBUG neutronclient.v2_0.client [None req-b124c0b5-b7ed-458d-b84e-6ce1d1ba3b27 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7137ef3c-fd39-40f7-8bfd-2f4381d1fd67 does not exist", "detail": ""}} {{(pid=126126) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:43:13.418502 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.security_group_api [None req-b124c0b5-b7ed-458d-b84e-6ce1d1ba3b27 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Neutron security group 7137ef3c-fd39-40f7-8bfd-2f4381d1fd67 not found {{(pid=126126) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 16:43:13.419194 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-b124c0b5-b7ed-458d-b84e-6ce1d1ba3b27 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] HTTP exception thrown: Security group 7137ef3c-fd39-40f7-8bfd-2f4381d1fd67 does not exist Aug 04 16:43:13.419194 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-82a40163-88eb-41eb-b105-6b58473a1157'] Aug 04 16:43:13.421316 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7f767160-94d1-4e81-af3a-ae440d56efaf tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c1c1660ad79d489392261a78b5677be5" status: 200 len: 4833 microversion: 2.1 time: 0.558410 Aug 04 16:43:13.437314 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 947/1876] 10.222.0.23 () {58 vars in 1257 bytes} [Thu Aug 4 16:43:12 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c1c1660ad79d489392261a78b5677be5 => generated 4833 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b124c0b5-b7ed-458d-b84e-6ce1d1ba3b27 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Request method failure captured: Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/os-security-groups/7137ef3c-fd39-40f7-8bfd-2f4381d1fd67 HTTP/1.1 Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_ZtqC96HabeWwNgyZnNmoMaRGEyMmVaUiLu9hLAQojAZCETOMBNx13l8QKIShQoX65FgHvzAm8VK7NKftXhvS9Bem6sccV9Ryn6Golur8wBQf_N6ajaCoRyYDB8mHggg2hJ4dz1CI18qnEF5I50zAGclpa2ng4xjm4gsGO8OQL5bTg Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: eb25e78b70ee48c99471d78e00e5949c Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb25e78b70ee48c99471d78e00e5949c"}]}] Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: eb25e78b70ee48c99471d78e00e5949c Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-SecurityGroupsTestJSON-886514065-project Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 23cc8f30e1f94ff0a520a071e5d81728 Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-SecurityGroupsTestJSON-886514065-project Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: exception: Security group 7137ef3c-fd39-40f7-8bfd-2f4381d1fd67 does not exist Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-82a40163-88eb-41eb-b105-6b58473a1157'] Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '7137ef3c-fd39-40f7-8bfd-2f4381d1fd67'} Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:43:13.450285 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7137ef3c-fd39-40f7-8bfd-2f4381d1fd67 does not exist Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82a40163-88eb-41eb-b105-6b58473a1157'] Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7137ef3c-fd39-40f7-8bfd-2f4381d1fd67 does not exist Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82a40163-88eb-41eb-b105-6b58473a1157'] Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7137ef3c-fd39-40f7-8bfd-2f4381d1fd67 does not exist Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82a40163-88eb-41eb-b105-6b58473a1157'] Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7137ef3c-fd39-40f7-8bfd-2f4381d1fd67 does not exist Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82a40163-88eb-41eb-b105-6b58473a1157'] Aug 04 16:43:13.453779 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:13.455395 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a8cba8f0-a8e6-4065-9ee4-9ffde0492596 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:13.458163 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b124c0b5-b7ed-458d-b84e-6ce1d1ba3b27 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Returning 404 to user: Security group 7137ef3c-fd39-40f7-8bfd-2f4381d1fd67 does not exist Aug 04 16:43:13.458163 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-82a40163-88eb-41eb-b105-6b58473a1157'] {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:43:13.461057 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b124c0b5-b7ed-458d-b84e-6ce1d1ba3b27 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/7137ef3c-fd39-40f7-8bfd-2f4381d1fd67" status: 404 len: 194 microversion: 2.1 time: 0.131300 Aug 04 16:43:13.466208 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 930/1877] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:43:13 2022] DELETE /compute/v2.1/os-security-groups/7137ef3c-fd39-40f7-8bfd-2f4381d1fd67 => generated 194 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:43:13.470986 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a8cba8f0-a8e6-4065-9ee4-9ffde0492596 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Searching by: {'tenant_id': 'd7505c2c3b5f43e9bee9778a86e05237', 'deleted': False} {{(pid=126125) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:43:13.472294 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-16b3148d-6059-49ff-af8d-8c2021ec0882 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '.version_select at 0x7f7e84a0b5e0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:13.493123 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8cba8f0-a8e6-4065-9ee4-9ffde0492596 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:13.493725 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8cba8f0-a8e6-4065-9ee4-9ffde0492596 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:13.495011 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8cba8f0-a8e6-4065-9ee4-9ffde0492596 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:13.495752 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8cba8f0-a8e6-4065-9ee4-9ffde0492596 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:13.589644 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a8cba8f0-a8e6-4065-9ee4-9ffde0492596 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=d7505c2c3b5f43e9bee9778a86e05237" status: 200 len: 15 microversion: 2.1 time: 0.142608 Aug 04 16:43:13.592425 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 948/1878] 10.222.0.23 () {58 vars in 1257 bytes} [Thu Aug 4 16:43:13 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=d7505c2c3b5f43e9bee9778a86e05237 => generated 15 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 16:43:13.614829 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3efa3622-3f91-4546-96d2-c0825528d014 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:13.624069 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3efa3622-3f91-4546-96d2-c0825528d014 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.014159 Aug 04 16:43:13.633728 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 949/1879] 10.222.0.23 () {58 vars in 1189 bytes} [Thu Aug 4 16:43:13 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:43:13.649107 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b8d950de-2261-4270-95c1-143f0ad4962a tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:43:13.651708 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b8d950de-2261-4270-95c1-143f0ad4962a tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:13.680973 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8d950de-2261-4270-95c1-143f0ad4962a tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:13.681497 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8d950de-2261-4270-95c1-143f0ad4962a tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:13.682315 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8d950de-2261-4270-95c1-143f0ad4962a tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:13.682938 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8d950de-2261-4270-95c1-143f0ad4962a tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:13.745133 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:43:13.745637 n-d-846466-12 devstack@n-api.service[126126]: DEBUG neutronclient.v2_0.client [None req-16b3148d-6059-49ff-af8d-8c2021ec0882 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 37a7d6ab-171d-4b5c-a953-31cb528228df does not exist", "detail": ""}} {{(pid=126126) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:43:13.746825 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.security_group_api [None req-16b3148d-6059-49ff-af8d-8c2021ec0882 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Neutron security group 37a7d6ab-171d-4b5c-a953-31cb528228df not found {{(pid=126126) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 16:43:13.747694 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-16b3148d-6059-49ff-af8d-8c2021ec0882 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] HTTP exception thrown: Security group 37a7d6ab-171d-4b5c-a953-31cb528228df does not exist Aug 04 16:43:13.747694 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-3fdf5a52-33ad-4099-8467-9d08a6b4e602'] Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-16b3148d-6059-49ff-af8d-8c2021ec0882 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Request method failure captured: Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/os-security-groups/37a7d6ab-171d-4b5c-a953-31cb528228df HTTP/1.1 Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_ZtqC96HabeWwNgyZnNmoMaRGEyMmVaUiLu9hLAQojAZCETOMBNx13l8QKIShQoX65FgHvzAm8VK7NKftXhvS9Bem6sccV9Ryn6Golur8wBQf_N6ajaCoRyYDB8mHggg2hJ4dz1CI18qnEF5I50zAGclpa2ng4xjm4gsGO8OQL5bTg Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: eb25e78b70ee48c99471d78e00e5949c Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb25e78b70ee48c99471d78e00e5949c"}]}] Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: eb25e78b70ee48c99471d78e00e5949c Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-SecurityGroupsTestJSON-886514065-project Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 23cc8f30e1f94ff0a520a071e5d81728 Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-SecurityGroupsTestJSON-886514065-project Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: exception: Security group 37a7d6ab-171d-4b5c-a953-31cb528228df does not exist Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-3fdf5a52-33ad-4099-8467-9d08a6b4e602'] Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '37a7d6ab-171d-4b5c-a953-31cb528228df'} Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:43:13.751609 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 37a7d6ab-171d-4b5c-a953-31cb528228df does not exist Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fdf5a52-33ad-4099-8467-9d08a6b4e602'] Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 37a7d6ab-171d-4b5c-a953-31cb528228df does not exist Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fdf5a52-33ad-4099-8467-9d08a6b4e602'] Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 37a7d6ab-171d-4b5c-a953-31cb528228df does not exist Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fdf5a52-33ad-4099-8467-9d08a6b4e602'] Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 37a7d6ab-171d-4b5c-a953-31cb528228df does not exist Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fdf5a52-33ad-4099-8467-9d08a6b4e602'] Aug 04 16:43:13.754975 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:13.758472 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-16b3148d-6059-49ff-af8d-8c2021ec0882 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Returning 404 to user: Security group 37a7d6ab-171d-4b5c-a953-31cb528228df does not exist Aug 04 16:43:13.758472 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-3fdf5a52-33ad-4099-8467-9d08a6b4e602'] {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:43:13.759617 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-16b3148d-6059-49ff-af8d-8c2021ec0882 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/37a7d6ab-171d-4b5c-a953-31cb528228df" status: 404 len: 194 microversion: 2.1 time: 0.292057 Aug 04 16:43:13.760369 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 931/1880] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:43:13 2022] DELETE /compute/v2.1/os-security-groups/37a7d6ab-171d-4b5c-a953-31cb528228df => generated 194 bytes in 293 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:43:13.774244 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2dfccdc3-343e-4f65-8959-2985bb3db685 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:13.775145 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2dfccdc3-343e-4f65-8959-2985bb3db685 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] [instance: b7f869cc-6c2f-4f4c-aa03-b39ed943c47b] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:13.798183 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2dfccdc3-343e-4f65-8959-2985bb3db685 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:13.799542 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2dfccdc3-343e-4f65-8959-2985bb3db685 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:13.800680 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2dfccdc3-343e-4f65-8959-2985bb3db685 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:13.801853 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2dfccdc3-343e-4f65-8959-2985bb3db685 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:13.949121 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2dfccdc3-343e-4f65-8959-2985bb3db685 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cd7076f4514ee89b0c4b2a586fe69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547b33a8f5a344f788da917f3512be5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:13.987276 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2dfccdc3-343e-4f65-8959-2985bb3db685 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] 10.222.0.23 "GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b" status: 200 len: 1252 microversion: 2.1 time: 0.219841 Aug 04 16:43:13.988651 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 932/1881] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:13 2022] GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b => generated 1252 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:14.013867 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9661adc1-3dae-4440-93c3-5e8e01a53607 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '.version_select at 0x7f7e84bec4c0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:14.044824 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b8d950de-2261-4270-95c1-143f0ad4962a tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526/action" status: 202 len: 0 microversion: 2.1 time: 0.403285 Aug 04 16:43:14.046723 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 950/1882] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:43:13 2022] POST /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526/action => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:43:14.052739 n-d-846466-12 devstack@n-api.service[126126]: DEBUG neutronclient.v2_0.client [None req-9661adc1-3dae-4440-93c3-5e8e01a53607 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e406980e-85f8-416c-b8ba-fac4eb4d9411 does not exist", "detail": ""}} {{(pid=126126) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:43:14.053418 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.security_group_api [None req-9661adc1-3dae-4440-93c3-5e8e01a53607 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Neutron security group e406980e-85f8-416c-b8ba-fac4eb4d9411 not found {{(pid=126126) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 16:43:14.053903 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-9661adc1-3dae-4440-93c3-5e8e01a53607 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] HTTP exception thrown: Security group e406980e-85f8-416c-b8ba-fac4eb4d9411 does not exist Aug 04 16:43:14.053903 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-3c4504cb-a2bb-4f17-9be0-3764b775f1eb'] Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9661adc1-3dae-4440-93c3-5e8e01a53607 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Request method failure captured: Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/os-security-groups/e406980e-85f8-416c-b8ba-fac4eb4d9411 HTTP/1.1 Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_ZtqC96HabeWwNgyZnNmoMaRGEyMmVaUiLu9hLAQojAZCETOMBNx13l8QKIShQoX65FgHvzAm8VK7NKftXhvS9Bem6sccV9Ryn6Golur8wBQf_N6ajaCoRyYDB8mHggg2hJ4dz1CI18qnEF5I50zAGclpa2ng4xjm4gsGO8OQL5bTg Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: eb25e78b70ee48c99471d78e00e5949c Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb25e78b70ee48c99471d78e00e5949c"}]}] Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: eb25e78b70ee48c99471d78e00e5949c Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-SecurityGroupsTestJSON-886514065-project Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 23cc8f30e1f94ff0a520a071e5d81728 Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-SecurityGroupsTestJSON-886514065-project Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: exception: Security group e406980e-85f8-416c-b8ba-fac4eb4d9411 does not exist Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-3c4504cb-a2bb-4f17-9be0-3764b775f1eb'] Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'e406980e-85f8-416c-b8ba-fac4eb4d9411'} Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:43:14.055753 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e406980e-85f8-416c-b8ba-fac4eb4d9411 does not exist Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c4504cb-a2bb-4f17-9be0-3764b775f1eb'] Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e406980e-85f8-416c-b8ba-fac4eb4d9411 does not exist Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c4504cb-a2bb-4f17-9be0-3764b775f1eb'] Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e406980e-85f8-416c-b8ba-fac4eb4d9411 does not exist Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c4504cb-a2bb-4f17-9be0-3764b775f1eb'] Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e406980e-85f8-416c-b8ba-fac4eb4d9411 does not exist Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c4504cb-a2bb-4f17-9be0-3764b775f1eb'] Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9661adc1-3dae-4440-93c3-5e8e01a53607 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Returning 404 to user: Security group e406980e-85f8-416c-b8ba-fac4eb4d9411 does not exist Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-3c4504cb-a2bb-4f17-9be0-3764b775f1eb'] {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9661adc1-3dae-4440-93c3-5e8e01a53607 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/e406980e-85f8-416c-b8ba-fac4eb4d9411" status: 404 len: 194 microversion: 2.1 time: 0.066765 Aug 04 16:43:14.059111 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 933/1883] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:43:13 2022] DELETE /compute/v2.1/os-security-groups/e406980e-85f8-416c-b8ba-fac4eb4d9411 => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:43:14.071317 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1ff15c92-5c1d-46c5-ac49-75f0e2ef092d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '.version_select at 0x7f7e89c62ca0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:14.071571 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-98449c78-4b48-42f6-a177-c7744ae53877 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:14.093302 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-98449c78-4b48-42f6-a177-c7744ae53877 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:14.094589 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-98449c78-4b48-42f6-a177-c7744ae53877 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'c1c1660ad79d489392261a78b5677be5'} {{(pid=126125) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:43:14.125794 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-98449c78-4b48-42f6-a177-c7744ae53877 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:14.134140 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-98449c78-4b48-42f6-a177-c7744ae53877 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:14.135496 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-98449c78-4b48-42f6-a177-c7744ae53877 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:14.141438 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-98449c78-4b48-42f6-a177-c7744ae53877 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:14.249791 n-d-846466-12 devstack@n-api.service[126126]: DEBUG neutronclient.v2_0.client [None req-1ff15c92-5c1d-46c5-ac49-75f0e2ef092d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f906bc12-1520-4c1e-ac50-ef902af656f0 does not exist", "detail": ""}} {{(pid=126126) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:43:14.251789 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.security_group_api [None req-1ff15c92-5c1d-46c5-ac49-75f0e2ef092d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Neutron security group f906bc12-1520-4c1e-ac50-ef902af656f0 not found {{(pid=126126) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 16:43:14.252532 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-1ff15c92-5c1d-46c5-ac49-75f0e2ef092d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] HTTP exception thrown: Security group f906bc12-1520-4c1e-ac50-ef902af656f0 does not exist Aug 04 16:43:14.252532 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-be496680-bb0c-448a-884d-cb9648e45ffc'] Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1ff15c92-5c1d-46c5-ac49-75f0e2ef092d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Request method failure captured: Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/os-security-groups/f906bc12-1520-4c1e-ac50-ef902af656f0 HTTP/1.1 Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_ZtqC96HabeWwNgyZnNmoMaRGEyMmVaUiLu9hLAQojAZCETOMBNx13l8QKIShQoX65FgHvzAm8VK7NKftXhvS9Bem6sccV9Ryn6Golur8wBQf_N6ajaCoRyYDB8mHggg2hJ4dz1CI18qnEF5I50zAGclpa2ng4xjm4gsGO8OQL5bTg Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: eb25e78b70ee48c99471d78e00e5949c Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb25e78b70ee48c99471d78e00e5949c"}]}] Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: eb25e78b70ee48c99471d78e00e5949c Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-SecurityGroupsTestJSON-886514065-project Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 23cc8f30e1f94ff0a520a071e5d81728 Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-SecurityGroupsTestJSON-886514065-project Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: exception: Security group f906bc12-1520-4c1e-ac50-ef902af656f0 does not exist Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-be496680-bb0c-448a-884d-cb9648e45ffc'] Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'f906bc12-1520-4c1e-ac50-ef902af656f0'} Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:43:14.256988 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f906bc12-1520-4c1e-ac50-ef902af656f0 does not exist Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be496680-bb0c-448a-884d-cb9648e45ffc'] Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f906bc12-1520-4c1e-ac50-ef902af656f0 does not exist Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be496680-bb0c-448a-884d-cb9648e45ffc'] Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f906bc12-1520-4c1e-ac50-ef902af656f0 does not exist Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be496680-bb0c-448a-884d-cb9648e45ffc'] Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f906bc12-1520-4c1e-ac50-ef902af656f0 does not exist Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be496680-bb0c-448a-884d-cb9648e45ffc'] Aug 04 16:43:14.260702 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:14.265416 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1ff15c92-5c1d-46c5-ac49-75f0e2ef092d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Returning 404 to user: Security group f906bc12-1520-4c1e-ac50-ef902af656f0 does not exist Aug 04 16:43:14.265416 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-be496680-bb0c-448a-884d-cb9648e45ffc'] {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:43:14.266597 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1ff15c92-5c1d-46c5-ac49-75f0e2ef092d tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/f906bc12-1520-4c1e-ac50-ef902af656f0" status: 404 len: 194 microversion: 2.1 time: 0.199449 Aug 04 16:43:14.270914 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 934/1884] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:43:14 2022] DELETE /compute/v2.1/os-security-groups/f906bc12-1520-4c1e-ac50-ef902af656f0 => generated 194 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:43:14.283598 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fdb073c3-1007-4852-8ea1-3fb186ce20bd tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '.version_select at 0x7f7e89c8b940>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:14.350139 n-d-846466-12 devstack@n-api.service[126126]: DEBUG neutronclient.v2_0.client [None req-fdb073c3-1007-4852-8ea1-3fb186ce20bd tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0fcf40ae-f583-49f9-996d-0a6b171ed7e0 does not exist", "detail": ""}} {{(pid=126126) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:43:14.350790 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.security_group_api [None req-fdb073c3-1007-4852-8ea1-3fb186ce20bd tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Neutron security group 0fcf40ae-f583-49f9-996d-0a6b171ed7e0 not found {{(pid=126126) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 16:43:14.351332 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-fdb073c3-1007-4852-8ea1-3fb186ce20bd tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] HTTP exception thrown: Security group 0fcf40ae-f583-49f9-996d-0a6b171ed7e0 does not exist Aug 04 16:43:14.351332 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-6c385fa5-9c6a-405a-a0f5-ceb1fb9e8090'] Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fdb073c3-1007-4852-8ea1-3fb186ce20bd tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Request method failure captured: Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/os-security-groups/0fcf40ae-f583-49f9-996d-0a6b171ed7e0 HTTP/1.1 Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_ZtqC96HabeWwNgyZnNmoMaRGEyMmVaUiLu9hLAQojAZCETOMBNx13l8QKIShQoX65FgHvzAm8VK7NKftXhvS9Bem6sccV9Ryn6Golur8wBQf_N6ajaCoRyYDB8mHggg2hJ4dz1CI18qnEF5I50zAGclpa2ng4xjm4gsGO8OQL5bTg Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: eb25e78b70ee48c99471d78e00e5949c Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb25e78b70ee48c99471d78e00e5949c"}]}] Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: eb25e78b70ee48c99471d78e00e5949c Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-SecurityGroupsTestJSON-886514065-project Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 23cc8f30e1f94ff0a520a071e5d81728 Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-SecurityGroupsTestJSON-886514065-project Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: exception: Security group 0fcf40ae-f583-49f9-996d-0a6b171ed7e0 does not exist Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-6c385fa5-9c6a-405a-a0f5-ceb1fb9e8090'] Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '0fcf40ae-f583-49f9-996d-0a6b171ed7e0'} Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:43:14.353663 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0fcf40ae-f583-49f9-996d-0a6b171ed7e0 does not exist Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c385fa5-9c6a-405a-a0f5-ceb1fb9e8090'] Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0fcf40ae-f583-49f9-996d-0a6b171ed7e0 does not exist Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c385fa5-9c6a-405a-a0f5-ceb1fb9e8090'] Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0fcf40ae-f583-49f9-996d-0a6b171ed7e0 does not exist Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c385fa5-9c6a-405a-a0f5-ceb1fb9e8090'] Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0fcf40ae-f583-49f9-996d-0a6b171ed7e0 does not exist Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c385fa5-9c6a-405a-a0f5-ceb1fb9e8090'] Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fdb073c3-1007-4852-8ea1-3fb186ce20bd tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Returning 404 to user: Security group 0fcf40ae-f583-49f9-996d-0a6b171ed7e0 does not exist Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: Neutron server returns request_ids: ['req-6c385fa5-9c6a-405a-a0f5-ceb1fb9e8090'] {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fdb073c3-1007-4852-8ea1-3fb186ce20bd tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/0fcf40ae-f583-49f9-996d-0a6b171ed7e0" status: 404 len: 194 microversion: 2.1 time: 0.083892 Aug 04 16:43:14.361850 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 935/1885] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:43:14 2022] DELETE /compute/v2.1/os-security-groups/0fcf40ae-f583-49f9-996d-0a6b171ed7e0 => generated 194 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:43:14.377473 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e7e15d53-ec18-464c-8933-5fc1d377c364 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:14.378172 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e7e15d53-ec18-464c-8933-5fc1d377c364 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: 95a1d0a6-3d88-4b0d-ba60-b1972539d2bd] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:14.399471 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e7e15d53-ec18-464c-8933-5fc1d377c364 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:14.399920 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e7e15d53-ec18-464c-8933-5fc1d377c364 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:14.400718 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e7e15d53-ec18-464c-8933-5fc1d377c364 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:14.401326 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e7e15d53-ec18-464c-8933-5fc1d377c364 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:14.409325 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.multi_cell_list [None req-98449c78-4b48-42f6-a177-c7744ae53877 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:43:14.574364 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e7e15d53-ec18-464c-8933-5fc1d377c364 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: 95a1d0a6-3d88-4b0d-ba60-b1972539d2bd] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:43:14.619049 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-98449c78-4b48-42f6-a177-c7744ae53877 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.567115 Aug 04 16:43:14.619841 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 951/1886] 10.222.0.23 () {58 vars in 1150 bytes} [Thu Aug 4 16:43:14 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:43:14.639569 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9c3ff6fb-a030-43b1-9c4e-0117ed31fa75 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:43:14.642779 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9c3ff6fb-a030-43b1-9c4e-0117ed31fa75 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:14.659474 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c3ff6fb-a030-43b1-9c4e-0117ed31fa75 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:14.662074 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c3ff6fb-a030-43b1-9c4e-0117ed31fa75 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:14.666870 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c3ff6fb-a030-43b1-9c4e-0117ed31fa75 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:14.670004 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c3ff6fb-a030-43b1-9c4e-0117ed31fa75 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:14.948883 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e7e15d53-ec18-464c-8933-5fc1d377c364 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "DELETE /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd" status: 204 len: 0 microversion: 2.1 time: 0.587299 Aug 04 16:43:14.963238 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 936/1887] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:43:14 2022] DELETE /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd => generated 0 bytes in 600 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:43:14.977098 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9c3ff6fb-a030-43b1-9c4e-0117ed31fa75 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526/action" status: 202 len: 0 microversion: 2.1 time: 0.348864 Aug 04 16:43:14.983689 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 952/1888] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:43:14 2022] POST /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:43:15.000292 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3c97dc4a-2756-46f9-8711-8cf29e788411 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:15.002855 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3c97dc4a-2756-46f9-8711-8cf29e788411 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: 95a1d0a6-3d88-4b0d-ba60-b1972539d2bd] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:15.015605 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f4e89e4e-b3cc-4f7c-a13b-6b47411e3132 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:15.017376 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f4e89e4e-b3cc-4f7c-a13b-6b47411e3132 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:15.038174 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3c97dc4a-2756-46f9-8711-8cf29e788411 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:15.043841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3c97dc4a-2756-46f9-8711-8cf29e788411 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:15.047480 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3c97dc4a-2756-46f9-8711-8cf29e788411 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:15.055453 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3c97dc4a-2756-46f9-8711-8cf29e788411 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:15.055916 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f4e89e4e-b3cc-4f7c-a13b-6b47411e3132 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:15.058755 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f4e89e4e-b3cc-4f7c-a13b-6b47411e3132 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:15.064100 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f4e89e4e-b3cc-4f7c-a13b-6b47411e3132 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:15.067726 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f4e89e4e-b3cc-4f7c-a13b-6b47411e3132 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:15.902232 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3c97dc4a-2756-46f9-8711-8cf29e788411 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23cc8f30e1f94ff0a520a071e5d81728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb25e78b70ee48c99471d78e00e5949c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:15.911727 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3c97dc4a-2756-46f9-8711-8cf29e788411 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd" status: 200 len: 1647 microversion: 2.1 time: 0.944222 Aug 04 16:43:15.941848 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 937/1889] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:14 2022] GET /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd => generated 1647 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:15.947634 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-86b93ec1-7d5f-4d7d-956c-3c783eb21d90 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:15.948491 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-86b93ec1-7d5f-4d7d-956c-3c783eb21d90 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] [instance: b7f869cc-6c2f-4f4c-aa03-b39ed943c47b] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:15.963399 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-86b93ec1-7d5f-4d7d-956c-3c783eb21d90 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:15.964589 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-86b93ec1-7d5f-4d7d-956c-3c783eb21d90 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:15.965609 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-86b93ec1-7d5f-4d7d-956c-3c783eb21d90 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:15.966215 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-86b93ec1-7d5f-4d7d-956c-3c783eb21d90 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:16.121753 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-86b93ec1-7d5f-4d7d-956c-3c783eb21d90 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cd7076f4514ee89b0c4b2a586fe69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547b33a8f5a344f788da917f3512be5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:16.130615 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-86b93ec1-7d5f-4d7d-956c-3c783eb21d90 tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] 10.222.0.23 "GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b" status: 200 len: 1252 microversion: 2.1 time: 0.187218 Aug 04 16:43:16.131889 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 938/1890] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:15 2022] GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b => generated 1252 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:16.137129 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-d06294cb-4f84-4fb7-93e4-7639fb63ff5e req-1bc6be20-20c3-4111-b229-ec3ce800e167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c62ae02-0f30-43e1-a005-89dcb8122d4e", "name": "network-vif-plugged", "status": "completed", "tag": "93c46fa1-3978-4529-9c01-36e6a216c294"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:43:16.149244 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-d06294cb-4f84-4fb7-93e4-7639fb63ff5e req-1bc6be20-20c3-4111-b229-ec3ce800e167 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:16.150124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-d06294cb-4f84-4fb7-93e4-7639fb63ff5e req-1bc6be20-20c3-4111-b229-ec3ce800e167 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:16.171268 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-d06294cb-4f84-4fb7-93e4-7639fb63ff5e req-1bc6be20-20c3-4111-b229-ec3ce800e167 service nova] Creating event network-vif-plugged:93c46fa1-3978-4529-9c01-36e6a216c294 for instance 0c62ae02-0f30-43e1-a005-89dcb8122d4e on n-h1-846466-12 Aug 04 16:43:16.178197 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-d06294cb-4f84-4fb7-93e4-7639fb63ff5e req-1bc6be20-20c3-4111-b229-ec3ce800e167 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044824 Aug 04 16:43:16.179379 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 939/1891] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:43:16.246144 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f4e89e4e-b3cc-4f7c-a13b-6b47411e3132 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1616 microversion: 2.1 time: 1.257192 Aug 04 16:43:16.254374 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 953/1892] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:14 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1616 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:16.278803 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c818269f-4076-4225-bfeb-9f038988dba0 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:16.282631 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c818269f-4076-4225-bfeb-9f038988dba0 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:16.318693 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c818269f-4076-4225-bfeb-9f038988dba0 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:16.319414 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c818269f-4076-4225-bfeb-9f038988dba0 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:16.323704 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c818269f-4076-4225-bfeb-9f038988dba0 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:16.324447 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c818269f-4076-4225-bfeb-9f038988dba0 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:16.747884 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-07e92f3d-c836-4fb4-9362-35640cab9d12 tempest-ExtensionsTest-40071720 tempest-ExtensionsTest-40071720-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:16.760719 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-07e92f3d-c836-4fb4-9362-35640cab9d12 tempest-ExtensionsTest-40071720 tempest-ExtensionsTest-40071720-project] 10.222.0.23 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.462077 Aug 04 16:43:16.765834 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 954/1893] 10.222.0.23 () {58 vars in 1170 bytes} [Thu Aug 4 16:43:16 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:43:16.791754 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-13492e39-d71f-42b0-b6f3-8626f152c7c2 tempest-ExtensionsTest-40071720 tempest-ExtensionsTest-40071720-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:16.819531 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-13492e39-d71f-42b0-b6f3-8626f152c7c2 tempest-ExtensionsTest-40071720 tempest-ExtensionsTest-40071720-project] 10.222.0.23 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.039937 Aug 04 16:43:16.837229 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 955/1894] 10.222.0.23 () {58 vars in 1134 bytes} [Thu Aug 4 16:43:16 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:43:16.942075 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0970c036-ef06-424e-a9c0-3ea2f2fc2363 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:16.945955 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0970c036-ef06-424e-a9c0-3ea2f2fc2363 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: 95a1d0a6-3d88-4b0d-ba60-b1972539d2bd] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:16.970827 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0970c036-ef06-424e-a9c0-3ea2f2fc2363 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:16.972177 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0970c036-ef06-424e-a9c0-3ea2f2fc2363 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:16.973888 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0970c036-ef06-424e-a9c0-3ea2f2fc2363 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:16.975008 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0970c036-ef06-424e-a9c0-3ea2f2fc2363 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:17.357012 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c818269f-4076-4225-bfeb-9f038988dba0 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1616 microversion: 2.1 time: 1.085517 Aug 04 16:43:17.374111 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 940/1895] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:16 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1616 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:17.381416 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cb41f88d-0b06-4062-aa69-d6990db5828e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:17.382048 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cb41f88d-0b06-4062-aa69-d6990db5828e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] [instance: b7f869cc-6c2f-4f4c-aa03-b39ed943c47b] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:17.399488 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cb41f88d-0b06-4062-aa69-d6990db5828e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:17.399939 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cb41f88d-0b06-4062-aa69-d6990db5828e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:17.400744 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cb41f88d-0b06-4062-aa69-d6990db5828e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:17.401179 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cb41f88d-0b06-4062-aa69-d6990db5828e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:17.435817 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-cb41f88d-0b06-4062-aa69-d6990db5828e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] HTTP exception thrown: Instance b7f869cc-6c2f-4f4c-aa03-b39ed943c47b could not be found. Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cb41f88d-0b06-4062-aa69-d6990db5828e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Request method failure captured: Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b HTTP/1.1 Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_aARzNprUgN3gSU-Jzg81E4F-wqIE1HSboaeEnkd4aWAeqxKqQb9-ZqZotc_RPGtM_ePFqnN3MYRWb8qzk59dQY5nXhpDNbfT5iQJ46WzN2tDTCT_Zr1Ay0h4X27p_bcp1_7OMdMi5eAE_2wXi_qeGWSHI17YGOBh0fDYIwLM5bULY Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 547b33a8f5a344f788da917f3512be5f Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersTestBootFromVolume-282823056 Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/547b33a8f5a344f788da917f3512be5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_547b33a8f5a344f788da917f3512be5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/547b33a8f5a344f788da917f3512be5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/547b33a8f5a344f788da917f3512be5f"}]}] Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersTestBootFromVolume-282823056 Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 547b33a8f5a344f788da917f3512be5f Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersTestBootFromVolume-282823056 Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersTestBootFromVolume-282823056-project Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: d3cd7076f4514ee89b0c4b2a586fe69e Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersTestBootFromVolume-282823056-project Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance b7f869cc-6c2f-4f4c-aa03-b39ed943c47b could not be found. Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'b7f869cc-6c2f-4f4c-aa03-b39ed943c47b'} Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7f869cc-6c2f-4f4c-aa03-b39ed943c47b could not be found. Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7f869cc-6c2f-4f4c-aa03-b39ed943c47b could not be found. Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:43:17.439099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:17.442970 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:17.442970 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:43:17.442970 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:43:17.442970 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:43:17.442970 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:43:17.442970 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7f869cc-6c2f-4f4c-aa03-b39ed943c47b could not be found. Aug 04 16:43:17.442970 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:17.445452 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cb41f88d-0b06-4062-aa69-d6990db5828e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Returning 404 to user: Instance b7f869cc-6c2f-4f4c-aa03-b39ed943c47b could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:43:17.446989 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cb41f88d-0b06-4062-aa69-d6990db5828e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] 10.222.0.23 "GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b" status: 404 len: 111 microversion: 2.1 time: 0.071483 Aug 04 16:43:17.452028 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 941/1896] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:17 2022] GET /compute/v2.1/servers/b7f869cc-6c2f-4f4c-aa03-b39ed943c47b => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:43:17.461114 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d1051fb3-36cb-4395-83f0-d7b770373dff tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:17.471365 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d1051fb3-36cb-4395-83f0-d7b770373dff tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Searching by: {'host': 'n-h1-846466-12', 'deleted': False} {{(pid=126126) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:43:17.481936 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d1051fb3-36cb-4395-83f0-d7b770373dff tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:17.482654 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d1051fb3-36cb-4395-83f0-d7b770373dff tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:17.483723 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d1051fb3-36cb-4395-83f0-d7b770373dff tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:17.484439 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d1051fb3-36cb-4395-83f0-d7b770373dff tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:17.656860 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.multi_cell_list [None req-d1051fb3-36cb-4395-83f0-d7b770373dff tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=126126) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:43:17.792839 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d1051fb3-36cb-4395-83f0-d7b770373dff tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] 10.222.0.23 "GET /compute/v2.1/servers?host=n-h1-846466-12&all_tenants=1" status: 200 len: 1320 microversion: 2.1 time: 0.339337 Aug 04 16:43:17.793839 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 942/1897] 10.222.0.23 () {58 vars in 1192 bytes} [Thu Aug 4 16:43:17 2022] GET /compute/v2.1/servers?host=n-h1-846466-12&all_tenants=1 => generated 1320 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:17.801827 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c2f8aedf-018a-47c1-b547-3cc51cb0ec7e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] Calling method '.version_select at 0x7f7e89b6eca0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:17.841158 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c2f8aedf-018a-47c1-b547-3cc51cb0ec7e tempest-ServersTestBootFromVolume-282823056 tempest-ServersTestBootFromVolume-282823056-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-342563486" status: 202 len: 0 microversion: 2.1 time: 0.039358 Aug 04 16:43:17.859910 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 943/1898] 10.222.0.23 () {58 vars in 1218 bytes} [Thu Aug 4 16:43:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-342563486 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:43:17.874819 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-883a6850-1f2c-4aea-882f-141a6d1040ca tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:17.897830 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-883a6850-1f2c-4aea-882f-141a6d1040ca tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=126126) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:43:17.905384 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0970c036-ef06-424e-a9c0-3ea2f2fc2363 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23cc8f30e1f94ff0a520a071e5d81728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb25e78b70ee48c99471d78e00e5949c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:17.913260 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-883a6850-1f2c-4aea-882f-141a6d1040ca tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:17.913889 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-883a6850-1f2c-4aea-882f-141a6d1040ca tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:17.914815 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-883a6850-1f2c-4aea-882f-141a6d1040ca tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:17.916562 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-883a6850-1f2c-4aea-882f-141a6d1040ca tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:17.952222 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0970c036-ef06-424e-a9c0-3ea2f2fc2363 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd" status: 200 len: 1647 microversion: 2.1 time: 1.011767 Aug 04 16:43:17.960440 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 956/1899] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:16 2022] GET /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd => generated 1647 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:43:17.969945 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-883a6850-1f2c-4aea-882f-141a6d1040ca tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] 10.222.0.23 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.106797 Aug 04 16:43:17.978233 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 944/1900] 10.222.0.23 () {58 vars in 1196 bytes} [Thu Aug 4 16:43:17 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:43:17.995877 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ae700269-3e52-4eb5-a6fd-36770e488855 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:43:18.000719 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ae700269-3e52-4eb5-a6fd-36770e488855 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:18.016356 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ae700269-3e52-4eb5-a6fd-36770e488855 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:18.017405 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ae700269-3e52-4eb5-a6fd-36770e488855 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:18.019057 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ae700269-3e52-4eb5-a6fd-36770e488855 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:18.020273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ae700269-3e52-4eb5-a6fd-36770e488855 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:18.288858 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ae700269-3e52-4eb5-a6fd-36770e488855 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526/action" status: 202 len: 0 microversion: 2.1 time: 0.303913 Aug 04 16:43:18.296485 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 957/1901] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:43:17 2022] POST /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:43:18.309778 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9d188889-4eec-4e08-a82a-2a03bedc37af tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:43:18.324201 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9d188889-4eec-4e08-a82a-2a03bedc37af tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:18.373838 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d188889-4eec-4e08-a82a-2a03bedc37af tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:18.381403 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d188889-4eec-4e08-a82a-2a03bedc37af tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:18.389424 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d188889-4eec-4e08-a82a-2a03bedc37af tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:18.390880 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d188889-4eec-4e08-a82a-2a03bedc37af tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:18.775334 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9d188889-4eec-4e08-a82a-2a03bedc37af tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:43:18.776162 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9d188889-4eec-4e08-a82a-2a03bedc37af tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:43:18.777026 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9d188889-4eec-4e08-a82a-2a03bedc37af tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:43:18.777774 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9d188889-4eec-4e08-a82a-2a03bedc37af tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:43:18.778573 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9d188889-4eec-4e08-a82a-2a03bedc37af tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:43:18.946789 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:43:19.095261 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9d188889-4eec-4e08-a82a-2a03bedc37af tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:19.111404 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d188889-4eec-4e08-a82a-2a03bedc37af tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:19.112766 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d188889-4eec-4e08-a82a-2a03bedc37af tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:19.115394 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d188889-4eec-4e08-a82a-2a03bedc37af tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:19.138838 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d188889-4eec-4e08-a82a-2a03bedc37af tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:19.247140 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9d188889-4eec-4e08-a82a-2a03bedc37af tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "POST /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526/action" status: 202 len: 1067 microversion: 2.1 time: 0.945442 Aug 04 16:43:19.255212 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 945/1902] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:43:18 2022] POST /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526/action => generated 1067 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 16:43:19.274470 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-165bdfe1-4e48-4383-956d-45a0cfe25883 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:19.275540 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-165bdfe1-4e48-4383-956d-45a0cfe25883 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: 95a1d0a6-3d88-4b0d-ba60-b1972539d2bd] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:19.288186 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-165bdfe1-4e48-4383-956d-45a0cfe25883 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:19.289012 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-165bdfe1-4e48-4383-956d-45a0cfe25883 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:19.290160 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-165bdfe1-4e48-4383-956d-45a0cfe25883 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:19.300067 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-165bdfe1-4e48-4383-956d-45a0cfe25883 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:19.577261 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9ea09d4d-1295-4e18-9e0e-d63c564e16b0 tempest-QuotaClassesAdminTestJSON-1806293306 tempest-QuotaClassesAdminTestJSON-1806293306-project-admin] Calling method '.version_select at 0x7f7e77c5bdc0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:19.579053 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:43:19.579053 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:43:19.617768 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9ea09d4d-1295-4e18-9e0e-d63c564e16b0 tempest-QuotaClassesAdminTestJSON-1806293306 tempest-QuotaClassesAdminTestJSON-1806293306-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.755978 Aug 04 16:43:19.619486 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 958/1903] 10.222.0.23 () {58 vars in 1185 bytes} [Thu Aug 4 16:43:18 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:43:19.634043 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f0f57935-4d86-4e75-9903-e2e8b50f4735 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:19.636254 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f0f57935-4d86-4e75-9903-e2e8b50f4735 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:19.655761 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f0f57935-4d86-4e75-9903-e2e8b50f4735 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:19.658029 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f0f57935-4d86-4e75-9903-e2e8b50f4735 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:19.659382 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f0f57935-4d86-4e75-9903-e2e8b50f4735 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:19.660009 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f0f57935-4d86-4e75-9903-e2e8b50f4735 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:20.756003 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-165bdfe1-4e48-4383-956d-45a0cfe25883 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23cc8f30e1f94ff0a520a071e5d81728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb25e78b70ee48c99471d78e00e5949c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:20.780897 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-165bdfe1-4e48-4383-956d-45a0cfe25883 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd" status: 200 len: 1647 microversion: 2.1 time: 1.523727 Aug 04 16:43:20.785074 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 946/1904] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:19 2022] GET /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd => generated 1647 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:20.818178 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4b7262b4-68c8-4b47-9eac-0248902e930f tempest-QuotaClassesAdminTestJSON-1806293306 tempest-QuotaClassesAdminTestJSON-1806293306-project-admin] Action: 'update', calling method: .version_select at 0x7f7e84897dc0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:43:20.845812 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:43:20.845812 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:43:21.147800 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f0f57935-4d86-4e75-9903-e2e8b50f4735 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:21.185022 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f0f57935-4d86-4e75-9903-e2e8b50f4735 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1471 microversion: 2.1 time: 1.563321 Aug 04 16:43:21.186664 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 959/1905] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:19 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1471 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:21.366149 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-3aff71d8-4d15-44dc-bd9b-444db200c3b8 req-dff2f821-b5d2-4858-be9f-af9de6bbfd6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a1d0a6-3d88-4b0d-ba60-b1972539d2bd", "name": "network-vif-deleted", "tag": "a6403208-7435-4b06-b55d-2373bc1a3cd3"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:43:21.460169 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-3aff71d8-4d15-44dc-bd9b-444db200c3b8 req-dff2f821-b5d2-4858-be9f-af9de6bbfd6f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:21.462809 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-3aff71d8-4d15-44dc-bd9b-444db200c3b8 req-dff2f821-b5d2-4858-be9f-af9de6bbfd6f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:21.544873 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-3aff71d8-4d15-44dc-bd9b-444db200c3b8 req-dff2f821-b5d2-4858-be9f-af9de6bbfd6f service nova] Creating event network-vif-deleted:a6403208-7435-4b06-b55d-2373bc1a3cd3 for instance 95a1d0a6-3d88-4b0d-ba60-b1972539d2bd on n-h1-846466-12 Aug 04 16:43:21.594130 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-3aff71d8-4d15-44dc-bd9b-444db200c3b8 req-dff2f821-b5d2-4858-be9f-af9de6bbfd6f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.235089 Aug 04 16:43:21.594130 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 960/1906] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:43:21.826709 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2c6c9e50-6b9f-4ad8-bef1-8009775c338a tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:21.828992 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2c6c9e50-6b9f-4ad8-bef1-8009775c338a tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: 95a1d0a6-3d88-4b0d-ba60-b1972539d2bd] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:21.830530 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=12,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:43:21.852816 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2c6c9e50-6b9f-4ad8-bef1-8009775c338a tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:21.854727 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2c6c9e50-6b9f-4ad8-bef1-8009775c338a tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:21.858413 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2c6c9e50-6b9f-4ad8-bef1-8009775c338a tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:21.875029 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2c6c9e50-6b9f-4ad8-bef1-8009775c338a tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:21.967796 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4b7262b4-68c8-4b47-9eac-0248902e930f tempest-QuotaClassesAdminTestJSON-1806293306 tempest-QuotaClassesAdminTestJSON-1806293306-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.177575 Aug 04 16:43:21.978717 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 947/1907] 10.222.0.23 () {60 vars in 1206 bytes} [Thu Aug 4 16:43:20 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:43:22.005734 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c782fcdf-070f-452f-a23e-4e7141ca27cc tempest-QuotaClassesAdminTestJSON-1806293306 tempest-QuotaClassesAdminTestJSON-1806293306-project-admin] Calling method '.version_select at 0x7f7e84897c10>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:22.011110 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:43:22.011110 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 16:43:22.048094 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c782fcdf-070f-452f-a23e-4e7141ca27cc tempest-QuotaClassesAdminTestJSON-1806293306 tempest-QuotaClassesAdminTestJSON-1806293306-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.066613 Aug 04 16:43:22.054468 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2c6c9e50-6b9f-4ad8-bef1-8009775c338a tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:22.054926 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2c6c9e50-6b9f-4ad8-bef1-8009775c338a tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:22.057471 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-2c6c9e50-6b9f-4ad8-bef1-8009775c338a tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lazy-loading 'fault' on Instance uuid 95a1d0a6-3d88-4b0d-ba60-b1972539d2bd {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:43:22.060966 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 948/1908] 10.222.0.23 () {58 vars in 1185 bytes} [Thu Aug 4 16:43:21 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:43:22.068281 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1efb9d4f-a3c6-40d5-9e41-ee123cb3fc94 tempest-QuotaClassesAdminTestJSON-1806293306 tempest-QuotaClassesAdminTestJSON-1806293306-project-admin] Action: 'update', calling method: .version_select at 0x7f7e89b8fe50>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:43:22.374512 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2c6c9e50-6b9f-4ad8-bef1-8009775c338a tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23cc8f30e1f94ff0a520a071e5d81728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb25e78b70ee48c99471d78e00e5949c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:22.396740 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2c6c9e50-6b9f-4ad8-bef1-8009775c338a tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd" status: 200 len: 1306 microversion: 2.1 time: 0.574193 Aug 04 16:43:22.419709 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 961/1909] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:21 2022] GET /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd => generated 1306 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:43:22.435909 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fb7662e6-3ba2-46ba-9113-898427d5094c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:22.438154 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fb7662e6-3ba2-46ba-9113-898427d5094c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:22.456683 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fb7662e6-3ba2-46ba-9113-898427d5094c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:22.459892 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fb7662e6-3ba2-46ba-9113-898427d5094c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:22.462839 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fb7662e6-3ba2-46ba-9113-898427d5094c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:22.463912 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1efb9d4f-a3c6-40d5-9e41-ee123cb3fc94 tempest-QuotaClassesAdminTestJSON-1806293306 tempest-QuotaClassesAdminTestJSON-1806293306-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.401498 Aug 04 16:43:22.464489 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 949/1910] 10.222.0.23 () {60 vars in 1206 bytes} [Thu Aug 4 16:43:22 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:43:22.466749 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fb7662e6-3ba2-46ba-9113-898427d5094c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:23.428698 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6076966f-eb22-4c63-8b0e-3da659df75d3 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:23.430165 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6076966f-eb22-4c63-8b0e-3da659df75d3 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] [instance: 95a1d0a6-3d88-4b0d-ba60-b1972539d2bd] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:23.455974 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6076966f-eb22-4c63-8b0e-3da659df75d3 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:23.457208 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6076966f-eb22-4c63-8b0e-3da659df75d3 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:23.464048 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6076966f-eb22-4c63-8b0e-3da659df75d3 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:23.465308 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6076966f-eb22-4c63-8b0e-3da659df75d3 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:23.526046 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-6076966f-eb22-4c63-8b0e-3da659df75d3 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] HTTP exception thrown: Instance 95a1d0a6-3d88-4b0d-ba60-b1972539d2bd could not be found. Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6076966f-eb22-4c63-8b0e-3da659df75d3 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Request method failure captured: Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd HTTP/1.1 Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_ZtqC96HabeWwNgyZnNmoMaRGEyMmVaUiLu9hLAQojAZCETOMBNx13l8QKIShQoX65FgHvzAm8VK7NKftXhvS9Bem6sccV9Ryn6Golur8wBQf_N6ajaCoRyYDB8mHggg2hJ4dz1CI18qnEF5I50zAGclpa2ng4xjm4gsGO8OQL5bTg Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: eb25e78b70ee48c99471d78e00e5949c Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb25e78b70ee48c99471d78e00e5949c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb25e78b70ee48c99471d78e00e5949c"}]}] Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: eb25e78b70ee48c99471d78e00e5949c Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-886514065 Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-SecurityGroupsTestJSON-886514065-project Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 23cc8f30e1f94ff0a520a071e5d81728 Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-SecurityGroupsTestJSON-886514065-project Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 95a1d0a6-3d88-4b0d-ba60-b1972539d2bd could not be found. Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '95a1d0a6-3d88-4b0d-ba60-b1972539d2bd'} Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95a1d0a6-3d88-4b0d-ba60-b1972539d2bd could not be found. Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95a1d0a6-3d88-4b0d-ba60-b1972539d2bd could not be found. Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:43:23.541949 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:23.545393 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:43:23.545393 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:43:23.545393 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:43:23.545393 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:43:23.545393 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:43:23.545393 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95a1d0a6-3d88-4b0d-ba60-b1972539d2bd could not be found. Aug 04 16:43:23.545393 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:43:23.547682 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6076966f-eb22-4c63-8b0e-3da659df75d3 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Returning 404 to user: Instance 95a1d0a6-3d88-4b0d-ba60-b1972539d2bd could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:43:23.548829 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6076966f-eb22-4c63-8b0e-3da659df75d3 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "GET /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd" status: 404 len: 111 microversion: 2.1 time: 0.124374 Aug 04 16:43:23.550526 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 950/1911] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:23 2022] GET /compute/v2.1/servers/95a1d0a6-3d88-4b0d-ba60-b1972539d2bd => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:43:23.561096 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-eb863ed0-91ef-4a31-8a9d-121fb14f0576 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '.version_select at 0x7f7e842109d0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:23.997207 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fb7662e6-3ba2-46ba-9113-898427d5094c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:24.016944 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fb7662e6-3ba2-46ba-9113-898427d5094c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1471 microversion: 2.1 time: 1.594885 Aug 04 16:43:24.045904 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 962/1912] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:22 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1471 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:25.102842 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b5d64079-e70a-49e6-9171-d4352b117dfc tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:25.111232 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b5d64079-e70a-49e6-9171-d4352b117dfc tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:25.142861 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=8 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:43:25.147870 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b5d64079-e70a-49e6-9171-d4352b117dfc tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:25.153887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b5d64079-e70a-49e6-9171-d4352b117dfc tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:25.157678 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b5d64079-e70a-49e6-9171-d4352b117dfc tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:25.158212 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b5d64079-e70a-49e6-9171-d4352b117dfc tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:25.906034 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-eb863ed0-91ef-4a31-8a9d-121fb14f0576 tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/b84e1c25-dbc9-4bdf-9a4e-f79d71f521ff" status: 202 len: 0 microversion: 2.1 time: 2.349037 Aug 04 16:43:25.906912 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 951/1913] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:43:23 2022] DELETE /compute/v2.1/os-security-groups/b84e1c25-dbc9-4bdf-9a4e-f79d71f521ff => generated 0 bytes in 2351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:43:25.916829 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a3cbc22d-bbf9-4dc1-9def-41bafd5d514a tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] Calling method '.version_select at 0x7f7e84216310>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:26.995717 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b5d64079-e70a-49e6-9171-d4352b117dfc tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:27.029491 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b5d64079-e70a-49e6-9171-d4352b117dfc tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1471 microversion: 2.1 time: 1.960835 Aug 04 16:43:27.031678 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 963/1914] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:25 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1471 bytes in 1965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:27.932946 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=8 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:43:28.088243 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0ad16e8f-7474-44cb-981f-84985e7d9e7c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:28.095306 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0ad16e8f-7474-44cb-981f-84985e7d9e7c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:28.131595 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:43:28.157095 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ad16e8f-7474-44cb-981f-84985e7d9e7c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:28.159319 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ad16e8f-7474-44cb-981f-84985e7d9e7c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:28.164034 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ad16e8f-7474-44cb-981f-84985e7d9e7c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:28.165087 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ad16e8f-7474-44cb-981f-84985e7d9e7c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:28.876654 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a3cbc22d-bbf9-4dc1-9def-41bafd5d514a tempest-SecurityGroupsTestJSON-886514065 tempest-SecurityGroupsTestJSON-886514065-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/26fe7344-0b29-43f4-8ca4-b71316c8dded" status: 202 len: 0 microversion: 2.1 time: 2.963668 Aug 04 16:43:28.883112 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 952/1915] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:43:25 2022] DELETE /compute/v2.1/os-security-groups/26fe7344-0b29-43f4-8ca4-b71316c8dded => generated 0 bytes in 2965 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:43:29.605799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:43:29.735733 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0ad16e8f-7474-44cb-981f-84985e7d9e7c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:29.772973 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0ad16e8f-7474-44cb-981f-84985e7d9e7c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1471 microversion: 2.1 time: 1.703058 Aug 04 16:43:29.794709 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 964/1916] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:28 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1471 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:43:30.820846 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-28a5c2e3-46a9-49dc-9da2-9aa97bc93a43 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:30.822331 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-28a5c2e3-46a9-49dc-9da2-9aa97bc93a43 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:30.871254 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-28a5c2e3-46a9-49dc-9da2-9aa97bc93a43 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:30.880330 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-28a5c2e3-46a9-49dc-9da2-9aa97bc93a43 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:30.884069 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-28a5c2e3-46a9-49dc-9da2-9aa97bc93a43 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:30.885542 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-28a5c2e3-46a9-49dc-9da2-9aa97bc93a43 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:31.355409 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-28a5c2e3-46a9-49dc-9da2-9aa97bc93a43 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:31.371735 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-28a5c2e3-46a9-49dc-9da2-9aa97bc93a43 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1471 microversion: 2.1 time: 0.558512 Aug 04 16:43:31.373213 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 953/1917] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:30 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1471 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:43:32.395198 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-76080008-5e4c-440d-a68c-105a50d370af tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:32.396131 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-76080008-5e4c-440d-a68c-105a50d370af tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:32.410673 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-76080008-5e4c-440d-a68c-105a50d370af tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:32.412545 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-76080008-5e4c-440d-a68c-105a50d370af tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:32.420426 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-76080008-5e4c-440d-a68c-105a50d370af tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:32.423759 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-76080008-5e4c-440d-a68c-105a50d370af tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:33.252469 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-76080008-5e4c-440d-a68c-105a50d370af tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:33.276890 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:43:33.281515 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-76080008-5e4c-440d-a68c-105a50d370af tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1477 microversion: 2.1 time: 0.889096 Aug 04 16:43:33.287805 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 965/1918] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:32 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1477 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:34.333095 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3b4d378f-545c-46a1-b7d2-89cc33bbfc9b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:34.344044 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3b4d378f-545c-46a1-b7d2-89cc33bbfc9b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:34.391812 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=27,nova_cell0:UPDATE=7 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:43:34.416881 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b4d378f-545c-46a1-b7d2-89cc33bbfc9b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:34.423907 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b4d378f-545c-46a1-b7d2-89cc33bbfc9b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:34.425518 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b4d378f-545c-46a1-b7d2-89cc33bbfc9b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:34.436286 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b4d378f-545c-46a1-b7d2-89cc33bbfc9b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:34.939774 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3b4d378f-545c-46a1-b7d2-89cc33bbfc9b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:34.951078 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3b4d378f-545c-46a1-b7d2-89cc33bbfc9b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1477 microversion: 2.1 time: 0.642072 Aug 04 16:43:34.966292 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 954/1919] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:34 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1477 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:35.991834 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-29eb63dd-25d4-4204-896a-0d9a5ff45be7 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:35.997098 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-29eb63dd-25d4-4204-896a-0d9a5ff45be7 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:36.064935 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-29eb63dd-25d4-4204-896a-0d9a5ff45be7 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:36.082951 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-29eb63dd-25d4-4204-896a-0d9a5ff45be7 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:36.086080 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-29eb63dd-25d4-4204-896a-0d9a5ff45be7 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:36.087017 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-29eb63dd-25d4-4204-896a-0d9a5ff45be7 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:36.670748 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-29eb63dd-25d4-4204-896a-0d9a5ff45be7 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:36.687934 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-29eb63dd-25d4-4204-896a-0d9a5ff45be7 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1477 microversion: 2.1 time: 0.711856 Aug 04 16:43:36.688612 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 966/1920] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:35 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1477 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:43:37.719065 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-20925511-64a8-439d-bd49-eccaa56358dd tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:37.720948 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-20925511-64a8-439d-bd49-eccaa56358dd tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:37.743732 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-20925511-64a8-439d-bd49-eccaa56358dd tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:37.744224 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-20925511-64a8-439d-bd49-eccaa56358dd tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:37.746355 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-20925511-64a8-439d-bd49-eccaa56358dd tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:37.754904 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-20925511-64a8-439d-bd49-eccaa56358dd tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:38.328755 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-20925511-64a8-439d-bd49-eccaa56358dd tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:38.332598 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:43:38.367647 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-20925511-64a8-439d-bd49-eccaa56358dd tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1477 microversion: 2.1 time: 0.654220 Aug 04 16:43:38.368751 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 955/1921] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:37 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1477 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:39.424553 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-227812ca-265d-45da-853c-53f5d22f4537 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:39.425180 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-227812ca-265d-45da-853c-53f5d22f4537 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:39.507404 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-227812ca-265d-45da-853c-53f5d22f4537 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:39.509021 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-227812ca-265d-45da-853c-53f5d22f4537 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:39.514085 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-227812ca-265d-45da-853c-53f5d22f4537 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:39.516104 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-227812ca-265d-45da-853c-53f5d22f4537 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:39.934841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-227812ca-265d-45da-853c-53f5d22f4537 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:39.947349 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-227812ca-265d-45da-853c-53f5d22f4537 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1477 microversion: 2.1 time: 0.533496 Aug 04 16:43:39.949559 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 956/1922] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:39 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1477 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:40.093131 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-9bd8c1dd-314b-431d-9dc5-5bea2815e467 req-f571f6f0-c8f0-4aa5-8df2-8658795c65e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b80b04-533e-48b5-8595-9de81ed2c526", "name": "network-vif-plugged", "status": "completed", "tag": "1b245f3e-3f81-40cd-9523-09b35900d9ec"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:43:40.170966 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-9bd8c1dd-314b-431d-9dc5-5bea2815e467 req-f571f6f0-c8f0-4aa5-8df2-8658795c65e4 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:40.174073 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-9bd8c1dd-314b-431d-9dc5-5bea2815e467 req-f571f6f0-c8f0-4aa5-8df2-8658795c65e4 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:40.220463 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-9bd8c1dd-314b-431d-9dc5-5bea2815e467 req-f571f6f0-c8f0-4aa5-8df2-8658795c65e4 service nova] Creating event network-vif-plugged:1b245f3e-3f81-40cd-9523-09b35900d9ec for instance 97b80b04-533e-48b5-8595-9de81ed2c526 on n-h1-846466-12 Aug 04 16:43:40.233957 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-9bd8c1dd-314b-431d-9dc5-5bea2815e467 req-f571f6f0-c8f0-4aa5-8df2-8658795c65e4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.123075 Aug 04 16:43:40.235274 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 967/1923] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:43:40.977914 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ab1974f1-a31f-497a-ba29-9099767f0836 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:40.979672 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ab1974f1-a31f-497a-ba29-9099767f0836 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:41.001445 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab1974f1-a31f-497a-ba29-9099767f0836 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:41.010667 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab1974f1-a31f-497a-ba29-9099767f0836 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:41.019852 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab1974f1-a31f-497a-ba29-9099767f0836 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:41.025108 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab1974f1-a31f-497a-ba29-9099767f0836 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:41.542256 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3373390b-0376-4021-8984-bef86db9f5be tempest-QuotasAdminTestV236-326937986 tempest-QuotasAdminTestV236-326937986-project-admin] Action: 'update', calling method: .version_select at 0x7f7e84af1a60>, body: {"quota_set": {"ram": "5120"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:43:41.746140 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ab1974f1-a31f-497a-ba29-9099767f0836 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:41.758966 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ab1974f1-a31f-497a-ba29-9099767f0836 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1477 microversion: 2.1 time: 0.785837 Aug 04 16:43:41.763444 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 968/1924] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:40 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1477 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:42.395512 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3373390b-0376-4021-8984-bef86db9f5be tempest-QuotasAdminTestV236-326937986 tempest-QuotasAdminTestV236-326937986-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:42.396307 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3373390b-0376-4021-8984-bef86db9f5be tempest-QuotasAdminTestV236-326937986 tempest-QuotasAdminTestV236-326937986-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:42.398003 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3373390b-0376-4021-8984-bef86db9f5be tempest-QuotasAdminTestV236-326937986 tempest-QuotasAdminTestV236-326937986-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:42.406158 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3373390b-0376-4021-8984-bef86db9f5be tempest-QuotasAdminTestV236-326937986 tempest-QuotasAdminTestV236-326937986-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:42.528539 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3373390b-0376-4021-8984-bef86db9f5be tempest-QuotasAdminTestV236-326937986 tempest-QuotasAdminTestV236-326937986-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/d4de60d9995a4cf2a53b71c0492eb38f" status: 200 len: 240 microversion: 2.36 time: 1.856302 Aug 04 16:43:42.531320 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 957/1925] 10.222.0.23 () {62 vars in 1303 bytes} [Thu Aug 4 16:43:40 2022] PUT /compute/v2.1/os-quota-sets/d4de60d9995a4cf2a53b71c0492eb38f => generated 240 bytes in 1860 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:43:42.545143 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9ede937b-242f-4da6-9cb6-eb4b8e14ab4b tempest-QuotasAdminTestV236-326937986 tempest-QuotasAdminTestV236-326937986-project-admin] Calling method '.version_select at 0x7f7e77bd19d0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:42.786375 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1943d4fb-9eb1-4b85-8027-6c8805731c4d tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:42.787153 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1943d4fb-9eb1-4b85-8027-6c8805731c4d tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:42.804054 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1943d4fb-9eb1-4b85-8027-6c8805731c4d tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:42.805189 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1943d4fb-9eb1-4b85-8027-6c8805731c4d tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:42.806054 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1943d4fb-9eb1-4b85-8027-6c8805731c4d tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:42.813076 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1943d4fb-9eb1-4b85-8027-6c8805731c4d tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:43.139902 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9ede937b-242f-4da6-9cb6-eb4b8e14ab4b tempest-QuotasAdminTestV236-326937986 tempest-QuotasAdminTestV236-326937986-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:43.143384 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9ede937b-242f-4da6-9cb6-eb4b8e14ab4b tempest-QuotasAdminTestV236-326937986 tempest-QuotasAdminTestV236-326937986-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:43.150372 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9ede937b-242f-4da6-9cb6-eb4b8e14ab4b tempest-QuotasAdminTestV236-326937986 tempest-QuotasAdminTestV236-326937986-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:43.150954 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9ede937b-242f-4da6-9cb6-eb4b8e14ab4b tempest-QuotasAdminTestV236-326937986 tempest-QuotasAdminTestV236-326937986-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:43.231235 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9ede937b-242f-4da6-9cb6-eb4b8e14ab4b tempest-QuotasAdminTestV236-326937986 tempest-QuotasAdminTestV236-326937986-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/d4de60d9995a4cf2a53b71c0492eb38f/detail" status: 200 len: 672 microversion: 2.36 time: 0.689496 Aug 04 16:43:43.243133 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 969/1926] 10.222.0.23 () {60 vars in 1304 bytes} [Thu Aug 4 16:43:42 2022] GET /compute/v2.1/os-quota-sets/d4de60d9995a4cf2a53b71c0492eb38f/detail => generated 672 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:43:43.789242 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4430465c-9c29-4acb-89c3-46a49df7e67e tempest-QuotasAdminTestV236-326937986 tempest-QuotasAdminTestV236-326937986-project-admin] Action: 'update', calling method: .version_select at 0x7f7e77cb3d30>, body: {"quota_set": {"ram": "2048"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:43:43.894497 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1943d4fb-9eb1-4b85-8027-6c8805731c4d tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:43.919970 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1943d4fb-9eb1-4b85-8027-6c8805731c4d tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1463 microversion: 2.1 time: 1.127757 Aug 04 16:43:43.920654 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 958/1927] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:42 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1463 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:43.942113 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2154adb2-129d-4456-9680-239cd9999bab tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:43.943009 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2154adb2-129d-4456-9680-239cd9999bab tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:43.951559 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2154adb2-129d-4456-9680-239cd9999bab tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:43.952314 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2154adb2-129d-4456-9680-239cd9999bab tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:43.953406 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2154adb2-129d-4456-9680-239cd9999bab tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:43.954091 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2154adb2-129d-4456-9680-239cd9999bab tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:44.200810 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4430465c-9c29-4acb-89c3-46a49df7e67e tempest-QuotasAdminTestV236-326937986 tempest-QuotasAdminTestV236-326937986-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:44.204541 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4430465c-9c29-4acb-89c3-46a49df7e67e tempest-QuotasAdminTestV236-326937986 tempest-QuotasAdminTestV236-326937986-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:44.206001 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4430465c-9c29-4acb-89c3-46a49df7e67e tempest-QuotasAdminTestV236-326937986 tempest-QuotasAdminTestV236-326937986-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:44.207436 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4430465c-9c29-4acb-89c3-46a49df7e67e tempest-QuotasAdminTestV236-326937986 tempest-QuotasAdminTestV236-326937986-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:44.259731 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2154adb2-129d-4456-9680-239cd9999bab tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:44.275106 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2154adb2-129d-4456-9680-239cd9999bab tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1463 microversion: 2.1 time: 0.337606 Aug 04 16:43:44.291415 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 959/1928] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:43 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1463 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:44.303244 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-171cf06d-2c73-4832-b516-3c088e175e3c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:43:44.312595 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-171cf06d-2c73-4832-b516-3c088e175e3c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:44.336513 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-171cf06d-2c73-4832-b516-3c088e175e3c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:44.337400 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-171cf06d-2c73-4832-b516-3c088e175e3c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:44.338414 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-171cf06d-2c73-4832-b516-3c088e175e3c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:44.339058 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-171cf06d-2c73-4832-b516-3c088e175e3c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:44.352842 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4430465c-9c29-4acb-89c3-46a49df7e67e tempest-QuotasAdminTestV236-326937986 tempest-QuotasAdminTestV236-326937986-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:44.353295 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4430465c-9c29-4acb-89c3-46a49df7e67e tempest-QuotasAdminTestV236-326937986 tempest-QuotasAdminTestV236-326937986-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:44.354259 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4430465c-9c29-4acb-89c3-46a49df7e67e tempest-QuotasAdminTestV236-326937986 tempest-QuotasAdminTestV236-326937986-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:44.354733 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4430465c-9c29-4acb-89c3-46a49df7e67e tempest-QuotasAdminTestV236-326937986 tempest-QuotasAdminTestV236-326937986-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:44.634075 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-171cf06d-2c73-4832-b516-3c088e175e3c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:43:44.634927 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-171cf06d-2c73-4832-b516-3c088e175e3c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:43:44.635602 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-171cf06d-2c73-4832-b516-3c088e175e3c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:43:44.636865 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-171cf06d-2c73-4832-b516-3c088e175e3c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:43:44.637533 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-171cf06d-2c73-4832-b516-3c088e175e3c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:43:44.642685 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4430465c-9c29-4acb-89c3-46a49df7e67e tempest-QuotasAdminTestV236-326937986 tempest-QuotasAdminTestV236-326937986-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/d4de60d9995a4cf2a53b71c0492eb38f?user_id=60c1e16e0d4e4c03b34a573c6882e4f3" status: 200 len: 240 microversion: 2.36 time: 0.857763 Aug 04 16:43:44.664327 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 970/1929] 10.222.0.23 () {62 vars in 1384 bytes} [Thu Aug 4 16:43:43 2022] PUT /compute/v2.1/os-quota-sets/d4de60d9995a4cf2a53b71c0492eb38f?user_id=60c1e16e0d4e4c03b34a573c6882e4f3 => generated 240 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:43:44.681923 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cf6c6b23-3205-473d-89a2-85197b3b8153 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:44.683647 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cf6c6b23-3205-473d-89a2-85197b3b8153 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:44.708638 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cf6c6b23-3205-473d-89a2-85197b3b8153 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:44.709683 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cf6c6b23-3205-473d-89a2-85197b3b8153 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:44.717968 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cf6c6b23-3205-473d-89a2-85197b3b8153 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:44.719068 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cf6c6b23-3205-473d-89a2-85197b3b8153 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:44.730716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-171cf06d-2c73-4832-b516-3c088e175e3c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:44.753887 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-171cf06d-2c73-4832-b516-3c088e175e3c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:44.756737 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-171cf06d-2c73-4832-b516-3c088e175e3c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:44.758054 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-171cf06d-2c73-4832-b516-3c088e175e3c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:44.760771 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-171cf06d-2c73-4832-b516-3c088e175e3c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:44.838024 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-171cf06d-2c73-4832-b516-3c088e175e3c tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "POST /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526/action" status: 202 len: 1067 microversion: 2.1 time: 0.538797 Aug 04 16:43:44.857884 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 960/1930] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:43:44 2022] POST /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526/action => generated 1067 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 16:43:44.872227 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6c8a594f-af47-4ddb-8901-d8a09eb68fe9 tempest-QuotasAdminTestV236-326937986 tempest-QuotasAdminTestV236-326937986-project-admin] Calling method '.version_select at 0x7f7e848a68b0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:45.465218 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cf6c6b23-3205-473d-89a2-85197b3b8153 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:45.484142 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cf6c6b23-3205-473d-89a2-85197b3b8153 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.817383 Aug 04 16:43:45.485630 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 971/1931] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:44 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:45.495612 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ba5f7190-ecb4-45d5-83e1-660fb0d8fcee tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:45.497412 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ba5f7190-ecb4-45d5-83e1-660fb0d8fcee tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:45.523033 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba5f7190-ecb4-45d5-83e1-660fb0d8fcee tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:45.523835 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba5f7190-ecb4-45d5-83e1-660fb0d8fcee tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:45.527425 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba5f7190-ecb4-45d5-83e1-660fb0d8fcee tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:45.530148 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba5f7190-ecb4-45d5-83e1-660fb0d8fcee tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:45.620640 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6c8a594f-af47-4ddb-8901-d8a09eb68fe9 tempest-QuotasAdminTestV236-326937986 tempest-QuotasAdminTestV236-326937986-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/d4de60d9995a4cf2a53b71c0492eb38f?user_id=60c1e16e0d4e4c03b34a573c6882e4f3" status: 200 len: 282 microversion: 2.36 time: 0.759401 Aug 04 16:43:45.633376 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 961/1932] 10.222.0.23 () {60 vars in 1364 bytes} [Thu Aug 4 16:43:44 2022] GET /compute/v2.1/os-quota-sets/d4de60d9995a4cf2a53b71c0492eb38f?user_id=60c1e16e0d4e4c03b34a573c6882e4f3 => generated 282 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:43:45.676191 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-63978cc3-c313-485e-a09f-25dcaaebc2dd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1598819756"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:43:45.691303 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-63978cc3-c313-485e-a09f-25dcaaebc2dd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:45.733883 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63978cc3-c313-485e-a09f-25dcaaebc2dd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:45.735947 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63978cc3-c313-485e-a09f-25dcaaebc2dd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:45.746123 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63978cc3-c313-485e-a09f-25dcaaebc2dd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:45.747404 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63978cc3-c313-485e-a09f-25dcaaebc2dd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:46.227322 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ba5f7190-ecb4-45d5-83e1-660fb0d8fcee tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:46.258690 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ba5f7190-ecb4-45d5-83e1-660fb0d8fcee tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1472 microversion: 2.1 time: 0.757100 Aug 04 16:43:46.258690 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 972/1933] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:45 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1472 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:46.390052 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-63978cc3-c313-485e-a09f-25dcaaebc2dd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action" status: 202 len: 0 microversion: 2.1 time: 0.756339 Aug 04 16:43:46.392146 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 962/1934] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:43:45 2022] POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action => generated 0 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 04 16:43:46.428143 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-59c7fd59-4a29-48ee-b5f3-70b510b00d72 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:46.436595 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-59c7fd59-4a29-48ee-b5f3-70b510b00d72 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:46.469908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-59c7fd59-4a29-48ee-b5f3-70b510b00d72 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:46.473027 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-59c7fd59-4a29-48ee-b5f3-70b510b00d72 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:46.475108 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-59c7fd59-4a29-48ee-b5f3-70b510b00d72 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:46.476266 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-59c7fd59-4a29-48ee-b5f3-70b510b00d72 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:46.825808 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-27b1fc34-c803-45f2-a767-1ff14b14cd27 req-f368feef-54fb-4815-9ff7-e33f9f528fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c62ae02-0f30-43e1-a005-89dcb8122d4e", "name": "network-vif-unplugged", "status": "completed", "tag": "93c46fa1-3978-4529-9c01-36e6a216c294"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:43:46.875014 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-27b1fc34-c803-45f2-a767-1ff14b14cd27 req-f368feef-54fb-4815-9ff7-e33f9f528fa5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:46.878555 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-27b1fc34-c803-45f2-a767-1ff14b14cd27 req-f368feef-54fb-4815-9ff7-e33f9f528fa5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:46.932969 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-27b1fc34-c803-45f2-a767-1ff14b14cd27 req-f368feef-54fb-4815-9ff7-e33f9f528fa5 service nova] Creating event network-vif-unplugged:93c46fa1-3978-4529-9c01-36e6a216c294 for instance 0c62ae02-0f30-43e1-a005-89dcb8122d4e on n-h1-846466-12 Aug 04 16:43:46.946606 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-27b1fc34-c803-45f2-a767-1ff14b14cd27 req-f368feef-54fb-4815-9ff7-e33f9f528fa5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126422 Aug 04 16:43:46.951110 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 963/1935] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:43:47.163058 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-59c7fd59-4a29-48ee-b5f3-70b510b00d72 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:47.180373 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-59c7fd59-4a29-48ee-b5f3-70b510b00d72 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1679 microversion: 2.1 time: 0.775895 Aug 04 16:43:47.185694 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 973/1936] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:46 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1679 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:47.296299 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d2d11c0b-4da6-4cca-8219-4b86f2cec0fb tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:47.298827 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d2d11c0b-4da6-4cca-8219-4b86f2cec0fb tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:47.330169 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d2d11c0b-4da6-4cca-8219-4b86f2cec0fb tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:47.333961 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d2d11c0b-4da6-4cca-8219-4b86f2cec0fb tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:47.340989 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d2d11c0b-4da6-4cca-8219-4b86f2cec0fb tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:47.344508 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d2d11c0b-4da6-4cca-8219-4b86f2cec0fb tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:48.210145 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1731b8ee-09ad-48d5-9861-59be4524afed tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:48.211518 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1731b8ee-09ad-48d5-9861-59be4524afed tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:48.245148 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1731b8ee-09ad-48d5-9861-59be4524afed tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:48.250951 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1731b8ee-09ad-48d5-9861-59be4524afed tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:48.251279 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d2d11c0b-4da6-4cca-8219-4b86f2cec0fb tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:48.256566 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1731b8ee-09ad-48d5-9861-59be4524afed tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:48.261898 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1731b8ee-09ad-48d5-9861-59be4524afed tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:48.268675 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d2d11c0b-4da6-4cca-8219-4b86f2cec0fb tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1472 microversion: 2.1 time: 0.985998 Aug 04 16:43:48.272730 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 964/1937] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:47 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1472 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:48.375449 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4e3217cb-10d2-4705-9425-ebcfb62480bd tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:48.376752 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4e3217cb-10d2-4705-9425-ebcfb62480bd tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:48.392416 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4e3217cb-10d2-4705-9425-ebcfb62480bd tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:48.392858 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4e3217cb-10d2-4705-9425-ebcfb62480bd tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:48.400473 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4e3217cb-10d2-4705-9425-ebcfb62480bd tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:48.402065 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4e3217cb-10d2-4705-9425-ebcfb62480bd tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:49.186692 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1731b8ee-09ad-48d5-9861-59be4524afed tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:49.205854 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1731b8ee-09ad-48d5-9861-59be4524afed tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1687 microversion: 2.1 time: 1.001848 Aug 04 16:43:49.206906 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 974/1938] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:48 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1687 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:43:49.307212 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f8ffff68-8d90-42eb-bb14-7674ab0e4d97 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:49.308256 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f8ffff68-8d90-42eb-bb14-7674ab0e4d97 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:49.337962 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f8ffff68-8d90-42eb-bb14-7674ab0e4d97 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:49.354568 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f8ffff68-8d90-42eb-bb14-7674ab0e4d97 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:49.355917 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f8ffff68-8d90-42eb-bb14-7674ab0e4d97 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:49.357388 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f8ffff68-8d90-42eb-bb14-7674ab0e4d97 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:49.395561 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4e3217cb-10d2-4705-9425-ebcfb62480bd tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:49.410646 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4e3217cb-10d2-4705-9425-ebcfb62480bd tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:49.418599 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4e3217cb-10d2-4705-9425-ebcfb62480bd tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:49.420989 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4e3217cb-10d2-4705-9425-ebcfb62480bd tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 2945 microversion: 2.32 time: 1.052376 Aug 04 16:43:49.439372 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 965/1939] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:43:48 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 2945 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:43:49.458629 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ad448a5f-502e-4ea2-b36d-b5afb8d6003c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:49.459702 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ad448a5f-502e-4ea2-b36d-b5afb8d6003c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:49.469779 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad448a5f-502e-4ea2-b36d-b5afb8d6003c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:49.470515 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad448a5f-502e-4ea2-b36d-b5afb8d6003c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:49.471624 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad448a5f-502e-4ea2-b36d-b5afb8d6003c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:49.472276 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad448a5f-502e-4ea2-b36d-b5afb8d6003c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:49.808430 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ad448a5f-502e-4ea2-b36d-b5afb8d6003c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.355563 Aug 04 16:43:49.812519 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 966/1940] 10.222.0.23 () {60 vars in 1316 bytes} [Thu Aug 4 16:43:49 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e/os-interface => generated 1832 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:43:50.039753 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f8ffff68-8d90-42eb-bb14-7674ab0e4d97 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:50.069407 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f8ffff68-8d90-42eb-bb14-7674ab0e4d97 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1472 microversion: 2.1 time: 0.767321 Aug 04 16:43:50.070619 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 975/1941] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:49 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1472 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:50.231509 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-29205a6b-09de-4623-aa15-f38353af764c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:50.235251 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-29205a6b-09de-4623-aa15-f38353af764c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:50.254817 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-29205a6b-09de-4623-aa15-f38353af764c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:50.255668 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-29205a6b-09de-4623-aa15-f38353af764c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:50.258730 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-29205a6b-09de-4623-aa15-f38353af764c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:50.260009 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-29205a6b-09de-4623-aa15-f38353af764c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:50.918898 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-29205a6b-09de-4623-aa15-f38353af764c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:50.935789 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-29205a6b-09de-4623-aa15-f38353af764c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1687 microversion: 2.1 time: 0.708765 Aug 04 16:43:50.938606 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 967/1942] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:50 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1687 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:51.096747 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c78179d5-1cde-440f-a2b4-6b3c0d4df722 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:51.098678 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c78179d5-1cde-440f-a2b4-6b3c0d4df722 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:51.111686 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c78179d5-1cde-440f-a2b4-6b3c0d4df722 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:51.119303 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c78179d5-1cde-440f-a2b4-6b3c0d4df722 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:51.119303 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c78179d5-1cde-440f-a2b4-6b3c0d4df722 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:51.119303 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c78179d5-1cde-440f-a2b4-6b3c0d4df722 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:51.967872 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-493b2d9f-7195-4041-b411-535f2e032ae2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:51.977738 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-493b2d9f-7195-4041-b411-535f2e032ae2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:52.008044 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:UPDATE=13,nova_api:SELECT=72,nova_api:INSERT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:43:52.027660 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-493b2d9f-7195-4041-b411-535f2e032ae2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:52.028377 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-493b2d9f-7195-4041-b411-535f2e032ae2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:52.045960 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-493b2d9f-7195-4041-b411-535f2e032ae2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:52.046995 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-493b2d9f-7195-4041-b411-535f2e032ae2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:52.426621 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:43:52.536030 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c78179d5-1cde-440f-a2b4-6b3c0d4df722 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:52.560300 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c78179d5-1cde-440f-a2b4-6b3c0d4df722 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1472 microversion: 2.1 time: 1.468079 Aug 04 16:43:52.574140 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 976/1943] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:51 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1472 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:52.854529 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-493b2d9f-7195-4041-b411-535f2e032ae2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:52.868791 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-493b2d9f-7195-4041-b411-535f2e032ae2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1682 microversion: 2.1 time: 0.912461 Aug 04 16:43:52.869433 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 968/1944] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:51 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1682 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:53.599425 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8f1e4c0a-ed31-4d54-80d3-66e56ef78ad2 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:53.607336 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8f1e4c0a-ed31-4d54-80d3-66e56ef78ad2 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:53.670826 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8f1e4c0a-ed31-4d54-80d3-66e56ef78ad2 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:53.672810 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8f1e4c0a-ed31-4d54-80d3-66e56ef78ad2 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:53.676772 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8f1e4c0a-ed31-4d54-80d3-66e56ef78ad2 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:53.680924 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8f1e4c0a-ed31-4d54-80d3-66e56ef78ad2 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:53.914111 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a7f0ddd9-1377-4568-ad9c-da844406ac8f tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:53.917035 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a7f0ddd9-1377-4568-ad9c-da844406ac8f tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:53.994929 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a7f0ddd9-1377-4568-ad9c-da844406ac8f tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:54.002346 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a7f0ddd9-1377-4568-ad9c-da844406ac8f tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:54.004518 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a7f0ddd9-1377-4568-ad9c-da844406ac8f tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:54.005527 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a7f0ddd9-1377-4568-ad9c-da844406ac8f tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:54.421926 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=7 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:43:54.459180 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8f1e4c0a-ed31-4d54-80d3-66e56ef78ad2 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:54.504275 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8f1e4c0a-ed31-4d54-80d3-66e56ef78ad2 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1472 microversion: 2.1 time: 0.911949 Aug 04 16:43:54.507207 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 977/1945] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:53 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1472 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:54.716258 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a7f0ddd9-1377-4568-ad9c-da844406ac8f tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:54.742346 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a7f0ddd9-1377-4568-ad9c-da844406ac8f tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1682 microversion: 2.1 time: 0.836621 Aug 04 16:43:54.743845 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 969/1946] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:53 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1682 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:55.536279 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0404089f-0049-40c0-bdf4-ad06236cfeb2 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:55.543403 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0404089f-0049-40c0-bdf4-ad06236cfeb2 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:55.593831 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=14 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:43:55.607055 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0404089f-0049-40c0-bdf4-ad06236cfeb2 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:55.624654 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0404089f-0049-40c0-bdf4-ad06236cfeb2 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:55.626791 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0404089f-0049-40c0-bdf4-ad06236cfeb2 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:55.643323 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0404089f-0049-40c0-bdf4-ad06236cfeb2 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:55.770297 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3f921fdc-7bd8-4854-8c6a-b2e8d2ecce32 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:55.771534 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3f921fdc-7bd8-4854-8c6a-b2e8d2ecce32 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:55.828853 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=12 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:43:55.860884 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3f921fdc-7bd8-4854-8c6a-b2e8d2ecce32 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:55.861706 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3f921fdc-7bd8-4854-8c6a-b2e8d2ecce32 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:55.863243 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3f921fdc-7bd8-4854-8c6a-b2e8d2ecce32 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:55.871841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3f921fdc-7bd8-4854-8c6a-b2e8d2ecce32 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:56.401844 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0404089f-0049-40c0-bdf4-ad06236cfeb2 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:56.412198 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0404089f-0049-40c0-bdf4-ad06236cfeb2 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1472 microversion: 2.1 time: 0.884439 Aug 04 16:43:56.412875 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 978/1947] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:55 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1472 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:56.638517 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3f921fdc-7bd8-4854-8c6a-b2e8d2ecce32 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:56.660913 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3f921fdc-7bd8-4854-8c6a-b2e8d2ecce32 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1682 microversion: 2.1 time: 0.897581 Aug 04 16:43:56.665716 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-8373ebe6-bd52-41ff-9c63-21043d91aabb req-325514a1-783e-4c0c-a986-27164c15a473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c62ae02-0f30-43e1-a005-89dcb8122d4e", "name": "network-vif-plugged", "status": "completed", "tag": "93c46fa1-3978-4529-9c01-36e6a216c294"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:43:56.683890 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 970/1948] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:55 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1682 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:56.705777 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-8373ebe6-bd52-41ff-9c63-21043d91aabb req-325514a1-783e-4c0c-a986-27164c15a473 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:56.706240 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-8373ebe6-bd52-41ff-9c63-21043d91aabb req-325514a1-783e-4c0c-a986-27164c15a473 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:56.741936 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-8373ebe6-bd52-41ff-9c63-21043d91aabb req-325514a1-783e-4c0c-a986-27164c15a473 service nova] Creating event network-vif-plugged:93c46fa1-3978-4529-9c01-36e6a216c294 for instance 0c62ae02-0f30-43e1-a005-89dcb8122d4e on n-h1-846466-12 Aug 04 16:43:56.756403 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-8373ebe6-bd52-41ff-9c63-21043d91aabb req-325514a1-783e-4c0c-a986-27164c15a473 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092894 Aug 04 16:43:56.761272 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 979/1949] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:43:57.441872 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b3fd2c89-9abe-498a-93b6-90dd1a4b93b3 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:57.443979 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b3fd2c89-9abe-498a-93b6-90dd1a4b93b3 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:57.496349 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b3fd2c89-9abe-498a-93b6-90dd1a4b93b3 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:57.508324 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b3fd2c89-9abe-498a-93b6-90dd1a4b93b3 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:57.510144 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b3fd2c89-9abe-498a-93b6-90dd1a4b93b3 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:57.511681 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b3fd2c89-9abe-498a-93b6-90dd1a4b93b3 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:57.696855 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-71fcc3a3-fc79-43e7-a7ad-122e6c0b5df1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:57.719817 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-71fcc3a3-fc79-43e7-a7ad-122e6c0b5df1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:57.754345 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-71fcc3a3-fc79-43e7-a7ad-122e6c0b5df1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:57.758148 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-71fcc3a3-fc79-43e7-a7ad-122e6c0b5df1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:57.760853 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-71fcc3a3-fc79-43e7-a7ad-122e6c0b5df1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:57.762616 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-71fcc3a3-fc79-43e7-a7ad-122e6c0b5df1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:58.187077 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b3fd2c89-9abe-498a-93b6-90dd1a4b93b3 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:58.190209 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:43:58.201757 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b3fd2c89-9abe-498a-93b6-90dd1a4b93b3 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1472 microversion: 2.1 time: 0.767333 Aug 04 16:43:58.204692 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 971/1950] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:57 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1472 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:58.318976 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-71fcc3a3-fc79-43e7-a7ad-122e6c0b5df1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:43:58.331497 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-71fcc3a3-fc79-43e7-a7ad-122e6c0b5df1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1682 microversion: 2.1 time: 0.646756 Aug 04 16:43:58.350721 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 980/1951] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:57 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1682 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:43:58.719227 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b53c4d1a-068e-4c82-b20e-006dd54b87a8 tempest-SecurityGroupsTestAdminJSON-1298736483 tempest-SecurityGroupsTestAdminJSON-1298736483-project] Action: 'create', calling method: .version_select at 0x7f7e841dfa60>, body: {"security_group": {"name": "tempest-securitygroup-1367108381", "description": "tempest-description-72336881"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:43:59.308560 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-58446032-8d77-4f87-959b-ebaf96cc7982 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-145832543", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "a690ca05-294e-4f0a-96cd-75ec0df3880f"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:43:59.325361 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:43:59.445913 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-58446032-8d77-4f87-959b-ebaf96cc7982 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] validate_networks() for [('a690ca05-294e-4f0a-96cd-75ec0df3880f', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:43:59.811026 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b53c4d1a-068e-4c82-b20e-006dd54b87a8 tempest-SecurityGroupsTestAdminJSON-1298736483 tempest-SecurityGroupsTestAdminJSON-1298736483-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.604784 Aug 04 16:43:59.819500 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 972/1952] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Aug 4 16:43:58 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:43:59.825139 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-40f1c12c-ab0d-4d37-92af-d0e039f5df99 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:59.825820 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-40f1c12c-ab0d-4d37-92af-d0e039f5df99 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:43:59.835431 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-40f1c12c-ab0d-4d37-92af-d0e039f5df99 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:59.836107 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-40f1c12c-ab0d-4d37-92af-d0e039f5df99 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:43:59.837110 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-40f1c12c-ab0d-4d37-92af-d0e039f5df99 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:43:59.837770 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-40f1c12c-ab0d-4d37-92af-d0e039f5df99 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:00.483696 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-40f1c12c-ab0d-4d37-92af-d0e039f5df99 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:00.507541 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-40f1c12c-ab0d-4d37-92af-d0e039f5df99 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1472 microversion: 2.1 time: 0.686158 Aug 04 16:44:00.514199 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 973/1953] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:43:59 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1472 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:00.553822 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f738507c-7587-4b05-a3b2-830255ca562f tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:00.561059 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f738507c-7587-4b05-a3b2-830255ca562f tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:00.585154 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f738507c-7587-4b05-a3b2-830255ca562f tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:00.587524 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f738507c-7587-4b05-a3b2-830255ca562f tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:00.590290 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f738507c-7587-4b05-a3b2-830255ca562f tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:00.592739 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f738507c-7587-4b05-a3b2-830255ca562f tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:01.107400 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f738507c-7587-4b05-a3b2-830255ca562f tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:01.132255 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f738507c-7587-4b05-a3b2-830255ca562f tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1682 microversion: 2.1 time: 0.597578 Aug 04 16:44:01.133630 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 974/1954] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:00 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1682 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:01.139887 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1ec92856-5ef0-4fb2-b84e-8dccc661d4c7 tempest-SecurityGroupsTestAdminJSON-1298736483 tempest-SecurityGroupsTestAdminJSON-1298736483-project] Action: 'create', calling method: .version_select at 0x7f7e841df160>, body: {"security_group": {"name": "tempest-securitygroup-479326203", "description": "tempest-description-504463048"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:44:01.522152 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-58446032-8d77-4f87-959b-ebaf96cc7982 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:44:01.523450 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-58446032-8d77-4f87-959b-ebaf96cc7982 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:44:01.524292 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-58446032-8d77-4f87-959b-ebaf96cc7982 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:44:01.525224 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-58446032-8d77-4f87-959b-ebaf96cc7982 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:44:01.525889 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-58446032-8d77-4f87-959b-ebaf96cc7982 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:44:01.566233 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58446032-8d77-4f87-959b-ebaf96cc7982 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:01.577316 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58446032-8d77-4f87-959b-ebaf96cc7982 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:01.584092 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58446032-8d77-4f87-959b-ebaf96cc7982 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:01.603182 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58446032-8d77-4f87-959b-ebaf96cc7982 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:01.683617 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-58446032-8d77-4f87-959b-ebaf96cc7982 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Getting quotas for project afa49d3246ea4361abb452e16e017faf. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:44:01.716340 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-58446032-8d77-4f87-959b-ebaf96cc7982 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Getting quotas for user a85f0bd88d79409e9610a47f3ae943ce and project afa49d3246ea4361abb452e16e017faf. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:44:01.787750 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-58446032-8d77-4f87-959b-ebaf96cc7982 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:44:01.797054 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-58446032-8d77-4f87-959b-ebaf96cc7982 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:44:01.797403 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1ec92856-5ef0-4fb2-b84e-8dccc661d4c7 tempest-SecurityGroupsTestAdminJSON-1298736483 tempest-SecurityGroupsTestAdminJSON-1298736483-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.661768 Aug 04 16:44:01.798579 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 975/1955] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Aug 4 16:44:01 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:44:01.811451 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4fd77198-062d-4b1d-adff-f16cbcf96462 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:01.812588 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4fd77198-062d-4b1d-adff-f16cbcf96462 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:01.826529 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4fd77198-062d-4b1d-adff-f16cbcf96462 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:01.827240 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4fd77198-062d-4b1d-adff-f16cbcf96462 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:01.830727 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4fd77198-062d-4b1d-adff-f16cbcf96462 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:01.831316 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4fd77198-062d-4b1d-adff-f16cbcf96462 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:02.077039 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-58446032-8d77-4f87-959b-ebaf96cc7982 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.019562 Aug 04 16:44:02.089642 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 981/1956] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:43:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 3034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:44:02.393890 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4fd77198-062d-4b1d-adff-f16cbcf96462 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:02.416786 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4fd77198-062d-4b1d-adff-f16cbcf96462 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1472 microversion: 2.1 time: 0.613889 Aug 04 16:44:02.418835 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 976/1957] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:01 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1472 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:02.436620 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2f359342-f7ad-45b3-8e06-3b440fe0b6cc tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:02.438459 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2f359342-f7ad-45b3-8e06-3b440fe0b6cc tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:02.691779 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2f359342-f7ad-45b3-8e06-3b440fe0b6cc tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:02.704656 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2f359342-f7ad-45b3-8e06-3b440fe0b6cc tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e" status: 200 len: 1207 microversion: 2.1 time: 0.278787 Aug 04 16:44:02.722753 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 977/1958] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:02 2022] GET /compute/v2.1/servers/6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e => generated 1207 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:02.739046 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b3a89ea0-38d2-4332-9521-a3710a811ceb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:02.743231 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b3a89ea0-38d2-4332-9521-a3710a811ceb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:02.764711 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b3a89ea0-38d2-4332-9521-a3710a811ceb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:02.768657 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b3a89ea0-38d2-4332-9521-a3710a811ceb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:02.773920 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b3a89ea0-38d2-4332-9521-a3710a811ceb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:02.774814 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b3a89ea0-38d2-4332-9521-a3710a811ceb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:03.376007 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4dbc87ef-43f5-446a-868a-ba8d24fb2082 tempest-SecurityGroupsTestAdminJSON-916926096 tempest-SecurityGroupsTestAdminJSON-916926096-project-admin] Action: 'create', calling method: .version_select at 0x7f7e77b61790>, body: {"security_group": {"name": "tempest-securitygroup-1586050386", "description": "tempest-description-1719666961"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:44:03.882848 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b3a89ea0-38d2-4332-9521-a3710a811ceb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:03.894248 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b3a89ea0-38d2-4332-9521-a3710a811ceb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1682 microversion: 2.1 time: 1.169458 Aug 04 16:44:03.896526 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 978/1959] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:02 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1682 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:03.916745 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d45627c8-f33c-4763-973f-dfe138bff83b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:03.919893 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d45627c8-f33c-4763-973f-dfe138bff83b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:03.945002 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d45627c8-f33c-4763-973f-dfe138bff83b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:03.946086 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d45627c8-f33c-4763-973f-dfe138bff83b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:03.949541 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d45627c8-f33c-4763-973f-dfe138bff83b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:03.950242 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d45627c8-f33c-4763-973f-dfe138bff83b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:05.419413 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d45627c8-f33c-4763-973f-dfe138bff83b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:05.432863 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d45627c8-f33c-4763-973f-dfe138bff83b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1472 microversion: 2.1 time: 1.531527 Aug 04 16:44:05.434239 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 979/1960] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:03 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1472 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:05.439005 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4dbc87ef-43f5-446a-868a-ba8d24fb2082 tempest-SecurityGroupsTestAdminJSON-916926096 tempest-SecurityGroupsTestAdminJSON-916926096-project-admin] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 3.347579 Aug 04 16:44:05.447816 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 982/1961] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Aug 4 16:44:02 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 3357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:44:05.453517 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2af1cb4b-2cf7-4eb8-add0-2438bd648516 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:05.454381 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2af1cb4b-2cf7-4eb8-add0-2438bd648516 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:05.463902 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fcfda646-e9fc-47f1-afbc-6938092db9de tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:05.465223 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fcfda646-e9fc-47f1-afbc-6938092db9de tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:05.475791 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2af1cb4b-2cf7-4eb8-add0-2438bd648516 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:05.483689 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2af1cb4b-2cf7-4eb8-add0-2438bd648516 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:05.501869 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2af1cb4b-2cf7-4eb8-add0-2438bd648516 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:05.505998 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2af1cb4b-2cf7-4eb8-add0-2438bd648516 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:05.508058 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fcfda646-e9fc-47f1-afbc-6938092db9de tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:05.511645 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fcfda646-e9fc-47f1-afbc-6938092db9de tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:05.517896 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fcfda646-e9fc-47f1-afbc-6938092db9de tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:05.518640 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fcfda646-e9fc-47f1-afbc-6938092db9de tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:06.107277 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fcfda646-e9fc-47f1-afbc-6938092db9de tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:06.118513 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fcfda646-e9fc-47f1-afbc-6938092db9de tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e" status: 200 len: 1265 microversion: 2.1 time: 0.683051 Aug 04 16:44:06.127268 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 980/1962] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:05 2022] GET /compute/v2.1/servers/6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e => generated 1265 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:06.629499 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2af1cb4b-2cf7-4eb8-add0-2438bd648516 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:06.640932 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=85 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:44:06.702747 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2af1cb4b-2cf7-4eb8-add0-2438bd648516 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1682 microversion: 2.1 time: 1.250617 Aug 04 16:44:06.703615 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 983/1963] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:05 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1682 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:06.722382 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d2285b1e-6e9b-469e-a5ac-6bcb50da9881 tempest-SecurityGroupsTestAdminJSON-916926096 tempest-SecurityGroupsTestAdminJSON-916926096-project-admin] Action: 'create', calling method: .version_select at 0x7f7e77cab820>, body: {"security_group": {"name": "tempest-securitygroup-105942298", "description": "tempest-description-827710301"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:44:06.813738 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-eb85829b-f0bb-46cd-8567-84208b3e650a tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Action: 'create', calling method: .version_select at 0x7f7e841b18b0>, body: {"keypair": {"name": "tempest-keypair-434211813", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtyF9Ra4Kez0v1b49V4NRd/EO6Lum6tSgDOp07MB5h8ulMe8G+NgGK/AgWQokCsf8L1qUb7mVZq2xBvj0q7f28dz7Nnm6PJvXuq/ulCOgKM72Es75M68k/HPNzbsK9XWw=="}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:44:06.859761 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-eb85829b-f0bb-46cd-8567-84208b3e650a tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Getting quotas for project 4f8ad7f728004fa0a6db9fba7c3c9cbd. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:44:06.879352 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-eb85829b-f0bb-46cd-8567-84208b3e650a tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Getting quotas for user 8c9bde1645f64765a41a3f0d65a9ee2e and project 4f8ad7f728004fa0a6db9fba7c3c9cbd. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:44:06.951750 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-eb85829b-f0bb-46cd-8567-84208b3e650a tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.806839 Aug 04 16:44:06.954030 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 981/1964] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 16:44:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:44:06.964625 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a77ec4a3-b336-4c52-927c-4f3ecafa7400 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:06.981347 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a77ec4a3-b336-4c52-927c-4f3ecafa7400 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:07.008302 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a77ec4a3-b336-4c52-927c-4f3ecafa7400 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:07.016533 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a77ec4a3-b336-4c52-927c-4f3ecafa7400 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:07.018827 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a77ec4a3-b336-4c52-927c-4f3ecafa7400 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:07.024360 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a77ec4a3-b336-4c52-927c-4f3ecafa7400 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:07.641672 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a77ec4a3-b336-4c52-927c-4f3ecafa7400 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:07.694802 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a77ec4a3-b336-4c52-927c-4f3ecafa7400 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1472 microversion: 2.1 time: 0.731693 Aug 04 16:44:07.696269 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 982/1965] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:06 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1472 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:07.723917 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-95d82b9b-161e-4652-8235-994230522ffd tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:07.730250 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-95d82b9b-161e-4652-8235-994230522ffd tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:07.775832 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-95d82b9b-161e-4652-8235-994230522ffd tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:07.782290 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-95d82b9b-161e-4652-8235-994230522ffd tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:07.787442 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-95d82b9b-161e-4652-8235-994230522ffd tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:07.789428 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-95d82b9b-161e-4652-8235-994230522ffd tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:08.747918 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-95d82b9b-161e-4652-8235-994230522ffd tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:08.794119 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-95d82b9b-161e-4652-8235-994230522ffd tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e" status: 200 len: 1307 microversion: 2.1 time: 1.090951 Aug 04 16:44:08.832720 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 983/1966] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:07 2022] GET /compute/v2.1/servers/6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e => generated 1307 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:08.848956 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-51be84e2-32ee-494b-904c-dd8ff200fad3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:08.852653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-51be84e2-32ee-494b-904c-dd8ff200fad3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:08.867737 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-51be84e2-32ee-494b-904c-dd8ff200fad3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:08.868821 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-51be84e2-32ee-494b-904c-dd8ff200fad3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:08.871094 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-51be84e2-32ee-494b-904c-dd8ff200fad3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:08.873130 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-51be84e2-32ee-494b-904c-dd8ff200fad3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:09.119037 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d2285b1e-6e9b-469e-a5ac-6bcb50da9881 tempest-SecurityGroupsTestAdminJSON-916926096 tempest-SecurityGroupsTestAdminJSON-916926096-project-admin] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 2.408219 Aug 04 16:44:09.134022 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 984/1967] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Aug 4 16:44:06 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 2424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:44:09.141869 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7c5b3296-5c07-4688-a21a-658d767ab89b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:09.157608 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7c5b3296-5c07-4688-a21a-658d767ab89b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:09.223543 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7c5b3296-5c07-4688-a21a-658d767ab89b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:09.224544 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7c5b3296-5c07-4688-a21a-658d767ab89b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:09.226276 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7c5b3296-5c07-4688-a21a-658d767ab89b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:09.238947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7c5b3296-5c07-4688-a21a-658d767ab89b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:09.973232 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-51be84e2-32ee-494b-904c-dd8ff200fad3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:09.990107 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-51be84e2-32ee-494b-904c-dd8ff200fad3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1682 microversion: 2.1 time: 1.155255 Aug 04 16:44:09.990745 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 984/1968] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:08 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1682 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:10.007561 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d887004d-bfa2-4f38-badd-801323ca313b tempest-SecurityGroupsTestAdminJSON-916926096 tempest-SecurityGroupsTestAdminJSON-916926096-project-admin] Calling method '.version_select at 0x7f7e89b8fe50>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:10.808402 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7c5b3296-5c07-4688-a21a-658d767ab89b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:10.821316 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7c5b3296-5c07-4688-a21a-658d767ab89b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1472 microversion: 2.1 time: 1.685537 Aug 04 16:44:10.821913 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 985/1969] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:09 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1472 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:10.828789 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6416af42-1da4-4a3b-8f6b-9a0df671285d tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:10.834473 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6416af42-1da4-4a3b-8f6b-9a0df671285d tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:10.852435 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6416af42-1da4-4a3b-8f6b-9a0df671285d tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:10.861712 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6416af42-1da4-4a3b-8f6b-9a0df671285d tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:10.863081 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6416af42-1da4-4a3b-8f6b-9a0df671285d tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:10.864045 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6416af42-1da4-4a3b-8f6b-9a0df671285d tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:11.643162 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:44:11.747018 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:44:12.217904 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6416af42-1da4-4a3b-8f6b-9a0df671285d tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:12.254755 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6416af42-1da4-4a3b-8f6b-9a0df671285d tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e" status: 200 len: 1307 microversion: 2.1 time: 1.431447 Aug 04 16:44:12.276233 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 986/1970] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:10 2022] GET /compute/v2.1/servers/6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e => generated 1307 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:12.283183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6534597d-c09d-4637-a101-d371bcb38d76 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:12.296842 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6534597d-c09d-4637-a101-d371bcb38d76 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:12.331117 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6534597d-c09d-4637-a101-d371bcb38d76 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:12.331992 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6534597d-c09d-4637-a101-d371bcb38d76 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:12.333232 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6534597d-c09d-4637-a101-d371bcb38d76 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:12.333879 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6534597d-c09d-4637-a101-d371bcb38d76 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:14.552723 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6534597d-c09d-4637-a101-d371bcb38d76 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:14.566050 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6534597d-c09d-4637-a101-d371bcb38d76 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1682 microversion: 2.1 time: 2.289117 Aug 04 16:44:14.568631 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 987/1971] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:12 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1682 bytes in 2293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:14.576429 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2c94ec71-337b-45bf-a263-0e12aa6fd592 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:14.578850 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2c94ec71-337b-45bf-a263-0e12aa6fd592 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:14.589936 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2c94ec71-337b-45bf-a263-0e12aa6fd592 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:14.591143 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2c94ec71-337b-45bf-a263-0e12aa6fd592 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:14.591991 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2c94ec71-337b-45bf-a263-0e12aa6fd592 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:14.592440 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2c94ec71-337b-45bf-a263-0e12aa6fd592 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:15.664034 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2c94ec71-337b-45bf-a263-0e12aa6fd592 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:15.707303 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2c94ec71-337b-45bf-a263-0e12aa6fd592 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1478 microversion: 2.1 time: 1.136374 Aug 04 16:44:15.726453 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 988/1972] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:14 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1478 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:15.760540 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f3a02ee7-85ef-4745-b50e-ebf8eb574d86 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:15.761695 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f3a02ee7-85ef-4745-b50e-ebf8eb574d86 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:15.786423 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3a02ee7-85ef-4745-b50e-ebf8eb574d86 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:15.787400 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3a02ee7-85ef-4745-b50e-ebf8eb574d86 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:15.788426 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3a02ee7-85ef-4745-b50e-ebf8eb574d86 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:15.802512 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3a02ee7-85ef-4745-b50e-ebf8eb574d86 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:16.745505 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f3a02ee7-85ef-4745-b50e-ebf8eb574d86 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:16.818001 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f3a02ee7-85ef-4745-b50e-ebf8eb574d86 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e" status: 200 len: 1307 microversion: 2.1 time: 1.089025 Aug 04 16:44:16.835468 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 989/1973] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:15 2022] GET /compute/v2.1/servers/6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e => generated 1307 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:16.905321 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:44:17.492218 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-50a48dfd-a5a9-4400-bb8a-e3a155bd55a1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1687633067", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "fd9ba46f-9583-4f53-9ced-a3b1af7aa6df"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:44:17.670476 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-50a48dfd-a5a9-4400-bb8a-e3a155bd55a1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] validate_networks() for [('fd9ba46f-9583-4f53-9ced-a3b1af7aa6df', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:44:18.866016 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:44:19.701541 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-50a48dfd-a5a9-4400-bb8a-e3a155bd55a1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:44:19.702486 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-50a48dfd-a5a9-4400-bb8a-e3a155bd55a1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:44:19.703503 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-50a48dfd-a5a9-4400-bb8a-e3a155bd55a1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:44:19.705069 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-50a48dfd-a5a9-4400-bb8a-e3a155bd55a1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:44:19.706283 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-50a48dfd-a5a9-4400-bb8a-e3a155bd55a1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:44:19.750425 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50a48dfd-a5a9-4400-bb8a-e3a155bd55a1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:19.752088 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50a48dfd-a5a9-4400-bb8a-e3a155bd55a1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:19.760283 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50a48dfd-a5a9-4400-bb8a-e3a155bd55a1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:19.761232 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50a48dfd-a5a9-4400-bb8a-e3a155bd55a1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:19.854705 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-50a48dfd-a5a9-4400-bb8a-e3a155bd55a1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Getting quotas for project 60281cf1dbe645d8949e93f9e70b5d91. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:44:19.873117 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-50a48dfd-a5a9-4400-bb8a-e3a155bd55a1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Getting quotas for user 3cfb4739b53b411391a26de37b98469f and project 60281cf1dbe645d8949e93f9e70b5d91. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:44:19.926463 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-50a48dfd-a5a9-4400-bb8a-e3a155bd55a1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:44:19.931119 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-50a48dfd-a5a9-4400-bb8a-e3a155bd55a1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 8f6461bb-aeb9-459a-8518-47055bfd5f41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:44:19.983497 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=55 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:44:20.072633 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-50a48dfd-a5a9-4400-bb8a-e3a155bd55a1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.234632 Aug 04 16:44:20.074710 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 990/1974] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:44:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 3238 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:44:20.086115 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7d7d82f1-322a-4387-9314-ad9fd0322de4 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "67cfa9a8-1188-400a-8196-6d7c8d6be0b3"}], "security_groups": [{"name": "tempest-securitygroup--1666012109"}], "key_name": "tempest-keypair-434211813", "user_data": "}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:44:20.576445 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-7d7d82f1-322a-4387-9314-ad9fd0322de4 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] validate_networks() for [('67cfa9a8-1188-400a-8196-6d7c8d6be0b3', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:44:21.036313 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d887004d-bfa2-4f38-badd-801323ca313b tempest-SecurityGroupsTestAdminJSON-916926096 tempest-SecurityGroupsTestAdminJSON-916926096-project-admin] 10.222.0.23 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11609 microversion: 2.1 time: 11.039950 Aug 04 16:44:21.038580 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 985/1975] 10.222.0.23 () {58 vars in 1191 bytes} [Thu Aug 4 16:44:09 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11609 bytes in 11044 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:44:21.061198 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-f229b00e-d164-473d-9c94-00e8a62c2ba4 req-85dedd6b-bcd4-44f1-9d33-7af97ce1e94a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e", "tag": "a6611342-a3b8-4d7d-b82d-62a23bc1209a"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:44:21.092900 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f229b00e-d164-473d-9c94-00e8a62c2ba4 req-85dedd6b-bcd4-44f1-9d33-7af97ce1e94a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:21.093918 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f229b00e-d164-473d-9c94-00e8a62c2ba4 req-85dedd6b-bcd4-44f1-9d33-7af97ce1e94a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:21.136382 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-f229b00e-d164-473d-9c94-00e8a62c2ba4 req-85dedd6b-bcd4-44f1-9d33-7af97ce1e94a service nova] Creating event network-changed:a6611342-a3b8-4d7d-b82d-62a23bc1209a for instance 6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e on n-h2-846466-12 Aug 04 16:44:21.152527 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-f229b00e-d164-473d-9c94-00e8a62c2ba4 req-85dedd6b-bcd4-44f1-9d33-7af97ce1e94a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108109 Aug 04 16:44:21.156453 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 986/1976] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:44:21.172201 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-edc94fb8-db5b-4317-b041-a19ca36f1b79 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:21.179764 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-edc94fb8-db5b-4317-b041-a19ca36f1b79 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:21.210612 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-edc94fb8-db5b-4317-b041-a19ca36f1b79 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:21.211631 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-edc94fb8-db5b-4317-b041-a19ca36f1b79 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:21.239513 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-edc94fb8-db5b-4317-b041-a19ca36f1b79 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:21.252064 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-edc94fb8-db5b-4317-b041-a19ca36f1b79 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:21.835052 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-edc94fb8-db5b-4317-b041-a19ca36f1b79 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:21.892563 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-edc94fb8-db5b-4317-b041-a19ca36f1b79 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1682 microversion: 2.1 time: 0.711157 Aug 04 16:44:21.895189 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 987/1977] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:21 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1682 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:21.939118 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5fc57f31-a12a-4c5b-ad25-9084da34a0fa tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:21.941731 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5fc57f31-a12a-4c5b-ad25-9084da34a0fa tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:21.957593 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5fc57f31-a12a-4c5b-ad25-9084da34a0fa tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:21.958299 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5fc57f31-a12a-4c5b-ad25-9084da34a0fa tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:21.959507 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5fc57f31-a12a-4c5b-ad25-9084da34a0fa tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:21.960114 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5fc57f31-a12a-4c5b-ad25-9084da34a0fa tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:23.080635 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-7d7d82f1-322a-4387-9314-ad9fd0322de4 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:44:23.082356 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-7d7d82f1-322a-4387-9314-ad9fd0322de4 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:44:23.082982 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-7d7d82f1-322a-4387-9314-ad9fd0322de4 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:44:23.083522 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-7d7d82f1-322a-4387-9314-ad9fd0322de4 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:44:23.084035 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-7d7d82f1-322a-4387-9314-ad9fd0322de4 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:44:23.097066 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d7d82f1-322a-4387-9314-ad9fd0322de4 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:23.098098 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d7d82f1-322a-4387-9314-ad9fd0322de4 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:23.099768 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d7d82f1-322a-4387-9314-ad9fd0322de4 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:23.100475 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d7d82f1-322a-4387-9314-ad9fd0322de4 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:23.150935 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-7d7d82f1-322a-4387-9314-ad9fd0322de4 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Getting quotas for project 4f8ad7f728004fa0a6db9fba7c3c9cbd. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:44:23.161693 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-7d7d82f1-322a-4387-9314-ad9fd0322de4 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Getting quotas for user 8c9bde1645f64765a41a3f0d65a9ee2e and project 4f8ad7f728004fa0a6db9fba7c3c9cbd. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:44:23.178636 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7d7d82f1-322a-4387-9314-ad9fd0322de4 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:44:23.184244 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7d7d82f1-322a-4387-9314-ad9fd0322de4 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] [instance: 632449ba-73dd-4aeb-bc39-f26d6de4e726] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:44:23.336209 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7d7d82f1-322a-4387-9314-ad9fd0322de4 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.259264 Aug 04 16:44:23.349158 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 991/1978] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:44:20 2022] POST /compute/v2.1/servers => generated 409 bytes in 3262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:44:23.358925 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-3cb9987f-0a31-418e-926c-76de38c42376 req-ea629971-1e9b-45bc-951e-f92fa4bb7bd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b80b04-533e-48b5-8595-9de81ed2c526", "name": "network-vif-unplugged", "status": "completed", "tag": "1b245f3e-3f81-40cd-9523-09b35900d9ec"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:44:23.387141 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-3cb9987f-0a31-418e-926c-76de38c42376 req-ea629971-1e9b-45bc-951e-f92fa4bb7bd7 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:23.388147 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-3cb9987f-0a31-418e-926c-76de38c42376 req-ea629971-1e9b-45bc-951e-f92fa4bb7bd7 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:23.413844 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5fc57f31-a12a-4c5b-ad25-9084da34a0fa tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:23.423916 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-3cb9987f-0a31-418e-926c-76de38c42376 req-ea629971-1e9b-45bc-951e-f92fa4bb7bd7 service nova] Creating event network-vif-unplugged:1b245f3e-3f81-40cd-9523-09b35900d9ec for instance 97b80b04-533e-48b5-8595-9de81ed2c526 on n-h1-846466-12 Aug 04 16:44:23.430213 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5fc57f31-a12a-4c5b-ad25-9084da34a0fa tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1478 microversion: 2.1 time: 1.530294 Aug 04 16:44:23.430842 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 988/1979] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:21 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1478 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:23.439508 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-3cb9987f-0a31-418e-926c-76de38c42376 req-ea629971-1e9b-45bc-951e-f92fa4bb7bd7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085980 Aug 04 16:44:23.440997 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 992/1980] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:44:23.452922 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f8c5a6c0-f09c-414d-a121-6df4bb3c3ea9 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:23.455400 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f8c5a6c0-f09c-414d-a121-6df4bb3c3ea9 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 8f6461bb-aeb9-459a-8518-47055bfd5f41] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:23.456953 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-23cbe781-57ac-43bd-9127-210e85f9d754 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:23.464403 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-23cbe781-57ac-43bd-9127-210e85f9d754 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:23.472776 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f8c5a6c0-f09c-414d-a121-6df4bb3c3ea9 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:23.474097 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f8c5a6c0-f09c-414d-a121-6df4bb3c3ea9 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:23.476086 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f8c5a6c0-f09c-414d-a121-6df4bb3c3ea9 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:23.477138 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f8c5a6c0-f09c-414d-a121-6df4bb3c3ea9 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:23.511656 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-23cbe781-57ac-43bd-9127-210e85f9d754 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:23.512362 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-23cbe781-57ac-43bd-9127-210e85f9d754 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:23.527629 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-23cbe781-57ac-43bd-9127-210e85f9d754 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:23.531648 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-23cbe781-57ac-43bd-9127-210e85f9d754 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:23.934297 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f8c5a6c0-f09c-414d-a121-6df4bb3c3ea9 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:23.946913 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f8c5a6c0-f09c-414d-a121-6df4bb3c3ea9 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/8f6461bb-aeb9-459a-8518-47055bfd5f41" status: 200 len: 1273 microversion: 2.1 time: 0.503495 Aug 04 16:44:23.961332 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 993/1981] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:23 2022] GET /compute/v2.1/servers/8f6461bb-aeb9-459a-8518-47055bfd5f41 => generated 1273 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:23.961332 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f150068e-b537-482b-828b-d534e2c667b7 tempest-SecurityGroupsTestAdminJSON-1298736483 tempest-SecurityGroupsTestAdminJSON-1298736483-project] Calling method '.version_select at 0x7f7e77c5b5e0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:24.430446 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-23cbe781-57ac-43bd-9127-210e85f9d754 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:24.454808 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-23cbe781-57ac-43bd-9127-210e85f9d754 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e" status: 200 len: 1307 microversion: 2.1 time: 1.021672 Aug 04 16:44:24.458582 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 989/1982] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:23 2022] GET /compute/v2.1/servers/6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e => generated 1307 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:24.471394 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b35b004e-44af-43ff-8792-d5b04145cb08 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:24.475195 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b35b004e-44af-43ff-8792-d5b04145cb08 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:24.518488 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b35b004e-44af-43ff-8792-d5b04145cb08 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:24.524338 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b35b004e-44af-43ff-8792-d5b04145cb08 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:24.527165 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b35b004e-44af-43ff-8792-d5b04145cb08 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:24.533960 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b35b004e-44af-43ff-8792-d5b04145cb08 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:24.685580 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f150068e-b537-482b-828b-d534e2c667b7 tempest-SecurityGroupsTestAdminJSON-1298736483 tempest-SecurityGroupsTestAdminJSON-1298736483-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1109 microversion: 2.1 time: 0.736462 Aug 04 16:44:24.686916 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 994/1983] 10.222.0.23 () {58 vars in 1191 bytes} [Thu Aug 4 16:44:23 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1109 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:24.698750 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8292bc92-e121-4aba-9b27-36755466b0a4 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:24.699760 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8292bc92-e121-4aba-9b27-36755466b0a4 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] [instance: 632449ba-73dd-4aeb-bc39-f26d6de4e726] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:24.708243 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8292bc92-e121-4aba-9b27-36755466b0a4 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:24.708703 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8292bc92-e121-4aba-9b27-36755466b0a4 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:24.709618 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8292bc92-e121-4aba-9b27-36755466b0a4 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:24.710127 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8292bc92-e121-4aba-9b27-36755466b0a4 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:24.881701 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8292bc92-e121-4aba-9b27-36755466b0a4 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9bde1645f64765a41a3f0d65a9ee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8ad7f728004fa0a6db9fba7c3c9cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:24.894277 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8292bc92-e121-4aba-9b27-36755466b0a4 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] 10.222.0.23 "GET /compute/v2.1/servers/632449ba-73dd-4aeb-bc39-f26d6de4e726" status: 200 len: 1277 microversion: 2.1 time: 0.205984 Aug 04 16:44:24.905392 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 995/1984] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:24 2022] GET /compute/v2.1/servers/632449ba-73dd-4aeb-bc39-f26d6de4e726 => generated 1277 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:24.905392 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-55e86f40-cb29-495d-9728-a18debc48c5f tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:24.905392 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-55e86f40-cb29-495d-9728-a18debc48c5f tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:24.926683 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-55e86f40-cb29-495d-9728-a18debc48c5f tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:24.927170 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-55e86f40-cb29-495d-9728-a18debc48c5f tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:24.928016 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-55e86f40-cb29-495d-9728-a18debc48c5f tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:24.928464 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-55e86f40-cb29-495d-9728-a18debc48c5f tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:25.086351 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b35b004e-44af-43ff-8792-d5b04145cb08 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:25.109865 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b35b004e-44af-43ff-8792-d5b04145cb08 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1682 microversion: 2.1 time: 0.645981 Aug 04 16:44:25.112703 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 990/1985] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:24 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1682 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:25.163003 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cc6ce174-003a-4ce0-8de5-257a7ff70db0 tempest-SecurityGroupsTestAdminJSON-916926096 tempest-SecurityGroupsTestAdminJSON-916926096-project-admin] Calling method '.version_select at 0x7f7e841be280>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:25.407467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-55e86f40-cb29-495d-9728-a18debc48c5f tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:25.418614 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-55e86f40-cb29-495d-9728-a18debc48c5f tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1478 microversion: 2.1 time: 0.519086 Aug 04 16:44:25.419353 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 996/1986] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:24 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1478 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:25.445932 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cbd62dc0-a76d-4964-901a-1d84c220af12 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:25.447649 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cbd62dc0-a76d-4964-901a-1d84c220af12 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 8f6461bb-aeb9-459a-8518-47055bfd5f41] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:25.466758 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cbd62dc0-a76d-4964-901a-1d84c220af12 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:25.468218 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cbd62dc0-a76d-4964-901a-1d84c220af12 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:25.470606 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cbd62dc0-a76d-4964-901a-1d84c220af12 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:25.472001 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cbd62dc0-a76d-4964-901a-1d84c220af12 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:25.662189 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cbd62dc0-a76d-4964-901a-1d84c220af12 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:25.695399 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cbd62dc0-a76d-4964-901a-1d84c220af12 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/8f6461bb-aeb9-459a-8518-47055bfd5f41" status: 200 len: 1273 microversion: 2.1 time: 0.274267 Aug 04 16:44:25.696841 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 997/1987] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:25 2022] GET /compute/v2.1/servers/8f6461bb-aeb9-459a-8518-47055bfd5f41 => generated 1273 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:25.711026 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-539fc9a4-6cd7-458e-b906-e8d4d7fa240b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:25.711026 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-539fc9a4-6cd7-458e-b906-e8d4d7fa240b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:25.723442 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-539fc9a4-6cd7-458e-b906-e8d4d7fa240b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:25.725633 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-539fc9a4-6cd7-458e-b906-e8d4d7fa240b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:25.727967 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-539fc9a4-6cd7-458e-b906-e8d4d7fa240b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:25.728981 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-539fc9a4-6cd7-458e-b906-e8d4d7fa240b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:26.551488 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-539fc9a4-6cd7-458e-b906-e8d4d7fa240b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:26.596187 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-539fc9a4-6cd7-458e-b906-e8d4d7fa240b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e" status: 200 len: 1307 microversion: 2.1 time: 0.896319 Aug 04 16:44:26.597649 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 998/1988] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:25 2022] GET /compute/v2.1/servers/6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e => generated 1307 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:26.614907 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-34a3ed89-b889-455f-bd8a-f3979b3d49df req-badaff35-530f-4b5d-b17e-983039fce8dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b80b04-533e-48b5-8595-9de81ed2c526", "name": "network-vif-plugged", "status": "completed", "tag": "1b245f3e-3f81-40cd-9523-09b35900d9ec"}, {"server_uuid": "6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e", "name": "network-vif-plugged", "status": "completed", "tag": "a6611342-a3b8-4d7d-b82d-62a23bc1209a"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:44:26.637621 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-34a3ed89-b889-455f-bd8a-f3979b3d49df req-badaff35-530f-4b5d-b17e-983039fce8dd service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:26.638502 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-34a3ed89-b889-455f-bd8a-f3979b3d49df req-badaff35-530f-4b5d-b17e-983039fce8dd service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:26.669183 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-34a3ed89-b889-455f-bd8a-f3979b3d49df req-badaff35-530f-4b5d-b17e-983039fce8dd service nova] Creating event network-vif-plugged:1b245f3e-3f81-40cd-9523-09b35900d9ec for instance 97b80b04-533e-48b5-8595-9de81ed2c526 on n-h1-846466-12 Aug 04 16:44:26.669960 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-34a3ed89-b889-455f-bd8a-f3979b3d49df req-badaff35-530f-4b5d-b17e-983039fce8dd service nova] Creating event network-vif-plugged:a6611342-a3b8-4d7d-b82d-62a23bc1209a for instance 6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e on n-h2-846466-12 Aug 04 16:44:26.686697 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-34a3ed89-b889-455f-bd8a-f3979b3d49df req-badaff35-530f-4b5d-b17e-983039fce8dd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.086682 Aug 04 16:44:26.688260 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 999/1989] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:44:26.697981 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-95696327-3292-4108-81fd-11bf4631ada2 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:26.700871 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-95696327-3292-4108-81fd-11bf4631ada2 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] [instance: 632449ba-73dd-4aeb-bc39-f26d6de4e726] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:26.709858 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-95696327-3292-4108-81fd-11bf4631ada2 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:26.710740 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-95696327-3292-4108-81fd-11bf4631ada2 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:26.711730 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-95696327-3292-4108-81fd-11bf4631ada2 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:26.712480 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-95696327-3292-4108-81fd-11bf4631ada2 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:26.733885 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cc6ce174-003a-4ce0-8de5-257a7ff70db0 tempest-SecurityGroupsTestAdminJSON-916926096 tempest-SecurityGroupsTestAdminJSON-916926096-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/7bd4e3a4-6651-46e4-920f-041f4b44d897" status: 202 len: 0 microversion: 2.1 time: 1.618992 Aug 04 16:44:26.735285 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 991/1990] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:44:25 2022] DELETE /compute/v2.1/os-security-groups/7bd4e3a4-6651-46e4-920f-041f4b44d897 => generated 0 bytes in 1621 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:44:26.749065 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d42b144b-0e00-4736-a264-1923285d0069 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:26.752221 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d42b144b-0e00-4736-a264-1923285d0069 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:26.788029 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d42b144b-0e00-4736-a264-1923285d0069 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:26.797169 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d42b144b-0e00-4736-a264-1923285d0069 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:26.799372 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d42b144b-0e00-4736-a264-1923285d0069 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:26.806642 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d42b144b-0e00-4736-a264-1923285d0069 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:26.942107 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-95696327-3292-4108-81fd-11bf4631ada2 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9bde1645f64765a41a3f0d65a9ee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8ad7f728004fa0a6db9fba7c3c9cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:26.962118 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-95696327-3292-4108-81fd-11bf4631ada2 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] 10.222.0.23 "GET /compute/v2.1/servers/632449ba-73dd-4aeb-bc39-f26d6de4e726" status: 200 len: 1283 microversion: 2.1 time: 0.266651 Aug 04 16:44:26.963219 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1000/1991] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:26 2022] GET /compute/v2.1/servers/632449ba-73dd-4aeb-bc39-f26d6de4e726 => generated 1283 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:26.972342 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e5eb8114-01f6-4964-9c6c-1dbaccf4a117 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:26.973082 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e5eb8114-01f6-4964-9c6c-1dbaccf4a117 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:27.008328 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e5eb8114-01f6-4964-9c6c-1dbaccf4a117 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:27.012271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e5eb8114-01f6-4964-9c6c-1dbaccf4a117 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:27.021244 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e5eb8114-01f6-4964-9c6c-1dbaccf4a117 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:27.022584 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e5eb8114-01f6-4964-9c6c-1dbaccf4a117 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:27.694791 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d42b144b-0e00-4736-a264-1923285d0069 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:27.705240 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d42b144b-0e00-4736-a264-1923285d0069 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.968349 Aug 04 16:44:27.706710 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 992/1992] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:26 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:27.712566 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0963666e-986f-4f8b-a74b-dc6b930a27ee tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:27.714046 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0963666e-986f-4f8b-a74b-dc6b930a27ee tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 8f6461bb-aeb9-459a-8518-47055bfd5f41] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:27.721425 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0963666e-986f-4f8b-a74b-dc6b930a27ee tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:27.722364 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0963666e-986f-4f8b-a74b-dc6b930a27ee tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:27.723330 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0963666e-986f-4f8b-a74b-dc6b930a27ee tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:27.723906 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0963666e-986f-4f8b-a74b-dc6b930a27ee tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:27.793988 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e5eb8114-01f6-4964-9c6c-1dbaccf4a117 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:27.812694 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e5eb8114-01f6-4964-9c6c-1dbaccf4a117 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1478 microversion: 2.1 time: 0.848025 Aug 04 16:44:27.814234 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1001/1993] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:26 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1478 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:27.821680 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0a6f2dcb-699f-43a1-9b8b-e24ff55aeb3c tempest-SecurityGroupsTestAdminJSON-916926096 tempest-SecurityGroupsTestAdminJSON-916926096-project-admin] Calling method '.version_select at 0x7f7e77ba9280>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:28.286557 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0963666e-986f-4f8b-a74b-dc6b930a27ee tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:28.302695 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0963666e-986f-4f8b-a74b-dc6b930a27ee tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/8f6461bb-aeb9-459a-8518-47055bfd5f41" status: 200 len: 1315 microversion: 2.1 time: 0.594200 Aug 04 16:44:28.303857 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 993/1994] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:27 2022] GET /compute/v2.1/servers/8f6461bb-aeb9-459a-8518-47055bfd5f41 => generated 1315 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:28.317368 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-741677a2-279f-4636-b4cc-5639c070d6ce tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:28.318819 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-741677a2-279f-4636-b4cc-5639c070d6ce tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:28.354324 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-741677a2-279f-4636-b4cc-5639c070d6ce tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:28.355464 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-741677a2-279f-4636-b4cc-5639c070d6ce tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:28.357015 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-741677a2-279f-4636-b4cc-5639c070d6ce tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:28.357750 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-741677a2-279f-4636-b4cc-5639c070d6ce tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:29.019829 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0a6f2dcb-699f-43a1-9b8b-e24ff55aeb3c tempest-SecurityGroupsTestAdminJSON-916926096 tempest-SecurityGroupsTestAdminJSON-916926096-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/3466877f-acca-4077-904c-06779fc28f0b" status: 202 len: 0 microversion: 2.1 time: 1.199261 Aug 04 16:44:29.028644 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1002/1995] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:44:27 2022] DELETE /compute/v2.1/os-security-groups/3466877f-acca-4077-904c-06779fc28f0b => generated 0 bytes in 1213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:44:29.036935 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1b6989e0-9df0-4f47-af54-a8cd7516f8fd tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:29.038625 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1b6989e0-9df0-4f47-af54-a8cd7516f8fd tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] [instance: 632449ba-73dd-4aeb-bc39-f26d6de4e726] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:29.050671 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1b6989e0-9df0-4f47-af54-a8cd7516f8fd tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:29.052924 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1b6989e0-9df0-4f47-af54-a8cd7516f8fd tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:29.057706 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1b6989e0-9df0-4f47-af54-a8cd7516f8fd tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:29.059827 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1b6989e0-9df0-4f47-af54-a8cd7516f8fd tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:29.145812 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-741677a2-279f-4636-b4cc-5639c070d6ce tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:29.158389 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-741677a2-279f-4636-b4cc-5639c070d6ce tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e" status: 200 len: 1307 microversion: 2.1 time: 0.852763 Aug 04 16:44:29.159456 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 994/1996] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:28 2022] GET /compute/v2.1/servers/6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e => generated 1307 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:29.173857 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1e5beb96-0586-455f-92cb-1d0dddad44e9 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:29.174497 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1e5beb96-0586-455f-92cb-1d0dddad44e9 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:29.201231 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1e5beb96-0586-455f-92cb-1d0dddad44e9 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:29.202636 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1e5beb96-0586-455f-92cb-1d0dddad44e9 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:29.205429 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1e5beb96-0586-455f-92cb-1d0dddad44e9 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:29.206822 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1e5beb96-0586-455f-92cb-1d0dddad44e9 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:29.542074 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1b6989e0-9df0-4f47-af54-a8cd7516f8fd tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9bde1645f64765a41a3f0d65a9ee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8ad7f728004fa0a6db9fba7c3c9cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:29.559017 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1b6989e0-9df0-4f47-af54-a8cd7516f8fd tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] 10.222.0.23 "GET /compute/v2.1/servers/632449ba-73dd-4aeb-bc39-f26d6de4e726" status: 200 len: 1351 microversion: 2.1 time: 0.528248 Aug 04 16:44:29.561439 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1003/1997] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:29 2022] GET /compute/v2.1/servers/632449ba-73dd-4aeb-bc39-f26d6de4e726 => generated 1351 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:29.575235 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-372ad745-6e8a-49b1-8091-67ff0ea4c9ea tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:29.576733 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-372ad745-6e8a-49b1-8091-67ff0ea4c9ea tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:29.582966 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=9 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:44:29.591380 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-372ad745-6e8a-49b1-8091-67ff0ea4c9ea tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:29.592451 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-372ad745-6e8a-49b1-8091-67ff0ea4c9ea tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:29.594651 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-372ad745-6e8a-49b1-8091-67ff0ea4c9ea tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:29.595804 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-372ad745-6e8a-49b1-8091-67ff0ea4c9ea tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:29.739898 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1e5beb96-0586-455f-92cb-1d0dddad44e9 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:29.752350 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1e5beb96-0586-455f-92cb-1d0dddad44e9 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1463 microversion: 2.1 time: 0.591218 Aug 04 16:44:29.753522 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 995/1998] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:29 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1463 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:29.765210 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e5e9bacf-cc91-4c8c-81da-558c60fa83fc tempest-SecurityGroupsTestAdminJSON-1298736483 tempest-SecurityGroupsTestAdminJSON-1298736483-project] Calling method '.version_select at 0x7f7e842169d0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:30.333857 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-372ad745-6e8a-49b1-8091-67ff0ea4c9ea tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:30.348347 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-372ad745-6e8a-49b1-8091-67ff0ea4c9ea tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.782533 Aug 04 16:44:30.349562 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1004/1999] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:29 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:30.363463 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2623563e-b3bc-4ce2-9b88-26c8b353c2d4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:30.366969 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2623563e-b3bc-4ce2-9b88-26c8b353c2d4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 8f6461bb-aeb9-459a-8518-47055bfd5f41] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:30.380374 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2623563e-b3bc-4ce2-9b88-26c8b353c2d4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:30.381742 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2623563e-b3bc-4ce2-9b88-26c8b353c2d4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:30.383475 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2623563e-b3bc-4ce2-9b88-26c8b353c2d4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:30.384611 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2623563e-b3bc-4ce2-9b88-26c8b353c2d4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:30.883522 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2623563e-b3bc-4ce2-9b88-26c8b353c2d4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:30.902549 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2623563e-b3bc-4ce2-9b88-26c8b353c2d4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/8f6461bb-aeb9-459a-8518-47055bfd5f41" status: 200 len: 1315 microversion: 2.1 time: 0.547751 Aug 04 16:44:30.905154 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1005/2000] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:30 2022] GET /compute/v2.1/servers/8f6461bb-aeb9-459a-8518-47055bfd5f41 => generated 1315 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:30.915559 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-ec7dc674-bd5d-45b9-a85c-961805046e5f req-e3af94ff-ac7a-46df-b255-ece08e542eab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f6461bb-aeb9-459a-8518-47055bfd5f41", "tag": "a2d89e60-6642-4d21-9485-0ab90d28d1ae"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:44:30.947011 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-ec7dc674-bd5d-45b9-a85c-961805046e5f req-e3af94ff-ac7a-46df-b255-ece08e542eab service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:30.947612 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-ec7dc674-bd5d-45b9-a85c-961805046e5f req-e3af94ff-ac7a-46df-b255-ece08e542eab service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:30.960787 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e5e9bacf-cc91-4c8c-81da-558c60fa83fc tempest-SecurityGroupsTestAdminJSON-1298736483 tempest-SecurityGroupsTestAdminJSON-1298736483-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/00cb8a21-4393-4b80-8ce1-5ca15728da47" status: 202 len: 0 microversion: 2.1 time: 1.205185 Aug 04 16:44:30.965790 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 996/2001] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:44:29 2022] DELETE /compute/v2.1/os-security-groups/00cb8a21-4393-4b80-8ce1-5ca15728da47 => generated 0 bytes in 1211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:44:30.972124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6ea601d7-be5c-4c4d-87be-e7430a411d91 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:44:30.980120 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6ea601d7-be5c-4c4d-87be-e7430a411d91 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:30.983915 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=100 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:44:30.992506 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-ec7dc674-bd5d-45b9-a85c-961805046e5f req-e3af94ff-ac7a-46df-b255-ece08e542eab service nova] Creating event network-changed:a2d89e60-6642-4d21-9485-0ab90d28d1ae for instance 8f6461bb-aeb9-459a-8518-47055bfd5f41 on n-h1-846466-12 Aug 04 16:44:31.006404 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6ea601d7-be5c-4c4d-87be-e7430a411d91 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:31.009858 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-ec7dc674-bd5d-45b9-a85c-961805046e5f req-e3af94ff-ac7a-46df-b255-ece08e542eab service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101542 Aug 04 16:44:31.010124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6ea601d7-be5c-4c4d-87be-e7430a411d91 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:31.013786 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6ea601d7-be5c-4c4d-87be-e7430a411d91 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:31.014814 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6ea601d7-be5c-4c4d-87be-e7430a411d91 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:31.015304 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1006/2002] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:44:31.038085 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-38f1bd4d-67d0-4238-9ea0-cb6f15b706b6 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:31.039752 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-38f1bd4d-67d0-4238-9ea0-cb6f15b706b6 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:31.055771 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-38f1bd4d-67d0-4238-9ea0-cb6f15b706b6 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:31.056384 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-38f1bd4d-67d0-4238-9ea0-cb6f15b706b6 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:31.070225 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-38f1bd4d-67d0-4238-9ea0-cb6f15b706b6 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:31.073753 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-38f1bd4d-67d0-4238-9ea0-cb6f15b706b6 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:31.195529 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6ea601d7-be5c-4c4d-87be-e7430a411d91 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526/action" status: 202 len: 0 microversion: 2.1 time: 0.227881 Aug 04 16:44:31.196935 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 997/2003] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:44:30 2022] POST /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:44:31.208370 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d09405ff-a719-4699-b4e6-90b682df0a45 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:31.209101 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d09405ff-a719-4699-b4e6-90b682df0a45 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] [instance: 632449ba-73dd-4aeb-bc39-f26d6de4e726] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:31.225856 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d09405ff-a719-4699-b4e6-90b682df0a45 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:31.226508 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d09405ff-a719-4699-b4e6-90b682df0a45 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:31.227509 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d09405ff-a719-4699-b4e6-90b682df0a45 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:31.227928 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d09405ff-a719-4699-b4e6-90b682df0a45 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:31.393620 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-38f1bd4d-67d0-4238-9ea0-cb6f15b706b6 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:31.409512 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-38f1bd4d-67d0-4238-9ea0-cb6f15b706b6 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e" status: 200 len: 1487 microversion: 2.1 time: 0.390788 Aug 04 16:44:31.421818 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1007/2004] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:31 2022] GET /compute/v2.1/servers/6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e => generated 1487 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:31.433391 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-88422bcd-92fa-46ab-aa3b-5ced00db688e req-852eeca3-9d72-4511-8396-406d743afebc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c62ae02-0f30-43e1-a005-89dcb8122d4e", "name": "network-vif-unplugged", "status": "completed", "tag": "93c46fa1-3978-4529-9c01-36e6a216c294"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:44:31.459673 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-88422bcd-92fa-46ab-aa3b-5ced00db688e req-852eeca3-9d72-4511-8396-406d743afebc service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:31.460155 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-88422bcd-92fa-46ab-aa3b-5ced00db688e req-852eeca3-9d72-4511-8396-406d743afebc service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:31.492156 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-88422bcd-92fa-46ab-aa3b-5ced00db688e req-852eeca3-9d72-4511-8396-406d743afebc service nova] Creating event network-vif-unplugged:93c46fa1-3978-4529-9c01-36e6a216c294 for instance 0c62ae02-0f30-43e1-a005-89dcb8122d4e on n-h1-846466-12 Aug 04 16:44:31.507692 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-88422bcd-92fa-46ab-aa3b-5ced00db688e req-852eeca3-9d72-4511-8396-406d743afebc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083753 Aug 04 16:44:31.509047 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1008/2005] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:44:31.522101 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7d831cea-f7c9-43f0-889a-a65fbf1395d1 tempest-SecurityGroupsTestAdminJSON-1298736483 tempest-SecurityGroupsTestAdminJSON-1298736483-project] Calling method '.version_select at 0x7f7e77bb6c10>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:31.691193 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d09405ff-a719-4699-b4e6-90b682df0a45 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9bde1645f64765a41a3f0d65a9ee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8ad7f728004fa0a6db9fba7c3c9cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:31.701689 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d09405ff-a719-4699-b4e6-90b682df0a45 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] 10.222.0.23 "GET /compute/v2.1/servers/632449ba-73dd-4aeb-bc39-f26d6de4e726" status: 200 len: 1351 microversion: 2.1 time: 0.501801 Aug 04 16:44:31.702481 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 998/2006] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:31 2022] GET /compute/v2.1/servers/632449ba-73dd-4aeb-bc39-f26d6de4e726 => generated 1351 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:31.725109 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-70530882-c6fc-4869-a4c0-ff3f199e34a6 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:31.729224 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-70530882-c6fc-4869-a4c0-ff3f199e34a6 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:31.754921 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70530882-c6fc-4869-a4c0-ff3f199e34a6 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:31.756354 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70530882-c6fc-4869-a4c0-ff3f199e34a6 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:31.759594 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70530882-c6fc-4869-a4c0-ff3f199e34a6 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:31.762217 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70530882-c6fc-4869-a4c0-ff3f199e34a6 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:31.849840 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70530882-c6fc-4869-a4c0-ff3f199e34a6 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:31.850589 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70530882-c6fc-4869-a4c0-ff3f199e34a6 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:31.851360 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-70530882-c6fc-4869-a4c0-ff3f199e34a6 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lazy-loading 'fault' on Instance uuid 97b80b04-533e-48b5-8595-9de81ed2c526 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:44:32.314408 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-70530882-c6fc-4869-a4c0-ff3f199e34a6 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1599 microversion: 2.1 time: 0.601463 Aug 04 16:44:32.316001 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 999/2007] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:31 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1599 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:32.350542 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-aeffed1c-5c2d-4861-aac5-f6312a2a3c38 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:44:32.351987 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-aeffed1c-5c2d-4861-aac5-f6312a2a3c38 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:32.363362 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7d831cea-f7c9-43f0-889a-a65fbf1395d1 tempest-SecurityGroupsTestAdminJSON-1298736483 tempest-SecurityGroupsTestAdminJSON-1298736483-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/62b92932-8e4b-49bb-bafa-5d751ac60668" status: 202 len: 0 microversion: 2.1 time: 0.851147 Aug 04 16:44:32.364827 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1009/2008] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:44:31 2022] DELETE /compute/v2.1/os-security-groups/62b92932-8e4b-49bb-bafa-5d751ac60668 => generated 0 bytes in 855 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:44:32.368711 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aeffed1c-5c2d-4861-aac5-f6312a2a3c38 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:32.370859 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aeffed1c-5c2d-4861-aac5-f6312a2a3c38 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:32.374410 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aeffed1c-5c2d-4861-aac5-f6312a2a3c38 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:32.375798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aeffed1c-5c2d-4861-aac5-f6312a2a3c38 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:32.392835 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-06b24ea2-12d9-470e-b7f3-8fc7f4131eee tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:32.397467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-06b24ea2-12d9-470e-b7f3-8fc7f4131eee tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 8f6461bb-aeb9-459a-8518-47055bfd5f41] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:32.432708 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-06b24ea2-12d9-470e-b7f3-8fc7f4131eee tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:32.436719 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-06b24ea2-12d9-470e-b7f3-8fc7f4131eee tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:32.442634 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-06b24ea2-12d9-470e-b7f3-8fc7f4131eee tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:32.444630 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-06b24ea2-12d9-470e-b7f3-8fc7f4131eee tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:32.728765 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-aeffed1c-5c2d-4861-aac5-f6312a2a3c38 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "POST /compute/v2.1/servers/6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e/action" status: 202 len: 0 microversion: 2.1 time: 0.402388 Aug 04 16:44:32.742911 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1000/2009] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:44:32 2022] POST /compute/v2.1/servers/6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e/action => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:44:32.766826 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f1db48dc-0524-444e-96e9-64cc6bb816b0 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:44:32.773276 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f1db48dc-0524-444e-96e9-64cc6bb816b0 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:32.822710 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f1db48dc-0524-444e-96e9-64cc6bb816b0 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:32.826653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f1db48dc-0524-444e-96e9-64cc6bb816b0 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:32.832368 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f1db48dc-0524-444e-96e9-64cc6bb816b0 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:32.832883 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f1db48dc-0524-444e-96e9-64cc6bb816b0 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:32.969608 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:44:33.031246 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f1db48dc-0524-444e-96e9-64cc6bb816b0 tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526/action" status: 202 len: 0 microversion: 2.1 time: 0.281799 Aug 04 16:44:33.040946 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1001/2010] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:44:32 2022] POST /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:44:33.062641 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a061f47f-871c-4e39-862b-469efd349c1d tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:33.064047 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a061f47f-871c-4e39-862b-469efd349c1d tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] [instance: 632449ba-73dd-4aeb-bc39-f26d6de4e726] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:33.081548 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a061f47f-871c-4e39-862b-469efd349c1d tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:33.082450 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a061f47f-871c-4e39-862b-469efd349c1d tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:33.084060 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a061f47f-871c-4e39-862b-469efd349c1d tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:33.086345 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a061f47f-871c-4e39-862b-469efd349c1d tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:33.141065 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:44:33.172954 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=12 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:44:33.742974 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-06b24ea2-12d9-470e-b7f3-8fc7f4131eee tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:33.762788 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-06b24ea2-12d9-470e-b7f3-8fc7f4131eee tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/8f6461bb-aeb9-459a-8518-47055bfd5f41" status: 200 len: 1315 microversion: 2.1 time: 1.395481 Aug 04 16:44:33.766529 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1010/2011] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:32 2022] GET /compute/v2.1/servers/8f6461bb-aeb9-459a-8518-47055bfd5f41 => generated 1315 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:33.787852 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a061f47f-871c-4e39-862b-469efd349c1d tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9bde1645f64765a41a3f0d65a9ee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8ad7f728004fa0a6db9fba7c3c9cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:33.794104 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b589c9e2-e0e1-46dd-962b-3adb133f73b9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:33.797671 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b589c9e2-e0e1-46dd-962b-3adb133f73b9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:33.811638 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b589c9e2-e0e1-46dd-962b-3adb133f73b9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:33.812125 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b589c9e2-e0e1-46dd-962b-3adb133f73b9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:33.815145 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a061f47f-871c-4e39-862b-469efd349c1d tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] 10.222.0.23 "GET /compute/v2.1/servers/632449ba-73dd-4aeb-bc39-f26d6de4e726" status: 200 len: 1351 microversion: 2.1 time: 0.771417 Aug 04 16:44:33.817201 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1002/2012] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:33 2022] GET /compute/v2.1/servers/632449ba-73dd-4aeb-bc39-f26d6de4e726 => generated 1351 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:33.819060 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b589c9e2-e0e1-46dd-962b-3adb133f73b9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:33.819528 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b589c9e2-e0e1-46dd-962b-3adb133f73b9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:33.831915 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-73fbf129-61b7-4b92-a609-5eaaccbeed3c tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:33.833441 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-73fbf129-61b7-4b92-a609-5eaaccbeed3c tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:33.845797 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-73fbf129-61b7-4b92-a609-5eaaccbeed3c tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:33.847219 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-73fbf129-61b7-4b92-a609-5eaaccbeed3c tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:33.849046 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-73fbf129-61b7-4b92-a609-5eaaccbeed3c tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:33.850113 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-73fbf129-61b7-4b92-a609-5eaaccbeed3c tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:34.140810 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b589c9e2-e0e1-46dd-962b-3adb133f73b9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:34.153461 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-73fbf129-61b7-4b92-a609-5eaaccbeed3c tempest-ServersAdminTestJSON-1802081269 tempest-ServersAdminTestJSON-1802081269-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1616 microversion: 2.1 time: 0.333427 Aug 04 16:44:34.155384 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b589c9e2-e0e1-46dd-962b-3adb133f73b9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e" status: 200 len: 1472 microversion: 2.1 time: 0.384386 Aug 04 16:44:34.156615 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1011/2013] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:33 2022] GET /compute/v2.1/servers/6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e => generated 1472 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:34.164692 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-2a0dfc0d-f86b-42ef-bc14-6e6bd72e464e req-cab819aa-b2c1-42cc-8545-f0e6e1b3c958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "632449ba-73dd-4aeb-bc39-f26d6de4e726", "tag": "a0e744c5-ed04-46e2-85e9-7e1d7d8096d3"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:44:34.169733 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1003/2014] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:33 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1616 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:34.177154 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2cebf4ad-35d2-4a47-b029-848be8fe7a3b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:34.178379 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2cebf4ad-35d2-4a47-b029-848be8fe7a3b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:34.181204 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-2a0dfc0d-f86b-42ef-bc14-6e6bd72e464e req-cab819aa-b2c1-42cc-8545-f0e6e1b3c958 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:34.181671 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-2a0dfc0d-f86b-42ef-bc14-6e6bd72e464e req-cab819aa-b2c1-42cc-8545-f0e6e1b3c958 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:34.186841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2cebf4ad-35d2-4a47-b029-848be8fe7a3b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:34.187783 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2cebf4ad-35d2-4a47-b029-848be8fe7a3b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:34.188841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2cebf4ad-35d2-4a47-b029-848be8fe7a3b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:34.189508 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2cebf4ad-35d2-4a47-b029-848be8fe7a3b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:34.201001 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-2a0dfc0d-f86b-42ef-bc14-6e6bd72e464e req-cab819aa-b2c1-42cc-8545-f0e6e1b3c958 service nova] Creating event network-changed:a0e744c5-ed04-46e2-85e9-7e1d7d8096d3 for instance 632449ba-73dd-4aeb-bc39-f26d6de4e726 on n-h2-846466-12 Aug 04 16:44:34.204960 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-2a0dfc0d-f86b-42ef-bc14-6e6bd72e464e req-cab819aa-b2c1-42cc-8545-f0e6e1b3c958 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046552 Aug 04 16:44:34.211643 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1012/2015] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:44:34.240854 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a32a2a53-f0f4-4714-b543-6240c7d235e0 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:34.243546 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a32a2a53-f0f4-4714-b543-6240c7d235e0 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 8ad2a63b-d522-4e78-9246-e6e0d3c554f8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:34.262625 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a32a2a53-f0f4-4714-b543-6240c7d235e0 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:34.263451 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a32a2a53-f0f4-4714-b543-6240c7d235e0 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:34.265224 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a32a2a53-f0f4-4714-b543-6240c7d235e0 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:34.266191 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a32a2a53-f0f4-4714-b543-6240c7d235e0 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:34.333672 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a32a2a53-f0f4-4714-b543-6240c7d235e0 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 8ad2a63b-d522-4e78-9246-e6e0d3c554f8] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:44:34.515625 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a32a2a53-f0f4-4714-b543-6240c7d235e0 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8ad2a63b-d522-4e78-9246-e6e0d3c554f8" status: 204 len: 0 microversion: 2.1 time: 0.302266 Aug 04 16:44:34.516801 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1013/2016] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:44:34 2022] DELETE /compute/v2.1/servers/8ad2a63b-d522-4e78-9246-e6e0d3c554f8 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:44:34.525612 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8de8c04b-46b4-473c-ac57-4cd53e540fb9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1374579238"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:44:34.529729 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8de8c04b-46b4-473c-ac57-4cd53e540fb9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:34.540104 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8de8c04b-46b4-473c-ac57-4cd53e540fb9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:34.540740 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8de8c04b-46b4-473c-ac57-4cd53e540fb9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:34.541632 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8de8c04b-46b4-473c-ac57-4cd53e540fb9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:34.542085 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8de8c04b-46b4-473c-ac57-4cd53e540fb9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:34.570571 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2cebf4ad-35d2-4a47-b029-848be8fe7a3b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:34.586286 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2cebf4ad-35d2-4a47-b029-848be8fe7a3b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.414980 Aug 04 16:44:34.586983 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1004/2017] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:34 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:34.593131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-10dd4211-2f08-48df-a835-b907f632376e tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:34.594188 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-10dd4211-2f08-48df-a835-b907f632376e tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 8ad2a63b-d522-4e78-9246-e6e0d3c554f8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:34.607178 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-10dd4211-2f08-48df-a835-b907f632376e tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:34.607956 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-10dd4211-2f08-48df-a835-b907f632376e tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:34.610081 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-10dd4211-2f08-48df-a835-b907f632376e tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:34.611168 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-10dd4211-2f08-48df-a835-b907f632376e tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:34.953774 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-10dd4211-2f08-48df-a835-b907f632376e tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:34.970260 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-10dd4211-2f08-48df-a835-b907f632376e tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad2a63b-d522-4e78-9246-e6e0d3c554f8" status: 200 len: 1470 microversion: 2.1 time: 0.382238 Aug 04 16:44:34.971860 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1005/2018] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:34 2022] GET /compute/v2.1/servers/8ad2a63b-d522-4e78-9246-e6e0d3c554f8 => generated 1470 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:34.983090 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7dfaf8ce-f9e2-404b-b448-7f5a9731214a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:34.985604 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7dfaf8ce-f9e2-404b-b448-7f5a9731214a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:35.003252 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7dfaf8ce-f9e2-404b-b448-7f5a9731214a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:35.004017 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7dfaf8ce-f9e2-404b-b448-7f5a9731214a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:35.005114 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7dfaf8ce-f9e2-404b-b448-7f5a9731214a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:35.009215 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7dfaf8ce-f9e2-404b-b448-7f5a9731214a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:35.058595 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8de8c04b-46b4-473c-ac57-4cd53e540fb9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "POST /compute/v2.1/servers/6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e/action" status: 202 len: 0 microversion: 2.1 time: 0.538714 Aug 04 16:44:35.059214 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1014/2019] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:44:34 2022] POST /compute/v2.1/servers/6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e/action => generated 0 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 16:44:35.108734 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9daea714-9c1c-4ce4-9358-bf5834385dc8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:35.110144 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9daea714-9c1c-4ce4-9358-bf5834385dc8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 8f6461bb-aeb9-459a-8518-47055bfd5f41] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:35.154113 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9daea714-9c1c-4ce4-9358-bf5834385dc8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:35.160050 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9daea714-9c1c-4ce4-9358-bf5834385dc8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:35.164079 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9daea714-9c1c-4ce4-9358-bf5834385dc8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:35.164969 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9daea714-9c1c-4ce4-9358-bf5834385dc8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:35.357685 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7dfaf8ce-f9e2-404b-b448-7f5a9731214a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:35.367401 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7dfaf8ce-f9e2-404b-b448-7f5a9731214a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.394106 Aug 04 16:44:35.376571 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1006/2020] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:34 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:35.382709 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-27bdb0b3-3b68-4f7b-9302-3c6944b0ef97 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:35.393953 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-27bdb0b3-3b68-4f7b-9302-3c6944b0ef97 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] [instance: 632449ba-73dd-4aeb-bc39-f26d6de4e726] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:35.400803 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-27bdb0b3-3b68-4f7b-9302-3c6944b0ef97 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:35.402113 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-27bdb0b3-3b68-4f7b-9302-3c6944b0ef97 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:35.403039 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-27bdb0b3-3b68-4f7b-9302-3c6944b0ef97 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:35.413810 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-27bdb0b3-3b68-4f7b-9302-3c6944b0ef97 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:35.654624 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9daea714-9c1c-4ce4-9358-bf5834385dc8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:35.695114 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9daea714-9c1c-4ce4-9358-bf5834385dc8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/8f6461bb-aeb9-459a-8518-47055bfd5f41" status: 200 len: 1315 microversion: 2.1 time: 0.633670 Aug 04 16:44:35.704995 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1015/2021] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:35 2022] GET /compute/v2.1/servers/8f6461bb-aeb9-459a-8518-47055bfd5f41 => generated 1315 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:35.714286 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d0bbaf46-1ebf-4c5f-b175-ae718886337c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e77cbd040>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:35.822323 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d0bbaf46-1ebf-4c5f-b175-ae718886337c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f" status: 200 len: 1410 microversion: 2.1 time: 0.115174 Aug 04 16:44:35.822982 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1016/2022] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:44:35 2022] GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f => generated 1410 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:35.828780 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cf412ba9-d990-4aab-81c0-9e1be15f4fc0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:35.829387 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cf412ba9-d990-4aab-81c0-9e1be15f4fc0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:35.845555 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-27bdb0b3-3b68-4f7b-9302-3c6944b0ef97 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9bde1645f64765a41a3f0d65a9ee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8ad7f728004fa0a6db9fba7c3c9cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:35.848171 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cf412ba9-d990-4aab-81c0-9e1be15f4fc0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:35.848649 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cf412ba9-d990-4aab-81c0-9e1be15f4fc0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:35.849532 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cf412ba9-d990-4aab-81c0-9e1be15f4fc0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:35.850013 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cf412ba9-d990-4aab-81c0-9e1be15f4fc0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:35.859460 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-27bdb0b3-3b68-4f7b-9302-3c6944b0ef97 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] 10.222.0.23 "GET /compute/v2.1/servers/632449ba-73dd-4aeb-bc39-f26d6de4e726" status: 200 len: 1351 microversion: 2.1 time: 0.481246 Aug 04 16:44:35.874454 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1007/2023] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:35 2022] GET /compute/v2.1/servers/632449ba-73dd-4aeb-bc39-f26d6de4e726 => generated 1351 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:36.014773 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-429f6acb-1f36-4378-b190-f9d83ca08b91 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:36.015445 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-429f6acb-1f36-4378-b190-f9d83ca08b91 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 8ad2a63b-d522-4e78-9246-e6e0d3c554f8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:36.033662 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-429f6acb-1f36-4378-b190-f9d83ca08b91 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:36.034214 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-429f6acb-1f36-4378-b190-f9d83ca08b91 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:36.035482 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-429f6acb-1f36-4378-b190-f9d83ca08b91 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:36.036202 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-429f6acb-1f36-4378-b190-f9d83ca08b91 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:36.188422 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cf412ba9-d990-4aab-81c0-9e1be15f4fc0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:36.198222 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cf412ba9-d990-4aab-81c0-9e1be15f4fc0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.374075 Aug 04 16:44:36.198870 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1017/2024] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:35 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:36.236302 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0ce744a2-ae56-44a7-8624-afb1fb875f75 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:44:36.241192 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0ce744a2-ae56-44a7-8624-afb1fb875f75 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:36.259011 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ce744a2-ae56-44a7-8624-afb1fb875f75 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:36.260627 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ce744a2-ae56-44a7-8624-afb1fb875f75 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:36.261799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ce744a2-ae56-44a7-8624-afb1fb875f75 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:36.262463 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ce744a2-ae56-44a7-8624-afb1fb875f75 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:36.400897 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0ce744a2-ae56-44a7-8624-afb1fb875f75 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action" status: 202 len: 0 microversion: 2.1 time: 0.169227 Aug 04 16:44:36.402725 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1018/2025] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:44:36 2022] POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:44:36.417147 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-39a2ddc5-bb2b-4987-8696-66dee1e80bd8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:36.420701 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-39a2ddc5-bb2b-4987-8696-66dee1e80bd8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:36.431941 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-39a2ddc5-bb2b-4987-8696-66dee1e80bd8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:36.432557 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-39a2ddc5-bb2b-4987-8696-66dee1e80bd8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:36.434207 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-39a2ddc5-bb2b-4987-8696-66dee1e80bd8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:36.446348 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-39a2ddc5-bb2b-4987-8696-66dee1e80bd8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:36.627969 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-429f6acb-1f36-4378-b190-f9d83ca08b91 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:36.638109 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-429f6acb-1f36-4378-b190-f9d83ca08b91 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad2a63b-d522-4e78-9246-e6e0d3c554f8" status: 200 len: 1470 microversion: 2.1 time: 0.630179 Aug 04 16:44:36.638707 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1008/2026] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:36 2022] GET /compute/v2.1/servers/8ad2a63b-d522-4e78-9246-e6e0d3c554f8 => generated 1470 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:36.743615 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-aabd637b-0d38-41c5-b625-d1b5770c94df tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:36.744251 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-aabd637b-0d38-41c5-b625-d1b5770c94df tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 8f6461bb-aeb9-459a-8518-47055bfd5f41] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:36.759865 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aabd637b-0d38-41c5-b625-d1b5770c94df tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:36.760485 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aabd637b-0d38-41c5-b625-d1b5770c94df tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:36.761717 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aabd637b-0d38-41c5-b625-d1b5770c94df tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:36.764093 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aabd637b-0d38-41c5-b625-d1b5770c94df tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:37.050854 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-39a2ddc5-bb2b-4987-8696-66dee1e80bd8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:37.064687 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-39a2ddc5-bb2b-4987-8696-66dee1e80bd8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1671 microversion: 2.1 time: 0.655793 Aug 04 16:44:37.067959 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1019/2027] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:36 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1671 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:37.074473 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-aabd637b-0d38-41c5-b625-d1b5770c94df tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:37.092164 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-aabd637b-0d38-41c5-b625-d1b5770c94df tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/8f6461bb-aeb9-459a-8518-47055bfd5f41" status: 200 len: 1315 microversion: 2.1 time: 0.350531 Aug 04 16:44:37.095474 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-554d80db-ed69-41e3-acaa-1ce319931aa3 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e872eb790>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:37.110225 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1009/2028] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:36 2022] GET /compute/v2.1/servers/8f6461bb-aeb9-459a-8518-47055bfd5f41 => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:44:37.123149 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b3f7046c-0fa4-4e6f-a51f-92c31bad98d5 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:37.124206 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b3f7046c-0fa4-4e6f-a51f-92c31bad98d5 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] [instance: 632449ba-73dd-4aeb-bc39-f26d6de4e726] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:37.139014 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b3f7046c-0fa4-4e6f-a51f-92c31bad98d5 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:37.145994 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b3f7046c-0fa4-4e6f-a51f-92c31bad98d5 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:37.147210 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b3f7046c-0fa4-4e6f-a51f-92c31bad98d5 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:37.147828 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b3f7046c-0fa4-4e6f-a51f-92c31bad98d5 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:37.249517 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-554d80db-ed69-41e3-acaa-1ce319931aa3 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f" status: 200 len: 1410 microversion: 2.1 time: 0.179911 Aug 04 16:44:37.251634 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1020/2029] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:44:37 2022] GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f => generated 1410 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:37.344692 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-940c28b0-2781-4f54-b6bb-cdf2daf93909 req-bf600509-3c4f-4e75-9758-77b6556c0a7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f6461bb-aeb9-459a-8518-47055bfd5f41", "name": "network-vif-plugged", "status": "completed", "tag": "a2d89e60-6642-4d21-9485-0ab90d28d1ae"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:44:37.376568 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-940c28b0-2781-4f54-b6bb-cdf2daf93909 req-bf600509-3c4f-4e75-9758-77b6556c0a7d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:37.377666 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-940c28b0-2781-4f54-b6bb-cdf2daf93909 req-bf600509-3c4f-4e75-9758-77b6556c0a7d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:37.395120 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-940c28b0-2781-4f54-b6bb-cdf2daf93909 req-bf600509-3c4f-4e75-9758-77b6556c0a7d service nova] Creating event network-vif-plugged:a2d89e60-6642-4d21-9485-0ab90d28d1ae for instance 8f6461bb-aeb9-459a-8518-47055bfd5f41 on n-h1-846466-12 Aug 04 16:44:37.404470 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-940c28b0-2781-4f54-b6bb-cdf2daf93909 req-bf600509-3c4f-4e75-9758-77b6556c0a7d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066812 Aug 04 16:44:37.406215 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1021/2030] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:44:37.662502 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-51fe4300-e922-4531-b8bc-40f1bcd085e5 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:37.663452 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-51fe4300-e922-4531-b8bc-40f1bcd085e5 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 8ad2a63b-d522-4e78-9246-e6e0d3c554f8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:37.677851 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-51fe4300-e922-4531-b8bc-40f1bcd085e5 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:37.680140 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-51fe4300-e922-4531-b8bc-40f1bcd085e5 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:37.683519 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-51fe4300-e922-4531-b8bc-40f1bcd085e5 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:37.684437 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-51fe4300-e922-4531-b8bc-40f1bcd085e5 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:37.896762 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b3f7046c-0fa4-4e6f-a51f-92c31bad98d5 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9bde1645f64765a41a3f0d65a9ee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8ad7f728004fa0a6db9fba7c3c9cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:37.901173 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-51fe4300-e922-4531-b8bc-40f1bcd085e5 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:37.924470 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b3f7046c-0fa4-4e6f-a51f-92c31bad98d5 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] 10.222.0.23 "GET /compute/v2.1/servers/632449ba-73dd-4aeb-bc39-f26d6de4e726" status: 200 len: 1351 microversion: 2.1 time: 0.810880 Aug 04 16:44:37.926126 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1010/2031] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:37 2022] GET /compute/v2.1/servers/632449ba-73dd-4aeb-bc39-f26d6de4e726 => generated 1351 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:37.952288 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-ff6c7368-6722-490e-915c-b004ce179c29 req-d231c0ec-78f7-4995-b638-cd8e9327e690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ad2a63b-d522-4e78-9246-e6e0d3c554f8", "name": "network-vif-deleted", "tag": "61cddda4-3f06-46e6-a9ae-52b5d6f90428"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:44:37.952587 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-51fe4300-e922-4531-b8bc-40f1bcd085e5 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad2a63b-d522-4e78-9246-e6e0d3c554f8" status: 200 len: 1428 microversion: 2.1 time: 0.268933 Aug 04 16:44:37.954390 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1022/2032] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:37 2022] GET /compute/v2.1/servers/8ad2a63b-d522-4e78-9246-e6e0d3c554f8 => generated 1428 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:37.993656 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-ff6c7368-6722-490e-915c-b004ce179c29 req-d231c0ec-78f7-4995-b638-cd8e9327e690 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:37.994383 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-ff6c7368-6722-490e-915c-b004ce179c29 req-d231c0ec-78f7-4995-b638-cd8e9327e690 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:38.023587 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-ff6c7368-6722-490e-915c-b004ce179c29 req-d231c0ec-78f7-4995-b638-cd8e9327e690 service nova] Creating event network-vif-deleted:61cddda4-3f06-46e6-a9ae-52b5d6f90428 for instance 8ad2a63b-d522-4e78-9246-e6e0d3c554f8 on n-h1-846466-12 Aug 04 16:44:38.035125 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-ff6c7368-6722-490e-915c-b004ce179c29 req-d231c0ec-78f7-4995-b638-cd8e9327e690 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106424 Aug 04 16:44:38.037207 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1011/2033] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:44:38.097779 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-eb211cff-5112-4019-be76-25005b6f8a33 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:38.098881 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-eb211cff-5112-4019-be76-25005b6f8a33 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:38.124840 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e00e3e27-acdb-42e1-b239-69e186c0f11b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:38.125636 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e00e3e27-acdb-42e1-b239-69e186c0f11b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 8f6461bb-aeb9-459a-8518-47055bfd5f41] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:38.154498 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e00e3e27-acdb-42e1-b239-69e186c0f11b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:38.155281 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e00e3e27-acdb-42e1-b239-69e186c0f11b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:38.156390 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e00e3e27-acdb-42e1-b239-69e186c0f11b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:38.157011 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e00e3e27-acdb-42e1-b239-69e186c0f11b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:38.179241 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eb211cff-5112-4019-be76-25005b6f8a33 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:38.179743 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eb211cff-5112-4019-be76-25005b6f8a33 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:38.186869 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eb211cff-5112-4019-be76-25005b6f8a33 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:38.187761 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eb211cff-5112-4019-be76-25005b6f8a33 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:38.603420 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-eb211cff-5112-4019-be76-25005b6f8a33 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:38.614920 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-eb211cff-5112-4019-be76-25005b6f8a33 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1676 microversion: 2.1 time: 0.526743 Aug 04 16:44:38.638132 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1023/2034] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:38 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1676 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:38.645955 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-48214667-ad74-47df-9fd4-d0f3838c786d tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e77c88040>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:38.712070 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e00e3e27-acdb-42e1-b239-69e186c0f11b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:38.714653 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-48214667-ad74-47df-9fd4-d0f3838c786d tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f" status: 200 len: 1410 microversion: 2.1 time: 0.074981 Aug 04 16:44:38.722403 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1024/2035] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:44:38 2022] GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f => generated 1410 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:38.736263 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e00e3e27-acdb-42e1-b239-69e186c0f11b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/8f6461bb-aeb9-459a-8518-47055bfd5f41" status: 200 len: 1315 microversion: 2.1 time: 0.619007 Aug 04 16:44:38.743066 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1012/2036] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:38 2022] GET /compute/v2.1/servers/8f6461bb-aeb9-459a-8518-47055bfd5f41 => generated 1315 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:38.969358 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bca4f1c6-a396-4f83-b619-129110a666b3 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:38.970272 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bca4f1c6-a396-4f83-b619-129110a666b3 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] [instance: 632449ba-73dd-4aeb-bc39-f26d6de4e726] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:38.983410 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bca4f1c6-a396-4f83-b619-129110a666b3 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:38.984215 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bca4f1c6-a396-4f83-b619-129110a666b3 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:38.985678 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bca4f1c6-a396-4f83-b619-129110a666b3 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:38.986452 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bca4f1c6-a396-4f83-b619-129110a666b3 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:39.037477 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d9aff531-7969-4bad-a65c-2a32e27c0bd5 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1992101785", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:44:39.123696 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-d9aff531-7969-4bad-a65c-2a32e27c0bd5 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] validate_networks() for None {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:44:39.319700 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bca4f1c6-a396-4f83-b619-129110a666b3 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9bde1645f64765a41a3f0d65a9ee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8ad7f728004fa0a6db9fba7c3c9cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:39.337853 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bca4f1c6-a396-4f83-b619-129110a666b3 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] 10.222.0.23 "GET /compute/v2.1/servers/632449ba-73dd-4aeb-bc39-f26d6de4e726" status: 200 len: 1351 microversion: 2.1 time: 0.374931 Aug 04 16:44:39.353366 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1013/2037] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:38 2022] GET /compute/v2.1/servers/632449ba-73dd-4aeb-bc39-f26d6de4e726 => generated 1351 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:39.355594 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f6364a75-fa2e-475b-8d11-54e1b7eb516b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:39.356329 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f6364a75-fa2e-475b-8d11-54e1b7eb516b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 8ad2a63b-d522-4e78-9246-e6e0d3c554f8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:39.374396 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6364a75-fa2e-475b-8d11-54e1b7eb516b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:39.376532 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6364a75-fa2e-475b-8d11-54e1b7eb516b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:39.378969 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6364a75-fa2e-475b-8d11-54e1b7eb516b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:39.379775 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6364a75-fa2e-475b-8d11-54e1b7eb516b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:39.468025 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6364a75-fa2e-475b-8d11-54e1b7eb516b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:39.468855 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6364a75-fa2e-475b-8d11-54e1b7eb516b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:39.469919 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-f6364a75-fa2e-475b-8d11-54e1b7eb516b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lazy-loading 'fault' on Instance uuid 8ad2a63b-d522-4e78-9246-e6e0d3c554f8 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:44:39.634062 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f6364a75-fa2e-475b-8d11-54e1b7eb516b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:39.646409 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f6364a75-fa2e-475b-8d11-54e1b7eb516b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad2a63b-d522-4e78-9246-e6e0d3c554f8" status: 200 len: 1304 microversion: 2.1 time: 0.303821 Aug 04 16:44:39.664885 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1014/2038] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:39 2022] GET /compute/v2.1/servers/8ad2a63b-d522-4e78-9246-e6e0d3c554f8 => generated 1304 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:39.673129 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-d7f0b1e2-c93a-4e20-8100-d1cb834870d4 req-5d252598-4f66-4382-9faf-e4fa48b8be2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "632449ba-73dd-4aeb-bc39-f26d6de4e726", "name": "network-vif-plugged", "status": "completed", "tag": "a0e744c5-ed04-46e2-85e9-7e1d7d8096d3"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:44:39.707376 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-d7f0b1e2-c93a-4e20-8100-d1cb834870d4 req-5d252598-4f66-4382-9faf-e4fa48b8be2e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:39.710959 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-d7f0b1e2-c93a-4e20-8100-d1cb834870d4 req-5d252598-4f66-4382-9faf-e4fa48b8be2e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:39.758347 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-d7f0b1e2-c93a-4e20-8100-d1cb834870d4 req-5d252598-4f66-4382-9faf-e4fa48b8be2e service nova] Creating event network-vif-plugged:a0e744c5-ed04-46e2-85e9-7e1d7d8096d3 for instance 632449ba-73dd-4aeb-bc39-f26d6de4e726 on n-h2-846466-12 Aug 04 16:44:39.773579 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-d7f0b1e2-c93a-4e20-8100-d1cb834870d4 req-5d252598-4f66-4382-9faf-e4fa48b8be2e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106862 Aug 04 16:44:39.777383 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1015/2039] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:44:39.802580 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a2a4a88b-291e-40df-a412-b62f534a18b1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:39.808416 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a2a4a88b-291e-40df-a412-b62f534a18b1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:39.824424 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a2a4a88b-291e-40df-a412-b62f534a18b1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:39.827182 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a2a4a88b-291e-40df-a412-b62f534a18b1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:39.830742 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a2a4a88b-291e-40df-a412-b62f534a18b1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:39.831647 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a2a4a88b-291e-40df-a412-b62f534a18b1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:39.841087 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-d9aff531-7969-4bad-a65c-2a32e27c0bd5 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:44:39.842892 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-d9aff531-7969-4bad-a65c-2a32e27c0bd5 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:44:39.843923 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-d9aff531-7969-4bad-a65c-2a32e27c0bd5 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:44:39.844974 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-d9aff531-7969-4bad-a65c-2a32e27c0bd5 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:44:39.846030 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-d9aff531-7969-4bad-a65c-2a32e27c0bd5 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:44:39.892238 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d9aff531-7969-4bad-a65c-2a32e27c0bd5 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:39.894424 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d9aff531-7969-4bad-a65c-2a32e27c0bd5 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:39.900647 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d9aff531-7969-4bad-a65c-2a32e27c0bd5 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:39.901849 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d9aff531-7969-4bad-a65c-2a32e27c0bd5 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:39.993522 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-d9aff531-7969-4bad-a65c-2a32e27c0bd5 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for project b9e709c95a964cd5855d4e253aeb1043. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:44:40.013561 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-d9aff531-7969-4bad-a65c-2a32e27c0bd5 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for user 336c26b5dd6644bc83f9b80adac06bce and project b9e709c95a964cd5855d4e253aeb1043. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:44:40.059928 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d9aff531-7969-4bad-a65c-2a32e27c0bd5 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:44:40.065071 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d9aff531-7969-4bad-a65c-2a32e27c0bd5 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 86667237-3005-4ee4-83d6-c250bba481d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:44:40.178136 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d9aff531-7969-4bad-a65c-2a32e27c0bd5 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.455904 Aug 04 16:44:40.181750 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1025/2040] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:44:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:44:40.223526 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-41e52194-6988-47c1-a4fe-e4a473c7eb2b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e77c88f70>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:40.314822 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a2a4a88b-291e-40df-a412-b62f534a18b1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:40.326331 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a2a4a88b-291e-40df-a412-b62f534a18b1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.539866 Aug 04 16:44:40.349937 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1016/2041] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:39 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:40.364349 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8cdca5f3-acee-4fbc-97b9-a177a50391a1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:40.365839 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8cdca5f3-acee-4fbc-97b9-a177a50391a1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 8f6461bb-aeb9-459a-8518-47055bfd5f41] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:40.384422 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8cdca5f3-acee-4fbc-97b9-a177a50391a1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:40.386071 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8cdca5f3-acee-4fbc-97b9-a177a50391a1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:40.389977 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8cdca5f3-acee-4fbc-97b9-a177a50391a1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:40.390617 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8cdca5f3-acee-4fbc-97b9-a177a50391a1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:40.407532 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-41e52194-6988-47c1-a4fe-e4a473c7eb2b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f" status: 200 len: 1410 microversion: 2.1 time: 0.223716 Aug 04 16:44:40.410069 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1026/2042] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:44:40 2022] GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f => generated 1410 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:40.419348 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c5b43c5c-3e92-476b-9bc9-eca823517e5e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:40.420634 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c5b43c5c-3e92-476b-9bc9-eca823517e5e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 86667237-3005-4ee4-83d6-c250bba481d5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:40.826287 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8cdca5f3-acee-4fbc-97b9-a177a50391a1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:40.846858 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8cdca5f3-acee-4fbc-97b9-a177a50391a1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/8f6461bb-aeb9-459a-8518-47055bfd5f41" status: 200 len: 1503 microversion: 2.1 time: 0.495614 Aug 04 16:44:40.847813 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c5b43c5c-3e92-476b-9bc9-eca823517e5e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:40.848437 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1017/2043] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:40 2022] GET /compute/v2.1/servers/8f6461bb-aeb9-459a-8518-47055bfd5f41 => generated 1503 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:40.863694 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-57ac037a-722b-44d7-8f1b-e1c4b5a65a6a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:44:40.872226 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-57ac037a-722b-44d7-8f1b-e1c4b5a65a6a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:40.886420 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-57ac037a-722b-44d7-8f1b-e1c4b5a65a6a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:40.887281 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-57ac037a-722b-44d7-8f1b-e1c4b5a65a6a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:40.888855 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-57ac037a-722b-44d7-8f1b-e1c4b5a65a6a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:40.890020 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c5b43c5c-3e92-476b-9bc9-eca823517e5e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5" status: 200 len: 1217 microversion: 2.1 time: 0.477250 Aug 04 16:44:40.890470 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-57ac037a-722b-44d7-8f1b-e1c4b5a65a6a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:40.890993 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1027/2044] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:40 2022] GET /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5 => generated 1217 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:40.914310 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-299f0fd1-8b01-4e23-8e31-b5f26ed2af6c tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:40.924129 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-299f0fd1-8b01-4e23-8e31-b5f26ed2af6c tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] [instance: 632449ba-73dd-4aeb-bc39-f26d6de4e726] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:40.943459 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-299f0fd1-8b01-4e23-8e31-b5f26ed2af6c tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:40.945493 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-299f0fd1-8b01-4e23-8e31-b5f26ed2af6c tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:40.947364 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-299f0fd1-8b01-4e23-8e31-b5f26ed2af6c tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:40.948460 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-299f0fd1-8b01-4e23-8e31-b5f26ed2af6c tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:40.950174 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:44:40.999458 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:44:41.019692 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-57ac037a-722b-44d7-8f1b-e1c4b5a65a6a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action" status: 200 len: 322 microversion: 2.1 time: 0.169650 Aug 04 16:44:41.020521 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1018/2045] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:44:40 2022] POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action => generated 322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:44:41.034257 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3cf0dac8-2000-4348-92ff-0bb55641f2c4 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:41.037177 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3cf0dac8-2000-4348-92ff-0bb55641f2c4 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 8ad2a63b-d522-4e78-9246-e6e0d3c554f8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:41.057172 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3cf0dac8-2000-4348-92ff-0bb55641f2c4 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:41.057967 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3cf0dac8-2000-4348-92ff-0bb55641f2c4 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:41.058956 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3cf0dac8-2000-4348-92ff-0bb55641f2c4 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:41.062590 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3cf0dac8-2000-4348-92ff-0bb55641f2c4 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:41.111848 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-3cf0dac8-2000-4348-92ff-0bb55641f2c4 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] HTTP exception thrown: Instance 8ad2a63b-d522-4e78-9246-e6e0d3c554f8 could not be found. Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3cf0dac8-2000-4348-92ff-0bb55641f2c4 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Request method failure captured: Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/8ad2a63b-d522-4e78-9246-e6e0d3c554f8 HTTP/1.1 Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_bZFBL2oiOie5_diZ5zNflD2pbGbft80N-Y0rzqNM6V8pf91Nq45zdBzt65M0kUJff4yWEoTtey2YQlNfqJ8ZaazTn-wwDCfMEOSbDn0rMMxVz9E_3C1qnIqgIJX-YeerahmeIHi5uD5MMVPX7wW51Keli7-cOEPEioUPDmBmFvl1I Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: c1c1660ad79d489392261a78b5677be5 Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersAdminTestJSON-1585527377 Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c1c1660ad79d489392261a78b5677be5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c1c1660ad79d489392261a78b5677be5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c1c1660ad79d489392261a78b5677be5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c1c1660ad79d489392261a78b5677be5"}]}] Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersAdminTestJSON-1585527377 Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: c1c1660ad79d489392261a78b5677be5 Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersAdminTestJSON-1585527377 Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersAdminTestJSON-1585527377-project Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 648fb8ee69e24f74bf694d0e99f04502 Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersAdminTestJSON-1585527377-project Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 8ad2a63b-d522-4e78-9246-e6e0d3c554f8 could not be found. Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '8ad2a63b-d522-4e78-9246-e6e0d3c554f8'} Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ad2a63b-d522-4e78-9246-e6e0d3c554f8 could not be found. Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ad2a63b-d522-4e78-9246-e6e0d3c554f8 could not be found. Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:44:41.115667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:44:41.119398 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:44:41.119398 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:44:41.119398 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:44:41.119398 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:44:41.119398 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:44:41.119398 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ad2a63b-d522-4e78-9246-e6e0d3c554f8 could not be found. Aug 04 16:44:41.119398 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:44:41.124458 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3cf0dac8-2000-4348-92ff-0bb55641f2c4 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Returning 404 to user: Instance 8ad2a63b-d522-4e78-9246-e6e0d3c554f8 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:44:41.126297 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3cf0dac8-2000-4348-92ff-0bb55641f2c4 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/8ad2a63b-d522-4e78-9246-e6e0d3c554f8" status: 404 len: 111 microversion: 2.1 time: 0.097732 Aug 04 16:44:41.128205 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1019/2046] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:41 2022] GET /compute/v2.1/servers/8ad2a63b-d522-4e78-9246-e6e0d3c554f8 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:44:41.138566 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-260a021a-1ac5-4075-b6cd-c2d1670f9033 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:41.140604 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-260a021a-1ac5-4075-b6cd-c2d1670f9033 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 8f6461bb-aeb9-459a-8518-47055bfd5f41] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:41.158316 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-260a021a-1ac5-4075-b6cd-c2d1670f9033 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:41.162043 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-260a021a-1ac5-4075-b6cd-c2d1670f9033 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:41.165827 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-260a021a-1ac5-4075-b6cd-c2d1670f9033 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:41.169716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-260a021a-1ac5-4075-b6cd-c2d1670f9033 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:41.320939 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-299f0fd1-8b01-4e23-8e31-b5f26ed2af6c tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9bde1645f64765a41a3f0d65a9ee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8ad7f728004fa0a6db9fba7c3c9cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:41.324437 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-260a021a-1ac5-4075-b6cd-c2d1670f9033 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 8f6461bb-aeb9-459a-8518-47055bfd5f41] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:44:41.335134 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-299f0fd1-8b01-4e23-8e31-b5f26ed2af6c tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] 10.222.0.23 "GET /compute/v2.1/servers/632449ba-73dd-4aeb-bc39-f26d6de4e726" status: 200 len: 1351 microversion: 2.1 time: 0.438734 Aug 04 16:44:41.337438 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1028/2047] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:40 2022] GET /compute/v2.1/servers/632449ba-73dd-4aeb-bc39-f26d6de4e726 => generated 1351 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:41.343936 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4c112e28-b631-4533-873f-3b3bae844d37 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:41.344947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4c112e28-b631-4533-873f-3b3bae844d37 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:41.355866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4c112e28-b631-4533-873f-3b3bae844d37 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:41.356953 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4c112e28-b631-4533-873f-3b3bae844d37 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:41.358123 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4c112e28-b631-4533-873f-3b3bae844d37 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:41.359378 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4c112e28-b631-4533-873f-3b3bae844d37 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:41.672849 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-260a021a-1ac5-4075-b6cd-c2d1670f9033 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8f6461bb-aeb9-459a-8518-47055bfd5f41" status: 204 len: 0 microversion: 2.1 time: 0.542862 Aug 04 16:44:41.673617 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1020/2048] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:44:41 2022] DELETE /compute/v2.1/servers/8f6461bb-aeb9-459a-8518-47055bfd5f41 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:44:41.694687 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4babb59f-6f06-4db3-8725-1e6e6c720064 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:41.695283 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4babb59f-6f06-4db3-8725-1e6e6c720064 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:41.718611 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4c112e28-b631-4533-873f-3b3bae844d37 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:41.731638 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4babb59f-6f06-4db3-8725-1e6e6c720064 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:41.732247 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4babb59f-6f06-4db3-8725-1e6e6c720064 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:41.732844 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4c112e28-b631-4533-873f-3b3bae844d37 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.393300 Aug 04 16:44:41.733738 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1029/2049] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:41 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:41.739410 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-92f7c56b-5925-485a-93ee-610e8e89a293 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e77c888b0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:41.746274 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4babb59f-6f06-4db3-8725-1e6e6c720064 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:41.758449 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4babb59f-6f06-4db3-8725-1e6e6c720064 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:41.855904 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-92f7c56b-5925-485a-93ee-610e8e89a293 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f" status: 200 len: 1410 microversion: 2.1 time: 0.120895 Aug 04 16:44:41.856963 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1030/2050] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:44:41 2022] GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f => generated 1410 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:41.866027 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2423eb31-46b2-4067-a569-a26c978662ca tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:41.867041 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2423eb31-46b2-4067-a569-a26c978662ca tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 8f6461bb-aeb9-459a-8518-47055bfd5f41] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:41.875653 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2423eb31-46b2-4067-a569-a26c978662ca tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:41.876067 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4babb59f-6f06-4db3-8725-1e6e6c720064 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:44:41.876775 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2423eb31-46b2-4067-a569-a26c978662ca tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:41.877916 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2423eb31-46b2-4067-a569-a26c978662ca tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:41.878643 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2423eb31-46b2-4067-a569-a26c978662ca tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:42.148704 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4babb59f-6f06-4db3-8725-1e6e6c720064 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1" status: 204 len: 0 microversion: 2.1 time: 0.464353 Aug 04 16:44:42.150479 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1021/2051] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:44:41 2022] DELETE /compute/v2.1/servers/0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:44:42.162751 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6a153166-f52c-47ac-95bb-78d753094e4d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:42.164492 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6a153166-f52c-47ac-95bb-78d753094e4d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:42.199609 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a153166-f52c-47ac-95bb-78d753094e4d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:42.204091 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a153166-f52c-47ac-95bb-78d753094e4d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:42.210902 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a153166-f52c-47ac-95bb-78d753094e4d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:42.211174 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2423eb31-46b2-4067-a569-a26c978662ca tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:42.217905 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a153166-f52c-47ac-95bb-78d753094e4d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:42.249136 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2423eb31-46b2-4067-a569-a26c978662ca tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/8f6461bb-aeb9-459a-8518-47055bfd5f41" status: 200 len: 1509 microversion: 2.1 time: 0.389984 Aug 04 16:44:42.253613 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1031/2052] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:41 2022] GET /compute/v2.1/servers/8f6461bb-aeb9-459a-8518-47055bfd5f41 => generated 1509 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:42.288378 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8297a45a-2ae5-4cc9-923a-64976ec91a36 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:42.288810 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8297a45a-2ae5-4cc9-923a-64976ec91a36 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 86667237-3005-4ee4-83d6-c250bba481d5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:42.313553 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8297a45a-2ae5-4cc9-923a-64976ec91a36 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:42.329377 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8297a45a-2ae5-4cc9-923a-64976ec91a36 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:42.329839 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8297a45a-2ae5-4cc9-923a-64976ec91a36 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:42.333333 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8297a45a-2ae5-4cc9-923a-64976ec91a36 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:42.445827 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8297a45a-2ae5-4cc9-923a-64976ec91a36 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:42.455515 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8297a45a-2ae5-4cc9-923a-64976ec91a36 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5" status: 200 len: 1213 microversion: 2.1 time: 0.200669 Aug 04 16:44:42.460068 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1032/2053] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:42 2022] GET /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5 => generated 1213 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:42.469199 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-37e1ca70-4860-4775-ba87-3adc53d06631 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:42.469890 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-37e1ca70-4860-4775-ba87-3adc53d06631 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:42.485751 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-37e1ca70-4860-4775-ba87-3adc53d06631 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:42.486211 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-37e1ca70-4860-4775-ba87-3adc53d06631 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:42.487048 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-37e1ca70-4860-4775-ba87-3adc53d06631 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:42.487527 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-37e1ca70-4860-4775-ba87-3adc53d06631 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:42.764719 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6a153166-f52c-47ac-95bb-78d753094e4d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:42.790498 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6a153166-f52c-47ac-95bb-78d753094e4d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.636949 Aug 04 16:44:42.792236 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1022/2054] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:42 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:42.801258 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-282a1e67-b004-49cd-ba2d-9f2d77901f2b tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:42.802830 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-282a1e67-b004-49cd-ba2d-9f2d77901f2b tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] [instance: 632449ba-73dd-4aeb-bc39-f26d6de4e726] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:42.818789 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-37e1ca70-4860-4775-ba87-3adc53d06631 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:42.836611 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-37e1ca70-4860-4775-ba87-3adc53d06631 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1" status: 200 len: 1470 microversion: 2.1 time: 0.375097 Aug 04 16:44:42.848640 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1033/2055] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:42 2022] GET /compute/v2.1/servers/0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1 => generated 1470 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:42.848855 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-282a1e67-b004-49cd-ba2d-9f2d77901f2b tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:42.848855 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-282a1e67-b004-49cd-ba2d-9f2d77901f2b tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:42.848855 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-282a1e67-b004-49cd-ba2d-9f2d77901f2b tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:42.848855 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-282a1e67-b004-49cd-ba2d-9f2d77901f2b tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:42.849151 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-bd53ef0c-3c48-4ea9-9233-e490df344b63 req-eda484ef-6853-4a09-b340-6fe20dacfed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e", "name": "network-vif-plugged", "status": "completed", "tag": "a6611342-a3b8-4d7d-b82d-62a23bc1209a"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:44:42.855549 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-bd53ef0c-3c48-4ea9-9233-e490df344b63 req-eda484ef-6853-4a09-b340-6fe20dacfed5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:42.855549 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-bd53ef0c-3c48-4ea9-9233-e490df344b63 req-eda484ef-6853-4a09-b340-6fe20dacfed5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:42.880755 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-bd53ef0c-3c48-4ea9-9233-e490df344b63 req-eda484ef-6853-4a09-b340-6fe20dacfed5 service nova] Creating event network-vif-plugged:a6611342-a3b8-4d7d-b82d-62a23bc1209a for instance 6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e on n-h2-846466-12 Aug 04 16:44:42.888676 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-bd53ef0c-3c48-4ea9-9233-e490df344b63 req-eda484ef-6853-4a09-b340-6fe20dacfed5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049183 Aug 04 16:44:42.894072 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1034/2056] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:44:42.903928 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4b541867-5e97-4bd7-933c-1d7b05df6e83 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:42.904611 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4b541867-5e97-4bd7-933c-1d7b05df6e83 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:42.912735 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4b541867-5e97-4bd7-933c-1d7b05df6e83 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:42.914299 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4b541867-5e97-4bd7-933c-1d7b05df6e83 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:42.915203 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4b541867-5e97-4bd7-933c-1d7b05df6e83 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:42.915694 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4b541867-5e97-4bd7-933c-1d7b05df6e83 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:43.314469 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4b541867-5e97-4bd7-933c-1d7b05df6e83 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:43.318793 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-282a1e67-b004-49cd-ba2d-9f2d77901f2b tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9bde1645f64765a41a3f0d65a9ee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8ad7f728004fa0a6db9fba7c3c9cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:43.328916 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-282a1e67-b004-49cd-ba2d-9f2d77901f2b tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] 10.222.0.23 "GET /compute/v2.1/servers/632449ba-73dd-4aeb-bc39-f26d6de4e726" status: 200 len: 1542 microversion: 2.1 time: 0.534257 Aug 04 16:44:43.329544 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1023/2057] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:42 2022] GET /compute/v2.1/servers/632449ba-73dd-4aeb-bc39-f26d6de4e726 => generated 1542 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:43.362540 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c3a9629c-1f58-40f4-b48a-ed3c0658f1d7 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e84230700>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:43.366602 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4b541867-5e97-4bd7-933c-1d7b05df6e83 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.466841 Aug 04 16:44:43.374915 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1035/2058] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:42 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:43.420389 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3916ad83-d93f-43c5-a8dc-c236efaf0155 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:43.423140 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3916ad83-d93f-43c5-a8dc-c236efaf0155 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 8f6461bb-aeb9-459a-8518-47055bfd5f41] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:43.448880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3916ad83-d93f-43c5-a8dc-c236efaf0155 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:43.449235 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3916ad83-d93f-43c5-a8dc-c236efaf0155 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:43.450085 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3916ad83-d93f-43c5-a8dc-c236efaf0155 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:43.450508 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3916ad83-d93f-43c5-a8dc-c236efaf0155 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:43.544315 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c3a9629c-1f58-40f4-b48a-ed3c0658f1d7 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f" status: 200 len: 1410 microversion: 2.1 time: 0.195737 Aug 04 16:44:43.547033 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1024/2059] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:44:43 2022] GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f => generated 1410 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:43.552535 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f56c0b92-de74-4149-a99b-c467cdf2ba0b tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:43.563511 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f56c0b92-de74-4149-a99b-c467cdf2ba0b tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] [instance: 632449ba-73dd-4aeb-bc39-f26d6de4e726] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:43.598737 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f56c0b92-de74-4149-a99b-c467cdf2ba0b tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:43.600520 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f56c0b92-de74-4149-a99b-c467cdf2ba0b tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:43.602976 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f56c0b92-de74-4149-a99b-c467cdf2ba0b tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:43.608073 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f56c0b92-de74-4149-a99b-c467cdf2ba0b tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:44.541505 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f56c0b92-de74-4149-a99b-c467cdf2ba0b tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] 10.222.0.23 "GET /compute/v2.1/servers/632449ba-73dd-4aeb-bc39-f26d6de4e726/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.992964 Aug 04 16:44:44.542560 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1025/2060] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Aug 4 16:44:43 2022] GET /compute/v2.1/servers/632449ba-73dd-4aeb-bc39-f26d6de4e726/os-interface => generated 285 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:44:44.546803 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bf23dcda-a87c-4991-ad4f-a0b3cdf36d53 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:44.547663 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bf23dcda-a87c-4991-ad4f-a0b3cdf36d53 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:44.562437 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf23dcda-a87c-4991-ad4f-a0b3cdf36d53 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:44.563259 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf23dcda-a87c-4991-ad4f-a0b3cdf36d53 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:44.564337 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf23dcda-a87c-4991-ad4f-a0b3cdf36d53 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:44.565013 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf23dcda-a87c-4991-ad4f-a0b3cdf36d53 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:44.650807 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3916ad83-d93f-43c5-a8dc-c236efaf0155 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:44.668104 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3916ad83-d93f-43c5-a8dc-c236efaf0155 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/8f6461bb-aeb9-459a-8518-47055bfd5f41" status: 200 len: 1509 microversion: 2.1 time: 1.287784 Aug 04 16:44:44.668712 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1036/2061] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:43 2022] GET /compute/v2.1/servers/8f6461bb-aeb9-459a-8518-47055bfd5f41 => generated 1509 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:44.687495 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c6d64a10-20b0-4fa1-89c3-aa86b64b03b0 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:44.688446 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c6d64a10-20b0-4fa1-89c3-aa86b64b03b0 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 86667237-3005-4ee4-83d6-c250bba481d5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:44.695305 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c6d64a10-20b0-4fa1-89c3-aa86b64b03b0 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:44.696094 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c6d64a10-20b0-4fa1-89c3-aa86b64b03b0 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:44.697097 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c6d64a10-20b0-4fa1-89c3-aa86b64b03b0 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:44.697742 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c6d64a10-20b0-4fa1-89c3-aa86b64b03b0 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:44.938685 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c6d64a10-20b0-4fa1-89c3-aa86b64b03b0 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:44.953964 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c6d64a10-20b0-4fa1-89c3-aa86b64b03b0 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5" status: 200 len: 1275 microversion: 2.1 time: 0.271326 Aug 04 16:44:44.954860 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1037/2062] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:44 2022] GET /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5 => generated 1275 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:44.960245 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dea6c3d6-8ad8-47c0-8f44-39953e85c5f4 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:44.966264 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dea6c3d6-8ad8-47c0-8f44-39953e85c5f4 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:44.977136 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dea6c3d6-8ad8-47c0-8f44-39953e85c5f4 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:44.977896 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dea6c3d6-8ad8-47c0-8f44-39953e85c5f4 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:44.990531 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dea6c3d6-8ad8-47c0-8f44-39953e85c5f4 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:44.991247 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dea6c3d6-8ad8-47c0-8f44-39953e85c5f4 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:45.429083 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bf23dcda-a87c-4991-ad4f-a0b3cdf36d53 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:45.443121 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bf23dcda-a87c-4991-ad4f-a0b3cdf36d53 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.899845 Aug 04 16:44:45.444050 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1026/2063] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:44 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:45.467783 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c319bdf1-ae0c-4a2d-9c74-fb5e81c49329 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e89b751f0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:45.594299 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c319bdf1-ae0c-4a2d-9c74-fb5e81c49329 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f" status: 200 len: 1410 microversion: 2.1 time: 0.148180 Aug 04 16:44:45.612503 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1027/2064] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:44:45 2022] GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f => generated 1410 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:45.648464 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dea6c3d6-8ad8-47c0-8f44-39953e85c5f4 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:45.664587 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dea6c3d6-8ad8-47c0-8f44-39953e85c5f4 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1" status: 200 len: 1470 microversion: 2.1 time: 0.708402 Aug 04 16:44:45.667109 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1038/2065] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:44 2022] GET /compute/v2.1/servers/0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1 => generated 1470 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:45.701726 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-db5cbb88-938a-47d8-8980-0a20d315fd35 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:45.702891 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-db5cbb88-938a-47d8-8980-0a20d315fd35 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 8f6461bb-aeb9-459a-8518-47055bfd5f41] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:45.726712 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db5cbb88-938a-47d8-8980-0a20d315fd35 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:45.731705 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db5cbb88-938a-47d8-8980-0a20d315fd35 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:45.740885 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db5cbb88-938a-47d8-8980-0a20d315fd35 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:45.741722 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db5cbb88-938a-47d8-8980-0a20d315fd35 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:46.009321 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cb9f3e5b-348a-4657-866a-d845ffc2a6fd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1359961631", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "fcd939fe-a897-44ae-b0c2-2548006a8cea"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:44:46.156071 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-db5cbb88-938a-47d8-8980-0a20d315fd35 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:46.190582 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-db5cbb88-938a-47d8-8980-0a20d315fd35 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/8f6461bb-aeb9-459a-8518-47055bfd5f41" status: 200 len: 1467 microversion: 2.1 time: 0.499091 Aug 04 16:44:46.193961 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1028/2066] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:45 2022] GET /compute/v2.1/servers/8f6461bb-aeb9-459a-8518-47055bfd5f41 => generated 1467 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:46.209388 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-39d92c64-d029-49d0-a487-fc5c6c251653 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:46.212354 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-39d92c64-d029-49d0-a487-fc5c6c251653 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 86667237-3005-4ee4-83d6-c250bba481d5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:46.237097 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-cb9f3e5b-348a-4657-866a-d845ffc2a6fd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] validate_networks() for [('fcd939fe-a897-44ae-b0c2-2548006a8cea', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:44:46.290987 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39d92c64-d029-49d0-a487-fc5c6c251653 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:46.300006 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39d92c64-d029-49d0-a487-fc5c6c251653 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:46.301208 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39d92c64-d029-49d0-a487-fc5c6c251653 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:46.309510 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39d92c64-d029-49d0-a487-fc5c6c251653 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:46.683308 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-39d92c64-d029-49d0-a487-fc5c6c251653 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:46.713369 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-39d92c64-d029-49d0-a487-fc5c6c251653 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5" status: 200 len: 1275 microversion: 2.1 time: 0.517187 Aug 04 16:44:46.729797 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1029/2067] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:46 2022] GET /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5 => generated 1275 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:46.753263 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-b6bbc638-cda4-4b89-8e35-2e54bd650280 req-a6f908ab-78c8-4a3b-903a-af3c76cb7ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f6461bb-aeb9-459a-8518-47055bfd5f41", "name": "network-vif-deleted", "tag": "a2d89e60-6642-4d21-9485-0ab90d28d1ae"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:44:46.771828 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-b6bbc638-cda4-4b89-8e35-2e54bd650280 req-a6f908ab-78c8-4a3b-903a-af3c76cb7ab1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:46.772963 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-b6bbc638-cda4-4b89-8e35-2e54bd650280 req-a6f908ab-78c8-4a3b-903a-af3c76cb7ab1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:46.799944 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-b6bbc638-cda4-4b89-8e35-2e54bd650280 req-a6f908ab-78c8-4a3b-903a-af3c76cb7ab1 service nova] Creating event network-vif-deleted:a2d89e60-6642-4d21-9485-0ab90d28d1ae for instance 8f6461bb-aeb9-459a-8518-47055bfd5f41 on n-h1-846466-12 Aug 04 16:44:46.820161 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-b6bbc638-cda4-4b89-8e35-2e54bd650280 req-a6f908ab-78c8-4a3b-903a-af3c76cb7ab1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085969 Aug 04 16:44:46.825506 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1030/2068] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:44:46.838738 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-57e5005c-ba54-42f4-83ac-abb0aa07da72 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e84214790>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:46.918475 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-57e5005c-ba54-42f4-83ac-abb0aa07da72 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f" status: 200 len: 1410 microversion: 2.1 time: 0.090787 Aug 04 16:44:46.919486 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1031/2069] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:44:46 2022] GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f => generated 1410 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:46.937676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fd61298f-2760-4eb0-b5c0-36b24f25926b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:46.938738 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fd61298f-2760-4eb0-b5c0-36b24f25926b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:46.943958 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:44:46.951283 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fd61298f-2760-4eb0-b5c0-36b24f25926b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:46.952031 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fd61298f-2760-4eb0-b5c0-36b24f25926b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:46.953646 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fd61298f-2760-4eb0-b5c0-36b24f25926b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:46.954743 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fd61298f-2760-4eb0-b5c0-36b24f25926b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:47.068245 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fd61298f-2760-4eb0-b5c0-36b24f25926b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:47.071424 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fd61298f-2760-4eb0-b5c0-36b24f25926b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:47.073147 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-fd61298f-2760-4eb0-b5c0-36b24f25926b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lazy-loading 'fault' on Instance uuid 0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:44:47.239468 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fd61298f-2760-4eb0-b5c0-36b24f25926b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:47.257585 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fd61298f-2760-4eb0-b5c0-36b24f25926b tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1" status: 200 len: 1304 microversion: 2.1 time: 0.336353 Aug 04 16:44:47.276354 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1032/2070] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:46 2022] GET /compute/v2.1/servers/0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1 => generated 1304 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:47.282166 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-61af985e-7d2a-4f76-abcf-ef886e7b7b19 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:47.282916 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-61af985e-7d2a-4f76-abcf-ef886e7b7b19 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 8f6461bb-aeb9-459a-8518-47055bfd5f41] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:47.316777 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-61af985e-7d2a-4f76-abcf-ef886e7b7b19 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:47.317830 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-61af985e-7d2a-4f76-abcf-ef886e7b7b19 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:47.319139 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-61af985e-7d2a-4f76-abcf-ef886e7b7b19 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:47.319871 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-61af985e-7d2a-4f76-abcf-ef886e7b7b19 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:47.361070 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-61af985e-7d2a-4f76-abcf-ef886e7b7b19 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] HTTP exception thrown: Instance 8f6461bb-aeb9-459a-8518-47055bfd5f41 could not be found. Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-61af985e-7d2a-4f76-abcf-ef886e7b7b19 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Request method failure captured: Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/8f6461bb-aeb9-459a-8518-47055bfd5f41 HTTP/1.1 Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_ddGi-LUxEkOI7UNq-ijU5XnirMgjjOPky_n4iIeohsp_mBZi36CDxRY5dUKGmgKLroDx6IsvA3hey_uA7LPQbZI4NWhaCZQIOIkAKlIttRUGlU4y_AMkv45dQEQsQ8xd9VhN5XbmaVn_f0gvdFbALtWn0QI5OJtAeQ50IP8tuO8i0 Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/60281cf1dbe645d8949e93f9e70b5d91"}]}] Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 3cfb4739b53b411391a26de37b98469f Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 8f6461bb-aeb9-459a-8518-47055bfd5f41 could not be found. Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '8f6461bb-aeb9-459a-8518-47055bfd5f41'} Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f6461bb-aeb9-459a-8518-47055bfd5f41 could not be found. Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f6461bb-aeb9-459a-8518-47055bfd5f41 could not be found. Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:44:47.362864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:44:47.366695 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:44:47.366695 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:44:47.366695 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:44:47.366695 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:44:47.366695 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:44:47.366695 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f6461bb-aeb9-459a-8518-47055bfd5f41 could not be found. Aug 04 16:44:47.366695 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:44:47.366695 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-61af985e-7d2a-4f76-abcf-ef886e7b7b19 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Returning 404 to user: Instance 8f6461bb-aeb9-459a-8518-47055bfd5f41 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:44:47.367568 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-61af985e-7d2a-4f76-abcf-ef886e7b7b19 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/8f6461bb-aeb9-459a-8518-47055bfd5f41" status: 404 len: 111 microversion: 2.1 time: 0.086899 Aug 04 16:44:47.377468 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1033/2071] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:47 2022] GET /compute/v2.1/servers/8f6461bb-aeb9-459a-8518-47055bfd5f41 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:44:47.642810 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-af3f5f14-9ec2-40bf-a0e1-bccf52755633 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1177854530", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "fd9ba46f-9583-4f53-9ced-a3b1af7aa6df"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:44:47.779989 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-af3f5f14-9ec2-40bf-a0e1-bccf52755633 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] validate_networks() for [('fd9ba46f-9583-4f53-9ced-a3b1af7aa6df', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:44:48.332564 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-cb9f3e5b-348a-4657-866a-d845ffc2a6fd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:44:48.333665 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-cb9f3e5b-348a-4657-866a-d845ffc2a6fd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:44:48.334417 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-cb9f3e5b-348a-4657-866a-d845ffc2a6fd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:44:48.335015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-cb9f3e5b-348a-4657-866a-d845ffc2a6fd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:44:48.335607 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-cb9f3e5b-348a-4657-866a-d845ffc2a6fd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:44:48.359140 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cb9f3e5b-348a-4657-866a-d845ffc2a6fd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:48.363056 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cb9f3e5b-348a-4657-866a-d845ffc2a6fd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:48.367476 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cb9f3e5b-348a-4657-866a-d845ffc2a6fd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:48.369381 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cb9f3e5b-348a-4657-866a-d845ffc2a6fd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:48.434525 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-cb9f3e5b-348a-4657-866a-d845ffc2a6fd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Getting quotas for project 96ce955c9158463e9e98c53b99c581ec. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:44:48.464853 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-cb9f3e5b-348a-4657-866a-d845ffc2a6fd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Getting quotas for user 438d083dc9e74b2f8970455505791250 and project 96ce955c9158463e9e98c53b99c581ec. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:44:48.501331 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cb9f3e5b-348a-4657-866a-d845ffc2a6fd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:44:48.505894 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cb9f3e5b-348a-4657-866a-d845ffc2a6fd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:44:48.612096 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cb9f3e5b-348a-4657-866a-d845ffc2a6fd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.626274 Aug 04 16:44:48.618740 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1039/2072] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:44:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:44:48.626422 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7d293bf7-4dc1-48a0-a9aa-dbf31cb29b4b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:48.627230 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7d293bf7-4dc1-48a0-a9aa-dbf31cb29b4b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 86667237-3005-4ee4-83d6-c250bba481d5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:48.638765 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d293bf7-4dc1-48a0-a9aa-dbf31cb29b4b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:48.641578 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d293bf7-4dc1-48a0-a9aa-dbf31cb29b4b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:48.642618 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d293bf7-4dc1-48a0-a9aa-dbf31cb29b4b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:48.643488 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d293bf7-4dc1-48a0-a9aa-dbf31cb29b4b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:49.619199 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7d293bf7-4dc1-48a0-a9aa-dbf31cb29b4b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:49.670711 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7d293bf7-4dc1-48a0-a9aa-dbf31cb29b4b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5" status: 200 len: 1317 microversion: 2.1 time: 1.049942 Aug 04 16:44:49.671710 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1040/2073] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:48 2022] GET /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5 => generated 1317 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:49.703443 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-58a453a3-a053-4df9-801f-514e6924d323 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e77d39790>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:49.825469 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-58a453a3-a053-4df9-801f-514e6924d323 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f" status: 200 len: 1410 microversion: 2.1 time: 0.152223 Aug 04 16:44:49.827796 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1041/2074] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:44:49 2022] GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f => generated 1410 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:50.198631 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-af3f5f14-9ec2-40bf-a0e1-bccf52755633 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:44:50.213015 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-af3f5f14-9ec2-40bf-a0e1-bccf52755633 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:44:50.223520 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-af3f5f14-9ec2-40bf-a0e1-bccf52755633 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:44:50.224871 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-af3f5f14-9ec2-40bf-a0e1-bccf52755633 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:44:50.227993 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-af3f5f14-9ec2-40bf-a0e1-bccf52755633 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:44:50.263768 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-af3f5f14-9ec2-40bf-a0e1-bccf52755633 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:50.270078 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-af3f5f14-9ec2-40bf-a0e1-bccf52755633 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:50.273073 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-af3f5f14-9ec2-40bf-a0e1-bccf52755633 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:50.274009 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-af3f5f14-9ec2-40bf-a0e1-bccf52755633 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:50.357183 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-af3f5f14-9ec2-40bf-a0e1-bccf52755633 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Getting quotas for project 60281cf1dbe645d8949e93f9e70b5d91. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:44:50.359736 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-82f2e643-f8c3-40d4-99de-4ef25de73a37 req-e1251b43-631a-4ed2-a0f8-198dc4bacadb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "632449ba-73dd-4aeb-bc39-f26d6de4e726", "tag": "a0e744c5-ed04-46e2-85e9-7e1d7d8096d3"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:44:50.367241 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-af3f5f14-9ec2-40bf-a0e1-bccf52755633 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Getting quotas for user 3cfb4739b53b411391a26de37b98469f and project 60281cf1dbe645d8949e93f9e70b5d91. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:44:50.386111 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-af3f5f14-9ec2-40bf-a0e1-bccf52755633 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:44:50.389009 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-af3f5f14-9ec2-40bf-a0e1-bccf52755633 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 03f171b8-c8d3-46c8-9429-4d90317c2b19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:44:50.391684 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-82f2e643-f8c3-40d4-99de-4ef25de73a37 req-e1251b43-631a-4ed2-a0f8-198dc4bacadb service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:50.395468 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-82f2e643-f8c3-40d4-99de-4ef25de73a37 req-e1251b43-631a-4ed2-a0f8-198dc4bacadb service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:50.444836 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-82f2e643-f8c3-40d4-99de-4ef25de73a37 req-e1251b43-631a-4ed2-a0f8-198dc4bacadb service nova] Creating event network-changed:a0e744c5-ed04-46e2-85e9-7e1d7d8096d3 for instance 632449ba-73dd-4aeb-bc39-f26d6de4e726 on n-h2-846466-12 Aug 04 16:44:50.453246 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-82f2e643-f8c3-40d4-99de-4ef25de73a37 req-e1251b43-631a-4ed2-a0f8-198dc4bacadb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.623752 Aug 04 16:44:50.454818 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1042/2075] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:44:50.482254 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-af3f5f14-9ec2-40bf-a0e1-bccf52755633 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.843334 Aug 04 16:44:50.483761 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1034/2076] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:44:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 16:44:50.490685 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7995f4d2-2ca2-46ca-811e-7c0ae010663e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:50.491578 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7995f4d2-2ca2-46ca-811e-7c0ae010663e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:50.495686 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-741d4a39-20c3-4555-8163-83bf13a775f4 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:50.500082 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7995f4d2-2ca2-46ca-811e-7c0ae010663e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:50.500778 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7995f4d2-2ca2-46ca-811e-7c0ae010663e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:50.501967 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7995f4d2-2ca2-46ca-811e-7c0ae010663e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:50.502708 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7995f4d2-2ca2-46ca-811e-7c0ae010663e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:50.505580 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-741d4a39-20c3-4555-8163-83bf13a775f4 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:50.512442 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:44:50.553015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-741d4a39-20c3-4555-8163-83bf13a775f4 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:50.555991 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-741d4a39-20c3-4555-8163-83bf13a775f4 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:50.556804 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-741d4a39-20c3-4555-8163-83bf13a775f4 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:50.557387 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-741d4a39-20c3-4555-8163-83bf13a775f4 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:50.594622 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-741d4a39-20c3-4555-8163-83bf13a775f4 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] HTTP exception thrown: Instance 0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1 could not be found. Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-741d4a39-20c3-4555-8163-83bf13a775f4 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Request method failure captured: Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1 HTTP/1.1 Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_bZFBL2oiOie5_diZ5zNflD2pbGbft80N-Y0rzqNM6V8pf91Nq45zdBzt65M0kUJff4yWEoTtey2YQlNfqJ8ZaazTn-wwDCfMEOSbDn0rMMxVz9E_3C1qnIqgIJX-YeerahmeIHi5uD5MMVPX7wW51Keli7-cOEPEioUPDmBmFvl1I Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: c1c1660ad79d489392261a78b5677be5 Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersAdminTestJSON-1585527377 Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c1c1660ad79d489392261a78b5677be5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c1c1660ad79d489392261a78b5677be5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c1c1660ad79d489392261a78b5677be5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c1c1660ad79d489392261a78b5677be5"}]}] Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersAdminTestJSON-1585527377 Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: c1c1660ad79d489392261a78b5677be5 Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersAdminTestJSON-1585527377 Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersAdminTestJSON-1585527377-project Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 648fb8ee69e24f74bf694d0e99f04502 Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersAdminTestJSON-1585527377-project Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1 could not be found. Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1'} Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1 could not be found. Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1 could not be found. Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:44:50.601435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:44:50.605933 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:44:50.605933 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:44:50.605933 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:44:50.605933 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:44:50.605933 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:44:50.605933 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1 could not be found. Aug 04 16:44:50.605933 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:44:50.606606 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-741d4a39-20c3-4555-8163-83bf13a775f4 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Returning 404 to user: Instance 0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:44:50.607733 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-741d4a39-20c3-4555-8163-83bf13a775f4 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1" status: 404 len: 111 microversion: 2.1 time: 0.151154 Aug 04 16:44:50.609911 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1043/2077] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:50 2022] GET /compute/v2.1/servers/0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:44:50.623368 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-278bdd09-81cb-4228-90ab-681eb2a77ccc req-4b71bcbe-f5dc-4a83-8548-e4267ed0ebab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1", "name": "network-vif-deleted", "tag": "cd1f78ee-36ca-482d-a581-52c60f0acd8a"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:44:50.647943 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-278bdd09-81cb-4228-90ab-681eb2a77ccc req-4b71bcbe-f5dc-4a83-8548-e4267ed0ebab service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:50.648679 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-278bdd09-81cb-4228-90ab-681eb2a77ccc req-4b71bcbe-f5dc-4a83-8548-e4267ed0ebab service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:50.688881 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-278bdd09-81cb-4228-90ab-681eb2a77ccc req-4b71bcbe-f5dc-4a83-8548-e4267ed0ebab service nova] Creating event network-vif-deleted:cd1f78ee-36ca-482d-a581-52c60f0acd8a for instance 0c4b7dad-71f9-4a4c-9cba-5d97a8dd21d1 on n-h2-846466-12 Aug 04 16:44:50.702154 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-278bdd09-81cb-4228-90ab-681eb2a77ccc req-4b71bcbe-f5dc-4a83-8548-e4267ed0ebab service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088702 Aug 04 16:44:50.703461 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1044/2078] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:44:50.714023 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0447176d-cefb-4ae9-8aed-261636c75000 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:50.715042 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0447176d-cefb-4ae9-8aed-261636c75000 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 03f171b8-c8d3-46c8-9429-4d90317c2b19] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:51.132539 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7995f4d2-2ca2-46ca-811e-7c0ae010663e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:51.142821 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7995f4d2-2ca2-46ca-811e-7c0ae010663e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217" status: 200 len: 1267 microversion: 2.1 time: 0.657443 Aug 04 16:44:51.179050 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1035/2079] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:50 2022] GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217 => generated 1267 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:51.197079 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4eeca69f-5bb8-4de8-a174-12b1afc632ca tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:51.216107 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4eeca69f-5bb8-4de8-a174-12b1afc632ca tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:51.254553 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4eeca69f-5bb8-4de8-a174-12b1afc632ca tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:51.255739 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4eeca69f-5bb8-4de8-a174-12b1afc632ca tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:51.257508 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4eeca69f-5bb8-4de8-a174-12b1afc632ca tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:51.265858 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4eeca69f-5bb8-4de8-a174-12b1afc632ca tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:51.339476 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4eeca69f-5bb8-4de8-a174-12b1afc632ca tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:44:51.439293 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:44:51.548089 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4eeca69f-5bb8-4de8-a174-12b1afc632ca tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "DELETE /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 204 len: 0 microversion: 2.1 time: 0.366525 Aug 04 16:44:51.552801 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1036/2080] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:44:51 2022] DELETE /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:44:51.578974 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bb18e94b-8230-4701-be91-cef24fb30081 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:51.580541 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bb18e94b-8230-4701-be91-cef24fb30081 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 86667237-3005-4ee4-83d6-c250bba481d5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:51.606284 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0447176d-cefb-4ae9-8aed-261636c75000 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:51.607101 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bb18e94b-8230-4701-be91-cef24fb30081 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:51.607740 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bb18e94b-8230-4701-be91-cef24fb30081 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:51.608825 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bb18e94b-8230-4701-be91-cef24fb30081 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:51.609839 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bb18e94b-8230-4701-be91-cef24fb30081 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:51.646325 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0447176d-cefb-4ae9-8aed-261636c75000 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19" status: 200 len: 1215 microversion: 2.1 time: 0.938938 Aug 04 16:44:51.648929 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1045/2081] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:50 2022] GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19 => generated 1215 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:51.689074 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f898e817-a9a0-46f4-922f-6d8a5a1ff464 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e77c80310>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:51.857251 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f898e817-a9a0-46f4-922f-6d8a5a1ff464 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f" status: 200 len: 1410 microversion: 2.1 time: 0.203439 Aug 04 16:44:51.866693 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1046/2082] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:44:51 2022] GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f => generated 1410 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:51.875294 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-42324051-64f1-491f-bedd-96eaad12070e tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:51.876439 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-42324051-64f1-491f-bedd-96eaad12070e tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:51.886981 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-42324051-64f1-491f-bedd-96eaad12070e tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:51.887455 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-42324051-64f1-491f-bedd-96eaad12070e tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:51.888567 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-42324051-64f1-491f-bedd-96eaad12070e tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:51.889018 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-42324051-64f1-491f-bedd-96eaad12070e tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:52.917633 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-42324051-64f1-491f-bedd-96eaad12070e tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:52.942579 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-42324051-64f1-491f-bedd-96eaad12070e tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1469 microversion: 2.1 time: 1.073942 Aug 04 16:44:52.943257 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1047/2083] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:51 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1469 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:52.949154 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-02a92e64-1483-45c6-98a0-e554cebce266 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:52.949862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-02a92e64-1483-45c6-98a0-e554cebce266 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:52.976468 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02a92e64-1483-45c6-98a0-e554cebce266 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:52.977421 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02a92e64-1483-45c6-98a0-e554cebce266 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:52.978454 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02a92e64-1483-45c6-98a0-e554cebce266 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:52.979740 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02a92e64-1483-45c6-98a0-e554cebce266 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:53.109931 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bb18e94b-8230-4701-be91-cef24fb30081 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:53.140544 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bb18e94b-8230-4701-be91-cef24fb30081 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5" status: 200 len: 1317 microversion: 2.1 time: 1.574483 Aug 04 16:44:53.142585 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1037/2084] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:51 2022] GET /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5 => generated 1317 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:53.176942 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-eb6b6b5e-547a-45e5-8f9a-e69baebc0305 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:53.182699 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-eb6b6b5e-547a-45e5-8f9a-e69baebc0305 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 03f171b8-c8d3-46c8-9429-4d90317c2b19] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:53.222151 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eb6b6b5e-547a-45e5-8f9a-e69baebc0305 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:53.222743 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eb6b6b5e-547a-45e5-8f9a-e69baebc0305 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:53.223912 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eb6b6b5e-547a-45e5-8f9a-e69baebc0305 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:53.224548 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eb6b6b5e-547a-45e5-8f9a-e69baebc0305 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:53.325494 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-02a92e64-1483-45c6-98a0-e554cebce266 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:53.370007 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-02a92e64-1483-45c6-98a0-e554cebce266 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217" status: 200 len: 1273 microversion: 2.1 time: 0.424983 Aug 04 16:44:53.371563 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1048/2085] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:52 2022] GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217 => generated 1273 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:53.416841 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-09b0aa71-5d74-4df4-a91c-26b2a0a9f5f0 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e77c80c10>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:53.582147 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-eb6b6b5e-547a-45e5-8f9a-e69baebc0305 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:53.604474 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-eb6b6b5e-547a-45e5-8f9a-e69baebc0305 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19" status: 200 len: 1273 microversion: 2.1 time: 0.458580 Aug 04 16:44:53.606512 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1038/2086] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:53 2022] GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19 => generated 1273 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:53.763277 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-09b0aa71-5d74-4df4-a91c-26b2a0a9f5f0 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f" status: 200 len: 1410 microversion: 2.1 time: 0.367323 Aug 04 16:44:53.766580 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1049/2087] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:44:53 2022] GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f => generated 1410 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:53.980112 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-eccae514-8d1c-4c15-b12b-6e0bcae220fc tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:53.980872 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-eccae514-8d1c-4c15-b12b-6e0bcae220fc tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:53.995828 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eccae514-8d1c-4c15-b12b-6e0bcae220fc tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:53.996367 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eccae514-8d1c-4c15-b12b-6e0bcae220fc tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:53.997512 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eccae514-8d1c-4c15-b12b-6e0bcae220fc tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:53.998177 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eccae514-8d1c-4c15-b12b-6e0bcae220fc tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:54.184432 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1f23ff4f-c16b-4980-89e2-31dbd3c20429 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:54.185701 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1f23ff4f-c16b-4980-89e2-31dbd3c20429 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 86667237-3005-4ee4-83d6-c250bba481d5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:54.215673 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f23ff4f-c16b-4980-89e2-31dbd3c20429 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:54.223906 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f23ff4f-c16b-4980-89e2-31dbd3c20429 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:54.227587 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f23ff4f-c16b-4980-89e2-31dbd3c20429 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:54.229864 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f23ff4f-c16b-4980-89e2-31dbd3c20429 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:54.424397 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-eccae514-8d1c-4c15-b12b-6e0bcae220fc tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:54.447659 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-eccae514-8d1c-4c15-b12b-6e0bcae220fc tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1427 microversion: 2.1 time: 0.471493 Aug 04 16:44:54.449111 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1039/2088] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:53 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1427 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:44:54.479574 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9d3287c8-17a1-4901-9ae8-2fead23d9cea tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:54.480682 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9d3287c8-17a1-4901-9ae8-2fead23d9cea tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:54.492956 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d3287c8-17a1-4901-9ae8-2fead23d9cea tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:54.494792 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d3287c8-17a1-4901-9ae8-2fead23d9cea tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:54.496427 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d3287c8-17a1-4901-9ae8-2fead23d9cea tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:54.498209 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d3287c8-17a1-4901-9ae8-2fead23d9cea tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:54.767747 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9d3287c8-17a1-4901-9ae8-2fead23d9cea tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:54.783060 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9d3287c8-17a1-4901-9ae8-2fead23d9cea tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217" status: 200 len: 1273 microversion: 2.1 time: 0.331103 Aug 04 16:44:54.784676 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1040/2089] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:54 2022] GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217 => generated 1273 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:54.791967 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-08e8347e-b707-400a-99eb-7c1b79926482 req-17515326-0fd8-462a-90f5-a9352c9388c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b80b04-533e-48b5-8595-9de81ed2c526", "name": "network-vif-deleted", "tag": "1b245f3e-3f81-40cd-9523-09b35900d9ec"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:44:54.808828 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-08e8347e-b707-400a-99eb-7c1b79926482 req-17515326-0fd8-462a-90f5-a9352c9388c5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:54.810289 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-08e8347e-b707-400a-99eb-7c1b79926482 req-17515326-0fd8-462a-90f5-a9352c9388c5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:54.847698 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-08e8347e-b707-400a-99eb-7c1b79926482 req-17515326-0fd8-462a-90f5-a9352c9388c5 service nova] Creating event network-vif-deleted:1b245f3e-3f81-40cd-9523-09b35900d9ec for instance 97b80b04-533e-48b5-8595-9de81ed2c526 on n-h1-846466-12 Aug 04 16:44:54.860615 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-08e8347e-b707-400a-99eb-7c1b79926482 req-17515326-0fd8-462a-90f5-a9352c9388c5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073534 Aug 04 16:44:54.862336 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1041/2090] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:44:54.873127 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-58cfb8b7-2d15-4459-b417-496f4ce180cd tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:54.876399 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-58cfb8b7-2d15-4459-b417-496f4ce180cd tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 03f171b8-c8d3-46c8-9429-4d90317c2b19] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:54.888457 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58cfb8b7-2d15-4459-b417-496f4ce180cd tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:54.889220 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58cfb8b7-2d15-4459-b417-496f4ce180cd tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:54.890700 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58cfb8b7-2d15-4459-b417-496f4ce180cd tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:54.892783 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58cfb8b7-2d15-4459-b417-496f4ce180cd tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:55.120360 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-58cfb8b7-2d15-4459-b417-496f4ce180cd tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:55.168236 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-58cfb8b7-2d15-4459-b417-496f4ce180cd tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19" status: 200 len: 1273 microversion: 2.1 time: 0.303396 Aug 04 16:44:55.177009 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1042/2091] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:54 2022] GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19 => generated 1273 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:55.215190 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d180cd0e-483b-4e84-a7fe-1f3362077ee4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e848a6820>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:55.405950 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d180cd0e-483b-4e84-a7fe-1f3362077ee4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f" status: 200 len: 1410 microversion: 2.1 time: 0.227044 Aug 04 16:44:55.406833 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1043/2092] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:44:55 2022] GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f => generated 1410 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:55.418253 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-fd442434-9c28-4f88-b94b-baf1231c25b7 req-3623ab68-a1f2-497b-a84a-4493f23225e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86667237-3005-4ee4-83d6-c250bba481d5", "tag": "86efd42c-b4ec-48e6-be31-8bf561896203"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:44:55.443295 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-fd442434-9c28-4f88-b94b-baf1231c25b7 req-3623ab68-a1f2-497b-a84a-4493f23225e1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:55.444231 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-fd442434-9c28-4f88-b94b-baf1231c25b7 req-3623ab68-a1f2-497b-a84a-4493f23225e1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:55.476731 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-fd442434-9c28-4f88-b94b-baf1231c25b7 req-3623ab68-a1f2-497b-a84a-4493f23225e1 service nova] Creating event network-changed:86efd42c-b4ec-48e6-be31-8bf561896203 for instance 86667237-3005-4ee4-83d6-c250bba481d5 on n-h1-846466-12 Aug 04 16:44:55.490826 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-fd442434-9c28-4f88-b94b-baf1231c25b7 req-3623ab68-a1f2-497b-a84a-4493f23225e1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079132 Aug 04 16:44:55.492626 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1044/2093] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:44:55.495283 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1f23ff4f-c16b-4980-89e2-31dbd3c20429 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:55.506749 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1f23ff4f-c16b-4980-89e2-31dbd3c20429 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5" status: 200 len: 1317 microversion: 2.1 time: 1.329558 Aug 04 16:44:55.508470 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1050/2094] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:54 2022] GET /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5 => generated 1317 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:55.528665 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-687dbedf-43e2-4cbc-b5f4-3403fa63262f tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:55.529747 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-687dbedf-43e2-4cbc-b5f4-3403fa63262f tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:55.538174 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-687dbedf-43e2-4cbc-b5f4-3403fa63262f tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:55.538950 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-687dbedf-43e2-4cbc-b5f4-3403fa63262f tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:55.539955 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-687dbedf-43e2-4cbc-b5f4-3403fa63262f tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:55.540579 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-687dbedf-43e2-4cbc-b5f4-3403fa63262f tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:55.597118 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-687dbedf-43e2-4cbc-b5f4-3403fa63262f tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:55.599183 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-687dbedf-43e2-4cbc-b5f4-3403fa63262f tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:55.600500 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-687dbedf-43e2-4cbc-b5f4-3403fa63262f tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lazy-loading 'fault' on Instance uuid 97b80b04-533e-48b5-8595-9de81ed2c526 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:44:55.789870 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-687dbedf-43e2-4cbc-b5f4-3403fa63262f tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648fb8ee69e24f74bf694d0e99f04502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1660ad79d489392261a78b5677be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:55.802179 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-687dbedf-43e2-4cbc-b5f4-3403fa63262f tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 200 len: 1304 microversion: 2.1 time: 0.278525 Aug 04 16:44:55.810440 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1045/2095] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:55 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 1304 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:55.820000 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-65c11ebb-71b2-4d38-9802-72662f4f25b0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:55.821093 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-65c11ebb-71b2-4d38-9802-72662f4f25b0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:55.853210 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-65c11ebb-71b2-4d38-9802-72662f4f25b0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:55.854306 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-65c11ebb-71b2-4d38-9802-72662f4f25b0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:55.864084 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-65c11ebb-71b2-4d38-9802-72662f4f25b0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:55.868938 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-65c11ebb-71b2-4d38-9802-72662f4f25b0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:56.060452 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-65c11ebb-71b2-4d38-9802-72662f4f25b0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:56.083637 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-65c11ebb-71b2-4d38-9802-72662f4f25b0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217" status: 200 len: 1273 microversion: 2.1 time: 0.271024 Aug 04 16:44:56.086192 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1051/2096] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:55 2022] GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217 => generated 1273 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:56.207327 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e80057a0-1c2d-4b51-adb4-9a9c4521ba84 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:56.208822 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e80057a0-1c2d-4b51-adb4-9a9c4521ba84 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 03f171b8-c8d3-46c8-9429-4d90317c2b19] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:56.232799 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e80057a0-1c2d-4b51-adb4-9a9c4521ba84 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:56.234254 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e80057a0-1c2d-4b51-adb4-9a9c4521ba84 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:56.235769 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e80057a0-1c2d-4b51-adb4-9a9c4521ba84 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:56.236491 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e80057a0-1c2d-4b51-adb4-9a9c4521ba84 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:56.429924 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d617b313-9dca-4a7d-9115-1259d7dee812 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e77cc8ca0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:56.523265 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d617b313-9dca-4a7d-9115-1259d7dee812 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f" status: 200 len: 1410 microversion: 2.1 time: 0.099184 Aug 04 16:44:56.524678 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1052/2097] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:44:56 2022] GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f => generated 1410 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:56.530259 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-34aa713b-0c40-47f6-93d3-90bff38cf062 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:56.531083 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-34aa713b-0c40-47f6-93d3-90bff38cf062 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 86667237-3005-4ee4-83d6-c250bba481d5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:56.539897 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-34aa713b-0c40-47f6-93d3-90bff38cf062 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:56.540703 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-34aa713b-0c40-47f6-93d3-90bff38cf062 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:56.541789 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-34aa713b-0c40-47f6-93d3-90bff38cf062 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:56.542391 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-34aa713b-0c40-47f6-93d3-90bff38cf062 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:56.580283 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e80057a0-1c2d-4b51-adb4-9a9c4521ba84 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:56.591622 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e80057a0-1c2d-4b51-adb4-9a9c4521ba84 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19" status: 200 len: 1273 microversion: 2.1 time: 0.391359 Aug 04 16:44:56.613051 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1046/2098] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:56 2022] GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19 => generated 1273 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:56.853159 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-464a49c6-0f8a-4723-8abb-4d84f86e9250 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:56.858739 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-464a49c6-0f8a-4723-8abb-4d84f86e9250 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] [instance: 97b80b04-533e-48b5-8595-9de81ed2c526] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:56.867418 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-464a49c6-0f8a-4723-8abb-4d84f86e9250 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:56.868094 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-464a49c6-0f8a-4723-8abb-4d84f86e9250 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:56.880973 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-464a49c6-0f8a-4723-8abb-4d84f86e9250 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:56.882404 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-464a49c6-0f8a-4723-8abb-4d84f86e9250 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:56.919598 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-464a49c6-0f8a-4723-8abb-4d84f86e9250 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] HTTP exception thrown: Instance 97b80b04-533e-48b5-8595-9de81ed2c526 could not be found. Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-464a49c6-0f8a-4723-8abb-4d84f86e9250 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Request method failure captured: Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 HTTP/1.1 Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_bZFBL2oiOie5_diZ5zNflD2pbGbft80N-Y0rzqNM6V8pf91Nq45zdBzt65M0kUJff4yWEoTtey2YQlNfqJ8ZaazTn-wwDCfMEOSbDn0rMMxVz9E_3C1qnIqgIJX-YeerahmeIHi5uD5MMVPX7wW51Keli7-cOEPEioUPDmBmFvl1I Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: c1c1660ad79d489392261a78b5677be5 Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersAdminTestJSON-1585527377 Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c1c1660ad79d489392261a78b5677be5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c1c1660ad79d489392261a78b5677be5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c1c1660ad79d489392261a78b5677be5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c1c1660ad79d489392261a78b5677be5"}]}] Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersAdminTestJSON-1585527377 Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: c1c1660ad79d489392261a78b5677be5 Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersAdminTestJSON-1585527377 Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersAdminTestJSON-1585527377-project Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 648fb8ee69e24f74bf694d0e99f04502 Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersAdminTestJSON-1585527377-project Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 97b80b04-533e-48b5-8595-9de81ed2c526 could not be found. Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '97b80b04-533e-48b5-8595-9de81ed2c526'} Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97b80b04-533e-48b5-8595-9de81ed2c526 could not be found. Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97b80b04-533e-48b5-8595-9de81ed2c526 could not be found. Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:44:56.926835 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:44:56.932099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:44:56.932099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:44:56.932099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:44:56.932099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:44:56.932099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:44:56.932099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97b80b04-533e-48b5-8595-9de81ed2c526 could not be found. Aug 04 16:44:56.932099 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:44:56.936599 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-464a49c6-0f8a-4723-8abb-4d84f86e9250 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] Returning 404 to user: Instance 97b80b04-533e-48b5-8595-9de81ed2c526 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:44:56.946835 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-464a49c6-0f8a-4723-8abb-4d84f86e9250 tempest-ServersAdminTestJSON-1585527377 tempest-ServersAdminTestJSON-1585527377-project] 10.222.0.23 "GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526" status: 404 len: 111 microversion: 2.1 time: 0.093457 Aug 04 16:44:56.953894 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1047/2099] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:56 2022] GET /compute/v2.1/servers/97b80b04-533e-48b5-8595-9de81ed2c526 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:44:57.136069 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3f0d2a52-c2e2-4a70-a2d4-39f1b7ad766b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:57.137653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3f0d2a52-c2e2-4a70-a2d4-39f1b7ad766b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:57.166705 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3f0d2a52-c2e2-4a70-a2d4-39f1b7ad766b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:57.168053 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3f0d2a52-c2e2-4a70-a2d4-39f1b7ad766b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:57.169237 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3f0d2a52-c2e2-4a70-a2d4-39f1b7ad766b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:57.169980 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3f0d2a52-c2e2-4a70-a2d4-39f1b7ad766b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:57.242863 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-34aa713b-0c40-47f6-93d3-90bff38cf062 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:57.255380 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-34aa713b-0c40-47f6-93d3-90bff38cf062 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5" status: 200 len: 1317 microversion: 2.1 time: 0.726933 Aug 04 16:44:57.257230 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1053/2100] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:56 2022] GET /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5 => generated 1317 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:57.558700 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-46281565-c1e6-4ec2-85a2-029398f9c2e9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e84550040>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:57.680871 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-46281565-c1e6-4ec2-85a2-029398f9c2e9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f" status: 200 len: 1410 microversion: 2.1 time: 0.137516 Aug 04 16:44:57.682769 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1054/2101] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:44:57 2022] GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f => generated 1410 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:57.690807 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c5fa3a85-1b10-4261-8067-08aa57d99390 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:57.692435 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c5fa3a85-1b10-4261-8067-08aa57d99390 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 03f171b8-c8d3-46c8-9429-4d90317c2b19] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:57.707528 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c5fa3a85-1b10-4261-8067-08aa57d99390 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:57.709025 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c5fa3a85-1b10-4261-8067-08aa57d99390 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:57.712908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c5fa3a85-1b10-4261-8067-08aa57d99390 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:57.713791 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c5fa3a85-1b10-4261-8067-08aa57d99390 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:57.733917 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=100 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:44:57.804779 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3f0d2a52-c2e2-4a70-a2d4-39f1b7ad766b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:57.822874 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3f0d2a52-c2e2-4a70-a2d4-39f1b7ad766b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217" status: 200 len: 1315 microversion: 2.1 time: 0.693468 Aug 04 16:44:57.836306 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1048/2102] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:57 2022] GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217 => generated 1315 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:58.285417 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dffc3c98-9b20-4482-8eaa-39a614b7f836 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:58.286703 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-dffc3c98-9b20-4482-8eaa-39a614b7f836 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 86667237-3005-4ee4-83d6-c250bba481d5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:58.299976 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dffc3c98-9b20-4482-8eaa-39a614b7f836 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:58.316980 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dffc3c98-9b20-4482-8eaa-39a614b7f836 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:58.324483 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dffc3c98-9b20-4482-8eaa-39a614b7f836 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:58.326376 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dffc3c98-9b20-4482-8eaa-39a614b7f836 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:58.401039 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:44:58.671103 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c5fa3a85-1b10-4261-8067-08aa57d99390 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:58.699426 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c5fa3a85-1b10-4261-8067-08aa57d99390 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19" status: 200 len: 1315 microversion: 2.1 time: 1.008956 Aug 04 16:44:58.706970 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1055/2103] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:57 2022] GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19 => generated 1315 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:58.737831 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b3e8c130-bc00-4b15-8bac-eba4a6306ea4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e77cbd9d0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:58.829760 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b3e8c130-bc00-4b15-8bac-eba4a6306ea4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f" status: 200 len: 1410 microversion: 2.1 time: 0.121069 Aug 04 16:44:58.830459 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1056/2104] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:44:58 2022] GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f => generated 1410 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:58.868490 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c7d104c2-1304-4bd1-9b22-f240e6e86ec3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:58.869130 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c7d104c2-1304-4bd1-9b22-f240e6e86ec3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:58.893317 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c7d104c2-1304-4bd1-9b22-f240e6e86ec3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:58.894890 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c7d104c2-1304-4bd1-9b22-f240e6e86ec3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:58.896011 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c7d104c2-1304-4bd1-9b22-f240e6e86ec3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:58.896460 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c7d104c2-1304-4bd1-9b22-f240e6e86ec3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:59.735829 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-dffc3c98-9b20-4482-8eaa-39a614b7f836 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:44:59.755224 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dffc3c98-9b20-4482-8eaa-39a614b7f836 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5" status: 200 len: 1317 microversion: 2.1 time: 1.474849 Aug 04 16:44:59.777810 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1049/2105] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:58 2022] GET /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5 => generated 1317 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:44:59.791767 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d96b3e37-dd83-495e-acde-34d86895d86d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:44:59.793274 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d96b3e37-dd83-495e-acde-34d86895d86d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 03f171b8-c8d3-46c8-9429-4d90317c2b19] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:44:59.805538 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d96b3e37-dd83-495e-acde-34d86895d86d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:59.806647 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d96b3e37-dd83-495e-acde-34d86895d86d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:44:59.808288 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d96b3e37-dd83-495e-acde-34d86895d86d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:44:59.809275 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d96b3e37-dd83-495e-acde-34d86895d86d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:00.125948 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c7d104c2-1304-4bd1-9b22-f240e6e86ec3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:00.163824 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c7d104c2-1304-4bd1-9b22-f240e6e86ec3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217" status: 200 len: 1315 microversion: 2.1 time: 1.300981 Aug 04 16:45:00.167967 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1057/2106] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:58 2022] GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217 => generated 1315 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:00.186361 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-58bf3b0c-646f-477c-8955-c9c18eb43c44 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e77cbd310>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:00.316270 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-58bf3b0c-646f-477c-8955-c9c18eb43c44 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f" status: 200 len: 1410 microversion: 2.1 time: 0.133281 Aug 04 16:45:00.323777 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:45:00.325667 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1058/2107] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:45:00 2022] GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f => generated 1410 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:00.379982 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:45:00.434007 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d96b3e37-dd83-495e-acde-34d86895d86d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:00.470875 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d96b3e37-dd83-495e-acde-34d86895d86d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19" status: 200 len: 1315 microversion: 2.1 time: 0.690694 Aug 04 16:45:00.479443 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1050/2108] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:44:59 2022] GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19 => generated 1315 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:00.797113 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f15e679b-757c-48b5-9898-a15dc6521bed tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:00.798364 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f15e679b-757c-48b5-9898-a15dc6521bed tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 86667237-3005-4ee4-83d6-c250bba481d5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:00.821185 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f15e679b-757c-48b5-9898-a15dc6521bed tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:00.821944 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f15e679b-757c-48b5-9898-a15dc6521bed tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:00.822995 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f15e679b-757c-48b5-9898-a15dc6521bed tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:00.823711 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f15e679b-757c-48b5-9898-a15dc6521bed tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:01.194574 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5443b685-4d2e-45f7-b5d0-332bfb29057b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:01.196139 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5443b685-4d2e-45f7-b5d0-332bfb29057b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:01.210529 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5443b685-4d2e-45f7-b5d0-332bfb29057b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:01.211852 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5443b685-4d2e-45f7-b5d0-332bfb29057b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:01.213909 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5443b685-4d2e-45f7-b5d0-332bfb29057b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:01.216356 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5443b685-4d2e-45f7-b5d0-332bfb29057b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:01.405752 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f15e679b-757c-48b5-9898-a15dc6521bed tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:01.429114 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f15e679b-757c-48b5-9898-a15dc6521bed tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5" status: 200 len: 1317 microversion: 2.1 time: 0.638094 Aug 04 16:45:01.443885 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1059/2109] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:00 2022] GET /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5 => generated 1317 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:01.460848 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c2e4053b-0bf8-42f3-8257-a95cef63232b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e77cbd9d0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:01.535839 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c2e4053b-0bf8-42f3-8257-a95cef63232b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f" status: 200 len: 1419 microversion: 2.1 time: 0.089558 Aug 04 16:45:01.549154 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1060/2110] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:45:01 2022] GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f => generated 1419 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:01.558781 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-5e1effab-dfda-493c-99cf-45896394aa6a req-32fe1555-fcb8-489e-98b1-dec8b0918b47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86667237-3005-4ee4-83d6-c250bba481d5", "name": "network-vif-plugged", "status": "completed", "tag": "86efd42c-b4ec-48e6-be31-8bf561896203"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:01.576454 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-5e1effab-dfda-493c-99cf-45896394aa6a req-32fe1555-fcb8-489e-98b1-dec8b0918b47 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:01.577491 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-5e1effab-dfda-493c-99cf-45896394aa6a req-32fe1555-fcb8-489e-98b1-dec8b0918b47 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:01.595589 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-5e1effab-dfda-493c-99cf-45896394aa6a req-32fe1555-fcb8-489e-98b1-dec8b0918b47 service nova] Creating event network-vif-plugged:86efd42c-b4ec-48e6-be31-8bf561896203 for instance 86667237-3005-4ee4-83d6-c250bba481d5 on n-h1-846466-12 Aug 04 16:45:01.605693 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-5e1effab-dfda-493c-99cf-45896394aa6a req-32fe1555-fcb8-489e-98b1-dec8b0918b47 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053575 Aug 04 16:45:01.607271 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1061/2111] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:45:01.647846 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-835ffc4e-5d06-484b-bffb-d888dec38c33 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:01.651183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-835ffc4e-5d06-484b-bffb-d888dec38c33 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 03f171b8-c8d3-46c8-9429-4d90317c2b19] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:01.664616 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=16 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:45:01.669009 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-835ffc4e-5d06-484b-bffb-d888dec38c33 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:01.670055 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-835ffc4e-5d06-484b-bffb-d888dec38c33 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:01.671705 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-835ffc4e-5d06-484b-bffb-d888dec38c33 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:01.672521 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-835ffc4e-5d06-484b-bffb-d888dec38c33 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:01.682798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5443b685-4d2e-45f7-b5d0-332bfb29057b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:01.740671 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5443b685-4d2e-45f7-b5d0-332bfb29057b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217" status: 200 len: 1315 microversion: 2.1 time: 0.544405 Aug 04 16:45:01.742018 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1051/2112] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:01 2022] GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217 => generated 1315 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:01.757189 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4aac650a-fafd-4a8e-87d7-e386c19e9178 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e89c8bf70>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:01.974569 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4aac650a-fafd-4a8e-87d7-e386c19e9178 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f" status: 200 len: 1419 microversion: 2.1 time: 0.230966 Aug 04 16:45:01.980260 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1052/2113] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:45:01 2022] GET /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f => generated 1419 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:02.030961 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-dbf1c931-315a-4a92-9a9c-097afd35b69e req-ba717e7a-616d-4978-86a3-f48d25489e7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03f171b8-c8d3-46c8-9429-4d90317c2b19", "tag": "aeae8ac0-7f22-4211-a9c4-9052ca44865b"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:02.117653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-dbf1c931-315a-4a92-9a9c-097afd35b69e req-ba717e7a-616d-4978-86a3-f48d25489e7c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:02.124722 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-dbf1c931-315a-4a92-9a9c-097afd35b69e req-ba717e7a-616d-4978-86a3-f48d25489e7c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:02.199123 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-dbf1c931-315a-4a92-9a9c-097afd35b69e req-ba717e7a-616d-4978-86a3-f48d25489e7c service nova] Creating event network-changed:aeae8ac0-7f22-4211-a9c4-9052ca44865b for instance 03f171b8-c8d3-46c8-9429-4d90317c2b19 on n-h2-846466-12 Aug 04 16:45:02.240173 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-dbf1c931-315a-4a92-9a9c-097afd35b69e req-ba717e7a-616d-4978-86a3-f48d25489e7c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.238222 Aug 04 16:45:02.271444 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1053/2114] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:45:02.288870 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-51d7101b-49d8-4c64-a1fe-ec54d92dc4ae tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e89c8be50>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:02.739805 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-835ffc4e-5d06-484b-bffb-d888dec38c33 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:02.779535 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-835ffc4e-5d06-484b-bffb-d888dec38c33 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19" status: 200 len: 1315 microversion: 2.1 time: 1.168806 Aug 04 16:45:02.783726 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1062/2115] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:01 2022] GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19 => generated 1315 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:02.803472 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ae2d478a-8165-414c-bb53-451662d06ebd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:02.812938 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ae2d478a-8165-414c-bb53-451662d06ebd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 86667237-3005-4ee4-83d6-c250bba481d5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:02.846538 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ae2d478a-8165-414c-bb53-451662d06ebd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:02.847905 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ae2d478a-8165-414c-bb53-451662d06ebd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:02.849444 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ae2d478a-8165-414c-bb53-451662d06ebd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:02.850189 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ae2d478a-8165-414c-bb53-451662d06ebd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:03.664994 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-51d7101b-49d8-4c64-a1fe-ec54d92dc4ae tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "DELETE /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f" status: 204 len: 0 microversion: 2.1 time: 1.386913 Aug 04 16:45:03.666620 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1054/2116] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:02 2022] DELETE /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f => generated 0 bytes in 1395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:45:03.687313 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fe6ced97-9ef7-4711-92e1-1756a7a0ae27 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:03.690219 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fe6ced97-9ef7-4711-92e1-1756a7a0ae27 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:03.721504 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fe6ced97-9ef7-4711-92e1-1756a7a0ae27 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:03.722931 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fe6ced97-9ef7-4711-92e1-1756a7a0ae27 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:03.726193 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fe6ced97-9ef7-4711-92e1-1756a7a0ae27 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:03.728051 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fe6ced97-9ef7-4711-92e1-1756a7a0ae27 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:04.166363 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ae2d478a-8165-414c-bb53-451662d06ebd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:04.181196 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ae2d478a-8165-414c-bb53-451662d06ebd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5" status: 200 len: 1317 microversion: 2.1 time: 1.395233 Aug 04 16:45:04.181886 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1063/2117] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:02 2022] GET /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5 => generated 1317 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:04.189196 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-97abaac2-1a3b-4f36-b026-ba10969e493c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:04.189903 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-97abaac2-1a3b-4f36-b026-ba10969e493c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:04.198183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-97abaac2-1a3b-4f36-b026-ba10969e493c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:04.198883 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-97abaac2-1a3b-4f36-b026-ba10969e493c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:04.200119 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-97abaac2-1a3b-4f36-b026-ba10969e493c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:04.201028 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-97abaac2-1a3b-4f36-b026-ba10969e493c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:04.265442 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-97abaac2-1a3b-4f36-b026-ba10969e493c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:45:04.412684 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fe6ced97-9ef7-4711-92e1-1756a7a0ae27 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:04.425213 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fe6ced97-9ef7-4711-92e1-1756a7a0ae27 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217" status: 200 len: 1315 microversion: 2.1 time: 0.756607 Aug 04 16:45:04.446897 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1055/2118] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:03 2022] GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217 => generated 1315 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:04.454407 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c1cbae35-d0f2-4fc0-89d4-fb7377093a93 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:04.455398 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c1cbae35-d0f2-4fc0-89d4-fb7377093a93 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 03f171b8-c8d3-46c8-9429-4d90317c2b19] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:04.465594 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c1cbae35-d0f2-4fc0-89d4-fb7377093a93 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:04.466594 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c1cbae35-d0f2-4fc0-89d4-fb7377093a93 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:04.466854 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-97abaac2-1a3b-4f36-b026-ba10969e493c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e" status: 204 len: 0 microversion: 2.1 time: 0.283489 Aug 04 16:45:04.467508 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1064/2119] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:45:04 2022] DELETE /compute/v2.1/servers/6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:45:04.474815 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-14f01337-eb14-4358-99aa-d4fba5cdcbc3 req-d9a7c6c3-5b7d-4bac-a958-35d12e2920c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86b8342c-3797-4540-a6f3-f967340c1217", "tag": "6e42d24d-c057-4234-8aa4-45a8f3a0f560"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:04.481036 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c1cbae35-d0f2-4fc0-89d4-fb7377093a93 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:04.482359 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c1cbae35-d0f2-4fc0-89d4-fb7377093a93 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:04.501499 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-14f01337-eb14-4358-99aa-d4fba5cdcbc3 req-d9a7c6c3-5b7d-4bac-a958-35d12e2920c1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:04.505989 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-14f01337-eb14-4358-99aa-d4fba5cdcbc3 req-d9a7c6c3-5b7d-4bac-a958-35d12e2920c1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:04.541605 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-14f01337-eb14-4358-99aa-d4fba5cdcbc3 req-d9a7c6c3-5b7d-4bac-a958-35d12e2920c1 service nova] Creating event network-changed:6e42d24d-c057-4234-8aa4-45a8f3a0f560 for instance 86b8342c-3797-4540-a6f3-f967340c1217 on n-h1-846466-12 Aug 04 16:45:04.551912 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-14f01337-eb14-4358-99aa-d4fba5cdcbc3 req-d9a7c6c3-5b7d-4bac-a958-35d12e2920c1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082852 Aug 04 16:45:04.558865 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1065/2120] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:45:04.656112 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-421bd878-3ef6-4d3e-8d35-b89d70642d03 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-619538898", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "a690ca05-294e-4f0a-96cd-75ec0df3880f"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:04.755248 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-421bd878-3ef6-4d3e-8d35-b89d70642d03 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] validate_networks() for [('a690ca05-294e-4f0a-96cd-75ec0df3880f', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:45:05.037241 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c1cbae35-d0f2-4fc0-89d4-fb7377093a93 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:05.052204 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c1cbae35-d0f2-4fc0-89d4-fb7377093a93 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19" status: 200 len: 1315 microversion: 2.1 time: 0.603930 Aug 04 16:45:05.065798 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1056/2121] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:04 2022] GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19 => generated 1315 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:05.210451 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cf97a01d-cb39-424a-92ba-4535a679f204 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:05.212515 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cf97a01d-cb39-424a-92ba-4535a679f204 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 86667237-3005-4ee4-83d6-c250bba481d5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:05.223703 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf97a01d-cb39-424a-92ba-4535a679f204 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:05.224190 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf97a01d-cb39-424a-92ba-4535a679f204 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:05.229561 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf97a01d-cb39-424a-92ba-4535a679f204 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:05.233177 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf97a01d-cb39-424a-92ba-4535a679f204 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:05.930615 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cf97a01d-cb39-424a-92ba-4535a679f204 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:05.942874 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cf97a01d-cb39-424a-92ba-4535a679f204 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5" status: 200 len: 1466 microversion: 2.1 time: 0.739506 Aug 04 16:45:05.945072 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1057/2122] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:05 2022] GET /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5 => generated 1466 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:05.951712 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e2e6bdaa-c628-41dd-8e28-38030e9b66b5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:05.952873 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e2e6bdaa-c628-41dd-8e28-38030e9b66b5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:05.963684 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e2e6bdaa-c628-41dd-8e28-38030e9b66b5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:05.966675 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e2e6bdaa-c628-41dd-8e28-38030e9b66b5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:05.968733 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e2e6bdaa-c628-41dd-8e28-38030e9b66b5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:05.969815 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e2e6bdaa-c628-41dd-8e28-38030e9b66b5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:05.978880 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:45:06.432053 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-421bd878-3ef6-4d3e-8d35-b89d70642d03 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:45:06.433070 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-421bd878-3ef6-4d3e-8d35-b89d70642d03 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:45:06.434428 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-421bd878-3ef6-4d3e-8d35-b89d70642d03 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:45:06.435016 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-421bd878-3ef6-4d3e-8d35-b89d70642d03 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:45:06.435583 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-421bd878-3ef6-4d3e-8d35-b89d70642d03 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:45:06.459269 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-421bd878-3ef6-4d3e-8d35-b89d70642d03 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:06.460617 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-421bd878-3ef6-4d3e-8d35-b89d70642d03 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:06.462466 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-421bd878-3ef6-4d3e-8d35-b89d70642d03 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:06.463003 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-421bd878-3ef6-4d3e-8d35-b89d70642d03 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:06.498393 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-421bd878-3ef6-4d3e-8d35-b89d70642d03 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Getting quotas for project afa49d3246ea4361abb452e16e017faf. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:45:06.509707 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-421bd878-3ef6-4d3e-8d35-b89d70642d03 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Getting quotas for user a85f0bd88d79409e9610a47f3ae943ce and project afa49d3246ea4361abb452e16e017faf. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:45:06.526078 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e2e6bdaa-c628-41dd-8e28-38030e9b66b5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:06.530166 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-421bd878-3ef6-4d3e-8d35-b89d70642d03 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:45:06.538433 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e2e6bdaa-c628-41dd-8e28-38030e9b66b5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217" status: 200 len: 1315 microversion: 2.1 time: 0.591507 Aug 04 16:45:06.539325 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1058/2123] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:05 2022] GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217 => generated 1315 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:06.555362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-421bd878-3ef6-4d3e-8d35-b89d70642d03 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 45b975d2-057f-4aae-9e4b-95b8ed28c805] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:45:06.631102 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-421bd878-3ef6-4d3e-8d35-b89d70642d03 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.979514 Aug 04 16:45:06.632244 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1066/2124] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:45:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 16:45:06.637575 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a5183c25-5020-42e0-8bbb-de1b4e57e0b2 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:06.638476 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a5183c25-5020-42e0-8bbb-de1b4e57e0b2 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 03f171b8-c8d3-46c8-9429-4d90317c2b19] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:06.648268 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a5183c25-5020-42e0-8bbb-de1b4e57e0b2 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:06.649097 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a5183c25-5020-42e0-8bbb-de1b4e57e0b2 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:06.650218 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a5183c25-5020-42e0-8bbb-de1b4e57e0b2 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:06.650822 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a5183c25-5020-42e0-8bbb-de1b4e57e0b2 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:07.013980 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cb5c9c2a-a6ba-4e4b-bf6d-3a3b2797153e tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:07.014840 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cb5c9c2a-a6ba-4e4b-bf6d-3a3b2797153e tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] [instance: 86667237-3005-4ee4-83d6-c250bba481d5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:07.030187 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cb5c9c2a-a6ba-4e4b-bf6d-3a3b2797153e tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:07.030630 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cb5c9c2a-a6ba-4e4b-bf6d-3a3b2797153e tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:07.034578 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cb5c9c2a-a6ba-4e4b-bf6d-3a3b2797153e tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:07.038565 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cb5c9c2a-a6ba-4e4b-bf6d-3a3b2797153e tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:07.266947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a5183c25-5020-42e0-8bbb-de1b4e57e0b2 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:07.284572 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a5183c25-5020-42e0-8bbb-de1b4e57e0b2 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19" status: 200 len: 1315 microversion: 2.1 time: 0.651045 Aug 04 16:45:07.289627 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1067/2125] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:06 2022] GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19 => generated 1315 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:07.314430 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bae14fac-6638-4f58-9582-10213f44a47c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:07.319568 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bae14fac-6638-4f58-9582-10213f44a47c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 45b975d2-057f-4aae-9e4b-95b8ed28c805] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:07.571505 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bae14fac-6638-4f58-9582-10213f44a47c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:07.590318 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bae14fac-6638-4f58-9582-10213f44a47c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805" status: 200 len: 1207 microversion: 2.1 time: 0.294926 Aug 04 16:45:07.593501 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1068/2126] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:07 2022] GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805 => generated 1207 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:07.610222 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-b6ae7792-043e-49b8-9782-a3018ba2e0c7 req-a129c385-26bf-4769-8d9e-96abd47edb49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e", "name": "network-vif-unplugged", "status": "completed", "tag": "a6611342-a3b8-4d7d-b82d-62a23bc1209a"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:07.628259 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-b6ae7792-043e-49b8-9782-a3018ba2e0c7 req-a129c385-26bf-4769-8d9e-96abd47edb49 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:07.628968 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-b6ae7792-043e-49b8-9782-a3018ba2e0c7 req-a129c385-26bf-4769-8d9e-96abd47edb49 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:07.644461 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-b6ae7792-043e-49b8-9782-a3018ba2e0c7 req-a129c385-26bf-4769-8d9e-96abd47edb49 service nova] Creating event network-vif-unplugged:a6611342-a3b8-4d7d-b82d-62a23bc1209a for instance 6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e on n-h2-846466-12 Aug 04 16:45:07.654706 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-b6ae7792-043e-49b8-9782-a3018ba2e0c7 req-a129c385-26bf-4769-8d9e-96abd47edb49 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057926 Aug 04 16:45:07.655353 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1069/2127] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:45:07.662347 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1c9485f3-42e0-401b-92a3-eddb27117ff5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:07.663160 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1c9485f3-42e0-401b-92a3-eddb27117ff5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:07.696707 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1c9485f3-42e0-401b-92a3-eddb27117ff5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:07.697578 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1c9485f3-42e0-401b-92a3-eddb27117ff5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:07.701448 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1c9485f3-42e0-401b-92a3-eddb27117ff5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:07.702156 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1c9485f3-42e0-401b-92a3-eddb27117ff5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:09.629733 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cb5c9c2a-a6ba-4e4b-bf6d-3a3b2797153e tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5" status: 200 len: 1619 microversion: 2.1 time: 3.087093 Aug 04 16:45:09.639315 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1059/2128] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:06 2022] GET /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5 => generated 1619 bytes in 3097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:09.647074 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5db7a698-0822-4389-8f24-036974273454 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:09.648612 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5db7a698-0822-4389-8f24-036974273454 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 03f171b8-c8d3-46c8-9429-4d90317c2b19] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:09.665095 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5db7a698-0822-4389-8f24-036974273454 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:09.670850 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5db7a698-0822-4389-8f24-036974273454 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:09.673584 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5db7a698-0822-4389-8f24-036974273454 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:09.674213 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5db7a698-0822-4389-8f24-036974273454 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:10.099476 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1c9485f3-42e0-401b-92a3-eddb27117ff5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:10.107804 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1c9485f3-42e0-401b-92a3-eddb27117ff5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217" status: 200 len: 1315 microversion: 2.1 time: 2.451165 Aug 04 16:45:10.108897 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1070/2129] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:07 2022] GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217 => generated 1315 bytes in 2453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:10.127625 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-05c5a34e-ee6c-4eb5-a5ca-8467beed9bcb tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:10.128882 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-05c5a34e-ee6c-4eb5-a5ca-8467beed9bcb tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 45b975d2-057f-4aae-9e4b-95b8ed28c805] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:10.136929 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-05c5a34e-ee6c-4eb5-a5ca-8467beed9bcb tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:10.137826 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-05c5a34e-ee6c-4eb5-a5ca-8467beed9bcb tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:10.138922 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-05c5a34e-ee6c-4eb5-a5ca-8467beed9bcb tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:10.139938 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-05c5a34e-ee6c-4eb5-a5ca-8467beed9bcb tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:10.377622 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5db7a698-0822-4389-8f24-036974273454 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:10.380347 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-05c5a34e-ee6c-4eb5-a5ca-8467beed9bcb tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:10.388592 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-05c5a34e-ee6c-4eb5-a5ca-8467beed9bcb tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805" status: 200 len: 1265 microversion: 2.1 time: 0.265206 Aug 04 16:45:10.390451 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5db7a698-0822-4389-8f24-036974273454 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19" status: 200 len: 1315 microversion: 2.1 time: 0.749256 Aug 04 16:45:10.397540 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1071/2130] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:10 2022] GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805 => generated 1265 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:10.406287 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a7045ff7-2fc8-4b02-84a6-167870d77da1 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Action: 'create', calling method: .version_select at 0x7f7e77bd1040>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1534204247", "policies": ["affinity"]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:10.420874 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1060/2131] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:09 2022] GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19 => generated 1315 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:10.456712 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-a7045ff7-2fc8-4b02-84a6-167870d77da1 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for project b9e709c95a964cd5855d4e253aeb1043. Resources: {'server_groups'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:45:10.469818 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-a7045ff7-2fc8-4b02-84a6-167870d77da1 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for user 336c26b5dd6644bc83f9b80adac06bce and project b9e709c95a964cd5855d4e253aeb1043. Resources: {'server_groups'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:45:10.587146 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-a7045ff7-2fc8-4b02-84a6-167870d77da1 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for project b9e709c95a964cd5855d4e253aeb1043. Resources: {'server_groups'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:45:10.606399 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-a7045ff7-2fc8-4b02-84a6-167870d77da1 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for user 336c26b5dd6644bc83f9b80adac06bce and project b9e709c95a964cd5855d4e253aeb1043. Resources: {'server_groups'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:45:10.635870 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a7045ff7-2fc8-4b02-84a6-167870d77da1 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.236688 Aug 04 16:45:10.640406 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1072/2132] 10.222.0.23 () {60 vars in 1174 bytes} [Thu Aug 4 16:45:10 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:45:10.864971 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7b5d744c-e542-4915-a71c-05ab9c9580ea tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-170323655", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "9204ead0-2936-4e23-b741-7fe0269ed796"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:10.964393 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-7b5d744c-e542-4915-a71c-05ab9c9580ea tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] validate_networks() for None {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:45:11.134889 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-734da48a-3c89-4971-9238-38f6420f13a7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:11.143077 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-734da48a-3c89-4971-9238-38f6420f13a7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:11.174290 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-734da48a-3c89-4971-9238-38f6420f13a7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:11.175226 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-734da48a-3c89-4971-9238-38f6420f13a7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:11.176802 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-734da48a-3c89-4971-9238-38f6420f13a7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:11.181596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-734da48a-3c89-4971-9238-38f6420f13a7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:12.244131 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-734da48a-3c89-4971-9238-38f6420f13a7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:12.267065 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-734da48a-3c89-4971-9238-38f6420f13a7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217" status: 200 len: 1315 microversion: 2.1 time: 1.140037 Aug 04 16:45:12.272664 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1073/2133] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:11 2022] GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217 => generated 1315 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:12.283265 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-350c3c1e-6c0d-4e70-8024-3b0e632fdaa6 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:12.284685 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-350c3c1e-6c0d-4e70-8024-3b0e632fdaa6 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 03f171b8-c8d3-46c8-9429-4d90317c2b19] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:12.313183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-350c3c1e-6c0d-4e70-8024-3b0e632fdaa6 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:12.314268 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-350c3c1e-6c0d-4e70-8024-3b0e632fdaa6 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:12.316910 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-350c3c1e-6c0d-4e70-8024-3b0e632fdaa6 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:12.317800 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-350c3c1e-6c0d-4e70-8024-3b0e632fdaa6 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:12.469156 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-7b5d744c-e542-4915-a71c-05ab9c9580ea tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:45:12.469826 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-7b5d744c-e542-4915-a71c-05ab9c9580ea tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:45:12.470344 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-7b5d744c-e542-4915-a71c-05ab9c9580ea tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:45:12.470762 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-7b5d744c-e542-4915-a71c-05ab9c9580ea tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:45:12.471219 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-7b5d744c-e542-4915-a71c-05ab9c9580ea tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:45:12.577777 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b5d744c-e542-4915-a71c-05ab9c9580ea tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:12.578505 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b5d744c-e542-4915-a71c-05ab9c9580ea tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:12.579649 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b5d744c-e542-4915-a71c-05ab9c9580ea tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:12.580294 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b5d744c-e542-4915-a71c-05ab9c9580ea tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:12.635560 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-7b5d744c-e542-4915-a71c-05ab9c9580ea tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for project b9e709c95a964cd5855d4e253aeb1043. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:45:12.651066 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-7b5d744c-e542-4915-a71c-05ab9c9580ea tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for user 336c26b5dd6644bc83f9b80adac06bce and project b9e709c95a964cd5855d4e253aeb1043. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:45:12.699284 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7b5d744c-e542-4915-a71c-05ab9c9580ea tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Going to run 2 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:45:12.706190 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7b5d744c-e542-4915-a71c-05ab9c9580ea tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 43de7756-af0e-4833-9b96-73843a67532c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:45:12.802871 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-7b5d744c-e542-4915-a71c-05ab9c9580ea tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=126126) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 04 16:45:12.899396 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-7b5d744c-e542-4915-a71c-05ab9c9580ea tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for project b9e709c95a964cd5855d4e253aeb1043. Resources: {'server_group_members'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:45:12.906448 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:45:12.918904 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-7b5d744c-e542-4915-a71c-05ab9c9580ea tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for user 336c26b5dd6644bc83f9b80adac06bce and project b9e709c95a964cd5855d4e253aeb1043. Resources: {'server_group_members'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:45:13.072642 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-7b5d744c-e542-4915-a71c-05ab9c9580ea tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for project b9e709c95a964cd5855d4e253aeb1043. Resources: {'server_group_members'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:45:13.086819 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-7b5d744c-e542-4915-a71c-05ab9c9580ea tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for user 336c26b5dd6644bc83f9b80adac06bce and project b9e709c95a964cd5855d4e253aeb1043. Resources: {'server_group_members'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:45:13.154692 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7b5d744c-e542-4915-a71c-05ab9c9580ea tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: cc98a160-2abd-430e-8ea7-492777d8a226] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=43de7756-af0e-4833-9b96-73843a67532c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:45:13.341758 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-7b5d744c-e542-4915-a71c-05ab9c9580ea tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for project b9e709c95a964cd5855d4e253aeb1043. Resources: {'server_group_members'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:45:13.350656 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-7b5d744c-e542-4915-a71c-05ab9c9580ea tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for user 336c26b5dd6644bc83f9b80adac06bce and project b9e709c95a964cd5855d4e253aeb1043. Resources: {'server_group_members'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:45:13.375316 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-350c3c1e-6c0d-4e70-8024-3b0e632fdaa6 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:13.394123 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-350c3c1e-6c0d-4e70-8024-3b0e632fdaa6 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19" status: 200 len: 1315 microversion: 2.1 time: 1.118860 Aug 04 16:45:13.394740 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1074/2134] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:12 2022] GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19 => generated 1315 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:13.422289 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3085dc56-b58d-4166-9d1c-89844b8a7b57 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:13.422907 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3085dc56-b58d-4166-9d1c-89844b8a7b57 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 45b975d2-057f-4aae-9e4b-95b8ed28c805] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:13.460231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:45:13.466046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3085dc56-b58d-4166-9d1c-89844b8a7b57 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:13.472585 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3085dc56-b58d-4166-9d1c-89844b8a7b57 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:13.473810 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3085dc56-b58d-4166-9d1c-89844b8a7b57 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:13.477599 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3085dc56-b58d-4166-9d1c-89844b8a7b57 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:13.490430 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-7b5d744c-e542-4915-a71c-05ab9c9580ea tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for project b9e709c95a964cd5855d4e253aeb1043. Resources: {'server_group_members'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:45:13.518789 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-7b5d744c-e542-4915-a71c-05ab9c9580ea tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for user 336c26b5dd6644bc83f9b80adac06bce and project b9e709c95a964cd5855d4e253aeb1043. Resources: {'server_group_members'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:45:13.647271 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7b5d744c-e542-4915-a71c-05ab9c9580ea tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.786462 Aug 04 16:45:13.650221 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1061/2135] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:45:10 2022] POST /compute/v2.1/servers => generated 32 bytes in 2790 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 04 16:45:13.667305 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-d825a174-e4e9-4915-96dc-abc0b395df20 req-b2d215d0-1552-4c5e-9d02-5863f93df408 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e", "name": "network-vif-deleted", "tag": "a6611342-a3b8-4d7d-b82d-62a23bc1209a"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:13.687725 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-d825a174-e4e9-4915-96dc-abc0b395df20 req-b2d215d0-1552-4c5e-9d02-5863f93df408 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:13.688154 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-d825a174-e4e9-4915-96dc-abc0b395df20 req-b2d215d0-1552-4c5e-9d02-5863f93df408 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:13.737573 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-d825a174-e4e9-4915-96dc-abc0b395df20 req-b2d215d0-1552-4c5e-9d02-5863f93df408 service nova] Creating event network-vif-deleted:a6611342-a3b8-4d7d-b82d-62a23bc1209a for instance 6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e on n-h2-846466-12 Aug 04 16:45:13.756128 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-d825a174-e4e9-4915-96dc-abc0b395df20 req-b2d215d0-1552-4c5e-9d02-5863f93df408 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104309 Aug 04 16:45:13.760062 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1062/2136] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:45:13.782770 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-2b06244f-f1d0-4140-97be-ce36c928ed9d req-920cc1ec-e606-4795-83df-b7682419876d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b8342c-3797-4540-a6f3-f967340c1217", "name": "network-vif-plugged", "status": "completed", "tag": "6e42d24d-c057-4234-8aa4-45a8f3a0f560"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:13.815991 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-2b06244f-f1d0-4140-97be-ce36c928ed9d req-920cc1ec-e606-4795-83df-b7682419876d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:13.815991 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-2b06244f-f1d0-4140-97be-ce36c928ed9d req-920cc1ec-e606-4795-83df-b7682419876d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:13.849005 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-2b06244f-f1d0-4140-97be-ce36c928ed9d req-920cc1ec-e606-4795-83df-b7682419876d service nova] Creating event network-vif-plugged:6e42d24d-c057-4234-8aa4-45a8f3a0f560 for instance 86b8342c-3797-4540-a6f3-f967340c1217 on n-h1-846466-12 Aug 04 16:45:13.867963 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-2b06244f-f1d0-4140-97be-ce36c928ed9d req-920cc1ec-e606-4795-83df-b7682419876d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104592 Aug 04 16:45:13.876686 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1063/2137] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:45:13.898613 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f5b65cad-bafe-439e-b8e1-ff289f344c5b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:13.900615 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f5b65cad-bafe-439e-b8e1-ff289f344c5b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:13.937094 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f5b65cad-bafe-439e-b8e1-ff289f344c5b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:13.950138 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f5b65cad-bafe-439e-b8e1-ff289f344c5b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:13.955493 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f5b65cad-bafe-439e-b8e1-ff289f344c5b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:13.956258 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f5b65cad-bafe-439e-b8e1-ff289f344c5b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:14.244063 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3085dc56-b58d-4166-9d1c-89844b8a7b57 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:14.258921 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3085dc56-b58d-4166-9d1c-89844b8a7b57 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805" status: 200 len: 1307 microversion: 2.1 time: 0.863029 Aug 04 16:45:14.273407 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1075/2138] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:13 2022] GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805 => generated 1307 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:14.274310 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dd889f6e-353e-4b25-86df-8d84cec3ddc7 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:14.285744 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dd889f6e-353e-4b25-86df-8d84cec3ddc7 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:14.292184 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dd889f6e-353e-4b25-86df-8d84cec3ddc7 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Searching by: {'deleted': False, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043'} {{(pid=126125) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:45:14.335969 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dd889f6e-353e-4b25-86df-8d84cec3ddc7 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:14.336774 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dd889f6e-353e-4b25-86df-8d84cec3ddc7 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:14.337881 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dd889f6e-353e-4b25-86df-8d84cec3ddc7 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:14.338499 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dd889f6e-353e-4b25-86df-8d84cec3ddc7 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:14.382817 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.multi_cell_list [None req-dd889f6e-353e-4b25-86df-8d84cec3ddc7 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=126125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:45:14.462642 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dd889f6e-353e-4b25-86df-8d84cec3ddc7 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.192373 Aug 04 16:45:14.464861 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1076/2139] 10.222.0.23 () {58 vars in 1125 bytes} [Thu Aug 4 16:45:14 2022] GET /compute/v2.1/servers => generated 1002 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:14.504183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-50fd9217-e501-455d-95f2-20af7a23dba5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:14.508467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-50fd9217-e501-455d-95f2-20af7a23dba5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 03f171b8-c8d3-46c8-9429-4d90317c2b19] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:14.543897 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50fd9217-e501-455d-95f2-20af7a23dba5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:14.544432 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50fd9217-e501-455d-95f2-20af7a23dba5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:14.558635 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50fd9217-e501-455d-95f2-20af7a23dba5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:14.559407 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50fd9217-e501-455d-95f2-20af7a23dba5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:14.585095 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:45:15.429271 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f5b65cad-bafe-439e-b8e1-ff289f344c5b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:15.439497 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f5b65cad-bafe-439e-b8e1-ff289f344c5b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217" status: 200 len: 1315 microversion: 2.1 time: 1.561143 Aug 04 16:45:15.449951 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1064/2140] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:13 2022] GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217 => generated 1315 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:15.455157 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1ba3849a-91fc-4850-966a-4d7456e4e2b6 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:15.455996 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1ba3849a-91fc-4850-966a-4d7456e4e2b6 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: cc98a160-2abd-430e-8ea7-492777d8a226] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:15.467791 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1ba3849a-91fc-4850-966a-4d7456e4e2b6 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:15.470795 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1ba3849a-91fc-4850-966a-4d7456e4e2b6 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:15.473322 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1ba3849a-91fc-4850-966a-4d7456e4e2b6 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:15.475298 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1ba3849a-91fc-4850-966a-4d7456e4e2b6 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:15.647121 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1ba3849a-91fc-4850-966a-4d7456e4e2b6 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:15.656169 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1ba3849a-91fc-4850-966a-4d7456e4e2b6 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226" status: 200 len: 1222 microversion: 2.1 time: 0.204977 Aug 04 16:45:15.664773 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1065/2141] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:15 2022] GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226 => generated 1222 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:15.670400 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4335cf91-e3e7-46d8-ba7c-5fb1f705851c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:15.675989 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4335cf91-e3e7-46d8-ba7c-5fb1f705851c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 45b975d2-057f-4aae-9e4b-95b8ed28c805] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:15.691031 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4335cf91-e3e7-46d8-ba7c-5fb1f705851c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:15.691791 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4335cf91-e3e7-46d8-ba7c-5fb1f705851c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:15.692985 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4335cf91-e3e7-46d8-ba7c-5fb1f705851c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:15.693917 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-50fd9217-e501-455d-95f2-20af7a23dba5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:15.694582 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4335cf91-e3e7-46d8-ba7c-5fb1f705851c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:15.729161 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-50fd9217-e501-455d-95f2-20af7a23dba5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19" status: 200 len: 1315 microversion: 2.1 time: 1.260648 Aug 04 16:45:15.754806 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1077/2142] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:14 2022] GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19 => generated 1315 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:15.975530 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-8bf08032-7aec-466b-8caf-9efa861d96d3 req-2ae59cde-bf3b-4e24-ae64-d6c3d2c0f8c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03f171b8-c8d3-46c8-9429-4d90317c2b19", "name": "network-vif-plugged", "status": "completed", "tag": "aeae8ac0-7f22-4211-a9c4-9052ca44865b"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:15.999035 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-8bf08032-7aec-466b-8caf-9efa861d96d3 req-2ae59cde-bf3b-4e24-ae64-d6c3d2c0f8c6 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:16.004903 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-8bf08032-7aec-466b-8caf-9efa861d96d3 req-2ae59cde-bf3b-4e24-ae64-d6c3d2c0f8c6 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:16.042646 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-8bf08032-7aec-466b-8caf-9efa861d96d3 req-2ae59cde-bf3b-4e24-ae64-d6c3d2c0f8c6 service nova] Creating event network-vif-plugged:aeae8ac0-7f22-4211-a9c4-9052ca44865b for instance 03f171b8-c8d3-46c8-9429-4d90317c2b19 on n-h2-846466-12 Aug 04 16:45:16.048982 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-8bf08032-7aec-466b-8caf-9efa861d96d3 req-2ae59cde-bf3b-4e24-ae64-d6c3d2c0f8c6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077751 Aug 04 16:45:16.049799 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1078/2143] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:45:16.063717 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4335cf91-e3e7-46d8-ba7c-5fb1f705851c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:16.082707 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4335cf91-e3e7-46d8-ba7c-5fb1f705851c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805" status: 200 len: 1307 microversion: 2.1 time: 0.416271 Aug 04 16:45:16.083600 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1066/2144] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:15 2022] GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805 => generated 1307 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:16.472306 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b020cfaa-2fd5-406c-8dd5-639f7bba637d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:16.473499 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b020cfaa-2fd5-406c-8dd5-639f7bba637d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:16.480721 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b020cfaa-2fd5-406c-8dd5-639f7bba637d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:16.481489 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b020cfaa-2fd5-406c-8dd5-639f7bba637d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:16.482698 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b020cfaa-2fd5-406c-8dd5-639f7bba637d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:16.483686 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b020cfaa-2fd5-406c-8dd5-639f7bba637d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:16.655315 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-03ab1fd5-ab99-42a8-bea5-b85afe91c43f req-c23a1f30-61d9-4165-97b2-a9ed866597c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45b975d2-057f-4aae-9e4b-95b8ed28c805", "tag": "30523aff-f8cc-4a84-b24c-70715dfaed14"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:16.708201 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-03ab1fd5-ab99-42a8-bea5-b85afe91c43f req-c23a1f30-61d9-4165-97b2-a9ed866597c0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:16.709127 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-03ab1fd5-ab99-42a8-bea5-b85afe91c43f req-c23a1f30-61d9-4165-97b2-a9ed866597c0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:16.763798 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-03ab1fd5-ab99-42a8-bea5-b85afe91c43f req-c23a1f30-61d9-4165-97b2-a9ed866597c0 service nova] Creating event network-changed:30523aff-f8cc-4a84-b24c-70715dfaed14 for instance 45b975d2-057f-4aae-9e4b-95b8ed28c805 on n-h1-846466-12 Aug 04 16:45:16.786996 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-03ab1fd5-ab99-42a8-bea5-b85afe91c43f req-c23a1f30-61d9-4165-97b2-a9ed866597c0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139776 Aug 04 16:45:16.795729 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1067/2145] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:45:16.814598 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a08c2039-bbd3-4188-8ea5-c58b39194b83 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:16.817868 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a08c2039-bbd3-4188-8ea5-c58b39194b83 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: cc98a160-2abd-430e-8ea7-492777d8a226] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:16.841512 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a08c2039-bbd3-4188-8ea5-c58b39194b83 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:16.845242 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a08c2039-bbd3-4188-8ea5-c58b39194b83 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:16.850897 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a08c2039-bbd3-4188-8ea5-c58b39194b83 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:16.854108 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a08c2039-bbd3-4188-8ea5-c58b39194b83 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:17.217832 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a08c2039-bbd3-4188-8ea5-c58b39194b83 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:17.235896 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a08c2039-bbd3-4188-8ea5-c58b39194b83 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226" status: 200 len: 1270 microversion: 2.1 time: 0.437214 Aug 04 16:45:17.238948 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1068/2146] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:16 2022] GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226 => generated 1270 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:17.255219 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-910a46d6-8635-406e-92c8-b498fa76ea25 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:17.256897 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-910a46d6-8635-406e-92c8-b498fa76ea25 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 03f171b8-c8d3-46c8-9429-4d90317c2b19] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:17.286574 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-910a46d6-8635-406e-92c8-b498fa76ea25 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:17.287639 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-910a46d6-8635-406e-92c8-b498fa76ea25 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:17.289714 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-910a46d6-8635-406e-92c8-b498fa76ea25 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:17.290154 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-910a46d6-8635-406e-92c8-b498fa76ea25 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:17.350454 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b020cfaa-2fd5-406c-8dd5-639f7bba637d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:17.366517 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b020cfaa-2fd5-406c-8dd5-639f7bba637d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217" status: 200 len: 1315 microversion: 2.1 time: 0.899526 Aug 04 16:45:17.379391 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1079/2147] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:16 2022] GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217 => generated 1315 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:17.395955 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-354554b9-56b7-405a-88d6-331b38cb6dc3 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:17.398034 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-354554b9-56b7-405a-88d6-331b38cb6dc3 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 45b975d2-057f-4aae-9e4b-95b8ed28c805] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:17.416580 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-354554b9-56b7-405a-88d6-331b38cb6dc3 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:17.430518 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-354554b9-56b7-405a-88d6-331b38cb6dc3 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:17.431609 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-354554b9-56b7-405a-88d6-331b38cb6dc3 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:17.432297 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-354554b9-56b7-405a-88d6-331b38cb6dc3 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:18.315998 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-910a46d6-8635-406e-92c8-b498fa76ea25 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:18.334440 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-910a46d6-8635-406e-92c8-b498fa76ea25 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19" status: 200 len: 1315 microversion: 2.1 time: 1.093388 Aug 04 16:45:18.335040 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1069/2148] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:17 2022] GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19 => generated 1315 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:18.340120 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-64a6fd37-67cc-41a6-a654-0e7c7ed55172 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:18.341022 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-64a6fd37-67cc-41a6-a654-0e7c7ed55172 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: cc98a160-2abd-430e-8ea7-492777d8a226] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:18.357585 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-64a6fd37-67cc-41a6-a654-0e7c7ed55172 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:18.358359 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-64a6fd37-67cc-41a6-a654-0e7c7ed55172 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:18.359564 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-64a6fd37-67cc-41a6-a654-0e7c7ed55172 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:18.360107 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-64a6fd37-67cc-41a6-a654-0e7c7ed55172 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:18.428824 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-354554b9-56b7-405a-88d6-331b38cb6dc3 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:18.444028 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-354554b9-56b7-405a-88d6-331b38cb6dc3 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805" status: 200 len: 1307 microversion: 2.1 time: 1.059296 Aug 04 16:45:18.458269 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1080/2149] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:17 2022] GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805 => generated 1307 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:18.464203 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cccd7445-1a5c-4b55-936a-120704da8d25 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:18.465153 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cccd7445-1a5c-4b55-936a-120704da8d25 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:18.473099 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cccd7445-1a5c-4b55-936a-120704da8d25 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:18.473726 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cccd7445-1a5c-4b55-936a-120704da8d25 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:18.474629 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cccd7445-1a5c-4b55-936a-120704da8d25 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:18.475163 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cccd7445-1a5c-4b55-936a-120704da8d25 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:18.628345 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-64a6fd37-67cc-41a6-a654-0e7c7ed55172 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:18.640933 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-64a6fd37-67cc-41a6-a654-0e7c7ed55172 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226" status: 200 len: 1276 microversion: 2.1 time: 0.304479 Aug 04 16:45:18.645424 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1070/2150] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:18 2022] GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226 => generated 1276 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:19.071734 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cccd7445-1a5c-4b55-936a-120704da8d25 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:19.101498 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cccd7445-1a5c-4b55-936a-120704da8d25 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217" status: 200 len: 1503 microversion: 2.1 time: 0.641819 Aug 04 16:45:19.107821 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1081/2151] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:18 2022] GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217 => generated 1503 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:19.142239 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c37d5d9f-9d5b-4500-99c9-484656cb3477 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:19.174404 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c37d5d9f-9d5b-4500-99c9-484656cb3477 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:19.176415 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c37d5d9f-9d5b-4500-99c9-484656cb3477 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:19.313101 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c37d5d9f-9d5b-4500-99c9-484656cb3477 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Going to try to stop instance {{(pid=126126) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 16:45:19.366144 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b8bab5ba-5a07-413f-a0a4-624788b14ae5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:19.366776 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b8bab5ba-5a07-413f-a0a4-624788b14ae5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 03f171b8-c8d3-46c8-9429-4d90317c2b19] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:19.380786 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c37d5d9f-9d5b-4500-99c9-484656cb3477 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "POST /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217/action" status: 202 len: 0 microversion: 2.1 time: 0.257157 Aug 04 16:45:19.382221 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1071/2152] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:45:19 2022] POST /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:45:19.394491 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8bab5ba-5a07-413f-a0a4-624788b14ae5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:19.396868 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8bab5ba-5a07-413f-a0a4-624788b14ae5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:19.398375 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8bab5ba-5a07-413f-a0a4-624788b14ae5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:19.401240 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8bab5ba-5a07-413f-a0a4-624788b14ae5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:19.410458 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3b2b380f-3c30-4ec0-b297-2a6a546cbb1d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:19.421865 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3b2b380f-3c30-4ec0-b297-2a6a546cbb1d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:19.461410 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b2b380f-3c30-4ec0-b297-2a6a546cbb1d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:19.462373 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b2b380f-3c30-4ec0-b297-2a6a546cbb1d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:19.464167 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b2b380f-3c30-4ec0-b297-2a6a546cbb1d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:19.466758 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b2b380f-3c30-4ec0-b297-2a6a546cbb1d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:19.944511 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b8bab5ba-5a07-413f-a0a4-624788b14ae5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:19.965163 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b8bab5ba-5a07-413f-a0a4-624788b14ae5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19" status: 200 len: 1502 microversion: 2.1 time: 0.600394 Aug 04 16:45:19.965898 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1082/2153] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:19 2022] GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19 => generated 1502 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:19.973688 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f9ae5076-1612-4c8d-9930-cc275b49d295 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:19.981047 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f9ae5076-1612-4c8d-9930-cc275b49d295 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 45b975d2-057f-4aae-9e4b-95b8ed28c805] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:20.010789 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9ae5076-1612-4c8d-9930-cc275b49d295 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:20.011938 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9ae5076-1612-4c8d-9930-cc275b49d295 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:20.015013 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9ae5076-1612-4c8d-9930-cc275b49d295 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:20.016659 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9ae5076-1612-4c8d-9930-cc275b49d295 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:20.551673 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3b2b380f-3c30-4ec0-b297-2a6a546cbb1d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:20.596525 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3b2b380f-3c30-4ec0-b297-2a6a546cbb1d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217" status: 200 len: 1513 microversion: 2.1 time: 1.203633 Aug 04 16:45:20.610102 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1072/2154] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:19 2022] GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217 => generated 1513 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:20.633656 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=16 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:45:20.637533 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-10ef7055-8743-46a2-850a-3a4325a25897 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:20.641147 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-10ef7055-8743-46a2-850a-3a4325a25897 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: cc98a160-2abd-430e-8ea7-492777d8a226] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:20.696232 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-10ef7055-8743-46a2-850a-3a4325a25897 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:20.698408 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-10ef7055-8743-46a2-850a-3a4325a25897 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:20.707201 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-10ef7055-8743-46a2-850a-3a4325a25897 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:20.711096 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-10ef7055-8743-46a2-850a-3a4325a25897 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:21.143495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-10ef7055-8743-46a2-850a-3a4325a25897 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:21.176813 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-10ef7055-8743-46a2-850a-3a4325a25897 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226" status: 200 len: 1276 microversion: 2.1 time: 0.562210 Aug 04 16:45:21.178508 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1073/2155] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:20 2022] GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226 => generated 1276 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:21.212796 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b91b7dd7-b36c-485a-8b6e-8df38fdef867 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:21.213381 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b91b7dd7-b36c-485a-8b6e-8df38fdef867 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] [instance: 632449ba-73dd-4aeb-bc39-f26d6de4e726] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:21.224078 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b91b7dd7-b36c-485a-8b6e-8df38fdef867 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:21.226793 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b91b7dd7-b36c-485a-8b6e-8df38fdef867 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:21.229649 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b91b7dd7-b36c-485a-8b6e-8df38fdef867 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:21.230105 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b91b7dd7-b36c-485a-8b6e-8df38fdef867 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:21.297942 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b91b7dd7-b36c-485a-8b6e-8df38fdef867 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] [instance: 632449ba-73dd-4aeb-bc39-f26d6de4e726] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:45:21.418622 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:45:21.510065 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b91b7dd7-b36c-485a-8b6e-8df38fdef867 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] 10.222.0.23 "DELETE /compute/v2.1/servers/632449ba-73dd-4aeb-bc39-f26d6de4e726" status: 204 len: 0 microversion: 2.1 time: 0.303675 Aug 04 16:45:21.511081 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1074/2156] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:45:21 2022] DELETE /compute/v2.1/servers/632449ba-73dd-4aeb-bc39-f26d6de4e726 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:45:21.522816 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2d673a93-07ea-4345-97da-815278ddfb73 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:21.523754 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2d673a93-07ea-4345-97da-815278ddfb73 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] [instance: 632449ba-73dd-4aeb-bc39-f26d6de4e726] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:21.535829 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2d673a93-07ea-4345-97da-815278ddfb73 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:21.538877 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2d673a93-07ea-4345-97da-815278ddfb73 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:21.540596 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2d673a93-07ea-4345-97da-815278ddfb73 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:21.543565 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2d673a93-07ea-4345-97da-815278ddfb73 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:21.577529 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f9ae5076-1612-4c8d-9930-cc275b49d295 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:21.599375 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f9ae5076-1612-4c8d-9930-cc275b49d295 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805" status: 200 len: 1307 microversion: 2.1 time: 1.631547 Aug 04 16:45:21.600368 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1083/2157] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:19 2022] GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805 => generated 1307 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:21.623744 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b89b53f7-0b16-4eca-8a02-305f0e4368d7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:21.624565 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b89b53f7-0b16-4eca-8a02-305f0e4368d7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:21.649199 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b89b53f7-0b16-4eca-8a02-305f0e4368d7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:21.649972 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b89b53f7-0b16-4eca-8a02-305f0e4368d7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:21.650956 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b89b53f7-0b16-4eca-8a02-305f0e4368d7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:21.651567 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b89b53f7-0b16-4eca-8a02-305f0e4368d7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:22.604805 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:45:22.661929 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2d673a93-07ea-4345-97da-815278ddfb73 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9bde1645f64765a41a3f0d65a9ee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8ad7f728004fa0a6db9fba7c3c9cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:22.673922 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2d673a93-07ea-4345-97da-815278ddfb73 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] 10.222.0.23 "GET /compute/v2.1/servers/632449ba-73dd-4aeb-bc39-f26d6de4e726" status: 200 len: 1666 microversion: 2.1 time: 1.157470 Aug 04 16:45:22.674517 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1075/2158] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:21 2022] GET /compute/v2.1/servers/632449ba-73dd-4aeb-bc39-f26d6de4e726 => generated 1666 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:22.679651 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a5a2a470-eb11-425a-bca5-3fd993cc23db tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:22.680602 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a5a2a470-eb11-425a-bca5-3fd993cc23db tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: cc98a160-2abd-430e-8ea7-492777d8a226] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:22.689336 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a5a2a470-eb11-425a-bca5-3fd993cc23db tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:22.689828 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a5a2a470-eb11-425a-bca5-3fd993cc23db tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:22.690769 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a5a2a470-eb11-425a-bca5-3fd993cc23db tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:22.691243 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a5a2a470-eb11-425a-bca5-3fd993cc23db tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:22.873842 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a5a2a470-eb11-425a-bca5-3fd993cc23db tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:22.886002 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a5a2a470-eb11-425a-bca5-3fd993cc23db tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226" status: 200 len: 1276 microversion: 2.1 time: 0.209937 Aug 04 16:45:22.886999 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1076/2159] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:22 2022] GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226 => generated 1276 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:22.895931 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b86f5312-1c26-4902-847d-1be64b4d6b5d tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:22.896896 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b86f5312-1c26-4902-847d-1be64b4d6b5d tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 45b975d2-057f-4aae-9e4b-95b8ed28c805] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:22.905122 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b86f5312-1c26-4902-847d-1be64b4d6b5d tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:22.905935 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b86f5312-1c26-4902-847d-1be64b4d6b5d tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:22.906911 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b86f5312-1c26-4902-847d-1be64b4d6b5d tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:22.907543 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b86f5312-1c26-4902-847d-1be64b4d6b5d tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:23.178271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b89b53f7-0b16-4eca-8a02-305f0e4368d7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:23.193979 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b89b53f7-0b16-4eca-8a02-305f0e4368d7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217" status: 200 len: 1513 microversion: 2.1 time: 1.574448 Aug 04 16:45:23.199530 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1084/2160] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:21 2022] GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217 => generated 1513 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:23.210447 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-129b8609-dc63-4bcd-97b6-543fb7dc35ad tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94ba2840-dc9f-4a95-a285-97a2b3e92bd0"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:23.220503 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-129b8609-dc63-4bcd-97b6-543fb7dc35ad tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 03f171b8-c8d3-46c8-9429-4d90317c2b19] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:23.237815 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-129b8609-dc63-4bcd-97b6-543fb7dc35ad tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:23.242521 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-129b8609-dc63-4bcd-97b6-543fb7dc35ad tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:23.243809 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-129b8609-dc63-4bcd-97b6-543fb7dc35ad tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:23.244503 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-129b8609-dc63-4bcd-97b6-543fb7dc35ad tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:23.547391 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=22 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:45:23.785932 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-129b8609-dc63-4bcd-97b6-543fb7dc35ad tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "POST /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.583248 Aug 04 16:45:23.787347 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1085/2161] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Aug 4 16:45:23 2022] POST /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19/os-volume_attachments => generated 194 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:45:23.796536 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-1136fb4b-45f9-4574-9d7b-b0f8252c66ed req-aad522f4-4805-4853-9d07-debd203b9895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45b975d2-057f-4aae-9e4b-95b8ed28c805", "name": "network-vif-plugged", "status": "completed", "tag": "30523aff-f8cc-4a84-b24c-70715dfaed14"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:23.816451 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-1136fb4b-45f9-4574-9d7b-b0f8252c66ed req-aad522f4-4805-4853-9d07-debd203b9895 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:23.817986 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-1136fb4b-45f9-4574-9d7b-b0f8252c66ed req-aad522f4-4805-4853-9d07-debd203b9895 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:23.842218 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-1136fb4b-45f9-4574-9d7b-b0f8252c66ed req-aad522f4-4805-4853-9d07-debd203b9895 service nova] Creating event network-vif-plugged:30523aff-f8cc-4a84-b24c-70715dfaed14 for instance 45b975d2-057f-4aae-9e4b-95b8ed28c805 on n-h1-846466-12 Aug 04 16:45:23.872156 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-1136fb4b-45f9-4574-9d7b-b0f8252c66ed req-aad522f4-4805-4853-9d07-debd203b9895 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080482 Aug 04 16:45:23.876579 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1086/2162] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:45:23.890473 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bb3fa462-0a6a-411e-9509-3fb9b81f82c8 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:23.892240 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bb3fa462-0a6a-411e-9509-3fb9b81f82c8 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] [instance: 632449ba-73dd-4aeb-bc39-f26d6de4e726] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:23.907598 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bb3fa462-0a6a-411e-9509-3fb9b81f82c8 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:23.908454 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bb3fa462-0a6a-411e-9509-3fb9b81f82c8 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:23.910956 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bb3fa462-0a6a-411e-9509-3fb9b81f82c8 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:23.912190 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bb3fa462-0a6a-411e-9509-3fb9b81f82c8 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:24.152142 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b86f5312-1c26-4902-847d-1be64b4d6b5d tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:24.176040 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b86f5312-1c26-4902-847d-1be64b4d6b5d tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805" status: 200 len: 1307 microversion: 2.1 time: 1.287426 Aug 04 16:45:24.181832 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1077/2163] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:22 2022] GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805 => generated 1307 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:24.187533 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3893eb25-8c61-4766-a171-26d2fd941f8f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:24.192558 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3893eb25-8c61-4766-a171-26d2fd941f8f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: cc98a160-2abd-430e-8ea7-492777d8a226] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:24.211747 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3893eb25-8c61-4766-a171-26d2fd941f8f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:24.212367 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3893eb25-8c61-4766-a171-26d2fd941f8f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:24.213404 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3893eb25-8c61-4766-a171-26d2fd941f8f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:24.214129 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3893eb25-8c61-4766-a171-26d2fd941f8f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:24.360479 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:45:26.181678 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bb3fa462-0a6a-411e-9509-3fb9b81f82c8 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9bde1645f64765a41a3f0d65a9ee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8ad7f728004fa0a6db9fba7c3c9cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:26.194007 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bb3fa462-0a6a-411e-9509-3fb9b81f82c8 tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] 10.222.0.23 "GET /compute/v2.1/servers/632449ba-73dd-4aeb-bc39-f26d6de4e726" status: 200 len: 1666 microversion: 2.1 time: 2.311540 Aug 04 16:45:26.209236 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1087/2164] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:23 2022] GET /compute/v2.1/servers/632449ba-73dd-4aeb-bc39-f26d6de4e726 => generated 1666 bytes in 2331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:26.222449 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6ff2cf5f-f8c7-441d-9046-1b93e39b937b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:26.223774 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6ff2cf5f-f8c7-441d-9046-1b93e39b937b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:26.278938 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3893eb25-8c61-4766-a171-26d2fd941f8f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:26.292495 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6ff2cf5f-f8c7-441d-9046-1b93e39b937b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:26.293331 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6ff2cf5f-f8c7-441d-9046-1b93e39b937b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:26.294337 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6ff2cf5f-f8c7-441d-9046-1b93e39b937b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:26.295635 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6ff2cf5f-f8c7-441d-9046-1b93e39b937b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:26.296055 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3893eb25-8c61-4766-a171-26d2fd941f8f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226" status: 200 len: 1318 microversion: 2.1 time: 2.108505 Aug 04 16:45:26.312236 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1078/2165] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:24 2022] GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226 => generated 1318 bytes in 2129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:26.323211 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e70d89f1-4ac5-4fa0-a9db-43d8665224f2 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:26.328434 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e70d89f1-4ac5-4fa0-a9db-43d8665224f2 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 45b975d2-057f-4aae-9e4b-95b8ed28c805] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:26.352087 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e70d89f1-4ac5-4fa0-a9db-43d8665224f2 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:26.353573 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e70d89f1-4ac5-4fa0-a9db-43d8665224f2 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:26.354643 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e70d89f1-4ac5-4fa0-a9db-43d8665224f2 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:26.358120 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e70d89f1-4ac5-4fa0-a9db-43d8665224f2 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:27.267900 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6ff2cf5f-f8c7-441d-9046-1b93e39b937b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:27.330103 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6ff2cf5f-f8c7-441d-9046-1b93e39b937b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217" status: 200 len: 1513 microversion: 2.1 time: 1.106206 Aug 04 16:45:27.332430 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1088/2166] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:26 2022] GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217 => generated 1513 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:27.351829 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-a2ab8360-c624-4bf1-947c-60df1ad3916f req-fee7826a-1d0a-4f25-86c2-c12d4ac93d49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "632449ba-73dd-4aeb-bc39-f26d6de4e726", "name": "network-vif-deleted", "tag": "a0e744c5-ed04-46e2-85e9-7e1d7d8096d3"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:27.392112 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-a2ab8360-c624-4bf1-947c-60df1ad3916f req-fee7826a-1d0a-4f25-86c2-c12d4ac93d49 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:27.396654 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-a2ab8360-c624-4bf1-947c-60df1ad3916f req-fee7826a-1d0a-4f25-86c2-c12d4ac93d49 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:27.481216 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-a2ab8360-c624-4bf1-947c-60df1ad3916f req-fee7826a-1d0a-4f25-86c2-c12d4ac93d49 service nova] Creating event network-vif-deleted:a0e744c5-ed04-46e2-85e9-7e1d7d8096d3 for instance 632449ba-73dd-4aeb-bc39-f26d6de4e726 on n-h2-846466-12 Aug 04 16:45:27.486275 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e70d89f1-4ac5-4fa0-a9db-43d8665224f2 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:27.490825 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-a2ab8360-c624-4bf1-947c-60df1ad3916f req-fee7826a-1d0a-4f25-86c2-c12d4ac93d49 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156074 Aug 04 16:45:27.491459 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1089/2167] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:45:27.496475 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e70d89f1-4ac5-4fa0-a9db-43d8665224f2 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805" status: 200 len: 1307 microversion: 2.1 time: 1.181611 Aug 04 16:45:27.497177 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1079/2168] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:26 2022] GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805 => generated 1307 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:27.514382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a6f1825b-50a4-42a7-9bf5-7570bb62cd84 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:27.514912 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3212b54c-098e-44e0-a888-e6687454800e tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:27.516677 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3212b54c-098e-44e0-a888-e6687454800e tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] [instance: 632449ba-73dd-4aeb-bc39-f26d6de4e726] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:27.517020 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a6f1825b-50a4-42a7-9bf5-7570bb62cd84 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: cc98a160-2abd-430e-8ea7-492777d8a226] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:27.540434 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3212b54c-098e-44e0-a888-e6687454800e tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:27.543479 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3212b54c-098e-44e0-a888-e6687454800e tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:27.544589 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3212b54c-098e-44e0-a888-e6687454800e tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:27.546866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3212b54c-098e-44e0-a888-e6687454800e tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:27.547857 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6f1825b-50a4-42a7-9bf5-7570bb62cd84 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:27.550808 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6f1825b-50a4-42a7-9bf5-7570bb62cd84 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:27.552284 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6f1825b-50a4-42a7-9bf5-7570bb62cd84 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:27.559348 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6f1825b-50a4-42a7-9bf5-7570bb62cd84 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:27.597237 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-3212b54c-098e-44e0-a888-e6687454800e tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] HTTP exception thrown: Instance 632449ba-73dd-4aeb-bc39-f26d6de4e726 could not be found. Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3212b54c-098e-44e0-a888-e6687454800e tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Request method failure captured: Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/632449ba-73dd-4aeb-bc39-f26d6de4e726 HTTP/1.1 Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_dU9FYS7Nj8NX0Ipes4-zhfKK9qbmX1Hlz_e8qYlw8CN6OlF2Zl-l4bhMHQ_cS3PEmIRrKRBjs03iZuNvJ-TzaRr475j3RPc7mYsxu8Efo8dw_7otRBZunwrOaZd2l8xtF9xUWd3YbpEtYD8AL1f-F6htXOXP6Me9jEFHCjawAR_CM Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 4f8ad7f728004fa0a6db9fba7c3c9cbd Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersTestFqdnHostnames-1011992978 Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4f8ad7f728004fa0a6db9fba7c3c9cbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4f8ad7f728004fa0a6db9fba7c3c9cbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4f8ad7f728004fa0a6db9fba7c3c9cbd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4f8ad7f728004fa0a6db9fba7c3c9cbd"}]}] Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersTestFqdnHostnames-1011992978 Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 4f8ad7f728004fa0a6db9fba7c3c9cbd Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1011992978 Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersTestFqdnHostnames-1011992978-project Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 8c9bde1645f64765a41a3f0d65a9ee2e Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersTestFqdnHostnames-1011992978-project Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 632449ba-73dd-4aeb-bc39-f26d6de4e726 could not be found. Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '632449ba-73dd-4aeb-bc39-f26d6de4e726'} Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 632449ba-73dd-4aeb-bc39-f26d6de4e726 could not be found. Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 632449ba-73dd-4aeb-bc39-f26d6de4e726 could not be found. Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:45:27.608148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:45:27.612896 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:45:27.612896 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:45:27.612896 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:45:27.612896 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:45:27.612896 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:45:27.612896 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 632449ba-73dd-4aeb-bc39-f26d6de4e726 could not be found. Aug 04 16:45:27.612896 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:45:27.614419 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3212b54c-098e-44e0-a888-e6687454800e tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Returning 404 to user: Instance 632449ba-73dd-4aeb-bc39-f26d6de4e726 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:45:27.634057 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3212b54c-098e-44e0-a888-e6687454800e tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] 10.222.0.23 "GET /compute/v2.1/servers/632449ba-73dd-4aeb-bc39-f26d6de4e726" status: 404 len: 111 microversion: 2.1 time: 0.137290 Aug 04 16:45:27.638494 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1090/2169] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:27 2022] GET /compute/v2.1/servers/632449ba-73dd-4aeb-bc39-f26d6de4e726 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:45:27.644438 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-709258af-fe0b-4db7-aaf7-1b42f57ff35c tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] Calling method '.version_select at 0x7f7e77c88af0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:27.686935 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-709258af-fe0b-4db7-aaf7-1b42f57ff35c tempest-ServersTestFqdnHostnames-1011992978 tempest-ServersTestFqdnHostnames-1011992978-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-434211813" status: 202 len: 0 microversion: 2.1 time: 0.046963 Aug 04 16:45:27.704275 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1091/2170] 10.222.0.23 () {58 vars in 1218 bytes} [Thu Aug 4 16:45:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-434211813 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:45:28.303129 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a6f1825b-50a4-42a7-9bf5-7570bb62cd84 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:28.317870 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a6f1825b-50a4-42a7-9bf5-7570bb62cd84 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226" status: 200 len: 1318 microversion: 2.1 time: 0.814668 Aug 04 16:45:28.319805 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1080/2171] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:27 2022] GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226 => generated 1318 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:28.367549 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5c744fec-c83b-4262-a006-b4e0826d0648 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:28.368567 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5c744fec-c83b-4262-a006-b4e0826d0648 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:28.392859 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5c744fec-c83b-4262-a006-b4e0826d0648 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:28.393384 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5c744fec-c83b-4262-a006-b4e0826d0648 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:28.398455 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5c744fec-c83b-4262-a006-b4e0826d0648 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:28.398922 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5c744fec-c83b-4262-a006-b4e0826d0648 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:28.519881 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5b3c46be-e0a2-46c3-97c4-db9fba5fe296 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:28.521902 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5b3c46be-e0a2-46c3-97c4-db9fba5fe296 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 45b975d2-057f-4aae-9e4b-95b8ed28c805] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:28.531406 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5b3c46be-e0a2-46c3-97c4-db9fba5fe296 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:28.537789 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5b3c46be-e0a2-46c3-97c4-db9fba5fe296 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:28.538779 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5b3c46be-e0a2-46c3-97c4-db9fba5fe296 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:28.542674 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5b3c46be-e0a2-46c3-97c4-db9fba5fe296 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:29.145103 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5c744fec-c83b-4262-a006-b4e0826d0648 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:29.155806 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5c744fec-c83b-4262-a006-b4e0826d0648 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217" status: 200 len: 1513 microversion: 2.1 time: 0.792425 Aug 04 16:45:29.157169 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1092/2172] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:28 2022] GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217 => generated 1513 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:29.163357 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-eda93ecd-4845-411f-a435-2753e603b8b5 req-b34d0c1f-a988-4936-8d62-9f7a2be2be8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43de7756-af0e-4833-9b96-73843a67532c", "tag": "c105eb13-4f08-4bde-af50-0ff69cb99472"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:29.175312 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-eda93ecd-4845-411f-a435-2753e603b8b5 req-b34d0c1f-a988-4936-8d62-9f7a2be2be8c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:29.175933 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-eda93ecd-4845-411f-a435-2753e603b8b5 req-b34d0c1f-a988-4936-8d62-9f7a2be2be8c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:29.189250 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-eda93ecd-4845-411f-a435-2753e603b8b5 req-b34d0c1f-a988-4936-8d62-9f7a2be2be8c service nova] Creating event network-changed:c105eb13-4f08-4bde-af50-0ff69cb99472 for instance 43de7756-af0e-4833-9b96-73843a67532c on n-h2-846466-12 Aug 04 16:45:29.196450 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-eda93ecd-4845-411f-a435-2753e603b8b5 req-b34d0c1f-a988-4936-8d62-9f7a2be2be8c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036901 Aug 04 16:45:29.198227 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1093/2173] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:45:29.331138 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5b3c46be-e0a2-46c3-97c4-db9fba5fe296 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:29.341419 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-50b93e4d-4fae-449c-82bd-a7da6264dd2e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:29.342237 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-50b93e4d-4fae-449c-82bd-a7da6264dd2e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: cc98a160-2abd-430e-8ea7-492777d8a226] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:29.355900 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5b3c46be-e0a2-46c3-97c4-db9fba5fe296 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805" status: 200 len: 1488 microversion: 2.1 time: 0.841454 Aug 04 16:45:29.358179 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1081/2174] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:28 2022] GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805 => generated 1488 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:29.360398 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50b93e4d-4fae-449c-82bd-a7da6264dd2e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:29.363842 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50b93e4d-4fae-449c-82bd-a7da6264dd2e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:29.366111 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50b93e4d-4fae-449c-82bd-a7da6264dd2e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:29.366693 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50b93e4d-4fae-449c-82bd-a7da6264dd2e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:29.399560 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-65d014d4-940b-4d59-b0d2-dcaa54276d1e tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:29.413588 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65d014d4-940b-4d59-b0d2-dcaa54276d1e tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:29.414152 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65d014d4-940b-4d59-b0d2-dcaa54276d1e tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:29.467719 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-65d014d4-940b-4d59-b0d2-dcaa54276d1e tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 45b975d2-057f-4aae-9e4b-95b8ed28c805] Going to try to stop instance {{(pid=126126) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 16:45:29.543689 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-65d014d4-940b-4d59-b0d2-dcaa54276d1e tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "POST /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805/action" status: 202 len: 0 microversion: 2.1 time: 0.150062 Aug 04 16:45:29.545123 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1082/2175] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:45:29 2022] POST /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 16:45:29.558222 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ceebc067-5afb-4433-934d-9e28f7a505ee tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:29.559595 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ceebc067-5afb-4433-934d-9e28f7a505ee tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 45b975d2-057f-4aae-9e4b-95b8ed28c805] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:29.569673 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ceebc067-5afb-4433-934d-9e28f7a505ee tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:29.570599 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ceebc067-5afb-4433-934d-9e28f7a505ee tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:29.571901 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ceebc067-5afb-4433-934d-9e28f7a505ee tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:29.572614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ceebc067-5afb-4433-934d-9e28f7a505ee tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:30.402207 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-50b93e4d-4fae-449c-82bd-a7da6264dd2e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:30.435686 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-50b93e4d-4fae-449c-82bd-a7da6264dd2e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226" status: 200 len: 1318 microversion: 2.1 time: 1.093649 Aug 04 16:45:30.445556 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1094/2176] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:29 2022] GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226 => generated 1318 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:30.477660 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-96932783-d2bb-4032-8303-b0ab77fbc80e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:30.478273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-96932783-d2bb-4032-8303-b0ab77fbc80e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:30.496321 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-96932783-d2bb-4032-8303-b0ab77fbc80e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:30.497027 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-96932783-d2bb-4032-8303-b0ab77fbc80e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:30.500337 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-96932783-d2bb-4032-8303-b0ab77fbc80e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:30.501221 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-96932783-d2bb-4032-8303-b0ab77fbc80e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:31.122711 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ceebc067-5afb-4433-934d-9e28f7a505ee tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:31.147756 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ceebc067-5afb-4433-934d-9e28f7a505ee tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805" status: 200 len: 1498 microversion: 2.1 time: 1.593397 Aug 04 16:45:31.150224 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1083/2177] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:29 2022] GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805 => generated 1498 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:45:31.304692 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-4005ba98-c732-4ff0-9e05-5f57b6251fb6 req-e76ec830-d606-4574-930f-204f06711283 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc98a160-2abd-430e-8ea7-492777d8a226", "tag": "6d22be3f-4df2-4063-b40a-5e24bfd4d685"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:31.366255 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-4005ba98-c732-4ff0-9e05-5f57b6251fb6 req-e76ec830-d606-4574-930f-204f06711283 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:31.367514 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-4005ba98-c732-4ff0-9e05-5f57b6251fb6 req-e76ec830-d606-4574-930f-204f06711283 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:31.406956 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-4005ba98-c732-4ff0-9e05-5f57b6251fb6 req-e76ec830-d606-4574-930f-204f06711283 service nova] Creating event network-changed:6d22be3f-4df2-4063-b40a-5e24bfd4d685 for instance cc98a160-2abd-430e-8ea7-492777d8a226 on n-h2-846466-12 Aug 04 16:45:31.421313 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-4005ba98-c732-4ff0-9e05-5f57b6251fb6 req-e76ec830-d606-4574-930f-204f06711283 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124624 Aug 04 16:45:31.424684 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1084/2178] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:45:31.460815 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-07e77af2-7483-408d-b5b8-6839357ed46e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:31.462019 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-07e77af2-7483-408d-b5b8-6839357ed46e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: cc98a160-2abd-430e-8ea7-492777d8a226] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:31.478419 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:45:31.483055 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-07e77af2-7483-408d-b5b8-6839357ed46e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:31.483826 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-07e77af2-7483-408d-b5b8-6839357ed46e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:31.484873 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-07e77af2-7483-408d-b5b8-6839357ed46e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:31.485595 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-07e77af2-7483-408d-b5b8-6839357ed46e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:31.829793 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-96932783-d2bb-4032-8303-b0ab77fbc80e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:31.853788 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-96932783-d2bb-4032-8303-b0ab77fbc80e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217" status: 200 len: 1513 microversion: 2.1 time: 1.399729 Aug 04 16:45:31.861883 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1095/2179] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:30 2022] GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217 => generated 1513 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:32.173974 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-08cebeb1-0d53-459d-a308-5c98f7813c68 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1552680769 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1552680769-project-admin] Calling method '.version_select at 0x7f7e77c5bc10>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:32.175304 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:45:32.175304 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:45:32.177049 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-08cebeb1-0d53-459d-a308-5c98f7813c68 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1552680769 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1552680769-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:32.177847 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-08cebeb1-0d53-459d-a308-5c98f7813c68 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1552680769 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1552680769-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:32.201523 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-08cebeb1-0d53-459d-a308-5c98f7813c68 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1552680769 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1552680769-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:32.202504 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-08cebeb1-0d53-459d-a308-5c98f7813c68 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1552680769 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1552680769-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:32.234466 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-08cebeb1-0d53-459d-a308-5c98f7813c68 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1552680769 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1552680769-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:32.234920 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-08cebeb1-0d53-459d-a308-5c98f7813c68 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1552680769 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1552680769-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:32.245631 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-08cebeb1-0d53-459d-a308-5c98f7813c68 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1552680769 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1552680769-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.381987 Aug 04 16:45:32.246246 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1096/2180] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:45:31 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:45:32.255388 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8946f60e-a332-40e4-9e5e-2a0d13434d37 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:32.256475 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8946f60e-a332-40e4-9e5e-2a0d13434d37 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 45b975d2-057f-4aae-9e4b-95b8ed28c805] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:32.265170 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8946f60e-a332-40e4-9e5e-2a0d13434d37 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:32.266311 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8946f60e-a332-40e4-9e5e-2a0d13434d37 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:32.267593 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8946f60e-a332-40e4-9e5e-2a0d13434d37 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:32.268740 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8946f60e-a332-40e4-9e5e-2a0d13434d37 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:32.276658 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:45:32.301497 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-07e77af2-7483-408d-b5b8-6839357ed46e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:32.324629 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-07e77af2-7483-408d-b5b8-6839357ed46e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226" status: 200 len: 1318 microversion: 2.1 time: 0.869672 Aug 04 16:45:32.325344 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1085/2181] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:31 2022] GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226 => generated 1318 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:45:32.639795 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8946f60e-a332-40e4-9e5e-2a0d13434d37 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:32.652646 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8946f60e-a332-40e4-9e5e-2a0d13434d37 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805" status: 200 len: 1498 microversion: 2.1 time: 0.405047 Aug 04 16:45:32.661170 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1097/2182] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:32 2022] GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805 => generated 1498 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:32.893549 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9a95ae81-8cf8-4efa-9631-80f0ec8fcf1f tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:32.894470 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9a95ae81-8cf8-4efa-9631-80f0ec8fcf1f tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:32.908047 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9a95ae81-8cf8-4efa-9631-80f0ec8fcf1f tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:32.910671 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9a95ae81-8cf8-4efa-9631-80f0ec8fcf1f tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:32.915023 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9a95ae81-8cf8-4efa-9631-80f0ec8fcf1f tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:32.915023 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9a95ae81-8cf8-4efa-9631-80f0ec8fcf1f tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:33.360318 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cf90658d-4bd4-40a7-bee2-31128d66b9a8 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:33.363419 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cf90658d-4bd4-40a7-bee2-31128d66b9a8 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: cc98a160-2abd-430e-8ea7-492777d8a226] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:33.373130 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cf90658d-4bd4-40a7-bee2-31128d66b9a8 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:33.373818 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cf90658d-4bd4-40a7-bee2-31128d66b9a8 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:33.375270 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cf90658d-4bd4-40a7-bee2-31128d66b9a8 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:33.375920 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cf90658d-4bd4-40a7-bee2-31128d66b9a8 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:33.843776 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9a95ae81-8cf8-4efa-9631-80f0ec8fcf1f tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:33.854467 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9a95ae81-8cf8-4efa-9631-80f0ec8fcf1f tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217" status: 200 len: 1513 microversion: 2.1 time: 0.965882 Aug 04 16:45:33.869768 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1086/2183] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:32 2022] GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217 => generated 1513 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:33.875216 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f52dd4ff-36d7-421d-9c8e-973414d5f18b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:33.876129 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f52dd4ff-36d7-421d-9c8e-973414d5f18b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 45b975d2-057f-4aae-9e4b-95b8ed28c805] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:33.884212 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f52dd4ff-36d7-421d-9c8e-973414d5f18b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:33.884964 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f52dd4ff-36d7-421d-9c8e-973414d5f18b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:33.886225 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f52dd4ff-36d7-421d-9c8e-973414d5f18b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:33.886868 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f52dd4ff-36d7-421d-9c8e-973414d5f18b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:33.954005 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cf90658d-4bd4-40a7-bee2-31128d66b9a8 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:33.967684 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cf90658d-4bd4-40a7-bee2-31128d66b9a8 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226" status: 200 len: 1318 microversion: 2.1 time: 0.612474 Aug 04 16:45:33.968299 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1098/2184] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:33 2022] GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226 => generated 1318 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:34.250461 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f52dd4ff-36d7-421d-9c8e-973414d5f18b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:34.268946 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f52dd4ff-36d7-421d-9c8e-973414d5f18b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805" status: 200 len: 1498 microversion: 2.1 time: 0.394258 Aug 04 16:45:34.279877 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1087/2185] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:33 2022] GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805 => generated 1498 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:34.877145 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-25c06173-1a23-4223-9066-db7c6df1f806 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:34.877859 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-25c06173-1a23-4223-9066-db7c6df1f806 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:34.895479 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-25c06173-1a23-4223-9066-db7c6df1f806 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:34.895937 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-25c06173-1a23-4223-9066-db7c6df1f806 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:34.896757 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-25c06173-1a23-4223-9066-db7c6df1f806 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:34.897196 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-25c06173-1a23-4223-9066-db7c6df1f806 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:34.988864 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6f21a71f-a40e-47ed-9c33-87c90b52c18e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:34.990351 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6f21a71f-a40e-47ed-9c33-87c90b52c18e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: cc98a160-2abd-430e-8ea7-492777d8a226] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:34.998135 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6f21a71f-a40e-47ed-9c33-87c90b52c18e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:34.999011 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6f21a71f-a40e-47ed-9c33-87c90b52c18e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:35.000070 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6f21a71f-a40e-47ed-9c33-87c90b52c18e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:35.000745 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6f21a71f-a40e-47ed-9c33-87c90b52c18e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:35.793561 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-25c06173-1a23-4223-9066-db7c6df1f806 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:35.802611 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-25c06173-1a23-4223-9066-db7c6df1f806 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217" status: 200 len: 1513 microversion: 2.1 time: 0.929923 Aug 04 16:45:35.810516 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1099/2186] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:34 2022] GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217 => generated 1513 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:35.820584 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-46f030c6-1b7b-4cfe-97e6-353ee44937ce tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:35.821647 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-46f030c6-1b7b-4cfe-97e6-353ee44937ce tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 45b975d2-057f-4aae-9e4b-95b8ed28c805] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:35.838237 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6f21a71f-a40e-47ed-9c33-87c90b52c18e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:35.840860 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46f030c6-1b7b-4cfe-97e6-353ee44937ce tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:35.841681 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46f030c6-1b7b-4cfe-97e6-353ee44937ce tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:35.842774 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46f030c6-1b7b-4cfe-97e6-353ee44937ce tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:35.843451 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46f030c6-1b7b-4cfe-97e6-353ee44937ce tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:35.848655 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6f21a71f-a40e-47ed-9c33-87c90b52c18e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226" status: 200 len: 1318 microversion: 2.1 time: 0.863790 Aug 04 16:45:35.850110 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1088/2187] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:34 2022] GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226 => generated 1318 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:45:36.696065 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-46f030c6-1b7b-4cfe-97e6-353ee44937ce tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:36.756206 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-46f030c6-1b7b-4cfe-97e6-353ee44937ce tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805" status: 200 len: 1498 microversion: 2.1 time: 0.938852 Aug 04 16:45:36.761655 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1100/2188] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:35 2022] GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805 => generated 1498 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:36.849612 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-09d7c758-2a33-481b-9af4-02c1d2e2273a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:36.850299 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-09d7c758-2a33-481b-9af4-02c1d2e2273a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:36.882801 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-09d7c758-2a33-481b-9af4-02c1d2e2273a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:36.887059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-09d7c758-2a33-481b-9af4-02c1d2e2273a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:36.889962 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-09d7c758-2a33-481b-9af4-02c1d2e2273a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:36.890459 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-09d7c758-2a33-481b-9af4-02c1d2e2273a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:37.067610 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1388202f-c460-40a3-b752-f4516620bd1f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Action: 'create', calling method: .version_select at 0x7f7e84d6a700>, body: {"keypair": {"name": "tempest-keypair-386779736", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMR6u5j4uEhHtZwnLQz7lKOIMf9XfEtf05M2YptLAatlxYFINOw3UFA6TiwYizWW9zJwXAfroJMU2LYsx5wXROLyveIbUuXP6g1yeuVNbpJADL9NbWvH0ULQuqV4kRPdA=="}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:37.136504 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-1388202f-c460-40a3-b752-f4516620bd1f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Getting quotas for project 1f4cdb4245df44119c504915dc542d9b. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:45:37.146936 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-1388202f-c460-40a3-b752-f4516620bd1f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Getting quotas for user c97a079594a2400bb4db33f3ce3a1497 and project 1f4cdb4245df44119c504915dc542d9b. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:45:37.205368 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1388202f-c460-40a3-b752-f4516620bd1f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.478231 Aug 04 16:45:37.210398 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1089/2189] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 16:45:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:45:37.229591 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2aa01809-7636-4b8b-9231-83f886e90f00 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:37.232333 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2aa01809-7636-4b8b-9231-83f886e90f00 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: cc98a160-2abd-430e-8ea7-492777d8a226] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:37.257634 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2aa01809-7636-4b8b-9231-83f886e90f00 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:37.259115 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2aa01809-7636-4b8b-9231-83f886e90f00 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:37.263281 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2aa01809-7636-4b8b-9231-83f886e90f00 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:37.264878 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2aa01809-7636-4b8b-9231-83f886e90f00 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:37.672941 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-09d7c758-2a33-481b-9af4-02c1d2e2273a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:37.725772 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-09d7c758-2a33-481b-9af4-02c1d2e2273a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217" status: 200 len: 1513 microversion: 2.1 time: 0.878313 Aug 04 16:45:37.736323 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1101/2190] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:36 2022] GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217 => generated 1513 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:37.784157 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c966f667-3193-4318-b36a-a6e23bbff72f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:37.785682 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c966f667-3193-4318-b36a-a6e23bbff72f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 45b975d2-057f-4aae-9e4b-95b8ed28c805] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:37.806494 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c966f667-3193-4318-b36a-a6e23bbff72f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:37.808798 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c966f667-3193-4318-b36a-a6e23bbff72f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:37.810389 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c966f667-3193-4318-b36a-a6e23bbff72f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:37.812672 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c966f667-3193-4318-b36a-a6e23bbff72f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:38.099159 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2aa01809-7636-4b8b-9231-83f886e90f00 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:38.115263 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2aa01809-7636-4b8b-9231-83f886e90f00 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226" status: 200 len: 1318 microversion: 2.1 time: 0.901846 Aug 04 16:45:38.116381 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1090/2191] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:37 2022] GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226 => generated 1318 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:38.361382 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c966f667-3193-4318-b36a-a6e23bbff72f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:38.372195 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c966f667-3193-4318-b36a-a6e23bbff72f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805" status: 200 len: 1498 microversion: 2.1 time: 0.592566 Aug 04 16:45:38.389905 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1102/2192] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:37 2022] GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805 => generated 1498 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:45:38.759436 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-02f036c6-b8d8-4cf4-862d-8946cbc1e297 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:38.760614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-02f036c6-b8d8-4cf4-862d-8946cbc1e297 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:38.788437 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-02f036c6-b8d8-4cf4-862d-8946cbc1e297 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:38.789492 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-02f036c6-b8d8-4cf4-862d-8946cbc1e297 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:38.792479 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-02f036c6-b8d8-4cf4-862d-8946cbc1e297 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:38.794355 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-02f036c6-b8d8-4cf4-862d-8946cbc1e297 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:39.142885 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7f03c43d-3ef9-46dc-865a-b42b373e544b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:39.144682 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7f03c43d-3ef9-46dc-865a-b42b373e544b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: cc98a160-2abd-430e-8ea7-492777d8a226] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:39.169050 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7f03c43d-3ef9-46dc-865a-b42b373e544b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:39.169887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7f03c43d-3ef9-46dc-865a-b42b373e544b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:39.171327 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7f03c43d-3ef9-46dc-865a-b42b373e544b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:39.172463 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7f03c43d-3ef9-46dc-865a-b42b373e544b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:39.292370 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-02f036c6-b8d8-4cf4-862d-8946cbc1e297 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:39.304019 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-02f036c6-b8d8-4cf4-862d-8946cbc1e297 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217" status: 200 len: 1513 microversion: 2.1 time: 0.550004 Aug 04 16:45:39.304617 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1091/2193] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:38 2022] GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217 => generated 1513 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:39.405481 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5320fed0-7f0a-4eda-a344-8db572aba0a4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:39.406949 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5320fed0-7f0a-4eda-a344-8db572aba0a4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 45b975d2-057f-4aae-9e4b-95b8ed28c805] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:39.423234 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5320fed0-7f0a-4eda-a344-8db572aba0a4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:39.424592 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5320fed0-7f0a-4eda-a344-8db572aba0a4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:39.427666 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5320fed0-7f0a-4eda-a344-8db572aba0a4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:39.430482 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5320fed0-7f0a-4eda-a344-8db572aba0a4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:39.443560 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:45:39.714200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7f03c43d-3ef9-46dc-865a-b42b373e544b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:39.723573 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7f03c43d-3ef9-46dc-865a-b42b373e544b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226" status: 200 len: 1318 microversion: 2.1 time: 0.587918 Aug 04 16:45:39.745024 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1103/2194] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:39 2022] GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226 => generated 1318 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:39.894434 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5320fed0-7f0a-4eda-a344-8db572aba0a4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:39.917117 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5320fed0-7f0a-4eda-a344-8db572aba0a4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805" status: 200 len: 1498 microversion: 2.1 time: 0.521290 Aug 04 16:45:39.918543 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1092/2195] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:39 2022] GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805 => generated 1498 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:40.215408 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ec79ad85-5f6d-4c53-a3da-a6432a3f4a3b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:40.216197 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ec79ad85-5f6d-4c53-a3da-a6432a3f4a3b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 03f171b8-c8d3-46c8-9429-4d90317c2b19] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:40.231850 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec79ad85-5f6d-4c53-a3da-a6432a3f4a3b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:40.233038 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec79ad85-5f6d-4c53-a3da-a6432a3f4a3b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:40.234464 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec79ad85-5f6d-4c53-a3da-a6432a3f4a3b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:40.235533 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec79ad85-5f6d-4c53-a3da-a6432a3f4a3b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:40.283985 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ec79ad85-5f6d-4c53-a3da-a6432a3f4a3b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 03f171b8-c8d3-46c8-9429-4d90317c2b19] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:45:40.326123 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a2a3e7aa-4cb4-44b2-a507-4718a174fd3d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:40.326871 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a2a3e7aa-4cb4-44b2-a507-4718a174fd3d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:40.347373 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a2a3e7aa-4cb4-44b2-a507-4718a174fd3d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:40.347823 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a2a3e7aa-4cb4-44b2-a507-4718a174fd3d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:40.349315 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a2a3e7aa-4cb4-44b2-a507-4718a174fd3d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:40.349964 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a2a3e7aa-4cb4-44b2-a507-4718a174fd3d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:40.432198 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ec79ad85-5f6d-4c53-a3da-a6432a3f4a3b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "DELETE /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19" status: 204 len: 0 microversion: 2.1 time: 0.220063 Aug 04 16:45:40.434093 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1104/2196] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:45:40 2022] DELETE /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:45:40.449627 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-adcb9a3e-0865-4ac6-ade3-3698410570d1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:40.452767 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-adcb9a3e-0865-4ac6-ade3-3698410570d1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 03f171b8-c8d3-46c8-9429-4d90317c2b19] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:40.469624 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-adcb9a3e-0865-4ac6-ade3-3698410570d1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:40.472117 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-adcb9a3e-0865-4ac6-ade3-3698410570d1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:40.474596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-adcb9a3e-0865-4ac6-ade3-3698410570d1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:40.475385 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-adcb9a3e-0865-4ac6-ade3-3698410570d1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:41.353182 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-adcb9a3e-0865-4ac6-ade3-3698410570d1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:41.374111 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-adcb9a3e-0865-4ac6-ade3-3698410570d1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19" status: 200 len: 1554 microversion: 2.1 time: 0.932744 Aug 04 16:45:41.376043 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1105/2197] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:40 2022] GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19 => generated 1554 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:45:41.389456 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-b38e33fa-37d2-4051-b629-ab1c9d6b3162 req-25950f74-6e62-47be-b20e-39cbbf16cf76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43de7756-af0e-4833-9b96-73843a67532c", "name": "network-vif-plugged", "status": "completed", "tag": "c105eb13-4f08-4bde-af50-0ff69cb99472"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:41.412100 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-b38e33fa-37d2-4051-b629-ab1c9d6b3162 req-25950f74-6e62-47be-b20e-39cbbf16cf76 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:41.413422 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-b38e33fa-37d2-4051-b629-ab1c9d6b3162 req-25950f74-6e62-47be-b20e-39cbbf16cf76 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:41.419349 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a2a3e7aa-4cb4-44b2-a507-4718a174fd3d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:41.446969 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-b38e33fa-37d2-4051-b629-ab1c9d6b3162 req-25950f74-6e62-47be-b20e-39cbbf16cf76 service nova] Creating event network-vif-plugged:c105eb13-4f08-4bde-af50-0ff69cb99472 for instance 43de7756-af0e-4833-9b96-73843a67532c on n-h2-846466-12 Aug 04 16:45:41.455927 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a2a3e7aa-4cb4-44b2-a507-4718a174fd3d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217" status: 200 len: 1513 microversion: 2.1 time: 1.132398 Aug 04 16:45:41.459844 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-b38e33fa-37d2-4051-b629-ab1c9d6b3162 req-25950f74-6e62-47be-b20e-39cbbf16cf76 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080156 Aug 04 16:45:41.461015 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1093/2198] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:40 2022] GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217 => generated 1513 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:41.461838 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1106/2199] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:45:41.476926 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-67291d84-fb26-4f95-9a25-130d0bdeaf52 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:41.477864 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8178433f-a6de-4510-9a4b-bce3ee284400 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:41.478515 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-67291d84-fb26-4f95-9a25-130d0bdeaf52 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: cc98a160-2abd-430e-8ea7-492777d8a226] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:41.478973 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8178433f-a6de-4510-9a4b-bce3ee284400 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 45b975d2-057f-4aae-9e4b-95b8ed28c805] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:41.487707 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8178433f-a6de-4510-9a4b-bce3ee284400 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:41.488475 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8178433f-a6de-4510-9a4b-bce3ee284400 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:41.489518 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8178433f-a6de-4510-9a4b-bce3ee284400 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:41.490146 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8178433f-a6de-4510-9a4b-bce3ee284400 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:41.493305 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-67291d84-fb26-4f95-9a25-130d0bdeaf52 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:41.494238 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-67291d84-fb26-4f95-9a25-130d0bdeaf52 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:41.497095 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-67291d84-fb26-4f95-9a25-130d0bdeaf52 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:41.497929 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-67291d84-fb26-4f95-9a25-130d0bdeaf52 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:42.049319 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8178433f-a6de-4510-9a4b-bce3ee284400 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:42.055239 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8178433f-a6de-4510-9a4b-bce3ee284400 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805" status: 200 len: 1498 microversion: 2.1 time: 0.591105 Aug 04 16:45:42.070096 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1107/2200] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:41 2022] GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805 => generated 1498 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:42.077621 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-67291d84-fb26-4f95-9a25-130d0bdeaf52 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:42.090275 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-67291d84-fb26-4f95-9a25-130d0bdeaf52 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226" status: 200 len: 1318 microversion: 2.1 time: 0.621721 Aug 04 16:45:42.091738 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1094/2201] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:41 2022] GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226 => generated 1318 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:42.417056 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-28821dae-f7b2-4fe0-bd9f-85dfecaee4ff tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:42.418515 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-28821dae-f7b2-4fe0-bd9f-85dfecaee4ff tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 03f171b8-c8d3-46c8-9429-4d90317c2b19] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:42.430997 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-28821dae-f7b2-4fe0-bd9f-85dfecaee4ff tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:42.431819 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-28821dae-f7b2-4fe0-bd9f-85dfecaee4ff tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:42.435976 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-28821dae-f7b2-4fe0-bd9f-85dfecaee4ff tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:42.437104 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-28821dae-f7b2-4fe0-bd9f-85dfecaee4ff tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:42.490423 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6a9e3561-c6ac-4b83-be2d-47bd15970c10 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:42.491480 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6a9e3561-c6ac-4b83-be2d-47bd15970c10 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:42.513466 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a9e3561-c6ac-4b83-be2d-47bd15970c10 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:42.516717 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a9e3561-c6ac-4b83-be2d-47bd15970c10 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:42.517990 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a9e3561-c6ac-4b83-be2d-47bd15970c10 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:42.520479 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a9e3561-c6ac-4b83-be2d-47bd15970c10 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:42.837447 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-28821dae-f7b2-4fe0-bd9f-85dfecaee4ff tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:42.857676 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-28821dae-f7b2-4fe0-bd9f-85dfecaee4ff tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19" status: 200 len: 1554 microversion: 2.1 time: 0.448217 Aug 04 16:45:42.858628 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1108/2202] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:42 2022] GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19 => generated 1554 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:42.874806 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-18c27f0c-5f61-45da-87ef-513887b79b09 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2098989566", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "a226ab43-a2ff-42ab-8f4b-732352dfa018"}], "security_groups": [{"name": "tempest-securitygroup--1580858228"}], "key_name": "tempest-keypair-386779736", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:42.899207 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6a9e3561-c6ac-4b83-be2d-47bd15970c10 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:42.919460 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6a9e3561-c6ac-4b83-be2d-47bd15970c10 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217" status: 200 len: 1513 microversion: 2.1 time: 0.436520 Aug 04 16:45:42.933988 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1095/2203] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:42 2022] GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217 => generated 1513 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:43.094731 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-51984fa0-5374-47ad-8337-72b3872e27c1 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:43.096479 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-51984fa0-5374-47ad-8337-72b3872e27c1 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 45b975d2-057f-4aae-9e4b-95b8ed28c805] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:43.103034 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-18c27f0c-5f61-45da-87ef-513887b79b09 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] validate_networks() for [('a226ab43-a2ff-42ab-8f4b-732352dfa018', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:45:43.116483 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-51984fa0-5374-47ad-8337-72b3872e27c1 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:43.119678 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-51984fa0-5374-47ad-8337-72b3872e27c1 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:43.121814 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-51984fa0-5374-47ad-8337-72b3872e27c1 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:43.122971 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-51984fa0-5374-47ad-8337-72b3872e27c1 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:43.874954 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-51984fa0-5374-47ad-8337-72b3872e27c1 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:43.916640 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-51984fa0-5374-47ad-8337-72b3872e27c1 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805" status: 200 len: 1498 microversion: 2.1 time: 0.825990 Aug 04 16:45:43.957545 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1096/2204] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:43 2022] GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805 => generated 1498 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:43.969164 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-47573c56-eb5d-4364-a857-c0981d5d7cea tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:43.977007 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-47573c56-eb5d-4364-a857-c0981d5d7cea tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: cc98a160-2abd-430e-8ea7-492777d8a226] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:43.991758 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-47573c56-eb5d-4364-a857-c0981d5d7cea tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:43.992900 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-47573c56-eb5d-4364-a857-c0981d5d7cea tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:43.994427 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-47573c56-eb5d-4364-a857-c0981d5d7cea tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:43.996498 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-47573c56-eb5d-4364-a857-c0981d5d7cea tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:44.066880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:45:44.536532 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-47573c56-eb5d-4364-a857-c0981d5d7cea tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:44.550944 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-47573c56-eb5d-4364-a857-c0981d5d7cea tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226" status: 200 len: 1318 microversion: 2.1 time: 0.590161 Aug 04 16:45:44.554668 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1097/2205] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:43 2022] GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226 => generated 1318 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:44.567386 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-5dd7ab7b-5465-4952-a13d-b2d281213db2 req-f28844a9-c754-4027-aee9-5ddfe818b112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc98a160-2abd-430e-8ea7-492777d8a226", "name": "network-vif-plugged", "status": "completed", "tag": "6d22be3f-4df2-4063-b40a-5e24bfd4d685"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:44.589655 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-5dd7ab7b-5465-4952-a13d-b2d281213db2 req-f28844a9-c754-4027-aee9-5ddfe818b112 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:44.591205 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-5dd7ab7b-5465-4952-a13d-b2d281213db2 req-f28844a9-c754-4027-aee9-5ddfe818b112 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:44.627842 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-5dd7ab7b-5465-4952-a13d-b2d281213db2 req-f28844a9-c754-4027-aee9-5ddfe818b112 service nova] Creating event network-vif-plugged:6d22be3f-4df2-4063-b40a-5e24bfd4d685 for instance cc98a160-2abd-430e-8ea7-492777d8a226 on n-h2-846466-12 Aug 04 16:45:44.646520 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-5dd7ab7b-5465-4952-a13d-b2d281213db2 req-f28844a9-c754-4027-aee9-5ddfe818b112 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087258 Aug 04 16:45:44.647850 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1098/2206] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:45:44.668355 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-37142e05-d196-48c8-89c0-ffa7cc6a9eba tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:44.669966 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-37142e05-d196-48c8-89c0-ffa7cc6a9eba tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 03f171b8-c8d3-46c8-9429-4d90317c2b19] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:44.683721 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-18c27f0c-5f61-45da-87ef-513887b79b09 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:45:44.684528 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-18c27f0c-5f61-45da-87ef-513887b79b09 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:45:44.685195 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-18c27f0c-5f61-45da-87ef-513887b79b09 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:45:44.685788 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-18c27f0c-5f61-45da-87ef-513887b79b09 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:45:44.687010 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-18c27f0c-5f61-45da-87ef-513887b79b09 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:45:44.710927 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-37142e05-d196-48c8-89c0-ffa7cc6a9eba tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:44.712311 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-37142e05-d196-48c8-89c0-ffa7cc6a9eba tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:44.715287 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-37142e05-d196-48c8-89c0-ffa7cc6a9eba tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:44.723918 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-37142e05-d196-48c8-89c0-ffa7cc6a9eba tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:44.731008 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-18c27f0c-5f61-45da-87ef-513887b79b09 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:44.736944 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-18c27f0c-5f61-45da-87ef-513887b79b09 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:44.738184 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-18c27f0c-5f61-45da-87ef-513887b79b09 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:44.739912 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-18c27f0c-5f61-45da-87ef-513887b79b09 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:44.815546 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-18c27f0c-5f61-45da-87ef-513887b79b09 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Getting quotas for project 1f4cdb4245df44119c504915dc542d9b. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:45:44.834949 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-18c27f0c-5f61-45da-87ef-513887b79b09 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Getting quotas for user c97a079594a2400bb4db33f3ce3a1497 and project 1f4cdb4245df44119c504915dc542d9b. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:45:44.867713 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-18c27f0c-5f61-45da-87ef-513887b79b09 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:45:44.883632 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-18c27f0c-5f61-45da-87ef-513887b79b09 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: befbf568-78f2-4571-bf63-fdac57291b28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:45:44.903093 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-37142e05-d196-48c8-89c0-ffa7cc6a9eba tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:44.918752 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-37142e05-d196-48c8-89c0-ffa7cc6a9eba tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19" status: 200 len: 1346 microversion: 2.1 time: 0.268854 Aug 04 16:45:44.932092 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1099/2207] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:44 2022] GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19 => generated 1346 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:44.937964 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c46ca3d0-37f8-480d-802f-fe485f917234 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:44.938578 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c46ca3d0-37f8-480d-802f-fe485f917234 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:44.963932 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c46ca3d0-37f8-480d-802f-fe485f917234 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:44.964947 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c46ca3d0-37f8-480d-802f-fe485f917234 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:44.968176 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c46ca3d0-37f8-480d-802f-fe485f917234 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:44.968691 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c46ca3d0-37f8-480d-802f-fe485f917234 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:44.977730 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-18c27f0c-5f61-45da-87ef-513887b79b09 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.117349 Aug 04 16:45:44.979765 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1109/2208] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:45:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 2120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:45:44.986554 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-98d511ae-3d87-4d3c-b401-4251e214315d req-42a1a04a-7eb1-4dd7-8d02-70b7e4b84d30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03f171b8-c8d3-46c8-9429-4d90317c2b19", "name": "network-vif-deleted", "tag": "aeae8ac0-7f22-4211-a9c4-9052ca44865b"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:45.000226 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-98d511ae-3d87-4d3c-b401-4251e214315d req-42a1a04a-7eb1-4dd7-8d02-70b7e4b84d30 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:45.000990 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-98d511ae-3d87-4d3c-b401-4251e214315d req-42a1a04a-7eb1-4dd7-8d02-70b7e4b84d30 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:45.017036 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-98d511ae-3d87-4d3c-b401-4251e214315d req-42a1a04a-7eb1-4dd7-8d02-70b7e4b84d30 service nova] Creating event network-vif-deleted:aeae8ac0-7f22-4211-a9c4-9052ca44865b for instance 03f171b8-c8d3-46c8-9429-4d90317c2b19 on n-h2-846466-12 Aug 04 16:45:45.023257 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-98d511ae-3d87-4d3c-b401-4251e214315d req-42a1a04a-7eb1-4dd7-8d02-70b7e4b84d30 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041102 Aug 04 16:45:45.024262 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1110/2209] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:45:45.030813 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3e9a753d-665e-4fd1-9539-2854e55df9fd tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:45.031634 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3e9a753d-665e-4fd1-9539-2854e55df9fd tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 45b975d2-057f-4aae-9e4b-95b8ed28c805] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:45.040488 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3e9a753d-665e-4fd1-9539-2854e55df9fd tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:45.041049 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3e9a753d-665e-4fd1-9539-2854e55df9fd tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:45.042751 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3e9a753d-665e-4fd1-9539-2854e55df9fd tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:45.043846 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3e9a753d-665e-4fd1-9539-2854e55df9fd tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:45.395664 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c46ca3d0-37f8-480d-802f-fe485f917234 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:45.414933 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c46ca3d0-37f8-480d-802f-fe485f917234 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217" status: 200 len: 1513 microversion: 2.1 time: 0.494296 Aug 04 16:45:45.417069 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1100/2210] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:44 2022] GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217 => generated 1513 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:45.438297 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-037d6ca0-931f-405d-b7f6-4b93f80a1627 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:45.438929 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-037d6ca0-931f-405d-b7f6-4b93f80a1627 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: befbf568-78f2-4571-bf63-fdac57291b28] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:45.494238 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3e9a753d-665e-4fd1-9539-2854e55df9fd tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:45.506842 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3e9a753d-665e-4fd1-9539-2854e55df9fd tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805" status: 200 len: 1498 microversion: 2.1 time: 0.481283 Aug 04 16:45:45.507621 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1111/2211] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:45 2022] GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805 => generated 1498 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:45.563774 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-037d6ca0-931f-405d-b7f6-4b93f80a1627 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97a079594a2400bb4db33f3ce3a1497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4cdb4245df44119c504915dc542d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:45.572909 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-037d6ca0-931f-405d-b7f6-4b93f80a1627 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28" status: 200 len: 1241 microversion: 2.1 time: 0.152371 Aug 04 16:45:45.576971 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1101/2212] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:45 2022] GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28 => generated 1241 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:45.585379 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0fae4a86-5cd9-4bd3-81f5-a6d7ce9d60fc tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:45.586236 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0fae4a86-5cd9-4bd3-81f5-a6d7ce9d60fc tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: cc98a160-2abd-430e-8ea7-492777d8a226] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:45.602649 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0fae4a86-5cd9-4bd3-81f5-a6d7ce9d60fc tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:45.603124 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0fae4a86-5cd9-4bd3-81f5-a6d7ce9d60fc tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:45.603978 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0fae4a86-5cd9-4bd3-81f5-a6d7ce9d60fc tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:45.604382 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0fae4a86-5cd9-4bd3-81f5-a6d7ce9d60fc tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:45.946679 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e3f8b7ca-e957-4ba4-b364-65a5e66bf711 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:45.958152 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e3f8b7ca-e957-4ba4-b364-65a5e66bf711 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 03f171b8-c8d3-46c8-9429-4d90317c2b19] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:45.993329 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e3f8b7ca-e957-4ba4-b364-65a5e66bf711 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:45.993578 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0fae4a86-5cd9-4bd3-81f5-a6d7ce9d60fc tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:45.999531 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e3f8b7ca-e957-4ba4-b364-65a5e66bf711 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:46.002505 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0fae4a86-5cd9-4bd3-81f5-a6d7ce9d60fc tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226" status: 200 len: 1318 microversion: 2.1 time: 0.431978 Aug 04 16:45:46.003412 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1112/2213] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:45 2022] GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226 => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:45:46.017827 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e3f8b7ca-e957-4ba4-b364-65a5e66bf711 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:46.018720 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e3f8b7ca-e957-4ba4-b364-65a5e66bf711 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:46.175156 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e3f8b7ca-e957-4ba4-b364-65a5e66bf711 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:46.186743 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e3f8b7ca-e957-4ba4-b364-65a5e66bf711 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19" status: 200 len: 1346 microversion: 2.1 time: 0.250051 Aug 04 16:45:46.188359 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1102/2214] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:45 2022] GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19 => generated 1346 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:46.456206 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d20e679c-bea3-4058-9ccc-aaaef6181254 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:46.456974 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d20e679c-bea3-4058-9ccc-aaaef6181254 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:46.471584 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d20e679c-bea3-4058-9ccc-aaaef6181254 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:46.474485 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d20e679c-bea3-4058-9ccc-aaaef6181254 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:46.479477 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d20e679c-bea3-4058-9ccc-aaaef6181254 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:46.480673 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d20e679c-bea3-4058-9ccc-aaaef6181254 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:46.538413 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-68a84097-1630-4c46-8bf9-1995c91f31d6 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:46.540494 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-68a84097-1630-4c46-8bf9-1995c91f31d6 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 45b975d2-057f-4aae-9e4b-95b8ed28c805] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:46.547824 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-68a84097-1630-4c46-8bf9-1995c91f31d6 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:46.548857 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-68a84097-1630-4c46-8bf9-1995c91f31d6 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:46.550603 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-68a84097-1630-4c46-8bf9-1995c91f31d6 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:46.551317 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-68a84097-1630-4c46-8bf9-1995c91f31d6 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:46.921107 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d20e679c-bea3-4058-9ccc-aaaef6181254 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:46.938207 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d20e679c-bea3-4058-9ccc-aaaef6181254 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217" status: 200 len: 1513 microversion: 2.1 time: 0.487221 Aug 04 16:45:46.938747 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1113/2215] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:46 2022] GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217 => generated 1513 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:46.968165 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-68a84097-1630-4c46-8bf9-1995c91f31d6 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:46.981954 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-830a0870-eb8c-496f-b406-4c5b4bef4a03 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:46.983064 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-830a0870-eb8c-496f-b406-4c5b4bef4a03 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: befbf568-78f2-4571-bf63-fdac57291b28] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:46.983204 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-68a84097-1630-4c46-8bf9-1995c91f31d6 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805" status: 200 len: 1498 microversion: 2.1 time: 0.450053 Aug 04 16:45:46.987263 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1103/2216] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:46 2022] GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805 => generated 1498 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:46.991255 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-830a0870-eb8c-496f-b406-4c5b4bef4a03 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:46.991779 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-830a0870-eb8c-496f-b406-4c5b4bef4a03 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:46.992631 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-830a0870-eb8c-496f-b406-4c5b4bef4a03 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:46.993118 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-830a0870-eb8c-496f-b406-4c5b4bef4a03 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:46.996597 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:45:47.026275 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-85dcf93b-d822-44b7-8d07-13375d79fb0e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:47.027261 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-85dcf93b-d822-44b7-8d07-13375d79fb0e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: cc98a160-2abd-430e-8ea7-492777d8a226] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:47.040667 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-85dcf93b-d822-44b7-8d07-13375d79fb0e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:47.041115 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-85dcf93b-d822-44b7-8d07-13375d79fb0e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:47.045436 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-85dcf93b-d822-44b7-8d07-13375d79fb0e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:47.045886 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-85dcf93b-d822-44b7-8d07-13375d79fb0e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:47.099608 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-830a0870-eb8c-496f-b406-4c5b4bef4a03 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97a079594a2400bb4db33f3ce3a1497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4cdb4245df44119c504915dc542d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:47.114474 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-830a0870-eb8c-496f-b406-4c5b4bef4a03 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28" status: 200 len: 1293 microversion: 2.1 time: 0.155925 Aug 04 16:45:47.116686 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1114/2217] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:46 2022] GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28 => generated 1293 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:47.216902 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1191fb80-49b4-4467-8d21-9feacd48d035 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:47.222829 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1191fb80-49b4-4467-8d21-9feacd48d035 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 03f171b8-c8d3-46c8-9429-4d90317c2b19] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:47.238541 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-85dcf93b-d822-44b7-8d07-13375d79fb0e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:47.239915 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1191fb80-49b4-4467-8d21-9feacd48d035 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:47.241417 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1191fb80-49b4-4467-8d21-9feacd48d035 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:47.243429 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1191fb80-49b4-4467-8d21-9feacd48d035 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:47.244621 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1191fb80-49b4-4467-8d21-9feacd48d035 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:47.282859 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-85dcf93b-d822-44b7-8d07-13375d79fb0e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226" status: 200 len: 1467 microversion: 2.1 time: 0.260450 Aug 04 16:45:47.283479 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1104/2218] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:47 2022] GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226 => generated 1467 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:45:47.304097 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-eed68597-c004-4ad8-862a-5f0a717cdb3f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:47.307268 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-eed68597-c004-4ad8-862a-5f0a717cdb3f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 43de7756-af0e-4833-9b96-73843a67532c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:47.328171 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eed68597-c004-4ad8-862a-5f0a717cdb3f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:47.329971 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eed68597-c004-4ad8-862a-5f0a717cdb3f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:47.332395 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eed68597-c004-4ad8-862a-5f0a717cdb3f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:47.335587 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eed68597-c004-4ad8-862a-5f0a717cdb3f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:47.465362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1191fb80-49b4-4467-8d21-9feacd48d035 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:47.526340 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1191fb80-49b4-4467-8d21-9feacd48d035 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19" status: 200 len: 1346 microversion: 2.1 time: 0.312819 Aug 04 16:45:47.538783 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1115/2219] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:47 2022] GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19 => generated 1346 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:45:47.942321 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-eed68597-c004-4ad8-862a-5f0a717cdb3f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:47.959061 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-eed68597-c004-4ad8-862a-5f0a717cdb3f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/43de7756-af0e-4833-9b96-73843a67532c" status: 200 len: 1468 microversion: 2.1 time: 0.658691 Aug 04 16:45:47.973313 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1105/2220] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:47 2022] GET /compute/v2.1/servers/43de7756-af0e-4833-9b96-73843a67532c => generated 1468 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:45:47.974003 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-45a3d696-f830-4b1a-b4cc-2b55f58a3422 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:47.974003 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-45a3d696-f830-4b1a-b4cc-2b55f58a3422 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:47.974003 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-45a3d696-f830-4b1a-b4cc-2b55f58a3422 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:47.974003 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-45a3d696-f830-4b1a-b4cc-2b55f58a3422 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:47.974003 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-45a3d696-f830-4b1a-b4cc-2b55f58a3422 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:47.974694 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-45a3d696-f830-4b1a-b4cc-2b55f58a3422 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:47.985031 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9e4f8133-635b-4000-8cac-7953e0051d03 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:47.993723 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9e4f8133-635b-4000-8cac-7953e0051d03 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:47.995291 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9e4f8133-635b-4000-8cac-7953e0051d03 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Searching by: {'reservation_id': 'r-n6tl5c40', 'deleted': False, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043'} {{(pid=126126) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:45:48.014179 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e4f8133-635b-4000-8cac-7953e0051d03 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:48.015118 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e4f8133-635b-4000-8cac-7953e0051d03 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:48.016175 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e4f8133-635b-4000-8cac-7953e0051d03 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:48.016606 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e4f8133-635b-4000-8cac-7953e0051d03 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:48.266480 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.multi_cell_list [None req-9e4f8133-635b-4000-8cac-7953e0051d03 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126126) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:45:48.365519 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9e4f8133-635b-4000-8cac-7953e0051d03 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:48.380586 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e4f8133-635b-4000-8cac-7953e0051d03 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:48.382638 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e4f8133-635b-4000-8cac-7953e0051d03 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:48.600045 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-45a3d696-f830-4b1a-b4cc-2b55f58a3422 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:48.624457 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-45a3d696-f830-4b1a-b4cc-2b55f58a3422 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217" status: 200 len: 1513 microversion: 2.1 time: 0.666793 Aug 04 16:45:48.628538 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1116/2221] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:47 2022] GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217 => generated 1513 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:45:48.641748 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f5f67889-9a02-4e62-9a24-0bc88588ae4b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:48.643678 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f5f67889-9a02-4e62-9a24-0bc88588ae4b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 45b975d2-057f-4aae-9e4b-95b8ed28c805] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:48.669539 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f5f67889-9a02-4e62-9a24-0bc88588ae4b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:48.673849 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f5f67889-9a02-4e62-9a24-0bc88588ae4b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:48.679305 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f5f67889-9a02-4e62-9a24-0bc88588ae4b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:48.680784 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f5f67889-9a02-4e62-9a24-0bc88588ae4b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:48.747656 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9e4f8133-635b-4000-8cac-7953e0051d03 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?reservation_id=r-n6tl5c40" status: 200 len: 2928 microversion: 2.1 time: 0.766733 Aug 04 16:45:48.748751 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1106/2222] 10.222.0.23 () {58 vars in 1197 bytes} [Thu Aug 4 16:45:47 2022] GET /compute/v2.1/servers/detail?reservation_id=r-n6tl5c40 => generated 2928 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:45:48.754191 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4320ffbd-1f60-4ca8-8150-e6f4c27ce070 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:48.754958 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4320ffbd-1f60-4ca8-8150-e6f4c27ce070 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: befbf568-78f2-4571-bf63-fdac57291b28] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:48.781258 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4320ffbd-1f60-4ca8-8150-e6f4c27ce070 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:48.800433 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4320ffbd-1f60-4ca8-8150-e6f4c27ce070 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:48.804532 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4320ffbd-1f60-4ca8-8150-e6f4c27ce070 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:48.807725 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4320ffbd-1f60-4ca8-8150-e6f4c27ce070 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:48.977581 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4320ffbd-1f60-4ca8-8150-e6f4c27ce070 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97a079594a2400bb4db33f3ce3a1497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4cdb4245df44119c504915dc542d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:48.991435 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4320ffbd-1f60-4ca8-8150-e6f4c27ce070 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28" status: 200 len: 1299 microversion: 2.1 time: 0.240477 Aug 04 16:45:48.992636 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1107/2223] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:48 2022] GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28 => generated 1299 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:49.000443 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c9835bed-dc5e-47a5-9186-70dc5e65e351 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:49.001536 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c9835bed-dc5e-47a5-9186-70dc5e65e351 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 03f171b8-c8d3-46c8-9429-4d90317c2b19] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:49.014299 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9835bed-dc5e-47a5-9186-70dc5e65e351 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:49.015059 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9835bed-dc5e-47a5-9186-70dc5e65e351 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:49.015905 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9835bed-dc5e-47a5-9186-70dc5e65e351 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:49.017218 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9835bed-dc5e-47a5-9186-70dc5e65e351 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:49.108985 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f5f67889-9a02-4e62-9a24-0bc88588ae4b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:49.123806 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f5f67889-9a02-4e62-9a24-0bc88588ae4b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805" status: 200 len: 1498 microversion: 2.1 time: 0.492755 Aug 04 16:45:49.127892 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1117/2224] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:48 2022] GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805 => generated 1498 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:49.135652 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e2fca751-344e-4de2-8f8d-e49046b681db tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:49.218012 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.compute.server_groups [None req-e2fca751-344e-4de2-8f8d-e49046b681db tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Querying cell e056d029-674a-446e-ac9e-5108621d9db2(cell1) for 2 instances {{(pid=126125) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 04 16:45:49.220919 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e2fca751-344e-4de2-8f8d-e49046b681db tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:49.221988 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e2fca751-344e-4de2-8f8d-e49046b681db tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:49.240464 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c9835bed-dc5e-47a5-9186-70dc5e65e351 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:49.257208 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c9835bed-dc5e-47a5-9186-70dc5e65e351 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19" status: 200 len: 1346 microversion: 2.1 time: 0.262273 Aug 04 16:45:49.258261 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1108/2225] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:48 2022] GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19 => generated 1346 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:49.343537 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e2fca751-344e-4de2-8f8d-e49046b681db tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/9204ead0-2936-4e23-b741-7fe0269ed796" status: 200 len: 266 microversion: 2.1 time: 0.214105 Aug 04 16:45:49.344169 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1118/2226] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Aug 4 16:45:49 2022] GET /compute/v2.1/os-server-groups/9204ead0-2936-4e23-b741-7fe0269ed796 => generated 266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:45:49.361937 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ea3bd3f9-4845-4a19-a4b9-dcde15bbcfe1 tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:49.365831 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ea3bd3f9-4845-4a19-a4b9-dcde15bbcfe1 tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] [instance: cc98a160-2abd-430e-8ea7-492777d8a226] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:49.377732 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea3bd3f9-4845-4a19-a4b9-dcde15bbcfe1 tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:49.378631 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea3bd3f9-4845-4a19-a4b9-dcde15bbcfe1 tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:49.380579 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea3bd3f9-4845-4a19-a4b9-dcde15bbcfe1 tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:49.381373 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea3bd3f9-4845-4a19-a4b9-dcde15bbcfe1 tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:49.651329 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-558a4087-a3c5-4b95-97f9-ee0c4e8a9e01 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:49.652203 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-558a4087-a3c5-4b95-97f9-ee0c4e8a9e01 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:49.668014 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-558a4087-a3c5-4b95-97f9-ee0c4e8a9e01 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:49.671903 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-558a4087-a3c5-4b95-97f9-ee0c4e8a9e01 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:49.674657 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-558a4087-a3c5-4b95-97f9-ee0c4e8a9e01 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:49.679505 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-558a4087-a3c5-4b95-97f9-ee0c4e8a9e01 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:50.192809 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=100 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:45:50.198882 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ea3bd3f9-4845-4a19-a4b9-dcde15bbcfe1 tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226" status: 200 len: 1620 microversion: 2.1 time: 0.843768 Aug 04 16:45:50.199549 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1109/2227] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:49 2022] GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226 => generated 1620 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:50.205225 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cfd71726-0ace-4574-b056-d5aba5e4af69 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:50.207612 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cfd71726-0ace-4574-b056-d5aba5e4af69 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: befbf568-78f2-4571-bf63-fdac57291b28] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:50.229463 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cfd71726-0ace-4574-b056-d5aba5e4af69 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:50.230871 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cfd71726-0ace-4574-b056-d5aba5e4af69 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:50.232030 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cfd71726-0ace-4574-b056-d5aba5e4af69 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:50.232780 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cfd71726-0ace-4574-b056-d5aba5e4af69 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:50.254790 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-558a4087-a3c5-4b95-97f9-ee0c4e8a9e01 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:50.271479 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-558a4087-a3c5-4b95-97f9-ee0c4e8a9e01 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217" status: 200 len: 1513 microversion: 2.1 time: 0.625004 Aug 04 16:45:50.273756 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1119/2228] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:49 2022] GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217 => generated 1513 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:50.282650 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-82c70888-e2fc-489d-9df1-3a1ba4aef479 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:50.284756 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-82c70888-e2fc-489d-9df1-3a1ba4aef479 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 45b975d2-057f-4aae-9e4b-95b8ed28c805] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:50.313978 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-82c70888-e2fc-489d-9df1-3a1ba4aef479 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:50.315316 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-82c70888-e2fc-489d-9df1-3a1ba4aef479 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:50.316184 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-82c70888-e2fc-489d-9df1-3a1ba4aef479 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:50.316622 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-82c70888-e2fc-489d-9df1-3a1ba4aef479 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:50.927045 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cfd71726-0ace-4574-b056-d5aba5e4af69 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97a079594a2400bb4db33f3ce3a1497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4cdb4245df44119c504915dc542d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:50.939324 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cfd71726-0ace-4574-b056-d5aba5e4af69 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28" status: 200 len: 1367 microversion: 2.1 time: 0.738211 Aug 04 16:45:50.939930 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1110/2229] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:50 2022] GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28 => generated 1367 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:50.949046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-82c70888-e2fc-489d-9df1-3a1ba4aef479 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:50.951210 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a351fad6-ffa5-45d0-9a4c-d96bbc2eb3d2 tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:50.954933 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a351fad6-ffa5-45d0-9a4c-d96bbc2eb3d2 tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] [instance: 43de7756-af0e-4833-9b96-73843a67532c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:50.964268 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-82c70888-e2fc-489d-9df1-3a1ba4aef479 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805" status: 200 len: 1498 microversion: 2.1 time: 0.688603 Aug 04 16:45:50.971859 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a351fad6-ffa5-45d0-9a4c-d96bbc2eb3d2 tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:50.976576 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a351fad6-ffa5-45d0-9a4c-d96bbc2eb3d2 tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:50.978029 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1120/2230] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:50 2022] GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805 => generated 1498 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:50.981155 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a351fad6-ffa5-45d0-9a4c-d96bbc2eb3d2 tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:50.991205 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a351fad6-ffa5-45d0-9a4c-d96bbc2eb3d2 tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:50.999594 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-41a9ae6f-0e7b-43de-ac2e-e7891114455f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:51.000228 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-41a9ae6f-0e7b-43de-ac2e-e7891114455f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 03f171b8-c8d3-46c8-9429-4d90317c2b19] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:51.025932 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-41a9ae6f-0e7b-43de-ac2e-e7891114455f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:51.026386 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-41a9ae6f-0e7b-43de-ac2e-e7891114455f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:51.027214 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-41a9ae6f-0e7b-43de-ac2e-e7891114455f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:51.027655 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-41a9ae6f-0e7b-43de-ac2e-e7891114455f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:51.269808 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-41a9ae6f-0e7b-43de-ac2e-e7891114455f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:51.290924 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-41a9ae6f-0e7b-43de-ac2e-e7891114455f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19" status: 200 len: 1346 microversion: 2.1 time: 0.310754 Aug 04 16:45:51.291847 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1121/2231] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:50 2022] GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19 => generated 1346 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:51.308011 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c6ee8ece-b465-4c19-8907-acd1d42b2597 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:51.311320 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c6ee8ece-b465-4c19-8907-acd1d42b2597 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:51.331419 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c6ee8ece-b465-4c19-8907-acd1d42b2597 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:51.334684 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c6ee8ece-b465-4c19-8907-acd1d42b2597 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:51.337265 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c6ee8ece-b465-4c19-8907-acd1d42b2597 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:51.340641 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c6ee8ece-b465-4c19-8907-acd1d42b2597 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:51.943207 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c6ee8ece-b465-4c19-8907-acd1d42b2597 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:51.975884 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c6ee8ece-b465-4c19-8907-acd1d42b2597 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217" status: 200 len: 1490 microversion: 2.1 time: 0.681963 Aug 04 16:45:51.999892 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1122/2232] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:51 2022] GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217 => generated 1490 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:52.002683 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a351fad6-ffa5-45d0-9a4c-d96bbc2eb3d2 tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/43de7756-af0e-4833-9b96-73843a67532c" status: 200 len: 1621 microversion: 2.1 time: 1.060010 Aug 04 16:45:52.021346 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1111/2233] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:50 2022] GET /compute/v2.1/servers/43de7756-af0e-4833-9b96-73843a67532c => generated 1621 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:52.021589 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6242df04-27fe-4bd0-9141-197a22068114 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:52.021589 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6242df04-27fe-4bd0-9141-197a22068114 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: befbf568-78f2-4571-bf63-fdac57291b28] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:52.028331 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-404578a4-730d-4074-b2e3-60e78699e744 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:52.029431 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-404578a4-730d-4074-b2e3-60e78699e744 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 45b975d2-057f-4aae-9e4b-95b8ed28c805] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:52.044153 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6242df04-27fe-4bd0-9141-197a22068114 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:52.052378 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6242df04-27fe-4bd0-9141-197a22068114 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:52.054417 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6242df04-27fe-4bd0-9141-197a22068114 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:52.056163 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-404578a4-730d-4074-b2e3-60e78699e744 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:52.057152 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6242df04-27fe-4bd0-9141-197a22068114 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:52.057869 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-404578a4-730d-4074-b2e3-60e78699e744 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:52.062003 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-404578a4-730d-4074-b2e3-60e78699e744 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:52.067179 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-404578a4-730d-4074-b2e3-60e78699e744 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:52.619258 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-404578a4-730d-4074-b2e3-60e78699e744 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:52.635703 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-404578a4-730d-4074-b2e3-60e78699e744 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805" status: 200 len: 1498 microversion: 2.1 time: 0.623800 Aug 04 16:45:52.637229 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1112/2234] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:52 2022] GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805 => generated 1498 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:52.649998 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-97bd8edf-557c-493c-a1c6-cb34666f6c3d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:52.660526 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6242df04-27fe-4bd0-9141-197a22068114 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97a079594a2400bb4db33f3ce3a1497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4cdb4245df44119c504915dc542d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:52.672280 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-97bd8edf-557c-493c-a1c6-cb34666f6c3d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:52.675307 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6242df04-27fe-4bd0-9141-197a22068114 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28" status: 200 len: 1367 microversion: 2.1 time: 0.671931 Aug 04 16:45:52.677318 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1123/2235] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:52 2022] GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28 => generated 1367 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:52.696165 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-97bd8edf-557c-493c-a1c6-cb34666f6c3d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:52.698030 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1bd93b48-ef04-4d5b-875e-d9a78fecc6b7 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Action: 'create', calling method: .version_select at 0x7f7e84d5cca0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-229087988", "policies": ["anti-affinity"]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:52.698910 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-97bd8edf-557c-493c-a1c6-cb34666f6c3d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:52.705916 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-97bd8edf-557c-493c-a1c6-cb34666f6c3d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:52.706963 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-97bd8edf-557c-493c-a1c6-cb34666f6c3d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:52.771805 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-1bd93b48-ef04-4d5b-875e-d9a78fecc6b7 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for project b9e709c95a964cd5855d4e253aeb1043. Resources: {'server_groups'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:45:52.807360 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-1bd93b48-ef04-4d5b-875e-d9a78fecc6b7 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for user 336c26b5dd6644bc83f9b80adac06bce and project b9e709c95a964cd5855d4e253aeb1043. Resources: {'server_groups'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:45:52.815606 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-97bd8edf-557c-493c-a1c6-cb34666f6c3d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action" status: 200 len: 176 microversion: 2.1 time: 0.176275 Aug 04 16:45:52.821579 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1113/2236] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:45:52 2022] POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action => generated 176 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:45:52.830260 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b5f9d6dd-b358-4e19-8d19-696ec64e32ba tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:52.831439 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b5f9d6dd-b358-4e19-8d19-696ec64e32ba tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 03f171b8-c8d3-46c8-9429-4d90317c2b19] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:52.846249 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b5f9d6dd-b358-4e19-8d19-696ec64e32ba tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:52.847559 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b5f9d6dd-b358-4e19-8d19-696ec64e32ba tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:52.848745 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b5f9d6dd-b358-4e19-8d19-696ec64e32ba tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:52.849765 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b5f9d6dd-b358-4e19-8d19-696ec64e32ba tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:52.962425 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-1bd93b48-ef04-4d5b-875e-d9a78fecc6b7 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for project b9e709c95a964cd5855d4e253aeb1043. Resources: {'server_groups'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:45:52.987953 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-1bd93b48-ef04-4d5b-875e-d9a78fecc6b7 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for user 336c26b5dd6644bc83f9b80adac06bce and project b9e709c95a964cd5855d4e253aeb1043. Resources: {'server_groups'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:45:53.012891 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b5f9d6dd-b358-4e19-8d19-696ec64e32ba tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:53.019949 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b5f9d6dd-b358-4e19-8d19-696ec64e32ba tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:53.022061 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-b5f9d6dd-b358-4e19-8d19-696ec64e32ba tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lazy-loading 'fault' on Instance uuid 03f171b8-c8d3-46c8-9429-4d90317c2b19 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:45:53.027598 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1bd93b48-ef04-4d5b-875e-d9a78fecc6b7 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.348744 Aug 04 16:45:53.029343 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1124/2237] 10.222.0.23 () {60 vars in 1174 bytes} [Thu Aug 4 16:45:52 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:45:53.047263 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8074a4a7-7f82-4d50-98ba-8ff702b91d9a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:53.048521 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8074a4a7-7f82-4d50-98ba-8ff702b91d9a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:53.087947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8074a4a7-7f82-4d50-98ba-8ff702b91d9a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:53.091104 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8074a4a7-7f82-4d50-98ba-8ff702b91d9a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:53.092484 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8074a4a7-7f82-4d50-98ba-8ff702b91d9a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:53.092982 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8074a4a7-7f82-4d50-98ba-8ff702b91d9a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:53.171891 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b5f9d6dd-b358-4e19-8d19-696ec64e32ba tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:53.193299 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b5f9d6dd-b358-4e19-8d19-696ec64e32ba tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19" status: 200 len: 1351 microversion: 2.1 time: 0.369768 Aug 04 16:45:53.198805 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1114/2238] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:52 2022] GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19 => generated 1351 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:53.210688 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-98d00fea-f18c-4e17-abac-57c322b03919 req-5a4ffabc-27d7-458a-b2ec-c28e0275c011 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "befbf568-78f2-4571-bf63-fdac57291b28", "tag": "4d207d96-918f-45a6-92bf-48edb7564806"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:53.232521 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-98d00fea-f18c-4e17-abac-57c322b03919 req-5a4ffabc-27d7-458a-b2ec-c28e0275c011 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:53.233571 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-98d00fea-f18c-4e17-abac-57c322b03919 req-5a4ffabc-27d7-458a-b2ec-c28e0275c011 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:53.256506 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-98d00fea-f18c-4e17-abac-57c322b03919 req-5a4ffabc-27d7-458a-b2ec-c28e0275c011 service nova] Creating event network-changed:4d207d96-918f-45a6-92bf-48edb7564806 for instance befbf568-78f2-4571-bf63-fdac57291b28 on n-h1-846466-12 Aug 04 16:45:53.265622 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-98d00fea-f18c-4e17-abac-57c322b03919 req-5a4ffabc-27d7-458a-b2ec-c28e0275c011 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063680 Aug 04 16:45:53.270372 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1115/2239] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:45:53.600139 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8074a4a7-7f82-4d50-98ba-8ff702b91d9a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:53.613634 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8074a4a7-7f82-4d50-98ba-8ff702b91d9a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.582850 Aug 04 16:45:53.614688 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1125/2240] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:53 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:53.619646 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-77c38f6e-cb7a-4456-a4c6-1aa12ea0f8dd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-895168210", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "752ef6cd-d50c-4a56-b56f-fc340448c45d"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:53.709211 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-77c38f6e-cb7a-4456-a4c6-1aa12ea0f8dd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] validate_networks() for None {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:45:53.817524 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bfacb79a-3787-4652-923c-f342e9c8d84d tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-2142554019", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "0135e309-4742-49be-b3e3-c69a20b0dc39"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:53.932984 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-bfacb79a-3787-4652-923c-f342e9c8d84d tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] validate_networks() for [('0135e309-4742-49be-b3e3-c69a20b0dc39', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:45:54.699138 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-77c38f6e-cb7a-4456-a4c6-1aa12ea0f8dd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:45:54.700067 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-77c38f6e-cb7a-4456-a4c6-1aa12ea0f8dd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:45:54.701142 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-77c38f6e-cb7a-4456-a4c6-1aa12ea0f8dd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:45:54.701867 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-77c38f6e-cb7a-4456-a4c6-1aa12ea0f8dd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:45:54.702836 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-77c38f6e-cb7a-4456-a4c6-1aa12ea0f8dd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:45:54.737119 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-77c38f6e-cb7a-4456-a4c6-1aa12ea0f8dd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:54.739064 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-77c38f6e-cb7a-4456-a4c6-1aa12ea0f8dd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:54.742172 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-77c38f6e-cb7a-4456-a4c6-1aa12ea0f8dd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:54.743288 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-77c38f6e-cb7a-4456-a4c6-1aa12ea0f8dd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:54.783813 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-77c38f6e-cb7a-4456-a4c6-1aa12ea0f8dd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for project b9e709c95a964cd5855d4e253aeb1043. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:45:54.795669 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-77c38f6e-cb7a-4456-a4c6-1aa12ea0f8dd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for user 336c26b5dd6644bc83f9b80adac06bce and project b9e709c95a964cd5855d4e253aeb1043. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:45:54.823220 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-77c38f6e-cb7a-4456-a4c6-1aa12ea0f8dd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Going to run 2 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:45:54.828249 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-77c38f6e-cb7a-4456-a4c6-1aa12ea0f8dd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 3c687b7a-617f-46d4-b1c1-c629814fac1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:45:54.896364 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-bfacb79a-3787-4652-923c-f342e9c8d84d tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:45:54.897324 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-bfacb79a-3787-4652-923c-f342e9c8d84d tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:45:54.897871 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-bfacb79a-3787-4652-923c-f342e9c8d84d tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:45:54.898455 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-bfacb79a-3787-4652-923c-f342e9c8d84d tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:45:54.898871 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-bfacb79a-3787-4652-923c-f342e9c8d84d tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:45:54.912951 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-77c38f6e-cb7a-4456-a4c6-1aa12ea0f8dd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=126125) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 04 16:45:54.920472 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bfacb79a-3787-4652-923c-f342e9c8d84d tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:54.920806 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bfacb79a-3787-4652-923c-f342e9c8d84d tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:54.930507 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bfacb79a-3787-4652-923c-f342e9c8d84d tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:54.932895 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bfacb79a-3787-4652-923c-f342e9c8d84d tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:54.995240 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-77c38f6e-cb7a-4456-a4c6-1aa12ea0f8dd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for project b9e709c95a964cd5855d4e253aeb1043. Resources: {'server_group_members'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:45:55.012928 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:45:55.016622 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-77c38f6e-cb7a-4456-a4c6-1aa12ea0f8dd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for user 336c26b5dd6644bc83f9b80adac06bce and project b9e709c95a964cd5855d4e253aeb1043. Resources: {'server_group_members'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:45:55.019822 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-bfacb79a-3787-4652-923c-f342e9c8d84d tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Getting quotas for project ba7a69315bfb4723b95c9b79e0741b0e. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:45:55.035836 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-bfacb79a-3787-4652-923c-f342e9c8d84d tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Getting quotas for user 450c14de401149bc8a24efb11e24b631 and project ba7a69315bfb4723b95c9b79e0741b0e. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:45:55.069611 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bfacb79a-3787-4652-923c-f342e9c8d84d tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Going to run 2 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:45:55.087958 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bfacb79a-3787-4652-923c-f342e9c8d84d tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: ab3019e6-7cb9-44e9-a08a-e453ba9ded47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:45:55.128531 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-77c38f6e-cb7a-4456-a4c6-1aa12ea0f8dd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for project b9e709c95a964cd5855d4e253aeb1043. Resources: {'server_group_members'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:45:55.149094 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-77c38f6e-cb7a-4456-a4c6-1aa12ea0f8dd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for user 336c26b5dd6644bc83f9b80adac06bce and project b9e709c95a964cd5855d4e253aeb1043. Resources: {'server_group_members'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:45:55.177080 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bfacb79a-3787-4652-923c-f342e9c8d84d tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: 9379d600-7def-463c-9655-b6d3a3833762] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=ab3019e6-7cb9-44e9-a08a-e453ba9ded47,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:45:55.186698 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-77c38f6e-cb7a-4456-a4c6-1aa12ea0f8dd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=3c687b7a-617f-46d4-b1c1-c629814fac1a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:45:55.255037 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bfacb79a-3787-4652-923c-f342e9c8d84d tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.892664 Aug 04 16:45:55.262799 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1116/2241] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:45:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 16:45:55.268347 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6c60330b-18eb-4c1d-afc3-acc18c92a208 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:55.268970 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6c60330b-18eb-4c1d-afc3-acc18c92a208 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 45b975d2-057f-4aae-9e4b-95b8ed28c805] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:55.278095 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c60330b-18eb-4c1d-afc3-acc18c92a208 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:55.279333 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c60330b-18eb-4c1d-afc3-acc18c92a208 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:55.281929 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c60330b-18eb-4c1d-afc3-acc18c92a208 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:55.283127 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c60330b-18eb-4c1d-afc3-acc18c92a208 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:55.294538 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-77c38f6e-cb7a-4456-a4c6-1aa12ea0f8dd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for project b9e709c95a964cd5855d4e253aeb1043. Resources: {'server_group_members'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:45:55.304086 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-77c38f6e-cb7a-4456-a4c6-1aa12ea0f8dd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for user 336c26b5dd6644bc83f9b80adac06bce and project b9e709c95a964cd5855d4e253aeb1043. Resources: {'server_group_members'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:45:55.419028 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-77c38f6e-cb7a-4456-a4c6-1aa12ea0f8dd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for project b9e709c95a964cd5855d4e253aeb1043. Resources: {'server_group_members'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:45:55.437355 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-77c38f6e-cb7a-4456-a4c6-1aa12ea0f8dd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for user 336c26b5dd6644bc83f9b80adac06bce and project b9e709c95a964cd5855d4e253aeb1043. Resources: {'server_group_members'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:45:55.537535 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-77c38f6e-cb7a-4456-a4c6-1aa12ea0f8dd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.919865 Aug 04 16:45:55.538264 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1126/2242] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:45:53 2022] POST /compute/v2.1/servers => generated 32 bytes in 1923 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 04 16:45:55.553748 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-92d01494-8abe-4d61-8ef2-9f503265715e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:55.574719 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-92d01494-8abe-4d61-8ef2-9f503265715e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:55.596105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-92d01494-8abe-4d61-8ef2-9f503265715e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:55.597046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-92d01494-8abe-4d61-8ef2-9f503265715e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:55.600921 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-92d01494-8abe-4d61-8ef2-9f503265715e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:55.603260 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-92d01494-8abe-4d61-8ef2-9f503265715e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:56.206497 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6c60330b-18eb-4c1d-afc3-acc18c92a208 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:56.226720 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6c60330b-18eb-4c1d-afc3-acc18c92a208 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805" status: 200 len: 1498 microversion: 2.1 time: 0.962607 Aug 04 16:45:56.231456 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1117/2243] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:55 2022] GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805 => generated 1498 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:56.240043 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cf3dad94-679b-41d5-b118-f95b734fbc8f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:56.244255 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cf3dad94-679b-41d5-b118-f95b734fbc8f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: befbf568-78f2-4571-bf63-fdac57291b28] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:56.273004 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:45:56.297558 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf3dad94-679b-41d5-b118-f95b734fbc8f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:56.300075 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf3dad94-679b-41d5-b118-f95b734fbc8f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:56.302048 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf3dad94-679b-41d5-b118-f95b734fbc8f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:56.307179 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf3dad94-679b-41d5-b118-f95b734fbc8f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:56.495948 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-92d01494-8abe-4d61-8ef2-9f503265715e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:56.515206 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-92d01494-8abe-4d61-8ef2-9f503265715e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.973272 Aug 04 16:45:56.518924 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1127/2244] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:55 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:56.546144 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-565e4543-46a3-4bef-a271-a3e5e23afd40 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:56.548300 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-565e4543-46a3-4bef-a271-a3e5e23afd40 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 03f171b8-c8d3-46c8-9429-4d90317c2b19] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:56.584016 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-565e4543-46a3-4bef-a271-a3e5e23afd40 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:56.587556 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-565e4543-46a3-4bef-a271-a3e5e23afd40 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:56.588787 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-565e4543-46a3-4bef-a271-a3e5e23afd40 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:56.589518 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-565e4543-46a3-4bef-a271-a3e5e23afd40 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:56.652812 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-565e4543-46a3-4bef-a271-a3e5e23afd40 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] HTTP exception thrown: Instance 03f171b8-c8d3-46c8-9429-4d90317c2b19 could not be found. Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-565e4543-46a3-4bef-a271-a3e5e23afd40 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Request method failure captured: Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19 HTTP/1.1 Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_ddGi-LUxEkOI7UNq-ijU5XnirMgjjOPky_n4iIeohsp_mBZi36CDxRY5dUKGmgKLroDx6IsvA3hey_uA7LPQbZI4NWhaCZQIOIkAKlIttRUGlU4y_AMkv45dQEQsQ8xd9VhN5XbmaVn_f0gvdFbALtWn0QI5OJtAeQ50IP8tuO8i0 Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/60281cf1dbe645d8949e93f9e70b5d91"}]}] Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 3cfb4739b53b411391a26de37b98469f Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 03f171b8-c8d3-46c8-9429-4d90317c2b19 could not be found. Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '03f171b8-c8d3-46c8-9429-4d90317c2b19'} Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03f171b8-c8d3-46c8-9429-4d90317c2b19 could not be found. Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03f171b8-c8d3-46c8-9429-4d90317c2b19 could not be found. Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:45:56.660572 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:45:56.665486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:45:56.665486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:45:56.665486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:45:56.665486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:45:56.665486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:45:56.665486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03f171b8-c8d3-46c8-9429-4d90317c2b19 could not be found. Aug 04 16:45:56.665486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:45:56.667773 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-565e4543-46a3-4bef-a271-a3e5e23afd40 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Returning 404 to user: Instance 03f171b8-c8d3-46c8-9429-4d90317c2b19 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:45:56.668909 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-565e4543-46a3-4bef-a271-a3e5e23afd40 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19" status: 404 len: 111 microversion: 2.1 time: 0.139012 Aug 04 16:45:56.670130 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1128/2245] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:56 2022] GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:45:56.688864 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2c71dd9f-23d7-4466-abcf-807563b881c1 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:56.705652 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2c71dd9f-23d7-4466-abcf-807563b881c1 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '450c14de401149bc8a24efb11e24b631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a69315bfb4723b95c9b79e0741b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:56.706947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2c71dd9f-23d7-4466-abcf-807563b881c1 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Searching by: {'deleted': False, 'project_id': 'ba7a69315bfb4723b95c9b79e0741b0e'} {{(pid=126125) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:45:56.775412 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2c71dd9f-23d7-4466-abcf-807563b881c1 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:56.777852 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2c71dd9f-23d7-4466-abcf-807563b881c1 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:56.779770 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2c71dd9f-23d7-4466-abcf-807563b881c1 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:56.781153 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2c71dd9f-23d7-4466-abcf-807563b881c1 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:56.876931 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.multi_cell_list [None req-2c71dd9f-23d7-4466-abcf-807563b881c1 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=126125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:45:56.990288 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cf3dad94-679b-41d5-b118-f95b734fbc8f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97a079594a2400bb4db33f3ce3a1497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4cdb4245df44119c504915dc542d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:57.007945 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cf3dad94-679b-41d5-b118-f95b734fbc8f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28" status: 200 len: 1367 microversion: 2.1 time: 0.774786 Aug 04 16:45:57.014002 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1118/2246] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:56 2022] GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28 => generated 1367 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:57.024938 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4ad8aa58-b720-48fe-8ed2-7b9aa33074c8 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:57.025673 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2c71dd9f-23d7-4466-abcf-807563b881c1 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.354178 Aug 04 16:45:57.032475 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1129/2247] 10.222.0.23 () {58 vars in 1125 bytes} [Thu Aug 4 16:45:56 2022] GET /compute/v2.1/servers => generated 677 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:45:57.041579 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-649d319e-5851-4928-a784-24fa1c4549b8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:57.042236 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-649d319e-5851-4928-a784-24fa1c4549b8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:57.053591 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4ad8aa58-b720-48fe-8ed2-7b9aa33074c8 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:57.055243 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4ad8aa58-b720-48fe-8ed2-7b9aa33074c8 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Searching by: {'deleted': False, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043'} {{(pid=126126) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:45:57.064408 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-649d319e-5851-4928-a784-24fa1c4549b8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:57.073216 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-649d319e-5851-4928-a784-24fa1c4549b8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:57.074451 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-649d319e-5851-4928-a784-24fa1c4549b8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:57.076020 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-649d319e-5851-4928-a784-24fa1c4549b8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:57.168514 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4ad8aa58-b720-48fe-8ed2-7b9aa33074c8 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:57.171040 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4ad8aa58-b720-48fe-8ed2-7b9aa33074c8 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:57.172483 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4ad8aa58-b720-48fe-8ed2-7b9aa33074c8 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:57.182162 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4ad8aa58-b720-48fe-8ed2-7b9aa33074c8 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:57.352855 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.multi_cell_list [None req-4ad8aa58-b720-48fe-8ed2-7b9aa33074c8 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Listed batch of 5 results from cell out of 998 limit. Returned 5 total so far. {{(pid=126126) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:45:57.484397 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4ad8aa58-b720-48fe-8ed2-7b9aa33074c8 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1662 microversion: 2.1 time: 0.463111 Aug 04 16:45:57.494981 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1119/2248] 10.222.0.23 () {58 vars in 1125 bytes} [Thu Aug 4 16:45:57 2022] GET /compute/v2.1/servers => generated 1662 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:57.504419 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5a189c3b-2824-4b13-98c3-d3c92ae4fa72 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:57.524059 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5a189c3b-2824-4b13-98c3-d3c92ae4fa72 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 03f171b8-c8d3-46c8-9429-4d90317c2b19] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:57.561464 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a189c3b-2824-4b13-98c3-d3c92ae4fa72 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:57.563314 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a189c3b-2824-4b13-98c3-d3c92ae4fa72 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:57.564951 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a189c3b-2824-4b13-98c3-d3c92ae4fa72 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:57.566590 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a189c3b-2824-4b13-98c3-d3c92ae4fa72 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:57.626462 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-5a189c3b-2824-4b13-98c3-d3c92ae4fa72 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] HTTP exception thrown: Instance 03f171b8-c8d3-46c8-9429-4d90317c2b19 could not be found. Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5a189c3b-2824-4b13-98c3-d3c92ae4fa72 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Request method failure captured: Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19/os-volume_attachments HTTP/1.1 Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_ddGi-LUxEkOI7UNq-ijU5XnirMgjjOPky_n4iIeohsp_mBZi36CDxRY5dUKGmgKLroDx6IsvA3hey_uA7LPQbZI4NWhaCZQIOIkAKlIttRUGlU4y_AMkv45dQEQsQ8xd9VhN5XbmaVn_f0gvdFbALtWn0QI5OJtAeQ50IP8tuO8i0 Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/60281cf1dbe645d8949e93f9e70b5d91"}]}] Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 3cfb4739b53b411391a26de37b98469f Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 03f171b8-c8d3-46c8-9429-4d90317c2b19 could not be found. Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'server_id': '03f171b8-c8d3-46c8-9429-4d90317c2b19'} Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03f171b8-c8d3-46c8-9429-4d90317c2b19 could not be found. Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:45:57.633974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:45:57.638887 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03f171b8-c8d3-46c8-9429-4d90317c2b19 could not be found. Aug 04 16:45:57.638887 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:45:57.638887 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:45:57.638887 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:45:57.638887 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:45:57.638887 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:45:57.638887 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:45:57.638887 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:45:57.638887 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:45:57.638887 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03f171b8-c8d3-46c8-9429-4d90317c2b19 could not be found. Aug 04 16:45:57.638887 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:45:57.642179 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5a189c3b-2824-4b13-98c3-d3c92ae4fa72 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Returning 404 to user: Instance 03f171b8-c8d3-46c8-9429-4d90317c2b19 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:45:57.647808 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5a189c3b-2824-4b13-98c3-d3c92ae4fa72 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.148383 Aug 04 16:45:57.652283 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1120/2249] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 16:45:57 2022] GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19/os-volume_attachments => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:45:57.672790 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a0d03819-c157-49f7-b17e-0e46d5f10dfc tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:57.674714 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a0d03819-c157-49f7-b17e-0e46d5f10dfc tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: 9379d600-7def-463c-9655-b6d3a3833762] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:57.710650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a0d03819-c157-49f7-b17e-0e46d5f10dfc tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:57.727315 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a0d03819-c157-49f7-b17e-0e46d5f10dfc tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:57.735950 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a0d03819-c157-49f7-b17e-0e46d5f10dfc tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:57.737533 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a0d03819-c157-49f7-b17e-0e46d5f10dfc tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:57.746314 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-649d319e-5851-4928-a784-24fa1c4549b8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:57.760523 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-649d319e-5851-4928-a784-24fa1c4549b8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.732674 Aug 04 16:45:57.761161 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1130/2250] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:57 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:57.788120 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d9af10c2-3846-4a46-91a5-aace712a4c3f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:57.789978 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d9af10c2-3846-4a46-91a5-aace712a4c3f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 45b975d2-057f-4aae-9e4b-95b8ed28c805] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:57.810674 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d9af10c2-3846-4a46-91a5-aace712a4c3f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:57.818418 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d9af10c2-3846-4a46-91a5-aace712a4c3f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:57.822731 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d9af10c2-3846-4a46-91a5-aace712a4c3f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:57.823424 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d9af10c2-3846-4a46-91a5-aace712a4c3f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:58.393667 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a0d03819-c157-49f7-b17e-0e46d5f10dfc tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450c14de401149bc8a24efb11e24b631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a69315bfb4723b95c9b79e0741b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:58.418728 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a0d03819-c157-49f7-b17e-0e46d5f10dfc tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "GET /compute/v2.1/servers/9379d600-7def-463c-9655-b6d3a3833762" status: 200 len: 1216 microversion: 2.1 time: 0.762285 Aug 04 16:45:58.434420 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1121/2251] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:57 2022] GET /compute/v2.1/servers/9379d600-7def-463c-9655-b6d3a3833762 => generated 1216 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:58.460192 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a4d22361-1221-49bc-a9fd-c38a7f75a80b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:58.467876 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a4d22361-1221-49bc-a9fd-c38a7f75a80b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:58.472157 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d9af10c2-3846-4a46-91a5-aace712a4c3f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:58.483399 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a4d22361-1221-49bc-a9fd-c38a7f75a80b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:58.483838 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a4d22361-1221-49bc-a9fd-c38a7f75a80b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:58.486990 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a4d22361-1221-49bc-a9fd-c38a7f75a80b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:58.487789 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a4d22361-1221-49bc-a9fd-c38a7f75a80b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:58.493577 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d9af10c2-3846-4a46-91a5-aace712a4c3f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805" status: 200 len: 1475 microversion: 2.1 time: 0.727797 Aug 04 16:45:58.500548 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1131/2252] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:57 2022] GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805 => generated 1475 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:58.735572 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a4d22361-1221-49bc-a9fd-c38a7f75a80b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:58.752770 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a4d22361-1221-49bc-a9fd-c38a7f75a80b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be" status: 200 len: 1270 microversion: 2.1 time: 0.314108 Aug 04 16:45:58.755051 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1122/2253] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:58 2022] GET /compute/v2.1/servers/f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be => generated 1270 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:58.766963 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d8d628b1-fe33-43ce-a78d-33d5ebaf3c19 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:58.770993 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d8d628b1-fe33-43ce-a78d-33d5ebaf3c19 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:58.781881 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d8d628b1-fe33-43ce-a78d-33d5ebaf3c19 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:58.786032 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d8d628b1-fe33-43ce-a78d-33d5ebaf3c19 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:58.787225 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d8d628b1-fe33-43ce-a78d-33d5ebaf3c19 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:58.787874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d8d628b1-fe33-43ce-a78d-33d5ebaf3c19 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:59.103256 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-29e617da-d36b-4450-b2c7-06c4913ee1af tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:59.103804 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-29e617da-d36b-4450-b2c7-06c4913ee1af tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:59.116958 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-29e617da-d36b-4450-b2c7-06c4913ee1af tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:59.117454 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-29e617da-d36b-4450-b2c7-06c4913ee1af tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:59.118449 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-29e617da-d36b-4450-b2c7-06c4913ee1af tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:59.118893 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-29e617da-d36b-4450-b2c7-06c4913ee1af tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:59.184827 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-29e617da-d36b-4450-b2c7-06c4913ee1af tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:45:59.282380 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=100 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:45:59.389273 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d8d628b1-fe33-43ce-a78d-33d5ebaf3c19 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:45:59.403320 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d8d628b1-fe33-43ce-a78d-33d5ebaf3c19 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.645692 Aug 04 16:45:59.409610 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1123/2254] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:58 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:59.446648 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ffed9c7c-1474-4947-84da-1ea4c0ed5d5a tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:59.447734 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ffed9c7c-1474-4947-84da-1ea4c0ed5d5a tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: befbf568-78f2-4571-bf63-fdac57291b28] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:45:59.472004 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ffed9c7c-1474-4947-84da-1ea4c0ed5d5a tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:59.474005 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ffed9c7c-1474-4947-84da-1ea4c0ed5d5a tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:59.475498 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ffed9c7c-1474-4947-84da-1ea4c0ed5d5a tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:45:59.477082 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-29e617da-d36b-4450-b2c7-06c4913ee1af tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "DELETE /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 204 len: 0 microversion: 2.32 time: 0.972284 Aug 04 16:45:59.477738 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ffed9c7c-1474-4947-84da-1ea4c0ed5d5a tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:45:59.480448 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1132/2255] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Aug 4 16:45:58 2022] DELETE /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 0 bytes in 979 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 16:45:59.500591 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-eb7795d1-b163-439d-a0df-20be94e7513e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1226698145", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "fd9ba46f-9583-4f53-9ced-a3b1af7aa6df"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:59.613587 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-eb7795d1-b163-439d-a0df-20be94e7513e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] validate_networks() for [('fd9ba46f-9583-4f53-9ced-a3b1af7aa6df', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:46:00.473173 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ffed9c7c-1474-4947-84da-1ea4c0ed5d5a tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97a079594a2400bb4db33f3ce3a1497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4cdb4245df44119c504915dc542d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:00.483126 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ffed9c7c-1474-4947-84da-1ea4c0ed5d5a tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28" status: 200 len: 1367 microversion: 2.1 time: 1.072073 Aug 04 16:46:00.483729 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1124/2256] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:45:59 2022] GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28 => generated 1367 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:00.503267 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-54f91a44-7fe5-45fe-b432-9682fb3f8dd7 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2006376711"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:00.506287 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-54f91a44-7fe5-45fe-b432-9682fb3f8dd7 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 45b975d2-057f-4aae-9e4b-95b8ed28c805] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:00.513893 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-54f91a44-7fe5-45fe-b432-9682fb3f8dd7 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:00.515022 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-54f91a44-7fe5-45fe-b432-9682fb3f8dd7 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:00.516283 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-54f91a44-7fe5-45fe-b432-9682fb3f8dd7 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:00.517129 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-54f91a44-7fe5-45fe-b432-9682fb3f8dd7 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:00.858009 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-54f91a44-7fe5-45fe-b432-9682fb3f8dd7 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "POST /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805/action" status: 202 len: 0 microversion: 2.1 time: 0.359076 Aug 04 16:46:00.876841 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1125/2257] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:46:00 2022] POST /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 16:46:00.921024 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3a2a2b1b-157d-4dd1-821b-d96c0f3ec866 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:00.922277 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3a2a2b1b-157d-4dd1-821b-d96c0f3ec866 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: 9379d600-7def-463c-9655-b6d3a3833762] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:00.939594 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a2a2b1b-157d-4dd1-821b-d96c0f3ec866 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:00.940054 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a2a2b1b-157d-4dd1-821b-d96c0f3ec866 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:00.957009 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a2a2b1b-157d-4dd1-821b-d96c0f3ec866 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:00.961131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a2a2b1b-157d-4dd1-821b-d96c0f3ec866 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:01.146796 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3a2a2b1b-157d-4dd1-821b-d96c0f3ec866 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450c14de401149bc8a24efb11e24b631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a69315bfb4723b95c9b79e0741b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:01.150081 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:46:01.161995 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3a2a2b1b-157d-4dd1-821b-d96c0f3ec866 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "GET /compute/v2.1/servers/9379d600-7def-463c-9655-b6d3a3833762" status: 200 len: 1290 microversion: 2.1 time: 0.279299 Aug 04 16:46:01.162661 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1126/2258] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:00 2022] GET /compute/v2.1/servers/9379d600-7def-463c-9655-b6d3a3833762 => generated 1290 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:01.181926 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-637201a7-ecdd-46a6-90c8-d90e88557055 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:01.182546 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-637201a7-ecdd-46a6-90c8-d90e88557055 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:01.192062 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-637201a7-ecdd-46a6-90c8-d90e88557055 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:01.192519 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-637201a7-ecdd-46a6-90c8-d90e88557055 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:01.197955 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-637201a7-ecdd-46a6-90c8-d90e88557055 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:01.198839 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-637201a7-ecdd-46a6-90c8-d90e88557055 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:01.815108 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-eb7795d1-b163-439d-a0df-20be94e7513e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:46:01.817348 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-eb7795d1-b163-439d-a0df-20be94e7513e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:46:01.818868 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-eb7795d1-b163-439d-a0df-20be94e7513e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:46:01.820776 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-eb7795d1-b163-439d-a0df-20be94e7513e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:46:01.821906 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-eb7795d1-b163-439d-a0df-20be94e7513e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:46:01.888726 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eb7795d1-b163-439d-a0df-20be94e7513e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:01.890221 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eb7795d1-b163-439d-a0df-20be94e7513e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:01.902135 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eb7795d1-b163-439d-a0df-20be94e7513e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:01.904105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eb7795d1-b163-439d-a0df-20be94e7513e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:02.004736 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-637201a7-ecdd-46a6-90c8-d90e88557055 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:02.021418 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-eb7795d1-b163-439d-a0df-20be94e7513e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Getting quotas for project 60281cf1dbe645d8949e93f9e70b5d91. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:46:02.021756 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-637201a7-ecdd-46a6-90c8-d90e88557055 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:02.023401 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-637201a7-ecdd-46a6-90c8-d90e88557055 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:02.028359 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-637201a7-ecdd-46a6-90c8-d90e88557055 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 2951 microversion: 2.32 time: 0.864601 Aug 04 16:46:02.029782 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1127/2259] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:46:01 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 2951 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:46:02.036925 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3a29fbc0-9dd1-42bd-8475-4e7975f190fb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-32145963", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "fcd939fe-a897-44ae-b0c2-2548006a8cea"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:02.047844 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-eb7795d1-b163-439d-a0df-20be94e7513e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Getting quotas for user 3cfb4739b53b411391a26de37b98469f and project 60281cf1dbe645d8949e93f9e70b5d91. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:46:02.099576 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-eb7795d1-b163-439d-a0df-20be94e7513e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:46:02.109188 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-eb7795d1-b163-439d-a0df-20be94e7513e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: d6141949-1d15-4c84-8638-426cf7244dbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:46:02.235225 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-eb7795d1-b163-439d-a0df-20be94e7513e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.751357 Aug 04 16:46:02.241782 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1133/2260] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:45:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:46:02.268366 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ffc2b013-a11d-42aa-9842-65120aaea78a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:02.269227 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ffc2b013-a11d-42aa-9842-65120aaea78a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:02.288918 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ffc2b013-a11d-42aa-9842-65120aaea78a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:02.289712 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ffc2b013-a11d-42aa-9842-65120aaea78a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:02.290881 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ffc2b013-a11d-42aa-9842-65120aaea78a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:02.295514 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ffc2b013-a11d-42aa-9842-65120aaea78a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:02.462213 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-3a29fbc0-9dd1-42bd-8475-4e7975f190fb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] validate_networks() for [('fcd939fe-a897-44ae-b0c2-2548006a8cea', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:46:02.614710 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ffc2b013-a11d-42aa-9842-65120aaea78a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:02.635649 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ffc2b013-a11d-42aa-9842-65120aaea78a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be" status: 200 len: 1276 microversion: 2.1 time: 0.383603 Aug 04 16:46:02.637650 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1134/2261] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:02 2022] GET /compute/v2.1/servers/f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be => generated 1276 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:02.666907 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-d6e17b9c-1815-48c0-b1a9-6703c538d9d7 req-57a41a8a-c9c8-4db4-ada8-0c24fd7245e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "befbf568-78f2-4571-bf63-fdac57291b28", "name": "network-vif-plugged", "status": "completed", "tag": "4d207d96-918f-45a6-92bf-48edb7564806"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:02.691031 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-d6e17b9c-1815-48c0-b1a9-6703c538d9d7 req-57a41a8a-c9c8-4db4-ada8-0c24fd7245e5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:02.691482 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-d6e17b9c-1815-48c0-b1a9-6703c538d9d7 req-57a41a8a-c9c8-4db4-ada8-0c24fd7245e5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:02.727100 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-d6e17b9c-1815-48c0-b1a9-6703c538d9d7 req-57a41a8a-c9c8-4db4-ada8-0c24fd7245e5 service nova] Creating event network-vif-plugged:4d207d96-918f-45a6-92bf-48edb7564806 for instance befbf568-78f2-4571-bf63-fdac57291b28 on n-h1-846466-12 Aug 04 16:46:02.733461 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-d6e17b9c-1815-48c0-b1a9-6703c538d9d7 req-57a41a8a-c9c8-4db4-ada8-0c24fd7245e5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094183 Aug 04 16:46:02.742904 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1135/2262] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:46:02.749216 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-62c7a160-31e1-4f21-9aba-bd0390613f95 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e846f5b80>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:02.837479 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-62c7a160-31e1-4f21-9aba-bd0390613f95 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/b7c42f97-f9b7-487b-8dd3-3ee62452aa70" status: 200 len: 1410 microversion: 2.1 time: 0.092857 Aug 04 16:46:02.847836 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1136/2263] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:46:02 2022] GET /compute/v2.1/images/b7c42f97-f9b7-487b-8dd3-3ee62452aa70 => generated 1410 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:02.856155 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-69600fed-a43b-4be4-be09-e08dc27fcfcc tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:02.857395 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-69600fed-a43b-4be4-be09-e08dc27fcfcc tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: befbf568-78f2-4571-bf63-fdac57291b28] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:02.866821 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-69600fed-a43b-4be4-be09-e08dc27fcfcc tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:02.867621 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-69600fed-a43b-4be4-be09-e08dc27fcfcc tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:02.868892 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-69600fed-a43b-4be4-be09-e08dc27fcfcc tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:02.869848 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-69600fed-a43b-4be4-be09-e08dc27fcfcc tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:04.458659 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-69600fed-a43b-4be4-be09-e08dc27fcfcc tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97a079594a2400bb4db33f3ce3a1497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4cdb4245df44119c504915dc542d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:04.480207 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-69600fed-a43b-4be4-be09-e08dc27fcfcc tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28" status: 200 len: 1367 microversion: 2.1 time: 1.630767 Aug 04 16:46:04.505052 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1137/2264] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:02 2022] GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28 => generated 1367 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:04.512936 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-21816703-cc67-42d9-a4f9-0e3c5675042a tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:04.515778 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-21816703-cc67-42d9-a4f9-0e3c5675042a tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: 9379d600-7def-463c-9655-b6d3a3833762] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:04.535246 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-21816703-cc67-42d9-a4f9-0e3c5675042a tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:04.535806 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-21816703-cc67-42d9-a4f9-0e3c5675042a tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:04.537024 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-21816703-cc67-42d9-a4f9-0e3c5675042a tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:04.543015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-21816703-cc67-42d9-a4f9-0e3c5675042a tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:04.933919 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-21816703-cc67-42d9-a4f9-0e3c5675042a tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450c14de401149bc8a24efb11e24b631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a69315bfb4723b95c9b79e0741b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:04.965811 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-21816703-cc67-42d9-a4f9-0e3c5675042a tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "GET /compute/v2.1/servers/9379d600-7def-463c-9655-b6d3a3833762" status: 200 len: 1278 microversion: 2.1 time: 0.456038 Aug 04 16:46:04.967206 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1138/2265] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:04 2022] GET /compute/v2.1/servers/9379d600-7def-463c-9655-b6d3a3833762 => generated 1278 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:04.990099 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-036749e2-a6b1-49db-8f20-49d1f37ac4ae tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:04.997433 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-036749e2-a6b1-49db-8f20-49d1f37ac4ae tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: d6141949-1d15-4c84-8638-426cf7244dbd] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:05.026033 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-036749e2-a6b1-49db-8f20-49d1f37ac4ae tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:05.029112 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-036749e2-a6b1-49db-8f20-49d1f37ac4ae tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:05.034020 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-036749e2-a6b1-49db-8f20-49d1f37ac4ae tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:05.036860 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-036749e2-a6b1-49db-8f20-49d1f37ac4ae tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:05.056210 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=14 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:46:05.639596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-036749e2-a6b1-49db-8f20-49d1f37ac4ae tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:05.650238 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-036749e2-a6b1-49db-8f20-49d1f37ac4ae tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd" status: 200 len: 1275 microversion: 2.1 time: 0.678431 Aug 04 16:46:05.653438 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1139/2266] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:04 2022] GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd => generated 1275 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:05.666196 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7bd5acdd-67f7-4028-b5f0-2e8da40f322f tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:05.667479 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7bd5acdd-67f7-4028-b5f0-2e8da40f322f tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:05.690812 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7bd5acdd-67f7-4028-b5f0-2e8da40f322f tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:05.693996 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7bd5acdd-67f7-4028-b5f0-2e8da40f322f tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:05.696900 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7bd5acdd-67f7-4028-b5f0-2e8da40f322f tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:05.697879 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7bd5acdd-67f7-4028-b5f0-2e8da40f322f tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:05.939333 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-3a29fbc0-9dd1-42bd-8475-4e7975f190fb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:46:05.940039 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-3a29fbc0-9dd1-42bd-8475-4e7975f190fb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:46:05.940860 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-3a29fbc0-9dd1-42bd-8475-4e7975f190fb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:46:05.941538 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-3a29fbc0-9dd1-42bd-8475-4e7975f190fb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:46:05.942822 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-3a29fbc0-9dd1-42bd-8475-4e7975f190fb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:46:05.977188 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a29fbc0-9dd1-42bd-8475-4e7975f190fb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:05.979605 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a29fbc0-9dd1-42bd-8475-4e7975f190fb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:05.987487 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a29fbc0-9dd1-42bd-8475-4e7975f190fb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:05.988148 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a29fbc0-9dd1-42bd-8475-4e7975f190fb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:06.081995 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-3a29fbc0-9dd1-42bd-8475-4e7975f190fb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Getting quotas for project 96ce955c9158463e9e98c53b99c581ec. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:46:06.103889 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-3a29fbc0-9dd1-42bd-8475-4e7975f190fb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Getting quotas for user 438d083dc9e74b2f8970455505791250 and project 96ce955c9158463e9e98c53b99c581ec. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:46:06.145351 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3a29fbc0-9dd1-42bd-8475-4e7975f190fb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:46:06.148113 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3a29fbc0-9dd1-42bd-8475-4e7975f190fb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:46:06.258348 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3a29fbc0-9dd1-42bd-8475-4e7975f190fb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.225701 Aug 04 16:46:06.259018 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1128/2267] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:46:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 4227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:46:06.301473 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-847b37c2-15a9-4578-8ec7-5dfd6e4b16bf tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:06.314683 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-847b37c2-15a9-4578-8ec7-5dfd6e4b16bf tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:06.350856 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-847b37c2-15a9-4578-8ec7-5dfd6e4b16bf tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:06.351657 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-847b37c2-15a9-4578-8ec7-5dfd6e4b16bf tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:06.370171 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-847b37c2-15a9-4578-8ec7-5dfd6e4b16bf tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:06.370980 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-847b37c2-15a9-4578-8ec7-5dfd6e4b16bf tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:08.107608 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7bd5acdd-67f7-4028-b5f0-2e8da40f322f tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:08.128534 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7bd5acdd-67f7-4028-b5f0-2e8da40f322f tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:08.133953 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7bd5acdd-67f7-4028-b5f0-2e8da40f322f tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:08.137161 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7bd5acdd-67f7-4028-b5f0-2e8da40f322f tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 2930 microversion: 2.32 time: 2.476785 Aug 04 16:46:08.138313 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1140/2268] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:46:05 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 2930 bytes in 2480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:46:08.148058 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-296d5b56-4137-4244-856b-64d214e98c5c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e77c4af70>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:08.305086 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-296d5b56-4137-4244-856b-64d214e98c5c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/b7c42f97-f9b7-487b-8dd3-3ee62452aa70" status: 200 len: 1410 microversion: 2.1 time: 0.160365 Aug 04 16:46:08.308121 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1141/2269] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:46:08 2022] GET /compute/v2.1/images/b7c42f97-f9b7-487b-8dd3-3ee62452aa70 => generated 1410 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:08.319657 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5e5a6028-6177-4ea0-8bd3-2bb30a8ef159 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:08.320731 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5e5a6028-6177-4ea0-8bd3-2bb30a8ef159 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: befbf568-78f2-4571-bf63-fdac57291b28] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:08.331481 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5e5a6028-6177-4ea0-8bd3-2bb30a8ef159 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:08.336354 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5e5a6028-6177-4ea0-8bd3-2bb30a8ef159 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:08.338393 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5e5a6028-6177-4ea0-8bd3-2bb30a8ef159 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:08.339086 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5e5a6028-6177-4ea0-8bd3-2bb30a8ef159 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:08.851705 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-847b37c2-15a9-4578-8ec7-5dfd6e4b16bf tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:08.864842 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-847b37c2-15a9-4578-8ec7-5dfd6e4b16bf tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be" status: 200 len: 1318 microversion: 2.1 time: 2.584448 Aug 04 16:46:08.867652 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1129/2270] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:06 2022] GET /compute/v2.1/servers/f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be => generated 1318 bytes in 2588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:08.884835 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-544c279c-12d7-4962-a3e8-dfd22131f498 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:08.885776 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-544c279c-12d7-4962-a3e8-dfd22131f498 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: d6141949-1d15-4c84-8638-426cf7244dbd] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:08.900712 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-544c279c-12d7-4962-a3e8-dfd22131f498 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:08.902851 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-544c279c-12d7-4962-a3e8-dfd22131f498 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:08.909024 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-544c279c-12d7-4962-a3e8-dfd22131f498 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:08.909877 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-544c279c-12d7-4962-a3e8-dfd22131f498 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:08.977492 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-544c279c-12d7-4962-a3e8-dfd22131f498 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: d6141949-1d15-4c84-8638-426cf7244dbd] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:46:09.166430 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-544c279c-12d7-4962-a3e8-dfd22131f498 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd" status: 204 len: 0 microversion: 2.1 time: 0.297146 Aug 04 16:46:09.170317 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1130/2271] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:46:08 2022] DELETE /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:46:09.189591 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a0c7016b-fe08-49f9-967b-c565e4197513 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:09.196515 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a0c7016b-fe08-49f9-967b-c565e4197513 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: 9379d600-7def-463c-9655-b6d3a3833762] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:09.210868 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a0c7016b-fe08-49f9-967b-c565e4197513 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:09.212427 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a0c7016b-fe08-49f9-967b-c565e4197513 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:09.215038 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a0c7016b-fe08-49f9-967b-c565e4197513 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:09.220738 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a0c7016b-fe08-49f9-967b-c565e4197513 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:10.329766 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a0c7016b-fe08-49f9-967b-c565e4197513 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450c14de401149bc8a24efb11e24b631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a69315bfb4723b95c9b79e0741b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:10.353448 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a0c7016b-fe08-49f9-967b-c565e4197513 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "GET /compute/v2.1/servers/9379d600-7def-463c-9655-b6d3a3833762" status: 200 len: 1320 microversion: 2.1 time: 1.179658 Aug 04 16:46:10.355314 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1131/2272] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:09 2022] GET /compute/v2.1/servers/9379d600-7def-463c-9655-b6d3a3833762 => generated 1320 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:10.366858 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-261d983c-55b6-4c3d-b3c7-7c3417da3d00 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:10.370673 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-261d983c-55b6-4c3d-b3c7-7c3417da3d00 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:10.387381 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-261d983c-55b6-4c3d-b3c7-7c3417da3d00 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:10.388638 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-261d983c-55b6-4c3d-b3c7-7c3417da3d00 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:10.392922 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-261d983c-55b6-4c3d-b3c7-7c3417da3d00 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:10.395994 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-261d983c-55b6-4c3d-b3c7-7c3417da3d00 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:10.645047 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-261d983c-55b6-4c3d-b3c7-7c3417da3d00 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:10.657913 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-261d983c-55b6-4c3d-b3c7-7c3417da3d00 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433" status: 200 len: 1271 microversion: 2.1 time: 0.299651 Aug 04 16:46:10.658503 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1132/2273] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:10 2022] GET /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433 => generated 1271 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:10.672365 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-cf86f747-fc33-4c4c-9a6e-b740c25062dd req-f652c3bd-295d-4ca5-a43a-f42e5a58f302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09e1b482-0372-4270-ac25-6d3349aca31e", "name": "network-vif-unplugged", "status": "completed", "tag": "a55a1fc3-452c-4f78-8499-e76e8bdb7750"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:10.703075 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-cf86f747-fc33-4c4c-9a6e-b740c25062dd req-f652c3bd-295d-4ca5-a43a-f42e5a58f302 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:10.705131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-cf86f747-fc33-4c4c-9a6e-b740c25062dd req-f652c3bd-295d-4ca5-a43a-f42e5a58f302 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:10.748758 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-cf86f747-fc33-4c4c-9a6e-b740c25062dd req-f652c3bd-295d-4ca5-a43a-f42e5a58f302 service nova] Creating event network-vif-unplugged:a55a1fc3-452c-4f78-8499-e76e8bdb7750 for instance 09e1b482-0372-4270-ac25-6d3349aca31e on n-h2-846466-12 Aug 04 16:46:10.755594 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-cf86f747-fc33-4c4c-9a6e-b740c25062dd req-f652c3bd-295d-4ca5-a43a-f42e5a58f302 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090579 Aug 04 16:46:10.761936 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1133/2274] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:46:10.770722 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f3e56164-3b42-499e-acf2-3f19ebf37c83 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:10.771859 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f3e56164-3b42-499e-acf2-3f19ebf37c83 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: d6141949-1d15-4c84-8638-426cf7244dbd] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:10.780605 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f3e56164-3b42-499e-acf2-3f19ebf37c83 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:10.781574 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f3e56164-3b42-499e-acf2-3f19ebf37c83 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:10.782674 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f3e56164-3b42-499e-acf2-3f19ebf37c83 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:10.788877 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f3e56164-3b42-499e-acf2-3f19ebf37c83 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:11.298209 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5e5a6028-6177-4ea0-8bd3-2bb30a8ef159 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97a079594a2400bb4db33f3ce3a1497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4cdb4245df44119c504915dc542d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:11.312739 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5e5a6028-6177-4ea0-8bd3-2bb30a8ef159 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28" status: 200 len: 1558 microversion: 2.1 time: 3.001314 Aug 04 16:46:11.314602 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1142/2275] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:08 2022] GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28 => generated 1558 bytes in 3004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:11.327586 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ef1b9b38-aa73-43e8-8516-a0c061670f35 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:11.328451 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ef1b9b38-aa73-43e8-8516-a0c061670f35 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:11.367348 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef1b9b38-aa73-43e8-8516-a0c061670f35 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:11.367807 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef1b9b38-aa73-43e8-8516-a0c061670f35 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:11.372314 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef1b9b38-aa73-43e8-8516-a0c061670f35 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:11.373105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef1b9b38-aa73-43e8-8516-a0c061670f35 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:11.970346 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=8 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:46:12.090992 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=42 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:46:12.711845 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f3e56164-3b42-499e-acf2-3f19ebf37c83 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:12.725361 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f3e56164-3b42-499e-acf2-3f19ebf37c83 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd" status: 200 len: 1315 microversion: 2.1 time: 1.956395 Aug 04 16:46:12.726532 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1134/2276] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:10 2022] GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd => generated 1315 bytes in 1964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:12.739916 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f36b785d-de87-44fe-9a6f-a7b35b29fea2 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e8484cee0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:12.856489 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f36b785d-de87-44fe-9a6f-a7b35b29fea2 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/b7c42f97-f9b7-487b-8dd3-3ee62452aa70" status: 200 len: 1410 microversion: 2.1 time: 0.128764 Aug 04 16:46:12.865666 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1135/2277] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:46:12 2022] GET /compute/v2.1/images/b7c42f97-f9b7-487b-8dd3-3ee62452aa70 => generated 1410 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:12.865666 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a42cd0fe-150e-4a81-8e73-c15eeb4f7b6f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:12.865666 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a42cd0fe-150e-4a81-8e73-c15eeb4f7b6f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:12.875051 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a42cd0fe-150e-4a81-8e73-c15eeb4f7b6f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:12.875811 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a42cd0fe-150e-4a81-8e73-c15eeb4f7b6f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:12.877665 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a42cd0fe-150e-4a81-8e73-c15eeb4f7b6f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:12.878712 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a42cd0fe-150e-4a81-8e73-c15eeb4f7b6f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:13.590634 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ef1b9b38-aa73-43e8-8516-a0c061670f35 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:13.620939 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ef1b9b38-aa73-43e8-8516-a0c061670f35 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:13.624526 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ef1b9b38-aa73-43e8-8516-a0c061670f35 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:13.627951 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ef1b9b38-aa73-43e8-8516-a0c061670f35 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 2863 microversion: 2.32 time: 2.311986 Aug 04 16:46:13.649423 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1143/2278] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:46:11 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 2863 bytes in 2328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:46:13.661209 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-e8d99450-7f25-4271-b395-fdf7e346364c req-7aec9999-06cf-4521-a754-27488bfc810d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9379d600-7def-463c-9655-b6d3a3833762", "tag": "efebf1a7-acf2-4917-a887-fb24fd837a51"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:13.696775 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-e8d99450-7f25-4271-b395-fdf7e346364c req-7aec9999-06cf-4521-a754-27488bfc810d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:13.697942 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-e8d99450-7f25-4271-b395-fdf7e346364c req-7aec9999-06cf-4521-a754-27488bfc810d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:13.718655 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-e8d99450-7f25-4271-b395-fdf7e346364c req-7aec9999-06cf-4521-a754-27488bfc810d service nova] Creating event network-changed:efebf1a7-acf2-4917-a887-fb24fd837a51 for instance 9379d600-7def-463c-9655-b6d3a3833762 on n-h2-846466-12 Aug 04 16:46:13.726580 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-e8d99450-7f25-4271-b395-fdf7e346364c req-7aec9999-06cf-4521-a754-27488bfc810d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074750 Aug 04 16:46:13.728380 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1144/2279] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:46:13.736622 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-e5c2f4f3-fef5-4bba-b65e-e0d8fbd223d4 req-f410c002-42e8-4bc0-a3d4-d1b989c89300 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab3019e6-7cb9-44e9-a08a-e453ba9ded47", "tag": "6935f5b8-35a8-4890-a898-a39dd8e00592"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:13.753541 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:46:13.756384 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-e5c2f4f3-fef5-4bba-b65e-e0d8fbd223d4 req-f410c002-42e8-4bc0-a3d4-d1b989c89300 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:13.757171 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-e5c2f4f3-fef5-4bba-b65e-e0d8fbd223d4 req-f410c002-42e8-4bc0-a3d4-d1b989c89300 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:13.861678 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-e5c2f4f3-fef5-4bba-b65e-e0d8fbd223d4 req-f410c002-42e8-4bc0-a3d4-d1b989c89300 service nova] Creating event network-changed:6935f5b8-35a8-4890-a898-a39dd8e00592 for instance ab3019e6-7cb9-44e9-a08a-e453ba9ded47 on n-h2-846466-12 Aug 04 16:46:13.875809 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-e5c2f4f3-fef5-4bba-b65e-e0d8fbd223d4 req-f410c002-42e8-4bc0-a3d4-d1b989c89300 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145412 Aug 04 16:46:13.886174 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1145/2280] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:46:13.895048 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6666f484-d692-4b71-8798-8b244381be30 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:13.895924 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6666f484-d692-4b71-8798-8b244381be30 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: befbf568-78f2-4571-bf63-fdac57291b28] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:13.910584 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6666f484-d692-4b71-8798-8b244381be30 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:13.911601 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6666f484-d692-4b71-8798-8b244381be30 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:13.913041 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6666f484-d692-4b71-8798-8b244381be30 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:13.913573 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6666f484-d692-4b71-8798-8b244381be30 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:14.116009 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6666f484-d692-4b71-8798-8b244381be30 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.228108 Aug 04 16:46:14.117000 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1146/2281] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Aug 4 16:46:13 2022] GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28/os-interface => generated 285 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:46:14.133185 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-11e80835-0673-4bb8-959c-1889ddd28c1b tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:14.134093 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-11e80835-0673-4bb8-959c-1889ddd28c1b tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: 9379d600-7def-463c-9655-b6d3a3833762] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:14.150850 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-11e80835-0673-4bb8-959c-1889ddd28c1b tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:14.151296 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-11e80835-0673-4bb8-959c-1889ddd28c1b tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:14.152104 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-11e80835-0673-4bb8-959c-1889ddd28c1b tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:14.152535 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-11e80835-0673-4bb8-959c-1889ddd28c1b tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:14.491307 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a42cd0fe-150e-4a81-8e73-c15eeb4f7b6f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:14.501097 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a42cd0fe-150e-4a81-8e73-c15eeb4f7b6f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be" status: 200 len: 1318 microversion: 2.1 time: 1.641912 Aug 04 16:46:14.518094 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1136/2282] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:12 2022] GET /compute/v2.1/servers/f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be => generated 1318 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:14.527765 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-373bf81e-4ee7-42ee-acc4-cb7f70bbb05c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:14.528741 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-373bf81e-4ee7-42ee-acc4-cb7f70bbb05c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:14.536288 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-373bf81e-4ee7-42ee-acc4-cb7f70bbb05c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:14.537076 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-373bf81e-4ee7-42ee-acc4-cb7f70bbb05c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:14.538102 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-373bf81e-4ee7-42ee-acc4-cb7f70bbb05c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:14.538764 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-373bf81e-4ee7-42ee-acc4-cb7f70bbb05c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:15.216743 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-11e80835-0673-4bb8-959c-1889ddd28c1b tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450c14de401149bc8a24efb11e24b631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a69315bfb4723b95c9b79e0741b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:15.237491 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-11e80835-0673-4bb8-959c-1889ddd28c1b tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "GET /compute/v2.1/servers/9379d600-7def-463c-9655-b6d3a3833762" status: 200 len: 1320 microversion: 2.1 time: 1.119030 Aug 04 16:46:15.238654 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1147/2283] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:14 2022] GET /compute/v2.1/servers/9379d600-7def-463c-9655-b6d3a3833762 => generated 1320 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:15.250083 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-568dd2c4-16c8-470a-b498-5368ffed9f11 req-9aac6eae-2d86-4b24-a191-919b4edb2d8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09e1b482-0372-4270-ac25-6d3349aca31e", "name": "network-vif-unplugged", "status": "completed", "tag": "80b3b8c3-3818-4e0b-9096-8ce22a3ec0f3"}, {"server_uuid": "45b975d2-057f-4aae-9e4b-95b8ed28c805", "name": "network-vif-plugged", "status": "completed", "tag": "30523aff-f8cc-4a84-b24c-70715dfaed14"}, {"server_uuid": "09e1b482-0372-4270-ac25-6d3349aca31e", "name": "network-vif-unplugged", "status": "completed", "tag": "c03b3426-9b13-43b4-8130-95a9515f9f8a"}, {"server_uuid": "09e1b482-0372-4270-ac25-6d3349aca31e", "name": "network-vif-unplugged", "status": "completed", "tag": "535d6e32-66f9-49c7-b95a-15ae2962f14b"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:15.317043 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-568dd2c4-16c8-470a-b498-5368ffed9f11 req-9aac6eae-2d86-4b24-a191-919b4edb2d8a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:15.319034 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-568dd2c4-16c8-470a-b498-5368ffed9f11 req-9aac6eae-2d86-4b24-a191-919b4edb2d8a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:15.379453 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-568dd2c4-16c8-470a-b498-5368ffed9f11 req-9aac6eae-2d86-4b24-a191-919b4edb2d8a service nova] Creating event network-vif-unplugged:80b3b8c3-3818-4e0b-9096-8ce22a3ec0f3 for instance 09e1b482-0372-4270-ac25-6d3349aca31e on n-h2-846466-12 Aug 04 16:46:15.379993 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-568dd2c4-16c8-470a-b498-5368ffed9f11 req-9aac6eae-2d86-4b24-a191-919b4edb2d8a service nova] Creating event network-vif-plugged:30523aff-f8cc-4a84-b24c-70715dfaed14 for instance 45b975d2-057f-4aae-9e4b-95b8ed28c805 on n-h1-846466-12 Aug 04 16:46:15.381770 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-568dd2c4-16c8-470a-b498-5368ffed9f11 req-9aac6eae-2d86-4b24-a191-919b4edb2d8a service nova] Creating event network-vif-unplugged:c03b3426-9b13-43b4-8130-95a9515f9f8a for instance 09e1b482-0372-4270-ac25-6d3349aca31e on n-h2-846466-12 Aug 04 16:46:15.382333 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-568dd2c4-16c8-470a-b498-5368ffed9f11 req-9aac6eae-2d86-4b24-a191-919b4edb2d8a service nova] Creating event network-vif-unplugged:535d6e32-66f9-49c7-b95a-15ae2962f14b for instance 09e1b482-0372-4270-ac25-6d3349aca31e on n-h2-846466-12 Aug 04 16:46:15.414456 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-568dd2c4-16c8-470a-b498-5368ffed9f11 req-9aac6eae-2d86-4b24-a191-919b4edb2d8a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 702 microversion: 2.1 time: 0.172937 Aug 04 16:46:15.417957 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1148/2284] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 702 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:46:15.455985 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7ce7d281-55bb-415a-b575-9618c0339722 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:15.464991 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7ce7d281-55bb-415a-b575-9618c0339722 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: d6141949-1d15-4c84-8638-426cf7244dbd] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:15.493350 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ce7d281-55bb-415a-b575-9618c0339722 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:15.493818 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ce7d281-55bb-415a-b575-9618c0339722 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:15.494633 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ce7d281-55bb-415a-b575-9618c0339722 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:15.495079 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ce7d281-55bb-415a-b575-9618c0339722 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:15.740815 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-373bf81e-4ee7-42ee-acc4-cb7f70bbb05c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:15.765601 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-373bf81e-4ee7-42ee-acc4-cb7f70bbb05c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433" status: 200 len: 1313 microversion: 2.1 time: 1.239609 Aug 04 16:46:15.767535 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1137/2285] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:14 2022] GET /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433 => generated 1313 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:15.784787 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0895191c-5a51-4d9d-aa78-60925730d0cf tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e84bec820>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:15.898879 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0895191c-5a51-4d9d-aa78-60925730d0cf tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/b7c42f97-f9b7-487b-8dd3-3ee62452aa70" status: 200 len: 1410 microversion: 2.1 time: 0.123687 Aug 04 16:46:15.900058 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1138/2286] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:46:15 2022] GET /compute/v2.1/images/b7c42f97-f9b7-487b-8dd3-3ee62452aa70 => generated 1410 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:15.921468 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9f104a16-5b7d-4d03-be07-1abd32f73d45 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:15.923099 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9f104a16-5b7d-4d03-be07-1abd32f73d45 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:15.938374 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f104a16-5b7d-4d03-be07-1abd32f73d45 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:15.939254 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f104a16-5b7d-4d03-be07-1abd32f73d45 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:15.940327 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f104a16-5b7d-4d03-be07-1abd32f73d45 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:15.941308 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f104a16-5b7d-4d03-be07-1abd32f73d45 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:16.046942 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=8 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:46:16.124413 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:46:17.058933 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7ce7d281-55bb-415a-b575-9618c0339722 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:17.076063 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7ce7d281-55bb-415a-b575-9618c0339722 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd" status: 200 len: 1315 microversion: 2.1 time: 1.654570 Aug 04 16:46:17.076835 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1149/2287] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:15 2022] GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd => generated 1315 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:17.088893 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2e193584-8683-4826-ada3-09db960b5f2f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:17.089795 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2e193584-8683-4826-ada3-09db960b5f2f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:17.107869 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e193584-8683-4826-ada3-09db960b5f2f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:17.113999 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e193584-8683-4826-ada3-09db960b5f2f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:17.115350 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e193584-8683-4826-ada3-09db960b5f2f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:17.115898 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e193584-8683-4826-ada3-09db960b5f2f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:17.290042 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9f104a16-5b7d-4d03-be07-1abd32f73d45 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:17.322540 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9f104a16-5b7d-4d03-be07-1abd32f73d45 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:17.326770 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9f104a16-5b7d-4d03-be07-1abd32f73d45 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:17.334840 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9f104a16-5b7d-4d03-be07-1abd32f73d45 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 2817 microversion: 2.32 time: 1.432981 Aug 04 16:46:17.335954 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1139/2288] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:46:15 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 2817 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:46:17.356923 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-4b53349e-dbd4-4a54-a6b7-a60575fd17bf req-dbf6045f-d31f-43e0-8035-9962d46bc07a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be", "tag": "5b3bfd83-b1f7-4c0c-9a5b-1aa6390e316d"}, {"name": "network-changed", "server_uuid": "d6141949-1d15-4c84-8638-426cf7244dbd", "tag": "922c5ddd-6ae1-49df-9bef-4c7ffa319e4e"}, {"name": "network-changed", "server_uuid": "3c687b7a-617f-46d4-b1c1-c629814fac1a", "tag": "829cc34c-b2fd-494c-be1a-a87319f8c284"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:17.391883 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-4b53349e-dbd4-4a54-a6b7-a60575fd17bf req-dbf6045f-d31f-43e0-8035-9962d46bc07a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:17.397431 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-4b53349e-dbd4-4a54-a6b7-a60575fd17bf req-dbf6045f-d31f-43e0-8035-9962d46bc07a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:17.435586 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-4b53349e-dbd4-4a54-a6b7-a60575fd17bf req-dbf6045f-d31f-43e0-8035-9962d46bc07a service nova] Creating event network-changed:5b3bfd83-b1f7-4c0c-9a5b-1aa6390e316d for instance f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be on n-h1-846466-12 Aug 04 16:46:17.436625 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-4b53349e-dbd4-4a54-a6b7-a60575fd17bf req-dbf6045f-d31f-43e0-8035-9962d46bc07a service nova] Creating event network-changed:922c5ddd-6ae1-49df-9bef-4c7ffa319e4e for instance d6141949-1d15-4c84-8638-426cf7244dbd on n-h1-846466-12 Aug 04 16:46:17.437589 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-4b53349e-dbd4-4a54-a6b7-a60575fd17bf req-dbf6045f-d31f-43e0-8035-9962d46bc07a service nova] Creating event network-changed:829cc34c-b2fd-494c-be1a-a87319f8c284 for instance 3c687b7a-617f-46d4-b1c1-c629814fac1a on n-h2-846466-12 Aug 04 16:46:17.463089 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-4b53349e-dbd4-4a54-a6b7-a60575fd17bf req-dbf6045f-d31f-43e0-8035-9962d46bc07a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.116221 Aug 04 16:46:17.464368 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1140/2289] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:46:17.473644 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b70371c3-da66-4341-b95a-5b7b6e140b28 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:17.480494 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b70371c3-da66-4341-b95a-5b7b6e140b28 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: 9379d600-7def-463c-9655-b6d3a3833762] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:17.495930 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b70371c3-da66-4341-b95a-5b7b6e140b28 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:17.496779 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b70371c3-da66-4341-b95a-5b7b6e140b28 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:17.501979 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b70371c3-da66-4341-b95a-5b7b6e140b28 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:17.502713 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b70371c3-da66-4341-b95a-5b7b6e140b28 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:19.194848 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b70371c3-da66-4341-b95a-5b7b6e140b28 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450c14de401149bc8a24efb11e24b631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a69315bfb4723b95c9b79e0741b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:19.220734 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b70371c3-da66-4341-b95a-5b7b6e140b28 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "GET /compute/v2.1/servers/9379d600-7def-463c-9655-b6d3a3833762" status: 200 len: 1320 microversion: 2.1 time: 1.754038 Aug 04 16:46:19.222121 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1141/2290] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:17 2022] GET /compute/v2.1/servers/9379d600-7def-463c-9655-b6d3a3833762 => generated 1320 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:19.238497 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2e193584-8683-4826-ada3-09db960b5f2f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:19.249676 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2e193584-8683-4826-ada3-09db960b5f2f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be" status: 200 len: 1318 microversion: 2.1 time: 2.171614 Aug 04 16:46:19.255855 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1150/2291] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:17 2022] GET /compute/v2.1/servers/f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be => generated 1318 bytes in 2175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:19.257063 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-5ec8537e-aa79-4875-b8cf-60e3b60d3474 req-4162fbaa-abb0-482b-b28d-bb2f3424c177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09e1b482-0372-4270-ac25-6d3349aca31e", "name": "network-vif-deleted", "tag": "c5e38244-ed96-4228-beb9-52ba893cf961"}, {"server_uuid": "09e1b482-0372-4270-ac25-6d3349aca31e", "name": "network-vif-deleted", "tag": "535d6e32-66f9-49c7-b95a-15ae2962f14b"}, {"name": "network-changed", "server_uuid": "3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433", "tag": "a0e9ef94-e4ce-4bcf-8c9b-274f319b2855"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:19.261525 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bb4b2ae9-960d-4f80-a704-97d8d7784973 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:19.265169 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bb4b2ae9-960d-4f80-a704-97d8d7784973 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:19.281325 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bb4b2ae9-960d-4f80-a704-97d8d7784973 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:19.284288 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bb4b2ae9-960d-4f80-a704-97d8d7784973 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:19.285447 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bb4b2ae9-960d-4f80-a704-97d8d7784973 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:19.288891 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bb4b2ae9-960d-4f80-a704-97d8d7784973 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:19.354274 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-5ec8537e-aa79-4875-b8cf-60e3b60d3474 req-4162fbaa-abb0-482b-b28d-bb2f3424c177 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:19.355237 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-5ec8537e-aa79-4875-b8cf-60e3b60d3474 req-4162fbaa-abb0-482b-b28d-bb2f3424c177 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:19.441497 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-5ec8537e-aa79-4875-b8cf-60e3b60d3474 req-4162fbaa-abb0-482b-b28d-bb2f3424c177 service nova] Creating event network-vif-deleted:c5e38244-ed96-4228-beb9-52ba893cf961 for instance 09e1b482-0372-4270-ac25-6d3349aca31e on n-h2-846466-12 Aug 04 16:46:19.441911 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-5ec8537e-aa79-4875-b8cf-60e3b60d3474 req-4162fbaa-abb0-482b-b28d-bb2f3424c177 service nova] Creating event network-vif-deleted:535d6e32-66f9-49c7-b95a-15ae2962f14b for instance 09e1b482-0372-4270-ac25-6d3349aca31e on n-h2-846466-12 Aug 04 16:46:19.442421 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-5ec8537e-aa79-4875-b8cf-60e3b60d3474 req-4162fbaa-abb0-482b-b28d-bb2f3424c177 service nova] Creating event network-changed:a0e9ef94-e4ce-4bcf-8c9b-274f319b2855 for instance 3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433 on n-h2-846466-12 Aug 04 16:46:19.467771 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-5ec8537e-aa79-4875-b8cf-60e3b60d3474 req-4162fbaa-abb0-482b-b28d-bb2f3424c177 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.241989 Aug 04 16:46:19.469022 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1142/2292] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:46:19.484366 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-022c7ae9-a619-41e6-bad0-f26ee604cda7 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e84a9f5e0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:19.627326 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-022c7ae9-a619-41e6-bad0-f26ee604cda7 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/b7c42f97-f9b7-487b-8dd3-3ee62452aa70" status: 200 len: 1410 microversion: 2.1 time: 0.156690 Aug 04 16:46:19.636043 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1143/2293] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:46:19 2022] GET /compute/v2.1/images/b7c42f97-f9b7-487b-8dd3-3ee62452aa70 => generated 1410 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:19.642870 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a86568b6-bce3-48f1-b759-9f7609a4921e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:19.652745 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a86568b6-bce3-48f1-b759-9f7609a4921e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: d6141949-1d15-4c84-8638-426cf7244dbd] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:19.676877 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a86568b6-bce3-48f1-b759-9f7609a4921e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:19.686130 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a86568b6-bce3-48f1-b759-9f7609a4921e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:19.688134 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a86568b6-bce3-48f1-b759-9f7609a4921e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:19.688784 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a86568b6-bce3-48f1-b759-9f7609a4921e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:20.827230 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a86568b6-bce3-48f1-b759-9f7609a4921e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:20.837022 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a86568b6-bce3-48f1-b759-9f7609a4921e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd" status: 200 len: 1315 microversion: 2.1 time: 1.199051 Aug 04 16:46:20.843598 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1144/2294] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:19 2022] GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd => generated 1315 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:20.859740 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a1ffc129-c84d-45ab-b9d5-330cc28ae74c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:20.861074 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a1ffc129-c84d-45ab-b9d5-330cc28ae74c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:20.872755 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a1ffc129-c84d-45ab-b9d5-330cc28ae74c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:20.881227 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a1ffc129-c84d-45ab-b9d5-330cc28ae74c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:20.882430 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a1ffc129-c84d-45ab-b9d5-330cc28ae74c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:20.883272 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a1ffc129-c84d-45ab-b9d5-330cc28ae74c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:20.883653 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bb4b2ae9-960d-4f80-a704-97d8d7784973 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:20.906723 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bb4b2ae9-960d-4f80-a704-97d8d7784973 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433" status: 200 len: 1313 microversion: 2.1 time: 1.642406 Aug 04 16:46:20.926067 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1151/2295] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:19 2022] GET /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433 => generated 1313 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:20.962252 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c99ee3ee-befe-4745-bbd9-0dd4f77fb223 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:20.963042 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c99ee3ee-befe-4745-bbd9-0dd4f77fb223 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: 9379d600-7def-463c-9655-b6d3a3833762] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:20.989591 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c99ee3ee-befe-4745-bbd9-0dd4f77fb223 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:20.995652 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c99ee3ee-befe-4745-bbd9-0dd4f77fb223 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:20.996857 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c99ee3ee-befe-4745-bbd9-0dd4f77fb223 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:20.997686 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c99ee3ee-befe-4745-bbd9-0dd4f77fb223 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:22.400543 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a1ffc129-c84d-45ab-b9d5-330cc28ae74c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:22.444994 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a1ffc129-c84d-45ab-b9d5-330cc28ae74c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:22.450556 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a1ffc129-c84d-45ab-b9d5-330cc28ae74c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:22.461908 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a1ffc129-c84d-45ab-b9d5-330cc28ae74c tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 2453 microversion: 2.32 time: 1.616229 Aug 04 16:46:22.463383 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1145/2296] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:46:20 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 2453 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:46:22.501540 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4a46646a-43eb-40fd-8ea0-dfbe63e5b863 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:22.502738 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4a46646a-43eb-40fd-8ea0-dfbe63e5b863 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:22.524716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4a46646a-43eb-40fd-8ea0-dfbe63e5b863 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:22.526102 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4a46646a-43eb-40fd-8ea0-dfbe63e5b863 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:22.527795 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4a46646a-43eb-40fd-8ea0-dfbe63e5b863 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:22.528875 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4a46646a-43eb-40fd-8ea0-dfbe63e5b863 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:22.923438 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c99ee3ee-befe-4745-bbd9-0dd4f77fb223 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450c14de401149bc8a24efb11e24b631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a69315bfb4723b95c9b79e0741b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:22.959145 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c99ee3ee-befe-4745-bbd9-0dd4f77fb223 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "GET /compute/v2.1/servers/9379d600-7def-463c-9655-b6d3a3833762" status: 200 len: 1320 microversion: 2.1 time: 2.027819 Aug 04 16:46:22.963605 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1152/2297] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:20 2022] GET /compute/v2.1/servers/9379d600-7def-463c-9655-b6d3a3833762 => generated 1320 bytes in 2036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:22.977904 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7780f194-1663-454d-b409-579586a92d26 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e845228b0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:23.115096 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7780f194-1663-454d-b409-579586a92d26 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/b7c42f97-f9b7-487b-8dd3-3ee62452aa70" status: 200 len: 1410 microversion: 2.1 time: 0.150155 Aug 04 16:46:23.116410 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1153/2298] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:46:22 2022] GET /compute/v2.1/images/b7c42f97-f9b7-487b-8dd3-3ee62452aa70 => generated 1410 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:23.122725 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-e54e22d3-f977-47d1-b78c-0ad755e1b136 req-df99206d-4bf2-4bd5-ba4e-dae981a43328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9379d600-7def-463c-9655-b6d3a3833762", "name": "network-vif-plugged", "status": "completed", "tag": "efebf1a7-acf2-4917-a887-fb24fd837a51"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:23.147534 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-e54e22d3-f977-47d1-b78c-0ad755e1b136 req-df99206d-4bf2-4bd5-ba4e-dae981a43328 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:23.148102 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-e54e22d3-f977-47d1-b78c-0ad755e1b136 req-df99206d-4bf2-4bd5-ba4e-dae981a43328 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:23.172344 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-e54e22d3-f977-47d1-b78c-0ad755e1b136 req-df99206d-4bf2-4bd5-ba4e-dae981a43328 service nova] Creating event network-vif-plugged:efebf1a7-acf2-4917-a887-fb24fd837a51 for instance 9379d600-7def-463c-9655-b6d3a3833762 on n-h2-846466-12 Aug 04 16:46:23.183737 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-e54e22d3-f977-47d1-b78c-0ad755e1b136 req-df99206d-4bf2-4bd5-ba4e-dae981a43328 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062302 Aug 04 16:46:23.187082 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1154/2299] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:46:23.200987 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-76430a33-d570-4e05-87bd-dd65f3aa0d2b req-d6b9e121-6c6b-4d68-950e-936db3ca1ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09e1b482-0372-4270-ac25-6d3349aca31e", "name": "network-vif-deleted", "tag": "c03b3426-9b13-43b4-8130-95a9515f9f8a"}, {"server_uuid": "09e1b482-0372-4270-ac25-6d3349aca31e", "name": "network-vif-deleted", "tag": "a55a1fc3-452c-4f78-8499-e76e8bdb7750"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:23.260886 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-76430a33-d570-4e05-87bd-dd65f3aa0d2b req-d6b9e121-6c6b-4d68-950e-936db3ca1ee7 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:23.261354 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-76430a33-d570-4e05-87bd-dd65f3aa0d2b req-d6b9e121-6c6b-4d68-950e-936db3ca1ee7 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:23.300174 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-76430a33-d570-4e05-87bd-dd65f3aa0d2b req-d6b9e121-6c6b-4d68-950e-936db3ca1ee7 service nova] Creating event network-vif-deleted:c03b3426-9b13-43b4-8130-95a9515f9f8a for instance 09e1b482-0372-4270-ac25-6d3349aca31e on n-h2-846466-12 Aug 04 16:46:23.303621 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-76430a33-d570-4e05-87bd-dd65f3aa0d2b req-d6b9e121-6c6b-4d68-950e-936db3ca1ee7 service nova] Creating event network-vif-deleted:a55a1fc3-452c-4f78-8499-e76e8bdb7750 for instance 09e1b482-0372-4270-ac25-6d3349aca31e on n-h2-846466-12 Aug 04 16:46:23.321475 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-76430a33-d570-4e05-87bd-dd65f3aa0d2b req-d6b9e121-6c6b-4d68-950e-936db3ca1ee7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.129686 Aug 04 16:46:23.325347 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1155/2300] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:46:23.339619 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-20e4b6ab-d865-4b77-90b7-a9027b47252b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:23.342397 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-20e4b6ab-d865-4b77-90b7-a9027b47252b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: d6141949-1d15-4c84-8638-426cf7244dbd] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:23.363373 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-20e4b6ab-d865-4b77-90b7-a9027b47252b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:23.363818 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-20e4b6ab-d865-4b77-90b7-a9027b47252b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:23.367348 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-20e4b6ab-d865-4b77-90b7-a9027b47252b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:23.370824 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-20e4b6ab-d865-4b77-90b7-a9027b47252b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:23.374661 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:46:23.619368 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4a46646a-43eb-40fd-8ea0-dfbe63e5b863 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:23.635563 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4a46646a-43eb-40fd-8ea0-dfbe63e5b863 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be" status: 200 len: 1318 microversion: 2.1 time: 1.165779 Aug 04 16:46:23.654359 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1146/2301] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:22 2022] GET /compute/v2.1/servers/f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be => generated 1318 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:23.661683 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7a38e31b-504c-4399-af29-8689d152e6d5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:23.662614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7a38e31b-504c-4399-af29-8689d152e6d5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:23.673690 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7a38e31b-504c-4399-af29-8689d152e6d5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:23.674560 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7a38e31b-504c-4399-af29-8689d152e6d5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:23.676512 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7a38e31b-504c-4399-af29-8689d152e6d5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:23.677730 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7a38e31b-504c-4399-af29-8689d152e6d5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:23.710936 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:46:23.951902 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-20e4b6ab-d865-4b77-90b7-a9027b47252b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:23.968293 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-20e4b6ab-d865-4b77-90b7-a9027b47252b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd" status: 200 len: 1315 microversion: 2.1 time: 0.641281 Aug 04 16:46:23.988786 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1156/2302] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:23 2022] GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd => generated 1315 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:24.004869 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2bc6970e-8d3e-4489-97d1-9bbafb218389 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:24.007257 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2bc6970e-8d3e-4489-97d1-9bbafb218389 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:24.036838 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2bc6970e-8d3e-4489-97d1-9bbafb218389 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:24.038102 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2bc6970e-8d3e-4489-97d1-9bbafb218389 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:24.039338 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2bc6970e-8d3e-4489-97d1-9bbafb218389 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:24.042485 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2bc6970e-8d3e-4489-97d1-9bbafb218389 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:24.591501 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2bc6970e-8d3e-4489-97d1-9bbafb218389 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:24.620482 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2bc6970e-8d3e-4489-97d1-9bbafb218389 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:24.624314 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2bc6970e-8d3e-4489-97d1-9bbafb218389 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:24.631957 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2bc6970e-8d3e-4489-97d1-9bbafb218389 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 2159 microversion: 2.32 time: 0.641302 Aug 04 16:46:24.633521 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1157/2303] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:46:23 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 2159 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:46:24.648317 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f5439704-48d9-4571-bd3b-6badeb33d812 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:24.649762 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f5439704-48d9-4571-bd3b-6badeb33d812 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: 9379d600-7def-463c-9655-b6d3a3833762] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:24.682685 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f5439704-48d9-4571-bd3b-6badeb33d812 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:24.683703 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f5439704-48d9-4571-bd3b-6badeb33d812 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:24.684798 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f5439704-48d9-4571-bd3b-6badeb33d812 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:24.685430 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f5439704-48d9-4571-bd3b-6badeb33d812 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:24.726360 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7a38e31b-504c-4399-af29-8689d152e6d5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:24.754917 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7a38e31b-504c-4399-af29-8689d152e6d5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433" status: 200 len: 1313 microversion: 2.1 time: 1.098935 Aug 04 16:46:24.786223 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1147/2304] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:23 2022] GET /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433 => generated 1313 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:24.800036 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-27c82912-c3f4-44c8-a09b-dd97e38e767b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e89cc9700>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:24.921389 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-27c82912-c3f4-44c8-a09b-dd97e38e767b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/b7c42f97-f9b7-487b-8dd3-3ee62452aa70" status: 200 len: 1410 microversion: 2.1 time: 0.132916 Aug 04 16:46:24.924440 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1148/2305] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:46:24 2022] GET /compute/v2.1/images/b7c42f97-f9b7-487b-8dd3-3ee62452aa70 => generated 1410 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:24.939523 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-485139c4-e5be-4644-9aa0-8efafdcff844 req-a9343894-f371-4898-aa8e-a162b1ac6f58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "befbf568-78f2-4571-bf63-fdac57291b28", "tag": "4d207d96-918f-45a6-92bf-48edb7564806"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:24.965726 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-485139c4-e5be-4644-9aa0-8efafdcff844 req-a9343894-f371-4898-aa8e-a162b1ac6f58 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:24.967759 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-485139c4-e5be-4644-9aa0-8efafdcff844 req-a9343894-f371-4898-aa8e-a162b1ac6f58 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:25.000544 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-485139c4-e5be-4644-9aa0-8efafdcff844 req-a9343894-f371-4898-aa8e-a162b1ac6f58 service nova] Creating event network-changed:4d207d96-918f-45a6-92bf-48edb7564806 for instance befbf568-78f2-4571-bf63-fdac57291b28 on n-h1-846466-12 Aug 04 16:46:25.012972 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-485139c4-e5be-4644-9aa0-8efafdcff844 req-a9343894-f371-4898-aa8e-a162b1ac6f58 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086833 Aug 04 16:46:25.015710 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1149/2306] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:46:25.030411 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7afad698-a641-455a-a5a8-abd1be6664de tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:25.036145 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7afad698-a641-455a-a5a8-abd1be6664de tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:25.050212 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7afad698-a641-455a-a5a8-abd1be6664de tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:25.053019 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7afad698-a641-455a-a5a8-abd1be6664de tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:25.058434 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7afad698-a641-455a-a5a8-abd1be6664de tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:25.059374 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7afad698-a641-455a-a5a8-abd1be6664de tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:25.599615 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f5439704-48d9-4571-bd3b-6badeb33d812 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450c14de401149bc8a24efb11e24b631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a69315bfb4723b95c9b79e0741b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:25.614984 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f5439704-48d9-4571-bd3b-6badeb33d812 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "GET /compute/v2.1/servers/9379d600-7def-463c-9655-b6d3a3833762" status: 200 len: 1320 microversion: 2.1 time: 0.975399 Aug 04 16:46:25.617515 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1158/2307] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:24 2022] GET /compute/v2.1/servers/9379d600-7def-463c-9655-b6d3a3833762 => generated 1320 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:25.643708 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6ab9b6d2-7aaf-4df4-8bd5-85f13047d9a1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:25.646408 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6ab9b6d2-7aaf-4df4-8bd5-85f13047d9a1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: d6141949-1d15-4c84-8638-426cf7244dbd] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:25.681637 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6ab9b6d2-7aaf-4df4-8bd5-85f13047d9a1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:25.682808 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6ab9b6d2-7aaf-4df4-8bd5-85f13047d9a1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:25.690786 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6ab9b6d2-7aaf-4df4-8bd5-85f13047d9a1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:25.692217 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6ab9b6d2-7aaf-4df4-8bd5-85f13047d9a1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:26.346335 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7afad698-a641-455a-a5a8-abd1be6664de tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:26.355526 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7afad698-a641-455a-a5a8-abd1be6664de tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be" status: 200 len: 1318 microversion: 2.1 time: 1.338027 Aug 04 16:46:26.369418 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1150/2308] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:25 2022] GET /compute/v2.1/servers/f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be => generated 1318 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:26.398901 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-ae56dfdc-f120-4c41-bb16-00c57c6e2b76 req-2794ae43-6f89-4156-9aed-2ceaf0574295 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be", "name": "network-vif-plugged", "status": "completed", "tag": "5b3bfd83-b1f7-4c0c-9a5b-1aa6390e316d"}, {"server_uuid": "ab3019e6-7cb9-44e9-a08a-e453ba9ded47", "name": "network-vif-plugged", "status": "completed", "tag": "6935f5b8-35a8-4890-a898-a39dd8e00592"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:26.441591 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:46:26.448389 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-ae56dfdc-f120-4c41-bb16-00c57c6e2b76 req-2794ae43-6f89-4156-9aed-2ceaf0574295 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:26.448880 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-ae56dfdc-f120-4c41-bb16-00c57c6e2b76 req-2794ae43-6f89-4156-9aed-2ceaf0574295 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:26.520329 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-ae56dfdc-f120-4c41-bb16-00c57c6e2b76 req-2794ae43-6f89-4156-9aed-2ceaf0574295 service nova] Creating event network-vif-plugged:5b3bfd83-b1f7-4c0c-9a5b-1aa6390e316d for instance f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be on n-h1-846466-12 Aug 04 16:46:26.524035 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-ae56dfdc-f120-4c41-bb16-00c57c6e2b76 req-2794ae43-6f89-4156-9aed-2ceaf0574295 service nova] Creating event network-vif-plugged:6935f5b8-35a8-4890-a898-a39dd8e00592 for instance ab3019e6-7cb9-44e9-a08a-e453ba9ded47 on n-h2-846466-12 Aug 04 16:46:26.605067 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-ae56dfdc-f120-4c41-bb16-00c57c6e2b76 req-2794ae43-6f89-4156-9aed-2ceaf0574295 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.230751 Aug 04 16:46:26.609023 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1151/2309] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:46:26.643656 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-ea392141-4af3-4ee8-8727-959b65f254d4 req-7ceba72b-c1e3-4c01-8465-73854b6451fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09e1b482-0372-4270-ac25-6d3349aca31e", "name": "network-vif-deleted", "tag": "80b3b8c3-3818-4e0b-9096-8ce22a3ec0f3"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:26.691706 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-ea392141-4af3-4ee8-8727-959b65f254d4 req-7ceba72b-c1e3-4c01-8465-73854b6451fa service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:26.699920 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-ea392141-4af3-4ee8-8727-959b65f254d4 req-7ceba72b-c1e3-4c01-8465-73854b6451fa service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:26.772640 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-ea392141-4af3-4ee8-8727-959b65f254d4 req-7ceba72b-c1e3-4c01-8465-73854b6451fa service nova] Creating event network-vif-deleted:80b3b8c3-3818-4e0b-9096-8ce22a3ec0f3 for instance 09e1b482-0372-4270-ac25-6d3349aca31e on n-h2-846466-12 Aug 04 16:46:26.795471 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-ea392141-4af3-4ee8-8727-959b65f254d4 req-7ceba72b-c1e3-4c01-8465-73854b6451fa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182286 Aug 04 16:46:26.827533 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1152/2310] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:46:26.858111 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2e66aab8-0c9c-4c35-89e7-0c27db839bae tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:26.865835 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2e66aab8-0c9c-4c35-89e7-0c27db839bae tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:26.909888 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2e66aab8-0c9c-4c35-89e7-0c27db839bae tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:26.913479 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2e66aab8-0c9c-4c35-89e7-0c27db839bae tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:26.926538 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2e66aab8-0c9c-4c35-89e7-0c27db839bae tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:26.927479 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2e66aab8-0c9c-4c35-89e7-0c27db839bae tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:27.968698 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2e66aab8-0c9c-4c35-89e7-0c27db839bae tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:27.986213 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2e66aab8-0c9c-4c35-89e7-0c27db839bae tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:27.992764 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2e66aab8-0c9c-4c35-89e7-0c27db839bae tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:28.002907 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2e66aab8-0c9c-4c35-89e7-0c27db839bae tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1604 microversion: 2.32 time: 1.172619 Aug 04 16:46:28.008472 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1153/2311] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:46:26 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1604 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:46:28.029974 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7e9f3fd9-ddae-40c7-b30f-f2fafe2ad4c0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:28.031303 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7e9f3fd9-ddae-40c7-b30f-f2fafe2ad4c0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:28.038945 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7e9f3fd9-ddae-40c7-b30f-f2fafe2ad4c0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:28.039804 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7e9f3fd9-ddae-40c7-b30f-f2fafe2ad4c0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:28.040841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7e9f3fd9-ddae-40c7-b30f-f2fafe2ad4c0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:28.041671 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7e9f3fd9-ddae-40c7-b30f-f2fafe2ad4c0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:28.441657 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6ab9b6d2-7aaf-4df4-8bd5-85f13047d9a1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:28.476023 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6ab9b6d2-7aaf-4df4-8bd5-85f13047d9a1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd" status: 200 len: 1315 microversion: 2.1 time: 2.850335 Aug 04 16:46:28.482346 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1159/2312] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:25 2022] GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd => generated 1315 bytes in 2862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:28.521347 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-05c3bfae-58c7-4a86-a782-7f04cd4540f5 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e84522af0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:28.780925 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-05c3bfae-58c7-4a86-a782-7f04cd4540f5 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/b7c42f97-f9b7-487b-8dd3-3ee62452aa70" status: 200 len: 1410 microversion: 2.1 time: 0.291991 Aug 04 16:46:28.787219 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1160/2313] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:46:28 2022] GET /compute/v2.1/images/b7c42f97-f9b7-487b-8dd3-3ee62452aa70 => generated 1410 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:28.819470 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-453b7a2b-c052-4106-8ddd-f551d5b69049 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:28.820069 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-453b7a2b-c052-4106-8ddd-f551d5b69049 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: 9379d600-7def-463c-9655-b6d3a3833762] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:28.864998 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-453b7a2b-c052-4106-8ddd-f551d5b69049 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:28.865671 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-453b7a2b-c052-4106-8ddd-f551d5b69049 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:28.868550 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-453b7a2b-c052-4106-8ddd-f551d5b69049 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:28.869377 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-453b7a2b-c052-4106-8ddd-f551d5b69049 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:29.464077 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7e9f3fd9-ddae-40c7-b30f-f2fafe2ad4c0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:29.473321 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7e9f3fd9-ddae-40c7-b30f-f2fafe2ad4c0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433" status: 200 len: 1313 microversion: 2.1 time: 1.450465 Aug 04 16:46:29.479022 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1154/2314] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:28 2022] GET /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433 => generated 1313 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:29.484258 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ad1ff320-32b0-42a1-b783-182cbe8de2db tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:29.488937 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ad1ff320-32b0-42a1-b783-182cbe8de2db tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:29.496181 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad1ff320-32b0-42a1-b783-182cbe8de2db tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:29.496930 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad1ff320-32b0-42a1-b783-182cbe8de2db tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:29.497959 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad1ff320-32b0-42a1-b783-182cbe8de2db tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:29.498606 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad1ff320-32b0-42a1-b783-182cbe8de2db tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:29.707651 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-453b7a2b-c052-4106-8ddd-f551d5b69049 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450c14de401149bc8a24efb11e24b631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a69315bfb4723b95c9b79e0741b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:29.730712 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-453b7a2b-c052-4106-8ddd-f551d5b69049 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "GET /compute/v2.1/servers/9379d600-7def-463c-9655-b6d3a3833762" status: 200 len: 1508 microversion: 2.1 time: 0.938291 Aug 04 16:46:29.732175 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1161/2315] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:28 2022] GET /compute/v2.1/servers/9379d600-7def-463c-9655-b6d3a3833762 => generated 1508 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:29.738625 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b1c16328-fe79-42ff-b378-86921a55ce14 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:29.746235 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b1c16328-fe79-42ff-b378-86921a55ce14 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:29.762668 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b1c16328-fe79-42ff-b378-86921a55ce14 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:29.769167 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b1c16328-fe79-42ff-b378-86921a55ce14 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:29.772379 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b1c16328-fe79-42ff-b378-86921a55ce14 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:29.775947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b1c16328-fe79-42ff-b378-86921a55ce14 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:30.296729 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b1c16328-fe79-42ff-b378-86921a55ce14 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:30.333507 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b1c16328-fe79-42ff-b378-86921a55ce14 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:30.346210 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b1c16328-fe79-42ff-b378-86921a55ce14 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:30.360823 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b1c16328-fe79-42ff-b378-86921a55ce14 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1604 microversion: 2.32 time: 0.619191 Aug 04 16:46:30.367113 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1162/2316] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:46:29 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1604 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:46:30.413447 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ab2ed367-44fd-44c9-846f-a558596fa663 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:30.419474 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ab2ed367-44fd-44c9-846f-a558596fa663 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: d6141949-1d15-4c84-8638-426cf7244dbd] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:30.455732 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab2ed367-44fd-44c9-846f-a558596fa663 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:30.456675 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab2ed367-44fd-44c9-846f-a558596fa663 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:30.458316 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab2ed367-44fd-44c9-846f-a558596fa663 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:30.459439 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab2ed367-44fd-44c9-846f-a558596fa663 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:30.466528 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ad1ff320-32b0-42a1-b783-182cbe8de2db tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:30.475664 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ad1ff320-32b0-42a1-b783-182cbe8de2db tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be" status: 200 len: 1467 microversion: 2.1 time: 0.995041 Aug 04 16:46:30.476611 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1155/2317] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:29 2022] GET /compute/v2.1/servers/f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be => generated 1467 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:30.510692 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dde22790-1615-4264-b884-dd8a0c6c9773 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:30.514091 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-dde22790-1615-4264-b884-dd8a0c6c9773 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: ab3019e6-7cb9-44e9-a08a-e453ba9ded47] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:30.540108 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dde22790-1615-4264-b884-dd8a0c6c9773 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:30.541319 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dde22790-1615-4264-b884-dd8a0c6c9773 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:30.543103 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dde22790-1615-4264-b884-dd8a0c6c9773 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:30.544053 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dde22790-1615-4264-b884-dd8a0c6c9773 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:30.996848 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ab2ed367-44fd-44c9-846f-a558596fa663 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:31.052670 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ab2ed367-44fd-44c9-846f-a558596fa663 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd" status: 200 len: 1315 microversion: 2.1 time: 0.677579 Aug 04 16:46:31.057856 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1163/2318] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:30 2022] GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd => generated 1315 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:31.084445 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-edb58e87-24ed-43a9-acf5-6ac18f75e87d tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e843bbd30>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:31.128707 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-dde22790-1615-4264-b884-dd8a0c6c9773 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450c14de401149bc8a24efb11e24b631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a69315bfb4723b95c9b79e0741b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:31.158070 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dde22790-1615-4264-b884-dd8a0c6c9773 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "GET /compute/v2.1/servers/ab3019e6-7cb9-44e9-a08a-e453ba9ded47" status: 200 len: 1507 microversion: 2.1 time: 0.673590 Aug 04 16:46:31.169873 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1156/2319] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:30 2022] GET /compute/v2.1/servers/ab3019e6-7cb9-44e9-a08a-e453ba9ded47 => generated 1507 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:31.170136 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-edb58e87-24ed-43a9-acf5-6ac18f75e87d tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/b7c42f97-f9b7-487b-8dd3-3ee62452aa70" status: 200 len: 1410 microversion: 2.1 time: 0.105914 Aug 04 16:46:31.170263 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3ada9fe1-4ff1-4cef-af75-686605588f21 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:31.176119 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3ada9fe1-4ff1-4cef-af75-686605588f21 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 3c687b7a-617f-46d4-b1c1-c629814fac1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:31.176355 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1164/2320] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:46:31 2022] GET /compute/v2.1/images/b7c42f97-f9b7-487b-8dd3-3ee62452aa70 => generated 1410 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:31.197988 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ada9fe1-4ff1-4cef-af75-686605588f21 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:31.198440 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ada9fe1-4ff1-4cef-af75-686605588f21 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:31.199135 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5ad46dbc-21e2-43e8-8c7b-aa802778fbf4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:31.199617 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ada9fe1-4ff1-4cef-af75-686605588f21 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:31.200270 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5ad46dbc-21e2-43e8-8c7b-aa802778fbf4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:31.200404 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ada9fe1-4ff1-4cef-af75-686605588f21 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:31.231565 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ad46dbc-21e2-43e8-8c7b-aa802778fbf4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:31.232368 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ad46dbc-21e2-43e8-8c7b-aa802778fbf4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:31.233866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ad46dbc-21e2-43e8-8c7b-aa802778fbf4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:31.234792 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ad46dbc-21e2-43e8-8c7b-aa802778fbf4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:31.749159 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5ad46dbc-21e2-43e8-8c7b-aa802778fbf4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:31.766668 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5ad46dbc-21e2-43e8-8c7b-aa802778fbf4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433" status: 200 len: 1313 microversion: 2.1 time: 0.590610 Aug 04 16:46:31.769896 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1165/2321] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:31 2022] GET /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433 => generated 1313 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:31.792322 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-85d26665-08dc-484d-840c-2509a3e60ebf tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:31.803809 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-85d26665-08dc-484d-840c-2509a3e60ebf tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: ab3019e6-7cb9-44e9-a08a-e453ba9ded47] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:31.822365 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-85d26665-08dc-484d-840c-2509a3e60ebf tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:31.823997 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-85d26665-08dc-484d-840c-2509a3e60ebf tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:31.825374 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-85d26665-08dc-484d-840c-2509a3e60ebf tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:31.826024 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-85d26665-08dc-484d-840c-2509a3e60ebf tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:31.888522 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3ada9fe1-4ff1-4cef-af75-686605588f21 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:31.902368 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3ada9fe1-4ff1-4cef-af75-686605588f21 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/3c687b7a-617f-46d4-b1c1-c629814fac1a" status: 200 len: 1318 microversion: 2.1 time: 0.741620 Aug 04 16:46:31.903176 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1157/2322] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:31 2022] GET /compute/v2.1/servers/3c687b7a-617f-46d4-b1c1-c629814fac1a => generated 1318 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:31.915388 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-85d26665-08dc-484d-840c-2509a3e60ebf tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: ab3019e6-7cb9-44e9-a08a-e453ba9ded47] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:46:31.933763 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6eb7b564-9359-4860-b211-aecbab499a52 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:31.934754 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6eb7b564-9359-4860-b211-aecbab499a52 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:31.954046 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6eb7b564-9359-4860-b211-aecbab499a52 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:31.955423 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6eb7b564-9359-4860-b211-aecbab499a52 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:31.962131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6eb7b564-9359-4860-b211-aecbab499a52 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:31.967275 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6eb7b564-9359-4860-b211-aecbab499a52 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:32.188041 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6eb7b564-9359-4860-b211-aecbab499a52 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:32.207979 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6eb7b564-9359-4860-b211-aecbab499a52 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:32.212150 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6eb7b564-9359-4860-b211-aecbab499a52 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:32.213858 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6eb7b564-9359-4860-b211-aecbab499a52 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1604 microversion: 2.32 time: 0.296574 Aug 04 16:46:32.214263 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-85d26665-08dc-484d-840c-2509a3e60ebf tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ab3019e6-7cb9-44e9-a08a-e453ba9ded47" status: 204 len: 0 microversion: 2.1 time: 0.425025 Aug 04 16:46:32.214919 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1166/2323] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:46:31 2022] DELETE /compute/v2.1/servers/ab3019e6-7cb9-44e9-a08a-e453ba9ded47 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:46:32.221633 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1158/2324] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:46:31 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1604 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:46:32.227282 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c413deab-79e6-457c-96e3-e2dd926f7585 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:32.228202 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c413deab-79e6-457c-96e3-e2dd926f7585 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: d6141949-1d15-4c84-8638-426cf7244dbd] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:32.228639 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-2cbdb570-2b8c-4859-84bb-5d11c9648e7e req-97a651e4-8e6e-42f4-85ea-5812fb1df0aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433", "name": "network-vif-plugged", "status": "completed", "tag": "a0e9ef94-e4ce-4bcf-8c9b-274f319b2855"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:32.237851 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c413deab-79e6-457c-96e3-e2dd926f7585 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:32.238606 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c413deab-79e6-457c-96e3-e2dd926f7585 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:32.240291 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c413deab-79e6-457c-96e3-e2dd926f7585 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:32.240933 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c413deab-79e6-457c-96e3-e2dd926f7585 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:32.285410 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-2cbdb570-2b8c-4859-84bb-5d11c9648e7e req-97a651e4-8e6e-42f4-85ea-5812fb1df0aa service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:32.297199 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-2cbdb570-2b8c-4859-84bb-5d11c9648e7e req-97a651e4-8e6e-42f4-85ea-5812fb1df0aa service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:32.324875 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-2cbdb570-2b8c-4859-84bb-5d11c9648e7e req-97a651e4-8e6e-42f4-85ea-5812fb1df0aa service nova] Creating event network-vif-plugged:a0e9ef94-e4ce-4bcf-8c9b-274f319b2855 for instance 3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433 on n-h2-846466-12 Aug 04 16:46:32.331315 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-2cbdb570-2b8c-4859-84bb-5d11c9648e7e req-97a651e4-8e6e-42f4-85ea-5812fb1df0aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111720 Aug 04 16:46:32.347131 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1167/2325] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:46:32.353155 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-568bf3e0-c0d2-44c5-835c-aee9dd6ef22f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e843bbd30>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:32.462454 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-568bf3e0-c0d2-44c5-835c-aee9dd6ef22f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/b7c42f97-f9b7-487b-8dd3-3ee62452aa70" status: 200 len: 1410 microversion: 2.1 time: 0.113647 Aug 04 16:46:32.463376 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1168/2326] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:46:32 2022] GET /compute/v2.1/images/b7c42f97-f9b7-487b-8dd3-3ee62452aa70 => generated 1410 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:32.474098 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-eaa6203a-94a0-433a-be80-5af6c5144683 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:32.477261 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-eaa6203a-94a0-433a-be80-5af6c5144683 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: 9379d600-7def-463c-9655-b6d3a3833762] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:32.508005 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eaa6203a-94a0-433a-be80-5af6c5144683 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:32.508711 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eaa6203a-94a0-433a-be80-5af6c5144683 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:32.509784 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eaa6203a-94a0-433a-be80-5af6c5144683 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:32.510408 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eaa6203a-94a0-433a-be80-5af6c5144683 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:32.585780 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-eaa6203a-94a0-433a-be80-5af6c5144683 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: 9379d600-7def-463c-9655-b6d3a3833762] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:46:32.717699 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c413deab-79e6-457c-96e3-e2dd926f7585 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:32.731190 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c413deab-79e6-457c-96e3-e2dd926f7585 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd" status: 200 len: 1315 microversion: 2.1 time: 0.507930 Aug 04 16:46:32.745726 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1159/2327] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:32 2022] GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd => generated 1315 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:32.787221 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-eaa6203a-94a0-433a-be80-5af6c5144683 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9379d600-7def-463c-9655-b6d3a3833762" status: 204 len: 0 microversion: 2.1 time: 0.322328 Aug 04 16:46:32.788105 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1169/2328] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:46:32 2022] DELETE /compute/v2.1/servers/9379d600-7def-463c-9655-b6d3a3833762 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:46:32.796832 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f8b4ab91-ae9f-424e-ae2d-e8b3c8926cf7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:32.798313 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f8b4ab91-ae9f-424e-ae2d-e8b3c8926cf7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:32.852777 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f8b4ab91-ae9f-424e-ae2d-e8b3c8926cf7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:32.857471 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f8b4ab91-ae9f-424e-ae2d-e8b3c8926cf7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:32.870777 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f8b4ab91-ae9f-424e-ae2d-e8b3c8926cf7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:32.884527 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f8b4ab91-ae9f-424e-ae2d-e8b3c8926cf7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:32.925308 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-23600e39-bd70-4be5-849f-3632b4a24d64 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:32.925932 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-23600e39-bd70-4be5-849f-3632b4a24d64 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 3c687b7a-617f-46d4-b1c1-c629814fac1a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:32.934854 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-23600e39-bd70-4be5-849f-3632b4a24d64 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:32.935606 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-23600e39-bd70-4be5-849f-3632b4a24d64 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:32.936648 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-23600e39-bd70-4be5-849f-3632b4a24d64 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:32.937463 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-23600e39-bd70-4be5-849f-3632b4a24d64 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:33.557510 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-23600e39-bd70-4be5-849f-3632b4a24d64 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:33.577694 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f8b4ab91-ae9f-424e-ae2d-e8b3c8926cf7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:33.589203 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f8b4ab91-ae9f-424e-ae2d-e8b3c8926cf7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433" status: 200 len: 1313 microversion: 2.1 time: 0.798370 Aug 04 16:46:33.592427 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1160/2329] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:32 2022] GET /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433 => generated 1313 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:33.592609 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-23600e39-bd70-4be5-849f-3632b4a24d64 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/3c687b7a-617f-46d4-b1c1-c629814fac1a" status: 200 len: 1318 microversion: 2.1 time: 0.671335 Aug 04 16:46:33.602428 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1542f373-fe4f-4088-8d4e-3dd832a50856 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1248904031", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "0135e309-4742-49be-b3e3-c69a20b0dc39"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:33.606677 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1170/2330] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:32 2022] GET /compute/v2.1/servers/3c687b7a-617f-46d4-b1c1-c629814fac1a => generated 1318 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:33.614341 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a6deb1a2-d363-484e-86f5-75b0e09e5008 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:33.615718 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a6deb1a2-d363-484e-86f5-75b0e09e5008 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:33.632363 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6deb1a2-d363-484e-86f5-75b0e09e5008 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:33.633170 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6deb1a2-d363-484e-86f5-75b0e09e5008 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:33.634276 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6deb1a2-d363-484e-86f5-75b0e09e5008 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:33.635336 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6deb1a2-d363-484e-86f5-75b0e09e5008 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:33.717360 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-1542f373-fe4f-4088-8d4e-3dd832a50856 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] validate_networks() for [('0135e309-4742-49be-b3e3-c69a20b0dc39', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:46:33.863624 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a6deb1a2-d363-484e-86f5-75b0e09e5008 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:33.879710 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a6deb1a2-d363-484e-86f5-75b0e09e5008 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:33.886218 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a6deb1a2-d363-484e-86f5-75b0e09e5008 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:33.890741 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a6deb1a2-d363-484e-86f5-75b0e09e5008 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1604 microversion: 2.32 time: 0.281347 Aug 04 16:46:33.897752 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1171/2331] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:46:33 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1604 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:46:33.903727 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c5d1e157-77e7-4904-ad68-92f7205f8c8b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e84522430>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:34.073453 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c5d1e157-77e7-4904-ad68-92f7205f8c8b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/b7c42f97-f9b7-487b-8dd3-3ee62452aa70" status: 200 len: 1419 microversion: 2.1 time: 0.170918 Aug 04 16:46:34.074547 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1172/2332] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:46:33 2022] GET /compute/v2.1/images/b7c42f97-f9b7-487b-8dd3-3ee62452aa70 => generated 1419 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:34.124798 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-67c8098f-17d8-4cba-8771-7009ce012e6c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:34.128345 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-67c8098f-17d8-4cba-8771-7009ce012e6c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: d6141949-1d15-4c84-8638-426cf7244dbd] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:34.163612 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-67c8098f-17d8-4cba-8771-7009ce012e6c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:34.170982 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-67c8098f-17d8-4cba-8771-7009ce012e6c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:34.170982 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-67c8098f-17d8-4cba-8771-7009ce012e6c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:34.170982 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-67c8098f-17d8-4cba-8771-7009ce012e6c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:34.815450 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-67c8098f-17d8-4cba-8771-7009ce012e6c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:34.825884 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-67c8098f-17d8-4cba-8771-7009ce012e6c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd" status: 200 len: 1315 microversion: 2.1 time: 0.731527 Aug 04 16:46:34.828545 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1173/2333] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:34 2022] GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd => generated 1315 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:34.842945 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a2476c54-afca-4d3c-b6f8-103c93fa8fba tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e847e4c10>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:34.913923 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a2476c54-afca-4d3c-b6f8-103c93fa8fba tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/b7c42f97-f9b7-487b-8dd3-3ee62452aa70" status: 200 len: 1419 microversion: 2.1 time: 0.076080 Aug 04 16:46:34.917910 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1174/2334] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:46:34 2022] GET /compute/v2.1/images/b7c42f97-f9b7-487b-8dd3-3ee62452aa70 => generated 1419 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:34.923829 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-10a0e884-49c2-4bd9-9444-1414fa4e1ba8 req-2fbac8d3-71b7-485c-934e-b3bcb30223b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6141949-1d15-4c84-8638-426cf7244dbd", "name": "network-vif-plugged", "status": "completed", "tag": "922c5ddd-6ae1-49df-9bef-4c7ffa319e4e"}, {"server_uuid": "3c687b7a-617f-46d4-b1c1-c629814fac1a", "name": "network-vif-plugged", "status": "completed", "tag": "829cc34c-b2fd-494c-be1a-a87319f8c284"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:34.937921 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-10a0e884-49c2-4bd9-9444-1414fa4e1ba8 req-2fbac8d3-71b7-485c-934e-b3bcb30223b1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:34.938842 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-10a0e884-49c2-4bd9-9444-1414fa4e1ba8 req-2fbac8d3-71b7-485c-934e-b3bcb30223b1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:34.944524 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:46:34.975908 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-10a0e884-49c2-4bd9-9444-1414fa4e1ba8 req-2fbac8d3-71b7-485c-934e-b3bcb30223b1 service nova] Creating event network-vif-plugged:922c5ddd-6ae1-49df-9bef-4c7ffa319e4e for instance d6141949-1d15-4c84-8638-426cf7244dbd on n-h1-846466-12 Aug 04 16:46:34.978288 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-10a0e884-49c2-4bd9-9444-1414fa4e1ba8 req-2fbac8d3-71b7-485c-934e-b3bcb30223b1 service nova] Creating event network-vif-plugged:829cc34c-b2fd-494c-be1a-a87319f8c284 for instance 3c687b7a-617f-46d4-b1c1-c629814fac1a on n-h2-846466-12 Aug 04 16:46:35.004936 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-10a0e884-49c2-4bd9-9444-1414fa4e1ba8 req-2fbac8d3-71b7-485c-934e-b3bcb30223b1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.085240 Aug 04 16:46:35.005880 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1175/2335] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:46:35.023159 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-46a17a62-596d-45df-916d-46fb35a9d968 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:35.026453 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-46a17a62-596d-45df-916d-46fb35a9d968 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:35.041016 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46a17a62-596d-45df-916d-46fb35a9d968 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:35.049793 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46a17a62-596d-45df-916d-46fb35a9d968 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:35.050933 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46a17a62-596d-45df-916d-46fb35a9d968 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:35.051555 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46a17a62-596d-45df-916d-46fb35a9d968 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:35.374812 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-1542f373-fe4f-4088-8d4e-3dd832a50856 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:46:35.376067 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-1542f373-fe4f-4088-8d4e-3dd832a50856 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:46:35.376988 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-1542f373-fe4f-4088-8d4e-3dd832a50856 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:46:35.377672 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-1542f373-fe4f-4088-8d4e-3dd832a50856 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:46:35.378293 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-1542f373-fe4f-4088-8d4e-3dd832a50856 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:46:35.396598 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1542f373-fe4f-4088-8d4e-3dd832a50856 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:35.397340 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1542f373-fe4f-4088-8d4e-3dd832a50856 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:35.398363 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1542f373-fe4f-4088-8d4e-3dd832a50856 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:35.399026 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1542f373-fe4f-4088-8d4e-3dd832a50856 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:35.429485 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-1542f373-fe4f-4088-8d4e-3dd832a50856 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Getting quotas for project ba7a69315bfb4723b95c9b79e0741b0e. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:46:35.453222 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-1542f373-fe4f-4088-8d4e-3dd832a50856 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Getting quotas for user 450c14de401149bc8a24efb11e24b631 and project ba7a69315bfb4723b95c9b79e0741b0e. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:46:35.474812 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1542f373-fe4f-4088-8d4e-3dd832a50856 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Going to run 2 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:46:35.478467 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1542f373-fe4f-4088-8d4e-3dd832a50856 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: 40121d67-65d4-4a6b-ae3f-6a85d3c99e46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:46:35.534021 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1542f373-fe4f-4088-8d4e-3dd832a50856 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: fbc88621-3d3a-4819-a1bd-d0515850bd01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=40121d67-65d4-4a6b-ae3f-6a85d3c99e46,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:46:35.534476 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-46a17a62-596d-45df-916d-46fb35a9d968 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:35.560505 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-46a17a62-596d-45df-916d-46fb35a9d968 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433" status: 200 len: 1313 microversion: 2.1 time: 0.546678 Aug 04 16:46:35.562766 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1176/2336] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:35 2022] GET /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433 => generated 1313 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:35.580672 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7b2cca53-0674-4b5a-b3ba-1d4d125f1e8b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:35.582227 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7b2cca53-0674-4b5a-b3ba-1d4d125f1e8b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 3c687b7a-617f-46d4-b1c1-c629814fac1a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:35.612180 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b2cca53-0674-4b5a-b3ba-1d4d125f1e8b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:35.613432 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b2cca53-0674-4b5a-b3ba-1d4d125f1e8b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:35.615634 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b2cca53-0674-4b5a-b3ba-1d4d125f1e8b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:35.621589 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b2cca53-0674-4b5a-b3ba-1d4d125f1e8b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:35.701413 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1542f373-fe4f-4088-8d4e-3dd832a50856 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.103200 Aug 04 16:46:35.714888 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1161/2337] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:46:33 2022] POST /compute/v2.1/servers => generated 32 bytes in 2119 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 04 16:46:35.727210 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-042fc7dd-bc81-466e-80b9-dda082f88061 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:35.728378 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-042fc7dd-bc81-466e-80b9-dda082f88061 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:35.747009 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-042fc7dd-bc81-466e-80b9-dda082f88061 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:35.747468 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-042fc7dd-bc81-466e-80b9-dda082f88061 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:35.748280 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-042fc7dd-bc81-466e-80b9-dda082f88061 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:35.751853 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-042fc7dd-bc81-466e-80b9-dda082f88061 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:36.352734 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-042fc7dd-bc81-466e-80b9-dda082f88061 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:36.377570 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-042fc7dd-bc81-466e-80b9-dda082f88061 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:36.393364 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-042fc7dd-bc81-466e-80b9-dda082f88061 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:36.395342 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-042fc7dd-bc81-466e-80b9-dda082f88061 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1604 microversion: 2.32 time: 0.682074 Aug 04 16:46:36.398199 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1162/2338] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:46:35 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1604 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:46:36.421153 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-38f6ebca-efbc-4d87-9c3d-9783edb768e4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e84ac83a0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:36.741400 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7b2cca53-0674-4b5a-b3ba-1d4d125f1e8b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:36.756273 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7b2cca53-0674-4b5a-b3ba-1d4d125f1e8b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/3c687b7a-617f-46d4-b1c1-c629814fac1a" status: 200 len: 1318 microversion: 2.1 time: 1.192049 Aug 04 16:46:36.759647 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1177/2339] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:35 2022] GET /compute/v2.1/servers/3c687b7a-617f-46d4-b1c1-c629814fac1a => generated 1318 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:36.770719 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f4319482-8299-4777-a31c-6f8d647ca8eb tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:36.787828 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f4319482-8299-4777-a31c-6f8d647ca8eb tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '450c14de401149bc8a24efb11e24b631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a69315bfb4723b95c9b79e0741b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:36.790202 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f4319482-8299-4777-a31c-6f8d647ca8eb tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Searching by: {'deleted': False, 'project_id': 'ba7a69315bfb4723b95c9b79e0741b0e'} {{(pid=126125) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:46:36.858966 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f4319482-8299-4777-a31c-6f8d647ca8eb tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:36.869553 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f4319482-8299-4777-a31c-6f8d647ca8eb tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:36.870880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f4319482-8299-4777-a31c-6f8d647ca8eb tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:36.871329 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f4319482-8299-4777-a31c-6f8d647ca8eb tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:36.954883 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.multi_cell_list [None req-f4319482-8299-4777-a31c-6f8d647ca8eb tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=126125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:46:37.060478 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f4319482-8299-4777-a31c-6f8d647ca8eb tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1005 microversion: 2.1 time: 0.295298 Aug 04 16:46:37.064164 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1178/2340] 10.222.0.23 () {58 vars in 1125 bytes} [Thu Aug 4 16:46:36 2022] GET /compute/v2.1/servers => generated 1005 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:37.083671 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-bf790f14-d092-4317-81b3-f8c38d029d9f req-70130185-c6c1-4773-b0bf-be248833f80d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9379d600-7def-463c-9655-b6d3a3833762", "name": "network-vif-deleted", "tag": "efebf1a7-acf2-4917-a887-fb24fd837a51"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:37.137761 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-bf790f14-d092-4317-81b3-f8c38d029d9f req-70130185-c6c1-4773-b0bf-be248833f80d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:37.138352 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-bf790f14-d092-4317-81b3-f8c38d029d9f req-70130185-c6c1-4773-b0bf-be248833f80d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:37.192826 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-bf790f14-d092-4317-81b3-f8c38d029d9f req-70130185-c6c1-4773-b0bf-be248833f80d service nova] Creating event network-vif-deleted:efebf1a7-acf2-4917-a887-fb24fd837a51 for instance 9379d600-7def-463c-9655-b6d3a3833762 on n-h2-846466-12 Aug 04 16:46:37.218165 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-bf790f14-d092-4317-81b3-f8c38d029d9f req-70130185-c6c1-4773-b0bf-be248833f80d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150609 Aug 04 16:46:37.220947 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1179/2341] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:46:37.223640 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-38f6ebca-efbc-4d87-9c3d-9783edb768e4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "DELETE /compute/v2.1/images/b7c42f97-f9b7-487b-8dd3-3ee62452aa70" status: 204 len: 0 microversion: 2.1 time: 0.815051 Aug 04 16:46:37.224455 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1163/2342] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:36 2022] DELETE /compute/v2.1/images/b7c42f97-f9b7-487b-8dd3-3ee62452aa70 => generated 0 bytes in 817 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:46:37.230730 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-86ffd856-c3b0-460a-b91a-87cbee757131 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:37.238119 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-86ffd856-c3b0-460a-b91a-87cbee757131 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:37.243499 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9130f1aa-16a4-414f-bdc3-bbdf1b096391 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:37.247494 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9130f1aa-16a4-414f-bdc3-bbdf1b096391 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: d6141949-1d15-4c84-8638-426cf7244dbd] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:37.265730 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9130f1aa-16a4-414f-bdc3-bbdf1b096391 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:37.267747 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9130f1aa-16a4-414f-bdc3-bbdf1b096391 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:37.270092 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9130f1aa-16a4-414f-bdc3-bbdf1b096391 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:37.272557 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9130f1aa-16a4-414f-bdc3-bbdf1b096391 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:37.276351 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-86ffd856-c3b0-460a-b91a-87cbee757131 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:37.276827 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-86ffd856-c3b0-460a-b91a-87cbee757131 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:37.282573 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-86ffd856-c3b0-460a-b91a-87cbee757131 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:37.283056 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-86ffd856-c3b0-460a-b91a-87cbee757131 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:38.745119 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9130f1aa-16a4-414f-bdc3-bbdf1b096391 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:38.772855 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9130f1aa-16a4-414f-bdc3-bbdf1b096391 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd" status: 200 len: 1315 microversion: 2.1 time: 1.550397 Aug 04 16:46:38.774171 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1180/2343] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:37 2022] GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd => generated 1315 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:38.779221 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-86ffd856-c3b0-460a-b91a-87cbee757131 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:38.789495 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-1fa9c7dd-10c7-43d4-9f53-d694c579be4e req-c6bf84ee-9808-4f59-ad2b-ebc7c9f2313b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3019e6-7cb9-44e9-a08a-e453ba9ded47", "name": "network-vif-deleted", "tag": "6935f5b8-35a8-4890-a898-a39dd8e00592"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:38.811150 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-86ffd856-c3b0-460a-b91a-87cbee757131 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433" status: 200 len: 1500 microversion: 2.1 time: 1.585472 Aug 04 16:46:38.811764 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1164/2344] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:37 2022] GET /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433 => generated 1500 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:38.842741 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5f398251-96d9-45f7-8772-1fbe2a290b3e tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:38.843389 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5f398251-96d9-45f7-8772-1fbe2a290b3e tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: fbc88621-3d3a-4819-a1bd-d0515850bd01] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:38.850833 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-1fa9c7dd-10c7-43d4-9f53-d694c579be4e req-c6bf84ee-9808-4f59-ad2b-ebc7c9f2313b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:38.854387 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-1fa9c7dd-10c7-43d4-9f53-d694c579be4e req-c6bf84ee-9808-4f59-ad2b-ebc7c9f2313b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:38.872075 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5f398251-96d9-45f7-8772-1fbe2a290b3e tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:38.882939 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5f398251-96d9-45f7-8772-1fbe2a290b3e tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:38.886708 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5f398251-96d9-45f7-8772-1fbe2a290b3e tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:38.887267 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5f398251-96d9-45f7-8772-1fbe2a290b3e tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:38.955447 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-1fa9c7dd-10c7-43d4-9f53-d694c579be4e req-c6bf84ee-9808-4f59-ad2b-ebc7c9f2313b service nova] Creating event network-vif-deleted:6935f5b8-35a8-4890-a898-a39dd8e00592 for instance ab3019e6-7cb9-44e9-a08a-e453ba9ded47 on n-h2-846466-12 Aug 04 16:46:38.975222 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-1fa9c7dd-10c7-43d4-9f53-d694c579be4e req-c6bf84ee-9808-4f59-ad2b-ebc7c9f2313b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193967 Aug 04 16:46:38.977856 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1181/2345] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:46:38.989352 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d106e243-da21-4801-82a8-a05ff21045e0 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:38.993138 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d106e243-da21-4801-82a8-a05ff21045e0 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 45b975d2-057f-4aae-9e4b-95b8ed28c805] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:39.014084 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d106e243-da21-4801-82a8-a05ff21045e0 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:39.015117 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d106e243-da21-4801-82a8-a05ff21045e0 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:39.016169 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d106e243-da21-4801-82a8-a05ff21045e0 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:39.016956 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d106e243-da21-4801-82a8-a05ff21045e0 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:39.059802 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d106e243-da21-4801-82a8-a05ff21045e0 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 45b975d2-057f-4aae-9e4b-95b8ed28c805] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:46:39.190987 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d106e243-da21-4801-82a8-a05ff21045e0 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "DELETE /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805" status: 204 len: 0 microversion: 2.1 time: 0.209944 Aug 04 16:46:39.192387 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1182/2346] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:46:38 2022] DELETE /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:46:39.237164 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-417f7778-01c4-42da-aafa-a04f334c15eb tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:39.240900 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-417f7778-01c4-42da-aafa-a04f334c15eb tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:39.248410 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-417f7778-01c4-42da-aafa-a04f334c15eb tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:39.259829 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-417f7778-01c4-42da-aafa-a04f334c15eb tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:39.261072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-417f7778-01c4-42da-aafa-a04f334c15eb tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:39.261560 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-417f7778-01c4-42da-aafa-a04f334c15eb tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:39.652078 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5f398251-96d9-45f7-8772-1fbe2a290b3e tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450c14de401149bc8a24efb11e24b631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a69315bfb4723b95c9b79e0741b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:39.664682 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5f398251-96d9-45f7-8772-1fbe2a290b3e tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "GET /compute/v2.1/servers/fbc88621-3d3a-4819-a1bd-d0515850bd01" status: 200 len: 1288 microversion: 2.1 time: 0.843112 Aug 04 16:46:39.665547 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1165/2347] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:38 2022] GET /compute/v2.1/servers/fbc88621-3d3a-4819-a1bd-d0515850bd01 => generated 1288 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:39.674998 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-511c1f6a-53cb-4ad8-a253-4b2b6aa1855b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:39.675603 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-511c1f6a-53cb-4ad8-a253-4b2b6aa1855b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 3c687b7a-617f-46d4-b1c1-c629814fac1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:39.690731 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-417f7778-01c4-42da-aafa-a04f334c15eb tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:39.700253 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-511c1f6a-53cb-4ad8-a253-4b2b6aa1855b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:39.700705 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-511c1f6a-53cb-4ad8-a253-4b2b6aa1855b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:39.706587 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-511c1f6a-53cb-4ad8-a253-4b2b6aa1855b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:39.707234 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-511c1f6a-53cb-4ad8-a253-4b2b6aa1855b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:39.711087 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-417f7778-01c4-42da-aafa-a04f334c15eb tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:39.714851 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-417f7778-01c4-42da-aafa-a04f334c15eb tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:39.722072 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-417f7778-01c4-42da-aafa-a04f334c15eb tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1604 microversion: 2.32 time: 0.526696 Aug 04 16:46:39.723588 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1183/2348] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:46:39 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1604 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:46:39.730271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-f87ef1da-0b3f-48c9-b232-82c70f7042ab req-c1c18ca9-5dde-49c2-a7a9-883b83f172d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45b975d2-057f-4aae-9e4b-95b8ed28c805", "name": "network-vif-unplugged", "status": "completed", "tag": "30523aff-f8cc-4a84-b24c-70715dfaed14"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:39.755800 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-f87ef1da-0b3f-48c9-b232-82c70f7042ab req-c1c18ca9-5dde-49c2-a7a9-883b83f172d0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:39.764373 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-f87ef1da-0b3f-48c9-b232-82c70f7042ab req-c1c18ca9-5dde-49c2-a7a9-883b83f172d0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:39.792242 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-f87ef1da-0b3f-48c9-b232-82c70f7042ab req-c1c18ca9-5dde-49c2-a7a9-883b83f172d0 service nova] Creating event network-vif-unplugged:30523aff-f8cc-4a84-b24c-70715dfaed14 for instance 45b975d2-057f-4aae-9e4b-95b8ed28c805 on n-h1-846466-12 Aug 04 16:46:39.803923 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-f87ef1da-0b3f-48c9-b232-82c70f7042ab req-c1c18ca9-5dde-49c2-a7a9-883b83f172d0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078664 Aug 04 16:46:39.805937 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1184/2349] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:46:39.813178 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-44f50a4d-c6ec-4f90-8470-021cd3d994c8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:39.817589 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-44f50a4d-c6ec-4f90-8470-021cd3d994c8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:39.830272 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-44f50a4d-c6ec-4f90-8470-021cd3d994c8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:39.831337 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-44f50a4d-c6ec-4f90-8470-021cd3d994c8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:39.832474 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-44f50a4d-c6ec-4f90-8470-021cd3d994c8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:39.833191 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-44f50a4d-c6ec-4f90-8470-021cd3d994c8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:39.892831 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-44f50a4d-c6ec-4f90-8470-021cd3d994c8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "POST /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433/action" status: 200 len: 14 microversion: 2.1 time: 0.084649 Aug 04 16:46:39.894609 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1185/2350] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:46:39 2022] POST /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:46:39.904053 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b4f9eb1e-a0fc-4c70-a1e5-a3652cb16c28 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1919432974", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "a690ca05-294e-4f0a-96cd-75ec0df3880f"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:40.002676 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-b4f9eb1e-a0fc-4c70-a1e5-a3652cb16c28 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] validate_networks() for [('a690ca05-294e-4f0a-96cd-75ec0df3880f', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:46:40.295600 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-511c1f6a-53cb-4ad8-a253-4b2b6aa1855b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:40.338224 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-511c1f6a-53cb-4ad8-a253-4b2b6aa1855b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/3c687b7a-617f-46d4-b1c1-c629814fac1a" status: 200 len: 1468 microversion: 2.1 time: 0.668810 Aug 04 16:46:40.342533 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1166/2351] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:39 2022] GET /compute/v2.1/servers/3c687b7a-617f-46d4-b1c1-c629814fac1a => generated 1468 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:40.383479 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-16a79a6f-1385-4511-afb2-94f848446159 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:40.388239 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-16a79a6f-1385-4511-afb2-94f848446159 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: d6141949-1d15-4c84-8638-426cf7244dbd] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:40.405809 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-16a79a6f-1385-4511-afb2-94f848446159 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:40.409852 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-16a79a6f-1385-4511-afb2-94f848446159 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:40.411728 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-16a79a6f-1385-4511-afb2-94f848446159 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:40.414793 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-16a79a6f-1385-4511-afb2-94f848446159 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:41.087674 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-16a79a6f-1385-4511-afb2-94f848446159 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:41.111083 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-16a79a6f-1385-4511-afb2-94f848446159 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd" status: 200 len: 1315 microversion: 2.1 time: 0.761623 Aug 04 16:46:41.111960 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1167/2352] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:40 2022] GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd => generated 1315 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:41.123232 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a1cace90-a2ea-40ba-b118-3a977af86d0d tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:41.135404 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a1cace90-a2ea-40ba-b118-3a977af86d0d tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:41.141238 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a1cace90-a2ea-40ba-b118-3a977af86d0d tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Searching by: {'reservation_id': 'r-0evy2k3j', 'deleted': False, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043'} {{(pid=126126) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:46:41.159085 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a1cace90-a2ea-40ba-b118-3a977af86d0d tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:41.159534 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a1cace90-a2ea-40ba-b118-3a977af86d0d tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:41.160353 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a1cace90-a2ea-40ba-b118-3a977af86d0d tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:41.160781 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a1cace90-a2ea-40ba-b118-3a977af86d0d tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:41.370914 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.multi_cell_list [None req-a1cace90-a2ea-40ba-b118-3a977af86d0d tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126126) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:46:41.390216 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=100 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:46:41.477024 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b4f9eb1e-a0fc-4c70-a1e5-a3652cb16c28 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:46:41.477915 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a1cace90-a2ea-40ba-b118-3a977af86d0d tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:41.478179 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b4f9eb1e-a0fc-4c70-a1e5-a3652cb16c28 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:46:41.478851 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b4f9eb1e-a0fc-4c70-a1e5-a3652cb16c28 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:46:41.479417 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b4f9eb1e-a0fc-4c70-a1e5-a3652cb16c28 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:46:41.480031 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b4f9eb1e-a0fc-4c70-a1e5-a3652cb16c28 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:46:41.498268 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b4f9eb1e-a0fc-4c70-a1e5-a3652cb16c28 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:41.498532 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a1cace90-a2ea-40ba-b118-3a977af86d0d tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:41.498899 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a1cace90-a2ea-40ba-b118-3a977af86d0d tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:41.499158 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b4f9eb1e-a0fc-4c70-a1e5-a3652cb16c28 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:41.499982 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b4f9eb1e-a0fc-4c70-a1e5-a3652cb16c28 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:41.500510 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b4f9eb1e-a0fc-4c70-a1e5-a3652cb16c28 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:41.525928 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-b4f9eb1e-a0fc-4c70-a1e5-a3652cb16c28 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Getting quotas for project afa49d3246ea4361abb452e16e017faf. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:46:41.545481 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-b4f9eb1e-a0fc-4c70-a1e5-a3652cb16c28 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Getting quotas for user a85f0bd88d79409e9610a47f3ae943ce and project afa49d3246ea4361abb452e16e017faf. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:46:41.571062 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b4f9eb1e-a0fc-4c70-a1e5-a3652cb16c28 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:46:41.573881 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b4f9eb1e-a0fc-4c70-a1e5-a3652cb16c28 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:46:41.623289 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:46:41.719216 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b4f9eb1e-a0fc-4c70-a1e5-a3652cb16c28 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.821263 Aug 04 16:46:41.722195 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1186/2353] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:46:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:46:41.731608 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e8864455-ad26-4043-bc1e-97cce50be2e6 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:41.734461 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e8864455-ad26-4043-bc1e-97cce50be2e6 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: fbc88621-3d3a-4819-a1bd-d0515850bd01] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:41.744905 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e8864455-ad26-4043-bc1e-97cce50be2e6 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:41.745603 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e8864455-ad26-4043-bc1e-97cce50be2e6 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:41.746772 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e8864455-ad26-4043-bc1e-97cce50be2e6 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:41.747416 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e8864455-ad26-4043-bc1e-97cce50be2e6 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:41.966233 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e8864455-ad26-4043-bc1e-97cce50be2e6 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450c14de401149bc8a24efb11e24b631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a69315bfb4723b95c9b79e0741b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:42.001315 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e8864455-ad26-4043-bc1e-97cce50be2e6 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "GET /compute/v2.1/servers/fbc88621-3d3a-4819-a1bd-d0515850bd01" status: 200 len: 1276 microversion: 2.1 time: 0.267384 Aug 04 16:46:42.002394 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1187/2354] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:41 2022] GET /compute/v2.1/servers/fbc88621-3d3a-4819-a1bd-d0515850bd01 => generated 1276 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:42.021188 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6fcb83f3-e523-435c-9682-84854fbe4e45 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:42.022693 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6fcb83f3-e523-435c-9682-84854fbe4e45 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:42.033733 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6fcb83f3-e523-435c-9682-84854fbe4e45 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:42.038279 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6fcb83f3-e523-435c-9682-84854fbe4e45 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:42.040156 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6fcb83f3-e523-435c-9682-84854fbe4e45 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:42.052943 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6fcb83f3-e523-435c-9682-84854fbe4e45 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:42.313472 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6fcb83f3-e523-435c-9682-84854fbe4e45 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:42.326954 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6fcb83f3-e523-435c-9682-84854fbe4e45 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:42.335653 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6fcb83f3-e523-435c-9682-84854fbe4e45 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:42.338945 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6fcb83f3-e523-435c-9682-84854fbe4e45 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1604 microversion: 2.32 time: 0.333423 Aug 04 16:46:42.344549 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1188/2355] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:46:42 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1604 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:46:42.352897 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-36104eef-7a5e-46ce-8742-1408673e4d72 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:42.361852 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-36104eef-7a5e-46ce-8742-1408673e4d72 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:42.382001 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-36104eef-7a5e-46ce-8742-1408673e4d72 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:42.382720 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-36104eef-7a5e-46ce-8742-1408673e4d72 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:42.384791 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-36104eef-7a5e-46ce-8742-1408673e4d72 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:42.386254 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-36104eef-7a5e-46ce-8742-1408673e4d72 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:42.486542 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-36104eef-7a5e-46ce-8742-1408673e4d72 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "POST /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433/action" status: 200 len: 14 microversion: 2.1 time: 0.140266 Aug 04 16:46:42.488247 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1189/2356] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:46:42 2022] POST /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:46:42.495234 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-82ae86cd-2d7d-4eb5-9a88-db1ee3521265 req-d695b88b-1209-43bc-9fd6-b67fd4138e00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6141949-1d15-4c84-8638-426cf7244dbd", "name": "network-vif-deleted", "tag": "922c5ddd-6ae1-49df-9bef-4c7ffa319e4e"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:42.518131 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-82ae86cd-2d7d-4eb5-9a88-db1ee3521265 req-d695b88b-1209-43bc-9fd6-b67fd4138e00 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:42.520105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-82ae86cd-2d7d-4eb5-9a88-db1ee3521265 req-d695b88b-1209-43bc-9fd6-b67fd4138e00 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:42.554539 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-82ae86cd-2d7d-4eb5-9a88-db1ee3521265 req-d695b88b-1209-43bc-9fd6-b67fd4138e00 service nova] Creating event network-vif-deleted:922c5ddd-6ae1-49df-9bef-4c7ffa319e4e for instance d6141949-1d15-4c84-8638-426cf7244dbd on n-h1-846466-12 Aug 04 16:46:42.570180 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-82ae86cd-2d7d-4eb5-9a88-db1ee3521265 req-d695b88b-1209-43bc-9fd6-b67fd4138e00 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079929 Aug 04 16:46:42.576491 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1190/2357] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:46:42.585042 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d3c42e38-912c-460f-854d-26ad0ec8e8c6 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:42.591772 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d3c42e38-912c-460f-854d-26ad0ec8e8c6 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:42.630209 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a1cace90-a2ea-40ba-b118-3a977af86d0d tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?reservation_id=r-0evy2k3j" status: 200 len: 2928 microversion: 2.1 time: 1.517015 Aug 04 16:46:42.646695 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1168/2358] 10.222.0.23 () {58 vars in 1197 bytes} [Thu Aug 4 16:46:41 2022] GET /compute/v2.1/servers/detail?reservation_id=r-0evy2k3j => generated 2928 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:42.659236 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-872c66e9-33d5-4e09-a9eb-b3044c4865b4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:42.660550 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-872c66e9-33d5-4e09-a9eb-b3044c4865b4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: d6141949-1d15-4c84-8638-426cf7244dbd] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:42.680850 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-872c66e9-33d5-4e09-a9eb-b3044c4865b4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:42.683421 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-872c66e9-33d5-4e09-a9eb-b3044c4865b4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:42.690618 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-872c66e9-33d5-4e09-a9eb-b3044c4865b4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:42.691863 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-872c66e9-33d5-4e09-a9eb-b3044c4865b4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:42.795387 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d3c42e38-912c-460f-854d-26ad0ec8e8c6 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:42.808265 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d3c42e38-912c-460f-854d-26ad0ec8e8c6 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61" status: 200 len: 1208 microversion: 2.1 time: 0.229956 Aug 04 16:46:42.812527 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1191/2359] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:42 2022] GET /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61 => generated 1208 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:42.826023 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-78c60533-8744-4571-b713-885768d26bf2 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:42.868614 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.compute.server_groups [None req-78c60533-8744-4571-b713-885768d26bf2 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Querying cell e056d029-674a-446e-ac9e-5108621d9db2(cell1) for 2 instances {{(pid=126125) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 04 16:46:42.870243 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-78c60533-8744-4571-b713-885768d26bf2 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:42.871161 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-78c60533-8744-4571-b713-885768d26bf2 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:42.919849 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-78c60533-8744-4571-b713-885768d26bf2 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/752ef6cd-d50c-4a56-b56f-fc340448c45d" status: 200 len: 270 microversion: 2.1 time: 0.104583 Aug 04 16:46:42.927590 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1192/2360] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Aug 4 16:46:42 2022] GET /compute/v2.1/os-server-groups/752ef6cd-d50c-4a56-b56f-fc340448c45d => generated 270 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:46:42.939644 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2816618e-05a5-4ecb-974c-f90ec8be1de0 tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:42.942419 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2816618e-05a5-4ecb-974c-f90ec8be1de0 tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] [instance: f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:42.960828 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2816618e-05a5-4ecb-974c-f90ec8be1de0 tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:42.961479 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2816618e-05a5-4ecb-974c-f90ec8be1de0 tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:42.962650 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2816618e-05a5-4ecb-974c-f90ec8be1de0 tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:42.963432 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2816618e-05a5-4ecb-974c-f90ec8be1de0 tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:42.964249 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-872c66e9-33d5-4e09-a9eb-b3044c4865b4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:42.974701 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-872c66e9-33d5-4e09-a9eb-b3044c4865b4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd" status: 200 len: 1294 microversion: 2.1 time: 0.326621 Aug 04 16:46:42.975784 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1169/2361] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:42 2022] GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd => generated 1294 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:43.024347 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-19dacae5-de1c-4958-829a-b1a810577bfd tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:43.025601 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-19dacae5-de1c-4958-829a-b1a810577bfd tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: fbc88621-3d3a-4819-a1bd-d0515850bd01] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:43.038085 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-19dacae5-de1c-4958-829a-b1a810577bfd tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:43.039454 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-19dacae5-de1c-4958-829a-b1a810577bfd tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:43.042159 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-19dacae5-de1c-4958-829a-b1a810577bfd tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:43.045174 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-19dacae5-de1c-4958-829a-b1a810577bfd tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:43.315865 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-19dacae5-de1c-4958-829a-b1a810577bfd tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450c14de401149bc8a24efb11e24b631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a69315bfb4723b95c9b79e0741b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:43.338041 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-19dacae5-de1c-4958-829a-b1a810577bfd tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "GET /compute/v2.1/servers/fbc88621-3d3a-4819-a1bd-d0515850bd01" status: 200 len: 1276 microversion: 2.1 time: 0.317181 Aug 04 16:46:43.349780 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1170/2362] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:43 2022] GET /compute/v2.1/servers/fbc88621-3d3a-4819-a1bd-d0515850bd01 => generated 1276 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:43.374939 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1aa0e888-d6bc-49db-b717-5a097f708108 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:43.375613 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1aa0e888-d6bc-49db-b717-5a097f708108 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:43.390414 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1aa0e888-d6bc-49db-b717-5a097f708108 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:43.391495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1aa0e888-d6bc-49db-b717-5a097f708108 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:43.394400 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1aa0e888-d6bc-49db-b717-5a097f708108 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:43.395462 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1aa0e888-d6bc-49db-b717-5a097f708108 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:44.020416 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1aa0e888-d6bc-49db-b717-5a097f708108 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:44.034134 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1aa0e888-d6bc-49db-b717-5a097f708108 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:44.039630 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1aa0e888-d6bc-49db-b717-5a097f708108 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:44.042018 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1aa0e888-d6bc-49db-b717-5a097f708108 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1604 microversion: 2.32 time: 0.673135 Aug 04 16:46:44.053538 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1171/2363] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:46:43 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1604 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:46:44.069824 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ee5b2e3e-5e19-4be0-bc85-e68a5b558460 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:44.073566 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ee5b2e3e-5e19-4be0-bc85-e68a5b558460 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:44.084162 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ee5b2e3e-5e19-4be0-bc85-e68a5b558460 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:44.085890 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ee5b2e3e-5e19-4be0-bc85-e68a5b558460 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:44.087457 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ee5b2e3e-5e19-4be0-bc85-e68a5b558460 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:44.089132 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ee5b2e3e-5e19-4be0-bc85-e68a5b558460 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:44.156197 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ee5b2e3e-5e19-4be0-bc85-e68a5b558460 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "POST /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433/action" status: 200 len: 14 microversion: 2.1 time: 0.099706 Aug 04 16:46:44.158260 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1172/2364] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:46:44 2022] POST /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:46:44.165686 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-4bf1c7e6-11e4-41d9-98c2-b91619109383 req-54e85152-c25f-4889-9d43-45393e57dbaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40121d67-65d4-4a6b-ae3f-6a85d3c99e46", "tag": "69742927-466e-479d-bc59-c96d132c5421"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:44.184832 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-4bf1c7e6-11e4-41d9-98c2-b91619109383 req-54e85152-c25f-4889-9d43-45393e57dbaf service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:44.186152 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-4bf1c7e6-11e4-41d9-98c2-b91619109383 req-54e85152-c25f-4889-9d43-45393e57dbaf service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:44.208705 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-4bf1c7e6-11e4-41d9-98c2-b91619109383 req-54e85152-c25f-4889-9d43-45393e57dbaf service nova] Creating event network-changed:69742927-466e-479d-bc59-c96d132c5421 for instance 40121d67-65d4-4a6b-ae3f-6a85d3c99e46 on n-h1-846466-12 Aug 04 16:46:44.216721 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-4bf1c7e6-11e4-41d9-98c2-b91619109383 req-54e85152-c25f-4889-9d43-45393e57dbaf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055610 Aug 04 16:46:44.218061 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1173/2365] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:46:44.226691 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f062a1d8-ffd7-44fd-84ae-6bfbe1989693 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:44.227717 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f062a1d8-ffd7-44fd-84ae-6bfbe1989693 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:44.235495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f062a1d8-ffd7-44fd-84ae-6bfbe1989693 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:44.236384 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f062a1d8-ffd7-44fd-84ae-6bfbe1989693 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:44.237469 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f062a1d8-ffd7-44fd-84ae-6bfbe1989693 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:44.238145 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f062a1d8-ffd7-44fd-84ae-6bfbe1989693 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:44.351761 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2816618e-05a5-4ecb-974c-f90ec8be1de0 tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be" status: 200 len: 1620 microversion: 2.1 time: 1.413136 Aug 04 16:46:44.353583 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1193/2366] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:42 2022] GET /compute/v2.1/servers/f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be => generated 1620 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:46:44.375162 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-13d93635-3d56-4282-9e2e-997d747cb9f3 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:44.377749 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-13d93635-3d56-4282-9e2e-997d747cb9f3 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: d6141949-1d15-4c84-8638-426cf7244dbd] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:44.391586 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-13d93635-3d56-4282-9e2e-997d747cb9f3 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:44.392902 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-13d93635-3d56-4282-9e2e-997d747cb9f3 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:44.394867 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-13d93635-3d56-4282-9e2e-997d747cb9f3 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:44.395781 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-13d93635-3d56-4282-9e2e-997d747cb9f3 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:44.473146 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f062a1d8-ffd7-44fd-84ae-6bfbe1989693 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:44.490609 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f062a1d8-ffd7-44fd-84ae-6bfbe1989693 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61" status: 200 len: 1266 microversion: 2.1 time: 0.270751 Aug 04 16:46:44.491432 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1174/2367] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:44 2022] GET /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61 => generated 1266 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:44.498845 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-95c18107-17b4-4bb3-9ce4-2b335e698f5f tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:44.499686 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-95c18107-17b4-4bb3-9ce4-2b335e698f5f tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] [instance: 3c687b7a-617f-46d4-b1c1-c629814fac1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:44.513340 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-95c18107-17b4-4bb3-9ce4-2b335e698f5f tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:44.515462 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-95c18107-17b4-4bb3-9ce4-2b335e698f5f tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:44.518092 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-95c18107-17b4-4bb3-9ce4-2b335e698f5f tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:44.518955 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-95c18107-17b4-4bb3-9ce4-2b335e698f5f tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:44.639598 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-13d93635-3d56-4282-9e2e-997d747cb9f3 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:44.659300 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-13d93635-3d56-4282-9e2e-997d747cb9f3 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd" status: 200 len: 1294 microversion: 2.1 time: 0.301583 Aug 04 16:46:44.659956 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1194/2368] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:44 2022] GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd => generated 1294 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:44.700227 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-747facf6-47c1-4467-a17f-69469a976a8c tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:44.702288 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-747facf6-47c1-4467-a17f-69469a976a8c tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: fbc88621-3d3a-4819-a1bd-d0515850bd01] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:44.729608 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-747facf6-47c1-4467-a17f-69469a976a8c tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:44.730689 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-747facf6-47c1-4467-a17f-69469a976a8c tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:44.733622 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-747facf6-47c1-4467-a17f-69469a976a8c tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:44.734388 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-747facf6-47c1-4467-a17f-69469a976a8c tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:45.081988 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-95c18107-17b4-4bb3-9ce4-2b335e698f5f tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3c687b7a-617f-46d4-b1c1-c629814fac1a" status: 200 len: 1621 microversion: 2.1 time: 0.587560 Aug 04 16:46:45.083903 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1175/2369] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:44 2022] GET /compute/v2.1/servers/3c687b7a-617f-46d4-b1c1-c629814fac1a => generated 1621 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:45.104083 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-02ff2bcd-dadb-4df8-8ccc-a5ea568dd64a tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:45.106035 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-02ff2bcd-dadb-4df8-8ccc-a5ea568dd64a tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:45.132057 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-02ff2bcd-dadb-4df8-8ccc-a5ea568dd64a tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:45.132535 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-02ff2bcd-dadb-4df8-8ccc-a5ea568dd64a tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:45.139503 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-02ff2bcd-dadb-4df8-8ccc-a5ea568dd64a tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:45.140832 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-02ff2bcd-dadb-4df8-8ccc-a5ea568dd64a tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:45.224474 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-747facf6-47c1-4467-a17f-69469a976a8c tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450c14de401149bc8a24efb11e24b631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a69315bfb4723b95c9b79e0741b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:45.227156 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:46:45.252696 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-747facf6-47c1-4467-a17f-69469a976a8c tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "GET /compute/v2.1/servers/fbc88621-3d3a-4819-a1bd-d0515850bd01" status: 200 len: 1276 microversion: 2.1 time: 0.569460 Aug 04 16:46:45.275116 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1195/2370] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:44 2022] GET /compute/v2.1/servers/fbc88621-3d3a-4819-a1bd-d0515850bd01 => generated 1276 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:45.298524 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-19d552c6-5ffa-460f-9c2e-42de2e67ae38 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:45.304151 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-19d552c6-5ffa-460f-9c2e-42de2e67ae38 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:45.335156 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-19d552c6-5ffa-460f-9c2e-42de2e67ae38 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:45.336319 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-02ff2bcd-dadb-4df8-8ccc-a5ea568dd64a tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:45.338802 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-19d552c6-5ffa-460f-9c2e-42de2e67ae38 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:45.349170 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-19d552c6-5ffa-460f-9c2e-42de2e67ae38 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:45.350416 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-19d552c6-5ffa-460f-9c2e-42de2e67ae38 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:45.369430 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-02ff2bcd-dadb-4df8-8ccc-a5ea568dd64a tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:45.375948 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-02ff2bcd-dadb-4df8-8ccc-a5ea568dd64a tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:45.383959 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-02ff2bcd-dadb-4df8-8ccc-a5ea568dd64a tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1604 microversion: 2.32 time: 0.294638 Aug 04 16:46:45.390515 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1176/2371] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:46:45 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1604 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:46:45.399277 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-515e176f-8a1f-4a9d-910b-f3930368e031 req-884ad44d-ae32-48c6-95bd-2de32d77b48f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45b975d2-057f-4aae-9e4b-95b8ed28c805", "name": "network-vif-deleted", "tag": "30523aff-f8cc-4a84-b24c-70715dfaed14"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:45.465231 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-515e176f-8a1f-4a9d-910b-f3930368e031 req-884ad44d-ae32-48c6-95bd-2de32d77b48f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:45.474518 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-515e176f-8a1f-4a9d-910b-f3930368e031 req-884ad44d-ae32-48c6-95bd-2de32d77b48f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:45.488874 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-19d552c6-5ffa-460f-9c2e-42de2e67ae38 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "POST /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433/action" status: 200 len: 14 microversion: 2.1 time: 0.211915 Aug 04 16:46:45.494086 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1196/2372] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:46:45 2022] POST /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433/action => generated 14 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:46:45.499963 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-53418ddd-598c-49a5-b2d5-aada34d0d885 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-155829232", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "86667237-3005-4ee4-83d6-c250bba481d5"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:45.513105 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-515e176f-8a1f-4a9d-910b-f3930368e031 req-884ad44d-ae32-48c6-95bd-2de32d77b48f service nova] Creating event network-vif-deleted:30523aff-f8cc-4a84-b24c-70715dfaed14 for instance 45b975d2-057f-4aae-9e4b-95b8ed28c805 on n-h1-846466-12 Aug 04 16:46:45.533665 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-515e176f-8a1f-4a9d-910b-f3930368e031 req-884ad44d-ae32-48c6-95bd-2de32d77b48f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141627 Aug 04 16:46:45.536875 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1177/2373] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:46:45.562697 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5ad2b7f4-050a-40be-93ec-d4baa3640ad3 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:45.564604 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5ad2b7f4-050a-40be-93ec-d4baa3640ad3 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:45.578661 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ad2b7f4-050a-40be-93ec-d4baa3640ad3 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:45.582260 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ad2b7f4-050a-40be-93ec-d4baa3640ad3 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:45.584079 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ad2b7f4-050a-40be-93ec-d4baa3640ad3 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:45.585382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ad2b7f4-050a-40be-93ec-d4baa3640ad3 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:45.652511 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-53418ddd-598c-49a5-b2d5-aada34d0d885 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] validate_networks() for None {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:46:45.987149 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5ad2b7f4-050a-40be-93ec-d4baa3640ad3 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:46.008693 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5ad2b7f4-050a-40be-93ec-d4baa3640ad3 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61" status: 200 len: 1266 microversion: 2.1 time: 0.464871 Aug 04 16:46:46.010039 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1178/2374] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:45 2022] GET /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61 => generated 1266 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:46.016211 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-030caace-ba3d-4ef4-b53d-7040e9e06974 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:46.017091 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-030caace-ba3d-4ef4-b53d-7040e9e06974 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: d6141949-1d15-4c84-8638-426cf7244dbd] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:46.033863 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-030caace-ba3d-4ef4-b53d-7040e9e06974 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:46.034250 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-030caace-ba3d-4ef4-b53d-7040e9e06974 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:46.035307 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-030caace-ba3d-4ef4-b53d-7040e9e06974 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:46.036151 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-030caace-ba3d-4ef4-b53d-7040e9e06974 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:46.226721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-030caace-ba3d-4ef4-b53d-7040e9e06974 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:46.245787 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-030caace-ba3d-4ef4-b53d-7040e9e06974 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd" status: 200 len: 1294 microversion: 2.1 time: 0.234330 Aug 04 16:46:46.246811 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1179/2375] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:46 2022] GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd => generated 1294 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:46.282664 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8f21fc0d-b0e8-416d-bce1-43a741669b67 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:46.283321 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8f21fc0d-b0e8-416d-bce1-43a741669b67 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: fbc88621-3d3a-4819-a1bd-d0515850bd01] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:46.293649 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8f21fc0d-b0e8-416d-bce1-43a741669b67 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:46.294098 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8f21fc0d-b0e8-416d-bce1-43a741669b67 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:46.294274 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-53418ddd-598c-49a5-b2d5-aada34d0d885 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:46:46.294890 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8f21fc0d-b0e8-416d-bce1-43a741669b67 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:46.295197 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-53418ddd-598c-49a5-b2d5-aada34d0d885 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:46:46.295336 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8f21fc0d-b0e8-416d-bce1-43a741669b67 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:46.296196 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-53418ddd-598c-49a5-b2d5-aada34d0d885 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:46:46.298409 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-53418ddd-598c-49a5-b2d5-aada34d0d885 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:46:46.299520 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-53418ddd-598c-49a5-b2d5-aada34d0d885 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:46:46.328279 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-53418ddd-598c-49a5-b2d5-aada34d0d885 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:46.328789 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-53418ddd-598c-49a5-b2d5-aada34d0d885 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:46.329688 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-53418ddd-598c-49a5-b2d5-aada34d0d885 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:46.330196 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-53418ddd-598c-49a5-b2d5-aada34d0d885 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:46.385113 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-53418ddd-598c-49a5-b2d5-aada34d0d885 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for project b9e709c95a964cd5855d4e253aeb1043. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:46:46.394976 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-53418ddd-598c-49a5-b2d5-aada34d0d885 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for user 336c26b5dd6644bc83f9b80adac06bce and project b9e709c95a964cd5855d4e253aeb1043. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:46:46.417491 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-53418ddd-598c-49a5-b2d5-aada34d0d885 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:46:46.420405 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-53418ddd-598c-49a5-b2d5-aada34d0d885 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 2290ea80-011c-47ab-b4a9-620f1a8f5631] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:46:46.480193 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-53418ddd-598c-49a5-b2d5-aada34d0d885 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.984477 Aug 04 16:46:46.481679 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1197/2376] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:46:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:46:46.491396 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fb24ed6e-e9a9-44c9-bfd2-da6b66513629 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:46.492838 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fb24ed6e-e9a9-44c9-bfd2-da6b66513629 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:46.506873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fb24ed6e-e9a9-44c9-bfd2-da6b66513629 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:46.510815 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fb24ed6e-e9a9-44c9-bfd2-da6b66513629 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:46.513198 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fb24ed6e-e9a9-44c9-bfd2-da6b66513629 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:46.513904 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fb24ed6e-e9a9-44c9-bfd2-da6b66513629 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:46.905938 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fb24ed6e-e9a9-44c9-bfd2-da6b66513629 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:46.929503 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fb24ed6e-e9a9-44c9-bfd2-da6b66513629 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:46.931561 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fb24ed6e-e9a9-44c9-bfd2-da6b66513629 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:46.933143 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fb24ed6e-e9a9-44c9-bfd2-da6b66513629 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1604 microversion: 2.32 time: 0.450174 Aug 04 16:46:46.934054 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1198/2377] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:46:46 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1604 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:46:46.939638 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3af92011-e523-4b96-821b-2240d83fafd7 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:46.943835 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3af92011-e523-4b96-821b-2240d83fafd7 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 2290ea80-011c-47ab-b4a9-620f1a8f5631] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:47.060003 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3af92011-e523-4b96-821b-2240d83fafd7 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:47.065098 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8f21fc0d-b0e8-416d-bce1-43a741669b67 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450c14de401149bc8a24efb11e24b631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a69315bfb4723b95c9b79e0741b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:47.075882 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3af92011-e523-4b96-821b-2240d83fafd7 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/2290ea80-011c-47ab-b4a9-620f1a8f5631" status: 200 len: 1216 microversion: 2.1 time: 0.140400 Aug 04 16:46:47.076586 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1199/2378] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:46 2022] GET /compute/v2.1/servers/2290ea80-011c-47ab-b4a9-620f1a8f5631 => generated 1216 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:47.078748 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8f21fc0d-b0e8-416d-bce1-43a741669b67 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "GET /compute/v2.1/servers/fbc88621-3d3a-4819-a1bd-d0515850bd01" status: 200 len: 1318 microversion: 2.1 time: 0.800575 Aug 04 16:46:47.081546 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1180/2379] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:46 2022] GET /compute/v2.1/servers/fbc88621-3d3a-4819-a1bd-d0515850bd01 => generated 1318 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:47.099774 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ada48323-e42a-48ce-acfd-6fee9613fe7c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:47.102324 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ada48323-e42a-48ce-acfd-6fee9613fe7c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:47.112051 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dcedf6df-544a-4016-a284-c4ac9be50be1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:47.119851 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dcedf6df-544a-4016-a284-c4ac9be50be1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:47.123257 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ada48323-e42a-48ce-acfd-6fee9613fe7c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:47.124763 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ada48323-e42a-48ce-acfd-6fee9613fe7c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:47.127642 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ada48323-e42a-48ce-acfd-6fee9613fe7c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:47.130895 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ada48323-e42a-48ce-acfd-6fee9613fe7c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:47.141046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dcedf6df-544a-4016-a284-c4ac9be50be1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:47.143828 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dcedf6df-544a-4016-a284-c4ac9be50be1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:47.145221 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dcedf6df-544a-4016-a284-c4ac9be50be1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:47.146046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dcedf6df-544a-4016-a284-c4ac9be50be1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:47.277421 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dcedf6df-544a-4016-a284-c4ac9be50be1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "POST /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433/action" status: 200 len: 14 microversion: 2.1 time: 0.198423 Aug 04 16:46:47.279602 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1200/2380] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:46:47 2022] POST /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433/action => generated 14 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:46:47.303423 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9fbe788a-709b-4626-9543-ec1ecd21bd3d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:47.307045 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9fbe788a-709b-4626-9543-ec1ecd21bd3d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: d6141949-1d15-4c84-8638-426cf7244dbd] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:47.325835 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9fbe788a-709b-4626-9543-ec1ecd21bd3d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:47.327389 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9fbe788a-709b-4626-9543-ec1ecd21bd3d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:47.329468 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9fbe788a-709b-4626-9543-ec1ecd21bd3d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:47.330725 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9fbe788a-709b-4626-9543-ec1ecd21bd3d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:47.744159 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9fbe788a-709b-4626-9543-ec1ecd21bd3d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:47.773206 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9fbe788a-709b-4626-9543-ec1ecd21bd3d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd" status: 200 len: 1294 microversion: 2.1 time: 0.490988 Aug 04 16:46:47.778306 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1201/2381] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:47 2022] GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd => generated 1294 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:47.799998 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-40ab5d43-53f0-42a5-9539-19a4fe209e29 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "278f36e9-5430-4136-b12b-b945029fac1d"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:47.807366 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-40ab5d43-53f0-42a5-9539-19a4fe209e29 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: befbf568-78f2-4571-bf63-fdac57291b28] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:47.834388 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-40ab5d43-53f0-42a5-9539-19a4fe209e29 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:47.834937 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-40ab5d43-53f0-42a5-9539-19a4fe209e29 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:47.836083 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-40ab5d43-53f0-42a5-9539-19a4fe209e29 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:47.836736 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-40ab5d43-53f0-42a5-9539-19a4fe209e29 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:48.349556 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ada48323-e42a-48ce-acfd-6fee9613fe7c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:48.354001 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-40ab5d43-53f0-42a5-9539-19a4fe209e29 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "POST /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.568028 Aug 04 16:46:48.355991 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1202/2382] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Aug 4 16:46:47 2022] POST /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28/os-volume_attachments => generated 194 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:46:48.368078 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dde61bb9-cfc2-4e67-8b47-ad59aedbfed8 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:48.371362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dde61bb9-cfc2-4e67-8b47-ad59aedbfed8 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:48.384641 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ada48323-e42a-48ce-acfd-6fee9613fe7c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61" status: 200 len: 1308 microversion: 2.1 time: 1.301283 Aug 04 16:46:48.385745 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1181/2383] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:47 2022] GET /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61 => generated 1308 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:48.410390 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dde61bb9-cfc2-4e67-8b47-ad59aedbfed8 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:48.410390 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dde61bb9-cfc2-4e67-8b47-ad59aedbfed8 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:48.410390 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dde61bb9-cfc2-4e67-8b47-ad59aedbfed8 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:48.410390 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dde61bb9-cfc2-4e67-8b47-ad59aedbfed8 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:48.411042 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-036f0c6d-227c-43a0-93c4-abec20e0b716 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:48.411042 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-036f0c6d-227c-43a0-93c4-abec20e0b716 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: fbc88621-3d3a-4819-a1bd-d0515850bd01] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:48.429675 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-036f0c6d-227c-43a0-93c4-abec20e0b716 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:48.431297 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-036f0c6d-227c-43a0-93c4-abec20e0b716 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:48.435664 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-036f0c6d-227c-43a0-93c4-abec20e0b716 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:48.435664 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-036f0c6d-227c-43a0-93c4-abec20e0b716 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:48.671314 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dde61bb9-cfc2-4e67-8b47-ad59aedbfed8 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:48.688562 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dde61bb9-cfc2-4e67-8b47-ad59aedbfed8 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:48.690417 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dde61bb9-cfc2-4e67-8b47-ad59aedbfed8 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:48.691676 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dde61bb9-cfc2-4e67-8b47-ad59aedbfed8 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1604 microversion: 2.32 time: 0.332476 Aug 04 16:46:48.692287 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1203/2384] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:46:48 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1604 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:46:48.709479 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8fbdfd23-ffa9-447f-b989-7b07c1c07331 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:48.710399 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8fbdfd23-ffa9-447f-b989-7b07c1c07331 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 2290ea80-011c-47ab-b4a9-620f1a8f5631] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:48.721862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8fbdfd23-ffa9-447f-b989-7b07c1c07331 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:48.738567 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8fbdfd23-ffa9-447f-b989-7b07c1c07331 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:48.740660 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8fbdfd23-ffa9-447f-b989-7b07c1c07331 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:48.743887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8fbdfd23-ffa9-447f-b989-7b07c1c07331 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:49.337841 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8fbdfd23-ffa9-447f-b989-7b07c1c07331 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:49.355041 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8fbdfd23-ffa9-447f-b989-7b07c1c07331 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/2290ea80-011c-47ab-b4a9-620f1a8f5631" status: 200 len: 1274 microversion: 2.1 time: 0.661308 Aug 04 16:46:49.358115 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1204/2385] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:48 2022] GET /compute/v2.1/servers/2290ea80-011c-47ab-b4a9-620f1a8f5631 => generated 1274 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:49.368374 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f0a273ca-4893-4427-9b77-a383d25cd1a2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:49.372897 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f0a273ca-4893-4427-9b77-a383d25cd1a2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:49.389597 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f0a273ca-4893-4427-9b77-a383d25cd1a2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:49.394379 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f0a273ca-4893-4427-9b77-a383d25cd1a2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:49.401097 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f0a273ca-4893-4427-9b77-a383d25cd1a2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:49.408953 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f0a273ca-4893-4427-9b77-a383d25cd1a2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:49.505340 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f0a273ca-4893-4427-9b77-a383d25cd1a2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "POST /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433/action" status: 200 len: 8207 microversion: 2.1 time: 0.144728 Aug 04 16:46:49.506485 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1205/2386] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:46:49 2022] POST /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433/action => generated 8207 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:49.512752 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4f7196de-51b3-4d28-8aa7-c512e29b524c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:49.513511 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4f7196de-51b3-4d28-8aa7-c512e29b524c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: d6141949-1d15-4c84-8638-426cf7244dbd] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:49.522120 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4f7196de-51b3-4d28-8aa7-c512e29b524c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:49.522518 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4f7196de-51b3-4d28-8aa7-c512e29b524c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:49.523480 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4f7196de-51b3-4d28-8aa7-c512e29b524c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:49.523763 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4f7196de-51b3-4d28-8aa7-c512e29b524c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:49.544212 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-4f7196de-51b3-4d28-8aa7-c512e29b524c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] HTTP exception thrown: Instance d6141949-1d15-4c84-8638-426cf7244dbd could not be found. Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4f7196de-51b3-4d28-8aa7-c512e29b524c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Request method failure captured: Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd HTTP/1.1 Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_ddGi-LUxEkOI7UNq-ijU5XnirMgjjOPky_n4iIeohsp_mBZi36CDxRY5dUKGmgKLroDx6IsvA3hey_uA7LPQbZI4NWhaCZQIOIkAKlIttRUGlU4y_AMkv45dQEQsQ8xd9VhN5XbmaVn_f0gvdFbALtWn0QI5OJtAeQ50IP8tuO8i0 Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/60281cf1dbe645d8949e93f9e70b5d91"}]}] Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 3cfb4739b53b411391a26de37b98469f Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance d6141949-1d15-4c84-8638-426cf7244dbd could not be found. Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'd6141949-1d15-4c84-8638-426cf7244dbd'} Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6141949-1d15-4c84-8638-426cf7244dbd could not be found. Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6141949-1d15-4c84-8638-426cf7244dbd could not be found. Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:46:49.546430 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:46:49.551799 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:46:49.551799 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:46:49.551799 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:46:49.551799 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:46:49.551799 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:46:49.551799 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6141949-1d15-4c84-8638-426cf7244dbd could not be found. Aug 04 16:46:49.551799 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:46:49.551799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4f7196de-51b3-4d28-8aa7-c512e29b524c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Returning 404 to user: Instance d6141949-1d15-4c84-8638-426cf7244dbd could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:46:49.551799 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4f7196de-51b3-4d28-8aa7-c512e29b524c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd" status: 404 len: 111 microversion: 2.1 time: 0.039749 Aug 04 16:46:49.555786 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1206/2387] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:49 2022] GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:46:49.561403 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c2db562d-87e0-4c21-be0e-aea8a4c4f417 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:49.562057 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c2db562d-87e0-4c21-be0e-aea8a4c4f417 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:49.569969 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2db562d-87e0-4c21-be0e-aea8a4c4f417 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:49.570249 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2db562d-87e0-4c21-be0e-aea8a4c4f417 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:49.571140 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2db562d-87e0-4c21-be0e-aea8a4c4f417 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:49.572509 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2db562d-87e0-4c21-be0e-aea8a4c4f417 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:49.841895 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-036f0c6d-227c-43a0-93c4-abec20e0b716 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450c14de401149bc8a24efb11e24b631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a69315bfb4723b95c9b79e0741b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:49.854157 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-036f0c6d-227c-43a0-93c4-abec20e0b716 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "GET /compute/v2.1/servers/fbc88621-3d3a-4819-a1bd-d0515850bd01" status: 200 len: 1318 microversion: 2.1 time: 1.462940 Aug 04 16:46:49.855364 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1182/2388] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:48 2022] GET /compute/v2.1/servers/fbc88621-3d3a-4819-a1bd-d0515850bd01 => generated 1318 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:49.863330 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f4b1c691-508f-439c-b633-dc98a99e51ff tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:49.864002 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f4b1c691-508f-439c-b633-dc98a99e51ff tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:49.873654 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f4b1c691-508f-439c-b633-dc98a99e51ff tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:49.874618 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f4b1c691-508f-439c-b633-dc98a99e51ff tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:49.875784 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f4b1c691-508f-439c-b633-dc98a99e51ff tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:49.876505 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f4b1c691-508f-439c-b633-dc98a99e51ff tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:50.466367 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c2db562d-87e0-4c21-be0e-aea8a4c4f417 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:50.477129 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c2db562d-87e0-4c21-be0e-aea8a4c4f417 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61" status: 200 len: 1308 microversion: 2.1 time: 0.920088 Aug 04 16:46:50.478099 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1207/2389] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:49 2022] GET /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61 => generated 1308 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:50.497395 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1fd5c2ff-e09d-4057-a6fb-1d8950e46324 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1452870240", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "fd9ba46f-9583-4f53-9ced-a3b1af7aa6df"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:50.577724 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-1fd5c2ff-e09d-4057-a6fb-1d8950e46324 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] validate_networks() for [('fd9ba46f-9583-4f53-9ced-a3b1af7aa6df', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:46:50.696246 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f4b1c691-508f-439c-b633-dc98a99e51ff tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:50.715129 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f4b1c691-508f-439c-b633-dc98a99e51ff tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.855863 Aug 04 16:46:50.717821 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1183/2390] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:49 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:50.725596 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5d14ee29-ce1d-4b14-988b-bbd33879c5e3 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:50.727128 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5d14ee29-ce1d-4b14-988b-bbd33879c5e3 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:50.736502 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5d14ee29-ce1d-4b14-988b-bbd33879c5e3 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:50.738395 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5d14ee29-ce1d-4b14-988b-bbd33879c5e3 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:50.739796 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5d14ee29-ce1d-4b14-988b-bbd33879c5e3 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:50.740574 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5d14ee29-ce1d-4b14-988b-bbd33879c5e3 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:51.058059 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5d14ee29-ce1d-4b14-988b-bbd33879c5e3 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:51.070453 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5d14ee29-ce1d-4b14-988b-bbd33879c5e3 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:51.072749 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5d14ee29-ce1d-4b14-988b-bbd33879c5e3 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3d49f848ba4735a2ed7b077d6789d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfc77ffb53d4f53b5afc9d0b6313cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:51.074467 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5d14ee29-ce1d-4b14-988b-bbd33879c5e3 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 200 len: 1604 microversion: 2.32 time: 0.354648 Aug 04 16:46:51.075264 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1184/2391] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:46:50 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 1604 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:46:51.081508 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-82e78856-d9f3-4535-9d7f-d1344eaad789 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:51.082435 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-82e78856-d9f3-4535-9d7f-d1344eaad789 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 2290ea80-011c-47ab-b4a9-620f1a8f5631] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:51.089591 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-82e78856-d9f3-4535-9d7f-d1344eaad789 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:51.090333 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-82e78856-d9f3-4535-9d7f-d1344eaad789 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:51.091334 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-82e78856-d9f3-4535-9d7f-d1344eaad789 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:51.091983 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-82e78856-d9f3-4535-9d7f-d1344eaad789 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:51.234481 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=4 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:46:51.303884 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-82e78856-d9f3-4535-9d7f-d1344eaad789 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:51.328731 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-82e78856-d9f3-4535-9d7f-d1344eaad789 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/2290ea80-011c-47ab-b4a9-620f1a8f5631" status: 200 len: 1274 microversion: 2.1 time: 0.251070 Aug 04 16:46:51.358354 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1185/2392] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:51 2022] GET /compute/v2.1/servers/2290ea80-011c-47ab-b4a9-620f1a8f5631 => generated 1274 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:51.365247 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-da4a421f-bbb8-45a2-a99b-454d75d3205c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:51.366161 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-da4a421f-bbb8-45a2-a99b-454d75d3205c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:51.377276 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-da4a421f-bbb8-45a2-a99b-454d75d3205c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:51.378650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-da4a421f-bbb8-45a2-a99b-454d75d3205c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:51.379895 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-da4a421f-bbb8-45a2-a99b-454d75d3205c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:51.380502 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-da4a421f-bbb8-45a2-a99b-454d75d3205c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:51.411967 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=100 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:46:51.461733 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=8 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:46:52.364835 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-da4a421f-bbb8-45a2-a99b-454d75d3205c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:52.377759 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-da4a421f-bbb8-45a2-a99b-454d75d3205c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 1.017956 Aug 04 16:46:52.379307 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1186/2393] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:51 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:52.385256 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5e3c9856-ceff-4763-bb8d-5102d6117d85 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:52.387212 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5e3c9856-ceff-4763-bb8d-5102d6117d85 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: fbc88621-3d3a-4819-a1bd-d0515850bd01] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:52.400132 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e3c9856-ceff-4763-bb8d-5102d6117d85 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:52.402063 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e3c9856-ceff-4763-bb8d-5102d6117d85 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:52.403182 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e3c9856-ceff-4763-bb8d-5102d6117d85 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:52.403803 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e3c9856-ceff-4763-bb8d-5102d6117d85 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:52.928111 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-1fd5c2ff-e09d-4057-a6fb-1d8950e46324 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:46:52.928732 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-1fd5c2ff-e09d-4057-a6fb-1d8950e46324 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:46:52.929002 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-1fd5c2ff-e09d-4057-a6fb-1d8950e46324 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:46:52.931097 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-1fd5c2ff-e09d-4057-a6fb-1d8950e46324 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:46:52.931097 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-1fd5c2ff-e09d-4057-a6fb-1d8950e46324 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:46:52.949154 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1fd5c2ff-e09d-4057-a6fb-1d8950e46324 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:52.952795 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1fd5c2ff-e09d-4057-a6fb-1d8950e46324 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:52.956799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1fd5c2ff-e09d-4057-a6fb-1d8950e46324 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:52.958010 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1fd5c2ff-e09d-4057-a6fb-1d8950e46324 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:53.075498 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-1fd5c2ff-e09d-4057-a6fb-1d8950e46324 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Getting quotas for project 60281cf1dbe645d8949e93f9e70b5d91. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:46:53.099466 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-1fd5c2ff-e09d-4057-a6fb-1d8950e46324 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Getting quotas for user 3cfb4739b53b411391a26de37b98469f and project 60281cf1dbe645d8949e93f9e70b5d91. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:46:53.138108 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1fd5c2ff-e09d-4057-a6fb-1d8950e46324 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:46:53.147049 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1fd5c2ff-e09d-4057-a6fb-1d8950e46324 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea0f2c5d-c250-4617-9edd-03a8a74d1e2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:46:53.328070 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1fd5c2ff-e09d-4057-a6fb-1d8950e46324 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.820035 Aug 04 16:46:53.329157 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1208/2394] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:46:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:46:53.342524 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-59726e10-5181-4308-93e0-da40cca7d1c0 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:53.343573 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-59726e10-5181-4308-93e0-da40cca7d1c0 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:53.356572 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-59726e10-5181-4308-93e0-da40cca7d1c0 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:53.365181 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-59726e10-5181-4308-93e0-da40cca7d1c0 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:53.388775 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-59726e10-5181-4308-93e0-da40cca7d1c0 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:53.391776 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-59726e10-5181-4308-93e0-da40cca7d1c0 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:53.576678 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5e3c9856-ceff-4763-bb8d-5102d6117d85 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450c14de401149bc8a24efb11e24b631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a69315bfb4723b95c9b79e0741b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:53.616506 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5e3c9856-ceff-4763-bb8d-5102d6117d85 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "GET /compute/v2.1/servers/fbc88621-3d3a-4819-a1bd-d0515850bd01" status: 200 len: 1318 microversion: 2.1 time: 1.234165 Aug 04 16:46:53.626692 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1187/2395] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:52 2022] GET /compute/v2.1/servers/fbc88621-3d3a-4819-a1bd-d0515850bd01 => generated 1318 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:53.653970 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a190e13b-7450-4a5a-a14e-33e9df7e33c4 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:53.655062 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a190e13b-7450-4a5a-a14e-33e9df7e33c4 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:53.694642 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a190e13b-7450-4a5a-a14e-33e9df7e33c4 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:53.696077 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a190e13b-7450-4a5a-a14e-33e9df7e33c4 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:53.708025 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a190e13b-7450-4a5a-a14e-33e9df7e33c4 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:53.710352 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a190e13b-7450-4a5a-a14e-33e9df7e33c4 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:53.750828 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-a190e13b-7450-4a5a-a14e-33e9df7e33c4 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] HTTP exception thrown: Instance 09e1b482-0372-4270-ac25-6d3349aca31e could not be found. Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a190e13b-7450-4a5a-a14e-33e9df7e33c4 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Request method failure captured: Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e HTTP/1.1 Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_Ycu9CFgkTmHkUIsjjoTC-2WpUUEJdORjLDMzHP8xN-D-RLzPx04S-tUUmZY50Rq19hFYUNWlYkI3X1SOERilRo3RTH7SeHxPFXV9NmGPGvnIzzMRfCVpm6H6hA6QpQvT3Ne2R7Z_2OOERUbJymFc5wcx8Y319h_F9Na7Z0kGUX3zE Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: X-Openstack-Nova-Api-Version: 2.32 Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 6bfc77ffb53d4f53b5afc9d0b6313cf5 Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-TaggedBootDevicesTest-786050424 Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6bfc77ffb53d4f53b5afc9d0b6313cf5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6bfc77ffb53d4f53b5afc9d0b6313cf5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6bfc77ffb53d4f53b5afc9d0b6313cf5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6bfc77ffb53d4f53b5afc9d0b6313cf5"}]}] Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-TaggedBootDevicesTest-786050424 Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 6bfc77ffb53d4f53b5afc9d0b6313cf5 Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-TaggedBootDevicesTest-786050424 Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-TaggedBootDevicesTest-786050424-project Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 5d3d49f848ba4735a2ed7b077d6789d5 Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-TaggedBootDevicesTest-786050424-project Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 09e1b482-0372-4270-ac25-6d3349aca31e could not be found. Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '09e1b482-0372-4270-ac25-6d3349aca31e'} Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09e1b482-0372-4270-ac25-6d3349aca31e could not be found. Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09e1b482-0372-4270-ac25-6d3349aca31e could not be found. Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:46:53.757562 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:46:53.762097 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:46:53.762097 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:46:53.762097 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:46:53.762097 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:46:53.762097 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:46:53.762097 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09e1b482-0372-4270-ac25-6d3349aca31e could not be found. Aug 04 16:46:53.762097 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:46:53.762097 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a190e13b-7450-4a5a-a14e-33e9df7e33c4 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Returning 404 to user: Instance 09e1b482-0372-4270-ac25-6d3349aca31e could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:46:53.762097 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a190e13b-7450-4a5a-a14e-33e9df7e33c4 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 404 len: 111 microversion: 2.32 time: 0.130765 Aug 04 16:46:53.768752 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1188/2396] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:46:53 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:46:53.789022 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6685c602-efc5-43dd-8e25-784923a87a04 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:53.789773 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6685c602-efc5-43dd-8e25-784923a87a04 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 2290ea80-011c-47ab-b4a9-620f1a8f5631] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:53.811299 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6685c602-efc5-43dd-8e25-784923a87a04 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:53.811751 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6685c602-efc5-43dd-8e25-784923a87a04 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:53.812542 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6685c602-efc5-43dd-8e25-784923a87a04 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:53.813110 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6685c602-efc5-43dd-8e25-784923a87a04 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:54.697864 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6685c602-efc5-43dd-8e25-784923a87a04 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:54.708699 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6685c602-efc5-43dd-8e25-784923a87a04 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/2290ea80-011c-47ab-b4a9-620f1a8f5631" status: 200 len: 1316 microversion: 2.1 time: 0.937563 Aug 04 16:46:54.713424 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1189/2397] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:53 2022] GET /compute/v2.1/servers/2290ea80-011c-47ab-b4a9-620f1a8f5631 => generated 1316 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:54.721307 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-03c64807-d68c-4b1a-b5ca-4064cc34da1e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:54.726593 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-03c64807-d68c-4b1a-b5ca-4064cc34da1e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:54.745852 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03c64807-d68c-4b1a-b5ca-4064cc34da1e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:54.746655 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03c64807-d68c-4b1a-b5ca-4064cc34da1e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:54.748465 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03c64807-d68c-4b1a-b5ca-4064cc34da1e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:54.751216 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03c64807-d68c-4b1a-b5ca-4064cc34da1e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:55.069084 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-59726e10-5181-4308-93e0-da40cca7d1c0 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:55.083618 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-59726e10-5181-4308-93e0-da40cca7d1c0 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61" status: 200 len: 1308 microversion: 2.1 time: 1.751684 Aug 04 16:46:55.089177 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1209/2398] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:53 2022] GET /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61 => generated 1308 bytes in 1759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:55.102819 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-7384d785-fbb2-416c-830c-4dc9a07254e9 req-c27e885c-efb8-4eb5-ad8f-0109052241d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbc88621-3d3a-4819-a1bd-d0515850bd01", "tag": "f1766ddf-1d03-4c23-96bd-83ee51e1a5d3"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:55.135199 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7384d785-fbb2-416c-830c-4dc9a07254e9 req-c27e885c-efb8-4eb5-ad8f-0109052241d6 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:55.139677 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7384d785-fbb2-416c-830c-4dc9a07254e9 req-c27e885c-efb8-4eb5-ad8f-0109052241d6 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:55.197662 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-7384d785-fbb2-416c-830c-4dc9a07254e9 req-c27e885c-efb8-4eb5-ad8f-0109052241d6 service nova] Creating event network-changed:f1766ddf-1d03-4c23-96bd-83ee51e1a5d3 for instance fbc88621-3d3a-4819-a1bd-d0515850bd01 on n-h1-846466-12 Aug 04 16:46:55.223449 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-7384d785-fbb2-416c-830c-4dc9a07254e9 req-c27e885c-efb8-4eb5-ad8f-0109052241d6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120665 Aug 04 16:46:55.225133 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1210/2399] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:46:55.231241 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-548975d6-8389-4830-9a51-9b601feac5ac req-12d755aa-51a8-456e-a387-04cacce8f69c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40121d67-65d4-4a6b-ae3f-6a85d3c99e46", "name": "network-vif-plugged", "status": "completed", "tag": "69742927-466e-479d-bc59-c96d132c5421"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:55.262350 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-548975d6-8389-4830-9a51-9b601feac5ac req-12d755aa-51a8-456e-a387-04cacce8f69c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:55.263072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-548975d6-8389-4830-9a51-9b601feac5ac req-12d755aa-51a8-456e-a387-04cacce8f69c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:55.292765 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-548975d6-8389-4830-9a51-9b601feac5ac req-12d755aa-51a8-456e-a387-04cacce8f69c service nova] Creating event network-vif-plugged:69742927-466e-479d-bc59-c96d132c5421 for instance 40121d67-65d4-4a6b-ae3f-6a85d3c99e46 on n-h1-846466-12 Aug 04 16:46:55.305689 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-548975d6-8389-4830-9a51-9b601feac5ac req-12d755aa-51a8-456e-a387-04cacce8f69c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078524 Aug 04 16:46:55.307428 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1211/2400] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:46:55.320740 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0cb17acf-1c76-4370-bea0-a67127add8c5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:55.324273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0cb17acf-1c76-4370-bea0-a67127add8c5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea0f2c5d-c250-4617-9edd-03a8a74d1e2a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:55.344523 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0cb17acf-1c76-4370-bea0-a67127add8c5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:55.349173 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0cb17acf-1c76-4370-bea0-a67127add8c5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:55.350333 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0cb17acf-1c76-4370-bea0-a67127add8c5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:55.350978 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0cb17acf-1c76-4370-bea0-a67127add8c5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:55.831835 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0cb17acf-1c76-4370-bea0-a67127add8c5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:55.843139 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0cb17acf-1c76-4370-bea0-a67127add8c5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a" status: 200 len: 1267 microversion: 2.1 time: 0.534199 Aug 04 16:46:55.844264 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1212/2401] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:55 2022] GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a => generated 1267 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:55.861548 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1892f035-f9eb-4496-9900-a3286d5dbfb0 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '.version_select at 0x7f7e8492d9d0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:55.901531 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1892f035-f9eb-4496-9900-a3286d5dbfb0 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1046115166" status: 204 len: 0 microversion: 2.32 time: 0.056076 Aug 04 16:46:55.906367 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1213/2402] 10.222.0.23 () {60 vars in 1262 bytes} [Thu Aug 4 16:46:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1046115166 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 16:46:55.912431 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dfc52d52-c96c-4ea5-bd0d-04beb90960b7 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:55.913566 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dfc52d52-c96c-4ea5-bd0d-04beb90960b7 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: fbc88621-3d3a-4819-a1bd-d0515850bd01] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:55.921689 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dfc52d52-c96c-4ea5-bd0d-04beb90960b7 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:55.922601 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dfc52d52-c96c-4ea5-bd0d-04beb90960b7 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:55.923640 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dfc52d52-c96c-4ea5-bd0d-04beb90960b7 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:55.924314 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dfc52d52-c96c-4ea5-bd0d-04beb90960b7 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:56.023848 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-03c64807-d68c-4b1a-b5ca-4064cc34da1e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:56.039505 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-03c64807-d68c-4b1a-b5ca-4064cc34da1e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 1.323962 Aug 04 16:46:56.041227 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1190/2403] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:54 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:56.049489 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ae4f4dc5-5882-424f-8b35-04128c56f9e0 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:56.050594 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ae4f4dc5-5882-424f-8b35-04128c56f9e0 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 2290ea80-011c-47ab-b4a9-620f1a8f5631] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:56.059235 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ae4f4dc5-5882-424f-8b35-04128c56f9e0 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:56.060154 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ae4f4dc5-5882-424f-8b35-04128c56f9e0 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:56.061272 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ae4f4dc5-5882-424f-8b35-04128c56f9e0 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:56.062014 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ae4f4dc5-5882-424f-8b35-04128c56f9e0 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:56.421657 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dfc52d52-c96c-4ea5-bd0d-04beb90960b7 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450c14de401149bc8a24efb11e24b631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a69315bfb4723b95c9b79e0741b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:56.435975 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dfc52d52-c96c-4ea5-bd0d-04beb90960b7 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "GET /compute/v2.1/servers/fbc88621-3d3a-4819-a1bd-d0515850bd01" status: 200 len: 1318 microversion: 2.1 time: 0.525648 Aug 04 16:46:56.438127 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1214/2404] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:55 2022] GET /compute/v2.1/servers/fbc88621-3d3a-4819-a1bd-d0515850bd01 => generated 1318 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:56.449826 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3589a0fb-d22d-4e30-a134-de5d22f14445 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:56.450517 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3589a0fb-d22d-4e30-a134-de5d22f14445 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:56.469233 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3589a0fb-d22d-4e30-a134-de5d22f14445 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:56.469996 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3589a0fb-d22d-4e30-a134-de5d22f14445 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:56.471058 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3589a0fb-d22d-4e30-a134-de5d22f14445 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:56.474146 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3589a0fb-d22d-4e30-a134-de5d22f14445 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:56.477406 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ae4f4dc5-5882-424f-8b35-04128c56f9e0 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:56.504915 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ae4f4dc5-5882-424f-8b35-04128c56f9e0 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/2290ea80-011c-47ab-b4a9-620f1a8f5631" status: 200 len: 1316 microversion: 2.1 time: 0.460896 Aug 04 16:46:56.519529 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1191/2405] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:56 2022] GET /compute/v2.1/servers/2290ea80-011c-47ab-b4a9-620f1a8f5631 => generated 1316 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:56.537405 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a7301574-0d7e-46c1-ba6e-232595c17b9f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:56.541849 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a7301574-0d7e-46c1-ba6e-232595c17b9f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:56.543683 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:46:56.561880 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a7301574-0d7e-46c1-ba6e-232595c17b9f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:56.562615 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a7301574-0d7e-46c1-ba6e-232595c17b9f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:56.563737 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a7301574-0d7e-46c1-ba6e-232595c17b9f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:56.564334 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a7301574-0d7e-46c1-ba6e-232595c17b9f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:58.083541 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a7301574-0d7e-46c1-ba6e-232595c17b9f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:58.093593 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a7301574-0d7e-46c1-ba6e-232595c17b9f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61" status: 200 len: 1308 microversion: 2.1 time: 1.571398 Aug 04 16:46:58.096598 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1192/2406] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:56 2022] GET /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61 => generated 1308 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:58.104140 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3589a0fb-d22d-4e30-a134-de5d22f14445 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:58.116112 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-029974c3-2808-4275-974f-102df5e259af tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:58.116943 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3589a0fb-d22d-4e30-a134-de5d22f14445 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 1.676096 Aug 04 16:46:58.118614 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1215/2407] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:56 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:58.127192 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-1fde8142-5844-42be-9fd0-dc9c29dbde99 req-49f749f3-d638-4339-b63c-1b8df7f3daec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e3e569c-a08f-4026-9fc9-ad9caf3d3c61", "tag": "b6270fe9-d0af-4606-ba95-ec0813af91bc"}, {"name": "network-changed", "server_uuid": "2290ea80-011c-47ab-b4a9-620f1a8f5631", "tag": "6791076a-a32f-4256-8c4d-42629ee687dd"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:58.137841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-029974c3-2808-4275-974f-102df5e259af tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea0f2c5d-c250-4617-9edd-03a8a74d1e2a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:58.142940 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-1fde8142-5844-42be-9fd0-dc9c29dbde99 req-49f749f3-d638-4339-b63c-1b8df7f3daec service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:58.144126 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-1fde8142-5844-42be-9fd0-dc9c29dbde99 req-49f749f3-d638-4339-b63c-1b8df7f3daec service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:58.159118 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-029974c3-2808-4275-974f-102df5e259af tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:58.160018 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-029974c3-2808-4275-974f-102df5e259af tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:58.161833 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-029974c3-2808-4275-974f-102df5e259af tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:58.162495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-029974c3-2808-4275-974f-102df5e259af tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:58.170064 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-1fde8142-5844-42be-9fd0-dc9c29dbde99 req-49f749f3-d638-4339-b63c-1b8df7f3daec service nova] Creating event network-changed:b6270fe9-d0af-4606-ba95-ec0813af91bc for instance 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61 on n-h2-846466-12 Aug 04 16:46:58.171108 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-1fde8142-5844-42be-9fd0-dc9c29dbde99 req-49f749f3-d638-4339-b63c-1b8df7f3daec service nova] Creating event network-changed:6791076a-a32f-4256-8c4d-42629ee687dd for instance 2290ea80-011c-47ab-b4a9-620f1a8f5631 on n-h2-846466-12 Aug 04 16:46:58.181434 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-1fde8142-5844-42be-9fd0-dc9c29dbde99 req-49f749f3-d638-4339-b63c-1b8df7f3daec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.061112 Aug 04 16:46:58.183395 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1216/2408] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:46:58.193952 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4ec5dbad-9af9-4387-b9bc-cf71f5a171ae tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:58.195741 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4ec5dbad-9af9-4387-b9bc-cf71f5a171ae tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: fbc88621-3d3a-4819-a1bd-d0515850bd01] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:58.205272 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=91,nova_api:DELETE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:46:58.210455 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4ec5dbad-9af9-4387-b9bc-cf71f5a171ae tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:58.212098 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4ec5dbad-9af9-4387-b9bc-cf71f5a171ae tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:58.214101 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4ec5dbad-9af9-4387-b9bc-cf71f5a171ae tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:58.215213 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4ec5dbad-9af9-4387-b9bc-cf71f5a171ae tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:58.842443 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4ec5dbad-9af9-4387-b9bc-cf71f5a171ae tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450c14de401149bc8a24efb11e24b631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a69315bfb4723b95c9b79e0741b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:58.852549 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4ec5dbad-9af9-4387-b9bc-cf71f5a171ae tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "GET /compute/v2.1/servers/fbc88621-3d3a-4819-a1bd-d0515850bd01" status: 200 len: 1318 microversion: 2.1 time: 0.667537 Aug 04 16:46:58.866448 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1217/2409] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:58 2022] GET /compute/v2.1/servers/fbc88621-3d3a-4819-a1bd-d0515850bd01 => generated 1318 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:58.872091 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e5725119-2ad1-4369-98c6-c6decdec058b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:58.873050 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e5725119-2ad1-4369-98c6-c6decdec058b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 2290ea80-011c-47ab-b4a9-620f1a8f5631] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:58.882373 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e5725119-2ad1-4369-98c6-c6decdec058b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:58.883097 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e5725119-2ad1-4369-98c6-c6decdec058b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:58.884039 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e5725119-2ad1-4369-98c6-c6decdec058b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:58.884659 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e5725119-2ad1-4369-98c6-c6decdec058b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:58.888096 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:46:58.990015 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-029974c3-2808-4275-974f-102df5e259af tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:59.010479 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-029974c3-2808-4275-974f-102df5e259af tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a" status: 200 len: 1315 microversion: 2.1 time: 0.911013 Aug 04 16:46:59.024542 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1193/2410] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:58 2022] GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a => generated 1315 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:59.035044 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9e37dd8b-e6c7-4849-930a-e7e2bfe5886b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:59.035674 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9e37dd8b-e6c7-4849-930a-e7e2bfe5886b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:59.052179 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e37dd8b-e6c7-4849-930a-e7e2bfe5886b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:59.053663 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e37dd8b-e6c7-4849-930a-e7e2bfe5886b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:59.055787 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e37dd8b-e6c7-4849-930a-e7e2bfe5886b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:59.056921 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e37dd8b-e6c7-4849-930a-e7e2bfe5886b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:59.138096 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9e37dd8b-e6c7-4849-930a-e7e2bfe5886b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Locking {{(pid=126126) lock /opt/stack/nova/nova/compute/api.py:4781}} Aug 04 16:46:59.235743 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9e37dd8b-e6c7-4849-930a-e7e2bfe5886b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action" status: 202 len: 0 microversion: 2.1 time: 0.208924 Aug 04 16:46:59.237494 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1194/2411] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:46:59 2022] POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:46:59.254828 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2319217e-3a27-42cc-83ec-4d72c033a1aa tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:59.256012 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2319217e-3a27-42cc-83ec-4d72c033a1aa tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:59.271893 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2319217e-3a27-42cc-83ec-4d72c033a1aa tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:59.273894 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2319217e-3a27-42cc-83ec-4d72c033a1aa tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:59.274954 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2319217e-3a27-42cc-83ec-4d72c033a1aa tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:59.275762 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2319217e-3a27-42cc-83ec-4d72c033a1aa tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:59.559134 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e5725119-2ad1-4369-98c6-c6decdec058b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:59.573051 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e5725119-2ad1-4369-98c6-c6decdec058b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/2290ea80-011c-47ab-b4a9-620f1a8f5631" status: 200 len: 1316 microversion: 2.1 time: 0.704624 Aug 04 16:46:59.574234 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1218/2412] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:58 2022] GET /compute/v2.1/servers/2290ea80-011c-47ab-b4a9-620f1a8f5631 => generated 1316 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:59.579940 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-db5b3f3c-ed28-42cc-a58c-448b9a7a6e86 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:59.580755 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-db5b3f3c-ed28-42cc-a58c-448b9a7a6e86 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:59.588508 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-db5b3f3c-ed28-42cc-a58c-448b9a7a6e86 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:59.589056 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-db5b3f3c-ed28-42cc-a58c-448b9a7a6e86 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:59.590226 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-db5b3f3c-ed28-42cc-a58c-448b9a7a6e86 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:59.590906 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-db5b3f3c-ed28-42cc-a58c-448b9a7a6e86 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:59.720094 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2319217e-3a27-42cc-83ec-4d72c033a1aa tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:46:59.729665 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2319217e-3a27-42cc-83ec-4d72c033a1aa tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61" status: 200 len: 1308 microversion: 2.1 time: 0.490418 Aug 04 16:46:59.730762 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1195/2413] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:59 2022] GET /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61 => generated 1308 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:59.915218 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-db8b8f79-676c-4c41-95ec-b435a44b1261 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:59.916125 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-db8b8f79-676c-4c41-95ec-b435a44b1261 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: fbc88621-3d3a-4819-a1bd-d0515850bd01] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:46:59.947330 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db8b8f79-676c-4c41-95ec-b435a44b1261 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:59.947768 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db8b8f79-676c-4c41-95ec-b435a44b1261 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:46:59.948804 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db8b8f79-676c-4c41-95ec-b435a44b1261 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:46:59.949226 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db8b8f79-676c-4c41-95ec-b435a44b1261 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:00.043444 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-db5b3f3c-ed28-42cc-a58c-448b9a7a6e86 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:00.068554 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-db5b3f3c-ed28-42cc-a58c-448b9a7a6e86 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.492928 Aug 04 16:47:00.070128 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1219/2414] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:59 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:00.077455 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c25160e5-91bf-4031-baec-1cf5d998d2d8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:00.086873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c25160e5-91bf-4031-baec-1cf5d998d2d8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea0f2c5d-c250-4617-9edd-03a8a74d1e2a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:00.094934 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c25160e5-91bf-4031-baec-1cf5d998d2d8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:00.095685 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c25160e5-91bf-4031-baec-1cf5d998d2d8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:00.096689 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c25160e5-91bf-4031-baec-1cf5d998d2d8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:00.097407 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c25160e5-91bf-4031-baec-1cf5d998d2d8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:00.237844 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-db8b8f79-676c-4c41-95ec-b435a44b1261 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450c14de401149bc8a24efb11e24b631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a69315bfb4723b95c9b79e0741b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:00.253648 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-db8b8f79-676c-4c41-95ec-b435a44b1261 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "GET /compute/v2.1/servers/fbc88621-3d3a-4819-a1bd-d0515850bd01" status: 200 len: 1318 microversion: 2.1 time: 0.352781 Aug 04 16:47:00.268091 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1196/2415] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:46:59 2022] GET /compute/v2.1/servers/fbc88621-3d3a-4819-a1bd-d0515850bd01 => generated 1318 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:00.273112 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8888e09d-79ad-4b19-8794-cdb88ed2cb5e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:00.281539 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8888e09d-79ad-4b19-8794-cdb88ed2cb5e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:00.282423 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8888e09d-79ad-4b19-8794-cdb88ed2cb5e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:00.338791 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-8888e09d-79ad-4b19-8794-cdb88ed2cb5e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] HTTP exception thrown: Instance 0c62ae02-0f30-43e1-a005-89dcb8122d4e is locked Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8888e09d-79ad-4b19-8794-cdb88ed2cb5e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Request method failure captured: Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action HTTP/1.1 Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 15 Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_abSC_qd4PHP0W808xgrI7Q0G4tlPTiB2-LAH-LZMv8d9UcRN9ZCFy6_giyx-c7RjiKNjELhrKAi_ora1AVfsDng4FTG7brYif3-z0rtdjlkilo5AULdT4A615Ra8__IvKNYC3N__kBvOWqowuttGiKr7m7ap4YyjQHEc3cVcyVFSU Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 96ce955c9158463e9e98c53b99c581ec Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServerActionsTestJSON-697118571 Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96ce955c9158463e9e98c53b99c581ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_96ce955c9158463e9e98c53b99c581ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96ce955c9158463e9e98c53b99c581ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/96ce955c9158463e9e98c53b99c581ec"}]}] Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServerActionsTestJSON-697118571 Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 96ce955c9158463e9e98c53b99c581ec Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServerActionsTestJSON-697118571 Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServerActionsTestJSON-697118571-project Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 438d083dc9e74b2f8970455505791250 Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServerActionsTestJSON-697118571-project Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: {"os-stop": {}} Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 0c62ae02-0f30-43e1-a005-89dcb8122d4e is locked Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '0c62ae02-0f30-43e1-a005-89dcb8122d4e', 'body': {'os-stop': {}}} Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 0c62ae02-0f30-43e1-a005-89dcb8122d4e is locked Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 0c62ae02-0f30-43e1-a005-89dcb8122d4e is locked Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c62ae02-0f30-43e1-a005-89dcb8122d4e is locked Aug 04 16:47:00.340495 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:47:00.346842 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8888e09d-79ad-4b19-8794-cdb88ed2cb5e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Returning 409 to user: Instance 0c62ae02-0f30-43e1-a005-89dcb8122d4e is locked {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:47:00.346842 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8888e09d-79ad-4b19-8794-cdb88ed2cb5e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action" status: 409 len: 107 microversion: 2.1 time: 0.073063 Aug 04 16:47:00.346842 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1197/2416] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:47:00 2022] POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action => generated 107 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:47:00.360603 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-24cee90c-10e6-47eb-a731-19d28b456faa tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:00.361203 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-24cee90c-10e6-47eb-a731-19d28b456faa tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:00.377878 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-24cee90c-10e6-47eb-a731-19d28b456faa tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:00.379357 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-24cee90c-10e6-47eb-a731-19d28b456faa tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:00.380361 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-24cee90c-10e6-47eb-a731-19d28b456faa tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:00.380799 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-24cee90c-10e6-47eb-a731-19d28b456faa tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:00.441740 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-24cee90c-10e6-47eb-a731-19d28b456faa tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Unlocking {{(pid=126126) unlock /opt/stack/nova/nova/compute/api.py:4810}} Aug 04 16:47:00.442053 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c25160e5-91bf-4031-baec-1cf5d998d2d8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:00.451936 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c25160e5-91bf-4031-baec-1cf5d998d2d8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a" status: 200 len: 1315 microversion: 2.1 time: 0.380204 Aug 04 16:47:00.456385 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1220/2417] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:00 2022] GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:00.540673 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-becbd78f-9972-4142-a574-20e2cfd76cc8 req-215e9284-5c0c-4423-a7f9-8fea691e4d92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e3e569c-a08f-4026-9fc9-ad9caf3d3c61", "name": "network-vif-plugged", "status": "completed", "tag": "b6270fe9-d0af-4606-ba95-ec0813af91bc"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:00.555201 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-24cee90c-10e6-47eb-a731-19d28b456faa tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action" status: 202 len: 0 microversion: 2.1 time: 0.199745 Aug 04 16:47:00.560173 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-becbd78f-9972-4142-a574-20e2cfd76cc8 req-215e9284-5c0c-4423-a7f9-8fea691e4d92 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:00.560768 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1198/2418] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:47:00 2022] POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:47:00.561542 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-becbd78f-9972-4142-a574-20e2cfd76cc8 req-215e9284-5c0c-4423-a7f9-8fea691e4d92 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:00.568091 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2ce6f8ae-3c83-469b-ac9d-cac6fa41facc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:00.582780 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-becbd78f-9972-4142-a574-20e2cfd76cc8 req-215e9284-5c0c-4423-a7f9-8fea691e4d92 service nova] Creating event network-vif-plugged:b6270fe9-d0af-4606-ba95-ec0813af91bc for instance 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61 on n-h2-846466-12 Aug 04 16:47:00.587535 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ce6f8ae-3c83-469b-ac9d-cac6fa41facc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:00.593481 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ce6f8ae-3c83-469b-ac9d-cac6fa41facc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:00.599817 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-becbd78f-9972-4142-a574-20e2cfd76cc8 req-215e9284-5c0c-4423-a7f9-8fea691e4d92 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063420 Aug 04 16:47:00.601385 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1221/2419] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:47:00.604583 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=4,nova_cell1:UPDATE=8 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:47:00.612573 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-508afe81-d274-46ab-9943-aaa32d74e7cd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:00.613738 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-508afe81-d274-46ab-9943-aaa32d74e7cd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 2290ea80-011c-47ab-b4a9-620f1a8f5631] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:00.626622 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-508afe81-d274-46ab-9943-aaa32d74e7cd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:00.627892 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-508afe81-d274-46ab-9943-aaa32d74e7cd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:00.629327 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-508afe81-d274-46ab-9943-aaa32d74e7cd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:00.630073 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-508afe81-d274-46ab-9943-aaa32d74e7cd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:00.672033 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2ce6f8ae-3c83-469b-ac9d-cac6fa41facc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Going to try to stop instance {{(pid=126126) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 16:47:00.795502 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2ce6f8ae-3c83-469b-ac9d-cac6fa41facc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action" status: 202 len: 0 microversion: 2.1 time: 0.233807 Aug 04 16:47:00.796521 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1199/2420] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:47:00 2022] POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:47:00.806810 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6ed6c805-fecd-42bf-91be-711a9f893886 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:00.808060 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6ed6c805-fecd-42bf-91be-711a9f893886 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:00.822203 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6ed6c805-fecd-42bf-91be-711a9f893886 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:00.823390 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6ed6c805-fecd-42bf-91be-711a9f893886 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:00.825497 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6ed6c805-fecd-42bf-91be-711a9f893886 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:00.826569 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6ed6c805-fecd-42bf-91be-711a9f893886 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:01.193650 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-508afe81-d274-46ab-9943-aaa32d74e7cd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:01.198249 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6ed6c805-fecd-42bf-91be-711a9f893886 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:01.205250 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-508afe81-d274-46ab-9943-aaa32d74e7cd tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/2290ea80-011c-47ab-b4a9-620f1a8f5631" status: 200 len: 1316 microversion: 2.1 time: 0.602032 Aug 04 16:47:01.207759 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1222/2421] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:00 2022] GET /compute/v2.1/servers/2290ea80-011c-47ab-b4a9-620f1a8f5631 => generated 1316 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:01.213666 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fb282819-f487-4bb2-8287-ac7a129e7a8c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:01.214429 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fb282819-f487-4bb2-8287-ac7a129e7a8c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:01.236644 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fb282819-f487-4bb2-8287-ac7a129e7a8c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:01.237515 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fb282819-f487-4bb2-8287-ac7a129e7a8c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:01.238489 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fb282819-f487-4bb2-8287-ac7a129e7a8c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:01.239855 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fb282819-f487-4bb2-8287-ac7a129e7a8c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:01.249511 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6ed6c805-fecd-42bf-91be-711a9f893886 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61" status: 200 len: 1308 microversion: 2.1 time: 0.450463 Aug 04 16:47:01.254734 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1200/2422] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:00 2022] GET /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61 => generated 1308 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:01.271705 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-c7486340-e79f-4637-946d-d74ec7204ab8 req-7f95af7f-fa4b-45ea-8bc6-7838140f8420 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea0f2c5d-c250-4617-9edd-03a8a74d1e2a", "tag": "71639f30-01c1-4d6c-9627-13f24e8950ac"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:01.286219 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-c7486340-e79f-4637-946d-d74ec7204ab8 req-7f95af7f-fa4b-45ea-8bc6-7838140f8420 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:01.286981 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-c7486340-e79f-4637-946d-d74ec7204ab8 req-7f95af7f-fa4b-45ea-8bc6-7838140f8420 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:01.303901 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-c7486340-e79f-4637-946d-d74ec7204ab8 req-7f95af7f-fa4b-45ea-8bc6-7838140f8420 service nova] Creating event network-changed:71639f30-01c1-4d6c-9627-13f24e8950ac for instance ea0f2c5d-c250-4617-9edd-03a8a74d1e2a on n-h2-846466-12 Aug 04 16:47:01.311848 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-c7486340-e79f-4637-946d-d74ec7204ab8 req-7f95af7f-fa4b-45ea-8bc6-7838140f8420 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055656 Aug 04 16:47:01.312950 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1201/2423] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:47:01.323376 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c7ee81fe-c5d6-4bd3-a429-c9602df3d93f tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:01.324370 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c7ee81fe-c5d6-4bd3-a429-c9602df3d93f tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: fbc88621-3d3a-4819-a1bd-d0515850bd01] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:01.332487 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c7ee81fe-c5d6-4bd3-a429-c9602df3d93f tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:01.332935 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c7ee81fe-c5d6-4bd3-a429-c9602df3d93f tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:01.333756 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c7ee81fe-c5d6-4bd3-a429-c9602df3d93f tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:01.334650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c7ee81fe-c5d6-4bd3-a429-c9602df3d93f tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:01.536731 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fb282819-f487-4bb2-8287-ac7a129e7a8c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:01.592159 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fb282819-f487-4bb2-8287-ac7a129e7a8c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1679 microversion: 2.1 time: 0.382681 Aug 04 16:47:01.598383 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1223/2424] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:01 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1679 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:01.608738 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f1318e79-2f0e-42a2-b48f-6e6b4c7f3e86 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:01.610653 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f1318e79-2f0e-42a2-b48f-6e6b4c7f3e86 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea0f2c5d-c250-4617-9edd-03a8a74d1e2a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:01.621343 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c7ee81fe-c5d6-4bd3-a429-c9602df3d93f tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450c14de401149bc8a24efb11e24b631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a69315bfb4723b95c9b79e0741b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:01.624040 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f1318e79-2f0e-42a2-b48f-6e6b4c7f3e86 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:01.624491 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f1318e79-2f0e-42a2-b48f-6e6b4c7f3e86 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:01.625771 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f1318e79-2f0e-42a2-b48f-6e6b4c7f3e86 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:01.626213 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f1318e79-2f0e-42a2-b48f-6e6b4c7f3e86 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:01.630793 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c7ee81fe-c5d6-4bd3-a429-c9602df3d93f tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "GET /compute/v2.1/servers/fbc88621-3d3a-4819-a1bd-d0515850bd01" status: 200 len: 1318 microversion: 2.1 time: 0.313801 Aug 04 16:47:01.631594 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1202/2425] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:01 2022] GET /compute/v2.1/servers/fbc88621-3d3a-4819-a1bd-d0515850bd01 => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:01.822019 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f1318e79-2f0e-42a2-b48f-6e6b4c7f3e86 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:01.833018 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f1318e79-2f0e-42a2-b48f-6e6b4c7f3e86 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a" status: 200 len: 1315 microversion: 2.1 time: 0.232655 Aug 04 16:47:01.833866 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1224/2426] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:01 2022] GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:02.239958 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-515c751d-6760-469d-8a6a-c867fec82508 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:02.241102 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-515c751d-6760-469d-8a6a-c867fec82508 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 2290ea80-011c-47ab-b4a9-620f1a8f5631] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:02.259646 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-515c751d-6760-469d-8a6a-c867fec82508 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:02.260582 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-515c751d-6760-469d-8a6a-c867fec82508 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:02.261195 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-515c751d-6760-469d-8a6a-c867fec82508 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:02.261812 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-515c751d-6760-469d-8a6a-c867fec82508 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:02.272767 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ed4ac9a8-ca2b-4e1f-9bd5-5a273973b90d tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:02.278757 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ed4ac9a8-ca2b-4e1f-9bd5-5a273973b90d tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:02.315415 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ed4ac9a8-ca2b-4e1f-9bd5-5a273973b90d tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:02.316197 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ed4ac9a8-ca2b-4e1f-9bd5-5a273973b90d tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:02.320754 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ed4ac9a8-ca2b-4e1f-9bd5-5a273973b90d tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:02.321439 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ed4ac9a8-ca2b-4e1f-9bd5-5a273973b90d tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:03.020179 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=8 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:47:03.119430 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=22 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:47:03.155605 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-515c751d-6760-469d-8a6a-c867fec82508 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:03.181582 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-515c751d-6760-469d-8a6a-c867fec82508 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/2290ea80-011c-47ab-b4a9-620f1a8f5631" status: 200 len: 1316 microversion: 2.1 time: 0.941931 Aug 04 16:47:03.186862 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1203/2427] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:02 2022] GET /compute/v2.1/servers/2290ea80-011c-47ab-b4a9-620f1a8f5631 => generated 1316 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:47:03.196217 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ed4ac9a8-ca2b-4e1f-9bd5-5a273973b90d tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:03.209794 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e2771e3d-f09f-4757-b1b5-16d65350553d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:03.218693 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ed4ac9a8-ca2b-4e1f-9bd5-5a273973b90d tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61" status: 200 len: 1308 microversion: 2.1 time: 0.947444 Aug 04 16:47:03.238889 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e2771e3d-f09f-4757-b1b5-16d65350553d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:03.238889 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e2771e3d-f09f-4757-b1b5-16d65350553d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:03.238889 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e2771e3d-f09f-4757-b1b5-16d65350553d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:03.239968 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e2771e3d-f09f-4757-b1b5-16d65350553d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:03.240386 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1225/2428] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:02 2022] GET /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61 => generated 1308 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:03.240516 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e2771e3d-f09f-4757-b1b5-16d65350553d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:03.246919 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-7113efa1-b046-48af-b813-2788d3f4e6b7 req-ff13f9cc-8b67-4e98-b908-05c29bdf06b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbc88621-3d3a-4819-a1bd-d0515850bd01", "name": "network-vif-plugged", "status": "completed", "tag": "f1766ddf-1d03-4c23-96bd-83ee51e1a5d3"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:03.279002 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7113efa1-b046-48af-b813-2788d3f4e6b7 req-ff13f9cc-8b67-4e98-b908-05c29bdf06b3 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:03.283097 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7113efa1-b046-48af-b813-2788d3f4e6b7 req-ff13f9cc-8b67-4e98-b908-05c29bdf06b3 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:03.334423 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-7113efa1-b046-48af-b813-2788d3f4e6b7 req-ff13f9cc-8b67-4e98-b908-05c29bdf06b3 service nova] Creating event network-vif-plugged:f1766ddf-1d03-4c23-96bd-83ee51e1a5d3 for instance fbc88621-3d3a-4819-a1bd-d0515850bd01 on n-h1-846466-12 Aug 04 16:47:03.354386 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-7113efa1-b046-48af-b813-2788d3f4e6b7 req-ff13f9cc-8b67-4e98-b908-05c29bdf06b3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111523 Aug 04 16:47:03.366547 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1226/2429] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:47:03.376383 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-46adf083-8f2f-4fd3-8b2d-e7a40a2ca083 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:03.391367 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-46adf083-8f2f-4fd3-8b2d-e7a40a2ca083 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: fbc88621-3d3a-4819-a1bd-d0515850bd01] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:03.404454 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46adf083-8f2f-4fd3-8b2d-e7a40a2ca083 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:03.409929 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46adf083-8f2f-4fd3-8b2d-e7a40a2ca083 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:03.411624 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46adf083-8f2f-4fd3-8b2d-e7a40a2ca083 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:03.415899 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46adf083-8f2f-4fd3-8b2d-e7a40a2ca083 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:03.897558 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e2771e3d-f09f-4757-b1b5-16d65350553d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:03.907404 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e2771e3d-f09f-4757-b1b5-16d65350553d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1679 microversion: 2.1 time: 0.705891 Aug 04 16:47:03.908150 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1204/2430] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:03 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1679 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:03.913495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2dca54b4-745e-477a-9a1d-0ba6718eb04f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:03.914640 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2dca54b4-745e-477a-9a1d-0ba6718eb04f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea0f2c5d-c250-4617-9edd-03a8a74d1e2a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:03.923591 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2dca54b4-745e-477a-9a1d-0ba6718eb04f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:03.924041 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2dca54b4-745e-477a-9a1d-0ba6718eb04f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:03.924817 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2dca54b4-745e-477a-9a1d-0ba6718eb04f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:03.925506 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2dca54b4-745e-477a-9a1d-0ba6718eb04f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:04.268705 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-46adf083-8f2f-4fd3-8b2d-e7a40a2ca083 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450c14de401149bc8a24efb11e24b631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a69315bfb4723b95c9b79e0741b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:04.287240 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-46adf083-8f2f-4fd3-8b2d-e7a40a2ca083 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "GET /compute/v2.1/servers/fbc88621-3d3a-4819-a1bd-d0515850bd01" status: 200 len: 1318 microversion: 2.1 time: 0.918570 Aug 04 16:47:04.294184 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1227/2431] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:03 2022] GET /compute/v2.1/servers/fbc88621-3d3a-4819-a1bd-d0515850bd01 => generated 1318 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:04.319438 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-65e5417b-57ed-4751-8153-bcfebf9b0351 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:04.320259 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-65e5417b-57ed-4751-8153-bcfebf9b0351 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 2290ea80-011c-47ab-b4a9-620f1a8f5631] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:04.340210 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-65e5417b-57ed-4751-8153-bcfebf9b0351 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:04.341748 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-65e5417b-57ed-4751-8153-bcfebf9b0351 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:04.343498 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-65e5417b-57ed-4751-8153-bcfebf9b0351 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:04.347946 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-65e5417b-57ed-4751-8153-bcfebf9b0351 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:04.628479 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2dca54b4-745e-477a-9a1d-0ba6718eb04f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:04.649615 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2dca54b4-745e-477a-9a1d-0ba6718eb04f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a" status: 200 len: 1315 microversion: 2.1 time: 0.732990 Aug 04 16:47:04.664735 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1205/2432] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:03 2022] GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a => generated 1315 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:04.664735 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-60cf5c28-57d4-408d-9c4f-e8f608bf5e61 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:04.665769 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-60cf5c28-57d4-408d-9c4f-e8f608bf5e61 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:04.683815 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-60cf5c28-57d4-408d-9c4f-e8f608bf5e61 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:04.687706 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-60cf5c28-57d4-408d-9c4f-e8f608bf5e61 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:04.689144 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-60cf5c28-57d4-408d-9c4f-e8f608bf5e61 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:04.689742 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-60cf5c28-57d4-408d-9c4f-e8f608bf5e61 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:04.987825 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-65e5417b-57ed-4751-8153-bcfebf9b0351 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:04.998068 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-65e5417b-57ed-4751-8153-bcfebf9b0351 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/2290ea80-011c-47ab-b4a9-620f1a8f5631" status: 200 len: 1316 microversion: 2.1 time: 0.690810 Aug 04 16:47:04.998778 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1228/2433] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:04 2022] GET /compute/v2.1/servers/2290ea80-011c-47ab-b4a9-620f1a8f5631 => generated 1316 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:05.182521 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-60cf5c28-57d4-408d-9c4f-e8f608bf5e61 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:05.197834 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-60cf5c28-57d4-408d-9c4f-e8f608bf5e61 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61" status: 200 len: 1488 microversion: 2.1 time: 0.544294 Aug 04 16:47:05.199660 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1206/2434] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:04 2022] GET /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61 => generated 1488 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:05.209548 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-640b183b-22cc-4bbc-821f-0a303a74cfbf tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:05.211306 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-640b183b-22cc-4bbc-821f-0a303a74cfbf tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:05.223617 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-640b183b-22cc-4bbc-821f-0a303a74cfbf tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:05.224818 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-640b183b-22cc-4bbc-821f-0a303a74cfbf tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:05.226588 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-640b183b-22cc-4bbc-821f-0a303a74cfbf tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:05.227698 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-640b183b-22cc-4bbc-821f-0a303a74cfbf tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:05.320895 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4d65b6bc-580b-4dd7-b410-1555415de6b2 tempest-VolumesAdminNegativeTest-599200631 tempest-VolumesAdminNegativeTest-599200631-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "f0408a23-35c3-4bc0-baf0-70b36409fb74"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:05.326025 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4d65b6bc-580b-4dd7-b410-1555415de6b2 tempest-VolumesAdminNegativeTest-599200631 tempest-VolumesAdminNegativeTest-599200631-project-admin] [instance: befbf568-78f2-4571-bf63-fdac57291b28] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:05.338951 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d65b6bc-580b-4dd7-b410-1555415de6b2 tempest-VolumesAdminNegativeTest-599200631 tempest-VolumesAdminNegativeTest-599200631-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:05.339657 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d65b6bc-580b-4dd7-b410-1555415de6b2 tempest-VolumesAdminNegativeTest-599200631 tempest-VolumesAdminNegativeTest-599200631-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:05.341040 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d65b6bc-580b-4dd7-b410-1555415de6b2 tempest-VolumesAdminNegativeTest-599200631 tempest-VolumesAdminNegativeTest-599200631-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:05.341903 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d65b6bc-580b-4dd7-b410-1555415de6b2 tempest-VolumesAdminNegativeTest-599200631 tempest-VolumesAdminNegativeTest-599200631-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:05.551085 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-4d65b6bc-580b-4dd7-b410-1555415de6b2 tempest-VolumesAdminNegativeTest-599200631 tempest-VolumesAdminNegativeTest-599200631-project-admin] HTTP exception thrown: Volume f0408a23-35c3-4bc0-baf0-70b36409fb74 could not be found. Aug 04 16:47:05.572076 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-640b183b-22cc-4bbc-821f-0a303a74cfbf tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:05.590961 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-640b183b-22cc-4bbc-821f-0a303a74cfbf tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1679 microversion: 2.1 time: 0.389193 Aug 04 16:47:05.601612 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1207/2435] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:05 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1679 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4d65b6bc-580b-4dd7-b410-1555415de6b2 tempest-VolumesAdminNegativeTest-599200631 tempest-VolumesAdminNegativeTest-599200631-project-admin] Request method failure captured: Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: request: PUT /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28/os-volume_attachments/278f36e9-5430-4136-b12b-b945029fac1d HTTP/1.1 Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 74 Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_ewV8gPqZ46izd633X9netnT8P075jeroBoFqQTzUbe3TOpDYG4k62rCR67fIetYp41IuDBrZgHUaOVwG4Jpjq4tzpRZklvk_Fa9yrmjCqJM5t4umuRiEY9y5xV4zcMtaQ0zu9qkHa8Xu0T4eqd7OdyPWZr-0RSXLyF0ypbullyaS8 Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 2ff074efc58145649d3988f5a753e96c Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-VolumesAdminNegativeTest-599200631 Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader,admin Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader,admin Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2ff074efc58145649d3988f5a753e96c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2ff074efc58145649d3988f5a753e96c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2ff074efc58145649d3988f5a753e96c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2ff074efc58145649d3988f5a753e96c"}]}] Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-VolumesAdminNegativeTest-599200631 Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 2ff074efc58145649d3988f5a753e96c Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-599200631 Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-VolumesAdminNegativeTest-599200631-project-admin Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 26df578270ab421384ad697664d35226 Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-VolumesAdminNegativeTest-599200631-project-admin Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: {"volumeAttachment": {"volumeId": "f0408a23-35c3-4bc0-baf0-70b36409fb74"}} Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: exception: Volume f0408a23-35c3-4bc0-baf0-70b36409fb74 could not be found. Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'server_id': 'befbf568-78f2-4571-bf63-fdac57291b28', 'id': '278f36e9-5430-4136-b12b-b945029fac1d', 'body': {'volumeAttachment': {'volumeId': 'f0408a23-35c3-4bc0-baf0-70b36409fb74'}}} Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f0408a23-35c3-4bc0-baf0-70b36409fb74 could not be found. (HTTP 404) (Request-ID: req-4119cb5c-93d9-4b58-acc2-8c74a0841962) Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 16:47:05.608200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f0408a23-35c3-4bc0-baf0-70b36409fb74 could not be found. Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume f0408a23-35c3-4bc0-baf0-70b36409fb74 could not be found. Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f0408a23-35c3-4bc0-baf0-70b36409fb74 could not be found. Aug 04 16:47:05.615829 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:05.623556 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4d65b6bc-580b-4dd7-b410-1555415de6b2 tempest-VolumesAdminNegativeTest-599200631 tempest-VolumesAdminNegativeTest-599200631-project-admin] Returning 400 to user: Volume f0408a23-35c3-4bc0-baf0-70b36409fb74 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:47:05.623556 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4d65b6bc-580b-4dd7-b410-1555415de6b2 tempest-VolumesAdminNegativeTest-599200631 tempest-VolumesAdminNegativeTest-599200631-project-admin] 10.222.0.23 "PUT /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28/os-volume_attachments/278f36e9-5430-4136-b12b-b945029fac1d" status: 400 len: 107 microversion: 2.1 time: 0.621869 Aug 04 16:47:05.624434 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-71feb7eb-4444-4f69-a6b8-6c7d13d2973b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:05.625762 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-71feb7eb-4444-4f69-a6b8-6c7d13d2973b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:05.626047 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1229/2436] 10.222.0.23 () {60 vars in 1433 bytes} [Thu Aug 4 16:47:04 2022] PUT /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28/os-volume_attachments/278f36e9-5430-4136-b12b-b945029fac1d => generated 107 bytes in 626 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:47:05.643925 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ce263711-3c61-43f9-aab9-fcad3ad30e95 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:05.646411 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ce263711-3c61-43f9-aab9-fcad3ad30e95 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: fbc88621-3d3a-4819-a1bd-d0515850bd01] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:05.651171 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-71feb7eb-4444-4f69-a6b8-6c7d13d2973b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:05.653678 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-71feb7eb-4444-4f69-a6b8-6c7d13d2973b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:05.656679 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-71feb7eb-4444-4f69-a6b8-6c7d13d2973b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:05.657995 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-71feb7eb-4444-4f69-a6b8-6c7d13d2973b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:05.675402 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ce263711-3c61-43f9-aab9-fcad3ad30e95 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:05.676202 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ce263711-3c61-43f9-aab9-fcad3ad30e95 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:05.677731 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ce263711-3c61-43f9-aab9-fcad3ad30e95 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:05.678537 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ce263711-3c61-43f9-aab9-fcad3ad30e95 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:05.715692 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-71feb7eb-4444-4f69-a6b8-6c7d13d2973b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lazy-loading 'flavor' on Instance uuid 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:47:05.882582 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-71feb7eb-4444-4f69-a6b8-6c7d13d2973b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "POST /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61/action" status: 202 len: 0 microversion: 2.1 time: 0.277988 Aug 04 16:47:05.884580 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1208/2437] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:47:05 2022] POST /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:47:05.904059 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-a8388a26-bace-4cfe-b2c8-c8639b42f371 req-8f897e49-e722-411e-ade9-0f6b6d7c4074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2290ea80-011c-47ab-b4a9-620f1a8f5631", "name": "network-vif-plugged", "status": "completed", "tag": "6791076a-a32f-4256-8c4d-42629ee687dd"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:05.934889 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a8388a26-bace-4cfe-b2c8-c8639b42f371 req-8f897e49-e722-411e-ade9-0f6b6d7c4074 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:05.935772 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a8388a26-bace-4cfe-b2c8-c8639b42f371 req-8f897e49-e722-411e-ade9-0f6b6d7c4074 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:05.951520 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-a8388a26-bace-4cfe-b2c8-c8639b42f371 req-8f897e49-e722-411e-ade9-0f6b6d7c4074 service nova] Creating event network-vif-plugged:6791076a-a32f-4256-8c4d-42629ee687dd for instance 2290ea80-011c-47ab-b4a9-620f1a8f5631 on n-h2-846466-12 Aug 04 16:47:05.959079 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-a8388a26-bace-4cfe-b2c8-c8639b42f371 req-8f897e49-e722-411e-ade9-0f6b6d7c4074 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071527 Aug 04 16:47:05.959546 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1209/2438] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:47:05.967095 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fb86b1cb-35b2-4515-b05c-0d27b5167b5e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:05.969767 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fb86b1cb-35b2-4515-b05c-0d27b5167b5e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea0f2c5d-c250-4617-9edd-03a8a74d1e2a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:05.980329 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fb86b1cb-35b2-4515-b05c-0d27b5167b5e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:05.981186 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fb86b1cb-35b2-4515-b05c-0d27b5167b5e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:05.982286 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fb86b1cb-35b2-4515-b05c-0d27b5167b5e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:05.983062 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fb86b1cb-35b2-4515-b05c-0d27b5167b5e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:06.239340 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ce263711-3c61-43f9-aab9-fcad3ad30e95 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450c14de401149bc8a24efb11e24b631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a69315bfb4723b95c9b79e0741b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:06.255094 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ce263711-3c61-43f9-aab9-fcad3ad30e95 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "GET /compute/v2.1/servers/fbc88621-3d3a-4819-a1bd-d0515850bd01" status: 200 len: 1505 microversion: 2.1 time: 0.627153 Aug 04 16:47:06.257627 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1230/2439] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:05 2022] GET /compute/v2.1/servers/fbc88621-3d3a-4819-a1bd-d0515850bd01 => generated 1505 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:06.266834 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0b7965ff-37ec-459f-95a7-d7ac610d5a5b tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:06.268052 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0b7965ff-37ec-459f-95a7-d7ac610d5a5b tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: befbf568-78f2-4571-bf63-fdac57291b28] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:06.278314 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0b7965ff-37ec-459f-95a7-d7ac610d5a5b tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:06.279359 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0b7965ff-37ec-459f-95a7-d7ac610d5a5b tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:06.280821 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0b7965ff-37ec-459f-95a7-d7ac610d5a5b tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:06.282430 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0b7965ff-37ec-459f-95a7-d7ac610d5a5b tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:06.426739 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-0b7965ff-37ec-459f-95a7-d7ac610d5a5b tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lazy-loading 'services' on Instance uuid befbf568-78f2-4571-bf63-fdac57291b28 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:47:06.498362 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fb86b1cb-35b2-4515-b05c-0d27b5167b5e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:06.516119 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fb86b1cb-35b2-4515-b05c-0d27b5167b5e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a" status: 200 len: 1315 microversion: 2.1 time: 0.550941 Aug 04 16:47:06.517169 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1210/2440] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:05 2022] GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a => generated 1315 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:06.522953 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e46f5c94-90d3-468e-93da-fdb27bd1bb1a tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:06.523862 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e46f5c94-90d3-468e-93da-fdb27bd1bb1a tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:06.532477 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e46f5c94-90d3-468e-93da-fdb27bd1bb1a tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:06.533415 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e46f5c94-90d3-468e-93da-fdb27bd1bb1a tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:06.534502 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e46f5c94-90d3-468e-93da-fdb27bd1bb1a tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:06.535300 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e46f5c94-90d3-468e-93da-fdb27bd1bb1a tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:06.594876 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0b7965ff-37ec-459f-95a7-d7ac610d5a5b tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "DELETE /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28/os-volume_attachments/278f36e9-5430-4136-b12b-b945029fac1d" status: 202 len: 0 microversion: 2.1 time: 0.333756 Aug 04 16:47:06.601443 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1231/2441] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Aug 4 16:47:06 2022] DELETE /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28/os-volume_attachments/278f36e9-5430-4136-b12b-b945029fac1d => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:47:06.615778 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-770a0443-7d12-42fa-a098-13e0945a5f3a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:06.617397 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-770a0443-7d12-42fa-a098-13e0945a5f3a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 2290ea80-011c-47ab-b4a9-620f1a8f5631] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:06.656205 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-770a0443-7d12-42fa-a098-13e0945a5f3a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:06.660072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-770a0443-7d12-42fa-a098-13e0945a5f3a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:06.661614 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-770a0443-7d12-42fa-a098-13e0945a5f3a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:06.663318 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-770a0443-7d12-42fa-a098-13e0945a5f3a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:06.903243 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e46f5c94-90d3-468e-93da-fdb27bd1bb1a tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:06.921819 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e46f5c94-90d3-468e-93da-fdb27bd1bb1a tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61" status: 200 len: 1479 microversion: 2.1 time: 0.402392 Aug 04 16:47:06.923898 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1211/2442] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:06 2022] GET /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61 => generated 1479 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:06.935922 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d1f7bb2c-dceb-4c40-a5b6-3cc8b450cf86 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:06.937758 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d1f7bb2c-dceb-4c40-a5b6-3cc8b450cf86 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: 40121d67-65d4-4a6b-ae3f-6a85d3c99e46] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:06.952396 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d1f7bb2c-dceb-4c40-a5b6-3cc8b450cf86 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:06.953798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d1f7bb2c-dceb-4c40-a5b6-3cc8b450cf86 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:06.956033 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d1f7bb2c-dceb-4c40-a5b6-3cc8b450cf86 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:06.959883 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d1f7bb2c-dceb-4c40-a5b6-3cc8b450cf86 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:07.045729 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-770a0443-7d12-42fa-a098-13e0945a5f3a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:07.058249 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-770a0443-7d12-42fa-a098-13e0945a5f3a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/2290ea80-011c-47ab-b4a9-620f1a8f5631" status: 200 len: 1316 microversion: 2.1 time: 0.454494 Aug 04 16:47:07.058849 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1232/2443] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:06 2022] GET /compute/v2.1/servers/2290ea80-011c-47ab-b4a9-620f1a8f5631 => generated 1316 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:07.065299 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5763c820-f897-4d67-8e2f-a22b5a8c5125 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:07.072238 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5763c820-f897-4d67-8e2f-a22b5a8c5125 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: befbf568-78f2-4571-bf63-fdac57291b28] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:07.103689 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5763c820-f897-4d67-8e2f-a22b5a8c5125 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:07.104170 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5763c820-f897-4d67-8e2f-a22b5a8c5125 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:07.104986 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5763c820-f897-4d67-8e2f-a22b5a8c5125 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:07.105455 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5763c820-f897-4d67-8e2f-a22b5a8c5125 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:07.190542 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5763c820-f897-4d67-8e2f-a22b5a8c5125 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127398 Aug 04 16:47:07.192039 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1233/2444] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 16:47:07 2022] GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:47:07.202736 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-19c73b2b-c3d4-4f65-bb7e-c4f30f4db3ee tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:07.204169 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-19c73b2b-c3d4-4f65-bb7e-c4f30f4db3ee tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:07.221001 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-19c73b2b-c3d4-4f65-bb7e-c4f30f4db3ee tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:07.221886 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-19c73b2b-c3d4-4f65-bb7e-c4f30f4db3ee tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:07.224999 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-19c73b2b-c3d4-4f65-bb7e-c4f30f4db3ee tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:07.225978 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-19c73b2b-c3d4-4f65-bb7e-c4f30f4db3ee tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:07.307566 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d1f7bb2c-dceb-4c40-a5b6-3cc8b450cf86 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450c14de401149bc8a24efb11e24b631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a69315bfb4723b95c9b79e0741b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:07.322866 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d1f7bb2c-dceb-4c40-a5b6-3cc8b450cf86 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "GET /compute/v2.1/servers/40121d67-65d4-4a6b-ae3f-6a85d3c99e46" status: 200 len: 1505 microversion: 2.1 time: 0.396450 Aug 04 16:47:07.324136 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1212/2445] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:06 2022] GET /compute/v2.1/servers/40121d67-65d4-4a6b-ae3f-6a85d3c99e46 => generated 1505 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:07.330951 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b498ab49-60d8-4a77-bc4f-303e8cc1bcff tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-418464528"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:07.333911 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b498ab49-60d8-4a77-bc4f-303e8cc1bcff tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:07.343361 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b498ab49-60d8-4a77-bc4f-303e8cc1bcff tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:07.345120 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b498ab49-60d8-4a77-bc4f-303e8cc1bcff tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:07.346819 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b498ab49-60d8-4a77-bc4f-303e8cc1bcff tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:07.347771 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b498ab49-60d8-4a77-bc4f-303e8cc1bcff tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:07.502588 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-19c73b2b-c3d4-4f65-bb7e-c4f30f4db3ee tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:07.528249 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-19c73b2b-c3d4-4f65-bb7e-c4f30f4db3ee tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1679 microversion: 2.1 time: 0.334274 Aug 04 16:47:07.541315 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1234/2446] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:07 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1679 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:07.541926 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-25904bf5-a4ae-4e68-b254-283889499ef8 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:07.543047 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-25904bf5-a4ae-4e68-b254-283889499ef8 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: 40121d67-65d4-4a6b-ae3f-6a85d3c99e46] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:07.568632 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-25904bf5-a4ae-4e68-b254-283889499ef8 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:07.570411 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-25904bf5-a4ae-4e68-b254-283889499ef8 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:07.575748 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-25904bf5-a4ae-4e68-b254-283889499ef8 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:07.576624 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-25904bf5-a4ae-4e68-b254-283889499ef8 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:07.663239 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-25904bf5-a4ae-4e68-b254-283889499ef8 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: 40121d67-65d4-4a6b-ae3f-6a85d3c99e46] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:47:07.679340 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:47:07.954962 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:47:08.033351 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-25904bf5-a4ae-4e68-b254-283889499ef8 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "DELETE /compute/v2.1/servers/40121d67-65d4-4a6b-ae3f-6a85d3c99e46" status: 204 len: 0 microversion: 2.1 time: 0.501193 Aug 04 16:47:08.041603 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1235/2447] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:47:07 2022] DELETE /compute/v2.1/servers/40121d67-65d4-4a6b-ae3f-6a85d3c99e46 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:47:08.079509 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b498ab49-60d8-4a77-bc4f-303e8cc1bcff tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "POST /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61/action" status: 202 len: 0 microversion: 2.1 time: 0.752551 Aug 04 16:47:08.086547 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1213/2448] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:47:07 2022] POST /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61/action => generated 0 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 16:47:08.095139 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0f240273-547f-4b08-8e39-1cdd8def1fc8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:08.096978 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0f240273-547f-4b08-8e39-1cdd8def1fc8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea0f2c5d-c250-4617-9edd-03a8a74d1e2a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:08.107973 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c6804bf7-e536-434b-9726-8f3dd6d7d32a tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:08.114506 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c6804bf7-e536-434b-9726-8f3dd6d7d32a tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: fbc88621-3d3a-4819-a1bd-d0515850bd01] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:08.127795 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0f240273-547f-4b08-8e39-1cdd8def1fc8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:08.128716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c6804bf7-e536-434b-9726-8f3dd6d7d32a tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:08.129066 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0f240273-547f-4b08-8e39-1cdd8def1fc8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:08.129670 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c6804bf7-e536-434b-9726-8f3dd6d7d32a tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:08.132359 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c6804bf7-e536-434b-9726-8f3dd6d7d32a tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:08.133087 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c6804bf7-e536-434b-9726-8f3dd6d7d32a tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:08.133467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0f240273-547f-4b08-8e39-1cdd8def1fc8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:08.136242 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0f240273-547f-4b08-8e39-1cdd8def1fc8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:08.198757 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c6804bf7-e536-434b-9726-8f3dd6d7d32a tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: fbc88621-3d3a-4819-a1bd-d0515850bd01] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:47:08.425986 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c6804bf7-e536-434b-9726-8f3dd6d7d32a tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fbc88621-3d3a-4819-a1bd-d0515850bd01" status: 204 len: 0 microversion: 2.1 time: 0.337533 Aug 04 16:47:08.432213 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1214/2449] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:47:08 2022] DELETE /compute/v2.1/servers/fbc88621-3d3a-4819-a1bd-d0515850bd01 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:47:08.448491 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9e49c279-ce6c-414b-a5b2-9d26ddf99ae4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e84be75e0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:08.538012 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0f240273-547f-4b08-8e39-1cdd8def1fc8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:08.552056 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9e49c279-ce6c-414b-a5b2-9d26ddf99ae4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3" status: 200 len: 1435 microversion: 2.1 time: 0.115614 Aug 04 16:47:08.553996 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0f240273-547f-4b08-8e39-1cdd8def1fc8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a" status: 200 len: 1315 microversion: 2.1 time: 0.510319 Aug 04 16:47:08.555469 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1236/2450] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:08 2022] GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a => generated 1315 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:08.561972 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f8afe16f-b558-4981-9d72-32670633471b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:08.563136 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f8afe16f-b558-4981-9d72-32670633471b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 2290ea80-011c-47ab-b4a9-620f1a8f5631] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:08.576710 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1215/2451] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:47:08 2022] GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3 => generated 1435 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:08.589248 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-895aa336-b1c0-4533-a1f2-cb4052da00e7 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:08.591827 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f8afe16f-b558-4981-9d72-32670633471b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:08.592548 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f8afe16f-b558-4981-9d72-32670633471b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:08.596940 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f8afe16f-b558-4981-9d72-32670633471b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:08.597560 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f8afe16f-b558-4981-9d72-32670633471b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:08.598736 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-895aa336-b1c0-4533-a1f2-cb4052da00e7 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: befbf568-78f2-4571-bf63-fdac57291b28] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:08.617144 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-895aa336-b1c0-4533-a1f2-cb4052da00e7 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:08.618864 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-895aa336-b1c0-4533-a1f2-cb4052da00e7 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:08.622656 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-895aa336-b1c0-4533-a1f2-cb4052da00e7 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:08.623338 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-895aa336-b1c0-4533-a1f2-cb4052da00e7 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:08.703250 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-895aa336-b1c0-4533-a1f2-cb4052da00e7 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124897 Aug 04 16:47:08.705314 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1216/2452] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 16:47:08 2022] GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:47:08.730491 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4bd1437b-bda7-4f56-901d-435bf25dd9ef tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:08.736010 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4bd1437b-bda7-4f56-901d-435bf25dd9ef tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: 40121d67-65d4-4a6b-ae3f-6a85d3c99e46] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:08.767300 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4bd1437b-bda7-4f56-901d-435bf25dd9ef tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:08.773603 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4bd1437b-bda7-4f56-901d-435bf25dd9ef tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:08.775916 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4bd1437b-bda7-4f56-901d-435bf25dd9ef tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:08.785890 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4bd1437b-bda7-4f56-901d-435bf25dd9ef tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:08.991784 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f8afe16f-b558-4981-9d72-32670633471b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:09.005224 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f8afe16f-b558-4981-9d72-32670633471b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/2290ea80-011c-47ab-b4a9-620f1a8f5631" status: 200 len: 1466 microversion: 2.1 time: 0.448094 Aug 04 16:47:09.034831 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1237/2453] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:08 2022] GET /compute/v2.1/servers/2290ea80-011c-47ab-b4a9-620f1a8f5631 => generated 1466 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:09.044397 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6d504018-e2ac-43ec-bb62-5bbb664f4ef9 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:09.045475 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6d504018-e2ac-43ec-bb62-5bbb664f4ef9 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:09.054759 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d504018-e2ac-43ec-bb62-5bbb664f4ef9 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:09.055457 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d504018-e2ac-43ec-bb62-5bbb664f4ef9 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:09.056485 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d504018-e2ac-43ec-bb62-5bbb664f4ef9 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:09.057230 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d504018-e2ac-43ec-bb62-5bbb664f4ef9 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:09.743676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4bd1437b-bda7-4f56-901d-435bf25dd9ef tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450c14de401149bc8a24efb11e24b631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a69315bfb4723b95c9b79e0741b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:09.746813 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6d504018-e2ac-43ec-bb62-5bbb664f4ef9 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:09.794485 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6d504018-e2ac-43ec-bb62-5bbb664f4ef9 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1679 microversion: 2.1 time: 0.757828 Aug 04 16:47:09.795670 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4bd1437b-bda7-4f56-901d-435bf25dd9ef tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "GET /compute/v2.1/servers/40121d67-65d4-4a6b-ae3f-6a85d3c99e46" status: 200 len: 1511 microversion: 2.1 time: 1.085247 Aug 04 16:47:09.807709 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1238/2454] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:09 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1679 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:09.809016 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1217/2455] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:08 2022] GET /compute/v2.1/servers/40121d67-65d4-4a6b-ae3f-6a85d3c99e46 => generated 1511 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:09.856635 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7ccaf539-9598-4ebc-b32b-512d38f83ed2 tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:09.857603 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a8f88a2f-fb2b-4a8c-998a-ea33d7dd3808 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:09.862101 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7ccaf539-9598-4ebc-b32b-512d38f83ed2 tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] [instance: 2290ea80-011c-47ab-b4a9-620f1a8f5631] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:09.862858 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a8f88a2f-fb2b-4a8c-998a-ea33d7dd3808 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea0f2c5d-c250-4617-9edd-03a8a74d1e2a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:09.883306 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ccaf539-9598-4ebc-b32b-512d38f83ed2 tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:09.883810 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ccaf539-9598-4ebc-b32b-512d38f83ed2 tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:09.887227 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ccaf539-9598-4ebc-b32b-512d38f83ed2 tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:09.888362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ccaf539-9598-4ebc-b32b-512d38f83ed2 tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:09.890366 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a8f88a2f-fb2b-4a8c-998a-ea33d7dd3808 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:09.891830 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a8f88a2f-fb2b-4a8c-998a-ea33d7dd3808 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:09.894674 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a8f88a2f-fb2b-4a8c-998a-ea33d7dd3808 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:09.895833 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a8f88a2f-fb2b-4a8c-998a-ea33d7dd3808 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:10.187576 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a8f88a2f-fb2b-4a8c-998a-ea33d7dd3808 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:10.226887 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7ccaf539-9598-4ebc-b32b-512d38f83ed2 tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/2290ea80-011c-47ab-b4a9-620f1a8f5631" status: 200 len: 1619 microversion: 2.1 time: 0.408540 Aug 04 16:47:10.228114 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a8f88a2f-fb2b-4a8c-998a-ea33d7dd3808 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a" status: 200 len: 1315 microversion: 2.1 time: 0.404289 Aug 04 16:47:10.237879 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1239/2456] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:09 2022] GET /compute/v2.1/servers/2290ea80-011c-47ab-b4a9-620f1a8f5631 => generated 1619 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:10.238584 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1218/2457] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:09 2022] GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:10.331677 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7dc35dd5-4e24-464f-8d1a-cbf9ba0e5782 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e841c93a0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:10.340527 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bede414b-aeff-4738-9816-df342b1b1194 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:10.351135 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bede414b-aeff-4738-9816-df342b1b1194 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: befbf568-78f2-4571-bf63-fdac57291b28] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:10.426386 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bede414b-aeff-4738-9816-df342b1b1194 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:10.430312 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bede414b-aeff-4738-9816-df342b1b1194 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:10.431675 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bede414b-aeff-4738-9816-df342b1b1194 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:10.432379 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bede414b-aeff-4738-9816-df342b1b1194 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:10.492208 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7dc35dd5-4e24-464f-8d1a-cbf9ba0e5782 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3" status: 200 len: 1435 microversion: 2.1 time: 0.178161 Aug 04 16:47:10.512657 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1240/2458] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:47:10 2022] GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3 => generated 1435 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:10.543876 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-860bb804-92a6-46a1-951a-25d820f60ec9 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:10.544753 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-860bb804-92a6-46a1-951a-25d820f60ec9 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:10.582055 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-860bb804-92a6-46a1-951a-25d820f60ec9 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:10.583233 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-860bb804-92a6-46a1-951a-25d820f60ec9 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:10.591684 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-860bb804-92a6-46a1-951a-25d820f60ec9 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:10.601142 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-860bb804-92a6-46a1-951a-25d820f60ec9 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:10.643212 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bede414b-aeff-4738-9816-df342b1b1194 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.402452 Aug 04 16:47:10.651527 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1219/2459] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 16:47:10 2022] GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28/os-volume_attachments => generated 197 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:47:10.662588 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-860bb804-92a6-46a1-951a-25d820f60ec9 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] HTTP exception thrown: Instance 09e1b482-0372-4270-ac25-6d3349aca31e could not be found. Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-860bb804-92a6-46a1-951a-25d820f60ec9 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Request method failure captured: Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e HTTP/1.1 Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_Ycu9CFgkTmHkUIsjjoTC-2WpUUEJdORjLDMzHP8xN-D-RLzPx04S-tUUmZY50Rq19hFYUNWlYkI3X1SOERilRo3RTH7SeHxPFXV9NmGPGvnIzzMRfCVpm6H6hA6QpQvT3Ne2R7Z_2OOERUbJymFc5wcx8Y319h_F9Na7Z0kGUX3zE Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: X-Openstack-Nova-Api-Version: 2.32 Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 6bfc77ffb53d4f53b5afc9d0b6313cf5 Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-TaggedBootDevicesTest-786050424 Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6bfc77ffb53d4f53b5afc9d0b6313cf5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6bfc77ffb53d4f53b5afc9d0b6313cf5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6bfc77ffb53d4f53b5afc9d0b6313cf5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6bfc77ffb53d4f53b5afc9d0b6313cf5"}]}] Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-TaggedBootDevicesTest-786050424 Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 6bfc77ffb53d4f53b5afc9d0b6313cf5 Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-TaggedBootDevicesTest-786050424 Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-TaggedBootDevicesTest-786050424-project Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 5d3d49f848ba4735a2ed7b077d6789d5 Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-TaggedBootDevicesTest-786050424-project Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 09e1b482-0372-4270-ac25-6d3349aca31e could not be found. Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '09e1b482-0372-4270-ac25-6d3349aca31e'} Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09e1b482-0372-4270-ac25-6d3349aca31e could not be found. Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:47:10.666508 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:47:10.674109 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09e1b482-0372-4270-ac25-6d3349aca31e could not be found. Aug 04 16:47:10.674109 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:10.674109 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:47:10.674109 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:10.674109 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:47:10.674109 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:47:10.674109 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:47:10.674109 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:47:10.674109 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:47:10.674109 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09e1b482-0372-4270-ac25-6d3349aca31e could not be found. Aug 04 16:47:10.674109 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:10.685128 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6a584274-c479-483d-8253-f19958fa2dac tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1333745153", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["86667237-3005-4ee4-83d6-c250bba481d5"]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:10.687129 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-860bb804-92a6-46a1-951a-25d820f60ec9 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Returning 404 to user: Instance 09e1b482-0372-4270-ac25-6d3349aca31e could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:47:10.690746 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-860bb804-92a6-46a1-951a-25d820f60ec9 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "DELETE /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 404 len: 111 microversion: 2.32 time: 0.176474 Aug 04 16:47:10.699907 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1241/2460] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Aug 4 16:47:10 2022] DELETE /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:47:10.710809 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-af4d0466-bf68-4cd3-bedf-b82b57503fc9 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:10.726352 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-af4d0466-bf68-4cd3-bedf-b82b57503fc9 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] [instance: 09e1b482-0372-4270-ac25-6d3349aca31e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:10.733470 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-af4d0466-bf68-4cd3-bedf-b82b57503fc9 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:10.734477 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-af4d0466-bf68-4cd3-bedf-b82b57503fc9 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:10.735774 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-af4d0466-bf68-4cd3-bedf-b82b57503fc9 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:10.736448 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-af4d0466-bf68-4cd3-bedf-b82b57503fc9 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:10.765589 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-af4d0466-bf68-4cd3-bedf-b82b57503fc9 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] HTTP exception thrown: Instance 09e1b482-0372-4270-ac25-6d3349aca31e could not be found. Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-af4d0466-bf68-4cd3-bedf-b82b57503fc9 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Request method failure captured: Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e HTTP/1.1 Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_Ycu9CFgkTmHkUIsjjoTC-2WpUUEJdORjLDMzHP8xN-D-RLzPx04S-tUUmZY50Rq19hFYUNWlYkI3X1SOERilRo3RTH7SeHxPFXV9NmGPGvnIzzMRfCVpm6H6hA6QpQvT3Ne2R7Z_2OOERUbJymFc5wcx8Y319h_F9Na7Z0kGUX3zE Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: X-Openstack-Nova-Api-Version: 2.32 Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 6bfc77ffb53d4f53b5afc9d0b6313cf5 Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-TaggedBootDevicesTest-786050424 Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6bfc77ffb53d4f53b5afc9d0b6313cf5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6bfc77ffb53d4f53b5afc9d0b6313cf5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6bfc77ffb53d4f53b5afc9d0b6313cf5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6bfc77ffb53d4f53b5afc9d0b6313cf5"}]}] Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-TaggedBootDevicesTest-786050424 Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 6bfc77ffb53d4f53b5afc9d0b6313cf5 Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-TaggedBootDevicesTest-786050424 Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-TaggedBootDevicesTest-786050424-project Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 5d3d49f848ba4735a2ed7b077d6789d5 Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-TaggedBootDevicesTest-786050424-project Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 09e1b482-0372-4270-ac25-6d3349aca31e could not be found. Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '09e1b482-0372-4270-ac25-6d3349aca31e'} Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09e1b482-0372-4270-ac25-6d3349aca31e could not be found. Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09e1b482-0372-4270-ac25-6d3349aca31e could not be found. Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:47:10.781547 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:10.788519 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:47:10.788519 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:47:10.788519 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:47:10.788519 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:47:10.788519 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:47:10.788519 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09e1b482-0372-4270-ac25-6d3349aca31e could not be found. Aug 04 16:47:10.788519 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:10.790255 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-af4d0466-bf68-4cd3-bedf-b82b57503fc9 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] Returning 404 to user: Instance 09e1b482-0372-4270-ac25-6d3349aca31e could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:47:10.791380 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-af4d0466-bf68-4cd3-bedf-b82b57503fc9 tempest-TaggedBootDevicesTest-786050424 tempest-TaggedBootDevicesTest-786050424-project] 10.222.0.23 "GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e" status: 404 len: 111 microversion: 2.32 time: 0.090411 Aug 04 16:47:10.796524 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-6a584274-c479-483d-8253-f19958fa2dac tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] validate_networks() for None {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:47:10.798910 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1242/2461] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:47:10 2022] GET /compute/v2.1/servers/09e1b482-0372-4270-ac25-6d3349aca31e => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:47:10.838265 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-579c2343-43fd-4550-8997-f1c0de35a1e4 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:10.838892 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-579c2343-43fd-4550-8997-f1c0de35a1e4 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: 40121d67-65d4-4a6b-ae3f-6a85d3c99e46] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:10.852049 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-579c2343-43fd-4550-8997-f1c0de35a1e4 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:10.853670 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-579c2343-43fd-4550-8997-f1c0de35a1e4 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:10.856595 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-579c2343-43fd-4550-8997-f1c0de35a1e4 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:10.858512 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-579c2343-43fd-4550-8997-f1c0de35a1e4 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:11.847538 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-579c2343-43fd-4550-8997-f1c0de35a1e4 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450c14de401149bc8a24efb11e24b631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a69315bfb4723b95c9b79e0741b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:11.884195 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-579c2343-43fd-4550-8997-f1c0de35a1e4 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "GET /compute/v2.1/servers/40121d67-65d4-4a6b-ae3f-6a85d3c99e46" status: 200 len: 1511 microversion: 2.1 time: 1.050332 Aug 04 16:47:11.886166 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1243/2462] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:10 2022] GET /compute/v2.1/servers/40121d67-65d4-4a6b-ae3f-6a85d3c99e46 => generated 1511 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:47:11.895735 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f3ed0888-8454-4255-ac98-794dfbda314d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:11.908723 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f3ed0888-8454-4255-ac98-794dfbda314d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:11.932551 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3ed0888-8454-4255-ac98-794dfbda314d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:11.940674 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3ed0888-8454-4255-ac98-794dfbda314d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:11.943148 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3ed0888-8454-4255-ac98-794dfbda314d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:11.944500 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3ed0888-8454-4255-ac98-794dfbda314d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:13.857769 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f3ed0888-8454-4255-ac98-794dfbda314d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:13.879230 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f3ed0888-8454-4255-ac98-794dfbda314d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1656 microversion: 2.1 time: 1.991016 Aug 04 16:47:13.879901 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1244/2463] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:11 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1656 bytes in 1993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:13.910061 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9c543010-1f52-40cb-83ae-95961ea128c5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:13.910714 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9c543010-1f52-40cb-83ae-95961ea128c5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea0f2c5d-c250-4617-9edd-03a8a74d1e2a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:13.925092 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c543010-1f52-40cb-83ae-95961ea128c5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:13.929376 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-6a584274-c479-483d-8253-f19958fa2dac tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:47:13.930095 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-6a584274-c479-483d-8253-f19958fa2dac tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:47:13.930798 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c543010-1f52-40cb-83ae-95961ea128c5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:13.930954 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-6a584274-c479-483d-8253-f19958fa2dac tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:47:13.931650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-6a584274-c479-483d-8253-f19958fa2dac tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:47:13.932177 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c543010-1f52-40cb-83ae-95961ea128c5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:13.932353 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-6a584274-c479-483d-8253-f19958fa2dac tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:47:13.932939 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c543010-1f52-40cb-83ae-95961ea128c5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:13.998831 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a584274-c479-483d-8253-f19958fa2dac tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:13.999574 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a584274-c479-483d-8253-f19958fa2dac tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:14.001845 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a584274-c479-483d-8253-f19958fa2dac tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:14.005598 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a584274-c479-483d-8253-f19958fa2dac tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:14.035319 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-6a584274-c479-483d-8253-f19958fa2dac tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for project b9e709c95a964cd5855d4e253aeb1043. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:47:14.043290 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-6a584274-c479-483d-8253-f19958fa2dac tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for user 336c26b5dd6644bc83f9b80adac06bce and project b9e709c95a964cd5855d4e253aeb1043. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:47:14.061454 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6a584274-c479-483d-8253-f19958fa2dac tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:47:14.065491 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6a584274-c479-483d-8253-f19958fa2dac tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 36ad8e81-987e-4c31-986e-005b5b65e40a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:47:14.162500 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6a584274-c479-483d-8253-f19958fa2dac tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.484834 Aug 04 16:47:14.163809 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1220/2464] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:47:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 3488 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:47:14.184310 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c2ad90b6-d586-4dfc-b205-ec93c7921775 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e84a31a60>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:14.362769 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c2ad90b6-d586-4dfc-b205-ec93c7921775 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3" status: 200 len: 1435 microversion: 2.1 time: 0.195953 Aug 04 16:47:14.378526 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1221/2465] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:47:14 2022] GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3 => generated 1435 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:14.449919 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-ea908505-8fb4-4d39-8377-e926ebda1281 req-4531a3a7-28d3-4946-99c9-94643d8cf03a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea0f2c5d-c250-4617-9edd-03a8a74d1e2a", "name": "network-vif-plugged", "status": "completed", "tag": "71639f30-01c1-4d6c-9627-13f24e8950ac"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:14.543216 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-ea908505-8fb4-4d39-8377-e926ebda1281 req-4531a3a7-28d3-4946-99c9-94643d8cf03a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:14.547486 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-ea908505-8fb4-4d39-8377-e926ebda1281 req-4531a3a7-28d3-4946-99c9-94643d8cf03a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:14.605601 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-ea908505-8fb4-4d39-8377-e926ebda1281 req-4531a3a7-28d3-4946-99c9-94643d8cf03a service nova] Creating event network-vif-plugged:71639f30-01c1-4d6c-9627-13f24e8950ac for instance ea0f2c5d-c250-4617-9edd-03a8a74d1e2a on n-h2-846466-12 Aug 04 16:47:14.637389 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-ea908505-8fb4-4d39-8377-e926ebda1281 req-4531a3a7-28d3-4946-99c9-94643d8cf03a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.254176 Aug 04 16:47:14.640746 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1222/2466] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:47:14.668452 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a88457cf-70d0-459a-af45-5615d4e10bf6 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:14.682942 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a88457cf-70d0-459a-af45-5615d4e10bf6 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: befbf568-78f2-4571-bf63-fdac57291b28] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:14.724025 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a88457cf-70d0-459a-af45-5615d4e10bf6 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:14.725301 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a88457cf-70d0-459a-af45-5615d4e10bf6 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:14.734697 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a88457cf-70d0-459a-af45-5615d4e10bf6 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:14.741508 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a88457cf-70d0-459a-af45-5615d4e10bf6 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:14.925469 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a88457cf-70d0-459a-af45-5615d4e10bf6 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.276941 Aug 04 16:47:14.943574 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1223/2467] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 16:47:14 2022] GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28/os-volume_attachments => generated 197 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:47:14.968174 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dba7387b-17e1-46ef-b3c5-33f1b116716f tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:14.971309 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-dba7387b-17e1-46ef-b3c5-33f1b116716f tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: 40121d67-65d4-4a6b-ae3f-6a85d3c99e46] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:14.996851 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dba7387b-17e1-46ef-b3c5-33f1b116716f tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:15.002937 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dba7387b-17e1-46ef-b3c5-33f1b116716f tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:15.004398 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dba7387b-17e1-46ef-b3c5-33f1b116716f tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:15.006003 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dba7387b-17e1-46ef-b3c5-33f1b116716f tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:15.364548 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9c543010-1f52-40cb-83ae-95961ea128c5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:15.460899 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9c543010-1f52-40cb-83ae-95961ea128c5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a" status: 200 len: 1315 microversion: 2.1 time: 1.557362 Aug 04 16:47:15.503599 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1245/2468] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:13 2022] GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a => generated 1315 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:15.523910 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f6697a8c-4d21-4136-ae01-ce7296b981d4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:15.578209 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f6697a8c-4d21-4136-ae01-ce7296b981d4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:15.594879 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f6697a8c-4d21-4136-ae01-ce7296b981d4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:15.901149 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f6697a8c-4d21-4136-ae01-ce7296b981d4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Going to try to start instance {{(pid=126125) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 16:47:16.079957 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f6697a8c-4d21-4136-ae01-ce7296b981d4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action" status: 202 len: 0 microversion: 2.1 time: 0.574152 Aug 04 16:47:16.093131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-dba7387b-17e1-46ef-b3c5-33f1b116716f tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450c14de401149bc8a24efb11e24b631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a69315bfb4723b95c9b79e0741b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:16.093578 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1246/2469] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:47:15 2022] POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action => generated 0 bytes in 585 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:47:16.104721 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dba7387b-17e1-46ef-b3c5-33f1b116716f tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "GET /compute/v2.1/servers/40121d67-65d4-4a6b-ae3f-6a85d3c99e46" status: 200 len: 1511 microversion: 2.1 time: 1.152657 Aug 04 16:47:16.110191 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1224/2470] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:14 2022] GET /compute/v2.1/servers/40121d67-65d4-4a6b-ae3f-6a85d3c99e46 => generated 1511 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:16.114418 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f93692cd-5e24-4065-84bc-f97c74bea6f0 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:16.115215 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f93692cd-5e24-4065-84bc-f97c74bea6f0 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 36ad8e81-987e-4c31-986e-005b5b65e40a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:16.127694 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-840690eb-a200-4a9a-b36d-22f00a8fc690 req-0e4344b2-d017-4eb8-a25c-e659d0728058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbc88621-3d3a-4819-a1bd-d0515850bd01", "name": "network-vif-deleted", "tag": "f1766ddf-1d03-4c23-96bd-83ee51e1a5d3"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:16.145327 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f93692cd-5e24-4065-84bc-f97c74bea6f0 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:16.145955 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f93692cd-5e24-4065-84bc-f97c74bea6f0 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:16.146854 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f93692cd-5e24-4065-84bc-f97c74bea6f0 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:16.147291 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f93692cd-5e24-4065-84bc-f97c74bea6f0 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:16.192413 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-840690eb-a200-4a9a-b36d-22f00a8fc690 req-0e4344b2-d017-4eb8-a25c-e659d0728058 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:16.194002 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-840690eb-a200-4a9a-b36d-22f00a8fc690 req-0e4344b2-d017-4eb8-a25c-e659d0728058 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:16.233706 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-840690eb-a200-4a9a-b36d-22f00a8fc690 req-0e4344b2-d017-4eb8-a25c-e659d0728058 service nova] Creating event network-vif-deleted:f1766ddf-1d03-4c23-96bd-83ee51e1a5d3 for instance fbc88621-3d3a-4819-a1bd-d0515850bd01 on n-h1-846466-12 Aug 04 16:47:16.244339 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-840690eb-a200-4a9a-b36d-22f00a8fc690 req-0e4344b2-d017-4eb8-a25c-e659d0728058 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132306 Aug 04 16:47:16.245619 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1225/2471] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:47:16.252365 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c96375d8-3d15-48da-a0d4-60bc6cda4209 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e84a77b80>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:16.355104 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c96375d8-3d15-48da-a0d4-60bc6cda4209 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3" status: 200 len: 1435 microversion: 2.1 time: 0.107176 Aug 04 16:47:16.355910 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1226/2472] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:47:16 2022] GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3 => generated 1435 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:16.369180 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2f170d89-522c-45a4-be69-aab3d513bbec tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:16.376036 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2f170d89-522c-45a4-be69-aab3d513bbec tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: befbf568-78f2-4571-bf63-fdac57291b28] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:16.398619 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f170d89-522c-45a4-be69-aab3d513bbec tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:16.399416 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f170d89-522c-45a4-be69-aab3d513bbec tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:16.403076 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f170d89-522c-45a4-be69-aab3d513bbec tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:16.404013 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f170d89-522c-45a4-be69-aab3d513bbec tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:16.483566 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2f170d89-522c-45a4-be69-aab3d513bbec tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125818 Aug 04 16:47:16.490798 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1227/2473] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 16:47:16 2022] GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:47:16.496843 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ca2d364f-eafe-48eb-99f7-84e90a099e13 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:16.497531 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ca2d364f-eafe-48eb-99f7-84e90a099e13 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:16.511799 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ca2d364f-eafe-48eb-99f7-84e90a099e13 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:16.512287 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ca2d364f-eafe-48eb-99f7-84e90a099e13 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:16.516221 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ca2d364f-eafe-48eb-99f7-84e90a099e13 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:16.523185 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ca2d364f-eafe-48eb-99f7-84e90a099e13 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:16.570691 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f93692cd-5e24-4065-84bc-f97c74bea6f0 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:16.582374 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f93692cd-5e24-4065-84bc-f97c74bea6f0 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/36ad8e81-987e-4c31-986e-005b5b65e40a" status: 200 len: 1269 microversion: 2.1 time: 0.491446 Aug 04 16:47:16.593659 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1247/2474] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:16 2022] GET /compute/v2.1/servers/36ad8e81-987e-4c31-986e-005b5b65e40a => generated 1269 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:16.606923 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3b9f3487-5eac-4d73-b26c-f1db73fa1e39 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:16.617961 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3b9f3487-5eac-4d73-b26c-f1db73fa1e39 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea0f2c5d-c250-4617-9edd-03a8a74d1e2a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:16.667718 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b9f3487-5eac-4d73-b26c-f1db73fa1e39 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:16.669754 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b9f3487-5eac-4d73-b26c-f1db73fa1e39 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:16.671316 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b9f3487-5eac-4d73-b26c-f1db73fa1e39 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:16.683072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b9f3487-5eac-4d73-b26c-f1db73fa1e39 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:17.562095 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3b9f3487-5eac-4d73-b26c-f1db73fa1e39 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:17.592507 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3b9f3487-5eac-4d73-b26c-f1db73fa1e39 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a" status: 200 len: 1315 microversion: 2.1 time: 0.988542 Aug 04 16:47:17.595264 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1248/2475] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:16 2022] GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a => generated 1315 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:17.621901 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-9a8cb5fc-f6ed-4038-850b-cf696bb9f28c req-06888eaa-55a1-4707-b2c2-f3a3a102a738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e3e569c-a08f-4026-9fc9-ad9caf3d3c61", "name": "network-vif-plugged", "status": "completed", "tag": "b6270fe9-d0af-4606-ba95-ec0813af91bc"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:17.665035 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-9a8cb5fc-f6ed-4038-850b-cf696bb9f28c req-06888eaa-55a1-4707-b2c2-f3a3a102a738 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:17.668946 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-9a8cb5fc-f6ed-4038-850b-cf696bb9f28c req-06888eaa-55a1-4707-b2c2-f3a3a102a738 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:17.684462 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ca2d364f-eafe-48eb-99f7-84e90a099e13 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:17.704862 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-9a8cb5fc-f6ed-4038-850b-cf696bb9f28c req-06888eaa-55a1-4707-b2c2-f3a3a102a738 service nova] Creating event network-vif-plugged:b6270fe9-d0af-4606-ba95-ec0813af91bc for instance 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61 on n-h2-846466-12 Aug 04 16:47:17.706124 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ca2d364f-eafe-48eb-99f7-84e90a099e13 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1665 microversion: 2.1 time: 1.218905 Aug 04 16:47:17.708923 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1228/2476] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:16 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1665 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:17.717454 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-75d6d5b3-1a80-4f2d-86e0-1b35af8bb664 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:17.718504 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-75d6d5b3-1a80-4f2d-86e0-1b35af8bb664 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: 40121d67-65d4-4a6b-ae3f-6a85d3c99e46] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:17.732157 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-9a8cb5fc-f6ed-4038-850b-cf696bb9f28c req-06888eaa-55a1-4707-b2c2-f3a3a102a738 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130129 Aug 04 16:47:17.734187 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1249/2477] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:47:17.741512 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-10691f97-84b8-42f0-8b34-a6666002e553 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e841ae160>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:17.754542 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-75d6d5b3-1a80-4f2d-86e0-1b35af8bb664 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:17.755568 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-75d6d5b3-1a80-4f2d-86e0-1b35af8bb664 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:17.759049 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-75d6d5b3-1a80-4f2d-86e0-1b35af8bb664 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:17.760020 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-75d6d5b3-1a80-4f2d-86e0-1b35af8bb664 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:17.842769 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-10691f97-84b8-42f0-8b34-a6666002e553 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3" status: 200 len: 1435 microversion: 2.1 time: 0.099329 Aug 04 16:47:17.844330 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1250/2478] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:47:17 2022] GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3 => generated 1435 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:17.858707 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-75d6d5b3-1a80-4f2d-86e0-1b35af8bb664 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:17.866480 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3df3bee6-1567-41f3-8ce4-ec1f0cf13db4 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:17.868779 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-75d6d5b3-1a80-4f2d-86e0-1b35af8bb664 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:17.873512 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-75d6d5b3-1a80-4f2d-86e0-1b35af8bb664 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lazy-loading 'fault' on Instance uuid 40121d67-65d4-4a6b-ae3f-6a85d3c99e46 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:47:17.886174 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3df3bee6-1567-41f3-8ce4-ec1f0cf13db4 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: befbf568-78f2-4571-bf63-fdac57291b28] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:17.945723 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3df3bee6-1567-41f3-8ce4-ec1f0cf13db4 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:17.948417 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3df3bee6-1567-41f3-8ce4-ec1f0cf13db4 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:17.953083 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3df3bee6-1567-41f3-8ce4-ec1f0cf13db4 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:17.960313 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3df3bee6-1567-41f3-8ce4-ec1f0cf13db4 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:18.072332 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3df3bee6-1567-41f3-8ce4-ec1f0cf13db4 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.226540 Aug 04 16:47:18.073406 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1251/2479] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 16:47:17 2022] GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28/os-volume_attachments => generated 25 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:47:18.090617 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6ab75872-7d07-4b18-ab2a-4a247355a09a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:18.093111 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6ab75872-7d07-4b18-ab2a-4a247355a09a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 36ad8e81-987e-4c31-986e-005b5b65e40a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:18.112102 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6ab75872-7d07-4b18-ab2a-4a247355a09a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:18.113084 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6ab75872-7d07-4b18-ab2a-4a247355a09a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:18.117779 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6ab75872-7d07-4b18-ab2a-4a247355a09a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:18.118755 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6ab75872-7d07-4b18-ab2a-4a247355a09a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:18.300199 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-75d6d5b3-1a80-4f2d-86e0-1b35af8bb664 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450c14de401149bc8a24efb11e24b631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a69315bfb4723b95c9b79e0741b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:18.372517 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-75d6d5b3-1a80-4f2d-86e0-1b35af8bb664 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "GET /compute/v2.1/servers/40121d67-65d4-4a6b-ae3f-6a85d3c99e46" status: 200 len: 1308 microversion: 2.1 time: 0.655173 Aug 04 16:47:18.417896 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1229/2480] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:17 2022] GET /compute/v2.1/servers/40121d67-65d4-4a6b-ae3f-6a85d3c99e46 => generated 1308 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:18.574568 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-6a919c8b-c082-4fee-b455-1d0adb129fdc req-4fd9fc9b-6058-4947-b1ca-77dd5a6fd5a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40121d67-65d4-4a6b-ae3f-6a85d3c99e46", "name": "network-vif-deleted", "tag": "69742927-466e-479d-bc59-c96d132c5421"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:18.641793 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-6a919c8b-c082-4fee-b455-1d0adb129fdc req-4fd9fc9b-6058-4947-b1ca-77dd5a6fd5a4 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:18.642298 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-6a919c8b-c082-4fee-b455-1d0adb129fdc req-4fd9fc9b-6058-4947-b1ca-77dd5a6fd5a4 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:18.669161 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-6a919c8b-c082-4fee-b455-1d0adb129fdc req-4fd9fc9b-6058-4947-b1ca-77dd5a6fd5a4 service nova] Creating event network-vif-deleted:69742927-466e-479d-bc59-c96d132c5421 for instance 40121d67-65d4-4a6b-ae3f-6a85d3c99e46 on n-h1-846466-12 Aug 04 16:47:18.685717 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-6a919c8b-c082-4fee-b455-1d0adb129fdc req-4fd9fc9b-6058-4947-b1ca-77dd5a6fd5a4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115975 Aug 04 16:47:18.689974 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1230/2481] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:47:18.696268 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6ab75872-7d07-4b18-ab2a-4a247355a09a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:18.700718 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4d0ae1ee-d605-4385-9d80-70814bfef46e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:18.702660 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4d0ae1ee-d605-4385-9d80-70814bfef46e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea0f2c5d-c250-4617-9edd-03a8a74d1e2a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:18.705930 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6ab75872-7d07-4b18-ab2a-4a247355a09a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/36ad8e81-987e-4c31-986e-005b5b65e40a" status: 200 len: 1275 microversion: 2.1 time: 0.631002 Aug 04 16:47:18.713691 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1252/2482] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:18 2022] GET /compute/v2.1/servers/36ad8e81-987e-4c31-986e-005b5b65e40a => generated 1275 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:18.721704 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6d4f85ce-b529-4bee-bba0-a3cfa177ae3f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-427908799", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "a226ab43-a2ff-42ab-8f4b-732352dfa018"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:18.724049 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4d0ae1ee-d605-4385-9d80-70814bfef46e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:18.733770 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4d0ae1ee-d605-4385-9d80-70814bfef46e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:18.735903 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4d0ae1ee-d605-4385-9d80-70814bfef46e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:18.739934 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4d0ae1ee-d605-4385-9d80-70814bfef46e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:18.876932 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-6d4f85ce-b529-4bee-bba0-a3cfa177ae3f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] validate_networks() for [('a226ab43-a2ff-42ab-8f4b-732352dfa018', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:47:19.051054 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4d0ae1ee-d605-4385-9d80-70814bfef46e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:19.062959 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4d0ae1ee-d605-4385-9d80-70814bfef46e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a" status: 200 len: 1502 microversion: 2.1 time: 0.371240 Aug 04 16:47:19.069096 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1231/2483] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:18 2022] GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a => generated 1502 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:19.098662 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-73ca4eb7-76a6-4b33-a0fa-c61614d7c994 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:19.099592 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-73ca4eb7-76a6-4b33-a0fa-c61614d7c994 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:19.108740 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-73ca4eb7-76a6-4b33-a0fa-c61614d7c994 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:19.109638 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-73ca4eb7-76a6-4b33-a0fa-c61614d7c994 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:19.110771 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-73ca4eb7-76a6-4b33-a0fa-c61614d7c994 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:19.111404 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-73ca4eb7-76a6-4b33-a0fa-c61614d7c994 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:20.493574 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-73ca4eb7-76a6-4b33-a0fa-c61614d7c994 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:20.519168 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-73ca4eb7-76a6-4b33-a0fa-c61614d7c994 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1665 microversion: 2.1 time: 1.431839 Aug 04 16:47:20.521355 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1232/2484] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:19 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1665 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:20.526458 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2bce94be-1b42-4302-978d-88de0c23cdd1 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e84135670>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:20.626097 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2bce94be-1b42-4302-978d-88de0c23cdd1 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3" status: 200 len: 1435 microversion: 2.1 time: 0.103199 Aug 04 16:47:20.630394 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1233/2485] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:47:20 2022] GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3 => generated 1435 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:20.635636 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d7858731-1daf-47ed-8a4c-8c63c087cb2a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:20.642238 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d7858731-1daf-47ed-8a4c-8c63c087cb2a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea0f2c5d-c250-4617-9edd-03a8a74d1e2a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:20.656734 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d7858731-1daf-47ed-8a4c-8c63c087cb2a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:20.665851 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d7858731-1daf-47ed-8a4c-8c63c087cb2a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:20.667086 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d7858731-1daf-47ed-8a4c-8c63c087cb2a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:20.667708 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d7858731-1daf-47ed-8a4c-8c63c087cb2a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:20.734574 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:47:20.862454 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d7858731-1daf-47ed-8a4c-8c63c087cb2a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "POST /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a/action" status: 202 len: 0 microversion: 2.1 time: 0.219097 Aug 04 16:47:20.864658 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1234/2486] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:47:20 2022] POST /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:47:20.883795 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dd6b2933-b963-4b8c-83a7-97c2b5ecf45f tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:20.884933 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-dd6b2933-b963-4b8c-83a7-97c2b5ecf45f tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: 40121d67-65d4-4a6b-ae3f-6a85d3c99e46] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:20.894598 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:47:20.896752 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd6b2933-b963-4b8c-83a7-97c2b5ecf45f tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:20.902124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd6b2933-b963-4b8c-83a7-97c2b5ecf45f tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:20.903249 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd6b2933-b963-4b8c-83a7-97c2b5ecf45f tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:20.904003 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd6b2933-b963-4b8c-83a7-97c2b5ecf45f tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:20.958387 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-dd6b2933-b963-4b8c-83a7-97c2b5ecf45f tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] HTTP exception thrown: Instance 40121d67-65d4-4a6b-ae3f-6a85d3c99e46 could not be found. Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dd6b2933-b963-4b8c-83a7-97c2b5ecf45f tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Request method failure captured: Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/40121d67-65d4-4a6b-ae3f-6a85d3c99e46 HTTP/1.1 Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_fAjsKUtItXIsCgriSVoDnB2ksZVmLCJm9VXNWsyMX5Ud6SFPMDmp78aVD1gSJE7RhJeu5HGbhH_dpShx_ladgp-gUwMpml9w8B74Bsy_Q9i_HyfFsM0rcQa7-Jup9m3ZG7BycGMzwT-vTFHpYp_zoMVHWgYffiPPOvCapic56iLos Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: ba7a69315bfb4723b95c9b79e0741b0e Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-MultipleCreateTestJSON-741543070 Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ba7a69315bfb4723b95c9b79e0741b0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ba7a69315bfb4723b95c9b79e0741b0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ba7a69315bfb4723b95c9b79e0741b0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ba7a69315bfb4723b95c9b79e0741b0e"}]}] Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-MultipleCreateTestJSON-741543070 Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: ba7a69315bfb4723b95c9b79e0741b0e Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-MultipleCreateTestJSON-741543070 Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-MultipleCreateTestJSON-741543070-project Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 450c14de401149bc8a24efb11e24b631 Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-MultipleCreateTestJSON-741543070-project Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 40121d67-65d4-4a6b-ae3f-6a85d3c99e46 could not be found. Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '40121d67-65d4-4a6b-ae3f-6a85d3c99e46'} Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40121d67-65d4-4a6b-ae3f-6a85d3c99e46 could not be found. Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40121d67-65d4-4a6b-ae3f-6a85d3c99e46 could not be found. Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:47:20.960954 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:47:20.966120 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:47:20.966120 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:47:20.966120 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:47:20.966120 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:47:20.966120 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:47:20.966120 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40121d67-65d4-4a6b-ae3f-6a85d3c99e46 could not be found. Aug 04 16:47:20.966120 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:47:20.977499 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dd6b2933-b963-4b8c-83a7-97c2b5ecf45f tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Returning 404 to user: Instance 40121d67-65d4-4a6b-ae3f-6a85d3c99e46 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:47:20.978748 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dd6b2933-b963-4b8c-83a7-97c2b5ecf45f tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "GET /compute/v2.1/servers/40121d67-65d4-4a6b-ae3f-6a85d3c99e46" status: 404 len: 111 microversion: 2.1 time: 0.112524 Aug 04 16:47:20.979483 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1235/2487] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:20 2022] GET /compute/v2.1/servers/40121d67-65d4-4a6b-ae3f-6a85d3c99e46 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:47:20.984622 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c9326716-4bf2-4a64-9289-1b81d8a32d4c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:20.988039 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c9326716-4bf2-4a64-9289-1b81d8a32d4c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 36ad8e81-987e-4c31-986e-005b5b65e40a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:21.002318 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9326716-4bf2-4a64-9289-1b81d8a32d4c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:21.002983 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9326716-4bf2-4a64-9289-1b81d8a32d4c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:21.004044 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9326716-4bf2-4a64-9289-1b81d8a32d4c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:21.016344 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9326716-4bf2-4a64-9289-1b81d8a32d4c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:22.773449 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-6d4f85ce-b529-4bee-bba0-a3cfa177ae3f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:47:22.775239 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-6d4f85ce-b529-4bee-bba0-a3cfa177ae3f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:47:22.776981 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-6d4f85ce-b529-4bee-bba0-a3cfa177ae3f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:47:22.777775 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-6d4f85ce-b529-4bee-bba0-a3cfa177ae3f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:47:22.778389 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-6d4f85ce-b529-4bee-bba0-a3cfa177ae3f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:47:22.783901 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c9326716-4bf2-4a64-9289-1b81d8a32d4c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:22.792439 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c9326716-4bf2-4a64-9289-1b81d8a32d4c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/36ad8e81-987e-4c31-986e-005b5b65e40a" status: 200 len: 1317 microversion: 2.1 time: 1.811663 Aug 04 16:47:22.815927 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1236/2488] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:20 2022] GET /compute/v2.1/servers/36ad8e81-987e-4c31-986e-005b5b65e40a => generated 1317 bytes in 1835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:22.821871 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-21744ac0-7c08-4b0e-bac2-16fffa11f435 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:22.823016 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-21744ac0-7c08-4b0e-bac2-16fffa11f435 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea0f2c5d-c250-4617-9edd-03a8a74d1e2a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:22.841519 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d4f85ce-b529-4bee-bba0-a3cfa177ae3f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:22.844576 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-21744ac0-7c08-4b0e-bac2-16fffa11f435 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:22.845669 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d4f85ce-b529-4bee-bba0-a3cfa177ae3f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:22.846897 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d4f85ce-b529-4bee-bba0-a3cfa177ae3f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:22.847833 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-21744ac0-7c08-4b0e-bac2-16fffa11f435 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:22.848641 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d4f85ce-b529-4bee-bba0-a3cfa177ae3f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:22.849891 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-21744ac0-7c08-4b0e-bac2-16fffa11f435 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:22.856382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-21744ac0-7c08-4b0e-bac2-16fffa11f435 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:22.899478 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-6d4f85ce-b529-4bee-bba0-a3cfa177ae3f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Getting quotas for project 1f4cdb4245df44119c504915dc542d9b. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:47:22.917571 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-6d4f85ce-b529-4bee-bba0-a3cfa177ae3f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Getting quotas for user c97a079594a2400bb4db33f3ce3a1497 and project 1f4cdb4245df44119c504915dc542d9b. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:47:22.947128 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6d4f85ce-b529-4bee-bba0-a3cfa177ae3f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:47:22.950168 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6d4f85ce-b529-4bee-bba0-a3cfa177ae3f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: fd0b16dd-d4dd-45d3-891a-646b89dce6fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:47:23.051017 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6d4f85ce-b529-4bee-bba0-a3cfa177ae3f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.336700 Aug 04 16:47:23.052439 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1253/2489] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:47:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 4339 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:47:23.062294 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1a38ba08-7e8b-4ac3-9dd0-6d037b05f2a5 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:23.080232 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1a38ba08-7e8b-4ac3-9dd0-6d037b05f2a5 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] [instance: fbc88621-3d3a-4819-a1bd-d0515850bd01] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:23.117115 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1a38ba08-7e8b-4ac3-9dd0-6d037b05f2a5 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:23.118179 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1a38ba08-7e8b-4ac3-9dd0-6d037b05f2a5 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:23.120700 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1a38ba08-7e8b-4ac3-9dd0-6d037b05f2a5 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:23.121479 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1a38ba08-7e8b-4ac3-9dd0-6d037b05f2a5 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:23.202761 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-1a38ba08-7e8b-4ac3-9dd0-6d037b05f2a5 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] HTTP exception thrown: Instance fbc88621-3d3a-4819-a1bd-d0515850bd01 could not be found. Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1a38ba08-7e8b-4ac3-9dd0-6d037b05f2a5 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Request method failure captured: Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/fbc88621-3d3a-4819-a1bd-d0515850bd01 HTTP/1.1 Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_fAjsKUtItXIsCgriSVoDnB2ksZVmLCJm9VXNWsyMX5Ud6SFPMDmp78aVD1gSJE7RhJeu5HGbhH_dpShx_ladgp-gUwMpml9w8B74Bsy_Q9i_HyfFsM0rcQa7-Jup9m3ZG7BycGMzwT-vTFHpYp_zoMVHWgYffiPPOvCapic56iLos Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: ba7a69315bfb4723b95c9b79e0741b0e Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-MultipleCreateTestJSON-741543070 Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ba7a69315bfb4723b95c9b79e0741b0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ba7a69315bfb4723b95c9b79e0741b0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ba7a69315bfb4723b95c9b79e0741b0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ba7a69315bfb4723b95c9b79e0741b0e"}]}] Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-MultipleCreateTestJSON-741543070 Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: ba7a69315bfb4723b95c9b79e0741b0e Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-MultipleCreateTestJSON-741543070 Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-MultipleCreateTestJSON-741543070-project Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 450c14de401149bc8a24efb11e24b631 Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-MultipleCreateTestJSON-741543070-project Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance fbc88621-3d3a-4819-a1bd-d0515850bd01 could not be found. Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'fbc88621-3d3a-4819-a1bd-d0515850bd01'} Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbc88621-3d3a-4819-a1bd-d0515850bd01 could not be found. Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbc88621-3d3a-4819-a1bd-d0515850bd01 could not be found. Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:47:23.206217 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:23.214033 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:47:23.214033 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:47:23.214033 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:47:23.214033 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:47:23.214033 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:47:23.214033 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbc88621-3d3a-4819-a1bd-d0515850bd01 could not be found. Aug 04 16:47:23.214033 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:23.218009 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1a38ba08-7e8b-4ac3-9dd0-6d037b05f2a5 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] Returning 404 to user: Instance fbc88621-3d3a-4819-a1bd-d0515850bd01 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:47:23.220409 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1a38ba08-7e8b-4ac3-9dd0-6d037b05f2a5 tempest-MultipleCreateTestJSON-741543070 tempest-MultipleCreateTestJSON-741543070-project] 10.222.0.23 "GET /compute/v2.1/servers/fbc88621-3d3a-4819-a1bd-d0515850bd01" status: 404 len: 111 microversion: 2.1 time: 0.166232 Aug 04 16:47:23.227138 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1254/2490] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:23 2022] GET /compute/v2.1/servers/fbc88621-3d3a-4819-a1bd-d0515850bd01 => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:47:23.245394 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b172253e-d9df-4680-baaa-12c3989079ea tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:23.247081 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b172253e-d9df-4680-baaa-12c3989079ea tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:23.279838 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b172253e-d9df-4680-baaa-12c3989079ea tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:23.284158 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b172253e-d9df-4680-baaa-12c3989079ea tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:23.291091 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b172253e-d9df-4680-baaa-12c3989079ea tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:23.294511 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b172253e-d9df-4680-baaa-12c3989079ea tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:23.328297 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:47:23.918534 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-21744ac0-7c08-4b0e-bac2-16fffa11f435 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:23.944960 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-21744ac0-7c08-4b0e-bac2-16fffa11f435 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a" status: 200 len: 1487 microversion: 2.1 time: 1.127047 Aug 04 16:47:23.949495 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1237/2491] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:22 2022] GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a => generated 1487 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:23.979646 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bdfeccb5-8d8b-4480-9da0-98c87c8c88c9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e89b6e820>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:24.028551 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:47:24.053062 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:47:24.385053 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bdfeccb5-8d8b-4480-9da0-98c87c8c88c9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3" status: 200 len: 1435 microversion: 2.1 time: 0.433215 Aug 04 16:47:24.390233 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1238/2492] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:47:23 2022] GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3 => generated 1435 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:24.403099 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-a9f407ea-5c47-4391-a2d8-9daca4dc1396 req-6b5d7f4b-82ec-4001-a608-d3f6868f22a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36ad8e81-987e-4c31-986e-005b5b65e40a", "tag": "9949cc20-028a-4378-acd4-328f948f117b"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:24.449667 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a9f407ea-5c47-4391-a2d8-9daca4dc1396 req-6b5d7f4b-82ec-4001-a608-d3f6868f22a2 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:24.451116 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a9f407ea-5c47-4391-a2d8-9daca4dc1396 req-6b5d7f4b-82ec-4001-a608-d3f6868f22a2 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:24.477765 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b172253e-d9df-4680-baaa-12c3989079ea tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:24.508560 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-a9f407ea-5c47-4391-a2d8-9daca4dc1396 req-6b5d7f4b-82ec-4001-a608-d3f6868f22a2 service nova] Creating event network-changed:9949cc20-028a-4378-acd4-328f948f117b for instance 36ad8e81-987e-4c31-986e-005b5b65e40a on n-h2-846466-12 Aug 04 16:47:24.526506 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b172253e-d9df-4680-baaa-12c3989079ea tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 1.295949 Aug 04 16:47:24.530917 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1255/2493] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:23 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:24.538420 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-a9f407ea-5c47-4391-a2d8-9daca4dc1396 req-6b5d7f4b-82ec-4001-a608-d3f6868f22a2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146674 Aug 04 16:47:24.547599 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1239/2494] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:47:24.564898 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8595dce2-96f4-43f0-b33f-2b42ef8d3ec8 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:24.573559 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8595dce2-96f4-43f0-b33f-2b42ef8d3ec8 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: fd0b16dd-d4dd-45d3-891a-646b89dce6fa] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:24.588777 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f9140a2c-c323-45d3-a0fd-cec2fb31fd8b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:24.593038 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f9140a2c-c323-45d3-a0fd-cec2fb31fd8b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 36ad8e81-987e-4c31-986e-005b5b65e40a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:24.613644 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8595dce2-96f4-43f0-b33f-2b42ef8d3ec8 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:24.618041 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8595dce2-96f4-43f0-b33f-2b42ef8d3ec8 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:24.628158 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8595dce2-96f4-43f0-b33f-2b42ef8d3ec8 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:24.628880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8595dce2-96f4-43f0-b33f-2b42ef8d3ec8 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:24.644033 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f9140a2c-c323-45d3-a0fd-cec2fb31fd8b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:24.646372 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f9140a2c-c323-45d3-a0fd-cec2fb31fd8b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:24.648704 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f9140a2c-c323-45d3-a0fd-cec2fb31fd8b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:24.654952 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f9140a2c-c323-45d3-a0fd-cec2fb31fd8b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:25.279142 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8595dce2-96f4-43f0-b33f-2b42ef8d3ec8 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97a079594a2400bb4db33f3ce3a1497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4cdb4245df44119c504915dc542d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:25.310906 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8595dce2-96f4-43f0-b33f-2b42ef8d3ec8 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa" status: 200 len: 1221 microversion: 2.1 time: 0.767189 Aug 04 16:47:25.315836 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1256/2495] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:24 2022] GET /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa => generated 1221 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:25.336210 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-32e7152d-894b-4b82-9342-c6ea08e45147 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:25.340299 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-32e7152d-894b-4b82-9342-c6ea08e45147 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea0f2c5d-c250-4617-9edd-03a8a74d1e2a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:25.388463 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-32e7152d-894b-4b82-9342-c6ea08e45147 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:25.398095 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-32e7152d-894b-4b82-9342-c6ea08e45147 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:25.400009 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-32e7152d-894b-4b82-9342-c6ea08e45147 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:25.401535 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-32e7152d-894b-4b82-9342-c6ea08e45147 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:25.475629 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-32e7152d-894b-4b82-9342-c6ea08e45147 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea0f2c5d-c250-4617-9edd-03a8a74d1e2a] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:47:25.685641 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f9140a2c-c323-45d3-a0fd-cec2fb31fd8b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:25.724245 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f9140a2c-c323-45d3-a0fd-cec2fb31fd8b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/36ad8e81-987e-4c31-986e-005b5b65e40a" status: 200 len: 1317 microversion: 2.1 time: 1.167900 Aug 04 16:47:25.730834 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1240/2496] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:24 2022] GET /compute/v2.1/servers/36ad8e81-987e-4c31-986e-005b5b65e40a => generated 1317 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:25.776370 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5d47a14d-3aae-4537-949f-499a4d68ec3d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:25.782291 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5d47a14d-3aae-4537-949f-499a4d68ec3d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:25.818736 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:47:25.847129 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5d47a14d-3aae-4537-949f-499a4d68ec3d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:25.849629 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5d47a14d-3aae-4537-949f-499a4d68ec3d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:25.860937 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5d47a14d-3aae-4537-949f-499a4d68ec3d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:25.862240 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5d47a14d-3aae-4537-949f-499a4d68ec3d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:25.899090 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-32e7152d-894b-4b82-9342-c6ea08e45147 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a" status: 204 len: 0 microversion: 2.1 time: 0.577638 Aug 04 16:47:25.905387 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1257/2497] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:47:25 2022] DELETE /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a => generated 0 bytes in 588 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:47:25.938768 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bfe5763f-cb55-43a7-aef4-2c3a2cfad8b1 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e77f87ca0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:26.167992 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bfe5763f-cb55-43a7-aef4-2c3a2cfad8b1 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3" status: 200 len: 1435 microversion: 2.1 time: 0.252245 Aug 04 16:47:26.169195 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1258/2498] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:47:25 2022] GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3 => generated 1435 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:26.192256 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ab46b684-2709-46de-be57-5a7db36b5beb tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:26.201122 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ab46b684-2709-46de-be57-5a7db36b5beb tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea0f2c5d-c250-4617-9edd-03a8a74d1e2a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:26.242559 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab46b684-2709-46de-be57-5a7db36b5beb tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:26.247737 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab46b684-2709-46de-be57-5a7db36b5beb tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:26.252836 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab46b684-2709-46de-be57-5a7db36b5beb tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:26.266646 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab46b684-2709-46de-be57-5a7db36b5beb tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:27.183204 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5d47a14d-3aae-4537-949f-499a4d68ec3d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:27.198314 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ab46b684-2709-46de-be57-5a7db36b5beb tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:27.225266 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ab46b684-2709-46de-be57-5a7db36b5beb tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a" status: 200 len: 1493 microversion: 2.1 time: 1.054439 Aug 04 16:47:27.228628 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1259/2499] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:26 2022] GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a => generated 1493 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:27.242887 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5d47a14d-3aae-4537-949f-499a4d68ec3d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 1.509861 Aug 04 16:47:27.245264 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0d1d2054-6d30-4203-823f-2921e2283dc2 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:27.248968 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0d1d2054-6d30-4203-823f-2921e2283dc2 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: fd0b16dd-d4dd-45d3-891a-646b89dce6fa] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:27.269343 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1241/2500] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:25 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:27.291155 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0d1d2054-6d30-4203-823f-2921e2283dc2 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:27.291930 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0d1d2054-6d30-4203-823f-2921e2283dc2 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:27.292983 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0d1d2054-6d30-4203-823f-2921e2283dc2 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:27.295428 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0d1d2054-6d30-4203-823f-2921e2283dc2 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:27.296831 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f71e2b70-8d6d-4307-bb4c-920fc0d7706a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:27.302158 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f71e2b70-8d6d-4307-bb4c-920fc0d7706a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 36ad8e81-987e-4c31-986e-005b5b65e40a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:27.318410 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f71e2b70-8d6d-4307-bb4c-920fc0d7706a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:27.318875 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f71e2b70-8d6d-4307-bb4c-920fc0d7706a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:27.321198 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f71e2b70-8d6d-4307-bb4c-920fc0d7706a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:27.326836 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f71e2b70-8d6d-4307-bb4c-920fc0d7706a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:27.700504 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0d1d2054-6d30-4203-823f-2921e2283dc2 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97a079594a2400bb4db33f3ce3a1497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4cdb4245df44119c504915dc542d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:27.728125 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0d1d2054-6d30-4203-823f-2921e2283dc2 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa" status: 200 len: 1275 microversion: 2.1 time: 0.497687 Aug 04 16:47:27.747411 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1260/2501] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:27 2022] GET /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa => generated 1275 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:27.788262 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8c08a24b-ef0b-4032-ad04-a533b67a9d89 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e84da5ca0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:28.039984 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8c08a24b-ef0b-4032-ad04-a533b67a9d89 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3" status: 200 len: 1435 microversion: 2.1 time: 0.256008 Aug 04 16:47:28.041144 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1261/2502] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:47:27 2022] GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3 => generated 1435 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:28.066428 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-31c321af-feda-4f9e-802e-008983b02080 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:28.073941 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-31c321af-feda-4f9e-802e-008983b02080 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:28.121837 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-31c321af-feda-4f9e-802e-008983b02080 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:28.122575 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-31c321af-feda-4f9e-802e-008983b02080 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:28.123887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-31c321af-feda-4f9e-802e-008983b02080 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:28.124714 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-31c321af-feda-4f9e-802e-008983b02080 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:28.395585 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-31c321af-feda-4f9e-802e-008983b02080 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Unlocking {{(pid=126125) unlock /opt/stack/nova/nova/compute/api.py:4810}} Aug 04 16:47:28.787558 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-31c321af-feda-4f9e-802e-008983b02080 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action" status: 202 len: 0 microversion: 2.1 time: 0.740300 Aug 04 16:47:28.797826 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1262/2503] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:47:28 2022] POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action => generated 0 bytes in 752 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:47:28.811447 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c16e6599-cf43-4860-b7cc-3feb17f60816 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:28.826289 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c16e6599-cf43-4860-b7cc-3feb17f60816 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea0f2c5d-c250-4617-9edd-03a8a74d1e2a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:28.858587 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c16e6599-cf43-4860-b7cc-3feb17f60816 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:28.862576 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c16e6599-cf43-4860-b7cc-3feb17f60816 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:28.863922 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c16e6599-cf43-4860-b7cc-3feb17f60816 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:28.864605 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c16e6599-cf43-4860-b7cc-3feb17f60816 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:29.678370 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f71e2b70-8d6d-4307-bb4c-920fc0d7706a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:29.727400 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f71e2b70-8d6d-4307-bb4c-920fc0d7706a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/36ad8e81-987e-4c31-986e-005b5b65e40a" status: 200 len: 1317 microversion: 2.1 time: 2.466426 Aug 04 16:47:29.730435 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1242/2504] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:27 2022] GET /compute/v2.1/servers/36ad8e81-987e-4c31-986e-005b5b65e40a => generated 1317 bytes in 2471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:29.748325 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e3726c84-8afa-417c-92ad-d32457c1616e tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:29.754768 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e3726c84-8afa-417c-92ad-d32457c1616e tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: fd0b16dd-d4dd-45d3-891a-646b89dce6fa] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:29.787306 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e3726c84-8afa-417c-92ad-d32457c1616e tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:29.788783 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e3726c84-8afa-417c-92ad-d32457c1616e tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:29.793064 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e3726c84-8afa-417c-92ad-d32457c1616e tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:29.794539 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e3726c84-8afa-417c-92ad-d32457c1616e tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:30.081446 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e3726c84-8afa-417c-92ad-d32457c1616e tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97a079594a2400bb4db33f3ce3a1497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4cdb4245df44119c504915dc542d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:30.094599 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e3726c84-8afa-417c-92ad-d32457c1616e tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa" status: 200 len: 1275 microversion: 2.1 time: 0.358679 Aug 04 16:47:30.096464 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1243/2505] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:29 2022] GET /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa => generated 1275 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:30.111047 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d3825180-8731-4e18-b6ef-fbf953546046 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:30.115634 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d3825180-8731-4e18-b6ef-fbf953546046 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:30.142025 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d3825180-8731-4e18-b6ef-fbf953546046 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:30.142595 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d3825180-8731-4e18-b6ef-fbf953546046 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:30.143438 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d3825180-8731-4e18-b6ef-fbf953546046 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:30.143900 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d3825180-8731-4e18-b6ef-fbf953546046 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:30.434263 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c16e6599-cf43-4860-b7cc-3feb17f60816 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:30.456769 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c16e6599-cf43-4860-b7cc-3feb17f60816 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a" status: 200 len: 1493 microversion: 2.1 time: 1.656955 Aug 04 16:47:30.459289 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1263/2506] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:28 2022] GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a => generated 1493 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:30.471249 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-23a05b36-7150-4aee-8d34-730ff633c5d2 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e841d94c0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:30.592200 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-23a05b36-7150-4aee-8d34-730ff633c5d2 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3" status: 200 len: 1435 microversion: 2.1 time: 0.131299 Aug 04 16:47:30.593367 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1264/2507] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:47:30 2022] GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3 => generated 1435 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:30.615274 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-8f3cd7ae-e7b8-4e1b-82a0-ad6a4a94a848 req-c7c30d8e-7318-4245-a0c8-b06e9d3cddd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36ad8e81-987e-4c31-986e-005b5b65e40a", "name": "network-vif-plugged", "status": "completed", "tag": "9949cc20-028a-4378-acd4-328f948f117b"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:30.651567 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-8f3cd7ae-e7b8-4e1b-82a0-ad6a4a94a848 req-c7c30d8e-7318-4245-a0c8-b06e9d3cddd9 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:30.652724 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-8f3cd7ae-e7b8-4e1b-82a0-ad6a4a94a848 req-c7c30d8e-7318-4245-a0c8-b06e9d3cddd9 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:30.679305 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-8f3cd7ae-e7b8-4e1b-82a0-ad6a4a94a848 req-c7c30d8e-7318-4245-a0c8-b06e9d3cddd9 service nova] Creating event network-vif-plugged:9949cc20-028a-4378-acd4-328f948f117b for instance 36ad8e81-987e-4c31-986e-005b5b65e40a on n-h2-846466-12 Aug 04 16:47:30.693408 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-8f3cd7ae-e7b8-4e1b-82a0-ad6a4a94a848 req-c7c30d8e-7318-4245-a0c8-b06e9d3cddd9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089598 Aug 04 16:47:30.697767 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1265/2508] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:47:30.757863 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1dc2aaad-6406-4b2d-bf24-001e152ef024 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:30.758624 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1dc2aaad-6406-4b2d-bf24-001e152ef024 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 36ad8e81-987e-4c31-986e-005b5b65e40a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:30.778474 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1dc2aaad-6406-4b2d-bf24-001e152ef024 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:30.779248 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1dc2aaad-6406-4b2d-bf24-001e152ef024 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:30.780453 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1dc2aaad-6406-4b2d-bf24-001e152ef024 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:30.782592 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1dc2aaad-6406-4b2d-bf24-001e152ef024 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:30.821904 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d3825180-8731-4e18-b6ef-fbf953546046 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:30.835451 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d3825180-8731-4e18-b6ef-fbf953546046 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.735756 Aug 04 16:47:30.838152 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1244/2509] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:30 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:30.859716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4682db2b-0a15-41dd-9abf-5cd5e282032b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:30.860519 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4682db2b-0a15-41dd-9abf-5cd5e282032b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:30.874298 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4682db2b-0a15-41dd-9abf-5cd5e282032b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:30.874995 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4682db2b-0a15-41dd-9abf-5cd5e282032b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:30.878377 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4682db2b-0a15-41dd-9abf-5cd5e282032b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:30.879699 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4682db2b-0a15-41dd-9abf-5cd5e282032b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:31.190318 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1dc2aaad-6406-4b2d-bf24-001e152ef024 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:31.206474 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1dc2aaad-6406-4b2d-bf24-001e152ef024 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/36ad8e81-987e-4c31-986e-005b5b65e40a" status: 200 len: 1317 microversion: 2.1 time: 0.453684 Aug 04 16:47:31.209465 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1266/2510] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:30 2022] GET /compute/v2.1/servers/36ad8e81-987e-4c31-986e-005b5b65e40a => generated 1317 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:47:31.221061 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a3257ede-8227-431a-addd-663d53db7a5f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:31.222072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a3257ede-8227-431a-addd-663d53db7a5f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: fd0b16dd-d4dd-45d3-891a-646b89dce6fa] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:31.243105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a3257ede-8227-431a-addd-663d53db7a5f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:31.244973 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a3257ede-8227-431a-addd-663d53db7a5f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:31.247019 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a3257ede-8227-431a-addd-663d53db7a5f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:31.250889 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a3257ede-8227-431a-addd-663d53db7a5f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:31.699340 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4682db2b-0a15-41dd-9abf-5cd5e282032b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:31.714465 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4682db2b-0a15-41dd-9abf-5cd5e282032b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.859283 Aug 04 16:47:31.727895 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1245/2511] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:30 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:47:31.727895 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-01664de3-cba2-4876-9ae1-d8ec1f8fe0ca tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:31.727895 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-01664de3-cba2-4876-9ae1-d8ec1f8fe0ca tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea0f2c5d-c250-4617-9edd-03a8a74d1e2a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:31.748616 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-01664de3-cba2-4876-9ae1-d8ec1f8fe0ca tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:31.749171 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-01664de3-cba2-4876-9ae1-d8ec1f8fe0ca tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:31.750562 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-01664de3-cba2-4876-9ae1-d8ec1f8fe0ca tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:31.751361 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-01664de3-cba2-4876-9ae1-d8ec1f8fe0ca tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:32.012232 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a3257ede-8227-431a-addd-663d53db7a5f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97a079594a2400bb4db33f3ce3a1497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4cdb4245df44119c504915dc542d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:32.020968 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a3257ede-8227-431a-addd-663d53db7a5f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa" status: 200 len: 1317 microversion: 2.1 time: 0.810107 Aug 04 16:47:32.033837 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1267/2512] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:31 2022] GET /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa => generated 1317 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:32.061093 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3a824d09-63c7-470f-8c89-98d39d37feee tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e8413ad30>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:32.163594 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3a824d09-63c7-470f-8c89-98d39d37feee tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3" status: 200 len: 1435 microversion: 2.1 time: 0.128237 Aug 04 16:47:32.166379 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1268/2513] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:47:32 2022] GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3 => generated 1435 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:32.174897 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fdd1a536-cd97-468f-a522-859cdba12f6a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:32.181657 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fdd1a536-cd97-468f-a522-859cdba12f6a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:32.211775 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fdd1a536-cd97-468f-a522-859cdba12f6a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:32.212773 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fdd1a536-cd97-468f-a522-859cdba12f6a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:32.213844 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fdd1a536-cd97-468f-a522-859cdba12f6a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:32.217329 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fdd1a536-cd97-468f-a522-859cdba12f6a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:32.670074 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-01664de3-cba2-4876-9ae1-d8ec1f8fe0ca tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:32.688538 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-01664de3-cba2-4876-9ae1-d8ec1f8fe0ca tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a" status: 200 len: 1451 microversion: 2.1 time: 0.971652 Aug 04 16:47:32.701009 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1246/2514] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:31 2022] GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a => generated 1451 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:32.713759 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0f0065b5-a9a9-4372-afee-78ce3d422e5a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:32.722215 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0f0065b5-a9a9-4372-afee-78ce3d422e5a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 36ad8e81-987e-4c31-986e-005b5b65e40a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:32.734860 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0f0065b5-a9a9-4372-afee-78ce3d422e5a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:32.738709 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0f0065b5-a9a9-4372-afee-78ce3d422e5a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:32.739685 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0f0065b5-a9a9-4372-afee-78ce3d422e5a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:32.740262 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0f0065b5-a9a9-4372-afee-78ce3d422e5a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:32.864997 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:47:32.941623 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:47:34.269061 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fdd1a536-cd97-468f-a522-859cdba12f6a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:34.282173 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fdd1a536-cd97-468f-a522-859cdba12f6a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 2.113814 Aug 04 16:47:34.284000 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1269/2515] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:32 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 2117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:34.293622 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ecacdc6a-959e-4fc4-8141-d57fada8dbd1 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:34.294851 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ecacdc6a-959e-4fc4-8141-d57fada8dbd1 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: fd0b16dd-d4dd-45d3-891a-646b89dce6fa] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:34.316474 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ecacdc6a-959e-4fc4-8141-d57fada8dbd1 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:34.317446 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ecacdc6a-959e-4fc4-8141-d57fada8dbd1 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:34.319066 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ecacdc6a-959e-4fc4-8141-d57fada8dbd1 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:34.319893 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ecacdc6a-959e-4fc4-8141-d57fada8dbd1 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:34.762727 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0f0065b5-a9a9-4372-afee-78ce3d422e5a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:34.776896 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0f0065b5-a9a9-4372-afee-78ce3d422e5a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/36ad8e81-987e-4c31-986e-005b5b65e40a" status: 200 len: 1466 microversion: 2.1 time: 2.073910 Aug 04 16:47:34.778727 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1247/2516] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:32 2022] GET /compute/v2.1/servers/36ad8e81-987e-4c31-986e-005b5b65e40a => generated 1466 bytes in 2077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:34.807249 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-692dbd00-b63a-4da4-ad0a-e3cbdae24bee tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e84a310d0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:34.919613 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-692dbd00-b63a-4da4-ad0a-e3cbdae24bee tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3" status: 200 len: 1435 microversion: 2.1 time: 0.121008 Aug 04 16:47:34.921611 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1248/2517] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:47:34 2022] GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3 => generated 1435 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:34.928197 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-3fdbda34-20b7-4e37-aa0e-9f1db9a83524 req-71a7113e-3dfb-4590-b671-d8bf0a4a1d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea0f2c5d-c250-4617-9edd-03a8a74d1e2a", "name": "network-vif-deleted", "tag": "71639f30-01c1-4d6c-9627-13f24e8950ac"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:34.952053 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ecacdc6a-959e-4fc4-8141-d57fada8dbd1 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97a079594a2400bb4db33f3ce3a1497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4cdb4245df44119c504915dc542d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:34.969444 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ecacdc6a-959e-4fc4-8141-d57fada8dbd1 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa" status: 200 len: 1317 microversion: 2.1 time: 0.682607 Aug 04 16:47:34.973186 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1270/2518] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:34 2022] GET /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa => generated 1317 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:34.993068 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a58d658f-b451-4afa-ba33-1c0f30a177a8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:35.006715 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a58d658f-b451-4afa-ba33-1c0f30a177a8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea0f2c5d-c250-4617-9edd-03a8a74d1e2a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:35.009744 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-3fdbda34-20b7-4e37-aa0e-9f1db9a83524 req-71a7113e-3dfb-4590-b671-d8bf0a4a1d42 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:35.010363 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-3fdbda34-20b7-4e37-aa0e-9f1db9a83524 req-71a7113e-3dfb-4590-b671-d8bf0a4a1d42 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:35.038214 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a58d658f-b451-4afa-ba33-1c0f30a177a8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:35.038645 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a58d658f-b451-4afa-ba33-1c0f30a177a8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:35.044766 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a58d658f-b451-4afa-ba33-1c0f30a177a8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:35.052812 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a58d658f-b451-4afa-ba33-1c0f30a177a8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:35.087250 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-3fdbda34-20b7-4e37-aa0e-9f1db9a83524 req-71a7113e-3dfb-4590-b671-d8bf0a4a1d42 service nova] Creating event network-vif-deleted:71639f30-01c1-4d6c-9627-13f24e8950ac for instance ea0f2c5d-c250-4617-9edd-03a8a74d1e2a on n-h2-846466-12 Aug 04 16:47:35.107635 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-3fdbda34-20b7-4e37-aa0e-9f1db9a83524 req-71a7113e-3dfb-4590-b671-d8bf0a4a1d42 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183530 Aug 04 16:47:35.119646 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1249/2519] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:47:35.131102 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-de1d8e94-4aff-4a06-96e0-fb356433b1df tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:35.134133 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-de1d8e94-4aff-4a06-96e0-fb356433b1df tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:35.154360 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-a58d658f-b451-4afa-ba33-1c0f30a177a8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] HTTP exception thrown: Instance ea0f2c5d-c250-4617-9edd-03a8a74d1e2a could not be found. Aug 04 16:47:35.166933 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-de1d8e94-4aff-4a06-96e0-fb356433b1df tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a58d658f-b451-4afa-ba33-1c0f30a177a8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Request method failure captured: Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a HTTP/1.1 Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_ddGi-LUxEkOI7UNq-ijU5XnirMgjjOPky_n4iIeohsp_mBZi36CDxRY5dUKGmgKLroDx6IsvA3hey_uA7LPQbZI4NWhaCZQIOIkAKlIttRUGlU4y_AMkv45dQEQsQ8xd9VhN5XbmaVn_f0gvdFbALtWn0QI5OJtAeQ50IP8tuO8i0 Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/60281cf1dbe645d8949e93f9e70b5d91"}]}] Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 3cfb4739b53b411391a26de37b98469f Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance ea0f2c5d-c250-4617-9edd-03a8a74d1e2a could not be found. Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'ea0f2c5d-c250-4617-9edd-03a8a74d1e2a'} Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea0f2c5d-c250-4617-9edd-03a8a74d1e2a could not be found. Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea0f2c5d-c250-4617-9edd-03a8a74d1e2a could not be found. Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:47:35.169626 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:35.174437 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:47:35.174437 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:47:35.174437 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:47:35.174437 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:47:35.174437 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:47:35.174437 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea0f2c5d-c250-4617-9edd-03a8a74d1e2a could not be found. Aug 04 16:47:35.174437 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:35.175153 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-de1d8e94-4aff-4a06-96e0-fb356433b1df tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:35.177940 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-de1d8e94-4aff-4a06-96e0-fb356433b1df tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:35.178408 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-de1d8e94-4aff-4a06-96e0-fb356433b1df tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:35.180520 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a58d658f-b451-4afa-ba33-1c0f30a177a8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Returning 404 to user: Instance ea0f2c5d-c250-4617-9edd-03a8a74d1e2a could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:47:35.182748 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a58d658f-b451-4afa-ba33-1c0f30a177a8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a" status: 404 len: 111 microversion: 2.1 time: 0.206055 Aug 04 16:47:35.198710 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1271/2520] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:34 2022] GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a => generated 111 bytes in 222 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:47:35.211279 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fed158e0-2612-420a-8e12-285da73e446c tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:35.214460 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fed158e0-2612-420a-8e12-285da73e446c tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] [instance: 36ad8e81-987e-4c31-986e-005b5b65e40a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:35.233198 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fed158e0-2612-420a-8e12-285da73e446c tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:35.234178 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fed158e0-2612-420a-8e12-285da73e446c tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:35.235226 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fed158e0-2612-420a-8e12-285da73e446c tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:35.239669 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fed158e0-2612-420a-8e12-285da73e446c tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:35.601621 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-de1d8e94-4aff-4a06-96e0-fb356433b1df tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action" status: 202 len: 0 microversion: 2.1 time: 0.477371 Aug 04 16:47:35.604999 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1250/2521] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:47:35 2022] POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:47:35.621639 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dcf1f447-0174-474b-993f-5a2e7eabd906 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2051915544", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "fd9ba46f-9583-4f53-9ced-a3b1af7aa6df"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:35.812851 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-dcf1f447-0174-474b-993f-5a2e7eabd906 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] validate_networks() for [('fd9ba46f-9583-4f53-9ced-a3b1af7aa6df', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:47:36.082812 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:47:36.101937 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fed158e0-2612-420a-8e12-285da73e446c tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/36ad8e81-987e-4c31-986e-005b5b65e40a" status: 200 len: 1619 microversion: 2.1 time: 0.901426 Aug 04 16:47:36.105507 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1272/2522] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:35 2022] GET /compute/v2.1/servers/36ad8e81-987e-4c31-986e-005b5b65e40a => generated 1619 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:36.119975 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cf3294b4-6b66-4283-a910-649f3e2bae6a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:36.126456 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cf3294b4-6b66-4283-a910-649f3e2bae6a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:36.151676 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cf3294b4-6b66-4283-a910-649f3e2bae6a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:36.152687 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cf3294b4-6b66-4283-a910-649f3e2bae6a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:36.158052 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cf3294b4-6b66-4283-a910-649f3e2bae6a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:36.159630 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cf3294b4-6b66-4283-a910-649f3e2bae6a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:37.181622 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cf3294b4-6b66-4283-a910-649f3e2bae6a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:37.191786 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cf3294b4-6b66-4283-a910-649f3e2bae6a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1654 microversion: 2.1 time: 1.084797 Aug 04 16:47:37.207171 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1273/2523] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:36 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1654 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:37.215772 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2b8d33b7-2794-4a42-abad-992333a5e68d tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e846d6ca0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:37.354390 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2b8d33b7-2794-4a42-abad-992333a5e68d tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3" status: 200 len: 1435 microversion: 2.1 time: 0.145662 Aug 04 16:47:37.358533 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1274/2524] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:47:37 2022] GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3 => generated 1435 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:37.383687 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-74fe1cac-517e-46cd-9fcb-d412e625e994 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:37.385198 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-74fe1cac-517e-46cd-9fcb-d412e625e994 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: fd0b16dd-d4dd-45d3-891a-646b89dce6fa] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:37.398624 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-74fe1cac-517e-46cd-9fcb-d412e625e994 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:37.399848 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-74fe1cac-517e-46cd-9fcb-d412e625e994 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:37.401726 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-74fe1cac-517e-46cd-9fcb-d412e625e994 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:37.402893 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-74fe1cac-517e-46cd-9fcb-d412e625e994 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:38.169266 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-dcf1f447-0174-474b-993f-5a2e7eabd906 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:47:38.170408 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-dcf1f447-0174-474b-993f-5a2e7eabd906 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:47:38.171335 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-dcf1f447-0174-474b-993f-5a2e7eabd906 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:47:38.171971 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-dcf1f447-0174-474b-993f-5a2e7eabd906 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:47:38.172597 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-dcf1f447-0174-474b-993f-5a2e7eabd906 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:47:38.202667 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dcf1f447-0174-474b-993f-5a2e7eabd906 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:38.203732 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dcf1f447-0174-474b-993f-5a2e7eabd906 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:38.205849 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dcf1f447-0174-474b-993f-5a2e7eabd906 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:38.207440 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dcf1f447-0174-474b-993f-5a2e7eabd906 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:38.215858 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-74fe1cac-517e-46cd-9fcb-d412e625e994 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97a079594a2400bb4db33f3ce3a1497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4cdb4245df44119c504915dc542d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:38.237465 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-74fe1cac-517e-46cd-9fcb-d412e625e994 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa" status: 200 len: 1317 microversion: 2.1 time: 0.863912 Aug 04 16:47:38.245052 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1275/2525] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:37 2022] GET /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa => generated 1317 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:38.281342 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b162a679-4547-4244-9a8f-f27c9326099b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2124217531", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "86667237-3005-4ee4-83d6-c250bba481d5"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:38.325543 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-dcf1f447-0174-474b-993f-5a2e7eabd906 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Getting quotas for project 60281cf1dbe645d8949e93f9e70b5d91. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:47:38.336105 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-dcf1f447-0174-474b-993f-5a2e7eabd906 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Getting quotas for user 3cfb4739b53b411391a26de37b98469f and project 60281cf1dbe645d8949e93f9e70b5d91. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:47:38.357885 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-dcf1f447-0174-474b-993f-5a2e7eabd906 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:47:38.362096 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-dcf1f447-0174-474b-993f-5a2e7eabd906 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:47:38.460507 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dcf1f447-0174-474b-993f-5a2e7eabd906 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.851826 Aug 04 16:47:38.462372 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1251/2526] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:47:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:47:38.464981 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-b162a679-4547-4244-9a8f-f27c9326099b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] validate_networks() for None {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:47:38.481569 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0c6af915-0a31-422d-b999-93775f84167c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:38.485510 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0c6af915-0a31-422d-b999-93775f84167c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:38.501441 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c6af915-0a31-422d-b999-93775f84167c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:38.503501 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c6af915-0a31-422d-b999-93775f84167c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:38.508422 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c6af915-0a31-422d-b999-93775f84167c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:38.509318 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c6af915-0a31-422d-b999-93775f84167c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:38.711977 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:47:38.731542 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0c6af915-0a31-422d-b999-93775f84167c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action" status: 202 len: 0 microversion: 2.1 time: 0.264996 Aug 04 16:47:38.743202 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1252/2527] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:47:38 2022] POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:47:38.772874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-160d935c-a6bb-4d18-b18f-a011440d85ae req-52a98258-0e9d-44c2-9d4b-8b2451e4abae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd0b16dd-d4dd-45d3-891a-646b89dce6fa", "tag": "eb953bbe-dc6f-4f67-bede-dcadc3e53253"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:38.827249 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-160d935c-a6bb-4d18-b18f-a011440d85ae req-52a98258-0e9d-44c2-9d4b-8b2451e4abae service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:38.829710 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-160d935c-a6bb-4d18-b18f-a011440d85ae req-52a98258-0e9d-44c2-9d4b-8b2451e4abae service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:38.886827 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-160d935c-a6bb-4d18-b18f-a011440d85ae req-52a98258-0e9d-44c2-9d4b-8b2451e4abae service nova] Creating event network-changed:eb953bbe-dc6f-4f67-bede-dcadc3e53253 for instance fd0b16dd-d4dd-45d3-891a-646b89dce6fa on n-h1-846466-12 Aug 04 16:47:38.912341 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-160d935c-a6bb-4d18-b18f-a011440d85ae req-52a98258-0e9d-44c2-9d4b-8b2451e4abae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167483 Aug 04 16:47:38.913501 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1253/2528] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:47:38.926904 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4db5a3a2-7fe2-4a88-952f-5d2401f66d39 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e84a3dca0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:39.069116 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4db5a3a2-7fe2-4a88-952f-5d2401f66d39 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3" status: 200 len: 1435 microversion: 2.1 time: 0.154018 Aug 04 16:47:39.069846 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1254/2529] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:47:38 2022] GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3 => generated 1435 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:39.094947 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e20a46bb-135e-4b50-99aa-1f240eeac5a6 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:39.099739 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e20a46bb-135e-4b50-99aa-1f240eeac5a6 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:39.233054 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e20a46bb-135e-4b50-99aa-1f240eeac5a6 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:39.251189 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e20a46bb-135e-4b50-99aa-1f240eeac5a6 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1215 microversion: 2.1 time: 0.178905 Aug 04 16:47:39.252077 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1255/2530] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:39 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1215 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:39.261561 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-01b0e2d8-af67-401f-8a4d-c429f1b0408a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:39.268365 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-01b0e2d8-af67-401f-8a4d-c429f1b0408a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:39.292382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-01b0e2d8-af67-401f-8a4d-c429f1b0408a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:39.293153 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-01b0e2d8-af67-401f-8a4d-c429f1b0408a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:39.294386 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-01b0e2d8-af67-401f-8a4d-c429f1b0408a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:39.294987 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-01b0e2d8-af67-401f-8a4d-c429f1b0408a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:40.085026 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-01b0e2d8-af67-401f-8a4d-c429f1b0408a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:40.102107 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-01b0e2d8-af67-401f-8a4d-c429f1b0408a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.846027 Aug 04 16:47:40.106663 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1256/2531] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:39 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:40.112053 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-544c1ce0-d12d-45c5-a0da-8f63d3730442 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:40.136106 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-544c1ce0-d12d-45c5-a0da-8f63d3730442 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: fd0b16dd-d4dd-45d3-891a-646b89dce6fa] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:40.160141 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-544c1ce0-d12d-45c5-a0da-8f63d3730442 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:40.163789 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-544c1ce0-d12d-45c5-a0da-8f63d3730442 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:40.167598 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-544c1ce0-d12d-45c5-a0da-8f63d3730442 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:40.169776 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-544c1ce0-d12d-45c5-a0da-8f63d3730442 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:40.342339 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b162a679-4547-4244-9a8f-f27c9326099b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:47:40.345978 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b162a679-4547-4244-9a8f-f27c9326099b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:47:40.347260 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b162a679-4547-4244-9a8f-f27c9326099b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:47:40.350847 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b162a679-4547-4244-9a8f-f27c9326099b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:47:40.365065 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b162a679-4547-4244-9a8f-f27c9326099b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:47:40.421497 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b162a679-4547-4244-9a8f-f27c9326099b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:40.426438 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b162a679-4547-4244-9a8f-f27c9326099b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:40.431495 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b162a679-4547-4244-9a8f-f27c9326099b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:40.439471 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b162a679-4547-4244-9a8f-f27c9326099b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:40.502757 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-b162a679-4547-4244-9a8f-f27c9326099b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for project b9e709c95a964cd5855d4e253aeb1043. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:47:40.512577 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-b162a679-4547-4244-9a8f-f27c9326099b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Getting quotas for user 336c26b5dd6644bc83f9b80adac06bce and project b9e709c95a964cd5855d4e253aeb1043. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:47:40.535876 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b162a679-4547-4244-9a8f-f27c9326099b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:47:40.538840 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b162a679-4547-4244-9a8f-f27c9326099b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 12264581-815d-463d-be11-2dd941746cd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:47:40.641437 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-544c1ce0-d12d-45c5-a0da-8f63d3730442 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97a079594a2400bb4db33f3ce3a1497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4cdb4245df44119c504915dc542d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:40.655794 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-544c1ce0-d12d-45c5-a0da-8f63d3730442 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa" status: 200 len: 1317 microversion: 2.1 time: 0.547624 Aug 04 16:47:40.659775 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1257/2532] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:40 2022] GET /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa => generated 1317 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:40.676781 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b162a679-4547-4244-9a8f-f27c9326099b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.430425 Aug 04 16:47:40.683604 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1276/2533] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:47:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:47:40.698966 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-98bfbbed-b6ba-4584-b073-703c22c3d649 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e841b4ca0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:40.880388 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-98bfbbed-b6ba-4584-b073-703c22c3d649 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3" status: 200 len: 1435 microversion: 2.1 time: 0.195276 Aug 04 16:47:40.881707 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1277/2534] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:47:40 2022] GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3 => generated 1435 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:40.902404 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c32747c3-36b1-453c-b22d-0135582fdbbc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:40.906641 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c32747c3-36b1-453c-b22d-0135582fdbbc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:40.933704 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c32747c3-36b1-453c-b22d-0135582fdbbc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:40.937032 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c32747c3-36b1-453c-b22d-0135582fdbbc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:40.941126 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c32747c3-36b1-453c-b22d-0135582fdbbc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:40.942882 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c32747c3-36b1-453c-b22d-0135582fdbbc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:41.136914 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a25fca60-683b-4b5c-a3cb-773f08b521ec tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-225985232", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": "none"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:41.306077 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-a25fca60-683b-4b5c-a3cb-773f08b521ec tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:47:41.306891 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-a25fca60-683b-4b5c-a3cb-773f08b521ec tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:47:41.307631 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-a25fca60-683b-4b5c-a3cb-773f08b521ec tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:47:41.308303 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-a25fca60-683b-4b5c-a3cb-773f08b521ec tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:47:41.309092 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-a25fca60-683b-4b5c-a3cb-773f08b521ec tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:47:41.350638 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a25fca60-683b-4b5c-a3cb-773f08b521ec tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:41.367869 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a25fca60-683b-4b5c-a3cb-773f08b521ec tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:41.384145 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a25fca60-683b-4b5c-a3cb-773f08b521ec tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:41.388174 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a25fca60-683b-4b5c-a3cb-773f08b521ec tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:41.531769 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-a25fca60-683b-4b5c-a3cb-773f08b521ec tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Getting quotas for project a0212954c4b74bbe9eed6333d1f23758. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:47:41.544889 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-a25fca60-683b-4b5c-a3cb-773f08b521ec tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Getting quotas for user ad3ad8325b284ba186e19077c5f228b0 and project a0212954c4b74bbe9eed6333d1f23758. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:47:41.587951 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a25fca60-683b-4b5c-a3cb-773f08b521ec tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:47:41.590807 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a25fca60-683b-4b5c-a3cb-773f08b521ec tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] [instance: 56491bb2-61c9-4d9f-96cd-3ea7c80aae55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:47:41.725731 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a25fca60-683b-4b5c-a3cb-773f08b521ec tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.060314 Aug 04 16:47:41.726888 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1258/2535] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Aug 4 16:47:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 16:47:41.740109 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-688726c6-17c1-4b7d-bb73-2038baa23738 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:41.752470 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-688726c6-17c1-4b7d-bb73-2038baa23738 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:41.766367 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c32747c3-36b1-453c-b22d-0135582fdbbc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:41.771134 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-688726c6-17c1-4b7d-bb73-2038baa23738 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:41.772217 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-688726c6-17c1-4b7d-bb73-2038baa23738 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:41.773385 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-688726c6-17c1-4b7d-bb73-2038baa23738 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:41.773965 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-688726c6-17c1-4b7d-bb73-2038baa23738 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:41.783130 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c32747c3-36b1-453c-b22d-0135582fdbbc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.897210 Aug 04 16:47:41.800070 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1278/2536] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:40 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:41.812972 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0fa3a71f-896b-4be5-978a-6966ba46255a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:41.814127 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0fa3a71f-896b-4be5-978a-6966ba46255a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 12264581-815d-463d-be11-2dd941746cd3] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:42.131633 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0fa3a71f-896b-4be5-978a-6966ba46255a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:42.149864 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0fa3a71f-896b-4be5-978a-6966ba46255a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3" status: 200 len: 1217 microversion: 2.1 time: 0.346054 Aug 04 16:47:42.165661 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1279/2537] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:41 2022] GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3 => generated 1217 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:42.165822 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-688726c6-17c1-4b7d-bb73-2038baa23738 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:42.182685 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b0b78ce4-291a-4b29-ba59-f0f82cbf410f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:42.183395 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b0b78ce4-291a-4b29-ba59-f0f82cbf410f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: fd0b16dd-d4dd-45d3-891a-646b89dce6fa] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:42.190085 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-688726c6-17c1-4b7d-bb73-2038baa23738 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1273 microversion: 2.1 time: 0.459735 Aug 04 16:47:42.190935 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1259/2538] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:41 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1273 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:42.195847 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7028e2c9-70f7-4a09-82dc-7109adc3e504 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:42.210272 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7028e2c9-70f7-4a09-82dc-7109adc3e504 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] [instance: 56491bb2-61c9-4d9f-96cd-3ea7c80aae55] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:42.227359 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0b78ce4-291a-4b29-ba59-f0f82cbf410f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:42.235710 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0b78ce4-291a-4b29-ba59-f0f82cbf410f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:42.243063 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0b78ce4-291a-4b29-ba59-f0f82cbf410f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:42.243722 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0b78ce4-291a-4b29-ba59-f0f82cbf410f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:42.449733 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7028e2c9-70f7-4a09-82dc-7109adc3e504 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3ad8325b284ba186e19077c5f228b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0212954c4b74bbe9eed6333d1f23758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:42.471369 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7028e2c9-70f7-4a09-82dc-7109adc3e504 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad3ad8325b284ba186e19077c5f228b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0212954c4b74bbe9eed6333d1f23758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:42.475358 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7028e2c9-70f7-4a09-82dc-7109adc3e504 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad3ad8325b284ba186e19077c5f228b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0212954c4b74bbe9eed6333d1f23758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:42.478846 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7028e2c9-70f7-4a09-82dc-7109adc3e504 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] 10.222.0.23 "GET /compute/v2.1/servers/56491bb2-61c9-4d9f-96cd-3ea7c80aae55" status: 200 len: 1280 microversion: 2.47 time: 0.284687 Aug 04 16:47:42.479648 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1260/2539] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:47:42 2022] GET /compute/v2.1/servers/56491bb2-61c9-4d9f-96cd-3ea7c80aae55 => generated 1280 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:47:42.529824 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1b53c55b-a83a-4e5e-bbff-db91e43efab1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:42.531089 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1b53c55b-a83a-4e5e-bbff-db91e43efab1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:42.569849 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1b53c55b-a83a-4e5e-bbff-db91e43efab1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:42.576349 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1b53c55b-a83a-4e5e-bbff-db91e43efab1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:42.577617 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1b53c55b-a83a-4e5e-bbff-db91e43efab1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:42.582945 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1b53c55b-a83a-4e5e-bbff-db91e43efab1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:43.307731 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b0b78ce4-291a-4b29-ba59-f0f82cbf410f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97a079594a2400bb4db33f3ce3a1497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4cdb4245df44119c504915dc542d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:43.321837 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b0b78ce4-291a-4b29-ba59-f0f82cbf410f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa" status: 200 len: 1317 microversion: 2.1 time: 1.162996 Aug 04 16:47:43.323222 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1280/2540] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:42 2022] GET /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa => generated 1317 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:43.333941 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a37ee02b-7149-4921-ad91-c25bdb5e84a3 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e8413ba60>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:43.485887 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a37ee02b-7149-4921-ad91-c25bdb5e84a3 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3" status: 200 len: 1435 microversion: 2.1 time: 0.158452 Aug 04 16:47:43.499854 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1281/2541] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:47:43 2022] GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3 => generated 1435 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:43.543499 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8eded48b-9c30-43ad-9e89-c4ba4902de7e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:43.546204 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8eded48b-9c30-43ad-9e89-c4ba4902de7e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 12264581-815d-463d-be11-2dd941746cd3] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:43.585666 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8eded48b-9c30-43ad-9e89-c4ba4902de7e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:43.586778 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8eded48b-9c30-43ad-9e89-c4ba4902de7e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:43.587862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8eded48b-9c30-43ad-9e89-c4ba4902de7e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:43.588501 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8eded48b-9c30-43ad-9e89-c4ba4902de7e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:43.703109 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1b53c55b-a83a-4e5e-bbff-db91e43efab1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:43.719388 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1b53c55b-a83a-4e5e-bbff-db91e43efab1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 1.218076 Aug 04 16:47:43.723066 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1261/2542] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:42 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:43.743108 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8fc40463-2d84-4e10-956d-a8b9c31cab99 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:43.745792 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8fc40463-2d84-4e10-956d-a8b9c31cab99 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:43.763754 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8fc40463-2d84-4e10-956d-a8b9c31cab99 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:43.764625 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8fc40463-2d84-4e10-956d-a8b9c31cab99 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:43.766149 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8fc40463-2d84-4e10-956d-a8b9c31cab99 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:43.766869 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8fc40463-2d84-4e10-956d-a8b9c31cab99 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:44.051440 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8eded48b-9c30-43ad-9e89-c4ba4902de7e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:44.074479 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8eded48b-9c30-43ad-9e89-c4ba4902de7e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3" status: 200 len: 1269 microversion: 2.1 time: 0.569561 Aug 04 16:47:44.096656 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1282/2543] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:43 2022] GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3 => generated 1269 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:44.105651 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d93ee90b-c02b-44a5-a9f7-e231f12d1c6a tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:44.108427 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d93ee90b-c02b-44a5-a9f7-e231f12d1c6a tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] [instance: 56491bb2-61c9-4d9f-96cd-3ea7c80aae55] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:44.136848 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d93ee90b-c02b-44a5-a9f7-e231f12d1c6a tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:44.138571 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d93ee90b-c02b-44a5-a9f7-e231f12d1c6a tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:44.144468 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d93ee90b-c02b-44a5-a9f7-e231f12d1c6a tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:44.145196 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d93ee90b-c02b-44a5-a9f7-e231f12d1c6a tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:44.146278 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8fc40463-2d84-4e10-956d-a8b9c31cab99 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:44.166473 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8fc40463-2d84-4e10-956d-a8b9c31cab99 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1273 microversion: 2.1 time: 0.441847 Aug 04 16:47:44.167095 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1262/2544] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:43 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1273 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:44.205764 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-139795fc-0d43-4aef-a1f1-476e0ea57b2a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:44.206383 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-139795fc-0d43-4aef-a1f1-476e0ea57b2a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:44.231783 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-139795fc-0d43-4aef-a1f1-476e0ea57b2a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:44.232139 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-139795fc-0d43-4aef-a1f1-476e0ea57b2a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:44.232966 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-139795fc-0d43-4aef-a1f1-476e0ea57b2a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:44.233433 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-139795fc-0d43-4aef-a1f1-476e0ea57b2a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:44.512941 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d93ee90b-c02b-44a5-a9f7-e231f12d1c6a tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3ad8325b284ba186e19077c5f228b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0212954c4b74bbe9eed6333d1f23758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:44.543265 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d93ee90b-c02b-44a5-a9f7-e231f12d1c6a tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad3ad8325b284ba186e19077c5f228b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0212954c4b74bbe9eed6333d1f23758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:44.549788 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d93ee90b-c02b-44a5-a9f7-e231f12d1c6a tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad3ad8325b284ba186e19077c5f228b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0212954c4b74bbe9eed6333d1f23758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:44.557101 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d93ee90b-c02b-44a5-a9f7-e231f12d1c6a tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] 10.222.0.23 "GET /compute/v2.1/servers/56491bb2-61c9-4d9f-96cd-3ea7c80aae55" status: 200 len: 1340 microversion: 2.47 time: 0.471563 Aug 04 16:47:44.565454 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1283/2545] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:47:44 2022] GET /compute/v2.1/servers/56491bb2-61c9-4d9f-96cd-3ea7c80aae55 => generated 1340 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:47:44.581601 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bf3dedad-b181-4c93-ab0b-23cde131e2d0 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:44.582744 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bf3dedad-b181-4c93-ab0b-23cde131e2d0 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: fd0b16dd-d4dd-45d3-891a-646b89dce6fa] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:44.593918 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf3dedad-b181-4c93-ab0b-23cde131e2d0 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:44.596378 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf3dedad-b181-4c93-ab0b-23cde131e2d0 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:44.597589 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf3dedad-b181-4c93-ab0b-23cde131e2d0 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:44.599622 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf3dedad-b181-4c93-ab0b-23cde131e2d0 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:45.349882 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-139795fc-0d43-4aef-a1f1-476e0ea57b2a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:45.367641 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-139795fc-0d43-4aef-a1f1-476e0ea57b2a tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 1.173365 Aug 04 16:47:45.368718 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1263/2546] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:44 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:45.391197 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9beba7aa-10bc-44e3-9cd3-c58e093c8a2a tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e89b8fdc0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:45.447607 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bf3dedad-b181-4c93-ab0b-23cde131e2d0 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97a079594a2400bb4db33f3ce3a1497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4cdb4245df44119c504915dc542d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:45.473781 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bf3dedad-b181-4c93-ab0b-23cde131e2d0 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa" status: 200 len: 1317 microversion: 2.1 time: 0.905107 Aug 04 16:47:45.474961 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1284/2547] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:44 2022] GET /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa => generated 1317 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:45.480724 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f5baad46-c30c-466d-930e-5f5e115ea464 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:45.482635 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f5baad46-c30c-466d-930e-5f5e115ea464 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 12264581-815d-463d-be11-2dd941746cd3] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:45.502540 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f5baad46-c30c-466d-930e-5f5e115ea464 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:45.503279 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9beba7aa-10bc-44e3-9cd3-c58e093c8a2a tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3" status: 200 len: 1435 microversion: 2.1 time: 0.128863 Aug 04 16:47:45.503600 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f5baad46-c30c-466d-930e-5f5e115ea464 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:45.504456 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1264/2548] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:47:45 2022] GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3 => generated 1435 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:45.504922 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f5baad46-c30c-466d-930e-5f5e115ea464 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:45.505380 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f5baad46-c30c-466d-930e-5f5e115ea464 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:45.556750 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-381c6674-d41f-4946-aeff-d7b15ab80859 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:45.560516 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-381c6674-d41f-4946-aeff-d7b15ab80859 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:45.584682 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-381c6674-d41f-4946-aeff-d7b15ab80859 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:45.586849 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-381c6674-d41f-4946-aeff-d7b15ab80859 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:45.587981 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-381c6674-d41f-4946-aeff-d7b15ab80859 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:45.588676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-381c6674-d41f-4946-aeff-d7b15ab80859 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:45.750828 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f5baad46-c30c-466d-930e-5f5e115ea464 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:45.786572 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f5baad46-c30c-466d-930e-5f5e115ea464 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3" status: 200 len: 1275 microversion: 2.1 time: 0.309063 Aug 04 16:47:45.788667 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1285/2549] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:45 2022] GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3 => generated 1275 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:45.796910 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6363121e-03c7-485f-9e13-2396a9d4f5c3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:45.798042 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6363121e-03c7-485f-9e13-2396a9d4f5c3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:45.808440 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6363121e-03c7-485f-9e13-2396a9d4f5c3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:45.809603 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6363121e-03c7-485f-9e13-2396a9d4f5c3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:45.811290 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6363121e-03c7-485f-9e13-2396a9d4f5c3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:45.813110 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6363121e-03c7-485f-9e13-2396a9d4f5c3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:46.273594 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-381c6674-d41f-4946-aeff-d7b15ab80859 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:46.283104 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-381c6674-d41f-4946-aeff-d7b15ab80859 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1315 microversion: 2.1 time: 0.776927 Aug 04 16:47:46.283703 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1265/2550] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:45 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1315 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:46.300202 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-35d4d149-3a9d-4b1b-876a-40dc29c85c52 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:46.300880 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-35d4d149-3a9d-4b1b-876a-40dc29c85c52 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] [instance: 56491bb2-61c9-4d9f-96cd-3ea7c80aae55] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:46.314207 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-35d4d149-3a9d-4b1b-876a-40dc29c85c52 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:46.314916 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-35d4d149-3a9d-4b1b-876a-40dc29c85c52 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:46.315875 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-35d4d149-3a9d-4b1b-876a-40dc29c85c52 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:46.316509 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-35d4d149-3a9d-4b1b-876a-40dc29c85c52 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:46.846880 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-35d4d149-3a9d-4b1b-876a-40dc29c85c52 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3ad8325b284ba186e19077c5f228b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0212954c4b74bbe9eed6333d1f23758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:46.864341 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-35d4d149-3a9d-4b1b-876a-40dc29c85c52 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad3ad8325b284ba186e19077c5f228b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0212954c4b74bbe9eed6333d1f23758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:46.868070 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-35d4d149-3a9d-4b1b-876a-40dc29c85c52 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad3ad8325b284ba186e19077c5f228b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0212954c4b74bbe9eed6333d1f23758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:46.870063 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6363121e-03c7-485f-9e13-2396a9d4f5c3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:46.871413 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-35d4d149-3a9d-4b1b-876a-40dc29c85c52 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] 10.222.0.23 "GET /compute/v2.1/servers/56491bb2-61c9-4d9f-96cd-3ea7c80aae55" status: 200 len: 1338 microversion: 2.47 time: 0.585641 Aug 04 16:47:46.873245 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1266/2551] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:47:46 2022] GET /compute/v2.1/servers/56491bb2-61c9-4d9f-96cd-3ea7c80aae55 => generated 1338 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:47:46.881589 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-34e511b0-c01d-4b8a-8953-5e7e7b3169aa tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:46.882852 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-34e511b0-c01d-4b8a-8953-5e7e7b3169aa tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: fd0b16dd-d4dd-45d3-891a-646b89dce6fa] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:46.899399 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-34e511b0-c01d-4b8a-8953-5e7e7b3169aa tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:46.900243 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-34e511b0-c01d-4b8a-8953-5e7e7b3169aa tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:46.901978 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6363121e-03c7-485f-9e13-2396a9d4f5c3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 1.110969 Aug 04 16:47:46.902271 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-34e511b0-c01d-4b8a-8953-5e7e7b3169aa tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:46.902727 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-34e511b0-c01d-4b8a-8953-5e7e7b3169aa tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:46.911948 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1286/2552] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:45 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:46.926207 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dac4aede-e993-48ef-9f71-eea726b47f79 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e846d68b0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:47.003946 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dac4aede-e993-48ef-9f71-eea726b47f79 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3" status: 200 len: 1444 microversion: 2.1 time: 0.090542 Aug 04 16:47:47.005079 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1287/2553] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:47:46 2022] GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:47.028340 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dd69c56f-0e13-4032-aca6-247890a06294 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:47.029183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dd69c56f-0e13-4032-aca6-247890a06294 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 12264581-815d-463d-be11-2dd941746cd3] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:47.043306 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dd69c56f-0e13-4032-aca6-247890a06294 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:47.050189 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dd69c56f-0e13-4032-aca6-247890a06294 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:47.051463 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dd69c56f-0e13-4032-aca6-247890a06294 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:47.052124 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dd69c56f-0e13-4032-aca6-247890a06294 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:47.163811 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dd69c56f-0e13-4032-aca6-247890a06294 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:47.176159 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dd69c56f-0e13-4032-aca6-247890a06294 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3" status: 200 len: 1275 microversion: 2.1 time: 0.168253 Aug 04 16:47:47.191027 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-34e511b0-c01d-4b8a-8953-5e7e7b3169aa tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97a079594a2400bb4db33f3ce3a1497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4cdb4245df44119c504915dc542d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:47.193790 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1288/2554] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:47 2022] GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3 => generated 1275 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:47.200277 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bf397a39-6094-4da3-8af7-ee99b4864b17 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:47.200938 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bf397a39-6094-4da3-8af7-ee99b4864b17 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:47.208101 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-34e511b0-c01d-4b8a-8953-5e7e7b3169aa tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa" status: 200 len: 1317 microversion: 2.1 time: 0.332891 Aug 04 16:47:47.210363 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf397a39-6094-4da3-8af7-ee99b4864b17 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:47.211883 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf397a39-6094-4da3-8af7-ee99b4864b17 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:47.212902 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf397a39-6094-4da3-8af7-ee99b4864b17 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:47.214219 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf397a39-6094-4da3-8af7-ee99b4864b17 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:47.223516 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1267/2555] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:46 2022] GET /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa => generated 1317 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:47.276053 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6de45cee-0f14-4c71-ba0a-2944bda671d1 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e84155ee0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:47.367144 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6de45cee-0f14-4c71-ba0a-2944bda671d1 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3" status: 200 len: 1444 microversion: 2.1 time: 0.141632 Aug 04 16:47:47.368031 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1268/2556] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:47:47 2022] GET /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3 => generated 1444 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:47.374225 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2a77fa74-d0af-4a81-b57e-481866a12d90 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:47.375355 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2a77fa74-d0af-4a81-b57e-481866a12d90 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:47.382947 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a77fa74-d0af-4a81-b57e-481866a12d90 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:47.383660 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a77fa74-d0af-4a81-b57e-481866a12d90 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:47.384693 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a77fa74-d0af-4a81-b57e-481866a12d90 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:47.385542 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a77fa74-d0af-4a81-b57e-481866a12d90 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:47.651002 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bf397a39-6094-4da3-8af7-ee99b4864b17 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:47.689149 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bf397a39-6094-4da3-8af7-ee99b4864b17 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.492277 Aug 04 16:47:47.691968 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1289/2557] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:47 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:47.713720 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-e0b57bd8-f4eb-4a3d-91aa-8d3c2b471311 req-94aaa638-4c2f-46c2-aebf-9a7b8c6619a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd0b16dd-d4dd-45d3-891a-646b89dce6fa", "name": "network-vif-plugged", "status": "completed", "tag": "eb953bbe-dc6f-4f67-bede-dcadc3e53253"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:47.734099 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-e0b57bd8-f4eb-4a3d-91aa-8d3c2b471311 req-94aaa638-4c2f-46c2-aebf-9a7b8c6619a6 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:47.734656 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-e0b57bd8-f4eb-4a3d-91aa-8d3c2b471311 req-94aaa638-4c2f-46c2-aebf-9a7b8c6619a6 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:47.750478 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2a77fa74-d0af-4a81-b57e-481866a12d90 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:47.750687 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-e0b57bd8-f4eb-4a3d-91aa-8d3c2b471311 req-94aaa638-4c2f-46c2-aebf-9a7b8c6619a6 service nova] Creating event network-vif-plugged:eb953bbe-dc6f-4f67-bede-dcadc3e53253 for instance fd0b16dd-d4dd-45d3-891a-646b89dce6fa on n-h1-846466-12 Aug 04 16:47:47.759223 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-e0b57bd8-f4eb-4a3d-91aa-8d3c2b471311 req-94aaa638-4c2f-46c2-aebf-9a7b8c6619a6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059502 Aug 04 16:47:47.760372 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1290/2558] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:47:47.766981 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2a77fa74-d0af-4a81-b57e-481866a12d90 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1315 microversion: 2.1 time: 0.393615 Aug 04 16:47:47.767641 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ec8b6f6a-47b0-474a-8b62-e727669e66a9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e846d6040>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:47.769598 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1269/2559] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:47 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:47.901661 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f688861c-b9d0-4a7c-bbf5-e175f7c4d680 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:47.903207 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f688861c-b9d0-4a7c-bbf5-e175f7c4d680 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] [instance: 56491bb2-61c9-4d9f-96cd-3ea7c80aae55] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:47.944483 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f688861c-b9d0-4a7c-bbf5-e175f7c4d680 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:47.948283 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f688861c-b9d0-4a7c-bbf5-e175f7c4d680 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:47.949382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f688861c-b9d0-4a7c-bbf5-e175f7c4d680 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:47.949955 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f688861c-b9d0-4a7c-bbf5-e175f7c4d680 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:48.257969 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f688861c-b9d0-4a7c-bbf5-e175f7c4d680 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3ad8325b284ba186e19077c5f228b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0212954c4b74bbe9eed6333d1f23758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:48.282053 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f688861c-b9d0-4a7c-bbf5-e175f7c4d680 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad3ad8325b284ba186e19077c5f228b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0212954c4b74bbe9eed6333d1f23758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:48.283789 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f688861c-b9d0-4a7c-bbf5-e175f7c4d680 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad3ad8325b284ba186e19077c5f228b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0212954c4b74bbe9eed6333d1f23758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:48.287534 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f688861c-b9d0-4a7c-bbf5-e175f7c4d680 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] 10.222.0.23 "GET /compute/v2.1/servers/56491bb2-61c9-4d9f-96cd-3ea7c80aae55" status: 200 len: 1359 microversion: 2.47 time: 0.390955 Aug 04 16:47:48.289108 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1270/2560] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:47:47 2022] GET /compute/v2.1/servers/56491bb2-61c9-4d9f-96cd-3ea7c80aae55 => generated 1359 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:47:48.294747 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-3bfa767c-d5cb-43c5-b563-44e1f61c46dd req-461cf99b-f210-4df0-b6b6-f968795b3f3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73dff433-5880-43ec-b799-1230245db7f7", "tag": "cb07355a-33e6-4a7b-87c1-59ad0e6d64ce"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:48.322275 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-3bfa767c-d5cb-43c5-b563-44e1f61c46dd req-461cf99b-f210-4df0-b6b6-f968795b3f3b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:48.323118 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-3bfa767c-d5cb-43c5-b563-44e1f61c46dd req-461cf99b-f210-4df0-b6b6-f968795b3f3b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:48.340811 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-3bfa767c-d5cb-43c5-b563-44e1f61c46dd req-461cf99b-f210-4df0-b6b6-f968795b3f3b service nova] Creating event network-changed:cb07355a-33e6-4a7b-87c1-59ad0e6d64ce for instance 73dff433-5880-43ec-b799-1230245db7f7 on n-h1-846466-12 Aug 04 16:47:48.347819 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-3bfa767c-d5cb-43c5-b563-44e1f61c46dd req-461cf99b-f210-4df0-b6b6-f968795b3f3b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056503 Aug 04 16:47:48.353849 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1271/2561] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:47:48.361991 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-642f18f1-6d26-40df-856a-2a57b798e8eb tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:48.362809 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-642f18f1-6d26-40df-856a-2a57b798e8eb tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 12264581-815d-463d-be11-2dd941746cd3] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:48.372177 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-642f18f1-6d26-40df-856a-2a57b798e8eb tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:48.372712 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-642f18f1-6d26-40df-856a-2a57b798e8eb tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:48.373643 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-642f18f1-6d26-40df-856a-2a57b798e8eb tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:48.374311 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-642f18f1-6d26-40df-856a-2a57b798e8eb tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:48.742825 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-642f18f1-6d26-40df-856a-2a57b798e8eb tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:48.753632 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-642f18f1-6d26-40df-856a-2a57b798e8eb tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3" status: 200 len: 1317 microversion: 2.1 time: 0.396807 Aug 04 16:47:48.765482 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1272/2562] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:48 2022] GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3 => generated 1317 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:48.765482 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c31ed733-c27a-4a01-8ba7-50ec8ca62df4 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:48.765482 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c31ed733-c27a-4a01-8ba7-50ec8ca62df4 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: fd0b16dd-d4dd-45d3-891a-646b89dce6fa] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:48.770411 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c31ed733-c27a-4a01-8ba7-50ec8ca62df4 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:48.771148 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c31ed733-c27a-4a01-8ba7-50ec8ca62df4 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:48.772138 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c31ed733-c27a-4a01-8ba7-50ec8ca62df4 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:48.772759 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c31ed733-c27a-4a01-8ba7-50ec8ca62df4 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:48.991936 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ec8b6f6a-47b0-474a-8b62-e727669e66a9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "DELETE /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3" status: 204 len: 0 microversion: 2.1 time: 1.229815 Aug 04 16:47:48.993832 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1291/2563] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:47 2022] DELETE /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3 => generated 0 bytes in 1232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:47:49.000030 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2b5182e6-fc20-4525-bdee-bb412d56ea37 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-860207597"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:49.014339 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2b5182e6-fc20-4525-bdee-bb412d56ea37 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] [instance: 56491bb2-61c9-4d9f-96cd-3ea7c80aae55] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:49.025142 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2b5182e6-fc20-4525-bdee-bb412d56ea37 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:49.026346 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2b5182e6-fc20-4525-bdee-bb412d56ea37 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:49.027484 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2b5182e6-fc20-4525-bdee-bb412d56ea37 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:49.028200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2b5182e6-fc20-4525-bdee-bb412d56ea37 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:49.276449 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c31ed733-c27a-4a01-8ba7-50ec8ca62df4 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97a079594a2400bb4db33f3ce3a1497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4cdb4245df44119c504915dc542d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:49.299193 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c31ed733-c27a-4a01-8ba7-50ec8ca62df4 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa" status: 200 len: 1317 microversion: 2.1 time: 0.540878 Aug 04 16:47:49.303454 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1273/2564] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:48 2022] GET /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa => generated 1317 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:49.328835 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-81492486-92ec-4e48-ae55-d49ceae3f5f7 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:49.332106 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-81492486-92ec-4e48-ae55-d49ceae3f5f7 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:49.375274 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:47:49.377908 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-81492486-92ec-4e48-ae55-d49ceae3f5f7 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:49.378393 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-81492486-92ec-4e48-ae55-d49ceae3f5f7 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:49.379259 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-81492486-92ec-4e48-ae55-d49ceae3f5f7 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:49.379729 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-81492486-92ec-4e48-ae55-d49ceae3f5f7 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:49.510849 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2b5182e6-fc20-4525-bdee-bb412d56ea37 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] 10.222.0.23 "POST /compute/v2.1/servers/56491bb2-61c9-4d9f-96cd-3ea7c80aae55/action" status: 202 len: 52 microversion: 2.47 time: 0.513597 Aug 04 16:47:49.515344 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1292/2565] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Aug 4 16:47:48 2022] POST /compute/v2.1/servers/56491bb2-61c9-4d9f-96cd-3ea7c80aae55/action => generated 52 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Aug 04 16:47:49.540529 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2d2e4a74-afd4-43da-a8f1-35313696f678 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:49.542844 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2d2e4a74-afd4-43da-a8f1-35313696f678 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:49.557478 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d2e4a74-afd4-43da-a8f1-35313696f678 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:49.557946 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d2e4a74-afd4-43da-a8f1-35313696f678 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:49.558794 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d2e4a74-afd4-43da-a8f1-35313696f678 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:49.559248 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d2e4a74-afd4-43da-a8f1-35313696f678 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:49.641735 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2d2e4a74-afd4-43da-a8f1-35313696f678 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:47:49.818443 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:47:49.856256 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-81492486-92ec-4e48-ae55-d49ceae3f5f7 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:49.874447 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2d2e4a74-afd4-43da-a8f1-35313696f678 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61" status: 204 len: 0 microversion: 2.1 time: 0.348604 Aug 04 16:47:49.876610 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1293/2566] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:47:49 2022] DELETE /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:47:49.886337 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2897f746-b59c-4b68-9ada-291958ca12b0 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:49.887557 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2897f746-b59c-4b68-9ada-291958ca12b0 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] [instance: 56491bb2-61c9-4d9f-96cd-3ea7c80aae55] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:49.891593 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-81492486-92ec-4e48-ae55-d49ceae3f5f7 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1315 microversion: 2.1 time: 0.582619 Aug 04 16:47:49.893825 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1274/2567] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:49 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1315 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:49.903856 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0baf3595-42a1-48dd-b2af-322f482c797c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:49.904599 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0baf3595-42a1-48dd-b2af-322f482c797c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 12264581-815d-463d-be11-2dd941746cd3] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:49.924162 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2897f746-b59c-4b68-9ada-291958ca12b0 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:49.926337 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2897f746-b59c-4b68-9ada-291958ca12b0 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:49.927316 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0baf3595-42a1-48dd-b2af-322f482c797c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:49.927699 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2897f746-b59c-4b68-9ada-291958ca12b0 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:49.927823 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0baf3595-42a1-48dd-b2af-322f482c797c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:49.928641 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2897f746-b59c-4b68-9ada-291958ca12b0 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:49.930333 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0baf3595-42a1-48dd-b2af-322f482c797c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:49.930787 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0baf3595-42a1-48dd-b2af-322f482c797c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:49.980248 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2897f746-b59c-4b68-9ada-291958ca12b0 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] [instance: 56491bb2-61c9-4d9f-96cd-3ea7c80aae55] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:47:50.107299 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2897f746-b59c-4b68-9ada-291958ca12b0 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] 10.222.0.23 "DELETE /compute/v2.1/servers/56491bb2-61c9-4d9f-96cd-3ea7c80aae55" status: 204 len: 0 microversion: 2.47 time: 0.228005 Aug 04 16:47:50.109402 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1294/2568] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Aug 4 16:47:49 2022] DELETE /compute/v2.1/servers/56491bb2-61c9-4d9f-96cd-3ea7c80aae55 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 16:47:50.116284 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d76cbd72-4f2a-47cb-b835-5ba2b830dca8 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-940784383", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "a690ca05-294e-4f0a-96cd-75ec0df3880f"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:50.198404 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0baf3595-42a1-48dd-b2af-322f482c797c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:50.206699 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0baf3595-42a1-48dd-b2af-322f482c797c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3" status: 200 len: 1317 microversion: 2.1 time: 0.311863 Aug 04 16:47:50.207905 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1275/2569] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:49 2022] GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3 => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:50.241447 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5028e3e6-4c4e-47dd-84b0-355e55469303 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:50.242505 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5028e3e6-4c4e-47dd-84b0-355e55469303 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] [instance: 56491bb2-61c9-4d9f-96cd-3ea7c80aae55] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:50.249243 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5028e3e6-4c4e-47dd-84b0-355e55469303 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:50.250092 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5028e3e6-4c4e-47dd-84b0-355e55469303 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:50.251128 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5028e3e6-4c4e-47dd-84b0-355e55469303 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:50.251781 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5028e3e6-4c4e-47dd-84b0-355e55469303 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:50.278576 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-d76cbd72-4f2a-47cb-b835-5ba2b830dca8 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] validate_networks() for [('a690ca05-294e-4f0a-96cd-75ec0df3880f', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:47:50.285442 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=100 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:47:50.441908 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5028e3e6-4c4e-47dd-84b0-355e55469303 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3ad8325b284ba186e19077c5f228b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0212954c4b74bbe9eed6333d1f23758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:50.458718 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5028e3e6-4c4e-47dd-84b0-355e55469303 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad3ad8325b284ba186e19077c5f228b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0212954c4b74bbe9eed6333d1f23758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:50.462521 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5028e3e6-4c4e-47dd-84b0-355e55469303 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad3ad8325b284ba186e19077c5f228b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0212954c4b74bbe9eed6333d1f23758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:50.465210 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5028e3e6-4c4e-47dd-84b0-355e55469303 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] 10.222.0.23 "GET /compute/v2.1/servers/56491bb2-61c9-4d9f-96cd-3ea7c80aae55" status: 200 len: 1365 microversion: 2.47 time: 0.233889 Aug 04 16:47:50.467041 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1276/2570] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:47:50 2022] GET /compute/v2.1/servers/56491bb2-61c9-4d9f-96cd-3ea7c80aae55 => generated 1365 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:47:50.475359 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:47:50.476183 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-54954318-0866-4321-bc88-949d420c8a4b tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:50.477759 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-54954318-0866-4321-bc88-949d420c8a4b tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: fd0b16dd-d4dd-45d3-891a-646b89dce6fa] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:50.490032 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-54954318-0866-4321-bc88-949d420c8a4b tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:50.491291 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-54954318-0866-4321-bc88-949d420c8a4b tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:50.493201 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-54954318-0866-4321-bc88-949d420c8a4b tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:50.494372 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-54954318-0866-4321-bc88-949d420c8a4b tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:50.839455 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-54954318-0866-4321-bc88-949d420c8a4b tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97a079594a2400bb4db33f3ce3a1497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4cdb4245df44119c504915dc542d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:50.855252 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-54954318-0866-4321-bc88-949d420c8a4b tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa" status: 200 len: 1507 microversion: 2.1 time: 0.386121 Aug 04 16:47:50.856188 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1277/2571] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:50 2022] GET /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa => generated 1507 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:50.875347 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-9b987130-c95d-4230-9023-a8a9d149492d req-552a54c6-a547-4626-ab2f-d7c365088ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12264581-815d-463d-be11-2dd941746cd3", "tag": "e5c4411d-8d86-4d05-b8f9-3734ee665e16"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:50.885965 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-9b987130-c95d-4230-9023-a8a9d149492d req-552a54c6-a547-4626-ab2f-d7c365088ed9 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:50.886474 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-9b987130-c95d-4230-9023-a8a9d149492d req-552a54c6-a547-4626-ab2f-d7c365088ed9 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:50.916582 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-9b987130-c95d-4230-9023-a8a9d149492d req-552a54c6-a547-4626-ab2f-d7c365088ed9 service nova] Creating event network-changed:e5c4411d-8d86-4d05-b8f9-3734ee665e16 for instance 12264581-815d-463d-be11-2dd941746cd3 on n-h1-846466-12 Aug 04 16:47:50.925955 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-9b987130-c95d-4230-9023-a8a9d149492d req-552a54c6-a547-4626-ab2f-d7c365088ed9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053797 Aug 04 16:47:50.927821 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1278/2572] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:47:50.939314 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2e216de5-41e4-4772-9dbb-13434111d19b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:50.940157 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2e216de5-41e4-4772-9dbb-13434111d19b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:50.962439 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2e216de5-41e4-4772-9dbb-13434111d19b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:50.963061 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2e216de5-41e4-4772-9dbb-13434111d19b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:50.963988 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2e216de5-41e4-4772-9dbb-13434111d19b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:50.964482 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2e216de5-41e4-4772-9dbb-13434111d19b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:51.363957 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2e216de5-41e4-4772-9dbb-13434111d19b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:51.364708 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-d76cbd72-4f2a-47cb-b835-5ba2b830dca8 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:47:51.365062 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-d76cbd72-4f2a-47cb-b835-5ba2b830dca8 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:47:51.365461 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-d76cbd72-4f2a-47cb-b835-5ba2b830dca8 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:47:51.366039 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-d76cbd72-4f2a-47cb-b835-5ba2b830dca8 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:47:51.366632 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-d76cbd72-4f2a-47cb-b835-5ba2b830dca8 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:47:51.380776 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2e216de5-41e4-4772-9dbb-13434111d19b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1315 microversion: 2.1 time: 0.449943 Aug 04 16:47:51.384769 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1279/2573] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:50 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1315 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:51.408911 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fbe2181f-0e1f-4631-b951-6a6f9f10ec13 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:51.411098 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fbe2181f-0e1f-4631-b951-6a6f9f10ec13 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 12264581-815d-463d-be11-2dd941746cd3] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:51.413096 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d76cbd72-4f2a-47cb-b835-5ba2b830dca8 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:51.413923 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d76cbd72-4f2a-47cb-b835-5ba2b830dca8 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:51.415341 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d76cbd72-4f2a-47cb-b835-5ba2b830dca8 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:51.418166 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d76cbd72-4f2a-47cb-b835-5ba2b830dca8 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:51.428525 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fbe2181f-0e1f-4631-b951-6a6f9f10ec13 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:51.429513 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fbe2181f-0e1f-4631-b951-6a6f9f10ec13 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:51.432285 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fbe2181f-0e1f-4631-b951-6a6f9f10ec13 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:51.434637 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fbe2181f-0e1f-4631-b951-6a6f9f10ec13 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:51.475782 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-d76cbd72-4f2a-47cb-b835-5ba2b830dca8 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Getting quotas for project afa49d3246ea4361abb452e16e017faf. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:47:51.485145 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-d76cbd72-4f2a-47cb-b835-5ba2b830dca8 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Getting quotas for user a85f0bd88d79409e9610a47f3ae943ce and project afa49d3246ea4361abb452e16e017faf. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:47:51.511743 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=4 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:47:51.516868 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d76cbd72-4f2a-47cb-b835-5ba2b830dca8 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:47:51.521978 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d76cbd72-4f2a-47cb-b835-5ba2b830dca8 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: d23a6aaf-abc4-43f9-b229-7b52436529c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:47:51.543741 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:UPDATE=3,nova_api:SELECT=93,nova_api:INSERT=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:47:51.653186 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d76cbd72-4f2a-47cb-b835-5ba2b830dca8 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.541625 Aug 04 16:47:51.653904 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1295/2574] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:47:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:47:51.677599 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-aee4818d-9fb2-4671-b125-bb7fd83fcf44 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:51.678609 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-aee4818d-9fb2-4671-b125-bb7fd83fcf44 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] [instance: 56491bb2-61c9-4d9f-96cd-3ea7c80aae55] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:51.733342 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aee4818d-9fb2-4671-b125-bb7fd83fcf44 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:51.734051 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aee4818d-9fb2-4671-b125-bb7fd83fcf44 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:51.734865 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aee4818d-9fb2-4671-b125-bb7fd83fcf44 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:51.743554 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aee4818d-9fb2-4671-b125-bb7fd83fcf44 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:52.122147 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-aee4818d-9fb2-4671-b125-bb7fd83fcf44 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3ad8325b284ba186e19077c5f228b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0212954c4b74bbe9eed6333d1f23758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:52.134924 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-aee4818d-9fb2-4671-b125-bb7fd83fcf44 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad3ad8325b284ba186e19077c5f228b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0212954c4b74bbe9eed6333d1f23758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:52.139610 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-aee4818d-9fb2-4671-b125-bb7fd83fcf44 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad3ad8325b284ba186e19077c5f228b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0212954c4b74bbe9eed6333d1f23758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:52.143716 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-aee4818d-9fb2-4671-b125-bb7fd83fcf44 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] 10.222.0.23 "GET /compute/v2.1/servers/56491bb2-61c9-4d9f-96cd-3ea7c80aae55" status: 200 len: 1365 microversion: 2.47 time: 0.488718 Aug 04 16:47:52.147093 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1296/2575] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:47:51 2022] GET /compute/v2.1/servers/56491bb2-61c9-4d9f-96cd-3ea7c80aae55 => generated 1365 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:47:52.161635 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-68c3ccd7-486b-482e-a551-b330f8d82330 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:52.162440 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-68c3ccd7-486b-482e-a551-b330f8d82330 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: d23a6aaf-abc4-43f9-b229-7b52436529c9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:52.398234 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-68c3ccd7-486b-482e-a551-b330f8d82330 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:52.408395 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-68c3ccd7-486b-482e-a551-b330f8d82330 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9" status: 200 len: 1207 microversion: 2.1 time: 0.259917 Aug 04 16:47:52.409478 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1297/2576] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:52 2022] GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9 => generated 1207 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:52.414522 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-5e9d06fb-3291-4a14-a301-93e605370b17 req-f8857a71-b1a7-4ded-9c84-7d33c86fbaa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e3e569c-a08f-4026-9fc9-ad9caf3d3c61", "name": "network-vif-unplugged", "status": "completed", "tag": "b6270fe9-d0af-4606-ba95-ec0813af91bc"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:52.427566 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-5e9d06fb-3291-4a14-a301-93e605370b17 req-f8857a71-b1a7-4ded-9c84-7d33c86fbaa7 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:52.428326 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-5e9d06fb-3291-4a14-a301-93e605370b17 req-f8857a71-b1a7-4ded-9c84-7d33c86fbaa7 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:52.441949 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-5e9d06fb-3291-4a14-a301-93e605370b17 req-f8857a71-b1a7-4ded-9c84-7d33c86fbaa7 service nova] Creating event network-vif-unplugged:b6270fe9-d0af-4606-ba95-ec0813af91bc for instance 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61 on n-h2-846466-12 Aug 04 16:47:52.448164 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-5e9d06fb-3291-4a14-a301-93e605370b17 req-f8857a71-b1a7-4ded-9c84-7d33c86fbaa7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037236 Aug 04 16:47:52.449187 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1298/2577] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:47:52.454636 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=16 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:47:52.460090 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f92e39c9-02db-4aa0-8949-04f50aca22ab tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:52.461149 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f92e39c9-02db-4aa0-8949-04f50aca22ab tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:52.474019 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f92e39c9-02db-4aa0-8949-04f50aca22ab tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:52.474465 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f92e39c9-02db-4aa0-8949-04f50aca22ab tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:52.475271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f92e39c9-02db-4aa0-8949-04f50aca22ab tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:52.475719 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f92e39c9-02db-4aa0-8949-04f50aca22ab tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:52.601046 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fbe2181f-0e1f-4631-b951-6a6f9f10ec13 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:52.612083 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fbe2181f-0e1f-4631-b951-6a6f9f10ec13 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3" status: 200 len: 1317 microversion: 2.1 time: 1.223839 Aug 04 16:47:52.628301 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1280/2578] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:51 2022] GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3 => generated 1317 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:53.052378 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f92e39c9-02db-4aa0-8949-04f50aca22ab tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:53.062802 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f92e39c9-02db-4aa0-8949-04f50aca22ab tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1315 microversion: 2.1 time: 0.611342 Aug 04 16:47:53.063973 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1299/2579] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:52 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1315 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:53.180543 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-07ab9c68-1b3d-43c1-9e65-19e7ca2ee941 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:53.182394 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-07ab9c68-1b3d-43c1-9e65-19e7ca2ee941 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] [instance: 56491bb2-61c9-4d9f-96cd-3ea7c80aae55] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:53.223566 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-07ab9c68-1b3d-43c1-9e65-19e7ca2ee941 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:53.225795 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-07ab9c68-1b3d-43c1-9e65-19e7ca2ee941 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:53.228678 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-07ab9c68-1b3d-43c1-9e65-19e7ca2ee941 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:53.230227 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-07ab9c68-1b3d-43c1-9e65-19e7ca2ee941 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:53.372570 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-07ab9c68-1b3d-43c1-9e65-19e7ca2ee941 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3ad8325b284ba186e19077c5f228b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0212954c4b74bbe9eed6333d1f23758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:53.384411 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-07ab9c68-1b3d-43c1-9e65-19e7ca2ee941 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad3ad8325b284ba186e19077c5f228b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0212954c4b74bbe9eed6333d1f23758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:53.393439 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-07ab9c68-1b3d-43c1-9e65-19e7ca2ee941 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad3ad8325b284ba186e19077c5f228b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0212954c4b74bbe9eed6333d1f23758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:53.395429 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-07ab9c68-1b3d-43c1-9e65-19e7ca2ee941 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] 10.222.0.23 "GET /compute/v2.1/servers/56491bb2-61c9-4d9f-96cd-3ea7c80aae55" status: 200 len: 1365 microversion: 2.47 time: 0.222522 Aug 04 16:47:53.399986 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1281/2580] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:47:53 2022] GET /compute/v2.1/servers/56491bb2-61c9-4d9f-96cd-3ea7c80aae55 => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:47:53.441105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5aa3a901-1850-4ecf-a239-da83d812b616 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:53.442273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5aa3a901-1850-4ecf-a239-da83d812b616 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: d23a6aaf-abc4-43f9-b229-7b52436529c9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:53.464262 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5aa3a901-1850-4ecf-a239-da83d812b616 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:53.469071 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5aa3a901-1850-4ecf-a239-da83d812b616 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:53.470755 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5aa3a901-1850-4ecf-a239-da83d812b616 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:53.471677 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5aa3a901-1850-4ecf-a239-da83d812b616 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:53.554734 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5aa3a901-1850-4ecf-a239-da83d812b616 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:53.564538 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5aa3a901-1850-4ecf-a239-da83d812b616 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9" status: 200 len: 1211 microversion: 2.1 time: 0.132670 Aug 04 16:47:53.565504 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1300/2581] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:53 2022] GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9 => generated 1211 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:53.650499 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4326faef-69b6-47a0-af22-6be6377add1c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:53.651300 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4326faef-69b6-47a0-af22-6be6377add1c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 12264581-815d-463d-be11-2dd941746cd3] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:53.663061 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4326faef-69b6-47a0-af22-6be6377add1c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:53.663849 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4326faef-69b6-47a0-af22-6be6377add1c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:53.664888 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4326faef-69b6-47a0-af22-6be6377add1c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:53.665671 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4326faef-69b6-47a0-af22-6be6377add1c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:53.694881 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8bf0bd5c-38a2-4cd7-b316-bb2a7f173856 tempest-VolumesAdminNegativeTest-599200631 tempest-VolumesAdminNegativeTest-599200631-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "7dfc6c37-0ac7-4da1-b71a-1dfaa11b5504"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:53.698114 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8bf0bd5c-38a2-4cd7-b316-bb2a7f173856 tempest-VolumesAdminNegativeTest-599200631 tempest-VolumesAdminNegativeTest-599200631-project-admin] [instance: fd0b16dd-d4dd-45d3-891a-646b89dce6fa] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:53.705611 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8bf0bd5c-38a2-4cd7-b316-bb2a7f173856 tempest-VolumesAdminNegativeTest-599200631 tempest-VolumesAdminNegativeTest-599200631-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:53.706777 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8bf0bd5c-38a2-4cd7-b316-bb2a7f173856 tempest-VolumesAdminNegativeTest-599200631 tempest-VolumesAdminNegativeTest-599200631-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:53.707660 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8bf0bd5c-38a2-4cd7-b316-bb2a7f173856 tempest-VolumesAdminNegativeTest-599200631 tempest-VolumesAdminNegativeTest-599200631-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:53.708172 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8bf0bd5c-38a2-4cd7-b316-bb2a7f173856 tempest-VolumesAdminNegativeTest-599200631 tempest-VolumesAdminNegativeTest-599200631-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:53.780093 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-8bf0bd5c-38a2-4cd7-b316-bb2a7f173856 tempest-VolumesAdminNegativeTest-599200631 tempest-VolumesAdminNegativeTest-599200631-project-admin] HTTP exception thrown: Volume 87973997-f7b4-46bb-85c5-eecad3044787 could not be found. Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8bf0bd5c-38a2-4cd7-b316-bb2a7f173856 tempest-VolumesAdminNegativeTest-599200631 tempest-VolumesAdminNegativeTest-599200631-project-admin] Request method failure captured: Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: request: PUT /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa/os-volume_attachments/87973997-f7b4-46bb-85c5-eecad3044787 HTTP/1.1 Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 74 Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_ewV8gPqZ46izd633X9netnT8P075jeroBoFqQTzUbe3TOpDYG4k62rCR67fIetYp41IuDBrZgHUaOVwG4Jpjq4tzpRZklvk_Fa9yrmjCqJM5t4umuRiEY9y5xV4zcMtaQ0zu9qkHa8Xu0T4eqd7OdyPWZr-0RSXLyF0ypbullyaS8 Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 2ff074efc58145649d3988f5a753e96c Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-VolumesAdminNegativeTest-599200631 Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader,admin Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader,admin Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2ff074efc58145649d3988f5a753e96c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2ff074efc58145649d3988f5a753e96c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2ff074efc58145649d3988f5a753e96c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2ff074efc58145649d3988f5a753e96c"}]}] Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-VolumesAdminNegativeTest-599200631 Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 2ff074efc58145649d3988f5a753e96c Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-599200631 Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-VolumesAdminNegativeTest-599200631-project-admin Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 26df578270ab421384ad697664d35226 Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-VolumesAdminNegativeTest-599200631-project-admin Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: {"volumeAttachment": {"volumeId": "7dfc6c37-0ac7-4da1-b71a-1dfaa11b5504"}} Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: exception: Volume 87973997-f7b4-46bb-85c5-eecad3044787 could not be found. Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'server_id': 'fd0b16dd-d4dd-45d3-891a-646b89dce6fa', 'id': '87973997-f7b4-46bb-85c5-eecad3044787', 'body': {'volumeAttachment': {'volumeId': '7dfc6c37-0ac7-4da1-b71a-1dfaa11b5504'}}} Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 87973997-f7b4-46bb-85c5-eecad3044787 could not be found. (HTTP 404) (Request-ID: req-10137f32-1321-4b81-a8e7-b7cf9310a0da) Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 16:47:53.783120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 87973997-f7b4-46bb-85c5-eecad3044787 could not be found. Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 87973997-f7b4-46bb-85c5-eecad3044787 could not be found. Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 87973997-f7b4-46bb-85c5-eecad3044787 could not be found. Aug 04 16:47:53.787435 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:53.794401 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8bf0bd5c-38a2-4cd7-b316-bb2a7f173856 tempest-VolumesAdminNegativeTest-599200631 tempest-VolumesAdminNegativeTest-599200631-project-admin] Returning 404 to user: Volume 87973997-f7b4-46bb-85c5-eecad3044787 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:47:53.795855 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8bf0bd5c-38a2-4cd7-b316-bb2a7f173856 tempest-VolumesAdminNegativeTest-599200631 tempest-VolumesAdminNegativeTest-599200631-project-admin] 10.222.0.23 "PUT /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa/os-volume_attachments/87973997-f7b4-46bb-85c5-eecad3044787" status: 404 len: 109 microversion: 2.1 time: 0.105851 Aug 04 16:47:53.802200 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1301/2582] 10.222.0.23 () {60 vars in 1433 bytes} [Thu Aug 4 16:47:53 2022] PUT /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa/os-volume_attachments/87973997-f7b4-46bb-85c5-eecad3044787 => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:47:53.967096 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4326faef-69b6-47a0-af22-6be6377add1c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:53.976346 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4326faef-69b6-47a0-af22-6be6377add1c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3" status: 200 len: 1317 microversion: 2.1 time: 0.329829 Aug 04 16:47:53.985843 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1282/2583] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:53 2022] GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3 => generated 1317 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:54.086361 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a46fcefc-ef20-4c27-bae6-26aa7def366e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:54.087034 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a46fcefc-ef20-4c27-bae6-26aa7def366e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:54.146359 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a46fcefc-ef20-4c27-bae6-26aa7def366e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:54.146819 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a46fcefc-ef20-4c27-bae6-26aa7def366e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:54.149156 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a46fcefc-ef20-4c27-bae6-26aa7def366e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:54.149666 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a46fcefc-ef20-4c27-bae6-26aa7def366e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:54.435504 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-829de9c1-d873-4078-804c-c80cfc60eb66 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:54.438833 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-829de9c1-d873-4078-804c-c80cfc60eb66 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] [instance: 56491bb2-61c9-4d9f-96cd-3ea7c80aae55] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:54.464502 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-829de9c1-d873-4078-804c-c80cfc60eb66 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:54.466323 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-829de9c1-d873-4078-804c-c80cfc60eb66 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:54.478005 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-829de9c1-d873-4078-804c-c80cfc60eb66 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:54.479326 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-829de9c1-d873-4078-804c-c80cfc60eb66 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:54.682005 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-829de9c1-d873-4078-804c-c80cfc60eb66 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3ad8325b284ba186e19077c5f228b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0212954c4b74bbe9eed6333d1f23758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:54.696649 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-829de9c1-d873-4078-804c-c80cfc60eb66 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad3ad8325b284ba186e19077c5f228b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0212954c4b74bbe9eed6333d1f23758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:54.698506 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-829de9c1-d873-4078-804c-c80cfc60eb66 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad3ad8325b284ba186e19077c5f228b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0212954c4b74bbe9eed6333d1f23758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:54.699777 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-829de9c1-d873-4078-804c-c80cfc60eb66 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] 10.222.0.23 "GET /compute/v2.1/servers/56491bb2-61c9-4d9f-96cd-3ea7c80aae55" status: 200 len: 1365 microversion: 2.47 time: 0.272270 Aug 04 16:47:54.706402 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1283/2584] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:47:54 2022] GET /compute/v2.1/servers/56491bb2-61c9-4d9f-96cd-3ea7c80aae55 => generated 1365 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:47:54.713621 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fcd2edab-ba42-4beb-876e-60e838cb80b4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:54.724141 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fcd2edab-ba42-4beb-876e-60e838cb80b4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: d23a6aaf-abc4-43f9-b229-7b52436529c9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:54.745575 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fcd2edab-ba42-4beb-876e-60e838cb80b4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:54.746441 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fcd2edab-ba42-4beb-876e-60e838cb80b4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:54.747471 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fcd2edab-ba42-4beb-876e-60e838cb80b4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:54.748074 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fcd2edab-ba42-4beb-876e-60e838cb80b4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:54.913034 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fcd2edab-ba42-4beb-876e-60e838cb80b4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:54.927687 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fcd2edab-ba42-4beb-876e-60e838cb80b4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9" status: 200 len: 1259 microversion: 2.1 time: 0.220027 Aug 04 16:47:54.932251 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1284/2585] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:54 2022] GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9 => generated 1259 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:55.025941 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c6cfc9e8-d5ad-4155-b67f-5d1b2f9020fa tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:55.027156 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a46fcefc-ef20-4c27-bae6-26aa7def366e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:55.043731 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a46fcefc-ef20-4c27-bae6-26aa7def366e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1315 microversion: 2.1 time: 0.958505 Aug 04 16:47:55.050428 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c6cfc9e8-d5ad-4155-b67f-5d1b2f9020fa tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 12264581-815d-463d-be11-2dd941746cd3] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:55.058184 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1302/2586] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:54 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1315 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:55.082477 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c6cfc9e8-d5ad-4155-b67f-5d1b2f9020fa tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:55.084277 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c6cfc9e8-d5ad-4155-b67f-5d1b2f9020fa tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:55.098557 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c6cfc9e8-d5ad-4155-b67f-5d1b2f9020fa tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:55.099454 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c6cfc9e8-d5ad-4155-b67f-5d1b2f9020fa tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:55.445629 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-1610be42-0a32-4b34-aac2-e63a29b15c4d req-5bd9bc35-c5cc-48fe-917b-1a390ad9f3a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e3e569c-a08f-4026-9fc9-ad9caf3d3c61", "name": "network-vif-deleted", "tag": "b6270fe9-d0af-4606-ba95-ec0813af91bc"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:55.467166 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-1610be42-0a32-4b34-aac2-e63a29b15c4d req-5bd9bc35-c5cc-48fe-917b-1a390ad9f3a9 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:55.475231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-1610be42-0a32-4b34-aac2-e63a29b15c4d req-5bd9bc35-c5cc-48fe-917b-1a390ad9f3a9 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:55.497254 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-1610be42-0a32-4b34-aac2-e63a29b15c4d req-5bd9bc35-c5cc-48fe-917b-1a390ad9f3a9 service nova] Creating event network-vif-deleted:b6270fe9-d0af-4606-ba95-ec0813af91bc for instance 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61 on n-h2-846466-12 Aug 04 16:47:55.513652 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-1610be42-0a32-4b34-aac2-e63a29b15c4d req-5bd9bc35-c5cc-48fe-917b-1a390ad9f3a9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071723 Aug 04 16:47:55.514470 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1303/2587] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:47:55.646781 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-4b5fb5e8-6098-4d70-8621-c4505ec97f14 req-a015b364-0990-43a0-863a-cf5982ed0d50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73dff433-5880-43ec-b799-1230245db7f7", "name": "network-vif-plugged", "status": "completed", "tag": "cb07355a-33e6-4a7b-87c1-59ad0e6d64ce"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:47:55.676410 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-4b5fb5e8-6098-4d70-8621-c4505ec97f14 req-a015b364-0990-43a0-863a-cf5982ed0d50 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:55.676860 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-4b5fb5e8-6098-4d70-8621-c4505ec97f14 req-a015b364-0990-43a0-863a-cf5982ed0d50 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:55.697362 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-4b5fb5e8-6098-4d70-8621-c4505ec97f14 req-a015b364-0990-43a0-863a-cf5982ed0d50 service nova] Creating event network-vif-plugged:cb07355a-33e6-4a7b-87c1-59ad0e6d64ce for instance 73dff433-5880-43ec-b799-1230245db7f7 on n-h1-846466-12 Aug 04 16:47:55.711231 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-4b5fb5e8-6098-4d70-8621-c4505ec97f14 req-a015b364-0990-43a0-863a-cf5982ed0d50 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069081 Aug 04 16:47:55.713648 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1304/2588] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:47:55.741674 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b0db10ee-abe4-4a9a-a74c-b258d7e114ec tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:55.742699 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b0db10ee-abe4-4a9a-a74c-b258d7e114ec tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] [instance: 56491bb2-61c9-4d9f-96cd-3ea7c80aae55] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:55.758735 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0db10ee-abe4-4a9a-a74c-b258d7e114ec tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:55.759514 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0db10ee-abe4-4a9a-a74c-b258d7e114ec tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:55.762437 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0db10ee-abe4-4a9a-a74c-b258d7e114ec tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:55.763121 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0db10ee-abe4-4a9a-a74c-b258d7e114ec tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:55.855455 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0db10ee-abe4-4a9a-a74c-b258d7e114ec tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:55.860126 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0db10ee-abe4-4a9a-a74c-b258d7e114ec tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:55.860904 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-b0db10ee-abe4-4a9a-a74c-b258d7e114ec tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lazy-loading 'fault' on Instance uuid 56491bb2-61c9-4d9f-96cd-3ea7c80aae55 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:47:56.196354 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b0db10ee-abe4-4a9a-a74c-b258d7e114ec tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3ad8325b284ba186e19077c5f228b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0212954c4b74bbe9eed6333d1f23758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:56.270434 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b0db10ee-abe4-4a9a-a74c-b258d7e114ec tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad3ad8325b284ba186e19077c5f228b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0212954c4b74bbe9eed6333d1f23758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:56.284846 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b0db10ee-abe4-4a9a-a74c-b258d7e114ec tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad3ad8325b284ba186e19077c5f228b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0212954c4b74bbe9eed6333d1f23758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:56.286234 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b0db10ee-abe4-4a9a-a74c-b258d7e114ec tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] 10.222.0.23 "GET /compute/v2.1/servers/56491bb2-61c9-4d9f-96cd-3ea7c80aae55" status: 200 len: 1370 microversion: 2.47 time: 0.549436 Aug 04 16:47:56.286835 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1305/2589] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:47:55 2022] GET /compute/v2.1/servers/56491bb2-61c9-4d9f-96cd-3ea7c80aae55 => generated 1370 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:47:56.302933 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-de6171f8-5df8-4859-9a6d-6050ed6c92af tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:56.308902 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-de6171f8-5df8-4859-9a6d-6050ed6c92af tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: d23a6aaf-abc4-43f9-b229-7b52436529c9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:56.362894 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-de6171f8-5df8-4859-9a6d-6050ed6c92af tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:56.366339 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-de6171f8-5df8-4859-9a6d-6050ed6c92af tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:56.367850 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-de6171f8-5df8-4859-9a6d-6050ed6c92af tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:56.368622 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-de6171f8-5df8-4859-9a6d-6050ed6c92af tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:56.544168 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c6cfc9e8-d5ad-4155-b67f-5d1b2f9020fa tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:56.571491 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c6cfc9e8-d5ad-4155-b67f-5d1b2f9020fa tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3" status: 200 len: 1317 microversion: 2.1 time: 1.561237 Aug 04 16:47:56.603318 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1285/2590] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:55 2022] GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3 => generated 1317 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:47:56.622794 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-59a9789d-052d-41d4-a8c1-edc8607ebb5d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:56.624165 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-59a9789d-052d-41d4-a8c1-edc8607ebb5d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:56.663356 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-59a9789d-052d-41d4-a8c1-edc8607ebb5d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:56.666047 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-59a9789d-052d-41d4-a8c1-edc8607ebb5d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:56.674784 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-59a9789d-052d-41d4-a8c1-edc8607ebb5d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:56.677213 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-59a9789d-052d-41d4-a8c1-edc8607ebb5d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:56.747079 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-de6171f8-5df8-4859-9a6d-6050ed6c92af tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:56.781979 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-de6171f8-5df8-4859-9a6d-6050ed6c92af tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9" status: 200 len: 1265 microversion: 2.1 time: 0.473775 Aug 04 16:47:56.788389 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1306/2591] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:56 2022] GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9 => generated 1265 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:57.302273 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-59a9789d-052d-41d4-a8c1-edc8607ebb5d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:57.312489 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-59a9789d-052d-41d4-a8c1-edc8607ebb5d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1315 microversion: 2.1 time: 0.707528 Aug 04 16:47:57.313247 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1286/2592] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:56 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1315 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:57.352972 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8284d555-c2be-4c53-8e38-770f4be059c5 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:57.355319 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8284d555-c2be-4c53-8e38-770f4be059c5 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] [instance: 56491bb2-61c9-4d9f-96cd-3ea7c80aae55] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:57.371946 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8284d555-c2be-4c53-8e38-770f4be059c5 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:57.372674 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8284d555-c2be-4c53-8e38-770f4be059c5 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:57.374089 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8284d555-c2be-4c53-8e38-770f4be059c5 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:57.374798 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8284d555-c2be-4c53-8e38-770f4be059c5 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:57.404768 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-8284d555-c2be-4c53-8e38-770f4be059c5 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] HTTP exception thrown: Instance 56491bb2-61c9-4d9f-96cd-3ea7c80aae55 could not be found. Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8284d555-c2be-4c53-8e38-770f4be059c5 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Request method failure captured: Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/56491bb2-61c9-4d9f-96cd-3ea7c80aae55 HTTP/1.1 Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_gqA5FOIcY-WbBxELBqetx4FJPyEsshAbBppO4uVUXkZv_XqoMhHs-NnHcF_AqSszYAJd8zeGnMq9pljmZsfk5chS0HglyIwuxcjCa1kLSt6PXZUFKdP9O2QFQdnokh-ESnG_vmgMVMNdTG0T7ReBMrxTKoHKZswBvU5LYK2j-Ldyg Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: X-Openstack-Nova-Api-Version: 2.47 Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: a0212954c4b74bbe9eed6333d1f23758 Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersAaction247Test-1545263871 Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a0212954c4b74bbe9eed6333d1f23758"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a0212954c4b74bbe9eed6333d1f23758"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a0212954c4b74bbe9eed6333d1f23758"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a0212954c4b74bbe9eed6333d1f23758"}]}] Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersAaction247Test-1545263871 Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: a0212954c4b74bbe9eed6333d1f23758 Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersAaction247Test-1545263871 Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersAaction247Test-1545263871-project Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: ad3ad8325b284ba186e19077c5f228b0 Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersAaction247Test-1545263871-project Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 56491bb2-61c9-4d9f-96cd-3ea7c80aae55 could not be found. Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '56491bb2-61c9-4d9f-96cd-3ea7c80aae55'} Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56491bb2-61c9-4d9f-96cd-3ea7c80aae55 could not be found. Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56491bb2-61c9-4d9f-96cd-3ea7c80aae55 could not be found. Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:57.412725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:47:57.421223 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:57.421223 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:47:57.421223 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:47:57.421223 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:47:57.421223 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:47:57.421223 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:47:57.421223 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56491bb2-61c9-4d9f-96cd-3ea7c80aae55 could not be found. Aug 04 16:47:57.421223 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:47:57.425314 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8284d555-c2be-4c53-8e38-770f4be059c5 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] Returning 404 to user: Instance 56491bb2-61c9-4d9f-96cd-3ea7c80aae55 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:47:57.437567 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8284d555-c2be-4c53-8e38-770f4be059c5 tempest-ServersAaction247Test-1545263871 tempest-ServersAaction247Test-1545263871-project] 10.222.0.23 "GET /compute/v2.1/servers/56491bb2-61c9-4d9f-96cd-3ea7c80aae55" status: 404 len: 111 microversion: 2.47 time: 0.093325 Aug 04 16:47:57.443401 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1307/2593] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:47:57 2022] GET /compute/v2.1/servers/56491bb2-61c9-4d9f-96cd-3ea7c80aae55 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:47:57.614385 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a2a09e2d-12e6-490a-ac8e-e31e0847cad8 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:57.616027 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a2a09e2d-12e6-490a-ac8e-e31e0847cad8 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 12264581-815d-463d-be11-2dd941746cd3] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:57.629178 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a2a09e2d-12e6-490a-ac8e-e31e0847cad8 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:57.635568 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a2a09e2d-12e6-490a-ac8e-e31e0847cad8 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:57.637088 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a2a09e2d-12e6-490a-ac8e-e31e0847cad8 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:57.637825 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a2a09e2d-12e6-490a-ac8e-e31e0847cad8 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:57.831375 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d12a5971-f717-4e13-a87c-7f9096ce97a0 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:57.833347 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d12a5971-f717-4e13-a87c-7f9096ce97a0 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: d23a6aaf-abc4-43f9-b229-7b52436529c9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:57.870398 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d12a5971-f717-4e13-a87c-7f9096ce97a0 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:57.872229 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d12a5971-f717-4e13-a87c-7f9096ce97a0 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:57.877641 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d12a5971-f717-4e13-a87c-7f9096ce97a0 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:57.880528 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d12a5971-f717-4e13-a87c-7f9096ce97a0 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:59.070465 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d12a5971-f717-4e13-a87c-7f9096ce97a0 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:59.087999 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d12a5971-f717-4e13-a87c-7f9096ce97a0 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9" status: 200 len: 1307 microversion: 2.1 time: 1.264096 Aug 04 16:47:59.101316 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1308/2594] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:57 2022] GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9 => generated 1307 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:59.101316 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3fd5cc1c-635a-404c-bdf6-aa47becd2a2f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:59.101836 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3fd5cc1c-635a-404c-bdf6-aa47becd2a2f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:59.116836 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3fd5cc1c-635a-404c-bdf6-aa47becd2a2f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:59.117833 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3fd5cc1c-635a-404c-bdf6-aa47becd2a2f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:59.121254 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3fd5cc1c-635a-404c-bdf6-aa47becd2a2f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:59.122324 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3fd5cc1c-635a-404c-bdf6-aa47becd2a2f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:59.133132 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a2a09e2d-12e6-490a-ac8e-e31e0847cad8 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:47:59.166831 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a2a09e2d-12e6-490a-ac8e-e31e0847cad8 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3" status: 200 len: 1317 microversion: 2.1 time: 1.555633 Aug 04 16:47:59.172461 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1287/2595] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:57 2022] GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3 => generated 1317 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:59.193006 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-54977be0-55df-4a16-af75-921f4f8bcd60 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:59.193935 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-54977be0-55df-4a16-af75-921f4f8bcd60 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: fd0b16dd-d4dd-45d3-891a-646b89dce6fa] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:59.227874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-54977be0-55df-4a16-af75-921f4f8bcd60 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:59.229050 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-54977be0-55df-4a16-af75-921f4f8bcd60 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:59.231034 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-54977be0-55df-4a16-af75-921f4f8bcd60 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:59.240920 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-54977be0-55df-4a16-af75-921f4f8bcd60 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:59.302009 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-54977be0-55df-4a16-af75-921f4f8bcd60 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: fd0b16dd-d4dd-45d3-891a-646b89dce6fa] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:47:59.542414 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-54977be0-55df-4a16-af75-921f4f8bcd60 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa" status: 204 len: 0 microversion: 2.1 time: 0.362505 Aug 04 16:47:59.543300 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1288/2596] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:47:59 2022] DELETE /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:47:59.554496 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-76b5f7cf-20b1-4aa9-a755-ab7be96b1566 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:59.562527 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-76b5f7cf-20b1-4aa9-a755-ab7be96b1566 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: fd0b16dd-d4dd-45d3-891a-646b89dce6fa] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:47:59.575330 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-76b5f7cf-20b1-4aa9-a755-ab7be96b1566 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:59.575765 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-76b5f7cf-20b1-4aa9-a755-ab7be96b1566 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:47:59.577083 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-76b5f7cf-20b1-4aa9-a755-ab7be96b1566 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:47:59.577736 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-76b5f7cf-20b1-4aa9-a755-ab7be96b1566 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:00.180087 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3fd5cc1c-635a-404c-bdf6-aa47becd2a2f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:00.215536 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3fd5cc1c-635a-404c-bdf6-aa47becd2a2f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1502 microversion: 2.1 time: 1.123393 Aug 04 16:48:00.219968 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1309/2597] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:59 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1502 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:00.245036 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-021fc96a-4913-4144-9306-ab6f477a327c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:00.246915 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-021fc96a-4913-4144-9306-ab6f477a327c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: d23a6aaf-abc4-43f9-b229-7b52436529c9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:00.247391 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-76b5f7cf-20b1-4aa9-a755-ab7be96b1566 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97a079594a2400bb4db33f3ce3a1497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4cdb4245df44119c504915dc542d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:00.259201 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-76b5f7cf-20b1-4aa9-a755-ab7be96b1566 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa" status: 200 len: 1513 microversion: 2.1 time: 0.709219 Aug 04 16:48:00.260433 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1289/2598] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:47:59 2022] GET /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa => generated 1513 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:48:00.265980 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bbe6293d-3f9c-48be-aeea-6371c2217121 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:00.267491 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bbe6293d-3f9c-48be-aeea-6371c2217121 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 12264581-815d-463d-be11-2dd941746cd3] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:00.270374 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-021fc96a-4913-4144-9306-ab6f477a327c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:00.274440 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bbe6293d-3f9c-48be-aeea-6371c2217121 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:00.274739 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-021fc96a-4913-4144-9306-ab6f477a327c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:00.276300 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-021fc96a-4913-4144-9306-ab6f477a327c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:00.276715 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bbe6293d-3f9c-48be-aeea-6371c2217121 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:00.277589 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bbe6293d-3f9c-48be-aeea-6371c2217121 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:00.278024 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bbe6293d-3f9c-48be-aeea-6371c2217121 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:00.278373 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-021fc96a-4913-4144-9306-ab6f477a327c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:00.838897 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-021fc96a-4913-4144-9306-ab6f477a327c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:00.868338 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-021fc96a-4913-4144-9306-ab6f477a327c tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9" status: 200 len: 1307 microversion: 2.1 time: 0.645406 Aug 04 16:48:00.871257 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1310/2599] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:00 2022] GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9 => generated 1307 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:00.912554 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-32d6144e-050b-441e-bba4-b790b0e74ce0 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:48:00.913365 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-32d6144e-050b-441e-bba4-b790b0e74ce0 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:00.921816 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-32d6144e-050b-441e-bba4-b790b0e74ce0 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:00.922482 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-32d6144e-050b-441e-bba4-b790b0e74ce0 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:00.923404 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-32d6144e-050b-441e-bba4-b790b0e74ce0 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:00.923947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-32d6144e-050b-441e-bba4-b790b0e74ce0 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:00.961947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-32d6144e-050b-441e-bba4-b790b0e74ce0 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lazy-loading 'flavor' on Instance uuid 73dff433-5880-43ec-b799-1230245db7f7 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:48:01.057359 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bbe6293d-3f9c-48be-aeea-6371c2217121 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:01.104388 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:48:01.112082 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bbe6293d-3f9c-48be-aeea-6371c2217121 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3" status: 200 len: 1317 microversion: 2.1 time: 0.847629 Aug 04 16:48:01.113782 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1290/2600] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:00 2022] GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3 => generated 1317 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:01.287669 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-85b9c1cb-55a2-441c-b26a-98ac42796498 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:01.291152 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-85b9c1cb-55a2-441c-b26a-98ac42796498 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: fd0b16dd-d4dd-45d3-891a-646b89dce6fa] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:01.318105 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-85b9c1cb-55a2-441c-b26a-98ac42796498 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:01.321872 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-85b9c1cb-55a2-441c-b26a-98ac42796498 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:01.327188 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-85b9c1cb-55a2-441c-b26a-98ac42796498 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:01.331511 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-85b9c1cb-55a2-441c-b26a-98ac42796498 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:01.430661 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:48:01.436283 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-32d6144e-050b-441e-bba4-b790b0e74ce0 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "POST /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7/action" status: 202 len: 0 microversion: 2.1 time: 0.544789 Aug 04 16:48:01.442418 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1311/2601] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:48:00 2022] POST /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7/action => generated 0 bytes in 570 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:48:01.456051 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-17b5e4a9-d808-47e9-8643-2f85c2c84b83 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:01.460683 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-17b5e4a9-d808-47e9-8643-2f85c2c84b83 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:01.491739 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-17b5e4a9-d808-47e9-8643-2f85c2c84b83 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:01.494006 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-17b5e4a9-d808-47e9-8643-2f85c2c84b83 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:01.495230 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-17b5e4a9-d808-47e9-8643-2f85c2c84b83 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:01.501863 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-17b5e4a9-d808-47e9-8643-2f85c2c84b83 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:02.281047 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-85b9c1cb-55a2-441c-b26a-98ac42796498 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97a079594a2400bb4db33f3ce3a1497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4cdb4245df44119c504915dc542d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:02.313719 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-85b9c1cb-55a2-441c-b26a-98ac42796498 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa" status: 200 len: 1513 microversion: 2.1 time: 1.033690 Aug 04 16:48:02.314888 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1291/2602] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:01 2022] GET /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa => generated 1513 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:02.338757 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-3e2c8ef6-6f87-4a64-a3f9-42da437f6810 req-84b1a67f-1050-4bf7-96f6-b0ce064f1a77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12264581-815d-463d-be11-2dd941746cd3", "name": "network-vif-plugged", "status": "completed", "tag": "e5c4411d-8d86-4d05-b8f9-3734ee665e16"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:48:02.377904 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-3e2c8ef6-6f87-4a64-a3f9-42da437f6810 req-84b1a67f-1050-4bf7-96f6-b0ce064f1a77 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:02.379014 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-3e2c8ef6-6f87-4a64-a3f9-42da437f6810 req-84b1a67f-1050-4bf7-96f6-b0ce064f1a77 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:02.381273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-17b5e4a9-d808-47e9-8643-2f85c2c84b83 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:02.390752 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-17b5e4a9-d808-47e9-8643-2f85c2c84b83 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1508 microversion: 2.1 time: 0.944151 Aug 04 16:48:02.408954 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1312/2603] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:01 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1508 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:02.408954 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=16 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:48:02.410326 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6d265d85-7f76-4221-88ef-8d2faa87fdff tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:02.410966 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6d265d85-7f76-4221-88ef-8d2faa87fdff tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: d23a6aaf-abc4-43f9-b229-7b52436529c9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:02.417686 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:48:02.427539 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-3e2c8ef6-6f87-4a64-a3f9-42da437f6810 req-84b1a67f-1050-4bf7-96f6-b0ce064f1a77 service nova] Creating event network-vif-plugged:e5c4411d-8d86-4d05-b8f9-3734ee665e16 for instance 12264581-815d-463d-be11-2dd941746cd3 on n-h1-846466-12 Aug 04 16:48:02.437474 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-3e2c8ef6-6f87-4a64-a3f9-42da437f6810 req-84b1a67f-1050-4bf7-96f6-b0ce064f1a77 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119630 Aug 04 16:48:02.437783 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d265d85-7f76-4221-88ef-8d2faa87fdff tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:02.438557 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d265d85-7f76-4221-88ef-8d2faa87fdff tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:02.439550 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d265d85-7f76-4221-88ef-8d2faa87fdff tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:02.439723 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1292/2604] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:48:02.440326 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d265d85-7f76-4221-88ef-8d2faa87fdff tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:02.459108 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d2682dbe-1e83-42a7-ac74-b15e56f391ea tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:48:02.471057 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d2682dbe-1e83-42a7-ac74-b15e56f391ea tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:02.498330 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d2682dbe-1e83-42a7-ac74-b15e56f391ea tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:02.499718 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d2682dbe-1e83-42a7-ac74-b15e56f391ea tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:02.506565 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d2682dbe-1e83-42a7-ac74-b15e56f391ea tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:02.511408 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d2682dbe-1e83-42a7-ac74-b15e56f391ea tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:02.693165 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d2682dbe-1e83-42a7-ac74-b15e56f391ea tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action" status: 202 len: 0 microversion: 2.1 time: 0.251883 Aug 04 16:48:02.695805 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1293/2605] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:48:02 2022] POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:48:02.715199 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f7956a24-2bd3-437e-a482-7adc72068bfb tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:02.717019 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f7956a24-2bd3-437e-a482-7adc72068bfb tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 12264581-815d-463d-be11-2dd941746cd3] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:02.739330 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f7956a24-2bd3-437e-a482-7adc72068bfb tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:02.743267 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f7956a24-2bd3-437e-a482-7adc72068bfb tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:02.745580 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f7956a24-2bd3-437e-a482-7adc72068bfb tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:02.747678 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f7956a24-2bd3-437e-a482-7adc72068bfb tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:03.788200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6d265d85-7f76-4221-88ef-8d2faa87fdff tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:03.807830 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6d265d85-7f76-4221-88ef-8d2faa87fdff tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9" status: 200 len: 1307 microversion: 2.1 time: 1.404354 Aug 04 16:48:03.813699 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1313/2606] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:02 2022] GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9 => generated 1307 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:03.853712 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1f9b4939-c7c6-44e3-922b-f5a9c349e4fc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:03.855418 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1f9b4939-c7c6-44e3-922b-f5a9c349e4fc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:03.871191 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f9b4939-c7c6-44e3-922b-f5a9c349e4fc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:03.872317 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f9b4939-c7c6-44e3-922b-f5a9c349e4fc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:03.875510 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f9b4939-c7c6-44e3-922b-f5a9c349e4fc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:03.878103 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f9b4939-c7c6-44e3-922b-f5a9c349e4fc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:04.573756 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f7956a24-2bd3-437e-a482-7adc72068bfb tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:04.600039 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f7956a24-2bd3-437e-a482-7adc72068bfb tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3" status: 200 len: 1317 microversion: 2.1 time: 1.899014 Aug 04 16:48:04.615827 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1294/2607] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:02 2022] GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3 => generated 1317 bytes in 1918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:04.742323 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1f9b4939-c7c6-44e3-922b-f5a9c349e4fc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:04.774283 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1f9b4939-c7c6-44e3-922b-f5a9c349e4fc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1671 microversion: 2.1 time: 0.948289 Aug 04 16:48:04.776077 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1314/2608] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:03 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1671 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:04.801781 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-556f6f9d-6246-46b7-908f-f5cafcd9ac27 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:04.804129 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-556f6f9d-6246-46b7-908f-f5cafcd9ac27 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: fd0b16dd-d4dd-45d3-891a-646b89dce6fa] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:04.834957 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-556f6f9d-6246-46b7-908f-f5cafcd9ac27 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:04.836635 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-556f6f9d-6246-46b7-908f-f5cafcd9ac27 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:04.838950 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-556f6f9d-6246-46b7-908f-f5cafcd9ac27 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:04.841447 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-556f6f9d-6246-46b7-908f-f5cafcd9ac27 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:04.918755 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5f2c4d75-5c77-4eec-a1f4-5599a0534b52 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1177787888", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": "none"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:48:04.941250 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-556f6f9d-6246-46b7-908f-f5cafcd9ac27 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:04.942666 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-556f6f9d-6246-46b7-908f-f5cafcd9ac27 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:04.943573 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-556f6f9d-6246-46b7-908f-f5cafcd9ac27 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lazy-loading 'fault' on Instance uuid fd0b16dd-d4dd-45d3-891a-646b89dce6fa {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:48:05.093006 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-5f2c4d75-5c77-4eec-a1f4-5599a0534b52 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:48:05.093615 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-5f2c4d75-5c77-4eec-a1f4-5599a0534b52 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:48:05.094580 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-5f2c4d75-5c77-4eec-a1f4-5599a0534b52 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:48:05.095345 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-5f2c4d75-5c77-4eec-a1f4-5599a0534b52 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:48:05.096505 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-5f2c4d75-5c77-4eec-a1f4-5599a0534b52 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:48:05.126139 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5f2c4d75-5c77-4eec-a1f4-5599a0534b52 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:05.127163 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5f2c4d75-5c77-4eec-a1f4-5599a0534b52 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:05.131298 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5f2c4d75-5c77-4eec-a1f4-5599a0534b52 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:05.132106 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5f2c4d75-5c77-4eec-a1f4-5599a0534b52 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:05.160221 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-5f2c4d75-5c77-4eec-a1f4-5599a0534b52 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Getting quotas for project d3dcf49d342f431fa9040484372115be. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:48:05.179442 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-5f2c4d75-5c77-4eec-a1f4-5599a0534b52 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Getting quotas for user ca08e18f16dd4ded81abc6fe0d2ae0ac and project d3dcf49d342f431fa9040484372115be. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:48:05.200614 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-556f6f9d-6246-46b7-908f-f5cafcd9ac27 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97a079594a2400bb4db33f3ce3a1497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4cdb4245df44119c504915dc542d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:05.213895 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-556f6f9d-6246-46b7-908f-f5cafcd9ac27 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa" status: 200 len: 1307 microversion: 2.1 time: 0.434464 Aug 04 16:48:05.214955 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1315/2609] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:04 2022] GET /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa => generated 1307 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:05.215302 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5f2c4d75-5c77-4eec-a1f4-5599a0534b52 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:48:05.220979 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5f2c4d75-5c77-4eec-a1f4-5599a0534b52 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] [instance: a1d675a4-bcdd-4551-ba93-11f334a56e95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:48:05.224092 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-554c6bb6-6ddc-46f5-bc7b-3fee1f5ea89c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:05.228786 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-554c6bb6-6ddc-46f5-bc7b-3fee1f5ea89c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:05.250446 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-554c6bb6-6ddc-46f5-bc7b-3fee1f5ea89c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:05.251433 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-554c6bb6-6ddc-46f5-bc7b-3fee1f5ea89c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:05.252545 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-554c6bb6-6ddc-46f5-bc7b-3fee1f5ea89c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:05.266139 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-554c6bb6-6ddc-46f5-bc7b-3fee1f5ea89c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:05.303582 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5f2c4d75-5c77-4eec-a1f4-5599a0534b52 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.684042 Aug 04 16:48:05.314550 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1295/2610] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Aug 4 16:48:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 16:48:05.432265 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-0f0b768a-c9fb-4121-91eb-6710cda7d341 req-dc36e637-0cfb-4e6a-b402-5c2e6cbb9422 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d23a6aaf-abc4-43f9-b229-7b52436529c9", "tag": "b3dfb2dd-dc19-4306-9f4c-7d3e13704fcf"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:48:05.448422 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-0f0b768a-c9fb-4121-91eb-6710cda7d341 req-dc36e637-0cfb-4e6a-b402-5c2e6cbb9422 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:05.449390 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-0f0b768a-c9fb-4121-91eb-6710cda7d341 req-dc36e637-0cfb-4e6a-b402-5c2e6cbb9422 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:05.471659 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-0f0b768a-c9fb-4121-91eb-6710cda7d341 req-dc36e637-0cfb-4e6a-b402-5c2e6cbb9422 service nova] Creating event network-changed:b3dfb2dd-dc19-4306-9f4c-7d3e13704fcf for instance d23a6aaf-abc4-43f9-b229-7b52436529c9 on n-h2-846466-12 Aug 04 16:48:05.479737 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-0f0b768a-c9fb-4121-91eb-6710cda7d341 req-dc36e637-0cfb-4e6a-b402-5c2e6cbb9422 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162655 Aug 04 16:48:05.485845 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1296/2611] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:48:05.498045 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-55bbf635-13c6-4bb7-bed7-c26f65bf5383 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:05.499410 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-55bbf635-13c6-4bb7-bed7-c26f65bf5383 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: d23a6aaf-abc4-43f9-b229-7b52436529c9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:05.507335 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-55bbf635-13c6-4bb7-bed7-c26f65bf5383 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:05.509420 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-55bbf635-13c6-4bb7-bed7-c26f65bf5383 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:05.510572 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-55bbf635-13c6-4bb7-bed7-c26f65bf5383 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:05.511614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-55bbf635-13c6-4bb7-bed7-c26f65bf5383 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:05.742840 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-554c6bb6-6ddc-46f5-bc7b-3fee1f5ea89c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:05.767252 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-554c6bb6-6ddc-46f5-bc7b-3fee1f5ea89c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1508 microversion: 2.1 time: 0.550512 Aug 04 16:48:05.767870 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1316/2612] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:05 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1508 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:05.773012 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9be4ede1-de4a-4eb0-a13a-56d264cfc786 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:05.773984 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9be4ede1-de4a-4eb0-a13a-56d264cfc786 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] [instance: a1d675a4-bcdd-4551-ba93-11f334a56e95] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:05.899830 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9be4ede1-de4a-4eb0-a13a-56d264cfc786 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:05.925376 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9be4ede1-de4a-4eb0-a13a-56d264cfc786 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:05.928120 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9be4ede1-de4a-4eb0-a13a-56d264cfc786 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:05.929754 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9be4ede1-de4a-4eb0-a13a-56d264cfc786 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] 10.222.0.23 "GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95" status: 200 len: 1278 microversion: 2.54 time: 0.160858 Aug 04 16:48:05.932222 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1317/2613] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:48:05 2022] GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95 => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:48:05.953964 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-535e0c59-5b0a-42b8-b594-0b24c5c434e4 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:05.955124 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-535e0c59-5b0a-42b8-b594-0b24c5c434e4 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 12264581-815d-463d-be11-2dd941746cd3] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:05.967472 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-535e0c59-5b0a-42b8-b594-0b24c5c434e4 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:05.967955 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-535e0c59-5b0a-42b8-b594-0b24c5c434e4 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:05.968946 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-535e0c59-5b0a-42b8-b594-0b24c5c434e4 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:05.969636 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-535e0c59-5b0a-42b8-b594-0b24c5c434e4 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:05.991026 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-55bbf635-13c6-4bb7-bed7-c26f65bf5383 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:06.005084 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-55bbf635-13c6-4bb7-bed7-c26f65bf5383 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9" status: 200 len: 1307 microversion: 2.1 time: 0.512071 Aug 04 16:48:06.010645 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1297/2614] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:05 2022] GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9 => generated 1307 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:06.017557 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-01e1bbd6-1127-47b2-b725-ad48e0bc06fc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:06.018534 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-01e1bbd6-1127-47b2-b725-ad48e0bc06fc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:06.033827 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-01e1bbd6-1127-47b2-b725-ad48e0bc06fc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:06.034643 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-01e1bbd6-1127-47b2-b725-ad48e0bc06fc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:06.036176 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-01e1bbd6-1127-47b2-b725-ad48e0bc06fc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:06.036808 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-01e1bbd6-1127-47b2-b725-ad48e0bc06fc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:06.443207 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-535e0c59-5b0a-42b8-b594-0b24c5c434e4 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:06.453534 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-535e0c59-5b0a-42b8-b594-0b24c5c434e4 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3" status: 200 len: 1466 microversion: 2.1 time: 0.507646 Aug 04 16:48:06.454844 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1318/2615] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:05 2022] GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3 => generated 1466 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:06.474750 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d3231d2c-8d5d-40e2-961c-b64e7e9ee6a5 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:06.475911 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d3231d2c-8d5d-40e2-961c-b64e7e9ee6a5 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: fd0b16dd-d4dd-45d3-891a-646b89dce6fa] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:06.487046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d3231d2c-8d5d-40e2-961c-b64e7e9ee6a5 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:06.488207 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d3231d2c-8d5d-40e2-961c-b64e7e9ee6a5 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:06.489672 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d3231d2c-8d5d-40e2-961c-b64e7e9ee6a5 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:06.490382 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d3231d2c-8d5d-40e2-961c-b64e7e9ee6a5 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:06.514936 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-d3231d2c-8d5d-40e2-961c-b64e7e9ee6a5 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] HTTP exception thrown: Instance fd0b16dd-d4dd-45d3-891a-646b89dce6fa could not be found. Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d3231d2c-8d5d-40e2-961c-b64e7e9ee6a5 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Request method failure captured: Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa HTTP/1.1 Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_ecQdFr8t1mHp27RfNp-2bYbjto-1M7KgUsFDQ1x-flBZ5ok1An18DBV18yiaGCBKm9cmgfb8ncoVedeZaMlW4MyZodc893C_XoivAPSAI_SvRh5apXW1b5olqPB6D-zr4d1pgme6gm0zNgpS1yfSi7CbvjCSkDOqwIkFHWBbr3L6o Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 1f4cdb4245df44119c504915dc542d9b Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-VolumesAdminNegativeTest-510576780 Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1f4cdb4245df44119c504915dc542d9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1f4cdb4245df44119c504915dc542d9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1f4cdb4245df44119c504915dc542d9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1f4cdb4245df44119c504915dc542d9b"}]}] Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-VolumesAdminNegativeTest-510576780 Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 1f4cdb4245df44119c504915dc542d9b Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-510576780 Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-VolumesAdminNegativeTest-510576780-project Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: c97a079594a2400bb4db33f3ce3a1497 Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-VolumesAdminNegativeTest-510576780-project Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance fd0b16dd-d4dd-45d3-891a-646b89dce6fa could not be found. Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'fd0b16dd-d4dd-45d3-891a-646b89dce6fa'} Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd0b16dd-d4dd-45d3-891a-646b89dce6fa could not be found. Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd0b16dd-d4dd-45d3-891a-646b89dce6fa could not be found. Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:06.521356 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:06.526421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:06.526421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:06.526421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:06.526421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:48:06.526421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:48:06.526421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd0b16dd-d4dd-45d3-891a-646b89dce6fa could not be found. Aug 04 16:48:06.526421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:06.532471 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d3231d2c-8d5d-40e2-961c-b64e7e9ee6a5 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Returning 404 to user: Instance fd0b16dd-d4dd-45d3-891a-646b89dce6fa could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:48:06.533592 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d3231d2c-8d5d-40e2-961c-b64e7e9ee6a5 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa" status: 404 len: 111 microversion: 2.1 time: 0.077520 Aug 04 16:48:06.534805 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1319/2616] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:06 2022] GET /compute/v2.1/servers/fd0b16dd-d4dd-45d3-891a-646b89dce6fa => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:48:06.540441 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-01e1bbd6-1127-47b2-b725-ad48e0bc06fc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:06.543921 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6d29a33f-46f6-4eeb-9a00-e0af0af80afe tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:06.544735 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6d29a33f-46f6-4eeb-9a00-e0af0af80afe tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] [instance: 12264581-815d-463d-be11-2dd941746cd3] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:06.555022 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d29a33f-46f6-4eeb-9a00-e0af0af80afe tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:06.555723 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d29a33f-46f6-4eeb-9a00-e0af0af80afe tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:06.556756 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d29a33f-46f6-4eeb-9a00-e0af0af80afe tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:06.556958 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-01e1bbd6-1127-47b2-b725-ad48e0bc06fc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1671 microversion: 2.1 time: 0.544268 Aug 04 16:48:06.557475 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d29a33f-46f6-4eeb-9a00-e0af0af80afe tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:06.557971 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1298/2617] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:06 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1671 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:06.796229 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-262ab349-713b-49d2-aba5-90f10f1aa5be tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:06.796914 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-262ab349-713b-49d2-aba5-90f10f1aa5be tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:06.824376 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-262ab349-713b-49d2-aba5-90f10f1aa5be tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:06.824376 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-262ab349-713b-49d2-aba5-90f10f1aa5be tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:06.829060 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-262ab349-713b-49d2-aba5-90f10f1aa5be tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:06.834106 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-262ab349-713b-49d2-aba5-90f10f1aa5be tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:07.141766 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6d29a33f-46f6-4eeb-9a00-e0af0af80afe tempest-ServersOnMultiNodesTest-1224096490 tempest-ServersOnMultiNodesTest-1224096490-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3" status: 200 len: 1619 microversion: 2.1 time: 0.605374 Aug 04 16:48:07.147521 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1320/2618] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:06 2022] GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3 => generated 1619 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:07.165812 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ed9eca01-f972-4d9a-898d-5085e5da8469 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:07.167186 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ed9eca01-f972-4d9a-898d-5085e5da8469 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] [instance: a1d675a4-bcdd-4551-ba93-11f334a56e95] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:07.184598 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ed9eca01-f972-4d9a-898d-5085e5da8469 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:07.186171 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ed9eca01-f972-4d9a-898d-5085e5da8469 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:07.188410 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ed9eca01-f972-4d9a-898d-5085e5da8469 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:07.198677 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ed9eca01-f972-4d9a-898d-5085e5da8469 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:07.549983 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ed9eca01-f972-4d9a-898d-5085e5da8469 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:07.572185 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ed9eca01-f972-4d9a-898d-5085e5da8469 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:07.573946 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ed9eca01-f972-4d9a-898d-5085e5da8469 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:07.575901 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ed9eca01-f972-4d9a-898d-5085e5da8469 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] 10.222.0.23 "GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95" status: 200 len: 1330 microversion: 2.54 time: 0.427085 Aug 04 16:48:07.578397 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1321/2619] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:48:07 2022] GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95 => generated 1330 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:48:07.591328 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a34c2289-a972-44eb-a3c5-1c54d9e9a4e9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:07.592560 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a34c2289-a972-44eb-a3c5-1c54d9e9a4e9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: d23a6aaf-abc4-43f9-b229-7b52436529c9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:07.608350 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a34c2289-a972-44eb-a3c5-1c54d9e9a4e9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:07.611166 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a34c2289-a972-44eb-a3c5-1c54d9e9a4e9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:07.613650 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a34c2289-a972-44eb-a3c5-1c54d9e9a4e9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:07.614402 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a34c2289-a972-44eb-a3c5-1c54d9e9a4e9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:07.694683 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-262ab349-713b-49d2-aba5-90f10f1aa5be tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:07.709598 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-262ab349-713b-49d2-aba5-90f10f1aa5be tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1508 microversion: 2.1 time: 0.918422 Aug 04 16:48:07.710533 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1299/2620] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:06 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1508 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:07.720081 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-64b21587-fc01-4204-ae9c-d53f06ea6906 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:07.721904 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-64b21587-fc01-4204-ae9c-d53f06ea6906 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 12264581-815d-463d-be11-2dd941746cd3] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:07.740417 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-64b21587-fc01-4204-ae9c-d53f06ea6906 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:07.744178 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-64b21587-fc01-4204-ae9c-d53f06ea6906 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:07.745370 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-64b21587-fc01-4204-ae9c-d53f06ea6906 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:07.751424 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-64b21587-fc01-4204-ae9c-d53f06ea6906 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:07.830884 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-64b21587-fc01-4204-ae9c-d53f06ea6906 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 12264581-815d-463d-be11-2dd941746cd3] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:48:08.042610 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-64b21587-fc01-4204-ae9c-d53f06ea6906 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "DELETE /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3" status: 204 len: 0 microversion: 2.1 time: 0.330106 Aug 04 16:48:08.043696 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1300/2621] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:48:07 2022] DELETE /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:48:08.056194 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-1075641c-8131-4e8b-892e-a745dcc68d9c req-a9f65c65-6c42-4e8b-8664-5fd684af2281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd0b16dd-d4dd-45d3-891a-646b89dce6fa", "name": "network-vif-deleted", "tag": "eb953bbe-dc6f-4f67-bede-dcadc3e53253"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:48:08.071340 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-1075641c-8131-4e8b-892e-a745dcc68d9c req-a9f65c65-6c42-4e8b-8664-5fd684af2281 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:08.071998 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-1075641c-8131-4e8b-892e-a745dcc68d9c req-a9f65c65-6c42-4e8b-8664-5fd684af2281 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:08.087797 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-1075641c-8131-4e8b-892e-a745dcc68d9c req-a9f65c65-6c42-4e8b-8664-5fd684af2281 service nova] Creating event network-vif-deleted:eb953bbe-dc6f-4f67-bede-dcadc3e53253 for instance fd0b16dd-d4dd-45d3-891a-646b89dce6fa on n-h1-846466-12 Aug 04 16:48:08.093831 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-1075641c-8131-4e8b-892e-a745dcc68d9c req-a9f65c65-6c42-4e8b-8664-5fd684af2281 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044696 Aug 04 16:48:08.094893 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1301/2622] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:48:08.100429 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-750aa58b-b3a6-4cf4-ac7c-43d42f68f09c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:08.101149 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-750aa58b-b3a6-4cf4-ac7c-43d42f68f09c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:08.108539 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-750aa58b-b3a6-4cf4-ac7c-43d42f68f09c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:08.109083 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-750aa58b-b3a6-4cf4-ac7c-43d42f68f09c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:08.109818 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-750aa58b-b3a6-4cf4-ac7c-43d42f68f09c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:08.110439 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-750aa58b-b3a6-4cf4-ac7c-43d42f68f09c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:08.127952 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a34c2289-a972-44eb-a3c5-1c54d9e9a4e9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:08.144621 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a34c2289-a972-44eb-a3c5-1c54d9e9a4e9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9" status: 200 len: 1307 microversion: 2.1 time: 0.564586 Aug 04 16:48:08.145758 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1322/2623] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:07 2022] GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9 => generated 1307 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:08.150585 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fb626f91-76f2-481f-a97c-655c80a16282 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:08.151460 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fb626f91-76f2-481f-a97c-655c80a16282 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 12264581-815d-463d-be11-2dd941746cd3] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:08.159370 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fb626f91-76f2-481f-a97c-655c80a16282 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:08.160087 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fb626f91-76f2-481f-a97c-655c80a16282 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:08.161105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fb626f91-76f2-481f-a97c-655c80a16282 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:08.161762 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fb626f91-76f2-481f-a97c-655c80a16282 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:08.460017 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-750aa58b-b3a6-4cf4-ac7c-43d42f68f09c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:08.469515 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-750aa58b-b3a6-4cf4-ac7c-43d42f68f09c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.373311 Aug 04 16:48:08.470351 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1302/2624] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:08 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:08.539777 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fb626f91-76f2-481f-a97c-655c80a16282 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:08.588920 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fb626f91-76f2-481f-a97c-655c80a16282 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3" status: 200 len: 1472 microversion: 2.1 time: 0.441257 Aug 04 16:48:08.617713 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8179093e-481c-4779-bdd9-62f07c6378cd tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:08.617944 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1323/2625] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:08 2022] GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3 => generated 1472 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:08.621948 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8179093e-481c-4779-bdd9-62f07c6378cd tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] [instance: a1d675a4-bcdd-4551-ba93-11f334a56e95] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:08.660686 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8179093e-481c-4779-bdd9-62f07c6378cd tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:08.661545 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8179093e-481c-4779-bdd9-62f07c6378cd tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:08.663013 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8179093e-481c-4779-bdd9-62f07c6378cd tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:08.664485 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8179093e-481c-4779-bdd9-62f07c6378cd tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:08.752178 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-825465e3-71cc-46bc-8eb6-5ee09f028c5c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:08.753513 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-825465e3-71cc-46bc-8eb6-5ee09f028c5c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:08.761095 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-825465e3-71cc-46bc-8eb6-5ee09f028c5c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:08.761989 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-825465e3-71cc-46bc-8eb6-5ee09f028c5c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:08.763086 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-825465e3-71cc-46bc-8eb6-5ee09f028c5c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:08.763767 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-825465e3-71cc-46bc-8eb6-5ee09f028c5c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:08.864307 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8179093e-481c-4779-bdd9-62f07c6378cd tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:08.879122 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8179093e-481c-4779-bdd9-62f07c6378cd tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:08.887609 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8179093e-481c-4779-bdd9-62f07c6378cd tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:08.889332 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8179093e-481c-4779-bdd9-62f07c6378cd tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] 10.222.0.23 "GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95" status: 200 len: 1336 microversion: 2.54 time: 0.282552 Aug 04 16:48:08.889951 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1303/2626] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:48:08 2022] GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95 => generated 1336 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:48:09.050047 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-825465e3-71cc-46bc-8eb6-5ee09f028c5c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:09.064770 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-825465e3-71cc-46bc-8eb6-5ee09f028c5c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1508 microversion: 2.1 time: 0.318354 Aug 04 16:48:09.068114 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1324/2627] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:08 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1508 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:09.170852 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-63e89903-6bf6-4b63-a76e-e7785e91816b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:09.171659 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-63e89903-6bf6-4b63-a76e-e7785e91816b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: d23a6aaf-abc4-43f9-b229-7b52436529c9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:09.184675 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63e89903-6bf6-4b63-a76e-e7785e91816b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:09.185239 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63e89903-6bf6-4b63-a76e-e7785e91816b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:09.192860 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63e89903-6bf6-4b63-a76e-e7785e91816b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:09.193496 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63e89903-6bf6-4b63-a76e-e7785e91816b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:09.397874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-63e89903-6bf6-4b63-a76e-e7785e91816b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:09.409499 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-63e89903-6bf6-4b63-a76e-e7785e91816b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9" status: 200 len: 1307 microversion: 2.1 time: 0.242533 Aug 04 16:48:09.411131 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1304/2628] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:09 2022] GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9 => generated 1307 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:09.638094 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ad65a3ed-0bfd-43f8-b619-61a7c90f7ccf tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:09.638946 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ad65a3ed-0bfd-43f8-b619-61a7c90f7ccf tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 12264581-815d-463d-be11-2dd941746cd3] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:09.647847 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad65a3ed-0bfd-43f8-b619-61a7c90f7ccf tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:09.648418 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad65a3ed-0bfd-43f8-b619-61a7c90f7ccf tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:09.649374 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad65a3ed-0bfd-43f8-b619-61a7c90f7ccf tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:09.651115 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad65a3ed-0bfd-43f8-b619-61a7c90f7ccf tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:09.872996 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ad65a3ed-0bfd-43f8-b619-61a7c90f7ccf tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:09.893606 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ad65a3ed-0bfd-43f8-b619-61a7c90f7ccf tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3" status: 200 len: 1472 microversion: 2.1 time: 0.261420 Aug 04 16:48:09.895372 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1325/2629] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:09 2022] GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3 => generated 1472 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:48:09.918633 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ad516922-2c9a-4010-b7f1-66770d77d1c5 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:09.920617 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ad516922-2c9a-4010-b7f1-66770d77d1c5 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] [instance: a1d675a4-bcdd-4551-ba93-11f334a56e95] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:09.953593 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad516922-2c9a-4010-b7f1-66770d77d1c5 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:09.955081 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad516922-2c9a-4010-b7f1-66770d77d1c5 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:09.956158 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad516922-2c9a-4010-b7f1-66770d77d1c5 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:09.956893 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad516922-2c9a-4010-b7f1-66770d77d1c5 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:10.104371 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b24f3de8-42de-4e72-94f4-20aead1b556b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:10.107710 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b24f3de8-42de-4e72-94f4-20aead1b556b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:10.144339 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b24f3de8-42de-4e72-94f4-20aead1b556b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:10.146614 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b24f3de8-42de-4e72-94f4-20aead1b556b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:10.148081 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b24f3de8-42de-4e72-94f4-20aead1b556b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:10.148769 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b24f3de8-42de-4e72-94f4-20aead1b556b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:10.233031 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ad516922-2c9a-4010-b7f1-66770d77d1c5 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:10.259590 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ad516922-2c9a-4010-b7f1-66770d77d1c5 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:10.272885 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ad516922-2c9a-4010-b7f1-66770d77d1c5 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:10.280253 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ad516922-2c9a-4010-b7f1-66770d77d1c5 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] 10.222.0.23 "GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95" status: 200 len: 1336 microversion: 2.54 time: 0.366817 Aug 04 16:48:10.312542 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1305/2630] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:48:09 2022] GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95 => generated 1336 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:48:10.453837 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ff858447-4b91-4d6f-91a5-467a6d1b805b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:10.458215 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ff858447-4b91-4d6f-91a5-467a6d1b805b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: d23a6aaf-abc4-43f9-b229-7b52436529c9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:10.475169 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ff858447-4b91-4d6f-91a5-467a6d1b805b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:10.475615 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ff858447-4b91-4d6f-91a5-467a6d1b805b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:10.476409 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ff858447-4b91-4d6f-91a5-467a6d1b805b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:10.476845 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ff858447-4b91-4d6f-91a5-467a6d1b805b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:10.721781 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b24f3de8-42de-4e72-94f4-20aead1b556b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:10.732063 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b24f3de8-42de-4e72-94f4-20aead1b556b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1508 microversion: 2.1 time: 0.644292 Aug 04 16:48:10.754499 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1326/2631] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:10 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1508 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:10.787199 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ff858447-4b91-4d6f-91a5-467a6d1b805b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:10.796902 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ff858447-4b91-4d6f-91a5-467a6d1b805b tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9" status: 200 len: 1307 microversion: 2.1 time: 0.350171 Aug 04 16:48:10.798634 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1306/2632] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:10 2022] GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9 => generated 1307 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:10.918567 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e58bd3ae-49ea-49dd-a408-a1f60a4c8d79 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:10.919351 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e58bd3ae-49ea-49dd-a408-a1f60a4c8d79 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 12264581-815d-463d-be11-2dd941746cd3] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:10.932937 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e58bd3ae-49ea-49dd-a408-a1f60a4c8d79 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:10.933601 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e58bd3ae-49ea-49dd-a408-a1f60a4c8d79 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:10.941717 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e58bd3ae-49ea-49dd-a408-a1f60a4c8d79 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:10.942668 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e58bd3ae-49ea-49dd-a408-a1f60a4c8d79 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:11.329711 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0bccbfd1-5a11-43e5-ab86-a0e0679f8cce tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:11.337485 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0bccbfd1-5a11-43e5-ab86-a0e0679f8cce tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] [instance: a1d675a4-bcdd-4551-ba93-11f334a56e95] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:11.380715 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0bccbfd1-5a11-43e5-ab86-a0e0679f8cce tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:11.381601 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0bccbfd1-5a11-43e5-ab86-a0e0679f8cce tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:11.383088 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0bccbfd1-5a11-43e5-ab86-a0e0679f8cce tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:11.389251 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0bccbfd1-5a11-43e5-ab86-a0e0679f8cce tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:11.513977 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e58bd3ae-49ea-49dd-a408-a1f60a4c8d79 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:11.541130 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e58bd3ae-49ea-49dd-a408-a1f60a4c8d79 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3" status: 200 len: 1472 microversion: 2.1 time: 0.624887 Aug 04 16:48:11.576598 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1327/2633] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:10 2022] GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3 => generated 1472 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:11.667834 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0bccbfd1-5a11-43e5-ab86-a0e0679f8cce tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:11.687941 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0bccbfd1-5a11-43e5-ab86-a0e0679f8cce tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:11.691690 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0bccbfd1-5a11-43e5-ab86-a0e0679f8cce tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:11.707693 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0bccbfd1-5a11-43e5-ab86-a0e0679f8cce tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] 10.222.0.23 "GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95" status: 200 len: 1336 microversion: 2.54 time: 0.372577 Aug 04 16:48:11.711377 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1307/2634] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:48:11 2022] GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95 => generated 1336 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:48:11.777902 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2b0ac688-a26c-4a60-846d-5f6ec60e508b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:11.780014 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2b0ac688-a26c-4a60-846d-5f6ec60e508b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:11.809714 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2b0ac688-a26c-4a60-846d-5f6ec60e508b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:11.811272 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2b0ac688-a26c-4a60-846d-5f6ec60e508b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:11.816844 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2b0ac688-a26c-4a60-846d-5f6ec60e508b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:11.823194 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2b0ac688-a26c-4a60-846d-5f6ec60e508b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:11.842962 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-379e1c35-b4a5-417a-a557-49b93cca77b4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:11.845093 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-379e1c35-b4a5-417a-a557-49b93cca77b4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: d23a6aaf-abc4-43f9-b229-7b52436529c9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:11.875194 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-379e1c35-b4a5-417a-a557-49b93cca77b4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:11.881490 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-379e1c35-b4a5-417a-a557-49b93cca77b4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:11.885142 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-379e1c35-b4a5-417a-a557-49b93cca77b4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:11.887396 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-379e1c35-b4a5-417a-a557-49b93cca77b4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:12.714435 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-379e1c35-b4a5-417a-a557-49b93cca77b4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:12.718903 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:48:12.730680 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-379e1c35-b4a5-417a-a557-49b93cca77b4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9" status: 200 len: 1307 microversion: 2.1 time: 0.895680 Aug 04 16:48:12.748146 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1308/2635] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:11 2022] GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9 => generated 1307 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:12.762099 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-d7c7c320-9a45-47c6-bf5d-02cd4bcbd4fc req-46f73ee5-fbab-4929-8673-27f286af8ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d23a6aaf-abc4-43f9-b229-7b52436529c9", "name": "network-vif-plugged", "status": "completed", "tag": "b3dfb2dd-dc19-4306-9f4c-7d3e13704fcf"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:48:12.795186 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-d7c7c320-9a45-47c6-bf5d-02cd4bcbd4fc req-46f73ee5-fbab-4929-8673-27f286af8ba1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:12.798766 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-d7c7c320-9a45-47c6-bf5d-02cd4bcbd4fc req-46f73ee5-fbab-4929-8673-27f286af8ba1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:12.830461 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-d7c7c320-9a45-47c6-bf5d-02cd4bcbd4fc req-46f73ee5-fbab-4929-8673-27f286af8ba1 service nova] Creating event network-vif-plugged:b3dfb2dd-dc19-4306-9f4c-7d3e13704fcf for instance d23a6aaf-abc4-43f9-b229-7b52436529c9 on n-h2-846466-12 Aug 04 16:48:12.847636 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-d7c7c320-9a45-47c6-bf5d-02cd4bcbd4fc req-46f73ee5-fbab-4929-8673-27f286af8ba1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095131 Aug 04 16:48:12.849345 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1309/2636] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:48:12.867364 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6abe512c-6613-4887-8176-b38101726e67 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:12.868577 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6abe512c-6613-4887-8176-b38101726e67 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: befbf568-78f2-4571-bf63-fdac57291b28] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:12.875955 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2b0ac688-a26c-4a60-846d-5f6ec60e508b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:12.891061 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6abe512c-6613-4887-8176-b38101726e67 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:12.891475 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6abe512c-6613-4887-8176-b38101726e67 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:12.893347 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6abe512c-6613-4887-8176-b38101726e67 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:12.896306 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6abe512c-6613-4887-8176-b38101726e67 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:12.896520 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2b0ac688-a26c-4a60-846d-5f6ec60e508b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1508 microversion: 2.1 time: 1.124121 Aug 04 16:48:12.899883 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1328/2637] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:11 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1508 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:12.940938 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bb31a105-0b16-4243-81bb-8f9d502e449c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:12.951331 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bb31a105-0b16-4243-81bb-8f9d502e449c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 12264581-815d-463d-be11-2dd941746cd3] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:12.979567 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bb31a105-0b16-4243-81bb-8f9d502e449c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:12.988453 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6abe512c-6613-4887-8176-b38101726e67 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: befbf568-78f2-4571-bf63-fdac57291b28] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:48:12.991090 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bb31a105-0b16-4243-81bb-8f9d502e449c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:12.992239 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bb31a105-0b16-4243-81bb-8f9d502e449c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:12.995644 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bb31a105-0b16-4243-81bb-8f9d502e449c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:13.008391 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:48:13.143262 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bb31a105-0b16-4243-81bb-8f9d502e449c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:13.146036 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bb31a105-0b16-4243-81bb-8f9d502e449c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:13.151334 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-bb31a105-0b16-4243-81bb-8f9d502e449c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lazy-loading 'fault' on Instance uuid 12264581-815d-463d-be11-2dd941746cd3 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:48:13.209636 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:48:13.239251 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6abe512c-6613-4887-8176-b38101726e67 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "DELETE /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28" status: 204 len: 0 microversion: 2.1 time: 0.387764 Aug 04 16:48:13.240623 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1310/2638] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:48:12 2022] DELETE /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:48:13.248784 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-bfdf55b5-f375-4808-9e28-df667252331b req-a9b28c9e-e9bc-443c-a939-6b4d00fde57d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12264581-815d-463d-be11-2dd941746cd3", "name": "network-vif-deleted", "tag": "e5c4411d-8d86-4d05-b8f9-3734ee665e16"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:48:13.263426 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-bfdf55b5-f375-4808-9e28-df667252331b req-a9b28c9e-e9bc-443c-a939-6b4d00fde57d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:13.264883 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-bfdf55b5-f375-4808-9e28-df667252331b req-a9b28c9e-e9bc-443c-a939-6b4d00fde57d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:13.293498 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-bfdf55b5-f375-4808-9e28-df667252331b req-a9b28c9e-e9bc-443c-a939-6b4d00fde57d service nova] Creating event network-vif-deleted:e5c4411d-8d86-4d05-b8f9-3734ee665e16 for instance 12264581-815d-463d-be11-2dd941746cd3 on n-h1-846466-12 Aug 04 16:48:13.302861 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-bfdf55b5-f375-4808-9e28-df667252331b req-a9b28c9e-e9bc-443c-a939-6b4d00fde57d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060110 Aug 04 16:48:13.304213 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1311/2639] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:48:13.316387 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7601f27b-e01d-4c08-83e6-956e61cd310b tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:13.319979 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7601f27b-e01d-4c08-83e6-956e61cd310b tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] [instance: a1d675a4-bcdd-4551-ba93-11f334a56e95] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:13.341096 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7601f27b-e01d-4c08-83e6-956e61cd310b tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:13.342470 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7601f27b-e01d-4c08-83e6-956e61cd310b tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:13.345161 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7601f27b-e01d-4c08-83e6-956e61cd310b tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:13.347270 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7601f27b-e01d-4c08-83e6-956e61cd310b tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:13.437362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bb31a105-0b16-4243-81bb-8f9d502e449c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:13.453113 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bb31a105-0b16-4243-81bb-8f9d502e449c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3" status: 200 len: 1307 microversion: 2.1 time: 0.548741 Aug 04 16:48:13.454506 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1329/2640] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:12 2022] GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3 => generated 1307 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:13.472111 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f68d7dc4-4efc-4086-b8b3-13e47cc7b74f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:13.475162 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f68d7dc4-4efc-4086-b8b3-13e47cc7b74f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: befbf568-78f2-4571-bf63-fdac57291b28] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:13.494122 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f68d7dc4-4efc-4086-b8b3-13e47cc7b74f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:13.500289 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f68d7dc4-4efc-4086-b8b3-13e47cc7b74f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:13.504023 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f68d7dc4-4efc-4086-b8b3-13e47cc7b74f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:13.508472 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f68d7dc4-4efc-4086-b8b3-13e47cc7b74f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:14.014421 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7601f27b-e01d-4c08-83e6-956e61cd310b tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:14.031744 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7601f27b-e01d-4c08-83e6-956e61cd310b tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:14.033717 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7601f27b-e01d-4c08-83e6-956e61cd310b tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:14.035116 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7601f27b-e01d-4c08-83e6-956e61cd310b tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] 10.222.0.23 "GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95" status: 200 len: 1357 microversion: 2.54 time: 0.729397 Aug 04 16:48:14.040786 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1312/2641] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:48:13 2022] GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95 => generated 1357 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:48:14.046565 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f0b82b00-c20b-400e-a14d-85d6648ac9b5 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:14.053485 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f0b82b00-c20b-400e-a14d-85d6648ac9b5 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: d23a6aaf-abc4-43f9-b229-7b52436529c9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:14.068320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f0b82b00-c20b-400e-a14d-85d6648ac9b5 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:14.072560 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f0b82b00-c20b-400e-a14d-85d6648ac9b5 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:14.073683 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f0b82b00-c20b-400e-a14d-85d6648ac9b5 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:14.077647 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f0b82b00-c20b-400e-a14d-85d6648ac9b5 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:14.336297 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f68d7dc4-4efc-4086-b8b3-13e47cc7b74f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97a079594a2400bb4db33f3ce3a1497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4cdb4245df44119c504915dc542d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:14.349886 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f68d7dc4-4efc-4086-b8b3-13e47cc7b74f tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28" status: 200 len: 1683 microversion: 2.1 time: 0.893842 Aug 04 16:48:14.365746 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1330/2642] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:13 2022] GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28 => generated 1683 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:14.371493 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bed2c387-b990-41f6-912b-81c29cb98dfc tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:14.372407 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bed2c387-b990-41f6-912b-81c29cb98dfc tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:14.380997 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bed2c387-b990-41f6-912b-81c29cb98dfc tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:14.381744 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bed2c387-b990-41f6-912b-81c29cb98dfc tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:14.382697 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bed2c387-b990-41f6-912b-81c29cb98dfc tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:14.383329 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bed2c387-b990-41f6-912b-81c29cb98dfc tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:14.398702 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f0b82b00-c20b-400e-a14d-85d6648ac9b5 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:14.411998 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f0b82b00-c20b-400e-a14d-85d6648ac9b5 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9" status: 200 len: 1307 microversion: 2.1 time: 0.369667 Aug 04 16:48:14.429754 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1313/2643] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:14 2022] GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9 => generated 1307 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:14.438281 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-83f5b06e-bca8-463f-9a7d-a9654e25a379 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Action: 'create', calling method: .version_select at 0x7f7e77f38940>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-2006283829", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWNbQBseIfTCdURvyYlFXsRbXAjkxEWf8L9+6L4bgSPbUuxO66qau9OZZvKQ99OfkLupIJ/00z62mUhBRXYYrFTJbyetFTuGl8cfp16wz37Ti5d5p9Z4c/RpXk3ZNfnfA=="}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:48:14.459681 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-83f5b06e-bca8-463f-9a7d-a9654e25a379 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Getting quotas for project d3dcf49d342f431fa9040484372115be. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:48:14.469689 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-83f5b06e-bca8-463f-9a7d-a9654e25a379 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Getting quotas for user ca08e18f16dd4ded81abc6fe0d2ae0ac and project d3dcf49d342f431fa9040484372115be. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:48:14.508585 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-83f5b06e-bca8-463f-9a7d-a9654e25a379 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.076662 Aug 04 16:48:14.510208 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1314/2644] 10.222.0.23 () {62 vars in 1200 bytes} [Thu Aug 4 16:48:14 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 79 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 16:48:14.518732 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4ec80309-915e-4b7f-b635-0abdaf8f494a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:14.520421 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4ec80309-915e-4b7f-b635-0abdaf8f494a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 12264581-815d-463d-be11-2dd941746cd3] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:14.529138 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4ec80309-915e-4b7f-b635-0abdaf8f494a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:14.531753 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4ec80309-915e-4b7f-b635-0abdaf8f494a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:14.539905 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4ec80309-915e-4b7f-b635-0abdaf8f494a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:14.541267 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4ec80309-915e-4b7f-b635-0abdaf8f494a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:14.627853 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4ec80309-915e-4b7f-b635-0abdaf8f494a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:14.632400 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4ec80309-915e-4b7f-b635-0abdaf8f494a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:14.633709 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-4ec80309-915e-4b7f-b635-0abdaf8f494a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lazy-loading 'fault' on Instance uuid 12264581-815d-463d-be11-2dd941746cd3 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:48:14.677894 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bed2c387-b990-41f6-912b-81c29cb98dfc tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:14.696969 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bed2c387-b990-41f6-912b-81c29cb98dfc tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1508 microversion: 2.1 time: 0.329282 Aug 04 16:48:14.699366 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1331/2645] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:14 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1508 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:14.710235 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5cc2f5e2-081d-4b3b-bc2a-d79ecf5735dc tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-2006283829", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:48:14.716690 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5cc2f5e2-081d-4b3b-bc2a-d79ecf5735dc tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] [instance: a1d675a4-bcdd-4551-ba93-11f334a56e95] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:14.731652 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5cc2f5e2-081d-4b3b-bc2a-d79ecf5735dc tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:14.732864 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5cc2f5e2-081d-4b3b-bc2a-d79ecf5735dc tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:14.734596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5cc2f5e2-081d-4b3b-bc2a-d79ecf5735dc tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:14.735596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5cc2f5e2-081d-4b3b-bc2a-d79ecf5735dc tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:14.803646 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4ec80309-915e-4b7f-b635-0abdaf8f494a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:14.824288 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4ec80309-915e-4b7f-b635-0abdaf8f494a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3" status: 200 len: 1307 microversion: 2.1 time: 0.310396 Aug 04 16:48:14.828485 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1315/2646] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:14 2022] GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3 => generated 1307 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:15.039963 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-5cc2f5e2-081d-4b3b-bc2a-d79ecf5735dc tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:48:15.041105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-5cc2f5e2-081d-4b3b-bc2a-d79ecf5735dc tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:48:15.042616 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-5cc2f5e2-081d-4b3b-bc2a-d79ecf5735dc tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:48:15.043654 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-5cc2f5e2-081d-4b3b-bc2a-d79ecf5735dc tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:48:15.044858 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-5cc2f5e2-081d-4b3b-bc2a-d79ecf5735dc tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:48:15.310105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5cc2f5e2-081d-4b3b-bc2a-d79ecf5735dc tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] [instance: a1d675a4-bcdd-4551-ba93-11f334a56e95] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:15.351926 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5cc2f5e2-081d-4b3b-bc2a-d79ecf5735dc tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:15.357711 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5cc2f5e2-081d-4b3b-bc2a-d79ecf5735dc tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:15.362038 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5cc2f5e2-081d-4b3b-bc2a-d79ecf5735dc tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:15.362960 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5cc2f5e2-081d-4b3b-bc2a-d79ecf5735dc tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:15.378535 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cadfb557-b424-4587-a537-63747d1fe5de tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:15.380075 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cadfb557-b424-4587-a537-63747d1fe5de tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: befbf568-78f2-4571-bf63-fdac57291b28] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:15.397227 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:48:15.429254 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cadfb557-b424-4587-a537-63747d1fe5de tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:15.438058 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cadfb557-b424-4587-a537-63747d1fe5de tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:15.443815 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cadfb557-b424-4587-a537-63747d1fe5de tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:15.444790 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cadfb557-b424-4587-a537-63747d1fe5de tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:15.463870 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5cc2f5e2-081d-4b3b-bc2a-d79ecf5735dc tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] 10.222.0.23 "POST /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95/action" status: 202 len: 1140 microversion: 2.54 time: 0.762687 Aug 04 16:48:15.465675 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1332/2647] 10.222.0.23 () {62 vars in 1320 bytes} [Thu Aug 4 16:48:14 2022] POST /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95/action => generated 1140 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 04 16:48:15.477627 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d75fb421-eefb-4934-8d4a-6b6b15190162 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:15.478711 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d75fb421-eefb-4934-8d4a-6b6b15190162 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: d23a6aaf-abc4-43f9-b229-7b52436529c9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:15.488734 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d75fb421-eefb-4934-8d4a-6b6b15190162 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:15.490308 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d75fb421-eefb-4934-8d4a-6b6b15190162 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:15.493121 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d75fb421-eefb-4934-8d4a-6b6b15190162 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:15.494206 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d75fb421-eefb-4934-8d4a-6b6b15190162 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:15.914199 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d75fb421-eefb-4934-8d4a-6b6b15190162 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:15.924800 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:48:15.929083 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d75fb421-eefb-4934-8d4a-6b6b15190162 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9" status: 200 len: 1488 microversion: 2.1 time: 0.461020 Aug 04 16:48:15.946062 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1333/2648] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:15 2022] GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9 => generated 1488 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:15.952186 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7da08d83-6105-47c9-be49-da07bb0edbb7 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:15.953977 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7da08d83-6105-47c9-be49-da07bb0edbb7 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] [instance: a1d675a4-bcdd-4551-ba93-11f334a56e95] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:15.954486 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cadfb557-b424-4587-a537-63747d1fe5de tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97a079594a2400bb4db33f3ce3a1497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4cdb4245df44119c504915dc542d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:15.960816 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7da08d83-6105-47c9-be49-da07bb0edbb7 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:15.961539 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7da08d83-6105-47c9-be49-da07bb0edbb7 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:15.962526 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7da08d83-6105-47c9-be49-da07bb0edbb7 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:15.963192 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7da08d83-6105-47c9-be49-da07bb0edbb7 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:15.978927 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cadfb557-b424-4587-a537-63747d1fe5de tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28" status: 200 len: 1683 microversion: 2.1 time: 0.599210 Aug 04 16:48:15.979664 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1316/2649] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:15 2022] GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28 => generated 1683 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:48:15.985211 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e5053ea3-2d78-4140-be25-2d61bd53bf47 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:15.997729 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e5053ea3-2d78-4140-be25-2d61bd53bf47 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:16.028956 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5053ea3-2d78-4140-be25-2d61bd53bf47 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:16.030373 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5053ea3-2d78-4140-be25-2d61bd53bf47 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:16.033318 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5053ea3-2d78-4140-be25-2d61bd53bf47 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:16.034227 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5053ea3-2d78-4140-be25-2d61bd53bf47 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:16.205233 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7da08d83-6105-47c9-be49-da07bb0edbb7 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:16.219279 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7da08d83-6105-47c9-be49-da07bb0edbb7 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:16.226060 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7da08d83-6105-47c9-be49-da07bb0edbb7 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:16.228793 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7da08d83-6105-47c9-be49-da07bb0edbb7 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] 10.222.0.23 "GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95" status: 200 len: 1409 microversion: 2.54 time: 0.281137 Aug 04 16:48:16.231118 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1334/2650] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:48:15 2022] GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95 => generated 1409 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:48:16.239293 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dbc06555-2fa6-4f24-a877-5c5904fc2fa4 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:16.240405 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dbc06555-2fa6-4f24-a877-5c5904fc2fa4 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 12264581-815d-463d-be11-2dd941746cd3] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:16.258481 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dbc06555-2fa6-4f24-a877-5c5904fc2fa4 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:16.259195 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dbc06555-2fa6-4f24-a877-5c5904fc2fa4 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:16.260294 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dbc06555-2fa6-4f24-a877-5c5904fc2fa4 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:16.260935 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dbc06555-2fa6-4f24-a877-5c5904fc2fa4 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:16.287805 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-dbc06555-2fa6-4f24-a877-5c5904fc2fa4 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] HTTP exception thrown: Instance 12264581-815d-463d-be11-2dd941746cd3 could not be found. Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dbc06555-2fa6-4f24-a877-5c5904fc2fa4 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Request method failure captured: Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3 HTTP/1.1 Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_d0PWjKRFBWfxAhJyM9Llb5b9qIi5YfrBNXPAsDzIFh8zYJUWCF3RzIK4AGkYlNQVK5Am3F8P2Rbt4hrCuiVYFRb2bix8zHglKpYs5ivud-NO1ZEo-kW7N3_XgRhYscv5AJxIc_PiyQmdBCcRjkSDOpLzajPb1FiA8gOmTp1smuuJo Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: b9e709c95a964cd5855d4e253aeb1043 Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersOnMultiNodesTest-576816232 Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9e709c95a964cd5855d4e253aeb1043"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b9e709c95a964cd5855d4e253aeb1043"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9e709c95a964cd5855d4e253aeb1043"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b9e709c95a964cd5855d4e253aeb1043"}]}] Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersOnMultiNodesTest-576816232 Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: b9e709c95a964cd5855d4e253aeb1043 Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-576816232 Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersOnMultiNodesTest-576816232-project Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 336c26b5dd6644bc83f9b80adac06bce Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersOnMultiNodesTest-576816232-project Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 12264581-815d-463d-be11-2dd941746cd3 could not be found. Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '12264581-815d-463d-be11-2dd941746cd3'} Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12264581-815d-463d-be11-2dd941746cd3 could not be found. Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12264581-815d-463d-be11-2dd941746cd3 could not be found. Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:16.290110 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:16.294106 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:16.294106 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:16.294106 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:16.294106 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:48:16.294106 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:48:16.294106 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12264581-815d-463d-be11-2dd941746cd3 could not be found. Aug 04 16:48:16.294106 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:16.296540 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dbc06555-2fa6-4f24-a877-5c5904fc2fa4 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Returning 404 to user: Instance 12264581-815d-463d-be11-2dd941746cd3 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:48:16.298173 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dbc06555-2fa6-4f24-a877-5c5904fc2fa4 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3" status: 404 len: 111 microversion: 2.1 time: 0.065246 Aug 04 16:48:16.299416 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1335/2651] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:16 2022] GET /compute/v2.1/servers/12264581-815d-463d-be11-2dd941746cd3 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:48:16.307248 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6da01f92-a8f8-43ee-962d-6f1e45569f5a tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-149899867"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:48:16.309814 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6da01f92-a8f8-43ee-962d-6f1e45569f5a tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: d23a6aaf-abc4-43f9-b229-7b52436529c9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:16.317178 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=98 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:48:16.320021 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6da01f92-a8f8-43ee-962d-6f1e45569f5a tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:16.320603 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6da01f92-a8f8-43ee-962d-6f1e45569f5a tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:16.321600 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6da01f92-a8f8-43ee-962d-6f1e45569f5a tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:16.322035 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6da01f92-a8f8-43ee-962d-6f1e45569f5a tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:16.447274 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e5053ea3-2d78-4140-be25-2d61bd53bf47 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:16.463017 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e5053ea3-2d78-4140-be25-2d61bd53bf47 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1508 microversion: 2.1 time: 0.480306 Aug 04 16:48:16.467475 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1317/2652] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:15 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1508 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:16.474041 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e8abc542-0036-4244-9271-fa0f9d57745c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:16.474908 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e8abc542-0036-4244-9271-fa0f9d57745c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 36ad8e81-987e-4c31-986e-005b5b65e40a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:16.502704 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e8abc542-0036-4244-9271-fa0f9d57745c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:16.503166 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e8abc542-0036-4244-9271-fa0f9d57745c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:16.506679 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e8abc542-0036-4244-9271-fa0f9d57745c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:16.507428 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e8abc542-0036-4244-9271-fa0f9d57745c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:16.620267 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e8abc542-0036-4244-9271-fa0f9d57745c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 36ad8e81-987e-4c31-986e-005b5b65e40a] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:48:16.780820 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6da01f92-a8f8-43ee-962d-6f1e45569f5a tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "POST /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9/action" status: 202 len: 0 microversion: 2.1 time: 0.479148 Aug 04 16:48:16.788232 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1336/2653] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:48:16 2022] POST /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9/action => generated 0 bytes in 488 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 16:48:16.803537 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e8abc542-0036-4244-9271-fa0f9d57745c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "DELETE /compute/v2.1/servers/36ad8e81-987e-4c31-986e-005b5b65e40a" status: 204 len: 0 microversion: 2.1 time: 0.334075 Aug 04 16:48:16.804561 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1318/2654] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:48:16 2022] DELETE /compute/v2.1/servers/36ad8e81-987e-4c31-986e-005b5b65e40a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:48:16.818378 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9d6a2f4f-50dc-4603-8e24-226dc54f20fb tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e77bff5e0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:16.856866 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-948ea97b-65fc-4af7-8f2a-d7561ff9356f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:16.860607 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-948ea97b-65fc-4af7-8f2a-d7561ff9356f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 36ad8e81-987e-4c31-986e-005b5b65e40a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:16.894024 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-948ea97b-65fc-4af7-8f2a-d7561ff9356f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:16.894348 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-948ea97b-65fc-4af7-8f2a-d7561ff9356f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:16.901186 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-948ea97b-65fc-4af7-8f2a-d7561ff9356f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:16.904074 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-948ea97b-65fc-4af7-8f2a-d7561ff9356f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:16.970175 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9d6a2f4f-50dc-4603-8e24-226dc54f20fb tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/f1385f5d-91ba-4e76-92e5-04da5bddb64d" status: 200 len: 1409 microversion: 2.1 time: 0.170606 Aug 04 16:48:16.988349 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1337/2655] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:48:16 2022] GET /compute/v2.1/images/f1385f5d-91ba-4e76-92e5-04da5bddb64d => generated 1409 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:17.006528 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-eabfad23-8db8-4cb9-8211-8982f9ff32c4 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:17.007855 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-eabfad23-8db8-4cb9-8211-8982f9ff32c4 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: befbf568-78f2-4571-bf63-fdac57291b28] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:17.021836 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eabfad23-8db8-4cb9-8211-8982f9ff32c4 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:17.022263 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eabfad23-8db8-4cb9-8211-8982f9ff32c4 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:17.023051 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eabfad23-8db8-4cb9-8211-8982f9ff32c4 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:17.023480 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eabfad23-8db8-4cb9-8211-8982f9ff32c4 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:17.195651 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-eabfad23-8db8-4cb9-8211-8982f9ff32c4 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97a079594a2400bb4db33f3ce3a1497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4cdb4245df44119c504915dc542d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:17.228827 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-eabfad23-8db8-4cb9-8211-8982f9ff32c4 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28" status: 200 len: 1615 microversion: 2.1 time: 0.227206 Aug 04 16:48:17.241312 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1338/2656] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:17 2022] GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28 => generated 1615 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:48:17.249735 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e4a73e9a-c531-481f-af2c-9e3b81dbb1e0 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e841baaf0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:17.336505 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e4a73e9a-c531-481f-af2c-9e3b81dbb1e0 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/f1385f5d-91ba-4e76-92e5-04da5bddb64d" status: 200 len: 1409 microversion: 2.1 time: 0.105565 Aug 04 16:48:17.337339 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1339/2657] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:48:17 2022] GET /compute/v2.1/images/f1385f5d-91ba-4e76-92e5-04da5bddb64d => generated 1409 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:17.347690 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6fc39ce0-edbf-474a-84d0-46375d2cd4fa tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:17.348362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6fc39ce0-edbf-474a-84d0-46375d2cd4fa tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] [instance: a1d675a4-bcdd-4551-ba93-11f334a56e95] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:17.382455 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6fc39ce0-edbf-474a-84d0-46375d2cd4fa tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:17.386301 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6fc39ce0-edbf-474a-84d0-46375d2cd4fa tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:17.387820 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6fc39ce0-edbf-474a-84d0-46375d2cd4fa tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:17.391624 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6fc39ce0-edbf-474a-84d0-46375d2cd4fa tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:17.597184 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-948ea97b-65fc-4af7-8f2a-d7561ff9356f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:17.612163 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-948ea97b-65fc-4af7-8f2a-d7561ff9356f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/36ad8e81-987e-4c31-986e-005b5b65e40a" status: 200 len: 1472 microversion: 2.1 time: 0.782702 Aug 04 16:48:17.622762 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1319/2658] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:16 2022] GET /compute/v2.1/servers/36ad8e81-987e-4c31-986e-005b5b65e40a => generated 1472 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:17.635392 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-227eefdf-c955-40f7-9bea-82e3a46c98d8 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e841df5e0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:17.744908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6fc39ce0-edbf-474a-84d0-46375d2cd4fa tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:17.768276 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6fc39ce0-edbf-474a-84d0-46375d2cd4fa tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:17.773837 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6fc39ce0-edbf-474a-84d0-46375d2cd4fa tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:17.779006 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6fc39ce0-edbf-474a-84d0-46375d2cd4fa tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] 10.222.0.23 "GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95" status: 200 len: 1409 microversion: 2.54 time: 0.440461 Aug 04 16:48:17.789424 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1340/2659] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:48:17 2022] GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95 => generated 1409 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:48:17.789424 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4527c6cc-de63-402c-a0c7-737d7428797b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:17.790522 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4527c6cc-de63-402c-a0c7-737d7428797b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:17.804946 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4527c6cc-de63-402c-a0c7-737d7428797b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:17.805465 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4527c6cc-de63-402c-a0c7-737d7428797b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:17.806347 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4527c6cc-de63-402c-a0c7-737d7428797b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:17.806780 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4527c6cc-de63-402c-a0c7-737d7428797b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:18.040344 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-227eefdf-c955-40f7-9bea-82e3a46c98d8 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "DELETE /compute/v2.1/images/f1385f5d-91ba-4e76-92e5-04da5bddb64d" status: 204 len: 0 microversion: 2.1 time: 0.414847 Aug 04 16:48:18.042266 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1320/2660] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:17 2022] DELETE /compute/v2.1/images/f1385f5d-91ba-4e76-92e5-04da5bddb64d => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:48:18.049221 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-a22c3246-b9d8-4721-95cf-c1ecdcc6c288 req-2334fa1f-bb3d-4049-82bc-1f17d89e4378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "befbf568-78f2-4571-bf63-fdac57291b28", "name": "network-vif-deleted", "tag": "4d207d96-918f-45a6-92bf-48edb7564806"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:48:18.081981 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a22c3246-b9d8-4721-95cf-c1ecdcc6c288 req-2334fa1f-bb3d-4049-82bc-1f17d89e4378 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:18.083328 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a22c3246-b9d8-4721-95cf-c1ecdcc6c288 req-2334fa1f-bb3d-4049-82bc-1f17d89e4378 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:18.106188 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-a22c3246-b9d8-4721-95cf-c1ecdcc6c288 req-2334fa1f-bb3d-4049-82bc-1f17d89e4378 service nova] Creating event network-vif-deleted:4d207d96-918f-45a6-92bf-48edb7564806 for instance befbf568-78f2-4571-bf63-fdac57291b28 on n-h1-846466-12 Aug 04 16:48:18.115298 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-a22c3246-b9d8-4721-95cf-c1ecdcc6c288 req-2334fa1f-bb3d-4049-82bc-1f17d89e4378 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071107 Aug 04 16:48:18.116356 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1321/2661] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:48:18.121523 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4527c6cc-de63-402c-a0c7-737d7428797b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:18.123028 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ffccba24-8b68-40f4-92db-978afbf14164 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e89c79550>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:18.131778 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4527c6cc-de63-402c-a0c7-737d7428797b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1508 microversion: 2.1 time: 0.349411 Aug 04 16:48:18.137679 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1341/2662] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:17 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1508 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:18.157918 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-ffccba24-8b68-40f4-92db-978afbf14164 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] HTTP exception thrown: Image not found. Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ffccba24-8b68-40f4-92db-978afbf14164 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Request method failure captured: Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/images/f1385f5d-91ba-4e76-92e5-04da5bddb64d HTTP/1.1 Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_dOO7UsedsqygwWY3wqONL1C3XvUWyyQWteVTjxlk6_e14fRbH5QIwl0MR0jswL1bTsNdU7_ySVOUPWQHhAcgE2xj2ZhEWaRp5MluuPG9CHtvcP8oJmpaA_VSNcZwQ79WG__AL2jsD0U87Ln8DKcsaJvyJZuiedH0AejNlOCY8lVbk Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: afa49d3246ea4361abb452e16e017faf Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ImagesTestJSON-86748708 Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/afa49d3246ea4361abb452e16e017faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_afa49d3246ea4361abb452e16e017faf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/afa49d3246ea4361abb452e16e017faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/afa49d3246ea4361abb452e16e017faf"}]}] Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ImagesTestJSON-86748708 Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: afa49d3246ea4361abb452e16e017faf Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ImagesTestJSON-86748708 Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ImagesTestJSON-86748708-project Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: a85f0bd88d79409e9610a47f3ae943ce Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ImagesTestJSON-86748708-project Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: exception: Image not found. Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'f1385f5d-91ba-4e76-92e5-04da5bddb64d'} Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f1385f5d-91ba-4e76-92e5-04da5bddb64d Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 16:48:18.210320 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f1385f5d-91ba-4e76-92e5-04da5bddb64d could not be found. Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ffccba24-8b68-40f4-92db-978afbf14164 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Returning 404 to user: Image not found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ffccba24-8b68-40f4-92db-978afbf14164 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/images/f1385f5d-91ba-4e76-92e5-04da5bddb64d" status: 404 len: 62 microversion: 2.1 time: 0.094170 Aug 04 16:48:18.218017 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1322/2663] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:48:18 2022] GET /compute/v2.1/images/f1385f5d-91ba-4e76-92e5-04da5bddb64d => generated 62 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:48:18.230871 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-60c8785c-00fc-4f46-b332-f7c780157694 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:18.231655 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-60c8785c-00fc-4f46-b332-f7c780157694 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: d23a6aaf-abc4-43f9-b229-7b52436529c9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:18.252561 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-978e0549-08ad-436e-8185-0486887bfbf9 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:18.253664 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-978e0549-08ad-436e-8185-0486887bfbf9 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: befbf568-78f2-4571-bf63-fdac57291b28] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:18.262220 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-60c8785c-00fc-4f46-b332-f7c780157694 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:18.262946 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-60c8785c-00fc-4f46-b332-f7c780157694 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:18.264202 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-60c8785c-00fc-4f46-b332-f7c780157694 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:18.265770 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-60c8785c-00fc-4f46-b332-f7c780157694 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:18.278610 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-978e0549-08ad-436e-8185-0486887bfbf9 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:18.290135 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-978e0549-08ad-436e-8185-0486887bfbf9 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:18.291377 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-978e0549-08ad-436e-8185-0486887bfbf9 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:18.292050 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-978e0549-08ad-436e-8185-0486887bfbf9 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:18.355146 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-978e0549-08ad-436e-8185-0486887bfbf9 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:18.356003 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-978e0549-08ad-436e-8185-0486887bfbf9 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:18.356715 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-978e0549-08ad-436e-8185-0486887bfbf9 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lazy-loading 'fault' on Instance uuid befbf568-78f2-4571-bf63-fdac57291b28 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:48:18.559848 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-978e0549-08ad-436e-8185-0486887bfbf9 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97a079594a2400bb4db33f3ce3a1497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4cdb4245df44119c504915dc542d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:18.589488 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-978e0549-08ad-436e-8185-0486887bfbf9 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28" status: 200 len: 1331 microversion: 2.1 time: 0.341161 Aug 04 16:48:18.590521 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1323/2664] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:18 2022] GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28 => generated 1331 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:48:18.649824 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5ca1ee5a-968a-4ed6-8ec1-57032d1fd0ec tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:18.650901 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5ca1ee5a-968a-4ed6-8ec1-57032d1fd0ec tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 36ad8e81-987e-4c31-986e-005b5b65e40a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:18.680863 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ca1ee5a-968a-4ed6-8ec1-57032d1fd0ec tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:18.684074 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ca1ee5a-968a-4ed6-8ec1-57032d1fd0ec tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:18.685784 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ca1ee5a-968a-4ed6-8ec1-57032d1fd0ec tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:18.687387 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ca1ee5a-968a-4ed6-8ec1-57032d1fd0ec tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:18.950509 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-60c8785c-00fc-4f46-b332-f7c780157694 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:18.985327 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-60c8785c-00fc-4f46-b332-f7c780157694 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9" status: 200 len: 1500 microversion: 2.1 time: 0.762717 Aug 04 16:48:18.996820 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1342/2665] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:18 2022] GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9 => generated 1500 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:19.018622 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0d0cd29b-a1a2-4b2d-8ad4-794ea867c31d tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:19.020311 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0d0cd29b-a1a2-4b2d-8ad4-794ea867c31d tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] [instance: a1d675a4-bcdd-4551-ba93-11f334a56e95] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:19.080539 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0d0cd29b-a1a2-4b2d-8ad4-794ea867c31d tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:19.082538 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0d0cd29b-a1a2-4b2d-8ad4-794ea867c31d tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:19.085652 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0d0cd29b-a1a2-4b2d-8ad4-794ea867c31d tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:19.086586 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0d0cd29b-a1a2-4b2d-8ad4-794ea867c31d tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:19.483381 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5ca1ee5a-968a-4ed6-8ec1-57032d1fd0ec tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:19.500891 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5ca1ee5a-968a-4ed6-8ec1-57032d1fd0ec tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/36ad8e81-987e-4c31-986e-005b5b65e40a" status: 200 len: 1472 microversion: 2.1 time: 0.853257 Aug 04 16:48:19.501679 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1324/2666] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:18 2022] GET /compute/v2.1/servers/36ad8e81-987e-4c31-986e-005b5b65e40a => generated 1472 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:19.504339 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0d0cd29b-a1a2-4b2d-8ad4-794ea867c31d tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:19.514160 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-23712cce-a463-4aa5-bf35-8ea7a30fa908 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:19.525537 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-23712cce-a463-4aa5-bf35-8ea7a30fa908 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:19.541421 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0d0cd29b-a1a2-4b2d-8ad4-794ea867c31d tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:19.543099 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-23712cce-a463-4aa5-bf35-8ea7a30fa908 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:19.546159 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-23712cce-a463-4aa5-bf35-8ea7a30fa908 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:19.550289 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-23712cce-a463-4aa5-bf35-8ea7a30fa908 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:19.550526 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0d0cd29b-a1a2-4b2d-8ad4-794ea867c31d tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:19.552150 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-23712cce-a463-4aa5-bf35-8ea7a30fa908 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:19.556984 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0d0cd29b-a1a2-4b2d-8ad4-794ea867c31d tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] 10.222.0.23 "GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95" status: 200 len: 1409 microversion: 2.54 time: 0.555527 Aug 04 16:48:19.562766 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1343/2667] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:48:18 2022] GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95 => generated 1409 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:48:19.622657 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-64e55198-d2f2-405d-964f-c02546e128a8 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:19.626609 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-64e55198-d2f2-405d-964f-c02546e128a8 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] [instance: befbf568-78f2-4571-bf63-fdac57291b28] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:19.659114 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-64e55198-d2f2-405d-964f-c02546e128a8 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:19.659905 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-64e55198-d2f2-405d-964f-c02546e128a8 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:19.661413 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-64e55198-d2f2-405d-964f-c02546e128a8 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:19.662114 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-64e55198-d2f2-405d-964f-c02546e128a8 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:19.718892 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-64e55198-d2f2-405d-964f-c02546e128a8 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] HTTP exception thrown: Instance befbf568-78f2-4571-bf63-fdac57291b28 could not be found. Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-64e55198-d2f2-405d-964f-c02546e128a8 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Request method failure captured: Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28 HTTP/1.1 Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_ecQdFr8t1mHp27RfNp-2bYbjto-1M7KgUsFDQ1x-flBZ5ok1An18DBV18yiaGCBKm9cmgfb8ncoVedeZaMlW4MyZodc893C_XoivAPSAI_SvRh5apXW1b5olqPB6D-zr4d1pgme6gm0zNgpS1yfSi7CbvjCSkDOqwIkFHWBbr3L6o Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 1f4cdb4245df44119c504915dc542d9b Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-VolumesAdminNegativeTest-510576780 Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1f4cdb4245df44119c504915dc542d9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1f4cdb4245df44119c504915dc542d9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1f4cdb4245df44119c504915dc542d9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1f4cdb4245df44119c504915dc542d9b"}]}] Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-VolumesAdminNegativeTest-510576780 Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 1f4cdb4245df44119c504915dc542d9b Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-510576780 Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-VolumesAdminNegativeTest-510576780-project Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: c97a079594a2400bb4db33f3ce3a1497 Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-VolumesAdminNegativeTest-510576780-project Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance befbf568-78f2-4571-bf63-fdac57291b28 could not be found. Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'befbf568-78f2-4571-bf63-fdac57291b28'} Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance befbf568-78f2-4571-bf63-fdac57291b28 could not be found. Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance befbf568-78f2-4571-bf63-fdac57291b28 could not be found. Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:19.722078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:19.732581 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:19.732581 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:19.732581 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:19.732581 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:48:19.732581 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:48:19.732581 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance befbf568-78f2-4571-bf63-fdac57291b28 could not be found. Aug 04 16:48:19.732581 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:19.746783 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-64e55198-d2f2-405d-964f-c02546e128a8 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Returning 404 to user: Instance befbf568-78f2-4571-bf63-fdac57291b28 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:48:19.748960 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-64e55198-d2f2-405d-964f-c02546e128a8 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28" status: 404 len: 111 microversion: 2.1 time: 0.134354 Aug 04 16:48:19.750390 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1344/2668] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:19 2022] GET /compute/v2.1/servers/befbf568-78f2-4571-bf63-fdac57291b28 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:48:19.772341 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-825951b4-f2e9-443e-b028-2bb0c3895799 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] Calling method '.version_select at 0x7f7e89d88af0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:19.837131 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-825951b4-f2e9-443e-b028-2bb0c3895799 tempest-VolumesAdminNegativeTest-510576780 tempest-VolumesAdminNegativeTest-510576780-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-386779736" status: 202 len: 0 microversion: 2.1 time: 0.074940 Aug 04 16:48:19.849638 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1345/2669] 10.222.0.23 () {58 vars in 1218 bytes} [Thu Aug 4 16:48:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-386779736 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 16:48:20.027178 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-57d72c1b-95dc-4dbc-97a8-a54419c2d5bb tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:20.028606 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-57d72c1b-95dc-4dbc-97a8-a54419c2d5bb tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: d23a6aaf-abc4-43f9-b229-7b52436529c9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:20.046419 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-57d72c1b-95dc-4dbc-97a8-a54419c2d5bb tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:20.046868 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-57d72c1b-95dc-4dbc-97a8-a54419c2d5bb tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:20.047670 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-57d72c1b-95dc-4dbc-97a8-a54419c2d5bb tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:20.048223 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-57d72c1b-95dc-4dbc-97a8-a54419c2d5bb tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:20.054554 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:48:20.100837 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-23712cce-a463-4aa5-bf35-8ea7a30fa908 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:20.109957 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-23712cce-a463-4aa5-bf35-8ea7a30fa908 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1508 microversion: 2.1 time: 0.607150 Aug 04 16:48:20.117542 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1325/2670] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:19 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1508 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:20.456650 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-57d72c1b-95dc-4dbc-97a8-a54419c2d5bb tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:20.469415 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-57d72c1b-95dc-4dbc-97a8-a54419c2d5bb tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9" status: 200 len: 1506 microversion: 2.1 time: 0.443278 Aug 04 16:48:20.472220 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1346/2671] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:20 2022] GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9 => generated 1506 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:48:20.535397 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-674f7218-b007-42ea-8774-3c0e57678f70 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:20.536320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-674f7218-b007-42ea-8774-3c0e57678f70 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 36ad8e81-987e-4c31-986e-005b5b65e40a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:20.564409 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-674f7218-b007-42ea-8774-3c0e57678f70 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:20.565849 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-674f7218-b007-42ea-8774-3c0e57678f70 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:20.571212 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-674f7218-b007-42ea-8774-3c0e57678f70 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:20.572215 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-674f7218-b007-42ea-8774-3c0e57678f70 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:20.611108 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f1903d97-3d5a-4308-b292-091bd9bcfc30 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:20.614680 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f1903d97-3d5a-4308-b292-091bd9bcfc30 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] [instance: a1d675a4-bcdd-4551-ba93-11f334a56e95] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:20.643573 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f1903d97-3d5a-4308-b292-091bd9bcfc30 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:20.644141 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f1903d97-3d5a-4308-b292-091bd9bcfc30 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:20.646831 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f1903d97-3d5a-4308-b292-091bd9bcfc30 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:20.647272 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f1903d97-3d5a-4308-b292-091bd9bcfc30 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:20.695082 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:48:20.857050 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f1903d97-3d5a-4308-b292-091bd9bcfc30 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:20.874120 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f1903d97-3d5a-4308-b292-091bd9bcfc30 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:20.875769 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f1903d97-3d5a-4308-b292-091bd9bcfc30 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:20.877152 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f1903d97-3d5a-4308-b292-091bd9bcfc30 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] 10.222.0.23 "GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95" status: 200 len: 1409 microversion: 2.54 time: 0.272686 Aug 04 16:48:20.885962 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1347/2672] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:48:20 2022] GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95 => generated 1409 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:48:21.156613 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-45069108-8408-4d48-a4f8-c7417c4bad12 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:21.157801 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-45069108-8408-4d48-a4f8-c7417c4bad12 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:21.169772 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-45069108-8408-4d48-a4f8-c7417c4bad12 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:21.171213 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-45069108-8408-4d48-a4f8-c7417c4bad12 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:21.172375 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-45069108-8408-4d48-a4f8-c7417c4bad12 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:21.174188 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-45069108-8408-4d48-a4f8-c7417c4bad12 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:21.786692 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-674f7218-b007-42ea-8774-3c0e57678f70 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:21.850297 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-674f7218-b007-42ea-8774-3c0e57678f70 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/36ad8e81-987e-4c31-986e-005b5b65e40a" status: 200 len: 1472 microversion: 2.1 time: 1.316365 Aug 04 16:48:21.854011 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1326/2673] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:20 2022] GET /compute/v2.1/servers/36ad8e81-987e-4c31-986e-005b5b65e40a => generated 1472 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:48:21.878091 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-8e9ce7c4-389f-4f5d-84f3-d5e85f6cf9a4 req-28200acb-a8a0-47d2-86b3-dfcb43612c6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36ad8e81-987e-4c31-986e-005b5b65e40a", "name": "network-vif-deleted", "tag": "9949cc20-028a-4378-acd4-328f948f117b"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:48:21.943144 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-8e9ce7c4-389f-4f5d-84f3-d5e85f6cf9a4 req-28200acb-a8a0-47d2-86b3-dfcb43612c6c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:21.947148 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-8e9ce7c4-389f-4f5d-84f3-d5e85f6cf9a4 req-28200acb-a8a0-47d2-86b3-dfcb43612c6c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:21.990257 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-8e9ce7c4-389f-4f5d-84f3-d5e85f6cf9a4 req-28200acb-a8a0-47d2-86b3-dfcb43612c6c service nova] Creating event network-vif-deleted:9949cc20-028a-4378-acd4-328f948f117b for instance 36ad8e81-987e-4c31-986e-005b5b65e40a on n-h2-846466-12 Aug 04 16:48:22.031192 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-8e9ce7c4-389f-4f5d-84f3-d5e85f6cf9a4 req-28200acb-a8a0-47d2-86b3-dfcb43612c6c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173197 Aug 04 16:48:22.032749 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1327/2674] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:48:22.042162 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b2af7ceb-e07f-4108-ac18-6f7f95725590 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:22.043468 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b2af7ceb-e07f-4108-ac18-6f7f95725590 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: d23a6aaf-abc4-43f9-b229-7b52436529c9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:22.054501 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b2af7ceb-e07f-4108-ac18-6f7f95725590 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:22.055325 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b2af7ceb-e07f-4108-ac18-6f7f95725590 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:22.057417 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b2af7ceb-e07f-4108-ac18-6f7f95725590 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:22.061506 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b2af7ceb-e07f-4108-ac18-6f7f95725590 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:23.131006 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-45069108-8408-4d48-a4f8-c7417c4bad12 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:23.148093 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-45069108-8408-4d48-a4f8-c7417c4bad12 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1508 microversion: 2.1 time: 1.998142 Aug 04 16:48:23.163729 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1348/2675] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:21 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1508 bytes in 2014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:23.169307 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d5f43974-9b87-4b53-9f2a-91bcb10bcb4c tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:23.171474 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d5f43974-9b87-4b53-9f2a-91bcb10bcb4c tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] [instance: a1d675a4-bcdd-4551-ba93-11f334a56e95] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:23.180930 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d5f43974-9b87-4b53-9f2a-91bcb10bcb4c tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:23.181873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d5f43974-9b87-4b53-9f2a-91bcb10bcb4c tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:23.182964 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d5f43974-9b87-4b53-9f2a-91bcb10bcb4c tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:23.183681 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d5f43974-9b87-4b53-9f2a-91bcb10bcb4c tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:23.424110 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d5f43974-9b87-4b53-9f2a-91bcb10bcb4c tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:23.433275 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d5f43974-9b87-4b53-9f2a-91bcb10bcb4c tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:23.434983 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d5f43974-9b87-4b53-9f2a-91bcb10bcb4c tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:23.436420 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d5f43974-9b87-4b53-9f2a-91bcb10bcb4c tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] 10.222.0.23 "GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95" status: 200 len: 1409 microversion: 2.54 time: 0.271335 Aug 04 16:48:23.437019 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1349/2676] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:48:23 2022] GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95 => generated 1409 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:48:23.460251 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d6d7951a-e015-4397-afd3-c7ceccf13856 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:23.474848 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d6d7951a-e015-4397-afd3-c7ceccf13856 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 36ad8e81-987e-4c31-986e-005b5b65e40a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:23.493554 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d6d7951a-e015-4397-afd3-c7ceccf13856 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:23.494145 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d6d7951a-e015-4397-afd3-c7ceccf13856 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:23.495031 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d6d7951a-e015-4397-afd3-c7ceccf13856 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:23.502828 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d6d7951a-e015-4397-afd3-c7ceccf13856 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:23.531463 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-d6d7951a-e015-4397-afd3-c7ceccf13856 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] HTTP exception thrown: Instance 36ad8e81-987e-4c31-986e-005b5b65e40a could not be found. Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d6d7951a-e015-4397-afd3-c7ceccf13856 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Request method failure captured: Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/36ad8e81-987e-4c31-986e-005b5b65e40a HTTP/1.1 Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_d0PWjKRFBWfxAhJyM9Llb5b9qIi5YfrBNXPAsDzIFh8zYJUWCF3RzIK4AGkYlNQVK5Am3F8P2Rbt4hrCuiVYFRb2bix8zHglKpYs5ivud-NO1ZEo-kW7N3_XgRhYscv5AJxIc_PiyQmdBCcRjkSDOpLzajPb1FiA8gOmTp1smuuJo Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: b9e709c95a964cd5855d4e253aeb1043 Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersOnMultiNodesTest-576816232 Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9e709c95a964cd5855d4e253aeb1043"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b9e709c95a964cd5855d4e253aeb1043"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9e709c95a964cd5855d4e253aeb1043"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b9e709c95a964cd5855d4e253aeb1043"}]}] Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersOnMultiNodesTest-576816232 Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: b9e709c95a964cd5855d4e253aeb1043 Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-576816232 Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersOnMultiNodesTest-576816232-project Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 336c26b5dd6644bc83f9b80adac06bce Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersOnMultiNodesTest-576816232-project Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 36ad8e81-987e-4c31-986e-005b5b65e40a could not be found. Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '36ad8e81-987e-4c31-986e-005b5b65e40a'} Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36ad8e81-987e-4c31-986e-005b5b65e40a could not be found. Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36ad8e81-987e-4c31-986e-005b5b65e40a could not be found. Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:23.533079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:23.544690 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:23.544690 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:23.544690 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:23.544690 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:48:23.544690 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:48:23.544690 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36ad8e81-987e-4c31-986e-005b5b65e40a could not be found. Aug 04 16:48:23.544690 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:23.544690 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d6d7951a-e015-4397-afd3-c7ceccf13856 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Returning 404 to user: Instance 36ad8e81-987e-4c31-986e-005b5b65e40a could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:48:23.544690 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d6d7951a-e015-4397-afd3-c7ceccf13856 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/36ad8e81-987e-4c31-986e-005b5b65e40a" status: 404 len: 111 microversion: 2.1 time: 0.078389 Aug 04 16:48:23.544690 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1350/2677] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:23 2022] GET /compute/v2.1/servers/36ad8e81-987e-4c31-986e-005b5b65e40a => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:48:23.552008 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9ee3832c-8247-44fc-ac2b-ec567ed45962 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:23.560278 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9ee3832c-8247-44fc-ac2b-ec567ed45962 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 2290ea80-011c-47ab-b4a9-620f1a8f5631] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:23.573881 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9ee3832c-8247-44fc-ac2b-ec567ed45962 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:23.574446 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9ee3832c-8247-44fc-ac2b-ec567ed45962 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:23.575410 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9ee3832c-8247-44fc-ac2b-ec567ed45962 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:23.575898 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9ee3832c-8247-44fc-ac2b-ec567ed45962 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:23.634430 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9ee3832c-8247-44fc-ac2b-ec567ed45962 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 2290ea80-011c-47ab-b4a9-620f1a8f5631] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:48:23.844263 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9ee3832c-8247-44fc-ac2b-ec567ed45962 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2290ea80-011c-47ab-b4a9-620f1a8f5631" status: 204 len: 0 microversion: 2.1 time: 0.302629 Aug 04 16:48:23.848262 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1351/2678] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:48:23 2022] DELETE /compute/v2.1/servers/2290ea80-011c-47ab-b4a9-620f1a8f5631 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:48:23.858604 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-34deefe6-87e3-4351-a94f-9342e4a110ed tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:23.859358 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-34deefe6-87e3-4351-a94f-9342e4a110ed tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 2290ea80-011c-47ab-b4a9-620f1a8f5631] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:23.868311 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b2af7ceb-e07f-4108-ac18-6f7f95725590 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:23.877031 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-34deefe6-87e3-4351-a94f-9342e4a110ed tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:23.877527 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-34deefe6-87e3-4351-a94f-9342e4a110ed tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:23.878320 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-34deefe6-87e3-4351-a94f-9342e4a110ed tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:23.878752 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-34deefe6-87e3-4351-a94f-9342e4a110ed tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:23.879903 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b2af7ceb-e07f-4108-ac18-6f7f95725590 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9" status: 200 len: 1488 microversion: 2.1 time: 1.845238 Aug 04 16:48:23.902795 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1328/2679] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:22 2022] GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9 => generated 1488 bytes in 1869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:23.908992 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-db7110fd-562f-4ab5-94bf-88e47ace3df4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:23.914165 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-db7110fd-562f-4ab5-94bf-88e47ace3df4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: d23a6aaf-abc4-43f9-b229-7b52436529c9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:23.931089 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db7110fd-562f-4ab5-94bf-88e47ace3df4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:23.931771 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db7110fd-562f-4ab5-94bf-88e47ace3df4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:23.932716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db7110fd-562f-4ab5-94bf-88e47ace3df4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:23.938035 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db7110fd-562f-4ab5-94bf-88e47ace3df4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:24.001521 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-db7110fd-562f-4ab5-94bf-88e47ace3df4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: d23a6aaf-abc4-43f9-b229-7b52436529c9] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:48:24.188251 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-db7110fd-562f-4ab5-94bf-88e47ace3df4 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9" status: 204 len: 0 microversion: 2.1 time: 0.283729 Aug 04 16:48:24.188851 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1329/2680] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:48:23 2022] DELETE /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:48:24.198171 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-01dfc8e2-89b5-4ab5-87c3-3e62fdb728c3 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:24.205750 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-01dfc8e2-89b5-4ab5-87c3-3e62fdb728c3 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:24.216727 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-01dfc8e2-89b5-4ab5-87c3-3e62fdb728c3 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:24.226151 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-01dfc8e2-89b5-4ab5-87c3-3e62fdb728c3 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:24.227326 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-01dfc8e2-89b5-4ab5-87c3-3e62fdb728c3 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:24.227935 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-01dfc8e2-89b5-4ab5-87c3-3e62fdb728c3 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:24.481687 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=10 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:48:24.917738 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-01dfc8e2-89b5-4ab5-87c3-3e62fdb728c3 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:24.934730 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-01dfc8e2-89b5-4ab5-87c3-3e62fdb728c3 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1508 microversion: 2.1 time: 0.741241 Aug 04 16:48:24.935357 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1330/2681] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:24 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1508 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:24.956010 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-02558e47-23d4-4423-8f5c-5dd5c9741e8e tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e77e8c430>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:25.002177 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-02558e47-23d4-4423-8f5c-5dd5c9741e8e tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] HTTP exception thrown: Image not found. Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-02558e47-23d4-4423-8f5c-5dd5c9741e8e tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Request method failure captured: Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/images/f1385f5d-91ba-4e76-92e5-04da5bddb64d HTTP/1.1 Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_dOO7UsedsqygwWY3wqONL1C3XvUWyyQWteVTjxlk6_e14fRbH5QIwl0MR0jswL1bTsNdU7_ySVOUPWQHhAcgE2xj2ZhEWaRp5MluuPG9CHtvcP8oJmpaA_VSNcZwQ79WG__AL2jsD0U87Ln8DKcsaJvyJZuiedH0AejNlOCY8lVbk Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: afa49d3246ea4361abb452e16e017faf Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ImagesTestJSON-86748708 Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/afa49d3246ea4361abb452e16e017faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_afa49d3246ea4361abb452e16e017faf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/afa49d3246ea4361abb452e16e017faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/afa49d3246ea4361abb452e16e017faf"}]}] Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ImagesTestJSON-86748708 Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: afa49d3246ea4361abb452e16e017faf Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ImagesTestJSON-86748708 Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ImagesTestJSON-86748708-project Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: a85f0bd88d79409e9610a47f3ae943ce Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ImagesTestJSON-86748708-project Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: exception: Image not found. Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'f1385f5d-91ba-4e76-92e5-04da5bddb64d'} Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f1385f5d-91ba-4e76-92e5-04da5bddb64d to delete Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f1385f5d-91ba-4e76-92e5-04da5bddb64d could not be found. Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:25.004075 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:25.008715 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:25.008715 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:25.008715 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:48:25.008715 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:48:25.008715 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:48:25.008715 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:48:25.008715 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:48:25.008715 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:48:25.008715 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 16:48:25.008715 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 16:48:25.008715 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 16:48:25.008715 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:25.008715 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:25.008715 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:25.008715 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:25.008715 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:25.008715 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:25.008715 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:48:25.008715 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:48:25.008715 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 16:48:25.008715 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:25.013704 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-02558e47-23d4-4423-8f5c-5dd5c9741e8e tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Returning 404 to user: Image not found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:48:25.014920 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-02558e47-23d4-4423-8f5c-5dd5c9741e8e tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "DELETE /compute/v2.1/images/f1385f5d-91ba-4e76-92e5-04da5bddb64d" status: 404 len: 62 microversion: 2.1 time: 0.074227 Aug 04 16:48:25.016422 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1331/2682] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:24 2022] DELETE /compute/v2.1/images/f1385f5d-91ba-4e76-92e5-04da5bddb64d => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:48:25.021804 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4ee95ba2-3cbf-4027-aed4-26a35e8f4cbc tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:25.022877 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4ee95ba2-3cbf-4027-aed4-26a35e8f4cbc tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] [instance: a1d675a4-bcdd-4551-ba93-11f334a56e95] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:25.032605 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4ee95ba2-3cbf-4027-aed4-26a35e8f4cbc tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:25.033168 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-34deefe6-87e3-4351-a94f-9342e4a110ed tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:25.034166 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4ee95ba2-3cbf-4027-aed4-26a35e8f4cbc tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:25.035927 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4ee95ba2-3cbf-4027-aed4-26a35e8f4cbc tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:25.036647 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4ee95ba2-3cbf-4027-aed4-26a35e8f4cbc tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:25.061851 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-34deefe6-87e3-4351-a94f-9342e4a110ed tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/2290ea80-011c-47ab-b4a9-620f1a8f5631" status: 200 len: 1472 microversion: 2.1 time: 1.210524 Aug 04 16:48:25.073401 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1352/2683] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:23 2022] GET /compute/v2.1/servers/2290ea80-011c-47ab-b4a9-620f1a8f5631 => generated 1472 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:25.073401 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7ec140a9-5c35-48e0-9772-f4bfc89f6de5 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:25.073401 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7ec140a9-5c35-48e0-9772-f4bfc89f6de5 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: d23a6aaf-abc4-43f9-b229-7b52436529c9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:25.083424 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ec140a9-5c35-48e0-9772-f4bfc89f6de5 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:25.083424 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ec140a9-5c35-48e0-9772-f4bfc89f6de5 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:25.084547 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ec140a9-5c35-48e0-9772-f4bfc89f6de5 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:25.085009 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ec140a9-5c35-48e0-9772-f4bfc89f6de5 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:25.128712 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7ec140a9-5c35-48e0-9772-f4bfc89f6de5 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: d23a6aaf-abc4-43f9-b229-7b52436529c9] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:48:25.165729 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4ee95ba2-3cbf-4027-aed4-26a35e8f4cbc tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:25.181110 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4ee95ba2-3cbf-4027-aed4-26a35e8f4cbc tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:25.185688 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4ee95ba2-3cbf-4027-aed4-26a35e8f4cbc tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:25.190278 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4ee95ba2-3cbf-4027-aed4-26a35e8f4cbc tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] 10.222.0.23 "GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95" status: 200 len: 1409 microversion: 2.54 time: 0.172239 Aug 04 16:48:25.195894 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1332/2684] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:48:25 2022] GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95 => generated 1409 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:48:25.238905 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.compute.api [None req-7ec140a9-5c35-48e0-9772-f4bfc89f6de5 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: d23a6aaf-abc4-43f9-b229-7b52436529c9] Instance is already in deleting state, ignoring this request Aug 04 16:48:25.240526 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7ec140a9-5c35-48e0-9772-f4bfc89f6de5 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9" status: 204 len: 0 microversion: 2.1 time: 0.175752 Aug 04 16:48:25.249104 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1353/2685] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:48:25 2022] DELETE /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:48:25.260500 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-83c16425-86ab-4d09-84d3-dcca685ed7a3 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:25.261241 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-83c16425-86ab-4d09-84d3-dcca685ed7a3 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: d23a6aaf-abc4-43f9-b229-7b52436529c9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:25.277258 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-83c16425-86ab-4d09-84d3-dcca685ed7a3 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:25.279018 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-83c16425-86ab-4d09-84d3-dcca685ed7a3 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:25.281093 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-83c16425-86ab-4d09-84d3-dcca685ed7a3 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:25.281894 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-83c16425-86ab-4d09-84d3-dcca685ed7a3 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:25.847688 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-83c16425-86ab-4d09-84d3-dcca685ed7a3 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:25.888065 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-83c16425-86ab-4d09-84d3-dcca685ed7a3 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9" status: 200 len: 1494 microversion: 2.1 time: 0.633701 Aug 04 16:48:25.890578 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1333/2686] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:25 2022] GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9 => generated 1494 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:25.984511 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4060170c-4668-402d-9ad4-ef5eeed9e908 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:25.985150 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4060170c-4668-402d-9ad4-ef5eeed9e908 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:25.994026 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4060170c-4668-402d-9ad4-ef5eeed9e908 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:25.994802 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4060170c-4668-402d-9ad4-ef5eeed9e908 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:25.995849 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4060170c-4668-402d-9ad4-ef5eeed9e908 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:25.996490 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4060170c-4668-402d-9ad4-ef5eeed9e908 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:26.094510 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b75fec12-17aa-4f3e-9d51-1817c8906a57 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:26.095542 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b75fec12-17aa-4f3e-9d51-1817c8906a57 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 2290ea80-011c-47ab-b4a9-620f1a8f5631] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:26.122997 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b75fec12-17aa-4f3e-9d51-1817c8906a57 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:26.124351 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b75fec12-17aa-4f3e-9d51-1817c8906a57 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:26.125913 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b75fec12-17aa-4f3e-9d51-1817c8906a57 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:26.132115 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b75fec12-17aa-4f3e-9d51-1817c8906a57 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:27.186768 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b75fec12-17aa-4f3e-9d51-1817c8906a57 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:27.198620 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b75fec12-17aa-4f3e-9d51-1817c8906a57 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/2290ea80-011c-47ab-b4a9-620f1a8f5631" status: 200 len: 1472 microversion: 2.1 time: 1.108635 Aug 04 16:48:27.201560 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1334/2687] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:26 2022] GET /compute/v2.1/servers/2290ea80-011c-47ab-b4a9-620f1a8f5631 => generated 1472 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:48:27.210186 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2d37f96b-3651-4bc0-b4e7-2b5f3f6b100d tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:27.211777 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2d37f96b-3651-4bc0-b4e7-2b5f3f6b100d tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] [instance: a1d675a4-bcdd-4551-ba93-11f334a56e95] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:27.224059 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2d37f96b-3651-4bc0-b4e7-2b5f3f6b100d tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:27.225373 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2d37f96b-3651-4bc0-b4e7-2b5f3f6b100d tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:27.227177 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2d37f96b-3651-4bc0-b4e7-2b5f3f6b100d tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:27.228386 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2d37f96b-3651-4bc0-b4e7-2b5f3f6b100d tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:27.536769 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4060170c-4668-402d-9ad4-ef5eeed9e908 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:27.548970 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4060170c-4668-402d-9ad4-ef5eeed9e908 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1508 microversion: 2.1 time: 1.569826 Aug 04 16:48:27.564094 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1354/2688] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:25 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1508 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:27.568271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2774d532-ddb9-4d30-ac64-57c35adb1a08 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:27.569497 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2774d532-ddb9-4d30-ac64-57c35adb1a08 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: d23a6aaf-abc4-43f9-b229-7b52436529c9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:27.594278 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2774d532-ddb9-4d30-ac64-57c35adb1a08 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:27.595011 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2774d532-ddb9-4d30-ac64-57c35adb1a08 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:27.596851 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2774d532-ddb9-4d30-ac64-57c35adb1a08 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:27.597633 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2774d532-ddb9-4d30-ac64-57c35adb1a08 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:27.665600 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2d37f96b-3651-4bc0-b4e7-2b5f3f6b100d tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:27.685574 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2d37f96b-3651-4bc0-b4e7-2b5f3f6b100d tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:27.687801 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2d37f96b-3651-4bc0-b4e7-2b5f3f6b100d tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:27.689042 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2d37f96b-3651-4bc0-b4e7-2b5f3f6b100d tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] 10.222.0.23 "GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95" status: 200 len: 1409 microversion: 2.54 time: 0.485189 Aug 04 16:48:27.689652 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1335/2689] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:48:27 2022] GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95 => generated 1409 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:48:28.220384 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3c27e998-ccdf-4c95-939e-95237069dffe tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:28.221144 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3c27e998-ccdf-4c95-939e-95237069dffe tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 2290ea80-011c-47ab-b4a9-620f1a8f5631] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:28.228687 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3c27e998-ccdf-4c95-939e-95237069dffe tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:28.229447 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3c27e998-ccdf-4c95-939e-95237069dffe tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:28.230536 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3c27e998-ccdf-4c95-939e-95237069dffe tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:28.231186 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3c27e998-ccdf-4c95-939e-95237069dffe tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:28.389837 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3c27e998-ccdf-4c95-939e-95237069dffe tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:28.404046 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3c27e998-ccdf-4c95-939e-95237069dffe tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/2290ea80-011c-47ab-b4a9-620f1a8f5631" status: 200 len: 1430 microversion: 2.1 time: 0.187954 Aug 04 16:48:28.406144 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1336/2690] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:28 2022] GET /compute/v2.1/servers/2290ea80-011c-47ab-b4a9-620f1a8f5631 => generated 1430 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:28.429421 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-c2340806-3f29-46e9-8a07-deb2ec3677c1 req-b07e9ecd-f3ff-4611-8404-5deb17ae7658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2290ea80-011c-47ab-b4a9-620f1a8f5631", "name": "network-vif-deleted", "tag": "6791076a-a32f-4256-8c4d-42629ee687dd"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:48:28.445588 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-c2340806-3f29-46e9-8a07-deb2ec3677c1 req-b07e9ecd-f3ff-4611-8404-5deb17ae7658 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:28.459284 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-c2340806-3f29-46e9-8a07-deb2ec3677c1 req-b07e9ecd-f3ff-4611-8404-5deb17ae7658 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:28.494573 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-c2340806-3f29-46e9-8a07-deb2ec3677c1 req-b07e9ecd-f3ff-4611-8404-5deb17ae7658 service nova] Creating event network-vif-deleted:6791076a-a32f-4256-8c4d-42629ee687dd for instance 2290ea80-011c-47ab-b4a9-620f1a8f5631 on n-h2-846466-12 Aug 04 16:48:28.502649 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-c2340806-3f29-46e9-8a07-deb2ec3677c1 req-b07e9ecd-f3ff-4611-8404-5deb17ae7658 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091033 Aug 04 16:48:28.504137 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1337/2691] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:48:28.578110 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8527d69e-420b-4473-a068-5b8c5a1f1844 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:28.580402 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8527d69e-420b-4473-a068-5b8c5a1f1844 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:28.598943 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8527d69e-420b-4473-a068-5b8c5a1f1844 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:28.602298 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8527d69e-420b-4473-a068-5b8c5a1f1844 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:28.608099 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8527d69e-420b-4473-a068-5b8c5a1f1844 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:28.610473 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8527d69e-420b-4473-a068-5b8c5a1f1844 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:28.866669 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2774d532-ddb9-4d30-ac64-57c35adb1a08 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:28.895745 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2774d532-ddb9-4d30-ac64-57c35adb1a08 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9" status: 200 len: 1494 microversion: 2.1 time: 1.334576 Aug 04 16:48:28.898140 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1355/2692] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:27 2022] GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9 => generated 1494 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:28.930671 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-add28c3e-bfdc-481c-9153-62b37957c0a6 req-4e1619bf-82b2-47bc-9832-642042f8e02a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d23a6aaf-abc4-43f9-b229-7b52436529c9", "name": "network-vif-plugged", "status": "completed", "tag": "b3dfb2dd-dc19-4306-9f4c-7d3e13704fcf"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:48:28.953273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-add28c3e-bfdc-481c-9153-62b37957c0a6 req-4e1619bf-82b2-47bc-9832-642042f8e02a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:28.954910 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-add28c3e-bfdc-481c-9153-62b37957c0a6 req-4e1619bf-82b2-47bc-9832-642042f8e02a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:28.979103 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-add28c3e-bfdc-481c-9153-62b37957c0a6 req-4e1619bf-82b2-47bc-9832-642042f8e02a service nova] Creating event network-vif-plugged:b3dfb2dd-dc19-4306-9f4c-7d3e13704fcf for instance d23a6aaf-abc4-43f9-b229-7b52436529c9 on n-h2-846466-12 Aug 04 16:48:28.994348 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-add28c3e-bfdc-481c-9153-62b37957c0a6 req-4e1619bf-82b2-47bc-9832-642042f8e02a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079764 Aug 04 16:48:28.997243 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1356/2693] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:48:29.011440 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cc055403-cad9-4311-8ff1-acaac4ff4e71 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:29.013927 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cc055403-cad9-4311-8ff1-acaac4ff4e71 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] [instance: a1d675a4-bcdd-4551-ba93-11f334a56e95] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:29.024372 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cc055403-cad9-4311-8ff1-acaac4ff4e71 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:29.030434 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cc055403-cad9-4311-8ff1-acaac4ff4e71 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:29.031418 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cc055403-cad9-4311-8ff1-acaac4ff4e71 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:29.032018 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cc055403-cad9-4311-8ff1-acaac4ff4e71 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:29.340965 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cc055403-cad9-4311-8ff1-acaac4ff4e71 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:29.376554 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cc055403-cad9-4311-8ff1-acaac4ff4e71 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:29.396170 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cc055403-cad9-4311-8ff1-acaac4ff4e71 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:29.403096 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cc055403-cad9-4311-8ff1-acaac4ff4e71 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] 10.222.0.23 "GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95" status: 200 len: 1409 microversion: 2.54 time: 0.403061 Aug 04 16:48:29.404291 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1357/2694] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:48:28 2022] GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95 => generated 1409 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:48:29.454232 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-92567265-5015-4994-896c-089297ac7d5e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:29.456312 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-92567265-5015-4994-896c-089297ac7d5e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 2290ea80-011c-47ab-b4a9-620f1a8f5631] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:29.487318 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-92567265-5015-4994-896c-089297ac7d5e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:29.487839 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-92567265-5015-4994-896c-089297ac7d5e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:29.488560 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-92567265-5015-4994-896c-089297ac7d5e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:29.488987 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-92567265-5015-4994-896c-089297ac7d5e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:29.496652 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8527d69e-420b-4473-a068-5b8c5a1f1844 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:29.507447 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8527d69e-420b-4473-a068-5b8c5a1f1844 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1508 microversion: 2.1 time: 0.938529 Aug 04 16:48:29.513771 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1338/2695] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:28 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1508 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:29.527831 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-92567265-5015-4994-896c-089297ac7d5e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] HTTP exception thrown: Instance 2290ea80-011c-47ab-b4a9-620f1a8f5631 could not be found. Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-92567265-5015-4994-896c-089297ac7d5e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Request method failure captured: Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/2290ea80-011c-47ab-b4a9-620f1a8f5631 HTTP/1.1 Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_d0PWjKRFBWfxAhJyM9Llb5b9qIi5YfrBNXPAsDzIFh8zYJUWCF3RzIK4AGkYlNQVK5Am3F8P2Rbt4hrCuiVYFRb2bix8zHglKpYs5ivud-NO1ZEo-kW7N3_XgRhYscv5AJxIc_PiyQmdBCcRjkSDOpLzajPb1FiA8gOmTp1smuuJo Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: b9e709c95a964cd5855d4e253aeb1043 Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersOnMultiNodesTest-576816232 Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9e709c95a964cd5855d4e253aeb1043"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b9e709c95a964cd5855d4e253aeb1043"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9e709c95a964cd5855d4e253aeb1043"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b9e709c95a964cd5855d4e253aeb1043"}]}] Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersOnMultiNodesTest-576816232 Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: b9e709c95a964cd5855d4e253aeb1043 Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-576816232 Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersOnMultiNodesTest-576816232-project Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 336c26b5dd6644bc83f9b80adac06bce Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersOnMultiNodesTest-576816232-project Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 2290ea80-011c-47ab-b4a9-620f1a8f5631 could not be found. Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '2290ea80-011c-47ab-b4a9-620f1a8f5631'} Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2290ea80-011c-47ab-b4a9-620f1a8f5631 could not be found. Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2290ea80-011c-47ab-b4a9-620f1a8f5631 could not be found. Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:29.529874 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:29.534166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:29.534166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:29.534166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:29.534166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:48:29.534166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:48:29.534166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2290ea80-011c-47ab-b4a9-620f1a8f5631 could not be found. Aug 04 16:48:29.534166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:29.534166 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-92567265-5015-4994-896c-089297ac7d5e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Returning 404 to user: Instance 2290ea80-011c-47ab-b4a9-620f1a8f5631 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:48:29.536147 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-92567265-5015-4994-896c-089297ac7d5e tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/2290ea80-011c-47ab-b4a9-620f1a8f5631" status: 404 len: 111 microversion: 2.1 time: 0.099342 Aug 04 16:48:29.538296 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1358/2696] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:29 2022] GET /compute/v2.1/servers/2290ea80-011c-47ab-b4a9-620f1a8f5631 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:48:29.555141 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6c6df4ca-241d-431e-827f-733eb300afb9 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:29.556228 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6c6df4ca-241d-431e-827f-733eb300afb9 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 3c687b7a-617f-46d4-b1c1-c629814fac1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:29.579881 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c6df4ca-241d-431e-827f-733eb300afb9 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:29.580703 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c6df4ca-241d-431e-827f-733eb300afb9 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:29.585305 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c6df4ca-241d-431e-827f-733eb300afb9 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:29.595589 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c6df4ca-241d-431e-827f-733eb300afb9 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:29.683121 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6c6df4ca-241d-431e-827f-733eb300afb9 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 3c687b7a-617f-46d4-b1c1-c629814fac1a] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:48:29.828438 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6c6df4ca-241d-431e-827f-733eb300afb9 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3c687b7a-617f-46d4-b1c1-c629814fac1a" status: 204 len: 0 microversion: 2.1 time: 0.283680 Aug 04 16:48:29.834817 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1339/2697] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:48:29 2022] DELETE /compute/v2.1/servers/3c687b7a-617f-46d4-b1c1-c629814fac1a => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:48:29.843148 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ab51a8b9-a894-47ea-a4d3-21c503c94c80 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:29.843834 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ab51a8b9-a894-47ea-a4d3-21c503c94c80 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:29.865428 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab51a8b9-a894-47ea-a4d3-21c503c94c80 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:29.867450 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab51a8b9-a894-47ea-a4d3-21c503c94c80 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:29.868380 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab51a8b9-a894-47ea-a4d3-21c503c94c80 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:29.868876 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab51a8b9-a894-47ea-a4d3-21c503c94c80 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:29.908599 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ab51a8b9-a894-47ea-a4d3-21c503c94c80 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:48:29.941502 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-846b420d-7d94-4370-a5bb-033deea89231 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:29.942676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-846b420d-7d94-4370-a5bb-033deea89231 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: d23a6aaf-abc4-43f9-b229-7b52436529c9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:29.954461 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-846b420d-7d94-4370-a5bb-033deea89231 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:29.955106 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-846b420d-7d94-4370-a5bb-033deea89231 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:29.956824 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-846b420d-7d94-4370-a5bb-033deea89231 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:29.957465 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-846b420d-7d94-4370-a5bb-033deea89231 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:30.147766 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ab51a8b9-a894-47ea-a4d3-21c503c94c80 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be" status: 204 len: 0 microversion: 2.1 time: 0.311512 Aug 04 16:48:30.150146 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1359/2698] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:48:29 2022] DELETE /compute/v2.1/servers/f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:48:30.160733 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-90673ae3-5655-4ce1-9c06-9f03e40b6efa req-f80ecf6e-52fb-45c4-a626-dd5ad17d24ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d23a6aaf-abc4-43f9-b229-7b52436529c9", "name": "network-vif-deleted", "tag": "b3dfb2dd-dc19-4306-9f4c-7d3e13704fcf"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:48:30.180196 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-90673ae3-5655-4ce1-9c06-9f03e40b6efa req-f80ecf6e-52fb-45c4-a626-dd5ad17d24ce service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:30.181096 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-90673ae3-5655-4ce1-9c06-9f03e40b6efa req-f80ecf6e-52fb-45c4-a626-dd5ad17d24ce service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:30.190412 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:48:30.208237 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-90673ae3-5655-4ce1-9c06-9f03e40b6efa req-f80ecf6e-52fb-45c4-a626-dd5ad17d24ce service nova] Creating event network-vif-deleted:b3dfb2dd-dc19-4306-9f4c-7d3e13704fcf for instance d23a6aaf-abc4-43f9-b229-7b52436529c9 on n-h2-846466-12 Aug 04 16:48:30.218766 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-90673ae3-5655-4ce1-9c06-9f03e40b6efa req-f80ecf6e-52fb-45c4-a626-dd5ad17d24ce service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065246 Aug 04 16:48:30.220737 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1360/2699] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:48:30.233054 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b0b1102d-fea3-4b51-b2ba-18828e853a03 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:30.235228 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b0b1102d-fea3-4b51-b2ba-18828e853a03 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 3c687b7a-617f-46d4-b1c1-c629814fac1a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:30.264898 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0b1102d-fea3-4b51-b2ba-18828e853a03 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:30.266000 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0b1102d-fea3-4b51-b2ba-18828e853a03 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:30.267440 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0b1102d-fea3-4b51-b2ba-18828e853a03 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:30.268212 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0b1102d-fea3-4b51-b2ba-18828e853a03 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:30.298189 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-846b420d-7d94-4370-a5bb-033deea89231 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:30.310443 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-846b420d-7d94-4370-a5bb-033deea89231 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9" status: 200 len: 1452 microversion: 2.1 time: 0.381961 Aug 04 16:48:30.315729 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1340/2700] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:29 2022] GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9 => generated 1452 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:30.434704 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7d4f7535-6077-4204-abf0-af97a08dfcd3 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:30.446054 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7d4f7535-6077-4204-abf0-af97a08dfcd3 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] [instance: a1d675a4-bcdd-4551-ba93-11f334a56e95] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:30.457225 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7d4f7535-6077-4204-abf0-af97a08dfcd3 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:30.457707 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7d4f7535-6077-4204-abf0-af97a08dfcd3 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:30.458510 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7d4f7535-6077-4204-abf0-af97a08dfcd3 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:30.458999 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7d4f7535-6077-4204-abf0-af97a08dfcd3 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:30.696534 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7d4f7535-6077-4204-abf0-af97a08dfcd3 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:30.717071 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7d4f7535-6077-4204-abf0-af97a08dfcd3 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:30.719274 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7d4f7535-6077-4204-abf0-af97a08dfcd3 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:30.720895 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7d4f7535-6077-4204-abf0-af97a08dfcd3 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] 10.222.0.23 "GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95" status: 200 len: 1409 microversion: 2.54 time: 0.296184 Aug 04 16:48:30.721937 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1341/2701] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:48:30 2022] GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95 => generated 1409 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:48:30.728622 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fbe96136-8f4f-4239-9b88-6c81f9568910 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:30.729731 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fbe96136-8f4f-4239-9b88-6c81f9568910 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:30.738519 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fbe96136-8f4f-4239-9b88-6c81f9568910 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:30.739848 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fbe96136-8f4f-4239-9b88-6c81f9568910 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:30.740920 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fbe96136-8f4f-4239-9b88-6c81f9568910 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:30.741649 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fbe96136-8f4f-4239-9b88-6c81f9568910 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:30.746850 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:48:31.014288 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b0b1102d-fea3-4b51-b2ba-18828e853a03 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:31.026261 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b0b1102d-fea3-4b51-b2ba-18828e853a03 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/3c687b7a-617f-46d4-b1c1-c629814fac1a" status: 200 len: 1474 microversion: 2.1 time: 0.803005 Aug 04 16:48:31.027077 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1361/2702] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:30 2022] GET /compute/v2.1/servers/3c687b7a-617f-46d4-b1c1-c629814fac1a => generated 1474 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:31.336587 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fbe96136-8f4f-4239-9b88-6c81f9568910 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:31.351763 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fbe96136-8f4f-4239-9b88-6c81f9568910 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1508 microversion: 2.1 time: 0.627967 Aug 04 16:48:31.352283 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d7d22167-ee4b-4048-bf57-827c5fe630f9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:31.353010 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d7d22167-ee4b-4048-bf57-827c5fe630f9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: d23a6aaf-abc4-43f9-b229-7b52436529c9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:31.377803 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d7d22167-ee4b-4048-bf57-827c5fe630f9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:31.378246 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d7d22167-ee4b-4048-bf57-827c5fe630f9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:31.379079 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d7d22167-ee4b-4048-bf57-827c5fe630f9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:31.379441 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d7d22167-ee4b-4048-bf57-827c5fe630f9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:31.389390 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1342/2703] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:30 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1508 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:31.488688 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d7d22167-ee4b-4048-bf57-827c5fe630f9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:31.494076 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d7d22167-ee4b-4048-bf57-827c5fe630f9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:31.496236 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-d7d22167-ee4b-4048-bf57-827c5fe630f9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lazy-loading 'fault' on Instance uuid d23a6aaf-abc4-43f9-b229-7b52436529c9 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:48:31.636746 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d7d22167-ee4b-4048-bf57-827c5fe630f9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85f0bd88d79409e9610a47f3ae943ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa49d3246ea4361abb452e16e017faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:31.658767 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d7d22167-ee4b-4048-bf57-827c5fe630f9 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9" status: 200 len: 1297 microversion: 2.1 time: 0.308170 Aug 04 16:48:31.660539 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1362/2704] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:31 2022] GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9 => generated 1297 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:48:31.765577 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-61eb0f33-aecc-4c4c-9d4d-3d174bda3253 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:31.766397 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-61eb0f33-aecc-4c4c-9d4d-3d174bda3253 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] [instance: a1d675a4-bcdd-4551-ba93-11f334a56e95] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:31.780056 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-61eb0f33-aecc-4c4c-9d4d-3d174bda3253 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:31.780569 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-61eb0f33-aecc-4c4c-9d4d-3d174bda3253 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:31.790103 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-61eb0f33-aecc-4c4c-9d4d-3d174bda3253 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:31.790884 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-61eb0f33-aecc-4c4c-9d4d-3d174bda3253 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:32.041643 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-61eb0f33-aecc-4c4c-9d4d-3d174bda3253 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:32.055383 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3060b7bf-70d4-475d-bc64-69744016c627 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:32.056448 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3060b7bf-70d4-475d-bc64-69744016c627 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 3c687b7a-617f-46d4-b1c1-c629814fac1a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:32.058272 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-61eb0f33-aecc-4c4c-9d4d-3d174bda3253 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:32.062039 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-61eb0f33-aecc-4c4c-9d4d-3d174bda3253 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:32.064601 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-61eb0f33-aecc-4c4c-9d4d-3d174bda3253 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] 10.222.0.23 "GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95" status: 200 len: 1409 microversion: 2.54 time: 0.303249 Aug 04 16:48:32.066578 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1343/2705] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:48:31 2022] GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95 => generated 1409 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:48:32.067614 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3060b7bf-70d4-475d-bc64-69744016c627 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:32.068185 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3060b7bf-70d4-475d-bc64-69744016c627 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:32.069247 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3060b7bf-70d4-475d-bc64-69744016c627 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:32.069848 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3060b7bf-70d4-475d-bc64-69744016c627 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:32.393733 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9b80d4d4-2faa-4cfd-8bb0-35395e0a7155 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:32.394351 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9b80d4d4-2faa-4cfd-8bb0-35395e0a7155 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:32.413380 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9b80d4d4-2faa-4cfd-8bb0-35395e0a7155 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:32.413820 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9b80d4d4-2faa-4cfd-8bb0-35395e0a7155 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:32.414825 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9b80d4d4-2faa-4cfd-8bb0-35395e0a7155 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:32.415427 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9b80d4d4-2faa-4cfd-8bb0-35395e0a7155 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:33.860049 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9b80d4d4-2faa-4cfd-8bb0-35395e0a7155 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:33.900496 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9b80d4d4-2faa-4cfd-8bb0-35395e0a7155 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1529 microversion: 2.1 time: 1.511066 Aug 04 16:48:33.901459 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1344/2706] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:32 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1529 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:48:33.919348 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7f6f2794-f9f5-4408-9883-2fe82c9dc9c1 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:33.921676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7f6f2794-f9f5-4408-9883-2fe82c9dc9c1 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: d23a6aaf-abc4-43f9-b229-7b52436529c9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:33.927971 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:48:33.939945 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f6f2794-f9f5-4408-9883-2fe82c9dc9c1 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:33.944244 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f6f2794-f9f5-4408-9883-2fe82c9dc9c1 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:33.945459 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f6f2794-f9f5-4408-9883-2fe82c9dc9c1 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:33.945987 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f6f2794-f9f5-4408-9883-2fe82c9dc9c1 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:33.954318 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3060b7bf-70d4-475d-bc64-69744016c627 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:33.972557 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3060b7bf-70d4-475d-bc64-69744016c627 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/3c687b7a-617f-46d4-b1c1-c629814fac1a" status: 200 len: 1474 microversion: 2.1 time: 1.926854 Aug 04 16:48:33.975014 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1363/2707] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:32 2022] GET /compute/v2.1/servers/3c687b7a-617f-46d4-b1c1-c629814fac1a => generated 1474 bytes in 1931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:33.985106 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-7f6f2794-f9f5-4408-9883-2fe82c9dc9c1 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] HTTP exception thrown: Instance d23a6aaf-abc4-43f9-b229-7b52436529c9 could not be found. Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7f6f2794-f9f5-4408-9883-2fe82c9dc9c1 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Request method failure captured: Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9 HTTP/1.1 Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_dOO7UsedsqygwWY3wqONL1C3XvUWyyQWteVTjxlk6_e14fRbH5QIwl0MR0jswL1bTsNdU7_ySVOUPWQHhAcgE2xj2ZhEWaRp5MluuPG9CHtvcP8oJmpaA_VSNcZwQ79WG__AL2jsD0U87Ln8DKcsaJvyJZuiedH0AejNlOCY8lVbk Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: afa49d3246ea4361abb452e16e017faf Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ImagesTestJSON-86748708 Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/afa49d3246ea4361abb452e16e017faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_afa49d3246ea4361abb452e16e017faf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/afa49d3246ea4361abb452e16e017faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/afa49d3246ea4361abb452e16e017faf"}]}] Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ImagesTestJSON-86748708 Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: afa49d3246ea4361abb452e16e017faf Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ImagesTestJSON-86748708 Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ImagesTestJSON-86748708-project Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: a85f0bd88d79409e9610a47f3ae943ce Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ImagesTestJSON-86748708-project Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance d23a6aaf-abc4-43f9-b229-7b52436529c9 could not be found. Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'd23a6aaf-abc4-43f9-b229-7b52436529c9'} Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d23a6aaf-abc4-43f9-b229-7b52436529c9 could not be found. Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d23a6aaf-abc4-43f9-b229-7b52436529c9 could not be found. Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:33.987341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:33.991695 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:33.991695 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:33.991695 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:48:33.991695 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:48:33.991695 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d23a6aaf-abc4-43f9-b229-7b52436529c9 could not be found. Aug 04 16:48:33.991695 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:33.993071 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7f6f2794-f9f5-4408-9883-2fe82c9dc9c1 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Returning 404 to user: Instance d23a6aaf-abc4-43f9-b229-7b52436529c9 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:48:33.994233 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7f6f2794-f9f5-4408-9883-2fe82c9dc9c1 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9" status: 404 len: 111 microversion: 2.1 time: 0.086624 Aug 04 16:48:33.995514 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1345/2708] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:33 2022] GET /compute/v2.1/servers/d23a6aaf-abc4-43f9-b229-7b52436529c9 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:48:33.999159 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2ba88484-a32d-4580-b587-eaf724f7c1ca tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:34.005437 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2ba88484-a32d-4580-b587-eaf724f7c1ca tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] [instance: a1d675a4-bcdd-4551-ba93-11f334a56e95] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:34.008944 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ab06faf8-d868-4dd0-8061-7747dfe90417 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e89b8f5e0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:34.014343 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2ba88484-a32d-4580-b587-eaf724f7c1ca tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:34.021204 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2ba88484-a32d-4580-b587-eaf724f7c1ca tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:34.022125 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2ba88484-a32d-4580-b587-eaf724f7c1ca tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:34.023950 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2ba88484-a32d-4580-b587-eaf724f7c1ca tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:34.088602 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-ab06faf8-d868-4dd0-8061-7747dfe90417 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] HTTP exception thrown: Image not found. Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ab06faf8-d868-4dd0-8061-7747dfe90417 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Request method failure captured: Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3 HTTP/1.1 Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_dOO7UsedsqygwWY3wqONL1C3XvUWyyQWteVTjxlk6_e14fRbH5QIwl0MR0jswL1bTsNdU7_ySVOUPWQHhAcgE2xj2ZhEWaRp5MluuPG9CHtvcP8oJmpaA_VSNcZwQ79WG__AL2jsD0U87Ln8DKcsaJvyJZuiedH0AejNlOCY8lVbk Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: afa49d3246ea4361abb452e16e017faf Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ImagesTestJSON-86748708 Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/afa49d3246ea4361abb452e16e017faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_afa49d3246ea4361abb452e16e017faf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/afa49d3246ea4361abb452e16e017faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/afa49d3246ea4361abb452e16e017faf"}]}] Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ImagesTestJSON-86748708 Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: afa49d3246ea4361abb452e16e017faf Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ImagesTestJSON-86748708 Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ImagesTestJSON-86748708-project Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: a85f0bd88d79409e9610a47f3ae943ce Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ImagesTestJSON-86748708-project Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: exception: Image not found. Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '30692687-a60b-47b3-8ea3-6617e30ce9b3'} Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 30692687-a60b-47b3-8ea3-6617e30ce9b3 to delete Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 30692687-a60b-47b3-8ea3-6617e30ce9b3 could not be found. Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.090686 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:34.094756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:34.094756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:34.094756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:48:34.094756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:48:34.094756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:48:34.094756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:48:34.094756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:48:34.094756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:48:34.094756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 16:48:34.094756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 16:48:34.094756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 16:48:34.094756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.094756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:34.094756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.094756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:34.094756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:34.094756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:34.094756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:48:34.094756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:48:34.094756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 16:48:34.094756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.097854 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ab06faf8-d868-4dd0-8061-7747dfe90417 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Returning 404 to user: Image not found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:48:34.099008 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ab06faf8-d868-4dd0-8061-7747dfe90417 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "DELETE /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3" status: 404 len: 62 microversion: 2.1 time: 0.098524 Aug 04 16:48:34.099819 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1346/2709] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:33 2022] DELETE /compute/v2.1/images/30692687-a60b-47b3-8ea3-6617e30ce9b3 => generated 62 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:48:34.109471 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8777018b-d558-4715-9564-062406444104 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:34.110065 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8777018b-d558-4715-9564-062406444104 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:34.118906 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8777018b-d558-4715-9564-062406444104 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:34.119357 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8777018b-d558-4715-9564-062406444104 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:34.120168 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8777018b-d558-4715-9564-062406444104 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:34.120603 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8777018b-d558-4715-9564-062406444104 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:34.138288 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-8777018b-d558-4715-9564-062406444104 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] HTTP exception thrown: Instance 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61 could not be found. Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8777018b-d558-4715-9564-062406444104 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Request method failure captured: Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61 HTTP/1.1 Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_dOO7UsedsqygwWY3wqONL1C3XvUWyyQWteVTjxlk6_e14fRbH5QIwl0MR0jswL1bTsNdU7_ySVOUPWQHhAcgE2xj2ZhEWaRp5MluuPG9CHtvcP8oJmpaA_VSNcZwQ79WG__AL2jsD0U87Ln8DKcsaJvyJZuiedH0AejNlOCY8lVbk Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: afa49d3246ea4361abb452e16e017faf Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ImagesTestJSON-86748708 Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/afa49d3246ea4361abb452e16e017faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_afa49d3246ea4361abb452e16e017faf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/afa49d3246ea4361abb452e16e017faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/afa49d3246ea4361abb452e16e017faf"}]}] Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ImagesTestJSON-86748708 Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: afa49d3246ea4361abb452e16e017faf Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ImagesTestJSON-86748708 Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ImagesTestJSON-86748708-project Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: a85f0bd88d79409e9610a47f3ae943ce Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ImagesTestJSON-86748708-project Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61 could not be found. Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '3e3e569c-a08f-4026-9fc9-ad9caf3d3c61'} Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61 could not be found. Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:48:34.140341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61 could not be found. Aug 04 16:48:34.144217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.144217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:34.144217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.144217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:34.144217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:34.144217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:34.144217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:48:34.144217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:48:34.144217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61 could not be found. Aug 04 16:48:34.144217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.144217 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8777018b-d558-4715-9564-062406444104 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Returning 404 to user: Instance 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:48:34.144217 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8777018b-d558-4715-9564-062406444104 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61" status: 404 len: 111 microversion: 2.1 time: 0.037091 Aug 04 16:48:34.144217 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1347/2710] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:48:34 2022] DELETE /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:48:34.160370 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fc83dde3-09a0-40d5-b1a3-57a8a13f8ef1 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:34.161004 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fc83dde3-09a0-40d5-b1a3-57a8a13f8ef1 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:34.169690 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fc83dde3-09a0-40d5-b1a3-57a8a13f8ef1 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:34.170215 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fc83dde3-09a0-40d5-b1a3-57a8a13f8ef1 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:34.171178 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fc83dde3-09a0-40d5-b1a3-57a8a13f8ef1 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:34.171621 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fc83dde3-09a0-40d5-b1a3-57a8a13f8ef1 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:34.191792 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-fc83dde3-09a0-40d5-b1a3-57a8a13f8ef1 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] HTTP exception thrown: Instance 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61 could not be found. Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fc83dde3-09a0-40d5-b1a3-57a8a13f8ef1 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Request method failure captured: Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61 HTTP/1.1 Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_dOO7UsedsqygwWY3wqONL1C3XvUWyyQWteVTjxlk6_e14fRbH5QIwl0MR0jswL1bTsNdU7_ySVOUPWQHhAcgE2xj2ZhEWaRp5MluuPG9CHtvcP8oJmpaA_VSNcZwQ79WG__AL2jsD0U87Ln8DKcsaJvyJZuiedH0AejNlOCY8lVbk Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: afa49d3246ea4361abb452e16e017faf Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ImagesTestJSON-86748708 Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/afa49d3246ea4361abb452e16e017faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_afa49d3246ea4361abb452e16e017faf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/afa49d3246ea4361abb452e16e017faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/afa49d3246ea4361abb452e16e017faf"}]}] Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ImagesTestJSON-86748708 Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: afa49d3246ea4361abb452e16e017faf Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ImagesTestJSON-86748708 Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ImagesTestJSON-86748708-project Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: a85f0bd88d79409e9610a47f3ae943ce Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ImagesTestJSON-86748708-project Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61 could not be found. Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '3e3e569c-a08f-4026-9fc9-ad9caf3d3c61'} Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61 could not be found. Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61 could not be found. Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.194681 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:34.199632 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:34.199632 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:34.199632 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:48:34.199632 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:48:34.199632 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61 could not be found. Aug 04 16:48:34.199632 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.199632 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fc83dde3-09a0-40d5-b1a3-57a8a13f8ef1 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Returning 404 to user: Instance 3e3e569c-a08f-4026-9fc9-ad9caf3d3c61 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:48:34.199632 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fc83dde3-09a0-40d5-b1a3-57a8a13f8ef1 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61" status: 404 len: 111 microversion: 2.1 time: 0.049562 Aug 04 16:48:34.202341 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1348/2711] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:34 2022] GET /compute/v2.1/servers/3e3e569c-a08f-4026-9fc9-ad9caf3d3c61 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:48:34.208258 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7cddacc8-6026-4063-a35e-14cd3824c711 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e77f279d0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:34.239715 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2ba88484-a32d-4580-b587-eaf724f7c1ca tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:34.254989 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2ba88484-a32d-4580-b587-eaf724f7c1ca tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:34.258579 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2ba88484-a32d-4580-b587-eaf724f7c1ca tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:34.260866 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2ba88484-a32d-4580-b587-eaf724f7c1ca tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] 10.222.0.23 "GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95" status: 200 len: 1409 microversion: 2.54 time: 0.283855 Aug 04 16:48:34.292402 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-7cddacc8-6026-4063-a35e-14cd3824c711 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] HTTP exception thrown: Image not found. Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7cddacc8-6026-4063-a35e-14cd3824c711 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Request method failure captured: Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/images/b7c42f97-f9b7-487b-8dd3-3ee62452aa70 HTTP/1.1 Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_dOO7UsedsqygwWY3wqONL1C3XvUWyyQWteVTjxlk6_e14fRbH5QIwl0MR0jswL1bTsNdU7_ySVOUPWQHhAcgE2xj2ZhEWaRp5MluuPG9CHtvcP8oJmpaA_VSNcZwQ79WG__AL2jsD0U87Ln8DKcsaJvyJZuiedH0AejNlOCY8lVbk Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: afa49d3246ea4361abb452e16e017faf Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ImagesTestJSON-86748708 Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/afa49d3246ea4361abb452e16e017faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_afa49d3246ea4361abb452e16e017faf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/afa49d3246ea4361abb452e16e017faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/afa49d3246ea4361abb452e16e017faf"}]}] Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ImagesTestJSON-86748708 Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: afa49d3246ea4361abb452e16e017faf Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ImagesTestJSON-86748708 Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ImagesTestJSON-86748708-project Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: a85f0bd88d79409e9610a47f3ae943ce Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ImagesTestJSON-86748708-project Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: exception: Image not found. Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'b7c42f97-f9b7-487b-8dd3-3ee62452aa70'} Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b7c42f97-f9b7-487b-8dd3-3ee62452aa70 to delete Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b7c42f97-f9b7-487b-8dd3-3ee62452aa70 could not be found. Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.294552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:34.299083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:34.299083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:34.299083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:48:34.299083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:48:34.299083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:48:34.299083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:48:34.299083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:48:34.299083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:48:34.299083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 16:48:34.299083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 16:48:34.299083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 16:48:34.299083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.299083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:34.299083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.299083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:34.299083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:34.299083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:34.299083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:48:34.299083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:48:34.299083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 16:48:34.299083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.299083 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7cddacc8-6026-4063-a35e-14cd3824c711 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Returning 404 to user: Image not found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:48:34.299083 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7cddacc8-6026-4063-a35e-14cd3824c711 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "DELETE /compute/v2.1/images/b7c42f97-f9b7-487b-8dd3-3ee62452aa70" status: 404 len: 62 microversion: 2.1 time: 0.092571 Aug 04 16:48:34.306406 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1349/2712] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:34 2022] DELETE /compute/v2.1/images/b7c42f97-f9b7-487b-8dd3-3ee62452aa70 => generated 62 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:48:34.307453 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1364/2713] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:48:33 2022] GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95 => generated 1409 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:48:34.307643 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5d9c6286-cf7e-4c62-942d-a5e0ef65c856 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:34.307643 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5d9c6286-cf7e-4c62-942d-a5e0ef65c856 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 45b975d2-057f-4aae-9e4b-95b8ed28c805] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:34.320958 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5d9c6286-cf7e-4c62-942d-a5e0ef65c856 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:34.321613 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5d9c6286-cf7e-4c62-942d-a5e0ef65c856 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:34.322438 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5d9c6286-cf7e-4c62-942d-a5e0ef65c856 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:34.322959 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5d9c6286-cf7e-4c62-942d-a5e0ef65c856 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:34.351989 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-5d9c6286-cf7e-4c62-942d-a5e0ef65c856 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] HTTP exception thrown: Instance 45b975d2-057f-4aae-9e4b-95b8ed28c805 could not be found. Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5d9c6286-cf7e-4c62-942d-a5e0ef65c856 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Request method failure captured: Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805 HTTP/1.1 Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_dOO7UsedsqygwWY3wqONL1C3XvUWyyQWteVTjxlk6_e14fRbH5QIwl0MR0jswL1bTsNdU7_ySVOUPWQHhAcgE2xj2ZhEWaRp5MluuPG9CHtvcP8oJmpaA_VSNcZwQ79WG__AL2jsD0U87Ln8DKcsaJvyJZuiedH0AejNlOCY8lVbk Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: afa49d3246ea4361abb452e16e017faf Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ImagesTestJSON-86748708 Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/afa49d3246ea4361abb452e16e017faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_afa49d3246ea4361abb452e16e017faf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/afa49d3246ea4361abb452e16e017faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/afa49d3246ea4361abb452e16e017faf"}]}] Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ImagesTestJSON-86748708 Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: afa49d3246ea4361abb452e16e017faf Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ImagesTestJSON-86748708 Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ImagesTestJSON-86748708-project Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: a85f0bd88d79409e9610a47f3ae943ce Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ImagesTestJSON-86748708-project Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 45b975d2-057f-4aae-9e4b-95b8ed28c805 could not be found. Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '45b975d2-057f-4aae-9e4b-95b8ed28c805'} Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45b975d2-057f-4aae-9e4b-95b8ed28c805 could not be found. Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:48:34.353794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45b975d2-057f-4aae-9e4b-95b8ed28c805 could not be found. Aug 04 16:48:34.362661 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.362661 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:34.362661 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.362661 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:34.362661 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:34.362661 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:34.362661 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:48:34.362661 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:48:34.362661 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45b975d2-057f-4aae-9e4b-95b8ed28c805 could not be found. Aug 04 16:48:34.362661 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.362661 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5d9c6286-cf7e-4c62-942d-a5e0ef65c856 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Returning 404 to user: Instance 45b975d2-057f-4aae-9e4b-95b8ed28c805 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:48:34.362661 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5d9c6286-cf7e-4c62-942d-a5e0ef65c856 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "DELETE /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805" status: 404 len: 111 microversion: 2.1 time: 0.052930 Aug 04 16:48:34.362661 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1350/2714] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:48:34 2022] DELETE /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:48:34.365451 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-89290990-9eeb-4815-8540-a5be1468712f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:34.365868 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-89290990-9eeb-4815-8540-a5be1468712f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 45b975d2-057f-4aae-9e4b-95b8ed28c805] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:34.378835 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-89290990-9eeb-4815-8540-a5be1468712f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:34.379296 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-89290990-9eeb-4815-8540-a5be1468712f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:34.380115 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-89290990-9eeb-4815-8540-a5be1468712f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:34.380551 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-89290990-9eeb-4815-8540-a5be1468712f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:34.444509 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-89290990-9eeb-4815-8540-a5be1468712f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] HTTP exception thrown: Instance 45b975d2-057f-4aae-9e4b-95b8ed28c805 could not be found. Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-89290990-9eeb-4815-8540-a5be1468712f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Request method failure captured: Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805 HTTP/1.1 Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_dOO7UsedsqygwWY3wqONL1C3XvUWyyQWteVTjxlk6_e14fRbH5QIwl0MR0jswL1bTsNdU7_ySVOUPWQHhAcgE2xj2ZhEWaRp5MluuPG9CHtvcP8oJmpaA_VSNcZwQ79WG__AL2jsD0U87Ln8DKcsaJvyJZuiedH0AejNlOCY8lVbk Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: afa49d3246ea4361abb452e16e017faf Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ImagesTestJSON-86748708 Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/afa49d3246ea4361abb452e16e017faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_afa49d3246ea4361abb452e16e017faf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/afa49d3246ea4361abb452e16e017faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/afa49d3246ea4361abb452e16e017faf"}]}] Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ImagesTestJSON-86748708 Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: afa49d3246ea4361abb452e16e017faf Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ImagesTestJSON-86748708 Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ImagesTestJSON-86748708-project Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: a85f0bd88d79409e9610a47f3ae943ce Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ImagesTestJSON-86748708-project Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 45b975d2-057f-4aae-9e4b-95b8ed28c805 could not be found. Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '45b975d2-057f-4aae-9e4b-95b8ed28c805'} Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45b975d2-057f-4aae-9e4b-95b8ed28c805 could not be found. Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45b975d2-057f-4aae-9e4b-95b8ed28c805 could not be found. Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.447197 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:34.452086 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:34.452086 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:34.452086 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:48:34.452086 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:48:34.452086 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45b975d2-057f-4aae-9e4b-95b8ed28c805 could not be found. Aug 04 16:48:34.452086 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.452086 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-89290990-9eeb-4815-8540-a5be1468712f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Returning 404 to user: Instance 45b975d2-057f-4aae-9e4b-95b8ed28c805 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:48:34.452086 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-89290990-9eeb-4815-8540-a5be1468712f tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805" status: 404 len: 111 microversion: 2.1 time: 0.087866 Aug 04 16:48:34.458640 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7a1175b8-9953-4386-a5db-14bbd179333a tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '.version_select at 0x7f7e77f3a040>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:34.464613 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1365/2715] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:34 2022] GET /compute/v2.1/servers/45b975d2-057f-4aae-9e4b-95b8ed28c805 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:48:34.495363 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-7a1175b8-9953-4386-a5db-14bbd179333a tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] HTTP exception thrown: Image not found. Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7a1175b8-9953-4386-a5db-14bbd179333a tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Request method failure captured: Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f HTTP/1.1 Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_dOO7UsedsqygwWY3wqONL1C3XvUWyyQWteVTjxlk6_e14fRbH5QIwl0MR0jswL1bTsNdU7_ySVOUPWQHhAcgE2xj2ZhEWaRp5MluuPG9CHtvcP8oJmpaA_VSNcZwQ79WG__AL2jsD0U87Ln8DKcsaJvyJZuiedH0AejNlOCY8lVbk Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: afa49d3246ea4361abb452e16e017faf Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ImagesTestJSON-86748708 Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/afa49d3246ea4361abb452e16e017faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_afa49d3246ea4361abb452e16e017faf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/afa49d3246ea4361abb452e16e017faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/afa49d3246ea4361abb452e16e017faf"}]}] Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ImagesTestJSON-86748708 Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: afa49d3246ea4361abb452e16e017faf Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ImagesTestJSON-86748708 Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ImagesTestJSON-86748708-project Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: a85f0bd88d79409e9610a47f3ae943ce Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ImagesTestJSON-86748708-project Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: exception: Image not found. Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f'} Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f to delete Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f could not be found. Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.497179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:34.502292 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:34.502292 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:34.502292 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:48:34.502292 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:48:34.502292 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:48:34.502292 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:48:34.502292 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:48:34.502292 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:48:34.502292 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 16:48:34.502292 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 16:48:34.502292 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 16:48:34.502292 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.502292 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:34.502292 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.502292 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:34.502292 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:34.502292 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:34.502292 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:48:34.502292 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:48:34.502292 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 16:48:34.502292 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.505459 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7a1175b8-9953-4386-a5db-14bbd179333a tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Returning 404 to user: Image not found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:48:34.506537 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7a1175b8-9953-4386-a5db-14bbd179333a tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "DELETE /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f" status: 404 len: 62 microversion: 2.1 time: 0.052728 Aug 04 16:48:34.516551 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-60337e77-82c7-4424-81f2-1e66e6fec036 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:34.517582 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-60337e77-82c7-4424-81f2-1e66e6fec036 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:34.517967 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1351/2716] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:34 2022] DELETE /compute/v2.1/images/acba1744-d3cd-4b5e-bc74-cd9fbbbb6e9f => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 04 16:48:34.528668 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-60337e77-82c7-4424-81f2-1e66e6fec036 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:34.532112 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-60337e77-82c7-4424-81f2-1e66e6fec036 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:34.535435 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-60337e77-82c7-4424-81f2-1e66e6fec036 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:34.536127 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-60337e77-82c7-4424-81f2-1e66e6fec036 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:34.588469 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-60337e77-82c7-4424-81f2-1e66e6fec036 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] HTTP exception thrown: Instance 6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e could not be found. Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-60337e77-82c7-4424-81f2-1e66e6fec036 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Request method failure captured: Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/servers/6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e HTTP/1.1 Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_dOO7UsedsqygwWY3wqONL1C3XvUWyyQWteVTjxlk6_e14fRbH5QIwl0MR0jswL1bTsNdU7_ySVOUPWQHhAcgE2xj2ZhEWaRp5MluuPG9CHtvcP8oJmpaA_VSNcZwQ79WG__AL2jsD0U87Ln8DKcsaJvyJZuiedH0AejNlOCY8lVbk Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: afa49d3246ea4361abb452e16e017faf Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ImagesTestJSON-86748708 Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/afa49d3246ea4361abb452e16e017faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_afa49d3246ea4361abb452e16e017faf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/afa49d3246ea4361abb452e16e017faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/afa49d3246ea4361abb452e16e017faf"}]}] Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ImagesTestJSON-86748708 Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: afa49d3246ea4361abb452e16e017faf Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ImagesTestJSON-86748708 Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ImagesTestJSON-86748708-project Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: a85f0bd88d79409e9610a47f3ae943ce Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ImagesTestJSON-86748708-project Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e could not be found. Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e'} Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e could not be found. Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:48:34.591631 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e could not be found. Aug 04 16:48:34.596140 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.596140 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:34.596140 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.596140 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:34.596140 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:34.596140 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:34.596140 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:48:34.596140 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:48:34.596140 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e could not be found. Aug 04 16:48:34.596140 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.596140 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-60337e77-82c7-4424-81f2-1e66e6fec036 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Returning 404 to user: Instance 6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:48:34.596140 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-60337e77-82c7-4424-81f2-1e66e6fec036 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e" status: 404 len: 111 microversion: 2.1 time: 0.083858 Aug 04 16:48:34.600143 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1366/2717] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:48:34 2022] DELETE /compute/v2.1/servers/6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:48:34.605714 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a3706306-2a9e-4c5a-9678-3eb0f4d3a143 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:34.606626 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a3706306-2a9e-4c5a-9678-3eb0f4d3a143 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] [instance: 6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:34.622804 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a3706306-2a9e-4c5a-9678-3eb0f4d3a143 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:34.623772 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a3706306-2a9e-4c5a-9678-3eb0f4d3a143 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:34.626417 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a3706306-2a9e-4c5a-9678-3eb0f4d3a143 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:34.627102 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a3706306-2a9e-4c5a-9678-3eb0f4d3a143 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:34.662385 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-a3706306-2a9e-4c5a-9678-3eb0f4d3a143 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] HTTP exception thrown: Instance 6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e could not be found. Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a3706306-2a9e-4c5a-9678-3eb0f4d3a143 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Request method failure captured: Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e HTTP/1.1 Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_dOO7UsedsqygwWY3wqONL1C3XvUWyyQWteVTjxlk6_e14fRbH5QIwl0MR0jswL1bTsNdU7_ySVOUPWQHhAcgE2xj2ZhEWaRp5MluuPG9CHtvcP8oJmpaA_VSNcZwQ79WG__AL2jsD0U87Ln8DKcsaJvyJZuiedH0AejNlOCY8lVbk Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: afa49d3246ea4361abb452e16e017faf Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ImagesTestJSON-86748708 Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/afa49d3246ea4361abb452e16e017faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_afa49d3246ea4361abb452e16e017faf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/afa49d3246ea4361abb452e16e017faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/afa49d3246ea4361abb452e16e017faf"}]}] Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ImagesTestJSON-86748708 Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: afa49d3246ea4361abb452e16e017faf Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ImagesTestJSON-86748708 Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ImagesTestJSON-86748708-project Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: a85f0bd88d79409e9610a47f3ae943ce Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ImagesTestJSON-86748708-project Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e could not be found. Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e'} Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e could not be found. Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e could not be found. Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.664256 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:34.668790 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:34.668790 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:34.668790 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:48:34.668790 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:48:34.668790 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e could not be found. Aug 04 16:48:34.668790 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:34.675184 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a3706306-2a9e-4c5a-9678-3eb0f4d3a143 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] Returning 404 to user: Instance 6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:48:34.676570 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a3706306-2a9e-4c5a-9678-3eb0f4d3a143 tempest-ImagesTestJSON-86748708 tempest-ImagesTestJSON-86748708-project] 10.222.0.23 "GET /compute/v2.1/servers/6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e" status: 404 len: 111 microversion: 2.1 time: 0.075035 Aug 04 16:48:34.677397 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1352/2718] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:34 2022] GET /compute/v2.1/servers/6dc05ae0-f84e-4ae1-9b6f-e9aa2a348a8e => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:48:34.939532 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d27b2b5f-ea1d-48af-b119-9fdbb2095a33 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:34.941105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d27b2b5f-ea1d-48af-b119-9fdbb2095a33 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:34.957660 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d27b2b5f-ea1d-48af-b119-9fdbb2095a33 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:34.962212 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d27b2b5f-ea1d-48af-b119-9fdbb2095a33 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:34.964258 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d27b2b5f-ea1d-48af-b119-9fdbb2095a33 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:34.965581 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d27b2b5f-ea1d-48af-b119-9fdbb2095a33 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:34.997025 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b275cd56-7127-4a3b-b771-70cbf462d419 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:34.997904 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b275cd56-7127-4a3b-b771-70cbf462d419 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 3c687b7a-617f-46d4-b1c1-c629814fac1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:35.017681 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b275cd56-7127-4a3b-b771-70cbf462d419 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:35.018136 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b275cd56-7127-4a3b-b771-70cbf462d419 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:35.018935 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b275cd56-7127-4a3b-b771-70cbf462d419 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:35.019566 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b275cd56-7127-4a3b-b771-70cbf462d419 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:35.451990 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b275cd56-7127-4a3b-b771-70cbf462d419 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:35.465334 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b275cd56-7127-4a3b-b771-70cbf462d419 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/3c687b7a-617f-46d4-b1c1-c629814fac1a" status: 200 len: 1432 microversion: 2.1 time: 0.469448 Aug 04 16:48:35.466230 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1353/2719] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:34 2022] GET /compute/v2.1/servers/3c687b7a-617f-46d4-b1c1-c629814fac1a => generated 1432 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:35.486774 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9b711e18-6a36-468a-95b5-4b31d0760d1d tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:35.487757 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9b711e18-6a36-468a-95b5-4b31d0760d1d tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] [instance: a1d675a4-bcdd-4551-ba93-11f334a56e95] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:35.503913 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9b711e18-6a36-468a-95b5-4b31d0760d1d tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:35.505230 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9b711e18-6a36-468a-95b5-4b31d0760d1d tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:35.506147 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9b711e18-6a36-468a-95b5-4b31d0760d1d tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:35.512750 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9b711e18-6a36-468a-95b5-4b31d0760d1d tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:35.872382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9b711e18-6a36-468a-95b5-4b31d0760d1d tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:35.882265 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9b711e18-6a36-468a-95b5-4b31d0760d1d tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:35.883908 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9b711e18-6a36-468a-95b5-4b31d0760d1d tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:35.885148 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9b711e18-6a36-468a-95b5-4b31d0760d1d tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] 10.222.0.23 "GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95" status: 200 len: 1409 microversion: 2.54 time: 0.416742 Aug 04 16:48:35.895310 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1354/2720] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:48:35 2022] GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95 => generated 1409 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:48:35.901869 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-1fd4cc6b-bf9e-4628-836c-65e691919a8f req-35f67480-97e6-49e0-805e-10333481f72c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c687b7a-617f-46d4-b1c1-c629814fac1a", "name": "network-vif-deleted", "tag": "829cc34c-b2fd-494c-be1a-a87319f8c284"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:48:35.937630 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-1fd4cc6b-bf9e-4628-836c-65e691919a8f req-35f67480-97e6-49e0-805e-10333481f72c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:35.938414 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-1fd4cc6b-bf9e-4628-836c-65e691919a8f req-35f67480-97e6-49e0-805e-10333481f72c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:35.959576 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-1fd4cc6b-bf9e-4628-836c-65e691919a8f req-35f67480-97e6-49e0-805e-10333481f72c service nova] Creating event network-vif-deleted:829cc34c-b2fd-494c-be1a-a87319f8c284 for instance 3c687b7a-617f-46d4-b1c1-c629814fac1a on n-h2-846466-12 Aug 04 16:48:35.971072 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-1fd4cc6b-bf9e-4628-836c-65e691919a8f req-35f67480-97e6-49e0-805e-10333481f72c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073112 Aug 04 16:48:35.972054 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1355/2721] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:48:36.011463 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d27b2b5f-ea1d-48af-b119-9fdbb2095a33 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:36.032534 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d27b2b5f-ea1d-48af-b119-9fdbb2095a33 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1529 microversion: 2.1 time: 1.100123 Aug 04 16:48:36.067859 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1367/2722] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:34 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1529 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:36.508880 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ac726da7-8d01-46f7-bc64-1224862bca7b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:36.510638 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ac726da7-8d01-46f7-bc64-1224862bca7b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 3c687b7a-617f-46d4-b1c1-c629814fac1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:36.532079 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ac726da7-8d01-46f7-bc64-1224862bca7b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:36.532887 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ac726da7-8d01-46f7-bc64-1224862bca7b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:36.539663 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ac726da7-8d01-46f7-bc64-1224862bca7b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:36.540597 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ac726da7-8d01-46f7-bc64-1224862bca7b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:36.588070 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-ac726da7-8d01-46f7-bc64-1224862bca7b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] HTTP exception thrown: Instance 3c687b7a-617f-46d4-b1c1-c629814fac1a could not be found. Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ac726da7-8d01-46f7-bc64-1224862bca7b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Request method failure captured: Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/3c687b7a-617f-46d4-b1c1-c629814fac1a HTTP/1.1 Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_d0PWjKRFBWfxAhJyM9Llb5b9qIi5YfrBNXPAsDzIFh8zYJUWCF3RzIK4AGkYlNQVK5Am3F8P2Rbt4hrCuiVYFRb2bix8zHglKpYs5ivud-NO1ZEo-kW7N3_XgRhYscv5AJxIc_PiyQmdBCcRjkSDOpLzajPb1FiA8gOmTp1smuuJo Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: b9e709c95a964cd5855d4e253aeb1043 Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersOnMultiNodesTest-576816232 Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9e709c95a964cd5855d4e253aeb1043"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b9e709c95a964cd5855d4e253aeb1043"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9e709c95a964cd5855d4e253aeb1043"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b9e709c95a964cd5855d4e253aeb1043"}]}] Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersOnMultiNodesTest-576816232 Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: b9e709c95a964cd5855d4e253aeb1043 Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-576816232 Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersOnMultiNodesTest-576816232-project Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 336c26b5dd6644bc83f9b80adac06bce Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersOnMultiNodesTest-576816232-project Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 3c687b7a-617f-46d4-b1c1-c629814fac1a could not be found. Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '3c687b7a-617f-46d4-b1c1-c629814fac1a'} Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c687b7a-617f-46d4-b1c1-c629814fac1a could not be found. Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c687b7a-617f-46d4-b1c1-c629814fac1a could not be found. Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:36.595002 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:36.612342 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:36.612342 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:36.612342 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:36.612342 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:48:36.612342 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:48:36.612342 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c687b7a-617f-46d4-b1c1-c629814fac1a could not be found. Aug 04 16:48:36.612342 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:36.612342 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ac726da7-8d01-46f7-bc64-1224862bca7b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Returning 404 to user: Instance 3c687b7a-617f-46d4-b1c1-c629814fac1a could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:48:36.612342 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ac726da7-8d01-46f7-bc64-1224862bca7b tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/3c687b7a-617f-46d4-b1c1-c629814fac1a" status: 404 len: 111 microversion: 2.1 time: 0.107692 Aug 04 16:48:36.624717 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1356/2723] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:36 2022] GET /compute/v2.1/servers/3c687b7a-617f-46d4-b1c1-c629814fac1a => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:48:36.628172 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ecd44189-95ce-4c05-b6d8-42a41270775a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:36.628848 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ecd44189-95ce-4c05-b6d8-42a41270775a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:36.646319 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ecd44189-95ce-4c05-b6d8-42a41270775a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:36.646780 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ecd44189-95ce-4c05-b6d8-42a41270775a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:36.648336 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ecd44189-95ce-4c05-b6d8-42a41270775a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:36.650351 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ecd44189-95ce-4c05-b6d8-42a41270775a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:36.686151 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-ecd44189-95ce-4c05-b6d8-42a41270775a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] HTTP exception thrown: Instance f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be could not be found. Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ecd44189-95ce-4c05-b6d8-42a41270775a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Request method failure captured: Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be HTTP/1.1 Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_d0PWjKRFBWfxAhJyM9Llb5b9qIi5YfrBNXPAsDzIFh8zYJUWCF3RzIK4AGkYlNQVK5Am3F8P2Rbt4hrCuiVYFRb2bix8zHglKpYs5ivud-NO1ZEo-kW7N3_XgRhYscv5AJxIc_PiyQmdBCcRjkSDOpLzajPb1FiA8gOmTp1smuuJo Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: b9e709c95a964cd5855d4e253aeb1043 Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersOnMultiNodesTest-576816232 Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9e709c95a964cd5855d4e253aeb1043"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b9e709c95a964cd5855d4e253aeb1043"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9e709c95a964cd5855d4e253aeb1043"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b9e709c95a964cd5855d4e253aeb1043"}]}] Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersOnMultiNodesTest-576816232 Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: b9e709c95a964cd5855d4e253aeb1043 Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-576816232 Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersOnMultiNodesTest-576816232-project Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 336c26b5dd6644bc83f9b80adac06bce Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersOnMultiNodesTest-576816232-project Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be could not be found. Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be'} Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be could not be found. Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be could not be found. Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:36.691114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:36.695940 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:36.695940 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:36.695940 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:36.695940 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:48:36.695940 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:48:36.695940 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be could not be found. Aug 04 16:48:36.695940 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:36.702547 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ecd44189-95ce-4c05-b6d8-42a41270775a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Returning 404 to user: Instance f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:48:36.706429 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ecd44189-95ce-4c05-b6d8-42a41270775a tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be" status: 404 len: 111 microversion: 2.1 time: 0.081555 Aug 04 16:48:36.709008 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1368/2724] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:36 2022] GET /compute/v2.1/servers/f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:48:36.734439 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a67c219a-2665-4517-9c00-eebbfc88fe52 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:36.818205 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a67c219a-2665-4517-9c00-eebbfc88fe52 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/752ef6cd-d50c-4a56-b56f-fc340448c45d" status: 204 len: 0 microversion: 2.1 time: 0.099946 Aug 04 16:48:36.829004 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1357/2725] 10.222.0.23 () {58 vars in 1266 bytes} [Thu Aug 4 16:48:36 2022] DELETE /compute/v2.1/os-server-groups/752ef6cd-d50c-4a56-b56f-fc340448c45d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:48:36.834556 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-59a64d0f-da37-4a65-9b62-28874b92cb8c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:36.835199 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-59a64d0f-da37-4a65-9b62-28874b92cb8c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 43de7756-af0e-4833-9b96-73843a67532c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:36.847424 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-59a64d0f-da37-4a65-9b62-28874b92cb8c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:36.848083 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-59a64d0f-da37-4a65-9b62-28874b92cb8c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:36.850352 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-59a64d0f-da37-4a65-9b62-28874b92cb8c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:36.852290 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-59a64d0f-da37-4a65-9b62-28874b92cb8c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:36.922373 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e2af5360-0993-4b5f-9698-71876465192f tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:36.930481 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e2af5360-0993-4b5f-9698-71876465192f tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] [instance: a1d675a4-bcdd-4551-ba93-11f334a56e95] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:36.936451 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-59a64d0f-da37-4a65-9b62-28874b92cb8c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 43de7756-af0e-4833-9b96-73843a67532c] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:48:36.950407 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e2af5360-0993-4b5f-9698-71876465192f tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:36.951994 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e2af5360-0993-4b5f-9698-71876465192f tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:36.953656 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e2af5360-0993-4b5f-9698-71876465192f tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:36.954414 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e2af5360-0993-4b5f-9698-71876465192f tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:37.189163 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e2af5360-0993-4b5f-9698-71876465192f tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:37.231689 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e2af5360-0993-4b5f-9698-71876465192f tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:37.267984 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e2af5360-0993-4b5f-9698-71876465192f tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:37.294334 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e2af5360-0993-4b5f-9698-71876465192f tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] 10.222.0.23 "GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95" status: 200 len: 1409 microversion: 2.54 time: 0.378647 Aug 04 16:48:37.298336 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1358/2726] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:48:36 2022] GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95 => generated 1409 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:48:37.330815 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3f80a973-1b82-471a-8311-4be17118a591 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:37.357773 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3f80a973-1b82-471a-8311-4be17118a591 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:37.384458 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3f80a973-1b82-471a-8311-4be17118a591 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:37.385862 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3f80a973-1b82-471a-8311-4be17118a591 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:37.392241 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-59a64d0f-da37-4a65-9b62-28874b92cb8c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "DELETE /compute/v2.1/servers/43de7756-af0e-4833-9b96-73843a67532c" status: 204 len: 0 microversion: 2.1 time: 0.561497 Aug 04 16:48:37.394889 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3f80a973-1b82-471a-8311-4be17118a591 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:37.399567 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3f80a973-1b82-471a-8311-4be17118a591 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:37.412045 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1369/2727] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:48:36 2022] DELETE /compute/v2.1/servers/43de7756-af0e-4833-9b96-73843a67532c => generated 0 bytes in 577 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:48:37.447672 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cd746252-1cbd-473f-8a12-b2a22f783aed tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:37.456783 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cd746252-1cbd-473f-8a12-b2a22f783aed tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: cc98a160-2abd-430e-8ea7-492777d8a226] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:37.488509 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cd746252-1cbd-473f-8a12-b2a22f783aed tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:37.499311 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cd746252-1cbd-473f-8a12-b2a22f783aed tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:37.500775 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cd746252-1cbd-473f-8a12-b2a22f783aed tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:37.501832 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cd746252-1cbd-473f-8a12-b2a22f783aed tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:37.653539 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cd746252-1cbd-473f-8a12-b2a22f783aed tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: cc98a160-2abd-430e-8ea7-492777d8a226] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:48:37.982053 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cd746252-1cbd-473f-8a12-b2a22f783aed tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226" status: 204 len: 0 microversion: 2.1 time: 0.567312 Aug 04 16:48:37.983446 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1370/2728] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:48:37 2022] DELETE /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:48:37.992312 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ba4f7a2e-8394-4211-96a7-8f1079dcff71 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:37.997958 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ba4f7a2e-8394-4211-96a7-8f1079dcff71 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 43de7756-af0e-4833-9b96-73843a67532c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:38.012643 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba4f7a2e-8394-4211-96a7-8f1079dcff71 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:38.024728 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba4f7a2e-8394-4211-96a7-8f1079dcff71 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:38.029415 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba4f7a2e-8394-4211-96a7-8f1079dcff71 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:38.031224 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba4f7a2e-8394-4211-96a7-8f1079dcff71 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:38.180547 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3f80a973-1b82-471a-8311-4be17118a591 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:38.232464 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3f80a973-1b82-471a-8311-4be17118a591 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1524 microversion: 2.1 time: 0.923810 Aug 04 16:48:38.266837 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1359/2729] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:37 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1524 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:38.276151 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-72be0c99-e574-4d28-8200-3ea5db0da07e req-ba302e34-39de-42e5-a228-edeca09d64d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be", "name": "network-vif-deleted", "tag": "5b3bfd83-b1f7-4c0c-9a5b-1aa6390e316d"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:48:38.327678 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-72be0c99-e574-4d28-8200-3ea5db0da07e req-ba302e34-39de-42e5-a228-edeca09d64d7 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:38.329474 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-72be0c99-e574-4d28-8200-3ea5db0da07e req-ba302e34-39de-42e5-a228-edeca09d64d7 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:38.395791 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-72be0c99-e574-4d28-8200-3ea5db0da07e req-ba302e34-39de-42e5-a228-edeca09d64d7 service nova] Creating event network-vif-deleted:5b3bfd83-b1f7-4c0c-9a5b-1aa6390e316d for instance f14ce5ac-10f0-42f0-8cc4-ae1a0e91d6be on n-h1-846466-12 Aug 04 16:48:38.403908 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-72be0c99-e574-4d28-8200-3ea5db0da07e req-ba302e34-39de-42e5-a228-edeca09d64d7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135010 Aug 04 16:48:38.412014 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1360/2730] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:48:38.422276 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-04a960ec-70a0-4096-95f1-4d611b439b4e tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:38.429867 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-04a960ec-70a0-4096-95f1-4d611b439b4e tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] [instance: a1d675a4-bcdd-4551-ba93-11f334a56e95] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:38.450093 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-04a960ec-70a0-4096-95f1-4d611b439b4e tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:38.451197 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-04a960ec-70a0-4096-95f1-4d611b439b4e tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:38.452397 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-04a960ec-70a0-4096-95f1-4d611b439b4e tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:38.453021 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-04a960ec-70a0-4096-95f1-4d611b439b4e tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:38.787666 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ba4f7a2e-8394-4211-96a7-8f1079dcff71 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:38.803782 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ba4f7a2e-8394-4211-96a7-8f1079dcff71 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/43de7756-af0e-4833-9b96-73843a67532c" status: 200 len: 1474 microversion: 2.1 time: 0.815412 Aug 04 16:48:38.805341 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1371/2731] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:37 2022] GET /compute/v2.1/servers/43de7756-af0e-4833-9b96-73843a67532c => generated 1474 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:38.879234 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-04a960ec-70a0-4096-95f1-4d611b439b4e tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:38.920217 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-04a960ec-70a0-4096-95f1-4d611b439b4e tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:38.932091 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-04a960ec-70a0-4096-95f1-4d611b439b4e tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:38.939466 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-04a960ec-70a0-4096-95f1-4d611b439b4e tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] 10.222.0.23 "GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95" status: 200 len: 1409 microversion: 2.54 time: 0.520871 Aug 04 16:48:38.940786 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1361/2732] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:48:38 2022] GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95 => generated 1409 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:48:39.275811 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-690ce8e4-0b24-4ab9-9ebb-0d209cf92491 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:39.276678 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-690ce8e4-0b24-4ab9-9ebb-0d209cf92491 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:39.294860 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-690ce8e4-0b24-4ab9-9ebb-0d209cf92491 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:39.296963 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-690ce8e4-0b24-4ab9-9ebb-0d209cf92491 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:39.302988 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-690ce8e4-0b24-4ab9-9ebb-0d209cf92491 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:39.304903 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-690ce8e4-0b24-4ab9-9ebb-0d209cf92491 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:39.839107 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4f657f33-4597-4c5b-9d94-7a72134f6b93 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:39.840638 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4f657f33-4597-4c5b-9d94-7a72134f6b93 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 43de7756-af0e-4833-9b96-73843a67532c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:39.863943 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4f657f33-4597-4c5b-9d94-7a72134f6b93 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:39.872808 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4f657f33-4597-4c5b-9d94-7a72134f6b93 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:39.874115 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4f657f33-4597-4c5b-9d94-7a72134f6b93 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:39.881896 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4f657f33-4597-4c5b-9d94-7a72134f6b93 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:40.806610 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-690ce8e4-0b24-4ab9-9ebb-0d209cf92491 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:40.822044 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4f657f33-4597-4c5b-9d94-7a72134f6b93 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:40.834876 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-690ce8e4-0b24-4ab9-9ebb-0d209cf92491 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1524 microversion: 2.1 time: 1.565086 Aug 04 16:48:40.836127 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4f657f33-4597-4c5b-9d94-7a72134f6b93 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/43de7756-af0e-4833-9b96-73843a67532c" status: 200 len: 1432 microversion: 2.1 time: 1.010312 Aug 04 16:48:40.838377 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1372/2733] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:39 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1524 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:40.840783 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1362/2734] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:39 2022] GET /compute/v2.1/servers/43de7756-af0e-4833-9b96-73843a67532c => generated 1432 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:40.852670 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ceaba9a3-7d71-435a-aff8-be8bb09d3126 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:40.854331 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ceaba9a3-7d71-435a-aff8-be8bb09d3126 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] [instance: a1d675a4-bcdd-4551-ba93-11f334a56e95] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:40.878696 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ceaba9a3-7d71-435a-aff8-be8bb09d3126 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:40.879636 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ceaba9a3-7d71-435a-aff8-be8bb09d3126 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:40.882862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ceaba9a3-7d71-435a-aff8-be8bb09d3126 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:40.886660 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ceaba9a3-7d71-435a-aff8-be8bb09d3126 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:41.529513 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ceaba9a3-7d71-435a-aff8-be8bb09d3126 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:41.555432 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ceaba9a3-7d71-435a-aff8-be8bb09d3126 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:41.570596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ceaba9a3-7d71-435a-aff8-be8bb09d3126 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:41.573262 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ceaba9a3-7d71-435a-aff8-be8bb09d3126 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] 10.222.0.23 "GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95" status: 200 len: 1409 microversion: 2.54 time: 0.733279 Aug 04 16:48:41.579958 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1373/2735] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:48:40 2022] GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95 => generated 1409 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:48:41.604359 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-6b3375e3-5f03-4689-9902-0d4026400047 req-a4613577-31dc-4db3-9db6-6c4a8f025004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43de7756-af0e-4833-9b96-73843a67532c", "name": "network-vif-deleted", "tag": "c105eb13-4f08-4bde-af50-0ff69cb99472"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:48:41.678152 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-6b3375e3-5f03-4689-9902-0d4026400047 req-a4613577-31dc-4db3-9db6-6c4a8f025004 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:41.679621 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-6b3375e3-5f03-4689-9902-0d4026400047 req-a4613577-31dc-4db3-9db6-6c4a8f025004 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:41.750715 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-6b3375e3-5f03-4689-9902-0d4026400047 req-a4613577-31dc-4db3-9db6-6c4a8f025004 service nova] Creating event network-vif-deleted:c105eb13-4f08-4bde-af50-0ff69cb99472 for instance 43de7756-af0e-4833-9b96-73843a67532c on n-h2-846466-12 Aug 04 16:48:41.771138 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-6b3375e3-5f03-4689-9902-0d4026400047 req-a4613577-31dc-4db3-9db6-6c4a8f025004 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172662 Aug 04 16:48:41.773254 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1363/2736] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:48:41.895876 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a1cc0f10-4251-44ec-92f7-e4161aace394 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:41.906370 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-59579daa-b3d7-4318-8d09-86289f844d74 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:41.911040 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a1cc0f10-4251-44ec-92f7-e4161aace394 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 43de7756-af0e-4833-9b96-73843a67532c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:41.915671 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-59579daa-b3d7-4318-8d09-86289f844d74 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:41.949377 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:48:41.956604 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-59579daa-b3d7-4318-8d09-86289f844d74 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:41.959785 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a1cc0f10-4251-44ec-92f7-e4161aace394 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:41.963706 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-59579daa-b3d7-4318-8d09-86289f844d74 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:41.964775 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a1cc0f10-4251-44ec-92f7-e4161aace394 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:41.966590 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-59579daa-b3d7-4318-8d09-86289f844d74 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:41.968368 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a1cc0f10-4251-44ec-92f7-e4161aace394 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:41.969562 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-59579daa-b3d7-4318-8d09-86289f844d74 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:41.974898 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a1cc0f10-4251-44ec-92f7-e4161aace394 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:42.191585 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a1cc0f10-4251-44ec-92f7-e4161aace394 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:42.194214 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a1cc0f10-4251-44ec-92f7-e4161aace394 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:42.195161 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-a1cc0f10-4251-44ec-92f7-e4161aace394 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lazy-loading 'fault' on Instance uuid 43de7756-af0e-4833-9b96-73843a67532c {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:48:42.380769 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a1cc0f10-4251-44ec-92f7-e4161aace394 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:42.429971 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a1cc0f10-4251-44ec-92f7-e4161aace394 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/43de7756-af0e-4833-9b96-73843a67532c" status: 200 len: 1308 microversion: 2.1 time: 0.558564 Aug 04 16:48:42.437515 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1374/2737] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:41 2022] GET /compute/v2.1/servers/43de7756-af0e-4833-9b96-73843a67532c => generated 1308 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:42.617867 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-59579daa-b3d7-4318-8d09-86289f844d74 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:42.631807 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-59579daa-b3d7-4318-8d09-86289f844d74 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1524 microversion: 2.1 time: 0.755826 Aug 04 16:48:42.632092 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3804016a-2912-46a5-a32e-a812a67b21c0 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:42.632766 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3804016a-2912-46a5-a32e-a812a67b21c0 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] [instance: a1d675a4-bcdd-4551-ba93-11f334a56e95] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:42.644301 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1364/2738] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:41 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1524 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:42.651203 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3804016a-2912-46a5-a32e-a812a67b21c0 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:42.652137 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3804016a-2912-46a5-a32e-a812a67b21c0 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:42.653240 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3804016a-2912-46a5-a32e-a812a67b21c0 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:42.654250 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3804016a-2912-46a5-a32e-a812a67b21c0 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:42.708181 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:48:42.949837 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3804016a-2912-46a5-a32e-a812a67b21c0 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:42.967761 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3804016a-2912-46a5-a32e-a812a67b21c0 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:42.973249 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3804016a-2912-46a5-a32e-a812a67b21c0 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:42.979195 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3804016a-2912-46a5-a32e-a812a67b21c0 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] 10.222.0.23 "GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95" status: 200 len: 1427 microversion: 2.54 time: 0.358652 Aug 04 16:48:42.980411 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1375/2739] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:48:42 2022] GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95 => generated 1427 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:48:43.458364 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9318d5b5-d40f-48c8-b217-b00f4c2cc4f1 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:43.459314 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9318d5b5-d40f-48c8-b217-b00f4c2cc4f1 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 43de7756-af0e-4833-9b96-73843a67532c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:43.472973 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9318d5b5-d40f-48c8-b217-b00f4c2cc4f1 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:43.476507 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9318d5b5-d40f-48c8-b217-b00f4c2cc4f1 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:43.477632 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9318d5b5-d40f-48c8-b217-b00f4c2cc4f1 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:43.478082 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9318d5b5-d40f-48c8-b217-b00f4c2cc4f1 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:43.526643 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-9318d5b5-d40f-48c8-b217-b00f4c2cc4f1 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] HTTP exception thrown: Instance 43de7756-af0e-4833-9b96-73843a67532c could not be found. Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9318d5b5-d40f-48c8-b217-b00f4c2cc4f1 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Request method failure captured: Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/43de7756-af0e-4833-9b96-73843a67532c HTTP/1.1 Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_d0PWjKRFBWfxAhJyM9Llb5b9qIi5YfrBNXPAsDzIFh8zYJUWCF3RzIK4AGkYlNQVK5Am3F8P2Rbt4hrCuiVYFRb2bix8zHglKpYs5ivud-NO1ZEo-kW7N3_XgRhYscv5AJxIc_PiyQmdBCcRjkSDOpLzajPb1FiA8gOmTp1smuuJo Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: b9e709c95a964cd5855d4e253aeb1043 Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersOnMultiNodesTest-576816232 Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9e709c95a964cd5855d4e253aeb1043"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b9e709c95a964cd5855d4e253aeb1043"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9e709c95a964cd5855d4e253aeb1043"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b9e709c95a964cd5855d4e253aeb1043"}]}] Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersOnMultiNodesTest-576816232 Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: b9e709c95a964cd5855d4e253aeb1043 Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-576816232 Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersOnMultiNodesTest-576816232-project Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 336c26b5dd6644bc83f9b80adac06bce Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersOnMultiNodesTest-576816232-project Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 43de7756-af0e-4833-9b96-73843a67532c could not be found. Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '43de7756-af0e-4833-9b96-73843a67532c'} Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43de7756-af0e-4833-9b96-73843a67532c could not be found. Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43de7756-af0e-4833-9b96-73843a67532c could not be found. Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:43.533181 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:43.537202 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:43.537202 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:43.537202 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:43.537202 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:48:43.537202 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:48:43.537202 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43de7756-af0e-4833-9b96-73843a67532c could not be found. Aug 04 16:48:43.537202 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:43.537202 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9318d5b5-d40f-48c8-b217-b00f4c2cc4f1 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Returning 404 to user: Instance 43de7756-af0e-4833-9b96-73843a67532c could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:48:43.537202 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9318d5b5-d40f-48c8-b217-b00f4c2cc4f1 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/43de7756-af0e-4833-9b96-73843a67532c" status: 404 len: 111 microversion: 2.1 time: 0.084930 Aug 04 16:48:43.544234 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1376/2740] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:43 2022] GET /compute/v2.1/servers/43de7756-af0e-4833-9b96-73843a67532c => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:48:43.553487 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ad10f918-ce73-4349-868a-63a575bc9d22 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:43.559774 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ad10f918-ce73-4349-868a-63a575bc9d22 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: cc98a160-2abd-430e-8ea7-492777d8a226] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:43.579812 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad10f918-ce73-4349-868a-63a575bc9d22 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:43.580263 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad10f918-ce73-4349-868a-63a575bc9d22 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:43.584548 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad10f918-ce73-4349-868a-63a575bc9d22 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:43.586955 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad10f918-ce73-4349-868a-63a575bc9d22 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:43.594187 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-af8ce17a-e29b-4957-893e-f66129a5a6de req-01a78f12-d658-44a2-b26b-dc5cd7a4c20c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73dff433-5880-43ec-b799-1230245db7f7", "name": "network-vif-plugged", "status": "completed", "tag": "cb07355a-33e6-4a7b-87c1-59ad0e6d64ce"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:48:43.667134 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-af8ce17a-e29b-4957-893e-f66129a5a6de req-01a78f12-d658-44a2-b26b-dc5cd7a4c20c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:43.669330 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-af8ce17a-e29b-4957-893e-f66129a5a6de req-01a78f12-d658-44a2-b26b-dc5cd7a4c20c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:43.743898 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-af8ce17a-e29b-4957-893e-f66129a5a6de req-01a78f12-d658-44a2-b26b-dc5cd7a4c20c service nova] Creating event network-vif-plugged:cb07355a-33e6-4a7b-87c1-59ad0e6d64ce for instance 73dff433-5880-43ec-b799-1230245db7f7 on n-h1-846466-12 Aug 04 16:48:43.754045 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-af8ce17a-e29b-4957-893e-f66129a5a6de req-01a78f12-d658-44a2-b26b-dc5cd7a4c20c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.524963 Aug 04 16:48:43.761827 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1365/2741] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:48:43.798423 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-47e2f131-888d-4d54-9f1b-25e6d8d9e86c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:43.799968 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-47e2f131-888d-4d54-9f1b-25e6d8d9e86c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:43.814980 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-47e2f131-888d-4d54-9f1b-25e6d8d9e86c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:43.815686 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-47e2f131-888d-4d54-9f1b-25e6d8d9e86c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:43.816852 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-47e2f131-888d-4d54-9f1b-25e6d8d9e86c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:43.817609 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-47e2f131-888d-4d54-9f1b-25e6d8d9e86c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:44.077258 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ad10f918-ce73-4349-868a-63a575bc9d22 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:44.104460 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ad10f918-ce73-4349-868a-63a575bc9d22 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226" status: 200 len: 1431 microversion: 2.1 time: 0.557009 Aug 04 16:48:44.109398 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1377/2742] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:43 2022] GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226 => generated 1431 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:44.126965 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-99fb6068-3e5b-40ad-81a5-9fbfcc1d1722 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:44.131287 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-99fb6068-3e5b-40ad-81a5-9fbfcc1d1722 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] [instance: a1d675a4-bcdd-4551-ba93-11f334a56e95] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:44.167531 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-99fb6068-3e5b-40ad-81a5-9fbfcc1d1722 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:44.168090 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-99fb6068-3e5b-40ad-81a5-9fbfcc1d1722 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:44.169143 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-99fb6068-3e5b-40ad-81a5-9fbfcc1d1722 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:44.178016 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-99fb6068-3e5b-40ad-81a5-9fbfcc1d1722 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:44.461854 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-99fb6068-3e5b-40ad-81a5-9fbfcc1d1722 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:44.493855 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-99fb6068-3e5b-40ad-81a5-9fbfcc1d1722 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:44.497498 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-99fb6068-3e5b-40ad-81a5-9fbfcc1d1722 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:44.499237 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-99fb6068-3e5b-40ad-81a5-9fbfcc1d1722 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] 10.222.0.23 "GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95" status: 200 len: 1415 microversion: 2.54 time: 0.385784 Aug 04 16:48:44.501133 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1378/2743] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:48:44 2022] GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95 => generated 1415 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:48:44.511245 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-5de95af0-6d46-4bac-8eb6-166dfdb2d5f9 req-67d9d093-3069-4026-8bda-d180f27198bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc98a160-2abd-430e-8ea7-492777d8a226", "name": "network-vif-deleted", "tag": "6d22be3f-4df2-4063-b40a-5e24bfd4d685"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:48:44.536102 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-5de95af0-6d46-4bac-8eb6-166dfdb2d5f9 req-67d9d093-3069-4026-8bda-d180f27198bf service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:44.536925 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-5de95af0-6d46-4bac-8eb6-166dfdb2d5f9 req-67d9d093-3069-4026-8bda-d180f27198bf service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:44.558820 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-5de95af0-6d46-4bac-8eb6-166dfdb2d5f9 req-67d9d093-3069-4026-8bda-d180f27198bf service nova] Creating event network-vif-deleted:6d22be3f-4df2-4063-b40a-5e24bfd4d685 for instance cc98a160-2abd-430e-8ea7-492777d8a226 on n-h2-846466-12 Aug 04 16:48:44.568632 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-5de95af0-6d46-4bac-8eb6-166dfdb2d5f9 req-67d9d093-3069-4026-8bda-d180f27198bf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060881 Aug 04 16:48:44.572065 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1379/2744] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:48:44.806014 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-47e2f131-888d-4d54-9f1b-25e6d8d9e86c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:44.912511 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-47e2f131-888d-4d54-9f1b-25e6d8d9e86c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1524 microversion: 2.1 time: 1.113121 Aug 04 16:48:44.914988 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1366/2745] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:43 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1524 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:45.136577 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5407574c-44a6-44b8-8ad2-f7de6cb04b47 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:45.138097 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5407574c-44a6-44b8-8ad2-f7de6cb04b47 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: cc98a160-2abd-430e-8ea7-492777d8a226] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:45.165021 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5407574c-44a6-44b8-8ad2-f7de6cb04b47 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:45.178687 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5407574c-44a6-44b8-8ad2-f7de6cb04b47 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:45.187918 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5407574c-44a6-44b8-8ad2-f7de6cb04b47 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:45.193999 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5407574c-44a6-44b8-8ad2-f7de6cb04b47 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:45.291642 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-5407574c-44a6-44b8-8ad2-f7de6cb04b47 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] HTTP exception thrown: Instance cc98a160-2abd-430e-8ea7-492777d8a226 could not be found. Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5407574c-44a6-44b8-8ad2-f7de6cb04b47 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Request method failure captured: Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226 HTTP/1.1 Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_d0PWjKRFBWfxAhJyM9Llb5b9qIi5YfrBNXPAsDzIFh8zYJUWCF3RzIK4AGkYlNQVK5Am3F8P2Rbt4hrCuiVYFRb2bix8zHglKpYs5ivud-NO1ZEo-kW7N3_XgRhYscv5AJxIc_PiyQmdBCcRjkSDOpLzajPb1FiA8gOmTp1smuuJo Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: b9e709c95a964cd5855d4e253aeb1043 Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersOnMultiNodesTest-576816232 Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9e709c95a964cd5855d4e253aeb1043"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b9e709c95a964cd5855d4e253aeb1043"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9e709c95a964cd5855d4e253aeb1043"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b9e709c95a964cd5855d4e253aeb1043"}]}] Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersOnMultiNodesTest-576816232 Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: b9e709c95a964cd5855d4e253aeb1043 Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-576816232 Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersOnMultiNodesTest-576816232-project Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 336c26b5dd6644bc83f9b80adac06bce Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersOnMultiNodesTest-576816232-project Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance cc98a160-2abd-430e-8ea7-492777d8a226 could not be found. Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'cc98a160-2abd-430e-8ea7-492777d8a226'} Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc98a160-2abd-430e-8ea7-492777d8a226 could not be found. Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc98a160-2abd-430e-8ea7-492777d8a226 could not be found. Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:45.295706 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:45.303388 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:45.303388 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:45.303388 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:45.303388 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:48:45.303388 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:48:45.303388 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc98a160-2abd-430e-8ea7-492777d8a226 could not be found. Aug 04 16:48:45.303388 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:45.311396 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5407574c-44a6-44b8-8ad2-f7de6cb04b47 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Returning 404 to user: Instance cc98a160-2abd-430e-8ea7-492777d8a226 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:48:45.314322 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5407574c-44a6-44b8-8ad2-f7de6cb04b47 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226" status: 404 len: 111 microversion: 2.1 time: 0.185843 Aug 04 16:48:45.317262 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1380/2746] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:45 2022] GET /compute/v2.1/servers/cc98a160-2abd-430e-8ea7-492777d8a226 => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:48:45.324998 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ed228c2f-ab67-4c38-b3dd-c55db2b0d757 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:45.457962 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ed228c2f-ab67-4c38-b3dd-c55db2b0d757 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/9204ead0-2936-4e23-b741-7fe0269ed796" status: 204 len: 0 microversion: 2.1 time: 0.133355 Aug 04 16:48:45.460036 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1367/2747] 10.222.0.23 () {58 vars in 1266 bytes} [Thu Aug 4 16:48:45 2022] DELETE /compute/v2.1/os-server-groups/9204ead0-2936-4e23-b741-7fe0269ed796 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:48:45.483928 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-efefa0c8-8923-4411-af30-a7250b7def96 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:45.487095 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-efefa0c8-8923-4411-af30-a7250b7def96 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 86667237-3005-4ee4-83d6-c250bba481d5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:45.511780 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-efefa0c8-8923-4411-af30-a7250b7def96 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:45.513143 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-efefa0c8-8923-4411-af30-a7250b7def96 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:45.515484 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-efefa0c8-8923-4411-af30-a7250b7def96 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:45.516696 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-efefa0c8-8923-4411-af30-a7250b7def96 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:45.537557 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-63ccc00e-b9aa-4d91-9208-83f6e9a341e6 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:45.557673 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-63ccc00e-b9aa-4d91-9208-83f6e9a341e6 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] [instance: a1d675a4-bcdd-4551-ba93-11f334a56e95] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:45.624333 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63ccc00e-b9aa-4d91-9208-83f6e9a341e6 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:45.627885 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63ccc00e-b9aa-4d91-9208-83f6e9a341e6 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:45.634690 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63ccc00e-b9aa-4d91-9208-83f6e9a341e6 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:45.635143 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63ccc00e-b9aa-4d91-9208-83f6e9a341e6 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:45.742648 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-efefa0c8-8923-4411-af30-a7250b7def96 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 86667237-3005-4ee4-83d6-c250bba481d5] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:48:46.068578 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-63ccc00e-b9aa-4d91-9208-83f6e9a341e6 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:46.085550 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-63ccc00e-b9aa-4d91-9208-83f6e9a341e6 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:46.087184 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-63ccc00e-b9aa-4d91-9208-83f6e9a341e6 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:46.088420 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-63ccc00e-b9aa-4d91-9208-83f6e9a341e6 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] 10.222.0.23 "GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95" status: 200 len: 1415 microversion: 2.54 time: 0.564470 Aug 04 16:48:46.103388 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-efefa0c8-8923-4411-af30-a7250b7def96 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "DELETE /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5" status: 204 len: 0 microversion: 2.1 time: 0.636717 Aug 04 16:48:46.105704 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1381/2748] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:48:45 2022] DELETE /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:48:46.115709 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1368/2749] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:48:45 2022] GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95 => generated 1415 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:48:46.120121 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-769ee853-0fb5-4d54-a912-6308ed0f7ccc tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:46.124616 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d89ba3cd-2b8c-42f4-9293-4c9f18e126e7 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:46.125980 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-769ee853-0fb5-4d54-a912-6308ed0f7ccc tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:46.132088 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d89ba3cd-2b8c-42f4-9293-4c9f18e126e7 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 86667237-3005-4ee4-83d6-c250bba481d5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:46.142926 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-769ee853-0fb5-4d54-a912-6308ed0f7ccc tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:46.143528 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-769ee853-0fb5-4d54-a912-6308ed0f7ccc tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:46.143696 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d89ba3cd-2b8c-42f4-9293-4c9f18e126e7 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:46.144150 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d89ba3cd-2b8c-42f4-9293-4c9f18e126e7 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:46.144953 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d89ba3cd-2b8c-42f4-9293-4c9f18e126e7 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:46.147400 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d89ba3cd-2b8c-42f4-9293-4c9f18e126e7 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:46.157113 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-769ee853-0fb5-4d54-a912-6308ed0f7ccc tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:46.162290 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-769ee853-0fb5-4d54-a912-6308ed0f7ccc tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:47.030782 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-769ee853-0fb5-4d54-a912-6308ed0f7ccc tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:47.055317 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-769ee853-0fb5-4d54-a912-6308ed0f7ccc tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1524 microversion: 2.1 time: 0.947409 Aug 04 16:48:47.056114 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1382/2750] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:46 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1524 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:47.122358 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c2367ab3-dc7a-4e49-a02b-cb90b8ecf096 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:47.123016 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c2367ab3-dc7a-4e49-a02b-cb90b8ecf096 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] [instance: a1d675a4-bcdd-4551-ba93-11f334a56e95] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:47.136634 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2367ab3-dc7a-4e49-a02b-cb90b8ecf096 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:47.137109 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2367ab3-dc7a-4e49-a02b-cb90b8ecf096 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:47.146613 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2367ab3-dc7a-4e49-a02b-cb90b8ecf096 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:47.147274 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2367ab3-dc7a-4e49-a02b-cb90b8ecf096 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:47.338008 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d89ba3cd-2b8c-42f4-9293-4c9f18e126e7 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:47.376439 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d89ba3cd-2b8c-42f4-9293-4c9f18e126e7 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5" status: 200 len: 1472 microversion: 2.1 time: 1.259325 Aug 04 16:48:47.383020 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1369/2751] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:46 2022] GET /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5 => generated 1472 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:47.406889 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a2ea1ea8-fa0e-4536-bcb2-0602add091f0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:47.413341 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a2ea1ea8-fa0e-4536-bcb2-0602add091f0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:47.423381 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a2ea1ea8-fa0e-4536-bcb2-0602add091f0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:47.425521 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a2ea1ea8-fa0e-4536-bcb2-0602add091f0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:47.426653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a2ea1ea8-fa0e-4536-bcb2-0602add091f0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:47.427418 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a2ea1ea8-fa0e-4536-bcb2-0602add091f0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:47.452715 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=100 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:48:47.628948 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c2367ab3-dc7a-4e49-a02b-cb90b8ecf096 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:47.644341 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c2367ab3-dc7a-4e49-a02b-cb90b8ecf096 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:47.646213 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c2367ab3-dc7a-4e49-a02b-cb90b8ecf096 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:47.647420 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c2367ab3-dc7a-4e49-a02b-cb90b8ecf096 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] 10.222.0.23 "GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95" status: 200 len: 1400 microversion: 2.54 time: 0.529090 Aug 04 16:48:47.658676 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1383/2752] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:48:47 2022] GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95 => generated 1400 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:48:47.680762 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-51d2ae8b-83f2-4559-a7d0-34376d10705d tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Calling method '.version_select at 0x7f7e89d4b790>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:47.721872 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-51d2ae8b-83f2-4559-a7d0-34376d10705d tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-2006283829" status: 204 len: 0 microversion: 2.54 time: 0.047347 Aug 04 16:48:47.726079 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1384/2753] 10.222.0.23 () {60 vars in 1319 bytes} [Thu Aug 4 16:48:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-2006283829 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 04 16:48:47.735446 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8005a7d2-773c-4176-a2b6-309cc5ac3688 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:47.736299 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8005a7d2-773c-4176-a2b6-309cc5ac3688 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] [instance: a1d675a4-bcdd-4551-ba93-11f334a56e95] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:47.768908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8005a7d2-773c-4176-a2b6-309cc5ac3688 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:47.769718 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8005a7d2-773c-4176-a2b6-309cc5ac3688 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:47.771077 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8005a7d2-773c-4176-a2b6-309cc5ac3688 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:47.779653 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8005a7d2-773c-4176-a2b6-309cc5ac3688 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:47.860467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8005a7d2-773c-4176-a2b6-309cc5ac3688 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] [instance: a1d675a4-bcdd-4551-ba93-11f334a56e95] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:48:48.143191 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8005a7d2-773c-4176-a2b6-309cc5ac3688 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95" status: 204 len: 0 microversion: 2.54 time: 0.411667 Aug 04 16:48:48.147725 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1385/2754] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Aug 4 16:48:47 2022] DELETE /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 04 16:48:48.155192 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-df6223bc-a172-4eb8-9a40-51be1659cf4e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:48.155915 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-df6223bc-a172-4eb8-9a40-51be1659cf4e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:48.165529 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df6223bc-a172-4eb8-9a40-51be1659cf4e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:48.166338 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df6223bc-a172-4eb8-9a40-51be1659cf4e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:48.167334 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df6223bc-a172-4eb8-9a40-51be1659cf4e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:48.167943 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df6223bc-a172-4eb8-9a40-51be1659cf4e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:48.905138 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a2ea1ea8-fa0e-4536-bcb2-0602add091f0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:48.922213 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a2ea1ea8-fa0e-4536-bcb2-0602add091f0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 1.531938 Aug 04 16:48:48.923845 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1370/2755] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:47 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:48.934351 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-19e98066-6363-4e00-a7f6-340cd5a80bf9 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:48.939182 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-19e98066-6363-4e00-a7f6-340cd5a80bf9 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] [instance: a1d675a4-bcdd-4551-ba93-11f334a56e95] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:48.962503 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-19e98066-6363-4e00-a7f6-340cd5a80bf9 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:48.963290 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-19e98066-6363-4e00-a7f6-340cd5a80bf9 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:48.964673 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-19e98066-6363-4e00-a7f6-340cd5a80bf9 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:48.965486 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-19e98066-6363-4e00-a7f6-340cd5a80bf9 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:49.564065 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-19e98066-6363-4e00-a7f6-340cd5a80bf9 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:49.584291 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-df6223bc-a172-4eb8-9a40-51be1659cf4e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:49.614862 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-df6223bc-a172-4eb8-9a40-51be1659cf4e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1524 microversion: 2.1 time: 1.465642 Aug 04 16:48:49.615475 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1386/2756] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:48 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1524 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:49.622291 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-19e98066-6363-4e00-a7f6-340cd5a80bf9 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:49.632611 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-19e98066-6363-4e00-a7f6-340cd5a80bf9 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:49.635653 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-19e98066-6363-4e00-a7f6-340cd5a80bf9 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] 10.222.0.23 "GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95" status: 200 len: 1406 microversion: 2.54 time: 0.710530 Aug 04 16:48:49.656119 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1371/2757] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:48:48 2022] GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95 => generated 1406 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:48:49.662303 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-884ca3d8-2074-49a4-afa0-c29ac06d149f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:49.667266 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-884ca3d8-2074-49a4-afa0-c29ac06d149f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 86667237-3005-4ee4-83d6-c250bba481d5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:49.700359 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3a75b16e-6165-48b1-8973-4d98aa270923 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:49.705207 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3a75b16e-6165-48b1-8973-4d98aa270923 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:49.718589 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-884ca3d8-2074-49a4-afa0-c29ac06d149f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:49.719166 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-884ca3d8-2074-49a4-afa0-c29ac06d149f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:49.725118 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-884ca3d8-2074-49a4-afa0-c29ac06d149f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:49.726664 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-884ca3d8-2074-49a4-afa0-c29ac06d149f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:49.736085 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a75b16e-6165-48b1-8973-4d98aa270923 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:49.738113 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a75b16e-6165-48b1-8973-4d98aa270923 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:49.743487 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a75b16e-6165-48b1-8973-4d98aa270923 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:49.746453 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a75b16e-6165-48b1-8973-4d98aa270923 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:50.636591 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-884ca3d8-2074-49a4-afa0-c29ac06d149f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:50.664060 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-884ca3d8-2074-49a4-afa0-c29ac06d149f tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5" status: 200 len: 1472 microversion: 2.1 time: 1.041810 Aug 04 16:48:50.672843 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1387/2758] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:49 2022] GET /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5 => generated 1472 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:50.684700 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-69d33139-a31e-4bf8-abd6-6b24d841795a req-aea656fa-ea6e-42e8-a98d-85f0d26b0a93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86667237-3005-4ee4-83d6-c250bba481d5", "name": "network-vif-unplugged", "status": "completed", "tag": "86efd42c-b4ec-48e6-be31-8bf561896203"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:48:50.707594 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3a75b16e-6165-48b1-8973-4d98aa270923 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:50.713004 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-69d33139-a31e-4bf8-abd6-6b24d841795a req-aea656fa-ea6e-42e8-a98d-85f0d26b0a93 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:50.714173 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-69d33139-a31e-4bf8-abd6-6b24d841795a req-aea656fa-ea6e-42e8-a98d-85f0d26b0a93 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:50.719660 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3a75b16e-6165-48b1-8973-4d98aa270923 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 1.058487 Aug 04 16:48:50.721419 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1372/2759] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:49 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:50.732133 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c580d4d1-418c-4c1a-86aa-75ce6497ddf1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:50.736180 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c580d4d1-418c-4c1a-86aa-75ce6497ddf1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:50.748652 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-69d33139-a31e-4bf8-abd6-6b24d841795a req-aea656fa-ea6e-42e8-a98d-85f0d26b0a93 service nova] Creating event network-vif-unplugged:86efd42c-b4ec-48e6-be31-8bf561896203 for instance 86667237-3005-4ee4-83d6-c250bba481d5 on n-h1-846466-12 Aug 04 16:48:50.754865 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c580d4d1-418c-4c1a-86aa-75ce6497ddf1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:50.755591 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c580d4d1-418c-4c1a-86aa-75ce6497ddf1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:50.756721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c580d4d1-418c-4c1a-86aa-75ce6497ddf1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:50.758412 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c580d4d1-418c-4c1a-86aa-75ce6497ddf1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:50.777704 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-69d33139-a31e-4bf8-abd6-6b24d841795a req-aea656fa-ea6e-42e8-a98d-85f0d26b0a93 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100537 Aug 04 16:48:50.782501 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1388/2760] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:48:50.790672 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cff8b744-66df-446f-a720-74ab798d02ca tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:50.791368 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cff8b744-66df-446f-a720-74ab798d02ca tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] [instance: a1d675a4-bcdd-4551-ba93-11f334a56e95] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:50.823680 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cff8b744-66df-446f-a720-74ab798d02ca tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:50.836545 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cff8b744-66df-446f-a720-74ab798d02ca tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:50.837451 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cff8b744-66df-446f-a720-74ab798d02ca tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:50.837899 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cff8b744-66df-446f-a720-74ab798d02ca tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:50.996575 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cff8b744-66df-446f-a720-74ab798d02ca tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:50.997927 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cff8b744-66df-446f-a720-74ab798d02ca tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:50.999999 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-cff8b744-66df-446f-a720-74ab798d02ca tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lazy-loading 'fault' on Instance uuid a1d675a4-bcdd-4551-ba93-11f334a56e95 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:48:51.623176 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cff8b744-66df-446f-a720-74ab798d02ca tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:51.634976 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cff8b744-66df-446f-a720-74ab798d02ca tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:51.641421 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cff8b744-66df-446f-a720-74ab798d02ca tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca08e18f16dd4ded81abc6fe0d2ae0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dcf49d342f431fa9040484372115be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:51.644343 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cff8b744-66df-446f-a720-74ab798d02ca tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] 10.222.0.23 "GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95" status: 200 len: 1411 microversion: 2.54 time: 0.857848 Aug 04 16:48:51.647633 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1389/2761] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:48:50 2022] GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95 => generated 1411 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:48:51.665271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e806884c-a800-4a44-af52-2270efdd9e35 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:51.667406 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e806884c-a800-4a44-af52-2270efdd9e35 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:51.681844 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e806884c-a800-4a44-af52-2270efdd9e35 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:51.683698 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e806884c-a800-4a44-af52-2270efdd9e35 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:51.690948 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e806884c-a800-4a44-af52-2270efdd9e35 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:51.691786 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e806884c-a800-4a44-af52-2270efdd9e35 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:52.167510 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c580d4d1-418c-4c1a-86aa-75ce6497ddf1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:52.181988 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e806884c-a800-4a44-af52-2270efdd9e35 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:52.201121 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e806884c-a800-4a44-af52-2270efdd9e35 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.541156 Aug 04 16:48:52.206850 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c580d4d1-418c-4c1a-86aa-75ce6497ddf1 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1524 microversion: 2.1 time: 1.482892 Aug 04 16:48:52.218936 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1373/2762] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:50 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1524 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:52.239632 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1ef6d753-fa9b-4f75-9dc6-8e1807077110 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:52.240257 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1ef6d753-fa9b-4f75-9dc6-8e1807077110 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 86667237-3005-4ee4-83d6-c250bba481d5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:52.242944 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1390/2763] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:51 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:52.269559 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-c909f7d5-a444-4d02-858e-12337e856c5e req-aba86178-bb33-4876-a78d-10663d8bdcb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86667237-3005-4ee4-83d6-c250bba481d5", "name": "network-vif-deleted", "tag": "86efd42c-b4ec-48e6-be31-8bf561896203"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:48:52.291664 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1ef6d753-fa9b-4f75-9dc6-8e1807077110 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:52.298691 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1ef6d753-fa9b-4f75-9dc6-8e1807077110 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:52.299933 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1ef6d753-fa9b-4f75-9dc6-8e1807077110 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:52.300444 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1ef6d753-fa9b-4f75-9dc6-8e1807077110 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:52.349076 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-c909f7d5-a444-4d02-858e-12337e856c5e req-aba86178-bb33-4876-a78d-10663d8bdcb5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:52.352078 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-c909f7d5-a444-4d02-858e-12337e856c5e req-aba86178-bb33-4876-a78d-10663d8bdcb5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:52.410082 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-c909f7d5-a444-4d02-858e-12337e856c5e req-aba86178-bb33-4876-a78d-10663d8bdcb5 service nova] Creating event network-vif-deleted:86efd42c-b4ec-48e6-be31-8bf561896203 for instance 86667237-3005-4ee4-83d6-c250bba481d5 on n-h1-846466-12 Aug 04 16:48:52.420561 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-c909f7d5-a444-4d02-858e-12337e856c5e req-aba86178-bb33-4876-a78d-10663d8bdcb5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175171 Aug 04 16:48:52.422506 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1391/2764] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:48:52.433826 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-75657545-734c-4458-9b94-5f41ba09d780 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:52.445813 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-75657545-734c-4458-9b94-5f41ba09d780 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:52.460549 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-75657545-734c-4458-9b94-5f41ba09d780 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:52.461260 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-75657545-734c-4458-9b94-5f41ba09d780 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:52.462265 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-75657545-734c-4458-9b94-5f41ba09d780 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:52.462852 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-75657545-734c-4458-9b94-5f41ba09d780 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:52.489265 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1ef6d753-fa9b-4f75-9dc6-8e1807077110 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:52.489789 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1ef6d753-fa9b-4f75-9dc6-8e1807077110 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:52.490303 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-1ef6d753-fa9b-4f75-9dc6-8e1807077110 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lazy-loading 'fault' on Instance uuid 86667237-3005-4ee4-83d6-c250bba481d5 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:48:52.750503 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1ef6d753-fa9b-4f75-9dc6-8e1807077110 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336c26b5dd6644bc83f9b80adac06bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e709c95a964cd5855d4e253aeb1043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:52.766818 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1ef6d753-fa9b-4f75-9dc6-8e1807077110 tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5" status: 200 len: 1307 microversion: 2.1 time: 0.551409 Aug 04 16:48:52.772654 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1374/2765] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:52 2022] GET /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5 => generated 1307 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:52.781935 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-10d86a9c-04d8-4d67-bdc7-11bdf000b3f0 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:52.798432 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-10d86a9c-04d8-4d67-bdc7-11bdf000b3f0 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] [instance: a1d675a4-bcdd-4551-ba93-11f334a56e95] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:52.805982 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-10d86a9c-04d8-4d67-bdc7-11bdf000b3f0 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:52.806442 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-10d86a9c-04d8-4d67-bdc7-11bdf000b3f0 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:52.807241 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-10d86a9c-04d8-4d67-bdc7-11bdf000b3f0 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:52.807659 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-10d86a9c-04d8-4d67-bdc7-11bdf000b3f0 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:52.829142 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-75657545-734c-4458-9b94-5f41ba09d780 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:52.848243 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-10d86a9c-04d8-4d67-bdc7-11bdf000b3f0 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] HTTP exception thrown: Instance a1d675a4-bcdd-4551-ba93-11f334a56e95 could not be found. Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-10d86a9c-04d8-4d67-bdc7-11bdf000b3f0 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Request method failure captured: Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95 HTTP/1.1 Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_hCantUPhRhPMIOY8SU4KGXWtQjpaMpKuM3qbrSC5E7RYqWNJYGcdE4ljwcr1algEZrLXLziM1kQzO88QwfsHaNmDIg_967yjhHcUbEZe3P8E8EomMR17q4CMhgyf2exGf3tJVTdtE8maB19dviNtBop62BCVweM6rK9yh53gqULa0 Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: X-Openstack-Nova-Api-Version: 2.54 Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: d3dcf49d342f431fa9040484372115be Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServerShowV254Test-993836113 Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3dcf49d342f431fa9040484372115be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d3dcf49d342f431fa9040484372115be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3dcf49d342f431fa9040484372115be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d3dcf49d342f431fa9040484372115be"}]}] Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServerShowV254Test-993836113 Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: d3dcf49d342f431fa9040484372115be Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServerShowV254Test-993836113 Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServerShowV254Test-993836113-project Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: ca08e18f16dd4ded81abc6fe0d2ae0ac Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServerShowV254Test-993836113-project Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance a1d675a4-bcdd-4551-ba93-11f334a56e95 could not be found. Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'a1d675a4-bcdd-4551-ba93-11f334a56e95'} Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1d675a4-bcdd-4551-ba93-11f334a56e95 could not be found. Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1d675a4-bcdd-4551-ba93-11f334a56e95 could not be found. Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:52.852643 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:52.860596 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:52.860596 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:52.860596 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:52.860596 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:48:52.860596 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:48:52.860596 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1d675a4-bcdd-4551-ba93-11f334a56e95 could not be found. Aug 04 16:48:52.860596 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:48:52.860596 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-10d86a9c-04d8-4d67-bdc7-11bdf000b3f0 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] Returning 404 to user: Instance a1d675a4-bcdd-4551-ba93-11f334a56e95 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:48:52.860596 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-10d86a9c-04d8-4d67-bdc7-11bdf000b3f0 tempest-ServerShowV254Test-993836113 tempest-ServerShowV254Test-993836113-project] 10.222.0.23 "GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95" status: 404 len: 111 microversion: 2.54 time: 0.081835 Aug 04 16:48:52.860596 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1375/2766] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:48:52 2022] GET /compute/v2.1/servers/a1d675a4-bcdd-4551-ba93-11f334a56e95 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:48:52.869427 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:48:52.885702 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-75657545-734c-4458-9b94-5f41ba09d780 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.457000 Aug 04 16:48:52.891434 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1392/2767] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:52 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:53.134081 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a0e37234-a8a2-4ab9-a257-4dfdfc075227 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-375738136", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "fcd939fe-a897-44ae-b0c2-2548006a8cea"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:48:53.230346 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a6271366-5ddc-4f43-a492-8323c11c73f7 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:53.231361 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a6271366-5ddc-4f43-a492-8323c11c73f7 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:53.256479 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6271366-5ddc-4f43-a492-8323c11c73f7 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:53.257977 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6271366-5ddc-4f43-a492-8323c11c73f7 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:53.259029 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6271366-5ddc-4f43-a492-8323c11c73f7 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:53.274652 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6271366-5ddc-4f43-a492-8323c11c73f7 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:53.898654 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-a0e37234-a8a2-4ab9-a257-4dfdfc075227 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] validate_networks() for [('fcd939fe-a897-44ae-b0c2-2548006a8cea', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:48:54.603236 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a6271366-5ddc-4f43-a492-8323c11c73f7 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:54.615712 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a6271366-5ddc-4f43-a492-8323c11c73f7 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1524 microversion: 2.1 time: 1.391296 Aug 04 16:48:54.616514 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1393/2768] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:53 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1524 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:54.635493 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f4c44265-5ad5-464a-b675-d0792a07f15c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:54.636433 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f4c44265-5ad5-464a-b675-d0792a07f15c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] [instance: 86667237-3005-4ee4-83d6-c250bba481d5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:54.646313 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f4c44265-5ad5-464a-b675-d0792a07f15c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:54.647164 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f4c44265-5ad5-464a-b675-d0792a07f15c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:54.648243 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f4c44265-5ad5-464a-b675-d0792a07f15c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:54.648924 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f4c44265-5ad5-464a-b675-d0792a07f15c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:54.666956 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-f4c44265-5ad5-464a-b675-d0792a07f15c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] HTTP exception thrown: Instance 86667237-3005-4ee4-83d6-c250bba481d5 could not be found. Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f4c44265-5ad5-464a-b675-d0792a07f15c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Request method failure captured: Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5 HTTP/1.1 Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_d0PWjKRFBWfxAhJyM9Llb5b9qIi5YfrBNXPAsDzIFh8zYJUWCF3RzIK4AGkYlNQVK5Am3F8P2Rbt4hrCuiVYFRb2bix8zHglKpYs5ivud-NO1ZEo-kW7N3_XgRhYscv5AJxIc_PiyQmdBCcRjkSDOpLzajPb1FiA8gOmTp1smuuJo Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: b9e709c95a964cd5855d4e253aeb1043 Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersOnMultiNodesTest-576816232 Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9e709c95a964cd5855d4e253aeb1043"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b9e709c95a964cd5855d4e253aeb1043"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9e709c95a964cd5855d4e253aeb1043"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b9e709c95a964cd5855d4e253aeb1043"}]}] Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersOnMultiNodesTest-576816232 Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: b9e709c95a964cd5855d4e253aeb1043 Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-576816232 Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersOnMultiNodesTest-576816232-project Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 336c26b5dd6644bc83f9b80adac06bce Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersOnMultiNodesTest-576816232-project Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 86667237-3005-4ee4-83d6-c250bba481d5 could not be found. Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '86667237-3005-4ee4-83d6-c250bba481d5'} Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86667237-3005-4ee4-83d6-c250bba481d5 could not be found. Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86667237-3005-4ee4-83d6-c250bba481d5 could not be found. Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:48:54.671636 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:54.676673 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:48:54.676673 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:48:54.676673 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:48:54.676673 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:48:54.676673 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:48:54.676673 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86667237-3005-4ee4-83d6-c250bba481d5 could not be found. Aug 04 16:48:54.676673 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:48:54.680464 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f4c44265-5ad5-464a-b675-d0792a07f15c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] Returning 404 to user: Instance 86667237-3005-4ee4-83d6-c250bba481d5 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:48:54.682609 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f4c44265-5ad5-464a-b675-d0792a07f15c tempest-ServersOnMultiNodesTest-576816232 tempest-ServersOnMultiNodesTest-576816232-project] 10.222.0.23 "GET /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5" status: 404 len: 111 microversion: 2.1 time: 0.051091 Aug 04 16:48:54.686280 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1394/2769] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:54 2022] GET /compute/v2.1/servers/86667237-3005-4ee4-83d6-c250bba481d5 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:48:55.446030 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-a0e37234-a8a2-4ab9-a257-4dfdfc075227 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:48:55.447121 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-a0e37234-a8a2-4ab9-a257-4dfdfc075227 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:48:55.447776 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-a0e37234-a8a2-4ab9-a257-4dfdfc075227 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:48:55.448353 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-a0e37234-a8a2-4ab9-a257-4dfdfc075227 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:48:55.448929 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-a0e37234-a8a2-4ab9-a257-4dfdfc075227 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:48:55.464079 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a0e37234-a8a2-4ab9-a257-4dfdfc075227 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:55.468599 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a0e37234-a8a2-4ab9-a257-4dfdfc075227 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:55.469847 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a0e37234-a8a2-4ab9-a257-4dfdfc075227 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:55.470758 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a0e37234-a8a2-4ab9-a257-4dfdfc075227 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:55.523345 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-a0e37234-a8a2-4ab9-a257-4dfdfc075227 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Getting quotas for project 96ce955c9158463e9e98c53b99c581ec. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:48:55.533132 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-a0e37234-a8a2-4ab9-a257-4dfdfc075227 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Getting quotas for user 438d083dc9e74b2f8970455505791250 and project 96ce955c9158463e9e98c53b99c581ec. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:48:55.571457 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a0e37234-a8a2-4ab9-a257-4dfdfc075227 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:48:55.575253 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a0e37234-a8a2-4ab9-a257-4dfdfc075227 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 316d48b7-d25a-4666-90ce-1fba8a600987] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:48:55.645894 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-94f8e33b-17d0-4550-b315-919df264fe5a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:55.647122 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-94f8e33b-17d0-4550-b315-919df264fe5a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:55.665243 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-94f8e33b-17d0-4550-b315-919df264fe5a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:55.667931 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a0e37234-a8a2-4ab9-a257-4dfdfc075227 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.537735 Aug 04 16:48:55.668451 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-94f8e33b-17d0-4550-b315-919df264fe5a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:55.671487 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-94f8e33b-17d0-4550-b315-919df264fe5a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:55.672223 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-94f8e33b-17d0-4550-b315-919df264fe5a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:55.672808 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1376/2770] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:48:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:48:55.684265 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7a2faa9b-8f5a-49d7-b87c-c81d7e3ae467 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:55.685393 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7a2faa9b-8f5a-49d7-b87c-c81d7e3ae467 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 316d48b7-d25a-4666-90ce-1fba8a600987] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:55.902173 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7a2faa9b-8f5a-49d7-b87c-c81d7e3ae467 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:55.912812 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7a2faa9b-8f5a-49d7-b87c-c81d7e3ae467 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/316d48b7-d25a-4666-90ce-1fba8a600987" status: 200 len: 1214 microversion: 2.1 time: 0.232499 Aug 04 16:48:55.922419 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1377/2771] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:55 2022] GET /compute/v2.1/servers/316d48b7-d25a-4666-90ce-1fba8a600987 => generated 1214 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:48:56.112705 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-94f8e33b-17d0-4550-b315-919df264fe5a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:56.160170 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-94f8e33b-17d0-4550-b315-919df264fe5a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1524 microversion: 2.1 time: 0.518662 Aug 04 16:48:56.185448 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1395/2772] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:55 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1524 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:56.945904 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8814ddb7-0a2d-43db-a0f8-2cc64949ef6d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:56.946948 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8814ddb7-0a2d-43db-a0f8-2cc64949ef6d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 316d48b7-d25a-4666-90ce-1fba8a600987] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:56.969695 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8814ddb7-0a2d-43db-a0f8-2cc64949ef6d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:56.970470 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8814ddb7-0a2d-43db-a0f8-2cc64949ef6d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:56.976280 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8814ddb7-0a2d-43db-a0f8-2cc64949ef6d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:56.979414 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8814ddb7-0a2d-43db-a0f8-2cc64949ef6d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:57.198197 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8590308a-f0d4-49eb-b7b6-d746ef5ef9ee tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:57.206628 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8590308a-f0d4-49eb-b7b6-d746ef5ef9ee tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:57.232662 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8590308a-f0d4-49eb-b7b6-d746ef5ef9ee tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:57.233866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8590308a-f0d4-49eb-b7b6-d746ef5ef9ee tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:57.239900 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8590308a-f0d4-49eb-b7b6-d746ef5ef9ee tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:57.240829 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8590308a-f0d4-49eb-b7b6-d746ef5ef9ee tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:57.247204 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8814ddb7-0a2d-43db-a0f8-2cc64949ef6d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:57.262639 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8814ddb7-0a2d-43db-a0f8-2cc64949ef6d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/316d48b7-d25a-4666-90ce-1fba8a600987" status: 200 len: 1218 microversion: 2.1 time: 0.319403 Aug 04 16:48:57.269115 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1378/2773] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:56 2022] GET /compute/v2.1/servers/316d48b7-d25a-4666-90ce-1fba8a600987 => generated 1218 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:58.003686 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8590308a-f0d4-49eb-b7b6-d746ef5ef9ee tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:58.063145 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8590308a-f0d4-49eb-b7b6-d746ef5ef9ee tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1524 microversion: 2.1 time: 0.868052 Aug 04 16:48:58.085133 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1396/2774] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:57 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1524 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:58.283105 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f21aa61f-4721-46da-b7cc-79f174f0bd73 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:58.284390 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f21aa61f-4721-46da-b7cc-79f174f0bd73 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 316d48b7-d25a-4666-90ce-1fba8a600987] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:58.319981 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f21aa61f-4721-46da-b7cc-79f174f0bd73 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:58.326021 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f21aa61f-4721-46da-b7cc-79f174f0bd73 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:58.327321 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f21aa61f-4721-46da-b7cc-79f174f0bd73 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:58.328009 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f21aa61f-4721-46da-b7cc-79f174f0bd73 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:58.721503 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f21aa61f-4721-46da-b7cc-79f174f0bd73 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:48:58.748890 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f21aa61f-4721-46da-b7cc-79f174f0bd73 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/316d48b7-d25a-4666-90ce-1fba8a600987" status: 200 len: 1274 microversion: 2.1 time: 0.466034 Aug 04 16:48:58.754002 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1379/2775] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:58 2022] GET /compute/v2.1/servers/316d48b7-d25a-4666-90ce-1fba8a600987 => generated 1274 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:48:59.102963 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7d8b6bcc-a13b-464a-ada4-02a791fc8eb3 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:59.103902 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7d8b6bcc-a13b-464a-ada4-02a791fc8eb3 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:59.136200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d8b6bcc-a13b-464a-ada4-02a791fc8eb3 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:59.147072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d8b6bcc-a13b-464a-ada4-02a791fc8eb3 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:59.148531 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d8b6bcc-a13b-464a-ada4-02a791fc8eb3 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:59.149315 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d8b6bcc-a13b-464a-ada4-02a791fc8eb3 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:59.779331 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f60f8888-cb2d-4039-b958-e3461424eea3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:48:59.780222 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f60f8888-cb2d-4039-b958-e3461424eea3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 316d48b7-d25a-4666-90ce-1fba8a600987] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:48:59.789248 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f60f8888-cb2d-4039-b958-e3461424eea3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:59.789732 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f60f8888-cb2d-4039-b958-e3461424eea3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:59.805234 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f60f8888-cb2d-4039-b958-e3461424eea3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:48:59.805631 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f60f8888-cb2d-4039-b958-e3461424eea3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:48:59.998899 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7d8b6bcc-a13b-464a-ada4-02a791fc8eb3 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:00.007250 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7d8b6bcc-a13b-464a-ada4-02a791fc8eb3 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1524 microversion: 2.1 time: 0.914927 Aug 04 16:49:00.023012 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1397/2776] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:59 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1524 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:00.210612 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f60f8888-cb2d-4039-b958-e3461424eea3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:00.219210 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f60f8888-cb2d-4039-b958-e3461424eea3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/316d48b7-d25a-4666-90ce-1fba8a600987" status: 200 len: 1272 microversion: 2.1 time: 0.443691 Aug 04 16:49:00.226604 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1380/2777] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:48:59 2022] GET /compute/v2.1/servers/316d48b7-d25a-4666-90ce-1fba8a600987 => generated 1272 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:00.439622 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b3d5ffaf-0037-4c8b-9904-aa0c17ab677a tempest-ImagesDeleteNegativeTestJSON-712364615 tempest-ImagesDeleteNegativeTestJSON-712364615-project] 10.222.0.23 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.342175 Aug 04 16:49:00.444242 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1398/2778] 10.222.0.23 () {58 vars in 1128 bytes} [Thu Aug 4 16:49:00 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 16:49:00.449823 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d6c1a4a6-c4d3-4302-929a-d11f812cacd3 tempest-ImagesDeleteNegativeTestJSON-712364615 tempest-ImagesDeleteNegativeTestJSON-712364615-project] Calling method '.version_select at 0x7f7e8498a4c0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:01.190275 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-41d6300f-93e8-434b-9dc5-b7bc286ed0e9 tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] Action: 'create', calling method: .version_select at 0x7f7e89cc41f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1723765752"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:49:02.111686 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-41d6300f-93e8-434b-9dc5-b7bc286ed0e9 tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.399507 Aug 04 16:49:02.112740 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1399/2779] 10.222.0.23 () {60 vars in 1155 bytes} [Thu Aug 4 16:49:00 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1401 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 04 16:49:02.117704 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-80f86176-90ae-4d41-80fb-315af6d366c4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:02.118556 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-80f86176-90ae-4d41-80fb-315af6d366c4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:02.166136 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-80f86176-90ae-4d41-80fb-315af6d366c4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:02.166641 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-80f86176-90ae-4d41-80fb-315af6d366c4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:02.167388 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-80f86176-90ae-4d41-80fb-315af6d366c4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:02.167817 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-80f86176-90ae-4d41-80fb-315af6d366c4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:04.888968 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-80f86176-90ae-4d41-80fb-315af6d366c4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:04.898388 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-80f86176-90ae-4d41-80fb-315af6d366c4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1524 microversion: 2.1 time: 2.784453 Aug 04 16:49:04.913207 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1400/2780] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:02 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1524 bytes in 2800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:04.940484 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-94185d72-cdd5-4e45-9cca-74281cf1e93d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:04.941118 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-94185d72-cdd5-4e45-9cca-74281cf1e93d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 316d48b7-d25a-4666-90ce-1fba8a600987] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:04.974026 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-94185d72-cdd5-4e45-9cca-74281cf1e93d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:04.979773 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-94185d72-cdd5-4e45-9cca-74281cf1e93d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:04.984638 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-94185d72-cdd5-4e45-9cca-74281cf1e93d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:04.988040 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-94185d72-cdd5-4e45-9cca-74281cf1e93d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:05.488530 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:49:05.907689 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=8 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:49:05.994166 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-94185d72-cdd5-4e45-9cca-74281cf1e93d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:06.007536 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-94185d72-cdd5-4e45-9cca-74281cf1e93d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/316d48b7-d25a-4666-90ce-1fba8a600987" status: 200 len: 1314 microversion: 2.1 time: 1.093086 Aug 04 16:49:06.008142 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1401/2781] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:04 2022] GET /compute/v2.1/servers/316d48b7-d25a-4666-90ce-1fba8a600987 => generated 1314 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:06.028824 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ede193b4-4e23-4e43-b330-63a0844a1c0e tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] Calling method '.version_select at 0x7f7e89c59d30>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:06.159751 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ede193b4-4e23-4e43-b330-63a0844a1c0e tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/2c59d66e-c97b-4fb5-8cf0-40d66e755095" status: 200 len: 346 microversion: 2.1 time: 0.150012 Aug 04 16:49:06.161665 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1402/2782] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Aug 4 16:49:06 2022] GET /compute/v2.1/os-volumes/2c59d66e-c97b-4fb5-8cf0-40d66e755095 => generated 346 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:49:06.609351 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f4534ee1-df3b-4a82-b228-ab1a85359afe tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:06.613464 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:49:06.613464 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:49:06.617428 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f4534ee1-df3b-4a82-b228-ab1a85359afe tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:06.617980 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f4534ee1-df3b-4a82-b228-ab1a85359afe tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:06.620224 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f4534ee1-df3b-4a82-b228-ab1a85359afe tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:06.622298 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f4534ee1-df3b-4a82-b228-ab1a85359afe tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:06.727760 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f4534ee1-df3b-4a82-b228-ab1a85359afe tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.563972 Aug 04 16:49:06.739112 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1403/2783] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Aug 4 16:49:06 2022] GET /compute/v2.1/os-services => generated 949 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:49:06.762212 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0ae1c65f-2257-496a-9869-c37087108186 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:06.764638 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0ae1c65f-2257-496a-9869-c37087108186 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:06.811100 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ae1c65f-2257-496a-9869-c37087108186 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:06.812850 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ae1c65f-2257-496a-9869-c37087108186 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:06.815851 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ae1c65f-2257-496a-9869-c37087108186 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:06.818501 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ae1c65f-2257-496a-9869-c37087108186 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:07.293330 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0ae1c65f-2257-496a-9869-c37087108186 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:07.307763 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0ae1c65f-2257-496a-9869-c37087108186 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1524 microversion: 2.1 time: 0.565204 Aug 04 16:49:07.308366 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1404/2784] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:06 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1524 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:07.329265 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-11ed6d66-1695-4af6-85de-093c1268729c req-8a53d13d-176b-4d2d-94b5-3e36970baf21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "316d48b7-d25a-4666-90ce-1fba8a600987", "tag": "6d7c513d-1bfc-4e16-86a7-5af2d7a2adf8"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:49:07.355380 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-11ed6d66-1695-4af6-85de-093c1268729c req-8a53d13d-176b-4d2d-94b5-3e36970baf21 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:07.358054 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-11ed6d66-1695-4af6-85de-093c1268729c req-8a53d13d-176b-4d2d-94b5-3e36970baf21 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:07.387151 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-11ed6d66-1695-4af6-85de-093c1268729c req-8a53d13d-176b-4d2d-94b5-3e36970baf21 service nova] Creating event network-changed:6d7c513d-1bfc-4e16-86a7-5af2d7a2adf8 for instance 316d48b7-d25a-4666-90ce-1fba8a600987 on n-h2-846466-12 Aug 04 16:49:07.397170 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-11ed6d66-1695-4af6-85de-093c1268729c req-8a53d13d-176b-4d2d-94b5-3e36970baf21 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085001 Aug 04 16:49:07.398130 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1405/2785] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:49:07.405452 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-acab3442-c265-47bb-8429-384dd9521774 tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] Action: 'create', calling method: .version_select at 0x7f7e89ccdb80>, body: {"snapshot": {"volume_id": "2c59d66e-c97b-4fb5-8cf0-40d66e755095", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1595439886"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:49:07.800878 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-acab3442-c265-47bb-8429-384dd9521774 tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.400967 Aug 04 16:49:07.801723 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1406/2786] 10.222.0.23 () {60 vars in 1162 bytes} [Thu Aug 4 16:49:07 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:49:07.811978 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a4fce1b5-c2d4-4f03-8275-9d62834ab053 tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:07.814940 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:49:07.814940 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:49:07.816259 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a4fce1b5-c2d4-4f03-8275-9d62834ab053 tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:07.816708 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a4fce1b5-c2d4-4f03-8275-9d62834ab053 tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:07.817545 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a4fce1b5-c2d4-4f03-8275-9d62834ab053 tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:07.817984 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a4fce1b5-c2d4-4f03-8275-9d62834ab053 tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:07.872089 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a4fce1b5-c2d4-4f03-8275-9d62834ab053 tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.068853 Aug 04 16:49:07.873077 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1407/2787] 10.222.0.23 () {58 vars in 1170 bytes} [Thu Aug 4 16:49:07 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:49:07.878086 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-86e4d856-90da-416a-b437-09e48b18c917 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:07.879051 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-86e4d856-90da-416a-b437-09e48b18c917 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 316d48b7-d25a-4666-90ce-1fba8a600987] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:07.893380 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-86e4d856-90da-416a-b437-09e48b18c917 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:07.895413 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-86e4d856-90da-416a-b437-09e48b18c917 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:07.896510 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-86e4d856-90da-416a-b437-09e48b18c917 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:07.897115 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-86e4d856-90da-416a-b437-09e48b18c917 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:08.290500 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-d6c1a4a6-c4d3-4302-929a-d11f812cacd3 tempest-ImagesDeleteNegativeTestJSON-712364615 tempest-ImagesDeleteNegativeTestJSON-712364615-project] HTTP exception thrown: Image not found. Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d6c1a4a6-c4d3-4302-929a-d11f812cacd3 tempest-ImagesDeleteNegativeTestJSON-712364615 tempest-ImagesDeleteNegativeTestJSON-712364615-project] Request method failure captured: Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_h7OYTeYe5QeaVS2o9CItGBD3OH0rkcev3w9KnuzYo_dXBYRHgL6JMJtbYTkF5YY5Gx49ROx7ZVusS2kwWS84wTu8m_VUAHtXWV4IimnnUKrffdZ1Q3TGtIOO2SiCg7u7I427cdevn-lpdXpgmTNAZGWcROicBS2ok79OR3sLJgBXo Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 03cb2e961c46473696c505b9de11ce65 Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-712364615 Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03cb2e961c46473696c505b9de11ce65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_03cb2e961c46473696c505b9de11ce65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03cb2e961c46473696c505b9de11ce65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/03cb2e961c46473696c505b9de11ce65"}]}] Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-712364615 Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 03cb2e961c46473696c505b9de11ce65 Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-712364615 Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ImagesDeleteNegativeTestJSON-712364615-project Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 77561a778d6241b280320330b8faf66f Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-712364615-project Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: exception: Image not found. Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '-1'} Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:49:08.292443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:08.299328 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:49:08.299328 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:49:08.299328 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:49:08.299328 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:49:08.299328 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:49:08.299328 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:49:08.299328 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:49:08.299328 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:49:08.299328 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 16:49:08.299328 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 16:49:08.299328 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 16:49:08.299328 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:49:08.299328 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:49:08.299328 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:49:08.299328 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:08.299328 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:49:08.299328 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:49:08.299328 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:49:08.299328 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:49:08.299328 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 16:49:08.299328 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:49:08.299328 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d6c1a4a6-c4d3-4302-929a-d11f812cacd3 tempest-ImagesDeleteNegativeTestJSON-712364615 tempest-ImagesDeleteNegativeTestJSON-712364615-project] Returning 404 to user: Image not found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:49:08.299328 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d6c1a4a6-c4d3-4302-929a-d11f812cacd3 tempest-ImagesDeleteNegativeTestJSON-712364615 tempest-ImagesDeleteNegativeTestJSON-712364615-project] 10.222.0.23 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 7.847969 Aug 04 16:49:08.299328 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1381/2788] 10.222.0.23 () {58 vars in 1134 bytes} [Thu Aug 4 16:49:00 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 7849 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:49:08.305004 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2573cb09-7c65-471e-860e-76e9280355d2 tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] Calling method '.version_select at 0x7f7e847ed040>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:08.327700 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-86e4d856-90da-416a-b437-09e48b18c917 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:08.337655 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-86e4d856-90da-416a-b437-09e48b18c917 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/316d48b7-d25a-4666-90ce-1fba8a600987" status: 200 len: 1314 microversion: 2.1 time: 0.463204 Aug 04 16:49:08.349328 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1408/2789] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:07 2022] GET /compute/v2.1/servers/316d48b7-d25a-4666-90ce-1fba8a600987 => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:08.350769 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-797069dd-16dd-4397-9588-459fd541d7d8 tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:08.357584 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:49:08.357584 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:49:08.359019 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-797069dd-16dd-4397-9588-459fd541d7d8 tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:08.359452 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-797069dd-16dd-4397-9588-459fd541d7d8 tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:08.360295 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-797069dd-16dd-4397-9588-459fd541d7d8 tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:08.362330 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-797069dd-16dd-4397-9588-459fd541d7d8 tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:08.367789 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2573cb09-7c65-471e-860e-76e9280355d2 tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/d6a0c065-0f93-4498-bca6-b95fa4c15569" status: 200 len: 287 microversion: 2.1 time: 0.066490 Aug 04 16:49:08.368581 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1382/2790] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Aug 4 16:49:08 2022] GET /compute/v2.1/os-snapshots/d6a0c065-0f93-4498-bca6-b95fa4c15569 => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:49:08.374170 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1c2210d2-8230-4466-a415-97ea6f03c85a tempest-ImagesDeleteNegativeTestJSON-712364615 tempest-ImagesDeleteNegativeTestJSON-712364615-project] Calling method '.version_select at 0x7f7e8479c4c0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:08.420412 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-1c2210d2-8230-4466-a415-97ea6f03c85a tempest-ImagesDeleteNegativeTestJSON-712364615 tempest-ImagesDeleteNegativeTestJSON-712364615-project] HTTP exception thrown: Image not found. Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1c2210d2-8230-4466-a415-97ea6f03c85a tempest-ImagesDeleteNegativeTestJSON-712364615 tempest-ImagesDeleteNegativeTestJSON-712364615-project] Request method failure captured: Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/images/3fef189b-2c29-489d-ba75-1eec002c85dj HTTP/1.1 Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_h7OYTeYe5QeaVS2o9CItGBD3OH0rkcev3w9KnuzYo_dXBYRHgL6JMJtbYTkF5YY5Gx49ROx7ZVusS2kwWS84wTu8m_VUAHtXWV4IimnnUKrffdZ1Q3TGtIOO2SiCg7u7I427cdevn-lpdXpgmTNAZGWcROicBS2ok79OR3sLJgBXo Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 03cb2e961c46473696c505b9de11ce65 Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-712364615 Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03cb2e961c46473696c505b9de11ce65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_03cb2e961c46473696c505b9de11ce65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03cb2e961c46473696c505b9de11ce65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/03cb2e961c46473696c505b9de11ce65"}]}] Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-712364615 Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 03cb2e961c46473696c505b9de11ce65 Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-712364615 Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ImagesDeleteNegativeTestJSON-712364615-project Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 77561a778d6241b280320330b8faf66f Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-712364615-project Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: exception: Image not found. Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '3fef189b-2c29-489d-ba75-1eec002c85dj'} Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3fef189b-2c29-489d-ba75-1eec002c85dj to delete Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3fef189b-2c29-489d-ba75-1eec002c85dj could not be found. Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:49:08.422714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:49:08.427348 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:08.427348 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:49:08.427348 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:49:08.427348 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:49:08.427348 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:49:08.427348 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:49:08.427348 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:49:08.427348 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:49:08.427348 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:49:08.427348 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 16:49:08.427348 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 16:49:08.427348 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 16:49:08.427348 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:49:08.427348 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:49:08.427348 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:49:08.427348 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:08.427348 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:49:08.427348 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:49:08.427348 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:49:08.427348 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:49:08.427348 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 16:49:08.427348 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:49:08.430491 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1c2210d2-8230-4466-a415-97ea6f03c85a tempest-ImagesDeleteNegativeTestJSON-712364615 tempest-ImagesDeleteNegativeTestJSON-712364615-project] Returning 404 to user: Image not found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:49:08.431526 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1c2210d2-8230-4466-a415-97ea6f03c85a tempest-ImagesDeleteNegativeTestJSON-712364615 tempest-ImagesDeleteNegativeTestJSON-712364615-project] 10.222.0.23 "DELETE /compute/v2.1/images/3fef189b-2c29-489d-ba75-1eec002c85dj" status: 404 len: 62 microversion: 2.1 time: 0.061846 Aug 04 16:49:08.432250 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1383/2791] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:08 2022] DELETE /compute/v2.1/images/3fef189b-2c29-489d-ba75-1eec002c85dj => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:49:08.439918 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6c092f45-3d9a-4b90-bea0-4ce26ac20779 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:08.450226 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6c092f45-3d9a-4b90-bea0-4ce26ac20779 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:08.452457 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=6,nova_api:INSERT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:49:08.460515 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-797069dd-16dd-4397-9588-459fd541d7d8 tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.120169 Aug 04 16:49:08.464038 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c092f45-3d9a-4b90-bea0-4ce26ac20779 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:08.472062 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1409/2792] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Aug 4 16:49:08 2022] GET /compute/v2.1/os-services => generated 949 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:49:08.472062 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0de419af-0550-4b2f-a6e6-f82804a9c035 tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] Calling method '.version_select at 0x7f7e89cc4430>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:08.487540 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c092f45-3d9a-4b90-bea0-4ce26ac20779 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:08.493405 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c092f45-3d9a-4b90-bea0-4ce26ac20779 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:08.494914 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c092f45-3d9a-4b90-bea0-4ce26ac20779 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:08.591104 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0de419af-0550-4b2f-a6e6-f82804a9c035 tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.124137 Aug 04 16:49:08.592257 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1410/2793] 10.222.0.23 () {58 vars in 1140 bytes} [Thu Aug 4 16:49:08 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:49:08.602012 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f9097d78-7759-4f68-ad8e-f926007c9b70 tempest-ImagesDeleteNegativeTestJSON-712364615 tempest-ImagesDeleteNegativeTestJSON-712364615-project] Calling method '.version_select at 0x7f7e89d134c0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:08.626799 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-f9097d78-7759-4f68-ad8e-f926007c9b70 tempest-ImagesDeleteNegativeTestJSON-712364615 tempest-ImagesDeleteNegativeTestJSON-712364615-project] HTTP exception thrown: Image not found. Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f9097d78-7759-4f68-ad8e-f926007c9b70 tempest-ImagesDeleteNegativeTestJSON-712364615 tempest-ImagesDeleteNegativeTestJSON-712364615-project] Request method failure captured: Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/images/bce31ee8-1b42-4661-9f23-232d6d93846b1 HTTP/1.1 Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_h7OYTeYe5QeaVS2o9CItGBD3OH0rkcev3w9KnuzYo_dXBYRHgL6JMJtbYTkF5YY5Gx49ROx7ZVusS2kwWS84wTu8m_VUAHtXWV4IimnnUKrffdZ1Q3TGtIOO2SiCg7u7I427cdevn-lpdXpgmTNAZGWcROicBS2ok79OR3sLJgBXo Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 03cb2e961c46473696c505b9de11ce65 Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-712364615 Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03cb2e961c46473696c505b9de11ce65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_03cb2e961c46473696c505b9de11ce65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03cb2e961c46473696c505b9de11ce65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/03cb2e961c46473696c505b9de11ce65"}]}] Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-712364615 Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 03cb2e961c46473696c505b9de11ce65 Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-712364615 Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ImagesDeleteNegativeTestJSON-712364615-project Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 77561a778d6241b280320330b8faf66f Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-712364615-project Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: exception: Image not found. Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'bce31ee8-1b42-4661-9f23-232d6d93846b1'} Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image bce31ee8-1b42-4661-9f23-232d6d93846b1 to delete Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bce31ee8-1b42-4661-9f23-232d6d93846b1 could not be found. Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:49:08.637327 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:08.643681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:08.643681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:49:08.643681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:49:08.643681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:49:08.643681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:49:08.643681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:49:08.643681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:49:08.643681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:49:08.643681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:49:08.643681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 16:49:08.643681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 16:49:08.643681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 16:49:08.643681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:08.643681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:49:08.643681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:08.643681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:08.643681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:49:08.643681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:49:08.643681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:49:08.643681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:49:08.643681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 16:49:08.643681 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:08.648646 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f9097d78-7759-4f68-ad8e-f926007c9b70 tempest-ImagesDeleteNegativeTestJSON-712364615 tempest-ImagesDeleteNegativeTestJSON-712364615-project] Returning 404 to user: Image not found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:49:08.649972 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f9097d78-7759-4f68-ad8e-f926007c9b70 tempest-ImagesDeleteNegativeTestJSON-712364615 tempest-ImagesDeleteNegativeTestJSON-712364615-project] 10.222.0.23 "DELETE /compute/v2.1/images/bce31ee8-1b42-4661-9f23-232d6d93846b1" status: 404 len: 62 microversion: 2.1 time: 0.056297 Aug 04 16:49:08.652902 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1411/2794] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:49:08 2022] DELETE /compute/v2.1/images/bce31ee8-1b42-4661-9f23-232d6d93846b1 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:49:08.668647 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fdd0a108-40d5-40c5-ae93-636dd9bb43f7 tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:08.672544 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:49:08.672544 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:49:08.674717 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fdd0a108-40d5-40c5-ae93-636dd9bb43f7 tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:08.675759 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fdd0a108-40d5-40c5-ae93-636dd9bb43f7 tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:08.678323 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fdd0a108-40d5-40c5-ae93-636dd9bb43f7 tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:08.679056 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fdd0a108-40d5-40c5-ae93-636dd9bb43f7 tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:08.714219 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fdd0a108-40d5-40c5-ae93-636dd9bb43f7 tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=n-d-846466-12&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.058491 Aug 04 16:49:08.715549 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1412/2795] 10.222.0.23 () {58 vars in 1196 bytes} [Thu Aug 4 16:49:08 2022] GET /compute/v2.1/os-services?host=n-d-846466-12&binary=xxx => generated 16 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:49:08.722220 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e8302a2b-19e8-4efd-a3ff-09f6b79d601c tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] Calling method '.version_select at 0x7f7e89cc4e50>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:08.778151 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e8302a2b-19e8-4efd-a3ff-09f6b79d601c tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/d6a0c065-0f93-4498-bca6-b95fa4c15569" status: 200 len: 287 microversion: 2.1 time: 0.060618 Aug 04 16:49:08.780098 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1413/2796] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Aug 4 16:49:08 2022] GET /compute/v2.1/os-snapshots/d6a0c065-0f93-4498-bca6-b95fa4c15569 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:49:08.788239 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d19c2857-62dc-4a77-a81c-84719631819e tempest-ImagesDeleteNegativeTestJSON-712364615 tempest-ImagesDeleteNegativeTestJSON-712364615-project] Calling method '.version_select at 0x7f7e89cc4c10>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:08.836792 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-d19c2857-62dc-4a77-a81c-84719631819e tempest-ImagesDeleteNegativeTestJSON-712364615 tempest-ImagesDeleteNegativeTestJSON-712364615-project] HTTP exception thrown: Image not found. Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d19c2857-62dc-4a77-a81c-84719631819e tempest-ImagesDeleteNegativeTestJSON-712364615 tempest-ImagesDeleteNegativeTestJSON-712364615-project] Request method failure captured: Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/images/tempest-invalid-2067027214 HTTP/1.1 Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_h7OYTeYe5QeaVS2o9CItGBD3OH0rkcev3w9KnuzYo_dXBYRHgL6JMJtbYTkF5YY5Gx49ROx7ZVusS2kwWS84wTu8m_VUAHtXWV4IimnnUKrffdZ1Q3TGtIOO2SiCg7u7I427cdevn-lpdXpgmTNAZGWcROicBS2ok79OR3sLJgBXo Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 03cb2e961c46473696c505b9de11ce65 Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-712364615 Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03cb2e961c46473696c505b9de11ce65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_03cb2e961c46473696c505b9de11ce65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03cb2e961c46473696c505b9de11ce65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/03cb2e961c46473696c505b9de11ce65"}]}] Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-712364615 Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 03cb2e961c46473696c505b9de11ce65 Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-712364615 Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ImagesDeleteNegativeTestJSON-712364615-project Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 77561a778d6241b280320330b8faf66f Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-712364615-project Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: exception: Image not found. Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'tempest-invalid-2067027214'} Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-2067027214 to delete Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-2067027214 could not be found. Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:08.838906 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:08.842984 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:49:08.842984 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:49:08.842984 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:49:08.842984 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:49:08.842984 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:49:08.842984 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:49:08.842984 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:49:08.842984 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:49:08.842984 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 16:49:08.842984 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 16:49:08.842984 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 16:49:08.842984 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:08.842984 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:49:08.842984 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:08.842984 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:08.842984 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:49:08.842984 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:49:08.842984 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:49:08.842984 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:49:08.842984 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 16:49:08.842984 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:08.848637 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d19c2857-62dc-4a77-a81c-84719631819e tempest-ImagesDeleteNegativeTestJSON-712364615 tempest-ImagesDeleteNegativeTestJSON-712364615-project] Returning 404 to user: Image not found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:49:08.850424 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d19c2857-62dc-4a77-a81c-84719631819e tempest-ImagesDeleteNegativeTestJSON-712364615 tempest-ImagesDeleteNegativeTestJSON-712364615-project] 10.222.0.23 "DELETE /compute/v2.1/images/tempest-invalid-2067027214" status: 404 len: 62 microversion: 2.1 time: 0.069164 Aug 04 16:49:08.851608 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1414/2797] 10.222.0.23 () {58 vars in 1206 bytes} [Thu Aug 4 16:49:08 2022] DELETE /compute/v2.1/images/tempest-invalid-2067027214 => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:49:08.862902 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-284c59e0-3fba-4301-b070-2a5f803bc63e tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:08.868049 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:49:08.868049 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:49:08.872940 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-284c59e0-3fba-4301-b070-2a5f803bc63e tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:08.878164 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-284c59e0-3fba-4301-b070-2a5f803bc63e tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:08.879721 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-284c59e0-3fba-4301-b070-2a5f803bc63e tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:08.880378 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-284c59e0-3fba-4301-b070-2a5f803bc63e tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:08.948789 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-284c59e0-3fba-4301-b070-2a5f803bc63e tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.095985 Aug 04 16:49:08.957044 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1415/2798] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Aug 4 16:49:08 2022] GET /compute/v2.1/os-services => generated 949 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:49:08.968751 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-aff492d1-8c44-47ab-9c3a-1e6efb185c0e tempest-ImagesDeleteNegativeTestJSON-712364615 tempest-ImagesDeleteNegativeTestJSON-712364615-project] Calling method '.version_select at 0x7f7e841ca670>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:09.017118 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-aff492d1-8c44-47ab-9c3a-1e6efb185c0e tempest-ImagesDeleteNegativeTestJSON-712364615 tempest-ImagesDeleteNegativeTestJSON-712364615-project] HTTP exception thrown: Image not found. Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-aff492d1-8c44-47ab-9c3a-1e6efb185c0e tempest-ImagesDeleteNegativeTestJSON-712364615 tempest-ImagesDeleteNegativeTestJSON-712364615-project] Request method failure captured: Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/images/76675fa8-6ca9-4606-9888-dcf41b47d8f8 HTTP/1.1 Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_h7OYTeYe5QeaVS2o9CItGBD3OH0rkcev3w9KnuzYo_dXBYRHgL6JMJtbYTkF5YY5Gx49ROx7ZVusS2kwWS84wTu8m_VUAHtXWV4IimnnUKrffdZ1Q3TGtIOO2SiCg7u7I427cdevn-lpdXpgmTNAZGWcROicBS2ok79OR3sLJgBXo Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 03cb2e961c46473696c505b9de11ce65 Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-712364615 Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03cb2e961c46473696c505b9de11ce65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_03cb2e961c46473696c505b9de11ce65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03cb2e961c46473696c505b9de11ce65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/03cb2e961c46473696c505b9de11ce65"}]}] Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-712364615 Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 03cb2e961c46473696c505b9de11ce65 Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-712364615 Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ImagesDeleteNegativeTestJSON-712364615-project Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 77561a778d6241b280320330b8faf66f Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-712364615-project Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: exception: Image not found. Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '76675fa8-6ca9-4606-9888-dcf41b47d8f8'} Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 76675fa8-6ca9-4606-9888-dcf41b47d8f8 to delete Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 76675fa8-6ca9-4606-9888-dcf41b47d8f8 could not be found. Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:49:09.018828 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:09.029846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:09.029846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:49:09.029846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:49:09.029846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:49:09.029846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:49:09.029846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:49:09.029846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:49:09.029846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:49:09.029846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:49:09.029846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 16:49:09.029846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 16:49:09.029846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 16:49:09.029846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:09.029846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:49:09.029846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:09.029846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:09.029846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:49:09.029846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:49:09.029846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:49:09.029846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:49:09.029846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 16:49:09.029846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:09.029846 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-aff492d1-8c44-47ab-9c3a-1e6efb185c0e tempest-ImagesDeleteNegativeTestJSON-712364615 tempest-ImagesDeleteNegativeTestJSON-712364615-project] Returning 404 to user: Image not found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:49:09.029846 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-aff492d1-8c44-47ab-9c3a-1e6efb185c0e tempest-ImagesDeleteNegativeTestJSON-712364615 tempest-ImagesDeleteNegativeTestJSON-712364615-project] 10.222.0.23 "DELETE /compute/v2.1/images/76675fa8-6ca9-4606-9888-dcf41b47d8f8" status: 404 len: 62 microversion: 2.1 time: 0.062023 Aug 04 16:49:09.029846 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1416/2799] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:08 2022] DELETE /compute/v2.1/images/76675fa8-6ca9-4606-9888-dcf41b47d8f8 => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:49:09.039702 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-78487d8d-60b0-47aa-8cc0-336fd889cff9 tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:09.065790 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:49:09.065790 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:49:09.074406 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-78487d8d-60b0-47aa-8cc0-336fd889cff9 tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:09.075428 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-78487d8d-60b0-47aa-8cc0-336fd889cff9 tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:09.076747 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-78487d8d-60b0-47aa-8cc0-336fd889cff9 tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:09.077464 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-78487d8d-60b0-47aa-8cc0-336fd889cff9 tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:09.113913 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-78487d8d-60b0-47aa-8cc0-336fd889cff9 tempest-ServicesAdminNegativeTestJSON-1250460577 tempest-ServicesAdminNegativeTestJSON-1250460577-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.091486 Aug 04 16:49:09.122471 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1417/2800] 10.222.0.23 () {58 vars in 1198 bytes} [Thu Aug 4 16:49:09 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:49:09.308737 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6c092f45-3d9a-4b90-bea0-4ce26ac20779 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:09.320412 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6c092f45-3d9a-4b90-bea0-4ce26ac20779 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1524 microversion: 2.1 time: 0.886686 Aug 04 16:49:09.320740 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1384/2801] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:08 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1524 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:09.362508 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2adaf06b-0f47-429c-a68b-b3981318f772 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:09.363121 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2adaf06b-0f47-429c-a68b-b3981318f772 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 316d48b7-d25a-4666-90ce-1fba8a600987] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:09.375485 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2adaf06b-0f47-429c-a68b-b3981318f772 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:09.377761 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2adaf06b-0f47-429c-a68b-b3981318f772 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:09.378640 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2adaf06b-0f47-429c-a68b-b3981318f772 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:09.379084 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2adaf06b-0f47-429c-a68b-b3981318f772 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:09.930359 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2adaf06b-0f47-429c-a68b-b3981318f772 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:09.949060 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2adaf06b-0f47-429c-a68b-b3981318f772 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/316d48b7-d25a-4666-90ce-1fba8a600987" status: 200 len: 1314 microversion: 2.1 time: 0.591101 Aug 04 16:49:09.962478 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1385/2802] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:09 2022] GET /compute/v2.1/servers/316d48b7-d25a-4666-90ce-1fba8a600987 => generated 1314 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:09.978580 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9a863e6f-1c03-40ea-b843-46807a7a50a5 tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] Calling method '.version_select at 0x7f7e84a77430>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:10.043921 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9a863e6f-1c03-40ea-b843-46807a7a50a5 tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/d6a0c065-0f93-4498-bca6-b95fa4c15569" status: 200 len: 287 microversion: 2.1 time: 0.079793 Aug 04 16:49:10.045079 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1386/2803] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Aug 4 16:49:09 2022] GET /compute/v2.1/os-snapshots/d6a0c065-0f93-4498-bca6-b95fa4c15569 => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:49:10.225667 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3e9b2719-64fb-4d65-9e66-c89e81a920db tempest-ServicesAdminNegativeTestJSON-1878633169 tempest-ServicesAdminNegativeTestJSON-1878633169-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:10.228912 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:49:10.228912 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:49:10.230073 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3e9b2719-64fb-4d65-9e66-c89e81a920db tempest-ServicesAdminNegativeTestJSON-1878633169 tempest-ServicesAdminNegativeTestJSON-1878633169-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '1f0d23e9a26247b0b755cd44c180156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5ef8fcc1854759b450331cc0ecbd2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3e9b2719-64fb-4d65-9e66-c89e81a920db tempest-ServicesAdminNegativeTestJSON-1878633169 tempest-ServicesAdminNegativeTestJSON-1878633169-project] Request method failure captured: Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_h_SfYuMgrhRse5wPg2fCwkrWgufi-AVy909q8RafPM9Z3qZ0kSThOG33sV9XJewy3XBPBlS1bWBhz-2fRpPWhy35Qf6tDSF8tABApuF1yDE_pMz54fzINiLawORuG1pFubXUPRhzQJNrP5WhxfxQietqlOtkhCWOLoHQHZ03eslSc Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: ae5ef8fcc1854759b450331cc0ecbd2a Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1878633169 Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ae5ef8fcc1854759b450331cc0ecbd2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ae5ef8fcc1854759b450331cc0ecbd2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ae5ef8fcc1854759b450331cc0ecbd2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ae5ef8fcc1854759b450331cc0ecbd2a"}]}] Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1878633169 Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: ae5ef8fcc1854759b450331cc0ecbd2a Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1878633169 Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServicesAdminNegativeTestJSON-1878633169-project Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 1f0d23e9a26247b0b755cd44c180156c Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1878633169-project Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: action_args: {} Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 04 16:49:10.232382 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:10.237484 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:49:10.237484 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:10.237484 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:10.237484 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:49:10.237484 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:49:10.237484 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:49:10.237484 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:49:10.237484 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 04 16:49:10.237484 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:10.241180 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3e9b2719-64fb-4d65-9e66-c89e81a920db tempest-ServicesAdminNegativeTestJSON-1878633169 tempest-ServicesAdminNegativeTestJSON-1878633169-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:49:10.248207 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3e9b2719-64fb-4d65-9e66-c89e81a920db tempest-ServicesAdminNegativeTestJSON-1878633169 tempest-ServicesAdminNegativeTestJSON-1878633169-project] 10.222.0.23 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 1.123626 Aug 04 16:49:10.249397 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1418/2804] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Aug 4 16:49:09 2022] GET /compute/v2.1/os-services => generated 112 bytes in 1126 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:49:10.352945 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-00079822-bb9d-4aca-94c9-31e1b1bfbd58 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:10.354379 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-00079822-bb9d-4aca-94c9-31e1b1bfbd58 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:10.388164 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-00079822-bb9d-4aca-94c9-31e1b1bfbd58 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:10.388901 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-00079822-bb9d-4aca-94c9-31e1b1bfbd58 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:10.396590 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-00079822-bb9d-4aca-94c9-31e1b1bfbd58 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:10.401410 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-00079822-bb9d-4aca-94c9-31e1b1bfbd58 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:10.832211 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-00079822-bb9d-4aca-94c9-31e1b1bfbd58 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:10.846076 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-00079822-bb9d-4aca-94c9-31e1b1bfbd58 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1506 microversion: 2.1 time: 0.504148 Aug 04 16:49:10.862025 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1387/2805] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:10 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1506 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:10.971163 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-f13a7dc9-1187-4735-a9d7-d7005cb30a11 req-ccc1b871-b78d-446a-9e7d-5afe14a87c47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "316d48b7-d25a-4666-90ce-1fba8a600987", "name": "network-vif-plugged", "status": "completed", "tag": "6d7c513d-1bfc-4e16-86a7-5af2d7a2adf8"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:49:10.983694 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-799cf50f-cbc3-42fa-8c6c-057c71d881b8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:10.985163 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-799cf50f-cbc3-42fa-8c6c-057c71d881b8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 316d48b7-d25a-4666-90ce-1fba8a600987] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:10.996678 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-799cf50f-cbc3-42fa-8c6c-057c71d881b8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:11.000348 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-799cf50f-cbc3-42fa-8c6c-057c71d881b8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:11.002378 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-799cf50f-cbc3-42fa-8c6c-057c71d881b8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:11.004442 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-799cf50f-cbc3-42fa-8c6c-057c71d881b8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:11.006887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:49:11.012975 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-f13a7dc9-1187-4735-a9d7-d7005cb30a11 req-ccc1b871-b78d-446a-9e7d-5afe14a87c47 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:11.017426 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-f13a7dc9-1187-4735-a9d7-d7005cb30a11 req-ccc1b871-b78d-446a-9e7d-5afe14a87c47 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:11.056508 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-f13a7dc9-1187-4735-a9d7-d7005cb30a11 req-ccc1b871-b78d-446a-9e7d-5afe14a87c47 service nova] Creating event network-vif-plugged:6d7c513d-1bfc-4e16-86a7-5af2d7a2adf8 for instance 316d48b7-d25a-4666-90ce-1fba8a600987 on n-h2-846466-12 Aug 04 16:49:11.071138 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-f13a7dc9-1187-4735-a9d7-d7005cb30a11 req-ccc1b871-b78d-446a-9e7d-5afe14a87c47 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108204 Aug 04 16:49:11.077376 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1419/2806] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:49:11.091823 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c21a0fb1-2177-46c4-a59b-d4950cc4f2b7 tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] Calling method '.version_select at 0x7f7e89ca29d0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:11.160050 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c21a0fb1-2177-46c4-a59b-d4950cc4f2b7 tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/d6a0c065-0f93-4498-bca6-b95fa4c15569" status: 200 len: 288 microversion: 2.1 time: 0.080592 Aug 04 16:49:11.160640 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1420/2807] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Aug 4 16:49:11 2022] GET /compute/v2.1/os-snapshots/d6a0c065-0f93-4498-bca6-b95fa4c15569 => generated 288 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:49:11.172369 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cd120ff3-0a38-4a17-8484-78230c56ebd8 tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] Calling method '.version_select at 0x7f7e89caa8b0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:11.397461 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-799cf50f-cbc3-42fa-8c6c-057c71d881b8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:11.412585 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-799cf50f-cbc3-42fa-8c6c-057c71d881b8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/316d48b7-d25a-4666-90ce-1fba8a600987" status: 200 len: 1314 microversion: 2.1 time: 0.430823 Aug 04 16:49:11.415596 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1388/2808] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:10 2022] GET /compute/v2.1/servers/316d48b7-d25a-4666-90ce-1fba8a600987 => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:49:11.436912 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cd120ff3-0a38-4a17-8484-78230c56ebd8 tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/d6a0c065-0f93-4498-bca6-b95fa4c15569" status: 202 len: 0 microversion: 2.1 time: 0.268850 Aug 04 16:49:11.438500 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1421/2809] 10.222.0.23 () {58 vars in 1254 bytes} [Thu Aug 4 16:49:11 2022] DELETE /compute/v2.1/os-snapshots/d6a0c065-0f93-4498-bca6-b95fa4c15569 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 16:49:11.453716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-88a57211-833b-432d-94b5-0b1a63fc8a91 tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] Calling method '.version_select at 0x7f7e77ec7820>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:11.549327 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-88a57211-833b-432d-94b5-0b1a63fc8a91 tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/d6a0c065-0f93-4498-bca6-b95fa4c15569" status: 200 len: 287 microversion: 2.1 time: 0.104519 Aug 04 16:49:11.550214 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1389/2810] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Aug 4 16:49:11 2022] GET /compute/v2.1/os-snapshots/d6a0c065-0f93-4498-bca6-b95fa4c15569 => generated 287 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:49:11.871184 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8f761207-e3fe-421c-b03c-59efe5a84c84 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:11.872471 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8f761207-e3fe-421c-b03c-59efe5a84c84 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:11.887437 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8f761207-e3fe-421c-b03c-59efe5a84c84 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:11.891042 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8f761207-e3fe-421c-b03c-59efe5a84c84 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:11.897047 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8f761207-e3fe-421c-b03c-59efe5a84c84 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:11.897891 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8f761207-e3fe-421c-b03c-59efe5a84c84 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:12.392399 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8f761207-e3fe-421c-b03c-59efe5a84c84 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:12.414802 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8f761207-e3fe-421c-b03c-59efe5a84c84 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1506 microversion: 2.1 time: 0.549129 Aug 04 16:49:12.432053 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1422/2811] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:11 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1506 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:12.440378 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e8df954c-5008-4fc6-af99-49b3dc8ae6a7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:12.440999 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e8df954c-5008-4fc6-af99-49b3dc8ae6a7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 316d48b7-d25a-4666-90ce-1fba8a600987] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:12.464695 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e8df954c-5008-4fc6-af99-49b3dc8ae6a7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:12.465418 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e8df954c-5008-4fc6-af99-49b3dc8ae6a7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:12.466360 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e8df954c-5008-4fc6-af99-49b3dc8ae6a7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:12.466798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e8df954c-5008-4fc6-af99-49b3dc8ae6a7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:12.618113 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-40eb66e2-f568-412c-8f5c-1cf00cce5e3e tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] Calling method '.version_select at 0x7f7e89d52a60>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:12.720478 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-40eb66e2-f568-412c-8f5c-1cf00cce5e3e tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/d6a0c065-0f93-4498-bca6-b95fa4c15569" status: 200 len: 287 microversion: 2.1 time: 0.160656 Aug 04 16:49:12.721550 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1423/2812] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Aug 4 16:49:12 2022] GET /compute/v2.1/os-snapshots/d6a0c065-0f93-4498-bca6-b95fa4c15569 => generated 287 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:49:13.007783 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e8df954c-5008-4fc6-af99-49b3dc8ae6a7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:13.017465 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e8df954c-5008-4fc6-af99-49b3dc8ae6a7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/316d48b7-d25a-4666-90ce-1fba8a600987" status: 200 len: 1314 microversion: 2.1 time: 0.584965 Aug 04 16:49:13.033293 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1390/2813] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:12 2022] GET /compute/v2.1/servers/316d48b7-d25a-4666-90ce-1fba8a600987 => generated 1314 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:13.201246 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-17511f15-cce2-4620-9baa-78c5f1b7aecf req-196cf177-53d3-4c73-bb1a-41bcc2d47f30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73dff433-5880-43ec-b799-1230245db7f7", "name": "network-vif-unplugged", "status": "completed", "tag": "cb07355a-33e6-4a7b-87c1-59ad0e6d64ce"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:49:13.243502 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-17511f15-cce2-4620-9baa-78c5f1b7aecf req-196cf177-53d3-4c73-bb1a-41bcc2d47f30 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:13.246860 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-17511f15-cce2-4620-9baa-78c5f1b7aecf req-196cf177-53d3-4c73-bb1a-41bcc2d47f30 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:13.300305 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.compute.server_external_events [req-17511f15-cce2-4620-9baa-78c5f1b7aecf req-196cf177-53d3-4c73-bb1a-41bcc2d47f30 service nova] Unable to find a host for instance 73dff433-5880-43ec-b799-1230245db7f7. Dropping event network-vif-unplugged {{(pid=126125) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 04 16:49:13.301990 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-17511f15-cce2-4620-9baa-78c5f1b7aecf req-196cf177-53d3-4c73-bb1a-41bcc2d47f30 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.112819 Aug 04 16:49:13.309715 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1424/2814] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 121 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 04 16:49:13.439938 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f31475cf-d330-4697-90a2-6748b3a9bc8a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:13.440862 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f31475cf-d330-4697-90a2-6748b3a9bc8a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:13.461275 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f31475cf-d330-4697-90a2-6748b3a9bc8a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:13.462127 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f31475cf-d330-4697-90a2-6748b3a9bc8a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:13.463074 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f31475cf-d330-4697-90a2-6748b3a9bc8a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:13.463669 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f31475cf-d330-4697-90a2-6748b3a9bc8a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:13.733776 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-44130aa1-291d-4047-9355-b3883ab1354e tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] Calling method '.version_select at 0x7f7e841941f0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:13.788903 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-44130aa1-291d-4047-9355-b3883ab1354e tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/d6a0c065-0f93-4498-bca6-b95fa4c15569" status: 200 len: 287 microversion: 2.1 time: 0.059569 Aug 04 16:49:13.789513 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1425/2815] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Aug 4 16:49:13 2022] GET /compute/v2.1/os-snapshots/d6a0c065-0f93-4498-bca6-b95fa4c15569 => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:49:13.903875 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f31475cf-d330-4697-90a2-6748b3a9bc8a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:13.912435 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f31475cf-d330-4697-90a2-6748b3a9bc8a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 200 len: 1449 microversion: 2.1 time: 0.476558 Aug 04 16:49:13.913023 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1391/2816] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:13 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 1449 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:13.935535 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c0c58c06-cdfa-4f11-b56a-1fdd847e8622 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:13.936048 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c0c58c06-cdfa-4f11-b56a-1fdd847e8622 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:13.961401 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0c58c06-cdfa-4f11-b56a-1fdd847e8622 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:13.964451 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0c58c06-cdfa-4f11-b56a-1fdd847e8622 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:13.967467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0c58c06-cdfa-4f11-b56a-1fdd847e8622 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:13.970955 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0c58c06-cdfa-4f11-b56a-1fdd847e8622 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:14.054767 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8442a2dc-ce73-461a-b5d7-28f96987b00e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:14.055711 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8442a2dc-ce73-461a-b5d7-28f96987b00e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 316d48b7-d25a-4666-90ce-1fba8a600987] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:14.074952 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8442a2dc-ce73-461a-b5d7-28f96987b00e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:14.076374 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8442a2dc-ce73-461a-b5d7-28f96987b00e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:14.081867 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8442a2dc-ce73-461a-b5d7-28f96987b00e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:14.082932 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8442a2dc-ce73-461a-b5d7-28f96987b00e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:14.098846 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c0c58c06-cdfa-4f11-b56a-1fdd847e8622 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:49:14.131817 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.compute.api [None req-c0c58c06-cdfa-4f11-b56a-1fdd847e8622 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Working on deleting snapshot 53dc7c1a-9013-4bf2-bfbd-9bb40a152893 from shelved instance... Aug 04 16:49:15.288282 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c0c58c06-cdfa-4f11-b56a-1fdd847e8622 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Doing local delete in cell e056d029-674a-446e-ac9e-5108621d9db2(cell1) {{(pid=126125) _delete /opt/stack/nova/nova/compute/api.py:2491}} Aug 04 16:49:15.290395 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0c58c06-cdfa-4f11-b56a-1fdd847e8622 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:15.291401 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0c58c06-cdfa-4f11-b56a-1fdd847e8622 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:15.292340 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.compute.api [None req-c0c58c06-cdfa-4f11-b56a-1fdd847e8622 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 04 16:49:15.304153 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-c0c58c06-cdfa-4f11-b56a-1fdd847e8622 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] deallocate_for_instance() {{(pid=126125) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 04 16:49:15.515525 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8442a2dc-ce73-461a-b5d7-28f96987b00e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:15.527591 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8442a2dc-ce73-461a-b5d7-28f96987b00e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/316d48b7-d25a-4666-90ce-1fba8a600987" status: 200 len: 1501 microversion: 2.1 time: 1.489051 Aug 04 16:49:15.541307 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1392/2817] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:14 2022] GET /compute/v2.1/servers/316d48b7-d25a-4666-90ce-1fba8a600987 => generated 1501 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:15.552274 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0312792c-1185-4a9f-9288-d7266f1fba48 tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] Calling method '.version_select at 0x7f7e77e128b0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:15.601033 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-0312792c-1185-4a9f-9288-d7266f1fba48 tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] HTTP exception thrown: Snapshot d6a0c065-0f93-4498-bca6-b95fa4c15569 could not be found. Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0312792c-1185-4a9f-9288-d7266f1fba48 tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] Request method failure captured: Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/os-snapshots/d6a0c065-0f93-4498-bca6-b95fa4c15569 HTTP/1.1 Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_h8bJkeAGWqgeyQXfGWDPYF9WgKeW8oQDIVUv0lzEY3NgHS5-vEjiX7xpihMB4cj_eR39xjFqtssEfJgfbNDJCqXSOOtJHwpY3Oeh1dHj9uP-olZyF4bMtTrQ5Ut1Y2SGTV9EHanKVIifSR7DM2qmoudE972S1ub7GagkqJqpVsLFc Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: ee2d4f5c07de4e03a0faaa5c813a297b Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-109330324 Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee2d4f5c07de4e03a0faaa5c813a297b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ee2d4f5c07de4e03a0faaa5c813a297b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee2d4f5c07de4e03a0faaa5c813a297b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ee2d4f5c07de4e03a0faaa5c813a297b"}]}] Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-VolumesSnapshotsTestJSON-109330324 Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: ee2d4f5c07de4e03a0faaa5c813a297b Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-109330324 Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-VolumesSnapshotsTestJSON-109330324-project Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: f35db75473824161b1abbb033d711780 Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-VolumesSnapshotsTestJSON-109330324-project Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: exception: Snapshot d6a0c065-0f93-4498-bca6-b95fa4c15569 could not be found. Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'd6a0c065-0f93-4498-bca6-b95fa4c15569'} Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d6a0c065-0f93-4498-bca6-b95fa4c15569 could not be found. (HTTP 404) (Request-ID: req-9b60400a-9876-49ac-ae62-b367ee738aea) Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 16:49:15.611125 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d6a0c065-0f93-4498-bca6-b95fa4c15569 could not be found. Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d6a0c065-0f93-4498-bca6-b95fa4c15569 could not be found. Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d6a0c065-0f93-4498-bca6-b95fa4c15569 could not be found. Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0312792c-1185-4a9f-9288-d7266f1fba48 tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] Returning 404 to user: Snapshot d6a0c065-0f93-4498-bca6-b95fa4c15569 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0312792c-1185-4a9f-9288-d7266f1fba48 tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/d6a0c065-0f93-4498-bca6-b95fa4c15569" status: 404 len: 111 microversion: 2.1 time: 0.065392 Aug 04 16:49:15.615833 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1393/2818] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Aug 4 16:49:15 2022] GET /compute/v2.1/os-snapshots/d6a0c065-0f93-4498-bca6-b95fa4c15569 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:49:15.637407 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b433a0b8-d4cf-40c9-9e06-6d828275bc50 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:49:15.643429 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b433a0b8-d4cf-40c9-9e06-6d828275bc50 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 316d48b7-d25a-4666-90ce-1fba8a600987] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:15.670375 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b433a0b8-d4cf-40c9-9e06-6d828275bc50 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:15.671837 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b433a0b8-d4cf-40c9-9e06-6d828275bc50 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:15.674119 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b433a0b8-d4cf-40c9-9e06-6d828275bc50 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:15.675564 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b433a0b8-d4cf-40c9-9e06-6d828275bc50 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:16.339479 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.network.security_group_api [None req-b433a0b8-d4cf-40c9-9e06-6d828275bc50 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Removing security group a35aed80-19bc-40b4-9b46-9cc9d45b42e2 from port 6d7c513d-1bfc-4e16-86a7-5af2d7a2adf8 Aug 04 16:49:17.566387 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-c0c58c06-cdfa-4f11-b56a-1fdd847e8622 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Updating instance_info_cache with network_info: [] {{(pid=126125) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 16:49:17.805085 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b433a0b8-d4cf-40c9-9e06-6d828275bc50 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "POST /compute/v2.1/servers/316d48b7-d25a-4666-90ce-1fba8a600987/action" status: 202 len: 0 microversion: 2.1 time: 2.190073 Aug 04 16:49:17.819346 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1394/2819] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:49:15 2022] POST /compute/v2.1/servers/316d48b7-d25a-4666-90ce-1fba8a600987/action => generated 0 bytes in 2192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:49:17.838594 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-447138ce-af06-457a-a02a-02cc7eb0324e tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] Calling method '.version_select at 0x7f7e77ea1a60>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:18.065150 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-447138ce-af06-457a-a02a-02cc7eb0324e tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/2c59d66e-c97b-4fb5-8cf0-40d66e755095" status: 202 len: 0 microversion: 2.1 time: 0.244573 Aug 04 16:49:18.066579 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1395/2820] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Aug 4 16:49:17 2022] DELETE /compute/v2.1/os-volumes/2c59d66e-c97b-4fb5-8cf0-40d66e755095 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:49:18.071424 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6bcc3745-6979-4fa7-b810-703ed6b620b2 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e77f38790>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:18.154859 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6bcc3745-6979-4fa7-b810-703ed6b620b2 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/a43c8115-32f0-419c-9b79-1f9b97e22f50" status: 200 len: 661 microversion: 2.1 time: 0.086966 Aug 04 16:49:18.157407 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1396/2821] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:49:18 2022] GET /compute/v2.1/images/a43c8115-32f0-419c-9b79-1f9b97e22f50 => generated 661 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:49:18.178880 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-36fb7e5c-0a44-4e0e-b751-3eb17f10626d req-38b308a5-ceab-4300-8148-63602782fe22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73dff433-5880-43ec-b799-1230245db7f7", "name": "network-vif-deleted", "tag": "cb07355a-33e6-4a7b-87c1-59ad0e6d64ce"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:49:18.199361 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-36fb7e5c-0a44-4e0e-b751-3eb17f10626d req-38b308a5-ceab-4300-8148-63602782fe22 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:18.202578 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-36fb7e5c-0a44-4e0e-b751-3eb17f10626d req-38b308a5-ceab-4300-8148-63602782fe22 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:18.230076 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=97 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:49:18.237509 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.compute.server_external_events [req-36fb7e5c-0a44-4e0e-b751-3eb17f10626d req-38b308a5-ceab-4300-8148-63602782fe22 service nova] Unable to find a host for instance 73dff433-5880-43ec-b799-1230245db7f7. Dropping event network-vif-deleted {{(pid=126126) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 04 16:49:18.249095 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-36fb7e5c-0a44-4e0e-b751-3eb17f10626d req-38b308a5-ceab-4300-8148-63602782fe22 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.082649 Aug 04 16:49:18.249858 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1397/2822] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 92 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 04 16:49:18.256051 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dfde73c1-49a1-4b9b-932d-06b7bf5a4541 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:18.265404 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-dfde73c1-49a1-4b9b-932d-06b7bf5a4541 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 316d48b7-d25a-4666-90ce-1fba8a600987] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:18.275746 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dfde73c1-49a1-4b9b-932d-06b7bf5a4541 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:18.276500 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dfde73c1-49a1-4b9b-932d-06b7bf5a4541 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:18.277514 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dfde73c1-49a1-4b9b-932d-06b7bf5a4541 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:18.278559 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dfde73c1-49a1-4b9b-932d-06b7bf5a4541 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:18.365891 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:49:18.459079 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-dfde73c1-49a1-4b9b-932d-06b7bf5a4541 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:18.468592 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dfde73c1-49a1-4b9b-932d-06b7bf5a4541 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/316d48b7-d25a-4666-90ce-1fba8a600987" status: 200 len: 1459 microversion: 2.1 time: 0.216215 Aug 04 16:49:18.488097 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1398/2823] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:18 2022] GET /compute/v2.1/servers/316d48b7-d25a-4666-90ce-1fba8a600987 => generated 1459 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:18.500037 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bb13fe2a-0789-4daf-bfc4-c3c576efd0cc tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] Calling method '.version_select at 0x7f7e77dd55e0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:18.588463 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c0c58c06-cdfa-4f11-b56a-1fdd847e8622 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "DELETE /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 204 len: 0 microversion: 2.1 time: 4.656623 Aug 04 16:49:18.590019 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1426/2824] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:49:13 2022] DELETE /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 0 bytes in 4659 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:49:18.623103 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bb13fe2a-0789-4daf-bfc4-c3c576efd0cc tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/2c59d66e-c97b-4fb5-8cf0-40d66e755095" status: 200 len: 345 microversion: 2.1 time: 0.131410 Aug 04 16:49:18.623717 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1399/2825] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Aug 4 16:49:18 2022] GET /compute/v2.1/os-volumes/2c59d66e-c97b-4fb5-8cf0-40d66e755095 => generated 345 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:49:18.631314 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8a16ac56-cd4a-4ff0-b20b-caf8d144ddb9 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e77ec7dc0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:18.730082 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8a16ac56-cd4a-4ff0-b20b-caf8d144ddb9 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/a43c8115-32f0-419c-9b79-1f9b97e22f50" status: 200 len: 661 microversion: 2.1 time: 0.104641 Aug 04 16:49:18.730682 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1400/2826] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:49:18 2022] GET /compute/v2.1/images/a43c8115-32f0-419c-9b79-1f9b97e22f50 => generated 661 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:49:18.753453 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0f1a5de8-5f83-4543-a33c-a9a2b1d54c78 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:18.756134 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0f1a5de8-5f83-4543-a33c-a9a2b1d54c78 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:18.772282 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0f1a5de8-5f83-4543-a33c-a9a2b1d54c78 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:18.777147 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0f1a5de8-5f83-4543-a33c-a9a2b1d54c78 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:18.778887 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0f1a5de8-5f83-4543-a33c-a9a2b1d54c78 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:18.780989 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0f1a5de8-5f83-4543-a33c-a9a2b1d54c78 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:18.913905 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cd1182bf-9f00-43d1-ae2e-84912554c8a6 tempest-TenantUsagesNegativeTestJSON-122182804 tempest-TenantUsagesNegativeTestJSON-122182804-project-admin] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-03T16%3A49%3A18.065327&end=2022-08-05T16%3A49%3A18.065327" status: 404 len: 112 microversion: - time: 0.321931 Aug 04 16:49:18.915060 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1427/2827] 10.222.0.23 () {58 vars in 1316 bytes} [Thu Aug 4 16:49:18 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-03T16%3A49%3A18.065327&end=2022-08-05T16%3A49%3A18.065327 => generated 112 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 16:49:19.061218 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a354a705-417c-4851-a8ea-2e91addea694 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:19.062445 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a354a705-417c-4851-a8ea-2e91addea694 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:19.071294 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a354a705-417c-4851-a8ea-2e91addea694 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:19.071881 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a354a705-417c-4851-a8ea-2e91addea694 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:19.072690 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a354a705-417c-4851-a8ea-2e91addea694 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:19.073447 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a354a705-417c-4851-a8ea-2e91addea694 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:19.093646 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=12 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:49:19.095555 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-a354a705-417c-4851-a8ea-2e91addea694 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] HTTP exception thrown: Instance 73dff433-5880-43ec-b799-1230245db7f7 could not be found. Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a354a705-417c-4851-a8ea-2e91addea694 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Request method failure captured: Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 HTTP/1.1 Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_ddGi-LUxEkOI7UNq-ijU5XnirMgjjOPky_n4iIeohsp_mBZi36CDxRY5dUKGmgKLroDx6IsvA3hey_uA7LPQbZI4NWhaCZQIOIkAKlIttRUGlU4y_AMkv45dQEQsQ8xd9VhN5XbmaVn_f0gvdFbALtWn0QI5OJtAeQ50IP8tuO8i0 Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/60281cf1dbe645d8949e93f9e70b5d91"}]}] Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 3cfb4739b53b411391a26de37b98469f Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 73dff433-5880-43ec-b799-1230245db7f7 could not be found. Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '73dff433-5880-43ec-b799-1230245db7f7'} Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73dff433-5880-43ec-b799-1230245db7f7 could not be found. Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73dff433-5880-43ec-b799-1230245db7f7 could not be found. Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:49:19.097778 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:19.102832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:19.102832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:49:19.102832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:49:19.102832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:49:19.102832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:49:19.102832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73dff433-5880-43ec-b799-1230245db7f7 could not be found. Aug 04 16:49:19.102832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:19.102832 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a354a705-417c-4851-a8ea-2e91addea694 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Returning 404 to user: Instance 73dff433-5880-43ec-b799-1230245db7f7 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:49:19.102832 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a354a705-417c-4851-a8ea-2e91addea694 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 404 len: 111 microversion: 2.1 time: 0.183037 Aug 04 16:49:19.102832 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1428/2828] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:18 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:49:19.104393 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a71fe356-62e6-4265-bf54-c0774db2d3d0 tempest-TenantUsagesNegativeTestJSON-122182804 tempest-TenantUsagesNegativeTestJSON-122182804-project-admin] Calling method '.version_select at 0x7f7e77d7e310>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:19.109065 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-a71fe356-62e6-4265-bf54-c0774db2d3d0 tempest-TenantUsagesNegativeTestJSON-122182804 tempest-TenantUsagesNegativeTestJSON-122182804-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a71fe356-62e6-4265-bf54-c0774db2d3d0 tempest-TenantUsagesNegativeTestJSON-122182804 tempest-TenantUsagesNegativeTestJSON-122182804-project-admin] Request method failure captured: Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/os-simple-tenant-usage/b4ca421645bd4e739c88d71ed689dc74?start=2022-08-05T16%3A49%3A18.065327&end=2022-08-03T16%3A49%3A18.065327 HTTP/1.1 Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_iNAd_Bhd-2MeVh1rQ5cDCJMkPRBN-bAOfTro90dSxHAzdf_5TDTuadRW3Z4M7BpKJO1Fzpew-iSlX2b5rUrKyaxoEIXJ9myR21o4DBEk2cWZrK0BxunbVEHY1cXjy7Q-8o0Rqfa3r0DipoGYBAdzpv8-GYLhNiqBM191D8crTPyWQ Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 56784d170d264d3aa22de05042c627ef Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-122182804 Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader,admin Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader,admin Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56784d170d264d3aa22de05042c627ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_56784d170d264d3aa22de05042c627ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56784d170d264d3aa22de05042c627ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/56784d170d264d3aa22de05042c627ef"}]}] Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-122182804 Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 56784d170d264d3aa22de05042c627ef Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-122182804 Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-TenantUsagesNegativeTestJSON-122182804-project-admin Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: f453e17b28f54ec8b1cfcfe121966788 Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-122182804-project-admin Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: exception: Invalid start time. The start time cannot occur after the end time. Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'b4ca421645bd4e739c88d71ed689dc74'} Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 04 16:49:19.118561 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:19.124508 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a71fe356-62e6-4265-bf54-c0774db2d3d0 tempest-TenantUsagesNegativeTestJSON-122182804 tempest-TenantUsagesNegativeTestJSON-122182804-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:49:19.125743 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a71fe356-62e6-4265-bf54-c0774db2d3d0 tempest-TenantUsagesNegativeTestJSON-122182804 tempest-TenantUsagesNegativeTestJSON-122182804-project-admin] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage/b4ca421645bd4e739c88d71ed689dc74?start=2022-08-05T16%3A49%3A18.065327&end=2022-08-03T16%3A49%3A18.065327" status: 400 len: 111 microversion: 2.1 time: 0.024838 Aug 04 16:49:19.132529 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1429/2829] 10.222.0.23 () {58 vars in 1412 bytes} [Thu Aug 4 16:49:19 2022] GET /compute/v2.1/os-simple-tenant-usage/b4ca421645bd4e739c88d71ed689dc74?start=2022-08-05T16%3A49%3A18.065327&end=2022-08-03T16%3A49%3A18.065327 => generated 111 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:49:19.300888 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9703641f-8bab-40b9-b9be-be9c123eabbc tempest-TenantUsagesNegativeTestJSON-426049637 tempest-TenantUsagesNegativeTestJSON-426049637-project] Calling method '.version_select at 0x7f7e89cb2ca0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:19.306148 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9703641f-8bab-40b9-b9be-be9c123eabbc tempest-TenantUsagesNegativeTestJSON-426049637 tempest-TenantUsagesNegativeTestJSON-426049637-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '030291e985b9454fa2ec832270a4cfe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ca421645bd4e739c88d71ed689dc74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9703641f-8bab-40b9-b9be-be9c123eabbc tempest-TenantUsagesNegativeTestJSON-426049637 tempest-TenantUsagesNegativeTestJSON-426049637-project] Request method failure captured: Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-03T16%3A49%3A18.065327&end=2022-08-05T16%3A49%3A18.065327&detailed=1 HTTP/1.1 Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_iMuWetKUjxgzhJiOLZS0hAwtw-WzLV9i4gh_L7YBSFda05wfuKgxogyTCcbXJGw-xi5bBejveQ_kQO2qeqTB7DxD6QQhwLwyrBwCTvv6jAVL5V85_uqZNYUBBY2NC_cgpAvRlEH1veYlvVp9rD-kSSo8o8CQsKdvKaH8LHNfy-ebk Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: b4ca421645bd4e739c88d71ed689dc74 Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-426049637 Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b4ca421645bd4e739c88d71ed689dc74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b4ca421645bd4e739c88d71ed689dc74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b4ca421645bd4e739c88d71ed689dc74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b4ca421645bd4e739c88d71ed689dc74"}]}] Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-426049637 Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: b4ca421645bd4e739c88d71ed689dc74 Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-426049637 Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-TenantUsagesNegativeTestJSON-426049637-project Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 030291e985b9454fa2ec832270a4cfe7 Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-426049637-project Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: action_args: {} Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:49:19.307832 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:49:19.312150 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 04 16:49:19.312150 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:19.312150 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:49:19.312150 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:19.312150 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:19.312150 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:49:19.312150 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:49:19.312150 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:49:19.312150 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:49:19.312150 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 04 16:49:19.312150 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:19.312150 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9703641f-8bab-40b9-b9be-be9c123eabbc tempest-TenantUsagesNegativeTestJSON-426049637 tempest-TenantUsagesNegativeTestJSON-426049637-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:49:19.312150 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9703641f-8bab-40b9-b9be-be9c123eabbc tempest-TenantUsagesNegativeTestJSON-426049637 tempest-TenantUsagesNegativeTestJSON-426049637-project] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-03T16%3A49%3A18.065327&end=2022-08-05T16%3A49%3A18.065327&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.175850 Aug 04 16:49:19.316261 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1430/2830] 10.222.0.23 () {58 vars in 1335 bytes} [Thu Aug 4 16:49:19 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-03T16%3A49%3A18.065327&end=2022-08-05T16%3A49%3A18.065327&detailed=1 => generated 123 bytes in 183 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:49:19.323053 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ecbc2715-f313-4029-a9c6-6d160c749f77 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-751991194", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "fd9ba46f-9583-4f53-9ced-a3b1af7aa6df"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:49:19.387417 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-ecbc2715-f313-4029-a9c6-6d160c749f77 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] validate_networks() for [('fd9ba46f-9583-4f53-9ced-a3b1af7aa6df', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:49:19.799915 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0f1a5de8-5f83-4543-a33c-a9a2b1d54c78 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:19.834988 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0f1a5de8-5f83-4543-a33c-a9a2b1d54c78 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 1.091757 Aug 04 16:49:19.849438 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1401/2831] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:18 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:19.849438 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2bf06616-a940-419d-9589-6ef781ea2217 tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] Calling method '.version_select at 0x7f7e77ec7310>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:19.932462 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2bf06616-a940-419d-9589-6ef781ea2217 tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/2c59d66e-c97b-4fb5-8cf0-40d66e755095" status: 200 len: 345 microversion: 2.1 time: 0.093209 Aug 04 16:49:19.933349 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1402/2832] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Aug 4 16:49:19 2022] GET /compute/v2.1/os-volumes/2c59d66e-c97b-4fb5-8cf0-40d66e755095 => generated 345 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:49:19.963070 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f107cc39-f337-4128-bd50-3c029f16b8c6 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:19.963699 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f107cc39-f337-4128-bd50-3c029f16b8c6 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:19.979722 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f107cc39-f337-4128-bd50-3c029f16b8c6 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:19.983272 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f107cc39-f337-4128-bd50-3c029f16b8c6 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:19.984228 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f107cc39-f337-4128-bd50-3c029f16b8c6 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:19.984865 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f107cc39-f337-4128-bd50-3c029f16b8c6 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:20.764244 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f107cc39-f337-4128-bd50-3c029f16b8c6 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:20.778802 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f107cc39-f337-4128-bd50-3c029f16b8c6 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.828325 Aug 04 16:49:20.785661 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1403/2833] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:19 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:20.792330 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-f9bccf3a-0c81-4e45-b75d-41217c85fb78 req-633fde46-60dd-4e66-9bd8-c813cda13a38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "316d48b7-d25a-4666-90ce-1fba8a600987", "tag": "6d7c513d-1bfc-4e16-86a7-5af2d7a2adf8"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:49:20.823494 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f9bccf3a-0c81-4e45-b75d-41217c85fb78 req-633fde46-60dd-4e66-9bd8-c813cda13a38 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:20.824546 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f9bccf3a-0c81-4e45-b75d-41217c85fb78 req-633fde46-60dd-4e66-9bd8-c813cda13a38 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:20.855583 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-f9bccf3a-0c81-4e45-b75d-41217c85fb78 req-633fde46-60dd-4e66-9bd8-c813cda13a38 service nova] Creating event network-changed:6d7c513d-1bfc-4e16-86a7-5af2d7a2adf8 for instance 316d48b7-d25a-4666-90ce-1fba8a600987 on n-h2-846466-12 Aug 04 16:49:20.871871 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-f9bccf3a-0c81-4e45-b75d-41217c85fb78 req-633fde46-60dd-4e66-9bd8-c813cda13a38 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084187 Aug 04 16:49:20.873198 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1404/2834] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:49:20.893821 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-625c6741-5764-4554-a1cf-29cc7340d38b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:20.895237 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-625c6741-5764-4554-a1cf-29cc7340d38b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:20.910878 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-625c6741-5764-4554-a1cf-29cc7340d38b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:20.915137 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-625c6741-5764-4554-a1cf-29cc7340d38b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:20.916734 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-ecbc2715-f313-4029-a9c6-6d160c749f77 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:49:20.917302 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-ecbc2715-f313-4029-a9c6-6d160c749f77 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:49:20.917665 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-625c6741-5764-4554-a1cf-29cc7340d38b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:20.917793 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-ecbc2715-f313-4029-a9c6-6d160c749f77 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:49:20.918166 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-ecbc2715-f313-4029-a9c6-6d160c749f77 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:49:20.918576 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-ecbc2715-f313-4029-a9c6-6d160c749f77 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:49:20.919791 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-625c6741-5764-4554-a1cf-29cc7340d38b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:20.937440 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ecbc2715-f313-4029-a9c6-6d160c749f77 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:20.938348 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ecbc2715-f313-4029-a9c6-6d160c749f77 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:20.940279 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ecbc2715-f313-4029-a9c6-6d160c749f77 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:20.940722 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ecbc2715-f313-4029-a9c6-6d160c749f77 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:20.991428 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-ecbc2715-f313-4029-a9c6-6d160c749f77 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Getting quotas for project 60281cf1dbe645d8949e93f9e70b5d91. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:49:21.004742 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-ecbc2715-f313-4029-a9c6-6d160c749f77 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Getting quotas for user 3cfb4739b53b411391a26de37b98469f and project 60281cf1dbe645d8949e93f9e70b5d91. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:49:21.040823 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ecbc2715-f313-4029-a9c6-6d160c749f77 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:49:21.046032 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ecbc2715-f313-4029-a9c6-6d160c749f77 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea8f8711-8caf-4779-9178-ca984246258c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:49:21.131926 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ecbc2715-f313-4029-a9c6-6d160c749f77 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.814180 Aug 04 16:49:21.140563 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1431/2835] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:49:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:49:21.148786 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-569d4f04-8fb9-4e87-88f5-ba09a0a44467 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e89d4bd30>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:21.221020 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-569d4f04-8fb9-4e87-88f5-ba09a0a44467 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/4db9ab92-af40-463d-bbb5-2620217c9dc0" status: 200 len: 661 microversion: 2.1 time: 0.076643 Aug 04 16:49:21.222658 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1432/2836] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:49:21 2022] GET /compute/v2.1/images/4db9ab92-af40-463d-bbb5-2620217c9dc0 => generated 661 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:49:21.229674 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bff2e9e9-ad39-4e91-b3ac-89773fbb96e8 tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] Calling method '.version_select at 0x7f7e84194ee0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:21.361497 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bff2e9e9-ad39-4e91-b3ac-89773fbb96e8 tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/2c59d66e-c97b-4fb5-8cf0-40d66e755095" status: 200 len: 345 microversion: 2.1 time: 0.136136 Aug 04 16:49:21.362436 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1433/2837] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Aug 4 16:49:21 2022] GET /compute/v2.1/os-volumes/2c59d66e-c97b-4fb5-8cf0-40d66e755095 => generated 345 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:49:21.386149 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fca1a5cd-45c9-4438-8076-489f46d9f466 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:21.387591 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fca1a5cd-45c9-4438-8076-489f46d9f466 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea8f8711-8caf-4779-9178-ca984246258c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:21.691464 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-625c6741-5764-4554-a1cf-29cc7340d38b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:21.707121 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-625c6741-5764-4554-a1cf-29cc7340d38b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.830021 Aug 04 16:49:21.710229 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1405/2838] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:20 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:21.711526 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fca1a5cd-45c9-4438-8076-489f46d9f466 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:21.726152 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d27af5bb-440b-45fb-b753-f543ea4f26ed tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e847ed8b0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:21.733255 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fca1a5cd-45c9-4438-8076-489f46d9f466 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c" status: 200 len: 1214 microversion: 2.1 time: 0.361827 Aug 04 16:49:21.734159 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1434/2839] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:21 2022] GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c => generated 1214 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:21.752683 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7601debe-edca-4b12-85ca-e29fb88de1b4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:21.753585 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7601debe-edca-4b12-85ca-e29fb88de1b4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:21.766291 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7601debe-edca-4b12-85ca-e29fb88de1b4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:21.766734 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7601debe-edca-4b12-85ca-e29fb88de1b4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:21.767510 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7601debe-edca-4b12-85ca-e29fb88de1b4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:21.768064 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7601debe-edca-4b12-85ca-e29fb88de1b4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:21.835418 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d27af5bb-440b-45fb-b753-f543ea4f26ed tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/4db9ab92-af40-463d-bbb5-2620217c9dc0" status: 200 len: 661 microversion: 2.1 time: 0.122952 Aug 04 16:49:21.838919 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1406/2840] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:49:21 2022] GET /compute/v2.1/images/4db9ab92-af40-463d-bbb5-2620217c9dc0 => generated 661 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:49:22.201218 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7601debe-edca-4b12-85ca-e29fb88de1b4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:22.225374 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7601debe-edca-4b12-85ca-e29fb88de1b4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.489307 Aug 04 16:49:22.226539 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1435/2841] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:21 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:22.380654 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c1abfcae-ac8e-4a38-9855-43cd41eee32a tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] Calling method '.version_select at 0x7f7e89b6ec10>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:22.461359 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-c1abfcae-ac8e-4a38-9855-43cd41eee32a tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] HTTP exception thrown: Volume 2c59d66e-c97b-4fb5-8cf0-40d66e755095 could not be found. Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c1abfcae-ac8e-4a38-9855-43cd41eee32a tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] Request method failure captured: Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/os-volumes/2c59d66e-c97b-4fb5-8cf0-40d66e755095 HTTP/1.1 Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_h8bJkeAGWqgeyQXfGWDPYF9WgKeW8oQDIVUv0lzEY3NgHS5-vEjiX7xpihMB4cj_eR39xjFqtssEfJgfbNDJCqXSOOtJHwpY3Oeh1dHj9uP-olZyF4bMtTrQ5Ut1Y2SGTV9EHanKVIifSR7DM2qmoudE972S1ub7GagkqJqpVsLFc Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: ee2d4f5c07de4e03a0faaa5c813a297b Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-109330324 Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee2d4f5c07de4e03a0faaa5c813a297b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ee2d4f5c07de4e03a0faaa5c813a297b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee2d4f5c07de4e03a0faaa5c813a297b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ee2d4f5c07de4e03a0faaa5c813a297b"}]}] Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-VolumesSnapshotsTestJSON-109330324 Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: ee2d4f5c07de4e03a0faaa5c813a297b Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-109330324 Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-VolumesSnapshotsTestJSON-109330324-project Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: f35db75473824161b1abbb033d711780 Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-VolumesSnapshotsTestJSON-109330324-project Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: exception: Volume 2c59d66e-c97b-4fb5-8cf0-40d66e755095 could not be found. Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '2c59d66e-c97b-4fb5-8cf0-40d66e755095'} Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2c59d66e-c97b-4fb5-8cf0-40d66e755095 could not be found. (HTTP 404) (Request-ID: req-7227806b-7d1b-40d5-8c74-d29ff2351c9f) Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 16:49:22.464669 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2c59d66e-c97b-4fb5-8cf0-40d66e755095 could not be found. Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2c59d66e-c97b-4fb5-8cf0-40d66e755095 could not be found. Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2c59d66e-c97b-4fb5-8cf0-40d66e755095 could not be found. Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:49:22.470797 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c1abfcae-ac8e-4a38-9855-43cd41eee32a tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] Returning 404 to user: Volume 2c59d66e-c97b-4fb5-8cf0-40d66e755095 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:49:22.474178 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c1abfcae-ac8e-4a38-9855-43cd41eee32a tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/2c59d66e-c97b-4fb5-8cf0-40d66e755095" status: 404 len: 109 microversion: 2.1 time: 0.096573 Aug 04 16:49:22.479322 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1407/2842] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Aug 4 16:49:22 2022] GET /compute/v2.1/os-volumes/2c59d66e-c97b-4fb5-8cf0-40d66e755095 => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:49:22.487543 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4c388062-3dea-470e-8065-8e4d3b607b2d tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] Calling method '.version_select at 0x7f7e89b90af0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:22.547108 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-63feb8ad-403f-4290-a685-5f143c7be008 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-504231964", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "fcd939fe-a897-44ae-b0c2-2548006a8cea"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:49:22.574628 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-4c388062-3dea-470e-8065-8e4d3b607b2d tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] HTTP exception thrown: Volume 2c59d66e-c97b-4fb5-8cf0-40d66e755095 could not be found. Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4c388062-3dea-470e-8065-8e4d3b607b2d tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] Request method failure captured: Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/os-volumes/2c59d66e-c97b-4fb5-8cf0-40d66e755095 HTTP/1.1 Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_h8bJkeAGWqgeyQXfGWDPYF9WgKeW8oQDIVUv0lzEY3NgHS5-vEjiX7xpihMB4cj_eR39xjFqtssEfJgfbNDJCqXSOOtJHwpY3Oeh1dHj9uP-olZyF4bMtTrQ5Ut1Y2SGTV9EHanKVIifSR7DM2qmoudE972S1ub7GagkqJqpVsLFc Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: ee2d4f5c07de4e03a0faaa5c813a297b Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-109330324 Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee2d4f5c07de4e03a0faaa5c813a297b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ee2d4f5c07de4e03a0faaa5c813a297b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee2d4f5c07de4e03a0faaa5c813a297b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ee2d4f5c07de4e03a0faaa5c813a297b"}]}] Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-VolumesSnapshotsTestJSON-109330324 Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: ee2d4f5c07de4e03a0faaa5c813a297b Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-109330324 Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-VolumesSnapshotsTestJSON-109330324-project Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: f35db75473824161b1abbb033d711780 Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-VolumesSnapshotsTestJSON-109330324-project Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: exception: Volume 2c59d66e-c97b-4fb5-8cf0-40d66e755095 could not be found. Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '2c59d66e-c97b-4fb5-8cf0-40d66e755095'} Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2c59d66e-c97b-4fb5-8cf0-40d66e755095 could not be found. (HTTP 404) (Request-ID: req-dce5f7b5-ca46-4b92-a3d3-450f54775a3e) Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 16:49:22.577024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2c59d66e-c97b-4fb5-8cf0-40d66e755095 could not be found. Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2c59d66e-c97b-4fb5-8cf0-40d66e755095 could not be found. Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2c59d66e-c97b-4fb5-8cf0-40d66e755095 could not be found. Aug 04 16:49:22.580963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:22.589328 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4c388062-3dea-470e-8065-8e4d3b607b2d tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] Returning 404 to user: Volume 2c59d66e-c97b-4fb5-8cf0-40d66e755095 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:49:22.589328 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4c388062-3dea-470e-8065-8e4d3b607b2d tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/2c59d66e-c97b-4fb5-8cf0-40d66e755095" status: 404 len: 109 microversion: 2.1 time: 0.105159 Aug 04 16:49:22.589888 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1436/2843] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Aug 4 16:49:22 2022] DELETE /compute/v2.1/os-volumes/2c59d66e-c97b-4fb5-8cf0-40d66e755095 => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:49:22.598629 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-097c338a-262a-4b79-a767-e53d12176c2e tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] Calling method '.version_select at 0x7f7e89b96700>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:22.676600 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-097c338a-262a-4b79-a767-e53d12176c2e tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] HTTP exception thrown: Volume 2c59d66e-c97b-4fb5-8cf0-40d66e755095 could not be found. Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-097c338a-262a-4b79-a767-e53d12176c2e tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] Request method failure captured: Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/os-volumes/2c59d66e-c97b-4fb5-8cf0-40d66e755095 HTTP/1.1 Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_h8bJkeAGWqgeyQXfGWDPYF9WgKeW8oQDIVUv0lzEY3NgHS5-vEjiX7xpihMB4cj_eR39xjFqtssEfJgfbNDJCqXSOOtJHwpY3Oeh1dHj9uP-olZyF4bMtTrQ5Ut1Y2SGTV9EHanKVIifSR7DM2qmoudE972S1ub7GagkqJqpVsLFc Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: ee2d4f5c07de4e03a0faaa5c813a297b Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-109330324 Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee2d4f5c07de4e03a0faaa5c813a297b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ee2d4f5c07de4e03a0faaa5c813a297b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee2d4f5c07de4e03a0faaa5c813a297b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ee2d4f5c07de4e03a0faaa5c813a297b"}]}] Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-VolumesSnapshotsTestJSON-109330324 Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: ee2d4f5c07de4e03a0faaa5c813a297b Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-109330324 Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-VolumesSnapshotsTestJSON-109330324-project Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: f35db75473824161b1abbb033d711780 Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-VolumesSnapshotsTestJSON-109330324-project Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: exception: Volume 2c59d66e-c97b-4fb5-8cf0-40d66e755095 could not be found. Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '2c59d66e-c97b-4fb5-8cf0-40d66e755095'} Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2c59d66e-c97b-4fb5-8cf0-40d66e755095 could not be found. (HTTP 404) (Request-ID: req-b1f7f3cf-b785-43bf-bace-608d48bb0b98) Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 16:49:22.678686 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2c59d66e-c97b-4fb5-8cf0-40d66e755095 could not be found. Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2c59d66e-c97b-4fb5-8cf0-40d66e755095 could not be found. Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2c59d66e-c97b-4fb5-8cf0-40d66e755095 could not be found. Aug 04 16:49:22.683455 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:49:22.687576 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-097c338a-262a-4b79-a767-e53d12176c2e tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] Returning 404 to user: Volume 2c59d66e-c97b-4fb5-8cf0-40d66e755095 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:49:22.688989 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-097c338a-262a-4b79-a767-e53d12176c2e tempest-VolumesSnapshotsTestJSON-109330324 tempest-VolumesSnapshotsTestJSON-109330324-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/2c59d66e-c97b-4fb5-8cf0-40d66e755095" status: 404 len: 109 microversion: 2.1 time: 0.095034 Aug 04 16:49:22.690349 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1437/2844] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Aug 4 16:49:22 2022] GET /compute/v2.1/os-volumes/2c59d66e-c97b-4fb5-8cf0-40d66e755095 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:49:22.720011 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-63feb8ad-403f-4290-a685-5f143c7be008 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] validate_networks() for [('fcd939fe-a897-44ae-b0c2-2548006a8cea', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:49:22.757164 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2a73fc9c-95b6-46d6-a3a9-6580634ca160 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:22.758009 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2a73fc9c-95b6-46d6-a3a9-6580634ca160 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea8f8711-8caf-4779-9178-ca984246258c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:22.775903 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2a73fc9c-95b6-46d6-a3a9-6580634ca160 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:22.778347 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2a73fc9c-95b6-46d6-a3a9-6580634ca160 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:22.780606 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2a73fc9c-95b6-46d6-a3a9-6580634ca160 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:22.784975 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2a73fc9c-95b6-46d6-a3a9-6580634ca160 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:23.566496 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2a73fc9c-95b6-46d6-a3a9-6580634ca160 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:23.584158 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2a73fc9c-95b6-46d6-a3a9-6580634ca160 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c" status: 200 len: 1266 microversion: 2.1 time: 0.832063 Aug 04 16:49:23.586976 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1438/2845] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:22 2022] GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c => generated 1266 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:49:24.011625 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4e21727a-d674-4caa-a1af-99b7732ba456 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e89ca2a60>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:24.095169 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4e21727a-d674-4caa-a1af-99b7732ba456 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/d010b829-4d79-4cab-8cb1-1527e8ee4c61" status: 200 len: 661 microversion: 2.1 time: 0.088145 Aug 04 16:49:24.096372 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1439/2846] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:49:24 2022] GET /compute/v2.1/images/d010b829-4d79-4cab-8cb1-1527e8ee4c61 => generated 661 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:49:24.110348 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-74e4a4b2-5980-4dcd-978e-125e83cbb63e tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e89ba5940>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:24.174822 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-74e4a4b2-5980-4dcd-978e-125e83cbb63e tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/d010b829-4d79-4cab-8cb1-1527e8ee4c61" status: 200 len: 661 microversion: 2.1 time: 0.069519 Aug 04 16:49:24.175717 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1440/2847] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:49:24 2022] GET /compute/v2.1/images/d010b829-4d79-4cab-8cb1-1527e8ee4c61 => generated 661 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:49:24.398343 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6bd0093c-7171-44f4-9628-654cc031722c tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1646138855", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:49:24.479024 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-6bd0093c-7171-44f4-9628-654cc031722c tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] validate_networks() for None {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:49:25.029110 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-63feb8ad-403f-4290-a685-5f143c7be008 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:49:25.029846 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-63feb8ad-403f-4290-a685-5f143c7be008 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:49:25.030257 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-63feb8ad-403f-4290-a685-5f143c7be008 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:49:25.031181 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-63feb8ad-403f-4290-a685-5f143c7be008 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:49:25.032685 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-63feb8ad-403f-4290-a685-5f143c7be008 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:49:25.062866 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63feb8ad-403f-4290-a685-5f143c7be008 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:25.063319 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63feb8ad-403f-4290-a685-5f143c7be008 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:25.068933 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63feb8ad-403f-4290-a685-5f143c7be008 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:25.072209 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63feb8ad-403f-4290-a685-5f143c7be008 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:25.155323 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-63feb8ad-403f-4290-a685-5f143c7be008 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Getting quotas for project 96ce955c9158463e9e98c53b99c581ec. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:49:25.169929 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-63feb8ad-403f-4290-a685-5f143c7be008 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Getting quotas for user 438d083dc9e74b2f8970455505791250 and project 96ce955c9158463e9e98c53b99c581ec. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:49:25.254427 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-63feb8ad-403f-4290-a685-5f143c7be008 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:49:25.257123 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-63feb8ad-403f-4290-a685-5f143c7be008 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: f80ffdf6-eb69-43da-939b-4c9417d873bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:49:25.361233 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-63feb8ad-403f-4290-a685-5f143c7be008 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.818849 Aug 04 16:49:25.363038 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1408/2848] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:49:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 16:49:25.374637 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a044095a-5658-408a-8d90-126d47f1cba8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:25.380941 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a044095a-5658-408a-8d90-126d47f1cba8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea8f8711-8caf-4779-9178-ca984246258c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:25.389468 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a044095a-5658-408a-8d90-126d47f1cba8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:25.390579 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a044095a-5658-408a-8d90-126d47f1cba8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:25.391808 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a044095a-5658-408a-8d90-126d47f1cba8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:25.392497 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a044095a-5658-408a-8d90-126d47f1cba8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:26.675085 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a044095a-5658-408a-8d90-126d47f1cba8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:26.694628 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a044095a-5658-408a-8d90-126d47f1cba8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c" status: 200 len: 1272 microversion: 2.1 time: 1.327207 Aug 04 16:49:26.714354 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1409/2849] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:25 2022] GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c => generated 1272 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:26.728844 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-52ffba8a-b5a7-409a-80e1-1a5ff94c54d0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:26.734406 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-52ffba8a-b5a7-409a-80e1-1a5ff94c54d0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: f80ffdf6-eb69-43da-939b-4c9417d873bf] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:26.767315 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-52ffba8a-b5a7-409a-80e1-1a5ff94c54d0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:26.769456 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-52ffba8a-b5a7-409a-80e1-1a5ff94c54d0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:26.773269 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-52ffba8a-b5a7-409a-80e1-1a5ff94c54d0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:26.773990 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-52ffba8a-b5a7-409a-80e1-1a5ff94c54d0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:26.986864 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-52ffba8a-b5a7-409a-80e1-1a5ff94c54d0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:27.002064 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-52ffba8a-b5a7-409a-80e1-1a5ff94c54d0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf" status: 200 len: 1218 microversion: 2.1 time: 0.286491 Aug 04 16:49:27.018536 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1410/2850] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:26 2022] GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf => generated 1218 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:27.128193 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-6bd0093c-7171-44f4-9628-654cc031722c tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:49:27.128689 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-6bd0093c-7171-44f4-9628-654cc031722c tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:49:27.129533 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-6bd0093c-7171-44f4-9628-654cc031722c tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:49:27.130121 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-6bd0093c-7171-44f4-9628-654cc031722c tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:49:27.130707 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-6bd0093c-7171-44f4-9628-654cc031722c tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:49:27.190287 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6bd0093c-7171-44f4-9628-654cc031722c tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:27.195455 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6bd0093c-7171-44f4-9628-654cc031722c tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:27.201619 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6bd0093c-7171-44f4-9628-654cc031722c tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:27.208515 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6bd0093c-7171-44f4-9628-654cc031722c tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:27.346013 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-6bd0093c-7171-44f4-9628-654cc031722c tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Getting quotas for project 3731044d35c449289d1000d0628d06c4. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:49:27.371417 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-6bd0093c-7171-44f4-9628-654cc031722c tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Getting quotas for user 8ad56451fe41482585833461124f0497 and project 3731044d35c449289d1000d0628d06c4. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:49:27.417445 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6bd0093c-7171-44f4-9628-654cc031722c tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:49:27.428538 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6bd0093c-7171-44f4-9628-654cc031722c tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] [instance: 9139a17d-927c-4595-a7ff-11a1fa3a6a69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:49:27.592783 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6bd0093c-7171-44f4-9628-654cc031722c tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.197675 Aug 04 16:49:27.596920 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1441/2851] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:49:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 3203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:49:27.724253 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-46b9958a-22d0-4f12-a8a4-872ce625ac7e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:27.724886 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-46b9958a-22d0-4f12-a8a4-872ce625ac7e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea8f8711-8caf-4779-9178-ca984246258c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:27.737382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-46b9958a-22d0-4f12-a8a4-872ce625ac7e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:27.737829 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-46b9958a-22d0-4f12-a8a4-872ce625ac7e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:27.738613 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-46b9958a-22d0-4f12-a8a4-872ce625ac7e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:27.739060 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-46b9958a-22d0-4f12-a8a4-872ce625ac7e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:27.957429 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-46b9958a-22d0-4f12-a8a4-872ce625ac7e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:27.984099 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-46b9958a-22d0-4f12-a8a4-872ce625ac7e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c" status: 200 len: 1272 microversion: 2.1 time: 0.263552 Aug 04 16:49:27.987345 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1411/2852] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:27 2022] GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c => generated 1272 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:28.024779 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f017c6c6-1e1e-4ae9-9483-954086e7fa77 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:28.025972 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f017c6c6-1e1e-4ae9-9483-954086e7fa77 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: f80ffdf6-eb69-43da-939b-4c9417d873bf] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:28.044998 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f017c6c6-1e1e-4ae9-9483-954086e7fa77 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:28.056773 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f017c6c6-1e1e-4ae9-9483-954086e7fa77 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:28.058206 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f017c6c6-1e1e-4ae9-9483-954086e7fa77 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:28.061203 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f017c6c6-1e1e-4ae9-9483-954086e7fa77 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:28.169328 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-09db42e5-d2db-4dc3-89e5-748c0cdbed8e tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-711000495", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:49:28.402292 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-09db42e5-d2db-4dc3-89e5-748c0cdbed8e tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] validate_networks() for None {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:49:29.008912 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f017c6c6-1e1e-4ae9-9483-954086e7fa77 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:29.024370 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f017c6c6-1e1e-4ae9-9483-954086e7fa77 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf" status: 200 len: 1274 microversion: 2.1 time: 1.003104 Aug 04 16:49:29.025268 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1442/2853] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:28 2022] GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf => generated 1274 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:29.452832 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-15b9f1f3-b880-4c30-8c5e-e35df2970ed3 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1073495931", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "dbf7ee17-cf69-4014-9a16-7990ca252dc3"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:49:29.509777 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-09db42e5-d2db-4dc3-89e5-748c0cdbed8e tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:49:29.510237 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-09db42e5-d2db-4dc3-89e5-748c0cdbed8e tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:49:29.510644 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-09db42e5-d2db-4dc3-89e5-748c0cdbed8e tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:49:29.511040 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-09db42e5-d2db-4dc3-89e5-748c0cdbed8e tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:49:29.511500 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-09db42e5-d2db-4dc3-89e5-748c0cdbed8e tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:49:29.538675 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-09db42e5-d2db-4dc3-89e5-748c0cdbed8e tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:29.539444 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-09db42e5-d2db-4dc3-89e5-748c0cdbed8e tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:29.540722 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-09db42e5-d2db-4dc3-89e5-748c0cdbed8e tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:29.543267 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-09db42e5-d2db-4dc3-89e5-748c0cdbed8e tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:29.584570 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-15b9f1f3-b880-4c30-8c5e-e35df2970ed3 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] validate_networks() for [('dbf7ee17-cf69-4014-9a16-7990ca252dc3', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:49:29.593447 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-09db42e5-d2db-4dc3-89e5-748c0cdbed8e tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Getting quotas for project 3731044d35c449289d1000d0628d06c4. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:49:29.607391 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-09db42e5-d2db-4dc3-89e5-748c0cdbed8e tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Getting quotas for user 8ad56451fe41482585833461124f0497 and project 3731044d35c449289d1000d0628d06c4. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:49:29.643621 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-09db42e5-d2db-4dc3-89e5-748c0cdbed8e tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:49:29.647146 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-09db42e5-d2db-4dc3-89e5-748c0cdbed8e tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] [instance: 800296f7-67da-4f41-aea4-e7e1af65e6c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:49:29.731671 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-09db42e5-d2db-4dc3-89e5-748c0cdbed8e tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.570425 Aug 04 16:49:29.732770 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1412/2854] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:49:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 16:49:29.747868 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ccd2fad9-886c-48e3-b861-56da106bd4bb tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:29.752165 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ccd2fad9-886c-48e3-b861-56da106bd4bb tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea8f8711-8caf-4779-9178-ca984246258c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:29.783733 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ccd2fad9-886c-48e3-b861-56da106bd4bb tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:29.785484 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ccd2fad9-886c-48e3-b861-56da106bd4bb tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:29.787433 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ccd2fad9-886c-48e3-b861-56da106bd4bb tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:29.788038 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ccd2fad9-886c-48e3-b861-56da106bd4bb tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:31.396198 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ccd2fad9-886c-48e3-b861-56da106bd4bb tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:31.406500 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ccd2fad9-886c-48e3-b861-56da106bd4bb tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c" status: 200 len: 1314 microversion: 2.1 time: 1.672428 Aug 04 16:49:31.410783 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1413/2855] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:29 2022] GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c => generated 1314 bytes in 1677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:31.422112 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b8dc8888-67cf-4b8e-ade6-980c210f9846 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:31.422981 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b8dc8888-67cf-4b8e-ade6-980c210f9846 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] [instance: 800296f7-67da-4f41-aea4-e7e1af65e6c2] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:31.462766 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b8dc8888-67cf-4b8e-ade6-980c210f9846 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:31.464491 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b8dc8888-67cf-4b8e-ade6-980c210f9846 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:31.466684 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b8dc8888-67cf-4b8e-ade6-980c210f9846 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:31.467781 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b8dc8888-67cf-4b8e-ade6-980c210f9846 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:31.676043 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b8dc8888-67cf-4b8e-ade6-980c210f9846 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad56451fe41482585833461124f0497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3731044d35c449289d1000d0628d06c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:31.685864 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b8dc8888-67cf-4b8e-ade6-980c210f9846 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2" status: 200 len: 1269 microversion: 2.1 time: 0.273614 Aug 04 16:49:31.699191 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1414/2856] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:31 2022] GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2 => generated 1269 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:31.704595 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-58c63380-90c7-4bea-b9f4-a097f6a85349 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:31.705525 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-58c63380-90c7-4bea-b9f4-a097f6a85349 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: f80ffdf6-eb69-43da-939b-4c9417d873bf] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:31.712807 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58c63380-90c7-4bea-b9f4-a097f6a85349 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:31.713563 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58c63380-90c7-4bea-b9f4-a097f6a85349 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:31.714531 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58c63380-90c7-4bea-b9f4-a097f6a85349 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:31.715117 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58c63380-90c7-4bea-b9f4-a097f6a85349 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:33.855508 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-58c63380-90c7-4bea-b9f4-a097f6a85349 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:33.874089 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-58c63380-90c7-4bea-b9f4-a097f6a85349 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf" status: 200 len: 1314 microversion: 2.1 time: 2.173241 Aug 04 16:49:33.876332 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1415/2857] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:31 2022] GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf => generated 1314 bytes in 2176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:33.886955 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a449a033-37f0-4b12-99e9-728336f447a5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:33.893147 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a449a033-37f0-4b12-99e9-728336f447a5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea8f8711-8caf-4779-9178-ca984246258c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:33.899053 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a449a033-37f0-4b12-99e9-728336f447a5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:33.899611 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a449a033-37f0-4b12-99e9-728336f447a5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:33.900495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a449a033-37f0-4b12-99e9-728336f447a5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:33.901029 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a449a033-37f0-4b12-99e9-728336f447a5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:34.726288 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-15b9f1f3-b880-4c30-8c5e-e35df2970ed3 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:49:34.729781 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-15b9f1f3-b880-4c30-8c5e-e35df2970ed3 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:49:34.737341 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-15b9f1f3-b880-4c30-8c5e-e35df2970ed3 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:49:34.741516 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-15b9f1f3-b880-4c30-8c5e-e35df2970ed3 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:49:34.741988 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-15b9f1f3-b880-4c30-8c5e-e35df2970ed3 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:49:34.757585 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-15b9f1f3-b880-4c30-8c5e-e35df2970ed3 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:34.759872 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-15b9f1f3-b880-4c30-8c5e-e35df2970ed3 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:34.761139 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-15b9f1f3-b880-4c30-8c5e-e35df2970ed3 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:34.761815 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-15b9f1f3-b880-4c30-8c5e-e35df2970ed3 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:34.795306 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-15b9f1f3-b880-4c30-8c5e-e35df2970ed3 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Getting quotas for project d3f0979b44784c5d94b20f7592a9c30b. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:49:34.818372 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-15b9f1f3-b880-4c30-8c5e-e35df2970ed3 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Getting quotas for user a73a263f70e1496f9ecd5689db374f9b and project d3f0979b44784c5d94b20f7592a9c30b. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:49:34.891899 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-15b9f1f3-b880-4c30-8c5e-e35df2970ed3 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:49:34.909574 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-15b9f1f3-b880-4c30-8c5e-e35df2970ed3 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] [instance: a926ff5a-2816-4ee9-b6c6-68dd79c1976c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:49:35.027461 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-15b9f1f3-b880-4c30-8c5e-e35df2970ed3 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.997236 Aug 04 16:49:35.031087 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1443/2858] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:49:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 6004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:49:35.044792 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a8edde01-e1be-47fb-9e8a-a1c131a1a5d6 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:35.046183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a8edde01-e1be-47fb-9e8a-a1c131a1a5d6 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] [instance: 800296f7-67da-4f41-aea4-e7e1af65e6c2] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:35.058494 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8edde01-e1be-47fb-9e8a-a1c131a1a5d6 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:35.060888 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8edde01-e1be-47fb-9e8a-a1c131a1a5d6 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:35.062308 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8edde01-e1be-47fb-9e8a-a1c131a1a5d6 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:35.063263 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8edde01-e1be-47fb-9e8a-a1c131a1a5d6 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:35.296055 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a449a033-37f0-4b12-99e9-728336f447a5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:35.310052 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a449a033-37f0-4b12-99e9-728336f447a5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c" status: 200 len: 1314 microversion: 2.1 time: 1.431262 Aug 04 16:49:35.322333 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1416/2859] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:33 2022] GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c => generated 1314 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:35.338270 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-c33d343d-828b-4981-a52a-08ae2bf9d6b6 req-66db1e29-173a-4b5c-8b24-1d2c8c3f2f99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f80ffdf6-eb69-43da-939b-4c9417d873bf", "tag": "a94d7826-be7e-4909-ad12-744419720da9"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:49:35.348215 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a8edde01-e1be-47fb-9e8a-a1c131a1a5d6 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad56451fe41482585833461124f0497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3731044d35c449289d1000d0628d06c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:35.365209 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a8edde01-e1be-47fb-9e8a-a1c131a1a5d6 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2" status: 200 len: 1275 microversion: 2.1 time: 0.329723 Aug 04 16:49:35.367316 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1444/2860] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:35 2022] GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2 => generated 1275 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:35.375053 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-25acf6e7-caf8-4817-8802-3d437b85c2e1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:35.376108 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-c33d343d-828b-4981-a52a-08ae2bf9d6b6 req-66db1e29-173a-4b5c-8b24-1d2c8c3f2f99 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:35.376341 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-c33d343d-828b-4981-a52a-08ae2bf9d6b6 req-66db1e29-173a-4b5c-8b24-1d2c8c3f2f99 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:35.385012 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-25acf6e7-caf8-4817-8802-3d437b85c2e1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: f80ffdf6-eb69-43da-939b-4c9417d873bf] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:35.393590 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-c33d343d-828b-4981-a52a-08ae2bf9d6b6 req-66db1e29-173a-4b5c-8b24-1d2c8c3f2f99 service nova] Creating event network-changed:a94d7826-be7e-4909-ad12-744419720da9 for instance f80ffdf6-eb69-43da-939b-4c9417d873bf on n-h2-846466-12 Aug 04 16:49:35.399264 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-25acf6e7-caf8-4817-8802-3d437b85c2e1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:35.400458 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-c33d343d-828b-4981-a52a-08ae2bf9d6b6 req-66db1e29-173a-4b5c-8b24-1d2c8c3f2f99 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076519 Aug 04 16:49:35.401321 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1417/2861] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:49:35.401974 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-25acf6e7-caf8-4817-8802-3d437b85c2e1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:35.403764 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-25acf6e7-caf8-4817-8802-3d437b85c2e1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:35.404979 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-25acf6e7-caf8-4817-8802-3d437b85c2e1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:35.408039 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-19558191-7d4a-4289-98a7-e0d032cdfda8 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:35.414582 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-19558191-7d4a-4289-98a7-e0d032cdfda8 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] [instance: a926ff5a-2816-4ee9-b6c6-68dd79c1976c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:35.697812 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-19558191-7d4a-4289-98a7-e0d032cdfda8 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73a263f70e1496f9ecd5689db374f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f0979b44784c5d94b20f7592a9c30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:35.707933 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-19558191-7d4a-4289-98a7-e0d032cdfda8 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] 10.222.0.23 "GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c" status: 200 len: 1216 microversion: 2.1 time: 0.303150 Aug 04 16:49:35.710287 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1418/2862] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:35 2022] GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c => generated 1216 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:36.338811 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4cbff149-2a88-4e71-bbe4-99cc8d6a82e8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:36.339646 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4cbff149-2a88-4e71-bbe4-99cc8d6a82e8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea8f8711-8caf-4779-9178-ca984246258c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:36.353879 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4cbff149-2a88-4e71-bbe4-99cc8d6a82e8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:36.361887 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4cbff149-2a88-4e71-bbe4-99cc8d6a82e8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:36.363835 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4cbff149-2a88-4e71-bbe4-99cc8d6a82e8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:36.367632 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4cbff149-2a88-4e71-bbe4-99cc8d6a82e8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:36.538382 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-25acf6e7-caf8-4817-8802-3d437b85c2e1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:36.549327 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-25acf6e7-caf8-4817-8802-3d437b85c2e1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf" status: 200 len: 1314 microversion: 2.1 time: 1.179182 Aug 04 16:49:36.550455 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1445/2863] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:35 2022] GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf => generated 1314 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:36.556666 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0794011d-94c4-4b59-ac50-6368d570c94a tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:36.559314 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0794011d-94c4-4b59-ac50-6368d570c94a tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] [instance: 800296f7-67da-4f41-aea4-e7e1af65e6c2] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:36.567647 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0794011d-94c4-4b59-ac50-6368d570c94a tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:36.568371 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0794011d-94c4-4b59-ac50-6368d570c94a tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:36.569585 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0794011d-94c4-4b59-ac50-6368d570c94a tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:36.570174 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0794011d-94c4-4b59-ac50-6368d570c94a tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:36.941978 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0794011d-94c4-4b59-ac50-6368d570c94a tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad56451fe41482585833461124f0497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3731044d35c449289d1000d0628d06c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:36.961200 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0794011d-94c4-4b59-ac50-6368d570c94a tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2" status: 200 len: 1275 microversion: 2.1 time: 0.409268 Aug 04 16:49:36.963685 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1446/2864] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:36 2022] GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2 => generated 1275 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:36.977370 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-338f5451-5745-4e2a-a016-99ed794b1859 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:36.980399 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-338f5451-5745-4e2a-a016-99ed794b1859 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] [instance: a926ff5a-2816-4ee9-b6c6-68dd79c1976c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:37.001158 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-338f5451-5745-4e2a-a016-99ed794b1859 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:37.002013 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-338f5451-5745-4e2a-a016-99ed794b1859 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:37.007261 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-338f5451-5745-4e2a-a016-99ed794b1859 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:37.007831 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-338f5451-5745-4e2a-a016-99ed794b1859 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:37.352321 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-338f5451-5745-4e2a-a016-99ed794b1859 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73a263f70e1496f9ecd5689db374f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f0979b44784c5d94b20f7592a9c30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:37.355604 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4cbff149-2a88-4e71-bbe4-99cc8d6a82e8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:37.367866 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-338f5451-5745-4e2a-a016-99ed794b1859 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] 10.222.0.23 "GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c" status: 200 len: 1276 microversion: 2.1 time: 0.401339 Aug 04 16:49:37.369748 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1447/2865] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:36 2022] GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c => generated 1276 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:37.374129 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4cbff149-2a88-4e71-bbe4-99cc8d6a82e8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c" status: 200 len: 1314 microversion: 2.1 time: 1.039457 Aug 04 16:49:37.388873 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1419/2866] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:36 2022] GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c => generated 1314 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:37.510419 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-ecf1294f-6103-4f07-b9df-1e9ab9578469 req-ed50f8d2-2ac5-44ce-83f3-e6c45aca7a15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea8f8711-8caf-4779-9178-ca984246258c", "tag": "298e9931-d3d2-4d09-9874-fb606c37f54f"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:49:37.542119 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-ecf1294f-6103-4f07-b9df-1e9ab9578469 req-ed50f8d2-2ac5-44ce-83f3-e6c45aca7a15 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:37.548994 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-ecf1294f-6103-4f07-b9df-1e9ab9578469 req-ed50f8d2-2ac5-44ce-83f3-e6c45aca7a15 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:37.574510 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-04bc8c1f-02ad-463d-b649-68abce0ea00c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:37.575162 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-04bc8c1f-02ad-463d-b649-68abce0ea00c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: f80ffdf6-eb69-43da-939b-4c9417d873bf] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:37.578661 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-ecf1294f-6103-4f07-b9df-1e9ab9578469 req-ed50f8d2-2ac5-44ce-83f3-e6c45aca7a15 service nova] Creating event network-changed:298e9931-d3d2-4d09-9874-fb606c37f54f for instance ea8f8711-8caf-4779-9178-ca984246258c on n-h1-846466-12 Aug 04 16:49:37.587735 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-04bc8c1f-02ad-463d-b649-68abce0ea00c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:37.588797 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-04bc8c1f-02ad-463d-b649-68abce0ea00c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:37.589804 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-04bc8c1f-02ad-463d-b649-68abce0ea00c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:37.591584 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-04bc8c1f-02ad-463d-b649-68abce0ea00c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:37.595334 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-ecf1294f-6103-4f07-b9df-1e9ab9578469 req-ed50f8d2-2ac5-44ce-83f3-e6c45aca7a15 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090891 Aug 04 16:49:37.596312 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1448/2867] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:49:37.987005 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cc9b73df-6e77-4d6f-8b91-34e441b66228 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:37.987955 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cc9b73df-6e77-4d6f-8b91-34e441b66228 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] [instance: 800296f7-67da-4f41-aea4-e7e1af65e6c2] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:38.000338 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cc9b73df-6e77-4d6f-8b91-34e441b66228 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:38.004757 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cc9b73df-6e77-4d6f-8b91-34e441b66228 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:38.010357 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cc9b73df-6e77-4d6f-8b91-34e441b66228 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:38.011012 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cc9b73df-6e77-4d6f-8b91-34e441b66228 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:38.223453 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cc9b73df-6e77-4d6f-8b91-34e441b66228 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad56451fe41482585833461124f0497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3731044d35c449289d1000d0628d06c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:38.237714 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cc9b73df-6e77-4d6f-8b91-34e441b66228 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2" status: 200 len: 1275 microversion: 2.1 time: 0.256223 Aug 04 16:49:38.239319 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1449/2868] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:37 2022] GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2 => generated 1275 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:38.400066 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a5315ca7-b7ff-43bc-a5c6-024ce0e56f72 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:38.401683 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a5315ca7-b7ff-43bc-a5c6-024ce0e56f72 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] [instance: a926ff5a-2816-4ee9-b6c6-68dd79c1976c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:38.415580 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a5315ca7-b7ff-43bc-a5c6-024ce0e56f72 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:38.416519 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a5315ca7-b7ff-43bc-a5c6-024ce0e56f72 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:38.417648 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a5315ca7-b7ff-43bc-a5c6-024ce0e56f72 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:38.419455 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a5315ca7-b7ff-43bc-a5c6-024ce0e56f72 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:39.075734 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-04bc8c1f-02ad-463d-b649-68abce0ea00c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:39.086389 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-04bc8c1f-02ad-463d-b649-68abce0ea00c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf" status: 200 len: 1314 microversion: 2.1 time: 1.515782 Aug 04 16:49:39.093675 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1420/2869] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:37 2022] GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf => generated 1314 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:39.098821 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8bc6fcec-b399-4618-8126-739d67ce0cab tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:39.102048 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8bc6fcec-b399-4618-8126-739d67ce0cab tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea8f8711-8caf-4779-9178-ca984246258c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:39.119071 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:49:39.121141 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8bc6fcec-b399-4618-8126-739d67ce0cab tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:39.121849 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8bc6fcec-b399-4618-8126-739d67ce0cab tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:39.122948 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8bc6fcec-b399-4618-8126-739d67ce0cab tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:39.128693 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8bc6fcec-b399-4618-8126-739d67ce0cab tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:39.564881 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=4 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:49:39.659770 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a5315ca7-b7ff-43bc-a5c6-024ce0e56f72 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73a263f70e1496f9ecd5689db374f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f0979b44784c5d94b20f7592a9c30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:39.678124 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a5315ca7-b7ff-43bc-a5c6-024ce0e56f72 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] 10.222.0.23 "GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c" status: 200 len: 1316 microversion: 2.1 time: 1.285113 Aug 04 16:49:39.692068 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1450/2870] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:38 2022] GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c => generated 1316 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:39.697779 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-566d1669-6efa-4493-b8e2-a7c5cedf755b tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:39.698954 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-566d1669-6efa-4493-b8e2-a7c5cedf755b tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] [instance: 800296f7-67da-4f41-aea4-e7e1af65e6c2] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:39.706728 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-566d1669-6efa-4493-b8e2-a7c5cedf755b tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:39.707169 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-566d1669-6efa-4493-b8e2-a7c5cedf755b tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:39.708137 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-566d1669-6efa-4493-b8e2-a7c5cedf755b tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:39.708727 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-566d1669-6efa-4493-b8e2-a7c5cedf755b tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:40.329985 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8bc6fcec-b399-4618-8126-739d67ce0cab tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:40.353228 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8bc6fcec-b399-4618-8126-739d67ce0cab tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c" status: 200 len: 1314 microversion: 2.1 time: 1.258191 Aug 04 16:49:40.354046 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1421/2871] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:39 2022] GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c => generated 1314 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:40.371057 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-df92036e-0187-4caa-a315-9fa589175e0e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:40.372010 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-df92036e-0187-4caa-a315-9fa589175e0e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: f80ffdf6-eb69-43da-939b-4c9417d873bf] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:40.391178 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-df92036e-0187-4caa-a315-9fa589175e0e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:40.394308 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-df92036e-0187-4caa-a315-9fa589175e0e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:40.395264 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-df92036e-0187-4caa-a315-9fa589175e0e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:40.395830 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-df92036e-0187-4caa-a315-9fa589175e0e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:41.114980 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-566d1669-6efa-4493-b8e2-a7c5cedf755b tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad56451fe41482585833461124f0497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3731044d35c449289d1000d0628d06c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:41.146249 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-566d1669-6efa-4493-b8e2-a7c5cedf755b tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2" status: 200 len: 1317 microversion: 2.1 time: 1.452556 Aug 04 16:49:41.149597 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1451/2872] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:39 2022] GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2 => generated 1317 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:41.178142 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c2430643-8684-4575-948f-1807793bc4c1 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:41.180264 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c2430643-8684-4575-948f-1807793bc4c1 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] [instance: a926ff5a-2816-4ee9-b6c6-68dd79c1976c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:41.189026 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:49:41.215252 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2430643-8684-4575-948f-1807793bc4c1 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:41.216289 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2430643-8684-4575-948f-1807793bc4c1 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:41.217843 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2430643-8684-4575-948f-1807793bc4c1 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:41.218462 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2430643-8684-4575-948f-1807793bc4c1 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:41.972054 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-df92036e-0187-4caa-a315-9fa589175e0e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:41.997889 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-df92036e-0187-4caa-a315-9fa589175e0e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf" status: 200 len: 1314 microversion: 2.1 time: 1.640168 Aug 04 16:49:42.012774 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1422/2873] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:40 2022] GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf => generated 1314 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:42.012774 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-4e092e20-ad2e-4204-b73a-5f8fa0b9c813 req-1b6b809b-6e0e-4e44-b755-5f044c152794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f80ffdf6-eb69-43da-939b-4c9417d873bf", "name": "network-vif-plugged", "status": "completed", "tag": "a94d7826-be7e-4909-ad12-744419720da9"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:49:42.051778 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-4e092e20-ad2e-4204-b73a-5f8fa0b9c813 req-1b6b809b-6e0e-4e44-b755-5f044c152794 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:42.055558 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-4e092e20-ad2e-4204-b73a-5f8fa0b9c813 req-1b6b809b-6e0e-4e44-b755-5f044c152794 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:42.063784 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=100 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:49:42.090947 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-4e092e20-ad2e-4204-b73a-5f8fa0b9c813 req-1b6b809b-6e0e-4e44-b755-5f044c152794 service nova] Creating event network-vif-plugged:a94d7826-be7e-4909-ad12-744419720da9 for instance f80ffdf6-eb69-43da-939b-4c9417d873bf on n-h2-846466-12 Aug 04 16:49:42.108517 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-4e092e20-ad2e-4204-b73a-5f8fa0b9c813 req-1b6b809b-6e0e-4e44-b755-5f044c152794 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106659 Aug 04 16:49:42.109672 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1423/2874] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:49:42.118135 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e17f1547-447c-42ac-bddc-9f0d14e31b33 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:42.119461 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e17f1547-447c-42ac-bddc-9f0d14e31b33 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea8f8711-8caf-4779-9178-ca984246258c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:42.129691 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e17f1547-447c-42ac-bddc-9f0d14e31b33 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:42.130385 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e17f1547-447c-42ac-bddc-9f0d14e31b33 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:42.131352 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e17f1547-447c-42ac-bddc-9f0d14e31b33 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:42.132141 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e17f1547-447c-42ac-bddc-9f0d14e31b33 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:42.500753 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c2430643-8684-4575-948f-1807793bc4c1 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73a263f70e1496f9ecd5689db374f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f0979b44784c5d94b20f7592a9c30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:42.508732 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c2430643-8684-4575-948f-1807793bc4c1 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] 10.222.0.23 "GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c" status: 200 len: 1316 microversion: 2.1 time: 1.355203 Aug 04 16:49:42.509342 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1452/2875] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:41 2022] GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c => generated 1316 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:42.525394 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d0bc586b-fb62-464f-b7ed-919109151deb tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:42.526295 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d0bc586b-fb62-464f-b7ed-919109151deb tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] [instance: 800296f7-67da-4f41-aea4-e7e1af65e6c2] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:42.536345 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d0bc586b-fb62-464f-b7ed-919109151deb tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:42.538709 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d0bc586b-fb62-464f-b7ed-919109151deb tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:42.541805 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d0bc586b-fb62-464f-b7ed-919109151deb tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:42.542427 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d0bc586b-fb62-464f-b7ed-919109151deb tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:42.919685 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e17f1547-447c-42ac-bddc-9f0d14e31b33 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:42.932159 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e17f1547-447c-42ac-bddc-9f0d14e31b33 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c" status: 200 len: 1314 microversion: 2.1 time: 0.820913 Aug 04 16:49:42.933318 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1424/2876] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:42 2022] GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c => generated 1314 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:42.948270 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-ad9bb351-2968-4b3a-8cb7-724495786330 req-bbd5e2ed-b59b-4568-a647-ac74daf59022 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9139a17d-927c-4595-a7ff-11a1fa3a6a69", "tag": "ec13d30d-7a89-4d60-b71e-301109f0b912"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:49:42.966628 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-ad9bb351-2968-4b3a-8cb7-724495786330 req-bbd5e2ed-b59b-4568-a647-ac74daf59022 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:42.967909 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-ad9bb351-2968-4b3a-8cb7-724495786330 req-bbd5e2ed-b59b-4568-a647-ac74daf59022 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:42.986164 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-ad9bb351-2968-4b3a-8cb7-724495786330 req-bbd5e2ed-b59b-4568-a647-ac74daf59022 service nova] Creating event network-changed:ec13d30d-7a89-4d60-b71e-301109f0b912 for instance 9139a17d-927c-4595-a7ff-11a1fa3a6a69 on n-h1-846466-12 Aug 04 16:49:42.997165 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-ad9bb351-2968-4b3a-8cb7-724495786330 req-bbd5e2ed-b59b-4568-a647-ac74daf59022 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061848 Aug 04 16:49:43.000458 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1425/2877] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:49:43.006569 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-17800b6d-288d-4ba3-b68d-37da1b864cac req-a09a934c-a9fc-4d39-8653-5cefad6ec1a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a926ff5a-2816-4ee9-b6c6-68dd79c1976c", "tag": "760198a1-41cc-4e68-9cc4-560c06cd4d21"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:49:43.031426 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-17800b6d-288d-4ba3-b68d-37da1b864cac req-a09a934c-a9fc-4d39-8653-5cefad6ec1a0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:43.031967 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-17800b6d-288d-4ba3-b68d-37da1b864cac req-a09a934c-a9fc-4d39-8653-5cefad6ec1a0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:43.048750 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-17800b6d-288d-4ba3-b68d-37da1b864cac req-a09a934c-a9fc-4d39-8653-5cefad6ec1a0 service nova] Creating event network-changed:760198a1-41cc-4e68-9cc4-560c06cd4d21 for instance a926ff5a-2816-4ee9-b6c6-68dd79c1976c on n-h1-846466-12 Aug 04 16:49:43.060040 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-17800b6d-288d-4ba3-b68d-37da1b864cac req-a09a934c-a9fc-4d39-8653-5cefad6ec1a0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058048 Aug 04 16:49:43.061078 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1426/2878] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:49:43.066297 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d0bc586b-fb62-464f-b7ed-919109151deb tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad56451fe41482585833461124f0497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3731044d35c449289d1000d0628d06c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:43.075511 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-082f6bf7-b8b9-4b8c-bae4-fcb6806f94f8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:43.077430 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=11,nova_cell1:DELETE=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:49:43.088321 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-082f6bf7-b8b9-4b8c-bae4-fcb6806f94f8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: f80ffdf6-eb69-43da-939b-4c9417d873bf] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:43.094646 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d0bc586b-fb62-464f-b7ed-919109151deb tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2" status: 200 len: 1317 microversion: 2.1 time: 0.578329 Aug 04 16:49:43.095356 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1453/2879] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:42 2022] GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2 => generated 1317 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:43.104140 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-082f6bf7-b8b9-4b8c-bae4-fcb6806f94f8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:43.104915 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-082f6bf7-b8b9-4b8c-bae4-fcb6806f94f8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:43.105550 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-082f6bf7-b8b9-4b8c-bae4-fcb6806f94f8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:43.106174 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-082f6bf7-b8b9-4b8c-bae4-fcb6806f94f8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:43.447749 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5c9f8f61-6a0b-42e5-9c4d-371a521a8385 tempest-FloatingIPsTestJSON-464956199 tempest-FloatingIPsTestJSON-464956199-project] Action: 'create', calling method: .version_select at 0x7f7e89caad30>, body: {"pool": null} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:49:44.146321 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-082f6bf7-b8b9-4b8c-bae4-fcb6806f94f8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:44.157235 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-082f6bf7-b8b9-4b8c-bae4-fcb6806f94f8 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf" status: 200 len: 1314 microversion: 2.1 time: 1.094813 Aug 04 16:49:44.157978 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1427/2880] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:43 2022] GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf => generated 1314 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:44.168976 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-55168d1b-b567-4d7c-8190-5754b484a977 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:44.170034 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-55168d1b-b567-4d7c-8190-5754b484a977 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] [instance: a926ff5a-2816-4ee9-b6c6-68dd79c1976c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:44.186332 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-55168d1b-b567-4d7c-8190-5754b484a977 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:44.187662 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-55168d1b-b567-4d7c-8190-5754b484a977 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:44.188735 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-55168d1b-b567-4d7c-8190-5754b484a977 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:44.189467 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-55168d1b-b567-4d7c-8190-5754b484a977 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:44.778978 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:49:44.850696 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=20 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:49:45.069903 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-55168d1b-b567-4d7c-8190-5754b484a977 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73a263f70e1496f9ecd5689db374f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f0979b44784c5d94b20f7592a9c30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:45.087978 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-55168d1b-b567-4d7c-8190-5754b484a977 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] 10.222.0.23 "GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c" status: 200 len: 1316 microversion: 2.1 time: 0.928895 Aug 04 16:49:45.092661 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1428/2881] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:44 2022] GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c => generated 1316 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:45.105568 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f55e641d-2fcb-4e6f-9739-3506f3fd7ec4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:45.106267 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f55e641d-2fcb-4e6f-9739-3506f3fd7ec4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea8f8711-8caf-4779-9178-ca984246258c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:45.125149 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f55e641d-2fcb-4e6f-9739-3506f3fd7ec4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:45.125605 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f55e641d-2fcb-4e6f-9739-3506f3fd7ec4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:45.126592 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f55e641d-2fcb-4e6f-9739-3506f3fd7ec4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:45.126883 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f55e641d-2fcb-4e6f-9739-3506f3fd7ec4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:45.706002 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=14 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:49:45.822010 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f55e641d-2fcb-4e6f-9739-3506f3fd7ec4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:45.831277 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f55e641d-2fcb-4e6f-9739-3506f3fd7ec4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c" status: 200 len: 1314 microversion: 2.1 time: 0.737522 Aug 04 16:49:45.837487 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1429/2882] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:45 2022] GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c => generated 1314 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:45.848273 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f4a5bc1e-b6bc-4e4e-8893-8d08cb3fce1b tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:45.849166 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f4a5bc1e-b6bc-4e4e-8893-8d08cb3fce1b tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] [instance: 800296f7-67da-4f41-aea4-e7e1af65e6c2] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:45.858370 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f4a5bc1e-b6bc-4e4e-8893-8d08cb3fce1b tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:45.858942 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f4a5bc1e-b6bc-4e4e-8893-8d08cb3fce1b tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:45.859893 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f4a5bc1e-b6bc-4e4e-8893-8d08cb3fce1b tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:45.860452 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f4a5bc1e-b6bc-4e4e-8893-8d08cb3fce1b tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:47.098117 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f4a5bc1e-b6bc-4e4e-8893-8d08cb3fce1b tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad56451fe41482585833461124f0497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3731044d35c449289d1000d0628d06c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:47.107383 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f4a5bc1e-b6bc-4e4e-8893-8d08cb3fce1b tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2" status: 200 len: 1317 microversion: 2.1 time: 1.263405 Aug 04 16:49:47.116162 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1430/2883] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:45 2022] GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2 => generated 1317 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:47.137264 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-7eec841c-a63e-424a-8a75-e0cb7704266d req-4364763f-d34b-4d18-ad69-eb5ba8e67954 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "800296f7-67da-4f41-aea4-e7e1af65e6c2", "tag": "edcd52e8-c9af-4fd4-9b1a-35c30ea3ae67"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:49:47.160361 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-7eec841c-a63e-424a-8a75-e0cb7704266d req-4364763f-d34b-4d18-ad69-eb5ba8e67954 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:47.161872 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-7eec841c-a63e-424a-8a75-e0cb7704266d req-4364763f-d34b-4d18-ad69-eb5ba8e67954 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:47.204474 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-7eec841c-a63e-424a-8a75-e0cb7704266d req-4364763f-d34b-4d18-ad69-eb5ba8e67954 service nova] Creating event network-changed:edcd52e8-c9af-4fd4-9b1a-35c30ea3ae67 for instance 800296f7-67da-4f41-aea4-e7e1af65e6c2 on n-h2-846466-12 Aug 04 16:49:47.224669 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-7eec841c-a63e-424a-8a75-e0cb7704266d req-4364763f-d34b-4d18-ad69-eb5ba8e67954 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107408 Aug 04 16:49:47.225536 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1431/2884] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:49:47.235970 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-10211b84-a9c1-44ca-b913-a60526264edf tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:47.236671 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-10211b84-a9c1-44ca-b913-a60526264edf tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: f80ffdf6-eb69-43da-939b-4c9417d873bf] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:47.256359 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-10211b84-a9c1-44ca-b913-a60526264edf tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:47.259703 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-10211b84-a9c1-44ca-b913-a60526264edf tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:47.262789 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-10211b84-a9c1-44ca-b913-a60526264edf tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:47.263464 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-10211b84-a9c1-44ca-b913-a60526264edf tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:47.871085 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-10211b84-a9c1-44ca-b913-a60526264edf tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:47.911043 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-10211b84-a9c1-44ca-b913-a60526264edf tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf" status: 200 len: 1501 microversion: 2.1 time: 0.682489 Aug 04 16:49:47.913598 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1432/2885] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:47 2022] GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf => generated 1501 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:47.929832 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fba1b231-c687-4d0a-b467-4f3c1355b123 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:47.932273 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fba1b231-c687-4d0a-b467-4f3c1355b123 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] [instance: a926ff5a-2816-4ee9-b6c6-68dd79c1976c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:47.953238 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fba1b231-c687-4d0a-b467-4f3c1355b123 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:47.953776 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fba1b231-c687-4d0a-b467-4f3c1355b123 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:47.954617 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fba1b231-c687-4d0a-b467-4f3c1355b123 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:47.955047 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fba1b231-c687-4d0a-b467-4f3c1355b123 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:48.300281 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fba1b231-c687-4d0a-b467-4f3c1355b123 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73a263f70e1496f9ecd5689db374f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f0979b44784c5d94b20f7592a9c30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:48.314481 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fba1b231-c687-4d0a-b467-4f3c1355b123 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] 10.222.0.23 "GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c" status: 200 len: 1316 microversion: 2.1 time: 0.395943 Aug 04 16:49:48.315371 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1433/2886] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:47 2022] GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c => generated 1316 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:48.331661 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7b755e80-1826-48f9-9c3b-8d91d6ce2608 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:48.332284 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7b755e80-1826-48f9-9c3b-8d91d6ce2608 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea8f8711-8caf-4779-9178-ca984246258c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:48.340923 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b755e80-1826-48f9-9c3b-8d91d6ce2608 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:48.342456 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b755e80-1826-48f9-9c3b-8d91d6ce2608 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:48.344403 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b755e80-1826-48f9-9c3b-8d91d6ce2608 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:48.344849 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b755e80-1826-48f9-9c3b-8d91d6ce2608 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:48.806593 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7b755e80-1826-48f9-9c3b-8d91d6ce2608 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:48.818221 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7b755e80-1826-48f9-9c3b-8d91d6ce2608 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c" status: 200 len: 1314 microversion: 2.1 time: 0.501278 Aug 04 16:49:48.819722 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1434/2887] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:48 2022] GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c => generated 1314 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:48.827967 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-aa9cc04e-25ad-4120-9080-7675a84f884b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:49:48.834096 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-aa9cc04e-25ad-4120-9080-7675a84f884b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: f80ffdf6-eb69-43da-939b-4c9417d873bf] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:48.846832 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aa9cc04e-25ad-4120-9080-7675a84f884b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:48.858041 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aa9cc04e-25ad-4120-9080-7675a84f884b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:48.859153 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aa9cc04e-25ad-4120-9080-7675a84f884b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:48.859591 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aa9cc04e-25ad-4120-9080-7675a84f884b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:48.990950 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-aa9cc04e-25ad-4120-9080-7675a84f884b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "POST /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf/action" status: 202 len: 0 microversion: 2.1 time: 0.167670 Aug 04 16:49:48.991884 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1435/2888] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:49:48 2022] POST /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:49:49.029361 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-26c31802-66c3-4dec-a6f6-c47a605e4664 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:49.033308 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-26c31802-66c3-4dec-a6f6-c47a605e4664 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] [instance: 800296f7-67da-4f41-aea4-e7e1af65e6c2] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:49.058822 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-26c31802-66c3-4dec-a6f6-c47a605e4664 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:49.059796 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-26c31802-66c3-4dec-a6f6-c47a605e4664 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:49.068858 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-26c31802-66c3-4dec-a6f6-c47a605e4664 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:49.069673 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-26c31802-66c3-4dec-a6f6-c47a605e4664 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:49.143046 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5c9f8f61-6a0b-42e5-9c4d-371a521a8385 tempest-FloatingIPsTestJSON-464956199 tempest-FloatingIPsTestJSON-464956199-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.870657 Aug 04 16:49:49.150378 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1454/2889] 10.222.0.23 () {60 vars in 1170 bytes} [Thu Aug 4 16:49:43 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:49:49.156105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a2690c03-7f2c-41a4-97fb-bc45cfa9a11d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:49.156727 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a2690c03-7f2c-41a4-97fb-bc45cfa9a11d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: f80ffdf6-eb69-43da-939b-4c9417d873bf] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:49.163294 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a2690c03-7f2c-41a4-97fb-bc45cfa9a11d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:49.163920 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a2690c03-7f2c-41a4-97fb-bc45cfa9a11d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:49.164871 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a2690c03-7f2c-41a4-97fb-bc45cfa9a11d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:49.165489 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a2690c03-7f2c-41a4-97fb-bc45cfa9a11d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:49.681927 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-26c31802-66c3-4dec-a6f6-c47a605e4664 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad56451fe41482585833461124f0497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3731044d35c449289d1000d0628d06c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:49.689763 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a2690c03-7f2c-41a4-97fb-bc45cfa9a11d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:49.697888 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a2690c03-7f2c-41a4-97fb-bc45cfa9a11d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf" status: 200 len: 1506 microversion: 2.1 time: 0.546302 Aug 04 16:49:49.707258 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1455/2890] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:49 2022] GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf => generated 1506 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:49.712606 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-488b1a26-322a-4cad-8e03-1099cbcf0a29 tempest-FloatingIPsTestJSON-464956199 tempest-FloatingIPsTestJSON-464956199-project] Calling method '.version_select at 0x7f7e89b52e50>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:49.728526 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-26c31802-66c3-4dec-a6f6-c47a605e4664 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2" status: 200 len: 1317 microversion: 2.1 time: 0.732870 Aug 04 16:49:49.729716 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1436/2891] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:48 2022] GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2 => generated 1317 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:49.747278 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-3ae9a64e-327f-43ee-ba8d-301c6b1979ce req-692b483b-ec99-48c0-92bd-38d96bfe9947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea8f8711-8caf-4779-9178-ca984246258c", "name": "network-vif-plugged", "status": "completed", "tag": "298e9931-d3d2-4d09-9874-fb606c37f54f"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:49:49.769016 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-3ae9a64e-327f-43ee-ba8d-301c6b1979ce req-692b483b-ec99-48c0-92bd-38d96bfe9947 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:49.769985 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-3ae9a64e-327f-43ee-ba8d-301c6b1979ce req-692b483b-ec99-48c0-92bd-38d96bfe9947 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:49.795128 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-3ae9a64e-327f-43ee-ba8d-301c6b1979ce req-692b483b-ec99-48c0-92bd-38d96bfe9947 service nova] Creating event network-vif-plugged:298e9931-d3d2-4d09-9874-fb606c37f54f for instance ea8f8711-8caf-4779-9178-ca984246258c on n-h1-846466-12 Aug 04 16:49:49.803124 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-3ae9a64e-327f-43ee-ba8d-301c6b1979ce req-692b483b-ec99-48c0-92bd-38d96bfe9947 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071942 Aug 04 16:49:49.805550 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1437/2892] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:49:49.812676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-819e1e8a-5767-4df6-ab75-36d20b2c4e8d tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:49.814659 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-819e1e8a-5767-4df6-ab75-36d20b2c4e8d tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] [instance: a926ff5a-2816-4ee9-b6c6-68dd79c1976c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:49.824292 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-819e1e8a-5767-4df6-ab75-36d20b2c4e8d tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:49.825732 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-819e1e8a-5767-4df6-ab75-36d20b2c4e8d tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:49.827439 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-819e1e8a-5767-4df6-ab75-36d20b2c4e8d tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:49.828055 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-819e1e8a-5767-4df6-ab75-36d20b2c4e8d tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:50.423377 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-488b1a26-322a-4cad-8e03-1099cbcf0a29 tempest-FloatingIPsTestJSON-464956199 tempest-FloatingIPsTestJSON-464956199-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/8554261d-704f-4521-ac51-2cd0914d9b12" status: 200 len: 142 microversion: 2.1 time: 0.714631 Aug 04 16:49:50.424083 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1456/2893] 10.222.0.23 () {58 vars in 1260 bytes} [Thu Aug 4 16:49:49 2022] GET /compute/v2.1/os-floating-ips/8554261d-704f-4521-ac51-2cd0914d9b12 => generated 142 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:49:50.445334 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a50a1f3f-5b08-4212-a34b-2532e8827681 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:50.448249 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a50a1f3f-5b08-4212-a34b-2532e8827681 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea8f8711-8caf-4779-9178-ca984246258c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:50.456495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-819e1e8a-5767-4df6-ab75-36d20b2c4e8d tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73a263f70e1496f9ecd5689db374f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f0979b44784c5d94b20f7592a9c30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:50.465027 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-819e1e8a-5767-4df6-ab75-36d20b2c4e8d tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] 10.222.0.23 "GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c" status: 200 len: 1316 microversion: 2.1 time: 0.656555 Aug 04 16:49:50.465974 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1438/2894] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:49 2022] GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c => generated 1316 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:50.467382 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a50a1f3f-5b08-4212-a34b-2532e8827681 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:50.469850 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a50a1f3f-5b08-4212-a34b-2532e8827681 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:50.472862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a50a1f3f-5b08-4212-a34b-2532e8827681 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:50.473771 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a50a1f3f-5b08-4212-a34b-2532e8827681 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:50.477766 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bd129635-4d34-46ea-825c-3385ac6b46ce tempest-FloatingIPsTestJSON-464956199 tempest-FloatingIPsTestJSON-464956199-project] Calling method '.version_select at 0x7f7e84a35670>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:51.209409 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bd129635-4d34-46ea-825c-3385ac6b46ce tempest-FloatingIPsTestJSON-464956199 tempest-FloatingIPsTestJSON-464956199-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.742458 Aug 04 16:49:51.210160 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1439/2895] 10.222.0.23 () {58 vars in 1149 bytes} [Thu Aug 4 16:49:50 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:49:51.216261 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c00ae8d5-cc4d-4e6c-8051-fcc1a146647c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:51.216596 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c00ae8d5-cc4d-4e6c-8051-fcc1a146647c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: f80ffdf6-eb69-43da-939b-4c9417d873bf] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:51.233951 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c00ae8d5-cc4d-4e6c-8051-fcc1a146647c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:51.234789 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c00ae8d5-cc4d-4e6c-8051-fcc1a146647c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:51.236613 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c00ae8d5-cc4d-4e6c-8051-fcc1a146647c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:51.239566 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c00ae8d5-cc4d-4e6c-8051-fcc1a146647c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:51.340312 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a50a1f3f-5b08-4212-a34b-2532e8827681 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:51.360440 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a50a1f3f-5b08-4212-a34b-2532e8827681 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c" status: 200 len: 1314 microversion: 2.1 time: 0.925022 Aug 04 16:49:51.363462 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1457/2896] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:50 2022] GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c => generated 1314 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:51.380481 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0f51ab8b-cbb4-4fd0-a5fb-a54c012758d9 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:51.383335 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0f51ab8b-cbb4-4fd0-a5fb-a54c012758d9 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] [instance: 800296f7-67da-4f41-aea4-e7e1af65e6c2] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:51.394448 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0f51ab8b-cbb4-4fd0-a5fb-a54c012758d9 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:51.395164 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0f51ab8b-cbb4-4fd0-a5fb-a54c012758d9 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:51.396116 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0f51ab8b-cbb4-4fd0-a5fb-a54c012758d9 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:51.396717 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0f51ab8b-cbb4-4fd0-a5fb-a54c012758d9 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:52.179899 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c00ae8d5-cc4d-4e6c-8051-fcc1a146647c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:52.205339 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c00ae8d5-cc4d-4e6c-8051-fcc1a146647c tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf" status: 200 len: 1486 microversion: 2.1 time: 0.992094 Aug 04 16:49:52.205963 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1440/2897] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:51 2022] GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf => generated 1486 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:52.231316 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5bc8e66b-a1f4-486c-835a-bbf807005abd tempest-FloatingIPsTestJSON-464956199 tempest-FloatingIPsTestJSON-464956199-project] Calling method '.version_select at 0x7f7e89b6e9d0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:52.243269 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0f51ab8b-cbb4-4fd0-a5fb-a54c012758d9 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad56451fe41482585833461124f0497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3731044d35c449289d1000d0628d06c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:52.269447 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0f51ab8b-cbb4-4fd0-a5fb-a54c012758d9 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2" status: 200 len: 1317 microversion: 2.1 time: 0.898240 Aug 04 16:49:52.270541 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1458/2898] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:51 2022] GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2 => generated 1317 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:52.277712 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8e3a1b56-07a7-41f3-b4b4-f1a8ff62b461 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:52.278182 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8e3a1b56-07a7-41f3-b4b4-f1a8ff62b461 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] [instance: a926ff5a-2816-4ee9-b6c6-68dd79c1976c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:52.301491 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8e3a1b56-07a7-41f3-b4b4-f1a8ff62b461 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:52.302361 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8e3a1b56-07a7-41f3-b4b4-f1a8ff62b461 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:52.303534 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8e3a1b56-07a7-41f3-b4b4-f1a8ff62b461 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:52.304290 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8e3a1b56-07a7-41f3-b4b4-f1a8ff62b461 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:52.854869 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8e3a1b56-07a7-41f3-b4b4-f1a8ff62b461 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73a263f70e1496f9ecd5689db374f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f0979b44784c5d94b20f7592a9c30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:52.864016 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8e3a1b56-07a7-41f3-b4b4-f1a8ff62b461 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] 10.222.0.23 "GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c" status: 200 len: 1316 microversion: 2.1 time: 0.592571 Aug 04 16:49:52.869979 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1459/2899] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:52 2022] GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c => generated 1316 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:52.885614 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-042dafa0-77de-42b6-a7c9-dfab45219b74 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:49:52.886393 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-042dafa0-77de-42b6-a7c9-dfab45219b74 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: f80ffdf6-eb69-43da-939b-4c9417d873bf] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:52.899038 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-042dafa0-77de-42b6-a7c9-dfab45219b74 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:52.899684 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-042dafa0-77de-42b6-a7c9-dfab45219b74 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:52.900691 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-042dafa0-77de-42b6-a7c9-dfab45219b74 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:52.901306 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-042dafa0-77de-42b6-a7c9-dfab45219b74 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:52.961996 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-042dafa0-77de-42b6-a7c9-dfab45219b74 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lazy-loading 'flavor' on Instance uuid f80ffdf6-eb69-43da-939b-4c9417d873bf {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:49:53.373521 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-042dafa0-77de-42b6-a7c9-dfab45219b74 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "POST /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf/action" status: 202 len: 0 microversion: 2.1 time: 0.501092 Aug 04 16:49:53.375028 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1460/2900] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:49:52 2022] POST /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:49:53.391287 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-62af87e2-fafd-4122-9f2e-d10bbfa10fe5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:53.394177 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-62af87e2-fafd-4122-9f2e-d10bbfa10fe5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea8f8711-8caf-4779-9178-ca984246258c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:53.410325 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-62af87e2-fafd-4122-9f2e-d10bbfa10fe5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:53.411701 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-62af87e2-fafd-4122-9f2e-d10bbfa10fe5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:53.415399 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-62af87e2-fafd-4122-9f2e-d10bbfa10fe5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:53.416276 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-62af87e2-fafd-4122-9f2e-d10bbfa10fe5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:53.822001 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-62af87e2-fafd-4122-9f2e-d10bbfa10fe5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:53.837663 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-62af87e2-fafd-4122-9f2e-d10bbfa10fe5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c" status: 200 len: 1502 microversion: 2.1 time: 0.458318 Aug 04 16:49:53.841014 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1461/2901] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:53 2022] GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c => generated 1502 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:53.861826 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9447849d-3ec3-4896-ade8-4b3bc1f2257a tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:53.866661 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9447849d-3ec3-4896-ade8-4b3bc1f2257a tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] [instance: 800296f7-67da-4f41-aea4-e7e1af65e6c2] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:53.881965 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9447849d-3ec3-4896-ade8-4b3bc1f2257a tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:53.884735 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9447849d-3ec3-4896-ade8-4b3bc1f2257a tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:53.886509 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9447849d-3ec3-4896-ade8-4b3bc1f2257a tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:53.891607 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9447849d-3ec3-4896-ade8-4b3bc1f2257a tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:54.306215 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9447849d-3ec3-4896-ade8-4b3bc1f2257a tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad56451fe41482585833461124f0497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3731044d35c449289d1000d0628d06c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:54.319505 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9447849d-3ec3-4896-ade8-4b3bc1f2257a tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2" status: 200 len: 1317 microversion: 2.1 time: 0.475473 Aug 04 16:49:54.320737 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1462/2902] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:53 2022] GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2 => generated 1317 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:54.334369 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9c2e4d11-9c83-467b-9d3c-add01b67d5f7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:54.336036 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9c2e4d11-9c83-467b-9d3c-add01b67d5f7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: f80ffdf6-eb69-43da-939b-4c9417d873bf] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:54.355508 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c2e4d11-9c83-467b-9d3c-add01b67d5f7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:54.356496 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c2e4d11-9c83-467b-9d3c-add01b67d5f7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:54.357873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c2e4d11-9c83-467b-9d3c-add01b67d5f7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:54.358555 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c2e4d11-9c83-467b-9d3c-add01b67d5f7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:54.518078 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5bc8e66b-a1f4-486c-835a-bbf807005abd tempest-FloatingIPsTestJSON-464956199 tempest-FloatingIPsTestJSON-464956199-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/8554261d-704f-4521-ac51-2cd0914d9b12" status: 202 len: 0 microversion: 2.1 time: 2.305898 Aug 04 16:49:54.518783 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1441/2903] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Aug 4 16:49:52 2022] DELETE /compute/v2.1/os-floating-ips/8554261d-704f-4521-ac51-2cd0914d9b12 => generated 0 bytes in 2307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:49:54.524109 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ff7905f7-46c9-4702-997c-ff109d26c96a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:49:54.541147 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ff7905f7-46c9-4702-997c-ff109d26c96a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:54.542320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ff7905f7-46c9-4702-997c-ff109d26c96a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:54.601988 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ff7905f7-46c9-4702-997c-ff109d26c96a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea8f8711-8caf-4779-9178-ca984246258c] Going to try to stop instance {{(pid=126126) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 16:49:54.726805 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ff7905f7-46c9-4702-997c-ff109d26c96a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "POST /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c/action" status: 202 len: 0 microversion: 2.1 time: 0.203843 Aug 04 16:49:54.727514 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1442/2904] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:49:54 2022] POST /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:49:54.745717 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6a3f7ccb-b45b-4469-a0d0-f50158f44613 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:54.748093 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6a3f7ccb-b45b-4469-a0d0-f50158f44613 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] [instance: a926ff5a-2816-4ee9-b6c6-68dd79c1976c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:54.762340 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a3f7ccb-b45b-4469-a0d0-f50158f44613 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:54.763028 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a3f7ccb-b45b-4469-a0d0-f50158f44613 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:54.774021 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a3f7ccb-b45b-4469-a0d0-f50158f44613 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:54.775160 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a3f7ccb-b45b-4469-a0d0-f50158f44613 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:54.834919 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:49:55.117611 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6a3f7ccb-b45b-4469-a0d0-f50158f44613 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73a263f70e1496f9ecd5689db374f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f0979b44784c5d94b20f7592a9c30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:55.129584 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6a3f7ccb-b45b-4469-a0d0-f50158f44613 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] 10.222.0.23 "GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c" status: 200 len: 1316 microversion: 2.1 time: 0.398417 Aug 04 16:49:55.130499 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1443/2905] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:54 2022] GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c => generated 1316 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:55.131508 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9c2e4d11-9c83-467b-9d3c-add01b67d5f7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:55.136381 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0aa17ac0-5889-4e2d-b6b4-42fc68b4f87f tempest-FloatingIPsTestJSON-464956199 tempest-FloatingIPsTestJSON-464956199-project] Action: 'create', calling method: .version_select at 0x7f7e84a990d0>, body: {"pool": null} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:49:55.156060 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9c2e4d11-9c83-467b-9d3c-add01b67d5f7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf" status: 200 len: 1513 microversion: 2.1 time: 0.830797 Aug 04 16:49:55.156716 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1463/2906] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:54 2022] GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf => generated 1513 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:55.161547 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f5e02466-aa2a-498e-9318-07ea97b1a51b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:55.162472 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f5e02466-aa2a-498e-9318-07ea97b1a51b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea8f8711-8caf-4779-9178-ca984246258c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:55.172896 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f5e02466-aa2a-498e-9318-07ea97b1a51b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:55.173853 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f5e02466-aa2a-498e-9318-07ea97b1a51b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:55.175047 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f5e02466-aa2a-498e-9318-07ea97b1a51b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:55.175542 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f5e02466-aa2a-498e-9318-07ea97b1a51b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:55.491612 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f5e02466-aa2a-498e-9318-07ea97b1a51b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:55.516793 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f5e02466-aa2a-498e-9318-07ea97b1a51b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c" status: 200 len: 1512 microversion: 2.1 time: 0.357829 Aug 04 16:49:55.536626 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1464/2907] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:55 2022] GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c => generated 1512 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:55.555613 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-052f1b51-41d4-422c-8de9-55c3dd5b4745 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Action: 'create', calling method: .version_select at 0x7f7e84903160>, body: {"keypair": {"name": "tempest-keypair-1732731097", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINug/isFhZISvONnzPG5lTFfC2A85SRJLDxcNU/OD0pkQJr0PKiEFx3mdmWTpUWk2CZ0laA8Idj5HcyNwte49qwTW2fjuj4OhKHay01yVYZ2vRXfqIAgZDLWl8RQxJGJg=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:49:55.623034 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-052f1b51-41d4-422c-8de9-55c3dd5b4745 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Getting quotas for project b9fcc0fe6bb74058a0125be27a3a7090. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:49:55.640409 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-052f1b51-41d4-422c-8de9-55c3dd5b4745 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Getting quotas for user 1ebb42db61b34dd2a4ba2a8ffa984684 and project b9fcc0fe6bb74058a0125be27a3a7090. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:49:55.691508 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-052f1b51-41d4-422c-8de9-55c3dd5b4745 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.153452 Aug 04 16:49:55.692621 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1465/2908] 10.222.0.23 () {62 vars in 1200 bytes} [Thu Aug 4 16:49:55 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 155 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 16:49:55.698580 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4e745d1c-d934-4312-aa90-b00bdc54b8ad tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:55.707182 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4e745d1c-d934-4312-aa90-b00bdc54b8ad tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] [instance: 800296f7-67da-4f41-aea4-e7e1af65e6c2] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:55.715447 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4e745d1c-d934-4312-aa90-b00bdc54b8ad tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:55.716075 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4e745d1c-d934-4312-aa90-b00bdc54b8ad tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:55.728627 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4e745d1c-d934-4312-aa90-b00bdc54b8ad tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:55.729723 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4e745d1c-d934-4312-aa90-b00bdc54b8ad tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:56.016246 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4e745d1c-d934-4312-aa90-b00bdc54b8ad tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad56451fe41482585833461124f0497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3731044d35c449289d1000d0628d06c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:56.044481 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4e745d1c-d934-4312-aa90-b00bdc54b8ad tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2" status: 200 len: 1317 microversion: 2.1 time: 0.348834 Aug 04 16:49:56.045494 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1466/2909] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:55 2022] GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2 => generated 1317 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:56.071450 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-5fb1778f-a034-4caf-8036-7e7534c8ee9e req-7528f6ea-0e8b-4930-9764-0adda16e70e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800296f7-67da-4f41-aea4-e7e1af65e6c2", "name": "network-vif-plugged", "status": "completed", "tag": "edcd52e8-c9af-4fd4-9b1a-35c30ea3ae67"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:49:56.148753 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-5fb1778f-a034-4caf-8036-7e7534c8ee9e req-7528f6ea-0e8b-4930-9764-0adda16e70e3 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:56.149596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-5fb1778f-a034-4caf-8036-7e7534c8ee9e req-7528f6ea-0e8b-4930-9764-0adda16e70e3 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:56.192341 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-5fb1778f-a034-4caf-8036-7e7534c8ee9e req-7528f6ea-0e8b-4930-9764-0adda16e70e3 service nova] Creating event network-vif-plugged:edcd52e8-c9af-4fd4-9b1a-35c30ea3ae67 for instance 800296f7-67da-4f41-aea4-e7e1af65e6c2 on n-h2-846466-12 Aug 04 16:49:56.206875 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-5fb1778f-a034-4caf-8036-7e7534c8ee9e req-7528f6ea-0e8b-4930-9764-0adda16e70e3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159835 Aug 04 16:49:56.207503 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1467/2910] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:49:56.237467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4391399f-b6e2-4b6d-b4ea-02fdc7fdf843 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:56.238399 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4391399f-b6e2-4b6d-b4ea-02fdc7fdf843 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] [instance: a926ff5a-2816-4ee9-b6c6-68dd79c1976c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:56.265720 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4391399f-b6e2-4b6d-b4ea-02fdc7fdf843 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:56.266727 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4391399f-b6e2-4b6d-b4ea-02fdc7fdf843 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:56.267851 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4391399f-b6e2-4b6d-b4ea-02fdc7fdf843 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:56.269771 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4391399f-b6e2-4b6d-b4ea-02fdc7fdf843 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:56.675252 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4391399f-b6e2-4b6d-b4ea-02fdc7fdf843 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73a263f70e1496f9ecd5689db374f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f0979b44784c5d94b20f7592a9c30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:56.705664 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4391399f-b6e2-4b6d-b4ea-02fdc7fdf843 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] 10.222.0.23 "GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c" status: 200 len: 1316 microversion: 2.1 time: 0.478028 Aug 04 16:49:56.706383 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1468/2911] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:56 2022] GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c => generated 1316 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:56.717136 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1053f938-9e7d-402d-9a72-b526ad410aa6 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:56.718781 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1053f938-9e7d-402d-9a72-b526ad410aa6 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: f80ffdf6-eb69-43da-939b-4c9417d873bf] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:56.744136 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1053f938-9e7d-402d-9a72-b526ad410aa6 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:56.744636 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1053f938-9e7d-402d-9a72-b526ad410aa6 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:56.746086 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1053f938-9e7d-402d-9a72-b526ad410aa6 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:56.748160 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1053f938-9e7d-402d-9a72-b526ad410aa6 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:57.402982 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1053f938-9e7d-402d-9a72-b526ad410aa6 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:57.412160 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1053f938-9e7d-402d-9a72-b526ad410aa6 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf" status: 200 len: 1508 microversion: 2.1 time: 0.704244 Aug 04 16:49:57.414724 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1469/2912] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:56 2022] GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf => generated 1508 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:57.428411 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e0084ae1-4ced-43e9-82d1-ea5b20c7e5be tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:57.429273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e0084ae1-4ced-43e9-82d1-ea5b20c7e5be tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea8f8711-8caf-4779-9178-ca984246258c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:57.444803 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e0084ae1-4ced-43e9-82d1-ea5b20c7e5be tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:57.446043 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e0084ae1-4ced-43e9-82d1-ea5b20c7e5be tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:57.449321 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e0084ae1-4ced-43e9-82d1-ea5b20c7e5be tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:57.452605 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e0084ae1-4ced-43e9-82d1-ea5b20c7e5be tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:57.941534 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e0084ae1-4ced-43e9-82d1-ea5b20c7e5be tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:57.971458 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e0084ae1-4ced-43e9-82d1-ea5b20c7e5be tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c" status: 200 len: 1512 microversion: 2.1 time: 0.552070 Aug 04 16:49:57.972207 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1470/2913] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:57 2022] GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c => generated 1512 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:57.999535 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fb01d75d-7def-48d9-b12b-2a8fd3aa7faa tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:58.000687 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fb01d75d-7def-48d9-b12b-2a8fd3aa7faa tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] [instance: 800296f7-67da-4f41-aea4-e7e1af65e6c2] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:58.016820 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fb01d75d-7def-48d9-b12b-2a8fd3aa7faa tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:58.022057 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fb01d75d-7def-48d9-b12b-2a8fd3aa7faa tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:58.023820 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fb01d75d-7def-48d9-b12b-2a8fd3aa7faa tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:58.024714 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fb01d75d-7def-48d9-b12b-2a8fd3aa7faa tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:58.718202 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fb01d75d-7def-48d9-b12b-2a8fd3aa7faa tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad56451fe41482585833461124f0497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3731044d35c449289d1000d0628d06c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:58.728753 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fb01d75d-7def-48d9-b12b-2a8fd3aa7faa tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2" status: 200 len: 1466 microversion: 2.1 time: 0.741664 Aug 04 16:49:58.753436 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1471/2914] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:57 2022] GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2 => generated 1466 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:58.782110 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4444c54e-172f-448f-bb3e-d96d12849bb2 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:58.784610 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4444c54e-172f-448f-bb3e-d96d12849bb2 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] [instance: a926ff5a-2816-4ee9-b6c6-68dd79c1976c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:58.794226 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4444c54e-172f-448f-bb3e-d96d12849bb2 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:58.795036 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4444c54e-172f-448f-bb3e-d96d12849bb2 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:58.796057 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4444c54e-172f-448f-bb3e-d96d12849bb2 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:58.796696 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4444c54e-172f-448f-bb3e-d96d12849bb2 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:58.817113 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:49:59.590045 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4444c54e-172f-448f-bb3e-d96d12849bb2 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73a263f70e1496f9ecd5689db374f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f0979b44784c5d94b20f7592a9c30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:49:59.607729 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4444c54e-172f-448f-bb3e-d96d12849bb2 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] 10.222.0.23 "GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c" status: 200 len: 1316 microversion: 2.1 time: 0.850344 Aug 04 16:49:59.624707 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1472/2915] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:58 2022] GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c => generated 1316 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:49:59.651607 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-861610bf-9518-4ece-a3ad-d7c1ed4caea7 req-4575afa1-feeb-4029-98e4-57bf02a0ee7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9139a17d-927c-4595-a7ff-11a1fa3a6a69", "name": "network-vif-plugged", "status": "completed", "tag": "ec13d30d-7a89-4d60-b71e-301109f0b912"}, {"server_uuid": "a926ff5a-2816-4ee9-b6c6-68dd79c1976c", "name": "network-vif-plugged", "status": "completed", "tag": "760198a1-41cc-4e68-9cc4-560c06cd4d21"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:49:59.695986 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-861610bf-9518-4ece-a3ad-d7c1ed4caea7 req-4575afa1-feeb-4029-98e4-57bf02a0ee7e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:59.696714 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-861610bf-9518-4ece-a3ad-d7c1ed4caea7 req-4575afa1-feeb-4029-98e4-57bf02a0ee7e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:59.739410 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0aa17ac0-5889-4e2d-b6b4-42fc68b4f87f tempest-FloatingIPsTestJSON-464956199 tempest-FloatingIPsTestJSON-464956199-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.607400 Aug 04 16:49:59.740716 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1444/2916] 10.222.0.23 () {60 vars in 1170 bytes} [Thu Aug 4 16:49:55 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:49:59.752692 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1c3e28e4-deaf-447f-901a-457122d689fc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:59.752899 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-861610bf-9518-4ece-a3ad-d7c1ed4caea7 req-4575afa1-feeb-4029-98e4-57bf02a0ee7e service nova] Creating event network-vif-plugged:ec13d30d-7a89-4d60-b71e-301109f0b912 for instance 9139a17d-927c-4595-a7ff-11a1fa3a6a69 on n-h1-846466-12 Aug 04 16:49:59.753373 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-861610bf-9518-4ece-a3ad-d7c1ed4caea7 req-4575afa1-feeb-4029-98e4-57bf02a0ee7e service nova] Creating event network-vif-plugged:760198a1-41cc-4e68-9cc4-560c06cd4d21 for instance a926ff5a-2816-4ee9-b6c6-68dd79c1976c on n-h1-846466-12 Aug 04 16:49:59.753490 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1c3e28e4-deaf-447f-901a-457122d689fc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: f80ffdf6-eb69-43da-939b-4c9417d873bf] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:59.774190 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-861610bf-9518-4ece-a3ad-d7c1ed4caea7 req-4575afa1-feeb-4029-98e4-57bf02a0ee7e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.146362 Aug 04 16:49:59.775637 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1473/2917] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:49:59.778285 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c3e28e4-deaf-447f-901a-457122d689fc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:59.778879 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c3e28e4-deaf-447f-901a-457122d689fc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:59.780235 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c3e28e4-deaf-447f-901a-457122d689fc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:59.780960 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c3e28e4-deaf-447f-901a-457122d689fc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:59.798201 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f02f6db3-b1ee-4a36-8152-58472f79112a tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:49:59.799778 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f02f6db3-b1ee-4a36-8152-58472f79112a tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] [instance: 9139a17d-927c-4595-a7ff-11a1fa3a6a69] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:49:59.812589 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f02f6db3-b1ee-4a36-8152-58472f79112a tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:59.813597 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f02f6db3-b1ee-4a36-8152-58472f79112a tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:49:59.814594 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f02f6db3-b1ee-4a36-8152-58472f79112a tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:49:59.815240 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f02f6db3-b1ee-4a36-8152-58472f79112a tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:00.711306 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1c3e28e4-deaf-447f-901a-457122d689fc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:00.756380 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1c3e28e4-deaf-447f-901a-457122d689fc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf" status: 200 len: 1508 microversion: 2.1 time: 0.994582 Aug 04 16:50:00.764357 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1445/2918] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:59 2022] GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf => generated 1508 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:00.799007 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c160be2b-5769-4f39-ba90-3de47d3c28ba tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:00.810186 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c160be2b-5769-4f39-ba90-3de47d3c28ba tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea8f8711-8caf-4779-9178-ca984246258c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:00.835333 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c160be2b-5769-4f39-ba90-3de47d3c28ba tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:00.837924 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c160be2b-5769-4f39-ba90-3de47d3c28ba tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:00.846902 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c160be2b-5769-4f39-ba90-3de47d3c28ba tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:00.847665 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c160be2b-5769-4f39-ba90-3de47d3c28ba tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:00.874102 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f02f6db3-b1ee-4a36-8152-58472f79112a tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad56451fe41482585833461124f0497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3731044d35c449289d1000d0628d06c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:00.888843 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f02f6db3-b1ee-4a36-8152-58472f79112a tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/servers/9139a17d-927c-4595-a7ff-11a1fa3a6a69" status: 200 len: 1318 microversion: 2.1 time: 1.110051 Aug 04 16:50:00.892615 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1474/2919] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:49:59 2022] GET /compute/v2.1/servers/9139a17d-927c-4595-a7ff-11a1fa3a6a69 => generated 1318 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:00.904937 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-afd96867-55cc-4e9f-8530-61d13fb1932f tempest-FloatingIPsTestJSON-464956199 tempest-FloatingIPsTestJSON-464956199-project] Calling method '.version_select at 0x7f7e89cd1ca0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:01.330659 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c160be2b-5769-4f39-ba90-3de47d3c28ba tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:01.345591 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c160be2b-5769-4f39-ba90-3de47d3c28ba tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c" status: 200 len: 1512 microversion: 2.1 time: 0.557146 Aug 04 16:50:01.355388 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1446/2920] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:00 2022] GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c => generated 1512 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:01.365743 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c6a89922-77d5-4b45-8bdf-fd265f59cca4 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:01.373016 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c6a89922-77d5-4b45-8bdf-fd265f59cca4 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] [instance: a926ff5a-2816-4ee9-b6c6-68dd79c1976c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:01.381691 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c6a89922-77d5-4b45-8bdf-fd265f59cca4 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:01.382339 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c6a89922-77d5-4b45-8bdf-fd265f59cca4 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:01.383279 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c6a89922-77d5-4b45-8bdf-fd265f59cca4 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:01.384020 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c6a89922-77d5-4b45-8bdf-fd265f59cca4 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:01.711676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c6a89922-77d5-4b45-8bdf-fd265f59cca4 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73a263f70e1496f9ecd5689db374f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f0979b44784c5d94b20f7592a9c30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:01.719745 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c6a89922-77d5-4b45-8bdf-fd265f59cca4 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] 10.222.0.23 "GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c" status: 200 len: 1316 microversion: 2.1 time: 0.362862 Aug 04 16:50:01.720258 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1447/2921] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:01 2022] GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c => generated 1316 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:01.791464 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c36e96f7-8ee4-4be3-a0a8-e84872256988 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:01.792739 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c36e96f7-8ee4-4be3-a0a8-e84872256988 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: f80ffdf6-eb69-43da-939b-4c9417d873bf] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:01.826885 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c36e96f7-8ee4-4be3-a0a8-e84872256988 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:01.830423 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c36e96f7-8ee4-4be3-a0a8-e84872256988 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:01.836431 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c36e96f7-8ee4-4be3-a0a8-e84872256988 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:01.837262 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c36e96f7-8ee4-4be3-a0a8-e84872256988 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:02.243912 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c36e96f7-8ee4-4be3-a0a8-e84872256988 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:02.271018 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c36e96f7-8ee4-4be3-a0a8-e84872256988 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf" status: 200 len: 1508 microversion: 2.1 time: 0.481224 Aug 04 16:50:02.272140 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1448/2922] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:01 2022] GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf => generated 1508 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:50:02.303071 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-803e72c6-ba8b-4976-a9d6-9fe2543638ce req-dc6e2da9-b2b9-4b07-b126-b41689a1820a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f80ffdf6-eb69-43da-939b-4c9417d873bf", "name": "network-vif-plugged", "status": "completed", "tag": "a94d7826-be7e-4909-ad12-744419720da9"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:50:02.340919 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-803e72c6-ba8b-4976-a9d6-9fe2543638ce req-dc6e2da9-b2b9-4b07-b126-b41689a1820a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:02.341378 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-803e72c6-ba8b-4976-a9d6-9fe2543638ce req-dc6e2da9-b2b9-4b07-b126-b41689a1820a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:02.395971 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-803e72c6-ba8b-4976-a9d6-9fe2543638ce req-dc6e2da9-b2b9-4b07-b126-b41689a1820a service nova] Creating event network-vif-plugged:a94d7826-be7e-4909-ad12-744419720da9 for instance f80ffdf6-eb69-43da-939b-4c9417d873bf on n-h2-846466-12 Aug 04 16:50:02.424822 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-803e72c6-ba8b-4976-a9d6-9fe2543638ce req-dc6e2da9-b2b9-4b07-b126-b41689a1820a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144729 Aug 04 16:50:02.427022 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1449/2923] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:50:02.443627 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-808fe274-9a14-48f2-8ee0-5173f133844e tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:02.446128 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-808fe274-9a14-48f2-8ee0-5173f133844e tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] [instance: 9139a17d-927c-4595-a7ff-11a1fa3a6a69] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:02.465905 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-808fe274-9a14-48f2-8ee0-5173f133844e tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:02.466699 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-808fe274-9a14-48f2-8ee0-5173f133844e tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:02.467737 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-808fe274-9a14-48f2-8ee0-5173f133844e tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:02.468397 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-808fe274-9a14-48f2-8ee0-5173f133844e tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:02.904798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-808fe274-9a14-48f2-8ee0-5173f133844e tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad56451fe41482585833461124f0497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3731044d35c449289d1000d0628d06c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:02.919123 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-808fe274-9a14-48f2-8ee0-5173f133844e tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/servers/9139a17d-927c-4595-a7ff-11a1fa3a6a69" status: 200 len: 1468 microversion: 2.1 time: 0.490532 Aug 04 16:50:02.929624 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1450/2924] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:02 2022] GET /compute/v2.1/servers/9139a17d-927c-4595-a7ff-11a1fa3a6a69 => generated 1468 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:02.956780 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-39e3fc66-caa5-4b34-a729-6b1bbd45da57 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:02.962284 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-39e3fc66-caa5-4b34-a729-6b1bbd45da57 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea8f8711-8caf-4779-9178-ca984246258c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:02.990089 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39e3fc66-caa5-4b34-a729-6b1bbd45da57 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:02.992113 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39e3fc66-caa5-4b34-a729-6b1bbd45da57 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:02.996001 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39e3fc66-caa5-4b34-a729-6b1bbd45da57 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:02.997810 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39e3fc66-caa5-4b34-a729-6b1bbd45da57 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:03.247524 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-afd96867-55cc-4e9f-8530-61d13fb1932f tempest-FloatingIPsTestJSON-464956199 tempest-FloatingIPsTestJSON-464956199-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/6b85f355-b752-497d-933d-be5b3806d467" status: 202 len: 0 microversion: 2.1 time: 2.353369 Aug 04 16:50:03.248138 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1475/2925] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Aug 4 16:50:00 2022] DELETE /compute/v2.1/os-floating-ips/6b85f355-b752-497d-933d-be5b3806d467 => generated 0 bytes in 2355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:50:03.254389 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dc24050a-274c-46e3-85b6-c27bbfede115 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:03.255660 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dc24050a-274c-46e3-85b6-c27bbfede115 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] [instance: a926ff5a-2816-4ee9-b6c6-68dd79c1976c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:03.294390 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dc24050a-274c-46e3-85b6-c27bbfede115 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:03.294913 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dc24050a-274c-46e3-85b6-c27bbfede115 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:03.300203 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dc24050a-274c-46e3-85b6-c27bbfede115 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:03.300658 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dc24050a-274c-46e3-85b6-c27bbfede115 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:03.459625 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-39e3fc66-caa5-4b34-a729-6b1bbd45da57 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:03.469402 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-39e3fc66-caa5-4b34-a729-6b1bbd45da57 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c" status: 200 len: 1512 microversion: 2.1 time: 0.537672 Aug 04 16:50:03.476510 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1451/2926] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:02 2022] GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c => generated 1512 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:03.486549 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bce11345-8842-4639-bc66-93e5d3f337ce tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1160066506"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:50:03.493743 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bce11345-8842-4639-bc66-93e5d3f337ce tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] [instance: 9139a17d-927c-4595-a7ff-11a1fa3a6a69] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:03.501225 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bce11345-8842-4639-bc66-93e5d3f337ce tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:03.502708 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bce11345-8842-4639-bc66-93e5d3f337ce tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:03.503942 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bce11345-8842-4639-bc66-93e5d3f337ce tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:03.504875 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bce11345-8842-4639-bc66-93e5d3f337ce tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:03.701337 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dc24050a-274c-46e3-85b6-c27bbfede115 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73a263f70e1496f9ecd5689db374f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f0979b44784c5d94b20f7592a9c30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:03.712988 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dc24050a-274c-46e3-85b6-c27bbfede115 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] 10.222.0.23 "GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c" status: 200 len: 1504 microversion: 2.1 time: 0.463828 Aug 04 16:50:03.715225 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1476/2927] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:03 2022] GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c => generated 1504 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:03.769131 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-777662a1-bf02-4e7f-9822-e89ff8ed2673 tempest-FloatingIPsTestJSON-464956199 tempest-FloatingIPsTestJSON-464956199-project] Calling method '.version_select at 0x7f7e89cb21f0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:03.887496 n-d-846466-12 devstack@n-api.service[126125]: DEBUG neutronclient.v2_0.client [None req-777662a1-bf02-4e7f-9822-e89ff8ed2673 tempest-FloatingIPsTestJSON-464956199 tempest-FloatingIPsTestJSON-464956199-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 6b85f355-b752-497d-933d-be5b3806d467 could not be found", "detail": ""}} {{(pid=126125) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:50:03.888185 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-777662a1-bf02-4e7f-9822-e89ff8ed2673 tempest-FloatingIPsTestJSON-464956199 tempest-FloatingIPsTestJSON-464956199-project] HTTP exception thrown: Floating IP not found for ID 6b85f355-b752-497d-933d-be5b3806d467 Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-777662a1-bf02-4e7f-9822-e89ff8ed2673 tempest-FloatingIPsTestJSON-464956199 tempest-FloatingIPsTestJSON-464956199-project] Request method failure captured: Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/os-floating-ips/6b85f355-b752-497d-933d-be5b3806d467 HTTP/1.1 Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_in3hr2VWwTEZRJDNY1147XPPBMyfPSVCbPspUFIaz4TDQdJRrMWNNLRUe4-7J3bOVSjU9A64w8kniQV24EOltV2ppVRaA8jGVYr-1okLBMoM-SLpEyWOZVCPkl5id4XB65O4kZFAlwt3qzlyjGPPyqjcGWlfaWAobMzgTkBinExek Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 0b4a0267e49c41b9aabb72aeff251c6f Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-FloatingIPsTestJSON-464956199 Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0b4a0267e49c41b9aabb72aeff251c6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0b4a0267e49c41b9aabb72aeff251c6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0b4a0267e49c41b9aabb72aeff251c6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0b4a0267e49c41b9aabb72aeff251c6f"}]}] Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-FloatingIPsTestJSON-464956199 Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 0b4a0267e49c41b9aabb72aeff251c6f Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-FloatingIPsTestJSON-464956199 Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-FloatingIPsTestJSON-464956199-project Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: d2c5aa71696545e2ae0984d3405ccddc Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-FloatingIPsTestJSON-464956199-project Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: exception: Floating IP not found for ID 6b85f355-b752-497d-933d-be5b3806d467 Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '6b85f355-b752-497d-933d-be5b3806d467'} Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 6b85f355-b752-497d-933d-be5b3806d467 could not be found Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5f2d23b-2079-4686-bef8-15996b8ef31e'] Aug 04 16:50:03.894188 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:03.898923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:03.898923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:03.898923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:03.898923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 04 16:50:03.898923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 04 16:50:03.898923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 04 16:50:03.898923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 04 16:50:03.898923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 6b85f355-b752-497d-933d-be5b3806d467. Aug 04 16:50:03.898923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:03.898923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:03.898923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:03.898923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:03.898923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:50:03.898923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:50:03.898923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:50:03.898923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:50:03.898923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:50:03.898923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:50:03.898923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:50:03.898923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:50:03.898923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 04 16:50:03.898923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 16:50:03.898923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 6b85f355-b752-497d-933d-be5b3806d467 Aug 04 16:50:03.898923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:03.898923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:03.898923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:03.898923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:03.898923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:50:03.898923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:50:03.898923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:50:03.898923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:50:03.898923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 6b85f355-b752-497d-933d-be5b3806d467 Aug 04 16:50:03.898923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:03.898923 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-777662a1-bf02-4e7f-9822-e89ff8ed2673 tempest-FloatingIPsTestJSON-464956199 tempest-FloatingIPsTestJSON-464956199-project] Returning 404 to user: Floating IP not found for ID 6b85f355-b752-497d-933d-be5b3806d467 {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:50:03.898923 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-777662a1-bf02-4e7f-9822-e89ff8ed2673 tempest-FloatingIPsTestJSON-464956199 tempest-FloatingIPsTestJSON-464956199-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/6b85f355-b752-497d-933d-be5b3806d467" status: 404 len: 111 microversion: 2.1 time: 0.178829 Aug 04 16:50:03.903619 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1477/2928] 10.222.0.23 () {58 vars in 1260 bytes} [Thu Aug 4 16:50:03 2022] GET /compute/v2.1/os-floating-ips/6b85f355-b752-497d-933d-be5b3806d467 => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:50:03.913904 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3b63c1e3-c00d-46a7-8c02-f36ac6f5f384 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:03.914760 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3b63c1e3-c00d-46a7-8c02-f36ac6f5f384 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: f80ffdf6-eb69-43da-939b-4c9417d873bf] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:03.932391 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b63c1e3-c00d-46a7-8c02-f36ac6f5f384 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:03.936822 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b63c1e3-c00d-46a7-8c02-f36ac6f5f384 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:03.938833 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b63c1e3-c00d-46a7-8c02-f36ac6f5f384 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:03.939916 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b63c1e3-c00d-46a7-8c02-f36ac6f5f384 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:04.041807 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bce11345-8842-4639-bc66-93e5d3f337ce tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "POST /compute/v2.1/servers/9139a17d-927c-4595-a7ff-11a1fa3a6a69/action" status: 202 len: 0 microversion: 2.1 time: 0.561678 Aug 04 16:50:04.043346 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1452/2929] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:50:03 2022] POST /compute/v2.1/servers/9139a17d-927c-4595-a7ff-11a1fa3a6a69/action => generated 0 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 16:50:04.070095 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7aacb94f-facf-450f-9d79-fe7cb69850ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-2084132801", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "4c06324c-5733-4ac5-b611-3a1cae1cf8cd"}, {"port": "5be18406-7f65-42bc-aad8-d9f5cef83db3", "tag": "port-1"}, {"port": "afae5ef1-0557-47a8-8a2d-099bde970903", "tag": "port-2"}, {"uuid": "97efa1bd-8781-49f3-8f01-6c237775493d", "tag": "net-1"}, {"uuid": "97efa1bd-8781-49f3-8f01-6c237775493d"}, {"uuid": "02f1486f-7388-4d7e-bf53-52b75ca3bd52", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "02f1486f-7388-4d7e-bf53-52b75ca3bd52", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "5f259ef8-9cf7-448a-93a7-0116dabae173", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "d6ca9c5a-079e-4a7e-aab2-cd84910b480c", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "875b7953-065c-42f9-83eb-d017c5accbac", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--749110876"}], "key_name": "tempest-keypair-1732731097", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:50:04.384495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-7aacb94f-facf-450f-9d79-fe7cb69850ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] validate_networks() for [('4c06324c-5733-4ac5-b611-3a1cae1cf8cd', None, None, None, None, None), (None, None, '5be18406-7f65-42bc-aad8-d9f5cef83db3', None, None, None), (None, None, 'afae5ef1-0557-47a8-8a2d-099bde970903', None, None, None), ('97efa1bd-8781-49f3-8f01-6c237775493d', None, None, None, None, None), ('97efa1bd-8781-49f3-8f01-6c237775493d', None, None, None, None, None), ('02f1486f-7388-4d7e-bf53-52b75ca3bd52', '10.2.2.100', None, None, None, None), ('02f1486f-7388-4d7e-bf53-52b75ca3bd52', '10.2.2.200', None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:50:04.401883 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3b63c1e3-c00d-46a7-8c02-f36ac6f5f384 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:04.421642 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3b63c1e3-c00d-46a7-8c02-f36ac6f5f384 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf" status: 200 len: 1508 microversion: 2.1 time: 0.518634 Aug 04 16:50:04.422778 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1478/2930] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:03 2022] GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf => generated 1508 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:04.428267 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-63dd3734-661b-473a-b9e0-9eb2cf323ab3 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:04.428995 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-63dd3734-661b-473a-b9e0-9eb2cf323ab3 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] [instance: a926ff5a-2816-4ee9-b6c6-68dd79c1976c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:04.437228 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-63dd3734-661b-473a-b9e0-9eb2cf323ab3 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:04.437884 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-63dd3734-661b-473a-b9e0-9eb2cf323ab3 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:04.439612 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-63dd3734-661b-473a-b9e0-9eb2cf323ab3 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:04.440328 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-63dd3734-661b-473a-b9e0-9eb2cf323ab3 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:04.483131 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-63dd3734-661b-473a-b9e0-9eb2cf323ab3 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] [instance: a926ff5a-2816-4ee9-b6c6-68dd79c1976c] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:50:04.622144 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-63dd3734-661b-473a-b9e0-9eb2cf323ab3 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c" status: 204 len: 0 microversion: 2.1 time: 0.196766 Aug 04 16:50:04.625014 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1479/2931] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:50:04 2022] DELETE /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:50:04.635348 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d882764b-8665-49f6-9791-2f93ba0967c1 tempest-FloatingIPsTestJSON-464956199 tempest-FloatingIPsTestJSON-464956199-project] Calling method '.version_select at 0x7f7e77d7ec10>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:04.843466 n-d-846466-12 devstack@n-api.service[126125]: DEBUG neutronclient.v2_0.client [None req-d882764b-8665-49f6-9791-2f93ba0967c1 tempest-FloatingIPsTestJSON-464956199 tempest-FloatingIPsTestJSON-464956199-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 6b85f355-b752-497d-933d-be5b3806d467 could not be found", "detail": ""}} {{(pid=126125) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:50:04.844291 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-d882764b-8665-49f6-9791-2f93ba0967c1 tempest-FloatingIPsTestJSON-464956199 tempest-FloatingIPsTestJSON-464956199-project] HTTP exception thrown: Floating IP not found for ID 6b85f355-b752-497d-933d-be5b3806d467 Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d882764b-8665-49f6-9791-2f93ba0967c1 tempest-FloatingIPsTestJSON-464956199 tempest-FloatingIPsTestJSON-464956199-project] Request method failure captured: Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/os-floating-ips/6b85f355-b752-497d-933d-be5b3806d467 HTTP/1.1 Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_in3hr2VWwTEZRJDNY1147XPPBMyfPSVCbPspUFIaz4TDQdJRrMWNNLRUe4-7J3bOVSjU9A64w8kniQV24EOltV2ppVRaA8jGVYr-1okLBMoM-SLpEyWOZVCPkl5id4XB65O4kZFAlwt3qzlyjGPPyqjcGWlfaWAobMzgTkBinExek Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 0b4a0267e49c41b9aabb72aeff251c6f Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-FloatingIPsTestJSON-464956199 Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0b4a0267e49c41b9aabb72aeff251c6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0b4a0267e49c41b9aabb72aeff251c6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0b4a0267e49c41b9aabb72aeff251c6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0b4a0267e49c41b9aabb72aeff251c6f"}]}] Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-FloatingIPsTestJSON-464956199 Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 0b4a0267e49c41b9aabb72aeff251c6f Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-FloatingIPsTestJSON-464956199 Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-FloatingIPsTestJSON-464956199-project Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: d2c5aa71696545e2ae0984d3405ccddc Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-FloatingIPsTestJSON-464956199-project Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: exception: Floating IP not found for ID 6b85f355-b752-497d-933d-be5b3806d467 Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '6b85f355-b752-497d-933d-be5b3806d467'} Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 6b85f355-b752-497d-933d-be5b3806d467 could not be found Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-64f26856-d2c9-4251-bc30-cb351201928e'] Aug 04 16:50:04.846524 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:04.851664 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:04.851664 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:04.851664 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:04.851664 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 04 16:50:04.851664 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 04 16:50:04.851664 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 04 16:50:04.851664 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 04 16:50:04.851664 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 6b85f355-b752-497d-933d-be5b3806d467. Aug 04 16:50:04.851664 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:04.851664 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:04.851664 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:04.851664 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:04.851664 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:50:04.851664 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:50:04.851664 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:50:04.851664 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:50:04.851664 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:50:04.851664 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:50:04.851664 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:50:04.851664 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:50:04.851664 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 04 16:50:04.851664 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 16:50:04.851664 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 6b85f355-b752-497d-933d-be5b3806d467 Aug 04 16:50:04.851664 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:04.851664 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:04.851664 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:04.851664 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:04.851664 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:50:04.851664 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:50:04.851664 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:50:04.851664 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:50:04.851664 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 6b85f355-b752-497d-933d-be5b3806d467 Aug 04 16:50:04.851664 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:04.854300 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d882764b-8665-49f6-9791-2f93ba0967c1 tempest-FloatingIPsTestJSON-464956199 tempest-FloatingIPsTestJSON-464956199-project] Returning 404 to user: Floating IP not found for ID 6b85f355-b752-497d-933d-be5b3806d467 {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:50:04.854500 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d882764b-8665-49f6-9791-2f93ba0967c1 tempest-FloatingIPsTestJSON-464956199 tempest-FloatingIPsTestJSON-464956199-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/6b85f355-b752-497d-933d-be5b3806d467" status: 404 len: 111 microversion: 2.1 time: 0.228089 Aug 04 16:50:04.856495 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1480/2932] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Aug 4 16:50:04 2022] DELETE /compute/v2.1/os-floating-ips/6b85f355-b752-497d-933d-be5b3806d467 => generated 111 bytes in 231 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:50:04.864630 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5515bae5-d264-4fd7-8e8a-f9782c11c478 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e89c5f3a0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:04.920695 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5515bae5-d264-4fd7-8e8a-f9782c11c478 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/f45b6542-a249-441a-b979-42570ece3bd1" status: 200 len: 1455 microversion: 2.1 time: 0.063007 Aug 04 16:50:04.921628 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1481/2933] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:50:04 2022] GET /compute/v2.1/images/f45b6542-a249-441a-b979-42570ece3bd1 => generated 1455 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:04.926688 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-23a19283-6452-4c4f-bed5-e28325b2a768 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:04.927702 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-23a19283-6452-4c4f-bed5-e28325b2a768 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea8f8711-8caf-4779-9178-ca984246258c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:04.934407 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-23a19283-6452-4c4f-bed5-e28325b2a768 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:04.935204 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-23a19283-6452-4c4f-bed5-e28325b2a768 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:04.936207 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-23a19283-6452-4c4f-bed5-e28325b2a768 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:04.936861 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-23a19283-6452-4c4f-bed5-e28325b2a768 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:05.235044 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-23a19283-6452-4c4f-bed5-e28325b2a768 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:05.246842 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-23a19283-6452-4c4f-bed5-e28325b2a768 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c" status: 200 len: 1512 microversion: 2.1 time: 0.323901 Aug 04 16:50:05.257321 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1482/2934] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:04 2022] GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c => generated 1512 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:05.257321 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b9d2c51d-a6a6-4173-97ea-81d13c3c0019 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:05.258560 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b9d2c51d-a6a6-4173-97ea-81d13c3c0019 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] [instance: a926ff5a-2816-4ee9-b6c6-68dd79c1976c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:05.278671 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b9d2c51d-a6a6-4173-97ea-81d13c3c0019 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:05.279493 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b9d2c51d-a6a6-4173-97ea-81d13c3c0019 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:05.280506 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b9d2c51d-a6a6-4173-97ea-81d13c3c0019 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:05.281648 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b9d2c51d-a6a6-4173-97ea-81d13c3c0019 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:05.580239 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b9d2c51d-a6a6-4173-97ea-81d13c3c0019 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73a263f70e1496f9ecd5689db374f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f0979b44784c5d94b20f7592a9c30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:05.591200 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b9d2c51d-a6a6-4173-97ea-81d13c3c0019 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] 10.222.0.23 "GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c" status: 200 len: 1510 microversion: 2.1 time: 0.339536 Aug 04 16:50:05.593043 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1483/2935] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:05 2022] GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c => generated 1510 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:05.610833 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b0e79cff-8afb-4298-ac46-a7749d096f95 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:05.611708 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b0e79cff-8afb-4298-ac46-a7749d096f95 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: f80ffdf6-eb69-43da-939b-4c9417d873bf] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:05.619469 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0e79cff-8afb-4298-ac46-a7749d096f95 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:05.620220 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0e79cff-8afb-4298-ac46-a7749d096f95 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:05.621196 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0e79cff-8afb-4298-ac46-a7749d096f95 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:05.622269 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0e79cff-8afb-4298-ac46-a7749d096f95 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:05.665480 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:50:05.865761 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b0e79cff-8afb-4298-ac46-a7749d096f95 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:05.876822 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b0e79cff-8afb-4298-ac46-a7749d096f95 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf" status: 200 len: 1508 microversion: 2.1 time: 0.274131 Aug 04 16:50:05.879943 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1484/2936] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:05 2022] GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf => generated 1508 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:05.935764 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-48c9371b-6d79-498b-b14e-ccf3d9e96988 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e89cb2af0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:06.003240 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-48c9371b-6d79-498b-b14e-ccf3d9e96988 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/f45b6542-a249-441a-b979-42570ece3bd1" status: 200 len: 1455 microversion: 2.1 time: 0.071642 Aug 04 16:50:06.005129 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1485/2937] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:50:05 2022] GET /compute/v2.1/images/f45b6542-a249-441a-b979-42570ece3bd1 => generated 1455 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:50:06.272339 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9762c96f-7a1f-4eef-9e8e-a6b7b7b8f432 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:06.272967 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9762c96f-7a1f-4eef-9e8e-a6b7b7b8f432 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea8f8711-8caf-4779-9178-ca984246258c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:06.283571 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9762c96f-7a1f-4eef-9e8e-a6b7b7b8f432 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:06.284012 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9762c96f-7a1f-4eef-9e8e-a6b7b7b8f432 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:06.284796 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9762c96f-7a1f-4eef-9e8e-a6b7b7b8f432 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:06.285298 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9762c96f-7a1f-4eef-9e8e-a6b7b7b8f432 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:06.765182 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9762c96f-7a1f-4eef-9e8e-a6b7b7b8f432 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:06.777962 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9762c96f-7a1f-4eef-9e8e-a6b7b7b8f432 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c" status: 200 len: 1512 microversion: 2.1 time: 0.510402 Aug 04 16:50:06.781770 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1486/2938] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:06 2022] GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c => generated 1512 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:50:06.796453 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-03a247a3-f8fb-4ca6-bc9f-9f142f37c301 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:06.804651 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-03a247a3-f8fb-4ca6-bc9f-9f142f37c301 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] [instance: a926ff5a-2816-4ee9-b6c6-68dd79c1976c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:06.825687 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-03a247a3-f8fb-4ca6-bc9f-9f142f37c301 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:06.826271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-03a247a3-f8fb-4ca6-bc9f-9f142f37c301 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:06.827189 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-03a247a3-f8fb-4ca6-bc9f-9f142f37c301 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:06.827835 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-03a247a3-f8fb-4ca6-bc9f-9f142f37c301 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:08.194947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-03a247a3-f8fb-4ca6-bc9f-9f142f37c301 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73a263f70e1496f9ecd5689db374f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f0979b44784c5d94b20f7592a9c30b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:08.216631 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-03a247a3-f8fb-4ca6-bc9f-9f142f37c301 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] 10.222.0.23 "GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c" status: 200 len: 1510 microversion: 2.1 time: 1.430166 Aug 04 16:50:08.217505 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1487/2939] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:06 2022] GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c => generated 1510 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:08.237786 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a18feb13-4a51-4439-a0d7-9c647524e902 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:08.239123 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a18feb13-4a51-4439-a0d7-9c647524e902 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: f80ffdf6-eb69-43da-939b-4c9417d873bf] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:08.279693 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a18feb13-4a51-4439-a0d7-9c647524e902 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:08.282940 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a18feb13-4a51-4439-a0d7-9c647524e902 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:08.287875 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a18feb13-4a51-4439-a0d7-9c647524e902 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:08.298726 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a18feb13-4a51-4439-a0d7-9c647524e902 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:09.580058 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a18feb13-4a51-4439-a0d7-9c647524e902 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:09.580058 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a18feb13-4a51-4439-a0d7-9c647524e902 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf" status: 200 len: 1508 microversion: 2.1 time: 1.308908 Aug 04 16:50:09.580058 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1488/2940] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:08 2022] GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf => generated 1508 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:09.580058 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-60911b94-02bb-4e74-8f6a-0724cb8acd10 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e77d7e3a0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:13.082828 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-7aacb94f-facf-450f-9d79-fe7cb69850ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:50:13.084403 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-7aacb94f-facf-450f-9d79-fe7cb69850ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:50:13.085477 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-7aacb94f-facf-450f-9d79-fe7cb69850ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:50:13.086391 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-7aacb94f-facf-450f-9d79-fe7cb69850ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:50:13.087317 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-7aacb94f-facf-450f-9d79-fe7cb69850ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:50:13.095478 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=62 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:50:13.138051 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7aacb94f-facf-450f-9d79-fe7cb69850ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:13.142678 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7aacb94f-facf-450f-9d79-fe7cb69850ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:13.149528 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7aacb94f-facf-450f-9d79-fe7cb69850ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:13.150902 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7aacb94f-facf-450f-9d79-fe7cb69850ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:13.260632 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-7aacb94f-facf-450f-9d79-fe7cb69850ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Getting quotas for project b9fcc0fe6bb74058a0125be27a3a7090. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:50:13.313118 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-7aacb94f-facf-450f-9d79-fe7cb69850ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Getting quotas for user 1ebb42db61b34dd2a4ba2a8ffa984684 and project b9fcc0fe6bb74058a0125be27a3a7090. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:50:14.052947 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7aacb94f-facf-450f-9d79-fe7cb69850ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:50:14.066383 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7aacb94f-facf-450f-9d79-fe7cb69850ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='5f259ef8-9cf7-448a-93a7-0116dabae173',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='d6ca9c5a-079e-4a7e-aab2-cd84910b480c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='875b7953-065c-42f9-83eb-d017c5accbac',volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:50:15.045489 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7aacb94f-facf-450f-9d79-fe7cb69850ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 10.994824 Aug 04 16:50:15.052373 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1453/2941] 10.222.0.23 () {62 vars in 1189 bytes} [Thu Aug 4 16:50:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 11006 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 16:50:15.058478 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7fac69b2-7fd3-43e8-a643-65e4a8f6241f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:15.069108 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7fac69b2-7fd3-43e8-a643-65e4a8f6241f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea8f8711-8caf-4779-9178-ca984246258c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:15.081829 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7fac69b2-7fd3-43e8-a643-65e4a8f6241f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:15.082520 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7fac69b2-7fd3-43e8-a643-65e4a8f6241f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:15.084115 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7fac69b2-7fd3-43e8-a643-65e4a8f6241f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:15.084990 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7fac69b2-7fd3-43e8-a643-65e4a8f6241f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:17.454286 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7fac69b2-7fd3-43e8-a643-65e4a8f6241f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:17.485044 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7fac69b2-7fd3-43e8-a643-65e4a8f6241f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c" status: 200 len: 1512 microversion: 2.1 time: 2.427873 Aug 04 16:50:17.491478 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1454/2942] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:15 2022] GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c => generated 1512 bytes in 2439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:17.518225 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-50e31c78-b894-4cf9-8ab5-0fed2d079fae tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:17.520985 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-50e31c78-b894-4cf9-8ab5-0fed2d079fae tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] [instance: a926ff5a-2816-4ee9-b6c6-68dd79c1976c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:17.554323 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-50e31c78-b894-4cf9-8ab5-0fed2d079fae tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:17.556319 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-50e31c78-b894-4cf9-8ab5-0fed2d079fae tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:17.565756 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-50e31c78-b894-4cf9-8ab5-0fed2d079fae tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:17.568093 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-50e31c78-b894-4cf9-8ab5-0fed2d079fae tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:17.638842 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-50e31c78-b894-4cf9-8ab5-0fed2d079fae tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] HTTP exception thrown: Instance a926ff5a-2816-4ee9-b6c6-68dd79c1976c could not be found. Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-50e31c78-b894-4cf9-8ab5-0fed2d079fae tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Request method failure captured: Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c HTTP/1.1 Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_iXAedSIa4tVhqty62rkodIOrQmyxqCLVd1-InoxWHSfW43uoBZe2BaWkj0yj0fX1ayjaclJZvIpaVCq662rqU8Q9zPYCuajioNmzb1Yo5CAXgrWYydtdWr43-TYI_UDBATTmce8xoZE2aWYM5jCjWv8nfLn3Eh5KZDqWV-MET8M_Q Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: d3f0979b44784c5d94b20f7592a9c30b Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ImagesNegativeTestJSON-417021755 Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3f0979b44784c5d94b20f7592a9c30b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d3f0979b44784c5d94b20f7592a9c30b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3f0979b44784c5d94b20f7592a9c30b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d3f0979b44784c5d94b20f7592a9c30b"}]}] Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ImagesNegativeTestJSON-417021755 Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: d3f0979b44784c5d94b20f7592a9c30b Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-417021755 Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ImagesNegativeTestJSON-417021755-project Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: a73a263f70e1496f9ecd5689db374f9b Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ImagesNegativeTestJSON-417021755-project Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance a926ff5a-2816-4ee9-b6c6-68dd79c1976c could not be found. Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'a926ff5a-2816-4ee9-b6c6-68dd79c1976c'} Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a926ff5a-2816-4ee9-b6c6-68dd79c1976c could not be found. Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a926ff5a-2816-4ee9-b6c6-68dd79c1976c could not be found. Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:17.651249 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:17.657300 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:17.657300 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:50:17.657300 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:50:17.657300 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:50:17.657300 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:50:17.657300 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a926ff5a-2816-4ee9-b6c6-68dd79c1976c could not be found. Aug 04 16:50:17.657300 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:17.659982 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-50e31c78-b894-4cf9-8ab5-0fed2d079fae tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Returning 404 to user: Instance a926ff5a-2816-4ee9-b6c6-68dd79c1976c could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:50:17.661139 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-50e31c78-b894-4cf9-8ab5-0fed2d079fae tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] 10.222.0.23 "GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c" status: 404 len: 111 microversion: 2.1 time: 0.166633 Aug 04 16:50:17.665827 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1455/2943] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:17 2022] GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:50:17.671795 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-dd9ba078-2875-46a3-8a63-121d2c7fe55d req-07ec6b8f-66b4-4db7-bbe7-1276c9496051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a926ff5a-2816-4ee9-b6c6-68dd79c1976c", "name": "network-vif-deleted", "tag": "760198a1-41cc-4e68-9cc4-560c06cd4d21"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:50:17.685087 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-dd9ba078-2875-46a3-8a63-121d2c7fe55d req-07ec6b8f-66b4-4db7-bbe7-1276c9496051 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:17.685894 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-dd9ba078-2875-46a3-8a63-121d2c7fe55d req-07ec6b8f-66b4-4db7-bbe7-1276c9496051 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:17.707222 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-dd9ba078-2875-46a3-8a63-121d2c7fe55d req-07ec6b8f-66b4-4db7-bbe7-1276c9496051 service nova] Creating event network-vif-deleted:760198a1-41cc-4e68-9cc4-560c06cd4d21 for instance a926ff5a-2816-4ee9-b6c6-68dd79c1976c on n-h1-846466-12 Aug 04 16:50:17.723697 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-dd9ba078-2875-46a3-8a63-121d2c7fe55d req-07ec6b8f-66b4-4db7-bbe7-1276c9496051 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056190 Aug 04 16:50:17.726402 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1456/2944] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:50:17.767173 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-30495f0a-2824-4e26-b006-15553c389818 req-89053434-4132-455e-a394-61b9eb1c286b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9139a17d-927c-4595-a7ff-11a1fa3a6a69", "name": "network-vif-plugged", "status": "completed", "tag": "ec13d30d-7a89-4d60-b71e-301109f0b912"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:50:17.807884 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-30495f0a-2824-4e26-b006-15553c389818 req-89053434-4132-455e-a394-61b9eb1c286b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:17.813941 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-30495f0a-2824-4e26-b006-15553c389818 req-89053434-4132-455e-a394-61b9eb1c286b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:17.869005 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-30495f0a-2824-4e26-b006-15553c389818 req-89053434-4132-455e-a394-61b9eb1c286b service nova] Creating event network-vif-plugged:ec13d30d-7a89-4d60-b71e-301109f0b912 for instance 9139a17d-927c-4595-a7ff-11a1fa3a6a69 on n-h1-846466-12 Aug 04 16:50:17.885809 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-30495f0a-2824-4e26-b006-15553c389818 req-89053434-4132-455e-a394-61b9eb1c286b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141500 Aug 04 16:50:17.889342 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1457/2945] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:50:17.900491 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-365dbf9c-25ec-47eb-bedc-4a6ca3a5f283 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:17.903316 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-365dbf9c-25ec-47eb-bedc-4a6ca3a5f283 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: f80ffdf6-eb69-43da-939b-4c9417d873bf] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:17.925680 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-365dbf9c-25ec-47eb-bedc-4a6ca3a5f283 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:17.926406 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-365dbf9c-25ec-47eb-bedc-4a6ca3a5f283 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:17.927897 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-365dbf9c-25ec-47eb-bedc-4a6ca3a5f283 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:17.929041 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-365dbf9c-25ec-47eb-bedc-4a6ca3a5f283 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:18.257630 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:50:18.798301 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-365dbf9c-25ec-47eb-bedc-4a6ca3a5f283 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:18.811851 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-365dbf9c-25ec-47eb-bedc-4a6ca3a5f283 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf" status: 200 len: 1508 microversion: 2.1 time: 0.920795 Aug 04 16:50:18.829965 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1458/2946] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:17 2022] GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf => generated 1508 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:18.838238 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ab941c45-0438-4960-bdf7-15ff31a6b0ce tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:18.839063 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ab941c45-0438-4960-bdf7-15ff31a6b0ce tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:18.863073 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ab941c45-0438-4960-bdf7-15ff31a6b0ce tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:18.865006 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ab941c45-0438-4960-bdf7-15ff31a6b0ce tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:18.866684 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ab941c45-0438-4960-bdf7-15ff31a6b0ce tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:18.870634 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ab941c45-0438-4960-bdf7-15ff31a6b0ce tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:19.287600 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ab941c45-0438-4960-bdf7-15ff31a6b0ce tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:19.307973 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ab941c45-0438-4960-bdf7-15ff31a6b0ce tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:19.313417 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ab941c45-0438-4960-bdf7-15ff31a6b0ce tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:19.315002 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ab941c45-0438-4960-bdf7-15ff31a6b0ce tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1594 microversion: 2.42 time: 0.483592 Aug 04 16:50:19.318447 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1459/2947] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:50:18 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1594 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:50:19.327533 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-644a06f6-b4dd-4d76-952a-f24e0503d88c tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2126549366", "metadata": {"image_type": "test"}}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:50:19.336135 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-644a06f6-b4dd-4d76-952a-f24e0503d88c tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] [instance: a926ff5a-2816-4ee9-b6c6-68dd79c1976c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:19.354714 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-644a06f6-b4dd-4d76-952a-f24e0503d88c tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:19.355558 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-644a06f6-b4dd-4d76-952a-f24e0503d88c tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:19.356619 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-644a06f6-b4dd-4d76-952a-f24e0503d88c tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:19.361629 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-644a06f6-b4dd-4d76-952a-f24e0503d88c tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:19.404055 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-644a06f6-b4dd-4d76-952a-f24e0503d88c tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] HTTP exception thrown: Instance a926ff5a-2816-4ee9-b6c6-68dd79c1976c could not be found. Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-644a06f6-b4dd-4d76-952a-f24e0503d88c tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Request method failure captured: Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c/action HTTP/1.1 Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 112 Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_iXAedSIa4tVhqty62rkodIOrQmyxqCLVd1-InoxWHSfW43uoBZe2BaWkj0yj0fX1ayjaclJZvIpaVCq662rqU8Q9zPYCuajioNmzb1Yo5CAXgrWYydtdWr43-TYI_UDBATTmce8xoZE2aWYM5jCjWv8nfLn3Eh5KZDqWV-MET8M_Q Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: d3f0979b44784c5d94b20f7592a9c30b Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ImagesNegativeTestJSON-417021755 Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3f0979b44784c5d94b20f7592a9c30b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d3f0979b44784c5d94b20f7592a9c30b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3f0979b44784c5d94b20f7592a9c30b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d3f0979b44784c5d94b20f7592a9c30b"}]}] Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ImagesNegativeTestJSON-417021755 Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: d3f0979b44784c5d94b20f7592a9c30b Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-417021755 Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ImagesNegativeTestJSON-417021755-project Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: a73a263f70e1496f9ecd5689db374f9b Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ImagesNegativeTestJSON-417021755-project Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2126549366", "metadata": {"image_type": "test"}}} Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance a926ff5a-2816-4ee9-b6c6-68dd79c1976c could not be found. Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'a926ff5a-2816-4ee9-b6c6-68dd79c1976c', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-2126549366', 'metadata': {'image_type': 'test'}}}} Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a926ff5a-2816-4ee9-b6c6-68dd79c1976c could not be found. Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 04 16:50:19.413864 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:50:19.418119 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:50:19.418119 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:50:19.418119 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:50:19.418119 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a926ff5a-2816-4ee9-b6c6-68dd79c1976c could not be found. Aug 04 16:50:19.418119 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:19.418119 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:19.418119 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:19.418119 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:19.418119 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:50:19.418119 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:50:19.418119 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:50:19.418119 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:50:19.418119 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a926ff5a-2816-4ee9-b6c6-68dd79c1976c could not be found. Aug 04 16:50:19.418119 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:19.420900 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-644a06f6-b4dd-4d76-952a-f24e0503d88c tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Returning 404 to user: Instance a926ff5a-2816-4ee9-b6c6-68dd79c1976c could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:50:19.422084 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-644a06f6-b4dd-4d76-952a-f24e0503d88c tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] 10.222.0.23 "POST /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c/action" status: 404 len: 111 microversion: 2.1 time: 0.098815 Aug 04 16:50:19.424376 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1460/2948] 10.222.0.23 () {60 vars in 1279 bytes} [Thu Aug 4 16:50:19 2022] POST /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c/action => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:50:19.435798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4598cb95-c282-4e41-9e26-0a0476c3856f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:19.438180 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4598cb95-c282-4e41-9e26-0a0476c3856f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea8f8711-8caf-4779-9178-ca984246258c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:19.457717 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4598cb95-c282-4e41-9e26-0a0476c3856f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:19.458553 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4598cb95-c282-4e41-9e26-0a0476c3856f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:19.459612 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4598cb95-c282-4e41-9e26-0a0476c3856f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:19.460280 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4598cb95-c282-4e41-9e26-0a0476c3856f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:19.535962 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:50:20.233247 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-60911b94-02bb-4e74-8f6a-0724cb8acd10 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/f45b6542-a249-441a-b979-42570ece3bd1" status: 200 len: 1455 microversion: 2.1 time: 10.688221 Aug 04 16:50:20.240467 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1489/2949] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:50:09 2022] GET /compute/v2.1/images/f45b6542-a249-441a-b979-42570ece3bd1 => generated 1455 bytes in 10690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:20.242461 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8813c9ec-da17-4a3f-865e-1a86fb4c09ea tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-385144599", "metadata": {"image_type": "test"}}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:50:20.271840 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8813c9ec-da17-4a3f-865e-1a86fb4c09ea tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Failed to fetch instance by id tempest-invalid-1426721372 {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 04 16:50:20.272461 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-8813c9ec-da17-4a3f-865e-1a86fb4c09ea tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] HTTP exception thrown: Instance tempest-invalid-1426721372 could not be found. Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8813c9ec-da17-4a3f-865e-1a86fb4c09ea tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Request method failure captured: Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers/tempest-invalid-1426721372/action HTTP/1.1 Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 111 Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_iXAedSIa4tVhqty62rkodIOrQmyxqCLVd1-InoxWHSfW43uoBZe2BaWkj0yj0fX1ayjaclJZvIpaVCq662rqU8Q9zPYCuajioNmzb1Yo5CAXgrWYydtdWr43-TYI_UDBATTmce8xoZE2aWYM5jCjWv8nfLn3Eh5KZDqWV-MET8M_Q Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: d3f0979b44784c5d94b20f7592a9c30b Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ImagesNegativeTestJSON-417021755 Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3f0979b44784c5d94b20f7592a9c30b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d3f0979b44784c5d94b20f7592a9c30b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3f0979b44784c5d94b20f7592a9c30b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d3f0979b44784c5d94b20f7592a9c30b"}]}] Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ImagesNegativeTestJSON-417021755 Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: d3f0979b44784c5d94b20f7592a9c30b Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-417021755 Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ImagesNegativeTestJSON-417021755-project Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: a73a263f70e1496f9ecd5689db374f9b Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ImagesNegativeTestJSON-417021755-project Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-385144599", "metadata": {"image_type": "test"}}} Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance tempest-invalid-1426721372 could not be found. Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'tempest-invalid-1426721372', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-385144599', 'metadata': {'image_type': 'test'}}}} Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1426721372 could not be found. Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:50:20.274148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1426721372 could not be found. Aug 04 16:50:20.280183 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:20.280183 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:20.280183 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:20.280183 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:20.280183 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:50:20.280183 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:50:20.280183 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:50:20.280183 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:50:20.280183 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1426721372 could not be found. Aug 04 16:50:20.280183 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:20.299847 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8813c9ec-da17-4a3f-865e-1a86fb4c09ea tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Returning 404 to user: Instance tempest-invalid-1426721372 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:50:20.305800 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8813c9ec-da17-4a3f-865e-1a86fb4c09ea tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] 10.222.0.23 "POST /compute/v2.1/servers/tempest-invalid-1426721372/action" status: 404 len: 101 microversion: 2.1 time: 0.067743 Aug 04 16:50:20.310892 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4598cb95-c282-4e41-9e26-0a0476c3856f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:20.312832 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1490/2950] 10.222.0.23 () {60 vars in 1249 bytes} [Thu Aug 4 16:50:20 2022] POST /compute/v2.1/servers/tempest-invalid-1426721372/action => generated 101 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:50:20.335659 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4598cb95-c282-4e41-9e26-0a0476c3856f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c" status: 200 len: 1512 microversion: 2.1 time: 0.906307 Aug 04 16:50:20.336652 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1461/2951] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:19 2022] GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c => generated 1512 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:20.348188 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2016f210-cc02-4fcc-bcc0-ae5e503e4ed5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:20.350069 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2016f210-cc02-4fcc-bcc0-ae5e503e4ed5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: f80ffdf6-eb69-43da-939b-4c9417d873bf] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:20.373571 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2016f210-cc02-4fcc-bcc0-ae5e503e4ed5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:20.374477 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2016f210-cc02-4fcc-bcc0-ae5e503e4ed5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:20.375566 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2016f210-cc02-4fcc-bcc0-ae5e503e4ed5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:20.376270 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2016f210-cc02-4fcc-bcc0-ae5e503e4ed5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:20.398396 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-473eb4ff-a04e-4259-938f-dbd054189984 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-144433042"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:50:20.419794 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-473eb4ff-a04e-4259-938f-dbd054189984 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 04 16:50:20.421003 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-473eb4ff-a04e-4259-938f-dbd054189984 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-473eb4ff-a04e-4259-938f-dbd054189984 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Request method failure captured: Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 56 Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_iXAedSIa4tVhqty62rkodIOrQmyxqCLVd1-InoxWHSfW43uoBZe2BaWkj0yj0fX1ayjaclJZvIpaVCq662rqU8Q9zPYCuajioNmzb1Yo5CAXgrWYydtdWr43-TYI_UDBATTmce8xoZE2aWYM5jCjWv8nfLn3Eh5KZDqWV-MET8M_Q Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: d3f0979b44784c5d94b20f7592a9c30b Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ImagesNegativeTestJSON-417021755 Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3f0979b44784c5d94b20f7592a9c30b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d3f0979b44784c5d94b20f7592a9c30b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3f0979b44784c5d94b20f7592a9c30b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d3f0979b44784c5d94b20f7592a9c30b"}]}] Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ImagesNegativeTestJSON-417021755 Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: d3f0979b44784c5d94b20f7592a9c30b Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-417021755 Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ImagesNegativeTestJSON-417021755-project Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: a73a263f70e1496f9ecd5689db374f9b Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ImagesNegativeTestJSON-417021755-project Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: {"createImage": {"name": "tempest-test-snap-144433042"}} Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-144433042'}}} Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 16:50:20.422926 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:20.427288 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:20.427288 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:20.427288 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:20.427288 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:50:20.427288 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:50:20.427288 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:50:20.427288 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:50:20.427288 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 16:50:20.427288 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:20.431668 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-473eb4ff-a04e-4259-938f-dbd054189984 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:50:20.433248 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-473eb4ff-a04e-4259-938f-dbd054189984 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] 10.222.0.23 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.095264 Aug 04 16:50:20.434226 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1462/2952] 10.222.0.23 () {60 vars in 1275 bytes} [Thu Aug 4 16:50:20 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:50:20.439424 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8509d514-9e86-4f52-934f-d7d0bf7eb6c0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:20.440499 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8509d514-9e86-4f52-934f-d7d0bf7eb6c0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:20.451885 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8509d514-9e86-4f52-934f-d7d0bf7eb6c0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:20.452726 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8509d514-9e86-4f52-934f-d7d0bf7eb6c0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:20.453838 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8509d514-9e86-4f52-934f-d7d0bf7eb6c0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:20.454517 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8509d514-9e86-4f52-934f-d7d0bf7eb6c0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:20.685833 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8509d514-9e86-4f52-934f-d7d0bf7eb6c0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:20.705114 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8509d514-9e86-4f52-934f-d7d0bf7eb6c0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:20.710220 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8509d514-9e86-4f52-934f-d7d0bf7eb6c0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:20.718688 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8509d514-9e86-4f52-934f-d7d0bf7eb6c0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1594 microversion: 2.42 time: 0.280784 Aug 04 16:50:20.721207 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1463/2953] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:50:20 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1594 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:50:20.744706 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e986ddda-1ce5-400f-83cc-a005ba6e0b3c tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1489856582"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:50:20.754188 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e986ddda-1ce5-400f-83cc-a005ba6e0b3c tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 04 16:50:20.758302 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-e986ddda-1ce5-400f-83cc-a005ba6e0b3c tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e986ddda-1ce5-400f-83cc-a005ba6e0b3c tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Request method failure captured: Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 57 Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_iXAedSIa4tVhqty62rkodIOrQmyxqCLVd1-InoxWHSfW43uoBZe2BaWkj0yj0fX1ayjaclJZvIpaVCq662rqU8Q9zPYCuajioNmzb1Yo5CAXgrWYydtdWr43-TYI_UDBATTmce8xoZE2aWYM5jCjWv8nfLn3Eh5KZDqWV-MET8M_Q Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: d3f0979b44784c5d94b20f7592a9c30b Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ImagesNegativeTestJSON-417021755 Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3f0979b44784c5d94b20f7592a9c30b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d3f0979b44784c5d94b20f7592a9c30b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3f0979b44784c5d94b20f7592a9c30b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d3f0979b44784c5d94b20f7592a9c30b"}]}] Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ImagesNegativeTestJSON-417021755 Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: d3f0979b44784c5d94b20f7592a9c30b Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-417021755 Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ImagesNegativeTestJSON-417021755-project Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: a73a263f70e1496f9ecd5689db374f9b Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ImagesNegativeTestJSON-417021755-project Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: {"createImage": {"name": "tempest-test-snap-1489856582"}} Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1489856582'}}} Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 16:50:20.763673 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:20.768623 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:20.768623 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:20.768623 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:20.768623 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:50:20.768623 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:50:20.768623 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:50:20.768623 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:50:20.768623 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 16:50:20.768623 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:20.771937 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e986ddda-1ce5-400f-83cc-a005ba6e0b3c tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:50:20.775792 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e986ddda-1ce5-400f-83cc-a005ba6e0b3c tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] 10.222.0.23 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.051115 Aug 04 16:50:20.778942 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1464/2954] 10.222.0.23 () {60 vars in 1281 bytes} [Thu Aug 4 16:50:20 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:50:20.796731 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-14006f7f-7d2f-43c0-9d95-ece652fbf68f tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:20.799540 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-14006f7f-7d2f-43c0-9d95-ece652fbf68f tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] [instance: a926ff5a-2816-4ee9-b6c6-68dd79c1976c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:20.836389 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-14006f7f-7d2f-43c0-9d95-ece652fbf68f tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:20.838270 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-14006f7f-7d2f-43c0-9d95-ece652fbf68f tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:20.846013 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-14006f7f-7d2f-43c0-9d95-ece652fbf68f tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:20.847100 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-14006f7f-7d2f-43c0-9d95-ece652fbf68f tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:20.884850 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-14006f7f-7d2f-43c0-9d95-ece652fbf68f tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] HTTP exception thrown: Instance a926ff5a-2816-4ee9-b6c6-68dd79c1976c could not be found. Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-14006f7f-7d2f-43c0-9d95-ece652fbf68f tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Request method failure captured: Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c HTTP/1.1 Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_iXAedSIa4tVhqty62rkodIOrQmyxqCLVd1-InoxWHSfW43uoBZe2BaWkj0yj0fX1ayjaclJZvIpaVCq662rqU8Q9zPYCuajioNmzb1Yo5CAXgrWYydtdWr43-TYI_UDBATTmce8xoZE2aWYM5jCjWv8nfLn3Eh5KZDqWV-MET8M_Q Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: d3f0979b44784c5d94b20f7592a9c30b Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ImagesNegativeTestJSON-417021755 Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3f0979b44784c5d94b20f7592a9c30b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d3f0979b44784c5d94b20f7592a9c30b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3f0979b44784c5d94b20f7592a9c30b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d3f0979b44784c5d94b20f7592a9c30b"}]}] Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ImagesNegativeTestJSON-417021755 Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: d3f0979b44784c5d94b20f7592a9c30b Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-417021755 Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ImagesNegativeTestJSON-417021755-project Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: a73a263f70e1496f9ecd5689db374f9b Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ImagesNegativeTestJSON-417021755-project Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance a926ff5a-2816-4ee9-b6c6-68dd79c1976c could not be found. Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'a926ff5a-2816-4ee9-b6c6-68dd79c1976c'} Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a926ff5a-2816-4ee9-b6c6-68dd79c1976c could not be found. Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:50:20.886768 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:50:20.891679 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a926ff5a-2816-4ee9-b6c6-68dd79c1976c could not be found. Aug 04 16:50:20.891679 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:20.891679 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:20.891679 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:20.891679 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:20.891679 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:50:20.891679 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:50:20.891679 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:50:20.891679 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:50:20.891679 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a926ff5a-2816-4ee9-b6c6-68dd79c1976c could not be found. Aug 04 16:50:20.891679 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:20.893813 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-14006f7f-7d2f-43c0-9d95-ece652fbf68f tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Returning 404 to user: Instance a926ff5a-2816-4ee9-b6c6-68dd79c1976c could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:50:20.895401 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-14006f7f-7d2f-43c0-9d95-ece652fbf68f tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c" status: 404 len: 111 microversion: 2.1 time: 0.112028 Aug 04 16:50:20.900302 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1465/2955] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:50:20 2022] DELETE /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:50:20.907190 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4d6fa653-7a50-4592-92f0-302eb10b1c70 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:20.908083 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4d6fa653-7a50-4592-92f0-302eb10b1c70 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] [instance: a926ff5a-2816-4ee9-b6c6-68dd79c1976c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:20.918786 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4d6fa653-7a50-4592-92f0-302eb10b1c70 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:20.919532 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4d6fa653-7a50-4592-92f0-302eb10b1c70 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:20.920507 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4d6fa653-7a50-4592-92f0-302eb10b1c70 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:20.921103 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4d6fa653-7a50-4592-92f0-302eb10b1c70 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:20.926114 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:50:20.968427 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-4d6fa653-7a50-4592-92f0-302eb10b1c70 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] HTTP exception thrown: Instance a926ff5a-2816-4ee9-b6c6-68dd79c1976c could not be found. Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4d6fa653-7a50-4592-92f0-302eb10b1c70 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Request method failure captured: Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c HTTP/1.1 Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_iXAedSIa4tVhqty62rkodIOrQmyxqCLVd1-InoxWHSfW43uoBZe2BaWkj0yj0fX1ayjaclJZvIpaVCq662rqU8Q9zPYCuajioNmzb1Yo5CAXgrWYydtdWr43-TYI_UDBATTmce8xoZE2aWYM5jCjWv8nfLn3Eh5KZDqWV-MET8M_Q Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: d3f0979b44784c5d94b20f7592a9c30b Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ImagesNegativeTestJSON-417021755 Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3f0979b44784c5d94b20f7592a9c30b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d3f0979b44784c5d94b20f7592a9c30b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3f0979b44784c5d94b20f7592a9c30b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d3f0979b44784c5d94b20f7592a9c30b"}]}] Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ImagesNegativeTestJSON-417021755 Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: d3f0979b44784c5d94b20f7592a9c30b Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-417021755 Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ImagesNegativeTestJSON-417021755-project Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: a73a263f70e1496f9ecd5689db374f9b Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ImagesNegativeTestJSON-417021755-project Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance a926ff5a-2816-4ee9-b6c6-68dd79c1976c could not be found. Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'a926ff5a-2816-4ee9-b6c6-68dd79c1976c'} Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a926ff5a-2816-4ee9-b6c6-68dd79c1976c could not be found. Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a926ff5a-2816-4ee9-b6c6-68dd79c1976c could not be found. Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:20.972385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:20.976769 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:20.976769 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:50:20.976769 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:50:20.976769 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:50:20.976769 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:50:20.976769 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a926ff5a-2816-4ee9-b6c6-68dd79c1976c could not be found. Aug 04 16:50:20.976769 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:20.983942 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4d6fa653-7a50-4592-92f0-302eb10b1c70 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] Returning 404 to user: Instance a926ff5a-2816-4ee9-b6c6-68dd79c1976c could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:50:20.988411 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4d6fa653-7a50-4592-92f0-302eb10b1c70 tempest-ImagesNegativeTestJSON-417021755 tempest-ImagesNegativeTestJSON-417021755-project] 10.222.0.23 "GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c" status: 404 len: 111 microversion: 2.1 time: 0.084690 Aug 04 16:50:20.994269 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1466/2956] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:20 2022] GET /compute/v2.1/servers/a926ff5a-2816-4ee9-b6c6-68dd79c1976c => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:50:21.256325 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dd1de789-e013-4269-a02f-6e50b6915b01 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e84a09310>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:21.344707 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dd1de789-e013-4269-a02f-6e50b6915b01 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/f45b6542-a249-441a-b979-42570ece3bd1" status: 200 len: 1455 microversion: 2.1 time: 0.097420 Aug 04 16:50:21.353486 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1467/2957] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:50:21 2022] GET /compute/v2.1/images/f45b6542-a249-441a-b979-42570ece3bd1 => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:21.662613 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3241a30e-1668-4933-80c5-0140f6809da3 tempest-ImagesMetadataNegativeTestJSON-522982910 tempest-ImagesMetadataNegativeTestJSON-522982910-project] Calling method '.version_select at 0x7f7e854e09d0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:21.701924 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-3241a30e-1668-4933-80c5-0140f6809da3 tempest-ImagesMetadataNegativeTestJSON-522982910 tempest-ImagesMetadataNegativeTestJSON-522982910-project] HTTP exception thrown: Image not found. Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3241a30e-1668-4933-80c5-0140f6809da3 tempest-ImagesMetadataNegativeTestJSON-522982910 tempest-ImagesMetadataNegativeTestJSON-522982910-project] Request method failure captured: Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/images/0a9ce6f4-5912-43b5-a825-17bb16010498/metadata/os_distro HTTP/1.1 Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_jNYy-8XDn2tAfizGuZa76gp5opY4dpnTcPvM5xNffBJ1y5dQFPyLvDyLvwcz6LVbb5j9f6Ea6VagGBUWTC-HsCSbYoODEiY4aKuNydHwW-wK49Vq-XoNgxu-CiJ43q9XNfYwkbf2LUjlPRcNMScdvqVfGXE9xWAjiKHMTMFxae4ps Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 8ce4d81ef0324858a7ca2a55a231e640 Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-522982910 Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8ce4d81ef0324858a7ca2a55a231e640"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8ce4d81ef0324858a7ca2a55a231e640"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8ce4d81ef0324858a7ca2a55a231e640"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8ce4d81ef0324858a7ca2a55a231e640"}]}] Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-522982910 Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 8ce4d81ef0324858a7ca2a55a231e640 Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-522982910 Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ImagesMetadataNegativeTestJSON-522982910-project Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: d8c399e3bb7a46b09647638ebb8bf840 Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-522982910-project Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: exception: Image not found. Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'image_id': '0a9ce6f4-5912-43b5-a825-17bb16010498', 'id': 'os_distro'} Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0a9ce6f4-5912-43b5-a825-17bb16010498 Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 16:50:21.709794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0a9ce6f4-5912-43b5-a825-17bb16010498 could not be found. Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3241a30e-1668-4933-80c5-0140f6809da3 tempest-ImagesMetadataNegativeTestJSON-522982910 tempest-ImagesMetadataNegativeTestJSON-522982910-project] Returning 404 to user: Image not found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3241a30e-1668-4933-80c5-0140f6809da3 tempest-ImagesMetadataNegativeTestJSON-522982910 tempest-ImagesMetadataNegativeTestJSON-522982910-project] 10.222.0.23 "DELETE /compute/v2.1/images/0a9ce6f4-5912-43b5-a825-17bb16010498/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.361693 Aug 04 16:50:21.731973 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1468/2958] 10.222.0.23 () {58 vars in 1293 bytes} [Thu Aug 4 16:50:21 2022] DELETE /compute/v2.1/images/0a9ce6f4-5912-43b5-a825-17bb16010498/metadata/os_distro => generated 62 bytes in 369 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 04 16:50:21.739936 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-38e02a82-94a5-4871-a5dc-70e1ee57431d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:21.739936 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-38e02a82-94a5-4871-a5dc-70e1ee57431d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea8f8711-8caf-4779-9178-ca984246258c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:21.754001 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-38e02a82-94a5-4871-a5dc-70e1ee57431d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:21.754462 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-38e02a82-94a5-4871-a5dc-70e1ee57431d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:21.755369 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-38e02a82-94a5-4871-a5dc-70e1ee57431d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:21.759739 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-38e02a82-94a5-4871-a5dc-70e1ee57431d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:22.091367 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2016f210-cc02-4fcc-bcc0-ae5e503e4ed5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:22.103120 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2016f210-cc02-4fcc-bcc0-ae5e503e4ed5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf" status: 200 len: 1508 microversion: 2.1 time: 1.785644 Aug 04 16:50:22.107119 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1491/2959] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:20 2022] GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf => generated 1508 bytes in 1794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:22.142290 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f2b06cf3-30f6-4605-8c08-eefa8f0d1c5c tempest-ImagesMetadataNegativeTestJSON-522982910 tempest-ImagesMetadataNegativeTestJSON-522982910-project] Calling method '.version_select at 0x7f7e89bae670>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:22.197711 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-f2b06cf3-30f6-4605-8c08-eefa8f0d1c5c tempest-ImagesMetadataNegativeTestJSON-522982910 tempest-ImagesMetadataNegativeTestJSON-522982910-project] HTTP exception thrown: Image not found. Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f2b06cf3-30f6-4605-8c08-eefa8f0d1c5c tempest-ImagesMetadataNegativeTestJSON-522982910 tempest-ImagesMetadataNegativeTestJSON-522982910-project] Request method failure captured: Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/images/7b4f1963-111a-477a-b34a-4d606d2d3030/metadata/os_version HTTP/1.1 Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_jNYy-8XDn2tAfizGuZa76gp5opY4dpnTcPvM5xNffBJ1y5dQFPyLvDyLvwcz6LVbb5j9f6Ea6VagGBUWTC-HsCSbYoODEiY4aKuNydHwW-wK49Vq-XoNgxu-CiJ43q9XNfYwkbf2LUjlPRcNMScdvqVfGXE9xWAjiKHMTMFxae4ps Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 8ce4d81ef0324858a7ca2a55a231e640 Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-522982910 Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8ce4d81ef0324858a7ca2a55a231e640"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8ce4d81ef0324858a7ca2a55a231e640"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8ce4d81ef0324858a7ca2a55a231e640"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8ce4d81ef0324858a7ca2a55a231e640"}]}] Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-522982910 Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 8ce4d81ef0324858a7ca2a55a231e640 Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-522982910 Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ImagesMetadataNegativeTestJSON-522982910-project Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: d8c399e3bb7a46b09647638ebb8bf840 Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-522982910-project Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: exception: Image not found. Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'image_id': '7b4f1963-111a-477a-b34a-4d606d2d3030', 'id': 'os_version'} Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7b4f1963-111a-477a-b34a-4d606d2d3030 Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 16:50:22.200771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7b4f1963-111a-477a-b34a-4d606d2d3030 could not be found. Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 16:50:22.205680 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:22.212277 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f2b06cf3-30f6-4605-8c08-eefa8f0d1c5c tempest-ImagesMetadataNegativeTestJSON-522982910 tempest-ImagesMetadataNegativeTestJSON-522982910-project] Returning 404 to user: Image not found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:50:22.212277 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f2b06cf3-30f6-4605-8c08-eefa8f0d1c5c tempest-ImagesMetadataNegativeTestJSON-522982910 tempest-ImagesMetadataNegativeTestJSON-522982910-project] 10.222.0.23 "GET /compute/v2.1/images/7b4f1963-111a-477a-b34a-4d606d2d3030/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.085878 Aug 04 16:50:22.216779 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1492/2960] 10.222.0.23 () {58 vars in 1293 bytes} [Thu Aug 4 16:50:22 2022] GET /compute/v2.1/images/7b4f1963-111a-477a-b34a-4d606d2d3030/metadata/os_version => generated 62 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:50:22.232154 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1aff87ec-1715-45e9-8782-2cc2397a67b0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:22.239111 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1aff87ec-1715-45e9-8782-2cc2397a67b0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:22.256057 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1aff87ec-1715-45e9-8782-2cc2397a67b0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:22.260517 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1aff87ec-1715-45e9-8782-2cc2397a67b0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:22.263923 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1aff87ec-1715-45e9-8782-2cc2397a67b0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:22.264649 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1aff87ec-1715-45e9-8782-2cc2397a67b0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:22.670213 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1aff87ec-1715-45e9-8782-2cc2397a67b0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:22.682753 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1aff87ec-1715-45e9-8782-2cc2397a67b0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:22.690328 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1aff87ec-1715-45e9-8782-2cc2397a67b0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:22.694303 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1aff87ec-1715-45e9-8782-2cc2397a67b0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1594 microversion: 2.42 time: 0.476068 Aug 04 16:50:22.697569 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1493/2961] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:50:22 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1594 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:50:22.711056 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-58ce8d8a-0559-4e82-94e5-cd394c0038f6 tempest-ImagesMetadataNegativeTestJSON-522982910 tempest-ImagesMetadataNegativeTestJSON-522982910-project] Calling method '.version_select at 0x7f7e89ca2790>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:22.773206 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-58ce8d8a-0559-4e82-94e5-cd394c0038f6 tempest-ImagesMetadataNegativeTestJSON-522982910 tempest-ImagesMetadataNegativeTestJSON-522982910-project] HTTP exception thrown: Image not found. Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-58ce8d8a-0559-4e82-94e5-cd394c0038f6 tempest-ImagesMetadataNegativeTestJSON-522982910 tempest-ImagesMetadataNegativeTestJSON-522982910-project] Request method failure captured: Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/images/6bab29fd-1fdf-4643-844a-d05c60137351/metadata HTTP/1.1 Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_jNYy-8XDn2tAfizGuZa76gp5opY4dpnTcPvM5xNffBJ1y5dQFPyLvDyLvwcz6LVbb5j9f6Ea6VagGBUWTC-HsCSbYoODEiY4aKuNydHwW-wK49Vq-XoNgxu-CiJ43q9XNfYwkbf2LUjlPRcNMScdvqVfGXE9xWAjiKHMTMFxae4ps Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 8ce4d81ef0324858a7ca2a55a231e640 Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-522982910 Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8ce4d81ef0324858a7ca2a55a231e640"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8ce4d81ef0324858a7ca2a55a231e640"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8ce4d81ef0324858a7ca2a55a231e640"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8ce4d81ef0324858a7ca2a55a231e640"}]}] Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-522982910 Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 8ce4d81ef0324858a7ca2a55a231e640 Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-522982910 Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ImagesMetadataNegativeTestJSON-522982910-project Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: d8c399e3bb7a46b09647638ebb8bf840 Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-522982910-project Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: exception: Image not found. Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'image_id': '6bab29fd-1fdf-4643-844a-d05c60137351'} Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6bab29fd-1fdf-4643-844a-d05c60137351 Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 16:50:22.778294 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6bab29fd-1fdf-4643-844a-d05c60137351 could not be found. Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 16:50:22.786634 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:22.796499 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-58ce8d8a-0559-4e82-94e5-cd394c0038f6 tempest-ImagesMetadataNegativeTestJSON-522982910 tempest-ImagesMetadataNegativeTestJSON-522982910-project] Returning 404 to user: Image not found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:50:22.796499 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-58ce8d8a-0559-4e82-94e5-cd394c0038f6 tempest-ImagesMetadataNegativeTestJSON-522982910 tempest-ImagesMetadataNegativeTestJSON-522982910-project] 10.222.0.23 "GET /compute/v2.1/images/6bab29fd-1fdf-4643-844a-d05c60137351/metadata" status: 404 len: 62 microversion: 2.1 time: 0.093545 Aug 04 16:50:22.801071 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1494/2962] 10.222.0.23 () {58 vars in 1260 bytes} [Thu Aug 4 16:50:22 2022] GET /compute/v2.1/images/6bab29fd-1fdf-4643-844a-d05c60137351/metadata => generated 62 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:50:22.816912 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6d6b61a6-cf68-491e-96d6-c848e591bdce tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e89c59040>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:22.905446 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-38e02a82-94a5-4871-a5dc-70e1ee57431d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:22.914824 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6d6b61a6-cf68-491e-96d6-c848e591bdce tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/f45b6542-a249-441a-b979-42570ece3bd1" status: 200 len: 1455 microversion: 2.1 time: 0.111776 Aug 04 16:50:22.921967 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1495/2963] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:50:22 2022] GET /compute/v2.1/images/f45b6542-a249-441a-b979-42570ece3bd1 => generated 1455 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:22.922202 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-38e02a82-94a5-4871-a5dc-70e1ee57431d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c" status: 200 len: 1489 microversion: 2.1 time: 1.194214 Aug 04 16:50:22.922310 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6f1e8400-9540-4914-943f-d47fbf3fb5e3 tempest-ImagesMetadataNegativeTestJSON-522982910 tempest-ImagesMetadataNegativeTestJSON-522982910-project] Action: 'update_all', calling method: .version_select at 0x7f7e89c59a60>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:50:22.936109 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1469/2964] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:21 2022] GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c => generated 1489 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:22.955595 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b94732f8-9a5d-48b6-aa84-09ec587e20ac tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:22.956241 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b94732f8-9a5d-48b6-aa84-09ec587e20ac tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea8f8711-8caf-4779-9178-ca984246258c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:22.974038 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b94732f8-9a5d-48b6-aa84-09ec587e20ac tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:22.974653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b94732f8-9a5d-48b6-aa84-09ec587e20ac tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:22.975669 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b94732f8-9a5d-48b6-aa84-09ec587e20ac tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:22.976211 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b94732f8-9a5d-48b6-aa84-09ec587e20ac tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:22.979947 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-6f1e8400-9540-4914-943f-d47fbf3fb5e3 tempest-ImagesMetadataNegativeTestJSON-522982910 tempest-ImagesMetadataNegativeTestJSON-522982910-project] HTTP exception thrown: Image not found. Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6f1e8400-9540-4914-943f-d47fbf3fb5e3 tempest-ImagesMetadataNegativeTestJSON-522982910 tempest-ImagesMetadataNegativeTestJSON-522982910-project] Request method failure captured: Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: request: PUT /compute/v2.1/images/504d7ff3-d0a1-4063-ae1a-bcf77649f4cf/metadata HTTP/1.1 Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 57 Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_jNYy-8XDn2tAfizGuZa76gp5opY4dpnTcPvM5xNffBJ1y5dQFPyLvDyLvwcz6LVbb5j9f6Ea6VagGBUWTC-HsCSbYoODEiY4aKuNydHwW-wK49Vq-XoNgxu-CiJ43q9XNfYwkbf2LUjlPRcNMScdvqVfGXE9xWAjiKHMTMFxae4ps Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 8ce4d81ef0324858a7ca2a55a231e640 Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-522982910 Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8ce4d81ef0324858a7ca2a55a231e640"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8ce4d81ef0324858a7ca2a55a231e640"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8ce4d81ef0324858a7ca2a55a231e640"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8ce4d81ef0324858a7ca2a55a231e640"}]}] Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-522982910 Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 8ce4d81ef0324858a7ca2a55a231e640 Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-522982910 Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ImagesMetadataNegativeTestJSON-522982910-project Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: d8c399e3bb7a46b09647638ebb8bf840 Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-522982910-project Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: exception: Image not found. Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'image_id': '504d7ff3-d0a1-4063-ae1a-bcf77649f4cf', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 504d7ff3-d0a1-4063-ae1a-bcf77649f4cf Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 16:50:22.982175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 504d7ff3-d0a1-4063-ae1a-bcf77649f4cf could not be found. Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6f1e8400-9540-4914-943f-d47fbf3fb5e3 tempest-ImagesMetadataNegativeTestJSON-522982910 tempest-ImagesMetadataNegativeTestJSON-522982910-project] Returning 404 to user: Image not found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:50:22.987833 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6f1e8400-9540-4914-943f-d47fbf3fb5e3 tempest-ImagesMetadataNegativeTestJSON-522982910 tempest-ImagesMetadataNegativeTestJSON-522982910-project] 10.222.0.23 "PUT /compute/v2.1/images/504d7ff3-d0a1-4063-ae1a-bcf77649f4cf/metadata" status: 404 len: 62 microversion: 2.1 time: 0.066827 Aug 04 16:50:22.992066 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1496/2965] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Aug 4 16:50:22 2022] PUT /compute/v2.1/images/504d7ff3-d0a1-4063-ae1a-bcf77649f4cf/metadata => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:50:22.994833 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f3dd88d2-79a0-4b22-b758-3d6f64086a98 tempest-ImagesMetadataNegativeTestJSON-522982910 tempest-ImagesMetadataNegativeTestJSON-522982910-project] Action: 'update', calling method: .version_select at 0x7f7e89d771f0>, body: {"meta": {"os_distro": "alt"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:50:23.025741 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b94732f8-9a5d-48b6-aa84-09ec587e20ac tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea8f8711-8caf-4779-9178-ca984246258c] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:50:23.060432 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-f3dd88d2-79a0-4b22-b758-3d6f64086a98 tempest-ImagesMetadataNegativeTestJSON-522982910 tempest-ImagesMetadataNegativeTestJSON-522982910-project] HTTP exception thrown: Image not found. Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f3dd88d2-79a0-4b22-b758-3d6f64086a98 tempest-ImagesMetadataNegativeTestJSON-522982910 tempest-ImagesMetadataNegativeTestJSON-522982910-project] Request method failure captured: Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: request: PUT /compute/v2.1/images/42ea5742-7d1e-444e-b724-e4e592866b8b/metadata/os_distro HTTP/1.1 Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 30 Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_jNYy-8XDn2tAfizGuZa76gp5opY4dpnTcPvM5xNffBJ1y5dQFPyLvDyLvwcz6LVbb5j9f6Ea6VagGBUWTC-HsCSbYoODEiY4aKuNydHwW-wK49Vq-XoNgxu-CiJ43q9XNfYwkbf2LUjlPRcNMScdvqVfGXE9xWAjiKHMTMFxae4ps Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 8ce4d81ef0324858a7ca2a55a231e640 Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-522982910 Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8ce4d81ef0324858a7ca2a55a231e640"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8ce4d81ef0324858a7ca2a55a231e640"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8ce4d81ef0324858a7ca2a55a231e640"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8ce4d81ef0324858a7ca2a55a231e640"}]}] Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-522982910 Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 8ce4d81ef0324858a7ca2a55a231e640 Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-522982910 Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ImagesMetadataNegativeTestJSON-522982910-project Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: d8c399e3bb7a46b09647638ebb8bf840 Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-522982910-project Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: {"meta": {"os_distro": "alt"}} Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: exception: Image not found. Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'image_id': '42ea5742-7d1e-444e-b724-e4e592866b8b', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 42ea5742-7d1e-444e-b724-e4e592866b8b Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 16:50:23.062632 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 42ea5742-7d1e-444e-b724-e4e592866b8b could not be found. Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f3dd88d2-79a0-4b22-b758-3d6f64086a98 tempest-ImagesMetadataNegativeTestJSON-522982910 tempest-ImagesMetadataNegativeTestJSON-522982910-project] Returning 404 to user: Image not found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:50:23.067078 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f3dd88d2-79a0-4b22-b758-3d6f64086a98 tempest-ImagesMetadataNegativeTestJSON-522982910 tempest-ImagesMetadataNegativeTestJSON-522982910-project] 10.222.0.23 "PUT /compute/v2.1/images/42ea5742-7d1e-444e-b724-e4e592866b8b/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.073193 Aug 04 16:50:23.075071 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1497/2966] 10.222.0.23 () {60 vars in 1310 bytes} [Thu Aug 4 16:50:22 2022] PUT /compute/v2.1/images/42ea5742-7d1e-444e-b724-e4e592866b8b/metadata/os_distro => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:50:23.085880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-edaa1a10-b7f0-4a1a-93c7-1114fa5196ac tempest-ImagesMetadataNegativeTestJSON-522982910 tempest-ImagesMetadataNegativeTestJSON-522982910-project] Action: 'create', calling method: .version_select at 0x7f7e841ca550>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:50:23.130566 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-edaa1a10-b7f0-4a1a-93c7-1114fa5196ac tempest-ImagesMetadataNegativeTestJSON-522982910 tempest-ImagesMetadataNegativeTestJSON-522982910-project] HTTP exception thrown: Image not found. Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-edaa1a10-b7f0-4a1a-93c7-1114fa5196ac tempest-ImagesMetadataNegativeTestJSON-522982910 tempest-ImagesMetadataNegativeTestJSON-522982910-project] Request method failure captured: Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/images/36608e86-3f5f-48a6-b962-32ea5db8c6fa/metadata HTTP/1.1 Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 57 Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_jNYy-8XDn2tAfizGuZa76gp5opY4dpnTcPvM5xNffBJ1y5dQFPyLvDyLvwcz6LVbb5j9f6Ea6VagGBUWTC-HsCSbYoODEiY4aKuNydHwW-wK49Vq-XoNgxu-CiJ43q9XNfYwkbf2LUjlPRcNMScdvqVfGXE9xWAjiKHMTMFxae4ps Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 8ce4d81ef0324858a7ca2a55a231e640 Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-522982910 Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8ce4d81ef0324858a7ca2a55a231e640"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8ce4d81ef0324858a7ca2a55a231e640"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8ce4d81ef0324858a7ca2a55a231e640"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8ce4d81ef0324858a7ca2a55a231e640"}]}] Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-522982910 Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 8ce4d81ef0324858a7ca2a55a231e640 Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-522982910 Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ImagesMetadataNegativeTestJSON-522982910-project Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: d8c399e3bb7a46b09647638ebb8bf840 Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-522982910-project Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: exception: Image not found. Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'image_id': '36608e86-3f5f-48a6-b962-32ea5db8c6fa', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 36608e86-3f5f-48a6-b962-32ea5db8c6fa Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 16:50:23.132693 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 36608e86-3f5f-48a6-b962-32ea5db8c6fa could not be found. Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-edaa1a10-b7f0-4a1a-93c7-1114fa5196ac tempest-ImagesMetadataNegativeTestJSON-522982910 tempest-ImagesMetadataNegativeTestJSON-522982910-project] Returning 404 to user: Image not found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:50:23.137007 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-edaa1a10-b7f0-4a1a-93c7-1114fa5196ac tempest-ImagesMetadataNegativeTestJSON-522982910 tempest-ImagesMetadataNegativeTestJSON-522982910-project] 10.222.0.23 "POST /compute/v2.1/images/36608e86-3f5f-48a6-b962-32ea5db8c6fa/metadata" status: 404 len: 62 microversion: 2.1 time: 0.063407 Aug 04 16:50:23.148732 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1498/2967] 10.222.0.23 () {60 vars in 1281 bytes} [Thu Aug 4 16:50:23 2022] POST /compute/v2.1/images/36608e86-3f5f-48a6-b962-32ea5db8c6fa/metadata => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:50:23.195223 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3d584af5-a360-4daa-b1ba-6ee91e54468d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:23.200275 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3d584af5-a360-4daa-b1ba-6ee91e54468d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: f80ffdf6-eb69-43da-939b-4c9417d873bf] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:23.208317 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:50:23.244797 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3d584af5-a360-4daa-b1ba-6ee91e54468d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:23.254300 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3d584af5-a360-4daa-b1ba-6ee91e54468d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:23.254769 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b94732f8-9a5d-48b6-aa84-09ec587e20ac tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c" status: 204 len: 0 microversion: 2.1 time: 0.316738 Aug 04 16:50:23.258727 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1470/2968] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:50:22 2022] DELETE /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:50:23.258987 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3d584af5-a360-4daa-b1ba-6ee91e54468d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:23.258987 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3d584af5-a360-4daa-b1ba-6ee91e54468d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:23.274770 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f9f5d97d-1bc9-40ed-bcf3-c5de94c63eae tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:23.275219 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f9f5d97d-1bc9-40ed-bcf3-c5de94c63eae tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea8f8711-8caf-4779-9178-ca984246258c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:23.304005 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f9f5d97d-1bc9-40ed-bcf3-c5de94c63eae tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:23.304306 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f9f5d97d-1bc9-40ed-bcf3-c5de94c63eae tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:23.308550 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f9f5d97d-1bc9-40ed-bcf3-c5de94c63eae tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:23.309101 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f9f5d97d-1bc9-40ed-bcf3-c5de94c63eae tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:23.399358 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:50:25.916231 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f9f5d97d-1bc9-40ed-bcf3-c5de94c63eae tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:25.940177 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f9f5d97d-1bc9-40ed-bcf3-c5de94c63eae tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c" status: 200 len: 1495 microversion: 2.1 time: 2.672450 Aug 04 16:50:25.942923 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1471/2969] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:23 2022] GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c => generated 1495 bytes in 2678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:50:25.966487 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f3989646-e63f-4bd3-aed1-0db65f6e77e9 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:25.970045 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f3989646-e63f-4bd3-aed1-0db65f6e77e9 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:25.993692 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f3989646-e63f-4bd3-aed1-0db65f6e77e9 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:25.994452 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f3989646-e63f-4bd3-aed1-0db65f6e77e9 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:26.000115 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f3989646-e63f-4bd3-aed1-0db65f6e77e9 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:26.003373 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f3989646-e63f-4bd3-aed1-0db65f6e77e9 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:27.373020 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f3989646-e63f-4bd3-aed1-0db65f6e77e9 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:27.390231 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f3989646-e63f-4bd3-aed1-0db65f6e77e9 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:27.404496 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f3989646-e63f-4bd3-aed1-0db65f6e77e9 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:27.412614 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f3989646-e63f-4bd3-aed1-0db65f6e77e9 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1594 microversion: 2.42 time: 1.466891 Aug 04 16:50:27.415892 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1472/2970] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:50:25 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1594 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:50:27.441582 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d957cad9-5199-4e80-a54f-03d005e3ef82 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e84a9fdc0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:27.571842 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d957cad9-5199-4e80-a54f-03d005e3ef82 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/f45b6542-a249-441a-b979-42570ece3bd1" status: 200 len: 1455 microversion: 2.1 time: 0.153352 Aug 04 16:50:27.574200 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1473/2971] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:50:27 2022] GET /compute/v2.1/images/f45b6542-a249-441a-b979-42570ece3bd1 => generated 1455 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:27.588609 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-0982fc5c-d8c8-4637-a31f-b3db54e1ea35 req-ec7141d5-208f-4e70-85ad-c8bc8a9b506e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f80ffdf6-eb69-43da-939b-4c9417d873bf", "name": "network-vif-unplugged", "status": "completed", "tag": "a94d7826-be7e-4909-ad12-744419720da9"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:50:27.623494 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-0982fc5c-d8c8-4637-a31f-b3db54e1ea35 req-ec7141d5-208f-4e70-85ad-c8bc8a9b506e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:27.626965 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-0982fc5c-d8c8-4637-a31f-b3db54e1ea35 req-ec7141d5-208f-4e70-85ad-c8bc8a9b506e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:27.672446 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-0982fc5c-d8c8-4637-a31f-b3db54e1ea35 req-ec7141d5-208f-4e70-85ad-c8bc8a9b506e service nova] Creating event network-vif-unplugged:a94d7826-be7e-4909-ad12-744419720da9 for instance f80ffdf6-eb69-43da-939b-4c9417d873bf on n-h2-846466-12 Aug 04 16:50:27.688072 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-0982fc5c-d8c8-4637-a31f-b3db54e1ea35 req-ec7141d5-208f-4e70-85ad-c8bc8a9b506e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108639 Aug 04 16:50:27.693369 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1474/2972] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:50:27.745590 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3d584af5-a360-4daa-b1ba-6ee91e54468d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:27.760915 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3d584af5-a360-4daa-b1ba-6ee91e54468d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf" status: 200 len: 1505 microversion: 2.1 time: 4.608960 Aug 04 16:50:27.769892 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1499/2973] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:23 2022] GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf => generated 1505 bytes in 4621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:27.791748 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-42fa339c-9521-49d7-a834-d4767b99cb7b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:27.794236 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-42fa339c-9521-49d7-a834-d4767b99cb7b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea8f8711-8caf-4779-9178-ca984246258c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:27.812440 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-42fa339c-9521-49d7-a834-d4767b99cb7b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:27.817481 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-42fa339c-9521-49d7-a834-d4767b99cb7b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:27.819357 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-42fa339c-9521-49d7-a834-d4767b99cb7b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:27.820576 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-42fa339c-9521-49d7-a834-d4767b99cb7b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:27.861494 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-42fa339c-9521-49d7-a834-d4767b99cb7b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] HTTP exception thrown: Instance ea8f8711-8caf-4779-9178-ca984246258c could not be found. Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-42fa339c-9521-49d7-a834-d4767b99cb7b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Request method failure captured: Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c HTTP/1.1 Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_ddGi-LUxEkOI7UNq-ijU5XnirMgjjOPky_n4iIeohsp_mBZi36CDxRY5dUKGmgKLroDx6IsvA3hey_uA7LPQbZI4NWhaCZQIOIkAKlIttRUGlU4y_AMkv45dQEQsQ8xd9VhN5XbmaVn_f0gvdFbALtWn0QI5OJtAeQ50IP8tuO8i0 Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/60281cf1dbe645d8949e93f9e70b5d91"}]}] Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 3cfb4739b53b411391a26de37b98469f Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance ea8f8711-8caf-4779-9178-ca984246258c could not be found. Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'ea8f8711-8caf-4779-9178-ca984246258c'} Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea8f8711-8caf-4779-9178-ca984246258c could not be found. Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea8f8711-8caf-4779-9178-ca984246258c could not be found. Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:50:27.863492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:27.868250 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:50:27.868250 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:50:27.868250 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:50:27.868250 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:50:27.868250 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:50:27.868250 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea8f8711-8caf-4779-9178-ca984246258c could not be found. Aug 04 16:50:27.868250 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:50:27.869811 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-42fa339c-9521-49d7-a834-d4767b99cb7b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Returning 404 to user: Instance ea8f8711-8caf-4779-9178-ca984246258c could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:50:27.875380 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-42fa339c-9521-49d7-a834-d4767b99cb7b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c" status: 404 len: 111 microversion: 2.1 time: 0.098507 Aug 04 16:50:27.876640 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1500/2974] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:27 2022] GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:50:28.119756 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-2631314f-64d3-429c-8b0c-9c6218d2027e req-f6e37c4e-8eff-4091-b449-7aecdbb02efc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea8f8711-8caf-4779-9178-ca984246258c", "name": "network-vif-deleted", "tag": "298e9931-d3d2-4d09-9874-fb606c37f54f"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:50:28.151562 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-2631314f-64d3-429c-8b0c-9c6218d2027e req-f6e37c4e-8eff-4091-b449-7aecdbb02efc service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:28.163486 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-2631314f-64d3-429c-8b0c-9c6218d2027e req-f6e37c4e-8eff-4091-b449-7aecdbb02efc service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:28.200341 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e3f5ca44-81cf-4195-8f53-3e8de5bf06a5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-101041308", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "fd9ba46f-9583-4f53-9ced-a3b1af7aa6df"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:50:28.219158 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-2631314f-64d3-429c-8b0c-9c6218d2027e req-f6e37c4e-8eff-4091-b449-7aecdbb02efc service nova] Creating event network-vif-deleted:298e9931-d3d2-4d09-9874-fb606c37f54f for instance ea8f8711-8caf-4779-9178-ca984246258c on n-h1-846466-12 Aug 04 16:50:28.247338 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-2631314f-64d3-429c-8b0c-9c6218d2027e req-f6e37c4e-8eff-4091-b449-7aecdbb02efc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.549717 Aug 04 16:50:28.258062 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1475/2975] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:50:28.347508 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-e3f5ca44-81cf-4195-8f53-3e8de5bf06a5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] validate_networks() for [('fd9ba46f-9583-4f53-9ced-a3b1af7aa6df', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:50:28.466683 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0566779f-5585-4d61-a689-c9f0c884a4b1 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:28.467714 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0566779f-5585-4d61-a689-c9f0c884a4b1 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:28.493915 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0566779f-5585-4d61-a689-c9f0c884a4b1 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:28.494384 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0566779f-5585-4d61-a689-c9f0c884a4b1 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:28.495281 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0566779f-5585-4d61-a689-c9f0c884a4b1 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:28.501392 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0566779f-5585-4d61-a689-c9f0c884a4b1 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:30.753420 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0566779f-5585-4d61-a689-c9f0c884a4b1 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:30.772261 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0566779f-5585-4d61-a689-c9f0c884a4b1 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:30.773974 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0566779f-5585-4d61-a689-c9f0c884a4b1 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:30.775248 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0566779f-5585-4d61-a689-c9f0c884a4b1 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1661 microversion: 2.42 time: 2.314792 Aug 04 16:50:30.797077 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1476/2976] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:50:28 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1661 bytes in 2337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:50:30.808288 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8b1b7772-6d76-48d5-be56-3f57e2d72cb0 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e84a3d9d0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:30.942349 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8b1b7772-6d76-48d5-be56-3f57e2d72cb0 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/f45b6542-a249-441a-b979-42570ece3bd1" status: 200 len: 1455 microversion: 2.1 time: 0.143959 Aug 04 16:50:30.948513 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1477/2977] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:50:30 2022] GET /compute/v2.1/images/f45b6542-a249-441a-b979-42570ece3bd1 => generated 1455 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:30.970923 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1036e70b-8e49-4460-b844-32f156167907 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:30.971576 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1036e70b-8e49-4460-b844-32f156167907 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: f80ffdf6-eb69-43da-939b-4c9417d873bf] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:30.994624 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1036e70b-8e49-4460-b844-32f156167907 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:30.995025 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1036e70b-8e49-4460-b844-32f156167907 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:31.000147 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1036e70b-8e49-4460-b844-32f156167907 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:31.003007 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1036e70b-8e49-4460-b844-32f156167907 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:32.053803 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1036e70b-8e49-4460-b844-32f156167907 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:32.081709 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1036e70b-8e49-4460-b844-32f156167907 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf" status: 200 len: 1448 microversion: 2.1 time: 1.122429 Aug 04 16:50:32.082855 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1478/2978] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:30 2022] GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf => generated 1448 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:32.143709 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-121268c8-e8b2-4c62-8f31-c44f33638707 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:32.144460 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-121268c8-e8b2-4c62-8f31-c44f33638707 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:32.159388 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-121268c8-e8b2-4c62-8f31-c44f33638707 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:32.160065 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-121268c8-e8b2-4c62-8f31-c44f33638707 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:32.161391 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-121268c8-e8b2-4c62-8f31-c44f33638707 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:32.170294 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-121268c8-e8b2-4c62-8f31-c44f33638707 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:34.552215 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-121268c8-e8b2-4c62-8f31-c44f33638707 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:34.568941 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-121268c8-e8b2-4c62-8f31-c44f33638707 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:34.571573 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-121268c8-e8b2-4c62-8f31-c44f33638707 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:34.573416 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-121268c8-e8b2-4c62-8f31-c44f33638707 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1661 microversion: 2.42 time: 2.447089 Aug 04 16:50:34.594420 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1479/2979] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:50:32 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1661 bytes in 2508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:50:34.605239 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-452881ae-aac2-477a-8964-354d0aafeeac tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e84ba50d0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:34.621811 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-e3f5ca44-81cf-4195-8f53-3e8de5bf06a5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:50:34.622910 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-e3f5ca44-81cf-4195-8f53-3e8de5bf06a5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:50:34.624073 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-e3f5ca44-81cf-4195-8f53-3e8de5bf06a5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:50:34.624891 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-e3f5ca44-81cf-4195-8f53-3e8de5bf06a5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:50:34.625853 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-e3f5ca44-81cf-4195-8f53-3e8de5bf06a5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:50:34.680129 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3f5ca44-81cf-4195-8f53-3e8de5bf06a5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:34.680574 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3f5ca44-81cf-4195-8f53-3e8de5bf06a5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:34.681412 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3f5ca44-81cf-4195-8f53-3e8de5bf06a5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:34.682108 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3f5ca44-81cf-4195-8f53-3e8de5bf06a5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:34.738282 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-452881ae-aac2-477a-8964-354d0aafeeac tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/f45b6542-a249-441a-b979-42570ece3bd1" status: 200 len: 1455 microversion: 2.1 time: 0.141521 Aug 04 16:50:34.739210 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1480/2980] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:50:34 2022] GET /compute/v2.1/images/f45b6542-a249-441a-b979-42570ece3bd1 => generated 1455 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:34.746362 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-03ebf676-4e99-461f-9d35-86f24113ce7e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:34.747286 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-03ebf676-4e99-461f-9d35-86f24113ce7e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:34.756754 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03ebf676-4e99-461f-9d35-86f24113ce7e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:34.757643 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03ebf676-4e99-461f-9d35-86f24113ce7e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:34.758800 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03ebf676-4e99-461f-9d35-86f24113ce7e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:34.759469 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03ebf676-4e99-461f-9d35-86f24113ce7e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:34.760362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-e3f5ca44-81cf-4195-8f53-3e8de5bf06a5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Getting quotas for project 60281cf1dbe645d8949e93f9e70b5d91. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:50:34.800724 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-e3f5ca44-81cf-4195-8f53-3e8de5bf06a5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Getting quotas for user 3cfb4739b53b411391a26de37b98469f and project 60281cf1dbe645d8949e93f9e70b5d91. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:50:34.885432 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e3f5ca44-81cf-4195-8f53-3e8de5bf06a5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:50:34.898233 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e3f5ca44-81cf-4195-8f53-3e8de5bf06a5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 5294cc65-8c7f-413f-8b13-c4e1d48567fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:50:35.042514 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e3f5ca44-81cf-4195-8f53-3e8de5bf06a5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.846611 Aug 04 16:50:35.056842 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1501/2981] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:50:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 6862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 16:50:35.062627 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9e422e9d-33a2-43a6-9764-5bf0a8e1c912 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:35.063256 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9e422e9d-33a2-43a6-9764-5bf0a8e1c912 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 5294cc65-8c7f-413f-8b13-c4e1d48567fe] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:35.687425 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9e422e9d-33a2-43a6-9764-5bf0a8e1c912 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:35.705711 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9e422e9d-33a2-43a6-9764-5bf0a8e1c912 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe" status: 200 len: 1214 microversion: 2.1 time: 0.647364 Aug 04 16:50:35.712295 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1502/2982] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:35 2022] GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe => generated 1214 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:36.458763 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d3541561-a61d-426f-98ca-e856a1ff12b7 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-375869899", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:50:36.611265 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-d3541561-a61d-426f-98ca-e856a1ff12b7 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] validate_networks() for None {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:50:36.657729 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-03ebf676-4e99-461f-9d35-86f24113ce7e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:36.671032 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-03ebf676-4e99-461f-9d35-86f24113ce7e tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 1.930376 Aug 04 16:50:36.674187 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1481/2983] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:34 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 1934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:36.686684 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-39052539-26cb-4816-8866-a11ca0b39c87 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:36.687311 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-39052539-26cb-4816-8866-a11ca0b39c87 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:36.708340 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39052539-26cb-4816-8866-a11ca0b39c87 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:36.708804 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39052539-26cb-4816-8866-a11ca0b39c87 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:36.712526 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39052539-26cb-4816-8866-a11ca0b39c87 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:36.713061 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39052539-26cb-4816-8866-a11ca0b39c87 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:37.752280 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-39052539-26cb-4816-8866-a11ca0b39c87 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:37.790151 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-39052539-26cb-4816-8866-a11ca0b39c87 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:37.797656 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-39052539-26cb-4816-8866-a11ca0b39c87 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:37.800094 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-39052539-26cb-4816-8866-a11ca0b39c87 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1661 microversion: 2.42 time: 1.124179 Aug 04 16:50:37.807217 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1482/2984] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:50:36 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1661 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:50:37.826012 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b6107463-4923-42e3-be31-4941ba069a1b tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e84781dc0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:37.936853 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b6107463-4923-42e3-be31-4941ba069a1b tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/f45b6542-a249-441a-b979-42570ece3bd1" status: 200 len: 1464 microversion: 2.1 time: 0.127380 Aug 04 16:50:37.938911 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1483/2985] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:50:37 2022] GET /compute/v2.1/images/f45b6542-a249-441a-b979-42570ece3bd1 => generated 1464 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:37.965567 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-34d58408-17d9-469f-94fc-f669a5e00aeb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:37.967000 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-34d58408-17d9-469f-94fc-f669a5e00aeb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:37.988244 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-34d58408-17d9-469f-94fc-f669a5e00aeb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:37.989558 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-34d58408-17d9-469f-94fc-f669a5e00aeb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:37.991614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-34d58408-17d9-469f-94fc-f669a5e00aeb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:37.992704 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-34d58408-17d9-469f-94fc-f669a5e00aeb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:38.177981 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-d3541561-a61d-426f-98ca-e856a1ff12b7 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:50:38.178539 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-d3541561-a61d-426f-98ca-e856a1ff12b7 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:50:38.178857 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-d3541561-a61d-426f-98ca-e856a1ff12b7 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:50:38.179262 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-d3541561-a61d-426f-98ca-e856a1ff12b7 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:50:38.179667 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-d3541561-a61d-426f-98ca-e856a1ff12b7 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:50:38.195116 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d3541561-a61d-426f-98ca-e856a1ff12b7 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:38.195571 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d3541561-a61d-426f-98ca-e856a1ff12b7 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:38.196369 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d3541561-a61d-426f-98ca-e856a1ff12b7 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:38.196807 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d3541561-a61d-426f-98ca-e856a1ff12b7 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:38.266519 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-d3541561-a61d-426f-98ca-e856a1ff12b7 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Getting quotas for project c96b36239054414182544ccfe7550cd9. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:50:38.285724 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-d3541561-a61d-426f-98ca-e856a1ff12b7 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Getting quotas for user eb4c0d6fac94470d9665f19021d50007 and project c96b36239054414182544ccfe7550cd9. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:50:38.302976 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d3541561-a61d-426f-98ca-e856a1ff12b7 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:50:38.306639 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d3541561-a61d-426f-98ca-e856a1ff12b7 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] [instance: f91fdc58-3e45-4fc2-8bae-bda8292c908d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:50:38.441044 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d3541561-a61d-426f-98ca-e856a1ff12b7 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.713321 Aug 04 16:50:38.453781 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1503/2986] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:50:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:50:38.454889 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-eba862b6-2ff1-4203-aa12-12d0e260113d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:38.456030 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-eba862b6-2ff1-4203-aa12-12d0e260113d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 5294cc65-8c7f-413f-8b13-c4e1d48567fe] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:38.474406 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eba862b6-2ff1-4203-aa12-12d0e260113d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:38.475198 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eba862b6-2ff1-4203-aa12-12d0e260113d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:38.476246 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eba862b6-2ff1-4203-aa12-12d0e260113d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:38.476912 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eba862b6-2ff1-4203-aa12-12d0e260113d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:38.845798 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-eba862b6-2ff1-4203-aa12-12d0e260113d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:38.866612 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-eba862b6-2ff1-4203-aa12-12d0e260113d tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe" status: 200 len: 1272 microversion: 2.1 time: 0.422931 Aug 04 16:50:38.867337 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1504/2987] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:38 2022] GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe => generated 1272 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:38.885918 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-db5f1cbc-3870-4dcd-94bd-d712f9b88793 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e84903160>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:38.970207 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-db5f1cbc-3870-4dcd-94bd-d712f9b88793 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/f45b6542-a249-441a-b979-42570ece3bd1" status: 200 len: 1464 microversion: 2.1 time: 0.088339 Aug 04 16:50:38.971389 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1505/2988] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:50:38 2022] GET /compute/v2.1/images/f45b6542-a249-441a-b979-42570ece3bd1 => generated 1464 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:38.989634 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9c8859a2-e860-47d9-94df-0ae13ed12d22 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:38.990770 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9c8859a2-e860-47d9-94df-0ae13ed12d22 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] [instance: f91fdc58-3e45-4fc2-8bae-bda8292c908d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:39.758914 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9c8859a2-e860-47d9-94df-0ae13ed12d22 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4c0d6fac94470d9665f19021d50007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96b36239054414182544ccfe7550cd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:39.775955 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9c8859a2-e860-47d9-94df-0ae13ed12d22 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d" status: 200 len: 1216 microversion: 2.1 time: 0.803268 Aug 04 16:50:39.777364 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1506/2989] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:38 2022] GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d => generated 1216 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:39.782491 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e36fdf8c-d635-4572-ab61-df229cf766f9 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:39.794316 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e36fdf8c-d635-4572-ab61-df229cf766f9 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:39.803111 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e36fdf8c-d635-4572-ab61-df229cf766f9 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:39.803835 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e36fdf8c-d635-4572-ab61-df229cf766f9 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:39.811963 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e36fdf8c-d635-4572-ab61-df229cf766f9 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:39.812809 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e36fdf8c-d635-4572-ab61-df229cf766f9 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:39.941074 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-34d58408-17d9-469f-94fc-f669a5e00aeb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:39.951943 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-34d58408-17d9-469f-94fc-f669a5e00aeb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 2.011095 Aug 04 16:50:39.969741 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1484/2990] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:37 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 2030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:39.980480 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d3e439b7-dcc1-4659-8b44-a32ca7372bfa tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:39.984113 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d3e439b7-dcc1-4659-8b44-a32ca7372bfa tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] [instance: 9139a17d-927c-4595-a7ff-11a1fa3a6a69] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:39.999946 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d3e439b7-dcc1-4659-8b44-a32ca7372bfa tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:40.000662 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d3e439b7-dcc1-4659-8b44-a32ca7372bfa tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:40.001662 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d3e439b7-dcc1-4659-8b44-a32ca7372bfa tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:40.003958 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d3e439b7-dcc1-4659-8b44-a32ca7372bfa tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:41.435578 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d3e439b7-dcc1-4659-8b44-a32ca7372bfa tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad56451fe41482585833461124f0497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3731044d35c449289d1000d0628d06c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:41.459216 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d3e439b7-dcc1-4659-8b44-a32ca7372bfa tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/servers/9139a17d-927c-4595-a7ff-11a1fa3a6a69" status: 200 len: 1468 microversion: 2.1 time: 1.485868 Aug 04 16:50:41.462876 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1485/2991] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:39 2022] GET /compute/v2.1/servers/9139a17d-927c-4595-a7ff-11a1fa3a6a69 => generated 1468 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:41.503843 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-47790880-0fb9-4f8e-9609-97b7b7473fb3 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:41.504475 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-47790880-0fb9-4f8e-9609-97b7b7473fb3 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 5294cc65-8c7f-413f-8b13-c4e1d48567fe] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:41.508349 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e36fdf8c-d635-4572-ab61-df229cf766f9 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:41.527411 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-47790880-0fb9-4f8e-9609-97b7b7473fb3 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:41.528224 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-47790880-0fb9-4f8e-9609-97b7b7473fb3 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:41.529219 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-47790880-0fb9-4f8e-9609-97b7b7473fb3 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:41.530524 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-47790880-0fb9-4f8e-9609-97b7b7473fb3 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:41.534005 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e36fdf8c-d635-4572-ab61-df229cf766f9 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:41.536017 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e36fdf8c-d635-4572-ab61-df229cf766f9 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:41.546358 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e36fdf8c-d635-4572-ab61-df229cf766f9 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1707 microversion: 2.42 time: 1.761043 Aug 04 16:50:41.549326 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1507/2992] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:50:39 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1707 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:50:41.581899 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-12056b84-da04-4904-8b4e-5daa4b8281c3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:41.583773 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-12056b84-da04-4904-8b4e-5daa4b8281c3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:41.610346 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-12056b84-da04-4904-8b4e-5daa4b8281c3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:41.610791 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-12056b84-da04-4904-8b4e-5daa4b8281c3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:41.611801 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-12056b84-da04-4904-8b4e-5daa4b8281c3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:41.612411 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-12056b84-da04-4904-8b4e-5daa4b8281c3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:42.285841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-47790880-0fb9-4f8e-9609-97b7b7473fb3 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:42.305316 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-47790880-0fb9-4f8e-9609-97b7b7473fb3 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe" status: 200 len: 1314 microversion: 2.1 time: 0.840304 Aug 04 16:50:42.306884 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1486/2993] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:41 2022] GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe => generated 1314 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:42.320957 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-c463c7cd-b5dd-4319-918c-3b4a9a7bac8b req-56ed7596-2532-4317-8fa8-b0fe7662e611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9139a17d-927c-4595-a7ff-11a1fa3a6a69", "name": "network-vif-unplugged", "status": "completed", "tag": "ec13d30d-7a89-4d60-b71e-301109f0b912"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:50:42.332109 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-c463c7cd-b5dd-4319-918c-3b4a9a7bac8b req-56ed7596-2532-4317-8fa8-b0fe7662e611 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:42.332663 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-c463c7cd-b5dd-4319-918c-3b4a9a7bac8b req-56ed7596-2532-4317-8fa8-b0fe7662e611 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:42.352868 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-c463c7cd-b5dd-4319-918c-3b4a9a7bac8b req-56ed7596-2532-4317-8fa8-b0fe7662e611 service nova] Creating event network-vif-unplugged:ec13d30d-7a89-4d60-b71e-301109f0b912 for instance 9139a17d-927c-4595-a7ff-11a1fa3a6a69 on n-h1-846466-12 Aug 04 16:50:42.361818 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-c463c7cd-b5dd-4319-918c-3b4a9a7bac8b req-56ed7596-2532-4317-8fa8-b0fe7662e611 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053187 Aug 04 16:50:42.363916 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1487/2994] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:50:42.379849 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f2f16815-dd58-49fe-bc54-577aa91145a9 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:42.380770 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f2f16815-dd58-49fe-bc54-577aa91145a9 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] [instance: f91fdc58-3e45-4fc2-8bae-bda8292c908d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:42.388941 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f2f16815-dd58-49fe-bc54-577aa91145a9 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:42.390312 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f2f16815-dd58-49fe-bc54-577aa91145a9 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:42.391309 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f2f16815-dd58-49fe-bc54-577aa91145a9 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:42.392307 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f2f16815-dd58-49fe-bc54-577aa91145a9 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:42.520623 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-12056b84-da04-4904-8b4e-5daa4b8281c3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:42.536559 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-12056b84-da04-4904-8b4e-5daa4b8281c3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.982472 Aug 04 16:50:42.538700 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1508/2995] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:41 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:42.564277 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ef7d801d-7822-406a-bc85-3f2f89cc7379 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1920739947"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:50:42.576737 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ef7d801d-7822-406a-bc85-3f2f89cc7379 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] [instance: 800296f7-67da-4f41-aea4-e7e1af65e6c2] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:42.598997 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef7d801d-7822-406a-bc85-3f2f89cc7379 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:42.599854 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef7d801d-7822-406a-bc85-3f2f89cc7379 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:42.600850 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef7d801d-7822-406a-bc85-3f2f89cc7379 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:42.601523 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef7d801d-7822-406a-bc85-3f2f89cc7379 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:42.743396 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f2f16815-dd58-49fe-bc54-577aa91145a9 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4c0d6fac94470d9665f19021d50007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96b36239054414182544ccfe7550cd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:42.767379 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f2f16815-dd58-49fe-bc54-577aa91145a9 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d" status: 200 len: 1274 microversion: 2.1 time: 0.401808 Aug 04 16:50:42.768848 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1488/2996] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:42 2022] GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d => generated 1274 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:42.788032 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bca1670d-1a68-468e-9a9a-84477755e5db tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:42.789420 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bca1670d-1a68-468e-9a9a-84477755e5db tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:42.806985 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bca1670d-1a68-468e-9a9a-84477755e5db tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:42.809017 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bca1670d-1a68-468e-9a9a-84477755e5db tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:42.813645 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bca1670d-1a68-468e-9a9a-84477755e5db tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:42.814484 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bca1670d-1a68-468e-9a9a-84477755e5db tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:42.980239 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ef7d801d-7822-406a-bc85-3f2f89cc7379 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "POST /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2/action" status: 202 len: 0 microversion: 2.1 time: 0.438745 Aug 04 16:50:42.981070 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1509/2997] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:50:42 2022] POST /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2/action => generated 0 bytes in 442 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 16:50:42.989896 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-92c4bd71-5a59-4845-8132-be2ef18afe6e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:42.999622 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-92c4bd71-5a59-4845-8132-be2ef18afe6e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:43.006836 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-92c4bd71-5a59-4845-8132-be2ef18afe6e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:43.009882 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-92c4bd71-5a59-4845-8132-be2ef18afe6e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:43.022490 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-92c4bd71-5a59-4845-8132-be2ef18afe6e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:43.023121 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-92c4bd71-5a59-4845-8132-be2ef18afe6e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:43.793768 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bca1670d-1a68-468e-9a9a-84477755e5db tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:43.800825 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:50:43.831260 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bca1670d-1a68-468e-9a9a-84477755e5db tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 1.056739 Aug 04 16:50:43.834094 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1489/2998] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:42 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:43.857452 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-658cb2ae-5291-40ab-a0e3-91b41d35d0d8 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e84ba51f0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:43.978777 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-658cb2ae-5291-40ab-a0e3-91b41d35d0d8 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/2401103e-e83f-4a89-8a95-3958fca23039" status: 200 len: 1455 microversion: 2.1 time: 0.141508 Aug 04 16:50:43.983706 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1490/2999] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:50:43 2022] GET /compute/v2.1/images/2401103e-e83f-4a89-8a95-3958fca23039 => generated 1455 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:43.994564 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2414e54b-9202-40cc-9c80-8cb7ecb04fb5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:44.000112 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2414e54b-9202-40cc-9c80-8cb7ecb04fb5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 5294cc65-8c7f-413f-8b13-c4e1d48567fe] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:44.023386 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:50:44.031682 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2414e54b-9202-40cc-9c80-8cb7ecb04fb5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:44.034738 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2414e54b-9202-40cc-9c80-8cb7ecb04fb5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:44.037694 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2414e54b-9202-40cc-9c80-8cb7ecb04fb5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:44.041009 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2414e54b-9202-40cc-9c80-8cb7ecb04fb5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:44.980303 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-92c4bd71-5a59-4845-8132-be2ef18afe6e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:45.004083 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-92c4bd71-5a59-4845-8132-be2ef18afe6e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:45.008514 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-92c4bd71-5a59-4845-8132-be2ef18afe6e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:45.013468 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-92c4bd71-5a59-4845-8132-be2ef18afe6e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1753 microversion: 2.42 time: 2.030907 Aug 04 16:50:45.015203 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1510/3000] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:50:42 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1753 bytes in 2033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:50:45.030276 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e4e4415e-4b54-4469-bf87-7d6d28fa977d tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:45.033730 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e4e4415e-4b54-4469-bf87-7d6d28fa977d tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] [instance: f91fdc58-3e45-4fc2-8bae-bda8292c908d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:45.051423 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e4e4415e-4b54-4469-bf87-7d6d28fa977d tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:45.053714 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e4e4415e-4b54-4469-bf87-7d6d28fa977d tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:45.055762 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e4e4415e-4b54-4469-bf87-7d6d28fa977d tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:45.056446 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e4e4415e-4b54-4469-bf87-7d6d28fa977d tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:45.460964 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e4e4415e-4b54-4469-bf87-7d6d28fa977d tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4c0d6fac94470d9665f19021d50007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96b36239054414182544ccfe7550cd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:45.470710 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e4e4415e-4b54-4469-bf87-7d6d28fa977d tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d" status: 200 len: 1274 microversion: 2.1 time: 0.453576 Aug 04 16:50:45.484183 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1511/3001] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:45 2022] GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d => generated 1274 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:45.484183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-792fc956-5c62-4786-85b8-68d6760955f9 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:50:45.506821 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-792fc956-5c62-4786-85b8-68d6760955f9 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:45.507537 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-792fc956-5c62-4786-85b8-68d6760955f9 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:45.559609 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-792fc956-5c62-4786-85b8-68d6760955f9 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Going to try to stop instance {{(pid=126125) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 16:50:45.621732 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2414e54b-9202-40cc-9c80-8cb7ecb04fb5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:45.647090 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-792fc956-5c62-4786-85b8-68d6760955f9 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action" status: 202 len: 0 microversion: 2.1 time: 0.171113 Aug 04 16:50:45.648846 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1512/3002] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:50:45 2022] POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:50:45.649739 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2414e54b-9202-40cc-9c80-8cb7ecb04fb5 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe" status: 200 len: 1314 microversion: 2.1 time: 1.663901 Aug 04 16:50:45.660645 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-14a98670-9723-4a00-ac26-eff41daca9cb tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e89cc93a0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:45.680521 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1491/3003] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:43 2022] GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe => generated 1314 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:45.720416 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a21b9eea-fb1a-4d0a-8373-8c17b037d993 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:45.721774 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a21b9eea-fb1a-4d0a-8373-8c17b037d993 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:45.747698 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-14a98670-9723-4a00-ac26-eff41daca9cb tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/2401103e-e83f-4a89-8a95-3958fca23039" status: 200 len: 1455 microversion: 2.1 time: 0.095693 Aug 04 16:50:45.748299 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1513/3004] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:50:45 2022] GET /compute/v2.1/images/2401103e-e83f-4a89-8a95-3958fca23039 => generated 1455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:45.762416 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a21b9eea-fb1a-4d0a-8373-8c17b037d993 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:45.762849 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a21b9eea-fb1a-4d0a-8373-8c17b037d993 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:45.763662 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a21b9eea-fb1a-4d0a-8373-8c17b037d993 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:45.764123 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a21b9eea-fb1a-4d0a-8373-8c17b037d993 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:46.064283 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-58d912d4-dfce-4321-816e-d9a765474827 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:46.065031 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-58d912d4-dfce-4321-816e-d9a765474827 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:46.085114 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58d912d4-dfce-4321-816e-d9a765474827 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:46.087038 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58d912d4-dfce-4321-816e-d9a765474827 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:46.089841 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58d912d4-dfce-4321-816e-d9a765474827 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:46.090301 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58d912d4-dfce-4321-816e-d9a765474827 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:46.774906 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a21b9eea-fb1a-4d0a-8373-8c17b037d993 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:46.787636 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a21b9eea-fb1a-4d0a-8373-8c17b037d993 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1679 microversion: 2.1 time: 1.104652 Aug 04 16:50:46.806787 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1492/3005] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:45 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1679 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:46.835592 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c48b4636-24ce-40d8-95c6-32a4036a09b5 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:46.839216 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c48b4636-24ce-40d8-95c6-32a4036a09b5 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] [instance: f91fdc58-3e45-4fc2-8bae-bda8292c908d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:46.868501 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c48b4636-24ce-40d8-95c6-32a4036a09b5 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:46.869343 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c48b4636-24ce-40d8-95c6-32a4036a09b5 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:46.873490 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c48b4636-24ce-40d8-95c6-32a4036a09b5 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:46.874179 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c48b4636-24ce-40d8-95c6-32a4036a09b5 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:47.102567 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-58d912d4-dfce-4321-816e-d9a765474827 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:47.121351 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-58d912d4-dfce-4321-816e-d9a765474827 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:47.122963 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-58d912d4-dfce-4321-816e-d9a765474827 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:47.124218 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-58d912d4-dfce-4321-816e-d9a765474827 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1753 microversion: 2.42 time: 1.067365 Aug 04 16:50:47.124812 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1514/3006] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:50:46 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1753 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:50:47.160044 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-daf2cfe0-7507-486d-aebb-d292d7915fcd tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:47.160922 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-daf2cfe0-7507-486d-aebb-d292d7915fcd tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 5294cc65-8c7f-413f-8b13-c4e1d48567fe] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:47.179100 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-daf2cfe0-7507-486d-aebb-d292d7915fcd tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:47.179554 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-daf2cfe0-7507-486d-aebb-d292d7915fcd tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:47.180393 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-daf2cfe0-7507-486d-aebb-d292d7915fcd tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:47.180814 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-daf2cfe0-7507-486d-aebb-d292d7915fcd tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:47.292805 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c48b4636-24ce-40d8-95c6-32a4036a09b5 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4c0d6fac94470d9665f19021d50007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96b36239054414182544ccfe7550cd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:47.329189 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c48b4636-24ce-40d8-95c6-32a4036a09b5 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d" status: 200 len: 1274 microversion: 2.1 time: 0.520416 Aug 04 16:50:47.329848 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1493/3007] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:46 2022] GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d => generated 1274 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:47.376139 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1b6b17cb-159b-4dd0-852b-96fdb23bdc75 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e847810d0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:47.462890 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1b6b17cb-159b-4dd0-852b-96fdb23bdc75 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/2401103e-e83f-4a89-8a95-3958fca23039" status: 200 len: 1455 microversion: 2.1 time: 0.112479 Aug 04 16:50:47.463557 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1494/3008] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:50:47 2022] GET /compute/v2.1/images/2401103e-e83f-4a89-8a95-3958fca23039 => generated 1455 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:47.805420 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-daf2cfe0-7507-486d-aebb-d292d7915fcd tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:47.815966 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-daf2cfe0-7507-486d-aebb-d292d7915fcd tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe" status: 200 len: 1314 microversion: 2.1 time: 0.681854 Aug 04 16:50:47.830804 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f9e4d242-f233-42e7-9a33-4fb9a526a2e6 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:47.832314 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f9e4d242-f233-42e7-9a33-4fb9a526a2e6 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:47.840027 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1515/3009] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:47 2022] GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe => generated 1314 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:47.865429 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f9e4d242-f233-42e7-9a33-4fb9a526a2e6 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:47.869817 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f9e4d242-f233-42e7-9a33-4fb9a526a2e6 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:47.876170 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f9e4d242-f233-42e7-9a33-4fb9a526a2e6 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:47.884046 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f9e4d242-f233-42e7-9a33-4fb9a526a2e6 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:47.889354 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-139a1547-154a-4bf9-8593-a878a35ebec9 req-5dadc90d-2d53-4713-b10f-c85bb506e72c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5294cc65-8c7f-413f-8b13-c4e1d48567fe", "tag": "4417293d-153a-4971-97a2-6f2db8a13bb9"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:50:47.930805 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-139a1547-154a-4bf9-8593-a878a35ebec9 req-5dadc90d-2d53-4713-b10f-c85bb506e72c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:47.931267 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-139a1547-154a-4bf9-8593-a878a35ebec9 req-5dadc90d-2d53-4713-b10f-c85bb506e72c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:47.969000 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-139a1547-154a-4bf9-8593-a878a35ebec9 req-5dadc90d-2d53-4713-b10f-c85bb506e72c service nova] Creating event network-changed:4417293d-153a-4971-97a2-6f2db8a13bb9 for instance 5294cc65-8c7f-413f-8b13-c4e1d48567fe on n-h2-846466-12 Aug 04 16:50:47.983207 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-139a1547-154a-4bf9-8593-a878a35ebec9 req-5dadc90d-2d53-4713-b10f-c85bb506e72c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105183 Aug 04 16:50:47.984133 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1516/3010] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:50:48.156445 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8418198c-6e53-400d-8f2c-e7f5ae87eb85 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:48.158102 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8418198c-6e53-400d-8f2c-e7f5ae87eb85 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:48.192314 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8418198c-6e53-400d-8f2c-e7f5ae87eb85 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:48.201330 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8418198c-6e53-400d-8f2c-e7f5ae87eb85 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:48.207448 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8418198c-6e53-400d-8f2c-e7f5ae87eb85 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:48.209001 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8418198c-6e53-400d-8f2c-e7f5ae87eb85 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:48.282610 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:50:49.766059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=16 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:50:49.790536 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8418198c-6e53-400d-8f2c-e7f5ae87eb85 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:49.793768 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:50:49.823328 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f9e4d242-f233-42e7-9a33-4fb9a526a2e6 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:49.824151 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8418198c-6e53-400d-8f2c-e7f5ae87eb85 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:49.829364 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8418198c-6e53-400d-8f2c-e7f5ae87eb85 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:49.832211 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8418198c-6e53-400d-8f2c-e7f5ae87eb85 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1799 microversion: 2.42 time: 1.680444 Aug 04 16:50:49.844993 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f9e4d242-f233-42e7-9a33-4fb9a526a2e6 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1679 microversion: 2.1 time: 2.019904 Aug 04 16:50:49.854584 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1517/3011] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:50:48 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1799 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:50:49.858153 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1495/3012] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:47 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1679 bytes in 2034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:50:49.867762 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-aae95717-28fe-4c6a-9646-eafcb97d8599 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e850160d0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:49.871905 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-83688b29-95b3-4114-b198-6b57644170a7 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:49.872233 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-83688b29-95b3-4114-b198-6b57644170a7 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] [instance: f91fdc58-3e45-4fc2-8bae-bda8292c908d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:49.874290 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:50:49.913243 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-83688b29-95b3-4114-b198-6b57644170a7 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:49.913732 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-83688b29-95b3-4114-b198-6b57644170a7 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:49.914585 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-83688b29-95b3-4114-b198-6b57644170a7 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:49.915044 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-83688b29-95b3-4114-b198-6b57644170a7 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:49.955178 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-aae95717-28fe-4c6a-9646-eafcb97d8599 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/2401103e-e83f-4a89-8a95-3958fca23039" status: 200 len: 1455 microversion: 2.1 time: 0.095785 Aug 04 16:50:49.956377 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1496/3013] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:50:49 2022] GET /compute/v2.1/images/2401103e-e83f-4a89-8a95-3958fca23039 => generated 1455 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:49.966374 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-aded2a98-5752-4f97-abcf-b30e41606ee7 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:49.969002 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-aded2a98-5752-4f97-abcf-b30e41606ee7 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 5294cc65-8c7f-413f-8b13-c4e1d48567fe] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:49.978163 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aded2a98-5752-4f97-abcf-b30e41606ee7 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:49.978897 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aded2a98-5752-4f97-abcf-b30e41606ee7 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:49.982537 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aded2a98-5752-4f97-abcf-b30e41606ee7 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:49.983297 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aded2a98-5752-4f97-abcf-b30e41606ee7 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:51.642186 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-83688b29-95b3-4114-b198-6b57644170a7 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4c0d6fac94470d9665f19021d50007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96b36239054414182544ccfe7550cd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:51.684241 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-83688b29-95b3-4114-b198-6b57644170a7 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d" status: 200 len: 1316 microversion: 2.1 time: 1.823289 Aug 04 16:50:51.688965 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1518/3014] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:49 2022] GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d => generated 1316 bytes in 1833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:51.708215 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5bdae8a8-253f-4ba9-acd0-447382650dfd tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:51.718768 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5bdae8a8-253f-4ba9-acd0-447382650dfd tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:51.739946 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5bdae8a8-253f-4ba9-acd0-447382650dfd tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:51.742324 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5bdae8a8-253f-4ba9-acd0-447382650dfd tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:51.745873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5bdae8a8-253f-4ba9-acd0-447382650dfd tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:51.746831 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5bdae8a8-253f-4ba9-acd0-447382650dfd tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:52.228520 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-aded2a98-5752-4f97-abcf-b30e41606ee7 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:52.237258 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-aded2a98-5752-4f97-abcf-b30e41606ee7 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe" status: 200 len: 1314 microversion: 2.1 time: 2.279141 Aug 04 16:50:52.255888 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1497/3015] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:49 2022] GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe => generated 1314 bytes in 2299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:52.268188 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cf70d192-f367-4dc0-8f31-ceb491f0ad3b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:52.268830 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cf70d192-f367-4dc0-8f31-ceb491f0ad3b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:52.289655 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf70d192-f367-4dc0-8f31-ceb491f0ad3b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:52.290115 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf70d192-f367-4dc0-8f31-ceb491f0ad3b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:52.290940 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf70d192-f367-4dc0-8f31-ceb491f0ad3b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:52.291408 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf70d192-f367-4dc0-8f31-ceb491f0ad3b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:53.378424 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5bdae8a8-253f-4ba9-acd0-447382650dfd tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:53.401810 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5bdae8a8-253f-4ba9-acd0-447382650dfd tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:53.403467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5bdae8a8-253f-4ba9-acd0-447382650dfd tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:53.409011 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5bdae8a8-253f-4ba9-acd0-447382650dfd tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1799 microversion: 2.42 time: 1.718038 Aug 04 16:50:53.427966 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1519/3016] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:50:51 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1799 bytes in 1722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:50:53.430912 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f4858029-9b57-43a9-921d-c40f577da5c6 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e841ba040>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:53.522856 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f4858029-9b57-43a9-921d-c40f577da5c6 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/2401103e-e83f-4a89-8a95-3958fca23039" status: 200 len: 1455 microversion: 2.1 time: 0.103847 Aug 04 16:50:53.524708 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1520/3017] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:50:53 2022] GET /compute/v2.1/images/2401103e-e83f-4a89-8a95-3958fca23039 => generated 1455 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:53.532056 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cf70d192-f367-4dc0-8f31-ceb491f0ad3b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:53.535628 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-98b105d1-f4a7-44f0-b560-6d0a3aa31062 req-c925179f-c8e2-481b-bb3d-b8fc169424e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800296f7-67da-4f41-aea4-e7e1af65e6c2", "name": "network-vif-plugged", "status": "completed", "tag": "edcd52e8-c9af-4fd4-9b1a-35c30ea3ae67"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:50:53.540460 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cf70d192-f367-4dc0-8f31-ceb491f0ad3b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1679 microversion: 2.1 time: 1.280261 Aug 04 16:50:53.541108 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1498/3018] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:52 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1679 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:53.572334 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8eb6e8c9-4e7a-4bcd-8638-25c848291aef tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:53.573073 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8eb6e8c9-4e7a-4bcd-8638-25c848291aef tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] [instance: f91fdc58-3e45-4fc2-8bae-bda8292c908d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:53.586368 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-98b105d1-f4a7-44f0-b560-6d0a3aa31062 req-c925179f-c8e2-481b-bb3d-b8fc169424e0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:53.587282 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8eb6e8c9-4e7a-4bcd-8638-25c848291aef tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:53.587718 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-98b105d1-f4a7-44f0-b560-6d0a3aa31062 req-c925179f-c8e2-481b-bb3d-b8fc169424e0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:53.587838 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8eb6e8c9-4e7a-4bcd-8638-25c848291aef tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:53.588526 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8eb6e8c9-4e7a-4bcd-8638-25c848291aef tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:53.591963 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8eb6e8c9-4e7a-4bcd-8638-25c848291aef tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:53.636711 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-98b105d1-f4a7-44f0-b560-6d0a3aa31062 req-c925179f-c8e2-481b-bb3d-b8fc169424e0 service nova] Creating event network-vif-plugged:edcd52e8-c9af-4fd4-9b1a-35c30ea3ae67 for instance 800296f7-67da-4f41-aea4-e7e1af65e6c2 on n-h2-846466-12 Aug 04 16:50:53.654685 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-98b105d1-f4a7-44f0-b560-6d0a3aa31062 req-c925179f-c8e2-481b-bb3d-b8fc169424e0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123711 Aug 04 16:50:53.655657 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1521/3019] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:50:53.679566 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1eb37c0c-757b-4833-b34b-e7e94405040e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:53.681811 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1eb37c0c-757b-4833-b34b-e7e94405040e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 5294cc65-8c7f-413f-8b13-c4e1d48567fe] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:53.713354 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1eb37c0c-757b-4833-b34b-e7e94405040e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:53.722782 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1eb37c0c-757b-4833-b34b-e7e94405040e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:53.723733 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1eb37c0c-757b-4833-b34b-e7e94405040e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:53.724175 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1eb37c0c-757b-4833-b34b-e7e94405040e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:54.536383 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8eb6e8c9-4e7a-4bcd-8638-25c848291aef tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4c0d6fac94470d9665f19021d50007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96b36239054414182544ccfe7550cd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:54.549875 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8eb6e8c9-4e7a-4bcd-8638-25c848291aef tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d" status: 200 len: 1316 microversion: 2.1 time: 0.983194 Aug 04 16:50:54.551152 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1499/3020] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:53 2022] GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d => generated 1316 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:54.577333 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-360e41e4-85f3-447a-972e-776e0f34c4ec req-6608f2e5-34b9-470b-a33a-510af739158e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f91fdc58-3e45-4fc2-8bae-bda8292c908d", "tag": "8310e003-7985-4b7a-81eb-81193a3418ab"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:50:54.620364 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-360e41e4-85f3-447a-972e-776e0f34c4ec req-6608f2e5-34b9-470b-a33a-510af739158e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:54.624187 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-360e41e4-85f3-447a-972e-776e0f34c4ec req-6608f2e5-34b9-470b-a33a-510af739158e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:54.664849 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-360e41e4-85f3-447a-972e-776e0f34c4ec req-6608f2e5-34b9-470b-a33a-510af739158e service nova] Creating event network-changed:8310e003-7985-4b7a-81eb-81193a3418ab for instance f91fdc58-3e45-4fc2-8bae-bda8292c908d on n-h1-846466-12 Aug 04 16:50:54.675649 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-360e41e4-85f3-447a-972e-776e0f34c4ec req-6608f2e5-34b9-470b-a33a-510af739158e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122570 Aug 04 16:50:54.676688 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1500/3021] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:50:54.847767 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ba108131-f8fe-4677-97fb-bbd06c3043ce tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-159115467", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "46081ca9-0ee0-465c-8483-bd7332c8165a"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:50:54.951826 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-ba108131-f8fe-4677-97fb-bbd06c3043ce tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] validate_networks() for [('46081ca9-0ee0-465c-8483-bd7332c8165a', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:50:55.112808 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1eb37c0c-757b-4833-b34b-e7e94405040e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:55.134900 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1eb37c0c-757b-4833-b34b-e7e94405040e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe" status: 200 len: 1314 microversion: 2.1 time: 1.475799 Aug 04 16:50:55.146878 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1522/3022] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:53 2022] GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe => generated 1314 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:55.173324 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-855e2ee1-407b-4e08-a54b-a1bca78c0209 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:55.175331 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-855e2ee1-407b-4e08-a54b-a1bca78c0209 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:55.202869 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-855e2ee1-407b-4e08-a54b-a1bca78c0209 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:55.203704 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-855e2ee1-407b-4e08-a54b-a1bca78c0209 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:55.205334 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-855e2ee1-407b-4e08-a54b-a1bca78c0209 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:55.206032 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-855e2ee1-407b-4e08-a54b-a1bca78c0209 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:56.361136 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-855e2ee1-407b-4e08-a54b-a1bca78c0209 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:56.390645 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-855e2ee1-407b-4e08-a54b-a1bca78c0209 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:56.400280 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-855e2ee1-407b-4e08-a54b-a1bca78c0209 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:56.402144 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-855e2ee1-407b-4e08-a54b-a1bca78c0209 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1845 microversion: 2.42 time: 1.253430 Aug 04 16:50:56.403028 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1523/3023] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:50:55 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1845 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:50:56.408622 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6fd34271-c28c-4df5-a6a6-cf05c9ab167c tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e89cc9160>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:56.497610 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6fd34271-c28c-4df5-a6a6-cf05c9ab167c tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/2401103e-e83f-4a89-8a95-3958fca23039" status: 200 len: 1455 microversion: 2.1 time: 0.092911 Aug 04 16:50:56.498946 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1524/3024] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:50:56 2022] GET /compute/v2.1/images/2401103e-e83f-4a89-8a95-3958fca23039 => generated 1455 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:56.508738 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-caae371b-48c7-484b-a4c9-44faecdfa1b0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:56.514510 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-caae371b-48c7-484b-a4c9-44faecdfa1b0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:56.532748 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-caae371b-48c7-484b-a4c9-44faecdfa1b0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:56.533913 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-caae371b-48c7-484b-a4c9-44faecdfa1b0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:56.543397 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-caae371b-48c7-484b-a4c9-44faecdfa1b0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:56.546856 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-caae371b-48c7-484b-a4c9-44faecdfa1b0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:56.828789 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-ba108131-f8fe-4677-97fb-bbd06c3043ce tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:50:56.829220 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-ba108131-f8fe-4677-97fb-bbd06c3043ce tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:50:56.829938 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-ba108131-f8fe-4677-97fb-bbd06c3043ce tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:50:56.830982 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-ba108131-f8fe-4677-97fb-bbd06c3043ce tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:50:56.831435 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-ba108131-f8fe-4677-97fb-bbd06c3043ce tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:50:56.849371 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ba108131-f8fe-4677-97fb-bbd06c3043ce tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:56.849760 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ba108131-f8fe-4677-97fb-bbd06c3043ce tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:56.857393 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ba108131-f8fe-4677-97fb-bbd06c3043ce tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:56.858239 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ba108131-f8fe-4677-97fb-bbd06c3043ce tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:56.921484 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-ba108131-f8fe-4677-97fb-bbd06c3043ce tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Getting quotas for project eb9de718bdfb4d6dbf63c336dfde8d42. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:50:56.937951 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-ba108131-f8fe-4677-97fb-bbd06c3043ce tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Getting quotas for user 50ace5409bc54123aad5e1bc071cc3dd and project eb9de718bdfb4d6dbf63c336dfde8d42. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:50:56.965604 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ba108131-f8fe-4677-97fb-bbd06c3043ce tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:50:56.968911 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ba108131-f8fe-4677-97fb-bbd06c3043ce tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 30109352-6d98-4d4c-8613-96cfd959e86d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:50:57.070781 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ba108131-f8fe-4677-97fb-bbd06c3043ce tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.390889 Aug 04 16:50:57.072132 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1501/3025] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:50:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:50:57.078207 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e8bd78bc-085f-4394-8404-5127d2866891 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:57.079856 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e8bd78bc-085f-4394-8404-5127d2866891 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] [instance: f91fdc58-3e45-4fc2-8bae-bda8292c908d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:57.088809 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e8bd78bc-085f-4394-8404-5127d2866891 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:57.089696 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e8bd78bc-085f-4394-8404-5127d2866891 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:57.091139 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e8bd78bc-085f-4394-8404-5127d2866891 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:57.091725 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e8bd78bc-085f-4394-8404-5127d2866891 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:57.565318 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-caae371b-48c7-484b-a4c9-44faecdfa1b0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:57.580723 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-caae371b-48c7-484b-a4c9-44faecdfa1b0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1656 microversion: 2.1 time: 1.076426 Aug 04 16:50:57.581879 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1525/3026] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:56 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1656 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:57.593732 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1f67014f-7231-44b3-b210-8fe25700e286 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:57.594521 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1f67014f-7231-44b3-b210-8fe25700e286 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 5294cc65-8c7f-413f-8b13-c4e1d48567fe] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:57.602196 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f67014f-7231-44b3-b210-8fe25700e286 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:57.602662 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f67014f-7231-44b3-b210-8fe25700e286 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:57.603589 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f67014f-7231-44b3-b210-8fe25700e286 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:57.604050 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f67014f-7231-44b3-b210-8fe25700e286 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:57.954011 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1f67014f-7231-44b3-b210-8fe25700e286 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:57.967372 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1f67014f-7231-44b3-b210-8fe25700e286 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe" status: 200 len: 1314 microversion: 2.1 time: 0.384180 Aug 04 16:50:57.968694 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1526/3027] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:57 2022] GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:57.998007 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2b88227f-fff7-4ac6-a9a6-ccaec7373d36 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:57.998765 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2b88227f-fff7-4ac6-a9a6-ccaec7373d36 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 30109352-6d98-4d4c-8613-96cfd959e86d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:58.036564 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e8bd78bc-085f-4394-8404-5127d2866891 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4c0d6fac94470d9665f19021d50007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96b36239054414182544ccfe7550cd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:58.051522 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e8bd78bc-085f-4394-8404-5127d2866891 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d" status: 200 len: 1316 microversion: 2.1 time: 0.977628 Aug 04 16:50:58.059544 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1502/3028] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:57 2022] GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d => generated 1316 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:58.067100 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-aecfd34d-a92b-4ed1-b2ed-39414e38e1f6 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:58.080208 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-aecfd34d-a92b-4ed1-b2ed-39414e38e1f6 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:58.103116 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aecfd34d-a92b-4ed1-b2ed-39414e38e1f6 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:58.103772 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aecfd34d-a92b-4ed1-b2ed-39414e38e1f6 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:58.104806 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aecfd34d-a92b-4ed1-b2ed-39414e38e1f6 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:58.106228 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aecfd34d-a92b-4ed1-b2ed-39414e38e1f6 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:58.190549 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2b88227f-fff7-4ac6-a9a6-ccaec7373d36 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:58.197619 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2b88227f-fff7-4ac6-a9a6-ccaec7373d36 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d" status: 200 len: 1224 microversion: 2.1 time: 0.225728 Aug 04 16:50:58.200039 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1527/3029] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:57 2022] GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d => generated 1224 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:58.217062 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-294dec27-b964-43e8-8a0d-01b9ced082a4 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e89d88ca0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:58.291246 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-294dec27-b964-43e8-8a0d-01b9ced082a4 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/2401103e-e83f-4a89-8a95-3958fca23039" status: 200 len: 1455 microversion: 2.1 time: 0.089752 Aug 04 16:50:58.302102 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1528/3030] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:50:58 2022] GET /compute/v2.1/images/2401103e-e83f-4a89-8a95-3958fca23039 => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:58.307997 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ac8d9b49-f0cd-490d-900c-cab33d722049 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:50:58.319843 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ac8d9b49-f0cd-490d-900c-cab33d722049 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:58.320678 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ac8d9b49-f0cd-490d-900c-cab33d722049 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:58.395301 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ac8d9b49-f0cd-490d-900c-cab33d722049 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Going to try to start instance {{(pid=126125) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 16:50:58.547697 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ac8d9b49-f0cd-490d-900c-cab33d722049 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action" status: 202 len: 0 microversion: 2.1 time: 0.234494 Aug 04 16:50:58.555328 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1529/3031] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:50:58 2022] POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:50:58.575037 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-28cc29a9-110f-4886-b2fd-f9fcb7468e35 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:58.576980 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-28cc29a9-110f-4886-b2fd-f9fcb7468e35 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:58.608036 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-28cc29a9-110f-4886-b2fd-f9fcb7468e35 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:58.608493 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-28cc29a9-110f-4886-b2fd-f9fcb7468e35 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:58.609326 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-28cc29a9-110f-4886-b2fd-f9fcb7468e35 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:58.609740 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-28cc29a9-110f-4886-b2fd-f9fcb7468e35 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:58.745207 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-aecfd34d-a92b-4ed1-b2ed-39414e38e1f6 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:58.765217 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-aecfd34d-a92b-4ed1-b2ed-39414e38e1f6 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:58.772043 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-aecfd34d-a92b-4ed1-b2ed-39414e38e1f6 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:58.776577 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-aecfd34d-a92b-4ed1-b2ed-39414e38e1f6 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1833 microversion: 2.42 time: 0.714521 Aug 04 16:50:58.782079 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1503/3032] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:50:58 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1833 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:50:58.988309 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-96242c5e-f6b6-411e-9030-49b17e63df46 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:58.990169 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-96242c5e-f6b6-411e-9030-49b17e63df46 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 5294cc65-8c7f-413f-8b13-c4e1d48567fe] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:59.004201 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-96242c5e-f6b6-411e-9030-49b17e63df46 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:59.010585 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-96242c5e-f6b6-411e-9030-49b17e63df46 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:59.016738 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-96242c5e-f6b6-411e-9030-49b17e63df46 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:59.017535 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-96242c5e-f6b6-411e-9030-49b17e63df46 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:59.278863 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-28cc29a9-110f-4886-b2fd-f9fcb7468e35 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:59.292944 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-28cc29a9-110f-4886-b2fd-f9fcb7468e35 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1665 microversion: 2.1 time: 0.733226 Aug 04 16:50:59.294445 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1530/3033] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:58 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1665 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:59.310002 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-476db193-08b5-4c48-a0ef-1ec8494d1dcb tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:59.311034 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-476db193-08b5-4c48-a0ef-1ec8494d1dcb tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] [instance: f91fdc58-3e45-4fc2-8bae-bda8292c908d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:59.335220 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-476db193-08b5-4c48-a0ef-1ec8494d1dcb tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:59.336358 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-476db193-08b5-4c48-a0ef-1ec8494d1dcb tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:59.339417 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-476db193-08b5-4c48-a0ef-1ec8494d1dcb tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:59.341256 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-476db193-08b5-4c48-a0ef-1ec8494d1dcb tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:59.579266 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-96242c5e-f6b6-411e-9030-49b17e63df46 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:50:59.595384 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-96242c5e-f6b6-411e-9030-49b17e63df46 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe" status: 200 len: 1314 microversion: 2.1 time: 0.611051 Aug 04 16:50:59.599189 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1504/3034] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:58 2022] GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe => generated 1314 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:50:59.612168 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6079a97d-d34b-4042-a919-6774134b580e tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:50:59.623098 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6079a97d-d34b-4042-a919-6774134b580e tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 30109352-6d98-4d4c-8613-96cfd959e86d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:50:59.638335 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6079a97d-d34b-4042-a919-6774134b580e tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:59.640529 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6079a97d-d34b-4042-a919-6774134b580e tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:50:59.647226 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6079a97d-d34b-4042-a919-6774134b580e tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:50:59.648300 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6079a97d-d34b-4042-a919-6774134b580e tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:00.168441 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6079a97d-d34b-4042-a919-6774134b580e tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:00.179819 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6079a97d-d34b-4042-a919-6774134b580e tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d" status: 200 len: 1282 microversion: 2.1 time: 0.579096 Aug 04 16:51:00.182672 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1505/3035] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:59 2022] GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d => generated 1282 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:00.198441 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d9f2f522-26a1-495e-b406-a9ef01ab0bfe tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e84be70d0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:00.293608 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d9f2f522-26a1-495e-b406-a9ef01ab0bfe tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/2401103e-e83f-4a89-8a95-3958fca23039" status: 200 len: 1455 microversion: 2.1 time: 0.106887 Aug 04 16:51:00.294219 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1506/3036] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:00 2022] GET /compute/v2.1/images/2401103e-e83f-4a89-8a95-3958fca23039 => generated 1455 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:00.305353 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d591ab1b-8c37-4715-a856-d12abddb8af0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:00.306005 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d591ab1b-8c37-4715-a856-d12abddb8af0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:00.324774 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d591ab1b-8c37-4715-a856-d12abddb8af0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:00.325230 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d591ab1b-8c37-4715-a856-d12abddb8af0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:00.326056 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d591ab1b-8c37-4715-a856-d12abddb8af0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:00.326494 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d591ab1b-8c37-4715-a856-d12abddb8af0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:00.519791 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-476db193-08b5-4c48-a0ef-1ec8494d1dcb tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4c0d6fac94470d9665f19021d50007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96b36239054414182544ccfe7550cd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:00.544192 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-476db193-08b5-4c48-a0ef-1ec8494d1dcb tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d" status: 200 len: 1316 microversion: 2.1 time: 1.242179 Aug 04 16:51:00.546092 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1531/3037] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:50:59 2022] GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d => generated 1316 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:00.567776 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d6611c05-224a-4445-ab10-9010fe9f7e3d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:00.573109 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d6611c05-224a-4445-ab10-9010fe9f7e3d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:00.601251 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d6611c05-224a-4445-ab10-9010fe9f7e3d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:00.606517 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d6611c05-224a-4445-ab10-9010fe9f7e3d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:00.609647 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d6611c05-224a-4445-ab10-9010fe9f7e3d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:00.610740 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d6611c05-224a-4445-ab10-9010fe9f7e3d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:01.164575 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d591ab1b-8c37-4715-a856-d12abddb8af0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:01.187741 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d591ab1b-8c37-4715-a856-d12abddb8af0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:01.194091 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d591ab1b-8c37-4715-a856-d12abddb8af0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:01.196189 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d591ab1b-8c37-4715-a856-d12abddb8af0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1833 microversion: 2.42 time: 0.900844 Aug 04 16:51:01.197011 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1507/3038] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:51:00 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1833 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:51:01.208097 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-58da2805-5f93-422a-8794-28b230796ce8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:01.210934 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-58da2805-5f93-422a-8794-28b230796ce8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 5294cc65-8c7f-413f-8b13-c4e1d48567fe] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:01.231976 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58da2805-5f93-422a-8794-28b230796ce8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:01.232882 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58da2805-5f93-422a-8794-28b230796ce8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:01.238370 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58da2805-5f93-422a-8794-28b230796ce8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:01.239274 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58da2805-5f93-422a-8794-28b230796ce8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:01.444568 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d6611c05-224a-4445-ab10-9010fe9f7e3d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:01.492199 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d6611c05-224a-4445-ab10-9010fe9f7e3d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1665 microversion: 2.1 time: 0.932988 Aug 04 16:51:01.497446 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1532/3039] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:00 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1665 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:01.521347 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9f426191-5193-481f-87dc-b5514cc515ee tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:01.526350 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9f426191-5193-481f-87dc-b5514cc515ee tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 30109352-6d98-4d4c-8613-96cfd959e86d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:01.558231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9f426191-5193-481f-87dc-b5514cc515ee tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:01.559587 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9f426191-5193-481f-87dc-b5514cc515ee tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:01.561348 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9f426191-5193-481f-87dc-b5514cc515ee tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:01.563083 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9f426191-5193-481f-87dc-b5514cc515ee tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:01.590053 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-58da2805-5f93-422a-8794-28b230796ce8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:01.637341 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-58da2805-5f93-422a-8794-28b230796ce8 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe" status: 200 len: 1314 microversion: 2.1 time: 0.436169 Aug 04 16:51:01.642190 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1508/3040] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:01 2022] GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe => generated 1314 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:01.696979 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-70928241-f20e-45a4-96d6-d949f34e1b2d tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e84b62f70>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:01.871791 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-70928241-f20e-45a4-96d6-d949f34e1b2d tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/2401103e-e83f-4a89-8a95-3958fca23039" status: 200 len: 1455 microversion: 2.1 time: 0.225235 Aug 04 16:51:01.877233 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1509/3041] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:01 2022] GET /compute/v2.1/images/2401103e-e83f-4a89-8a95-3958fca23039 => generated 1455 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:01.887915 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1f5be396-d8e2-4e57-95ae-4b9d60de8983 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:01.888764 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1f5be396-d8e2-4e57-95ae-4b9d60de8983 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] [instance: f91fdc58-3e45-4fc2-8bae-bda8292c908d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:01.909084 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1f5be396-d8e2-4e57-95ae-4b9d60de8983 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:01.916589 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1f5be396-d8e2-4e57-95ae-4b9d60de8983 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:01.918721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1f5be396-d8e2-4e57-95ae-4b9d60de8983 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:01.919208 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1f5be396-d8e2-4e57-95ae-4b9d60de8983 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:02.696358 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9f426191-5193-481f-87dc-b5514cc515ee tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:02.711455 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9f426191-5193-481f-87dc-b5514cc515ee tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d" status: 200 len: 1282 microversion: 2.1 time: 1.212023 Aug 04 16:51:02.712065 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1533/3042] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:01 2022] GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d => generated 1282 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:02.725239 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-e87e5c4e-50fe-4468-b4fb-30ac6795a8c3 req-dad94a01-de83-48f2-9fd8-4b1f9cf7a62a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e273267-ae4b-4a99-821e-1c02c3440610", "tag": "cbcf974f-adce-4699-820a-253d13eee06d"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:51:02.775313 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-e87e5c4e-50fe-4468-b4fb-30ac6795a8c3 req-dad94a01-de83-48f2-9fd8-4b1f9cf7a62a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:02.776066 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-e87e5c4e-50fe-4468-b4fb-30ac6795a8c3 req-dad94a01-de83-48f2-9fd8-4b1f9cf7a62a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:02.799833 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-e87e5c4e-50fe-4468-b4fb-30ac6795a8c3 req-dad94a01-de83-48f2-9fd8-4b1f9cf7a62a service nova] Creating event network-changed:cbcf974f-adce-4699-820a-253d13eee06d for instance 8e273267-ae4b-4a99-821e-1c02c3440610 on n-h1-846466-12 Aug 04 16:51:02.816735 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-e87e5c4e-50fe-4468-b4fb-30ac6795a8c3 req-dad94a01-de83-48f2-9fd8-4b1f9cf7a62a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097519 Aug 04 16:51:02.818006 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1534/3043] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:51:02.827746 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-28c51361-17da-4731-9486-ac385e5f5dc4 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:02.829783 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-28c51361-17da-4731-9486-ac385e5f5dc4 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:02.847677 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-28c51361-17da-4731-9486-ac385e5f5dc4 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:02.848421 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-28c51361-17da-4731-9486-ac385e5f5dc4 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:02.849434 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-28c51361-17da-4731-9486-ac385e5f5dc4 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:02.850030 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-28c51361-17da-4731-9486-ac385e5f5dc4 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:03.977773 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1f5be396-d8e2-4e57-95ae-4b9d60de8983 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4c0d6fac94470d9665f19021d50007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96b36239054414182544ccfe7550cd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:04.024911 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1f5be396-d8e2-4e57-95ae-4b9d60de8983 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d" status: 200 len: 1316 microversion: 2.1 time: 2.138214 Aug 04 16:51:04.025840 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1510/3044] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:01 2022] GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d => generated 1316 bytes in 2148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:04.200248 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-28c51361-17da-4731-9486-ac385e5f5dc4 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:04.219123 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-28c51361-17da-4731-9486-ac385e5f5dc4 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:04.223718 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-28c51361-17da-4731-9486-ac385e5f5dc4 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:04.232570 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-28c51361-17da-4731-9486-ac385e5f5dc4 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1833 microversion: 2.42 time: 1.412620 Aug 04 16:51:04.234096 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1535/3045] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:51:02 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1833 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:51:04.240558 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f13de658-1b13-44c7-ac60-9c23a8e7c4c6 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:04.241625 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f13de658-1b13-44c7-ac60-9c23a8e7c4c6 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 5294cc65-8c7f-413f-8b13-c4e1d48567fe] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:04.253454 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f13de658-1b13-44c7-ac60-9c23a8e7c4c6 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:04.254287 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f13de658-1b13-44c7-ac60-9c23a8e7c4c6 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:04.255351 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f13de658-1b13-44c7-ac60-9c23a8e7c4c6 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:04.256066 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f13de658-1b13-44c7-ac60-9c23a8e7c4c6 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:04.618197 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e5f2c519-83a4-456e-949f-db6a72d0a5bd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:04.623733 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e5f2c519-83a4-456e-949f-db6a72d0a5bd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:04.654223 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5f2c519-83a4-456e-949f-db6a72d0a5bd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:04.654965 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5f2c519-83a4-456e-949f-db6a72d0a5bd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:04.659713 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5f2c519-83a4-456e-949f-db6a72d0a5bd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:04.660772 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5f2c519-83a4-456e-949f-db6a72d0a5bd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:05.455493 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f13de658-1b13-44c7-ac60-9c23a8e7c4c6 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:05.467289 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f13de658-1b13-44c7-ac60-9c23a8e7c4c6 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe" status: 200 len: 1314 microversion: 2.1 time: 1.231391 Aug 04 16:51:05.495274 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1536/3046] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:04 2022] GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe => generated 1314 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:05.517258 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-af18c9e8-ea48-49b1-a66f-0770b04f5516 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e77f879d0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:05.634075 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e5f2c519-83a4-456e-949f-db6a72d0a5bd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:05.648095 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e5f2c519-83a4-456e-949f-db6a72d0a5bd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 1.613336 Aug 04 16:51:05.648902 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1511/3047] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:04 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:05.663012 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8962def0-487e-4c6a-960a-fb10deb4a8b5 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:05.668280 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8962def0-487e-4c6a-960a-fb10deb4a8b5 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 30109352-6d98-4d4c-8613-96cfd959e86d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:05.688482 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8962def0-487e-4c6a-960a-fb10deb4a8b5 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:05.697763 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8962def0-487e-4c6a-960a-fb10deb4a8b5 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:05.700293 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-af18c9e8-ea48-49b1-a66f-0770b04f5516 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/2401103e-e83f-4a89-8a95-3958fca23039" status: 200 len: 1455 microversion: 2.1 time: 0.212299 Aug 04 16:51:05.701063 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1537/3048] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:05 2022] GET /compute/v2.1/images/2401103e-e83f-4a89-8a95-3958fca23039 => generated 1455 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:05.711035 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8962def0-487e-4c6a-960a-fb10deb4a8b5 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:05.712367 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8962def0-487e-4c6a-960a-fb10deb4a8b5 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:05.729729 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-59c690c7-6beb-4094-ba54-4426c4876de8 req-7e02bfeb-3c87-4df6-9ca8-9cbb6ab68e85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5294cc65-8c7f-413f-8b13-c4e1d48567fe", "name": "network-vif-plugged", "status": "completed", "tag": "4417293d-153a-4971-97a2-6f2db8a13bb9"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:51:05.849049 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-59c690c7-6beb-4094-ba54-4426c4876de8 req-7e02bfeb-3c87-4df6-9ca8-9cbb6ab68e85 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:05.850619 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-59c690c7-6beb-4094-ba54-4426c4876de8 req-7e02bfeb-3c87-4df6-9ca8-9cbb6ab68e85 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:05.922110 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-59c690c7-6beb-4094-ba54-4426c4876de8 req-7e02bfeb-3c87-4df6-9ca8-9cbb6ab68e85 service nova] Creating event network-vif-plugged:4417293d-153a-4971-97a2-6f2db8a13bb9 for instance 5294cc65-8c7f-413f-8b13-c4e1d48567fe on n-h2-846466-12 Aug 04 16:51:05.934605 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-59c690c7-6beb-4094-ba54-4426c4876de8 req-7e02bfeb-3c87-4df6-9ca8-9cbb6ab68e85 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228377 Aug 04 16:51:05.937847 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1538/3049] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:51:05.956826 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-66f954e8-8478-4dbe-a237-42eb2d983aaa tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:05.957960 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-66f954e8-8478-4dbe-a237-42eb2d983aaa tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] [instance: f91fdc58-3e45-4fc2-8bae-bda8292c908d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:05.975332 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-66f954e8-8478-4dbe-a237-42eb2d983aaa tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:05.976208 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-66f954e8-8478-4dbe-a237-42eb2d983aaa tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:05.978997 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-66f954e8-8478-4dbe-a237-42eb2d983aaa tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:05.982063 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-66f954e8-8478-4dbe-a237-42eb2d983aaa tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:06.075587 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8962def0-487e-4c6a-960a-fb10deb4a8b5 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:06.106154 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=100 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:51:06.120639 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8962def0-487e-4c6a-960a-fb10deb4a8b5 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d" status: 200 len: 1282 microversion: 2.1 time: 0.451894 Aug 04 16:51:06.127860 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1512/3050] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:05 2022] GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d => generated 1282 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:06.154919 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b5fc65cf-718d-4d0f-9d8a-cb381f1d225e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:06.155955 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b5fc65cf-718d-4d0f-9d8a-cb381f1d225e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:06.201143 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b5fc65cf-718d-4d0f-9d8a-cb381f1d225e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:06.203035 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b5fc65cf-718d-4d0f-9d8a-cb381f1d225e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:06.203872 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b5fc65cf-718d-4d0f-9d8a-cb381f1d225e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:06.206599 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b5fc65cf-718d-4d0f-9d8a-cb381f1d225e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:06.893220 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:51:06.936968 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b5fc65cf-718d-4d0f-9d8a-cb381f1d225e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:06.956715 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b5fc65cf-718d-4d0f-9d8a-cb381f1d225e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:06.966702 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b5fc65cf-718d-4d0f-9d8a-cb381f1d225e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:06.969402 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b5fc65cf-718d-4d0f-9d8a-cb381f1d225e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1854 microversion: 2.42 time: 0.838132 Aug 04 16:51:06.970567 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1513/3051] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:51:06 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1854 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:51:06.979531 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-529f72e1-bd49-461a-8735-4745c28184a5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:06.981035 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-529f72e1-bd49-461a-8735-4745c28184a5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:06.989825 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:51:06.995296 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-529f72e1-bd49-461a-8735-4745c28184a5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:06.996802 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-529f72e1-bd49-461a-8735-4745c28184a5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:06.998153 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-529f72e1-bd49-461a-8735-4745c28184a5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:06.998778 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-529f72e1-bd49-461a-8735-4745c28184a5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:08.194896 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:51:08.376869 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-66f954e8-8478-4dbe-a237-42eb2d983aaa tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4c0d6fac94470d9665f19021d50007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96b36239054414182544ccfe7550cd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:08.400557 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-66f954e8-8478-4dbe-a237-42eb2d983aaa tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d" status: 200 len: 1316 microversion: 2.1 time: 2.460927 Aug 04 16:51:08.428427 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1539/3052] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:05 2022] GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d => generated 1316 bytes in 2489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:08.438023 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-2210db3a-6ae0-4621-8aeb-cf4d91ec04ea req-f48fbc0b-d96b-4ff2-b8c2-c55261cce39e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e273267-ae4b-4a99-821e-1c02c3440610", "tag": "5be18406-7f65-42bc-aad8-d9f5cef83db3"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:51:08.471648 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-2210db3a-6ae0-4621-8aeb-cf4d91ec04ea req-f48fbc0b-d96b-4ff2-b8c2-c55261cce39e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:08.472406 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-2210db3a-6ae0-4621-8aeb-cf4d91ec04ea req-f48fbc0b-d96b-4ff2-b8c2-c55261cce39e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:08.519545 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-2210db3a-6ae0-4621-8aeb-cf4d91ec04ea req-f48fbc0b-d96b-4ff2-b8c2-c55261cce39e service nova] Creating event network-changed:5be18406-7f65-42bc-aad8-d9f5cef83db3 for instance 8e273267-ae4b-4a99-821e-1c02c3440610 on n-h1-846466-12 Aug 04 16:51:08.555984 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-2210db3a-6ae0-4621-8aeb-cf4d91ec04ea req-f48fbc0b-d96b-4ff2-b8c2-c55261cce39e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107570 Aug 04 16:51:08.557900 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1540/3053] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:51:08.571356 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7f094d30-35de-4afd-9f80-492c9fa86be4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:08.577064 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7f094d30-35de-4afd-9f80-492c9fa86be4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 5294cc65-8c7f-413f-8b13-c4e1d48567fe] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:08.594841 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7f094d30-35de-4afd-9f80-492c9fa86be4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:08.595525 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7f094d30-35de-4afd-9f80-492c9fa86be4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:08.596528 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7f094d30-35de-4afd-9f80-492c9fa86be4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:08.600912 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7f094d30-35de-4afd-9f80-492c9fa86be4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:08.664329 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:51:09.055429 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-529f72e1-bd49-461a-8735-4745c28184a5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:09.077087 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-529f72e1-bd49-461a-8735-4745c28184a5 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 2.103868 Aug 04 16:51:09.080441 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1514/3054] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:06 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 2109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:09.092237 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1b184c84-275a-4a32-92fd-0f1f33bce0ef tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e84b6f790>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:09.176290 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1b184c84-275a-4a32-92fd-0f1f33bce0ef tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/2401103e-e83f-4a89-8a95-3958fca23039" status: 200 len: 1455 microversion: 2.1 time: 0.094311 Aug 04 16:51:09.176975 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1515/3055] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:09 2022] GET /compute/v2.1/images/2401103e-e83f-4a89-8a95-3958fca23039 => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:09.182488 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dddaf040-6edc-4081-be4d-7e104e5f5b10 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:09.194566 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-dddaf040-6edc-4081-be4d-7e104e5f5b10 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 30109352-6d98-4d4c-8613-96cfd959e86d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:09.202854 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dddaf040-6edc-4081-be4d-7e104e5f5b10 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:09.203708 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dddaf040-6edc-4081-be4d-7e104e5f5b10 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:09.204812 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dddaf040-6edc-4081-be4d-7e104e5f5b10 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:09.212912 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dddaf040-6edc-4081-be4d-7e104e5f5b10 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:10.441141 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-dddaf040-6edc-4081-be4d-7e104e5f5b10 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:10.461504 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dddaf040-6edc-4081-be4d-7e104e5f5b10 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d" status: 200 len: 1324 microversion: 2.1 time: 1.282923 Aug 04 16:51:10.463514 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1516/3056] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:09 2022] GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d => generated 1324 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:10.469352 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7f094d30-35de-4afd-9f80-492c9fa86be4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:10.470337 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-032b20d3-c8d7-43a0-b235-c9f2fb69e738 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:10.471269 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-032b20d3-c8d7-43a0-b235-c9f2fb69e738 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:10.480542 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-032b20d3-c8d7-43a0-b235-c9f2fb69e738 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:10.482008 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-032b20d3-c8d7-43a0-b235-c9f2fb69e738 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:10.483013 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7f094d30-35de-4afd-9f80-492c9fa86be4 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe" status: 200 len: 1501 microversion: 2.1 time: 1.923242 Aug 04 16:51:10.483292 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-032b20d3-c8d7-43a0-b235-c9f2fb69e738 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:10.483909 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-032b20d3-c8d7-43a0-b235-c9f2fb69e738 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:10.487693 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1541/3057] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:08 2022] GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe => generated 1501 bytes in 1929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:10.503900 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-7d029291-9c98-48d0-99f1-b4b1f21fa164 req-29297f07-7418-4d03-a1fb-87387d7991c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f91fdc58-3e45-4fc2-8bae-bda8292c908d", "name": "network-vif-plugged", "status": "completed", "tag": "8310e003-7985-4b7a-81eb-81193a3418ab"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:51:10.542525 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7d029291-9c98-48d0-99f1-b4b1f21fa164 req-29297f07-7418-4d03-a1fb-87387d7991c8 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:10.543435 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7d029291-9c98-48d0-99f1-b4b1f21fa164 req-29297f07-7418-4d03-a1fb-87387d7991c8 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:10.559934 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-7d029291-9c98-48d0-99f1-b4b1f21fa164 req-29297f07-7418-4d03-a1fb-87387d7991c8 service nova] Creating event network-vif-plugged:8310e003-7985-4b7a-81eb-81193a3418ab for instance f91fdc58-3e45-4fc2-8bae-bda8292c908d on n-h1-846466-12 Aug 04 16:51:10.570128 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-7d029291-9c98-48d0-99f1-b4b1f21fa164 req-29297f07-7418-4d03-a1fb-87387d7991c8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080272 Aug 04 16:51:10.571324 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1542/3058] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:51:10.586575 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-05bd1610-e202-4f3f-9bb8-2ad06bc470ce tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:10.587793 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-05bd1610-e202-4f3f-9bb8-2ad06bc470ce tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:10.616191 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-05bd1610-e202-4f3f-9bb8-2ad06bc470ce tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:10.616665 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-05bd1610-e202-4f3f-9bb8-2ad06bc470ce tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:10.620020 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-05bd1610-e202-4f3f-9bb8-2ad06bc470ce tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:10.620654 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-05bd1610-e202-4f3f-9bb8-2ad06bc470ce tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:11.480943 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-032b20d3-c8d7-43a0-b235-c9f2fb69e738 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:11.494419 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-032b20d3-c8d7-43a0-b235-c9f2fb69e738 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:11.503317 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-032b20d3-c8d7-43a0-b235-c9f2fb69e738 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:11.504902 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-032b20d3-c8d7-43a0-b235-c9f2fb69e738 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1875 microversion: 2.42 time: 1.040047 Aug 04 16:51:11.515407 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1517/3059] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:51:10 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1875 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:51:11.520678 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9134c7d4-7a52-4fd7-838b-fafcbcbc15c2 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:11.521594 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-05bd1610-e202-4f3f-9bb8-2ad06bc470ce tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:11.530369 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9134c7d4-7a52-4fd7-838b-fafcbcbc15c2 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] [instance: f91fdc58-3e45-4fc2-8bae-bda8292c908d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:11.537183 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-05bd1610-e202-4f3f-9bb8-2ad06bc470ce tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.962355 Aug 04 16:51:11.538540 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1543/3060] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:10 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:11.553570 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bdd7468a-ae23-43e3-82e1-c6c7c6578179 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e89ca2b80>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:11.568884 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9134c7d4-7a52-4fd7-838b-fafcbcbc15c2 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:11.570393 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9134c7d4-7a52-4fd7-838b-fafcbcbc15c2 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:11.571911 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9134c7d4-7a52-4fd7-838b-fafcbcbc15c2 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:11.572787 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9134c7d4-7a52-4fd7-838b-fafcbcbc15c2 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:11.657681 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bdd7468a-ae23-43e3-82e1-c6c7c6578179 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/2401103e-e83f-4a89-8a95-3958fca23039" status: 200 len: 1455 microversion: 2.1 time: 0.117690 Aug 04 16:51:11.661445 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1544/3061] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:11 2022] GET /compute/v2.1/images/2401103e-e83f-4a89-8a95-3958fca23039 => generated 1455 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:11.682488 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2d83f065-41fa-48d2-b52b-d980431e8beb tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:51:11.685013 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2d83f065-41fa-48d2-b52b-d980431e8beb tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 5294cc65-8c7f-413f-8b13-c4e1d48567fe] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:11.694225 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d83f065-41fa-48d2-b52b-d980431e8beb tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:11.694951 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d83f065-41fa-48d2-b52b-d980431e8beb tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:11.695906 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d83f065-41fa-48d2-b52b-d980431e8beb tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:11.696529 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d83f065-41fa-48d2-b52b-d980431e8beb tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:11.747412 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-2d83f065-41fa-48d2-b52b-d980431e8beb tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lazy-loading 'flavor' on Instance uuid 5294cc65-8c7f-413f-8b13-c4e1d48567fe {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:51:11.951370 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2d83f065-41fa-48d2-b52b-d980431e8beb tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "POST /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe/action" status: 202 len: 0 microversion: 2.1 time: 0.288309 Aug 04 16:51:11.956380 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1545/3062] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:51:11 2022] POST /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:51:11.963078 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-0ae9372c-6aee-43a2-97e6-e60c8563cdf2 req-041e006a-37b7-4821-a000-8daa7132e94e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e273267-ae4b-4a99-821e-1c02c3440610", "tag": "afae5ef1-0557-47a8-8a2d-099bde970903"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:51:11.985535 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-0ae9372c-6aee-43a2-97e6-e60c8563cdf2 req-041e006a-37b7-4821-a000-8daa7132e94e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:11.989536 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-0ae9372c-6aee-43a2-97e6-e60c8563cdf2 req-041e006a-37b7-4821-a000-8daa7132e94e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:12.014175 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-0ae9372c-6aee-43a2-97e6-e60c8563cdf2 req-041e006a-37b7-4821-a000-8daa7132e94e service nova] Creating event network-changed:afae5ef1-0557-47a8-8a2d-099bde970903 for instance 8e273267-ae4b-4a99-821e-1c02c3440610 on n-h1-846466-12 Aug 04 16:51:12.021525 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-0ae9372c-6aee-43a2-97e6-e60c8563cdf2 req-041e006a-37b7-4821-a000-8daa7132e94e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062528 Aug 04 16:51:12.022569 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1546/3063] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:51:12.027756 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0dc9576d-bf7a-491d-aa04-bf7e00ece1ed tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:12.028534 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0dc9576d-bf7a-491d-aa04-bf7e00ece1ed tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 30109352-6d98-4d4c-8613-96cfd959e86d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:12.036497 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0dc9576d-bf7a-491d-aa04-bf7e00ece1ed tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:12.036890 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0dc9576d-bf7a-491d-aa04-bf7e00ece1ed tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:12.038783 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0dc9576d-bf7a-491d-aa04-bf7e00ece1ed tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:12.039289 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0dc9576d-bf7a-491d-aa04-bf7e00ece1ed tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:13.227547 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9134c7d4-7a52-4fd7-838b-fafcbcbc15c2 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4c0d6fac94470d9665f19021d50007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96b36239054414182544ccfe7550cd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:13.247802 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9134c7d4-7a52-4fd7-838b-fafcbcbc15c2 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d" status: 200 len: 1316 microversion: 2.1 time: 1.730057 Aug 04 16:51:13.251534 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1518/3064] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:11 2022] GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d => generated 1316 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:13.268892 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-05de999a-04e0-40ca-9a34-8ecb021ff49d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:13.269864 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-05de999a-04e0-40ca-9a34-8ecb021ff49d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:13.301004 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-05de999a-04e0-40ca-9a34-8ecb021ff49d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:13.302928 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-05de999a-04e0-40ca-9a34-8ecb021ff49d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:13.308403 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-05de999a-04e0-40ca-9a34-8ecb021ff49d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:13.309320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-05de999a-04e0-40ca-9a34-8ecb021ff49d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:13.495944 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0dc9576d-bf7a-491d-aa04-bf7e00ece1ed tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:13.510521 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0dc9576d-bf7a-491d-aa04-bf7e00ece1ed tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d" status: 200 len: 1324 microversion: 2.1 time: 1.486386 Aug 04 16:51:13.517360 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1547/3065] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:12 2022] GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d => generated 1324 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:13.528917 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b8225d52-c0a1-4ecc-b3d5-273338bb896e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:13.533073 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b8225d52-c0a1-4ecc-b3d5-273338bb896e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 5294cc65-8c7f-413f-8b13-c4e1d48567fe] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:13.572834 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8225d52-c0a1-4ecc-b3d5-273338bb896e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:13.579362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8225d52-c0a1-4ecc-b3d5-273338bb896e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:13.588467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8225d52-c0a1-4ecc-b3d5-273338bb896e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:13.589768 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8225d52-c0a1-4ecc-b3d5-273338bb896e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:14.131173 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-05de999a-04e0-40ca-9a34-8ecb021ff49d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:14.139174 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-05de999a-04e0-40ca-9a34-8ecb021ff49d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.885618 Aug 04 16:51:14.140121 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1519/3066] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:13 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:14.174419 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8bce4e49-3455-4c6b-8590-b71f6e77ad67 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:14.175034 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8bce4e49-3455-4c6b-8590-b71f6e77ad67 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:14.190404 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:51:14.192411 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8bce4e49-3455-4c6b-8590-b71f6e77ad67 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:14.192867 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8bce4e49-3455-4c6b-8590-b71f6e77ad67 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:14.193777 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8bce4e49-3455-4c6b-8590-b71f6e77ad67 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:14.194181 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8bce4e49-3455-4c6b-8590-b71f6e77ad67 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:14.629427 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b8225d52-c0a1-4ecc-b3d5-273338bb896e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:14.659018 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b8225d52-c0a1-4ecc-b3d5-273338bb896e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe" status: 200 len: 1492 microversion: 2.1 time: 1.139897 Aug 04 16:51:14.683119 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1548/3067] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:13 2022] GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe => generated 1492 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:14.691334 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f2534ae6-7bbd-48d2-9ad2-97889de94aa2 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e8413a3a0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:14.782508 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f2534ae6-7bbd-48d2-9ad2-97889de94aa2 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/2401103e-e83f-4a89-8a95-3958fca23039" status: 200 len: 1455 microversion: 2.1 time: 0.097607 Aug 04 16:51:14.783385 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1549/3068] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:14 2022] GET /compute/v2.1/images/2401103e-e83f-4a89-8a95-3958fca23039 => generated 1455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:14.788950 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-10417f7c-8809-4aae-aae9-2ce0d5c95673 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:14.790120 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-10417f7c-8809-4aae-aae9-2ce0d5c95673 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:14.798197 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-10417f7c-8809-4aae-aae9-2ce0d5c95673 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:14.798197 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-10417f7c-8809-4aae-aae9-2ce0d5c95673 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:14.799296 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-10417f7c-8809-4aae-aae9-2ce0d5c95673 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:14.800294 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-10417f7c-8809-4aae-aae9-2ce0d5c95673 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:14.857192 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8bce4e49-3455-4c6b-8590-b71f6e77ad67 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:14.879693 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8bce4e49-3455-4c6b-8590-b71f6e77ad67 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:14.886751 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8bce4e49-3455-4c6b-8590-b71f6e77ad67 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:14.888134 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8bce4e49-3455-4c6b-8590-b71f6e77ad67 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1875 microversion: 2.42 time: 0.717683 Aug 04 16:51:14.888751 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1520/3069] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:51:14 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1875 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:51:14.905498 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-25070d29-580e-4916-a809-fb014b92a7c4 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:14.906636 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-25070d29-580e-4916-a809-fb014b92a7c4 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] [instance: f91fdc58-3e45-4fc2-8bae-bda8292c908d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:14.919595 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-25070d29-580e-4916-a809-fb014b92a7c4 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:14.923631 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-25070d29-580e-4916-a809-fb014b92a7c4 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:14.926201 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-25070d29-580e-4916-a809-fb014b92a7c4 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:14.926843 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-25070d29-580e-4916-a809-fb014b92a7c4 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:16.017733 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-25070d29-580e-4916-a809-fb014b92a7c4 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4c0d6fac94470d9665f19021d50007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96b36239054414182544ccfe7550cd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:16.028372 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-25070d29-580e-4916-a809-fb014b92a7c4 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d" status: 200 len: 1466 microversion: 2.1 time: 1.135723 Aug 04 16:51:16.031752 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-10417f7c-8809-4aae-aae9-2ce0d5c95673 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:16.034363 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1521/3070] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:14 2022] GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d => generated 1466 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:16.058849 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-10417f7c-8809-4aae-aae9-2ce0d5c95673 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 1.273915 Aug 04 16:51:16.059560 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1550/3071] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:14 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:16.066016 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2549fd15-a589-4249-8283-f61a1e0d620b tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:16.070228 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2549fd15-a589-4249-8283-f61a1e0d620b tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 30109352-6d98-4d4c-8613-96cfd959e86d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:16.089371 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-663255ed-4ed7-45aa-b1fb-5d9009eee34b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:16.090652 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-663255ed-4ed7-45aa-b1fb-5d9009eee34b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 5294cc65-8c7f-413f-8b13-c4e1d48567fe] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:16.105208 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-663255ed-4ed7-45aa-b1fb-5d9009eee34b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:16.105766 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2549fd15-a589-4249-8283-f61a1e0d620b tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:16.106266 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2549fd15-a589-4249-8283-f61a1e0d620b tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:16.106568 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-663255ed-4ed7-45aa-b1fb-5d9009eee34b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:16.107098 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2549fd15-a589-4249-8283-f61a1e0d620b tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:16.107775 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2549fd15-a589-4249-8283-f61a1e0d620b tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:16.111172 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-663255ed-4ed7-45aa-b1fb-5d9009eee34b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:16.111888 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-663255ed-4ed7-45aa-b1fb-5d9009eee34b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:16.175042 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-663255ed-4ed7-45aa-b1fb-5d9009eee34b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 5294cc65-8c7f-413f-8b13-c4e1d48567fe] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:51:16.388889 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-663255ed-4ed7-45aa-b1fb-5d9009eee34b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe" status: 204 len: 0 microversion: 2.1 time: 0.305188 Aug 04 16:51:16.392890 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1551/3072] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:51:16 2022] DELETE /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:51:16.395969 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-2cdc5834-ff9a-44f5-ac6d-2af4803b01d3 req-ded78841-528c-4ca7-a50e-9b358c5f63bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30109352-6d98-4d4c-8613-96cfd959e86d", "tag": "25fb6649-7af7-45df-8635-9e27010c2ae1"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:51:16.431330 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-2cdc5834-ff9a-44f5-ac6d-2af4803b01d3 req-ded78841-528c-4ca7-a50e-9b358c5f63bd service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:16.434668 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-2cdc5834-ff9a-44f5-ac6d-2af4803b01d3 req-ded78841-528c-4ca7-a50e-9b358c5f63bd service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:16.462920 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-2cdc5834-ff9a-44f5-ac6d-2af4803b01d3 req-ded78841-528c-4ca7-a50e-9b358c5f63bd service nova] Creating event network-changed:25fb6649-7af7-45df-8635-9e27010c2ae1 for instance 30109352-6d98-4d4c-8613-96cfd959e86d on n-h2-846466-12 Aug 04 16:51:16.483052 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-2cdc5834-ff9a-44f5-ac6d-2af4803b01d3 req-ded78841-528c-4ca7-a50e-9b358c5f63bd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091231 Aug 04 16:51:16.488811 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1552/3073] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:51:16.504196 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6a243a36-7894-4045-80bd-1749ee161f6c tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e85162b80>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:16.603020 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6a243a36-7894-4045-80bd-1749ee161f6c tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/2401103e-e83f-4a89-8a95-3958fca23039" status: 200 len: 1455 microversion: 2.1 time: 0.103771 Aug 04 16:51:16.606796 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1553/3074] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:16 2022] GET /compute/v2.1/images/2401103e-e83f-4a89-8a95-3958fca23039 => generated 1455 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:16.621123 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0e71b573-ba5b-4537-a9ef-69c7f72c4e9e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:16.622834 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0e71b573-ba5b-4537-a9ef-69c7f72c4e9e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:16.631351 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0e71b573-ba5b-4537-a9ef-69c7f72c4e9e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:16.631998 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0e71b573-ba5b-4537-a9ef-69c7f72c4e9e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:16.632924 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0e71b573-ba5b-4537-a9ef-69c7f72c4e9e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:16.633486 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0e71b573-ba5b-4537-a9ef-69c7f72c4e9e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:16.672958 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2549fd15-a589-4249-8283-f61a1e0d620b tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:16.686253 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2549fd15-a589-4249-8283-f61a1e0d620b tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d" status: 200 len: 1324 microversion: 2.1 time: 0.649720 Aug 04 16:51:16.687686 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1522/3075] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:16 2022] GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d => generated 1324 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:16.712660 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-985c666f-6a6b-4544-95fd-2d4b64638cd3 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-166000935", "metadata": {"image_type": "test"}}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:51:16.717262 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-985c666f-6a6b-4544-95fd-2d4b64638cd3 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] [instance: f91fdc58-3e45-4fc2-8bae-bda8292c908d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:16.736666 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-985c666f-6a6b-4544-95fd-2d4b64638cd3 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:16.737256 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-985c666f-6a6b-4544-95fd-2d4b64638cd3 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:16.738163 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-985c666f-6a6b-4544-95fd-2d4b64638cd3 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:16.738687 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-985c666f-6a6b-4544-95fd-2d4b64638cd3 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:16.815843 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-985c666f-6a6b-4544-95fd-2d4b64638cd3 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Getting quotas for project c96b36239054414182544ccfe7550cd9. Resources: dict_keys(['metadata_items']) {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:51:16.828158 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-985c666f-6a6b-4544-95fd-2d4b64638cd3 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Getting quotas for user eb4c0d6fac94470d9665f19021d50007 and project c96b36239054414182544ccfe7550cd9. Resources: dict_keys(['metadata_items']) {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:51:17.067924 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0e71b573-ba5b-4537-a9ef-69c7f72c4e9e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:17.079559 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0e71b573-ba5b-4537-a9ef-69c7f72c4e9e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:17.081518 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0e71b573-ba5b-4537-a9ef-69c7f72c4e9e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:17.082916 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0e71b573-ba5b-4537-a9ef-69c7f72c4e9e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1875 microversion: 2.42 time: 0.466073 Aug 04 16:51:17.093482 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1554/3076] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:51:16 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1875 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:51:17.093482 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b2b42232-0710-43b7-ab3c-16b0106d44bb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:51:17.093482 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b2b42232-0710-43b7-ab3c-16b0106d44bb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:17.096216 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2b42232-0710-43b7-ab3c-16b0106d44bb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:17.096672 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2b42232-0710-43b7-ab3c-16b0106d44bb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:17.097476 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2b42232-0710-43b7-ab3c-16b0106d44bb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:17.097910 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2b42232-0710-43b7-ab3c-16b0106d44bb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:17.125860 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-b2b42232-0710-43b7-ab3c-16b0106d44bb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lazy-loading 'flavor' on Instance uuid 0c62ae02-0f30-43e1-a005-89dcb8122d4e {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:51:17.144796 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-985c666f-6a6b-4544-95fd-2d4b64638cd3 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "POST /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d/action" status: 202 len: 0 microversion: 2.1 time: 0.442993 Aug 04 16:51:17.145565 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1523/3077] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:51:16 2022] POST /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d/action => generated 0 bytes in 445 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 16:51:17.158060 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8a885b4e-c1bb-4161-a45d-0f050b2236cf tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:17.159011 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8a885b4e-c1bb-4161-a45d-0f050b2236cf tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 5294cc65-8c7f-413f-8b13-c4e1d48567fe] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:17.166282 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a885b4e-c1bb-4161-a45d-0f050b2236cf tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:17.167360 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a885b4e-c1bb-4161-a45d-0f050b2236cf tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:17.168388 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a885b4e-c1bb-4161-a45d-0f050b2236cf tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:17.169057 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a885b4e-c1bb-4161-a45d-0f050b2236cf tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:17.229609 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b2b42232-0710-43b7-ab3c-16b0106d44bb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action" status: 202 len: 0 microversion: 2.1 time: 0.144274 Aug 04 16:51:17.234358 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1555/3078] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:51:17 2022] POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:51:17.252623 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e5502786-ddf0-4997-88b2-70f88911c483 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '.version_select at 0x7f7e844f0160>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:17.317088 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e5502786-ddf0-4997-88b2-70f88911c483 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/images/424dce4c-9c5b-4295-bdcb-b0322621a2a5" status: 200 len: 1423 microversion: 2.1 time: 0.078666 Aug 04 16:51:17.324883 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1556/3079] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:17 2022] GET /compute/v2.1/images/424dce4c-9c5b-4295-bdcb-b0322621a2a5 => generated 1423 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:17.324883 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-59356f70-6c24-4cdf-84cd-2065f3eb7bc2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:17.325267 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-59356f70-6c24-4cdf-84cd-2065f3eb7bc2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:17.335180 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-59356f70-6c24-4cdf-84cd-2065f3eb7bc2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:17.335776 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-59356f70-6c24-4cdf-84cd-2065f3eb7bc2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:17.336584 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-59356f70-6c24-4cdf-84cd-2065f3eb7bc2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:17.337142 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-59356f70-6c24-4cdf-84cd-2065f3eb7bc2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:17.882778 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8a885b4e-c1bb-4161-a45d-0f050b2236cf tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:17.893115 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8a885b4e-c1bb-4161-a45d-0f050b2236cf tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe" status: 200 len: 1498 microversion: 2.1 time: 0.740468 Aug 04 16:51:17.911117 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-59356f70-6c24-4cdf-84cd-2065f3eb7bc2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:17.911117 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-59356f70-6c24-4cdf-84cd-2065f3eb7bc2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1677 microversion: 2.1 time: 0.590126 Aug 04 16:51:17.914450 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1524/3080] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:17 2022] GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe => generated 1498 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:17.931583 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dd4f2ca9-e1b8-47cc-b266-27530fd59787 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e85173670>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:17.935604 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1557/3081] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:17 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1677 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:17.940320 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6706bf64-80d7-4903-b988-df2b79651854 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:17.941125 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6706bf64-80d7-4903-b988-df2b79651854 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 30109352-6d98-4d4c-8613-96cfd959e86d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:17.956694 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6706bf64-80d7-4903-b988-df2b79651854 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:17.957546 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6706bf64-80d7-4903-b988-df2b79651854 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:17.958962 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6706bf64-80d7-4903-b988-df2b79651854 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:17.959772 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6706bf64-80d7-4903-b988-df2b79651854 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:18.008758 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dd4f2ca9-e1b8-47cc-b266-27530fd59787 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/2401103e-e83f-4a89-8a95-3958fca23039" status: 200 len: 1464 microversion: 2.1 time: 0.085953 Aug 04 16:51:18.014143 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1525/3082] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:17 2022] GET /compute/v2.1/images/2401103e-e83f-4a89-8a95-3958fca23039 => generated 1464 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:18.028725 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ca3ab5a2-3cb7-4e69-ba02-f692efa41d1c tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e84be7940>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:18.111682 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ca3ab5a2-3cb7-4e69-ba02-f692efa41d1c tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/2401103e-e83f-4a89-8a95-3958fca23039" status: 200 len: 1464 microversion: 2.1 time: 0.087700 Aug 04 16:51:18.113023 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1526/3083] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:18 2022] GET /compute/v2.1/images/2401103e-e83f-4a89-8a95-3958fca23039 => generated 1464 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:51:18.125680 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9056d1a0-4463-4776-9620-706584dc28cc tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:18.126928 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9056d1a0-4463-4776-9620-706584dc28cc tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:18.140716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9056d1a0-4463-4776-9620-706584dc28cc tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:18.142854 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9056d1a0-4463-4776-9620-706584dc28cc tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:18.143927 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9056d1a0-4463-4776-9620-706584dc28cc tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:18.144650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9056d1a0-4463-4776-9620-706584dc28cc tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:18.392674 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6706bf64-80d7-4903-b988-df2b79651854 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:18.398377 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:51:18.414675 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6706bf64-80d7-4903-b988-df2b79651854 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d" status: 200 len: 1324 microversion: 2.1 time: 0.475323 Aug 04 16:51:18.415763 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1558/3084] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:17 2022] GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d => generated 1324 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:18.423762 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fe02ef9d-b071-4bb1-b75c-135fd8080269 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:18.424682 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fe02ef9d-b071-4bb1-b75c-135fd8080269 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] [instance: 800296f7-67da-4f41-aea4-e7e1af65e6c2] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:18.438587 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fe02ef9d-b071-4bb1-b75c-135fd8080269 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:18.439311 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fe02ef9d-b071-4bb1-b75c-135fd8080269 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:18.440293 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fe02ef9d-b071-4bb1-b75c-135fd8080269 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:18.440894 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fe02ef9d-b071-4bb1-b75c-135fd8080269 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:18.501219 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9056d1a0-4463-4776-9620-706584dc28cc tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:18.517306 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9056d1a0-4463-4776-9620-706584dc28cc tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:18.519497 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9056d1a0-4463-4776-9620-706584dc28cc tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:18.520692 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9056d1a0-4463-4776-9620-706584dc28cc tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1875 microversion: 2.42 time: 0.404391 Aug 04 16:51:18.521845 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1527/3085] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:51:18 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1875 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:51:18.527492 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7123591b-d19a-4fc0-b22b-a3b2e4bb3f18 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '.version_select at 0x7f7e8498ad30>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:18.587061 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7123591b-d19a-4fc0-b22b-a3b2e4bb3f18 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/images/424dce4c-9c5b-4295-bdcb-b0322621a2a5" status: 200 len: 1423 microversion: 2.1 time: 0.063931 Aug 04 16:51:18.587729 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1528/3086] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:18 2022] GET /compute/v2.1/images/424dce4c-9c5b-4295-bdcb-b0322621a2a5 => generated 1423 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:18.594401 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-3b8c15cf-734b-4cca-8696-cd09ed50de59 req-9a84d018-031d-4937-b83a-98d596cf6d89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e273267-ae4b-4a99-821e-1c02c3440610", "tag": "43dba39e-c390-493c-9f63-1beb4d7fbdf4"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:51:18.605077 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-3b8c15cf-734b-4cca-8696-cd09ed50de59 req-9a84d018-031d-4937-b83a-98d596cf6d89 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:18.605760 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-3b8c15cf-734b-4cca-8696-cd09ed50de59 req-9a84d018-031d-4937-b83a-98d596cf6d89 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:18.618421 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-3b8c15cf-734b-4cca-8696-cd09ed50de59 req-9a84d018-031d-4937-b83a-98d596cf6d89 service nova] Creating event network-changed:43dba39e-c390-493c-9f63-1beb4d7fbdf4 for instance 8e273267-ae4b-4a99-821e-1c02c3440610 on n-h1-846466-12 Aug 04 16:51:18.624278 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-3b8c15cf-734b-4cca-8696-cd09ed50de59 req-9a84d018-031d-4937-b83a-98d596cf6d89 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034575 Aug 04 16:51:18.625201 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1529/3087] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:51:18.805042 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fe02ef9d-b071-4bb1-b75c-135fd8080269 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad56451fe41482585833461124f0497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3731044d35c449289d1000d0628d06c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:18.830603 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fe02ef9d-b071-4bb1-b75c-135fd8080269 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2" status: 200 len: 1479 microversion: 2.1 time: 0.411314 Aug 04 16:51:18.831961 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1559/3088] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:18 2022] GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2 => generated 1479 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:18.930428 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1c74d839-142d-47f9-9c68-c21a894e511b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:18.932471 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2c91c1de-f4f0-4449-805a-c5c0d29baae0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:18.933303 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1c74d839-142d-47f9-9c68-c21a894e511b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 5294cc65-8c7f-413f-8b13-c4e1d48567fe] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:18.933442 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2c91c1de-f4f0-4449-805a-c5c0d29baae0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:18.947203 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2c91c1de-f4f0-4449-805a-c5c0d29baae0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:18.948210 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2c91c1de-f4f0-4449-805a-c5c0d29baae0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:18.950131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c74d839-142d-47f9-9c68-c21a894e511b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:18.950717 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c74d839-142d-47f9-9c68-c21a894e511b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:18.951102 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2c91c1de-f4f0-4449-805a-c5c0d29baae0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:18.951995 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c74d839-142d-47f9-9c68-c21a894e511b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:18.952321 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2c91c1de-f4f0-4449-805a-c5c0d29baae0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:18.953300 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c74d839-142d-47f9-9c68-c21a894e511b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:19.500328 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2c91c1de-f4f0-4449-805a-c5c0d29baae0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:19.510251 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2c91c1de-f4f0-4449-805a-c5c0d29baae0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1660 microversion: 2.1 time: 0.583148 Aug 04 16:51:19.511638 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1560/3089] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:18 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1660 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:19.517650 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3354abda-b34f-4f8a-8717-8ad05ca21b21 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:19.519238 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3354abda-b34f-4f8a-8717-8ad05ca21b21 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 30109352-6d98-4d4c-8613-96cfd959e86d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:19.532091 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3354abda-b34f-4f8a-8717-8ad05ca21b21 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:19.533236 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3354abda-b34f-4f8a-8717-8ad05ca21b21 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:19.534164 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3354abda-b34f-4f8a-8717-8ad05ca21b21 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:19.534670 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3354abda-b34f-4f8a-8717-8ad05ca21b21 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:19.550500 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1c74d839-142d-47f9-9c68-c21a894e511b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfb4739b53b411391a26de37b98469f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60281cf1dbe645d8949e93f9e70b5d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:19.563500 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1c74d839-142d-47f9-9c68-c21a894e511b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe" status: 200 len: 1498 microversion: 2.1 time: 0.648295 Aug 04 16:51:19.564361 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1530/3090] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:18 2022] GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe => generated 1498 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:19.570576 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-755671a6-dbd8-4828-8f61-14ec7d693b64 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:51:19.571397 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-755671a6-dbd8-4828-8f61-14ec7d693b64 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:19.580031 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-755671a6-dbd8-4828-8f61-14ec7d693b64 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:19.580483 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-755671a6-dbd8-4828-8f61-14ec7d693b64 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:19.581463 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-755671a6-dbd8-4828-8f61-14ec7d693b64 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:19.581891 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-755671a6-dbd8-4828-8f61-14ec7d693b64 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:19.626951 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:51:19.668879 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-755671a6-dbd8-4828-8f61-14ec7d693b64 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action" status: 202 len: 0 microversion: 2.1 time: 0.102896 Aug 04 16:51:19.673877 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1531/3091] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:51:19 2022] POST /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:51:19.680197 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c6bf6ea4-5b73-4240-8483-e3701ef8f0db tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:19.681172 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c6bf6ea4-5b73-4240-8483-e3701ef8f0db tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:19.689725 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c6bf6ea4-5b73-4240-8483-e3701ef8f0db tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:19.690428 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c6bf6ea4-5b73-4240-8483-e3701ef8f0db tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:19.691411 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c6bf6ea4-5b73-4240-8483-e3701ef8f0db tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:19.691992 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c6bf6ea4-5b73-4240-8483-e3701ef8f0db tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:20.121777 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3354abda-b34f-4f8a-8717-8ad05ca21b21 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:20.131241 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3354abda-b34f-4f8a-8717-8ad05ca21b21 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d" status: 200 len: 1324 microversion: 2.1 time: 0.618329 Aug 04 16:51:20.133046 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1561/3092] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:19 2022] GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d => generated 1324 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:20.140718 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8340e928-4afb-4993-bd3a-f0e2dc875181 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '.version_select at 0x7f7e89c59ee0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:20.207058 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8340e928-4afb-4993-bd3a-f0e2dc875181 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/images/424dce4c-9c5b-4295-bdcb-b0322621a2a5" status: 200 len: 1423 microversion: 2.1 time: 0.071942 Aug 04 16:51:20.207941 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1562/3093] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:20 2022] GET /compute/v2.1/images/424dce4c-9c5b-4295-bdcb-b0322621a2a5 => generated 1423 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:20.213498 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9e7e7a6a-4724-4523-b677-531f48ed8127 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:20.214335 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9e7e7a6a-4724-4523-b677-531f48ed8127 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:20.223265 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:51:20.225828 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9e7e7a6a-4724-4523-b677-531f48ed8127 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:20.226604 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9e7e7a6a-4724-4523-b677-531f48ed8127 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:20.227984 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9e7e7a6a-4724-4523-b677-531f48ed8127 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:20.228884 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9e7e7a6a-4724-4523-b677-531f48ed8127 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:20.455484 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c6bf6ea4-5b73-4240-8483-e3701ef8f0db tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:20.473759 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c6bf6ea4-5b73-4240-8483-e3701ef8f0db tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:20.477891 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c6bf6ea4-5b73-4240-8483-e3701ef8f0db tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:20.483957 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c6bf6ea4-5b73-4240-8483-e3701ef8f0db tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1875 microversion: 2.42 time: 0.806838 Aug 04 16:51:20.486699 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1532/3094] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:51:19 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1875 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:51:20.497026 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-61d597ca-dd66-4547-a2e4-9c0e6928ca19 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:20.500910 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-61d597ca-dd66-4547-a2e4-9c0e6928ca19 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] [instance: 800296f7-67da-4f41-aea4-e7e1af65e6c2] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:20.519386 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-61d597ca-dd66-4547-a2e4-9c0e6928ca19 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:20.520240 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-61d597ca-dd66-4547-a2e4-9c0e6928ca19 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:20.521335 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-61d597ca-dd66-4547-a2e4-9c0e6928ca19 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:20.522070 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-61d597ca-dd66-4547-a2e4-9c0e6928ca19 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:20.976924 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9e7e7a6a-4724-4523-b677-531f48ed8127 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:20.998476 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9e7e7a6a-4724-4523-b677-531f48ed8127 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1666 microversion: 2.1 time: 0.789117 Aug 04 16:51:20.999824 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1563/3095] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:20 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1666 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:21.004788 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-eb2f51ee-c018-4bf3-8674-7a74a42702d4 req-6bcc1cbb-14a0-4866-a4e0-80f905c19280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5294cc65-8c7f-413f-8b13-c4e1d48567fe", "name": "network-vif-deleted", "tag": "4417293d-153a-4971-97a2-6f2db8a13bb9"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:51:21.049650 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-eb2f51ee-c018-4bf3-8674-7a74a42702d4 req-6bcc1cbb-14a0-4866-a4e0-80f905c19280 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:21.050343 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-eb2f51ee-c018-4bf3-8674-7a74a42702d4 req-6bcc1cbb-14a0-4866-a4e0-80f905c19280 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:21.067834 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-eb2f51ee-c018-4bf3-8674-7a74a42702d4 req-6bcc1cbb-14a0-4866-a4e0-80f905c19280 service nova] Creating event network-vif-deleted:4417293d-153a-4971-97a2-6f2db8a13bb9 for instance 5294cc65-8c7f-413f-8b13-c4e1d48567fe on n-h2-846466-12 Aug 04 16:51:21.074093 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-eb2f51ee-c018-4bf3-8674-7a74a42702d4 req-6bcc1cbb-14a0-4866-a4e0-80f905c19280 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072847 Aug 04 16:51:21.075005 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1564/3096] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:51:21.081255 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-93bf4466-9123-46ce-855b-da91394bcd80 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:21.082186 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-93bf4466-9123-46ce-855b-da91394bcd80 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 5294cc65-8c7f-413f-8b13-c4e1d48567fe] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:21.090326 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-93bf4466-9123-46ce-855b-da91394bcd80 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:21.091038 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-93bf4466-9123-46ce-855b-da91394bcd80 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:21.092036 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-93bf4466-9123-46ce-855b-da91394bcd80 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:21.093359 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-93bf4466-9123-46ce-855b-da91394bcd80 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:21.110323 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-93bf4466-9123-46ce-855b-da91394bcd80 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] HTTP exception thrown: Instance 5294cc65-8c7f-413f-8b13-c4e1d48567fe could not be found. Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-93bf4466-9123-46ce-855b-da91394bcd80 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Request method failure captured: Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe HTTP/1.1 Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_ddGi-LUxEkOI7UNq-ijU5XnirMgjjOPky_n4iIeohsp_mBZi36CDxRY5dUKGmgKLroDx6IsvA3hey_uA7LPQbZI4NWhaCZQIOIkAKlIttRUGlU4y_AMkv45dQEQsQ8xd9VhN5XbmaVn_f0gvdFbALtWn0QI5OJtAeQ50IP8tuO8i0 Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/60281cf1dbe645d8949e93f9e70b5d91"}]}] Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 3cfb4739b53b411391a26de37b98469f Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 5294cc65-8c7f-413f-8b13-c4e1d48567fe could not be found. Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '5294cc65-8c7f-413f-8b13-c4e1d48567fe'} Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5294cc65-8c7f-413f-8b13-c4e1d48567fe could not be found. Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5294cc65-8c7f-413f-8b13-c4e1d48567fe could not be found. Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:21.112995 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:21.118968 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:21.118968 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:21.118968 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:21.118968 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:51:21.118968 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:51:21.118968 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5294cc65-8c7f-413f-8b13-c4e1d48567fe could not be found. Aug 04 16:51:21.118968 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:21.120517 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-93bf4466-9123-46ce-855b-da91394bcd80 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Returning 404 to user: Instance 5294cc65-8c7f-413f-8b13-c4e1d48567fe could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:51:21.121814 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-93bf4466-9123-46ce-855b-da91394bcd80 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe" status: 404 len: 111 microversion: 2.1 time: 0.045502 Aug 04 16:51:21.122756 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1565/3097] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:21 2022] GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:51:21.130783 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-e0b51dc9-b343-41b1-a0d7-c6d5f94bb0d2 req-3c1aba6b-37a5-48ac-aa23-6da06484110d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e273267-ae4b-4a99-821e-1c02c3440610", "tag": "1d3e9f84-9473-48e1-a53e-66949e923559"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:51:21.146711 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-e0b51dc9-b343-41b1-a0d7-c6d5f94bb0d2 req-3c1aba6b-37a5-48ac-aa23-6da06484110d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:21.149150 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-e0b51dc9-b343-41b1-a0d7-c6d5f94bb0d2 req-3c1aba6b-37a5-48ac-aa23-6da06484110d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:21.166001 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-61d597ca-dd66-4547-a2e4-9c0e6928ca19 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad56451fe41482585833461124f0497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3731044d35c449289d1000d0628d06c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:21.173509 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-e0b51dc9-b343-41b1-a0d7-c6d5f94bb0d2 req-3c1aba6b-37a5-48ac-aa23-6da06484110d service nova] Creating event network-changed:1d3e9f84-9473-48e1-a53e-66949e923559 for instance 8e273267-ae4b-4a99-821e-1c02c3440610 on n-h1-846466-12 Aug 04 16:51:21.179728 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-e0b51dc9-b343-41b1-a0d7-c6d5f94bb0d2 req-3c1aba6b-37a5-48ac-aa23-6da06484110d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055309 Aug 04 16:51:21.180625 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1566/3098] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:51:21.184182 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-61d597ca-dd66-4547-a2e4-9c0e6928ca19 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2" status: 200 len: 1466 microversion: 2.1 time: 0.696137 Aug 04 16:51:21.193448 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-85e700b1-d419-4908-995d-c57dbc0b4a8c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:21.198950 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-85e700b1-d419-4908-995d-c57dbc0b4a8c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 5294cc65-8c7f-413f-8b13-c4e1d48567fe] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:21.202926 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1533/3099] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:20 2022] GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2 => generated 1466 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:21.216183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-85e700b1-d419-4908-995d-c57dbc0b4a8c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:21.218045 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6cc471ce-643e-408e-b2fc-a7a727973348 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:21.218749 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6cc471ce-643e-408e-b2fc-a7a727973348 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 30109352-6d98-4d4c-8613-96cfd959e86d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:21.220028 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-85e700b1-d419-4908-995d-c57dbc0b4a8c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:21.221082 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-85e700b1-d419-4908-995d-c57dbc0b4a8c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:21.221740 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-85e700b1-d419-4908-995d-c57dbc0b4a8c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:21.239171 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-85e700b1-d419-4908-995d-c57dbc0b4a8c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] HTTP exception thrown: Instance 5294cc65-8c7f-413f-8b13-c4e1d48567fe could not be found. Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-85e700b1-d419-4908-995d-c57dbc0b4a8c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Request method failure captured: Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe HTTP/1.1 Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_ddGi-LUxEkOI7UNq-ijU5XnirMgjjOPky_n4iIeohsp_mBZi36CDxRY5dUKGmgKLroDx6IsvA3hey_uA7LPQbZI4NWhaCZQIOIkAKlIttRUGlU4y_AMkv45dQEQsQ8xd9VhN5XbmaVn_f0gvdFbALtWn0QI5OJtAeQ50IP8tuO8i0 Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/60281cf1dbe645d8949e93f9e70b5d91"}]}] Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 3cfb4739b53b411391a26de37b98469f Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 5294cc65-8c7f-413f-8b13-c4e1d48567fe could not be found. Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '5294cc65-8c7f-413f-8b13-c4e1d48567fe'} Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5294cc65-8c7f-413f-8b13-c4e1d48567fe could not be found. Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:51:21.242141 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:51:21.246982 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5294cc65-8c7f-413f-8b13-c4e1d48567fe could not be found. Aug 04 16:51:21.246982 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:21.246982 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:21.246982 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:21.246982 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:21.246982 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:21.246982 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:21.246982 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:51:21.246982 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:51:21.246982 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5294cc65-8c7f-413f-8b13-c4e1d48567fe could not be found. Aug 04 16:51:21.246982 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:21.248931 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-85e700b1-d419-4908-995d-c57dbc0b4a8c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Returning 404 to user: Instance 5294cc65-8c7f-413f-8b13-c4e1d48567fe could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:51:21.250061 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-85e700b1-d419-4908-995d-c57dbc0b4a8c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe" status: 404 len: 111 microversion: 2.1 time: 0.067983 Aug 04 16:51:21.251181 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1567/3100] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:51:21 2022] DELETE /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:51:21.255727 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6cc471ce-643e-408e-b2fc-a7a727973348 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:21.256178 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6cc471ce-643e-408e-b2fc-a7a727973348 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:21.256968 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6cc471ce-643e-408e-b2fc-a7a727973348 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:21.257430 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6cc471ce-643e-408e-b2fc-a7a727973348 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:21.258097 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4da015b6-8467-4af8-bfcb-d59ca1c34b21 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-465207319"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:51:21.261831 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4da015b6-8467-4af8-bfcb-d59ca1c34b21 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] [instance: 9139a17d-927c-4595-a7ff-11a1fa3a6a69] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:21.269365 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4da015b6-8467-4af8-bfcb-d59ca1c34b21 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:21.270018 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4da015b6-8467-4af8-bfcb-d59ca1c34b21 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:21.270985 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4da015b6-8467-4af8-bfcb-d59ca1c34b21 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:21.271573 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4da015b6-8467-4af8-bfcb-d59ca1c34b21 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:21.528572 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4da015b6-8467-4af8-bfcb-d59ca1c34b21 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "POST /compute/v2.1/servers/9139a17d-927c-4595-a7ff-11a1fa3a6a69/action" status: 202 len: 0 microversion: 2.1 time: 0.274501 Aug 04 16:51:21.529934 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1568/3101] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:51:21 2022] POST /compute/v2.1/servers/9139a17d-927c-4595-a7ff-11a1fa3a6a69/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 16:51:21.536759 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f84033ab-5e42-4423-8672-86915d3b8fee tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '.version_select at 0x7f7e841ba940>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:21.593930 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f84033ab-5e42-4423-8672-86915d3b8fee tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/images/424dce4c-9c5b-4295-bdcb-b0322621a2a5" status: 200 len: 1423 microversion: 2.1 time: 0.062357 Aug 04 16:51:21.603062 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1569/3102] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:21 2022] GET /compute/v2.1/images/424dce4c-9c5b-4295-bdcb-b0322621a2a5 => generated 1423 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:21.608657 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f19a5191-89f6-4f45-8b6c-0acf79050e9e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:21.609711 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f19a5191-89f6-4f45-8b6c-0acf79050e9e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 5294cc65-8c7f-413f-8b13-c4e1d48567fe] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:21.618372 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f19a5191-89f6-4f45-8b6c-0acf79050e9e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:21.619246 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f19a5191-89f6-4f45-8b6c-0acf79050e9e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:21.620280 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f19a5191-89f6-4f45-8b6c-0acf79050e9e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:21.620871 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f19a5191-89f6-4f45-8b6c-0acf79050e9e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:21.637375 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-f19a5191-89f6-4f45-8b6c-0acf79050e9e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] HTTP exception thrown: Instance 5294cc65-8c7f-413f-8b13-c4e1d48567fe could not be found. Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f19a5191-89f6-4f45-8b6c-0acf79050e9e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Request method failure captured: Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe HTTP/1.1 Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_ddGi-LUxEkOI7UNq-ijU5XnirMgjjOPky_n4iIeohsp_mBZi36CDxRY5dUKGmgKLroDx6IsvA3hey_uA7LPQbZI4NWhaCZQIOIkAKlIttRUGlU4y_AMkv45dQEQsQ8xd9VhN5XbmaVn_f0gvdFbALtWn0QI5OJtAeQ50IP8tuO8i0 Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/60281cf1dbe645d8949e93f9e70b5d91"}]}] Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 3cfb4739b53b411391a26de37b98469f Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 5294cc65-8c7f-413f-8b13-c4e1d48567fe could not be found. Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '5294cc65-8c7f-413f-8b13-c4e1d48567fe'} Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5294cc65-8c7f-413f-8b13-c4e1d48567fe could not be found. Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5294cc65-8c7f-413f-8b13-c4e1d48567fe could not be found. Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:21.639470 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:21.645010 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:21.645010 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:21.645010 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:21.645010 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:51:21.645010 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:51:21.645010 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5294cc65-8c7f-413f-8b13-c4e1d48567fe could not be found. Aug 04 16:51:21.645010 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:21.647201 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f19a5191-89f6-4f45-8b6c-0acf79050e9e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Returning 404 to user: Instance 5294cc65-8c7f-413f-8b13-c4e1d48567fe could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:51:21.648327 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f19a5191-89f6-4f45-8b6c-0acf79050e9e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe" status: 404 len: 111 microversion: 2.1 time: 0.043887 Aug 04 16:51:21.649636 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1570/3103] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:21 2022] GET /compute/v2.1/servers/5294cc65-8c7f-413f-8b13-c4e1d48567fe => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:51:21.655963 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-980b0ead-f33d-4e00-800e-598e3d28c107 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:21.657585 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-980b0ead-f33d-4e00-800e-598e3d28c107 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:21.666248 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-980b0ead-f33d-4e00-800e-598e3d28c107 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:21.670273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-980b0ead-f33d-4e00-800e-598e3d28c107 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:21.671696 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-980b0ead-f33d-4e00-800e-598e3d28c107 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:21.672441 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-980b0ead-f33d-4e00-800e-598e3d28c107 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:22.836982 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6cc471ce-643e-408e-b2fc-a7a727973348 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:22.850489 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6cc471ce-643e-408e-b2fc-a7a727973348 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d" status: 200 len: 1324 microversion: 2.1 time: 1.645166 Aug 04 16:51:22.854144 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1534/3104] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:21 2022] GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d => generated 1324 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:22.861609 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b676604b-ccaf-41e3-b4de-41415efb4288 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e84a350d0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:22.967940 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b676604b-ccaf-41e3-b4de-41415efb4288 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/cc4c2019-5133-489d-8cd9-14d922790c64" status: 200 len: 1454 microversion: 2.1 time: 0.112603 Aug 04 16:51:22.968554 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1535/3105] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:22 2022] GET /compute/v2.1/images/cc4c2019-5133-489d-8cd9-14d922790c64 => generated 1454 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:22.987763 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e5a261e2-3112-43a0-a7d3-b12c65589c0f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:22.988371 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e5a261e2-3112-43a0-a7d3-b12c65589c0f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea8f8711-8caf-4779-9178-ca984246258c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:23.004961 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5a261e2-3112-43a0-a7d3-b12c65589c0f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:23.005431 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5a261e2-3112-43a0-a7d3-b12c65589c0f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:23.006204 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5a261e2-3112-43a0-a7d3-b12c65589c0f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:23.006633 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5a261e2-3112-43a0-a7d3-b12c65589c0f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:23.034975 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-e5a261e2-3112-43a0-a7d3-b12c65589c0f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] HTTP exception thrown: Instance ea8f8711-8caf-4779-9178-ca984246258c could not be found. Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e5a261e2-3112-43a0-a7d3-b12c65589c0f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Request method failure captured: Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c HTTP/1.1 Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_ddGi-LUxEkOI7UNq-ijU5XnirMgjjOPky_n4iIeohsp_mBZi36CDxRY5dUKGmgKLroDx6IsvA3hey_uA7LPQbZI4NWhaCZQIOIkAKlIttRUGlU4y_AMkv45dQEQsQ8xd9VhN5XbmaVn_f0gvdFbALtWn0QI5OJtAeQ50IP8tuO8i0 Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/60281cf1dbe645d8949e93f9e70b5d91"}]}] Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 3cfb4739b53b411391a26de37b98469f Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance ea8f8711-8caf-4779-9178-ca984246258c could not be found. Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'ea8f8711-8caf-4779-9178-ca984246258c'} Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea8f8711-8caf-4779-9178-ca984246258c could not be found. Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:51:23.036633 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:51:23.040639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea8f8711-8caf-4779-9178-ca984246258c could not be found. Aug 04 16:51:23.040639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.040639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:23.040639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.040639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:23.040639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:23.040639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:23.040639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:51:23.040639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:51:23.040639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea8f8711-8caf-4779-9178-ca984246258c could not be found. Aug 04 16:51:23.040639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.040639 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e5a261e2-3112-43a0-a7d3-b12c65589c0f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Returning 404 to user: Instance ea8f8711-8caf-4779-9178-ca984246258c could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:51:23.054523 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e5a261e2-3112-43a0-a7d3-b12c65589c0f tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c" status: 404 len: 111 microversion: 2.1 time: 0.071826 Aug 04 16:51:23.055128 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1536/3106] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:51:22 2022] DELETE /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:51:23.064056 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a6843cf9-0eeb-4df5-8e69-3678b153ddbc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:23.064680 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a6843cf9-0eeb-4df5-8e69-3678b153ddbc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:23.075609 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6843cf9-0eeb-4df5-8e69-3678b153ddbc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:23.075609 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6843cf9-0eeb-4df5-8e69-3678b153ddbc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:23.076459 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6843cf9-0eeb-4df5-8e69-3678b153ddbc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:23.076900 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6843cf9-0eeb-4df5-8e69-3678b153ddbc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:23.233535 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-980b0ead-f33d-4e00-800e-598e3d28c107 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:23.252371 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-980b0ead-f33d-4e00-800e-598e3d28c107 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:23.255161 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-980b0ead-f33d-4e00-800e-598e3d28c107 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:23.256947 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-980b0ead-f33d-4e00-800e-598e3d28c107 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1875 microversion: 2.42 time: 1.605795 Aug 04 16:51:23.257914 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1571/3107] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:51:21 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1875 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:51:23.277521 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-94d8ac82-f25b-4294-a9d0-450d3f8a6976 req-9314387a-a9ce-4041-be16-b06f12013123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800296f7-67da-4f41-aea4-e7e1af65e6c2", "name": "network-vif-unplugged", "status": "completed", "tag": "edcd52e8-c9af-4fd4-9b1a-35c30ea3ae67"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:51:23.299626 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-94d8ac82-f25b-4294-a9d0-450d3f8a6976 req-9314387a-a9ce-4041-be16-b06f12013123 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:23.300573 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-94d8ac82-f25b-4294-a9d0-450d3f8a6976 req-9314387a-a9ce-4041-be16-b06f12013123 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:23.324674 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-94d8ac82-f25b-4294-a9d0-450d3f8a6976 req-9314387a-a9ce-4041-be16-b06f12013123 service nova] Creating event network-vif-unplugged:edcd52e8-c9af-4fd4-9b1a-35c30ea3ae67 for instance 800296f7-67da-4f41-aea4-e7e1af65e6c2 on n-h2-846466-12 Aug 04 16:51:23.333679 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-94d8ac82-f25b-4294-a9d0-450d3f8a6976 req-9314387a-a9ce-4041-be16-b06f12013123 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072958 Aug 04 16:51:23.338322 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1572/3108] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:51:23.344510 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-764a29f9-5281-40ef-aefc-6b7630fcc5b7 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '.version_select at 0x7f7e841c93a0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:23.422976 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-764a29f9-5281-40ef-aefc-6b7630fcc5b7 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/images/424dce4c-9c5b-4295-bdcb-b0322621a2a5" status: 200 len: 1423 microversion: 2.1 time: 0.082504 Aug 04 16:51:23.423767 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1573/3109] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:23 2022] GET /compute/v2.1/images/424dce4c-9c5b-4295-bdcb-b0322621a2a5 => generated 1423 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:23.429066 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-39b2da17-a4da-4428-adba-76964f0e02c0 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:23.435273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-39b2da17-a4da-4428-adba-76964f0e02c0 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea8f8711-8caf-4779-9178-ca984246258c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:23.458573 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-39b2da17-a4da-4428-adba-76964f0e02c0 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:23.459521 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-39b2da17-a4da-4428-adba-76964f0e02c0 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:23.460552 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-39b2da17-a4da-4428-adba-76964f0e02c0 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:23.461203 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-39b2da17-a4da-4428-adba-76964f0e02c0 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:23.499227 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-39b2da17-a4da-4428-adba-76964f0e02c0 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] HTTP exception thrown: Instance ea8f8711-8caf-4779-9178-ca984246258c could not be found. Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-39b2da17-a4da-4428-adba-76964f0e02c0 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Request method failure captured: Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c HTTP/1.1 Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_ddGi-LUxEkOI7UNq-ijU5XnirMgjjOPky_n4iIeohsp_mBZi36CDxRY5dUKGmgKLroDx6IsvA3hey_uA7LPQbZI4NWhaCZQIOIkAKlIttRUGlU4y_AMkv45dQEQsQ8xd9VhN5XbmaVn_f0gvdFbALtWn0QI5OJtAeQ50IP8tuO8i0 Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/60281cf1dbe645d8949e93f9e70b5d91"}]}] Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 3cfb4739b53b411391a26de37b98469f Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance ea8f8711-8caf-4779-9178-ca984246258c could not be found. Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'ea8f8711-8caf-4779-9178-ca984246258c'} Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea8f8711-8caf-4779-9178-ca984246258c could not be found. Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea8f8711-8caf-4779-9178-ca984246258c could not be found. Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:23.501341 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.505330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:23.505330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:23.505330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:23.505330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:51:23.505330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:51:23.505330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea8f8711-8caf-4779-9178-ca984246258c could not be found. Aug 04 16:51:23.505330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.509056 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-39b2da17-a4da-4428-adba-76964f0e02c0 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Returning 404 to user: Instance ea8f8711-8caf-4779-9178-ca984246258c could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:51:23.510738 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-39b2da17-a4da-4428-adba-76964f0e02c0 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c" status: 404 len: 111 microversion: 2.1 time: 0.085837 Aug 04 16:51:23.515544 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1574/3110] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:23 2022] GET /compute/v2.1/servers/ea8f8711-8caf-4779-9178-ca984246258c => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:51:23.520902 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-7cad8d07-026c-4197-bfa6-dc822fb81b71 req-ec1948e5-c0ee-493c-995a-4b80977bf377 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e273267-ae4b-4a99-821e-1c02c3440610", "tag": "1155cb3d-57af-4e24-82ea-543e08adca46"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:51:23.531576 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7cad8d07-026c-4197-bfa6-dc822fb81b71 req-ec1948e5-c0ee-493c-995a-4b80977bf377 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:23.532536 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7cad8d07-026c-4197-bfa6-dc822fb81b71 req-ec1948e5-c0ee-493c-995a-4b80977bf377 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:23.545836 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-7cad8d07-026c-4197-bfa6-dc822fb81b71 req-ec1948e5-c0ee-493c-995a-4b80977bf377 service nova] Creating event network-changed:1155cb3d-57af-4e24-82ea-543e08adca46 for instance 8e273267-ae4b-4a99-821e-1c02c3440610 on n-h1-846466-12 Aug 04 16:51:23.556841 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-7cad8d07-026c-4197-bfa6-dc822fb81b71 req-ec1948e5-c0ee-493c-995a-4b80977bf377 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039124 Aug 04 16:51:23.559136 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1575/3111] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:51:23.575556 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b2836174-380b-4e4e-8722-62465eb1c59b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:23.580862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b2836174-380b-4e4e-8722-62465eb1c59b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:23.592714 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2836174-380b-4e4e-8722-62465eb1c59b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:23.593661 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2836174-380b-4e4e-8722-62465eb1c59b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:23.594746 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2836174-380b-4e4e-8722-62465eb1c59b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:23.595602 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2836174-380b-4e4e-8722-62465eb1c59b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:23.616832 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-b2836174-380b-4e4e-8722-62465eb1c59b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] HTTP exception thrown: Instance 73dff433-5880-43ec-b799-1230245db7f7 could not be found. Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b2836174-380b-4e4e-8722-62465eb1c59b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Request method failure captured: Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 HTTP/1.1 Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_ddGi-LUxEkOI7UNq-ijU5XnirMgjjOPky_n4iIeohsp_mBZi36CDxRY5dUKGmgKLroDx6IsvA3hey_uA7LPQbZI4NWhaCZQIOIkAKlIttRUGlU4y_AMkv45dQEQsQ8xd9VhN5XbmaVn_f0gvdFbALtWn0QI5OJtAeQ50IP8tuO8i0 Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/60281cf1dbe645d8949e93f9e70b5d91"}]}] Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 3cfb4739b53b411391a26de37b98469f Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 73dff433-5880-43ec-b799-1230245db7f7 could not be found. Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '73dff433-5880-43ec-b799-1230245db7f7'} Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73dff433-5880-43ec-b799-1230245db7f7 could not be found. Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:51:23.619092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:51:23.624539 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73dff433-5880-43ec-b799-1230245db7f7 could not be found. Aug 04 16:51:23.624539 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.624539 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:23.624539 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.624539 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:23.624539 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:23.624539 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:23.624539 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:51:23.624539 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:51:23.624539 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73dff433-5880-43ec-b799-1230245db7f7 could not be found. Aug 04 16:51:23.624539 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.628697 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b2836174-380b-4e4e-8722-62465eb1c59b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Returning 404 to user: Instance 73dff433-5880-43ec-b799-1230245db7f7 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:51:23.629828 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b2836174-380b-4e4e-8722-62465eb1c59b tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "DELETE /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 404 len: 111 microversion: 2.1 time: 0.068171 Aug 04 16:51:23.631093 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1576/3112] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:51:23 2022] DELETE /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:51:23.642296 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7ad5bf9f-c27e-4253-bcaf-bb40c572571e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:23.643931 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7ad5bf9f-c27e-4253-bcaf-bb40c572571e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 73dff433-5880-43ec-b799-1230245db7f7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:23.651628 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ad5bf9f-c27e-4253-bcaf-bb40c572571e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:23.652822 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ad5bf9f-c27e-4253-bcaf-bb40c572571e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:23.655287 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ad5bf9f-c27e-4253-bcaf-bb40c572571e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:23.657212 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ad5bf9f-c27e-4253-bcaf-bb40c572571e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:23.679101 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-7ad5bf9f-c27e-4253-bcaf-bb40c572571e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] HTTP exception thrown: Instance 73dff433-5880-43ec-b799-1230245db7f7 could not be found. Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7ad5bf9f-c27e-4253-bcaf-bb40c572571e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Request method failure captured: Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 HTTP/1.1 Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_ddGi-LUxEkOI7UNq-ijU5XnirMgjjOPky_n4iIeohsp_mBZi36CDxRY5dUKGmgKLroDx6IsvA3hey_uA7LPQbZI4NWhaCZQIOIkAKlIttRUGlU4y_AMkv45dQEQsQ8xd9VhN5XbmaVn_f0gvdFbALtWn0QI5OJtAeQ50IP8tuO8i0 Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/60281cf1dbe645d8949e93f9e70b5d91"}]}] Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 3cfb4739b53b411391a26de37b98469f Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 73dff433-5880-43ec-b799-1230245db7f7 could not be found. Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '73dff433-5880-43ec-b799-1230245db7f7'} Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73dff433-5880-43ec-b799-1230245db7f7 could not be found. Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73dff433-5880-43ec-b799-1230245db7f7 could not be found. Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:23.681308 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.685552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:23.685552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:23.685552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:23.685552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:51:23.685552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:51:23.685552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73dff433-5880-43ec-b799-1230245db7f7 could not be found. Aug 04 16:51:23.685552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.689141 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7ad5bf9f-c27e-4253-bcaf-bb40c572571e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Returning 404 to user: Instance 73dff433-5880-43ec-b799-1230245db7f7 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:51:23.691114 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7ad5bf9f-c27e-4253-bcaf-bb40c572571e tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7" status: 404 len: 111 microversion: 2.1 time: 0.052552 Aug 04 16:51:23.692432 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1577/3113] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:23 2022] GET /compute/v2.1/servers/73dff433-5880-43ec-b799-1230245db7f7 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:51:23.706852 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0288df04-58f7-4d1f-b235-a02c1a6f088a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:23.707473 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0288df04-58f7-4d1f-b235-a02c1a6f088a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea0f2c5d-c250-4617-9edd-03a8a74d1e2a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:23.711064 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a6843cf9-0eeb-4df5-8e69-3678b153ddbc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:23.716778 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0288df04-58f7-4d1f-b235-a02c1a6f088a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:23.717469 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0288df04-58f7-4d1f-b235-a02c1a6f088a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:23.718912 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0288df04-58f7-4d1f-b235-a02c1a6f088a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:23.719838 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0288df04-58f7-4d1f-b235-a02c1a6f088a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:23.742652 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a6843cf9-0eeb-4df5-8e69-3678b153ddbc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1666 microversion: 2.1 time: 0.682438 Aug 04 16:51:23.743968 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1537/3114] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:23 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1666 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:23.747398 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-0288df04-58f7-4d1f-b235-a02c1a6f088a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] HTTP exception thrown: Instance ea0f2c5d-c250-4617-9edd-03a8a74d1e2a could not be found. Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0288df04-58f7-4d1f-b235-a02c1a6f088a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Request method failure captured: Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a HTTP/1.1 Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_ddGi-LUxEkOI7UNq-ijU5XnirMgjjOPky_n4iIeohsp_mBZi36CDxRY5dUKGmgKLroDx6IsvA3hey_uA7LPQbZI4NWhaCZQIOIkAKlIttRUGlU4y_AMkv45dQEQsQ8xd9VhN5XbmaVn_f0gvdFbALtWn0QI5OJtAeQ50IP8tuO8i0 Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/60281cf1dbe645d8949e93f9e70b5d91"}]}] Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 3cfb4739b53b411391a26de37b98469f Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance ea0f2c5d-c250-4617-9edd-03a8a74d1e2a could not be found. Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'ea0f2c5d-c250-4617-9edd-03a8a74d1e2a'} Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea0f2c5d-c250-4617-9edd-03a8a74d1e2a could not be found. Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:51:23.751612 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:51:23.755964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea0f2c5d-c250-4617-9edd-03a8a74d1e2a could not be found. Aug 04 16:51:23.755964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.755964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:23.755964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.755964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:23.755964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:23.755964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:23.755964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:51:23.755964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:51:23.755964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea0f2c5d-c250-4617-9edd-03a8a74d1e2a could not be found. Aug 04 16:51:23.755964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.758262 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0288df04-58f7-4d1f-b235-a02c1a6f088a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Returning 404 to user: Instance ea0f2c5d-c250-4617-9edd-03a8a74d1e2a could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:51:23.759484 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0288df04-58f7-4d1f-b235-a02c1a6f088a tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a" status: 404 len: 111 microversion: 2.1 time: 0.062104 Aug 04 16:51:23.765147 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1578/3115] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:51:23 2022] DELETE /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:51:23.770570 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b113e8dd-3516-4117-8941-b0b45422476c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:23.771188 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b113e8dd-3516-4117-8941-b0b45422476c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: ea0f2c5d-c250-4617-9edd-03a8a74d1e2a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:23.788133 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b113e8dd-3516-4117-8941-b0b45422476c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:23.788557 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b113e8dd-3516-4117-8941-b0b45422476c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:23.794095 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b113e8dd-3516-4117-8941-b0b45422476c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:23.794774 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b113e8dd-3516-4117-8941-b0b45422476c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:23.823421 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-b113e8dd-3516-4117-8941-b0b45422476c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] HTTP exception thrown: Instance ea0f2c5d-c250-4617-9edd-03a8a74d1e2a could not be found. Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b113e8dd-3516-4117-8941-b0b45422476c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Request method failure captured: Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a HTTP/1.1 Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_ddGi-LUxEkOI7UNq-ijU5XnirMgjjOPky_n4iIeohsp_mBZi36CDxRY5dUKGmgKLroDx6IsvA3hey_uA7LPQbZI4NWhaCZQIOIkAKlIttRUGlU4y_AMkv45dQEQsQ8xd9VhN5XbmaVn_f0gvdFbALtWn0QI5OJtAeQ50IP8tuO8i0 Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/60281cf1dbe645d8949e93f9e70b5d91"}]}] Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 3cfb4739b53b411391a26de37b98469f Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance ea0f2c5d-c250-4617-9edd-03a8a74d1e2a could not be found. Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'ea0f2c5d-c250-4617-9edd-03a8a74d1e2a'} Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea0f2c5d-c250-4617-9edd-03a8a74d1e2a could not be found. Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea0f2c5d-c250-4617-9edd-03a8a74d1e2a could not be found. Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:23.831587 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.836794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:23.836794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:23.836794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:23.836794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:51:23.836794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:51:23.836794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea0f2c5d-c250-4617-9edd-03a8a74d1e2a could not be found. Aug 04 16:51:23.836794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.839101 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b113e8dd-3516-4117-8941-b0b45422476c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Returning 404 to user: Instance ea0f2c5d-c250-4617-9edd-03a8a74d1e2a could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:51:23.840154 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b113e8dd-3516-4117-8941-b0b45422476c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a" status: 404 len: 111 microversion: 2.1 time: 0.074732 Aug 04 16:51:23.842274 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1538/3116] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:23 2022] GET /compute/v2.1/servers/ea0f2c5d-c250-4617-9edd-03a8a74d1e2a => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:51:23.853485 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-953bd1cc-8baa-433c-af32-d5eab795ba99 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:23.854109 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-953bd1cc-8baa-433c-af32-d5eab795ba99 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: d6141949-1d15-4c84-8638-426cf7244dbd] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:23.871201 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-953bd1cc-8baa-433c-af32-d5eab795ba99 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:23.872057 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-953bd1cc-8baa-433c-af32-d5eab795ba99 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:23.873222 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-953bd1cc-8baa-433c-af32-d5eab795ba99 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:23.873434 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e774e306-045f-4fc5-9e68-774f7191042e tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:23.873682 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-953bd1cc-8baa-433c-af32-d5eab795ba99 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:23.874425 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e774e306-045f-4fc5-9e68-774f7191042e tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 30109352-6d98-4d4c-8613-96cfd959e86d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:23.883993 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e774e306-045f-4fc5-9e68-774f7191042e tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:23.885936 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e774e306-045f-4fc5-9e68-774f7191042e tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:23.887370 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e774e306-045f-4fc5-9e68-774f7191042e tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:23.889192 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e774e306-045f-4fc5-9e68-774f7191042e tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:23.910042 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-953bd1cc-8baa-433c-af32-d5eab795ba99 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] HTTP exception thrown: Instance d6141949-1d15-4c84-8638-426cf7244dbd could not be found. Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-953bd1cc-8baa-433c-af32-d5eab795ba99 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Request method failure captured: Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd HTTP/1.1 Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_ddGi-LUxEkOI7UNq-ijU5XnirMgjjOPky_n4iIeohsp_mBZi36CDxRY5dUKGmgKLroDx6IsvA3hey_uA7LPQbZI4NWhaCZQIOIkAKlIttRUGlU4y_AMkv45dQEQsQ8xd9VhN5XbmaVn_f0gvdFbALtWn0QI5OJtAeQ50IP8tuO8i0 Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/60281cf1dbe645d8949e93f9e70b5d91"}]}] Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 3cfb4739b53b411391a26de37b98469f Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance d6141949-1d15-4c84-8638-426cf7244dbd could not be found. Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'd6141949-1d15-4c84-8638-426cf7244dbd'} Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6141949-1d15-4c84-8638-426cf7244dbd could not be found. Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:51:23.918046 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:51:23.924951 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6141949-1d15-4c84-8638-426cf7244dbd could not be found. Aug 04 16:51:23.924951 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.924951 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:23.924951 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.924951 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:23.924951 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:23.924951 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:23.924951 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:51:23.924951 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:51:23.924951 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6141949-1d15-4c84-8638-426cf7244dbd could not be found. Aug 04 16:51:23.924951 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.944742 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-953bd1cc-8baa-433c-af32-d5eab795ba99 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Returning 404 to user: Instance d6141949-1d15-4c84-8638-426cf7244dbd could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:51:23.946358 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-953bd1cc-8baa-433c-af32-d5eab795ba99 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd" status: 404 len: 111 microversion: 2.1 time: 0.098847 Aug 04 16:51:23.951518 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1579/3117] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:51:23 2022] DELETE /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:51:23.958867 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-73ba6abf-ab17-46b0-bab3-30273e8d35a2 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:23.959780 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-73ba6abf-ab17-46b0-bab3-30273e8d35a2 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: d6141949-1d15-4c84-8638-426cf7244dbd] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:23.969323 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-73ba6abf-ab17-46b0-bab3-30273e8d35a2 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:23.970136 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-73ba6abf-ab17-46b0-bab3-30273e8d35a2 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:23.971967 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-73ba6abf-ab17-46b0-bab3-30273e8d35a2 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:23.972616 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-73ba6abf-ab17-46b0-bab3-30273e8d35a2 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:23.996832 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-73ba6abf-ab17-46b0-bab3-30273e8d35a2 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] HTTP exception thrown: Instance d6141949-1d15-4c84-8638-426cf7244dbd could not be found. Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-73ba6abf-ab17-46b0-bab3-30273e8d35a2 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Request method failure captured: Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd HTTP/1.1 Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_ddGi-LUxEkOI7UNq-ijU5XnirMgjjOPky_n4iIeohsp_mBZi36CDxRY5dUKGmgKLroDx6IsvA3hey_uA7LPQbZI4NWhaCZQIOIkAKlIttRUGlU4y_AMkv45dQEQsQ8xd9VhN5XbmaVn_f0gvdFbALtWn0QI5OJtAeQ50IP8tuO8i0 Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/60281cf1dbe645d8949e93f9e70b5d91"}]}] Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 3cfb4739b53b411391a26de37b98469f Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance d6141949-1d15-4c84-8638-426cf7244dbd could not be found. Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'd6141949-1d15-4c84-8638-426cf7244dbd'} Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6141949-1d15-4c84-8638-426cf7244dbd could not be found. Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6141949-1d15-4c84-8638-426cf7244dbd could not be found. Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:23.999068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:24.003790 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:24.003790 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:24.003790 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:24.003790 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:51:24.003790 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:51:24.003790 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6141949-1d15-4c84-8638-426cf7244dbd could not be found. Aug 04 16:51:24.003790 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:24.006636 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-73ba6abf-ab17-46b0-bab3-30273e8d35a2 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Returning 404 to user: Instance d6141949-1d15-4c84-8638-426cf7244dbd could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:51:24.008211 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-73ba6abf-ab17-46b0-bab3-30273e8d35a2 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd" status: 404 len: 111 microversion: 2.1 time: 0.055303 Aug 04 16:51:24.014325 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1580/3118] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:23 2022] GET /compute/v2.1/servers/d6141949-1d15-4c84-8638-426cf7244dbd => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:51:24.021713 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3ee680f3-5392-4d7c-9089-731cc74c0f66 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e848c4310>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:24.086126 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3ee680f3-5392-4d7c-9089-731cc74c0f66 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/cc4c2019-5133-489d-8cd9-14d922790c64" status: 200 len: 1454 microversion: 2.1 time: 0.068480 Aug 04 16:51:24.087014 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1581/3119] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:24 2022] GET /compute/v2.1/images/cc4c2019-5133-489d-8cd9-14d922790c64 => generated 1454 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:24.292347 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-19b60541-9934-4bcf-8e7c-a54a8c6f6404 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:24.297760 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-19b60541-9934-4bcf-8e7c-a54a8c6f6404 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:24.315951 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-19b60541-9934-4bcf-8e7c-a54a8c6f6404 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:24.316591 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-19b60541-9934-4bcf-8e7c-a54a8c6f6404 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:24.318278 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-19b60541-9934-4bcf-8e7c-a54a8c6f6404 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:24.318978 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-19b60541-9934-4bcf-8e7c-a54a8c6f6404 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:24.807150 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e774e306-045f-4fc5-9e68-774f7191042e tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:24.819288 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e774e306-045f-4fc5-9e68-774f7191042e tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d" status: 200 len: 1324 microversion: 2.1 time: 0.951490 Aug 04 16:51:24.830784 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1539/3120] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:23 2022] GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d => generated 1324 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:51:24.844969 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ab02ff5c-4a4b-43ca-bb22-079718dd37b0 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '.version_select at 0x7f7e84bce1f0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:24.982591 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ab02ff5c-4a4b-43ca-bb22-079718dd37b0 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/images/424dce4c-9c5b-4295-bdcb-b0322621a2a5" status: 200 len: 1423 microversion: 2.1 time: 0.144872 Aug 04 16:51:24.989395 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1540/3121] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:24 2022] GET /compute/v2.1/images/424dce4c-9c5b-4295-bdcb-b0322621a2a5 => generated 1423 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:25.013119 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-97aec7d1-5dfc-4a12-b9fd-87f14a4abaa4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:25.013805 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-97aec7d1-5dfc-4a12-b9fd-87f14a4abaa4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:25.068904 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-97aec7d1-5dfc-4a12-b9fd-87f14a4abaa4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:25.069394 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-97aec7d1-5dfc-4a12-b9fd-87f14a4abaa4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:25.093070 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-97aec7d1-5dfc-4a12-b9fd-87f14a4abaa4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:25.094857 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-97aec7d1-5dfc-4a12-b9fd-87f14a4abaa4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:25.161709 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-19b60541-9934-4bcf-8e7c-a54a8c6f6404 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:25.207260 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-19b60541-9934-4bcf-8e7c-a54a8c6f6404 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:25.211421 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-19b60541-9934-4bcf-8e7c-a54a8c6f6404 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:25.228736 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-19b60541-9934-4bcf-8e7c-a54a8c6f6404 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1875 microversion: 2.42 time: 0.935583 Aug 04 16:51:25.230533 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1582/3122] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:51:24 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1875 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:51:25.236679 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-feb57faf-6496-4007-b69e-7dbdea619269 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e84033dc0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:25.353979 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-feb57faf-6496-4007-b69e-7dbdea619269 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/cc4c2019-5133-489d-8cd9-14d922790c64" status: 200 len: 1454 microversion: 2.1 time: 0.121464 Aug 04 16:51:25.355068 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1583/3123] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:25 2022] GET /compute/v2.1/images/cc4c2019-5133-489d-8cd9-14d922790c64 => generated 1454 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:25.702069 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-78fcb104-45bf-4eba-8c27-4d4983c7fca3 req-14550cb9-b902-4d91-9d0b-628de8911919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f91fdc58-3e45-4fc2-8bae-bda8292c908d", "name": "network-vif-plugged", "status": "completed", "tag": "8310e003-7985-4b7a-81eb-81193a3418ab"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:51:25.737027 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-78fcb104-45bf-4eba-8c27-4d4983c7fca3 req-14550cb9-b902-4d91-9d0b-628de8911919 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:25.739731 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-78fcb104-45bf-4eba-8c27-4d4983c7fca3 req-14550cb9-b902-4d91-9d0b-628de8911919 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:25.778645 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-78fcb104-45bf-4eba-8c27-4d4983c7fca3 req-14550cb9-b902-4d91-9d0b-628de8911919 service nova] Creating event network-vif-plugged:8310e003-7985-4b7a-81eb-81193a3418ab for instance f91fdc58-3e45-4fc2-8bae-bda8292c908d on n-h1-846466-12 Aug 04 16:51:25.790162 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-78fcb104-45bf-4eba-8c27-4d4983c7fca3 req-14550cb9-b902-4d91-9d0b-628de8911919 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092762 Aug 04 16:51:25.793634 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1584/3124] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:51:25.809448 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-1a5fc29c-6775-404e-b8d9-e07a9bfc62e7 req-fc35809d-7dfd-4234-9925-d5a5032a1648 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e273267-ae4b-4a99-821e-1c02c3440610", "tag": "60a27540-9c7c-46c8-a5bc-7d1e309c4659"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:51:25.833441 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-1a5fc29c-6775-404e-b8d9-e07a9bfc62e7 req-fc35809d-7dfd-4234-9925-d5a5032a1648 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:25.834254 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-1a5fc29c-6775-404e-b8d9-e07a9bfc62e7 req-fc35809d-7dfd-4234-9925-d5a5032a1648 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:25.834877 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-97aec7d1-5dfc-4a12-b9fd-87f14a4abaa4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:25.848344 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-97aec7d1-5dfc-4a12-b9fd-87f14a4abaa4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 0.857739 Aug 04 16:51:25.854918 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1541/3125] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:24 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:25.874813 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-28bede4a-e281-4076-b545-84be96c86e87 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:25.876418 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-28bede4a-e281-4076-b545-84be96c86e87 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 30109352-6d98-4d4c-8613-96cfd959e86d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:25.880867 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-1a5fc29c-6775-404e-b8d9-e07a9bfc62e7 req-fc35809d-7dfd-4234-9925-d5a5032a1648 service nova] Creating event network-changed:60a27540-9c7c-46c8-a5bc-7d1e309c4659 for instance 8e273267-ae4b-4a99-821e-1c02c3440610 on n-h1-846466-12 Aug 04 16:51:25.905327 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-1a5fc29c-6775-404e-b8d9-e07a9bfc62e7 req-fc35809d-7dfd-4234-9925-d5a5032a1648 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109087 Aug 04 16:51:25.905955 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1585/3126] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:51:25.935887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dc5d7911-ea49-4325-9a53-5e5daab15c15 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:25.936639 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dc5d7911-ea49-4325-9a53-5e5daab15c15 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:25.938301 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-28bede4a-e281-4076-b545-84be96c86e87 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:25.946227 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-28bede4a-e281-4076-b545-84be96c86e87 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:25.948673 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-28bede4a-e281-4076-b545-84be96c86e87 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:25.949937 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-28bede4a-e281-4076-b545-84be96c86e87 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:25.952800 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dc5d7911-ea49-4325-9a53-5e5daab15c15 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:25.953254 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dc5d7911-ea49-4325-9a53-5e5daab15c15 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:25.959200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dc5d7911-ea49-4325-9a53-5e5daab15c15 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:25.959836 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dc5d7911-ea49-4325-9a53-5e5daab15c15 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:26.769952 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-28bede4a-e281-4076-b545-84be96c86e87 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:26.797108 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-28bede4a-e281-4076-b545-84be96c86e87 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d" status: 200 len: 1324 microversion: 2.1 time: 0.939717 Aug 04 16:51:26.814778 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1542/3127] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:25 2022] GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d => generated 1324 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:26.849850 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ee49b1f9-f2d0-4c7a-8d3b-d9a0ad41f3d4 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '.version_select at 0x7f7e77dd5c10>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:27.218703 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dc5d7911-ea49-4325-9a53-5e5daab15c15 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:27.229356 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dc5d7911-ea49-4325-9a53-5e5daab15c15 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1669 microversion: 2.1 time: 1.319289 Aug 04 16:51:27.234072 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1586/3128] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:25 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1669 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:27.273078 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-219930b5-e5f7-45d6-bd9b-24130e6ccec9 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:27.274125 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-219930b5-e5f7-45d6-bd9b-24130e6ccec9 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:27.295708 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-219930b5-e5f7-45d6-bd9b-24130e6ccec9 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:27.299485 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-219930b5-e5f7-45d6-bd9b-24130e6ccec9 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:27.300589 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-219930b5-e5f7-45d6-bd9b-24130e6ccec9 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:27.302245 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-219930b5-e5f7-45d6-bd9b-24130e6ccec9 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:29.006887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-219930b5-e5f7-45d6-bd9b-24130e6ccec9 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:29.027807 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-219930b5-e5f7-45d6-bd9b-24130e6ccec9 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:29.036181 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-219930b5-e5f7-45d6-bd9b-24130e6ccec9 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:29.046333 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-219930b5-e5f7-45d6-bd9b-24130e6ccec9 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1875 microversion: 2.42 time: 1.799649 Aug 04 16:51:29.047317 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1587/3129] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:51:27 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1875 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:51:29.075143 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fc2024e9-bb90-4033-af75-4ad27fa83c66 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e89d13160>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:35.938060 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=43 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:51:36.779981 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:51:37.295710 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=41 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:51:39.017251 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:51:39.297841 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ee49b1f9-f2d0-4c7a-8d3b-d9a0ad41f3d4 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/images/424dce4c-9c5b-4295-bdcb-b0322621a2a5" status: 200 len: 1432 microversion: 2.1 time: 12.478743 Aug 04 16:51:39.304633 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1543/3130] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:26 2022] GET /compute/v2.1/images/424dce4c-9c5b-4295-bdcb-b0322621a2a5 => generated 1432 bytes in 12487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:39.322987 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ff4c48c3-1286-46b6-b6ee-c6982aa6650b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:39.323651 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fc2024e9-bb90-4033-af75-4ad27fa83c66 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/cc4c2019-5133-489d-8cd9-14d922790c64" status: 200 len: 1454 microversion: 2.1 time: 10.275015 Aug 04 16:51:39.325145 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ff4c48c3-1286-46b6-b6ee-c6982aa6650b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: f80ffdf6-eb69-43da-939b-4c9417d873bf] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:39.325456 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1588/3131] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:29 2022] GET /compute/v2.1/images/cc4c2019-5133-489d-8cd9-14d922790c64 => generated 1454 bytes in 10277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:39.342899 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ff4c48c3-1286-46b6-b6ee-c6982aa6650b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:39.343656 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ff4c48c3-1286-46b6-b6ee-c6982aa6650b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:39.344682 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ff4c48c3-1286-46b6-b6ee-c6982aa6650b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:39.345410 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ff4c48c3-1286-46b6-b6ee-c6982aa6650b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:39.349727 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-7102cc5a-e41e-4b15-850f-9836db225a1a req-c0d2e197-86dc-4681-b6f2-5edae869b7be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30109352-6d98-4d4c-8613-96cfd959e86d", "name": "network-vif-plugged", "status": "completed", "tag": "25fb6649-7af7-45df-8635-9e27010c2ae1"}, {"server_uuid": "9139a17d-927c-4595-a7ff-11a1fa3a6a69", "name": "network-vif-plugged", "status": "completed", "tag": "ec13d30d-7a89-4d60-b71e-301109f0b912"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:51:39.373684 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7102cc5a-e41e-4b15-850f-9836db225a1a req-c0d2e197-86dc-4681-b6f2-5edae869b7be service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:39.374627 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7102cc5a-e41e-4b15-850f-9836db225a1a req-c0d2e197-86dc-4681-b6f2-5edae869b7be service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:39.391693 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-7102cc5a-e41e-4b15-850f-9836db225a1a req-c0d2e197-86dc-4681-b6f2-5edae869b7be service nova] Creating event network-vif-plugged:25fb6649-7af7-45df-8635-9e27010c2ae1 for instance 30109352-6d98-4d4c-8613-96cfd959e86d on n-h2-846466-12 Aug 04 16:51:39.392626 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-7102cc5a-e41e-4b15-850f-9836db225a1a req-c0d2e197-86dc-4681-b6f2-5edae869b7be service nova] Creating event network-vif-plugged:ec13d30d-7a89-4d60-b71e-301109f0b912 for instance 9139a17d-927c-4595-a7ff-11a1fa3a6a69 on n-h1-846466-12 Aug 04 16:51:39.406827 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-7102cc5a-e41e-4b15-850f-9836db225a1a req-c0d2e197-86dc-4681-b6f2-5edae869b7be service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.065196 Aug 04 16:51:39.413695 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ff4c48c3-1286-46b6-b6ee-c6982aa6650b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: f80ffdf6-eb69-43da-939b-4c9417d873bf] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:51:39.424891 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1589/3132] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:51:39.426726 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.compute.api [None req-ff4c48c3-1286-46b6-b6ee-c6982aa6650b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: f80ffdf6-eb69-43da-939b-4c9417d873bf] Working on deleting snapshot 5d347f95-7831-4f43-a238-38f6bc5e99ea from shelved instance... Aug 04 16:51:39.434089 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9ab23213-d43e-480a-afd7-a82c0ab63925 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:39.435818 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9ab23213-d43e-480a-afd7-a82c0ab63925 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 30109352-6d98-4d4c-8613-96cfd959e86d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:39.444237 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9ab23213-d43e-480a-afd7-a82c0ab63925 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:39.445556 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9ab23213-d43e-480a-afd7-a82c0ab63925 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:39.446678 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9ab23213-d43e-480a-afd7-a82c0ab63925 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:39.447278 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9ab23213-d43e-480a-afd7-a82c0ab63925 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:40.011898 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9ab23213-d43e-480a-afd7-a82c0ab63925 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:40.030955 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9ab23213-d43e-480a-afd7-a82c0ab63925 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d" status: 200 len: 1324 microversion: 2.1 time: 0.604118 Aug 04 16:51:40.045047 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1590/3133] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:39 2022] GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d => generated 1324 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:40.045047 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1c631776-f743-4427-8857-61776696ac44 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:40.045047 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1c631776-f743-4427-8857-61776696ac44 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:40.061320 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1c631776-f743-4427-8857-61776696ac44 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:40.061320 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1c631776-f743-4427-8857-61776696ac44 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:40.073742 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1c631776-f743-4427-8857-61776696ac44 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:40.074191 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1c631776-f743-4427-8857-61776696ac44 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:40.340172 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ff4c48c3-1286-46b6-b6ee-c6982aa6650b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: f80ffdf6-eb69-43da-939b-4c9417d873bf] Doing local delete in cell e056d029-674a-446e-ac9e-5108621d9db2(cell1) {{(pid=126126) _delete /opt/stack/nova/nova/compute/api.py:2491}} Aug 04 16:51:40.341773 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ff4c48c3-1286-46b6-b6ee-c6982aa6650b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:40.342220 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ff4c48c3-1286-46b6-b6ee-c6982aa6650b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:40.343161 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.compute.api [None req-ff4c48c3-1286-46b6-b6ee-c6982aa6650b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: f80ffdf6-eb69-43da-939b-4c9417d873bf] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 04 16:51:40.349323 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-ff4c48c3-1286-46b6-b6ee-c6982aa6650b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: f80ffdf6-eb69-43da-939b-4c9417d873bf] deallocate_for_instance() {{(pid=126126) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 04 16:51:40.646362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1c631776-f743-4427-8857-61776696ac44 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:40.684435 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1c631776-f743-4427-8857-61776696ac44 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:40.692396 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1c631776-f743-4427-8857-61776696ac44 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:40.693934 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1c631776-f743-4427-8857-61776696ac44 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1875 microversion: 2.42 time: 0.655047 Aug 04 16:51:40.700537 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1591/3134] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:51:40 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1875 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:51:40.726078 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6878f0b2-0c9e-4606-a1ae-e206ae9c5aea tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:40.727385 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6878f0b2-0c9e-4606-a1ae-e206ae9c5aea tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 03f171b8-c8d3-46c8-9429-4d90317c2b19] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:40.763503 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6878f0b2-0c9e-4606-a1ae-e206ae9c5aea tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:40.764150 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6878f0b2-0c9e-4606-a1ae-e206ae9c5aea tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:40.765649 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6878f0b2-0c9e-4606-a1ae-e206ae9c5aea tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:40.768576 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6878f0b2-0c9e-4606-a1ae-e206ae9c5aea tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:40.806588 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-6878f0b2-0c9e-4606-a1ae-e206ae9c5aea tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] HTTP exception thrown: Instance 03f171b8-c8d3-46c8-9429-4d90317c2b19 could not be found. Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6878f0b2-0c9e-4606-a1ae-e206ae9c5aea tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Request method failure captured: Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19 HTTP/1.1 Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_ddGi-LUxEkOI7UNq-ijU5XnirMgjjOPky_n4iIeohsp_mBZi36CDxRY5dUKGmgKLroDx6IsvA3hey_uA7LPQbZI4NWhaCZQIOIkAKlIttRUGlU4y_AMkv45dQEQsQ8xd9VhN5XbmaVn_f0gvdFbALtWn0QI5OJtAeQ50IP8tuO8i0 Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/60281cf1dbe645d8949e93f9e70b5d91"}]}] Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 3cfb4739b53b411391a26de37b98469f Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 03f171b8-c8d3-46c8-9429-4d90317c2b19 could not be found. Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '03f171b8-c8d3-46c8-9429-4d90317c2b19'} Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03f171b8-c8d3-46c8-9429-4d90317c2b19 could not be found. Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:51:40.812332 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:51:40.817783 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03f171b8-c8d3-46c8-9429-4d90317c2b19 could not be found. Aug 04 16:51:40.817783 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:40.817783 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:40.817783 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:40.817783 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:40.817783 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:40.817783 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:40.817783 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:51:40.817783 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:51:40.817783 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03f171b8-c8d3-46c8-9429-4d90317c2b19 could not be found. Aug 04 16:51:40.817783 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:40.822027 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6878f0b2-0c9e-4606-a1ae-e206ae9c5aea tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Returning 404 to user: Instance 03f171b8-c8d3-46c8-9429-4d90317c2b19 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:51:40.826277 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6878f0b2-0c9e-4606-a1ae-e206ae9c5aea tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "DELETE /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19" status: 404 len: 111 microversion: 2.1 time: 0.124755 Aug 04 16:51:40.830072 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1592/3135] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:51:40 2022] DELETE /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:51:40.835856 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7a0effe2-d729-4d8c-8543-8e056647463c tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '.version_select at 0x7f7e844ad8b0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:40.903405 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7a0effe2-d729-4d8c-8543-8e056647463c tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/images/424dce4c-9c5b-4295-bdcb-b0322621a2a5" status: 200 len: 1432 microversion: 2.1 time: 0.075416 Aug 04 16:51:40.904781 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1593/3136] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:40 2022] GET /compute/v2.1/images/424dce4c-9c5b-4295-bdcb-b0322621a2a5 => generated 1432 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:40.910619 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-33457a90-a285-4db9-8b42-4be0c808b94d tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e89c59670>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:41.000839 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-33457a90-a285-4db9-8b42-4be0c808b94d tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/cc4c2019-5133-489d-8cd9-14d922790c64" status: 200 len: 1454 microversion: 2.1 time: 0.094502 Aug 04 16:51:41.001453 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1594/3137] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:40 2022] GET /compute/v2.1/images/cc4c2019-5133-489d-8cd9-14d922790c64 => generated 1454 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:41.026025 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2859a20a-bb58-4458-b915-c35539326325 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:41.034939 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2859a20a-bb58-4458-b915-c35539326325 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 03f171b8-c8d3-46c8-9429-4d90317c2b19] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:41.051542 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2859a20a-bb58-4458-b915-c35539326325 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:41.052003 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2859a20a-bb58-4458-b915-c35539326325 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:41.053044 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2859a20a-bb58-4458-b915-c35539326325 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:41.062653 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2859a20a-bb58-4458-b915-c35539326325 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:41.106269 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-2859a20a-bb58-4458-b915-c35539326325 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] HTTP exception thrown: Instance 03f171b8-c8d3-46c8-9429-4d90317c2b19 could not be found. Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2859a20a-bb58-4458-b915-c35539326325 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Request method failure captured: Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19 HTTP/1.1 Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_ddGi-LUxEkOI7UNq-ijU5XnirMgjjOPky_n4iIeohsp_mBZi36CDxRY5dUKGmgKLroDx6IsvA3hey_uA7LPQbZI4NWhaCZQIOIkAKlIttRUGlU4y_AMkv45dQEQsQ8xd9VhN5XbmaVn_f0gvdFbALtWn0QI5OJtAeQ50IP8tuO8i0 Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/60281cf1dbe645d8949e93f9e70b5d91"}]}] Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 3cfb4739b53b411391a26de37b98469f Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 03f171b8-c8d3-46c8-9429-4d90317c2b19 could not be found. Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '03f171b8-c8d3-46c8-9429-4d90317c2b19'} Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03f171b8-c8d3-46c8-9429-4d90317c2b19 could not be found. Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03f171b8-c8d3-46c8-9429-4d90317c2b19 could not be found. Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:41.112584 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:41.134844 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:41.134844 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:41.134844 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:41.134844 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:51:41.134844 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:51:41.134844 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03f171b8-c8d3-46c8-9429-4d90317c2b19 could not be found. Aug 04 16:51:41.134844 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:41.134844 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2859a20a-bb58-4458-b915-c35539326325 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Returning 404 to user: Instance 03f171b8-c8d3-46c8-9429-4d90317c2b19 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:51:41.134844 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2859a20a-bb58-4458-b915-c35539326325 tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19" status: 404 len: 111 microversion: 2.1 time: 0.100399 Aug 04 16:51:41.134844 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1595/3138] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:41 2022] GET /compute/v2.1/servers/03f171b8-c8d3-46c8-9429-4d90317c2b19 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:51:41.134844 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0fa9876b-6eb9-42e1-b07e-e02e012ca5bf tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:41.134844 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0fa9876b-6eb9-42e1-b07e-e02e012ca5bf tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] [instance: f91fdc58-3e45-4fc2-8bae-bda8292c908d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:41.155045 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0fa9876b-6eb9-42e1-b07e-e02e012ca5bf tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:41.155498 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0fa9876b-6eb9-42e1-b07e-e02e012ca5bf tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:41.157968 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0fa9876b-6eb9-42e1-b07e-e02e012ca5bf tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:41.158284 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0fa9876b-6eb9-42e1-b07e-e02e012ca5bf tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:41.587158 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0fa9876b-6eb9-42e1-b07e-e02e012ca5bf tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4c0d6fac94470d9665f19021d50007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96b36239054414182544ccfe7550cd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:41.605336 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0fa9876b-6eb9-42e1-b07e-e02e012ca5bf tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d" status: 200 len: 1466 microversion: 2.1 time: 0.480651 Aug 04 16:51:41.609609 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1596/3139] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:41 2022] GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d => generated 1466 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:41.620895 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-833bda0a-3085-488c-8ea6-871dbd7c264f tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:41.621724 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-833bda0a-3085-488c-8ea6-871dbd7c264f tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 30109352-6d98-4d4c-8613-96cfd959e86d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:41.633604 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-833bda0a-3085-488c-8ea6-871dbd7c264f tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:41.634430 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-833bda0a-3085-488c-8ea6-871dbd7c264f tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:41.635234 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-833bda0a-3085-488c-8ea6-871dbd7c264f tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:41.637896 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-833bda0a-3085-488c-8ea6-871dbd7c264f tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:42.313000 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-833bda0a-3085-488c-8ea6-871dbd7c264f tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:42.324692 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-833bda0a-3085-488c-8ea6-871dbd7c264f tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d" status: 200 len: 1522 microversion: 2.1 time: 0.713681 Aug 04 16:51:42.328079 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1597/3140] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:41 2022] GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d => generated 1522 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:42.342972 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-43878a70-531f-4450-981d-375410e321fa tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:42.345055 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-43878a70-531f-4450-981d-375410e321fa tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 8f6461bb-aeb9-459a-8518-47055bfd5f41] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:42.368374 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-43878a70-531f-4450-981d-375410e321fa tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:42.368836 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-43878a70-531f-4450-981d-375410e321fa tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:42.373945 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-43878a70-531f-4450-981d-375410e321fa tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:42.374416 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-43878a70-531f-4450-981d-375410e321fa tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:42.391771 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-ff4c48c3-1286-46b6-b6ee-c6982aa6650b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: f80ffdf6-eb69-43da-939b-4c9417d873bf] Updating instance_info_cache with network_info: [] {{(pid=126126) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 16:51:42.410520 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-43878a70-531f-4450-981d-375410e321fa tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] HTTP exception thrown: Instance 8f6461bb-aeb9-459a-8518-47055bfd5f41 could not be found. Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-43878a70-531f-4450-981d-375410e321fa tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Request method failure captured: Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/servers/8f6461bb-aeb9-459a-8518-47055bfd5f41 HTTP/1.1 Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_ddGi-LUxEkOI7UNq-ijU5XnirMgjjOPky_n4iIeohsp_mBZi36CDxRY5dUKGmgKLroDx6IsvA3hey_uA7LPQbZI4NWhaCZQIOIkAKlIttRUGlU4y_AMkv45dQEQsQ8xd9VhN5XbmaVn_f0gvdFbALtWn0QI5OJtAeQ50IP8tuO8i0 Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/60281cf1dbe645d8949e93f9e70b5d91"}]}] Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 3cfb4739b53b411391a26de37b98469f Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 8f6461bb-aeb9-459a-8518-47055bfd5f41 could not be found. Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '8f6461bb-aeb9-459a-8518-47055bfd5f41'} Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f6461bb-aeb9-459a-8518-47055bfd5f41 could not be found. Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:51:42.412236 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:51:42.417784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f6461bb-aeb9-459a-8518-47055bfd5f41 could not be found. Aug 04 16:51:42.417784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:42.417784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:42.417784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:42.417784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:42.417784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:42.417784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:42.417784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:51:42.417784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:51:42.417784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f6461bb-aeb9-459a-8518-47055bfd5f41 could not be found. Aug 04 16:51:42.417784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:42.417784 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-43878a70-531f-4450-981d-375410e321fa tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Returning 404 to user: Instance 8f6461bb-aeb9-459a-8518-47055bfd5f41 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:51:42.417784 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-43878a70-531f-4450-981d-375410e321fa tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8f6461bb-aeb9-459a-8518-47055bfd5f41" status: 404 len: 111 microversion: 2.1 time: 0.082611 Aug 04 16:51:42.429610 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1598/3141] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:51:42 2022] DELETE /compute/v2.1/servers/8f6461bb-aeb9-459a-8518-47055bfd5f41 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:51:42.434969 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8a281868-9939-469c-a97e-3140b06af0ca tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '.version_select at 0x7f7e8479e940>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:42.508007 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8a281868-9939-469c-a97e-3140b06af0ca tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/images/58d80c01-1581-4a2f-bbb0-c2eaf1affa00" status: 200 len: 784 microversion: 2.1 time: 0.076552 Aug 04 16:51:42.518958 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1599/3142] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:42 2022] GET /compute/v2.1/images/58d80c01-1581-4a2f-bbb0-c2eaf1affa00 => generated 784 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:51:42.531266 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c1aace20-d3e5-4607-a324-3ee0baa2fb92 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:42.532030 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c1aace20-d3e5-4607-a324-3ee0baa2fb92 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:42.548229 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c1aace20-d3e5-4607-a324-3ee0baa2fb92 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:42.551564 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c1aace20-d3e5-4607-a324-3ee0baa2fb92 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:42.552704 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c1aace20-d3e5-4607-a324-3ee0baa2fb92 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:42.554091 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c1aace20-d3e5-4607-a324-3ee0baa2fb92 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:43.083810 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ff4c48c3-1286-46b6-b6ee-c6982aa6650b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf" status: 204 len: 0 microversion: 2.1 time: 3.776004 Aug 04 16:51:43.084492 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1544/3143] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:51:39 2022] DELETE /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf => generated 0 bytes in 3779 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:51:43.091343 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a308ae1a-09c1-445c-b1a0-bacdb0a3ffb8 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e849da940>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:43.200331 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a308ae1a-09c1-445c-b1a0-bacdb0a3ffb8 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/cc4c2019-5133-489d-8cd9-14d922790c64" status: 200 len: 1454 microversion: 2.1 time: 0.114056 Aug 04 16:51:43.200609 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1545/3144] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:43 2022] GET /compute/v2.1/images/cc4c2019-5133-489d-8cd9-14d922790c64 => generated 1454 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:43.212686 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0d8fdba9-5297-4771-9cb2-342e732df5da tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:43.213245 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0d8fdba9-5297-4771-9cb2-342e732df5da tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 30109352-6d98-4d4c-8613-96cfd959e86d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:43.217191 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c1aace20-d3e5-4607-a324-3ee0baa2fb92 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:43.219765 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0d8fdba9-5297-4771-9cb2-342e732df5da tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:43.220216 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0d8fdba9-5297-4771-9cb2-342e732df5da tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:43.220970 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0d8fdba9-5297-4771-9cb2-342e732df5da tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:43.221829 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0d8fdba9-5297-4771-9cb2-342e732df5da tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:43.235661 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c1aace20-d3e5-4607-a324-3ee0baa2fb92 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:43.248536 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c1aace20-d3e5-4607-a324-3ee0baa2fb92 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:43.251492 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c1aace20-d3e5-4607-a324-3ee0baa2fb92 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1875 microversion: 2.42 time: 0.741222 Aug 04 16:51:43.254924 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1600/3145] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:51:42 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1875 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:51:43.262075 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-e79c07f8-1560-4a83-9b38-5c96d6165cd2 req-564a3151-b63c-4caf-96e8-600d8dc49012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f80ffdf6-eb69-43da-939b-4c9417d873bf", "name": "network-vif-deleted", "tag": "a94d7826-be7e-4909-ad12-744419720da9"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:51:43.292364 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-e79c07f8-1560-4a83-9b38-5c96d6165cd2 req-564a3151-b63c-4caf-96e8-600d8dc49012 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:43.293735 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-e79c07f8-1560-4a83-9b38-5c96d6165cd2 req-564a3151-b63c-4caf-96e8-600d8dc49012 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:43.313020 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.compute.server_external_events [req-e79c07f8-1560-4a83-9b38-5c96d6165cd2 req-564a3151-b63c-4caf-96e8-600d8dc49012 service nova] Unable to find a host for instance f80ffdf6-eb69-43da-939b-4c9417d873bf. Dropping event network-vif-deleted {{(pid=126125) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 04 16:51:43.314886 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-e79c07f8-1560-4a83-9b38-5c96d6165cd2 req-564a3151-b63c-4caf-96e8-600d8dc49012 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.057766 Aug 04 16:51:43.315332 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1601/3146] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 60 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 04 16:51:43.322929 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-af381bd2-e46c-4ddb-8e94-6c0bfc36285c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:43.323858 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-af381bd2-e46c-4ddb-8e94-6c0bfc36285c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] [instance: 8f6461bb-aeb9-459a-8518-47055bfd5f41] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:43.331476 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-af381bd2-e46c-4ddb-8e94-6c0bfc36285c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:43.332333 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-af381bd2-e46c-4ddb-8e94-6c0bfc36285c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:43.333353 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-af381bd2-e46c-4ddb-8e94-6c0bfc36285c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:43.333953 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-af381bd2-e46c-4ddb-8e94-6c0bfc36285c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:43.357851 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-af381bd2-e46c-4ddb-8e94-6c0bfc36285c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] HTTP exception thrown: Instance 8f6461bb-aeb9-459a-8518-47055bfd5f41 could not be found. Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-af381bd2-e46c-4ddb-8e94-6c0bfc36285c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Request method failure captured: Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/8f6461bb-aeb9-459a-8518-47055bfd5f41 HTTP/1.1 Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_ddGi-LUxEkOI7UNq-ijU5XnirMgjjOPky_n4iIeohsp_mBZi36CDxRY5dUKGmgKLroDx6IsvA3hey_uA7LPQbZI4NWhaCZQIOIkAKlIttRUGlU4y_AMkv45dQEQsQ8xd9VhN5XbmaVn_f0gvdFbALtWn0QI5OJtAeQ50IP8tuO8i0 Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60281cf1dbe645d8949e93f9e70b5d91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/60281cf1dbe645d8949e93f9e70b5d91"}]}] Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 60281cf1dbe645d8949e93f9e70b5d91 Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-DeleteServersTestJSON-1493836307 Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 3cfb4739b53b411391a26de37b98469f Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-DeleteServersTestJSON-1493836307-project Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 8f6461bb-aeb9-459a-8518-47055bfd5f41 could not be found. Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '8f6461bb-aeb9-459a-8518-47055bfd5f41'} Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f6461bb-aeb9-459a-8518-47055bfd5f41 could not be found. Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f6461bb-aeb9-459a-8518-47055bfd5f41 could not be found. Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:43.359776 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:43.365907 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:43.365907 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:43.365907 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:43.365907 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:51:43.365907 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:51:43.365907 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f6461bb-aeb9-459a-8518-47055bfd5f41 could not be found. Aug 04 16:51:43.365907 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:43.367847 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-af381bd2-e46c-4ddb-8e94-6c0bfc36285c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] Returning 404 to user: Instance 8f6461bb-aeb9-459a-8518-47055bfd5f41 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:51:43.369040 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-af381bd2-e46c-4ddb-8e94-6c0bfc36285c tempest-DeleteServersTestJSON-1493836307 tempest-DeleteServersTestJSON-1493836307-project] 10.222.0.23 "GET /compute/v2.1/servers/8f6461bb-aeb9-459a-8518-47055bfd5f41" status: 404 len: 111 microversion: 2.1 time: 0.051812 Aug 04 16:51:43.373512 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1602/3147] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:43 2022] GET /compute/v2.1/servers/8f6461bb-aeb9-459a-8518-47055bfd5f41 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:51:43.380007 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-024f5d06-bf3c-4304-930b-63976a4a7272 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:43.389431 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-024f5d06-bf3c-4304-930b-63976a4a7272 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014502 Aug 04 16:51:43.390940 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1603/3148] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Aug 4 16:51:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:51:43.395896 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-1a9ec3c3-534f-42f6-b8a1-f8307d0a7ac2 req-6150824a-b9bf-489f-ace8-a75b7175b75f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f91fdc58-3e45-4fc2-8bae-bda8292c908d", "name": "network-vif-unplugged", "status": "completed", "tag": "8310e003-7985-4b7a-81eb-81193a3418ab"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:51:43.416813 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-1a9ec3c3-534f-42f6-b8a1-f8307d0a7ac2 req-6150824a-b9bf-489f-ace8-a75b7175b75f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:43.417654 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-1a9ec3c3-534f-42f6-b8a1-f8307d0a7ac2 req-6150824a-b9bf-489f-ace8-a75b7175b75f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:43.433984 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-1a9ec3c3-534f-42f6-b8a1-f8307d0a7ac2 req-6150824a-b9bf-489f-ace8-a75b7175b75f service nova] Creating event network-vif-unplugged:8310e003-7985-4b7a-81eb-81193a3418ab for instance f91fdc58-3e45-4fc2-8bae-bda8292c908d on n-h1-846466-12 Aug 04 16:51:43.440709 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-1a9ec3c3-534f-42f6-b8a1-f8307d0a7ac2 req-6150824a-b9bf-489f-ace8-a75b7175b75f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048158 Aug 04 16:51:43.441976 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1604/3149] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:51:43.450382 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f985a040-2875-46ca-a3e2-25e0f4bf3b39 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:43.451295 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f985a040-2875-46ca-a3e2-25e0f4bf3b39 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: f80ffdf6-eb69-43da-939b-4c9417d873bf] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:43.460263 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f985a040-2875-46ca-a3e2-25e0f4bf3b39 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:43.460954 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f985a040-2875-46ca-a3e2-25e0f4bf3b39 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:43.462019 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f985a040-2875-46ca-a3e2-25e0f4bf3b39 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:43.462628 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f985a040-2875-46ca-a3e2-25e0f4bf3b39 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:43.494067 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-f985a040-2875-46ca-a3e2-25e0f4bf3b39 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] HTTP exception thrown: Instance f80ffdf6-eb69-43da-939b-4c9417d873bf could not be found. Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f985a040-2875-46ca-a3e2-25e0f4bf3b39 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Request method failure captured: Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf HTTP/1.1 Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_abSC_qd4PHP0W808xgrI7Q0G4tlPTiB2-LAH-LZMv8d9UcRN9ZCFy6_giyx-c7RjiKNjELhrKAi_ora1AVfsDng4FTG7brYif3-z0rtdjlkilo5AULdT4A615Ra8__IvKNYC3N__kBvOWqowuttGiKr7m7ap4YyjQHEc3cVcyVFSU Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 96ce955c9158463e9e98c53b99c581ec Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerActionsTestJSON-697118571 Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96ce955c9158463e9e98c53b99c581ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_96ce955c9158463e9e98c53b99c581ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96ce955c9158463e9e98c53b99c581ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/96ce955c9158463e9e98c53b99c581ec"}]}] Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerActionsTestJSON-697118571 Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 96ce955c9158463e9e98c53b99c581ec Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerActionsTestJSON-697118571 Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerActionsTestJSON-697118571-project Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 438d083dc9e74b2f8970455505791250 Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerActionsTestJSON-697118571-project Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance f80ffdf6-eb69-43da-939b-4c9417d873bf could not be found. Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'f80ffdf6-eb69-43da-939b-4c9417d873bf'} Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f80ffdf6-eb69-43da-939b-4c9417d873bf could not be found. Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f80ffdf6-eb69-43da-939b-4c9417d873bf could not be found. Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:43.500939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:43.506117 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:43.506117 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:43.506117 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:43.506117 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:51:43.506117 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:51:43.506117 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f80ffdf6-eb69-43da-939b-4c9417d873bf could not be found. Aug 04 16:51:43.506117 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:43.508031 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f985a040-2875-46ca-a3e2-25e0f4bf3b39 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Returning 404 to user: Instance f80ffdf6-eb69-43da-939b-4c9417d873bf could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:51:43.511057 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f985a040-2875-46ca-a3e2-25e0f4bf3b39 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf" status: 404 len: 111 microversion: 2.1 time: 0.067100 Aug 04 16:51:43.517234 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1605/3150] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:43 2022] GET /compute/v2.1/servers/f80ffdf6-eb69-43da-939b-4c9417d873bf => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:51:43.528344 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ffd2773c-1cf6-4346-a476-a948c8ba89ba tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '.version_select at 0x7f7e8492d310>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:44.284299 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0d8fdba9-5297-4771-9cb2-342e732df5da tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:44.299544 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0d8fdba9-5297-4771-9cb2-342e732df5da tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d" status: 200 len: 1522 microversion: 2.1 time: 1.088792 Aug 04 16:51:44.300996 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1546/3151] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:43 2022] GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d => generated 1522 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:44.308353 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-de11dee2-5aa7-49fd-b326-8a538440ade2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:44.309192 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-de11dee2-5aa7-49fd-b326-8a538440ade2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 316d48b7-d25a-4666-90ce-1fba8a600987] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:44.316395 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-de11dee2-5aa7-49fd-b326-8a538440ade2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:44.318580 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-de11dee2-5aa7-49fd-b326-8a538440ade2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:44.319805 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-de11dee2-5aa7-49fd-b326-8a538440ade2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:44.320858 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-de11dee2-5aa7-49fd-b326-8a538440ade2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:44.403332 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-de11dee2-5aa7-49fd-b326-8a538440ade2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 316d48b7-d25a-4666-90ce-1fba8a600987] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:51:44.489822 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ffd2773c-1cf6-4346-a476-a948c8ba89ba tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "DELETE /compute/v2.1/images/424dce4c-9c5b-4295-bdcb-b0322621a2a5" status: 204 len: 0 microversion: 2.1 time: 0.971151 Aug 04 16:51:44.490973 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1606/3152] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:43 2022] DELETE /compute/v2.1/images/424dce4c-9c5b-4295-bdcb-b0322621a2a5 => generated 0 bytes in 973 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:51:44.497755 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bd14f16c-205c-403a-9171-b4437f5ce12f tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e84d0e3a0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:44.571297 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bd14f16c-205c-403a-9171-b4437f5ce12f tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/cc4c2019-5133-489d-8cd9-14d922790c64" status: 200 len: 1454 microversion: 2.1 time: 0.078853 Aug 04 16:51:44.580227 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1607/3153] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:44 2022] GET /compute/v2.1/images/cc4c2019-5133-489d-8cd9-14d922790c64 => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:44.597186 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-084e032b-c21a-46d3-8156-a5d1510abb6d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:44.598447 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-084e032b-c21a-46d3-8156-a5d1510abb6d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:44.638932 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-de11dee2-5aa7-49fd-b326-8a538440ade2 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "DELETE /compute/v2.1/servers/316d48b7-d25a-4666-90ce-1fba8a600987" status: 204 len: 0 microversion: 2.1 time: 0.336046 Aug 04 16:51:44.640889 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-084e032b-c21a-46d3-8156-a5d1510abb6d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:44.641487 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-084e032b-c21a-46d3-8156-a5d1510abb6d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:44.641877 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1547/3154] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:51:44 2022] DELETE /compute/v2.1/servers/316d48b7-d25a-4666-90ce-1fba8a600987 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:51:44.642462 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-084e032b-c21a-46d3-8156-a5d1510abb6d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:44.642996 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-084e032b-c21a-46d3-8156-a5d1510abb6d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:44.648784 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d57f5c24-1911-4a6f-afd1-3f1e5acbf66b tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2144128496", "metadata": {"": ""}}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d57f5c24-1911-4a6f-afd1-3f1e5acbf66b tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Request method failure captured: Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d/action HTTP/1.1 Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 107 Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_jtTPBPy4fXdQ0VJrZ7Fc7m71zszwq7ozUwryWnXkb5nfLRGrkK5ga8HzOO0RHGQ_JBzS6OyCZVWsMotLJPEGPUn58SVuz4Z61cosYCdd8YzpWwL0OdtEOtJV7MtqbPH74mZZtuOB-p1arvqTlVKRaIs7USdqyFhUTa2KSBwKWaYTU Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: eb9de718bdfb4d6dbf63c336dfde8d42 Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb9de718bdfb4d6dbf63c336dfde8d42"}]}] Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: eb9de718bdfb4d6dbf63c336dfde8d42 Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ImagesOneServerNegativeTestJSON-1002016988-project Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 50ace5409bc54123aad5e1bc071cc3dd Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988-project Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2144128496", "metadata": {"": ""}}} Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '30109352-6d98-4d4c-8613-96cfd959e86d', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2144128496', 'metadata': {'': ''}}}} Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi {'': ''} Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:51:44.655143 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 16:51:44.660100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 16:51:44.660100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:51:44.660100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:51:44.660100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:51:44.660100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:51:44.660100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 16:51:44.660100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:44.660100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:44.660100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:44.660100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:44.660100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:44.660100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:44.660100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:51:44.660100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:51:44.660100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 16:51:44.660100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:44.660100 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d57f5c24-1911-4a6f-afd1-3f1e5acbf66b tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:51:44.660100 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d57f5c24-1911-4a6f-afd1-3f1e5acbf66b tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "POST /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d/action" status: 400 len: 170 microversion: 2.1 time: 0.012889 Aug 04 16:51:44.660100 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1548/3155] 10.222.0.23 () {60 vars in 1279 bytes} [Thu Aug 4 16:51:44 2022] POST /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d/action => generated 170 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:51:44.663039 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a01be776-a63f-4cc6-84c4-9ca334e59681 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '.version_select at 0x7f7e8504f4c0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:44.692167 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-a01be776-a63f-4cc6-84c4-9ca334e59681 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] HTTP exception thrown: Image not found. Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a01be776-a63f-4cc6-84c4-9ca334e59681 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Request method failure captured: Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/images/424dce4c-9c5b-4295-bdcb-b0322621a2a5 HTTP/1.1 Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_jaIFQsvdDRq7ekzpKpaUdeG9RQ8sRqB0RVu8K0-1usQLyXf0BqO8bECFhERXc7ENKwGW5hp5Jl2YUuzmhqVAvqNq_sLNEMxfA77PUnMxhVwNvM7g7I6bz2N9D9ugLcBFOQ3n6gM0iCfIoLUhdrol0zuMl7QyBwgiLVeMBC4cPmmIM Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: c96b36239054414182544ccfe7550cd9 Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ImagesOneServerTestJSON-1892066733 Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c96b36239054414182544ccfe7550cd9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c96b36239054414182544ccfe7550cd9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c96b36239054414182544ccfe7550cd9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c96b36239054414182544ccfe7550cd9"}]}] Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ImagesOneServerTestJSON-1892066733 Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: c96b36239054414182544ccfe7550cd9 Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1892066733 Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ImagesOneServerTestJSON-1892066733-project Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: eb4c0d6fac94470d9665f19021d50007 Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ImagesOneServerTestJSON-1892066733-project Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: exception: Image not found. Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '424dce4c-9c5b-4295-bdcb-b0322621a2a5'} Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 424dce4c-9c5b-4295-bdcb-b0322621a2a5 Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 16:51:44.694412 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 424dce4c-9c5b-4295-bdcb-b0322621a2a5 could not be found. Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a01be776-a63f-4cc6-84c4-9ca334e59681 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Returning 404 to user: Image not found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:51:44.698659 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a01be776-a63f-4cc6-84c4-9ca334e59681 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/images/424dce4c-9c5b-4295-bdcb-b0322621a2a5" status: 404 len: 62 microversion: 2.1 time: 0.037216 Aug 04 16:51:44.703845 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1549/3156] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:44 2022] GET /compute/v2.1/images/424dce4c-9c5b-4295-bdcb-b0322621a2a5 => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:51:44.710431 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-276002aa-8c7a-4473-be71-a69e3e3b8e84 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:44.711170 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-276002aa-8c7a-4473-be71-a69e3e3b8e84 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 316d48b7-d25a-4666-90ce-1fba8a600987] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:44.719034 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-276002aa-8c7a-4473-be71-a69e3e3b8e84 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:44.719393 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-276002aa-8c7a-4473-be71-a69e3e3b8e84 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:44.720171 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-276002aa-8c7a-4473-be71-a69e3e3b8e84 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:44.720602 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-276002aa-8c7a-4473-be71-a69e3e3b8e84 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:45.013274 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-276002aa-8c7a-4473-be71-a69e3e3b8e84 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:45.033198 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-276002aa-8c7a-4473-be71-a69e3e3b8e84 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/316d48b7-d25a-4666-90ce-1fba8a600987" status: 200 len: 1465 microversion: 2.1 time: 0.328204 Aug 04 16:51:45.048064 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1550/3157] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:44 2022] GET /compute/v2.1/servers/316d48b7-d25a-4666-90ce-1fba8a600987 => generated 1465 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:45.056131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-986db55b-47e6-4307-878f-aa54f3948dc3 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:45.057181 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-986db55b-47e6-4307-878f-aa54f3948dc3 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 30109352-6d98-4d4c-8613-96cfd959e86d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:45.064709 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-986db55b-47e6-4307-878f-aa54f3948dc3 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:45.065489 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-986db55b-47e6-4307-878f-aa54f3948dc3 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:45.066567 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-986db55b-47e6-4307-878f-aa54f3948dc3 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:45.067223 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-986db55b-47e6-4307-878f-aa54f3948dc3 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:45.134573 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-084e032b-c21a-46d3-8156-a5d1510abb6d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:45.151010 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-084e032b-c21a-46d3-8156-a5d1510abb6d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:45.154188 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-084e032b-c21a-46d3-8156-a5d1510abb6d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:45.161612 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-084e032b-c21a-46d3-8156-a5d1510abb6d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1875 microversion: 2.42 time: 0.577250 Aug 04 16:51:45.176355 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1608/3158] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:51:44 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1875 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:51:45.177820 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-852149d8-cefd-4b21-b2f5-8f52f8ad2842 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-31331606"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:51:45.182041 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-852149d8-cefd-4b21-b2f5-8f52f8ad2842 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] [instance: f91fdc58-3e45-4fc2-8bae-bda8292c908d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:45.192322 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-852149d8-cefd-4b21-b2f5-8f52f8ad2842 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:45.193225 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-852149d8-cefd-4b21-b2f5-8f52f8ad2842 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:45.194213 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-852149d8-cefd-4b21-b2f5-8f52f8ad2842 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:45.194809 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-852149d8-cefd-4b21-b2f5-8f52f8ad2842 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:45.463343 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-852149d8-cefd-4b21-b2f5-8f52f8ad2842 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "POST /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d/action" status: 202 len: 0 microversion: 2.1 time: 0.297819 Aug 04 16:51:45.464083 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1609/3159] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:51:45 2022] POST /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 16:51:45.484846 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-82a1beb9-dc9e-4440-9ac6-092e289b2fac tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '.version_select at 0x7f7e84d0edc0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:45.549120 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-986db55b-47e6-4307-878f-aa54f3948dc3 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:45.564971 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-986db55b-47e6-4307-878f-aa54f3948dc3 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d" status: 200 len: 1522 microversion: 2.1 time: 0.515423 Aug 04 16:51:45.566224 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1551/3160] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:45 2022] GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d => generated 1522 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:45.573700 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-82a1beb9-dc9e-4440-9ac6-092e289b2fac tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5" status: 200 len: 1427 microversion: 2.1 time: 0.099419 Aug 04 16:51:45.574754 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1610/3161] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:45 2022] GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5 => generated 1427 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:45.595022 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9598a4a7-1614-4744-b0ac-1aa899cb7dd2 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e84e37310>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:45.615412 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ec19c695-dc03-4e2a-ac23-97a84bf86d58 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:45.620959 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ec19c695-dc03-4e2a-ac23-97a84bf86d58 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 30109352-6d98-4d4c-8613-96cfd959e86d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:45.637799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec19c695-dc03-4e2a-ac23-97a84bf86d58 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:45.638292 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec19c695-dc03-4e2a-ac23-97a84bf86d58 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:45.639030 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec19c695-dc03-4e2a-ac23-97a84bf86d58 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:45.639433 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec19c695-dc03-4e2a-ac23-97a84bf86d58 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:45.662085 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9598a4a7-1614-4744-b0ac-1aa899cb7dd2 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/cc4c2019-5133-489d-8cd9-14d922790c64" status: 200 len: 1463 microversion: 2.1 time: 0.071222 Aug 04 16:51:45.663417 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1552/3162] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:45 2022] GET /compute/v2.1/images/cc4c2019-5133-489d-8cd9-14d922790c64 => generated 1463 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:45.676859 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3ca39737-06d2-4794-bd4e-20b1bc432da6 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e84b6f9d0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:45.731292 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3ca39737-06d2-4794-bd4e-20b1bc432da6 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/cc4c2019-5133-489d-8cd9-14d922790c64" status: 200 len: 1463 microversion: 2.1 time: 0.058076 Aug 04 16:51:45.739879 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1553/3163] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:45 2022] GET /compute/v2.1/images/cc4c2019-5133-489d-8cd9-14d922790c64 => generated 1463 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:51:45.746500 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6a538b7d-6aa8-4229-bb58-40371a24ef0b tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:45.747987 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6a538b7d-6aa8-4229-bb58-40371a24ef0b tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] [instance: 9139a17d-927c-4595-a7ff-11a1fa3a6a69] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:45.755626 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a538b7d-6aa8-4229-bb58-40371a24ef0b tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:45.756071 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a538b7d-6aa8-4229-bb58-40371a24ef0b tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:45.756847 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a538b7d-6aa8-4229-bb58-40371a24ef0b tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:45.757343 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a538b7d-6aa8-4229-bb58-40371a24ef0b tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:46.023163 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ec19c695-dc03-4e2a-ac23-97a84bf86d58 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:46.032525 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ec19c695-dc03-4e2a-ac23-97a84bf86d58 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d" status: 200 len: 1522 microversion: 2.1 time: 0.436224 Aug 04 16:51:46.046931 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1611/3164] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:45 2022] GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d => generated 1522 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:51:46.055064 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c1a8b9e9-eb94-4e1d-bdc0-0f424f34333b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:46.055871 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c1a8b9e9-eb94-4e1d-bdc0-0f424f34333b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 316d48b7-d25a-4666-90ce-1fba8a600987] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:46.063947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c1a8b9e9-eb94-4e1d-bdc0-0f424f34333b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:46.064282 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c1a8b9e9-eb94-4e1d-bdc0-0f424f34333b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:46.065451 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c1a8b9e9-eb94-4e1d-bdc0-0f424f34333b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:46.066072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c1a8b9e9-eb94-4e1d-bdc0-0f424f34333b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:46.317176 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c1a8b9e9-eb94-4e1d-bdc0-0f424f34333b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:46.325978 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c1a8b9e9-eb94-4e1d-bdc0-0f424f34333b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/316d48b7-d25a-4666-90ce-1fba8a600987" status: 200 len: 1465 microversion: 2.1 time: 0.275530 Aug 04 16:51:46.326566 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1612/3165] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:46 2022] GET /compute/v2.1/servers/316d48b7-d25a-4666-90ce-1fba8a600987 => generated 1465 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:51:46.331783 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ab11518e-554f-4b1c-b333-a3bec05de8d9 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1460336436", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ab11518e-554f-4b1c-b333-a3bec05de8d9 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Request method failure captured: Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d/action HTTP/1.1 Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 619 Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_jtTPBPy4fXdQ0VJrZ7Fc7m71zszwq7ozUwryWnXkb5nfLRGrkK5ga8HzOO0RHGQ_JBzS6OyCZVWsMotLJPEGPUn58SVuz4Z61cosYCdd8YzpWwL0OdtEOtJV7MtqbPH74mZZtuOB-p1arvqTlVKRaIs7USdqyFhUTa2KSBwKWaYTU Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: eb9de718bdfb4d6dbf63c336dfde8d42 Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb9de718bdfb4d6dbf63c336dfde8d42"}]}] Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: eb9de718bdfb4d6dbf63c336dfde8d42 Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ImagesOneServerNegativeTestJSON-1002016988-project Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 50ace5409bc54123aad5e1bc071cc3dd Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988-project Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1460336436", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '30109352-6d98-4d4c-8613-96cfd959e86d', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1460336436', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:51:46.344610 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 16:51:46.347330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:46.352163 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ab11518e-554f-4b1c-b333-a3bec05de8d9 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:51:46.352163 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ab11518e-554f-4b1c-b333-a3bec05de8d9 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "POST /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d/action" status: 400 len: 938 microversion: 2.1 time: 0.018741 Aug 04 16:51:46.354202 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1613/3166] 10.222.0.23 () {60 vars in 1279 bytes} [Thu Aug 4 16:51:46 2022] POST /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d/action => generated 938 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:51:46.359260 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2a67095d-49c9-48e3-be6b-6b1372619401 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:46.359882 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2a67095d-49c9-48e3-be6b-6b1372619401 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:46.369978 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6a538b7d-6aa8-4229-bb58-40371a24ef0b tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad56451fe41482585833461124f0497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3731044d35c449289d1000d0628d06c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:46.374596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2a67095d-49c9-48e3-be6b-6b1372619401 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:46.375041 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2a67095d-49c9-48e3-be6b-6b1372619401 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:46.375832 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2a67095d-49c9-48e3-be6b-6b1372619401 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:46.376261 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2a67095d-49c9-48e3-be6b-6b1372619401 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:46.383748 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6a538b7d-6aa8-4229-bb58-40371a24ef0b tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/servers/9139a17d-927c-4595-a7ff-11a1fa3a6a69" status: 200 len: 1468 microversion: 2.1 time: 0.641455 Aug 04 16:51:46.385826 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1554/3167] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:45 2022] GET /compute/v2.1/servers/9139a17d-927c-4595-a7ff-11a1fa3a6a69 => generated 1468 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:46.393250 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1d850164-54b1-4613-a622-532074d1db43 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:46.394978 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1d850164-54b1-4613-a622-532074d1db43 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 30109352-6d98-4d4c-8613-96cfd959e86d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:46.409889 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d850164-54b1-4613-a622-532074d1db43 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:46.410605 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d850164-54b1-4613-a622-532074d1db43 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:46.411862 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d850164-54b1-4613-a622-532074d1db43 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:46.412512 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d850164-54b1-4613-a622-532074d1db43 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:47.358432 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1d850164-54b1-4613-a622-532074d1db43 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:47.366496 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1d850164-54b1-4613-a622-532074d1db43 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d" status: 200 len: 1522 microversion: 2.1 time: 0.979298 Aug 04 16:51:47.378293 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1555/3168] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:46 2022] GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d => generated 1522 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:47.383995 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e62b8206-0fa2-4f65-9963-b258879e93a7 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e84b6f790>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:47.423421 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2a67095d-49c9-48e3-be6b-6b1372619401 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:47.438940 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2a67095d-49c9-48e3-be6b-6b1372619401 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:47.443409 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2a67095d-49c9-48e3-be6b-6b1372619401 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:47.444830 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2a67095d-49c9-48e3-be6b-6b1372619401 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1875 microversion: 2.42 time: 1.089622 Aug 04 16:51:47.461952 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1614/3169] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:51:46 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1875 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:51:47.469313 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ec3ea5a2-910c-4815-b975-89ff59c0692e tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '.version_select at 0x7f7e77ffa0d0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:47.501274 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e62b8206-0fa2-4f65-9963-b258879e93a7 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images?changes-since=2022-08-04T16%3A49%3A22Z" status: 200 len: 1902 microversion: 2.1 time: 0.132857 Aug 04 16:51:47.502664 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1556/3170] 10.222.0.23 () {58 vars in 1199 bytes} [Thu Aug 4 16:51:47 2022] GET /compute/v2.1/images?changes-since=2022-08-04T16%3A49%3A22Z => generated 1902 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:47.511485 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2c08ccdb-1da4-499d-a928-baca74fd8441 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:47.512375 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2c08ccdb-1da4-499d-a928-baca74fd8441 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 316d48b7-d25a-4666-90ce-1fba8a600987] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:47.520969 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2c08ccdb-1da4-499d-a928-baca74fd8441 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:47.522855 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2c08ccdb-1da4-499d-a928-baca74fd8441 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:47.523900 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2c08ccdb-1da4-499d-a928-baca74fd8441 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:47.524637 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2c08ccdb-1da4-499d-a928-baca74fd8441 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:47.545473 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ec3ea5a2-910c-4815-b975-89ff59c0692e tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5" status: 200 len: 1427 microversion: 2.1 time: 0.081638 Aug 04 16:51:47.546050 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1615/3171] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:47 2022] GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5 => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:47.558059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2a89de91-980f-4305-8472-5de93c766305 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:47.558680 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2a89de91-980f-4305-8472-5de93c766305 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 30109352-6d98-4d4c-8613-96cfd959e86d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:47.569984 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2a89de91-980f-4305-8472-5de93c766305 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:47.571033 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2a89de91-980f-4305-8472-5de93c766305 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:47.572157 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2a89de91-980f-4305-8472-5de93c766305 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:47.572838 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2a89de91-980f-4305-8472-5de93c766305 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:47.802449 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2c08ccdb-1da4-499d-a928-baca74fd8441 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:47.819537 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2c08ccdb-1da4-499d-a928-baca74fd8441 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/316d48b7-d25a-4666-90ce-1fba8a600987" status: 200 len: 1465 microversion: 2.1 time: 0.309110 Aug 04 16:51:47.823211 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1557/3172] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:47 2022] GET /compute/v2.1/servers/316d48b7-d25a-4666-90ce-1fba8a600987 => generated 1465 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:47.828878 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-979cb60a-549a-4f90-af96-39018154daf7 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e84b6ff70>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:47.917117 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-979cb60a-549a-4f90-af96-39018154daf7 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-599998507" status: 200 len: 484 microversion: 2.1 time: 0.092815 Aug 04 16:51:47.955543 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1558/3173] 10.222.0.23 () {58 vars in 1229 bytes} [Thu Aug 4 16:51:47 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-599998507 => generated 484 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:51:47.964061 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a8d8d86f-3c88-4bcb-a24e-895266f96ca3 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e84f58e50>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:48.096416 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a8d8d86f-3c88-4bcb-a24e-895266f96ca3 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images?server=9139a17d-927c-4595-a7ff-11a1fa3a6a69" status: 200 len: 957 microversion: 2.1 time: 0.139549 Aug 04 16:51:48.106389 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1559/3174] 10.222.0.23 () {58 vars in 1209 bytes} [Thu Aug 4 16:51:47 2022] GET /compute/v2.1/images?server=9139a17d-927c-4595-a7ff-11a1fa3a6a69 => generated 957 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:51:48.119133 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-49c31910-4d90-4977-8428-b2e7b22fad19 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e84e968b0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:48.211252 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2a89de91-980f-4305-8472-5de93c766305 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:48.221138 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2a89de91-980f-4305-8472-5de93c766305 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d" status: 200 len: 1522 microversion: 2.1 time: 0.666966 Aug 04 16:51:48.226439 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1616/3175] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:47 2022] GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d => generated 1522 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:48.231515 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-37dfe9d8-796a-4d54-ae42-6280b2b51e66 req-50e28b71-b09a-418e-9c43-3192e85cae20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "316d48b7-d25a-4666-90ce-1fba8a600987", "name": "network-vif-deleted", "tag": "6d7c513d-1bfc-4e16-86a7-5af2d7a2adf8"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:51:48.260720 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-37dfe9d8-796a-4d54-ae42-6280b2b51e66 req-50e28b71-b09a-418e-9c43-3192e85cae20 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:48.261742 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-37dfe9d8-796a-4d54-ae42-6280b2b51e66 req-50e28b71-b09a-418e-9c43-3192e85cae20 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:48.276357 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-49c31910-4d90-4977-8428-b2e7b22fad19 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2F800296f7-67da-4f41-aea4-e7e1af65e6c2" status: 200 len: 485 microversion: 2.1 time: 0.168504 Aug 04 16:51:48.284720 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-37dfe9d8-796a-4d54-ae42-6280b2b51e66 req-50e28b71-b09a-418e-9c43-3192e85cae20 service nova] Creating event network-vif-deleted:6d7c513d-1bfc-4e16-86a7-5af2d7a2adf8 for instance 316d48b7-d25a-4666-90ce-1fba8a600987 on n-h2-846466-12 Aug 04 16:51:48.287825 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1560/3176] 10.222.0.23 () {58 vars in 1317 bytes} [Thu Aug 4 16:51:48 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2F800296f7-67da-4f41-aea4-e7e1af65e6c2 => generated 485 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:51:48.300173 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e24a1cc0-c47c-4064-bb33-b0ad22008340 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:51:48.303539 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-37dfe9d8-796a-4d54-ae42-6280b2b51e66 req-50e28b71-b09a-418e-9c43-3192e85cae20 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075667 Aug 04 16:51:48.306110 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1617/3177] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e24a1cc0-c47c-4064-bb33-b0ad22008340 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Request method failure captured: Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d/action HTTP/1.1 Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 285 Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_jtTPBPy4fXdQ0VJrZ7Fc7m71zszwq7ozUwryWnXkb5nfLRGrkK5ga8HzOO0RHGQ_JBzS6OyCZVWsMotLJPEGPUn58SVuz4Z61cosYCdd8YzpWwL0OdtEOtJV7MtqbPH74mZZtuOB-p1arvqTlVKRaIs7USdqyFhUTa2KSBwKWaYTU Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: eb9de718bdfb4d6dbf63c336dfde8d42 Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb9de718bdfb4d6dbf63c336dfde8d42"}]}] Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: eb9de718bdfb4d6dbf63c336dfde8d42 Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ImagesOneServerNegativeTestJSON-1002016988-project Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 50ace5409bc54123aad5e1bc071cc3dd Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988-project Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '30109352-6d98-4d4c-8613-96cfd959e86d', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:48.312851 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:48.316374 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:48.316374 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:48.316374 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:48.316374 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:51:48.316374 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:51:48.316374 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:51:48.316374 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:51:48.316374 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:51:48.316374 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:51:48.316374 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 16:51:48.316374 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 16:51:48.316374 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:51:48.316374 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:51:48.316374 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:51:48.316374 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:51:48.316374 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 16:51:48.316374 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:48.316374 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:48.316374 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:48.316374 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:48.316374 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:48.316374 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:48.316374 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:51:48.316374 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:51:48.316374 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 16:51:48.316374 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:48.316374 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e24a1cc0-c47c-4064-bb33-b0ad22008340 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:51:48.319926 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e24a1cc0-c47c-4064-bb33-b0ad22008340 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "POST /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d/action" status: 400 len: 619 microversion: 2.1 time: 0.028543 Aug 04 16:51:48.324604 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1561/3178] 10.222.0.23 () {60 vars in 1279 bytes} [Thu Aug 4 16:51:48 2022] POST /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d/action => generated 619 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:51:48.327301 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-674b7c1d-489e-41ee-8721-e8df3c7cc03c tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e8492d310>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:48.340902 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-60b19bc1-e490-4ab2-9302-43a3d2178afe tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:48.341642 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-60b19bc1-e490-4ab2-9302-43a3d2178afe tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 30109352-6d98-4d4c-8613-96cfd959e86d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:48.363994 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-60b19bc1-e490-4ab2-9302-43a3d2178afe tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:48.365258 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-60b19bc1-e490-4ab2-9302-43a3d2178afe tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:48.366310 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-60b19bc1-e490-4ab2-9302-43a3d2178afe tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:48.366943 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-60b19bc1-e490-4ab2-9302-43a3d2178afe tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:48.404687 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:51:48.439514 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-674b7c1d-489e-41ee-8721-e8df3c7cc03c tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2F800296f7-67da-4f41-aea4-e7e1af65e6c2" status: 200 len: 485 microversion: 2.1 time: 0.132087 Aug 04 16:51:48.441390 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1618/3179] 10.222.0.23 () {58 vars in 1303 bytes} [Thu Aug 4 16:51:48 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2F800296f7-67da-4f41-aea4-e7e1af65e6c2 => generated 485 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:51:48.463901 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-701468f2-70a9-46c2-89e0-22d4fe2d18f5 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e841ca700>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:48.759475 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-701468f2-70a9-46c2-89e0-22d4fe2d18f5 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.303902 Aug 04 16:51:48.761014 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1619/3180] 10.222.0.23 () {58 vars in 1149 bytes} [Thu Aug 4 16:51:48 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:48.772957 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b1f8e7b6-50c2-4d9c-af83-e356fe1225b7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:48.775503 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b1f8e7b6-50c2-4d9c-af83-e356fe1225b7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:48.787224 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b1f8e7b6-50c2-4d9c-af83-e356fe1225b7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:48.788143 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b1f8e7b6-50c2-4d9c-af83-e356fe1225b7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:48.790253 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b1f8e7b6-50c2-4d9c-af83-e356fe1225b7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:48.791107 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b1f8e7b6-50c2-4d9c-af83-e356fe1225b7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:48.816035 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-60b19bc1-e490-4ab2-9302-43a3d2178afe tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:48.824957 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-60b19bc1-e490-4ab2-9302-43a3d2178afe tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d" status: 200 len: 1522 microversion: 2.1 time: 0.499272 Aug 04 16:51:48.825866 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1562/3181] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:48 2022] GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d => generated 1522 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:48.840362 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-aa7e77b5-afbe-4a57-ac23-15c2d278862e req-a03d7af3-b727-4ad6-9f03-5976ae0bfbd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9139a17d-927c-4595-a7ff-11a1fa3a6a69", "name": "network-vif-unplugged", "status": "completed", "tag": "ec13d30d-7a89-4d60-b71e-301109f0b912"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:51:48.864027 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-aa7e77b5-afbe-4a57-ac23-15c2d278862e req-a03d7af3-b727-4ad6-9f03-5976ae0bfbd1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:48.869730 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-aa7e77b5-afbe-4a57-ac23-15c2d278862e req-a03d7af3-b727-4ad6-9f03-5976ae0bfbd1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:48.895801 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-aa7e77b5-afbe-4a57-ac23-15c2d278862e req-a03d7af3-b727-4ad6-9f03-5976ae0bfbd1 service nova] Creating event network-vif-unplugged:ec13d30d-7a89-4d60-b71e-301109f0b912 for instance 9139a17d-927c-4595-a7ff-11a1fa3a6a69 on n-h1-846466-12 Aug 04 16:51:48.901955 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-aa7e77b5-afbe-4a57-ac23-15c2d278862e req-a03d7af3-b727-4ad6-9f03-5976ae0bfbd1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073617 Aug 04 16:51:48.903410 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1563/3182] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:51:48.909766 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4caf61f7-8bb1-446d-92af-b6a631ba97c7 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '.version_select at 0x7f7e84b6f3a0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:48.988806 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4caf61f7-8bb1-446d-92af-b6a631ba97c7 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5" status: 200 len: 1427 microversion: 2.1 time: 0.083783 Aug 04 16:51:48.995619 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1564/3183] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:48 2022] GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5 => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:49.000576 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0cf10321-d1fa-4ae3-9771-467899fb2503 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e84e33d30>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:49.225789 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0cf10321-d1fa-4ae3-9771-467899fb2503 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.228813 Aug 04 16:51:49.226714 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1565/3184] 10.222.0.23 () {58 vars in 1149 bytes} [Thu Aug 4 16:51:48 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:49.244368 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6397144b-1d65-4ff0-985e-083f0330d4cc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:49.245696 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6397144b-1d65-4ff0-985e-083f0330d4cc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 316d48b7-d25a-4666-90ce-1fba8a600987] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:49.259247 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6397144b-1d65-4ff0-985e-083f0330d4cc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:49.262941 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6397144b-1d65-4ff0-985e-083f0330d4cc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:49.264011 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6397144b-1d65-4ff0-985e-083f0330d4cc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:49.264987 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6397144b-1d65-4ff0-985e-083f0330d4cc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:49.291139 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-6397144b-1d65-4ff0-985e-083f0330d4cc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] HTTP exception thrown: Instance 316d48b7-d25a-4666-90ce-1fba8a600987 could not be found. Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6397144b-1d65-4ff0-985e-083f0330d4cc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Request method failure captured: Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/316d48b7-d25a-4666-90ce-1fba8a600987 HTTP/1.1 Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_abSC_qd4PHP0W808xgrI7Q0G4tlPTiB2-LAH-LZMv8d9UcRN9ZCFy6_giyx-c7RjiKNjELhrKAi_ora1AVfsDng4FTG7brYif3-z0rtdjlkilo5AULdT4A615Ra8__IvKNYC3N__kBvOWqowuttGiKr7m7ap4YyjQHEc3cVcyVFSU Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 96ce955c9158463e9e98c53b99c581ec Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServerActionsTestJSON-697118571 Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96ce955c9158463e9e98c53b99c581ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_96ce955c9158463e9e98c53b99c581ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96ce955c9158463e9e98c53b99c581ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/96ce955c9158463e9e98c53b99c581ec"}]}] Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServerActionsTestJSON-697118571 Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 96ce955c9158463e9e98c53b99c581ec Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServerActionsTestJSON-697118571 Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServerActionsTestJSON-697118571-project Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 438d083dc9e74b2f8970455505791250 Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServerActionsTestJSON-697118571-project Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 316d48b7-d25a-4666-90ce-1fba8a600987 could not be found. Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '316d48b7-d25a-4666-90ce-1fba8a600987'} Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 316d48b7-d25a-4666-90ce-1fba8a600987 could not be found. Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 316d48b7-d25a-4666-90ce-1fba8a600987 could not be found. Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:49.293235 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:49.298571 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:49.298571 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:49.298571 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:49.298571 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:51:49.298571 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:51:49.298571 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 316d48b7-d25a-4666-90ce-1fba8a600987 could not be found. Aug 04 16:51:49.298571 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:51:49.298571 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6397144b-1d65-4ff0-985e-083f0330d4cc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Returning 404 to user: Instance 316d48b7-d25a-4666-90ce-1fba8a600987 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:51:49.298571 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6397144b-1d65-4ff0-985e-083f0330d4cc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/316d48b7-d25a-4666-90ce-1fba8a600987" status: 404 len: 111 microversion: 2.1 time: 0.056855 Aug 04 16:51:49.299883 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1566/3185] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:49 2022] GET /compute/v2.1/servers/316d48b7-d25a-4666-90ce-1fba8a600987 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:51:49.303921 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-12bccf84-90e0-4c60-be44-cb3cc1ad98f1 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:49.304538 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-12bccf84-90e0-4c60-be44-cb3cc1ad98f1 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 30109352-6d98-4d4c-8613-96cfd959e86d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:49.311495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-12bccf84-90e0-4c60-be44-cb3cc1ad98f1 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:49.312380 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-12bccf84-90e0-4c60-be44-cb3cc1ad98f1 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:49.314018 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-12bccf84-90e0-4c60-be44-cb3cc1ad98f1 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:49.316113 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-12bccf84-90e0-4c60-be44-cb3cc1ad98f1 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:49.514017 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b1f8e7b6-50c2-4d9c-af83-e356fe1225b7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:49.534414 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b1f8e7b6-50c2-4d9c-af83-e356fe1225b7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:49.538742 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b1f8e7b6-50c2-4d9c-af83-e356fe1225b7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:49.542998 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b1f8e7b6-50c2-4d9c-af83-e356fe1225b7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1875 microversion: 2.42 time: 0.778842 Aug 04 16:51:49.544393 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1620/3186] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:51:48 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1875 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:51:49.551600 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4631fd7a-c416-45c7-96e6-6507934a8716 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e84da59d0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:49.634805 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4631fd7a-c416-45c7-96e6-6507934a8716 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.087219 Aug 04 16:51:49.635320 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1621/3187] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Aug 4 16:51:49 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:51:49.645176 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9ad5b3f0-b9fb-47ca-8390-fd7fbfcd5eb1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:49.646220 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9ad5b3f0-b9fb-47ca-8390-fd7fbfcd5eb1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:49.657594 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9ad5b3f0-b9fb-47ca-8390-fd7fbfcd5eb1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:49.659699 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9ad5b3f0-b9fb-47ca-8390-fd7fbfcd5eb1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:49.661387 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9ad5b3f0-b9fb-47ca-8390-fd7fbfcd5eb1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:49.662020 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9ad5b3f0-b9fb-47ca-8390-fd7fbfcd5eb1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:49.672440 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:51:49.702019 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9ad5b3f0-b9fb-47ca-8390-fd7fbfcd5eb1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:51:49.729937 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-12bccf84-90e0-4c60-be44-cb3cc1ad98f1 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:49.755763 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-12bccf84-90e0-4c60-be44-cb3cc1ad98f1 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d" status: 200 len: 1522 microversion: 2.1 time: 0.455529 Aug 04 16:51:49.758196 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1567/3188] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:49 2022] GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d => generated 1522 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:49.780324 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-36b6f631-1d71-4856-89b9-9c4a7343dda5 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e8504f4c0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:49.885774 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9ad5b3f0-b9fb-47ca-8390-fd7fbfcd5eb1 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433" status: 204 len: 0 microversion: 2.1 time: 0.248667 Aug 04 16:51:49.893861 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1622/3189] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:51:49 2022] DELETE /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:51:49.904789 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-503f6c62-6cb0-4f40-9a61-558852036ca2 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-903221858"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:51:49.909981 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-503f6c62-6cb0-4f40-9a61-558852036ca2 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 30109352-6d98-4d4c-8613-96cfd959e86d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:49.915211 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-36b6f631-1d71-4856-89b9-9c4a7343dda5 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/detail?changes-since=2022-08-04T16%3A49%3A14Z" status: 200 len: 6332 microversion: 2.1 time: 0.154936 Aug 04 16:51:49.919084 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-503f6c62-6cb0-4f40-9a61-558852036ca2 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:49.920720 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-503f6c62-6cb0-4f40-9a61-558852036ca2 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:49.922203 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-503f6c62-6cb0-4f40-9a61-558852036ca2 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:49.923637 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-503f6c62-6cb0-4f40-9a61-558852036ca2 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:49.930512 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1568/3190] 10.222.0.23 () {58 vars in 1220 bytes} [Thu Aug 4 16:51:49 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-04T16%3A49%3A14Z => generated 6332 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:49.941569 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-36d276f4-d87b-4350-a39b-f46f59c45be3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:49.942490 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-36d276f4-d87b-4350-a39b-f46f59c45be3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:49.953514 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-36d276f4-d87b-4350-a39b-f46f59c45be3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:49.954247 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-36d276f4-d87b-4350-a39b-f46f59c45be3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:49.955212 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-36d276f4-d87b-4350-a39b-f46f59c45be3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:49.955807 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-36d276f4-d87b-4350-a39b-f46f59c45be3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:50.332844 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-503f6c62-6cb0-4f40-9a61-558852036ca2 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "POST /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d/action" status: 202 len: 0 microversion: 2.1 time: 0.436449 Aug 04 16:51:50.336346 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1623/3191] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:51:49 2022] POST /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d/action => generated 0 bytes in 442 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 16:51:50.351428 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-feafe3a4-4372-4d8a-bb26-631d7b33f4ea tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e84d8b4c0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:50.430011 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-feafe3a4-4372-4d8a-bb26-631d7b33f4ea tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-599998507" status: 200 len: 664 microversion: 2.1 time: 0.090487 Aug 04 16:51:50.430727 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1624/3192] 10.222.0.23 () {58 vars in 1250 bytes} [Thu Aug 4 16:51:50 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-599998507 => generated 664 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:51:50.463122 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e71efe03-1188-44a9-8ddf-22a66e6172a8 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '.version_select at 0x7f7e8479eca0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:50.557542 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e71efe03-1188-44a9-8ddf-22a66e6172a8 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5" status: 200 len: 1427 microversion: 2.1 time: 0.114005 Aug 04 16:51:50.574409 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1625/3193] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:50 2022] GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5 => generated 1427 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:50.592327 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-562e38c4-4e1b-4a21-a822-2ba7d5574f76 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-602551257"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:51:50.601544 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-562e38c4-4e1b-4a21-a822-2ba7d5574f76 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 30109352-6d98-4d4c-8613-96cfd959e86d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:50.623942 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-562e38c4-4e1b-4a21-a822-2ba7d5574f76 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:50.627329 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-562e38c4-4e1b-4a21-a822-2ba7d5574f76 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:50.630763 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-562e38c4-4e1b-4a21-a822-2ba7d5574f76 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:50.633558 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-562e38c4-4e1b-4a21-a822-2ba7d5574f76 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:50.697503 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-562e38c4-4e1b-4a21-a822-2ba7d5574f76 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] HTTP exception thrown: Cannot 'createImage' instance 30109352-6d98-4d4c-8613-96cfd959e86d while it is in task_state image_snapshot Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-562e38c4-4e1b-4a21-a822-2ba7d5574f76 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Request method failure captured: Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d/action HTTP/1.1 Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 84 Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_jtTPBPy4fXdQ0VJrZ7Fc7m71zszwq7ozUwryWnXkb5nfLRGrkK5ga8HzOO0RHGQ_JBzS6OyCZVWsMotLJPEGPUn58SVuz4Z61cosYCdd8YzpWwL0OdtEOtJV7MtqbPH74mZZtuOB-p1arvqTlVKRaIs7USdqyFhUTa2KSBwKWaYTU Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: eb9de718bdfb4d6dbf63c336dfde8d42 Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb9de718bdfb4d6dbf63c336dfde8d42"}]}] Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: eb9de718bdfb4d6dbf63c336dfde8d42 Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ImagesOneServerNegativeTestJSON-1002016988-project Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 50ace5409bc54123aad5e1bc071cc3dd Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988-project Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-602551257"}} Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: exception: Cannot 'createImage' instance 30109352-6d98-4d4c-8613-96cfd959e86d while it is in task_state image_snapshot Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '30109352-6d98-4d4c-8613-96cfd959e86d', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-602551257'}}} Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 30109352-6d98-4d4c-8613-96cfd959e86d in task_state image_snapshot. Cannot snapshot while the instance is in this state. Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 16:51:50.702432 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 30109352-6d98-4d4c-8613-96cfd959e86d while it is in task_state image_snapshot Aug 04 16:51:50.707549 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:50.707549 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:50.707549 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:50.707549 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:50.707549 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:50.707549 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:50.707549 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:51:50.707549 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:51:50.707549 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 30109352-6d98-4d4c-8613-96cfd959e86d while it is in task_state image_snapshot Aug 04 16:51:50.707549 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:50.711766 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-562e38c4-4e1b-4a21-a822-2ba7d5574f76 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Returning 409 to user: Cannot 'createImage' instance 30109352-6d98-4d4c-8613-96cfd959e86d while it is in task_state image_snapshot {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:51:50.715048 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-562e38c4-4e1b-4a21-a822-2ba7d5574f76 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "POST /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d/action" status: 409 len: 159 microversion: 2.1 time: 0.138133 Aug 04 16:51:50.717084 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1626/3194] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:51:50 2022] POST /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d/action => generated 159 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:51:50.729031 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-60408b7d-7473-4022-a695-4135aec68097 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e847bd9d0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:50.820667 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-60408b7d-7473-4022-a695-4135aec68097 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2F800296f7-67da-4f41-aea4-e7e1af65e6c2" status: 200 len: 1467 microversion: 2.1 time: 0.101469 Aug 04 16:51:50.821917 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1627/3195] 10.222.0.23 () {58 vars in 1338 bytes} [Thu Aug 4 16:51:50 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2F800296f7-67da-4f41-aea4-e7e1af65e6c2 => generated 1467 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:50.840485 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a5977069-172e-416f-bc65-137f9a8e2b6c tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:50.841377 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a5977069-172e-416f-bc65-137f9a8e2b6c tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:50.861240 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a5977069-172e-416f-bc65-137f9a8e2b6c tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:50.862069 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a5977069-172e-416f-bc65-137f9a8e2b6c tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:50.863789 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a5977069-172e-416f-bc65-137f9a8e2b6c tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:50.865648 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a5977069-172e-416f-bc65-137f9a8e2b6c tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:50.868418 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-36d276f4-d87b-4350-a39b-f46f59c45be3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:50.881635 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-36d276f4-d87b-4350-a39b-f46f59c45be3 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433" status: 200 len: 1506 microversion: 2.1 time: 0.949678 Aug 04 16:51:50.882476 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1569/3196] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:49 2022] GET /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433 => generated 1506 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:50.906606 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3dfdd211-0414-45c9-938e-a3723bce6bb0 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '.version_select at 0x7f7e84841ee0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:51.285233 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3dfdd211-0414-45c9-938e-a3723bce6bb0 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "DELETE /compute/v2.1/images/41f0ca97-276b-4b80-b276-8ab9ca607ed9" status: 204 len: 0 microversion: 2.1 time: 0.399992 Aug 04 16:51:51.286776 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1570/3197] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:50 2022] DELETE /compute/v2.1/images/41f0ca97-276b-4b80-b276-8ab9ca607ed9 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:51:51.304755 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-486f319d-0b4b-4399-9327-a727a052ab27 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e84841dc0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:51.411054 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-486f319d-0b4b-4399-9327-a727a052ab27 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2F800296f7-67da-4f41-aea4-e7e1af65e6c2" status: 200 len: 1467 microversion: 2.1 time: 0.119183 Aug 04 16:51:51.411992 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1571/3198] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Aug 4 16:51:51 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2F800296f7-67da-4f41-aea4-e7e1af65e6c2 => generated 1467 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:51.426266 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-12a723c9-f7ae-4b0f-9ab6-ee295a2681ab req-d1a1ca72-8d2f-45ad-b6e6-410be4386523 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f91fdc58-3e45-4fc2-8bae-bda8292c908d", "name": "network-vif-plugged", "status": "completed", "tag": "8310e003-7985-4b7a-81eb-81193a3418ab"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:51:51.444827 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-12a723c9-f7ae-4b0f-9ab6-ee295a2681ab req-d1a1ca72-8d2f-45ad-b6e6-410be4386523 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:51.445651 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-12a723c9-f7ae-4b0f-9ab6-ee295a2681ab req-d1a1ca72-8d2f-45ad-b6e6-410be4386523 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:51.472531 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-12a723c9-f7ae-4b0f-9ab6-ee295a2681ab req-d1a1ca72-8d2f-45ad-b6e6-410be4386523 service nova] Creating event network-vif-plugged:8310e003-7985-4b7a-81eb-81193a3418ab for instance f91fdc58-3e45-4fc2-8bae-bda8292c908d on n-h1-846466-12 Aug 04 16:51:51.486135 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-12a723c9-f7ae-4b0f-9ab6-ee295a2681ab req-d1a1ca72-8d2f-45ad-b6e6-410be4386523 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070522 Aug 04 16:51:51.489479 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1572/3199] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:51:51.505137 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e1fed4c6-3648-429d-b585-74f1d85d17a1 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:51.505884 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e1fed4c6-3648-429d-b585-74f1d85d17a1 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 30109352-6d98-4d4c-8613-96cfd959e86d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:51.519343 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e1fed4c6-3648-429d-b585-74f1d85d17a1 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:51.519797 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e1fed4c6-3648-429d-b585-74f1d85d17a1 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:51.520604 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e1fed4c6-3648-429d-b585-74f1d85d17a1 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:51.521038 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e1fed4c6-3648-429d-b585-74f1d85d17a1 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:51.932394 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a5977069-172e-416f-bc65-137f9a8e2b6c tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:51.953008 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a5977069-172e-416f-bc65-137f9a8e2b6c tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:51.960189 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a5977069-172e-416f-bc65-137f9a8e2b6c tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:51.962749 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a5977069-172e-416f-bc65-137f9a8e2b6c tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1875 microversion: 2.42 time: 1.136456 Aug 04 16:51:51.968337 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1628/3200] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:51:50 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1875 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:51:51.982629 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ed2ce9fe-b68d-47f5-8f7c-062cbc695a51 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e850d7ca0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:52.226321 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ed2ce9fe-b68d-47f5-8f7c-062cbc695a51 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7107 microversion: 2.1 time: 0.256266 Aug 04 16:51:52.228532 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1629/3201] 10.222.0.23 () {58 vars in 1170 bytes} [Thu Aug 4 16:51:51 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7107 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:52.243172 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6cd09308-cfea-4e6f-9e97-708bd91d431c tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '.version_select at 0x7f7e841d9700>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:52.336089 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6cd09308-cfea-4e6f-9e97-708bd91d431c tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5" status: 200 len: 1427 microversion: 2.1 time: 0.106222 Aug 04 16:51:52.337968 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1630/3202] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:52 2022] GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5 => generated 1427 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:52.344160 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f83dc21e-0afa-49e0-b04e-d76bc99edca7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:52.345106 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f83dc21e-0afa-49e0-b04e-d76bc99edca7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:52.374183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f83dc21e-0afa-49e0-b04e-d76bc99edca7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:52.374422 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f83dc21e-0afa-49e0-b04e-d76bc99edca7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:52.379362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f83dc21e-0afa-49e0-b04e-d76bc99edca7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:52.380576 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f83dc21e-0afa-49e0-b04e-d76bc99edca7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:52.895350 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e1fed4c6-3648-429d-b585-74f1d85d17a1 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:52.896235 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f83dc21e-0afa-49e0-b04e-d76bc99edca7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:52.907193 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f83dc21e-0afa-49e0-b04e-d76bc99edca7 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433" status: 200 len: 1464 microversion: 2.1 time: 0.567244 Aug 04 16:51:52.913537 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e1fed4c6-3648-429d-b585-74f1d85d17a1 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d" status: 200 len: 1534 microversion: 2.1 time: 1.422519 Aug 04 16:51:52.914521 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1573/3203] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:51 2022] GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d => generated 1534 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:52.921417 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b5e7ae01-b596-4432-b850-e83fccfb300a tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e8484c1f0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:52.923232 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1631/3204] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:52 2022] GET /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433 => generated 1464 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:52.992115 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-84cf7b50-14dd-49c6-bb3c-30aedcee2c59 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:52.993695 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-84cf7b50-14dd-49c6-bb3c-30aedcee2c59 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:53.011471 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-84cf7b50-14dd-49c6-bb3c-30aedcee2c59 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:53.021724 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-84cf7b50-14dd-49c6-bb3c-30aedcee2c59 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:53.023171 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-84cf7b50-14dd-49c6-bb3c-30aedcee2c59 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:53.024843 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-84cf7b50-14dd-49c6-bb3c-30aedcee2c59 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:53.132612 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b5e7ae01-b596-4432-b850-e83fccfb300a tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.214986 Aug 04 16:51:53.133659 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1574/3205] 10.222.0.23 () {58 vars in 1170 bytes} [Thu Aug 4 16:51:52 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:53.149944 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-be8b9058-c6fb-4cc8-9300-e345a488ac30 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e8504fdc0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:53.278933 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-be8b9058-c6fb-4cc8-9300-e345a488ac30 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/58d80c01-1581-4a2f-bbb0-c2eaf1affa00" status: 200 len: 784 microversion: 2.1 time: 0.128036 Aug 04 16:51:53.287581 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1575/3206] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:53 2022] GET /compute/v2.1/images/58d80c01-1581-4a2f-bbb0-c2eaf1affa00 => generated 784 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:51:53.304200 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ad823b07-ca02-46d7-b8f5-871bda8abe23 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e8498aaf0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:53.415695 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ad823b07-ca02-46d7-b8f5-871bda8abe23 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.117878 Aug 04 16:51:53.418941 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1576/3207] 10.222.0.23 () {58 vars in 1158 bytes} [Thu Aug 4 16:51:53 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:53.430723 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f7827306-93a7-4da0-87ce-aaa2b3c3c7ab tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '.version_select at 0x7f7e77f389d0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:53.553933 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f7827306-93a7-4da0-87ce-aaa2b3c3c7ab tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5" status: 200 len: 1427 microversion: 2.1 time: 0.133312 Aug 04 16:51:53.567170 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1577/3208] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:53 2022] GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5 => generated 1427 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:53.594766 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f6d28ac8-64d6-4258-a557-65017e97d978 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e8498a430>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:54.525548 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-84cf7b50-14dd-49c6-bb3c-30aedcee2c59 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:54.540616 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-84cf7b50-14dd-49c6-bb3c-30aedcee2c59 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:54.547346 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-84cf7b50-14dd-49c6-bb3c-30aedcee2c59 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:54.553041 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-84cf7b50-14dd-49c6-bb3c-30aedcee2c59 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1875 microversion: 2.42 time: 1.564746 Aug 04 16:51:54.557688 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1632/3209] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:51:52 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1875 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:51:54.563291 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a710c6e6-3591-4a91-9214-a17ff970833f tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:54.570286 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a710c6e6-3591-4a91-9214-a17ff970833f tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 30109352-6d98-4d4c-8613-96cfd959e86d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:54.597446 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a710c6e6-3591-4a91-9214-a17ff970833f tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:54.597446 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a710c6e6-3591-4a91-9214-a17ff970833f tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:54.597446 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a710c6e6-3591-4a91-9214-a17ff970833f tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:54.597446 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a710c6e6-3591-4a91-9214-a17ff970833f tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:54.982788 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a710c6e6-3591-4a91-9214-a17ff970833f tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:54.997171 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a710c6e6-3591-4a91-9214-a17ff970833f tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d" status: 200 len: 1522 microversion: 2.1 time: 0.437438 Aug 04 16:51:55.001306 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1633/3210] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:54 2022] GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d => generated 1522 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:55.025049 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c8b58f6b-9822-4033-98eb-5b07f77660c0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:55.026009 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c8b58f6b-9822-4033-98eb-5b07f77660c0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:55.042468 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c8b58f6b-9822-4033-98eb-5b07f77660c0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:55.043731 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c8b58f6b-9822-4033-98eb-5b07f77660c0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:55.045358 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c8b58f6b-9822-4033-98eb-5b07f77660c0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:55.047485 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c8b58f6b-9822-4033-98eb-5b07f77660c0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:55.085413 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-c8b58f6b-9822-4033-98eb-5b07f77660c0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] HTTP exception thrown: Instance 3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433 could not be found. Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c8b58f6b-9822-4033-98eb-5b07f77660c0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Request method failure captured: Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433 HTTP/1.1 Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_abSC_qd4PHP0W808xgrI7Q0G4tlPTiB2-LAH-LZMv8d9UcRN9ZCFy6_giyx-c7RjiKNjELhrKAi_ora1AVfsDng4FTG7brYif3-z0rtdjlkilo5AULdT4A615Ra8__IvKNYC3N__kBvOWqowuttGiKr7m7ap4YyjQHEc3cVcyVFSU Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 96ce955c9158463e9e98c53b99c581ec Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerActionsTestJSON-697118571 Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96ce955c9158463e9e98c53b99c581ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_96ce955c9158463e9e98c53b99c581ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96ce955c9158463e9e98c53b99c581ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/96ce955c9158463e9e98c53b99c581ec"}]}] Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerActionsTestJSON-697118571 Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 96ce955c9158463e9e98c53b99c581ec Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerActionsTestJSON-697118571 Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerActionsTestJSON-697118571-project Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 438d083dc9e74b2f8970455505791250 Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerActionsTestJSON-697118571-project Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433 could not be found. Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433'} Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433 could not be found. Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433 could not be found. Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:51:55.088100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:55.092644 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:51:55.092644 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:51:55.092644 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:51:55.092644 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:51:55.092644 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:51:55.092644 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433 could not be found. Aug 04 16:51:55.092644 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:51:55.094737 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c8b58f6b-9822-4033-98eb-5b07f77660c0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Returning 404 to user: Instance 3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:51:55.096064 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c8b58f6b-9822-4033-98eb-5b07f77660c0 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433" status: 404 len: 111 microversion: 2.1 time: 0.093058 Aug 04 16:51:55.096883 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1634/3211] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:55 2022] GET /compute/v2.1/servers/3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:51:55.106070 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-bcbb3a7a-1260-4185-b3df-40ce791a5247 req-d9520f64-384e-4635-9505-6dcc5eb86fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433", "name": "network-vif-deleted", "tag": "a0e9ef94-e4ce-4bcf-8c9b-274f319b2855"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:51:55.116906 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-bcbb3a7a-1260-4185-b3df-40ce791a5247 req-d9520f64-384e-4635-9505-6dcc5eb86fb8 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:55.117936 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-bcbb3a7a-1260-4185-b3df-40ce791a5247 req-d9520f64-384e-4635-9505-6dcc5eb86fb8 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:55.144112 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-bcbb3a7a-1260-4185-b3df-40ce791a5247 req-d9520f64-384e-4635-9505-6dcc5eb86fb8 service nova] Creating event network-vif-deleted:a0e9ef94-e4ce-4bcf-8c9b-274f319b2855 for instance 3ff1b6c9-4138-4b9e-b3c6-7eb4d4f1d433 on n-h2-846466-12 Aug 04 16:51:55.152330 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-bcbb3a7a-1260-4185-b3df-40ce791a5247 req-d9520f64-384e-4635-9505-6dcc5eb86fb8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050309 Aug 04 16:51:55.153812 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1635/3212] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:51:55.164700 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b291a623-6d0b-4451-8ba8-e0488047a787 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '.version_select at 0x7f7e846320d0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:55.305937 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f6d28ac8-64d6-4258-a557-65017e97d978 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "DELETE /compute/v2.1/images/cc4c2019-5133-489d-8cd9-14d922790c64" status: 204 len: 0 microversion: 2.1 time: 1.736056 Aug 04 16:51:55.310978 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1578/3213] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:53 2022] DELETE /compute/v2.1/images/cc4c2019-5133-489d-8cd9-14d922790c64 => generated 0 bytes in 1739 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:51:55.323897 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f9d1f19e-ce42-4d10-a855-629ca72732a3 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:55.327892 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f9d1f19e-ce42-4d10-a855-629ca72732a3 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 30109352-6d98-4d4c-8613-96cfd959e86d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:55.359721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f9d1f19e-ce42-4d10-a855-629ca72732a3 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:55.361653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f9d1f19e-ce42-4d10-a855-629ca72732a3 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:55.364225 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f9d1f19e-ce42-4d10-a855-629ca72732a3 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:55.367184 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f9d1f19e-ce42-4d10-a855-629ca72732a3 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:55.377221 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b291a623-6d0b-4451-8ba8-e0488047a787 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5" status: 200 len: 1427 microversion: 2.1 time: 0.221792 Aug 04 16:51:55.378144 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1636/3214] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:55 2022] GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5 => generated 1427 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:55.383227 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6d3593e4-787e-4859-a686-1cfab3e420bd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:55.384750 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6d3593e4-787e-4859-a686-1cfab3e420bd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:55.392587 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d3593e4-787e-4859-a686-1cfab3e420bd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:55.393364 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d3593e4-787e-4859-a686-1cfab3e420bd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:55.401782 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d3593e4-787e-4859-a686-1cfab3e420bd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:55.402597 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d3593e4-787e-4859-a686-1cfab3e420bd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:55.418767 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f9d1f19e-ce42-4d10-a855-629ca72732a3 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 30109352-6d98-4d4c-8613-96cfd959e86d] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:51:55.448440 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6d3593e4-787e-4859-a686-1cfab3e420bd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:51:55.563784 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f9d1f19e-ce42-4d10-a855-629ca72732a3 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "DELETE /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d" status: 204 len: 0 microversion: 2.1 time: 0.248163 Aug 04 16:51:55.564874 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1579/3215] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:51:55 2022] DELETE /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:51:55.578729 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-44391668-1b59-45c9-a4ca-b1b2b31b48e8 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e8498a8b0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:55.601443 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6d3593e4-787e-4859-a686-1cfab3e420bd tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "DELETE /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217" status: 204 len: 0 microversion: 2.1 time: 0.221602 Aug 04 16:51:55.609681 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1637/3216] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:51:55 2022] DELETE /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:51:55.615685 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-950c6370-72a2-4107-973b-3915e2815117 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:55.621618 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-950c6370-72a2-4107-973b-3915e2815117 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 30109352-6d98-4d4c-8613-96cfd959e86d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:55.640799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-950c6370-72a2-4107-973b-3915e2815117 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:55.641239 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-950c6370-72a2-4107-973b-3915e2815117 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:55.643402 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-950c6370-72a2-4107-973b-3915e2815117 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:55.645795 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-950c6370-72a2-4107-973b-3915e2815117 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:56.382922 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-950c6370-72a2-4107-973b-3915e2815117 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:56.409967 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-950c6370-72a2-4107-973b-3915e2815117 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d" status: 200 len: 1528 microversion: 2.1 time: 0.798455 Aug 04 16:51:56.410591 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1638/3217] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:55 2022] GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d => generated 1528 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:56.457632 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-45602f5e-723a-4f96-8b14-7ca5eb6a9018 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:56.463005 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-45602f5e-723a-4f96-8b14-7ca5eb6a9018 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:56.507306 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-45602f5e-723a-4f96-8b14-7ca5eb6a9018 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:56.517085 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-45602f5e-723a-4f96-8b14-7ca5eb6a9018 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:56.518541 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-45602f5e-723a-4f96-8b14-7ca5eb6a9018 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:56.520606 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-45602f5e-723a-4f96-8b14-7ca5eb6a9018 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:56.952597 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-44391668-1b59-45c9-a4ca-b1b2b31b48e8 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "DELETE /compute/v2.1/images/2401103e-e83f-4a89-8a95-3958fca23039" status: 204 len: 0 microversion: 2.1 time: 1.385413 Aug 04 16:51:56.953889 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1580/3218] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:55 2022] DELETE /compute/v2.1/images/2401103e-e83f-4a89-8a95-3958fca23039 => generated 0 bytes in 1388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:51:56.973643 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dd48af9e-c310-4ead-83fe-2c9473a86047 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:56.976485 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-dd48af9e-c310-4ead-83fe-2c9473a86047 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:57.017374 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd48af9e-c310-4ead-83fe-2c9473a86047 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:57.021927 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd48af9e-c310-4ead-83fe-2c9473a86047 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:57.022828 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd48af9e-c310-4ead-83fe-2c9473a86047 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:57.023280 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd48af9e-c310-4ead-83fe-2c9473a86047 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:57.820774 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-dd48af9e-c310-4ead-83fe-2c9473a86047 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:57.829801 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dd48af9e-c310-4ead-83fe-2c9473a86047 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217" status: 200 len: 1496 microversion: 2.1 time: 0.870244 Aug 04 16:51:57.842069 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1581/3219] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:56 2022] GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217 => generated 1496 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:57.847247 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-83462449-1796-4eae-9309-5320066b9ef9 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '.version_select at 0x7f7e84897ee0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:57.919227 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-83462449-1796-4eae-9309-5320066b9ef9 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5" status: 200 len: 1427 microversion: 2.1 time: 0.075629 Aug 04 16:51:57.926586 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1582/3220] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:57 2022] GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5 => generated 1427 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:57.943360 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-921965d9-95fa-416d-a81b-3a8e061666a2 req-54572598-146e-4264-bb33-7d33396ad118 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30109352-6d98-4d4c-8613-96cfd959e86d", "name": "network-vif-plugged", "status": "completed", "tag": "25fb6649-7af7-45df-8635-9e27010c2ae1"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:51:57.972635 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-921965d9-95fa-416d-a81b-3a8e061666a2 req-54572598-146e-4264-bb33-7d33396ad118 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:57.973342 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-921965d9-95fa-416d-a81b-3a8e061666a2 req-54572598-146e-4264-bb33-7d33396ad118 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:57.988228 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-921965d9-95fa-416d-a81b-3a8e061666a2 req-54572598-146e-4264-bb33-7d33396ad118 service nova] Creating event network-vif-plugged:25fb6649-7af7-45df-8635-9e27010c2ae1 for instance 30109352-6d98-4d4c-8613-96cfd959e86d on n-h2-846466-12 Aug 04 16:51:58.029518 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-921965d9-95fa-416d-a81b-3a8e061666a2 req-54572598-146e-4264-bb33-7d33396ad118 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101335 Aug 04 16:51:58.034353 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1583/3221] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:51:58.050079 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b7132585-c7dc-4996-bcbf-faee1ee0fb27 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e841f03a0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:58.669465 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-45602f5e-723a-4f96-8b14-7ca5eb6a9018 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:58.695063 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-45602f5e-723a-4f96-8b14-7ca5eb6a9018 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:58.705577 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-45602f5e-723a-4f96-8b14-7ca5eb6a9018 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:58.712983 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-45602f5e-723a-4f96-8b14-7ca5eb6a9018 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1875 microversion: 2.42 time: 2.288368 Aug 04 16:51:58.721259 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1639/3222] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:51:56 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1875 bytes in 2310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:51:58.754406 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-214876f5-3101-41fe-a645-50daf3f7fd10 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:58.760554 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-214876f5-3101-41fe-a645-50daf3f7fd10 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 30109352-6d98-4d4c-8613-96cfd959e86d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:58.791641 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-214876f5-3101-41fe-a645-50daf3f7fd10 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:58.798135 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-214876f5-3101-41fe-a645-50daf3f7fd10 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:58.801421 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-214876f5-3101-41fe-a645-50daf3f7fd10 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:58.809916 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-214876f5-3101-41fe-a645-50daf3f7fd10 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:59.236182 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-214876f5-3101-41fe-a645-50daf3f7fd10 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:59.279843 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-214876f5-3101-41fe-a645-50daf3f7fd10 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d" status: 200 len: 1486 microversion: 2.1 time: 0.554102 Aug 04 16:51:59.287703 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1640/3223] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:58 2022] GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d => generated 1486 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:59.328377 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d2a7eddf-4620-4b64-8040-bef374f4ce45 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:51:59.333962 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d2a7eddf-4620-4b64-8040-bef374f4ce45 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:51:59.394376 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d2a7eddf-4620-4b64-8040-bef374f4ce45 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:59.406254 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d2a7eddf-4620-4b64-8040-bef374f4ce45 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:59.410508 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d2a7eddf-4620-4b64-8040-bef374f4ce45 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:59.413512 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d2a7eddf-4620-4b64-8040-bef374f4ce45 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:59.495585 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:51:59.537418 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d2a7eddf-4620-4b64-8040-bef374f4ce45 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:51:59.540454 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d2a7eddf-4620-4b64-8040-bef374f4ce45 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:51:59.541304 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-d2a7eddf-4620-4b64-8040-bef374f4ce45 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lazy-loading 'fault' on Instance uuid 86b8342c-3797-4540-a6f3-f967340c1217 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:51:59.823192 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d2a7eddf-4620-4b64-8040-bef374f4ce45 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:51:59.844276 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d2a7eddf-4620-4b64-8040-bef374f4ce45 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217" status: 200 len: 1305 microversion: 2.1 time: 0.552993 Aug 04 16:51:59.846299 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1641/3224] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:59 2022] GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217 => generated 1305 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:51:59.881384 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8487d652-9a58-4aec-862c-d5334904a529 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '.version_select at 0x7f7e84b39820>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:00.172369 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b7132585-c7dc-4996-bcbf-faee1ee0fb27 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "DELETE /compute/v2.1/images/f45b6542-a249-441a-b979-42570ece3bd1" status: 204 len: 0 microversion: 2.1 time: 2.135080 Aug 04 16:52:00.176212 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1584/3225] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:51:58 2022] DELETE /compute/v2.1/images/f45b6542-a249-441a-b979-42570ece3bd1 => generated 0 bytes in 2138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:52:00.183398 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-6187760f-d729-47b7-97fe-1ebabab44fb1 req-a88b4411-cc57-45ad-a1a6-44dea48e570e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b8342c-3797-4540-a6f3-f967340c1217", "name": "network-vif-deleted", "tag": "6e42d24d-c057-4234-8aa4-45a8f3a0f560"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:00.235859 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-6187760f-d729-47b7-97fe-1ebabab44fb1 req-a88b4411-cc57-45ad-a1a6-44dea48e570e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:00.236476 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-6187760f-d729-47b7-97fe-1ebabab44fb1 req-a88b4411-cc57-45ad-a1a6-44dea48e570e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:00.263288 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8487d652-9a58-4aec-862c-d5334904a529 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5" status: 200 len: 1427 microversion: 2.1 time: 0.408216 Aug 04 16:52:00.268995 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1642/3226] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:51:59 2022] GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5 => generated 1427 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:00.286226 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-6187760f-d729-47b7-97fe-1ebabab44fb1 req-a88b4411-cc57-45ad-a1a6-44dea48e570e service nova] Creating event network-vif-deleted:6e42d24d-c057-4234-8aa4-45a8f3a0f560 for instance 86b8342c-3797-4540-a6f3-f967340c1217 on n-h1-846466-12 Aug 04 16:52:00.289018 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-33fb06b0-a979-4c26-8c46-2129f7a9f364 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:00.291021 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-33fb06b0-a979-4c26-8c46-2129f7a9f364 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:00.311097 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-6187760f-d729-47b7-97fe-1ebabab44fb1 req-a88b4411-cc57-45ad-a1a6-44dea48e570e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133548 Aug 04 16:52:00.317970 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1585/3227] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:52:00.328695 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-29304e1d-fec5-4f0f-934d-6b0f47deb81d req-be9d12ca-acc2-4a3b-9dcc-89d2433208ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30109352-6d98-4d4c-8613-96cfd959e86d", "name": "network-vif-unplugged", "status": "completed", "tag": "25fb6649-7af7-45df-8635-9e27010c2ae1"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:00.338024 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-33fb06b0-a979-4c26-8c46-2129f7a9f364 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:00.346442 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-33fb06b0-a979-4c26-8c46-2129f7a9f364 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:00.366974 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-33fb06b0-a979-4c26-8c46-2129f7a9f364 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:00.367228 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-29304e1d-fec5-4f0f-934d-6b0f47deb81d req-be9d12ca-acc2-4a3b-9dcc-89d2433208ec service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:00.367558 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-29304e1d-fec5-4f0f-934d-6b0f47deb81d req-be9d12ca-acc2-4a3b-9dcc-89d2433208ec service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:00.378164 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-33fb06b0-a979-4c26-8c46-2129f7a9f364 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:00.434385 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-29304e1d-fec5-4f0f-934d-6b0f47deb81d req-be9d12ca-acc2-4a3b-9dcc-89d2433208ec service nova] Creating event network-vif-unplugged:25fb6649-7af7-45df-8635-9e27010c2ae1 for instance 30109352-6d98-4d4c-8613-96cfd959e86d on n-h2-846466-12 Aug 04 16:52:00.455788 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-29304e1d-fec5-4f0f-934d-6b0f47deb81d req-be9d12ca-acc2-4a3b-9dcc-89d2433208ec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136028 Aug 04 16:52:00.464795 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1586/3228] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:52:00.470430 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7d955d2a-8e64-4431-aa95-ee01fd2fb127 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:00.470953 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7d955d2a-8e64-4431-aa95-ee01fd2fb127 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] [instance: 800296f7-67da-4f41-aea4-e7e1af65e6c2] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:00.516467 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7d955d2a-8e64-4431-aa95-ee01fd2fb127 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:00.516928 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7d955d2a-8e64-4431-aa95-ee01fd2fb127 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:00.517760 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7d955d2a-8e64-4431-aa95-ee01fd2fb127 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:00.518192 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7d955d2a-8e64-4431-aa95-ee01fd2fb127 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:00.574739 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7d955d2a-8e64-4431-aa95-ee01fd2fb127 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] [instance: 800296f7-67da-4f41-aea4-e7e1af65e6c2] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:52:00.765076 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7d955d2a-8e64-4431-aa95-ee01fd2fb127 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "DELETE /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2" status: 204 len: 0 microversion: 2.1 time: 0.298314 Aug 04 16:52:00.769556 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1587/3229] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:52:00 2022] DELETE /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:52:00.775921 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5fec1b53-3b0e-4938-9145-fef960b2aa32 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:00.780712 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5fec1b53-3b0e-4938-9145-fef960b2aa32 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 30109352-6d98-4d4c-8613-96cfd959e86d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:00.797252 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5fec1b53-3b0e-4938-9145-fef960b2aa32 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:00.797727 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5fec1b53-3b0e-4938-9145-fef960b2aa32 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:00.798610 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5fec1b53-3b0e-4938-9145-fef960b2aa32 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:00.799048 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5fec1b53-3b0e-4938-9145-fef960b2aa32 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:00.837883 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-5fec1b53-3b0e-4938-9145-fef960b2aa32 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] HTTP exception thrown: Instance 30109352-6d98-4d4c-8613-96cfd959e86d could not be found. Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5fec1b53-3b0e-4938-9145-fef960b2aa32 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Request method failure captured: Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d HTTP/1.1 Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_jtTPBPy4fXdQ0VJrZ7Fc7m71zszwq7ozUwryWnXkb5nfLRGrkK5ga8HzOO0RHGQ_JBzS6OyCZVWsMotLJPEGPUn58SVuz4Z61cosYCdd8YzpWwL0OdtEOtJV7MtqbPH74mZZtuOB-p1arvqTlVKRaIs7USdqyFhUTa2KSBwKWaYTU Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: eb9de718bdfb4d6dbf63c336dfde8d42 Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb9de718bdfb4d6dbf63c336dfde8d42"}]}] Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: eb9de718bdfb4d6dbf63c336dfde8d42 Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ImagesOneServerNegativeTestJSON-1002016988-project Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 50ace5409bc54123aad5e1bc071cc3dd Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988-project Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 30109352-6d98-4d4c-8613-96cfd959e86d could not be found. Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '30109352-6d98-4d4c-8613-96cfd959e86d'} Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30109352-6d98-4d4c-8613-96cfd959e86d could not be found. Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30109352-6d98-4d4c-8613-96cfd959e86d could not be found. Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:00.840019 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:52:00.852460 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:00.852460 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:00.852460 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:52:00.852460 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:52:00.852460 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:52:00.852460 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:52:00.852460 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30109352-6d98-4d4c-8613-96cfd959e86d could not be found. Aug 04 16:52:00.852460 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:00.852460 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5fec1b53-3b0e-4938-9145-fef960b2aa32 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Returning 404 to user: Instance 30109352-6d98-4d4c-8613-96cfd959e86d could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:52:00.852460 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5fec1b53-3b0e-4938-9145-fef960b2aa32 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d" status: 404 len: 111 microversion: 2.1 time: 0.070680 Aug 04 16:52:00.852460 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1588/3230] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:00 2022] GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:52:00.852460 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fc274b96-b5eb-4bb7-84e0-bedc922f12df tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:00.852460 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fc274b96-b5eb-4bb7-84e0-bedc922f12df tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] [instance: 800296f7-67da-4f41-aea4-e7e1af65e6c2] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:00.867409 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fc274b96-b5eb-4bb7-84e0-bedc922f12df tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:00.868130 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fc274b96-b5eb-4bb7-84e0-bedc922f12df tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:00.869129 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fc274b96-b5eb-4bb7-84e0-bedc922f12df tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:00.869603 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fc274b96-b5eb-4bb7-84e0-bedc922f12df tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:01.281938 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-33fb06b0-a979-4c26-8c46-2129f7a9f364 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:01.306937 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-33fb06b0-a979-4c26-8c46-2129f7a9f364 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:01.308925 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-33fb06b0-a979-4c26-8c46-2129f7a9f364 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:01.317169 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-33fb06b0-a979-4c26-8c46-2129f7a9f364 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1875 microversion: 2.42 time: 1.046590 Aug 04 16:52:01.317900 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1643/3231] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:52:00 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1875 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:52:01.342662 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c78b0ae4-1c27-4461-bc09-9246f2834dd3 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Action: 'create', calling method: .version_select at 0x7f7e841d9ca0>, body: {"keypair": {"name": "tempest-keypair-18211928", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrG+M3hB6DOQN0voSvM/gMLjPgbMPqLhtbfKzCrqkHRZAXMzOI1+/DpBDgyIr/plHVFXPd5Ya0aEQ3yQnq+qo4On4tWhPoq4KvV6n8ecdC6pOPxM33ENbEI9j9mQ8FwjQ=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:01.356008 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fc274b96-b5eb-4bb7-84e0-bedc922f12df tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad56451fe41482585833461124f0497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3731044d35c449289d1000d0628d06c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:01.383111 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fc274b96-b5eb-4bb7-84e0-bedc922f12df tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2" status: 200 len: 1472 microversion: 2.1 time: 0.537914 Aug 04 16:52:01.404320 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1589/3232] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:00 2022] GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2 => generated 1472 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:01.419056 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-c78b0ae4-1c27-4461-bc09-9246f2834dd3 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Getting quotas for project eb9de718bdfb4d6dbf63c336dfde8d42. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:52:01.426620 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6f83dd3d-f361-4397-8ed5-6e24a3129cdc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:01.427248 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6f83dd3d-f361-4397-8ed5-6e24a3129cdc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 86b8342c-3797-4540-a6f3-f967340c1217] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:01.441947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-c78b0ae4-1c27-4461-bc09-9246f2834dd3 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Getting quotas for user 50ace5409bc54123aad5e1bc071cc3dd and project eb9de718bdfb4d6dbf63c336dfde8d42. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:52:01.462209 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6f83dd3d-f361-4397-8ed5-6e24a3129cdc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:01.463783 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6f83dd3d-f361-4397-8ed5-6e24a3129cdc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:01.464839 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6f83dd3d-f361-4397-8ed5-6e24a3129cdc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:01.467559 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6f83dd3d-f361-4397-8ed5-6e24a3129cdc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:01.504337 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:52:01.506926 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-6f83dd3d-f361-4397-8ed5-6e24a3129cdc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] HTTP exception thrown: Instance 86b8342c-3797-4540-a6f3-f967340c1217 could not be found. Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6f83dd3d-f361-4397-8ed5-6e24a3129cdc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Request method failure captured: Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217 HTTP/1.1 Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_abSC_qd4PHP0W808xgrI7Q0G4tlPTiB2-LAH-LZMv8d9UcRN9ZCFy6_giyx-c7RjiKNjELhrKAi_ora1AVfsDng4FTG7brYif3-z0rtdjlkilo5AULdT4A615Ra8__IvKNYC3N__kBvOWqowuttGiKr7m7ap4YyjQHEc3cVcyVFSU Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 96ce955c9158463e9e98c53b99c581ec Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServerActionsTestJSON-697118571 Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96ce955c9158463e9e98c53b99c581ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_96ce955c9158463e9e98c53b99c581ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96ce955c9158463e9e98c53b99c581ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/96ce955c9158463e9e98c53b99c581ec"}]}] Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServerActionsTestJSON-697118571 Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 96ce955c9158463e9e98c53b99c581ec Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServerActionsTestJSON-697118571 Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServerActionsTestJSON-697118571-project Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 438d083dc9e74b2f8970455505791250 Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServerActionsTestJSON-697118571-project Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 86b8342c-3797-4540-a6f3-f967340c1217 could not be found. Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '86b8342c-3797-4540-a6f3-f967340c1217'} Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86b8342c-3797-4540-a6f3-f967340c1217 could not be found. Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86b8342c-3797-4540-a6f3-f967340c1217 could not be found. Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:52:01.512794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:01.517805 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:01.517805 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:52:01.517805 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:52:01.517805 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:52:01.517805 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:52:01.517805 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86b8342c-3797-4540-a6f3-f967340c1217 could not be found. Aug 04 16:52:01.517805 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:01.520025 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6f83dd3d-f361-4397-8ed5-6e24a3129cdc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Returning 404 to user: Instance 86b8342c-3797-4540-a6f3-f967340c1217 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:52:01.523048 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6f83dd3d-f361-4397-8ed5-6e24a3129cdc tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217" status: 404 len: 111 microversion: 2.1 time: 0.114541 Aug 04 16:52:01.524248 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1590/3233] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:01 2022] GET /compute/v2.1/servers/86b8342c-3797-4540-a6f3-f967340c1217 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:52:01.542512 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ed941934-ea4f-4c71-8f10-19e4c14d55ea tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '.version_select at 0x7f7e8498ad30>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:01.571496 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c78b0ae4-1c27-4461-bc09-9246f2834dd3 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.247949 Aug 04 16:52:01.572570 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1644/3234] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 16:52:01 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:52:01.583320 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-089fe40d-63c7-47f5-b717-cb448ef07183 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:01.585930 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-089fe40d-63c7-47f5-b717-cb448ef07183 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:01.616664 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ed941934-ea4f-4c71-8f10-19e4c14d55ea tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5" status: 200 len: 1427 microversion: 2.1 time: 0.089591 Aug 04 16:52:01.623968 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1591/3235] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:52:01 2022] GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5 => generated 1427 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:01.641511 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-089fe40d-63c7-47f5-b717-cb448ef07183 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:01.643056 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-089fe40d-63c7-47f5-b717-cb448ef07183 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:01.644424 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-089fe40d-63c7-47f5-b717-cb448ef07183 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:01.645155 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-089fe40d-63c7-47f5-b717-cb448ef07183 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:01.688634 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-089fe40d-63c7-47f5-b717-cb448ef07183 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:52:01.926947 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-089fe40d-63c7-47f5-b717-cb448ef07183 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 204 len: 0 microversion: 2.1 time: 0.352342 Aug 04 16:52:01.929047 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1645/3236] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:52:01 2022] DELETE /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:52:01.955484 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e13b761f-27dc-473d-9279-e0d3363ed09d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:01.957083 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e13b761f-27dc-473d-9279-e0d3363ed09d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:01.980026 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e13b761f-27dc-473d-9279-e0d3363ed09d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:01.988045 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e13b761f-27dc-473d-9279-e0d3363ed09d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:01.989143 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e13b761f-27dc-473d-9279-e0d3363ed09d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:01.989897 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e13b761f-27dc-473d-9279-e0d3363ed09d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:02.345327 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-75998790-5710-4ebb-b9a2-f4653a38994b tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:02.346884 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-75998790-5710-4ebb-b9a2-f4653a38994b tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:02.365345 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-75998790-5710-4ebb-b9a2-f4653a38994b tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:02.366171 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-75998790-5710-4ebb-b9a2-f4653a38994b tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:02.367143 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-75998790-5710-4ebb-b9a2-f4653a38994b tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:02.369697 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-75998790-5710-4ebb-b9a2-f4653a38994b tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:03.157236 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-75998790-5710-4ebb-b9a2-f4653a38994b tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:03.169853 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-75998790-5710-4ebb-b9a2-f4653a38994b tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:03.180065 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-75998790-5710-4ebb-b9a2-f4653a38994b tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:03.185361 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-75998790-5710-4ebb-b9a2-f4653a38994b tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1875 microversion: 2.42 time: 0.845222 Aug 04 16:52:03.192576 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1646/3237] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:52:02 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1875 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:52:03.216269 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-422afd39-b3ee-43a8-89a6-6f09796141d7 req-890c4fa4-e4f8-42e4-bdb4-d74ff8ef3ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30109352-6d98-4d4c-8613-96cfd959e86d", "name": "network-vif-deleted", "tag": "25fb6649-7af7-45df-8635-9e27010c2ae1"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:03.257088 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-422afd39-b3ee-43a8-89a6-6f09796141d7 req-890c4fa4-e4f8-42e4-bdb4-d74ff8ef3ed9 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:03.265556 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-422afd39-b3ee-43a8-89a6-6f09796141d7 req-890c4fa4-e4f8-42e4-bdb4-d74ff8ef3ed9 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:03.307773 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-422afd39-b3ee-43a8-89a6-6f09796141d7 req-890c4fa4-e4f8-42e4-bdb4-d74ff8ef3ed9 service nova] Creating event network-vif-deleted:25fb6649-7af7-45df-8635-9e27010c2ae1 for instance 30109352-6d98-4d4c-8613-96cfd959e86d on n-h2-846466-12 Aug 04 16:52:03.338086 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-422afd39-b3ee-43a8-89a6-6f09796141d7 req-890c4fa4-e4f8-42e4-bdb4-d74ff8ef3ed9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138975 Aug 04 16:52:03.347165 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1647/3238] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:52:03.382781 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9fa9d7fc-ddb9-43bb-bf96-e4c2dbb4c5e2 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:03.383836 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9fa9d7fc-ddb9-43bb-bf96-e4c2dbb4c5e2 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] [instance: 800296f7-67da-4f41-aea4-e7e1af65e6c2] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:03.428027 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9fa9d7fc-ddb9-43bb-bf96-e4c2dbb4c5e2 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:03.436002 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9fa9d7fc-ddb9-43bb-bf96-e4c2dbb4c5e2 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:03.438446 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9fa9d7fc-ddb9-43bb-bf96-e4c2dbb4c5e2 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:03.439124 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9fa9d7fc-ddb9-43bb-bf96-e4c2dbb4c5e2 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:04.600289 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e13b761f-27dc-473d-9279-e0d3363ed09d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:04.623731 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e13b761f-27dc-473d-9279-e0d3363ed09d tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1675 microversion: 2.1 time: 2.685935 Aug 04 16:52:04.624399 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1592/3239] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:01 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1675 bytes in 2692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:04.641098 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1afddccf-e811-4018-8f45-7b7d2b6126fe tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '.version_select at 0x7f7e854a00d0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:04.756277 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1afddccf-e811-4018-8f45-7b7d2b6126fe tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5" status: 200 len: 1427 microversion: 2.1 time: 0.127369 Aug 04 16:52:04.757261 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1593/3240] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:52:04 2022] GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5 => generated 1427 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:04.785621 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9838a187-c5f0-4729-a179-92220eec784b tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:04.791477 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9838a187-c5f0-4729-a179-92220eec784b tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:04.823041 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9838a187-c5f0-4729-a179-92220eec784b tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:04.823829 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9838a187-c5f0-4729-a179-92220eec784b tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:04.834042 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9838a187-c5f0-4729-a179-92220eec784b tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:04.835475 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9838a187-c5f0-4729-a179-92220eec784b tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:05.868819 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9fa9d7fc-ddb9-43bb-bf96-e4c2dbb4c5e2 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad56451fe41482585833461124f0497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3731044d35c449289d1000d0628d06c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:05.883975 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9fa9d7fc-ddb9-43bb-bf96-e4c2dbb4c5e2 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2" status: 200 len: 1472 microversion: 2.1 time: 2.532685 Aug 04 16:52:05.897771 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1648/3241] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:03 2022] GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2 => generated 1472 bytes in 2550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:05.908535 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-eed612f9-dd8c-4aa4-a972-53f3d7cb8c18 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:05.915600 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-eed612f9-dd8c-4aa4-a972-53f3d7cb8c18 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:05.948946 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eed612f9-dd8c-4aa4-a972-53f3d7cb8c18 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:05.951820 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eed612f9-dd8c-4aa4-a972-53f3d7cb8c18 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:05.962586 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eed612f9-dd8c-4aa4-a972-53f3d7cb8c18 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:05.967154 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eed612f9-dd8c-4aa4-a972-53f3d7cb8c18 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:06.448814 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9838a187-c5f0-4729-a179-92220eec784b tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:06.498066 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9838a187-c5f0-4729-a179-92220eec784b tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:06.504863 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9838a187-c5f0-4729-a179-92220eec784b tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:06.513054 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9838a187-c5f0-4729-a179-92220eec784b tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1875 microversion: 2.42 time: 1.748208 Aug 04 16:52:06.518922 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1594/3242] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:52:04 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1875 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:52:06.535877 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c9cd2a2b-a9bb-4c16-94b2-0d7d7fceed76 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '.version_select at 0x7f7e84a16160>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:06.691722 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c9cd2a2b-a9bb-4c16-94b2-0d7d7fceed76 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5" status: 200 len: 1427 microversion: 2.1 time: 0.168269 Aug 04 16:52:06.694553 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1595/3243] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:52:06 2022] GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5 => generated 1427 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:06.911209 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d7e78c3c-a742-47f8-923a-e6fa6d1ff625 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:06.911445 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d7e78c3c-a742-47f8-923a-e6fa6d1ff625 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] [instance: 800296f7-67da-4f41-aea4-e7e1af65e6c2] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:06.914530 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=4 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:52:06.945785 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d7e78c3c-a742-47f8-923a-e6fa6d1ff625 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:06.955595 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d7e78c3c-a742-47f8-923a-e6fa6d1ff625 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:06.956749 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d7e78c3c-a742-47f8-923a-e6fa6d1ff625 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:06.957205 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d7e78c3c-a742-47f8-923a-e6fa6d1ff625 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:07.378073 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d7e78c3c-a742-47f8-923a-e6fa6d1ff625 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad56451fe41482585833461124f0497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3731044d35c449289d1000d0628d06c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:07.387222 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d7e78c3c-a742-47f8-923a-e6fa6d1ff625 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2" status: 200 len: 1430 microversion: 2.1 time: 0.481168 Aug 04 16:52:07.398250 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1596/3244] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:06 2022] GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2 => generated 1430 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:07.533777 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-6ef34a6f-6501-47f2-b951-9a782ad2551f req-c0c8b095-6112-4b72-8f51-2a45e97b62f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800296f7-67da-4f41-aea4-e7e1af65e6c2", "name": "network-vif-deleted", "tag": "edcd52e8-c9af-4fd4-9b1a-35c30ea3ae67"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:07.560112 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-6ef34a6f-6501-47f2-b951-9a782ad2551f req-c0c8b095-6112-4b72-8f51-2a45e97b62f2 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:07.560769 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-6ef34a6f-6501-47f2-b951-9a782ad2551f req-c0c8b095-6112-4b72-8f51-2a45e97b62f2 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:07.621144 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:52:07.626215 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-6ef34a6f-6501-47f2-b951-9a782ad2551f req-c0c8b095-6112-4b72-8f51-2a45e97b62f2 service nova] Creating event network-vif-deleted:edcd52e8-c9af-4fd4-9b1a-35c30ea3ae67 for instance 800296f7-67da-4f41-aea4-e7e1af65e6c2 on n-h2-846466-12 Aug 04 16:52:07.667544 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-6ef34a6f-6501-47f2-b951-9a782ad2551f req-c0c8b095-6112-4b72-8f51-2a45e97b62f2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136745 Aug 04 16:52:07.669295 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1597/3245] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:52:07.698699 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6e4fcec2-53ea-492e-8b6b-42229d61fe58 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:07.700025 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6e4fcec2-53ea-492e-8b6b-42229d61fe58 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:07.713400 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e4fcec2-53ea-492e-8b6b-42229d61fe58 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:07.714267 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e4fcec2-53ea-492e-8b6b-42229d61fe58 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:07.716534 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e4fcec2-53ea-492e-8b6b-42229d61fe58 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:07.717212 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e4fcec2-53ea-492e-8b6b-42229d61fe58 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:07.856855 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-eed612f9-dd8c-4aa4-a972-53f3d7cb8c18 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:07.887520 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-eed612f9-dd8c-4aa4-a972-53f3d7cb8c18 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1675 microversion: 2.1 time: 1.981735 Aug 04 16:52:07.904781 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1649/3246] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:05 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1675 bytes in 1993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:07.916185 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-71f99f86-069e-45f2-86c9-ef5ba7429fa3 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '.version_select at 0x7f7e84632ca0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:08.011381 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-71f99f86-069e-45f2-86c9-ef5ba7429fa3 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5" status: 200 len: 1427 microversion: 2.1 time: 0.117479 Aug 04 16:52:08.015161 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1650/3247] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:52:07 2022] GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5 => generated 1427 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:08.088578 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-378b0396-4bea-48c0-9901-18543db969a2 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-906424935", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:08.380195 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-378b0396-4bea-48c0-9901-18543db969a2 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] validate_networks() for [('46081ca9-0ee0-465c-8483-bd7332c8165a', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:52:08.648486 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6e4fcec2-53ea-492e-8b6b-42229d61fe58 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:08.658415 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6e4fcec2-53ea-492e-8b6b-42229d61fe58 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:08.659937 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6e4fcec2-53ea-492e-8b6b-42229d61fe58 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:08.661122 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6e4fcec2-53ea-492e-8b6b-42229d61fe58 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1875 microversion: 2.42 time: 0.982627 Aug 04 16:52:08.690026 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1598/3248] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:52:07 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1875 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:52:08.710143 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-40157a4e-bbd1-40b2-bd50-806c26e040b6 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:08.711136 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-40157a4e-bbd1-40b2-bd50-806c26e040b6 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] [instance: 800296f7-67da-4f41-aea4-e7e1af65e6c2] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:08.718347 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-40157a4e-bbd1-40b2-bd50-806c26e040b6 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:08.719401 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-40157a4e-bbd1-40b2-bd50-806c26e040b6 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:08.720628 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-40157a4e-bbd1-40b2-bd50-806c26e040b6 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:08.721305 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-40157a4e-bbd1-40b2-bd50-806c26e040b6 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:08.739656 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-40157a4e-bbd1-40b2-bd50-806c26e040b6 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] HTTP exception thrown: Instance 800296f7-67da-4f41-aea4-e7e1af65e6c2 could not be found. Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-40157a4e-bbd1-40b2-bd50-806c26e040b6 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Request method failure captured: Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2 HTTP/1.1 Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_iJPM438P9dcnyIgNmMwzKD-zIndV3SvqTs48BBKrIkKKtZxKFzQG3_nrRFWuSAk6PApBLS20n18pF0PiYTAlLSDDtReRwo9OpQZH92vn6L7h9NOi6fMN2a2R7YgvZe-AmQZKezmBy5tnQpJ2b9LDNdi51Jb1XXx75RnhAAvVTg65M Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 3731044d35c449289d1000d0628d06c4 Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ListImageFiltersTestJSON-1008370460 Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3731044d35c449289d1000d0628d06c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3731044d35c449289d1000d0628d06c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3731044d35c449289d1000d0628d06c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3731044d35c449289d1000d0628d06c4"}]}] Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ListImageFiltersTestJSON-1008370460 Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 3731044d35c449289d1000d0628d06c4 Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1008370460 Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ListImageFiltersTestJSON-1008370460-project Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 8ad56451fe41482585833461124f0497 Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ListImageFiltersTestJSON-1008370460-project Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 800296f7-67da-4f41-aea4-e7e1af65e6c2 could not be found. Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '800296f7-67da-4f41-aea4-e7e1af65e6c2'} Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 800296f7-67da-4f41-aea4-e7e1af65e6c2 could not be found. Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 800296f7-67da-4f41-aea4-e7e1af65e6c2 could not be found. Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:52:08.742598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:08.750229 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:08.750229 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:52:08.750229 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:52:08.750229 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:52:08.750229 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:52:08.750229 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 800296f7-67da-4f41-aea4-e7e1af65e6c2 could not be found. Aug 04 16:52:08.750229 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:08.752544 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-40157a4e-bbd1-40b2-bd50-806c26e040b6 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Returning 404 to user: Instance 800296f7-67da-4f41-aea4-e7e1af65e6c2 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:52:08.753699 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-40157a4e-bbd1-40b2-bd50-806c26e040b6 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2" status: 404 len: 111 microversion: 2.1 time: 0.057243 Aug 04 16:52:08.754816 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1599/3249] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:08 2022] GET /compute/v2.1/servers/800296f7-67da-4f41-aea4-e7e1af65e6c2 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:52:08.793748 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6bcc9747-7ad0-4888-b2df-ef6c4778ebc4 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:08.796946 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6bcc9747-7ad0-4888-b2df-ef6c4778ebc4 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] [instance: 9139a17d-927c-4595-a7ff-11a1fa3a6a69] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:08.813198 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6bcc9747-7ad0-4888-b2df-ef6c4778ebc4 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:08.822444 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6bcc9747-7ad0-4888-b2df-ef6c4778ebc4 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:08.830222 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6bcc9747-7ad0-4888-b2df-ef6c4778ebc4 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:08.832422 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6bcc9747-7ad0-4888-b2df-ef6c4778ebc4 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:08.928753 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6bcc9747-7ad0-4888-b2df-ef6c4778ebc4 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] [instance: 9139a17d-927c-4595-a7ff-11a1fa3a6a69] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:52:09.132601 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6bcc9747-7ad0-4888-b2df-ef6c4778ebc4 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9139a17d-927c-4595-a7ff-11a1fa3a6a69" status: 204 len: 0 microversion: 2.1 time: 0.370815 Aug 04 16:52:09.139020 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1600/3250] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:52:08 2022] DELETE /compute/v2.1/servers/9139a17d-927c-4595-a7ff-11a1fa3a6a69 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:52:09.155770 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ed18d85b-1d9a-4ad6-900c-65e9875f29b4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:09.159022 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ed18d85b-1d9a-4ad6-900c-65e9875f29b4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:09.186655 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ed18d85b-1d9a-4ad6-900c-65e9875f29b4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:09.193596 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ed18d85b-1d9a-4ad6-900c-65e9875f29b4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:09.196323 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ed18d85b-1d9a-4ad6-900c-65e9875f29b4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:09.197658 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ed18d85b-1d9a-4ad6-900c-65e9875f29b4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:09.864599 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ed18d85b-1d9a-4ad6-900c-65e9875f29b4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:09.878308 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ed18d85b-1d9a-4ad6-900c-65e9875f29b4 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1608 microversion: 2.1 time: 0.735941 Aug 04 16:52:09.880034 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1601/3251] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:09 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1608 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:09.887180 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cbfb66f8-252c-4aee-9c68-d86fea46ee0a tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '.version_select at 0x7f7e84e96160>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:09.962677 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cbfb66f8-252c-4aee-9c68-d86fea46ee0a tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5" status: 200 len: 1427 microversion: 2.1 time: 0.080774 Aug 04 16:52:09.964143 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1602/3252] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:52:09 2022] GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5 => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:09.974672 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a7c2cccc-5b01-4e57-b20c-a77c45e6b9b8 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:09.978394 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a7c2cccc-5b01-4e57-b20c-a77c45e6b9b8 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] [instance: 9139a17d-927c-4595-a7ff-11a1fa3a6a69] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:10.005006 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a7c2cccc-5b01-4e57-b20c-a77c45e6b9b8 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:10.005833 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a7c2cccc-5b01-4e57-b20c-a77c45e6b9b8 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:10.006887 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a7c2cccc-5b01-4e57-b20c-a77c45e6b9b8 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:10.007553 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a7c2cccc-5b01-4e57-b20c-a77c45e6b9b8 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:10.322852 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-378b0396-4bea-48c0-9901-18543db969a2 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:52:10.324862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-378b0396-4bea-48c0-9901-18543db969a2 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:52:10.326039 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-378b0396-4bea-48c0-9901-18543db969a2 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:52:10.326869 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-378b0396-4bea-48c0-9901-18543db969a2 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:52:10.328161 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-378b0396-4bea-48c0-9901-18543db969a2 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:52:10.378304 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-378b0396-4bea-48c0-9901-18543db969a2 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:10.379263 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-378b0396-4bea-48c0-9901-18543db969a2 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:10.382539 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-378b0396-4bea-48c0-9901-18543db969a2 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:10.383542 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-378b0396-4bea-48c0-9901-18543db969a2 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:10.439333 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-378b0396-4bea-48c0-9901-18543db969a2 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Getting quotas for project eb9de718bdfb4d6dbf63c336dfde8d42. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:52:10.458182 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-378b0396-4bea-48c0-9901-18543db969a2 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Getting quotas for user 50ace5409bc54123aad5e1bc071cc3dd and project eb9de718bdfb4d6dbf63c336dfde8d42. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:52:10.501738 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-378b0396-4bea-48c0-9901-18543db969a2 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:52:10.510135 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-378b0396-4bea-48c0-9901-18543db969a2 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:52:10.639849 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-378b0396-4bea-48c0-9901-18543db969a2 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.556298 Aug 04 16:52:10.652369 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1651/3253] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:52:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 2569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 16:52:10.659930 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-61547484-473e-4a23-95b0-a646490f5adc tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:10.667263 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-61547484-473e-4a23-95b0-a646490f5adc tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:10.676435 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-61547484-473e-4a23-95b0-a646490f5adc tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:10.677671 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-61547484-473e-4a23-95b0-a646490f5adc tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:10.678597 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-61547484-473e-4a23-95b0-a646490f5adc tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:10.679729 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-61547484-473e-4a23-95b0-a646490f5adc tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:12.671122 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-61547484-473e-4a23-95b0-a646490f5adc tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:12.690644 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-61547484-473e-4a23-95b0-a646490f5adc tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:12.692228 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-61547484-473e-4a23-95b0-a646490f5adc tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:12.693560 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-61547484-473e-4a23-95b0-a646490f5adc tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1875 microversion: 2.42 time: 2.039431 Aug 04 16:52:12.694478 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1652/3254] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:52:10 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1875 bytes in 2042 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:52:12.709672 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-ea10f984-f4ca-449d-842d-1f87bd689615 req-8db3ea29-0f2b-456f-bebe-8302dd9584fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e273267-ae4b-4a99-821e-1c02c3440610", "name": "network-vif-plugged", "status": "completed", "tag": "afae5ef1-0557-47a8-8a2d-099bde970903"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:12.712147 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a7c2cccc-5b01-4e57-b20c-a77c45e6b9b8 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad56451fe41482585833461124f0497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3731044d35c449289d1000d0628d06c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:12.743933 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a7c2cccc-5b01-4e57-b20c-a77c45e6b9b8 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/servers/9139a17d-927c-4595-a7ff-11a1fa3a6a69" status: 200 len: 1474 microversion: 2.1 time: 2.777133 Aug 04 16:52:12.744999 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-ea10f984-f4ca-449d-842d-1f87bd689615 req-8db3ea29-0f2b-456f-bebe-8302dd9584fb service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:12.745701 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-ea10f984-f4ca-449d-842d-1f87bd689615 req-8db3ea29-0f2b-456f-bebe-8302dd9584fb service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:12.760624 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1603/3255] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:09 2022] GET /compute/v2.1/servers/9139a17d-927c-4595-a7ff-11a1fa3a6a69 => generated 1474 bytes in 2796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:12.775414 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f06c1678-985b-4b85-b58f-199c1980037b tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:12.787289 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f06c1678-985b-4b85-b58f-199c1980037b tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:12.794173 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-ea10f984-f4ca-449d-842d-1f87bd689615 req-8db3ea29-0f2b-456f-bebe-8302dd9584fb service nova] Creating event network-vif-plugged:afae5ef1-0557-47a8-8a2d-099bde970903 for instance 8e273267-ae4b-4a99-821e-1c02c3440610 on n-h1-846466-12 Aug 04 16:52:12.808514 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f06c1678-985b-4b85-b58f-199c1980037b tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:12.814073 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f06c1678-985b-4b85-b58f-199c1980037b tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:12.815164 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f06c1678-985b-4b85-b58f-199c1980037b tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:12.815878 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f06c1678-985b-4b85-b58f-199c1980037b tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:12.837473 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-ea10f984-f4ca-449d-842d-1f87bd689615 req-8db3ea29-0f2b-456f-bebe-8302dd9584fb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141957 Aug 04 16:52:12.845242 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1653/3256] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:52:12.873136 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3cc15021-5a4d-4242-98f2-4dcf505fdc35 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:12.882017 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3cc15021-5a4d-4242-98f2-4dcf505fdc35 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:12.933082 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3cc15021-5a4d-4242-98f2-4dcf505fdc35 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:12.943850 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3cc15021-5a4d-4242-98f2-4dcf505fdc35 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:12.944776 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3cc15021-5a4d-4242-98f2-4dcf505fdc35 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:12.945227 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3cc15021-5a4d-4242-98f2-4dcf505fdc35 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:13.010524 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f06c1678-985b-4b85-b58f-199c1980037b tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:13.047756 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f06c1678-985b-4b85-b58f-199c1980037b tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d" status: 200 len: 1276 microversion: 2.1 time: 0.283794 Aug 04 16:52:13.055814 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1604/3257] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:12 2022] GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d => generated 1276 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:13.073839 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dff64f84-c5dc-4354-ac77-5800d11c85c5 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '.version_select at 0x7f7e84e379d0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:13.220329 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dff64f84-c5dc-4354-ac77-5800d11c85c5 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5" status: 200 len: 1427 microversion: 2.1 time: 0.157164 Aug 04 16:52:13.224257 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1605/3258] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:52:13 2022] GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5 => generated 1427 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:13.543957 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3cc15021-5a4d-4242-98f2-4dcf505fdc35 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:13.596336 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3cc15021-5a4d-4242-98f2-4dcf505fdc35 tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1608 microversion: 2.1 time: 0.749060 Aug 04 16:52:13.637744 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1654/3259] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:12 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1608 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:13.720815 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-561a5773-95bf-4806-a77c-f74f7e3e0b0d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:13.722209 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-561a5773-95bf-4806-a77c-f74f7e3e0b0d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:13.735237 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-561a5773-95bf-4806-a77c-f74f7e3e0b0d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:13.736068 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-561a5773-95bf-4806-a77c-f74f7e3e0b0d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:13.737096 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-561a5773-95bf-4806-a77c-f74f7e3e0b0d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:13.742111 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-561a5773-95bf-4806-a77c-f74f7e3e0b0d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:13.769610 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1ed5ab2e-6a06-4492-9672-bd4092d6a37e tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:13.770239 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1ed5ab2e-6a06-4492-9672-bd4092d6a37e tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] [instance: 9139a17d-927c-4595-a7ff-11a1fa3a6a69] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:13.795616 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1ed5ab2e-6a06-4492-9672-bd4092d6a37e tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:13.796352 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1ed5ab2e-6a06-4492-9672-bd4092d6a37e tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:13.797166 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1ed5ab2e-6a06-4492-9672-bd4092d6a37e tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:13.797776 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1ed5ab2e-6a06-4492-9672-bd4092d6a37e tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:14.916393 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1ed5ab2e-6a06-4492-9672-bd4092d6a37e tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad56451fe41482585833461124f0497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3731044d35c449289d1000d0628d06c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:14.936253 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1ed5ab2e-6a06-4492-9672-bd4092d6a37e tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/servers/9139a17d-927c-4595-a7ff-11a1fa3a6a69" status: 200 len: 1474 microversion: 2.1 time: 1.171899 Aug 04 16:52:14.936866 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1655/3260] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:13 2022] GET /compute/v2.1/servers/9139a17d-927c-4595-a7ff-11a1fa3a6a69 => generated 1474 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:14.952499 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-362744f1-df64-43e7-97cd-b25e7a84e331 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:14.974444 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-362744f1-df64-43e7-97cd-b25e7a84e331 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:15.008195 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-362744f1-df64-43e7-97cd-b25e7a84e331 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:15.009209 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-362744f1-df64-43e7-97cd-b25e7a84e331 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:15.016065 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-362744f1-df64-43e7-97cd-b25e7a84e331 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:15.016754 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-362744f1-df64-43e7-97cd-b25e7a84e331 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:15.320836 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-561a5773-95bf-4806-a77c-f74f7e3e0b0d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:15.364773 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-561a5773-95bf-4806-a77c-f74f7e3e0b0d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:15.375577 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-561a5773-95bf-4806-a77c-f74f7e3e0b0d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:15.388197 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-561a5773-95bf-4806-a77c-f74f7e3e0b0d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1875 microversion: 2.42 time: 1.671170 Aug 04 16:52:15.396289 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-362744f1-df64-43e7-97cd-b25e7a84e331 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:15.411678 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1606/3261] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:52:13 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1875 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:52:15.412112 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-362744f1-df64-43e7-97cd-b25e7a84e331 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d" status: 200 len: 1282 microversion: 2.1 time: 0.467334 Aug 04 16:52:15.412894 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1656/3262] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:14 2022] GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d => generated 1282 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:15.425624 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7e74c5d2-aec2-4758-a8d3-8c02dfc06bbb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:15.429074 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7e74c5d2-aec2-4758-a8d3-8c02dfc06bbb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:15.439193 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-96a1fb3c-596a-4d3a-9283-5eb2932dab37 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '.version_select at 0x7f7e849ec9d0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:15.444907 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7e74c5d2-aec2-4758-a8d3-8c02dfc06bbb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:15.448587 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7e74c5d2-aec2-4758-a8d3-8c02dfc06bbb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:15.452057 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7e74c5d2-aec2-4758-a8d3-8c02dfc06bbb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:15.452784 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7e74c5d2-aec2-4758-a8d3-8c02dfc06bbb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:15.591029 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-96a1fb3c-596a-4d3a-9283-5eb2932dab37 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5" status: 200 len: 1427 microversion: 2.1 time: 0.177983 Aug 04 16:52:15.592133 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1607/3263] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:52:15 2022] GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5 => generated 1427 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:15.601155 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-4e930f66-6a5b-402b-aed1-160ed38eebf9 req-e0a7a072-6dfc-43fe-9e52-a6bcbfaa6349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e273267-ae4b-4a99-821e-1c02c3440610", "name": "network-vif-plugged", "status": "completed", "tag": "1d3e9f84-9473-48e1-a53e-66949e923559"}, {"server_uuid": "8e273267-ae4b-4a99-821e-1c02c3440610", "name": "network-vif-plugged", "status": "completed", "tag": "43dba39e-c390-493c-9f63-1beb4d7fbdf4"}, {"server_uuid": "8e273267-ae4b-4a99-821e-1c02c3440610", "name": "network-vif-plugged", "status": "completed", "tag": "5be18406-7f65-42bc-aad8-d9f5cef83db3"}, {"server_uuid": "8e273267-ae4b-4a99-821e-1c02c3440610", "name": "network-vif-plugged", "status": "completed", "tag": "cbcf974f-adce-4699-820a-253d13eee06d"}, {"server_uuid": "8e273267-ae4b-4a99-821e-1c02c3440610", "name": "network-vif-plugged", "status": "completed", "tag": "60a27540-9c7c-46c8-a5bc-7d1e309c4659"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:15.657104 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-4e930f66-6a5b-402b-aed1-160ed38eebf9 req-e0a7a072-6dfc-43fe-9e52-a6bcbfaa6349 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:15.658617 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-4e930f66-6a5b-402b-aed1-160ed38eebf9 req-e0a7a072-6dfc-43fe-9e52-a6bcbfaa6349 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:15.716926 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-4e930f66-6a5b-402b-aed1-160ed38eebf9 req-e0a7a072-6dfc-43fe-9e52-a6bcbfaa6349 service nova] Creating event network-vif-plugged:1d3e9f84-9473-48e1-a53e-66949e923559 for instance 8e273267-ae4b-4a99-821e-1c02c3440610 on n-h1-846466-12 Aug 04 16:52:15.726203 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-4e930f66-6a5b-402b-aed1-160ed38eebf9 req-e0a7a072-6dfc-43fe-9e52-a6bcbfaa6349 service nova] Creating event network-vif-plugged:43dba39e-c390-493c-9f63-1beb4d7fbdf4 for instance 8e273267-ae4b-4a99-821e-1c02c3440610 on n-h1-846466-12 Aug 04 16:52:15.728113 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-4e930f66-6a5b-402b-aed1-160ed38eebf9 req-e0a7a072-6dfc-43fe-9e52-a6bcbfaa6349 service nova] Creating event network-vif-plugged:5be18406-7f65-42bc-aad8-d9f5cef83db3 for instance 8e273267-ae4b-4a99-821e-1c02c3440610 on n-h1-846466-12 Aug 04 16:52:15.728690 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-4e930f66-6a5b-402b-aed1-160ed38eebf9 req-e0a7a072-6dfc-43fe-9e52-a6bcbfaa6349 service nova] Creating event network-vif-plugged:cbcf974f-adce-4699-820a-253d13eee06d for instance 8e273267-ae4b-4a99-821e-1c02c3440610 on n-h1-846466-12 Aug 04 16:52:15.729399 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-4e930f66-6a5b-402b-aed1-160ed38eebf9 req-e0a7a072-6dfc-43fe-9e52-a6bcbfaa6349 service nova] Creating event network-vif-plugged:60a27540-9c7c-46c8-a5bc-7d1e309c4659 for instance 8e273267-ae4b-4a99-821e-1c02c3440610 on n-h1-846466-12 Aug 04 16:52:15.741139 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-4e930f66-6a5b-402b-aed1-160ed38eebf9 req-e0a7a072-6dfc-43fe-9e52-a6bcbfaa6349 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.147324 Aug 04 16:52:15.748583 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1608/3264] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:52:15.765402 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-ca33a109-762d-4d1a-8f63-b9fa615f13c7 req-85118ad9-da15-4cb5-b1f1-28af463bafe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c62ae02-0f30-43e1-a005-89dcb8122d4e", "name": "network-vif-deleted", "tag": "93c46fa1-3978-4529-9c01-36e6a216c294"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:15.780671 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7e74c5d2-aec2-4758-a8d3-8c02dfc06bbb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438d083dc9e74b2f8970455505791250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce955c9158463e9e98c53b99c581ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:15.790360 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7e74c5d2-aec2-4758-a8d3-8c02dfc06bbb tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 200 len: 1323 microversion: 2.1 time: 0.374469 Aug 04 16:52:15.804110 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1657/3265] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:15 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 1323 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:15.811154 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-ca33a109-762d-4d1a-8f63-b9fa615f13c7 req-85118ad9-da15-4cb5-b1f1-28af463bafe1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:15.811626 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-ca33a109-762d-4d1a-8f63-b9fa615f13c7 req-85118ad9-da15-4cb5-b1f1-28af463bafe1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:15.848140 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-ca33a109-762d-4d1a-8f63-b9fa615f13c7 req-85118ad9-da15-4cb5-b1f1-28af463bafe1 service nova] Creating event network-vif-deleted:93c46fa1-3978-4529-9c01-36e6a216c294 for instance 0c62ae02-0f30-43e1-a005-89dcb8122d4e on n-h1-846466-12 Aug 04 16:52:15.863063 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-ca33a109-762d-4d1a-8f63-b9fa615f13c7 req-85118ad9-da15-4cb5-b1f1-28af463bafe1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112907 Aug 04 16:52:15.866547 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1609/3266] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:52:15.962298 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e9f1840f-e049-4479-9d60-6bf1ed067d52 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:15.963026 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e9f1840f-e049-4479-9d60-6bf1ed067d52 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] [instance: 9139a17d-927c-4595-a7ff-11a1fa3a6a69] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:15.992721 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e9f1840f-e049-4479-9d60-6bf1ed067d52 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:15.994862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e9f1840f-e049-4479-9d60-6bf1ed067d52 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:15.999560 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e9f1840f-e049-4479-9d60-6bf1ed067d52 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:16.003892 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e9f1840f-e049-4479-9d60-6bf1ed067d52 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:16.395517 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e9f1840f-e049-4479-9d60-6bf1ed067d52 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad56451fe41482585833461124f0497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3731044d35c449289d1000d0628d06c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:16.412491 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e9f1840f-e049-4479-9d60-6bf1ed067d52 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/servers/9139a17d-927c-4595-a7ff-11a1fa3a6a69" status: 200 len: 1432 microversion: 2.1 time: 0.455036 Aug 04 16:52:16.415290 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1658/3267] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:15 2022] GET /compute/v2.1/servers/9139a17d-927c-4595-a7ff-11a1fa3a6a69 => generated 1432 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:16.444719 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5c9fd6cd-5760-41c4-b3b3-e70828d82dbf tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:16.452033 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-12f44ef3-63e9-49ae-9564-d0af4b9f773b tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:16.453722 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5c9fd6cd-5760-41c4-b3b3-e70828d82dbf tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:16.456657 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-12f44ef3-63e9-49ae-9564-d0af4b9f773b tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:16.486766 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5c9fd6cd-5760-41c4-b3b3-e70828d82dbf tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:16.491967 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5c9fd6cd-5760-41c4-b3b3-e70828d82dbf tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:16.493515 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5c9fd6cd-5760-41c4-b3b3-e70828d82dbf tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:16.494251 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5c9fd6cd-5760-41c4-b3b3-e70828d82dbf tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:16.498899 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-12f44ef3-63e9-49ae-9564-d0af4b9f773b tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:16.501933 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-12f44ef3-63e9-49ae-9564-d0af4b9f773b tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:16.511384 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-12f44ef3-63e9-49ae-9564-d0af4b9f773b tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:16.512894 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-12f44ef3-63e9-49ae-9564-d0af4b9f773b tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:17.087637 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5c9fd6cd-5760-41c4-b3b3-e70828d82dbf tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:17.105620 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5c9fd6cd-5760-41c4-b3b3-e70828d82dbf tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d" status: 200 len: 1282 microversion: 2.1 time: 0.660523 Aug 04 16:52:17.126319 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1659/3268] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:16 2022] GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d => generated 1282 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:17.133620 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f03073f4-02f8-4577-bb4e-6fc3f8c800c9 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '.version_select at 0x7f7e87361b80>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:17.306705 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f03073f4-02f8-4577-bb4e-6fc3f8c800c9 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5" status: 200 len: 1427 microversion: 2.1 time: 0.178689 Aug 04 16:52:17.313934 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1660/3269] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:52:17 2022] GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5 => generated 1427 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:17.329682 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dc9b72d4-8a5a-4dca-a5d8-f5551f0dbe1b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:17.333176 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dc9b72d4-8a5a-4dca-a5d8-f5551f0dbe1b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] [instance: 0c62ae02-0f30-43e1-a005-89dcb8122d4e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:17.365340 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dc9b72d4-8a5a-4dca-a5d8-f5551f0dbe1b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:17.368600 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dc9b72d4-8a5a-4dca-a5d8-f5551f0dbe1b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:17.376823 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dc9b72d4-8a5a-4dca-a5d8-f5551f0dbe1b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:17.379078 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dc9b72d4-8a5a-4dca-a5d8-f5551f0dbe1b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:17.447285 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-dc9b72d4-8a5a-4dca-a5d8-f5551f0dbe1b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] HTTP exception thrown: Instance 0c62ae02-0f30-43e1-a005-89dcb8122d4e could not be found. Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dc9b72d4-8a5a-4dca-a5d8-f5551f0dbe1b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Request method failure captured: Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e HTTP/1.1 Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_abSC_qd4PHP0W808xgrI7Q0G4tlPTiB2-LAH-LZMv8d9UcRN9ZCFy6_giyx-c7RjiKNjELhrKAi_ora1AVfsDng4FTG7brYif3-z0rtdjlkilo5AULdT4A615Ra8__IvKNYC3N__kBvOWqowuttGiKr7m7ap4YyjQHEc3cVcyVFSU Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 96ce955c9158463e9e98c53b99c581ec Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerActionsTestJSON-697118571 Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96ce955c9158463e9e98c53b99c581ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_96ce955c9158463e9e98c53b99c581ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96ce955c9158463e9e98c53b99c581ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/96ce955c9158463e9e98c53b99c581ec"}]}] Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerActionsTestJSON-697118571 Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 96ce955c9158463e9e98c53b99c581ec Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerActionsTestJSON-697118571 Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerActionsTestJSON-697118571-project Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 438d083dc9e74b2f8970455505791250 Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerActionsTestJSON-697118571-project Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 0c62ae02-0f30-43e1-a005-89dcb8122d4e could not be found. Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '0c62ae02-0f30-43e1-a005-89dcb8122d4e'} Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c62ae02-0f30-43e1-a005-89dcb8122d4e could not be found. Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c62ae02-0f30-43e1-a005-89dcb8122d4e could not be found. Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:52:17.452923 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:52:17.457649 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:17.457649 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:52:17.457649 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:52:17.457649 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:52:17.457649 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:52:17.457649 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c62ae02-0f30-43e1-a005-89dcb8122d4e could not be found. Aug 04 16:52:17.457649 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:52:17.457649 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dc9b72d4-8a5a-4dca-a5d8-f5551f0dbe1b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Returning 404 to user: Instance 0c62ae02-0f30-43e1-a005-89dcb8122d4e could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:52:17.457649 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dc9b72d4-8a5a-4dca-a5d8-f5551f0dbe1b tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e" status: 404 len: 111 microversion: 2.1 time: 0.137714 Aug 04 16:52:17.457649 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1661/3270] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:17 2022] GET /compute/v2.1/servers/0c62ae02-0f30-43e1-a005-89dcb8122d4e => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:52:17.469273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d114a38f-db92-4620-a014-10a425cc2edd tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:17.470291 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d114a38f-db92-4620-a014-10a425cc2edd tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] [instance: 9139a17d-927c-4595-a7ff-11a1fa3a6a69] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:17.490918 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d114a38f-db92-4620-a014-10a425cc2edd tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:17.493231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d114a38f-db92-4620-a014-10a425cc2edd tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:17.496220 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d114a38f-db92-4620-a014-10a425cc2edd tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:17.499135 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d114a38f-db92-4620-a014-10a425cc2edd tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:17.530022 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-d114a38f-db92-4620-a014-10a425cc2edd tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] HTTP exception thrown: Instance 9139a17d-927c-4595-a7ff-11a1fa3a6a69 could not be found. Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d114a38f-db92-4620-a014-10a425cc2edd tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Request method failure captured: Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/9139a17d-927c-4595-a7ff-11a1fa3a6a69 HTTP/1.1 Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_iJPM438P9dcnyIgNmMwzKD-zIndV3SvqTs48BBKrIkKKtZxKFzQG3_nrRFWuSAk6PApBLS20n18pF0PiYTAlLSDDtReRwo9OpQZH92vn6L7h9NOi6fMN2a2R7YgvZe-AmQZKezmBy5tnQpJ2b9LDNdi51Jb1XXx75RnhAAvVTg65M Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 3731044d35c449289d1000d0628d06c4 Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ListImageFiltersTestJSON-1008370460 Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3731044d35c449289d1000d0628d06c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3731044d35c449289d1000d0628d06c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3731044d35c449289d1000d0628d06c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3731044d35c449289d1000d0628d06c4"}]}] Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ListImageFiltersTestJSON-1008370460 Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 3731044d35c449289d1000d0628d06c4 Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1008370460 Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ListImageFiltersTestJSON-1008370460-project Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 8ad56451fe41482585833461124f0497 Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ListImageFiltersTestJSON-1008370460-project Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 9139a17d-927c-4595-a7ff-11a1fa3a6a69 could not be found. Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '9139a17d-927c-4595-a7ff-11a1fa3a6a69'} Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9139a17d-927c-4595-a7ff-11a1fa3a6a69 could not be found. Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9139a17d-927c-4595-a7ff-11a1fa3a6a69 could not be found. Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:52:17.531652 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:52:17.538383 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:17.538383 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:52:17.538383 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:52:17.538383 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:52:17.538383 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:52:17.538383 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9139a17d-927c-4595-a7ff-11a1fa3a6a69 could not be found. Aug 04 16:52:17.538383 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:52:17.538383 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d114a38f-db92-4620-a014-10a425cc2edd tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Returning 404 to user: Instance 9139a17d-927c-4595-a7ff-11a1fa3a6a69 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:52:17.538383 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d114a38f-db92-4620-a014-10a425cc2edd tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "GET /compute/v2.1/servers/9139a17d-927c-4595-a7ff-11a1fa3a6a69" status: 404 len: 111 microversion: 2.1 time: 0.074901 Aug 04 16:52:17.541661 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1662/3271] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:17 2022] GET /compute/v2.1/servers/9139a17d-927c-4595-a7ff-11a1fa3a6a69 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:52:17.549965 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2ecfaa7a-ce0e-4982-89cb-fc0fac99d72f tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] Calling method '.version_select at 0x7f7e84607430>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:17.597466 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2ecfaa7a-ce0e-4982-89cb-fc0fac99d72f tempest-ServerActionsTestJSON-697118571 tempest-ServerActionsTestJSON-697118571-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-496783257" status: 202 len: 0 microversion: 2.1 time: 0.053683 Aug 04 16:52:17.603227 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1663/3272] 10.222.0.23 () {58 vars in 1218 bytes} [Thu Aug 4 16:52:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-496783257 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:52:17.612364 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-32e620ab-beaa-42e3-b631-7c8cf341d303 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e8421fc10>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:19.316736 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-32e620ab-beaa-42e3-b631-7c8cf341d303 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "DELETE /compute/v2.1/images/d010b829-4d79-4cab-8cb1-1527e8ee4c61" status: 204 len: 0 microversion: 2.1 time: 1.709201 Aug 04 16:52:19.320825 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1664/3273] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:17 2022] DELETE /compute/v2.1/images/d010b829-4d79-4cab-8cb1-1527e8ee4c61 => generated 0 bytes in 1714 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:52:19.336820 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-438263e8-62bb-47c6-b3fb-90630c9fd25a req-c5016969-0f9a-49b9-b8ea-4fb647c6ec9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e273267-ae4b-4a99-821e-1c02c3440610", "name": "network-vif-plugged", "status": "completed", "tag": "1155cb3d-57af-4e24-82ea-543e08adca46"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:19.387291 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-438263e8-62bb-47c6-b3fb-90630c9fd25a req-c5016969-0f9a-49b9-b8ea-4fb647c6ec9c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:19.388544 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-438263e8-62bb-47c6-b3fb-90630c9fd25a req-c5016969-0f9a-49b9-b8ea-4fb647c6ec9c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:19.450448 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-438263e8-62bb-47c6-b3fb-90630c9fd25a req-c5016969-0f9a-49b9-b8ea-4fb647c6ec9c service nova] Creating event network-vif-plugged:1155cb3d-57af-4e24-82ea-543e08adca46 for instance 8e273267-ae4b-4a99-821e-1c02c3440610 on n-h1-846466-12 Aug 04 16:52:19.486047 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-438263e8-62bb-47c6-b3fb-90630c9fd25a req-c5016969-0f9a-49b9-b8ea-4fb647c6ec9c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153839 Aug 04 16:52:19.494824 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1665/3274] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:52:19.512174 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-18a2ebbc-bd5c-4f7c-9573-4e4c28c911de tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:19.518538 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-18a2ebbc-bd5c-4f7c-9573-4e4c28c911de tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:19.532651 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-18a2ebbc-bd5c-4f7c-9573-4e4c28c911de tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:19.533521 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-18a2ebbc-bd5c-4f7c-9573-4e4c28c911de tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:19.534456 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-18a2ebbc-bd5c-4f7c-9573-4e4c28c911de tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:19.535039 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-18a2ebbc-bd5c-4f7c-9573-4e4c28c911de tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:19.545024 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:52:19.953661 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-12f44ef3-63e9-49ae-9564-d0af4b9f773b tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:19.981914 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-12f44ef3-63e9-49ae-9564-d0af4b9f773b tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:19.983798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-12f44ef3-63e9-49ae-9564-d0af4b9f773b tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:19.989173 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-12f44ef3-63e9-49ae-9564-d0af4b9f773b tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1875 microversion: 2.42 time: 3.553633 Aug 04 16:52:19.990133 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1610/3275] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:52:16 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1875 bytes in 3560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:52:20.001721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-e234f4c5-e9e8-460c-b110-75f8b326f292 req-aa42acf3-e61e-48e9-bb87-5ab3dd7c8254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9139a17d-927c-4595-a7ff-11a1fa3a6a69", "name": "network-vif-deleted", "tag": "ec13d30d-7a89-4d60-b71e-301109f0b912"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:20.020571 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-e234f4c5-e9e8-460c-b110-75f8b326f292 req-aa42acf3-e61e-48e9-bb87-5ab3dd7c8254 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:20.057836 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-e234f4c5-e9e8-460c-b110-75f8b326f292 req-aa42acf3-e61e-48e9-bb87-5ab3dd7c8254 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:20.091473 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-e234f4c5-e9e8-460c-b110-75f8b326f292 req-aa42acf3-e61e-48e9-bb87-5ab3dd7c8254 service nova] Creating event network-vif-deleted:ec13d30d-7a89-4d60-b71e-301109f0b912 for instance 9139a17d-927c-4595-a7ff-11a1fa3a6a69 on n-h1-846466-12 Aug 04 16:52:20.100656 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-e234f4c5-e9e8-460c-b110-75f8b326f292 req-aa42acf3-e61e-48e9-bb87-5ab3dd7c8254 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107150 Aug 04 16:52:20.110251 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1611/3276] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:52:20.117440 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-500425e1-5156-4e6c-89eb-9e9f064e963b tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '.version_select at 0x7f7e842148b0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:20.186793 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-500425e1-5156-4e6c-89eb-9e9f064e963b tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5" status: 200 len: 1436 microversion: 2.1 time: 0.074942 Aug 04 16:52:20.190549 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1612/3277] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:52:20 2022] GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5 => generated 1436 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:20.203876 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ee1bad79-1cc6-4134-accc-853d9cbbb53c tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e841b15e0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:20.362967 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-18a2ebbc-bd5c-4f7c-9573-4e4c28c911de tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:20.380016 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-18a2ebbc-bd5c-4f7c-9573-4e4c28c911de tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d" status: 200 len: 1324 microversion: 2.1 time: 0.881781 Aug 04 16:52:20.380921 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1666/3278] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:19 2022] GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d => generated 1324 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:20.386032 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-84197ef1-7599-44b1-b8d7-17791f43ec8e tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '.version_select at 0x7f7e84607ee0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:20.409817 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:52:20.463275 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-84197ef1-7599-44b1-b8d7-17791f43ec8e tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5" status: 200 len: 1436 microversion: 2.1 time: 0.081050 Aug 04 16:52:20.471902 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1667/3279] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:52:20 2022] GET /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5 => generated 1436 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:20.484076 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-70f66d8f-f454-4fc9-bd58-7083d4804ae1 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:20.484740 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-70f66d8f-f454-4fc9-bd58-7083d4804ae1 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] [instance: f91fdc58-3e45-4fc2-8bae-bda8292c908d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:20.491535 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=10 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:52:20.495500 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-70f66d8f-f454-4fc9-bd58-7083d4804ae1 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:20.496292 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-70f66d8f-f454-4fc9-bd58-7083d4804ae1 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:20.497720 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-70f66d8f-f454-4fc9-bd58-7083d4804ae1 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:20.498491 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-70f66d8f-f454-4fc9-bd58-7083d4804ae1 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:20.638493 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ee1bad79-1cc6-4134-accc-853d9cbbb53c tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "DELETE /compute/v2.1/images/4db9ab92-af40-463d-bbb5-2620217c9dc0" status: 204 len: 0 microversion: 2.1 time: 0.446236 Aug 04 16:52:20.642323 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1613/3280] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:20 2022] DELETE /compute/v2.1/images/4db9ab92-af40-463d-bbb5-2620217c9dc0 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:52:20.653202 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-276bb209-acc9-4c9a-b120-e6b5957749d0 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] Calling method '.version_select at 0x7f7e89b759d0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:21.284337 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-276bb209-acc9-4c9a-b120-e6b5957749d0 tempest-ListImageFiltersTestJSON-1008370460 tempest-ListImageFiltersTestJSON-1008370460-project] 10.222.0.23 "DELETE /compute/v2.1/images/a43c8115-32f0-419c-9b79-1f9b97e22f50" status: 204 len: 0 microversion: 2.1 time: 0.636739 Aug 04 16:52:21.288406 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1614/3281] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:20 2022] DELETE /compute/v2.1/images/a43c8115-32f0-419c-9b79-1f9b97e22f50 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:52:21.297949 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-14d08b7f-a936-4ef2-9d20-e089a1d2acd7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:21.300434 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-14d08b7f-a936-4ef2-9d20-e089a1d2acd7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:21.324808 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-14d08b7f-a936-4ef2-9d20-e089a1d2acd7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:21.326643 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-14d08b7f-a936-4ef2-9d20-e089a1d2acd7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:21.330888 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-14d08b7f-a936-4ef2-9d20-e089a1d2acd7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:21.331130 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-14d08b7f-a936-4ef2-9d20-e089a1d2acd7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:21.433442 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-70f66d8f-f454-4fc9-bd58-7083d4804ae1 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4c0d6fac94470d9665f19021d50007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96b36239054414182544ccfe7550cd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:21.448377 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-70f66d8f-f454-4fc9-bd58-7083d4804ae1 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d" status: 200 len: 1466 microversion: 2.1 time: 0.973174 Aug 04 16:52:21.462853 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1668/3282] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:20 2022] GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d => generated 1466 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:52:21.462853 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-665edc3f-65e5-4a61-918b-b06ddfb51dcc tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:21.462853 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-665edc3f-65e5-4a61-918b-b06ddfb51dcc tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:21.477484 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-665edc3f-65e5-4a61-918b-b06ddfb51dcc tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:21.479653 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-665edc3f-65e5-4a61-918b-b06ddfb51dcc tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:21.481486 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-665edc3f-65e5-4a61-918b-b06ddfb51dcc tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:21.481973 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-665edc3f-65e5-4a61-918b-b06ddfb51dcc tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:22.171465 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-14d08b7f-a936-4ef2-9d20-e089a1d2acd7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:22.197879 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-14d08b7f-a936-4ef2-9d20-e089a1d2acd7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:22.199708 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-14d08b7f-a936-4ef2-9d20-e089a1d2acd7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:22.200922 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-14d08b7f-a936-4ef2-9d20-e089a1d2acd7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1875 microversion: 2.42 time: 0.910595 Aug 04 16:52:22.201520 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1615/3283] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:52:21 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1875 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:52:22.211377 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-47d11940-e8c5-4a70-bad2-1e1a158018f5 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '.version_select at 0x7f7e84214550>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:22.324686 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-665edc3f-65e5-4a61-918b-b06ddfb51dcc tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:22.337727 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-665edc3f-65e5-4a61-918b-b06ddfb51dcc tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d" status: 200 len: 1324 microversion: 2.1 time: 0.883132 Aug 04 16:52:22.346136 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1669/3284] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:21 2022] GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d => generated 1324 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:23.103746 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-7d78051b-427c-4201-ad6b-48a154ec2027 req-a876137c-af17-420c-95fa-05e7c2fb9db4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f91fdc58-3e45-4fc2-8bae-bda8292c908d", "name": "network-vif-unplugged", "status": "completed", "tag": "8310e003-7985-4b7a-81eb-81193a3418ab"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:23.126535 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7d78051b-427c-4201-ad6b-48a154ec2027 req-a876137c-af17-420c-95fa-05e7c2fb9db4 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:23.127358 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7d78051b-427c-4201-ad6b-48a154ec2027 req-a876137c-af17-420c-95fa-05e7c2fb9db4 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:23.155376 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-7d78051b-427c-4201-ad6b-48a154ec2027 req-a876137c-af17-420c-95fa-05e7c2fb9db4 service nova] Creating event network-vif-unplugged:8310e003-7985-4b7a-81eb-81193a3418ab for instance f91fdc58-3e45-4fc2-8bae-bda8292c908d on n-h1-846466-12 Aug 04 16:52:23.166019 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-7d78051b-427c-4201-ad6b-48a154ec2027 req-a876137c-af17-420c-95fa-05e7c2fb9db4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066961 Aug 04 16:52:23.167640 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1670/3285] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:52:23.227784 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b82836f8-f5d7-4d25-aaae-58c2e79b71f8 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:23.230139 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b82836f8-f5d7-4d25-aaae-58c2e79b71f8 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:23.275748 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b82836f8-f5d7-4d25-aaae-58c2e79b71f8 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:23.276394 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b82836f8-f5d7-4d25-aaae-58c2e79b71f8 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:23.277462 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b82836f8-f5d7-4d25-aaae-58c2e79b71f8 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:23.278586 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b82836f8-f5d7-4d25-aaae-58c2e79b71f8 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:23.335718 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-47d11940-e8c5-4a70-bad2-1e1a158018f5 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "DELETE /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5" status: 204 len: 0 microversion: 2.1 time: 1.132933 Aug 04 16:52:23.336585 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1616/3286] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:22 2022] DELETE /compute/v2.1/images/ce0233e9-953a-4a39-8f5f-77f1eafaffc5 => generated 0 bytes in 1134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:52:23.345311 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-67dd4ff7-e70c-4874-b005-e87f2122f2e5 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '.version_select at 0x7f7e841f0c10>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:23.372617 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-67dd4ff7-e70c-4874-b005-e87f2122f2e5 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] HTTP exception thrown: Image not found. Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-67dd4ff7-e70c-4874-b005-e87f2122f2e5 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Request method failure captured: Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/images/424dce4c-9c5b-4295-bdcb-b0322621a2a5 HTTP/1.1 Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_jaIFQsvdDRq7ekzpKpaUdeG9RQ8sRqB0RVu8K0-1usQLyXf0BqO8bECFhERXc7ENKwGW5hp5Jl2YUuzmhqVAvqNq_sLNEMxfA77PUnMxhVwNvM7g7I6bz2N9D9ugLcBFOQ3n6gM0iCfIoLUhdrol0zuMl7QyBwgiLVeMBC4cPmmIM Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: c96b36239054414182544ccfe7550cd9 Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ImagesOneServerTestJSON-1892066733 Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c96b36239054414182544ccfe7550cd9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c96b36239054414182544ccfe7550cd9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c96b36239054414182544ccfe7550cd9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c96b36239054414182544ccfe7550cd9"}]}] Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ImagesOneServerTestJSON-1892066733 Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: c96b36239054414182544ccfe7550cd9 Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1892066733 Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ImagesOneServerTestJSON-1892066733-project Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: eb4c0d6fac94470d9665f19021d50007 Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ImagesOneServerTestJSON-1892066733-project Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: exception: Image not found. Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '424dce4c-9c5b-4295-bdcb-b0322621a2a5'} Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 424dce4c-9c5b-4295-bdcb-b0322621a2a5 to delete Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 424dce4c-9c5b-4295-bdcb-b0322621a2a5 could not be found. Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:23.374744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:23.380197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:52:23.380197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:52:23.380197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:52:23.380197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:52:23.380197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:52:23.380197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:52:23.380197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:52:23.380197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:52:23.380197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 16:52:23.380197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 16:52:23.380197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 16:52:23.380197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:23.380197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:52:23.380197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:23.380197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:23.380197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:52:23.380197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:52:23.380197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:52:23.380197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:52:23.380197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 16:52:23.380197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:23.380197 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-67dd4ff7-e70c-4874-b005-e87f2122f2e5 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Returning 404 to user: Image not found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:52:23.380197 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-67dd4ff7-e70c-4874-b005-e87f2122f2e5 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "DELETE /compute/v2.1/images/424dce4c-9c5b-4295-bdcb-b0322621a2a5" status: 404 len: 62 microversion: 2.1 time: 0.037883 Aug 04 16:52:23.385054 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1617/3287] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:23 2022] DELETE /compute/v2.1/images/424dce4c-9c5b-4295-bdcb-b0322621a2a5 => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:52:23.391710 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7125dc95-0408-4c60-889a-347e768d7247 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:23.392324 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7125dc95-0408-4c60-889a-347e768d7247 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:23.399880 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7125dc95-0408-4c60-889a-347e768d7247 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:23.400594 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7125dc95-0408-4c60-889a-347e768d7247 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:23.401581 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7125dc95-0408-4c60-889a-347e768d7247 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:23.402309 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7125dc95-0408-4c60-889a-347e768d7247 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:24.797338 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b82836f8-f5d7-4d25-aaae-58c2e79b71f8 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:24.808656 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b82836f8-f5d7-4d25-aaae-58c2e79b71f8 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:24.810908 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7125dc95-0408-4c60-889a-347e768d7247 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:24.811416 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b82836f8-f5d7-4d25-aaae-58c2e79b71f8 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:24.812450 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b82836f8-f5d7-4d25-aaae-58c2e79b71f8 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 2830 microversion: 2.42 time: 1.591863 Aug 04 16:52:24.813334 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1671/3288] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:52:23 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 2830 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:52:24.818567 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a59f28dc-81c2-4e38-8310-42d042a48d0e tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:24.819362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a59f28dc-81c2-4e38-8310-42d042a48d0e tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] [instance: f91fdc58-3e45-4fc2-8bae-bda8292c908d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:24.826680 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a59f28dc-81c2-4e38-8310-42d042a48d0e tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:24.827602 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a59f28dc-81c2-4e38-8310-42d042a48d0e tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:24.828663 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a59f28dc-81c2-4e38-8310-42d042a48d0e tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:24.829337 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a59f28dc-81c2-4e38-8310-42d042a48d0e tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:24.834157 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7125dc95-0408-4c60-889a-347e768d7247 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d" status: 200 len: 1324 microversion: 2.1 time: 1.447834 Aug 04 16:52:24.835029 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1618/3289] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:23 2022] GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d => generated 1324 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:24.870616 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a59f28dc-81c2-4e38-8310-42d042a48d0e tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] [instance: f91fdc58-3e45-4fc2-8bae-bda8292c908d] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:52:24.911552 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-46658bba-57de-47fd-b684-2ef67017dcfe tempest-ListImageFiltersNegativeTestJSON-1599872311 tempest-ListImageFiltersNegativeTestJSON-1599872311-project] Calling method '.version_select at 0x7f7e89b758b0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:24.936539 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-46658bba-57de-47fd-b684-2ef67017dcfe tempest-ListImageFiltersNegativeTestJSON-1599872311 tempest-ListImageFiltersNegativeTestJSON-1599872311-project] HTTP exception thrown: Image not found. Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-46658bba-57de-47fd-b684-2ef67017dcfe tempest-ListImageFiltersNegativeTestJSON-1599872311 tempest-ListImageFiltersNegativeTestJSON-1599872311-project] Request method failure captured: Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/images/00cd7dfc-0e72-43d5-9197-af3551e099a2 HTTP/1.1 Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_lHi11FxWSxvtMpdOcmEMiHEWOMO1hxrbDQ_T4xoTGrEAIRxaOkr-wZmNdr2QN-7626HOfXrULPa43irVGfqW6PcWImPOWM_q6KQeM_akyLZRcJFk34b381ifNuM-Kxajdogd7spx4-QfAADjVb-x3FfQd_AGo8JfBHfpKvOL8G5cw Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: bcd66342e2ed4e6f9a079c9e5a745b0a Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1599872311 Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcd66342e2ed4e6f9a079c9e5a745b0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bcd66342e2ed4e6f9a079c9e5a745b0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcd66342e2ed4e6f9a079c9e5a745b0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bcd66342e2ed4e6f9a079c9e5a745b0a"}]}] Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1599872311 Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: bcd66342e2ed4e6f9a079c9e5a745b0a Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1599872311 Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ListImageFiltersNegativeTestJSON-1599872311-project Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 607a7b83eb8f407689f88f4166320e83 Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1599872311-project Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: exception: Image not found. Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '00cd7dfc-0e72-43d5-9197-af3551e099a2'} Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 00cd7dfc-0e72-43d5-9197-af3551e099a2 Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 16:52:24.938976 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 00cd7dfc-0e72-43d5-9197-af3551e099a2 could not be found. Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 16:52:24.943559 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:24.953331 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-46658bba-57de-47fd-b684-2ef67017dcfe tempest-ListImageFiltersNegativeTestJSON-1599872311 tempest-ListImageFiltersNegativeTestJSON-1599872311-project] Returning 404 to user: Image not found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:52:24.953331 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-46658bba-57de-47fd-b684-2ef67017dcfe tempest-ListImageFiltersNegativeTestJSON-1599872311 tempest-ListImageFiltersNegativeTestJSON-1599872311-project] 10.222.0.23 "GET /compute/v2.1/images/00cd7dfc-0e72-43d5-9197-af3551e099a2" status: 404 len: 62 microversion: 2.1 time: 0.114506 Aug 04 16:52:24.953331 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1619/3290] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:52:24 2022] GET /compute/v2.1/images/00cd7dfc-0e72-43d5-9197-af3551e099a2 => generated 62 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:52:24.962095 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-b1b7c1ea-2645-472e-92f1-a34dbb583319 req-18f4576a-e07e-495f-b65a-58451557dfeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d", "tag": "a765ebd9-dbc5-4427-9287-f73efbed592f"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:24.975374 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-b1b7c1ea-2645-472e-92f1-a34dbb583319 req-18f4576a-e07e-495f-b65a-58451557dfeb service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:24.976411 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-b1b7c1ea-2645-472e-92f1-a34dbb583319 req-18f4576a-e07e-495f-b65a-58451557dfeb service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:24.989902 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-b1b7c1ea-2645-472e-92f1-a34dbb583319 req-18f4576a-e07e-495f-b65a-58451557dfeb service nova] Creating event network-changed:a765ebd9-dbc5-4427-9287-f73efbed592f for instance 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d on n-h2-846466-12 Aug 04 16:52:24.996128 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-b1b7c1ea-2645-472e-92f1-a34dbb583319 req-18f4576a-e07e-495f-b65a-58451557dfeb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042350 Aug 04 16:52:24.997436 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1620/3291] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:52:25.003585 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-95b27e74-3abe-4529-b587-ab9b5587d9e0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:25.004728 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-95b27e74-3abe-4529-b587-ab9b5587d9e0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:25.012432 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-95b27e74-3abe-4529-b587-ab9b5587d9e0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:25.013009 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-95b27e74-3abe-4529-b587-ab9b5587d9e0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:25.013978 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-95b27e74-3abe-4529-b587-ab9b5587d9e0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:25.014960 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-95b27e74-3abe-4529-b587-ab9b5587d9e0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:25.015282 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a59f28dc-81c2-4e38-8310-42d042a48d0e tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d" status: 204 len: 0 microversion: 2.1 time: 0.199866 Aug 04 16:52:25.015924 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1672/3292] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:52:24 2022] DELETE /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:52:25.026173 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f725a45d-2adb-43d8-bcfb-41f4724ee36c tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:25.026932 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f725a45d-2adb-43d8-bcfb-41f4724ee36c tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] [instance: f91fdc58-3e45-4fc2-8bae-bda8292c908d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:25.034333 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f725a45d-2adb-43d8-bcfb-41f4724ee36c tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:25.035921 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f725a45d-2adb-43d8-bcfb-41f4724ee36c tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:25.038427 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f725a45d-2adb-43d8-bcfb-41f4724ee36c tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:25.039509 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f725a45d-2adb-43d8-bcfb-41f4724ee36c tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:25.397670 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-95b27e74-3abe-4529-b587-ab9b5587d9e0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.398652 Aug 04 16:52:25.399349 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1621/3293] 10.222.0.23 () {60 vars in 1316 bytes} [Thu Aug 4 16:52:24 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610/os-interface => generated 1830 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:52:25.732797 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f725a45d-2adb-43d8-bcfb-41f4724ee36c tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4c0d6fac94470d9665f19021d50007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96b36239054414182544ccfe7550cd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:25.742110 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f725a45d-2adb-43d8-bcfb-41f4724ee36c tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d" status: 200 len: 1472 microversion: 2.1 time: 0.720485 Aug 04 16:52:25.755644 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1673/3294] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:25 2022] GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d => generated 1472 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:25.855318 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f70d35d8-9107-429b-b0eb-7cca380a3f6d tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:25.856024 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f70d35d8-9107-429b-b0eb-7cca380a3f6d tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:25.869611 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f70d35d8-9107-429b-b0eb-7cca380a3f6d tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:25.874964 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f70d35d8-9107-429b-b0eb-7cca380a3f6d tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:25.875807 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f70d35d8-9107-429b-b0eb-7cca380a3f6d tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:25.876450 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f70d35d8-9107-429b-b0eb-7cca380a3f6d tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:26.360223 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f70d35d8-9107-429b-b0eb-7cca380a3f6d tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:26.377910 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f70d35d8-9107-429b-b0eb-7cca380a3f6d tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d" status: 200 len: 1324 microversion: 2.1 time: 0.526798 Aug 04 16:52:26.378509 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1622/3295] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:25 2022] GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d => generated 1324 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:26.764179 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d1697357-6ac8-4c16-9e2a-51736d1701b1 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:26.766283 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d1697357-6ac8-4c16-9e2a-51736d1701b1 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] [instance: f91fdc58-3e45-4fc2-8bae-bda8292c908d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:26.785254 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d1697357-6ac8-4c16-9e2a-51736d1701b1 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:26.786132 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d1697357-6ac8-4c16-9e2a-51736d1701b1 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:26.787168 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d1697357-6ac8-4c16-9e2a-51736d1701b1 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:26.790426 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d1697357-6ac8-4c16-9e2a-51736d1701b1 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:27.406244 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0c1ff263-727f-4e80-8bca-74bb1a48e78b tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1633983881", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "d55595d1-c83a-40d7-88f6-5c793936f01b"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:27.529592 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-0c1ff263-727f-4e80-8bca-74bb1a48e78b tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] validate_networks() for [('d55595d1-c83a-40d7-88f6-5c793936f01b', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:52:28.398662 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d1697357-6ac8-4c16-9e2a-51736d1701b1 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4c0d6fac94470d9665f19021d50007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96b36239054414182544ccfe7550cd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:28.407433 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d1697357-6ac8-4c16-9e2a-51736d1701b1 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d" status: 200 len: 1472 microversion: 2.1 time: 1.647274 Aug 04 16:52:28.418727 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1674/3296] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:26 2022] GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d => generated 1472 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:28.423959 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1ed5035a-7334-4dc4-94c6-bf9af3299aca tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:28.424859 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1ed5035a-7334-4dc4-94c6-bf9af3299aca tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:28.437409 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1ed5035a-7334-4dc4-94c6-bf9af3299aca tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:28.450075 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1ed5035a-7334-4dc4-94c6-bf9af3299aca tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:28.451257 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1ed5035a-7334-4dc4-94c6-bf9af3299aca tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:28.451876 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1ed5035a-7334-4dc4-94c6-bf9af3299aca tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:29.138535 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1ed5035a-7334-4dc4-94c6-bf9af3299aca tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:29.147821 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1ed5035a-7334-4dc4-94c6-bf9af3299aca tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d" status: 200 len: 1324 microversion: 2.1 time: 0.727544 Aug 04 16:52:29.162124 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1675/3297] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:28 2022] GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d => generated 1324 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:29.177274 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-8f2f6525-2d00-4785-beb9-bd2c6bc5ccbe req-86ed2a0d-0f8c-4f3d-a83a-64607e176f1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e273267-ae4b-4a99-821e-1c02c3440610", "tag": "cbcf974f-adce-4699-820a-253d13eee06d"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:29.197728 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-8f2f6525-2d00-4785-beb9-bd2c6bc5ccbe req-86ed2a0d-0f8c-4f3d-a83a-64607e176f1b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:29.198539 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-8f2f6525-2d00-4785-beb9-bd2c6bc5ccbe req-86ed2a0d-0f8c-4f3d-a83a-64607e176f1b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:29.220330 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-8f2f6525-2d00-4785-beb9-bd2c6bc5ccbe req-86ed2a0d-0f8c-4f3d-a83a-64607e176f1b service nova] Creating event network-changed:cbcf974f-adce-4699-820a-253d13eee06d for instance 8e273267-ae4b-4a99-821e-1c02c3440610 on n-h1-846466-12 Aug 04 16:52:29.239423 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-8f2f6525-2d00-4785-beb9-bd2c6bc5ccbe req-86ed2a0d-0f8c-4f3d-a83a-64607e176f1b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075579 Aug 04 16:52:29.240762 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1676/3298] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:52:29.558327 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1323ae78-43f7-46ee-9806-f6d9a8926893 tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] Action: 'create', calling method: .version_select at 0x7f7e84607d30>, body: {"keypair": {"name": "tempest-keypair-1003175294", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAV/ipsa+a/u0kojlktBjwLfT8uEH21I08tR7y3W/VAUTBQwopAXz6eDBVUbFhKLrtnQ0B3WiGZ0FtV2tpzFU0ol2ZmAyvgrB9oTz7dNrcgpEjjZldD04LExkw6Eku1XIw=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:29.585275 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-1323ae78-43f7-46ee-9806-f6d9a8926893 tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] Getting quotas for project aef198c17d9a4167b7b3c0136155c23f. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:52:29.592733 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-1323ae78-43f7-46ee-9806-f6d9a8926893 tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] Getting quotas for user f9b78502aed34953a76596864729b320 and project aef198c17d9a4167b7b3c0136155c23f. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:52:29.634964 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1323ae78-43f7-46ee-9806-f6d9a8926893 tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.392617 Aug 04 16:52:29.635987 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1677/3299] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 16:52:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:52:29.647557 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7296b808-32c7-4806-9a09-ce09dc28895c tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:29.648762 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7296b808-32c7-4806-9a09-ce09dc28895c tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] [instance: f91fdc58-3e45-4fc2-8bae-bda8292c908d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:29.664657 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7296b808-32c7-4806-9a09-ce09dc28895c tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:29.665193 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7296b808-32c7-4806-9a09-ce09dc28895c tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:29.666017 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7296b808-32c7-4806-9a09-ce09dc28895c tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:29.666447 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7296b808-32c7-4806-9a09-ce09dc28895c tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:31.009080 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7296b808-32c7-4806-9a09-ce09dc28895c tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4c0d6fac94470d9665f19021d50007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96b36239054414182544ccfe7550cd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:31.022707 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7296b808-32c7-4806-9a09-ce09dc28895c tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d" status: 200 len: 1472 microversion: 2.1 time: 1.385418 Aug 04 16:52:31.024512 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1678/3300] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:29 2022] GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d => generated 1472 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:31.037402 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-80fa4fda-6109-4555-b851-6f16cba2e0c2 tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] Calling method '.version_select at 0x7f7e84495a60>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:31.060019 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:52:31.074306 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-80fa4fda-6109-4555-b851-6f16cba2e0c2 tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-1003175294" status: 200 len: 498 microversion: 2.1 time: 0.048460 Aug 04 16:52:31.075495 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1679/3301] 10.222.0.23 () {58 vars in 1218 bytes} [Thu Aug 4 16:52:31 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1003175294 => generated 498 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:52:31.093431 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a8617684-cf61-4e32-8ba1-80ef7e69b0b9 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:31.094991 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a8617684-cf61-4e32-8ba1-80ef7e69b0b9 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:31.108862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8617684-cf61-4e32-8ba1-80ef7e69b0b9 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:31.109814 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8617684-cf61-4e32-8ba1-80ef7e69b0b9 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:31.111307 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8617684-cf61-4e32-8ba1-80ef7e69b0b9 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:31.112054 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8617684-cf61-4e32-8ba1-80ef7e69b0b9 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:31.412937 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-0c1ff263-727f-4e80-8bca-74bb1a48e78b tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:52:31.415743 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-0c1ff263-727f-4e80-8bca-74bb1a48e78b tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:52:31.416477 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-0c1ff263-727f-4e80-8bca-74bb1a48e78b tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:52:31.417112 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-0c1ff263-727f-4e80-8bca-74bb1a48e78b tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:52:31.417745 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-0c1ff263-727f-4e80-8bca-74bb1a48e78b tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:52:31.432500 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c1ff263-727f-4e80-8bca-74bb1a48e78b tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:31.433365 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c1ff263-727f-4e80-8bca-74bb1a48e78b tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:31.434985 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c1ff263-727f-4e80-8bca-74bb1a48e78b tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:31.435683 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c1ff263-727f-4e80-8bca-74bb1a48e78b tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:31.495625 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-0c1ff263-727f-4e80-8bca-74bb1a48e78b tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Getting quotas for project de1977041291401a84ef2fe9287b0fcb. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:52:31.517900 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-0c1ff263-727f-4e80-8bca-74bb1a48e78b tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Getting quotas for user e46767eac23745aaa0bf5c14c48d5411 and project de1977041291401a84ef2fe9287b0fcb. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:52:31.562087 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0c1ff263-727f-4e80-8bca-74bb1a48e78b tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:52:31.569806 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0c1ff263-727f-4e80-8bca-74bb1a48e78b tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] [instance: 0e09aad3-5375-4b00-bd45-a59da90e0b07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:52:31.651273 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0c1ff263-727f-4e80-8bca-74bb1a48e78b tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.609670 Aug 04 16:52:31.652955 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1623/3302] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:52:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 4613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:52:31.677302 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-51002b28-28ab-466e-8426-4a9cda03313f req-f5431d5f-eac9-4f76-8b7b-ee33ecccc792 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d", "name": "network-vif-plugged", "status": "completed", "tag": "a765ebd9-dbc5-4427-9287-f73efbed592f"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:31.749012 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-51002b28-28ab-466e-8426-4a9cda03313f req-f5431d5f-eac9-4f76-8b7b-ee33ecccc792 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:31.750025 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-51002b28-28ab-466e-8426-4a9cda03313f req-f5431d5f-eac9-4f76-8b7b-ee33ecccc792 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:31.770818 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-51002b28-28ab-466e-8426-4a9cda03313f req-f5431d5f-eac9-4f76-8b7b-ee33ecccc792 service nova] Creating event network-vif-plugged:a765ebd9-dbc5-4427-9287-f73efbed592f for instance 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d on n-h2-846466-12 Aug 04 16:52:31.779969 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-51002b28-28ab-466e-8426-4a9cda03313f req-f5431d5f-eac9-4f76-8b7b-ee33ecccc792 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124813 Aug 04 16:52:31.781404 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1624/3303] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:52:31.793574 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2255c39d-bb06-4222-99bb-43fdc26b5519 tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] Calling method '.version_select at 0x7f7e84ca7790>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:31.823416 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2255c39d-bb06-4222-99bb-43fdc26b5519 tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1003175294" status: 202 len: 0 microversion: 2.1 time: 0.040236 Aug 04 16:52:31.824833 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1625/3304] 10.222.0.23 () {58 vars in 1221 bytes} [Thu Aug 4 16:52:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1003175294 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:52:31.835382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-7b1c25c0-70df-4c4a-9d1c-306a15f29a04 req-9eede2c3-d632-46c3-9329-673927dffa0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f91fdc58-3e45-4fc2-8bae-bda8292c908d", "name": "network-vif-deleted", "tag": "8310e003-7985-4b7a-81eb-81193a3418ab"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:31.853205 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-7b1c25c0-70df-4c4a-9d1c-306a15f29a04 req-9eede2c3-d632-46c3-9329-673927dffa0b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:31.854052 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-7b1c25c0-70df-4c4a-9d1c-306a15f29a04 req-9eede2c3-d632-46c3-9329-673927dffa0b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:31.878072 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-7b1c25c0-70df-4c4a-9d1c-306a15f29a04 req-9eede2c3-d632-46c3-9329-673927dffa0b service nova] Creating event network-vif-deleted:8310e003-7985-4b7a-81eb-81193a3418ab for instance f91fdc58-3e45-4fc2-8bae-bda8292c908d on n-h1-846466-12 Aug 04 16:52:31.889746 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-7b1c25c0-70df-4c4a-9d1c-306a15f29a04 req-9eede2c3-d632-46c3-9329-673927dffa0b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062506 Aug 04 16:52:31.891709 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1626/3305] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:52:31.903393 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-283a0682-1943-4b81-a28e-ee4f2e230b09 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:31.904540 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-283a0682-1943-4b81-a28e-ee4f2e230b09 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] [instance: 0e09aad3-5375-4b00-bd45-a59da90e0b07] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:32.069861 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a8617684-cf61-4e32-8ba1-80ef7e69b0b9 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:32.083341 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-283a0682-1943-4b81-a28e-ee4f2e230b09 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46767eac23745aaa0bf5c14c48d5411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1977041291401a84ef2fe9287b0fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:32.092855 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a8617684-cf61-4e32-8ba1-80ef7e69b0b9 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d" status: 200 len: 1324 microversion: 2.1 time: 1.015912 Aug 04 16:52:32.093549 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-283a0682-1943-4b81-a28e-ee4f2e230b09 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] 10.222.0.23 "GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07" status: 200 len: 1225 microversion: 2.1 time: 0.197218 Aug 04 16:52:32.094298 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1627/3306] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:31 2022] GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07 => generated 1225 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:32.095060 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1680/3307] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:31 2022] GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d => generated 1324 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:32.114135 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-035fe529-95da-42c7-9eac-e5fbe95b0965 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:32.114862 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-05db7b2c-f252-4dea-a4b8-c9f1801fce9c tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] Action: 'create', calling method: .version_select at 0x7f7e84ca7700>, body: {"keypair": {"name": "tempest-keypair-1351272249", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE+qQPv424Urf2GLqPzXHtSVHDG96HsdozfXF0CffCKrRsapVeHwqOGzErGVpWBn9obBzB8b+21s+ywuPFdOrCPieQdfDq81ADV42yYvJ8TgJ2vWFT+V+87uwVdOaIxew=="}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:32.117909 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-035fe529-95da-42c7-9eac-e5fbe95b0965 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] [instance: f91fdc58-3e45-4fc2-8bae-bda8292c908d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:32.140497 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-035fe529-95da-42c7-9eac-e5fbe95b0965 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:32.140853 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-035fe529-95da-42c7-9eac-e5fbe95b0965 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:32.146089 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-035fe529-95da-42c7-9eac-e5fbe95b0965 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:32.149669 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-035fe529-95da-42c7-9eac-e5fbe95b0965 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:32.175023 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-05db7b2c-f252-4dea-a4b8-c9f1801fce9c tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] Getting quotas for project aef198c17d9a4167b7b3c0136155c23f. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:52:32.187821 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-05db7b2c-f252-4dea-a4b8-c9f1801fce9c tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] Getting quotas for user f9b78502aed34953a76596864729b320 and project aef198c17d9a4167b7b3c0136155c23f. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:52:32.194056 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-035fe529-95da-42c7-9eac-e5fbe95b0965 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] HTTP exception thrown: Instance f91fdc58-3e45-4fc2-8bae-bda8292c908d could not be found. Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-035fe529-95da-42c7-9eac-e5fbe95b0965 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Request method failure captured: Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d HTTP/1.1 Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_jaIFQsvdDRq7ekzpKpaUdeG9RQ8sRqB0RVu8K0-1usQLyXf0BqO8bECFhERXc7ENKwGW5hp5Jl2YUuzmhqVAvqNq_sLNEMxfA77PUnMxhVwNvM7g7I6bz2N9D9ugLcBFOQ3n6gM0iCfIoLUhdrol0zuMl7QyBwgiLVeMBC4cPmmIM Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: c96b36239054414182544ccfe7550cd9 Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ImagesOneServerTestJSON-1892066733 Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c96b36239054414182544ccfe7550cd9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c96b36239054414182544ccfe7550cd9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c96b36239054414182544ccfe7550cd9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c96b36239054414182544ccfe7550cd9"}]}] Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ImagesOneServerTestJSON-1892066733 Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: c96b36239054414182544ccfe7550cd9 Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1892066733 Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ImagesOneServerTestJSON-1892066733-project Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: eb4c0d6fac94470d9665f19021d50007 Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ImagesOneServerTestJSON-1892066733-project Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance f91fdc58-3e45-4fc2-8bae-bda8292c908d could not be found. Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'f91fdc58-3e45-4fc2-8bae-bda8292c908d'} Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f91fdc58-3e45-4fc2-8bae-bda8292c908d could not be found. Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f91fdc58-3e45-4fc2-8bae-bda8292c908d could not be found. Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:52:32.200766 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:52:32.207092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:32.207092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:52:32.207092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:52:32.207092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:52:32.207092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:52:32.207092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f91fdc58-3e45-4fc2-8bae-bda8292c908d could not be found. Aug 04 16:52:32.207092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:52:32.209034 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-035fe529-95da-42c7-9eac-e5fbe95b0965 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] Returning 404 to user: Instance f91fdc58-3e45-4fc2-8bae-bda8292c908d could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:52:32.210660 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-035fe529-95da-42c7-9eac-e5fbe95b0965 tempest-ImagesOneServerTestJSON-1892066733 tempest-ImagesOneServerTestJSON-1892066733-project] 10.222.0.23 "GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d" status: 404 len: 111 microversion: 2.1 time: 0.112338 Aug 04 16:52:32.214502 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1681/3308] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:32 2022] GET /compute/v2.1/servers/f91fdc58-3e45-4fc2-8bae-bda8292c908d => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:52:32.241671 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-05db7b2c-f252-4dea-a4b8-c9f1801fce9c tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.145268 Aug 04 16:52:32.251061 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1628/3309] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 16:52:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:52:32.275192 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fcf2dbbf-b894-4670-8193-ee172ed98433 tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] Calling method '.version_select at 0x7f7e848b5040>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:32.304981 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fcf2dbbf-b894-4670-8193-ee172ed98433 tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1351272249" status: 202 len: 0 microversion: 2.1 time: 0.036525 Aug 04 16:52:32.314123 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1682/3310] 10.222.0.23 () {58 vars in 1221 bytes} [Thu Aug 4 16:52:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1351272249 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:52:32.326708 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f3865192-9577-454a-aacb-8ec8649997c5 tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] Action: 'create', calling method: .version_select at 0x7f7e841be0d0>, body: {"keypair": {"name": "tempest-keypair-1169461026", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:32.359442 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-f3865192-9577-454a-aacb-8ec8649997c5 tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] Getting quotas for project aef198c17d9a4167b7b3c0136155c23f. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:52:32.368650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-f3865192-9577-454a-aacb-8ec8649997c5 tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] Getting quotas for user f9b78502aed34953a76596864729b320 and project aef198c17d9a4167b7b3c0136155c23f. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:52:32.402625 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f3865192-9577-454a-aacb-8ec8649997c5 tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.082936 Aug 04 16:52:32.404250 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1629/3311] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 16:52:32 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:52:32.417015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f5f58001-6b0b-4e4e-9182-37a337fd5e09 tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] Calling method '.version_select at 0x7f7e8421fee0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:32.446768 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f5f58001-6b0b-4e4e-9182-37a337fd5e09 tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1169461026" status: 202 len: 0 microversion: 2.1 time: 0.033635 Aug 04 16:52:32.455257 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1683/3312] 10.222.0.23 () {58 vars in 1221 bytes} [Thu Aug 4 16:52:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1169461026 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:52:32.462416 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c3ee298f-0c25-42a7-b2a1-39821517bdd9 tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] Action: 'create', calling method: .version_select at 0x7f7e84135430>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-834329601", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5wx0p7hHyh9rYNXKqC5RuVt2b9jYI/tC4iBfQO0vGLx2Si4R63TOAex4inXyVkUlCR3mmJnH0/tneyiK+luzsWAnXV0ynp6AQqxpOrzAT70Xp5vxr1L85A9FlullocyQ=="}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:32.500133 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-c3ee298f-0c25-42a7-b2a1-39821517bdd9 tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] Getting quotas for project aef198c17d9a4167b7b3c0136155c23f. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:52:32.518472 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-c3ee298f-0c25-42a7-b2a1-39821517bdd9 tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] Getting quotas for user f9b78502aed34953a76596864729b320 and project aef198c17d9a4167b7b3c0136155c23f. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:52:32.529309 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:52:32.605592 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c3ee298f-0c25-42a7-b2a1-39821517bdd9 tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.148783 Aug 04 16:52:32.607201 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1630/3313] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 16:52:32 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:52:32.623588 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8cdf9e5b-25bd-452e-bc81-e6a4aedad3dc tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] Action: 'create', calling method: .version_select at 0x7f7e84495ee0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1177334357", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN096F3Qf/woWwnELtY9bTDDyL3Jajfh0+EnSpx5X+nZoEKtrnHnOTS9ddvMtf9E0EFkIrFSZzGQFBlggGySjO7KW45+uXN5Ue55GGvmwDe7TmdH4JeU6hu83N9hK0Yl7g=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:32.675097 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-8cdf9e5b-25bd-452e-bc81-e6a4aedad3dc tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] Getting quotas for project aef198c17d9a4167b7b3c0136155c23f. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:52:32.691283 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-8cdf9e5b-25bd-452e-bc81-e6a4aedad3dc tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] Getting quotas for user f9b78502aed34953a76596864729b320 and project aef198c17d9a4167b7b3c0136155c23f. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:52:32.733272 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8cdf9e5b-25bd-452e-bc81-e6a4aedad3dc tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.117278 Aug 04 16:52:32.743121 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1684/3314] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 16:52:32 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:52:32.749187 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7d42c2c4-1255-45b6-a037-f863263f847b tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] Action: 'create', calling method: .version_select at 0x7f7e84135d30>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1005843075", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfo18MUvL8VRts1chYjHO5YXCPd/BQDPU525iV7hjpnoJy+rjGhbBW+h52MNIE9iT9D3tjvik2VmDbRVLgoe70ibTh0xf9VxlQncZ5aF1epOE7xkHpzvI91u8g+NvA12g=="}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:32.802517 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-7d42c2c4-1255-45b6-a037-f863263f847b tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] Getting quotas for project aef198c17d9a4167b7b3c0136155c23f. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:52:32.818017 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-7d42c2c4-1255-45b6-a037-f863263f847b tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] Getting quotas for user f9b78502aed34953a76596864729b320 and project aef198c17d9a4167b7b3c0136155c23f. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:52:32.884643 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7d42c2c4-1255-45b6-a037-f863263f847b tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.141490 Aug 04 16:52:32.897185 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a7bb002d-541c-4574-961f-9f3250911870 tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] Calling method '.version_select at 0x7f7e84607670>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:32.902757 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1631/3315] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 16:52:32 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:52:32.907442 n-d-846466-12 devstack@n-api.service[126125]: WARNING oslo_db.sqlalchemy.utils [None req-a7bb002d-541c-4574-961f-9f3250911870 tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 04 16:52:32.941779 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a7bb002d-541c-4574-961f-9f3250911870 tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.049245 Aug 04 16:52:32.946314 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1685/3316] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Aug 4 16:52:32 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:32.953821 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0d72c23b-78d3-4940-987b-ce9491c3028a tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] Calling method '.version_select at 0x7f7e841bed30>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:32.987679 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0d72c23b-78d3-4940-987b-ce9491c3028a tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1005843075" status: 202 len: 0 microversion: 2.1 time: 0.038198 Aug 04 16:52:32.992663 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1632/3317] 10.222.0.23 () {58 vars in 1278 bytes} [Thu Aug 4 16:52:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1005843075 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:52:32.997791 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-716eda08-48d4-4d9b-87fb-d372190e6c1d tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] Calling method '.version_select at 0x7f7e843bb4c0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:33.061874 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-716eda08-48d4-4d9b-87fb-d372190e6c1d tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1177334357" status: 202 len: 0 microversion: 2.1 time: 0.067828 Aug 04 16:52:33.071801 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-29bdda0c-7228-4c95-b071-a4769d9f7140 tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] Calling method '.version_select at 0x7f7e84a16d30>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:33.077845 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1686/3318] 10.222.0.23 () {58 vars in 1278 bytes} [Thu Aug 4 16:52:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1177334357 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 16:52:33.121725 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0ab0b662-ef22-4bb1-a6b8-bd2cca88211b tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:33.122453 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0ab0b662-ef22-4bb1-a6b8-bd2cca88211b tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] [instance: 0e09aad3-5375-4b00-bd45-a59da90e0b07] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:33.153270 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-29bdda0c-7228-4c95-b071-a4769d9f7140 tempest-KeyPairsV2TestJSON-1358509214 tempest-KeyPairsV2TestJSON-1358509214-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-834329601" status: 202 len: 0 microversion: 2.1 time: 0.086112 Aug 04 16:52:33.163865 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1633/3319] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Aug 4 16:52:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-834329601 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:52:33.165433 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ab0b662-ef22-4bb1-a6b8-bd2cca88211b tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:33.169260 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ab0b662-ef22-4bb1-a6b8-bd2cca88211b tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:33.172165 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ab0b662-ef22-4bb1-a6b8-bd2cca88211b tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:33.172626 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ab0b662-ef22-4bb1-a6b8-bd2cca88211b tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:33.184448 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-70c4ef60-8bbe-43ba-a286-fef1eca16c69 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:33.187044 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-70c4ef60-8bbe-43ba-a286-fef1eca16c69 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:33.209710 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70c4ef60-8bbe-43ba-a286-fef1eca16c69 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:33.210169 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70c4ef60-8bbe-43ba-a286-fef1eca16c69 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:33.213411 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70c4ef60-8bbe-43ba-a286-fef1eca16c69 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:33.215183 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70c4ef60-8bbe-43ba-a286-fef1eca16c69 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:33.686122 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0ab0b662-ef22-4bb1-a6b8-bd2cca88211b tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46767eac23745aaa0bf5c14c48d5411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1977041291401a84ef2fe9287b0fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:33.699539 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0ab0b662-ef22-4bb1-a6b8-bd2cca88211b tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] 10.222.0.23 "GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07" status: 200 len: 1229 microversion: 2.1 time: 0.588090 Aug 04 16:52:33.711756 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1687/3320] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:33 2022] GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07 => generated 1229 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:33.819320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-70c4ef60-8bbe-43ba-a286-fef1eca16c69 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:33.838414 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-70c4ef60-8bbe-43ba-a286-fef1eca16c69 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d" status: 200 len: 1324 microversion: 2.1 time: 0.672204 Aug 04 16:52:33.842432 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1634/3321] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:33 2022] GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d => generated 1324 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:34.724403 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b291d545-cd3f-4f5a-bfaa-63efb0a46787 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:34.725771 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b291d545-cd3f-4f5a-bfaa-63efb0a46787 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] [instance: 0e09aad3-5375-4b00-bd45-a59da90e0b07] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:34.743458 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b291d545-cd3f-4f5a-bfaa-63efb0a46787 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:34.744397 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b291d545-cd3f-4f5a-bfaa-63efb0a46787 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:34.745755 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b291d545-cd3f-4f5a-bfaa-63efb0a46787 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:34.746547 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b291d545-cd3f-4f5a-bfaa-63efb0a46787 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:34.869081 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-23aeaa09-1a9c-43c9-8015-1e8b7d2c25bd tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:34.870476 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-23aeaa09-1a9c-43c9-8015-1e8b7d2c25bd tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:34.888127 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-23aeaa09-1a9c-43c9-8015-1e8b7d2c25bd tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:34.888584 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-23aeaa09-1a9c-43c9-8015-1e8b7d2c25bd tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:34.889808 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-23aeaa09-1a9c-43c9-8015-1e8b7d2c25bd tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:34.890515 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-23aeaa09-1a9c-43c9-8015-1e8b7d2c25bd tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:34.916865 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:52:35.083863 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b291d545-cd3f-4f5a-bfaa-63efb0a46787 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46767eac23745aaa0bf5c14c48d5411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1977041291401a84ef2fe9287b0fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:35.112130 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b291d545-cd3f-4f5a-bfaa-63efb0a46787 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] 10.222.0.23 "GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07" status: 200 len: 1283 microversion: 2.1 time: 0.391514 Aug 04 16:52:35.113647 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1688/3322] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:34 2022] GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07 => generated 1283 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:35.541224 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-23aeaa09-1a9c-43c9-8015-1e8b7d2c25bd tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:35.555141 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-23aeaa09-1a9c-43c9-8015-1e8b7d2c25bd tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d" status: 200 len: 1521 microversion: 2.1 time: 0.689502 Aug 04 16:52:35.558252 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1635/3323] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:34 2022] GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d => generated 1521 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:35.588173 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-64f3caf2-991e-4a34-bce3-3baa0ba8c0fd tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:35.589089 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-64f3caf2-991e-4a34-bce3-3baa0ba8c0fd tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:35.596304 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-64f3caf2-991e-4a34-bce3-3baa0ba8c0fd tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:35.597043 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-64f3caf2-991e-4a34-bce3-3baa0ba8c0fd tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:35.598022 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-64f3caf2-991e-4a34-bce3-3baa0ba8c0fd tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:35.598623 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-64f3caf2-991e-4a34-bce3-3baa0ba8c0fd tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:36.146079 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1c2d4ffa-26c3-4fa7-99d0-2a17e05ba5c4 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:36.148592 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1c2d4ffa-26c3-4fa7-99d0-2a17e05ba5c4 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] [instance: 0e09aad3-5375-4b00-bd45-a59da90e0b07] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:36.158790 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c2d4ffa-26c3-4fa7-99d0-2a17e05ba5c4 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:36.159629 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c2d4ffa-26c3-4fa7-99d0-2a17e05ba5c4 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:36.160847 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c2d4ffa-26c3-4fa7-99d0-2a17e05ba5c4 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:36.162740 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c2d4ffa-26c3-4fa7-99d0-2a17e05ba5c4 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:36.300826 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1c2d4ffa-26c3-4fa7-99d0-2a17e05ba5c4 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46767eac23745aaa0bf5c14c48d5411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1977041291401a84ef2fe9287b0fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:36.318305 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1c2d4ffa-26c3-4fa7-99d0-2a17e05ba5c4 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] 10.222.0.23 "GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07" status: 200 len: 1283 microversion: 2.1 time: 0.185559 Aug 04 16:52:36.332061 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1636/3324] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:36 2022] GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07 => generated 1283 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:52:36.434170 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-64f3caf2-991e-4a34-bce3-3baa0ba8c0fd tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:36.449662 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-64f3caf2-991e-4a34-bce3-3baa0ba8c0fd tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d" status: 200 len: 1521 microversion: 2.1 time: 0.865032 Aug 04 16:52:36.468200 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1689/3325] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:35 2022] GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d => generated 1521 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:36.472609 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-01c384a5-361e-4344-bb3d-92d302330a59 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-257450471"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:36.476120 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-01c384a5-361e-4344-bb3d-92d302330a59 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:36.483465 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-01c384a5-361e-4344-bb3d-92d302330a59 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:36.484281 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-01c384a5-361e-4344-bb3d-92d302330a59 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:36.485457 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-01c384a5-361e-4344-bb3d-92d302330a59 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:36.486419 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-01c384a5-361e-4344-bb3d-92d302330a59 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:36.801865 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-01c384a5-361e-4344-bb3d-92d302330a59 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "POST /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d/action" status: 202 len: 0 microversion: 2.1 time: 0.332939 Aug 04 16:52:36.804798 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1637/3326] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:52:36 2022] POST /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 16:52:36.814603 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9a3a11da-e293-40ae-8a8f-2fe8ddc09f75 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '.version_select at 0x7f7e8464e5e0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:37.231575 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9a3a11da-e293-40ae-8a8f-2fe8ddc09f75 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "DELETE /compute/v2.1/images/af4e5e98-361f-4560-b8d2-f81de6fb00f6" status: 204 len: 0 microversion: 2.1 time: 0.421720 Aug 04 16:52:37.232910 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1690/3327] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:36 2022] DELETE /compute/v2.1/images/af4e5e98-361f-4560-b8d2-f81de6fb00f6 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:52:37.251533 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-802528d2-a1f9-4e67-b9d3-b347fff8db6d tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '.version_select at 0x7f7e848970d0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:37.307012 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-802528d2-a1f9-4e67-b9d3-b347fff8db6d tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] HTTP exception thrown: Image not found. Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-802528d2-a1f9-4e67-b9d3-b347fff8db6d tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Request method failure captured: Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/images/af4e5e98-361f-4560-b8d2-f81de6fb00f6 HTTP/1.1 Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_jtTPBPy4fXdQ0VJrZ7Fc7m71zszwq7ozUwryWnXkb5nfLRGrkK5ga8HzOO0RHGQ_JBzS6OyCZVWsMotLJPEGPUn58SVuz4Z61cosYCdd8YzpWwL0OdtEOtJV7MtqbPH74mZZtuOB-p1arvqTlVKRaIs7USdqyFhUTa2KSBwKWaYTU Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: eb9de718bdfb4d6dbf63c336dfde8d42 Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb9de718bdfb4d6dbf63c336dfde8d42"}]}] Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: eb9de718bdfb4d6dbf63c336dfde8d42 Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ImagesOneServerNegativeTestJSON-1002016988-project Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 50ace5409bc54123aad5e1bc071cc3dd Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988-project Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: exception: Image not found. Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'af4e5e98-361f-4560-b8d2-f81de6fb00f6'} Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID af4e5e98-361f-4560-b8d2-f81de6fb00f6 Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 16:52:37.310646 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image af4e5e98-361f-4560-b8d2-f81de6fb00f6 could not be found. Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-802528d2-a1f9-4e67-b9d3-b347fff8db6d tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Returning 404 to user: Image not found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:52:37.315052 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-802528d2-a1f9-4e67-b9d3-b347fff8db6d tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/images/af4e5e98-361f-4560-b8d2-f81de6fb00f6" status: 404 len: 62 microversion: 2.1 time: 0.076566 Aug 04 16:52:37.323626 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-335efa4a-b9b2-46c1-8b9b-ae05f70b0649 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:37.324237 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-335efa4a-b9b2-46c1-8b9b-ae05f70b0649 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:37.325595 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1638/3328] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Aug 4 16:52:37 2022] GET /compute/v2.1/images/af4e5e98-361f-4560-b8d2-f81de6fb00f6 => generated 62 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:52:37.338749 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-335efa4a-b9b2-46c1-8b9b-ae05f70b0649 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:37.340002 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-335efa4a-b9b2-46c1-8b9b-ae05f70b0649 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:37.351775 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-335efa4a-b9b2-46c1-8b9b-ae05f70b0649 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:37.352739 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8d609390-1e7a-457d-a5c1-d2130563aa60 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:37.355998 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-335efa4a-b9b2-46c1-8b9b-ae05f70b0649 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:37.356603 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8d609390-1e7a-457d-a5c1-d2130563aa60 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] [instance: 0e09aad3-5375-4b00-bd45-a59da90e0b07] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:37.380797 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8d609390-1e7a-457d-a5c1-d2130563aa60 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:37.382659 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8d609390-1e7a-457d-a5c1-d2130563aa60 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:37.391741 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8d609390-1e7a-457d-a5c1-d2130563aa60 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:37.392253 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8d609390-1e7a-457d-a5c1-d2130563aa60 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:37.973575 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-335efa4a-b9b2-46c1-8b9b-ae05f70b0649 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:37.984110 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8d609390-1e7a-457d-a5c1-d2130563aa60 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46767eac23745aaa0bf5c14c48d5411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1977041291401a84ef2fe9287b0fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:37.990626 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-335efa4a-b9b2-46c1-8b9b-ae05f70b0649 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d" status: 200 len: 1533 microversion: 2.1 time: 0.670804 Aug 04 16:52:38.001543 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1691/3329] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:37 2022] GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d => generated 1533 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:38.001906 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8d609390-1e7a-457d-a5c1-d2130563aa60 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] 10.222.0.23 "GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07" status: 200 len: 1325 microversion: 2.1 time: 0.651793 Aug 04 16:52:38.001906 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1639/3330] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:37 2022] GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07 => generated 1325 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:38.550118 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-e4fda127-9806-4235-8214-df8bbc025b3f req-895e75ba-f9ae-4895-9a43-9674e0bc07e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e09aad3-5375-4b00-bd45-a59da90e0b07", "tag": "1b04fa39-c782-4031-a8cb-8f43ef0d05a3"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:38.586525 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-e4fda127-9806-4235-8214-df8bbc025b3f req-895e75ba-f9ae-4895-9a43-9674e0bc07e3 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:38.587639 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-e4fda127-9806-4235-8214-df8bbc025b3f req-895e75ba-f9ae-4895-9a43-9674e0bc07e3 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:38.593554 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:52:38.606026 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-e4fda127-9806-4235-8214-df8bbc025b3f req-895e75ba-f9ae-4895-9a43-9674e0bc07e3 service nova] Creating event network-changed:1b04fa39-c782-4031-a8cb-8f43ef0d05a3 for instance 0e09aad3-5375-4b00-bd45-a59da90e0b07 on n-h1-846466-12 Aug 04 16:52:38.616183 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-e4fda127-9806-4235-8214-df8bbc025b3f req-895e75ba-f9ae-4895-9a43-9674e0bc07e3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069032 Aug 04 16:52:38.617707 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1692/3331] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:52:39.016388 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6db108b9-4797-4761-b5be-3d4dc5524b3d tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:39.017107 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6db108b9-4797-4761-b5be-3d4dc5524b3d tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:39.035433 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6db108b9-4797-4761-b5be-3d4dc5524b3d tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:39.036095 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6db108b9-4797-4761-b5be-3d4dc5524b3d tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:39.044873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6db108b9-4797-4761-b5be-3d4dc5524b3d tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:39.045584 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6db108b9-4797-4761-b5be-3d4dc5524b3d tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:39.199839 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2bf51e06-2bf9-4a3d-9afb-9ddd16b7215b tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Action: 'create', calling method: .version_select at 0x7f7e84ca7700>, body: {"keypair": {"name": "tempest-keypair-1296133851", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBCYHulYuFIrNwe/Z5rsLLDEN5yKBK7AB9yvfDYgaxjTjPb1L4mTX2R/2nPIvZaIrZXw0I59gcGc6TDQ7QVGIT2C7WfXH4NkYv0xHyeizh+aGLwTn+CHR17PhrarUwdaA=="}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:39.249918 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-2bf51e06-2bf9-4a3d-9afb-9ddd16b7215b tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Getting quotas for project 0b3e0797ac574e4fb29db9faa5e258ac. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:52:39.269902 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-2bf51e06-2bf9-4a3d-9afb-9ddd16b7215b tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Getting quotas for user 9f0dae8f53f240aa82b784c416c9b04c and project 0b3e0797ac574e4fb29db9faa5e258ac. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:52:39.340827 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2bf51e06-2bf9-4a3d-9afb-9ddd16b7215b tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.712982 Aug 04 16:52:39.349260 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1640/3332] 10.222.0.23 () {62 vars in 1199 bytes} [Thu Aug 4 16:52:38 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 722 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 04 16:52:39.356119 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-eedabd5c-4d48-4b11-9e0c-a034bb08ca6f tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:39.357034 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-eedabd5c-4d48-4b11-9e0c-a034bb08ca6f tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] [instance: 0e09aad3-5375-4b00-bd45-a59da90e0b07] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:39.372992 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eedabd5c-4d48-4b11-9e0c-a034bb08ca6f tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:39.375258 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eedabd5c-4d48-4b11-9e0c-a034bb08ca6f tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:39.376279 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eedabd5c-4d48-4b11-9e0c-a034bb08ca6f tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:39.378659 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eedabd5c-4d48-4b11-9e0c-a034bb08ca6f tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:39.401665 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6db108b9-4797-4761-b5be-3d4dc5524b3d tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:39.410200 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6db108b9-4797-4761-b5be-3d4dc5524b3d tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d" status: 200 len: 1539 microversion: 2.1 time: 0.400807 Aug 04 16:52:39.411121 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1693/3333] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:39 2022] GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d => generated 1539 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:52:39.419535 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-61202e87-bafc-49cf-a8e1-2f74cb12c7be tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Calling method '.version_select at 0x7f7e84607c10>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:39.433328 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-61202e87-bafc-49cf-a8e1-2f74cb12c7be tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-1296133851" status: 200 len: 513 microversion: 2.2 time: 0.021111 Aug 04 16:52:39.442102 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1694/3334] 10.222.0.23 () {60 vars in 1258 bytes} [Thu Aug 4 16:52:39 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1296133851 => generated 513 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:52:39.449833 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d291acc5-2bf6-49f1-99d0-eec8ec54c393 tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Calling method '.version_select at 0x7f7e89d88040>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:39.481031 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d291acc5-2bf6-49f1-99d0-eec8ec54c393 tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1296133851" status: 204 len: 0 microversion: 2.2 time: 0.036156 Aug 04 16:52:39.490463 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1695/3335] 10.222.0.23 () {60 vars in 1261 bytes} [Thu Aug 4 16:52:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1296133851 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:52:39.512751 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f10f2004-a273-41d0-8fd6-0f98953606b1 tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Action: 'create', calling method: .version_select at 0x7f7e843e83a0>, body: {"keypair": {"name": "tempest-keypair-1467830657", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHMsSDZ6GhT9S3I3ZyRj41y9GoluxSPiDfhZC45c9k7KvlUNF2mivPPZCVbPh2Uji/5mdEIBFtRjLKTGi7XAMKcuOGx6a8vUQRjy8nIKm9UNdYNTgOOQEDPiTmo0vVvIA=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:39.553966 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-f10f2004-a273-41d0-8fd6-0f98953606b1 tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Getting quotas for project 0b3e0797ac574e4fb29db9faa5e258ac. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:52:39.561466 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-f10f2004-a273-41d0-8fd6-0f98953606b1 tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Getting quotas for user 9f0dae8f53f240aa82b784c416c9b04c and project 0b3e0797ac574e4fb29db9faa5e258ac. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:52:39.594147 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f10f2004-a273-41d0-8fd6-0f98953606b1 tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.102044 Aug 04 16:52:39.595207 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1696/3336] 10.222.0.23 () {62 vars in 1199 bytes} [Thu Aug 4 16:52:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 104 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 04 16:52:39.608998 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c5006083-0852-4e73-bd06-870b6727c188 tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Calling method '.version_select at 0x7f7e8452d1f0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:39.653118 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c5006083-0852-4e73-bd06-870b6727c188 tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1467830657" status: 204 len: 0 microversion: 2.2 time: 0.048636 Aug 04 16:52:39.654277 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1697/3337] 10.222.0.23 () {60 vars in 1261 bytes} [Thu Aug 4 16:52:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1467830657 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:52:39.665187 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4ece725b-0baa-48f9-9377-35de5239a0d5 tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Action: 'create', calling method: .version_select at 0x7f7e77ffa820>, body: {"keypair": {"name": "tempest-keypair-372576881", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:39.712087 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-4ece725b-0baa-48f9-9377-35de5239a0d5 tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Getting quotas for project 0b3e0797ac574e4fb29db9faa5e258ac. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:52:39.725697 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-4ece725b-0baa-48f9-9377-35de5239a0d5 tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Getting quotas for user 9f0dae8f53f240aa82b784c416c9b04c and project 0b3e0797ac574e4fb29db9faa5e258ac. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:52:39.834693 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-eedabd5c-4d48-4b11-9e0c-a034bb08ca6f tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46767eac23745aaa0bf5c14c48d5411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1977041291401a84ef2fe9287b0fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:39.847857 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-eedabd5c-4d48-4b11-9e0c-a034bb08ca6f tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] 10.222.0.23 "GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07" status: 200 len: 1325 microversion: 2.1 time: 0.497116 Aug 04 16:52:39.849622 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4ece725b-0baa-48f9-9377-35de5239a0d5 tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.189616 Aug 04 16:52:39.851512 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1641/3338] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:39 2022] GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07 => generated 1325 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:39.853146 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1698/3339] 10.222.0.23 () {62 vars in 1199 bytes} [Thu Aug 4 16:52:39 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 194 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 04 16:52:39.864842 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b0f65134-0a5e-4fe9-9581-1352ddfcd0c4 tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Calling method '.version_select at 0x7f7e84135310>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:39.911461 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b0f65134-0a5e-4fe9-9581-1352ddfcd0c4 tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-372576881" status: 204 len: 0 microversion: 2.2 time: 0.050489 Aug 04 16:52:39.912139 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1642/3340] 10.222.0.23 () {60 vars in 1258 bytes} [Thu Aug 4 16:52:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-372576881 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 16:52:39.929595 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-635092f4-5e2d-4fa6-99cd-6fc09cb31f8d tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Action: 'create', calling method: .version_select at 0x7f7e841c9c10>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1860276273", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmxxmNIPHrqgCB3Rj9UsEJZJt9LVsBosc7Kh6ITcpPAUCWuGUijc7zEb06NDgDjqgHqVF/K9NjnNH/K9BQ8fnr4EKuXUKTaGdjTT8oM9SBeAdtrbYEZUwjqs3S/n2g0jA=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:39.958065 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-635092f4-5e2d-4fa6-99cd-6fc09cb31f8d tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Getting quotas for project 0b3e0797ac574e4fb29db9faa5e258ac. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:52:39.968529 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-635092f4-5e2d-4fa6-99cd-6fc09cb31f8d tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Getting quotas for user 9f0dae8f53f240aa82b784c416c9b04c and project 0b3e0797ac574e4fb29db9faa5e258ac. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:52:40.006033 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-635092f4-5e2d-4fa6-99cd-6fc09cb31f8d tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.083074 Aug 04 16:52:40.016474 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1699/3341] 10.222.0.23 () {62 vars in 1199 bytes} [Thu Aug 4 16:52:39 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 94 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 04 16:52:40.028491 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fdd08e8a-d152-4937-bf4a-bebf7ecadd6e tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Action: 'create', calling method: .version_select at 0x7f7e84841310>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-77977815", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmvrq1XH/NHgIZpYarWliVVVBQ6bpd42X35g71XqhSHqRQvzsnuCu9lHKQoBB6VW0n29AZ/gm2hJKaYO58JPbtJnjntZHcHvACjnLlrFk+5YCRecO545cYkKyPHNGV+IA=="}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:40.089555 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-fdd08e8a-d152-4937-bf4a-bebf7ecadd6e tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Getting quotas for project 0b3e0797ac574e4fb29db9faa5e258ac. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:52:40.097566 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-fdd08e8a-d152-4937-bf4a-bebf7ecadd6e tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Getting quotas for user 9f0dae8f53f240aa82b784c416c9b04c and project 0b3e0797ac574e4fb29db9faa5e258ac. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:52:40.158474 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fdd08e8a-d152-4937-bf4a-bebf7ecadd6e tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.2 time: 0.140908 Aug 04 16:52:40.159130 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1643/3342] 10.222.0.23 () {62 vars in 1199 bytes} [Thu Aug 4 16:52:40 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 143 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 04 16:52:40.175632 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ec798596-2a12-4509-8c99-4f12fabea244 tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Action: 'create', calling method: .version_select at 0x7f7e84607d30>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-897931362", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2wjPnTWq+3b2ceZOkDdoIf5HeGQl7f8W4sAUdb+V3aE1nKDysidLz6h7mxQjmUJdsW+86TytxXzPLUqnamwhKdDkDhZKrKeYjJISbLe+5UbqeYTddsm3AOjumyeuHdWg=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:40.201578 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-ec798596-2a12-4509-8c99-4f12fabea244 tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Getting quotas for project 0b3e0797ac574e4fb29db9faa5e258ac. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:52:40.209744 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-ec798596-2a12-4509-8c99-4f12fabea244 tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Getting quotas for user 9f0dae8f53f240aa82b784c416c9b04c and project 0b3e0797ac574e4fb29db9faa5e258ac. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:52:40.236432 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=5,nova_api:INSERT=5 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:52:40.249191 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ec798596-2a12-4509-8c99-4f12fabea244 tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.079267 Aug 04 16:52:40.262342 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1700/3343] 10.222.0.23 () {62 vars in 1199 bytes} [Thu Aug 4 16:52:40 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 93 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 04 16:52:40.274641 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-54f651d8-4c8d-4e99-914f-16bdcb6ffbe8 tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Calling method '.version_select at 0x7f7e841be700>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:40.280343 n-d-846466-12 devstack@n-api.service[126126]: WARNING oslo_db.sqlalchemy.utils [None req-54f651d8-4c8d-4e99-914f-16bdcb6ffbe8 tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 04 16:52:40.288193 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-54f651d8-4c8d-4e99-914f-16bdcb6ffbe8 tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 1139 microversion: 2.2 time: 0.020192 Aug 04 16:52:40.289448 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1644/3344] 10.222.0.23 () {60 vars in 1177 bytes} [Thu Aug 4 16:52:40 2022] GET /compute/v2.1/os-keypairs => generated 1139 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:40.301373 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b1786de2-bb01-43c0-8d70-a9d55af12d69 tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Calling method '.version_select at 0x7f7e84660310>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:40.335672 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b1786de2-bb01-43c0-8d70-a9d55af12d69 tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-897931362" status: 204 len: 0 microversion: 2.2 time: 0.039077 Aug 04 16:52:40.340915 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1701/3345] 10.222.0.23 () {60 vars in 1318 bytes} [Thu Aug 4 16:52:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-897931362 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 16:52:40.352450 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-30027ce3-7f47-490e-bfdc-3aff6228d6d8 tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Calling method '.version_select at 0x7f7e84137700>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:40.403131 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-30027ce3-7f47-490e-bfdc-3aff6228d6d8 tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-77977815" status: 204 len: 0 microversion: 2.2 time: 0.057402 Aug 04 16:52:40.403715 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1645/3346] 10.222.0.23 () {60 vars in 1315 bytes} [Thu Aug 4 16:52:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-77977815 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:52:40.412835 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0e8b3ebd-7a37-49c5-a09f-4cb61a86da9e tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Calling method '.version_select at 0x7f7e843e8d30>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:40.431854 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2001d738-6e48-4618-b231-c7a7c242b545 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:40.432798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2001d738-6e48-4618-b231-c7a7c242b545 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:40.447120 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2001d738-6e48-4618-b231-c7a7c242b545 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:40.447861 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2001d738-6e48-4618-b231-c7a7c242b545 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:40.448854 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2001d738-6e48-4618-b231-c7a7c242b545 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:40.450404 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2001d738-6e48-4618-b231-c7a7c242b545 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:40.472667 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0e8b3ebd-7a37-49c5-a09f-4cb61a86da9e tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1860276273" status: 204 len: 0 microversion: 2.2 time: 0.063932 Aug 04 16:52:40.474030 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1702/3347] 10.222.0.23 () {60 vars in 1321 bytes} [Thu Aug 4 16:52:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1860276273 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:52:40.489578 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-77e9d7f6-6533-40c1-bfd7-ae4d03c6d342 tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Action: 'create', calling method: .version_select at 0x7f7e848d15e0>, body: {"keypair": {"name": "tempest-keypair-1350239417", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwDtogKIc4o7JwauIC2Kmrf/4I/BIQjN2hK/t3mBhUec43llgwT8UETki745rvVNpAuI2jLNK2f4p5l5WexcxavQWvufOYnanweMA0dxfZh6N35TaCulHRWCg/78JFjtg=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:40.538716 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-77e9d7f6-6533-40c1-bfd7-ae4d03c6d342 tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Getting quotas for project 0b3e0797ac574e4fb29db9faa5e258ac. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:52:40.550574 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-77e9d7f6-6533-40c1-bfd7-ae4d03c6d342 tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Getting quotas for user 9f0dae8f53f240aa82b784c416c9b04c and project 0b3e0797ac574e4fb29db9faa5e258ac. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:52:40.602150 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-77e9d7f6-6533-40c1-bfd7-ae4d03c6d342 tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.118926 Aug 04 16:52:40.603229 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1703/3348] 10.222.0.23 () {62 vars in 1199 bytes} [Thu Aug 4 16:52:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 121 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 04 16:52:40.618609 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b4bde469-9291-4d86-a971-fba482347ee0 tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Calling method '.version_select at 0x7f7e84607c10>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:40.644569 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b4bde469-9291-4d86-a971-fba482347ee0 tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-1350239417" status: 200 len: 513 microversion: 2.2 time: 0.034636 Aug 04 16:52:40.651823 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1704/3349] 10.222.0.23 () {60 vars in 1258 bytes} [Thu Aug 4 16:52:40 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1350239417 => generated 513 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:52:40.658088 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9ffad047-bd4d-4e50-8c41-7d8738b34a47 tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Calling method '.version_select at 0x7f7e840e8ee0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:40.667166 n-d-846466-12 devstack@n-api.service[126125]: WARNING oslo_db.sqlalchemy.utils [None req-9ffad047-bd4d-4e50-8c41-7d8738b34a47 tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 04 16:52:40.707541 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9ffad047-bd4d-4e50-8c41-7d8738b34a47 tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.053946 Aug 04 16:52:40.715899 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1705/3350] 10.222.0.23 () {60 vars in 1177 bytes} [Thu Aug 4 16:52:40 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:52:40.721577 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-69fd4245-ed2f-484d-b8ea-a89e683ca7d3 req-127bc674-a48d-4eb0-bbf3-bc13dc19c7f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d", "name": "network-vif-plugged", "status": "completed", "tag": "a765ebd9-dbc5-4427-9287-f73efbed592f"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:40.733887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-69fd4245-ed2f-484d-b8ea-a89e683ca7d3 req-127bc674-a48d-4eb0-bbf3-bc13dc19c7f3 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:40.735240 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-69fd4245-ed2f-484d-b8ea-a89e683ca7d3 req-127bc674-a48d-4eb0-bbf3-bc13dc19c7f3 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:40.760483 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-69fd4245-ed2f-484d-b8ea-a89e683ca7d3 req-127bc674-a48d-4eb0-bbf3-bc13dc19c7f3 service nova] Creating event network-vif-plugged:a765ebd9-dbc5-4427-9287-f73efbed592f for instance 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d on n-h2-846466-12 Aug 04 16:52:40.786084 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-69fd4245-ed2f-484d-b8ea-a89e683ca7d3 req-127bc674-a48d-4eb0-bbf3-bc13dc19c7f3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068743 Aug 04 16:52:40.786713 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1706/3351] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:52:40.807668 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1fa3abff-8164-425c-ab74-fecc7556a75b tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Calling method '.version_select at 0x7f7e8452de50>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:40.822328 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2001d738-6e48-4618-b231-c7a7c242b545 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:40.843105 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2001d738-6e48-4618-b231-c7a7c242b545 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d" status: 200 len: 1521 microversion: 2.1 time: 0.415005 Aug 04 16:52:40.845005 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1646/3352] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:40 2022] GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d => generated 1521 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:52:40.859766 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1fa3abff-8164-425c-ab74-fecc7556a75b tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1350239417" status: 204 len: 0 microversion: 2.2 time: 0.065782 Aug 04 16:52:40.860773 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1707/3353] 10.222.0.23 () {60 vars in 1261 bytes} [Thu Aug 4 16:52:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1350239417 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:52:40.867593 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-db32f64a-c3c6-4e30-a005-2f022fe437dd tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:40.868094 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-db32f64a-c3c6-4e30-a005-2f022fe437dd tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:40.872618 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-47949f16-cb5f-4ba9-aa83-531099832ebc tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Action: 'create', calling method: .version_select at 0x7f7e84660550>, body: {"keypair": {"name": "tempest-keypair-1165957254", "type": "x509"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:40.880829 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db32f64a-c3c6-4e30-a005-2f022fe437dd tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:40.881272 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db32f64a-c3c6-4e30-a005-2f022fe437dd tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:40.893420 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db32f64a-c3c6-4e30-a005-2f022fe437dd tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:40.893873 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db32f64a-c3c6-4e30-a005-2f022fe437dd tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:40.945957 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-47949f16-cb5f-4ba9-aa83-531099832ebc tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Getting quotas for project 0b3e0797ac574e4fb29db9faa5e258ac. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:52:40.950604 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-db32f64a-c3c6-4e30-a005-2f022fe437dd tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:52:40.962213 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-47949f16-cb5f-4ba9-aa83-531099832ebc tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Getting quotas for user 9f0dae8f53f240aa82b784c416c9b04c and project 0b3e0797ac574e4fb29db9faa5e258ac. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:52:41.007459 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.processutils [None req-47949f16-cb5f-4ba9-aa83-531099832ebc tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpdncfxbvy/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpdncfxbvy/temp.key -subj /CN=9f0dae8f53f240aa82b784c416c9b04c -extensions v3_req_client {{(pid=126125) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 04 16:52:41.145015 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-db32f64a-c3c6-4e30-a005-2f022fe437dd tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "DELETE /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d" status: 204 len: 0 microversion: 2.1 time: 0.282179 Aug 04 16:52:41.152155 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1647/3354] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:52:40 2022] DELETE /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:52:41.174382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-61168017-f049-4c54-83b0-7211eafe9111 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:41.183334 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-61168017-f049-4c54-83b0-7211eafe9111 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] [instance: 0e09aad3-5375-4b00-bd45-a59da90e0b07] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:41.208905 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-61168017-f049-4c54-83b0-7211eafe9111 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:41.211109 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-61168017-f049-4c54-83b0-7211eafe9111 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:41.212444 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-61168017-f049-4c54-83b0-7211eafe9111 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:41.216059 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-61168017-f049-4c54-83b0-7211eafe9111 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:41.349045 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.processutils [None req-47949f16-cb5f-4ba9-aa83-531099832ebc tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpdncfxbvy/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpdncfxbvy/temp.key -subj /CN=9f0dae8f53f240aa82b784c416c9b04c -extensions v3_req_client" returned: 0 in 0.338s {{(pid=126125) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 04 16:52:41.361954 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.processutils [None req-47949f16-cb5f-4ba9-aa83-531099832ebc tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpdncfxbvy/temp.key -password pass: {{(pid=126125) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 04 16:52:41.448184 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:52:41.454933 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.processutils [None req-47949f16-cb5f-4ba9-aa83-531099832ebc tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpdncfxbvy/temp.key -password pass:" returned: 0 in 0.094s {{(pid=126125) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 04 16:52:41.563122 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-47949f16-cb5f-4ba9-aa83-531099832ebc tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Getting quotas for project 0b3e0797ac574e4fb29db9faa5e258ac. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:52:41.607672 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-47949f16-cb5f-4ba9-aa83-531099832ebc tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Getting quotas for user 9f0dae8f53f240aa82b784c416c9b04c and project 0b3e0797ac574e4fb29db9faa5e258ac. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:52:41.670522 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-47949f16-cb5f-4ba9-aa83-531099832ebc tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.802031 Aug 04 16:52:41.674573 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1708/3355] 10.222.0.23 () {62 vars in 1198 bytes} [Thu Aug 4 16:52:40 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 809 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Aug 04 16:52:41.689924 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b0f00249-435b-45b5-8084-8a24cbb7e83c tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:41.692641 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b0f00249-435b-45b5-8084-8a24cbb7e83c tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:41.717472 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0f00249-435b-45b5-8084-8a24cbb7e83c tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:41.717948 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0f00249-435b-45b5-8084-8a24cbb7e83c tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:41.718863 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0f00249-435b-45b5-8084-8a24cbb7e83c tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:41.719304 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0f00249-435b-45b5-8084-8a24cbb7e83c tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:42.073610 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-61168017-f049-4c54-83b0-7211eafe9111 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46767eac23745aaa0bf5c14c48d5411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1977041291401a84ef2fe9287b0fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:42.082600 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-61168017-f049-4c54-83b0-7211eafe9111 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] 10.222.0.23 "GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07" status: 200 len: 1325 microversion: 2.1 time: 0.928896 Aug 04 16:52:42.083202 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1648/3356] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:41 2022] GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07 => generated 1325 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:42.105540 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-89af8e57-4202-46f6-8411-c7db44fa7aea tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Calling method '.version_select at 0x7f7e84e96c10>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:42.118991 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-89af8e57-4202-46f6-8411-c7db44fa7aea tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-1165957254" status: 200 len: 1534 microversion: 2.2 time: 0.027968 Aug 04 16:52:42.120734 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1649/3357] 10.222.0.23 () {60 vars in 1258 bytes} [Thu Aug 4 16:52:42 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1165957254 => generated 1534 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:42.136364 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9b865095-7cb6-47c6-babb-62f39acc696c tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Calling method '.version_select at 0x7f7e89b758b0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:42.141538 n-d-846466-12 devstack@n-api.service[126126]: WARNING oslo_db.sqlalchemy.utils [None req-9b865095-7cb6-47c6-babb-62f39acc696c tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 04 16:52:42.150326 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9b865095-7cb6-47c6-babb-62f39acc696c tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.020588 Aug 04 16:52:42.157077 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1650/3358] 10.222.0.23 () {60 vars in 1177 bytes} [Thu Aug 4 16:52:42 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:42.165175 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9b0b4992-6c5e-42fe-b71c-c76b5563d86c tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] Calling method '.version_select at 0x7f7e84ff5d30>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:42.194974 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9b0b4992-6c5e-42fe-b71c-c76b5563d86c tempest-KeyPairsV22TestJSON-1313301802 tempest-KeyPairsV22TestJSON-1313301802-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1165957254" status: 204 len: 0 microversion: 2.2 time: 0.035995 Aug 04 16:52:42.201940 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1651/3359] 10.222.0.23 () {60 vars in 1261 bytes} [Thu Aug 4 16:52:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1165957254 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:52:42.529520 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b0f00249-435b-45b5-8084-8a24cbb7e83c tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:42.546871 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b0f00249-435b-45b5-8084-8a24cbb7e83c tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d" status: 200 len: 1527 microversion: 2.1 time: 0.870153 Aug 04 16:52:42.553427 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1709/3360] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:41 2022] GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d => generated 1527 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:43.108079 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-89d3821c-8943-4433-afaa-9c93f82e3264 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:43.108914 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-89d3821c-8943-4433-afaa-9c93f82e3264 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] [instance: 0e09aad3-5375-4b00-bd45-a59da90e0b07] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:43.133586 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-89d3821c-8943-4433-afaa-9c93f82e3264 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:43.134145 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-89d3821c-8943-4433-afaa-9c93f82e3264 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:43.135013 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-89d3821c-8943-4433-afaa-9c93f82e3264 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:43.135469 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-89d3821c-8943-4433-afaa-9c93f82e3264 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:43.572766 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7d1a100d-9de9-4c02-8dfb-a58a4546ffb7 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:43.574498 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7d1a100d-9de9-4c02-8dfb-a58a4546ffb7 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:43.589831 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d1a100d-9de9-4c02-8dfb-a58a4546ffb7 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:43.591794 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d1a100d-9de9-4c02-8dfb-a58a4546ffb7 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:43.595611 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d1a100d-9de9-4c02-8dfb-a58a4546ffb7 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:43.596408 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d1a100d-9de9-4c02-8dfb-a58a4546ffb7 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:44.997956 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-89d3821c-8943-4433-afaa-9c93f82e3264 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46767eac23745aaa0bf5c14c48d5411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1977041291401a84ef2fe9287b0fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:45.010677 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-89d3821c-8943-4433-afaa-9c93f82e3264 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] 10.222.0.23 "GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07" status: 200 len: 1325 microversion: 2.1 time: 1.908168 Aug 04 16:52:45.027518 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1652/3361] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:43 2022] GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07 => generated 1325 bytes in 1926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:52:45.034554 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-2a08ba25-688e-4e3c-8341-a018b9fcdf30 req-2810b5d0-a4f9-4ff7-9c81-05d0de568d2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d", "name": "network-vif-unplugged", "status": "completed", "tag": "a765ebd9-dbc5-4427-9287-f73efbed592f"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:45.050086 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-2a08ba25-688e-4e3c-8341-a018b9fcdf30 req-2810b5d0-a4f9-4ff7-9c81-05d0de568d2f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:45.050956 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-2a08ba25-688e-4e3c-8341-a018b9fcdf30 req-2810b5d0-a4f9-4ff7-9c81-05d0de568d2f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:45.078996 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-2a08ba25-688e-4e3c-8341-a018b9fcdf30 req-2810b5d0-a4f9-4ff7-9c81-05d0de568d2f service nova] Creating event network-vif-unplugged:a765ebd9-dbc5-4427-9287-f73efbed592f for instance 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d on n-h2-846466-12 Aug 04 16:52:45.087130 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-2a08ba25-688e-4e3c-8341-a018b9fcdf30 req-2810b5d0-a4f9-4ff7-9c81-05d0de568d2f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057933 Aug 04 16:52:45.089638 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1653/3362] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:52:45.214182 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7d1a100d-9de9-4c02-8dfb-a58a4546ffb7 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:45.223877 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7d1a100d-9de9-4c02-8dfb-a58a4546ffb7 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d" status: 200 len: 1527 microversion: 2.1 time: 1.656240 Aug 04 16:52:45.228257 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1710/3363] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:43 2022] GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d => generated 1527 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:46.039546 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fbec09f6-5465-4bd2-a015-ebbd85f83f2e tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:46.040777 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fbec09f6-5465-4bd2-a015-ebbd85f83f2e tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] [instance: 0e09aad3-5375-4b00-bd45-a59da90e0b07] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:46.065914 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fbec09f6-5465-4bd2-a015-ebbd85f83f2e tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:46.066367 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fbec09f6-5465-4bd2-a015-ebbd85f83f2e tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:46.067165 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fbec09f6-5465-4bd2-a015-ebbd85f83f2e tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:46.067595 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fbec09f6-5465-4bd2-a015-ebbd85f83f2e tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:46.255237 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-aeee279a-dcf1-44ea-9e58-08bd13957c86 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:46.255950 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-aeee279a-dcf1-44ea-9e58-08bd13957c86 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:46.271512 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aeee279a-dcf1-44ea-9e58-08bd13957c86 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:46.277982 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aeee279a-dcf1-44ea-9e58-08bd13957c86 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:46.282734 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aeee279a-dcf1-44ea-9e58-08bd13957c86 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:46.283259 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aeee279a-dcf1-44ea-9e58-08bd13957c86 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:46.657543 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-aeee279a-dcf1-44ea-9e58-08bd13957c86 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:46.666473 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-aeee279a-dcf1-44ea-9e58-08bd13957c86 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d" status: 200 len: 1485 microversion: 2.1 time: 0.416385 Aug 04 16:52:46.669904 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1711/3364] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:46 2022] GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d => generated 1485 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:52:46.681855 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-133e6bd1-5b28-4897-a290-22fc5ab2ae95 req-7d8bae90-b1c8-4a87-ad0b-fc4e1abc7533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d", "name": "network-vif-deleted", "tag": "a765ebd9-dbc5-4427-9287-f73efbed592f"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:46.709368 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-133e6bd1-5b28-4897-a290-22fc5ab2ae95 req-7d8bae90-b1c8-4a87-ad0b-fc4e1abc7533 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:46.710270 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-133e6bd1-5b28-4897-a290-22fc5ab2ae95 req-7d8bae90-b1c8-4a87-ad0b-fc4e1abc7533 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:46.726885 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fbec09f6-5465-4bd2-a015-ebbd85f83f2e tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46767eac23745aaa0bf5c14c48d5411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1977041291401a84ef2fe9287b0fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:46.743558 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fbec09f6-5465-4bd2-a015-ebbd85f83f2e tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] 10.222.0.23 "GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07" status: 200 len: 1325 microversion: 2.1 time: 0.710153 Aug 04 16:52:46.744580 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-133e6bd1-5b28-4897-a290-22fc5ab2ae95 req-7d8bae90-b1c8-4a87-ad0b-fc4e1abc7533 service nova] Creating event network-vif-deleted:a765ebd9-dbc5-4427-9287-f73efbed592f for instance 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d on n-h2-846466-12 Aug 04 16:52:46.753877 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1654/3365] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:46 2022] GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07 => generated 1325 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:46.759463 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-133e6bd1-5b28-4897-a290-22fc5ab2ae95 req-7d8bae90-b1c8-4a87-ad0b-fc4e1abc7533 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083066 Aug 04 16:52:46.760452 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1712/3366] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:52:47.601415 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-0f974d52-ed52-42f4-bb6f-98a80e5ccc9f req-39fdbb06-3da7-4eac-a519-7f89fbd3cbca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e09aad3-5375-4b00-bd45-a59da90e0b07", "name": "network-vif-plugged", "status": "completed", "tag": "1b04fa39-c782-4031-a8cb-8f43ef0d05a3"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:47.617870 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-0f974d52-ed52-42f4-bb6f-98a80e5ccc9f req-39fdbb06-3da7-4eac-a519-7f89fbd3cbca service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:47.618663 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-0f974d52-ed52-42f4-bb6f-98a80e5ccc9f req-39fdbb06-3da7-4eac-a519-7f89fbd3cbca service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:47.633827 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-0f974d52-ed52-42f4-bb6f-98a80e5ccc9f req-39fdbb06-3da7-4eac-a519-7f89fbd3cbca service nova] Creating event network-vif-plugged:1b04fa39-c782-4031-a8cb-8f43ef0d05a3 for instance 0e09aad3-5375-4b00-bd45-a59da90e0b07 on n-h1-846466-12 Aug 04 16:52:47.639824 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-0f974d52-ed52-42f4-bb6f-98a80e5ccc9f req-39fdbb06-3da7-4eac-a519-7f89fbd3cbca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046830 Aug 04 16:52:47.640795 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1655/3367] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:52:47.692834 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c4e8af9a-cb6c-48fd-9ef9-ba0679387ae7 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:47.693705 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c4e8af9a-cb6c-48fd-9ef9-ba0679387ae7 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:47.708049 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c4e8af9a-cb6c-48fd-9ef9-ba0679387ae7 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:47.708567 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c4e8af9a-cb6c-48fd-9ef9-ba0679387ae7 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:47.715147 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c4e8af9a-cb6c-48fd-9ef9-ba0679387ae7 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:47.716083 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c4e8af9a-cb6c-48fd-9ef9-ba0679387ae7 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:47.742533 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-c4e8af9a-cb6c-48fd-9ef9-ba0679387ae7 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] HTTP exception thrown: Instance 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d could not be found. Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c4e8af9a-cb6c-48fd-9ef9-ba0679387ae7 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Request method failure captured: Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d HTTP/1.1 Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_jtTPBPy4fXdQ0VJrZ7Fc7m71zszwq7ozUwryWnXkb5nfLRGrkK5ga8HzOO0RHGQ_JBzS6OyCZVWsMotLJPEGPUn58SVuz4Z61cosYCdd8YzpWwL0OdtEOtJV7MtqbPH74mZZtuOB-p1arvqTlVKRaIs7USdqyFhUTa2KSBwKWaYTU Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: eb9de718bdfb4d6dbf63c336dfde8d42 Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb9de718bdfb4d6dbf63c336dfde8d42"}]}] Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: eb9de718bdfb4d6dbf63c336dfde8d42 Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ImagesOneServerNegativeTestJSON-1002016988-project Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 50ace5409bc54123aad5e1bc071cc3dd Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988-project Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d could not be found. Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d'} Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d could not be found. Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d could not be found. Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:52:47.747846 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:52:47.758440 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:52:47.758440 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:47.758440 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:52:47.758440 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:52:47.758440 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:52:47.758440 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:52:47.758440 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d could not be found. Aug 04 16:52:47.758440 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:52:47.762464 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c4e8af9a-cb6c-48fd-9ef9-ba0679387ae7 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Returning 404 to user: Instance 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:52:47.763627 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c4e8af9a-cb6c-48fd-9ef9-ba0679387ae7 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d" status: 404 len: 111 microversion: 2.1 time: 0.075241 Aug 04 16:52:47.765097 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1713/3368] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:47 2022] GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:52:47.790846 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1fdb7628-e90f-465b-af8c-cbc57dfc0d9d tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:47.792800 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1fdb7628-e90f-465b-af8c-cbc57dfc0d9d tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] [instance: 0e09aad3-5375-4b00-bd45-a59da90e0b07] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:47.797046 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=5,nova_api:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:52:47.808827 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1fdb7628-e90f-465b-af8c-cbc57dfc0d9d tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:47.811610 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1fdb7628-e90f-465b-af8c-cbc57dfc0d9d tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:47.816882 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1fdb7628-e90f-465b-af8c-cbc57dfc0d9d tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:47.822683 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1fdb7628-e90f-465b-af8c-cbc57dfc0d9d tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:47.983108 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b1508034-137e-43e3-ac32-4b4b99aa11c5 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1529208651", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:48.089065 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-b1508034-137e-43e3-ac32-4b4b99aa11c5 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] validate_networks() for [('46081ca9-0ee0-465c-8483-bd7332c8165a', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:52:48.655893 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1fdb7628-e90f-465b-af8c-cbc57dfc0d9d tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46767eac23745aaa0bf5c14c48d5411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1977041291401a84ef2fe9287b0fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:48.665801 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1fdb7628-e90f-465b-af8c-cbc57dfc0d9d tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] 10.222.0.23 "GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07" status: 200 len: 1325 microversion: 2.1 time: 0.883246 Aug 04 16:52:48.667695 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1656/3369] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:47 2022] GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07 => generated 1325 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:49.709984 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a46d9746-f92f-4aa1-9a8d-34868a4fc3cc tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:49.715711 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a46d9746-f92f-4aa1-9a8d-34868a4fc3cc tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] [instance: 0e09aad3-5375-4b00-bd45-a59da90e0b07] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:49.760779 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a46d9746-f92f-4aa1-9a8d-34868a4fc3cc tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:49.762113 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a46d9746-f92f-4aa1-9a8d-34868a4fc3cc tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:49.767374 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a46d9746-f92f-4aa1-9a8d-34868a4fc3cc tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:49.777002 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a46d9746-f92f-4aa1-9a8d-34868a4fc3cc tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:50.116758 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=32 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:52:50.267862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b1508034-137e-43e3-ac32-4b4b99aa11c5 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:52:50.269144 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b1508034-137e-43e3-ac32-4b4b99aa11c5 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:52:50.269859 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b1508034-137e-43e3-ac32-4b4b99aa11c5 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:52:50.270537 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b1508034-137e-43e3-ac32-4b4b99aa11c5 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:52:50.271173 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b1508034-137e-43e3-ac32-4b4b99aa11c5 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:52:50.290776 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b1508034-137e-43e3-ac32-4b4b99aa11c5 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:50.293327 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b1508034-137e-43e3-ac32-4b4b99aa11c5 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:50.294678 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b1508034-137e-43e3-ac32-4b4b99aa11c5 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:50.298176 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b1508034-137e-43e3-ac32-4b4b99aa11c5 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:50.342833 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-b1508034-137e-43e3-ac32-4b4b99aa11c5 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Getting quotas for project eb9de718bdfb4d6dbf63c336dfde8d42. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:52:50.372144 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-b1508034-137e-43e3-ac32-4b4b99aa11c5 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Getting quotas for user 50ace5409bc54123aad5e1bc071cc3dd and project eb9de718bdfb4d6dbf63c336dfde8d42. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:52:50.406164 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b1508034-137e-43e3-ac32-4b4b99aa11c5 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:52:50.417880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b1508034-137e-43e3-ac32-4b4b99aa11c5 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 56e8faca-3b86-4598-8e8c-0f511745e8de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:52:50.532469 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b1508034-137e-43e3-ac32-4b4b99aa11c5 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.556123 Aug 04 16:52:50.542826 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1714/3370] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:52:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 2567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:52:50.610463 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a46d9746-f92f-4aa1-9a8d-34868a4fc3cc tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46767eac23745aaa0bf5c14c48d5411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1977041291401a84ef2fe9287b0fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:50.626775 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a46d9746-f92f-4aa1-9a8d-34868a4fc3cc tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] 10.222.0.23 "GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07" status: 200 len: 1521 microversion: 2.1 time: 0.938374 Aug 04 16:52:50.641310 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1657/3371] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:49 2022] GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07 => generated 1521 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:50.647580 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fcfa15c9-8017-4ba1-a984-ecb51de53dc1 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:50.650604 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fcfa15c9-8017-4ba1-a984-ecb51de53dc1 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 56e8faca-3b86-4598-8e8c-0f511745e8de] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:50.834366 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fcfa15c9-8017-4ba1-a984-ecb51de53dc1 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:50.847669 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fcfa15c9-8017-4ba1-a984-ecb51de53dc1 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de" status: 200 len: 1225 microversion: 2.1 time: 0.214763 Aug 04 16:52:50.850651 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1658/3372] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:50 2022] GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de => generated 1225 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:50.877486 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d47c66ca-d2cd-4681-a2b9-3cf7193995cb tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:50.892842 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d47c66ca-d2cd-4681-a2b9-3cf7193995cb tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] [instance: 0e09aad3-5375-4b00-bd45-a59da90e0b07] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:50.932292 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d47c66ca-d2cd-4681-a2b9-3cf7193995cb tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:50.932767 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d47c66ca-d2cd-4681-a2b9-3cf7193995cb tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:50.934927 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d47c66ca-d2cd-4681-a2b9-3cf7193995cb tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:50.937062 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d47c66ca-d2cd-4681-a2b9-3cf7193995cb tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:51.068233 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-d47c66ca-d2cd-4681-a2b9-3cf7193995cb tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] HTTP exception thrown: Action 999 not found Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d47c66ca-d2cd-4681-a2b9-3cf7193995cb tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Request method failure captured: Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07/os-instance-actions/999 HTTP/1.1 Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_lK4HRKbbxYrelSTylP6qOz6rfATbJyyHUDMkMSOu7P-wZWUOuHxwVUQcGuSCZ6pXgF5kb6CA5lBssqL-HpD9I4XbsB_Xj2OTJWKdp3ACjEb0hPOsbbUsYOyxeJSfO0o6oGMzRG2e-15hKGb0hIAUYEQbW0FX1hw0I_FLt5ZL4WYWM Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: de1977041291401a84ef2fe9287b0fcb Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1162813466 Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de1977041291401a84ef2fe9287b0fcb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_de1977041291401a84ef2fe9287b0fcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de1977041291401a84ef2fe9287b0fcb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/de1977041291401a84ef2fe9287b0fcb"}]}] Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1162813466 Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: de1977041291401a84ef2fe9287b0fcb Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1162813466 Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-InstanceActionsNegativeTestJSON-1162813466-project Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: e46767eac23745aaa0bf5c14c48d5411 Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1162813466-project Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: exception: Action 999 not found Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'server_id': '0e09aad3-5375-4b00-bd45-a59da90e0b07', 'id': '999'} Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 04 16:52:51.078598 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:51.088158 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d47c66ca-d2cd-4681-a2b9-3cf7193995cb tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Returning 404 to user: Action 999 not found {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:52:51.088158 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d47c66ca-d2cd-4681-a2b9-3cf7193995cb tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] 10.222.0.23 "GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.228681 Aug 04 16:52:51.088158 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1659/3373] 10.222.0.23 () {58 vars in 1308 bytes} [Thu Aug 4 16:52:50 2022] GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07/os-instance-actions/999 => generated 66 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:52:51.102327 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b921c28f-c56b-4a09-9695-e6dec3eec736 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Calling method '.version_select at 0x7f7e77e8c1f0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:51.104497 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b921c28f-c56b-4a09-9695-e6dec3eec736 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] [instance: 20d3d03f-8aca-4f8b-a0dc-50c4b42620b3] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:51.130222 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-b921c28f-c56b-4a09-9695-e6dec3eec736 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] HTTP exception thrown: Instance 20d3d03f-8aca-4f8b-a0dc-50c4b42620b3 could not be found. Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b921c28f-c56b-4a09-9695-e6dec3eec736 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Request method failure captured: Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/20d3d03f-8aca-4f8b-a0dc-50c4b42620b3/os-instance-actions HTTP/1.1 Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_lK4HRKbbxYrelSTylP6qOz6rfATbJyyHUDMkMSOu7P-wZWUOuHxwVUQcGuSCZ6pXgF5kb6CA5lBssqL-HpD9I4XbsB_Xj2OTJWKdp3ACjEb0hPOsbbUsYOyxeJSfO0o6oGMzRG2e-15hKGb0hIAUYEQbW0FX1hw0I_FLt5ZL4WYWM Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: de1977041291401a84ef2fe9287b0fcb Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1162813466 Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de1977041291401a84ef2fe9287b0fcb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_de1977041291401a84ef2fe9287b0fcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de1977041291401a84ef2fe9287b0fcb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/de1977041291401a84ef2fe9287b0fcb"}]}] Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1162813466 Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: de1977041291401a84ef2fe9287b0fcb Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1162813466 Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-InstanceActionsNegativeTestJSON-1162813466-project Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: e46767eac23745aaa0bf5c14c48d5411 Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1162813466-project Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 20d3d03f-8aca-4f8b-a0dc-50c4b42620b3 could not be found. Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'server_id': '20d3d03f-8aca-4f8b-a0dc-50c4b42620b3'} Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20d3d03f-8aca-4f8b-a0dc-50c4b42620b3 could not be found. Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:52:51.134280 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:52:51.141899 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20d3d03f-8aca-4f8b-a0dc-50c4b42620b3 could not be found. Aug 04 16:52:51.141899 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:51.141899 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:52:51.141899 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:51.141899 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:51.141899 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:52:51.141899 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:52:51.141899 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:52:51.141899 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:52:51.141899 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20d3d03f-8aca-4f8b-a0dc-50c4b42620b3 could not be found. Aug 04 16:52:51.141899 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:52:51.158292 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b921c28f-c56b-4a09-9695-e6dec3eec736 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Returning 404 to user: Instance 20d3d03f-8aca-4f8b-a0dc-50c4b42620b3 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:52:51.164943 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b921c28f-c56b-4a09-9695-e6dec3eec736 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] 10.222.0.23 "GET /compute/v2.1/servers/20d3d03f-8aca-4f8b-a0dc-50c4b42620b3/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.071671 Aug 04 16:52:51.174179 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1660/3374] 10.222.0.23 () {58 vars in 1296 bytes} [Thu Aug 4 16:52:51 2022] GET /compute/v2.1/servers/20d3d03f-8aca-4f8b-a0dc-50c4b42620b3/os-instance-actions => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:52:51.210663 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2ce427af-28c6-40b5-b3aa-cbe8a10d3ec6 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:51.217692 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2ce427af-28c6-40b5-b3aa-cbe8a10d3ec6 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] [instance: 0e09aad3-5375-4b00-bd45-a59da90e0b07] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:51.274929 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ce427af-28c6-40b5-b3aa-cbe8a10d3ec6 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:51.279422 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ce427af-28c6-40b5-b3aa-cbe8a10d3ec6 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:51.285575 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ce427af-28c6-40b5-b3aa-cbe8a10d3ec6 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:51.288702 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ce427af-28c6-40b5-b3aa-cbe8a10d3ec6 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:51.412466 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:52:51.447075 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-be648441-a74b-420d-9fdd-00a2d9d26fa4 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1895668513", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "aaea12c2-7856-4247-8edf-27760ef402c1"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:51.455962 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2ce427af-28c6-40b5-b3aa-cbe8a10d3ec6 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] [instance: 0e09aad3-5375-4b00-bd45-a59da90e0b07] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:52:51.584177 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-be648441-a74b-420d-9fdd-00a2d9d26fa4 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] validate_networks() for [('aaea12c2-7856-4247-8edf-27760ef402c1', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:52:51.743483 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2ce427af-28c6-40b5-b3aa-cbe8a10d3ec6 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07" status: 204 len: 0 microversion: 2.1 time: 0.565442 Aug 04 16:52:51.746876 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1661/3375] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:52:51 2022] DELETE /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:52:51.765407 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3bf018ba-fd90-4292-bb95-806e1d535b33 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:51.767433 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3bf018ba-fd90-4292-bb95-806e1d535b33 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] [instance: 0e09aad3-5375-4b00-bd45-a59da90e0b07] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:51.786907 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3bf018ba-fd90-4292-bb95-806e1d535b33 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:51.787359 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3bf018ba-fd90-4292-bb95-806e1d535b33 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:51.791197 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3bf018ba-fd90-4292-bb95-806e1d535b33 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:51.793172 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3bf018ba-fd90-4292-bb95-806e1d535b33 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:52.599670 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3bf018ba-fd90-4292-bb95-806e1d535b33 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46767eac23745aaa0bf5c14c48d5411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1977041291401a84ef2fe9287b0fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:52.617490 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3bf018ba-fd90-4292-bb95-806e1d535b33 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] 10.222.0.23 "GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07" status: 200 len: 1527 microversion: 2.1 time: 0.865418 Aug 04 16:52:52.647448 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1662/3376] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:51 2022] GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07 => generated 1527 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:52.663265 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9929338d-46c8-4da4-b014-891084a3ca85 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:52.670729 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9929338d-46c8-4da4-b014-891084a3ca85 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 56e8faca-3b86-4598-8e8c-0f511745e8de] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:52.692418 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9929338d-46c8-4da4-b014-891084a3ca85 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:52.694192 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9929338d-46c8-4da4-b014-891084a3ca85 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:52.695630 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9929338d-46c8-4da4-b014-891084a3ca85 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:52.697318 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9929338d-46c8-4da4-b014-891084a3ca85 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:53.602539 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9929338d-46c8-4da4-b014-891084a3ca85 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:53.612873 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9929338d-46c8-4da4-b014-891084a3ca85 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de" status: 200 len: 1277 microversion: 2.1 time: 0.963832 Aug 04 16:52:53.619539 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1663/3377] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:52 2022] GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de => generated 1277 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:53.652093 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-586ee6dc-91a9-4811-a5dd-ed3f7144d5e2 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:53.652949 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-586ee6dc-91a9-4811-a5dd-ed3f7144d5e2 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] [instance: 0e09aad3-5375-4b00-bd45-a59da90e0b07] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:53.667914 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-586ee6dc-91a9-4811-a5dd-ed3f7144d5e2 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:53.672404 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-586ee6dc-91a9-4811-a5dd-ed3f7144d5e2 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:53.673484 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-586ee6dc-91a9-4811-a5dd-ed3f7144d5e2 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:53.675012 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-586ee6dc-91a9-4811-a5dd-ed3f7144d5e2 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:54.791360 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-be648441-a74b-420d-9fdd-00a2d9d26fa4 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:52:54.794844 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-586ee6dc-91a9-4811-a5dd-ed3f7144d5e2 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46767eac23745aaa0bf5c14c48d5411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1977041291401a84ef2fe9287b0fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:54.796970 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-be648441-a74b-420d-9fdd-00a2d9d26fa4 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:52:54.797545 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-be648441-a74b-420d-9fdd-00a2d9d26fa4 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:52:54.797944 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-be648441-a74b-420d-9fdd-00a2d9d26fa4 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:52:54.798354 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-be648441-a74b-420d-9fdd-00a2d9d26fa4 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:52:54.830488 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-586ee6dc-91a9-4811-a5dd-ed3f7144d5e2 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] 10.222.0.23 "GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07" status: 200 len: 1527 microversion: 2.1 time: 1.184216 Aug 04 16:52:54.833636 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1664/3378] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:53 2022] GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07 => generated 1527 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:52:54.850900 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=43 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:52:54.856672 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-968473c6-c6f7-4d98-bb41-19d1441f6db1 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:54.857970 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be648441-a74b-420d-9fdd-00a2d9d26fa4 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:54.858670 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be648441-a74b-420d-9fdd-00a2d9d26fa4 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:54.859573 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be648441-a74b-420d-9fdd-00a2d9d26fa4 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:54.860012 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be648441-a74b-420d-9fdd-00a2d9d26fa4 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:54.863645 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-968473c6-c6f7-4d98-bb41-19d1441f6db1 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 56e8faca-3b86-4598-8e8c-0f511745e8de] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:54.881190 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-968473c6-c6f7-4d98-bb41-19d1441f6db1 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:54.881917 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-968473c6-c6f7-4d98-bb41-19d1441f6db1 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:54.887887 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-968473c6-c6f7-4d98-bb41-19d1441f6db1 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:54.889627 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-968473c6-c6f7-4d98-bb41-19d1441f6db1 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:54.938681 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-be648441-a74b-420d-9fdd-00a2d9d26fa4 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Getting quotas for project c03c7dc970224dedb4778b16a402f1a3. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:52:54.967122 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-be648441-a74b-420d-9fdd-00a2d9d26fa4 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Getting quotas for user 3786fedbfc6043f8a0dacb3bf8ee82e9 and project c03c7dc970224dedb4778b16a402f1a3. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:52:55.021356 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-be648441-a74b-420d-9fdd-00a2d9d26fa4 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:52:55.024476 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-be648441-a74b-420d-9fdd-00a2d9d26fa4 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] [instance: b812d7ac-838e-4c92-a359-d237647925f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:52:55.125390 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-be648441-a74b-420d-9fdd-00a2d9d26fa4 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.580275 Aug 04 16:52:55.133739 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1715/3379] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:52:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 4590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:52:55.141779 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f69dec9a-16e1-4643-bf15-e00315e19ccd tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:55.142921 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f69dec9a-16e1-4643-bf15-e00315e19ccd tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] [instance: b812d7ac-838e-4c92-a359-d237647925f9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:55.174760 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-968473c6-c6f7-4d98-bb41-19d1441f6db1 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:55.190837 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-968473c6-c6f7-4d98-bb41-19d1441f6db1 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de" status: 200 len: 1283 microversion: 2.1 time: 0.352795 Aug 04 16:52:55.192642 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1665/3380] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:54 2022] GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de => generated 1283 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:55.472356 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f69dec9a-16e1-4643-bf15-e00315e19ccd tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3786fedbfc6043f8a0dacb3bf8ee82e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03c7dc970224dedb4778b16a402f1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:55.490411 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f69dec9a-16e1-4643-bf15-e00315e19ccd tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] 10.222.0.23 "GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9" status: 200 len: 1217 microversion: 2.1 time: 0.352765 Aug 04 16:52:55.493812 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1716/3381] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:55 2022] GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9 => generated 1217 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:55.857941 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b9267caa-7529-4ee7-aa13-d8ba6afb7c3c tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:55.859338 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b9267caa-7529-4ee7-aa13-d8ba6afb7c3c tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] [instance: 0e09aad3-5375-4b00-bd45-a59da90e0b07] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:55.875775 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b9267caa-7529-4ee7-aa13-d8ba6afb7c3c tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:55.876260 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b9267caa-7529-4ee7-aa13-d8ba6afb7c3c tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:55.877115 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b9267caa-7529-4ee7-aa13-d8ba6afb7c3c tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:55.877521 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b9267caa-7529-4ee7-aa13-d8ba6afb7c3c tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:56.218491 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e097c202-583a-4192-a099-3a9c97db2e60 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:56.219741 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e097c202-583a-4192-a099-3a9c97db2e60 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 56e8faca-3b86-4598-8e8c-0f511745e8de] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:56.232639 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=3,nova_api:INSERT=8 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:52:56.239244 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e097c202-583a-4192-a099-3a9c97db2e60 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:56.239670 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e097c202-583a-4192-a099-3a9c97db2e60 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:56.240464 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e097c202-583a-4192-a099-3a9c97db2e60 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:56.240906 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e097c202-583a-4192-a099-3a9c97db2e60 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:56.465168 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e097c202-583a-4192-a099-3a9c97db2e60 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:56.479650 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e097c202-583a-4192-a099-3a9c97db2e60 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de" status: 200 len: 1283 microversion: 2.1 time: 0.265008 Aug 04 16:52:56.481803 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1717/3382] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:56 2022] GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de => generated 1283 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:56.534518 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bf3ca904-29a0-44f3-aae2-b67bed39462f tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:56.535394 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bf3ca904-29a0-44f3-aae2-b67bed39462f tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] [instance: b812d7ac-838e-4c92-a359-d237647925f9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:56.557351 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf3ca904-29a0-44f3-aae2-b67bed39462f tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:56.558015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf3ca904-29a0-44f3-aae2-b67bed39462f tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:56.559022 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf3ca904-29a0-44f3-aae2-b67bed39462f tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:56.559705 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf3ca904-29a0-44f3-aae2-b67bed39462f tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:56.777997 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bf3ca904-29a0-44f3-aae2-b67bed39462f tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3786fedbfc6043f8a0dacb3bf8ee82e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03c7dc970224dedb4778b16a402f1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:56.788584 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bf3ca904-29a0-44f3-aae2-b67bed39462f tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] 10.222.0.23 "GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9" status: 200 len: 1213 microversion: 2.1 time: 0.265809 Aug 04 16:52:56.808197 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1718/3383] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:56 2022] GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9 => generated 1213 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:56.933820 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b9267caa-7529-4ee7-aa13-d8ba6afb7c3c tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46767eac23745aaa0bf5c14c48d5411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1977041291401a84ef2fe9287b0fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:56.949581 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b9267caa-7529-4ee7-aa13-d8ba6afb7c3c tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] 10.222.0.23 "GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07" status: 200 len: 1527 microversion: 2.1 time: 1.095058 Aug 04 16:52:56.956382 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1666/3384] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:55 2022] GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07 => generated 1527 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:57.296810 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-4bd8afad-dbdb-4b97-9ef7-7f4dc9572f5a req-7682b929-c83f-40e8-9afd-b9d5fac22b92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e09aad3-5375-4b00-bd45-a59da90e0b07", "name": "network-vif-deleted", "tag": "1b04fa39-c782-4031-a8cb-8f43ef0d05a3"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:52:57.320252 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-4bd8afad-dbdb-4b97-9ef7-7f4dc9572f5a req-7682b929-c83f-40e8-9afd-b9d5fac22b92 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:57.320689 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-4bd8afad-dbdb-4b97-9ef7-7f4dc9572f5a req-7682b929-c83f-40e8-9afd-b9d5fac22b92 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:57.359523 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-4bd8afad-dbdb-4b97-9ef7-7f4dc9572f5a req-7682b929-c83f-40e8-9afd-b9d5fac22b92 service nova] Creating event network-vif-deleted:1b04fa39-c782-4031-a8cb-8f43ef0d05a3 for instance 0e09aad3-5375-4b00-bd45-a59da90e0b07 on n-h1-846466-12 Aug 04 16:52:57.377036 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-4bd8afad-dbdb-4b97-9ef7-7f4dc9572f5a req-7682b929-c83f-40e8-9afd-b9d5fac22b92 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083922 Aug 04 16:52:57.379838 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1719/3385] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:52:57.505681 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-21549c38-6d44-485a-b3ce-f0a694763819 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:57.506600 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-21549c38-6d44-485a-b3ce-f0a694763819 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 56e8faca-3b86-4598-8e8c-0f511745e8de] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:57.526305 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-21549c38-6d44-485a-b3ce-f0a694763819 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:57.528859 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-21549c38-6d44-485a-b3ce-f0a694763819 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:57.533007 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-21549c38-6d44-485a-b3ce-f0a694763819 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:57.533545 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-21549c38-6d44-485a-b3ce-f0a694763819 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:57.773637 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-21549c38-6d44-485a-b3ce-f0a694763819 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:57.787165 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-21549c38-6d44-485a-b3ce-f0a694763819 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de" status: 200 len: 1283 microversion: 2.1 time: 0.288002 Aug 04 16:52:57.789053 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1667/3386] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:57 2022] GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de => generated 1283 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:57.813865 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4eee8984-e5eb-4c62-acd1-8406ce81922f tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:57.814922 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4eee8984-e5eb-4c62-acd1-8406ce81922f tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] [instance: b812d7ac-838e-4c92-a359-d237647925f9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:57.821752 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4eee8984-e5eb-4c62-acd1-8406ce81922f tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:57.822641 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4eee8984-e5eb-4c62-acd1-8406ce81922f tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:57.823763 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4eee8984-e5eb-4c62-acd1-8406ce81922f tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:57.824609 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4eee8984-e5eb-4c62-acd1-8406ce81922f tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:57.975821 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-483aa808-a793-48ed-9ec7-fbb03561f480 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:57.976783 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-483aa808-a793-48ed-9ec7-fbb03561f480 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] [instance: 0e09aad3-5375-4b00-bd45-a59da90e0b07] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:57.992344 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-483aa808-a793-48ed-9ec7-fbb03561f480 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:57.992798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-483aa808-a793-48ed-9ec7-fbb03561f480 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:57.993601 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-483aa808-a793-48ed-9ec7-fbb03561f480 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:57.994034 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-483aa808-a793-48ed-9ec7-fbb03561f480 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:58.095274 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-483aa808-a793-48ed-9ec7-fbb03561f480 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:58.095796 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-483aa808-a793-48ed-9ec7-fbb03561f480 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:58.096258 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-483aa808-a793-48ed-9ec7-fbb03561f480 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lazy-loading 'fault' on Instance uuid 0e09aad3-5375-4b00-bd45-a59da90e0b07 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:52:58.110511 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4eee8984-e5eb-4c62-acd1-8406ce81922f tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3786fedbfc6043f8a0dacb3bf8ee82e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03c7dc970224dedb4778b16a402f1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:58.124103 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4eee8984-e5eb-4c62-acd1-8406ce81922f tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] 10.222.0.23 "GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9" status: 200 len: 1275 microversion: 2.1 time: 0.314266 Aug 04 16:52:58.124726 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1720/3387] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:57 2022] GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9 => generated 1275 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:58.300732 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-483aa808-a793-48ed-9ec7-fbb03561f480 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46767eac23745aaa0bf5c14c48d5411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1977041291401a84ef2fe9287b0fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:58.330785 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-483aa808-a793-48ed-9ec7-fbb03561f480 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] 10.222.0.23 "GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07" status: 200 len: 1315 microversion: 2.1 time: 0.357072 Aug 04 16:52:58.336736 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1668/3388] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:57 2022] GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07 => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:52:58.809533 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-23de0ef6-6efb-4aee-b245-2b59c9fa7068 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:58.810398 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-23de0ef6-6efb-4aee-b245-2b59c9fa7068 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 56e8faca-3b86-4598-8e8c-0f511745e8de] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:58.820274 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-23de0ef6-6efb-4aee-b245-2b59c9fa7068 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:58.824948 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-23de0ef6-6efb-4aee-b245-2b59c9fa7068 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:58.826215 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-23de0ef6-6efb-4aee-b245-2b59c9fa7068 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:58.828245 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-23de0ef6-6efb-4aee-b245-2b59c9fa7068 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:59.153638 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9fbe6505-e986-47a9-af5e-de6aa272c4ac tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:59.154839 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9fbe6505-e986-47a9-af5e-de6aa272c4ac tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] [instance: b812d7ac-838e-4c92-a359-d237647925f9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:59.174461 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9fbe6505-e986-47a9-af5e-de6aa272c4ac tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:59.175505 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9fbe6505-e986-47a9-af5e-de6aa272c4ac tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:59.176796 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9fbe6505-e986-47a9-af5e-de6aa272c4ac tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:59.177469 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9fbe6505-e986-47a9-af5e-de6aa272c4ac tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:59.333871 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-23de0ef6-6efb-4aee-b245-2b59c9fa7068 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:52:59.346294 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-23de0ef6-6efb-4aee-b245-2b59c9fa7068 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de" status: 200 len: 1325 microversion: 2.1 time: 0.540581 Aug 04 16:52:59.348188 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1721/3389] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:58 2022] GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de => generated 1325 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:59.367271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5b896443-1e07-4a7a-a9a0-a9d31e70e093 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:59.368495 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5b896443-1e07-4a7a-a9a0-a9d31e70e093 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] [instance: 0e09aad3-5375-4b00-bd45-a59da90e0b07] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:52:59.376508 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5b896443-1e07-4a7a-a9a0-a9d31e70e093 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:59.378292 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5b896443-1e07-4a7a-a9a0-a9d31e70e093 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:59.379522 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5b896443-1e07-4a7a-a9a0-a9d31e70e093 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:52:59.380679 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5b896443-1e07-4a7a-a9a0-a9d31e70e093 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:52:59.408571 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-5b896443-1e07-4a7a-a9a0-a9d31e70e093 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] HTTP exception thrown: Instance 0e09aad3-5375-4b00-bd45-a59da90e0b07 could not be found. Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5b896443-1e07-4a7a-a9a0-a9d31e70e093 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Request method failure captured: Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07 HTTP/1.1 Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_lK4HRKbbxYrelSTylP6qOz6rfATbJyyHUDMkMSOu7P-wZWUOuHxwVUQcGuSCZ6pXgF5kb6CA5lBssqL-HpD9I4XbsB_Xj2OTJWKdp3ACjEb0hPOsbbUsYOyxeJSfO0o6oGMzRG2e-15hKGb0hIAUYEQbW0FX1hw0I_FLt5ZL4WYWM Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: de1977041291401a84ef2fe9287b0fcb Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1162813466 Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de1977041291401a84ef2fe9287b0fcb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_de1977041291401a84ef2fe9287b0fcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de1977041291401a84ef2fe9287b0fcb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/de1977041291401a84ef2fe9287b0fcb"}]}] Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1162813466 Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: de1977041291401a84ef2fe9287b0fcb Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1162813466 Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-InstanceActionsNegativeTestJSON-1162813466-project Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: e46767eac23745aaa0bf5c14c48d5411 Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1162813466-project Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 0e09aad3-5375-4b00-bd45-a59da90e0b07 could not be found. Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '0e09aad3-5375-4b00-bd45-a59da90e0b07'} Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e09aad3-5375-4b00-bd45-a59da90e0b07 could not be found. Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e09aad3-5375-4b00-bd45-a59da90e0b07 could not be found. Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:52:59.410858 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:52:59.416587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:52:59.416587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:52:59.416587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:52:59.416587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:52:59.416587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:52:59.416587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:52:59.416587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e09aad3-5375-4b00-bd45-a59da90e0b07 could not be found. Aug 04 16:52:59.416587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:52:59.420445 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5b896443-1e07-4a7a-a9a0-a9d31e70e093 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] Returning 404 to user: Instance 0e09aad3-5375-4b00-bd45-a59da90e0b07 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:52:59.421624 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5b896443-1e07-4a7a-a9a0-a9d31e70e093 tempest-InstanceActionsNegativeTestJSON-1162813466 tempest-InstanceActionsNegativeTestJSON-1162813466-project] 10.222.0.23 "GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07" status: 404 len: 111 microversion: 2.1 time: 0.068821 Aug 04 16:52:59.422783 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1722/3390] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:59 2022] GET /compute/v2.1/servers/0e09aad3-5375-4b00-bd45-a59da90e0b07 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:52:59.979368 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1e688ef8-ce07-4539-b70c-1ef569bd3b76 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Action: 'create', calling method: .version_select at 0x7f7e843cf670>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-958930024", "policies": ["affinity"]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:53:00.019290 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-1e688ef8-ce07-4539-b70c-1ef569bd3b76 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Getting quotas for project 8e38cf8e78184212a1680df483885d82. Resources: {'server_groups'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:53:00.034732 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-1e688ef8-ce07-4539-b70c-1ef569bd3b76 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Getting quotas for user 08e77ffd9d2840a3bde26a88069ee338 and project 8e38cf8e78184212a1680df483885d82. Resources: {'server_groups'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:53:00.160462 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-1e688ef8-ce07-4539-b70c-1ef569bd3b76 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Getting quotas for project 8e38cf8e78184212a1680df483885d82. Resources: {'server_groups'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:53:00.168913 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-1e688ef8-ce07-4539-b70c-1ef569bd3b76 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Getting quotas for user 08e77ffd9d2840a3bde26a88069ee338 and project 8e38cf8e78184212a1680df483885d82. Resources: {'server_groups'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:53:00.210118 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1e688ef8-ce07-4539-b70c-1ef569bd3b76 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.505792 Aug 04 16:53:00.217562 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1723/3391] 10.222.0.23 () {60 vars in 1174 bytes} [Thu Aug 4 16:52:59 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:53:00.223012 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2a0e0406-0f67-4857-ad05-a1d93196a74d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Action: 'create', calling method: .version_select at 0x7f7e77f8e8b0>, body: {"server_group": {"name": "tempest-server-group-1709463955", "policies": ["affinity"]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:53:00.231913 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9fbe6505-e986-47a9-af5e-de6aa272c4ac tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3786fedbfc6043f8a0dacb3bf8ee82e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03c7dc970224dedb4778b16a402f1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:00.255587 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9fbe6505-e986-47a9-af5e-de6aa272c4ac tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] 10.222.0.23 "GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9" status: 200 len: 1317 microversion: 2.1 time: 1.109625 Aug 04 16:53:00.267345 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-2a0e0406-0f67-4857-ad05-a1d93196a74d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Getting quotas for project 8e38cf8e78184212a1680df483885d82. Resources: {'server_groups'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:53:00.269049 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1669/3392] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:52:59 2022] GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9 => generated 1317 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:53:00.284843 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-2a0e0406-0f67-4857-ad05-a1d93196a74d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Getting quotas for user 08e77ffd9d2840a3bde26a88069ee338 and project 8e38cf8e78184212a1680df483885d82. Resources: {'server_groups'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:53:00.371079 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f7ac1db4-043d-4603-9156-ac0fc2652d59 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:00.371860 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f7ac1db4-043d-4603-9156-ac0fc2652d59 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 56e8faca-3b86-4598-8e8c-0f511745e8de] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:00.381095 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f7ac1db4-043d-4603-9156-ac0fc2652d59 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:00.387972 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-2a0e0406-0f67-4857-ad05-a1d93196a74d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Getting quotas for project 8e38cf8e78184212a1680df483885d82. Resources: {'server_groups'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:53:00.388686 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f7ac1db4-043d-4603-9156-ac0fc2652d59 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:00.392397 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f7ac1db4-043d-4603-9156-ac0fc2652d59 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:00.392919 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f7ac1db4-043d-4603-9156-ac0fc2652d59 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:00.395347 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-2a0e0406-0f67-4857-ad05-a1d93196a74d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Getting quotas for user 08e77ffd9d2840a3bde26a88069ee338 and project 8e38cf8e78184212a1680df483885d82. Resources: {'server_groups'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:53:00.434634 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2a0e0406-0f67-4857-ad05-a1d93196a74d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.213902 Aug 04 16:53:00.438275 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1724/3393] 10.222.0.23 () {60 vars in 1173 bytes} [Thu Aug 4 16:53:00 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:53:00.456052 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3b907485-6df4-4c97-9f4a-a5621ad0f7b1 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Action: 'create', calling method: .version_select at 0x7f7e840e8670>, body: {"server_group": {"name": "tempest-server-group-1709463955", "policies": ["affinity"]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:53:00.499616 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-3b907485-6df4-4c97-9f4a-a5621ad0f7b1 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Getting quotas for project 8e38cf8e78184212a1680df483885d82. Resources: {'server_groups'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:53:00.508942 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-3b907485-6df4-4c97-9f4a-a5621ad0f7b1 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Getting quotas for user 08e77ffd9d2840a3bde26a88069ee338 and project 8e38cf8e78184212a1680df483885d82. Resources: {'server_groups'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:53:00.648594 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-3b907485-6df4-4c97-9f4a-a5621ad0f7b1 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Getting quotas for project 8e38cf8e78184212a1680df483885d82. Resources: {'server_groups'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:53:00.658322 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-3b907485-6df4-4c97-9f4a-a5621ad0f7b1 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Getting quotas for user 08e77ffd9d2840a3bde26a88069ee338 and project 8e38cf8e78184212a1680df483885d82. Resources: {'server_groups'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:53:00.680210 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3b907485-6df4-4c97-9f4a-a5621ad0f7b1 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.232359 Aug 04 16:53:00.681788 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1725/3394] 10.222.0.23 () {60 vars in 1173 bytes} [Thu Aug 4 16:53:00 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:53:00.692559 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-74b189d5-c24f-4fc2-9949-9f117148a089 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:00.741254 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-74b189d5-c24f-4fc2-9949-9f117148a089 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/cf69ec3a-6e91-4469-9a13-3763143f3bf5" status: 204 len: 0 microversion: 2.1 time: 0.051520 Aug 04 16:53:00.744923 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1726/3395] 10.222.0.23 () {58 vars in 1266 bytes} [Thu Aug 4 16:53:00 2022] DELETE /compute/v2.1/os-server-groups/cf69ec3a-6e91-4469-9a13-3763143f3bf5 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 16:53:00.755071 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4d592632-30a0-4c6a-843e-fdf24379fc07 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:00.775292 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:53:00.778667 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4d592632-30a0-4c6a-843e-fdf24379fc07 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.028589 Aug 04 16:53:00.779862 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1727/3396] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Aug 4 16:53:00 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:53:00.799854 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c1d4d7c6-64b3-42d8-9b4f-7d0cda477070 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:00.843229 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:53:00.859044 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c1d4d7c6-64b3-42d8-9b4f-7d0cda477070 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/686c7ce5-1be4-43a0-b474-7f2503e5210a" status: 204 len: 0 microversion: 2.1 time: 0.071372 Aug 04 16:53:00.860549 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1728/3397] 10.222.0.23 () {58 vars in 1266 bytes} [Thu Aug 4 16:53:00 2022] DELETE /compute/v2.1/os-server-groups/686c7ce5-1be4-43a0-b474-7f2503e5210a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:53:00.870858 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5aaec8c6-9049-4b87-a4e1-d9074471f85b tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:00.887264 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5aaec8c6-9049-4b87-a4e1-d9074471f85b tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.022265 Aug 04 16:53:00.889803 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1729/3398] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Aug 4 16:53:00 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:53:00.905077 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-03cd686f-f8c8-4572-b1ac-91842b14c10b tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Action: 'create', calling method: .version_select at 0x7f7e843bb160>, body: {"server_group": {"name": "tempest-server-group-188179285", "policies": ["affinity"]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:53:00.932319 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-03cd686f-f8c8-4572-b1ac-91842b14c10b tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Getting quotas for project 8e38cf8e78184212a1680df483885d82. Resources: {'server_groups'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:53:00.940925 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-03cd686f-f8c8-4572-b1ac-91842b14c10b tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Getting quotas for user 08e77ffd9d2840a3bde26a88069ee338 and project 8e38cf8e78184212a1680df483885d82. Resources: {'server_groups'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:53:00.971661 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f7ac1db4-043d-4603-9156-ac0fc2652d59 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:00.984682 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f7ac1db4-043d-4603-9156-ac0fc2652d59 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de" status: 200 len: 1325 microversion: 2.1 time: 0.618613 Aug 04 16:53:01.007909 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1670/3399] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:00 2022] GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de => generated 1325 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:53:01.040522 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-03cd686f-f8c8-4572-b1ac-91842b14c10b tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Getting quotas for project 8e38cf8e78184212a1680df483885d82. Resources: {'server_groups'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:53:01.054286 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-03cd686f-f8c8-4572-b1ac-91842b14c10b tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Getting quotas for user 08e77ffd9d2840a3bde26a88069ee338 and project 8e38cf8e78184212a1680df483885d82. Resources: {'server_groups'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:53:01.085589 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-03cd686f-f8c8-4572-b1ac-91842b14c10b tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.185518 Aug 04 16:53:01.088291 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1730/3400] 10.222.0.23 () {60 vars in 1173 bytes} [Thu Aug 4 16:53:00 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:53:01.097736 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a85824b1-8d3b-431c-b736-97f8272b8d2d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:01.157379 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a85824b1-8d3b-431c-b736-97f8272b8d2d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/644af689-b450-424f-a760-f5bab2c64efe" status: 204 len: 0 microversion: 2.1 time: 0.064040 Aug 04 16:53:01.158762 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1671/3401] 10.222.0.23 () {58 vars in 1266 bytes} [Thu Aug 4 16:53:01 2022] DELETE /compute/v2.1/os-server-groups/644af689-b450-424f-a760-f5bab2c64efe => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:53:01.169653 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d56f0071-8cb4-4c45-900e-04dc526db865 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:01.196806 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d56f0071-8cb4-4c45-900e-04dc526db865 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.030283 Aug 04 16:53:01.197477 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1731/3402] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Aug 4 16:53:01 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:53:01.213551 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ccc56e88-0533-4add-bf83-3c1e85c69c0b tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Action: 'create', calling method: .version_select at 0x7f7e77e01dc0>, body: {"server_group": {"name": "tempest-server-group-532889638", "policies": ["anti-affinity"]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:53:01.282792 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-ccc56e88-0533-4add-bf83-3c1e85c69c0b tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Getting quotas for project 8e38cf8e78184212a1680df483885d82. Resources: {'server_groups'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:53:01.294402 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f76afd18-c4ae-415d-acc1-0150ce9bd589 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:01.294859 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f76afd18-c4ae-415d-acc1-0150ce9bd589 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] [instance: b812d7ac-838e-4c92-a359-d237647925f9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:01.313499 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-ccc56e88-0533-4add-bf83-3c1e85c69c0b tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Getting quotas for user 08e77ffd9d2840a3bde26a88069ee338 and project 8e38cf8e78184212a1680df483885d82. Resources: {'server_groups'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:53:01.315521 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f76afd18-c4ae-415d-acc1-0150ce9bd589 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:01.319285 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f76afd18-c4ae-415d-acc1-0150ce9bd589 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:01.320594 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f76afd18-c4ae-415d-acc1-0150ce9bd589 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:01.321314 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f76afd18-c4ae-415d-acc1-0150ce9bd589 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:01.449722 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-ccc56e88-0533-4add-bf83-3c1e85c69c0b tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Getting quotas for project 8e38cf8e78184212a1680df483885d82. Resources: {'server_groups'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:53:01.466564 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-ccc56e88-0533-4add-bf83-3c1e85c69c0b tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Getting quotas for user 08e77ffd9d2840a3bde26a88069ee338 and project 8e38cf8e78184212a1680df483885d82. Resources: {'server_groups'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:53:01.494705 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ccc56e88-0533-4add-bf83-3c1e85c69c0b tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.286164 Aug 04 16:53:01.495363 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1672/3403] 10.222.0.23 () {60 vars in 1173 bytes} [Thu Aug 4 16:53:01 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:53:01.518013 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-c140d6fa-655c-4a2f-b219-c2343cbec79f req-c78e35ef-9245-4030-b139-e884941f643b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56e8faca-3b86-4598-8e8c-0f511745e8de", "tag": "2435ab94-2ebc-4e63-aaec-1b9480927119"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:53:01.530365 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-c140d6fa-655c-4a2f-b219-c2343cbec79f req-c78e35ef-9245-4030-b139-e884941f643b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:01.530826 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-c140d6fa-655c-4a2f-b219-c2343cbec79f req-c78e35ef-9245-4030-b139-e884941f643b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:01.574478 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-c140d6fa-655c-4a2f-b219-c2343cbec79f req-c78e35ef-9245-4030-b139-e884941f643b service nova] Creating event network-changed:2435ab94-2ebc-4e63-aaec-1b9480927119 for instance 56e8faca-3b86-4598-8e8c-0f511745e8de on n-h2-846466-12 Aug 04 16:53:01.592273 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-c140d6fa-655c-4a2f-b219-c2343cbec79f req-c78e35ef-9245-4030-b139-e884941f643b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095481 Aug 04 16:53:01.593372 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1673/3404] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:53:01.604080 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f04251c7-8eff-4256-8438-8c858538e50b tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:01.681151 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f04251c7-8eff-4256-8438-8c858538e50b tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/08cacab9-2160-4826-8184-4da79d05a830" status: 204 len: 0 microversion: 2.1 time: 0.085892 Aug 04 16:53:01.682140 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1674/3405] 10.222.0.23 () {58 vars in 1266 bytes} [Thu Aug 4 16:53:01 2022] DELETE /compute/v2.1/os-server-groups/08cacab9-2160-4826-8184-4da79d05a830 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:53:01.688963 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-b1a30cc9-197d-47f0-80e2-1142dd0c20fe req-f5935606-b123-4689-ab88-eb0f483aaf33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b812d7ac-838e-4c92-a359-d237647925f9", "tag": "cd23c7a2-7fda-4065-a1f9-c3a7e4f2526c"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:53:01.721625 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-b1a30cc9-197d-47f0-80e2-1142dd0c20fe req-f5935606-b123-4689-ab88-eb0f483aaf33 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:01.727206 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-b1a30cc9-197d-47f0-80e2-1142dd0c20fe req-f5935606-b123-4689-ab88-eb0f483aaf33 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:01.759795 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-b1a30cc9-197d-47f0-80e2-1142dd0c20fe req-f5935606-b123-4689-ab88-eb0f483aaf33 service nova] Creating event network-changed:cd23c7a2-7fda-4065-a1f9-c3a7e4f2526c for instance b812d7ac-838e-4c92-a359-d237647925f9 on n-h2-846466-12 Aug 04 16:53:01.769395 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-b1a30cc9-197d-47f0-80e2-1142dd0c20fe req-f5935606-b123-4689-ab88-eb0f483aaf33 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085415 Aug 04 16:53:01.770831 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1675/3406] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:53:01.790951 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6bc0da7a-cc04-4198-ad71-77b2775fd266 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:01.822364 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6bc0da7a-cc04-4198-ad71-77b2775fd266 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.049585 Aug 04 16:53:01.837241 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1676/3407] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Aug 4 16:53:01 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:53:02.013633 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-be58fca4-864e-4206-bc74-57165f7a3e38 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:02.014700 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-be58fca4-864e-4206-bc74-57165f7a3e38 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 56e8faca-3b86-4598-8e8c-0f511745e8de] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:02.022070 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be58fca4-864e-4206-bc74-57165f7a3e38 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:02.025114 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be58fca4-864e-4206-bc74-57165f7a3e38 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:02.026244 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be58fca4-864e-4206-bc74-57165f7a3e38 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:02.026851 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be58fca4-864e-4206-bc74-57165f7a3e38 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:02.446275 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f76afd18-c4ae-415d-acc1-0150ce9bd589 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3786fedbfc6043f8a0dacb3bf8ee82e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03c7dc970224dedb4778b16a402f1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:02.466719 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f76afd18-c4ae-415d-acc1-0150ce9bd589 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] 10.222.0.23 "GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9" status: 200 len: 1317 microversion: 2.1 time: 1.177363 Aug 04 16:53:02.468116 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1732/3408] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:01 2022] GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9 => generated 1317 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:53:02.502130 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a780d40a-dd2c-448b-a462-ea20ea6e689d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1737554304", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "03fead9f-66be-47fc-ba89-069dcb69bb35"}]}, "os:scheduler_hints": {"group": "71c64be4-a913-449b-9dd0-c830a08e09c8"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:53:02.624855 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-a780d40a-dd2c-448b-a462-ea20ea6e689d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] validate_networks() for [('03fead9f-66be-47fc-ba89-069dcb69bb35', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:53:03.070427 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-be58fca4-864e-4206-bc74-57165f7a3e38 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:03.088868 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-be58fca4-864e-4206-bc74-57165f7a3e38 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de" status: 200 len: 1325 microversion: 2.1 time: 1.079030 Aug 04 16:53:03.092482 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1677/3409] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:02 2022] GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de => generated 1325 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:53:03.492649 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-651c8c4a-4533-4285-b6c9-c063ae4759d2 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:03.493474 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-651c8c4a-4533-4285-b6c9-c063ae4759d2 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] [instance: b812d7ac-838e-4c92-a359-d237647925f9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:03.519207 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-651c8c4a-4533-4285-b6c9-c063ae4759d2 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:03.520426 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-651c8c4a-4533-4285-b6c9-c063ae4759d2 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:03.521774 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-651c8c4a-4533-4285-b6c9-c063ae4759d2 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:03.522677 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-651c8c4a-4533-4285-b6c9-c063ae4759d2 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:04.896277 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:53:04.996746 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-a780d40a-dd2c-448b-a462-ea20ea6e689d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:53:04.997682 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-a780d40a-dd2c-448b-a462-ea20ea6e689d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:53:04.998383 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-a780d40a-dd2c-448b-a462-ea20ea6e689d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:53:04.999206 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-a780d40a-dd2c-448b-a462-ea20ea6e689d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:53:04.999812 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-a780d40a-dd2c-448b-a462-ea20ea6e689d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:53:05.043564 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a780d40a-dd2c-448b-a462-ea20ea6e689d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:05.046625 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a780d40a-dd2c-448b-a462-ea20ea6e689d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:05.047862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a780d40a-dd2c-448b-a462-ea20ea6e689d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:05.053506 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a780d40a-dd2c-448b-a462-ea20ea6e689d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:05.110300 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-a780d40a-dd2c-448b-a462-ea20ea6e689d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Getting quotas for project 8e38cf8e78184212a1680df483885d82. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:53:05.144540 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-a780d40a-dd2c-448b-a462-ea20ea6e689d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Getting quotas for user 08e77ffd9d2840a3bde26a88069ee338 and project 8e38cf8e78184212a1680df483885d82. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:53:05.162068 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-651c8c4a-4533-4285-b6c9-c063ae4759d2 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3786fedbfc6043f8a0dacb3bf8ee82e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03c7dc970224dedb4778b16a402f1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:05.171153 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-651c8c4a-4533-4285-b6c9-c063ae4759d2 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] 10.222.0.23 "GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9" status: 200 len: 1317 microversion: 2.1 time: 1.682544 Aug 04 16:53:05.171750 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1678/3410] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:03 2022] GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9 => generated 1317 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:53:05.185570 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3a1b3a3e-b32d-4fdc-a77d-c6f858272115 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:05.185570 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3a1b3a3e-b32d-4fdc-a77d-c6f858272115 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 56e8faca-3b86-4598-8e8c-0f511745e8de] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:05.189927 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a780d40a-dd2c-448b-a462-ea20ea6e689d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:53:05.202185 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a1b3a3e-b32d-4fdc-a77d-c6f858272115 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:05.202630 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a1b3a3e-b32d-4fdc-a77d-c6f858272115 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:05.203402 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a1b3a3e-b32d-4fdc-a77d-c6f858272115 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:05.203974 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a1b3a3e-b32d-4fdc-a77d-c6f858272115 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:05.204165 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a780d40a-dd2c-448b-a462-ea20ea6e689d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] [instance: 5ecc38b6-e6df-4a00-9757-708aac3a8734] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:53:05.318472 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-a780d40a-dd2c-448b-a462-ea20ea6e689d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Getting quotas for project 8e38cf8e78184212a1680df483885d82. Resources: {'server_group_members'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:53:05.325467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-a780d40a-dd2c-448b-a462-ea20ea6e689d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Getting quotas for user 08e77ffd9d2840a3bde26a88069ee338 and project 8e38cf8e78184212a1680df483885d82. Resources: {'server_group_members'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:53:05.416587 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-a780d40a-dd2c-448b-a462-ea20ea6e689d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Getting quotas for project 8e38cf8e78184212a1680df483885d82. Resources: {'server_group_members'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:53:05.449381 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-a780d40a-dd2c-448b-a462-ea20ea6e689d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Getting quotas for user 08e77ffd9d2840a3bde26a88069ee338 and project 8e38cf8e78184212a1680df483885d82. Resources: {'server_group_members'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:53:05.517076 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a780d40a-dd2c-448b-a462-ea20ea6e689d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.030251 Aug 04 16:53:05.518511 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1733/3411] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:53:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 3050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:53:05.531680 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-be1c98f8-dd17-410a-8b5b-9c6cbd5d60e5 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:05.532704 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-be1c98f8-dd17-410a-8b5b-9c6cbd5d60e5 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] [instance: 5ecc38b6-e6df-4a00-9757-708aac3a8734] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:06.334612 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-be1c98f8-dd17-410a-8b5b-9c6cbd5d60e5 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e77ffd9d2840a3bde26a88069ee338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e38cf8e78184212a1680df483885d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:06.346217 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-be1c98f8-dd17-410a-8b5b-9c6cbd5d60e5 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734" status: 200 len: 1213 microversion: 2.1 time: 0.820364 Aug 04 16:53:06.354897 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1734/3412] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:05 2022] GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734 => generated 1213 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:06.390081 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-427fbc5c-17d0-4dab-b2f7-7297b37e936f tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:06.390736 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-427fbc5c-17d0-4dab-b2f7-7297b37e936f tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] [instance: b812d7ac-838e-4c92-a359-d237647925f9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:06.438292 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-427fbc5c-17d0-4dab-b2f7-7297b37e936f tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:06.439339 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-427fbc5c-17d0-4dab-b2f7-7297b37e936f tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:06.442126 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-427fbc5c-17d0-4dab-b2f7-7297b37e936f tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:06.443364 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-427fbc5c-17d0-4dab-b2f7-7297b37e936f tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:06.670827 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3a1b3a3e-b32d-4fdc-a77d-c6f858272115 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:06.694833 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3a1b3a3e-b32d-4fdc-a77d-c6f858272115 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de" status: 200 len: 1325 microversion: 2.1 time: 1.521820 Aug 04 16:53:06.710832 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1679/3413] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:05 2022] GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de => generated 1325 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:07.377695 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9f4d7dbe-f6a5-4016-b676-43567bdd78de tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:07.378320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9f4d7dbe-f6a5-4016-b676-43567bdd78de tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] [instance: 5ecc38b6-e6df-4a00-9757-708aac3a8734] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:07.389644 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f4d7dbe-f6a5-4016-b676-43567bdd78de tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:07.389763 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f4d7dbe-f6a5-4016-b676-43567bdd78de tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:07.390456 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f4d7dbe-f6a5-4016-b676-43567bdd78de tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:07.390893 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f4d7dbe-f6a5-4016-b676-43567bdd78de tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:07.763747 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9f4d7dbe-f6a5-4016-b676-43567bdd78de tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e77ffd9d2840a3bde26a88069ee338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e38cf8e78184212a1680df483885d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:07.775333 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9f4d7dbe-f6a5-4016-b676-43567bdd78de tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734" status: 200 len: 1265 microversion: 2.1 time: 0.401488 Aug 04 16:53:07.775931 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1680/3414] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:07 2022] GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734 => generated 1265 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:07.782590 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8f545d8c-8aed-44ad-b2a7-fb332035f7fd tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:07.790047 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8f545d8c-8aed-44ad-b2a7-fb332035f7fd tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 56e8faca-3b86-4598-8e8c-0f511745e8de] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:07.803751 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8f545d8c-8aed-44ad-b2a7-fb332035f7fd tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:07.808233 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8f545d8c-8aed-44ad-b2a7-fb332035f7fd tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:07.809234 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8f545d8c-8aed-44ad-b2a7-fb332035f7fd tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:07.809848 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8f545d8c-8aed-44ad-b2a7-fb332035f7fd tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:07.869652 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:53:08.326131 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-427fbc5c-17d0-4dab-b2f7-7297b37e936f tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3786fedbfc6043f8a0dacb3bf8ee82e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03c7dc970224dedb4778b16a402f1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:08.336847 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-427fbc5c-17d0-4dab-b2f7-7297b37e936f tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] 10.222.0.23 "GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9" status: 200 len: 1317 microversion: 2.1 time: 1.961074 Aug 04 16:53:08.341900 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1735/3415] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:06 2022] GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9 => generated 1317 bytes in 1986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:08.742649 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8f545d8c-8aed-44ad-b2a7-fb332035f7fd tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:08.760704 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8f545d8c-8aed-44ad-b2a7-fb332035f7fd tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de" status: 200 len: 1325 microversion: 2.1 time: 0.982110 Aug 04 16:53:08.763696 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1681/3416] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:07 2022] GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de => generated 1325 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:08.802118 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-325e8a98-177a-4705-90d5-91acff4fb3b7 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:08.803052 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-325e8a98-177a-4705-90d5-91acff4fb3b7 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] [instance: 5ecc38b6-e6df-4a00-9757-708aac3a8734] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:08.813894 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-325e8a98-177a-4705-90d5-91acff4fb3b7 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:08.817600 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-325e8a98-177a-4705-90d5-91acff4fb3b7 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:08.820299 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-325e8a98-177a-4705-90d5-91acff4fb3b7 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:08.826991 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-325e8a98-177a-4705-90d5-91acff4fb3b7 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:09.006581 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-325e8a98-177a-4705-90d5-91acff4fb3b7 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e77ffd9d2840a3bde26a88069ee338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e38cf8e78184212a1680df483885d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:09.028194 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-325e8a98-177a-4705-90d5-91acff4fb3b7 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734" status: 200 len: 1271 microversion: 2.1 time: 0.230090 Aug 04 16:53:09.049870 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1736/3417] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:08 2022] GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734 => generated 1271 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:09.365916 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c0020c65-5cc5-417c-a188-dd2abf83e214 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:09.366656 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c0020c65-5cc5-417c-a188-dd2abf83e214 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] [instance: b812d7ac-838e-4c92-a359-d237647925f9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:09.376831 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=6,nova_api:INSERT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:53:09.378638 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c0020c65-5cc5-417c-a188-dd2abf83e214 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:09.381740 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c0020c65-5cc5-417c-a188-dd2abf83e214 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:09.382951 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c0020c65-5cc5-417c-a188-dd2abf83e214 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:09.384558 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c0020c65-5cc5-417c-a188-dd2abf83e214 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:09.785843 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5293af96-8333-474a-9c36-2c7b43ae20cb tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:09.786700 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5293af96-8333-474a-9c36-2c7b43ae20cb tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 56e8faca-3b86-4598-8e8c-0f511745e8de] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:09.796436 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5293af96-8333-474a-9c36-2c7b43ae20cb tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:09.797246 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5293af96-8333-474a-9c36-2c7b43ae20cb tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:09.798538 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5293af96-8333-474a-9c36-2c7b43ae20cb tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:09.799225 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5293af96-8333-474a-9c36-2c7b43ae20cb tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:09.804709 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c0020c65-5cc5-417c-a188-dd2abf83e214 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3786fedbfc6043f8a0dacb3bf8ee82e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03c7dc970224dedb4778b16a402f1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:09.806224 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=83 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:53:09.823193 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c0020c65-5cc5-417c-a188-dd2abf83e214 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] 10.222.0.23 "GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9" status: 200 len: 1317 microversion: 2.1 time: 0.461597 Aug 04 16:53:09.837338 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1682/3418] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:09 2022] GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9 => generated 1317 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:53:10.056837 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-35092cd1-d8ef-46fc-a129-efa00b547f88 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:10.057479 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-35092cd1-d8ef-46fc-a129-efa00b547f88 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] [instance: 5ecc38b6-e6df-4a00-9757-708aac3a8734] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:10.075355 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-35092cd1-d8ef-46fc-a129-efa00b547f88 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:10.075794 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-35092cd1-d8ef-46fc-a129-efa00b547f88 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:10.076581 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-35092cd1-d8ef-46fc-a129-efa00b547f88 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:10.076998 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-35092cd1-d8ef-46fc-a129-efa00b547f88 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:10.207654 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-35092cd1-d8ef-46fc-a129-efa00b547f88 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e77ffd9d2840a3bde26a88069ee338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e38cf8e78184212a1680df483885d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:10.221872 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-35092cd1-d8ef-46fc-a129-efa00b547f88 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734" status: 200 len: 1271 microversion: 2.1 time: 0.169030 Aug 04 16:53:10.222786 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1683/3419] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:10 2022] GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734 => generated 1271 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:53:10.298753 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5293af96-8333-474a-9c36-2c7b43ae20cb tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:10.314254 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5293af96-8333-474a-9c36-2c7b43ae20cb tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de" status: 200 len: 1325 microversion: 2.1 time: 0.532325 Aug 04 16:53:10.315490 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1737/3420] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:09 2022] GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de => generated 1325 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:10.843500 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5bd3cfe3-16db-4bd8-82a9-eb0ba1dc7aad tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:10.844740 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5bd3cfe3-16db-4bd8-82a9-eb0ba1dc7aad tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] [instance: b812d7ac-838e-4c92-a359-d237647925f9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:10.862673 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-634ef8b3-b249-4504-a4d3-9a670197ff59 req-2c4faf6b-8f07-4695-b1a0-341bb5457cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b812d7ac-838e-4c92-a359-d237647925f9", "name": "network-vif-plugged", "status": "completed", "tag": "cd23c7a2-7fda-4065-a1f9-c3a7e4f2526c"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:53:10.870745 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5bd3cfe3-16db-4bd8-82a9-eb0ba1dc7aad tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:10.871567 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5bd3cfe3-16db-4bd8-82a9-eb0ba1dc7aad tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:10.875537 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5bd3cfe3-16db-4bd8-82a9-eb0ba1dc7aad tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:10.876171 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5bd3cfe3-16db-4bd8-82a9-eb0ba1dc7aad tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:10.896945 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-634ef8b3-b249-4504-a4d3-9a670197ff59 req-2c4faf6b-8f07-4695-b1a0-341bb5457cb1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:10.897799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-634ef8b3-b249-4504-a4d3-9a670197ff59 req-2c4faf6b-8f07-4695-b1a0-341bb5457cb1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:10.948970 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-634ef8b3-b249-4504-a4d3-9a670197ff59 req-2c4faf6b-8f07-4695-b1a0-341bb5457cb1 service nova] Creating event network-vif-plugged:cd23c7a2-7fda-4065-a1f9-c3a7e4f2526c for instance b812d7ac-838e-4c92-a359-d237647925f9 on n-h2-846466-12 Aug 04 16:53:10.969007 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-634ef8b3-b249-4504-a4d3-9a670197ff59 req-2c4faf6b-8f07-4695-b1a0-341bb5457cb1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104451 Aug 04 16:53:10.969756 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1738/3421] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:53:11.250157 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9900cd01-3fb9-4e46-832d-8708e6a36b03 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:11.250990 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9900cd01-3fb9-4e46-832d-8708e6a36b03 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] [instance: 5ecc38b6-e6df-4a00-9757-708aac3a8734] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:11.269303 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9900cd01-3fb9-4e46-832d-8708e6a36b03 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:11.271045 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9900cd01-3fb9-4e46-832d-8708e6a36b03 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:11.273146 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9900cd01-3fb9-4e46-832d-8708e6a36b03 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:11.276669 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9900cd01-3fb9-4e46-832d-8708e6a36b03 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:11.479085 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=8 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:53:11.717920 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5bd3cfe3-16db-4bd8-82a9-eb0ba1dc7aad tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3786fedbfc6043f8a0dacb3bf8ee82e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03c7dc970224dedb4778b16a402f1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:11.736349 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5bd3cfe3-16db-4bd8-82a9-eb0ba1dc7aad tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] 10.222.0.23 "GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9" status: 200 len: 1317 microversion: 2.1 time: 0.895744 Aug 04 16:53:11.737797 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1684/3422] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:10 2022] GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9 => generated 1317 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:11.755091 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ee69e01c-6934-4a86-96d8-3031caf2746c tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:11.757449 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ee69e01c-6934-4a86-96d8-3031caf2746c tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 56e8faca-3b86-4598-8e8c-0f511745e8de] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:11.774269 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ee69e01c-6934-4a86-96d8-3031caf2746c tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:11.775042 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ee69e01c-6934-4a86-96d8-3031caf2746c tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:11.776985 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ee69e01c-6934-4a86-96d8-3031caf2746c tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:11.778527 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ee69e01c-6934-4a86-96d8-3031caf2746c tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:12.049427 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9900cd01-3fb9-4e46-832d-8708e6a36b03 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e77ffd9d2840a3bde26a88069ee338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e38cf8e78184212a1680df483885d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:12.078046 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9900cd01-3fb9-4e46-832d-8708e6a36b03 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734" status: 200 len: 1313 microversion: 2.1 time: 0.832981 Aug 04 16:53:12.102764 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1739/3423] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:11 2022] GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734 => generated 1313 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:53:12.455034 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ee69e01c-6934-4a86-96d8-3031caf2746c tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:12.472719 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ee69e01c-6934-4a86-96d8-3031caf2746c tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de" status: 200 len: 1325 microversion: 2.1 time: 0.733404 Aug 04 16:53:12.480081 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1685/3424] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:11 2022] GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de => generated 1325 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:12.763242 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8587c969-6f91-47fa-8a11-690a26da46c3 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:12.764011 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8587c969-6f91-47fa-8a11-690a26da46c3 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] [instance: b812d7ac-838e-4c92-a359-d237647925f9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:12.783676 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:53:12.826842 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8587c969-6f91-47fa-8a11-690a26da46c3 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:12.835996 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8587c969-6f91-47fa-8a11-690a26da46c3 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:12.838289 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8587c969-6f91-47fa-8a11-690a26da46c3 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:12.844886 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8587c969-6f91-47fa-8a11-690a26da46c3 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:13.109644 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-58c1399e-5b86-49b9-b48f-9ec5fb5b8172 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:13.110719 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-58c1399e-5b86-49b9-b48f-9ec5fb5b8172 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] [instance: 5ecc38b6-e6df-4a00-9757-708aac3a8734] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:13.124087 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58c1399e-5b86-49b9-b48f-9ec5fb5b8172 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:13.141190 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58c1399e-5b86-49b9-b48f-9ec5fb5b8172 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:13.143265 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58c1399e-5b86-49b9-b48f-9ec5fb5b8172 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:13.147873 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58c1399e-5b86-49b9-b48f-9ec5fb5b8172 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:13.871316 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8587c969-6f91-47fa-8a11-690a26da46c3 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3786fedbfc6043f8a0dacb3bf8ee82e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03c7dc970224dedb4778b16a402f1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:13.883485 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8587c969-6f91-47fa-8a11-690a26da46c3 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] 10.222.0.23 "GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9" status: 200 len: 1317 microversion: 2.1 time: 1.124930 Aug 04 16:53:13.884952 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1740/3425] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:12 2022] GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9 => generated 1317 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:13.892144 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2549175c-4f8d-4dc0-ac9d-940ea69babac tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:13.893552 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2549175c-4f8d-4dc0-ac9d-940ea69babac tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 56e8faca-3b86-4598-8e8c-0f511745e8de] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:13.907354 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2549175c-4f8d-4dc0-ac9d-940ea69babac tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:13.913162 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2549175c-4f8d-4dc0-ac9d-940ea69babac tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:13.915931 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2549175c-4f8d-4dc0-ac9d-940ea69babac tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:13.917735 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2549175c-4f8d-4dc0-ac9d-940ea69babac tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:13.920605 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-58c1399e-5b86-49b9-b48f-9ec5fb5b8172 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e77ffd9d2840a3bde26a88069ee338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e38cf8e78184212a1680df483885d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:13.939992 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-58c1399e-5b86-49b9-b48f-9ec5fb5b8172 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734" status: 200 len: 1313 microversion: 2.1 time: 0.836020 Aug 04 16:53:13.955501 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1686/3426] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:13 2022] GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734 => generated 1313 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:14.167125 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-efb4c08f-b56a-4138-97c0-5f337998c810 req-6166dea7-967f-4c6e-9dba-1e30f21d1a20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ecc38b6-e6df-4a00-9757-708aac3a8734", "tag": "e8b0a8d8-b4bf-4c61-92a8-de771eb93949"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:53:14.186315 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-efb4c08f-b56a-4138-97c0-5f337998c810 req-6166dea7-967f-4c6e-9dba-1e30f21d1a20 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:14.187063 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-efb4c08f-b56a-4138-97c0-5f337998c810 req-6166dea7-967f-4c6e-9dba-1e30f21d1a20 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:14.201110 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-efb4c08f-b56a-4138-97c0-5f337998c810 req-6166dea7-967f-4c6e-9dba-1e30f21d1a20 service nova] Creating event network-changed:e8b0a8d8-b4bf-4c61-92a8-de771eb93949 for instance 5ecc38b6-e6df-4a00-9757-708aac3a8734 on n-h1-846466-12 Aug 04 16:53:14.207202 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-efb4c08f-b56a-4138-97c0-5f337998c810 req-6166dea7-967f-4c6e-9dba-1e30f21d1a20 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.249977 Aug 04 16:53:14.208294 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1687/3427] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:53:14.577603 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2549175c-4f8d-4dc0-ac9d-940ea69babac tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:14.599339 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2549175c-4f8d-4dc0-ac9d-940ea69babac tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de" status: 200 len: 1325 microversion: 2.1 time: 0.711421 Aug 04 16:53:14.600956 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1741/3428] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:13 2022] GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de => generated 1325 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:14.908908 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cedbdb0e-e24b-48f3-ba94-efdca49f8e75 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:14.909698 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cedbdb0e-e24b-48f3-ba94-efdca49f8e75 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] [instance: b812d7ac-838e-4c92-a359-d237647925f9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:14.929495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cedbdb0e-e24b-48f3-ba94-efdca49f8e75 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:14.930095 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cedbdb0e-e24b-48f3-ba94-efdca49f8e75 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:14.930697 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cedbdb0e-e24b-48f3-ba94-efdca49f8e75 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:14.931118 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cedbdb0e-e24b-48f3-ba94-efdca49f8e75 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:14.958177 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-c7a8918f-33f9-48f6-a1f1-1e7981d03862 req-f0c30253-256c-4745-ace7-fac03bffae16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56e8faca-3b86-4598-8e8c-0f511745e8de", "name": "network-vif-plugged", "status": "completed", "tag": "2435ab94-2ebc-4e63-aaec-1b9480927119"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:53:14.981855 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-c7a8918f-33f9-48f6-a1f1-1e7981d03862 req-f0c30253-256c-4745-ace7-fac03bffae16 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:14.982289 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-c7a8918f-33f9-48f6-a1f1-1e7981d03862 req-f0c30253-256c-4745-ace7-fac03bffae16 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:15.027802 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-c7a8918f-33f9-48f6-a1f1-1e7981d03862 req-f0c30253-256c-4745-ace7-fac03bffae16 service nova] Creating event network-vif-plugged:2435ab94-2ebc-4e63-aaec-1b9480927119 for instance 56e8faca-3b86-4598-8e8c-0f511745e8de on n-h2-846466-12 Aug 04 16:53:15.044835 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-c7a8918f-33f9-48f6-a1f1-1e7981d03862 req-f0c30253-256c-4745-ace7-fac03bffae16 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089595 Aug 04 16:53:15.045546 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1742/3429] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:53:15.071635 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-31d14c17-d4a6-45ee-b234-7399b8b052c5 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:15.078518 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-31d14c17-d4a6-45ee-b234-7399b8b052c5 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] [instance: 5ecc38b6-e6df-4a00-9757-708aac3a8734] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:15.082955 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:53:15.096130 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-31d14c17-d4a6-45ee-b234-7399b8b052c5 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:15.096702 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-31d14c17-d4a6-45ee-b234-7399b8b052c5 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:15.097663 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-31d14c17-d4a6-45ee-b234-7399b8b052c5 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:15.098793 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-31d14c17-d4a6-45ee-b234-7399b8b052c5 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:15.695434 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cedbdb0e-e24b-48f3-ba94-efdca49f8e75 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3786fedbfc6043f8a0dacb3bf8ee82e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03c7dc970224dedb4778b16a402f1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:15.730961 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cedbdb0e-e24b-48f3-ba94-efdca49f8e75 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] 10.222.0.23 "GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9" status: 200 len: 1504 microversion: 2.1 time: 0.826356 Aug 04 16:53:15.749897 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-31d14c17-d4a6-45ee-b234-7399b8b052c5 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e77ffd9d2840a3bde26a88069ee338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e38cf8e78184212a1680df483885d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:15.755328 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1688/3430] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:14 2022] GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9 => generated 1504 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:15.767985 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-31d14c17-d4a6-45ee-b234-7399b8b052c5 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734" status: 200 len: 1313 microversion: 2.1 time: 0.716943 Aug 04 16:53:15.769797 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b6354c7e-8cb9-4f17-851f-02e48a2d30ab tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:15.771102 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1743/3431] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:15 2022] GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734 => generated 1313 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:15.782883 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b6354c7e-8cb9-4f17-851f-02e48a2d30ab tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 56e8faca-3b86-4598-8e8c-0f511745e8de] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:15.785184 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c89e13ca-9813-427a-a1ec-ea6469145903 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:15.788326 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c89e13ca-9813-427a-a1ec-ea6469145903 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] [instance: b812d7ac-838e-4c92-a359-d237647925f9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:15.798521 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b6354c7e-8cb9-4f17-851f-02e48a2d30ab tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:15.800550 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b6354c7e-8cb9-4f17-851f-02e48a2d30ab tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:15.801806 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b6354c7e-8cb9-4f17-851f-02e48a2d30ab tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:15.807088 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c89e13ca-9813-427a-a1ec-ea6469145903 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:15.809185 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c89e13ca-9813-427a-a1ec-ea6469145903 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:15.813079 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c89e13ca-9813-427a-a1ec-ea6469145903 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:15.814488 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c89e13ca-9813-427a-a1ec-ea6469145903 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:15.821750 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b6354c7e-8cb9-4f17-851f-02e48a2d30ab tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:15.939863 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c89e13ca-9813-427a-a1ec-ea6469145903 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '3786fedbfc6043f8a0dacb3bf8ee82e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03c7dc970224dedb4778b16a402f1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:15.942164 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c89e13ca-9813-427a-a1ec-ea6469145903 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] 10.222.0.23 "GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9/os-instance-actions/req-be648441-a74b-420d-9fdd-00a2d9d26fa4" status: 200 len: 313 microversion: 2.1 time: 0.168324 Aug 04 16:53:15.944217 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1744/3432] 10.222.0.23 () {58 vars in 1419 bytes} [Thu Aug 4 16:53:15 2022] GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9/os-instance-actions/req-be648441-a74b-420d-9fdd-00a2d9d26fa4 => generated 313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:53:15.972823 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-72ffd0c3-ef28-4743-a11d-106242f37a9b tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:53:15.979753 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-72ffd0c3-ef28-4743-a11d-106242f37a9b tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] [instance: b812d7ac-838e-4c92-a359-d237647925f9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:15.992703 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-72ffd0c3-ef28-4743-a11d-106242f37a9b tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:16.000423 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-72ffd0c3-ef28-4743-a11d-106242f37a9b tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:16.001806 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-72ffd0c3-ef28-4743-a11d-106242f37a9b tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:16.002611 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-72ffd0c3-ef28-4743-a11d-106242f37a9b tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:16.182340 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-72ffd0c3-ef28-4743-a11d-106242f37a9b tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] 10.222.0.23 "POST /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9/action" status: 202 len: 0 microversion: 2.1 time: 0.225964 Aug 04 16:53:16.184377 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1745/3433] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:53:15 2022] POST /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:53:16.209718 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1e7b0825-4afe-4f5e-b09c-be6aacf12dda tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:16.211254 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1e7b0825-4afe-4f5e-b09c-be6aacf12dda tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] [instance: b812d7ac-838e-4c92-a359-d237647925f9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:16.220386 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1e7b0825-4afe-4f5e-b09c-be6aacf12dda tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:16.221596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1e7b0825-4afe-4f5e-b09c-be6aacf12dda tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:16.222798 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1e7b0825-4afe-4f5e-b09c-be6aacf12dda tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:16.223711 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1e7b0825-4afe-4f5e-b09c-be6aacf12dda tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:16.342702 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=55 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:53:17.040657 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b6354c7e-8cb9-4f17-851f-02e48a2d30ab tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:17.059902 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b6354c7e-8cb9-4f17-851f-02e48a2d30ab tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de" status: 200 len: 1325 microversion: 2.1 time: 1.290843 Aug 04 16:53:17.064539 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1689/3434] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:15 2022] GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de => generated 1325 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:17.080914 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e48ae2ac-d267-44f4-923a-208e9aecb94e tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:17.081985 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e48ae2ac-d267-44f4-923a-208e9aecb94e tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] [instance: 5ecc38b6-e6df-4a00-9757-708aac3a8734] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:17.096870 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e48ae2ac-d267-44f4-923a-208e9aecb94e tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:17.097125 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1e7b0825-4afe-4f5e-b09c-be6aacf12dda tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3786fedbfc6043f8a0dacb3bf8ee82e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03c7dc970224dedb4778b16a402f1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:17.105676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e48ae2ac-d267-44f4-923a-208e9aecb94e tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:17.106894 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e48ae2ac-d267-44f4-923a-208e9aecb94e tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:17.107560 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e48ae2ac-d267-44f4-923a-208e9aecb94e tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:17.109827 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1e7b0825-4afe-4f5e-b09c-be6aacf12dda tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] 10.222.0.23 "GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9" status: 200 len: 1506 microversion: 2.1 time: 0.910584 Aug 04 16:53:17.121532 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1746/3435] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:16 2022] GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9 => generated 1506 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:17.405138 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ec877482-eca9-4385-b147-3f81b54ebf2f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1694948234", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "3c6327bd-43b3-457e-8c65-d5b7bef7f3d9"}, {"uuid": "eb2bee1b-709f-4700-a3d5-7d413ef167f8"}, {"uuid": "3c6327bd-43b3-457e-8c65-d5b7bef7f3d9"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:53:17.498503 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-ec877482-eca9-4385-b147-3f81b54ebf2f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] validate_networks() for [('3c6327bd-43b3-457e-8c65-d5b7bef7f3d9', None, None, None, None, None), ('eb2bee1b-709f-4700-a3d5-7d413ef167f8', None, None, None, None, None), ('3c6327bd-43b3-457e-8c65-d5b7bef7f3d9', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:53:18.404330 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e48ae2ac-d267-44f4-923a-208e9aecb94e tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e77ffd9d2840a3bde26a88069ee338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e38cf8e78184212a1680df483885d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:18.417272 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e48ae2ac-d267-44f4-923a-208e9aecb94e tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734" status: 200 len: 1313 microversion: 2.1 time: 1.350350 Aug 04 16:53:18.419459 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1690/3436] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:17 2022] GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734 => generated 1313 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:18.444542 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-53b67a37-c6b4-45b6-86c9-dafdffb5d5ae tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:18.446427 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-53b67a37-c6b4-45b6-86c9-dafdffb5d5ae tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 56e8faca-3b86-4598-8e8c-0f511745e8de] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:18.468281 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-53b67a37-c6b4-45b6-86c9-dafdffb5d5ae tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:18.469168 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-53b67a37-c6b4-45b6-86c9-dafdffb5d5ae tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:18.471980 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-53b67a37-c6b4-45b6-86c9-dafdffb5d5ae tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:18.472890 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-53b67a37-c6b4-45b6-86c9-dafdffb5d5ae tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:19.596937 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-53b67a37-c6b4-45b6-86c9-dafdffb5d5ae tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:19.617353 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-53b67a37-c6b4-45b6-86c9-dafdffb5d5ae tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de" status: 200 len: 1522 microversion: 2.1 time: 1.194643 Aug 04 16:53:19.618801 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1691/3437] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:18 2022] GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de => generated 1522 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:19.648364 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e967cc67-6b7e-4b7a-b694-0c005c05cda6 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:19.649621 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e967cc67-6b7e-4b7a-b694-0c005c05cda6 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] [instance: b812d7ac-838e-4c92-a359-d237647925f9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:19.662609 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e967cc67-6b7e-4b7a-b694-0c005c05cda6 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:19.663389 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e967cc67-6b7e-4b7a-b694-0c005c05cda6 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:19.664447 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e967cc67-6b7e-4b7a-b694-0c005c05cda6 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:19.667784 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e967cc67-6b7e-4b7a-b694-0c005c05cda6 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:20.414731 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e967cc67-6b7e-4b7a-b694-0c005c05cda6 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3786fedbfc6043f8a0dacb3bf8ee82e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03c7dc970224dedb4778b16a402f1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:20.425295 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e967cc67-6b7e-4b7a-b694-0c005c05cda6 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] 10.222.0.23 "GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9" status: 200 len: 1506 microversion: 2.1 time: 0.803659 Aug 04 16:53:20.440885 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1692/3438] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:19 2022] GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9 => generated 1506 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:20.452576 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5e646be5-7250-44d3-b506-32644e28a90a tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:20.457619 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5e646be5-7250-44d3-b506-32644e28a90a tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] [instance: 5ecc38b6-e6df-4a00-9757-708aac3a8734] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:20.465420 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e646be5-7250-44d3-b506-32644e28a90a tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:20.466163 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e646be5-7250-44d3-b506-32644e28a90a tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:20.467197 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e646be5-7250-44d3-b506-32644e28a90a tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:20.467637 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e646be5-7250-44d3-b506-32644e28a90a tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:20.993547 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5e646be5-7250-44d3-b506-32644e28a90a tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e77ffd9d2840a3bde26a88069ee338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e38cf8e78184212a1680df483885d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:21.001227 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5e646be5-7250-44d3-b506-32644e28a90a tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734" status: 200 len: 1313 microversion: 2.1 time: 0.558783 Aug 04 16:53:21.002369 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1693/3439] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:20 2022] GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734 => generated 1313 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:21.023989 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3bdedd20-cfd3-4206-a85f-4e4d71b774d4 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:21.026614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3bdedd20-cfd3-4206-a85f-4e4d71b774d4 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 56e8faca-3b86-4598-8e8c-0f511745e8de] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:21.044618 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3bdedd20-cfd3-4206-a85f-4e4d71b774d4 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:21.045558 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3bdedd20-cfd3-4206-a85f-4e4d71b774d4 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:21.049958 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3bdedd20-cfd3-4206-a85f-4e4d71b774d4 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:21.050765 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3bdedd20-cfd3-4206-a85f-4e4d71b774d4 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:21.153735 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3bdedd20-cfd3-4206-a85f-4e4d71b774d4 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 56e8faca-3b86-4598-8e8c-0f511745e8de] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:53:21.408684 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3bdedd20-cfd3-4206-a85f-4e4d71b774d4 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "DELETE /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de" status: 204 len: 0 microversion: 2.1 time: 0.402575 Aug 04 16:53:21.410338 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1694/3440] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:53:21 2022] DELETE /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:53:21.420749 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bc666d79-2a77-4fae-a549-df13407cf479 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:21.422741 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bc666d79-2a77-4fae-a549-df13407cf479 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:21.438366 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bc666d79-2a77-4fae-a549-df13407cf479 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:21.439092 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bc666d79-2a77-4fae-a549-df13407cf479 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:21.440311 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bc666d79-2a77-4fae-a549-df13407cf479 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:21.443379 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bc666d79-2a77-4fae-a549-df13407cf479 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:21.911144 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-ec877482-eca9-4385-b147-3f81b54ebf2f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:53:21.911144 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-ec877482-eca9-4385-b147-3f81b54ebf2f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:53:21.911144 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-ec877482-eca9-4385-b147-3f81b54ebf2f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:53:21.916346 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-ec877482-eca9-4385-b147-3f81b54ebf2f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:53:21.916783 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-ec877482-eca9-4385-b147-3f81b54ebf2f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:53:21.926924 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bc666d79-2a77-4fae-a549-df13407cf479 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:21.952454 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bc666d79-2a77-4fae-a549-df13407cf479 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:21.954472 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bc666d79-2a77-4fae-a549-df13407cf479 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:21.956112 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bc666d79-2a77-4fae-a549-df13407cf479 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 2949 microversion: 2.42 time: 0.542604 Aug 04 16:53:21.957327 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1695/3441] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:53:21 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 2949 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:53:21.964223 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-557276e3-9ca3-47ce-9f21-e85da4f371a0 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:21.964831 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-557276e3-9ca3-47ce-9f21-e85da4f371a0 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 56e8faca-3b86-4598-8e8c-0f511745e8de] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:21.973152 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-557276e3-9ca3-47ce-9f21-e85da4f371a0 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:21.973858 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-557276e3-9ca3-47ce-9f21-e85da4f371a0 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:21.974949 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-557276e3-9ca3-47ce-9f21-e85da4f371a0 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:21.976461 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-557276e3-9ca3-47ce-9f21-e85da4f371a0 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:21.994640 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec877482-eca9-4385-b147-3f81b54ebf2f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:21.998731 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec877482-eca9-4385-b147-3f81b54ebf2f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:21.999953 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec877482-eca9-4385-b147-3f81b54ebf2f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:22.006254 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec877482-eca9-4385-b147-3f81b54ebf2f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:22.070726 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-ec877482-eca9-4385-b147-3f81b54ebf2f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Getting quotas for project dc0ad871e21842a19511864aa9cd26c6. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:53:22.082038 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-ec877482-eca9-4385-b147-3f81b54ebf2f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Getting quotas for user 33f7d4658f514bda8e64382fd5e42bf1 and project dc0ad871e21842a19511864aa9cd26c6. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:53:22.120813 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ec877482-eca9-4385-b147-3f81b54ebf2f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:53:22.123785 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ec877482-eca9-4385-b147-3f81b54ebf2f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:53:22.207511 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ec877482-eca9-4385-b147-3f81b54ebf2f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.810965 Aug 04 16:53:22.208944 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1747/3442] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:53:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 4814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:53:22.216447 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-317d1c37-bd3e-4b29-90db-4fa429f9be1e tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:22.217475 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-317d1c37-bd3e-4b29-90db-4fa429f9be1e tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] [instance: b812d7ac-838e-4c92-a359-d237647925f9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:22.224521 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-317d1c37-bd3e-4b29-90db-4fa429f9be1e tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:22.225909 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-317d1c37-bd3e-4b29-90db-4fa429f9be1e tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:22.226927 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-317d1c37-bd3e-4b29-90db-4fa429f9be1e tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:22.227613 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-317d1c37-bd3e-4b29-90db-4fa429f9be1e tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:22.429188 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-557276e3-9ca3-47ce-9f21-e85da4f371a0 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:22.439007 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-557276e3-9ca3-47ce-9f21-e85da4f371a0 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de" status: 200 len: 1528 microversion: 2.1 time: 0.480355 Aug 04 16:53:22.452833 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1696/3443] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:21 2022] GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de => generated 1528 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:22.460571 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-69aa24a3-af88-4de4-bffb-f16ca711c311 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:22.461069 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-69aa24a3-af88-4de4-bffb-f16ca711c311 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:22.470930 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-69aa24a3-af88-4de4-bffb-f16ca711c311 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:22.471580 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-69aa24a3-af88-4de4-bffb-f16ca711c311 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:22.473218 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-69aa24a3-af88-4de4-bffb-f16ca711c311 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:22.480876 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-69aa24a3-af88-4de4-bffb-f16ca711c311 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:22.504372 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:53:22.961574 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-69aa24a3-af88-4de4-bffb-f16ca711c311 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.507427 Aug 04 16:53:22.972188 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1697/3444] 10.222.0.23 () {60 vars in 1316 bytes} [Thu Aug 4 16:53:22 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610/os-interface => generated 1830 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:53:22.980454 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e3d4e01f-e37e-4338-a805-ac6929eb103f tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:22.981108 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e3d4e01f-e37e-4338-a805-ac6929eb103f tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] [instance: 5ecc38b6-e6df-4a00-9757-708aac3a8734] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:22.997086 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e3d4e01f-e37e-4338-a805-ac6929eb103f tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:23.001659 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e3d4e01f-e37e-4338-a805-ac6929eb103f tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:23.002572 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e3d4e01f-e37e-4338-a805-ac6929eb103f tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:23.003363 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e3d4e01f-e37e-4338-a805-ac6929eb103f tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:23.113761 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-317d1c37-bd3e-4b29-90db-4fa429f9be1e tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3786fedbfc6043f8a0dacb3bf8ee82e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03c7dc970224dedb4778b16a402f1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:23.137017 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-317d1c37-bd3e-4b29-90db-4fa429f9be1e tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] 10.222.0.23 "GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9" status: 200 len: 1506 microversion: 2.1 time: 0.917875 Aug 04 16:53:23.137778 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1748/3445] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:22 2022] GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9 => generated 1506 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:23.162710 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bf447490-7e3b-4a85-ae46-f937050b03bb tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:23.167724 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bf447490-7e3b-4a85-ae46-f937050b03bb tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:23.198601 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf447490-7e3b-4a85-ae46-f937050b03bb tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:23.202728 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf447490-7e3b-4a85-ae46-f937050b03bb tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:23.206029 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf447490-7e3b-4a85-ae46-f937050b03bb tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:23.209025 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf447490-7e3b-4a85-ae46-f937050b03bb tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:23.710333 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bf447490-7e3b-4a85-ae46-f937050b03bb tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:23.732302 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bf447490-7e3b-4a85-ae46-f937050b03bb tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 200 len: 1217 microversion: 2.1 time: 0.589004 Aug 04 16:53:23.732953 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1749/3446] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:23 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 1217 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:23.744286 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-5578b575-f98d-4853-8741-c712ade271a7 req-6521ef5a-357b-4de7-b2fa-58fd44df2151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ecc38b6-e6df-4a00-9757-708aac3a8734", "name": "network-vif-plugged", "status": "completed", "tag": "e8b0a8d8-b4bf-4c61-92a8-de771eb93949"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:53:23.775528 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-5578b575-f98d-4853-8741-c712ade271a7 req-6521ef5a-357b-4de7-b2fa-58fd44df2151 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:23.775982 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-5578b575-f98d-4853-8741-c712ade271a7 req-6521ef5a-357b-4de7-b2fa-58fd44df2151 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:23.803894 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-5578b575-f98d-4853-8741-c712ade271a7 req-6521ef5a-357b-4de7-b2fa-58fd44df2151 service nova] Creating event network-vif-plugged:e8b0a8d8-b4bf-4c61-92a8-de771eb93949 for instance 5ecc38b6-e6df-4a00-9757-708aac3a8734 on n-h1-846466-12 Aug 04 16:53:23.820139 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-5578b575-f98d-4853-8741-c712ade271a7 req-6521ef5a-357b-4de7-b2fa-58fd44df2151 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083576 Aug 04 16:53:23.820800 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1750/3447] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:53:23.840307 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5292e5e5-8be7-4a32-af40-ddc333d4b765 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:23.842100 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5292e5e5-8be7-4a32-af40-ddc333d4b765 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 56e8faca-3b86-4598-8e8c-0f511745e8de] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:23.868837 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5292e5e5-8be7-4a32-af40-ddc333d4b765 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:23.874461 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5292e5e5-8be7-4a32-af40-ddc333d4b765 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:23.877853 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5292e5e5-8be7-4a32-af40-ddc333d4b765 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:23.878527 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5292e5e5-8be7-4a32-af40-ddc333d4b765 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:23.951490 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e3d4e01f-e37e-4338-a805-ac6929eb103f tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e77ffd9d2840a3bde26a88069ee338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e38cf8e78184212a1680df483885d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:23.960387 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e3d4e01f-e37e-4338-a805-ac6929eb103f tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734" status: 200 len: 1313 microversion: 2.1 time: 0.987098 Aug 04 16:53:23.969837 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1698/3448] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:22 2022] GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734 => generated 1313 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:24.164375 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-acf5d89a-3c45-46a8-87a7-96976c3f944a tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:24.165105 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-acf5d89a-3c45-46a8-87a7-96976c3f944a tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] [instance: b812d7ac-838e-4c92-a359-d237647925f9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:24.176495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-acf5d89a-3c45-46a8-87a7-96976c3f944a tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:24.180860 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-acf5d89a-3c45-46a8-87a7-96976c3f944a tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:24.181999 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-acf5d89a-3c45-46a8-87a7-96976c3f944a tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:24.182526 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-acf5d89a-3c45-46a8-87a7-96976c3f944a tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:25.255298 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-acf5d89a-3c45-46a8-87a7-96976c3f944a tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3786fedbfc6043f8a0dacb3bf8ee82e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03c7dc970224dedb4778b16a402f1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:25.271017 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-acf5d89a-3c45-46a8-87a7-96976c3f944a tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] 10.222.0.23 "GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9" status: 200 len: 1511 microversion: 2.1 time: 1.109839 Aug 04 16:53:25.271897 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1699/3449] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:24 2022] GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9 => generated 1511 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:53:25.284096 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b76fb3f0-c3f1-4fcb-934e-0a23d3642db0 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:25.287029 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b76fb3f0-c3f1-4fcb-934e-0a23d3642db0 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:25.318618 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b76fb3f0-c3f1-4fcb-934e-0a23d3642db0 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:25.322150 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b76fb3f0-c3f1-4fcb-934e-0a23d3642db0 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:25.323244 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b76fb3f0-c3f1-4fcb-934e-0a23d3642db0 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:25.327524 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b76fb3f0-c3f1-4fcb-934e-0a23d3642db0 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:25.352697 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5292e5e5-8be7-4a32-af40-ddc333d4b765 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ace5409bc54123aad5e1bc071cc3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9de718bdfb4d6dbf63c336dfde8d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:25.369895 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5292e5e5-8be7-4a32-af40-ddc333d4b765 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de" status: 200 len: 1528 microversion: 2.1 time: 1.547336 Aug 04 16:53:25.372271 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1751/3450] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:23 2022] GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de => generated 1528 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:25.384929 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1c703390-f309-4989-8c9b-b27a837e96a9 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:25.386319 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1c703390-f309-4989-8c9b-b27a837e96a9 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] [instance: 5ecc38b6-e6df-4a00-9757-708aac3a8734] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:25.402392 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1c703390-f309-4989-8c9b-b27a837e96a9 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:25.405117 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1c703390-f309-4989-8c9b-b27a837e96a9 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:25.410722 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1c703390-f309-4989-8c9b-b27a837e96a9 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:25.411419 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1c703390-f309-4989-8c9b-b27a837e96a9 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:25.546382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b76fb3f0-c3f1-4fcb-934e-0a23d3642db0 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:25.554961 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b76fb3f0-c3f1-4fcb-934e-0a23d3642db0 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 200 len: 1271 microversion: 2.1 time: 0.279752 Aug 04 16:53:25.556058 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1700/3451] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:25 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 1271 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:25.572630 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-435b321f-2e04-4f65-b2c4-0e66be18fa1f req-586cf181-5935-4517-bac8-c46cc88d6a77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56e8faca-3b86-4598-8e8c-0f511745e8de", "name": "network-vif-deleted", "tag": "2435ab94-2ebc-4e63-aaec-1b9480927119"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:53:25.597158 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-435b321f-2e04-4f65-b2c4-0e66be18fa1f req-586cf181-5935-4517-bac8-c46cc88d6a77 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:25.598023 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-435b321f-2e04-4f65-b2c4-0e66be18fa1f req-586cf181-5935-4517-bac8-c46cc88d6a77 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:25.626008 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-435b321f-2e04-4f65-b2c4-0e66be18fa1f req-586cf181-5935-4517-bac8-c46cc88d6a77 service nova] Creating event network-vif-deleted:2435ab94-2ebc-4e63-aaec-1b9480927119 for instance 56e8faca-3b86-4598-8e8c-0f511745e8de on n-h2-846466-12 Aug 04 16:53:25.635093 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-435b321f-2e04-4f65-b2c4-0e66be18fa1f req-586cf181-5935-4517-bac8-c46cc88d6a77 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077483 Aug 04 16:53:25.636427 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1701/3452] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:53:26.295987 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-15e70815-5032-44a4-a060-cb08be68ac66 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:26.296710 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-15e70815-5032-44a4-a060-cb08be68ac66 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] [instance: b812d7ac-838e-4c92-a359-d237647925f9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:26.348462 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-15e70815-5032-44a4-a060-cb08be68ac66 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:26.350576 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-15e70815-5032-44a4-a060-cb08be68ac66 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:26.358159 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-15e70815-5032-44a4-a060-cb08be68ac66 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:26.361235 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-15e70815-5032-44a4-a060-cb08be68ac66 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:26.530261 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1c703390-f309-4989-8c9b-b27a837e96a9 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e77ffd9d2840a3bde26a88069ee338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e38cf8e78184212a1680df483885d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:26.541543 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1c703390-f309-4989-8c9b-b27a837e96a9 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734" status: 200 len: 1313 microversion: 2.1 time: 1.166862 Aug 04 16:53:26.543672 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1752/3453] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:25 2022] GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734 => generated 1313 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:26.549433 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-21e22677-ab75-4b2c-a6b4-2d269b02c429 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:26.552979 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-21e22677-ab75-4b2c-a6b4-2d269b02c429 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 56e8faca-3b86-4598-8e8c-0f511745e8de] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:26.562131 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-21e22677-ab75-4b2c-a6b4-2d269b02c429 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:26.562880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-21e22677-ab75-4b2c-a6b4-2d269b02c429 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:26.563680 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-21e22677-ab75-4b2c-a6b4-2d269b02c429 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:26.564121 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-21e22677-ab75-4b2c-a6b4-2d269b02c429 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:26.600487 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-21e22677-ab75-4b2c-a6b4-2d269b02c429 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] HTTP exception thrown: Instance 56e8faca-3b86-4598-8e8c-0f511745e8de could not be found. Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-21e22677-ab75-4b2c-a6b4-2d269b02c429 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Request method failure captured: Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de HTTP/1.1 Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_jtTPBPy4fXdQ0VJrZ7Fc7m71zszwq7ozUwryWnXkb5nfLRGrkK5ga8HzOO0RHGQ_JBzS6OyCZVWsMotLJPEGPUn58SVuz4Z61cosYCdd8YzpWwL0OdtEOtJV7MtqbPH74mZZtuOB-p1arvqTlVKRaIs7USdqyFhUTa2KSBwKWaYTU Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: eb9de718bdfb4d6dbf63c336dfde8d42 Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb9de718bdfb4d6dbf63c336dfde8d42"}]}] Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: eb9de718bdfb4d6dbf63c336dfde8d42 Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ImagesOneServerNegativeTestJSON-1002016988-project Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 50ace5409bc54123aad5e1bc071cc3dd Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988-project Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 56e8faca-3b86-4598-8e8c-0f511745e8de could not be found. Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '56e8faca-3b86-4598-8e8c-0f511745e8de'} Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56e8faca-3b86-4598-8e8c-0f511745e8de could not be found. Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56e8faca-3b86-4598-8e8c-0f511745e8de could not be found. Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:26.606820 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:26.612514 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:26.612514 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:26.612514 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:26.612514 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:26.612514 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:53:26.612514 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:53:26.612514 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56e8faca-3b86-4598-8e8c-0f511745e8de could not be found. Aug 04 16:53:26.612514 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:26.612514 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-21e22677-ab75-4b2c-a6b4-2d269b02c429 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Returning 404 to user: Instance 56e8faca-3b86-4598-8e8c-0f511745e8de could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:53:26.612514 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-21e22677-ab75-4b2c-a6b4-2d269b02c429 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de" status: 404 len: 111 microversion: 2.1 time: 0.063385 Aug 04 16:53:26.616915 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1753/3454] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:26 2022] GET /compute/v2.1/servers/56e8faca-3b86-4598-8e8c-0f511745e8de => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:53:26.628408 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a08d4347-b546-4c39-b160-118767cbb129 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:26.629041 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a08d4347-b546-4c39-b160-118767cbb129 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:26.650719 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a08d4347-b546-4c39-b160-118767cbb129 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:26.651175 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a08d4347-b546-4c39-b160-118767cbb129 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:26.652346 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a08d4347-b546-4c39-b160-118767cbb129 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:26.653131 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a08d4347-b546-4c39-b160-118767cbb129 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:27.003675 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-15e70815-5032-44a4-a060-cb08be68ac66 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3786fedbfc6043f8a0dacb3bf8ee82e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03c7dc970224dedb4778b16a402f1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:27.017908 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-15e70815-5032-44a4-a060-cb08be68ac66 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] 10.222.0.23 "GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9" status: 200 len: 1504 microversion: 2.1 time: 0.729073 Aug 04 16:53:27.029269 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1702/3455] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:26 2022] GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9 => generated 1504 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:53:27.035619 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-feae637d-ce64-48e4-a780-b88cba45c5ba tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '.version_select at 0x7f7e84a305e0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:27.089869 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-feae637d-ce64-48e4-a780-b88cba45c5ba tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] HTTP exception thrown: Image not found. Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-feae637d-ce64-48e4-a780-b88cba45c5ba tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Request method failure captured: Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/images/af4e5e98-361f-4560-b8d2-f81de6fb00f6 HTTP/1.1 Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_jtTPBPy4fXdQ0VJrZ7Fc7m71zszwq7ozUwryWnXkb5nfLRGrkK5ga8HzOO0RHGQ_JBzS6OyCZVWsMotLJPEGPUn58SVuz4Z61cosYCdd8YzpWwL0OdtEOtJV7MtqbPH74mZZtuOB-p1arvqTlVKRaIs7USdqyFhUTa2KSBwKWaYTU Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: eb9de718bdfb4d6dbf63c336dfde8d42 Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb9de718bdfb4d6dbf63c336dfde8d42"}]}] Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: eb9de718bdfb4d6dbf63c336dfde8d42 Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ImagesOneServerNegativeTestJSON-1002016988-project Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 50ace5409bc54123aad5e1bc071cc3dd Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988-project Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: exception: Image not found. Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'af4e5e98-361f-4560-b8d2-f81de6fb00f6'} Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image af4e5e98-361f-4560-b8d2-f81de6fb00f6 to delete Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image af4e5e98-361f-4560-b8d2-f81de6fb00f6 could not be found. Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:27.091971 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:27.096818 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:27.096818 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:27.096818 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:27.096818 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:53:27.096818 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:53:27.096818 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:53:27.096818 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:53:27.096818 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:53:27.096818 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:53:27.096818 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 16:53:27.096818 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 16:53:27.096818 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 16:53:27.096818 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:27.096818 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:27.096818 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:27.096818 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:27.096818 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:27.096818 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:27.096818 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:53:27.096818 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:53:27.096818 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 16:53:27.096818 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:27.096818 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-feae637d-ce64-48e4-a780-b88cba45c5ba tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Returning 404 to user: Image not found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:53:27.096818 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-feae637d-ce64-48e4-a780-b88cba45c5ba tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "DELETE /compute/v2.1/images/af4e5e98-361f-4560-b8d2-f81de6fb00f6" status: 404 len: 62 microversion: 2.1 time: 0.061728 Aug 04 16:53:27.096818 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1703/3456] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:27 2022] DELETE /compute/v2.1/images/af4e5e98-361f-4560-b8d2-f81de6fb00f6 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:53:27.105360 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-117a7017-0107-4f0a-9a85-2fc9236e6936 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Calling method '.version_select at 0x7f7e841be9d0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:27.105945 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-117a7017-0107-4f0a-9a85-2fc9236e6936 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] [instance: b812d7ac-838e-4c92-a359-d237647925f9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:27.106976 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a08d4347-b546-4c39-b160-118767cbb129 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:27.122512 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a08d4347-b546-4c39-b160-118767cbb129 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 200 len: 1271 microversion: 2.1 time: 0.503494 Aug 04 16:53:27.125473 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1754/3457] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:26 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 1271 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:27.130965 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-117a7017-0107-4f0a-9a85-2fc9236e6936 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:27.131741 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-117a7017-0107-4f0a-9a85-2fc9236e6936 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:27.132203 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-117a7017-0107-4f0a-9a85-2fc9236e6936 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:27.132641 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-117a7017-0107-4f0a-9a85-2fc9236e6936 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:27.138087 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b485dcde-4a01-4206-bd4f-89ff688619ff tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:27.140880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b485dcde-4a01-4206-bd4f-89ff688619ff tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:27.183893 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b485dcde-4a01-4206-bd4f-89ff688619ff tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:27.184344 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b485dcde-4a01-4206-bd4f-89ff688619ff tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:27.185148 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b485dcde-4a01-4206-bd4f-89ff688619ff tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:27.185605 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b485dcde-4a01-4206-bd4f-89ff688619ff tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:27.213369 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-117a7017-0107-4f0a-9a85-2fc9236e6936 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] 10.222.0.23 "GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.118362 Aug 04 16:53:27.223798 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1704/3458] 10.222.0.23 () {58 vars in 1296 bytes} [Thu Aug 4 16:53:27 2022] GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9/os-instance-actions => generated 611 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:53:27.232658 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bbc749bb-4b0f-4ba3-a8a0-d3708f83ff91 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:27.233406 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bbc749bb-4b0f-4ba3-a8a0-d3708f83ff91 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] [instance: b812d7ac-838e-4c92-a359-d237647925f9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:27.244291 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-b485dcde-4a01-4206-bd4f-89ff688619ff tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] HTTP exception thrown: Instance 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d could not be found. Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b485dcde-4a01-4206-bd4f-89ff688619ff tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Request method failure captured: Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d HTTP/1.1 Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_jtTPBPy4fXdQ0VJrZ7Fc7m71zszwq7ozUwryWnXkb5nfLRGrkK5ga8HzOO0RHGQ_JBzS6OyCZVWsMotLJPEGPUn58SVuz4Z61cosYCdd8YzpWwL0OdtEOtJV7MtqbPH74mZZtuOB-p1arvqTlVKRaIs7USdqyFhUTa2KSBwKWaYTU Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: eb9de718bdfb4d6dbf63c336dfde8d42 Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb9de718bdfb4d6dbf63c336dfde8d42"}]}] Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: eb9de718bdfb4d6dbf63c336dfde8d42 Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ImagesOneServerNegativeTestJSON-1002016988-project Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 50ace5409bc54123aad5e1bc071cc3dd Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988-project Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d could not be found. Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d'} Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d could not be found. Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:53:27.246419 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:53:27.250882 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d could not be found. Aug 04 16:53:27.250882 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:27.250882 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:27.250882 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:27.250882 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:27.250882 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:27.250882 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:27.250882 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:53:27.250882 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:53:27.250882 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d could not be found. Aug 04 16:53:27.250882 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:27.251670 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bbc749bb-4b0f-4ba3-a8a0-d3708f83ff91 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:27.251670 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bbc749bb-4b0f-4ba3-a8a0-d3708f83ff91 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:27.251670 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bbc749bb-4b0f-4ba3-a8a0-d3708f83ff91 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:27.251670 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bbc749bb-4b0f-4ba3-a8a0-d3708f83ff91 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:27.262241 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b485dcde-4a01-4206-bd4f-89ff688619ff tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Returning 404 to user: Instance 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:53:27.263606 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b485dcde-4a01-4206-bd4f-89ff688619ff tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "DELETE /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d" status: 404 len: 111 microversion: 2.1 time: 0.135250 Aug 04 16:53:27.265167 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1755/3459] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:53:27 2022] DELETE /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:53:27.275975 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-128be415-c98f-457f-b6e3-7c626febb9f8 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:27.277039 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-128be415-c98f-457f-b6e3-7c626febb9f8 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:27.285390 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-128be415-c98f-457f-b6e3-7c626febb9f8 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:27.285853 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-128be415-c98f-457f-b6e3-7c626febb9f8 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:27.287630 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-128be415-c98f-457f-b6e3-7c626febb9f8 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:27.288596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-128be415-c98f-457f-b6e3-7c626febb9f8 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:27.331693 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-128be415-c98f-457f-b6e3-7c626febb9f8 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] HTTP exception thrown: Instance 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d could not be found. Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-128be415-c98f-457f-b6e3-7c626febb9f8 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Request method failure captured: Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d HTTP/1.1 Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_jtTPBPy4fXdQ0VJrZ7Fc7m71zszwq7ozUwryWnXkb5nfLRGrkK5ga8HzOO0RHGQ_JBzS6OyCZVWsMotLJPEGPUn58SVuz4Z61cosYCdd8YzpWwL0OdtEOtJV7MtqbPH74mZZtuOB-p1arvqTlVKRaIs7USdqyFhUTa2KSBwKWaYTU Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: eb9de718bdfb4d6dbf63c336dfde8d42 Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb9de718bdfb4d6dbf63c336dfde8d42"}]}] Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: eb9de718bdfb4d6dbf63c336dfde8d42 Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ImagesOneServerNegativeTestJSON-1002016988-project Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 50ace5409bc54123aad5e1bc071cc3dd Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988-project Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d could not be found. Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d'} Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d could not be found. Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d could not be found. Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:27.337701 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:27.343949 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:27.343949 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:27.343949 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:27.343949 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:27.343949 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:53:27.343949 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:53:27.343949 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d could not be found. Aug 04 16:53:27.343949 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:27.345363 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bbc749bb-4b0f-4ba3-a8a0-d3708f83ff91 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] [instance: b812d7ac-838e-4c92-a359-d237647925f9] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:53:27.348885 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-128be415-c98f-457f-b6e3-7c626febb9f8 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Returning 404 to user: Instance 19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:53:27.348885 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-128be415-c98f-457f-b6e3-7c626febb9f8 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d" status: 404 len: 111 microversion: 2.1 time: 0.077418 Aug 04 16:53:27.349480 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1756/3460] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:27 2022] GET /compute/v2.1/servers/19edd7ce-ab09-40e8-bb4a-d08a49e1ad0d => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:53:27.364242 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0325b377-6121-4fda-9a1e-838ffc3bb5c4 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '.version_select at 0x7f7e845505e0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:27.401060 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0325b377-6121-4fda-9a1e-838ffc3bb5c4 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-18211928" status: 202 len: 0 microversion: 2.1 time: 0.047267 Aug 04 16:53:27.404076 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1757/3461] 10.222.0.23 () {58 vars in 1215 bytes} [Thu Aug 4 16:53:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-18211928 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:53:27.560247 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bbc749bb-4b0f-4ba3-a8a0-d3708f83ff91 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9" status: 204 len: 0 microversion: 2.1 time: 0.331309 Aug 04 16:53:27.561309 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1705/3462] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:53:27 2022] DELETE /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:53:27.565730 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-eba96796-6632-45d2-9dff-f08927a4f7f5 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:27.566392 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-eba96796-6632-45d2-9dff-f08927a4f7f5 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] [instance: 5ecc38b6-e6df-4a00-9757-708aac3a8734] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:27.578579 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eba96796-6632-45d2-9dff-f08927a4f7f5 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:27.579038 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eba96796-6632-45d2-9dff-f08927a4f7f5 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:27.583622 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eba96796-6632-45d2-9dff-f08927a4f7f5 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:27.584113 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eba96796-6632-45d2-9dff-f08927a4f7f5 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:27.587302 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c0736478-3c36-4b09-ae22-b261ddde5d06 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:27.588031 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c0736478-3c36-4b09-ae22-b261ddde5d06 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] [instance: b812d7ac-838e-4c92-a359-d237647925f9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:27.606836 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c0736478-3c36-4b09-ae22-b261ddde5d06 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:27.607285 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c0736478-3c36-4b09-ae22-b261ddde5d06 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:27.608074 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c0736478-3c36-4b09-ae22-b261ddde5d06 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:27.608507 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c0736478-3c36-4b09-ae22-b261ddde5d06 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:27.650512 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:53:28.511510 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c0736478-3c36-4b09-ae22-b261ddde5d06 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3786fedbfc6043f8a0dacb3bf8ee82e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03c7dc970224dedb4778b16a402f1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:28.544677 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c0736478-3c36-4b09-ae22-b261ddde5d06 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] 10.222.0.23 "GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9" status: 200 len: 1510 microversion: 2.1 time: 0.971736 Aug 04 16:53:28.545885 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1706/3463] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:27 2022] GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9 => generated 1510 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:53:28.567109 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-72111d72-4896-481a-acb5-5ae153d42aff tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:28.568221 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-72111d72-4896-481a-acb5-5ae153d42aff tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:28.573696 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-eba96796-6632-45d2-9dff-f08927a4f7f5 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e77ffd9d2840a3bde26a88069ee338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e38cf8e78184212a1680df483885d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:28.585180 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-eba96796-6632-45d2-9dff-f08927a4f7f5 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734" status: 200 len: 1499 microversion: 2.1 time: 1.024899 Aug 04 16:53:28.586389 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1758/3464] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:27 2022] GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734 => generated 1499 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:53:28.624849 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-72111d72-4896-481a-acb5-5ae153d42aff tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:28.625995 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-72111d72-4896-481a-acb5-5ae153d42aff tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:28.626557 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-98b4be19-c188-401d-9916-fac9d8bb4f84 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:28.627880 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-72111d72-4896-481a-acb5-5ae153d42aff tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:28.629186 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-72111d72-4896-481a-acb5-5ae153d42aff tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:28.655775 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.compute.server_groups [None req-98b4be19-c188-401d-9916-fac9d8bb4f84 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Querying cell e056d029-674a-446e-ac9e-5108621d9db2(cell1) for 1 instances {{(pid=126125) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 04 16:53:28.657328 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-98b4be19-c188-401d-9916-fac9d8bb4f84 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:28.657779 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-98b4be19-c188-401d-9916-fac9d8bb4f84 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:28.706448 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-98b4be19-c188-401d-9916-fac9d8bb4f84 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/71c64be4-a913-449b-9dd0-c830a08e09c8" status: 200 len: 221 microversion: 2.1 time: 0.085706 Aug 04 16:53:28.714026 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1759/3465] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Aug 4 16:53:28 2022] GET /compute/v2.1/os-server-groups/71c64be4-a913-449b-9dd0-c830a08e09c8 => generated 221 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:53:28.719439 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-66915a22-4509-486b-8f29-cd5375ff9075 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:28.719944 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-66915a22-4509-486b-8f29-cd5375ff9075 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] [instance: 5ecc38b6-e6df-4a00-9757-708aac3a8734] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:28.728002 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-66915a22-4509-486b-8f29-cd5375ff9075 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:28.728666 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-66915a22-4509-486b-8f29-cd5375ff9075 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:28.733671 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-66915a22-4509-486b-8f29-cd5375ff9075 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:28.734504 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-66915a22-4509-486b-8f29-cd5375ff9075 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:28.790978 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-66915a22-4509-486b-8f29-cd5375ff9075 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] [instance: 5ecc38b6-e6df-4a00-9757-708aac3a8734] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:53:28.963402 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-66915a22-4509-486b-8f29-cd5375ff9075 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734" status: 204 len: 0 microversion: 2.1 time: 0.244770 Aug 04 16:53:28.972363 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1760/3466] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:53:28 2022] DELETE /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:53:28.988240 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6a12bebe-e75c-40d9-ba54-87c1a306e4f8 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:28.994077 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6a12bebe-e75c-40d9-ba54-87c1a306e4f8 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] [instance: 5ecc38b6-e6df-4a00-9757-708aac3a8734] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:29.009259 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a12bebe-e75c-40d9-ba54-87c1a306e4f8 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:29.009740 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a12bebe-e75c-40d9-ba54-87c1a306e4f8 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:29.013948 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a12bebe-e75c-40d9-ba54-87c1a306e4f8 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:29.014713 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a12bebe-e75c-40d9-ba54-87c1a306e4f8 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:29.440707 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-72111d72-4896-481a-acb5-5ae153d42aff tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:29.452142 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-72111d72-4896-481a-acb5-5ae153d42aff tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 200 len: 1313 microversion: 2.1 time: 0.904494 Aug 04 16:53:29.460969 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1707/3467] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:28 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 1313 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:29.500172 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6a12bebe-e75c-40d9-ba54-87c1a306e4f8 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e77ffd9d2840a3bde26a88069ee338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e38cf8e78184212a1680df483885d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:29.512029 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6a12bebe-e75c-40d9-ba54-87c1a306e4f8 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734" status: 200 len: 1505 microversion: 2.1 time: 0.528976 Aug 04 16:53:29.512677 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1761/3468] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:28 2022] GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734 => generated 1505 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:29.567093 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-118f9fd7-3f04-4700-9705-b31e4847bdba tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:29.567975 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-118f9fd7-3f04-4700-9705-b31e4847bdba tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] [instance: b812d7ac-838e-4c92-a359-d237647925f9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:29.581463 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-118f9fd7-3f04-4700-9705-b31e4847bdba tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:29.581965 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-118f9fd7-3f04-4700-9705-b31e4847bdba tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:29.582782 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-118f9fd7-3f04-4700-9705-b31e4847bdba tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:29.583210 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-118f9fd7-3f04-4700-9705-b31e4847bdba tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:30.166890 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-118f9fd7-3f04-4700-9705-b31e4847bdba tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3786fedbfc6043f8a0dacb3bf8ee82e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03c7dc970224dedb4778b16a402f1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:30.174994 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-118f9fd7-3f04-4700-9705-b31e4847bdba tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] 10.222.0.23 "GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9" status: 200 len: 1510 microversion: 2.1 time: 0.612526 Aug 04 16:53:30.190513 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1708/3469] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:29 2022] GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9 => generated 1510 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:30.479971 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-db565ece-eb5d-424d-ad9f-407013b3375b tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:30.480588 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-db565ece-eb5d-424d-ad9f-407013b3375b tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:30.493473 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-db565ece-eb5d-424d-ad9f-407013b3375b tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:30.494417 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-db565ece-eb5d-424d-ad9f-407013b3375b tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:30.497369 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-db565ece-eb5d-424d-ad9f-407013b3375b tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:30.500336 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-db565ece-eb5d-424d-ad9f-407013b3375b tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:30.540376 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b46a8098-d0f8-4b3c-913b-2874f7f797a4 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:30.541172 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b46a8098-d0f8-4b3c-913b-2874f7f797a4 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] [instance: 5ecc38b6-e6df-4a00-9757-708aac3a8734] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:30.558934 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b46a8098-d0f8-4b3c-913b-2874f7f797a4 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:30.559787 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b46a8098-d0f8-4b3c-913b-2874f7f797a4 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:30.560795 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b46a8098-d0f8-4b3c-913b-2874f7f797a4 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:30.561516 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b46a8098-d0f8-4b3c-913b-2874f7f797a4 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:31.776832 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-db565ece-eb5d-424d-ad9f-407013b3375b tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:31.791623 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-db565ece-eb5d-424d-ad9f-407013b3375b tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 200 len: 1313 microversion: 2.1 time: 1.317240 Aug 04 16:53:31.798584 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1762/3470] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:30 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 1313 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:31.807425 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-77f9ae29-2853-406c-9728-b90b3cefebaa req-911e0e0e-0581-4f7f-a678-d0b57d0c1445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b812d7ac-838e-4c92-a359-d237647925f9", "name": "network-vif-deleted", "tag": "cd23c7a2-7fda-4065-a1f9-c3a7e4f2526c"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:53:31.832093 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-77f9ae29-2853-406c-9728-b90b3cefebaa req-911e0e0e-0581-4f7f-a678-d0b57d0c1445 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:31.835954 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-77f9ae29-2853-406c-9728-b90b3cefebaa req-911e0e0e-0581-4f7f-a678-d0b57d0c1445 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:31.879307 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-77f9ae29-2853-406c-9728-b90b3cefebaa req-911e0e0e-0581-4f7f-a678-d0b57d0c1445 service nova] Creating event network-vif-deleted:cd23c7a2-7fda-4065-a1f9-c3a7e4f2526c for instance b812d7ac-838e-4c92-a359-d237647925f9 on n-h2-846466-12 Aug 04 16:53:31.891390 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-77f9ae29-2853-406c-9728-b90b3cefebaa req-911e0e0e-0581-4f7f-a678-d0b57d0c1445 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090979 Aug 04 16:53:31.892400 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1763/3471] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:53:31.901819 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d575ac05-45b3-472a-a858-aab289922541 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:31.902947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d575ac05-45b3-472a-a858-aab289922541 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] [instance: b812d7ac-838e-4c92-a359-d237647925f9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:31.926008 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d575ac05-45b3-472a-a858-aab289922541 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:31.926459 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d575ac05-45b3-472a-a858-aab289922541 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:31.927250 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d575ac05-45b3-472a-a858-aab289922541 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:31.927716 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d575ac05-45b3-472a-a858-aab289922541 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:31.970785 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d575ac05-45b3-472a-a858-aab289922541 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:31.972439 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d575ac05-45b3-472a-a858-aab289922541 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:31.972929 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-d575ac05-45b3-472a-a858-aab289922541 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lazy-loading 'fault' on Instance uuid b812d7ac-838e-4c92-a359-d237647925f9 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:53:32.048834 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b46a8098-d0f8-4b3c-913b-2874f7f797a4 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e77ffd9d2840a3bde26a88069ee338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e38cf8e78184212a1680df483885d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:32.052582 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:53:32.081329 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b46a8098-d0f8-4b3c-913b-2874f7f797a4 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734" status: 200 len: 1505 microversion: 2.1 time: 1.541492 Aug 04 16:53:32.082605 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1709/3472] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:30 2022] GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734 => generated 1505 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:53:32.105565 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:53:32.299359 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-71d70055-1b6c-4624-be77-32f508a2dddf tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1594346259", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "5f0abd8d-e508-48aa-8e86-2bf80031bada"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:53:32.365497 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d575ac05-45b3-472a-a858-aab289922541 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3786fedbfc6043f8a0dacb3bf8ee82e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03c7dc970224dedb4778b16a402f1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:32.377092 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d575ac05-45b3-472a-a858-aab289922541 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] 10.222.0.23 "GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9" status: 200 len: 1307 microversion: 2.1 time: 0.483177 Aug 04 16:53:32.381173 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1764/3473] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:31 2022] GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9 => generated 1307 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:32.383680 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-71d70055-1b6c-4624-be77-32f508a2dddf tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] validate_networks() for [('5f0abd8d-e508-48aa-8e86-2bf80031bada', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:53:32.644044 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-af17a0e7-f430-4cd6-afd0-674f24f528af tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '.version_select at 0x7f7e840e8f70>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:32.678898 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-af17a0e7-f430-4cd6-afd0-674f24f528af tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] HTTP exception thrown: Image not found. Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-af17a0e7-f430-4cd6-afd0-674f24f528af tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Request method failure captured: Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/images/41f0ca97-276b-4b80-b276-8ab9ca607ed9 HTTP/1.1 Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_jtTPBPy4fXdQ0VJrZ7Fc7m71zszwq7ozUwryWnXkb5nfLRGrkK5ga8HzOO0RHGQ_JBzS6OyCZVWsMotLJPEGPUn58SVuz4Z61cosYCdd8YzpWwL0OdtEOtJV7MtqbPH74mZZtuOB-p1arvqTlVKRaIs7USdqyFhUTa2KSBwKWaYTU Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: eb9de718bdfb4d6dbf63c336dfde8d42 Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb9de718bdfb4d6dbf63c336dfde8d42"}]}] Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: eb9de718bdfb4d6dbf63c336dfde8d42 Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ImagesOneServerNegativeTestJSON-1002016988-project Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 50ace5409bc54123aad5e1bc071cc3dd Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988-project Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: exception: Image not found. Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '41f0ca97-276b-4b80-b276-8ab9ca607ed9'} Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 41f0ca97-276b-4b80-b276-8ab9ca607ed9 to delete Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 41f0ca97-276b-4b80-b276-8ab9ca607ed9 could not be found. Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:32.681195 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:32.685739 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:32.685739 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:32.685739 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:32.685739 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:53:32.685739 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:53:32.685739 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:53:32.685739 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:53:32.685739 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:53:32.685739 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:53:32.685739 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 16:53:32.685739 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 16:53:32.685739 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 16:53:32.685739 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:32.685739 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:32.685739 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:32.685739 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:32.685739 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:32.685739 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:32.685739 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:53:32.685739 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:53:32.685739 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 16:53:32.685739 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:32.689453 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-af17a0e7-f430-4cd6-afd0-674f24f528af tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Returning 404 to user: Image not found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:53:32.690525 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-af17a0e7-f430-4cd6-afd0-674f24f528af tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "DELETE /compute/v2.1/images/41f0ca97-276b-4b80-b276-8ab9ca607ed9" status: 404 len: 62 microversion: 2.1 time: 0.050439 Aug 04 16:53:32.691609 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1765/3474] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:32 2022] DELETE /compute/v2.1/images/41f0ca97-276b-4b80-b276-8ab9ca607ed9 => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:53:32.699268 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dff40a96-2b9a-48a8-b5fe-f0227dcf6f54 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:32.700887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dff40a96-2b9a-48a8-b5fe-f0227dcf6f54 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 30109352-6d98-4d4c-8613-96cfd959e86d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:32.717708 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dff40a96-2b9a-48a8-b5fe-f0227dcf6f54 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:32.718403 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dff40a96-2b9a-48a8-b5fe-f0227dcf6f54 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:32.719386 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dff40a96-2b9a-48a8-b5fe-f0227dcf6f54 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:32.721259 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dff40a96-2b9a-48a8-b5fe-f0227dcf6f54 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:32.745754 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-dff40a96-2b9a-48a8-b5fe-f0227dcf6f54 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] HTTP exception thrown: Instance 30109352-6d98-4d4c-8613-96cfd959e86d could not be found. Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dff40a96-2b9a-48a8-b5fe-f0227dcf6f54 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Request method failure captured: Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d HTTP/1.1 Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_jtTPBPy4fXdQ0VJrZ7Fc7m71zszwq7ozUwryWnXkb5nfLRGrkK5ga8HzOO0RHGQ_JBzS6OyCZVWsMotLJPEGPUn58SVuz4Z61cosYCdd8YzpWwL0OdtEOtJV7MtqbPH74mZZtuOB-p1arvqTlVKRaIs7USdqyFhUTa2KSBwKWaYTU Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: eb9de718bdfb4d6dbf63c336dfde8d42 Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb9de718bdfb4d6dbf63c336dfde8d42"}]}] Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: eb9de718bdfb4d6dbf63c336dfde8d42 Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ImagesOneServerNegativeTestJSON-1002016988-project Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 50ace5409bc54123aad5e1bc071cc3dd Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988-project Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 30109352-6d98-4d4c-8613-96cfd959e86d could not be found. Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '30109352-6d98-4d4c-8613-96cfd959e86d'} Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30109352-6d98-4d4c-8613-96cfd959e86d could not be found. Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:53:32.757255 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:53:32.761739 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30109352-6d98-4d4c-8613-96cfd959e86d could not be found. Aug 04 16:53:32.761739 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:32.761739 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:32.761739 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:32.761739 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:32.761739 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:32.761739 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:32.761739 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:53:32.761739 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:53:32.761739 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30109352-6d98-4d4c-8613-96cfd959e86d could not be found. Aug 04 16:53:32.761739 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:32.764411 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dff40a96-2b9a-48a8-b5fe-f0227dcf6f54 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Returning 404 to user: Instance 30109352-6d98-4d4c-8613-96cfd959e86d could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:53:32.766326 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dff40a96-2b9a-48a8-b5fe-f0227dcf6f54 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "DELETE /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d" status: 404 len: 111 microversion: 2.1 time: 0.070760 Aug 04 16:53:32.770362 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1766/3475] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:53:32 2022] DELETE /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:53:32.780399 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-19b4bcc5-c822-412a-b8f5-2b8d043f9f02 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:32.781813 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-19b4bcc5-c822-412a-b8f5-2b8d043f9f02 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] [instance: 30109352-6d98-4d4c-8613-96cfd959e86d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:32.800108 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-19b4bcc5-c822-412a-b8f5-2b8d043f9f02 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:32.800933 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-19b4bcc5-c822-412a-b8f5-2b8d043f9f02 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:32.801969 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-19b4bcc5-c822-412a-b8f5-2b8d043f9f02 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:32.802646 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-19b4bcc5-c822-412a-b8f5-2b8d043f9f02 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:32.829882 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-19b4bcc5-c822-412a-b8f5-2b8d043f9f02 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] HTTP exception thrown: Instance 30109352-6d98-4d4c-8613-96cfd959e86d could not be found. Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-19b4bcc5-c822-412a-b8f5-2b8d043f9f02 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Request method failure captured: Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d HTTP/1.1 Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_jtTPBPy4fXdQ0VJrZ7Fc7m71zszwq7ozUwryWnXkb5nfLRGrkK5ga8HzOO0RHGQ_JBzS6OyCZVWsMotLJPEGPUn58SVuz4Z61cosYCdd8YzpWwL0OdtEOtJV7MtqbPH74mZZtuOB-p1arvqTlVKRaIs7USdqyFhUTa2KSBwKWaYTU Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: eb9de718bdfb4d6dbf63c336dfde8d42 Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb9de718bdfb4d6dbf63c336dfde8d42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb9de718bdfb4d6dbf63c336dfde8d42"}]}] Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: eb9de718bdfb4d6dbf63c336dfde8d42 Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988 Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ImagesOneServerNegativeTestJSON-1002016988-project Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 50ace5409bc54123aad5e1bc071cc3dd Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1002016988-project Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 30109352-6d98-4d4c-8613-96cfd959e86d could not be found. Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '30109352-6d98-4d4c-8613-96cfd959e86d'} Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30109352-6d98-4d4c-8613-96cfd959e86d could not be found. Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30109352-6d98-4d4c-8613-96cfd959e86d could not be found. Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:32.835457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:32.841133 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:32.841133 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:32.841133 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:32.841133 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:32.841133 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:53:32.841133 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:53:32.841133 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30109352-6d98-4d4c-8613-96cfd959e86d could not be found. Aug 04 16:53:32.841133 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:32.844153 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-19b4bcc5-c822-412a-b8f5-2b8d043f9f02 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] Returning 404 to user: Instance 30109352-6d98-4d4c-8613-96cfd959e86d could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:53:32.858617 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-19b4bcc5-c822-412a-b8f5-2b8d043f9f02 tempest-ImagesOneServerNegativeTestJSON-1002016988 tempest-ImagesOneServerNegativeTestJSON-1002016988-project] 10.222.0.23 "GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d" status: 404 len: 111 microversion: 2.1 time: 0.084103 Aug 04 16:53:32.859836 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1767/3476] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:32 2022] GET /compute/v2.1/servers/30109352-6d98-4d4c-8613-96cfd959e86d => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:53:32.864971 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ef6758d0-6048-464a-b33a-ab76f896165e tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:32.865995 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ef6758d0-6048-464a-b33a-ab76f896165e tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:32.881081 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef6758d0-6048-464a-b33a-ab76f896165e tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:32.881821 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef6758d0-6048-464a-b33a-ab76f896165e tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:32.882772 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef6758d0-6048-464a-b33a-ab76f896165e tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:32.883365 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef6758d0-6048-464a-b33a-ab76f896165e tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:33.340669 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ef6758d0-6048-464a-b33a-ab76f896165e tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:33.359994 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ef6758d0-6048-464a-b33a-ab76f896165e tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 200 len: 1313 microversion: 2.1 time: 0.498718 Aug 04 16:53:33.363195 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1768/3477] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:32 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 1313 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:33.376162 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fe9ac315-4e9c-4a9a-bd83-7b326c45329d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:33.377708 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fe9ac315-4e9c-4a9a-bd83-7b326c45329d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] [instance: 5ecc38b6-e6df-4a00-9757-708aac3a8734] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:33.388800 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fe9ac315-4e9c-4a9a-bd83-7b326c45329d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:33.390052 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fe9ac315-4e9c-4a9a-bd83-7b326c45329d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:33.391547 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fe9ac315-4e9c-4a9a-bd83-7b326c45329d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:33.392162 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fe9ac315-4e9c-4a9a-bd83-7b326c45329d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:34.362974 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fe9ac315-4e9c-4a9a-bd83-7b326c45329d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08e77ffd9d2840a3bde26a88069ee338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e38cf8e78184212a1680df483885d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:34.382984 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fe9ac315-4e9c-4a9a-bd83-7b326c45329d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734" status: 200 len: 1505 microversion: 2.1 time: 1.016766 Aug 04 16:53:34.387763 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1769/3478] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:33 2022] GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734 => generated 1505 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:34.416747 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5aa0922b-d621-460e-9d78-35884967c365 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:34.419275 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5aa0922b-d621-460e-9d78-35884967c365 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] [instance: b812d7ac-838e-4c92-a359-d237647925f9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:34.438583 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5aa0922b-d621-460e-9d78-35884967c365 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:34.439053 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5aa0922b-d621-460e-9d78-35884967c365 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:34.443168 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5aa0922b-d621-460e-9d78-35884967c365 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:34.444231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5aa0922b-d621-460e-9d78-35884967c365 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:34.580726 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-5aa0922b-d621-460e-9d78-35884967c365 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] HTTP exception thrown: Instance b812d7ac-838e-4c92-a359-d237647925f9 could not be found. Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5aa0922b-d621-460e-9d78-35884967c365 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Request method failure captured: Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9 HTTP/1.1 Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_lhb9DauHcxtkKh2UE0mhIO450_q4ZShhRyy_CZKQ4GEPcdRuRFDEWhuPAgd91yCOPGaGW7E_Okw7V7Y5HLZWRFtOXPnEl1Fv2FrwWtZUswwaFfVwLpbnXrKQ7xgtjzX3ZRCfrti4KF7TwlRoaAGGR8270KH6TbK-PBZ1NEnZpeFIw Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: c03c7dc970224dedb4778b16a402f1a3 Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-InstanceActionsTestJSON-2104010588 Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c03c7dc970224dedb4778b16a402f1a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c03c7dc970224dedb4778b16a402f1a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c03c7dc970224dedb4778b16a402f1a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c03c7dc970224dedb4778b16a402f1a3"}]}] Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-InstanceActionsTestJSON-2104010588 Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: c03c7dc970224dedb4778b16a402f1a3 Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-InstanceActionsTestJSON-2104010588 Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-InstanceActionsTestJSON-2104010588-project Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 3786fedbfc6043f8a0dacb3bf8ee82e9 Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-InstanceActionsTestJSON-2104010588-project Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance b812d7ac-838e-4c92-a359-d237647925f9 could not be found. Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'b812d7ac-838e-4c92-a359-d237647925f9'} Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b812d7ac-838e-4c92-a359-d237647925f9 could not be found. Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b812d7ac-838e-4c92-a359-d237647925f9 could not be found. Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:34.588457 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:34.594102 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:34.594102 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:34.594102 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:34.594102 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:53:34.594102 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:53:34.594102 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b812d7ac-838e-4c92-a359-d237647925f9 could not be found. Aug 04 16:53:34.594102 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:34.603185 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5aa0922b-d621-460e-9d78-35884967c365 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] Returning 404 to user: Instance b812d7ac-838e-4c92-a359-d237647925f9 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:53:34.611707 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5aa0922b-d621-460e-9d78-35884967c365 tempest-InstanceActionsTestJSON-2104010588 tempest-InstanceActionsTestJSON-2104010588-project] 10.222.0.23 "GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9" status: 404 len: 111 microversion: 2.1 time: 0.218983 Aug 04 16:53:34.619695 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1770/3479] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:34 2022] GET /compute/v2.1/servers/b812d7ac-838e-4c92-a359-d237647925f9 => generated 111 bytes in 231 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:53:34.640626 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c6464e78-4f46-443c-a6f3-4b1d869be7d1 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:34.646721 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c6464e78-4f46-443c-a6f3-4b1d869be7d1 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:34.669577 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c6464e78-4f46-443c-a6f3-4b1d869be7d1 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:34.671754 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c6464e78-4f46-443c-a6f3-4b1d869be7d1 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:34.672830 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c6464e78-4f46-443c-a6f3-4b1d869be7d1 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:34.673738 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c6464e78-4f46-443c-a6f3-4b1d869be7d1 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:35.468060 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-71d70055-1b6c-4624-be77-32f508a2dddf tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:53:35.468662 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-71d70055-1b6c-4624-be77-32f508a2dddf tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:53:35.469185 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-71d70055-1b6c-4624-be77-32f508a2dddf tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:53:35.469842 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-71d70055-1b6c-4624-be77-32f508a2dddf tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:53:35.471279 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-71d70055-1b6c-4624-be77-32f508a2dddf tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:53:35.484007 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-71d70055-1b6c-4624-be77-32f508a2dddf tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:35.484518 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-71d70055-1b6c-4624-be77-32f508a2dddf tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:35.485443 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-71d70055-1b6c-4624-be77-32f508a2dddf tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:35.486066 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-71d70055-1b6c-4624-be77-32f508a2dddf tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:35.516894 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-71d70055-1b6c-4624-be77-32f508a2dddf tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Getting quotas for project ad03564b02f14ba1b99973ad27799f9d. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:53:35.523815 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-71d70055-1b6c-4624-be77-32f508a2dddf tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Getting quotas for user eb604cd08fab4064a21854aeae139387 and project ad03564b02f14ba1b99973ad27799f9d. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:53:35.536931 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c6464e78-4f46-443c-a6f3-4b1d869be7d1 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:35.542704 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-71d70055-1b6c-4624-be77-32f508a2dddf tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:53:35.545614 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c6464e78-4f46-443c-a6f3-4b1d869be7d1 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 200 len: 1334 microversion: 2.1 time: 0.917462 Aug 04 16:53:35.546044 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-71d70055-1b6c-4624-be77-32f508a2dddf tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] [instance: 0fd8b1bc-a950-4d45-b35f-e6598e50ba1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:53:35.550019 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1771/3480] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:34 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 1334 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:35.565650 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-fbd4bcbe-ee62-49e8-9b0a-76bdf0111da7 req-778ae3ca-81c5-4a28-af8b-67ce204847fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ecc38b6-e6df-4a00-9757-708aac3a8734", "name": "network-vif-deleted", "tag": "e8b0a8d8-b4bf-4c61-92a8-de771eb93949"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:53:35.585102 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-fbd4bcbe-ee62-49e8-9b0a-76bdf0111da7 req-778ae3ca-81c5-4a28-af8b-67ce204847fe service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:35.586028 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-fbd4bcbe-ee62-49e8-9b0a-76bdf0111da7 req-778ae3ca-81c5-4a28-af8b-67ce204847fe service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:35.633857 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-71d70055-1b6c-4624-be77-32f508a2dddf tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.548125 Aug 04 16:53:35.634985 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1710/3481] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:53:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 3550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:53:35.642939 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-851c6df2-5d1a-4053-a127-9c0fe508b655 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:35.643938 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-851c6df2-5d1a-4053-a127-9c0fe508b655 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] [instance: 5ecc38b6-e6df-4a00-9757-708aac3a8734] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:35.645148 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-fbd4bcbe-ee62-49e8-9b0a-76bdf0111da7 req-778ae3ca-81c5-4a28-af8b-67ce204847fe service nova] Creating event network-vif-deleted:e8b0a8d8-b4bf-4c61-92a8-de771eb93949 for instance 5ecc38b6-e6df-4a00-9757-708aac3a8734 on n-h1-846466-12 Aug 04 16:53:35.652593 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-851c6df2-5d1a-4053-a127-9c0fe508b655 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:35.653566 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-851c6df2-5d1a-4053-a127-9c0fe508b655 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:35.654829 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-851c6df2-5d1a-4053-a127-9c0fe508b655 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:35.655503 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-851c6df2-5d1a-4053-a127-9c0fe508b655 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:35.657664 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-fbd4bcbe-ee62-49e8-9b0a-76bdf0111da7 req-778ae3ca-81c5-4a28-af8b-67ce204847fe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106161 Aug 04 16:53:35.660329 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1772/3482] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:53:35.668883 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d8dfa1c8-1fa5-4f47-adca-7c0cc01c8a31 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:35.669860 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d8dfa1c8-1fa5-4f47-adca-7c0cc01c8a31 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] [instance: 0fd8b1bc-a950-4d45-b35f-e6598e50ba1a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:35.693361 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-851c6df2-5d1a-4053-a127-9c0fe508b655 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] HTTP exception thrown: Instance 5ecc38b6-e6df-4a00-9757-708aac3a8734 could not be found. Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-851c6df2-5d1a-4053-a127-9c0fe508b655 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Request method failure captured: Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734 HTTP/1.1 Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_lrbYEAwpdzfcj4Y5ArXmKuqyvN98rmvOPm75TEHRMPE3ba_Tw89hpwFiEQdJXgVVVHzPvmfCj7WOqhu_PYO3b_Ya-wQN8ZOn8Ck_MyCcT0duwLZK1i_zOihCfTGNTRp3xFvENRtSnTwgLrAHrqnKd1AWVxytDfou89X0M7Rk0tBjM Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 8e38cf8e78184212a1680df483885d82 Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServerGroupTestJSON-723154200 Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e38cf8e78184212a1680df483885d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8e38cf8e78184212a1680df483885d82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e38cf8e78184212a1680df483885d82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8e38cf8e78184212a1680df483885d82"}]}] Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServerGroupTestJSON-723154200 Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 8e38cf8e78184212a1680df483885d82 Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServerGroupTestJSON-723154200 Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServerGroupTestJSON-723154200-project Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 08e77ffd9d2840a3bde26a88069ee338 Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServerGroupTestJSON-723154200-project Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 5ecc38b6-e6df-4a00-9757-708aac3a8734 could not be found. Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '5ecc38b6-e6df-4a00-9757-708aac3a8734'} Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ecc38b6-e6df-4a00-9757-708aac3a8734 could not be found. Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ecc38b6-e6df-4a00-9757-708aac3a8734 could not be found. Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:35.695761 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:35.700410 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:35.700410 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:35.700410 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:35.700410 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:53:35.700410 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:53:35.700410 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ecc38b6-e6df-4a00-9757-708aac3a8734 could not be found. Aug 04 16:53:35.700410 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:35.702785 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-851c6df2-5d1a-4053-a127-9c0fe508b655 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Returning 404 to user: Instance 5ecc38b6-e6df-4a00-9757-708aac3a8734 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:53:35.704033 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-851c6df2-5d1a-4053-a127-9c0fe508b655 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734" status: 404 len: 111 microversion: 2.1 time: 0.067719 Aug 04 16:53:35.705088 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1711/3483] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:35 2022] GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:53:35.718574 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-378a7866-2fc2-43cb-8000-cd67b7ab521d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:35.745056 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.compute.server_groups [None req-378a7866-2fc2-43cb-8000-cd67b7ab521d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Querying cell e056d029-674a-446e-ac9e-5108621d9db2(cell1) for 1 instances {{(pid=126126) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 04 16:53:35.746151 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-378a7866-2fc2-43cb-8000-cd67b7ab521d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:35.746601 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-378a7866-2fc2-43cb-8000-cd67b7ab521d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:35.774843 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-378a7866-2fc2-43cb-8000-cd67b7ab521d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.060463 Aug 04 16:53:35.776302 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1712/3484] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Aug 4 16:53:35 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:53:35.789222 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-742c90e8-aa59-47e2-b139-70415fac2166 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:35.825695 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.compute.server_groups [None req-742c90e8-aa59-47e2-b139-70415fac2166 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Querying cell e056d029-674a-446e-ac9e-5108621d9db2(cell1) for 1 instances {{(pid=126126) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 04 16:53:35.828141 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-742c90e8-aa59-47e2-b139-70415fac2166 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:35.828858 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-742c90e8-aa59-47e2-b139-70415fac2166 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:35.852711 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-742c90e8-aa59-47e2-b139-70415fac2166 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/71c64be4-a913-449b-9dd0-c830a08e09c8" status: 200 len: 183 microversion: 2.1 time: 0.068516 Aug 04 16:53:35.854213 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1713/3485] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Aug 4 16:53:35 2022] GET /compute/v2.1/os-server-groups/71c64be4-a913-449b-9dd0-c830a08e09c8 => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:53:35.869369 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f6eaffe7-caf4-425f-92b4-ce47e8017186 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:35.871038 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d8dfa1c8-1fa5-4f47-adca-7c0cc01c8a31 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb604cd08fab4064a21854aeae139387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad03564b02f14ba1b99973ad27799f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:35.871733 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f6eaffe7-caf4-425f-92b4-ce47e8017186 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] [instance: 5ecc38b6-e6df-4a00-9757-708aac3a8734] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:35.886177 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6eaffe7-caf4-425f-92b4-ce47e8017186 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:35.887390 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6eaffe7-caf4-425f-92b4-ce47e8017186 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:35.887834 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d8dfa1c8-1fa5-4f47-adca-7c0cc01c8a31 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] 10.222.0.23 "GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a" status: 200 len: 1225 microversion: 2.1 time: 0.224973 Aug 04 16:53:35.888729 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6eaffe7-caf4-425f-92b4-ce47e8017186 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:35.890652 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6eaffe7-caf4-425f-92b4-ce47e8017186 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:35.891288 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1773/3486] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:35 2022] GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a => generated 1225 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:35.925738 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-f6eaffe7-caf4-425f-92b4-ce47e8017186 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] HTTP exception thrown: Instance 5ecc38b6-e6df-4a00-9757-708aac3a8734 could not be found. Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f6eaffe7-caf4-425f-92b4-ce47e8017186 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Request method failure captured: Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734 HTTP/1.1 Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_lrbYEAwpdzfcj4Y5ArXmKuqyvN98rmvOPm75TEHRMPE3ba_Tw89hpwFiEQdJXgVVVHzPvmfCj7WOqhu_PYO3b_Ya-wQN8ZOn8Ck_MyCcT0duwLZK1i_zOihCfTGNTRp3xFvENRtSnTwgLrAHrqnKd1AWVxytDfou89X0M7Rk0tBjM Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 8e38cf8e78184212a1680df483885d82 Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServerGroupTestJSON-723154200 Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e38cf8e78184212a1680df483885d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8e38cf8e78184212a1680df483885d82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e38cf8e78184212a1680df483885d82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8e38cf8e78184212a1680df483885d82"}]}] Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServerGroupTestJSON-723154200 Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 8e38cf8e78184212a1680df483885d82 Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServerGroupTestJSON-723154200 Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServerGroupTestJSON-723154200-project Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 08e77ffd9d2840a3bde26a88069ee338 Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServerGroupTestJSON-723154200-project Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 5ecc38b6-e6df-4a00-9757-708aac3a8734 could not be found. Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '5ecc38b6-e6df-4a00-9757-708aac3a8734'} Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ecc38b6-e6df-4a00-9757-708aac3a8734 could not be found. Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:53:35.930974 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:53:35.936179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ecc38b6-e6df-4a00-9757-708aac3a8734 could not be found. Aug 04 16:53:35.936179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:35.936179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:35.936179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:35.936179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:35.936179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:35.936179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:35.936179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:53:35.936179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:53:35.936179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ecc38b6-e6df-4a00-9757-708aac3a8734 could not be found. Aug 04 16:53:35.936179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:35.936179 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f6eaffe7-caf4-425f-92b4-ce47e8017186 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Returning 404 to user: Instance 5ecc38b6-e6df-4a00-9757-708aac3a8734 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:53:35.937928 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f6eaffe7-caf4-425f-92b4-ce47e8017186 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734" status: 404 len: 111 microversion: 2.1 time: 0.072892 Aug 04 16:53:35.948729 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1714/3487] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:53:35 2022] DELETE /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:53:35.959410 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ec343f2b-48ce-4269-8d2f-3789bd2513d2 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:35.962217 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ec343f2b-48ce-4269-8d2f-3789bd2513d2 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] [instance: 5ecc38b6-e6df-4a00-9757-708aac3a8734] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:35.985855 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec343f2b-48ce-4269-8d2f-3789bd2513d2 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:35.986407 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec343f2b-48ce-4269-8d2f-3789bd2513d2 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:35.987804 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec343f2b-48ce-4269-8d2f-3789bd2513d2 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:35.991835 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec343f2b-48ce-4269-8d2f-3789bd2513d2 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:36.032516 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-ec343f2b-48ce-4269-8d2f-3789bd2513d2 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] HTTP exception thrown: Instance 5ecc38b6-e6df-4a00-9757-708aac3a8734 could not be found. Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ec343f2b-48ce-4269-8d2f-3789bd2513d2 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Request method failure captured: Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734 HTTP/1.1 Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_lrbYEAwpdzfcj4Y5ArXmKuqyvN98rmvOPm75TEHRMPE3ba_Tw89hpwFiEQdJXgVVVHzPvmfCj7WOqhu_PYO3b_Ya-wQN8ZOn8Ck_MyCcT0duwLZK1i_zOihCfTGNTRp3xFvENRtSnTwgLrAHrqnKd1AWVxytDfou89X0M7Rk0tBjM Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 8e38cf8e78184212a1680df483885d82 Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerGroupTestJSON-723154200 Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e38cf8e78184212a1680df483885d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8e38cf8e78184212a1680df483885d82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e38cf8e78184212a1680df483885d82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8e38cf8e78184212a1680df483885d82"}]}] Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerGroupTestJSON-723154200 Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 8e38cf8e78184212a1680df483885d82 Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerGroupTestJSON-723154200 Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerGroupTestJSON-723154200-project Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 08e77ffd9d2840a3bde26a88069ee338 Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerGroupTestJSON-723154200-project Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 5ecc38b6-e6df-4a00-9757-708aac3a8734 could not be found. Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '5ecc38b6-e6df-4a00-9757-708aac3a8734'} Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ecc38b6-e6df-4a00-9757-708aac3a8734 could not be found. Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ecc38b6-e6df-4a00-9757-708aac3a8734 could not be found. Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:36.038387 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:36.043158 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:36.043158 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:36.043158 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:36.043158 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:53:36.043158 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:53:36.043158 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ecc38b6-e6df-4a00-9757-708aac3a8734 could not be found. Aug 04 16:53:36.043158 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:36.045320 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ec343f2b-48ce-4269-8d2f-3789bd2513d2 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Returning 404 to user: Instance 5ecc38b6-e6df-4a00-9757-708aac3a8734 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:53:36.046430 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ec343f2b-48ce-4269-8d2f-3789bd2513d2 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734" status: 404 len: 111 microversion: 2.1 time: 0.096288 Aug 04 16:53:36.047691 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1774/3488] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:35 2022] GET /compute/v2.1/servers/5ecc38b6-e6df-4a00-9757-708aac3a8734 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:53:36.061587 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-eb81c96c-4454-46e1-94ea-abbe439c350d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:36.072902 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-eb81c96c-4454-46e1-94ea-abbe439c350d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] HTTP exception thrown: Instance group 08cacab9-2160-4826-8184-4da79d05a830 could not be found. Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-eb81c96c-4454-46e1-94ea-abbe439c350d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Request method failure captured: Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/os-server-groups/08cacab9-2160-4826-8184-4da79d05a830 HTTP/1.1 Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_lrbYEAwpdzfcj4Y5ArXmKuqyvN98rmvOPm75TEHRMPE3ba_Tw89hpwFiEQdJXgVVVHzPvmfCj7WOqhu_PYO3b_Ya-wQN8ZOn8Ck_MyCcT0duwLZK1i_zOihCfTGNTRp3xFvENRtSnTwgLrAHrqnKd1AWVxytDfou89X0M7Rk0tBjM Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 8e38cf8e78184212a1680df483885d82 Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServerGroupTestJSON-723154200 Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e38cf8e78184212a1680df483885d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8e38cf8e78184212a1680df483885d82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e38cf8e78184212a1680df483885d82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8e38cf8e78184212a1680df483885d82"}]}] Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServerGroupTestJSON-723154200 Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 8e38cf8e78184212a1680df483885d82 Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServerGroupTestJSON-723154200 Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServerGroupTestJSON-723154200-project Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 08e77ffd9d2840a3bde26a88069ee338 Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServerGroupTestJSON-723154200-project Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance group 08cacab9-2160-4826-8184-4da79d05a830 could not be found. Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '08cacab9-2160-4826-8184-4da79d05a830'} Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 08cacab9-2160-4826-8184-4da79d05a830 could not be found. Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 08cacab9-2160-4826-8184-4da79d05a830 could not be found. Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:36.087630 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:36.096179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:36.096179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:36.096179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:53:36.096179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:53:36.096179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 08cacab9-2160-4826-8184-4da79d05a830 could not be found. Aug 04 16:53:36.096179 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:36.098535 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-eb81c96c-4454-46e1-94ea-abbe439c350d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Returning 404 to user: Instance group 08cacab9-2160-4826-8184-4da79d05a830 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:53:36.100657 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-eb81c96c-4454-46e1-94ea-abbe439c350d tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/08cacab9-2160-4826-8184-4da79d05a830" status: 404 len: 117 microversion: 2.1 time: 0.048591 Aug 04 16:53:36.101570 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1715/3489] 10.222.0.23 () {58 vars in 1266 bytes} [Thu Aug 4 16:53:36 2022] DELETE /compute/v2.1/os-server-groups/08cacab9-2160-4826-8184-4da79d05a830 => generated 117 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:53:36.110636 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-23807974-44ac-4cce-bed8-157e7aa5d6e4 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:36.123558 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-23807974-44ac-4cce-bed8-157e7aa5d6e4 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] HTTP exception thrown: Instance group 644af689-b450-424f-a760-f5bab2c64efe could not be found. Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-23807974-44ac-4cce-bed8-157e7aa5d6e4 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Request method failure captured: Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/os-server-groups/644af689-b450-424f-a760-f5bab2c64efe HTTP/1.1 Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_lrbYEAwpdzfcj4Y5ArXmKuqyvN98rmvOPm75TEHRMPE3ba_Tw89hpwFiEQdJXgVVVHzPvmfCj7WOqhu_PYO3b_Ya-wQN8ZOn8Ck_MyCcT0duwLZK1i_zOihCfTGNTRp3xFvENRtSnTwgLrAHrqnKd1AWVxytDfou89X0M7Rk0tBjM Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 8e38cf8e78184212a1680df483885d82 Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerGroupTestJSON-723154200 Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e38cf8e78184212a1680df483885d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8e38cf8e78184212a1680df483885d82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e38cf8e78184212a1680df483885d82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8e38cf8e78184212a1680df483885d82"}]}] Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerGroupTestJSON-723154200 Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 8e38cf8e78184212a1680df483885d82 Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerGroupTestJSON-723154200 Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerGroupTestJSON-723154200-project Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 08e77ffd9d2840a3bde26a88069ee338 Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerGroupTestJSON-723154200-project Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance group 644af689-b450-424f-a760-f5bab2c64efe could not be found. Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '644af689-b450-424f-a760-f5bab2c64efe'} Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 644af689-b450-424f-a760-f5bab2c64efe could not be found. Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 644af689-b450-424f-a760-f5bab2c64efe could not be found. Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:36.126175 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:36.132492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:36.132492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:36.132492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:53:36.132492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:53:36.132492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 644af689-b450-424f-a760-f5bab2c64efe could not be found. Aug 04 16:53:36.132492 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:36.133778 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-23807974-44ac-4cce-bed8-157e7aa5d6e4 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Returning 404 to user: Instance group 644af689-b450-424f-a760-f5bab2c64efe could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:53:36.134983 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-23807974-44ac-4cce-bed8-157e7aa5d6e4 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/644af689-b450-424f-a760-f5bab2c64efe" status: 404 len: 117 microversion: 2.1 time: 0.028547 Aug 04 16:53:36.138975 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1775/3490] 10.222.0.23 () {58 vars in 1266 bytes} [Thu Aug 4 16:53:36 2022] DELETE /compute/v2.1/os-server-groups/644af689-b450-424f-a760-f5bab2c64efe => generated 117 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:53:36.147544 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4ac29419-6c57-4938-b554-5e45322742e7 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:36.162842 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-4ac29419-6c57-4938-b554-5e45322742e7 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] HTTP exception thrown: Instance group 686c7ce5-1be4-43a0-b474-7f2503e5210a could not be found. Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4ac29419-6c57-4938-b554-5e45322742e7 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Request method failure captured: Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/os-server-groups/686c7ce5-1be4-43a0-b474-7f2503e5210a HTTP/1.1 Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_lrbYEAwpdzfcj4Y5ArXmKuqyvN98rmvOPm75TEHRMPE3ba_Tw89hpwFiEQdJXgVVVHzPvmfCj7WOqhu_PYO3b_Ya-wQN8ZOn8Ck_MyCcT0duwLZK1i_zOihCfTGNTRp3xFvENRtSnTwgLrAHrqnKd1AWVxytDfou89X0M7Rk0tBjM Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 8e38cf8e78184212a1680df483885d82 Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServerGroupTestJSON-723154200 Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e38cf8e78184212a1680df483885d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8e38cf8e78184212a1680df483885d82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e38cf8e78184212a1680df483885d82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8e38cf8e78184212a1680df483885d82"}]}] Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServerGroupTestJSON-723154200 Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 8e38cf8e78184212a1680df483885d82 Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServerGroupTestJSON-723154200 Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServerGroupTestJSON-723154200-project Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 08e77ffd9d2840a3bde26a88069ee338 Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServerGroupTestJSON-723154200-project Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance group 686c7ce5-1be4-43a0-b474-7f2503e5210a could not be found. Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '686c7ce5-1be4-43a0-b474-7f2503e5210a'} Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 686c7ce5-1be4-43a0-b474-7f2503e5210a could not be found. Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 686c7ce5-1be4-43a0-b474-7f2503e5210a could not be found. Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:36.168992 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:36.179390 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:36.179390 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:36.179390 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:53:36.179390 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:53:36.179390 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 686c7ce5-1be4-43a0-b474-7f2503e5210a could not be found. Aug 04 16:53:36.179390 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:36.179390 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4ac29419-6c57-4938-b554-5e45322742e7 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Returning 404 to user: Instance group 686c7ce5-1be4-43a0-b474-7f2503e5210a could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:53:36.179390 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4ac29419-6c57-4938-b554-5e45322742e7 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/686c7ce5-1be4-43a0-b474-7f2503e5210a" status: 404 len: 117 microversion: 2.1 time: 0.031324 Aug 04 16:53:36.179390 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1716/3491] 10.222.0.23 () {58 vars in 1266 bytes} [Thu Aug 4 16:53:36 2022] DELETE /compute/v2.1/os-server-groups/686c7ce5-1be4-43a0-b474-7f2503e5210a => generated 117 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:53:36.185354 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d5870fb5-6ce0-45c7-85dd-6251f334d62c tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:36.195248 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-d5870fb5-6ce0-45c7-85dd-6251f334d62c tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] HTTP exception thrown: Instance group cf69ec3a-6e91-4469-9a13-3763143f3bf5 could not be found. Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d5870fb5-6ce0-45c7-85dd-6251f334d62c tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Request method failure captured: Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/os-server-groups/cf69ec3a-6e91-4469-9a13-3763143f3bf5 HTTP/1.1 Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_lrbYEAwpdzfcj4Y5ArXmKuqyvN98rmvOPm75TEHRMPE3ba_Tw89hpwFiEQdJXgVVVHzPvmfCj7WOqhu_PYO3b_Ya-wQN8ZOn8Ck_MyCcT0duwLZK1i_zOihCfTGNTRp3xFvENRtSnTwgLrAHrqnKd1AWVxytDfou89X0M7Rk0tBjM Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 8e38cf8e78184212a1680df483885d82 Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerGroupTestJSON-723154200 Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e38cf8e78184212a1680df483885d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8e38cf8e78184212a1680df483885d82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e38cf8e78184212a1680df483885d82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8e38cf8e78184212a1680df483885d82"}]}] Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerGroupTestJSON-723154200 Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 8e38cf8e78184212a1680df483885d82 Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerGroupTestJSON-723154200 Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerGroupTestJSON-723154200-project Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 08e77ffd9d2840a3bde26a88069ee338 Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerGroupTestJSON-723154200-project Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance group cf69ec3a-6e91-4469-9a13-3763143f3bf5 could not be found. Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'cf69ec3a-6e91-4469-9a13-3763143f3bf5'} Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group cf69ec3a-6e91-4469-9a13-3763143f3bf5 could not be found. Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group cf69ec3a-6e91-4469-9a13-3763143f3bf5 could not be found. Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:36.203900 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:36.212804 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:36.212804 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:36.212804 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:53:36.212804 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:53:36.212804 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group cf69ec3a-6e91-4469-9a13-3763143f3bf5 could not be found. Aug 04 16:53:36.212804 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:36.212804 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d5870fb5-6ce0-45c7-85dd-6251f334d62c tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Returning 404 to user: Instance group cf69ec3a-6e91-4469-9a13-3763143f3bf5 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:53:36.212804 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d5870fb5-6ce0-45c7-85dd-6251f334d62c tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/cf69ec3a-6e91-4469-9a13-3763143f3bf5" status: 404 len: 117 microversion: 2.1 time: 0.028018 Aug 04 16:53:36.217880 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2db5c4b2-deb6-4a1a-adfe-5e9d08e801e5 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:36.221020 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1776/3492] 10.222.0.23 () {58 vars in 1266 bytes} [Thu Aug 4 16:53:36 2022] DELETE /compute/v2.1/os-server-groups/cf69ec3a-6e91-4469-9a13-3763143f3bf5 => generated 117 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:53:36.237826 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:53:36.291443 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2db5c4b2-deb6-4a1a-adfe-5e9d08e801e5 tempest-ServerGroupTestJSON-723154200 tempest-ServerGroupTestJSON-723154200-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/71c64be4-a913-449b-9dd0-c830a08e09c8" status: 204 len: 0 microversion: 2.1 time: 0.077229 Aug 04 16:53:36.292335 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1717/3493] 10.222.0.23 () {58 vars in 1266 bytes} [Thu Aug 4 16:53:36 2022] DELETE /compute/v2.1/os-server-groups/71c64be4-a913-449b-9dd0-c830a08e09c8 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:53:36.579092 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d259a4cd-4587-4a70-ada0-2a42cd0ee53f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:36.579781 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d259a4cd-4587-4a70-ada0-2a42cd0ee53f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:36.584189 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:53:36.602144 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d259a4cd-4587-4a70-ada0-2a42cd0ee53f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:36.603256 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d259a4cd-4587-4a70-ada0-2a42cd0ee53f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:36.604457 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d259a4cd-4587-4a70-ada0-2a42cd0ee53f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:36.605295 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d259a4cd-4587-4a70-ada0-2a42cd0ee53f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:36.921773 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a85debf0-0b04-4c46-9825-873ec08e7bb1 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:36.923201 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a85debf0-0b04-4c46-9825-873ec08e7bb1 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] [instance: 0fd8b1bc-a950-4d45-b35f-e6598e50ba1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:36.940066 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a85debf0-0b04-4c46-9825-873ec08e7bb1 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:36.940598 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a85debf0-0b04-4c46-9825-873ec08e7bb1 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:36.941681 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a85debf0-0b04-4c46-9825-873ec08e7bb1 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:36.942182 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a85debf0-0b04-4c46-9825-873ec08e7bb1 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:37.108472 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a85debf0-0b04-4c46-9825-873ec08e7bb1 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb604cd08fab4064a21854aeae139387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad03564b02f14ba1b99973ad27799f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:37.119768 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a85debf0-0b04-4c46-9825-873ec08e7bb1 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] 10.222.0.23 "GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a" status: 200 len: 1277 microversion: 2.1 time: 0.212521 Aug 04 16:53:37.122836 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1718/3494] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:36 2022] GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a => generated 1277 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:37.185908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d259a4cd-4587-4a70-ada0-2a42cd0ee53f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:37.195985 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d259a4cd-4587-4a70-ada0-2a42cd0ee53f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 200 len: 1334 microversion: 2.1 time: 0.623791 Aug 04 16:53:37.197971 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1777/3495] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:36 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 1334 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:38.148016 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-46a76ef1-840c-460a-bcd2-bddc0bdb9cd1 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:38.153860 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-46a76ef1-840c-460a-bcd2-bddc0bdb9cd1 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] [instance: 0fd8b1bc-a950-4d45-b35f-e6598e50ba1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:38.165957 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-46a76ef1-840c-460a-bcd2-bddc0bdb9cd1 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:38.166820 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-46a76ef1-840c-460a-bcd2-bddc0bdb9cd1 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:38.168282 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-46a76ef1-840c-460a-bcd2-bddc0bdb9cd1 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:38.169041 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-46a76ef1-840c-460a-bcd2-bddc0bdb9cd1 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:38.297207 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0d70bc2a-8594-46f2-981b-166f26263e22 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:38.298483 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0d70bc2a-8594-46f2-981b-166f26263e22 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:38.323332 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0d70bc2a-8594-46f2-981b-166f26263e22 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:38.323769 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0d70bc2a-8594-46f2-981b-166f26263e22 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:38.329775 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0d70bc2a-8594-46f2-981b-166f26263e22 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:38.331180 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0d70bc2a-8594-46f2-981b-166f26263e22 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:39.082356 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-46a76ef1-840c-460a-bcd2-bddc0bdb9cd1 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb604cd08fab4064a21854aeae139387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad03564b02f14ba1b99973ad27799f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:39.090705 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-46a76ef1-840c-460a-bcd2-bddc0bdb9cd1 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] 10.222.0.23 "GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a" status: 200 len: 1283 microversion: 2.1 time: 0.950331 Aug 04 16:53:39.091914 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1719/3496] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:38 2022] GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a => generated 1283 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:39.688005 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0d70bc2a-8594-46f2-981b-166f26263e22 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:39.696236 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0d70bc2a-8594-46f2-981b-166f26263e22 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 200 len: 1355 microversion: 2.1 time: 1.403963 Aug 04 16:53:39.710422 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1778/3497] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:38 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 1355 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:40.117045 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6cf4bf79-3209-4ccf-a03b-9ec86f8de795 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:40.118281 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6cf4bf79-3209-4ccf-a03b-9ec86f8de795 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] [instance: 0fd8b1bc-a950-4d45-b35f-e6598e50ba1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:40.132621 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6cf4bf79-3209-4ccf-a03b-9ec86f8de795 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:40.133395 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6cf4bf79-3209-4ccf-a03b-9ec86f8de795 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:40.135651 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6cf4bf79-3209-4ccf-a03b-9ec86f8de795 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:40.140653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6cf4bf79-3209-4ccf-a03b-9ec86f8de795 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:40.181829 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:53:40.504896 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6cf4bf79-3209-4ccf-a03b-9ec86f8de795 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb604cd08fab4064a21854aeae139387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad03564b02f14ba1b99973ad27799f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:40.519485 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6cf4bf79-3209-4ccf-a03b-9ec86f8de795 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] 10.222.0.23 "GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a" status: 200 len: 1283 microversion: 2.1 time: 0.405610 Aug 04 16:53:40.521131 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1720/3498] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:40 2022] GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a => generated 1283 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:40.718822 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e22cc854-5d0f-4a2e-be05-e057452aa27d tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:40.720165 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e22cc854-5d0f-4a2e-be05-e057452aa27d tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:40.733052 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e22cc854-5d0f-4a2e-be05-e057452aa27d tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:40.733908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e22cc854-5d0f-4a2e-be05-e057452aa27d tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:40.737174 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e22cc854-5d0f-4a2e-be05-e057452aa27d tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:40.737843 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e22cc854-5d0f-4a2e-be05-e057452aa27d tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:41.472902 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e22cc854-5d0f-4a2e-be05-e057452aa27d tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:41.503036 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e22cc854-5d0f-4a2e-be05-e057452aa27d tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 200 len: 1355 microversion: 2.1 time: 0.787723 Aug 04 16:53:41.522295 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1779/3499] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:40 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 1355 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:53:41.540931 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a8b80025-8879-4cae-84de-291c722f0dae tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:41.542321 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a8b80025-8879-4cae-84de-291c722f0dae tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] [instance: 0fd8b1bc-a950-4d45-b35f-e6598e50ba1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:41.550945 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a8b80025-8879-4cae-84de-291c722f0dae tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:41.551980 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a8b80025-8879-4cae-84de-291c722f0dae tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:41.553066 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a8b80025-8879-4cae-84de-291c722f0dae tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:41.553863 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a8b80025-8879-4cae-84de-291c722f0dae tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:41.999805 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-53639c7b-91eb-4461-8193-5009e6b7f9a7 req-829d0c0e-bc94-4015-b116-ddd7e4fb1b00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "329e3811-2d1f-43ac-8c22-c2675ae6b9b8", "tag": "804d18b1-8d51-45f4-befe-8fc753241f09"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:53:42.028900 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-53639c7b-91eb-4461-8193-5009e6b7f9a7 req-829d0c0e-bc94-4015-b116-ddd7e4fb1b00 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:42.029404 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-53639c7b-91eb-4461-8193-5009e6b7f9a7 req-829d0c0e-bc94-4015-b116-ddd7e4fb1b00 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:42.061602 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-53639c7b-91eb-4461-8193-5009e6b7f9a7 req-829d0c0e-bc94-4015-b116-ddd7e4fb1b00 service nova] Creating event network-changed:804d18b1-8d51-45f4-befe-8fc753241f09 for instance 329e3811-2d1f-43ac-8c22-c2675ae6b9b8 on n-h2-846466-12 Aug 04 16:53:42.076733 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-53639c7b-91eb-4461-8193-5009e6b7f9a7 req-829d0c0e-bc94-4015-b116-ddd7e4fb1b00 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080962 Aug 04 16:53:42.078133 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1780/3500] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:53:42.426938 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a8b80025-8879-4cae-84de-291c722f0dae tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb604cd08fab4064a21854aeae139387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad03564b02f14ba1b99973ad27799f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:42.448839 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a8b80025-8879-4cae-84de-291c722f0dae tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] 10.222.0.23 "GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a" status: 200 len: 1325 microversion: 2.1 time: 0.911040 Aug 04 16:53:42.450825 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1721/3501] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:41 2022] GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a => generated 1325 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:42.537562 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b47c33c9-af51-4179-a22b-62422ca15e6d tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:42.538460 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b47c33c9-af51-4179-a22b-62422ca15e6d tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:42.550333 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b47c33c9-af51-4179-a22b-62422ca15e6d tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:42.550782 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b47c33c9-af51-4179-a22b-62422ca15e6d tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:42.561143 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b47c33c9-af51-4179-a22b-62422ca15e6d tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:42.562000 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b47c33c9-af51-4179-a22b-62422ca15e6d tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:43.470192 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8c69325d-3d1a-4fe6-9d72-a7bd500e06db tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:43.470932 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8c69325d-3d1a-4fe6-9d72-a7bd500e06db tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] [instance: 0fd8b1bc-a950-4d45-b35f-e6598e50ba1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:43.481762 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8c69325d-3d1a-4fe6-9d72-a7bd500e06db tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:43.482434 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8c69325d-3d1a-4fe6-9d72-a7bd500e06db tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:43.483409 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8c69325d-3d1a-4fe6-9d72-a7bd500e06db tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:43.484488 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8c69325d-3d1a-4fe6-9d72-a7bd500e06db tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:43.807174 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b47c33c9-af51-4179-a22b-62422ca15e6d tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:43.832654 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b47c33c9-af51-4179-a22b-62422ca15e6d tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 200 len: 1355 microversion: 2.1 time: 1.302589 Aug 04 16:53:43.839533 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1781/3502] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:42 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 1355 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:44.499218 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8c69325d-3d1a-4fe6-9d72-a7bd500e06db tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb604cd08fab4064a21854aeae139387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad03564b02f14ba1b99973ad27799f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:44.513078 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8c69325d-3d1a-4fe6-9d72-a7bd500e06db tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] 10.222.0.23 "GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a" status: 200 len: 1325 microversion: 2.1 time: 1.046277 Aug 04 16:53:44.532691 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1722/3503] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:43 2022] GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a => generated 1325 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:53:44.857166 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8ffa8dc9-8005-4072-92fb-3d76506a024b tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:44.858421 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8ffa8dc9-8005-4072-92fb-3d76506a024b tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:44.866207 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8ffa8dc9-8005-4072-92fb-3d76506a024b tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:44.866868 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8ffa8dc9-8005-4072-92fb-3d76506a024b tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:44.868767 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8ffa8dc9-8005-4072-92fb-3d76506a024b tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:44.869525 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8ffa8dc9-8005-4072-92fb-3d76506a024b tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:44.875228 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:53:45.536296 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8ebc0953-aa39-46db-a7b0-77af5ab291d0 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:45.537892 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8ebc0953-aa39-46db-a7b0-77af5ab291d0 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] [instance: 0fd8b1bc-a950-4d45-b35f-e6598e50ba1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:45.552726 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:53:45.555390 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:53:45.558985 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8ebc0953-aa39-46db-a7b0-77af5ab291d0 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:45.563555 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8ffa8dc9-8005-4072-92fb-3d76506a024b tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:45.574202 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8ffa8dc9-8005-4072-92fb-3d76506a024b tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 200 len: 1355 microversion: 2.1 time: 0.720690 Aug 04 16:53:45.577137 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8ebc0953-aa39-46db-a7b0-77af5ab291d0 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:45.579747 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8ebc0953-aa39-46db-a7b0-77af5ab291d0 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:45.593920 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1782/3504] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:44 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 1355 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:45.594971 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8ebc0953-aa39-46db-a7b0-77af5ab291d0 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:46.154533 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-97809a0c-d25f-4e31-b46d-81b9616a3840 req-52c7c39b-337c-4acd-9358-69a2e573e124 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "329e3811-2d1f-43ac-8c22-c2675ae6b9b8", "tag": "9ec644e9-34d2-4286-ac9f-d87c2adc2000"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:53:46.175615 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:53:46.185215 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-97809a0c-d25f-4e31-b46d-81b9616a3840 req-52c7c39b-337c-4acd-9358-69a2e573e124 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:46.185215 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-97809a0c-d25f-4e31-b46d-81b9616a3840 req-52c7c39b-337c-4acd-9358-69a2e573e124 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:46.205032 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-97809a0c-d25f-4e31-b46d-81b9616a3840 req-52c7c39b-337c-4acd-9358-69a2e573e124 service nova] Creating event network-changed:9ec644e9-34d2-4286-ac9f-d87c2adc2000 for instance 329e3811-2d1f-43ac-8c22-c2675ae6b9b8 on n-h2-846466-12 Aug 04 16:53:46.207910 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-97809a0c-d25f-4e31-b46d-81b9616a3840 req-52c7c39b-337c-4acd-9358-69a2e573e124 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059927 Aug 04 16:53:46.208976 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1783/3505] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:53:46.608111 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6a02b316-0aa2-4d2f-81a3-4999a5260338 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:46.609157 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6a02b316-0aa2-4d2f-81a3-4999a5260338 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:46.621357 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a02b316-0aa2-4d2f-81a3-4999a5260338 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:46.624577 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a02b316-0aa2-4d2f-81a3-4999a5260338 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:46.625717 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a02b316-0aa2-4d2f-81a3-4999a5260338 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:46.640841 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a02b316-0aa2-4d2f-81a3-4999a5260338 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:47.004505 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8ebc0953-aa39-46db-a7b0-77af5ab291d0 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb604cd08fab4064a21854aeae139387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad03564b02f14ba1b99973ad27799f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:47.017455 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8ebc0953-aa39-46db-a7b0-77af5ab291d0 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] 10.222.0.23 "GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a" status: 200 len: 1325 microversion: 2.1 time: 1.484123 Aug 04 16:53:47.034087 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1723/3506] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:45 2022] GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a => generated 1325 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:53:47.475199 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6a02b316-0aa2-4d2f-81a3-4999a5260338 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:47.489345 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6a02b316-0aa2-4d2f-81a3-4999a5260338 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 200 len: 1355 microversion: 2.1 time: 0.886907 Aug 04 16:53:47.490946 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1784/3507] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:46 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 1355 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:53:47.689040 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-028e27d3-3d4e-4298-b572-753b16554f84 tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Action: 'create', calling method: .version_select at 0x7f7e89c62310>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHa1Fxvr+shFXAGUqcS8kxcdW+TvW0l5RaA6NbanWGkTg2ABuK26JTOMA+nlZeKB+984QrsmqQTnTcgfRtPRmCEBYcNU/4+ktlcviQpXdH0SNdnhqdeRv8avsuWzveSPYw=="}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-028e27d3-3d4e-4298-b572-753b16554f84 tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Request method failure captured: Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 257 Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_mbrtzPDHSRWkU0RaW0SGjPog7MN07lfBY06X5KS8bmEpDXrouqvq_6wv8QMxuzHj-6fQ3aZcIU_eP5CE31v5dIVEs9_5y3W_D28_FbzAuMr73T53nTqtIlEyUexJNhR5NVqFmMWuBisCB7p2jEHV4Z1oEIVCYUgJsPY7xXw0lkEzc Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 3bce077a76024de5b1ce744983ff0c3a Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1004857266 Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3bce077a76024de5b1ce744983ff0c3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3bce077a76024de5b1ce744983ff0c3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3bce077a76024de5b1ce744983ff0c3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3bce077a76024de5b1ce744983ff0c3a"}]}] Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1004857266 Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 3bce077a76024de5b1ce744983ff0c3a Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1004857266 Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-KeyPairsNegativeTestJSON-1004857266-project Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: f49a80c605354e0daf3f8759c70f55db Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1004857266-project Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHa1Fxvr+shFXAGUqcS8kxcdW+TvW0l5RaA6NbanWGkTg2ABuK26JTOMA+nlZeKB+984QrsmqQTnTcgfRtPRmCEBYcNU/4+ktlcviQpXdH0SNdnhqdeRv8avsuWzveSPYw=="}} Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHa1Fxvr+shFXAGUqcS8kxcdW+TvW0l5RaA6NbanWGkTg2ABuK26JTOMA+nlZeKB+984QrsmqQTnTcgfRtPRmCEBYcNU/4+ktlcviQpXdH0SNdnhqdeRv8avsuWzveSPYw=='}}} Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 04 16:53:47.693456 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:47.700330 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:47.700330 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:47.700330 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:47.700330 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:47.700330 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:47.700330 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:53:47.700330 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:53:47.700330 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:53:47.700330 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:53:47.700330 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:53:47.700330 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:53:47.700330 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:53:47.700330 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:53:47.700330 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 16:53:47.700330 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 16:53:47.700330 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:53:47.700330 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:53:47.700330 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:53:47.700330 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:53:47.700330 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 04 16:53:47.700330 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:47.700330 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:47.700330 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:47.700330 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:47.700330 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:47.700330 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:47.700330 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:53:47.700330 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:53:47.700330 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 04 16:53:47.700330 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:53:47.700330 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-028e27d3-3d4e-4298-b572-753b16554f84 tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:53:47.700330 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-028e27d3-3d4e-4298-b572-753b16554f84 tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.235847 Aug 04 16:53:47.709497 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1724/3508] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 16:53:47 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 241 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:53:47.712209 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-15b74bba-b903-4f2d-9394-1818905e0e5a tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Action: 'create', calling method: .version_select at 0x7f7e77d39c10>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-466539980", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:53:47.753680 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-15b74bba-b903-4f2d-9394-1818905e0e5a tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Getting quotas for project 3bce077a76024de5b1ce744983ff0c3a. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:53:47.761623 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-15b74bba-b903-4f2d-9394-1818905e0e5a tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Getting quotas for user f49a80c605354e0daf3f8759c70f55db and project 3bce077a76024de5b1ce744983ff0c3a. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:53:47.817600 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-15b74bba-b903-4f2d-9394-1818905e0e5a tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 04 16:53:47.835792 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-15b74bba-b903-4f2d-9394-1818905e0e5a tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Request method failure captured: Aug 04 16:53:47.835792 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 04 16:53:47.835792 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:53:47.835792 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:53:47.835792 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:53:47.835792 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 2166 Aug 04 16:53:47.835792 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:53:47.835792 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:53:47.835792 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:53:47.835792 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:53:47.835792 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_mbrtzPDHSRWkU0RaW0SGjPog7MN07lfBY06X5KS8bmEpDXrouqvq_6wv8QMxuzHj-6fQ3aZcIU_eP5CE31v5dIVEs9_5y3W_D28_FbzAuMr73T53nTqtIlEyUexJNhR5NVqFmMWuBisCB7p2jEHV4Z1oEIVCYUgJsPY7xXw0lkEzc Aug 04 16:53:47.835792 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:53:47.835792 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:53:47.835792 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:53:47.835792 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:53:47.835792 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:53:47.835792 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:53:47.835792 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 3bce077a76024de5b1ce744983ff0c3a Aug 04 16:53:47.835792 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1004857266 Aug 04 16:53:47.835792 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:53:47.835792 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:53:47.835792 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3bce077a76024de5b1ce744983ff0c3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3bce077a76024de5b1ce744983ff0c3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3bce077a76024de5b1ce744983ff0c3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3bce077a76024de5b1ce744983ff0c3a"}]}] Aug 04 16:53:47.835792 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1004857266 Aug 04 16:53:47.835792 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 3bce077a76024de5b1ce744983ff0c3a Aug 04 16:53:47.835792 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1004857266 Aug 04 16:53:47.835792 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-KeyPairsNegativeTestJSON-1004857266-project Aug 04 16:53:47.835792 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:53:47.835792 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:53:47.835792 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: f49a80c605354e0daf3f8759c70f55db Aug 04 16:53:47.835792 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1004857266-project Aug 04 16:53:47.835792 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:53:47.835792 n-d-846466-12 devstack@n-api.service[126125]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-466539980", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 04 16:53:47.835792 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:53:47.835792 n-d-846466-12 devstack@n-api.service[126125]: exception: Keypair data is invalid: failed to generate fingerprint Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-466539980', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:53:47.838993 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:53:47.848771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:53:47.848771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:53:47.848771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:53:47.848771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:53:47.848771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 04 16:53:47.848771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 04 16:53:47.848771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 04 16:53:47.848771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 04 16:53:47.848771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 04 16:53:47.848771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:47.848771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:47.848771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:47.848771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:47.848771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:47.848771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:47.848771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:53:47.848771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:53:47.848771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 04 16:53:47.848771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:47.848771 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-15b74bba-b903-4f2d-9394-1818905e0e5a tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:53:47.848771 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-15b74bba-b903-4f2d-9394-1818905e0e5a tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.131637 Aug 04 16:53:47.848771 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1785/3509] 10.222.0.23 () {60 vars in 1160 bytes} [Thu Aug 4 16:53:47 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 133 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 16:53:47.855309 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f83637a3-7353-49e6-a3e7-9d0c8124f455 tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Action: 'create', calling method: .version_select at 0x7f7e89c79c10>, body: {"keypair": {"name": "tempest-keypair-1921653808", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdkzXFp217X0D15a9fQBSlBMh69UaeD11lUGQ6fyeV5AE9Vnq3Ul9fe6po8VF4oc1GZ/PoHN8RCudEuCNZOhUHX9Od3K92bLsEeh6JBdpJUEwf81nTB8Dbcs1o25+7SQg=="}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:53:47.877581 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-f83637a3-7353-49e6-a3e7-9d0c8124f455 tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Getting quotas for project 3bce077a76024de5b1ce744983ff0c3a. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:53:47.884356 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-f83637a3-7353-49e6-a3e7-9d0c8124f455 tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Getting quotas for user f49a80c605354e0daf3f8759c70f55db and project 3bce077a76024de5b1ce744983ff0c3a. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:53:47.928494 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f83637a3-7353-49e6-a3e7-9d0c8124f455 tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.080031 Aug 04 16:53:47.937378 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1725/3510] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 16:53:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:53:47.946137 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8b4dbe56-e61d-4372-b1bf-d843607fa38b tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Action: 'create', calling method: .version_select at 0x7f7e843cfca0>, body: {"keypair": {"name": "tempest-keypair-1921653808", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJLPRegAjVeanHYUdhQAVLa35Qvq8+wSjg25wvj2fNjuOU2OocaC4S14NvmaDzawoj6s9Ei4LCQf8GdDwJqSKkruMr6SedY2flq3npNjZxEtJaGVNv/pBLNuYBRmyY3lg=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:53:47.982927 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-8b4dbe56-e61d-4372-b1bf-d843607fa38b tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Getting quotas for project 3bce077a76024de5b1ce744983ff0c3a. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:53:47.991410 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-8b4dbe56-e61d-4372-b1bf-d843607fa38b tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Getting quotas for user f49a80c605354e0daf3f8759c70f55db and project 3bce077a76024de5b1ce744983ff0c3a. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:53:48.041055 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-8b4dbe56-e61d-4372-b1bf-d843607fa38b tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] HTTP exception thrown: Key pair 'tempest-keypair-1921653808' already exists. Aug 04 16:53:48.045402 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-54217c49-f9ea-4785-bdee-81f2e118632b tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:48.046116 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-54217c49-f9ea-4785-bdee-81f2e118632b tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] [instance: 0fd8b1bc-a950-4d45-b35f-e6598e50ba1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8b4dbe56-e61d-4372-b1bf-d843607fa38b tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Request method failure captured: Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 273 Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_mbrtzPDHSRWkU0RaW0SGjPog7MN07lfBY06X5KS8bmEpDXrouqvq_6wv8QMxuzHj-6fQ3aZcIU_eP5CE31v5dIVEs9_5y3W_D28_FbzAuMr73T53nTqtIlEyUexJNhR5NVqFmMWuBisCB7p2jEHV4Z1oEIVCYUgJsPY7xXw0lkEzc Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 3bce077a76024de5b1ce744983ff0c3a Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1004857266 Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3bce077a76024de5b1ce744983ff0c3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3bce077a76024de5b1ce744983ff0c3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3bce077a76024de5b1ce744983ff0c3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3bce077a76024de5b1ce744983ff0c3a"}]}] Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1004857266 Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 3bce077a76024de5b1ce744983ff0c3a Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1004857266 Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-KeyPairsNegativeTestJSON-1004857266-project Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: f49a80c605354e0daf3f8759c70f55db Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1004857266-project Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: {"keypair": {"name": "tempest-keypair-1921653808", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJLPRegAjVeanHYUdhQAVLa35Qvq8+wSjg25wvj2fNjuOU2OocaC4S14NvmaDzawoj6s9Ei4LCQf8GdDwJqSKkruMr6SedY2flq3npNjZxEtJaGVNv/pBLNuYBRmyY3lg=="}} Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: exception: Key pair 'tempest-keypair-1921653808' already exists. Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1921653808', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJLPRegAjVeanHYUdhQAVLa35Qvq8+wSjg25wvj2fNjuOU2OocaC4S14NvmaDzawoj6s9Ei4LCQf8GdDwJqSKkruMr6SedY2flq3npNjZxEtJaGVNv/pBLNuYBRmyY3lg=='}}} Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result.read() Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'f49a80c605354e0daf3f8759c70f55db-tempest-keypair-1921653808' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 04 16:53:48.046521 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi session.flush() Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result.read() Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 04 16:53:48.051541 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'f49a80c605354e0daf3f8759c70f55db-tempest-keypair-1921653808' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 4, 16, 53, 48, 15614), 'updated_at': None, 'name': 'tempest-keypair-1921653808', 'user_id': 'f49a80c605354e0daf3f8759c70f55db', 'fingerprint': 'f7:81:02:89:1b:bc:df:7f:31:64:4e:1e:22:3f:bf:0b', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJLPRegAjVeanHYUdhQAVLa35Qvq8+wSjg25wvj2fNjuOU2OocaC4S14NvmaDzawoj6s9Ei4LCQf8GdDwJqSKkruMr6SedY2flq3npNjZxEtJaGVNv/pBLNuYBRmyY3lg==', 'type': 'ssh'}] Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6730, in import_key_pair Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi keypair.create() Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._create() Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1921653808' already exists. Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 04 16:53:48.056762 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1921653808' already exists. Aug 04 16:53:48.065700 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.065700 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:48.065700 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.065700 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:48.065700 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:48.065700 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:48.065700 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:53:48.065700 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:53:48.065700 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1921653808' already exists. Aug 04 16:53:48.065700 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.068448 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8b4dbe56-e61d-4372-b1bf-d843607fa38b tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Returning 409 to user: Key pair 'tempest-keypair-1921653808' already exists. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:53:48.070531 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8b4dbe56-e61d-4372-b1bf-d843607fa38b tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.131176 Aug 04 16:53:48.072581 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1786/3511] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 16:53:47 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 135 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 04 16:53:48.074392 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-54217c49-f9ea-4785-bdee-81f2e118632b tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:48.074898 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-54217c49-f9ea-4785-bdee-81f2e118632b tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:48.076126 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-54217c49-f9ea-4785-bdee-81f2e118632b tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:48.076815 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-54217c49-f9ea-4785-bdee-81f2e118632b tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:48.082614 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bd9d9537-1a28-41c0-b9bb-0a8a3ddc0efe tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Calling method '.version_select at 0x7f7e77cc8790>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:48.124465 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bd9d9537-1a28-41c0-b9bb-0a8a3ddc0efe tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1921653808" status: 202 len: 0 microversion: 2.1 time: 0.046699 Aug 04 16:53:48.125718 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1787/3512] 10.222.0.23 () {58 vars in 1221 bytes} [Thu Aug 4 16:53:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1921653808 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:53:48.138660 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b19f83c1-36b6-4bb3-9140-049467b34a74 tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Action: 'create', calling method: .version_select at 0x7f7e77cc8ca0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLyhnBH8dnCmZDwsY+eRtXQW8Yr66fsbYG4Neo9IM0BWJQv8sOoQHJVZnvl139t+Yh/dGP7UnhJb42oiCuVurCzTXMWMkD49KCBlYdTc0AXqmT3kRddUrau4sJbY7PEZ/w=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b19f83c1-36b6-4bb3-9140-049467b34a74 tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Request method failure captured: Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 247 Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_mbrtzPDHSRWkU0RaW0SGjPog7MN07lfBY06X5KS8bmEpDXrouqvq_6wv8QMxuzHj-6fQ3aZcIU_eP5CE31v5dIVEs9_5y3W_D28_FbzAuMr73T53nTqtIlEyUexJNhR5NVqFmMWuBisCB7p2jEHV4Z1oEIVCYUgJsPY7xXw0lkEzc Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 3bce077a76024de5b1ce744983ff0c3a Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1004857266 Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3bce077a76024de5b1ce744983ff0c3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3bce077a76024de5b1ce744983ff0c3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3bce077a76024de5b1ce744983ff0c3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3bce077a76024de5b1ce744983ff0c3a"}]}] Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1004857266 Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 3bce077a76024de5b1ce744983ff0c3a Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1004857266 Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-KeyPairsNegativeTestJSON-1004857266-project Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: f49a80c605354e0daf3f8759c70f55db Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1004857266-project Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLyhnBH8dnCmZDwsY+eRtXQW8Yr66fsbYG4Neo9IM0BWJQv8sOoQHJVZnvl139t+Yh/dGP7UnhJb42oiCuVurCzTXMWMkD49KCBlYdTc0AXqmT3kRddUrau4sJbY7PEZ/w=="}} Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLyhnBH8dnCmZDwsY+eRtXQW8Yr66fsbYG4Neo9IM0BWJQv8sOoQHJVZnvl139t+Yh/dGP7UnhJb42oiCuVurCzTXMWMkD49KCBlYdTc0AXqmT3kRddUrau4sJbY7PEZ/w=='}}} Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi '' Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 16:53:48.144922 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 16:53:48.150868 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:53:48.150868 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:53:48.150868 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:53:48.150868 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:53:48.150868 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 04 16:53:48.150868 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.150868 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:48.150868 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.150868 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:48.150868 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:48.150868 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:48.150868 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:53:48.150868 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:53:48.150868 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 04 16:53:48.150868 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.154304 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b19f83c1-36b6-4bb3-9140-049467b34a74 tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:53:48.155449 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b19f83c1-36b6-4bb3-9140-049467b34a74 tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.021547 Aug 04 16:53:48.156928 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1788/3513] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 16:53:48 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:53:48.167372 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b5292f3e-2aa2-40b2-9ef6-b7a29f833660 tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Action: 'create', calling method: .version_select at 0x7f7e872b2280>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1736421381", "public_key": " "}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:53:48.187766 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-b5292f3e-2aa2-40b2-9ef6-b7a29f833660 tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Getting quotas for project 3bce077a76024de5b1ce744983ff0c3a. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:53:48.194265 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-b5292f3e-2aa2-40b2-9ef6-b7a29f833660 tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Getting quotas for user f49a80c605354e0daf3f8759c70f55db and project 3bce077a76024de5b1ce744983ff0c3a. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:53:48.238827 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-b5292f3e-2aa2-40b2-9ef6-b7a29f833660 tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b5292f3e-2aa2-40b2-9ef6-b7a29f833660 tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Request method failure captured: Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 95 Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_mbrtzPDHSRWkU0RaW0SGjPog7MN07lfBY06X5KS8bmEpDXrouqvq_6wv8QMxuzHj-6fQ3aZcIU_eP5CE31v5dIVEs9_5y3W_D28_FbzAuMr73T53nTqtIlEyUexJNhR5NVqFmMWuBisCB7p2jEHV4Z1oEIVCYUgJsPY7xXw0lkEzc Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 3bce077a76024de5b1ce744983ff0c3a Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1004857266 Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3bce077a76024de5b1ce744983ff0c3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3bce077a76024de5b1ce744983ff0c3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3bce077a76024de5b1ce744983ff0c3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3bce077a76024de5b1ce744983ff0c3a"}]}] Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1004857266 Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 3bce077a76024de5b1ce744983ff0c3a Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1004857266 Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-KeyPairsNegativeTestJSON-1004857266-project Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: f49a80c605354e0daf3f8759c70f55db Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1004857266-project Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1736421381", "public_key": " "}} Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: exception: Keypair data is invalid: failed to generate fingerprint Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1736421381', 'public_key': ' '}}} Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:48.241273 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.246370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:48.246370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:48.246370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:48.246370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:53:48.246370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:53:48.246370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:53:48.246370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:53:48.246370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:53:48.246370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:53:48.246370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:53:48.246370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:53:48.246370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:53:48.246370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:53:48.246370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 04 16:53:48.246370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 04 16:53:48.246370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 04 16:53:48.246370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 04 16:53:48.246370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 04 16:53:48.246370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.246370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:48.246370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.246370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:48.246370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:48.246370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:48.246370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:53:48.246370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:53:48.246370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 04 16:53:48.246370 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.246370 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b5292f3e-2aa2-40b2-9ef6-b7a29f833660 tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:53:48.246370 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b5292f3e-2aa2-40b2-9ef6-b7a29f833660 tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.080461 Aug 04 16:53:48.251236 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1789/3514] 10.222.0.23 () {60 vars in 1158 bytes} [Thu Aug 4 16:53:48 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 89 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 16:53:48.257851 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fe068413-e7e0-421e-8da0-13da7eb64d2a tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Action: 'create', calling method: .version_select at 0x7f7e872b21f0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1dCXGfXvJPc4PesS6YuQZpqLRow66wXkjvbUv6PoVNipXqAs7cYrY6liakezifoGigNuZqXwnAZOhTmOt4iN93Skma6PriAMXAnM+Z/R5/qHZdCl33swxLmslFDWlUPg=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fe068413-e7e0-421e-8da0-13da7eb64d2a tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Request method failure captured: Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 507 Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_mbrtzPDHSRWkU0RaW0SGjPog7MN07lfBY06X5KS8bmEpDXrouqvq_6wv8QMxuzHj-6fQ3aZcIU_eP5CE31v5dIVEs9_5y3W_D28_FbzAuMr73T53nTqtIlEyUexJNhR5NVqFmMWuBisCB7p2jEHV4Z1oEIVCYUgJsPY7xXw0lkEzc Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 3bce077a76024de5b1ce744983ff0c3a Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1004857266 Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3bce077a76024de5b1ce744983ff0c3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3bce077a76024de5b1ce744983ff0c3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3bce077a76024de5b1ce744983ff0c3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3bce077a76024de5b1ce744983ff0c3a"}]}] Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1004857266 Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 3bce077a76024de5b1ce744983ff0c3a Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1004857266 Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-KeyPairsNegativeTestJSON-1004857266-project Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: f49a80c605354e0daf3f8759c70f55db Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1004857266-project Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1dCXGfXvJPc4PesS6YuQZpqLRow66wXkjvbUv6PoVNipXqAs7cYrY6liakezifoGigNuZqXwnAZOhTmOt4iN93Skma6PriAMXAnM+Z/R5/qHZdCl33swxLmslFDWlUPg=="}} Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1dCXGfXvJPc4PesS6YuQZpqLRow66wXkjvbUv6PoVNipXqAs7cYrY6liakezifoGigNuZqXwnAZOhTmOt4iN93Skma6PriAMXAnM+Z/R5/qHZdCl33swxLmslFDWlUPg=='}}} Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 04 16:53:48.262851 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 04 16:53:48.267028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.267028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:48.267028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.267028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:48.267028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:48.267028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:48.267028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:53:48.267028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:53:48.267028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:53:48.267028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:53:48.267028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:53:48.267028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:53:48.267028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:53:48.267028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:53:48.267028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 16:53:48.267028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 16:53:48.267028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:53:48.267028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:53:48.267028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:53:48.267028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:53:48.267028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 04 16:53:48.267028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.267028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:48.267028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.267028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:48.267028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:48.267028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:48.267028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:53:48.267028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:53:48.267028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 04 16:53:48.267028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.267028 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fe068413-e7e0-421e-8da0-13da7eb64d2a tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:53:48.267028 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fe068413-e7e0-421e-8da0-13da7eb64d2a tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.011891 Aug 04 16:53:48.270400 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1790/3515] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 16:53:48 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:53:48.277316 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0284bf63-ca8b-4dbb-aa69-7f8e3f1bc4aa tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Action: 'create', calling method: .version_select at 0x7f7e77cc88b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-713266585", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:53:48.301139 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-0284bf63-ca8b-4dbb-aa69-7f8e3f1bc4aa tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Getting quotas for project 3bce077a76024de5b1ce744983ff0c3a. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:53:48.309233 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-0284bf63-ca8b-4dbb-aa69-7f8e3f1bc4aa tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Getting quotas for user f49a80c605354e0daf3f8759c70f55db and project 3bce077a76024de5b1ce744983ff0c3a. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:53:48.337565 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-0284bf63-ca8b-4dbb-aa69-7f8e3f1bc4aa tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0284bf63-ca8b-4dbb-aa69-7f8e3f1bc4aa tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Request method failure captured: Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 117 Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_mbrtzPDHSRWkU0RaW0SGjPog7MN07lfBY06X5KS8bmEpDXrouqvq_6wv8QMxuzHj-6fQ3aZcIU_eP5CE31v5dIVEs9_5y3W_D28_FbzAuMr73T53nTqtIlEyUexJNhR5NVqFmMWuBisCB7p2jEHV4Z1oEIVCYUgJsPY7xXw0lkEzc Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 3bce077a76024de5b1ce744983ff0c3a Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1004857266 Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3bce077a76024de5b1ce744983ff0c3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3bce077a76024de5b1ce744983ff0c3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3bce077a76024de5b1ce744983ff0c3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3bce077a76024de5b1ce744983ff0c3a"}]}] Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1004857266 Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 3bce077a76024de5b1ce744983ff0c3a Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1004857266 Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-KeyPairsNegativeTestJSON-1004857266-project Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: f49a80c605354e0daf3f8759c70f55db Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1004857266-project Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-713266585", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: exception: Keypair data is invalid: failed to generate fingerprint Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-713266585', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Aug 04 16:53:48.340502 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 04 16:53:48.348210 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 04 16:53:48.348210 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 04 16:53:48.348210 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 04 16:53:48.348210 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.348210 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:48.348210 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.348210 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:48.348210 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:48.348210 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:48.348210 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:53:48.348210 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:53:48.348210 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:53:48.348210 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:53:48.348210 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:53:48.348210 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:53:48.348210 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:53:48.348210 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:53:48.348210 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:53:48.348210 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:53:48.348210 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 04 16:53:48.348210 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 04 16:53:48.348210 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 04 16:53:48.348210 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 04 16:53:48.348210 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 04 16:53:48.348210 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.348210 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:48.348210 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.348210 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:48.348210 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:48.348210 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:48.348210 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:53:48.348210 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:53:48.348210 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 04 16:53:48.348210 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.355502 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0284bf63-ca8b-4dbb-aa69-7f8e3f1bc4aa tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:53:48.357169 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0284bf63-ca8b-4dbb-aa69-7f8e3f1bc4aa tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.084707 Aug 04 16:53:48.358208 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1791/3516] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 16:53:48 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 87 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 16:53:48.372754 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e5d73aad-a4f3-4cf7-9415-f7a5479416f0 tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Calling method '.version_select at 0x7f7e77d399d0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:48.389816 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-e5d73aad-a4f3-4cf7-9415-f7a5479416f0 tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1134293071 not found for user f49a80c605354e0daf3f8759c70f55db Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e5d73aad-a4f3-4cf7-9415-f7a5479416f0 tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Request method failure captured: Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1134293071 HTTP/1.1 Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_mbrtzPDHSRWkU0RaW0SGjPog7MN07lfBY06X5KS8bmEpDXrouqvq_6wv8QMxuzHj-6fQ3aZcIU_eP5CE31v5dIVEs9_5y3W_D28_FbzAuMr73T53nTqtIlEyUexJNhR5NVqFmMWuBisCB7p2jEHV4Z1oEIVCYUgJsPY7xXw0lkEzc Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 3bce077a76024de5b1ce744983ff0c3a Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1004857266 Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3bce077a76024de5b1ce744983ff0c3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3bce077a76024de5b1ce744983ff0c3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3bce077a76024de5b1ce744983ff0c3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3bce077a76024de5b1ce744983ff0c3a"}]}] Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1004857266 Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 3bce077a76024de5b1ce744983ff0c3a Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1004857266 Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-KeyPairsNegativeTestJSON-1004857266-project Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: f49a80c605354e0daf3f8759c70f55db Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1004857266-project Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: exception: Keypair tempest-keypair-non-existent-1134293071 not found for user f49a80c605354e0daf3f8759c70f55db Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'tempest-keypair-non-existent-1134293071'} Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6814, in delete_key_pair Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6835, in get_key_pair Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1134293071 not found for user f49a80c605354e0daf3f8759c70f55db Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.392207 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:48.398527 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.398527 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:48.398527 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:48.398527 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:48.398527 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:53:48.398527 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:53:48.398527 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:53:48.398527 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:53:48.398527 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 16:53:48.398527 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:53:48.398527 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:53:48.398527 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:53:48.398527 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 04 16:53:48.398527 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 04 16:53:48.398527 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 04 16:53:48.398527 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 04 16:53:48.398527 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1134293071 not found for user f49a80c605354e0daf3f8759c70f55db Aug 04 16:53:48.398527 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.398527 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:53:48.398527 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.398527 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:53:48.398527 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:53:48.398527 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:53:48.398527 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:53:48.398527 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:53:48.398527 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1134293071 not found for user f49a80c605354e0daf3f8759c70f55db Aug 04 16:53:48.398527 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:53:48.403090 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e5d73aad-a4f3-4cf7-9415-f7a5479416f0 tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1134293071 not found for user f49a80c605354e0daf3f8759c70f55db {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:53:48.404483 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e5d73aad-a4f3-4cf7-9415-f7a5479416f0 tempest-KeyPairsNegativeTestJSON-1004857266 tempest-KeyPairsNegativeTestJSON-1004857266-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1134293071" status: 404 len: 145 microversion: 2.1 time: 0.039209 Aug 04 16:53:48.405727 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1792/3517] 10.222.0.23 () {58 vars in 1260 bytes} [Thu Aug 4 16:53:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1134293071 => generated 145 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:53:48.524500 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-38cf0caa-30e6-46c3-a22d-ce66dca3a499 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:48.526981 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-38cf0caa-30e6-46c3-a22d-ce66dca3a499 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:48.538763 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-38cf0caa-30e6-46c3-a22d-ce66dca3a499 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:48.539717 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-38cf0caa-30e6-46c3-a22d-ce66dca3a499 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:48.540678 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-38cf0caa-30e6-46c3-a22d-ce66dca3a499 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:48.541840 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-38cf0caa-30e6-46c3-a22d-ce66dca3a499 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:48.678620 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-54217c49-f9ea-4785-bdee-81f2e118632b tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb604cd08fab4064a21854aeae139387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad03564b02f14ba1b99973ad27799f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:48.700531 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-54217c49-f9ea-4785-bdee-81f2e118632b tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] 10.222.0.23 "GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a" status: 200 len: 1325 microversion: 2.1 time: 0.661705 Aug 04 16:53:48.709659 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1726/3518] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:48 2022] GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a => generated 1325 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:48.936981 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-2625ea84-662a-456d-8384-505166fe7b94 req-896e7589-18bf-42ad-ae00-b4ebe232abef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fd8b1bc-a950-4d45-b35f-e6598e50ba1a", "tag": "18b20c55-1d72-4823-8ff3-1ccb4ff91fd1"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:53:48.957530 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-2625ea84-662a-456d-8384-505166fe7b94 req-896e7589-18bf-42ad-ae00-b4ebe232abef service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:48.958638 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-2625ea84-662a-456d-8384-505166fe7b94 req-896e7589-18bf-42ad-ae00-b4ebe232abef service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:48.987468 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-2625ea84-662a-456d-8384-505166fe7b94 req-896e7589-18bf-42ad-ae00-b4ebe232abef service nova] Creating event network-changed:18b20c55-1d72-4823-8ff3-1ccb4ff91fd1 for instance 0fd8b1bc-a950-4d45-b35f-e6598e50ba1a on n-h1-846466-12 Aug 04 16:53:49.001551 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-2625ea84-662a-456d-8384-505166fe7b94 req-896e7589-18bf-42ad-ae00-b4ebe232abef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068930 Aug 04 16:53:49.002283 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1727/3519] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:53:49.305122 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-38cf0caa-30e6-46c3-a22d-ce66dca3a499 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:49.314398 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-38cf0caa-30e6-46c3-a22d-ce66dca3a499 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 200 len: 1355 microversion: 2.1 time: 0.796567 Aug 04 16:53:49.316799 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1793/3520] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:48 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 1355 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:49.732747 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b0f8900e-b820-4d7c-834e-e4ac9e3ebcb8 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:49.733484 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b0f8900e-b820-4d7c-834e-e4ac9e3ebcb8 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] [instance: 0fd8b1bc-a950-4d45-b35f-e6598e50ba1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:49.749791 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b0f8900e-b820-4d7c-834e-e4ac9e3ebcb8 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:49.751737 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b0f8900e-b820-4d7c-834e-e4ac9e3ebcb8 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:49.756115 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b0f8900e-b820-4d7c-834e-e4ac9e3ebcb8 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:49.756666 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b0f8900e-b820-4d7c-834e-e4ac9e3ebcb8 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:50.340914 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4fea4117-33d6-4f94-b0da-83b11cb04dec tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:50.342973 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4fea4117-33d6-4f94-b0da-83b11cb04dec tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:50.360063 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4fea4117-33d6-4f94-b0da-83b11cb04dec tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:50.362446 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4fea4117-33d6-4f94-b0da-83b11cb04dec tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:50.366663 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4fea4117-33d6-4f94-b0da-83b11cb04dec tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:50.367555 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4fea4117-33d6-4f94-b0da-83b11cb04dec tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:51.685914 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b0f8900e-b820-4d7c-834e-e4ac9e3ebcb8 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb604cd08fab4064a21854aeae139387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad03564b02f14ba1b99973ad27799f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:51.735859 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b0f8900e-b820-4d7c-834e-e4ac9e3ebcb8 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] 10.222.0.23 "GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a" status: 200 len: 1325 microversion: 2.1 time: 1.979649 Aug 04 16:53:51.741170 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1728/3521] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:49 2022] GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a => generated 1325 bytes in 2010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:51.765594 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-99ede2da-5661-4096-ad0c-77a8c3962d9c req-469ba22d-45f5-433b-b7df-ead8e5f105f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "329e3811-2d1f-43ac-8c22-c2675ae6b9b8", "tag": "a718ac0b-984d-48a3-81aa-93b60f1cfb88"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:53:51.832825 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-99ede2da-5661-4096-ad0c-77a8c3962d9c req-469ba22d-45f5-433b-b7df-ead8e5f105f3 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:51.836578 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-99ede2da-5661-4096-ad0c-77a8c3962d9c req-469ba22d-45f5-433b-b7df-ead8e5f105f3 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:51.888505 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-99ede2da-5661-4096-ad0c-77a8c3962d9c req-469ba22d-45f5-433b-b7df-ead8e5f105f3 service nova] Creating event network-changed:a718ac0b-984d-48a3-81aa-93b60f1cfb88 for instance 329e3811-2d1f-43ac-8c22-c2675ae6b9b8 on n-h2-846466-12 Aug 04 16:53:51.912836 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-99ede2da-5661-4096-ad0c-77a8c3962d9c req-469ba22d-45f5-433b-b7df-ead8e5f105f3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164608 Aug 04 16:53:51.913833 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1729/3522] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:53:52.105968 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4fea4117-33d6-4f94-b0da-83b11cb04dec tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:52.115374 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4fea4117-33d6-4f94-b0da-83b11cb04dec tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 200 len: 1355 microversion: 2.1 time: 1.779099 Aug 04 16:53:52.120864 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1794/3523] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:50 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 1355 bytes in 1785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:52.758843 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dc00e931-6a97-4855-862a-7393bd3b502a tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:52.759551 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-dc00e931-6a97-4855-862a-7393bd3b502a tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] [instance: 0fd8b1bc-a950-4d45-b35f-e6598e50ba1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:52.775374 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dc00e931-6a97-4855-862a-7393bd3b502a tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:52.775873 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dc00e931-6a97-4855-862a-7393bd3b502a tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:52.776694 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dc00e931-6a97-4855-862a-7393bd3b502a tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:52.777123 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dc00e931-6a97-4855-862a-7393bd3b502a tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:53.152686 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a53f2c77-21cc-44a3-a18c-62e1b20bfea2 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:53.154760 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a53f2c77-21cc-44a3-a18c-62e1b20bfea2 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:53.185919 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a53f2c77-21cc-44a3-a18c-62e1b20bfea2 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:53.191575 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a53f2c77-21cc-44a3-a18c-62e1b20bfea2 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:53.193569 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a53f2c77-21cc-44a3-a18c-62e1b20bfea2 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:53.194215 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a53f2c77-21cc-44a3-a18c-62e1b20bfea2 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:53.607602 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-dc00e931-6a97-4855-862a-7393bd3b502a tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb604cd08fab4064a21854aeae139387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad03564b02f14ba1b99973ad27799f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:53.627545 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dc00e931-6a97-4855-862a-7393bd3b502a tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] 10.222.0.23 "GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a" status: 200 len: 1325 microversion: 2.1 time: 0.873116 Aug 04 16:53:53.636195 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1730/3524] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:52 2022] GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a => generated 1325 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:53.976106 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a53f2c77-21cc-44a3-a18c-62e1b20bfea2 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:54.015005 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a53f2c77-21cc-44a3-a18c-62e1b20bfea2 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 200 len: 1355 microversion: 2.1 time: 0.871432 Aug 04 16:53:54.023573 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1795/3525] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:53 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 1355 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:54.665926 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8a051c0c-7828-4693-b577-b7e3fe7f04fa tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:54.667311 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8a051c0c-7828-4693-b577-b7e3fe7f04fa tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] [instance: 0fd8b1bc-a950-4d45-b35f-e6598e50ba1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:54.682149 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a051c0c-7828-4693-b577-b7e3fe7f04fa tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:54.684847 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a051c0c-7828-4693-b577-b7e3fe7f04fa tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:54.685943 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a051c0c-7828-4693-b577-b7e3fe7f04fa tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:54.686955 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a051c0c-7828-4693-b577-b7e3fe7f04fa tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:55.060918 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-df4cb564-8321-496d-94ed-f3d675881141 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:55.064056 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-df4cb564-8321-496d-94ed-f3d675881141 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:55.084746 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df4cb564-8321-496d-94ed-f3d675881141 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:55.088071 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df4cb564-8321-496d-94ed-f3d675881141 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:55.092659 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df4cb564-8321-496d-94ed-f3d675881141 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:55.093611 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df4cb564-8321-496d-94ed-f3d675881141 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:55.875884 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-df4cb564-8321-496d-94ed-f3d675881141 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:55.891626 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-df4cb564-8321-496d-94ed-f3d675881141 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 200 len: 1355 microversion: 2.1 time: 0.832938 Aug 04 16:53:55.905319 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1796/3526] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:55 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 1355 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:55.996005 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8a051c0c-7828-4693-b577-b7e3fe7f04fa tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb604cd08fab4064a21854aeae139387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad03564b02f14ba1b99973ad27799f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:56.004436 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8a051c0c-7828-4693-b577-b7e3fe7f04fa tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] 10.222.0.23 "GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a" status: 200 len: 1325 microversion: 2.1 time: 1.348672 Aug 04 16:53:56.010147 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1731/3527] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:54 2022] GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a => generated 1325 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:56.185545 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-95974e82-804e-4dae-954d-fa44efdd35fe tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-940286058", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": "none"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:53:56.302358 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-95974e82-804e-4dae-954d-fa44efdd35fe tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:53:56.302772 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-95974e82-804e-4dae-954d-fa44efdd35fe tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:53:56.303316 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-95974e82-804e-4dae-954d-fa44efdd35fe tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:53:56.304364 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-95974e82-804e-4dae-954d-fa44efdd35fe tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:53:56.304830 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-95974e82-804e-4dae-954d-fa44efdd35fe tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:53:56.334174 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-95974e82-804e-4dae-954d-fa44efdd35fe tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:56.334957 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-95974e82-804e-4dae-954d-fa44efdd35fe tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:56.336079 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-95974e82-804e-4dae-954d-fa44efdd35fe tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:56.337569 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-95974e82-804e-4dae-954d-fa44efdd35fe tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:56.395373 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-95974e82-804e-4dae-954d-fa44efdd35fe tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Getting quotas for project 1a0f43fe131c471f96682a4fcd03ac99. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:53:56.407717 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-95974e82-804e-4dae-954d-fa44efdd35fe tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Getting quotas for user bb62865fda96428f92859aa585c6bae9 and project 1a0f43fe131c471f96682a4fcd03ac99. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:53:56.447503 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-95974e82-804e-4dae-954d-fa44efdd35fe tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:53:56.470380 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-95974e82-804e-4dae-954d-fa44efdd35fe tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: 4cedf22c-90c4-4dcd-8983-4ac09ba94d70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:53:56.586520 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-95974e82-804e-4dae-954d-fa44efdd35fe tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.690517 Aug 04 16:53:56.587563 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1797/3528] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Aug 4 16:53:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 16:53:56.600671 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-140c854b-8f98-4c0c-b574-178b670adadd tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:56.600946 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-140c854b-8f98-4c0c-b574-178b670adadd tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: 4cedf22c-90c4-4dcd-8983-4ac09ba94d70] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:56.915399 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-223e2ef8-df4b-48d9-b6ff-861a6b58f2e2 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:56.916133 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-223e2ef8-df4b-48d9-b6ff-861a6b58f2e2 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:56.939816 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-223e2ef8-df4b-48d9-b6ff-861a6b58f2e2 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:56.942987 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-223e2ef8-df4b-48d9-b6ff-861a6b58f2e2 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:56.948213 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-223e2ef8-df4b-48d9-b6ff-861a6b58f2e2 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:56.949166 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-223e2ef8-df4b-48d9-b6ff-861a6b58f2e2 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:57.883084 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-140c854b-8f98-4c0c-b574-178b670adadd tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:57.918415 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-140c854b-8f98-4c0c-b574-178b670adadd tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:57.932275 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-140c854b-8f98-4c0c-b574-178b670adadd tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:57.935115 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-140c854b-8f98-4c0c-b574-178b670adadd tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "GET /compute/v2.1/servers/4cedf22c-90c4-4dcd-8983-4ac09ba94d70" status: 200 len: 1277 microversion: 2.47 time: 1.339793 Aug 04 16:53:57.997671 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1732/3529] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:53:56 2022] GET /compute/v2.1/servers/4cedf22c-90c4-4dcd-8983-4ac09ba94d70 => generated 1277 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:53:58.037207 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1c559b68-bcc7-461b-8410-9e4a02a4ebea tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:53:58.038988 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1c559b68-bcc7-461b-8410-9e4a02a4ebea tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] [instance: 0fd8b1bc-a950-4d45-b35f-e6598e50ba1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:53:58.067846 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c559b68-bcc7-461b-8410-9e4a02a4ebea tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:58.073525 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c559b68-bcc7-461b-8410-9e4a02a4ebea tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:58.088373 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c559b68-bcc7-461b-8410-9e4a02a4ebea tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:53:58.090547 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c559b68-bcc7-461b-8410-9e4a02a4ebea tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:53:59.887019 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1c559b68-bcc7-461b-8410-9e4a02a4ebea tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb604cd08fab4064a21854aeae139387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad03564b02f14ba1b99973ad27799f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:59.903730 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1c559b68-bcc7-461b-8410-9e4a02a4ebea tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] 10.222.0.23 "GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a" status: 200 len: 1325 microversion: 2.1 time: 1.904410 Aug 04 16:53:59.909154 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-223e2ef8-df4b-48d9-b6ff-861a6b58f2e2 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:53:59.918052 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1733/3530] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:57 2022] GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a => generated 1325 bytes in 1920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:59.924443 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-223e2ef8-df4b-48d9-b6ff-861a6b58f2e2 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 200 len: 1355 microversion: 2.1 time: 3.012899 Aug 04 16:53:59.926347 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1798/3531] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:53:56 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 1355 bytes in 3016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:53:59.935869 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-047d94dc-0f50-458a-9d8f-c0d4a30599c2 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1313487151", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": "none"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:00.064766 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-047d94dc-0f50-458a-9d8f-c0d4a30599c2 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:54:00.065589 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-047d94dc-0f50-458a-9d8f-c0d4a30599c2 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:54:00.066709 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-047d94dc-0f50-458a-9d8f-c0d4a30599c2 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:54:00.067321 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-047d94dc-0f50-458a-9d8f-c0d4a30599c2 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:54:00.067931 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-047d94dc-0f50-458a-9d8f-c0d4a30599c2 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:54:00.083469 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-48f085af-9abd-491a-8452-3375ac50ce38 req-28dc74f6-7a69-4777-80b1-29339f7e37b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fd8b1bc-a950-4d45-b35f-e6598e50ba1a", "name": "network-vif-plugged", "status": "completed", "tag": "18b20c55-1d72-4823-8ff3-1ccb4ff91fd1"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:00.095667 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-047d94dc-0f50-458a-9d8f-c0d4a30599c2 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:00.096838 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-047d94dc-0f50-458a-9d8f-c0d4a30599c2 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:00.097947 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-047d94dc-0f50-458a-9d8f-c0d4a30599c2 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:00.098568 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-047d94dc-0f50-458a-9d8f-c0d4a30599c2 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:00.104505 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-48f085af-9abd-491a-8452-3375ac50ce38 req-28dc74f6-7a69-4777-80b1-29339f7e37b0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:00.107488 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-48f085af-9abd-491a-8452-3375ac50ce38 req-28dc74f6-7a69-4777-80b1-29339f7e37b0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:00.127437 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-48f085af-9abd-491a-8452-3375ac50ce38 req-28dc74f6-7a69-4777-80b1-29339f7e37b0 service nova] Creating event network-vif-plugged:18b20c55-1d72-4823-8ff3-1ccb4ff91fd1 for instance 0fd8b1bc-a950-4d45-b35f-e6598e50ba1a on n-h1-846466-12 Aug 04 16:54:00.134208 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-48f085af-9abd-491a-8452-3375ac50ce38 req-28dc74f6-7a69-4777-80b1-29339f7e37b0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206189 Aug 04 16:54:00.135669 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1799/3532] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:00.178452 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-047d94dc-0f50-458a-9d8f-c0d4a30599c2 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Getting quotas for project 1a0f43fe131c471f96682a4fcd03ac99. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:54:00.202632 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-047d94dc-0f50-458a-9d8f-c0d4a30599c2 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Getting quotas for user bb62865fda96428f92859aa585c6bae9 and project 1a0f43fe131c471f96682a4fcd03ac99. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:54:00.261189 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-047d94dc-0f50-458a-9d8f-c0d4a30599c2 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:54:00.286742 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-047d94dc-0f50-458a-9d8f-c0d4a30599c2 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:54:00.450616 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-047d94dc-0f50-458a-9d8f-c0d4a30599c2 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.524801 Aug 04 16:54:00.464552 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-610cac2c-064c-4df4-8887-aaa48c3b1ad0 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:00.465772 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1734/3533] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Aug 4 16:53:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 16:54:00.470770 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-610cac2c-064c-4df4-8887-aaa48c3b1ad0 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:00.591923 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-610cac2c-064c-4df4-8887-aaa48c3b1ad0 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "PUT /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192" status: 200 len: 992 microversion: 2.47 time: 0.132551 Aug 04 16:54:00.606835 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1800/3534] 10.222.0.23 () {62 vars in 1297 bytes} [Thu Aug 4 16:54:00 2022] PUT /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192 => generated 992 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:54:00.614340 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d8b23839-0faa-49cd-89ec-576854001313 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:00.615497 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d8b23839-0faa-49cd-89ec-576854001313 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:00.758984 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d8b23839-0faa-49cd-89ec-576854001313 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:00.770965 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d8b23839-0faa-49cd-89ec-576854001313 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:00.773363 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d8b23839-0faa-49cd-89ec-576854001313 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:00.775114 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d8b23839-0faa-49cd-89ec-576854001313 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192" status: 200 len: 1278 microversion: 2.47 time: 0.165678 Aug 04 16:54:00.776302 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1735/3535] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:54:00 2022] GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192 => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:54:00.954056 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5f37f0ba-d611-4456-b3e5-29f81da254cb tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:00.955503 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f6546f02-1471-4c19-b1bc-a41c94edf97f tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:00.956168 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5f37f0ba-d611-4456-b3e5-29f81da254cb tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:00.960207 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f6546f02-1471-4c19-b1bc-a41c94edf97f tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] [instance: 0fd8b1bc-a950-4d45-b35f-e6598e50ba1a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:00.963258 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5f37f0ba-d611-4456-b3e5-29f81da254cb tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:00.965101 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5f37f0ba-d611-4456-b3e5-29f81da254cb tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:00.967603 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5f37f0ba-d611-4456-b3e5-29f81da254cb tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:00.969965 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5f37f0ba-d611-4456-b3e5-29f81da254cb tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:01.018285 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:01.063667 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f6546f02-1471-4c19-b1bc-a41c94edf97f tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:01.066861 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f6546f02-1471-4c19-b1bc-a41c94edf97f tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:01.068483 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f6546f02-1471-4c19-b1bc-a41c94edf97f tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:01.069154 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f6546f02-1471-4c19-b1bc-a41c94edf97f tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:01.816563 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f6546f02-1471-4c19-b1bc-a41c94edf97f tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb604cd08fab4064a21854aeae139387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad03564b02f14ba1b99973ad27799f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:01.833988 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f6546f02-1471-4c19-b1bc-a41c94edf97f tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] 10.222.0.23 "GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a" status: 200 len: 1325 microversion: 2.1 time: 0.893907 Aug 04 16:54:01.835217 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1801/3536] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:00 2022] GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a => generated 1325 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:01.840374 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5f37f0ba-d611-4456-b3e5-29f81da254cb tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:01.849935 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b52abe99-684c-4385-8b81-20cb5c786973 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:01.852129 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b52abe99-684c-4385-8b81-20cb5c786973 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:01.856479 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5f37f0ba-d611-4456-b3e5-29f81da254cb tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 200 len: 1355 microversion: 2.1 time: 0.909936 Aug 04 16:54:01.858970 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1736/3537] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:00 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 1355 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:01.876793 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b52abe99-684c-4385-8b81-20cb5c786973 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:01.878725 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b52abe99-684c-4385-8b81-20cb5c786973 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:01.882141 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b52abe99-684c-4385-8b81-20cb5c786973 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:01.882765 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b52abe99-684c-4385-8b81-20cb5c786973 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:02.276465 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b52abe99-684c-4385-8b81-20cb5c786973 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:02.299139 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b52abe99-684c-4385-8b81-20cb5c786973 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:02.307666 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b52abe99-684c-4385-8b81-20cb5c786973 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:02.313705 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b52abe99-684c-4385-8b81-20cb5c786973 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192" status: 200 len: 1274 microversion: 2.47 time: 0.474877 Aug 04 16:54:02.318496 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1802/3538] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:54:01 2022] GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192 => generated 1274 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:54:02.875557 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a860efb8-1b22-4018-a58b-21e07adbd8cf tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:02.876863 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a860efb8-1b22-4018-a58b-21e07adbd8cf tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] [instance: 0fd8b1bc-a950-4d45-b35f-e6598e50ba1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:02.892608 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0a7c02e5-28eb-4496-b93e-6a43dc3ee61b tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:02.894144 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0a7c02e5-28eb-4496-b93e-6a43dc3ee61b tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:02.899281 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a860efb8-1b22-4018-a58b-21e07adbd8cf tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:02.904573 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a860efb8-1b22-4018-a58b-21e07adbd8cf tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:02.910477 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a860efb8-1b22-4018-a58b-21e07adbd8cf tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:02.911288 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a860efb8-1b22-4018-a58b-21e07adbd8cf tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:02.912785 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0a7c02e5-28eb-4496-b93e-6a43dc3ee61b tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:02.914529 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0a7c02e5-28eb-4496-b93e-6a43dc3ee61b tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:02.921913 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0a7c02e5-28eb-4496-b93e-6a43dc3ee61b tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:02.924451 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0a7c02e5-28eb-4496-b93e-6a43dc3ee61b tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:03.721175 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0a7c02e5-28eb-4496-b93e-6a43dc3ee61b tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:03.736842 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0a7c02e5-28eb-4496-b93e-6a43dc3ee61b tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 200 len: 1355 microversion: 2.1 time: 0.848357 Aug 04 16:54:03.743643 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1803/3539] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:02 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 1355 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:03.765328 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d5324701-3e60-45ca-ba0f-5fc389d95de9 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:03.766264 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d5324701-3e60-45ca-ba0f-5fc389d95de9 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:03.789401 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d5324701-3e60-45ca-ba0f-5fc389d95de9 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:03.789858 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d5324701-3e60-45ca-ba0f-5fc389d95de9 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:03.790663 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d5324701-3e60-45ca-ba0f-5fc389d95de9 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:03.791105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d5324701-3e60-45ca-ba0f-5fc389d95de9 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:03.919660 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a860efb8-1b22-4018-a58b-21e07adbd8cf tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb604cd08fab4064a21854aeae139387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad03564b02f14ba1b99973ad27799f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:03.929324 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a860efb8-1b22-4018-a58b-21e07adbd8cf tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] 10.222.0.23 "GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a" status: 200 len: 1522 microversion: 2.1 time: 1.059124 Aug 04 16:54:03.929938 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1737/3540] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:02 2022] GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a => generated 1522 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:03.954238 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7f1814bc-1d1a-441f-b033-88fb72cf408f tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:03.954741 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7f1814bc-1d1a-441f-b033-88fb72cf408f tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] [instance: 0fd8b1bc-a950-4d45-b35f-e6598e50ba1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:03.986936 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f1814bc-1d1a-441f-b033-88fb72cf408f tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:03.989274 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f1814bc-1d1a-441f-b033-88fb72cf408f tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:04.003543 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f1814bc-1d1a-441f-b033-88fb72cf408f tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:04.006376 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f1814bc-1d1a-441f-b033-88fb72cf408f tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:04.045181 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d5324701-3e60-45ca-ba0f-5fc389d95de9 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:04.060119 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d5324701-3e60-45ca-ba0f-5fc389d95de9 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:04.068129 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d5324701-3e60-45ca-ba0f-5fc389d95de9 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:04.075030 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d5324701-3e60-45ca-ba0f-5fc389d95de9 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192" status: 200 len: 1336 microversion: 2.47 time: 0.329765 Aug 04 16:54:04.084566 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1804/3541] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:54:03 2022] GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192 => generated 1336 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:54:04.089496 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-7f1814bc-1d1a-441f-b033-88fb72cf408f tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] HTTP exception thrown: Instance is not a member of specified network Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7f1814bc-1d1a-441f-b033-88fb72cf408f tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Request method failure captured: Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a/ips/invalid HTTP/1.1 Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_mLJU5j2UezrvfjDAK0f7T4nPdVJjEhE3V4671pJwZy5K1vdC-z2KHwBNfcMvGdvstw7N0s3M--qCs11_apGbghC7mh0WkcXpAj6CTAp3gz9XaxwHSEOo6lEFRQNTOYe7IbIMb-QEG66WZ6s5DKLm0uCWFjOB6eITsQFPuK9kSL_qU Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: ad03564b02f14ba1b99973ad27799f9d Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1027984076 Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad03564b02f14ba1b99973ad27799f9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ad03564b02f14ba1b99973ad27799f9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad03564b02f14ba1b99973ad27799f9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ad03564b02f14ba1b99973ad27799f9d"}]}] Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1027984076 Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: ad03564b02f14ba1b99973ad27799f9d Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1027984076 Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServerAddressesNegativeTestJSON-1027984076-project Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: eb604cd08fab4064a21854aeae139387 Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1027984076-project Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance is not a member of specified network Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'server_id': '0fd8b1bc-a950-4d45-b35f-e6598e50ba1a', 'id': 'invalid'} Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 04 16:54:04.098782 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:54:04.104540 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7f1814bc-1d1a-441f-b033-88fb72cf408f tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Returning 404 to user: Instance is not a member of specified network {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:54:04.105690 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7f1814bc-1d1a-441f-b033-88fb72cf408f tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] 10.222.0.23 "GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.159220 Aug 04 16:54:04.106958 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1738/3542] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 16:54:03 2022] GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a/ips/invalid => generated 91 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 04 16:54:04.116330 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-156f10ed-d30a-4c0d-9afa-0b4b82730ad0 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:04.117311 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-156f10ed-d30a-4c0d-9afa-0b4b82730ad0 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Failed to fetch instance by id 999 {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 04 16:54:04.118032 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-156f10ed-d30a-4c0d-9afa-0b4b82730ad0 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] HTTP exception thrown: Instance 999 could not be found. Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-156f10ed-d30a-4c0d-9afa-0b4b82730ad0 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Request method failure captured: Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_mLJU5j2UezrvfjDAK0f7T4nPdVJjEhE3V4671pJwZy5K1vdC-z2KHwBNfcMvGdvstw7N0s3M--qCs11_apGbghC7mh0WkcXpAj6CTAp3gz9XaxwHSEOo6lEFRQNTOYe7IbIMb-QEG66WZ6s5DKLm0uCWFjOB6eITsQFPuK9kSL_qU Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: ad03564b02f14ba1b99973ad27799f9d Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1027984076 Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad03564b02f14ba1b99973ad27799f9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ad03564b02f14ba1b99973ad27799f9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad03564b02f14ba1b99973ad27799f9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ad03564b02f14ba1b99973ad27799f9d"}]}] Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1027984076 Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: ad03564b02f14ba1b99973ad27799f9d Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1027984076 Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerAddressesNegativeTestJSON-1027984076-project Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: eb604cd08fab4064a21854aeae139387 Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1027984076-project Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 999 could not be found. Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'server_id': '999'} Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 04 16:54:04.120028 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:54:04.126883 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-156f10ed-d30a-4c0d-9afa-0b4b82730ad0 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Returning 404 to user: Instance 999 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:54:04.130525 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-156f10ed-d30a-4c0d-9afa-0b4b82730ad0 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] 10.222.0.23 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.018115 Aug 04 16:54:04.131332 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1805/3543] 10.222.0.23 () {58 vars in 1149 bytes} [Thu Aug 4 16:54:04 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:54:04.142343 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-10a48b84-489d-464a-82bd-3d945c0cc793 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:04.143146 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-10a48b84-489d-464a-82bd-3d945c0cc793 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] [instance: 0fd8b1bc-a950-4d45-b35f-e6598e50ba1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:04.154081 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-10a48b84-489d-464a-82bd-3d945c0cc793 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:04.156936 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-10a48b84-489d-464a-82bd-3d945c0cc793 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:04.158053 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-10a48b84-489d-464a-82bd-3d945c0cc793 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:04.162026 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-10a48b84-489d-464a-82bd-3d945c0cc793 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:04.239009 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-10a48b84-489d-464a-82bd-3d945c0cc793 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] [instance: 0fd8b1bc-a950-4d45-b35f-e6598e50ba1a] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:54:04.487030 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-10a48b84-489d-464a-82bd-3d945c0cc793 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a" status: 204 len: 0 microversion: 2.1 time: 0.348160 Aug 04 16:54:04.492986 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1739/3544] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:54:04 2022] DELETE /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:54:04.503049 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f3cb8201-da0a-472a-bcee-1a3d7cf9d4c1 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:04.507630 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f3cb8201-da0a-472a-bcee-1a3d7cf9d4c1 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] [instance: 0fd8b1bc-a950-4d45-b35f-e6598e50ba1a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:04.547739 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3cb8201-da0a-472a-bcee-1a3d7cf9d4c1 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:04.548464 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3cb8201-da0a-472a-bcee-1a3d7cf9d4c1 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:04.549348 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3cb8201-da0a-472a-bcee-1a3d7cf9d4c1 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:04.549797 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3cb8201-da0a-472a-bcee-1a3d7cf9d4c1 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:04.782635 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-86bb68a2-eeb8-4703-aa87-21aedf157d9a tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:04.785637 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-86bb68a2-eeb8-4703-aa87-21aedf157d9a tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:04.812584 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-86bb68a2-eeb8-4703-aa87-21aedf157d9a tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:04.813053 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-86bb68a2-eeb8-4703-aa87-21aedf157d9a tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:04.816347 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-86bb68a2-eeb8-4703-aa87-21aedf157d9a tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:04.816846 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-86bb68a2-eeb8-4703-aa87-21aedf157d9a tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:05.861457 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f3cb8201-da0a-472a-bcee-1a3d7cf9d4c1 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb604cd08fab4064a21854aeae139387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad03564b02f14ba1b99973ad27799f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:05.881980 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f3cb8201-da0a-472a-bcee-1a3d7cf9d4c1 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] 10.222.0.23 "GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a" status: 200 len: 1528 microversion: 2.1 time: 1.386767 Aug 04 16:54:05.885781 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1806/3545] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:04 2022] GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a => generated 1528 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:05.908468 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c713bd49-7e75-405d-95b3-9bd213ad5362 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:05.910387 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c713bd49-7e75-405d-95b3-9bd213ad5362 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:05.928204 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c713bd49-7e75-405d-95b3-9bd213ad5362 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:05.928633 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c713bd49-7e75-405d-95b3-9bd213ad5362 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:05.929755 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c713bd49-7e75-405d-95b3-9bd213ad5362 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:05.930203 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c713bd49-7e75-405d-95b3-9bd213ad5362 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:05.945520 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-86bb68a2-eeb8-4703-aa87-21aedf157d9a tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:05.971067 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-86bb68a2-eeb8-4703-aa87-21aedf157d9a tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 200 len: 1355 microversion: 2.1 time: 1.196177 Aug 04 16:54:05.973064 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1740/3546] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:04 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 1355 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:06.092936 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c713bd49-7e75-405d-95b3-9bd213ad5362 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:06.116168 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c713bd49-7e75-405d-95b3-9bd213ad5362 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:06.117658 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c713bd49-7e75-405d-95b3-9bd213ad5362 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:06.166418 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c713bd49-7e75-405d-95b3-9bd213ad5362 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192" status: 200 len: 1336 microversion: 2.47 time: 0.272217 Aug 04 16:54:06.166999 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1807/3547] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:54:05 2022] GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192 => generated 1336 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:54:06.920621 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0dc2f0c5-0c2d-47a3-8110-ec3ee7e710ea tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:06.921479 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0dc2f0c5-0c2d-47a3-8110-ec3ee7e710ea tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] [instance: 0fd8b1bc-a950-4d45-b35f-e6598e50ba1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:06.934594 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=3,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:06.942234 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0dc2f0c5-0c2d-47a3-8110-ec3ee7e710ea tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:06.945845 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0dc2f0c5-0c2d-47a3-8110-ec3ee7e710ea tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:06.949014 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0dc2f0c5-0c2d-47a3-8110-ec3ee7e710ea tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:06.950063 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0dc2f0c5-0c2d-47a3-8110-ec3ee7e710ea tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:06.998514 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-91409daf-cacb-4c7c-a46f-141e80d00a11 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:06.999243 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-91409daf-cacb-4c7c-a46f-141e80d00a11 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:07.002597 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:07.003250 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=22 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:07.020729 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-91409daf-cacb-4c7c-a46f-141e80d00a11 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:07.021367 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-91409daf-cacb-4c7c-a46f-141e80d00a11 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:07.033947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-91409daf-cacb-4c7c-a46f-141e80d00a11 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:07.034406 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-91409daf-cacb-4c7c-a46f-141e80d00a11 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:07.863748 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-91409daf-cacb-4c7c-a46f-141e80d00a11 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:07.880012 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-91409daf-cacb-4c7c-a46f-141e80d00a11 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 200 len: 1355 microversion: 2.1 time: 0.886119 Aug 04 16:54:07.885376 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1808/3548] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:06 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 1355 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:07.894077 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d549defb-3717-4d19-902f-177982b6b8a9 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:07.898453 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d549defb-3717-4d19-902f-177982b6b8a9 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:07.921957 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d549defb-3717-4d19-902f-177982b6b8a9 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:07.922611 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d549defb-3717-4d19-902f-177982b6b8a9 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:07.924452 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d549defb-3717-4d19-902f-177982b6b8a9 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:07.924903 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d549defb-3717-4d19-902f-177982b6b8a9 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:08.004418 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0dc2f0c5-0c2d-47a3-8110-ec3ee7e710ea tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb604cd08fab4064a21854aeae139387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad03564b02f14ba1b99973ad27799f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:08.016210 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:08.022713 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0dc2f0c5-0c2d-47a3-8110-ec3ee7e710ea tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] 10.222.0.23 "GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a" status: 200 len: 1528 microversion: 2.1 time: 1.107202 Aug 04 16:54:08.041509 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1741/3549] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:06 2022] GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a => generated 1528 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:08.246700 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d549defb-3717-4d19-902f-177982b6b8a9 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:08.277204 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d549defb-3717-4d19-902f-177982b6b8a9 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:08.283170 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d549defb-3717-4d19-902f-177982b6b8a9 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:08.290508 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d549defb-3717-4d19-902f-177982b6b8a9 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192" status: 200 len: 1357 microversion: 2.47 time: 0.397537 Aug 04 16:54:08.291193 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1809/3550] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:54:07 2022] GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192 => generated 1357 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:54:08.319624 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-08f27390-5a87-46df-bfeb-3533d2fe783f tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:08.323435 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-08f27390-5a87-46df-bfeb-3533d2fe783f tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:08.332988 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-08f27390-5a87-46df-bfeb-3533d2fe783f tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:08.334048 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-08f27390-5a87-46df-bfeb-3533d2fe783f tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:08.335676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-08f27390-5a87-46df-bfeb-3533d2fe783f tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:08.336831 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-08f27390-5a87-46df-bfeb-3533d2fe783f tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:08.552747 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-08f27390-5a87-46df-bfeb-3533d2fe783f tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:54:08.563473 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-08f27390-5a87-46df-bfeb-3533d2fe783f tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:54:08.567716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-08f27390-5a87-46df-bfeb-3533d2fe783f tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:54:08.568263 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-08f27390-5a87-46df-bfeb-3533d2fe783f tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:54:08.570928 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-08f27390-5a87-46df-bfeb-3533d2fe783f tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:54:08.818828 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-08f27390-5a87-46df-bfeb-3533d2fe783f tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:08.837169 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-08f27390-5a87-46df-bfeb-3533d2fe783f tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:08.837994 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-08f27390-5a87-46df-bfeb-3533d2fe783f tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:08.839257 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-08f27390-5a87-46df-bfeb-3533d2fe783f tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:08.840139 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-08f27390-5a87-46df-bfeb-3533d2fe783f tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:08.914216 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-809d30ef-7561-4a35-beaa-71d88db43d14 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:08.915021 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-809d30ef-7561-4a35-beaa-71d88db43d14 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:08.925601 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-08f27390-5a87-46df-bfeb-3533d2fe783f tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "POST /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192/action" status: 202 len: 1079 microversion: 2.47 time: 0.614752 Aug 04 16:54:08.928633 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1742/3551] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Aug 4 16:54:08 2022] POST /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192/action => generated 1079 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 04 16:54:08.939868 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-809d30ef-7561-4a35-beaa-71d88db43d14 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:08.940675 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-809d30ef-7561-4a35-beaa-71d88db43d14 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:08.941673 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-809d30ef-7561-4a35-beaa-71d88db43d14 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:08.949874 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-809d30ef-7561-4a35-beaa-71d88db43d14 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:08.963529 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5476f32a-615d-4d65-a036-db9c6a9a3cd6 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:08.964156 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5476f32a-615d-4d65-a036-db9c6a9a3cd6 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:08.982471 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5476f32a-615d-4d65-a036-db9c6a9a3cd6 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:08.994675 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5476f32a-615d-4d65-a036-db9c6a9a3cd6 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:08.995655 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5476f32a-615d-4d65-a036-db9c6a9a3cd6 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:08.996111 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5476f32a-615d-4d65-a036-db9c6a9a3cd6 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:09.267246 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5476f32a-615d-4d65-a036-db9c6a9a3cd6 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:09.291422 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5476f32a-615d-4d65-a036-db9c6a9a3cd6 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:09.293037 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5476f32a-615d-4d65-a036-db9c6a9a3cd6 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:09.294288 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5476f32a-615d-4d65-a036-db9c6a9a3cd6 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192" status: 200 len: 1366 microversion: 2.47 time: 0.347790 Aug 04 16:54:09.294841 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1743/3552] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:54:08 2022] GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192 => generated 1366 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:54:09.319216 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-95b50f66-18bd-447d-8d4d-525ff77ee410 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:09.319829 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-95b50f66-18bd-447d-8d4d-525ff77ee410 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] [instance: 0fd8b1bc-a950-4d45-b35f-e6598e50ba1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:09.354540 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-95b50f66-18bd-447d-8d4d-525ff77ee410 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:09.355075 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-95b50f66-18bd-447d-8d4d-525ff77ee410 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:09.356032 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-95b50f66-18bd-447d-8d4d-525ff77ee410 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:09.387580 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-95b50f66-18bd-447d-8d4d-525ff77ee410 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:09.893810 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-95b50f66-18bd-447d-8d4d-525ff77ee410 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb604cd08fab4064a21854aeae139387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad03564b02f14ba1b99973ad27799f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:09.934851 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-95b50f66-18bd-447d-8d4d-525ff77ee410 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] 10.222.0.23 "GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a" status: 200 len: 1486 microversion: 2.1 time: 0.627467 Aug 04 16:54:09.967039 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1744/3553] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:09 2022] GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a => generated 1486 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:10.104076 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-809d30ef-7561-4a35-beaa-71d88db43d14 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:10.105907 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-374afaa0-b6ff-40c8-8fc4-aff772fac3c1 req-a7ed7f31-8b94-494e-8a72-e1c92cc4a765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fd8b1bc-a950-4d45-b35f-e6598e50ba1a", "name": "network-vif-deleted", "tag": "18b20c55-1d72-4823-8ff3-1ccb4ff91fd1"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:10.110690 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=100 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:10.143775 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-809d30ef-7561-4a35-beaa-71d88db43d14 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 200 len: 1355 microversion: 2.1 time: 1.234064 Aug 04 16:54:10.144414 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1810/3554] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:08 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 1355 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:54:10.150432 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:10.160389 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-374afaa0-b6ff-40c8-8fc4-aff772fac3c1 req-a7ed7f31-8b94-494e-8a72-e1c92cc4a765 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:10.164896 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-374afaa0-b6ff-40c8-8fc4-aff772fac3c1 req-a7ed7f31-8b94-494e-8a72-e1c92cc4a765 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:10.266449 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-374afaa0-b6ff-40c8-8fc4-aff772fac3c1 req-a7ed7f31-8b94-494e-8a72-e1c92cc4a765 service nova] Creating event network-vif-deleted:18b20c55-1d72-4823-8ff3-1ccb4ff91fd1 for instance 0fd8b1bc-a950-4d45-b35f-e6598e50ba1a on n-h1-846466-12 Aug 04 16:54:10.278120 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-374afaa0-b6ff-40c8-8fc4-aff772fac3c1 req-a7ed7f31-8b94-494e-8a72-e1c92cc4a765 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182122 Aug 04 16:54:10.280516 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1745/3555] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:10.328253 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-21440b74-4dc8-4573-b592-294497e2246c tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:10.329505 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-21440b74-4dc8-4573-b592-294497e2246c tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:10.351638 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-21440b74-4dc8-4573-b592-294497e2246c tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:10.367827 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-21440b74-4dc8-4573-b592-294497e2246c tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:10.368804 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-21440b74-4dc8-4573-b592-294497e2246c tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:10.373998 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-21440b74-4dc8-4573-b592-294497e2246c tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:10.591692 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-21440b74-4dc8-4573-b592-294497e2246c tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:10.603245 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-21440b74-4dc8-4573-b592-294497e2246c tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:10.604761 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-21440b74-4dc8-4573-b592-294497e2246c tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:10.614406 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-21440b74-4dc8-4573-b592-294497e2246c tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192" status: 200 len: 1366 microversion: 2.47 time: 0.290273 Aug 04 16:54:10.615301 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1811/3556] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:54:10 2022] GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192 => generated 1366 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:54:10.672439 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5d9cb13c-52b9-4200-9ad8-d8ea40121f8b tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1957341743", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "85df5a51-302c-4d29-a0d9-76e76c3ba002"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:10.768409 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=14 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:10.773673 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ff0774e9-32e6-49a9-a135-8d7b42447897 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1363864526", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "684d9347-862c-4a28-a98b-94e8785b69ab"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:10.817484 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-5d9cb13c-52b9-4200-9ad8-d8ea40121f8b tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] validate_networks() for [('85df5a51-302c-4d29-a0d9-76e76c3ba002', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:54:10.896697 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-ff0774e9-32e6-49a9-a135-8d7b42447897 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] validate_networks() for [('684d9347-862c-4a28-a98b-94e8785b69ab', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:54:12.519987 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-5d9cb13c-52b9-4200-9ad8-d8ea40121f8b tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:54:12.520921 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-5d9cb13c-52b9-4200-9ad8-d8ea40121f8b tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:54:12.521506 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-5d9cb13c-52b9-4200-9ad8-d8ea40121f8b tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:54:12.522012 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-5d9cb13c-52b9-4200-9ad8-d8ea40121f8b tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:54:12.522780 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-5d9cb13c-52b9-4200-9ad8-d8ea40121f8b tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:54:12.551295 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5d9cb13c-52b9-4200-9ad8-d8ea40121f8b tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:12.556736 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5d9cb13c-52b9-4200-9ad8-d8ea40121f8b tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:12.558350 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5d9cb13c-52b9-4200-9ad8-d8ea40121f8b tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:12.562598 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5d9cb13c-52b9-4200-9ad8-d8ea40121f8b tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:12.637009 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-5d9cb13c-52b9-4200-9ad8-d8ea40121f8b tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Getting quotas for project 1878c64d978e4a059943138584ce96e9. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:54:12.651930 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-5d9cb13c-52b9-4200-9ad8-d8ea40121f8b tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Getting quotas for user 2c1a321017d04de0a62b3660623ded61 and project 1878c64d978e4a059943138584ce96e9. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:54:12.655375 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-ff0774e9-32e6-49a9-a135-8d7b42447897 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:54:12.655913 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-ff0774e9-32e6-49a9-a135-8d7b42447897 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:54:12.656511 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-ff0774e9-32e6-49a9-a135-8d7b42447897 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:54:12.656998 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-ff0774e9-32e6-49a9-a135-8d7b42447897 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:54:12.657691 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-ff0774e9-32e6-49a9-a135-8d7b42447897 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:54:12.678875 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5d9cb13c-52b9-4200-9ad8-d8ea40121f8b tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:54:12.682210 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ff0774e9-32e6-49a9-a135-8d7b42447897 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:12.683850 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ff0774e9-32e6-49a9-a135-8d7b42447897 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:12.686490 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ff0774e9-32e6-49a9-a135-8d7b42447897 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:12.690896 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ff0774e9-32e6-49a9-a135-8d7b42447897 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:12.700502 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5d9cb13c-52b9-4200-9ad8-d8ea40121f8b tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] [instance: 10cfa2cd-b0d6-415e-aa30-74a440d1c754] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:54:12.740115 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-ff0774e9-32e6-49a9-a135-8d7b42447897 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Getting quotas for project fac13585fd514c8390f32d1104a19c0d. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:54:12.757142 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-ff0774e9-32e6-49a9-a135-8d7b42447897 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Getting quotas for user 9a7e71c772ce49388bc47daf929ab9e1 and project fac13585fd514c8390f32d1104a19c0d. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:54:12.795790 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ff0774e9-32e6-49a9-a135-8d7b42447897 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:54:12.798773 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ff0774e9-32e6-49a9-a135-8d7b42447897 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:54:12.879949 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5d9cb13c-52b9-4200-9ad8-d8ea40121f8b tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.473554 Aug 04 16:54:12.890117 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1746/3557] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:54:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 16:54:12.900963 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ff0774e9-32e6-49a9-a135-8d7b42447897 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.281993 Aug 04 16:54:12.902961 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1812/3558] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:54:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2287 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:54:12.912171 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f83cf0e1-a97f-4698-ba47-1b5768be6b1d tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:12.916471 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f83cf0e1-a97f-4698-ba47-1b5768be6b1d tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:12.932019 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f83cf0e1-a97f-4698-ba47-1b5768be6b1d tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:12.934025 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f83cf0e1-a97f-4698-ba47-1b5768be6b1d tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:12.937135 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f83cf0e1-a97f-4698-ba47-1b5768be6b1d tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:12.937920 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f83cf0e1-a97f-4698-ba47-1b5768be6b1d tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:12.954215 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-67f5322e-5e89-4425-a22b-882b2240c7e6 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:12.990595 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-67f5322e-5e89-4425-a22b-882b2240c7e6 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] [instance: 0fd8b1bc-a950-4d45-b35f-e6598e50ba1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:13.015181 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-67f5322e-5e89-4425-a22b-882b2240c7e6 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:13.016463 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-67f5322e-5e89-4425-a22b-882b2240c7e6 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:13.017989 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-67f5322e-5e89-4425-a22b-882b2240c7e6 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:13.018646 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-67f5322e-5e89-4425-a22b-882b2240c7e6 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:13.050922 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-67f5322e-5e89-4425-a22b-882b2240c7e6 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] HTTP exception thrown: Instance 0fd8b1bc-a950-4d45-b35f-e6598e50ba1a could not be found. Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-67f5322e-5e89-4425-a22b-882b2240c7e6 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Request method failure captured: Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a HTTP/1.1 Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_mLJU5j2UezrvfjDAK0f7T4nPdVJjEhE3V4671pJwZy5K1vdC-z2KHwBNfcMvGdvstw7N0s3M--qCs11_apGbghC7mh0WkcXpAj6CTAp3gz9XaxwHSEOo6lEFRQNTOYe7IbIMb-QEG66WZ6s5DKLm0uCWFjOB6eITsQFPuK9kSL_qU Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: ad03564b02f14ba1b99973ad27799f9d Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1027984076 Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad03564b02f14ba1b99973ad27799f9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ad03564b02f14ba1b99973ad27799f9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ad03564b02f14ba1b99973ad27799f9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ad03564b02f14ba1b99973ad27799f9d"}]}] Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1027984076 Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: ad03564b02f14ba1b99973ad27799f9d Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1027984076 Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServerAddressesNegativeTestJSON-1027984076-project Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: eb604cd08fab4064a21854aeae139387 Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1027984076-project Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 0fd8b1bc-a950-4d45-b35f-e6598e50ba1a could not be found. Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '0fd8b1bc-a950-4d45-b35f-e6598e50ba1a'} Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fd8b1bc-a950-4d45-b35f-e6598e50ba1a could not be found. Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fd8b1bc-a950-4d45-b35f-e6598e50ba1a could not be found. Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:54:13.057639 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:13.064030 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:54:13.064030 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:13.064030 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:13.064030 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:13.064030 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:54:13.064030 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:54:13.064030 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fd8b1bc-a950-4d45-b35f-e6598e50ba1a could not be found. Aug 04 16:54:13.064030 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:54:13.064030 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-67f5322e-5e89-4425-a22b-882b2240c7e6 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] Returning 404 to user: Instance 0fd8b1bc-a950-4d45-b35f-e6598e50ba1a could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:54:13.065324 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-67f5322e-5e89-4425-a22b-882b2240c7e6 tempest-ServerAddressesNegativeTestJSON-1027984076 tempest-ServerAddressesNegativeTestJSON-1027984076-project] 10.222.0.23 "GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a" status: 404 len: 111 microversion: 2.1 time: 0.171853 Aug 04 16:54:13.068658 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1747/3559] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:12 2022] GET /compute/v2.1/servers/0fd8b1bc-a950-4d45-b35f-e6598e50ba1a => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:54:13.078876 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-eafe026f-3d1d-4de2-b92a-d2d8ef9d2907 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:13.085879 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-eafe026f-3d1d-4de2-b92a-d2d8ef9d2907 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:13.093805 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eafe026f-3d1d-4de2-b92a-d2d8ef9d2907 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:13.094600 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eafe026f-3d1d-4de2-b92a-d2d8ef9d2907 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:13.095655 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eafe026f-3d1d-4de2-b92a-d2d8ef9d2907 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:13.096309 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eafe026f-3d1d-4de2-b92a-d2d8ef9d2907 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:13.335296 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-eafe026f-3d1d-4de2-b92a-d2d8ef9d2907 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:13.344310 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f83cf0e1-a97f-4698-ba47-1b5768be6b1d tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:13.350503 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-eafe026f-3d1d-4de2-b92a-d2d8ef9d2907 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:13.354614 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f83cf0e1-a97f-4698-ba47-1b5768be6b1d tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 200 len: 1355 microversion: 2.1 time: 0.448544 Aug 04 16:54:13.355220 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1813/3560] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:12 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 1355 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:13.366054 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-eafe026f-3d1d-4de2-b92a-d2d8ef9d2907 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:13.366054 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-eafe026f-3d1d-4de2-b92a-d2d8ef9d2907 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192" status: 200 len: 1366 microversion: 2.47 time: 0.289980 Aug 04 16:54:13.366054 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1748/3561] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:54:13 2022] GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192 => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:54:13.384666 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-02d2b037-7cb9-4d02-9b5d-5cfd4bce0901 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:13.389152 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-02d2b037-7cb9-4d02-9b5d-5cfd4bce0901 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] [instance: 10cfa2cd-b0d6-415e-aa30-74a440d1c754] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:13.407697 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d9985f73-544a-467b-bb7a-99494c71e641 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:13.409860 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d9985f73-544a-467b-bb7a-99494c71e641 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:13.564865 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-02d2b037-7cb9-4d02-9b5d-5cfd4bce0901 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1a321017d04de0a62b3660623ded61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1878c64d978e4a059943138584ce96e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:13.574943 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-02d2b037-7cb9-4d02-9b5d-5cfd4bce0901 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] 10.222.0.23 "GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754" status: 200 len: 1217 microversion: 2.1 time: 0.202303 Aug 04 16:54:13.579892 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1814/3562] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:13 2022] GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754 => generated 1217 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:13.636007 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-ba229e8a-9bf8-4bd1-9dab-934307472d15 req-93098887-1663-4c1c-8de1-c2ff7214adb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "329e3811-2d1f-43ac-8c22-c2675ae6b9b8", "name": "network-vif-plugged", "status": "completed", "tag": "804d18b1-8d51-45f4-befe-8fc753241f09"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:13.689064 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-ba229e8a-9bf8-4bd1-9dab-934307472d15 req-93098887-1663-4c1c-8de1-c2ff7214adb5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:13.690980 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-ba229e8a-9bf8-4bd1-9dab-934307472d15 req-93098887-1663-4c1c-8de1-c2ff7214adb5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:13.749899 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-ba229e8a-9bf8-4bd1-9dab-934307472d15 req-93098887-1663-4c1c-8de1-c2ff7214adb5 service nova] Creating event network-vif-plugged:804d18b1-8d51-45f4-befe-8fc753241f09 for instance 329e3811-2d1f-43ac-8c22-c2675ae6b9b8 on n-h2-846466-12 Aug 04 16:54:13.762443 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d9985f73-544a-467b-bb7a-99494c71e641 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:13.765109 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-ba229e8a-9bf8-4bd1-9dab-934307472d15 req-93098887-1663-4c1c-8de1-c2ff7214adb5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167636 Aug 04 16:54:13.773515 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1815/3563] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:13.775386 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d9985f73-544a-467b-bb7a-99494c71e641 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1218 microversion: 2.1 time: 0.413435 Aug 04 16:54:13.783481 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1749/3564] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:13 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1218 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:14.382103 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4cf2898f-4e5a-4295-a65c-ed92c689b066 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:14.383661 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4cf2898f-4e5a-4295-a65c-ed92c689b066 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:14.401001 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b008ff71-d7e2-4cbf-ab10-e8256736db07 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:14.402621 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b008ff71-d7e2-4cbf-ab10-e8256736db07 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:14.422336 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4cf2898f-4e5a-4295-a65c-ed92c689b066 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:14.422937 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4cf2898f-4e5a-4295-a65c-ed92c689b066 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:14.428280 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4cf2898f-4e5a-4295-a65c-ed92c689b066 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:14.430327 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4cf2898f-4e5a-4295-a65c-ed92c689b066 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:14.462286 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b008ff71-d7e2-4cbf-ab10-e8256736db07 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:14.467858 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b008ff71-d7e2-4cbf-ab10-e8256736db07 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:14.470722 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b008ff71-d7e2-4cbf-ab10-e8256736db07 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:14.472222 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b008ff71-d7e2-4cbf-ab10-e8256736db07 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:14.729015 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b008ff71-d7e2-4cbf-ab10-e8256736db07 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:14.744872 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b008ff71-d7e2-4cbf-ab10-e8256736db07 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:14.746448 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b008ff71-d7e2-4cbf-ab10-e8256736db07 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:14.749941 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b008ff71-d7e2-4cbf-ab10-e8256736db07 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192" status: 200 len: 1366 microversion: 2.47 time: 0.363506 Aug 04 16:54:14.754565 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1750/3565] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:54:14 2022] GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192 => generated 1366 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:54:14.768059 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-05b91183-99d6-40ba-8e63-67b043ce389c tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:14.768719 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-05b91183-99d6-40ba-8e63-67b043ce389c tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] [instance: 10cfa2cd-b0d6-415e-aa30-74a440d1c754] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:14.786934 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-05b91183-99d6-40ba-8e63-67b043ce389c tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:14.793871 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-05b91183-99d6-40ba-8e63-67b043ce389c tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:14.799043 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-05b91183-99d6-40ba-8e63-67b043ce389c tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:14.799783 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-05b91183-99d6-40ba-8e63-67b043ce389c tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:15.034880 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-05b91183-99d6-40ba-8e63-67b043ce389c tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1a321017d04de0a62b3660623ded61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1878c64d978e4a059943138584ce96e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:15.052033 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-05b91183-99d6-40ba-8e63-67b043ce389c tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] 10.222.0.23 "GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754" status: 200 len: 1269 microversion: 2.1 time: 0.291569 Aug 04 16:54:15.054023 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1751/3566] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:14 2022] GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754 => generated 1269 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:15.070779 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-79b58814-ea95-42ab-b743-797fb72f1bb7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:15.075209 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-79b58814-ea95-42ab-b743-797fb72f1bb7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:15.088907 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-79b58814-ea95-42ab-b743-797fb72f1bb7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:15.090848 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-79b58814-ea95-42ab-b743-797fb72f1bb7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:15.094162 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-79b58814-ea95-42ab-b743-797fb72f1bb7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:15.095118 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-79b58814-ea95-42ab-b743-797fb72f1bb7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:15.102875 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4cf2898f-4e5a-4295-a65c-ed92c689b066 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:15.119905 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4cf2898f-4e5a-4295-a65c-ed92c689b066 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 200 len: 1355 microversion: 2.1 time: 0.744491 Aug 04 16:54:15.135013 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1816/3567] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:14 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 1355 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:54:15.350044 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-79b58814-ea95-42ab-b743-797fb72f1bb7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:15.368833 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-79b58814-ea95-42ab-b743-797fb72f1bb7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1270 microversion: 2.1 time: 0.312424 Aug 04 16:54:15.369983 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1752/3568] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:15 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1270 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:15.778196 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-21f0b8c3-cc36-43a1-8194-da4e9b06f1d6 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:15.778826 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-21f0b8c3-cc36-43a1-8194-da4e9b06f1d6 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:15.794364 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-21f0b8c3-cc36-43a1-8194-da4e9b06f1d6 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:15.794822 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-21f0b8c3-cc36-43a1-8194-da4e9b06f1d6 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:15.795615 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-21f0b8c3-cc36-43a1-8194-da4e9b06f1d6 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:15.796044 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-21f0b8c3-cc36-43a1-8194-da4e9b06f1d6 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:16.004561 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-21f0b8c3-cc36-43a1-8194-da4e9b06f1d6 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:16.018919 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-21f0b8c3-cc36-43a1-8194-da4e9b06f1d6 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:16.023133 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-21f0b8c3-cc36-43a1-8194-da4e9b06f1d6 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:16.026003 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-21f0b8c3-cc36-43a1-8194-da4e9b06f1d6 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192" status: 200 len: 1366 microversion: 2.47 time: 0.253346 Aug 04 16:54:16.042076 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1817/3569] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:54:15 2022] GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:54:16.076379 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9417d51c-8231-42e2-9e7a-281dca1400ed tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:16.077005 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9417d51c-8231-42e2-9e7a-281dca1400ed tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] [instance: 10cfa2cd-b0d6-415e-aa30-74a440d1c754] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:16.088926 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9417d51c-8231-42e2-9e7a-281dca1400ed tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:16.089449 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9417d51c-8231-42e2-9e7a-281dca1400ed tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:16.090252 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9417d51c-8231-42e2-9e7a-281dca1400ed tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:16.090693 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9417d51c-8231-42e2-9e7a-281dca1400ed tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:16.159625 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f79500d5-067f-44a4-a6af-ec056055f4d7 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:16.160280 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f79500d5-067f-44a4-a6af-ec056055f4d7 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:16.175422 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f79500d5-067f-44a4-a6af-ec056055f4d7 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:16.177577 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f79500d5-067f-44a4-a6af-ec056055f4d7 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:16.178404 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f79500d5-067f-44a4-a6af-ec056055f4d7 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:16.180699 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f79500d5-067f-44a4-a6af-ec056055f4d7 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:16.281754 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9417d51c-8231-42e2-9e7a-281dca1400ed tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1a321017d04de0a62b3660623ded61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1878c64d978e4a059943138584ce96e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:16.290603 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9417d51c-8231-42e2-9e7a-281dca1400ed tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] 10.222.0.23 "GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754" status: 200 len: 1275 microversion: 2.1 time: 0.218936 Aug 04 16:54:16.293786 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1753/3570] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:16 2022] GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754 => generated 1275 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:16.347862 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-aa88be28-3e4e-4916-909e-2d62c40c5496 req-4ce5c63f-e79f-478f-8aba-af027f31b046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "329e3811-2d1f-43ac-8c22-c2675ae6b9b8", "name": "network-vif-plugged", "status": "completed", "tag": "9ec644e9-34d2-4286-ac9f-d87c2adc2000"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:16.374066 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-aa88be28-3e4e-4916-909e-2d62c40c5496 req-4ce5c63f-e79f-478f-8aba-af027f31b046 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:16.374849 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-aa88be28-3e4e-4916-909e-2d62c40c5496 req-4ce5c63f-e79f-478f-8aba-af027f31b046 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:16.393662 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-aa88be28-3e4e-4916-909e-2d62c40c5496 req-4ce5c63f-e79f-478f-8aba-af027f31b046 service nova] Creating event network-vif-plugged:9ec644e9-34d2-4286-ac9f-d87c2adc2000 for instance 329e3811-2d1f-43ac-8c22-c2675ae6b9b8 on n-h2-846466-12 Aug 04 16:54:16.410764 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-aa88be28-3e4e-4916-909e-2d62c40c5496 req-4ce5c63f-e79f-478f-8aba-af027f31b046 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069045 Aug 04 16:54:16.411584 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1754/3571] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:54:16.417470 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c7b6dab1-f0c9-469c-90fa-c85945a72a89 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:16.428800 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c7b6dab1-f0c9-469c-90fa-c85945a72a89 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:16.439565 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c7b6dab1-f0c9-469c-90fa-c85945a72a89 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:16.440292 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c7b6dab1-f0c9-469c-90fa-c85945a72a89 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:16.448490 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c7b6dab1-f0c9-469c-90fa-c85945a72a89 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:16.448958 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c7b6dab1-f0c9-469c-90fa-c85945a72a89 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:16.806378 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c7b6dab1-f0c9-469c-90fa-c85945a72a89 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:16.816592 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c7b6dab1-f0c9-469c-90fa-c85945a72a89 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1276 microversion: 2.1 time: 0.403256 Aug 04 16:54:16.822976 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1755/3572] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:16 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1276 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:17.054281 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fd03050c-4fd3-4d47-8918-51f88ba7c3de tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:17.055427 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fd03050c-4fd3-4d47-8918-51f88ba7c3de tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:17.068749 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fd03050c-4fd3-4d47-8918-51f88ba7c3de tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:17.069395 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fd03050c-4fd3-4d47-8918-51f88ba7c3de tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:17.071826 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fd03050c-4fd3-4d47-8918-51f88ba7c3de tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:17.073490 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fd03050c-4fd3-4d47-8918-51f88ba7c3de tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:17.100182 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f79500d5-067f-44a4-a6af-ec056055f4d7 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:17.123973 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f79500d5-067f-44a4-a6af-ec056055f4d7 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 200 len: 1355 microversion: 2.1 time: 0.969687 Aug 04 16:54:17.132566 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1818/3573] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:16 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 1355 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:17.317040 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f53ccfd0-8bdc-4fd7-adee-a7a6124c3f30 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:17.319165 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f53ccfd0-8bdc-4fd7-adee-a7a6124c3f30 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] [instance: 10cfa2cd-b0d6-415e-aa30-74a440d1c754] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:17.331304 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f53ccfd0-8bdc-4fd7-adee-a7a6124c3f30 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:17.338471 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f53ccfd0-8bdc-4fd7-adee-a7a6124c3f30 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:17.339651 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f53ccfd0-8bdc-4fd7-adee-a7a6124c3f30 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:17.340286 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f53ccfd0-8bdc-4fd7-adee-a7a6124c3f30 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:17.341346 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fd03050c-4fd3-4d47-8918-51f88ba7c3de tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:17.355678 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fd03050c-4fd3-4d47-8918-51f88ba7c3de tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:17.359091 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fd03050c-4fd3-4d47-8918-51f88ba7c3de tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:17.362455 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fd03050c-4fd3-4d47-8918-51f88ba7c3de tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192" status: 200 len: 1366 microversion: 2.47 time: 0.313140 Aug 04 16:54:17.364796 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1756/3574] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:54:17 2022] GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192 => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:54:17.582033 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f53ccfd0-8bdc-4fd7-adee-a7a6124c3f30 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1a321017d04de0a62b3660623ded61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1878c64d978e4a059943138584ce96e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:17.591297 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f53ccfd0-8bdc-4fd7-adee-a7a6124c3f30 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] 10.222.0.23 "GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754" status: 200 len: 1275 microversion: 2.1 time: 0.278131 Aug 04 16:54:17.602181 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1819/3575] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:17 2022] GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754 => generated 1275 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:54:17.844133 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6e7e6c24-62d3-4861-a05b-5e25de261d38 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:17.844952 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6e7e6c24-62d3-4861-a05b-5e25de261d38 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:17.856937 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e7e6c24-62d3-4861-a05b-5e25de261d38 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:17.879021 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e7e6c24-62d3-4861-a05b-5e25de261d38 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:17.882413 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e7e6c24-62d3-4861-a05b-5e25de261d38 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:17.898930 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e7e6c24-62d3-4861-a05b-5e25de261d38 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:18.128346 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6e7e6c24-62d3-4861-a05b-5e25de261d38 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:18.160182 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6e7e6c24-62d3-4861-a05b-5e25de261d38 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1276 microversion: 2.1 time: 0.323692 Aug 04 16:54:18.162586 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1757/3576] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:17 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1276 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:18.167761 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5d32b8e7-f242-457e-8df5-fa7850725fa8 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:18.169191 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5d32b8e7-f242-457e-8df5-fa7850725fa8 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:18.200009 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5d32b8e7-f242-457e-8df5-fa7850725fa8 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:18.203542 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5d32b8e7-f242-457e-8df5-fa7850725fa8 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:18.204770 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5d32b8e7-f242-457e-8df5-fa7850725fa8 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:18.209909 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5d32b8e7-f242-457e-8df5-fa7850725fa8 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:18.391766 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a1a01016-4e5a-4dbb-8295-0d54e2b9c044 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:18.392512 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a1a01016-4e5a-4dbb-8295-0d54e2b9c044 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:18.410108 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a1a01016-4e5a-4dbb-8295-0d54e2b9c044 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:18.412804 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a1a01016-4e5a-4dbb-8295-0d54e2b9c044 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:18.414082 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a1a01016-4e5a-4dbb-8295-0d54e2b9c044 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:18.416116 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a1a01016-4e5a-4dbb-8295-0d54e2b9c044 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:18.781148 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a1a01016-4e5a-4dbb-8295-0d54e2b9c044 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:18.800090 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a1a01016-4e5a-4dbb-8295-0d54e2b9c044 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:18.805508 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a1a01016-4e5a-4dbb-8295-0d54e2b9c044 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:18.811563 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a1a01016-4e5a-4dbb-8295-0d54e2b9c044 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192" status: 200 len: 1366 microversion: 2.47 time: 0.420034 Aug 04 16:54:18.815256 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1758/3577] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:54:18 2022] GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192 => generated 1366 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:54:18.826051 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-e9a1651a-feaa-43b3-9f60-e7f4e4278331 req-eddca47d-3478-4815-88fd-f372f00ac080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "329e3811-2d1f-43ac-8c22-c2675ae6b9b8", "name": "network-vif-plugged", "status": "completed", "tag": "a718ac0b-984d-48a3-81aa-93b60f1cfb88"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:18.862040 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-e9a1651a-feaa-43b3-9f60-e7f4e4278331 req-eddca47d-3478-4815-88fd-f372f00ac080 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:18.863176 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-e9a1651a-feaa-43b3-9f60-e7f4e4278331 req-eddca47d-3478-4815-88fd-f372f00ac080 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:18.884429 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5d32b8e7-f242-457e-8df5-fa7850725fa8 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:18.904695 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5d32b8e7-f242-457e-8df5-fa7850725fa8 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 200 len: 1355 microversion: 2.1 time: 0.756083 Aug 04 16:54:18.914240 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1820/3578] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:18 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 1355 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:54:18.934625 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-e9a1651a-feaa-43b3-9f60-e7f4e4278331 req-eddca47d-3478-4815-88fd-f372f00ac080 service nova] Creating event network-vif-plugged:a718ac0b-984d-48a3-81aa-93b60f1cfb88 for instance 329e3811-2d1f-43ac-8c22-c2675ae6b9b8 on n-h2-846466-12 Aug 04 16:54:18.944006 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-544aa223-344a-41da-a0a0-54402ae32dbe tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:18.948056 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-544aa223-344a-41da-a0a0-54402ae32dbe tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] [instance: 10cfa2cd-b0d6-415e-aa30-74a440d1c754] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:18.953952 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-e9a1651a-feaa-43b3-9f60-e7f4e4278331 req-eddca47d-3478-4815-88fd-f372f00ac080 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134907 Aug 04 16:54:18.956911 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1759/3579] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:19.000769 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-544aa223-344a-41da-a0a0-54402ae32dbe tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:19.005660 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-544aa223-344a-41da-a0a0-54402ae32dbe tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:19.007965 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-544aa223-344a-41da-a0a0-54402ae32dbe tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:19.009546 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-544aa223-344a-41da-a0a0-54402ae32dbe tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:19.245256 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c029af46-814e-45be-a40e-63f77ca0d02e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:19.251682 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c029af46-814e-45be-a40e-63f77ca0d02e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:19.308861 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c029af46-814e-45be-a40e-63f77ca0d02e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:19.310037 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c029af46-814e-45be-a40e-63f77ca0d02e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:19.319265 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c029af46-814e-45be-a40e-63f77ca0d02e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:19.325910 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c029af46-814e-45be-a40e-63f77ca0d02e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:20.725807 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-544aa223-344a-41da-a0a0-54402ae32dbe tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1a321017d04de0a62b3660623ded61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1878c64d978e4a059943138584ce96e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:20.735624 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-544aa223-344a-41da-a0a0-54402ae32dbe tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] 10.222.0.23 "GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754" status: 200 len: 1317 microversion: 2.1 time: 1.819340 Aug 04 16:54:20.736448 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1821/3580] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:18 2022] GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754 => generated 1317 bytes in 1821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:20.747400 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9e4d5774-7288-46fb-bf3e-db137f4d8f18 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:20.751230 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9e4d5774-7288-46fb-bf3e-db137f4d8f18 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:20.759380 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9e4d5774-7288-46fb-bf3e-db137f4d8f18 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:20.761170 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9e4d5774-7288-46fb-bf3e-db137f4d8f18 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:20.762698 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9e4d5774-7288-46fb-bf3e-db137f4d8f18 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:20.763422 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9e4d5774-7288-46fb-bf3e-db137f4d8f18 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:21.092792 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9e4d5774-7288-46fb-bf3e-db137f4d8f18 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:21.131762 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9e4d5774-7288-46fb-bf3e-db137f4d8f18 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:21.155612 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9e4d5774-7288-46fb-bf3e-db137f4d8f18 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:21.176799 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c029af46-814e-45be-a40e-63f77ca0d02e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:21.180841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:21.186204 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9e4d5774-7288-46fb-bf3e-db137f4d8f18 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192" status: 200 len: 1366 microversion: 2.47 time: 0.432395 Aug 04 16:54:21.186901 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1822/3581] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:54:20 2022] GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192 => generated 1366 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:54:21.191495 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c029af46-814e-45be-a40e-63f77ca0d02e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1318 microversion: 2.1 time: 1.982638 Aug 04 16:54:21.211110 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1760/3582] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:19 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1318 bytes in 2023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:21.211737 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5f3ce3d1-f060-48f5-878b-9bc2e3ba6d57 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:21.217239 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5f3ce3d1-f060-48f5-878b-9bc2e3ba6d57 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:21.236632 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5f3ce3d1-f060-48f5-878b-9bc2e3ba6d57 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:21.241247 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5f3ce3d1-f060-48f5-878b-9bc2e3ba6d57 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:21.245095 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5f3ce3d1-f060-48f5-878b-9bc2e3ba6d57 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:21.245954 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5f3ce3d1-f060-48f5-878b-9bc2e3ba6d57 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:21.759610 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fb8dc47c-c4eb-49eb-983a-9e5a7c864b87 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:21.760465 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fb8dc47c-c4eb-49eb-983a-9e5a7c864b87 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] [instance: 10cfa2cd-b0d6-415e-aa30-74a440d1c754] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:21.787554 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fb8dc47c-c4eb-49eb-983a-9e5a7c864b87 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:21.789899 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fb8dc47c-c4eb-49eb-983a-9e5a7c864b87 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:21.792910 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fb8dc47c-c4eb-49eb-983a-9e5a7c864b87 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:21.795593 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fb8dc47c-c4eb-49eb-983a-9e5a7c864b87 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:22.361025 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5f3ce3d1-f060-48f5-878b-9bc2e3ba6d57 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:22.395512 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5f3ce3d1-f060-48f5-878b-9bc2e3ba6d57 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 200 len: 1355 microversion: 2.1 time: 1.205474 Aug 04 16:54:22.398755 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1823/3583] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:21 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 1355 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:22.410304 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-40fa7208-92cb-4566-b446-af82dd51b647 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:22.411955 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-40fa7208-92cb-4566-b446-af82dd51b647 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:22.441562 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-40fa7208-92cb-4566-b446-af82dd51b647 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:22.442479 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-40fa7208-92cb-4566-b446-af82dd51b647 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:22.449525 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-40fa7208-92cb-4566-b446-af82dd51b647 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:22.452207 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-40fa7208-92cb-4566-b446-af82dd51b647 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:22.607442 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:22.722920 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:22.848164 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-40fa7208-92cb-4566-b446-af82dd51b647 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:22.858656 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-40fa7208-92cb-4566-b446-af82dd51b647 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:22.860474 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-40fa7208-92cb-4566-b446-af82dd51b647 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:22.862086 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-40fa7208-92cb-4566-b446-af82dd51b647 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192" status: 200 len: 1366 microversion: 2.47 time: 0.461637 Aug 04 16:54:22.863215 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1824/3584] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:54:22 2022] GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192 => generated 1366 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:54:22.870853 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6340a806-354e-4372-83fc-0ff330dced2a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:22.871721 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6340a806-354e-4372-83fc-0ff330dced2a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:22.879621 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6340a806-354e-4372-83fc-0ff330dced2a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:22.880710 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6340a806-354e-4372-83fc-0ff330dced2a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:22.882032 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6340a806-354e-4372-83fc-0ff330dced2a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:22.882610 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6340a806-354e-4372-83fc-0ff330dced2a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:23.129788 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fb8dc47c-c4eb-49eb-983a-9e5a7c864b87 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1a321017d04de0a62b3660623ded61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1878c64d978e4a059943138584ce96e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:23.140750 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fb8dc47c-c4eb-49eb-983a-9e5a7c864b87 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] 10.222.0.23 "GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754" status: 200 len: 1317 microversion: 2.1 time: 1.388349 Aug 04 16:54:23.144066 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1761/3585] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:21 2022] GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754 => generated 1317 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:23.366678 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-f49345b3-0adb-4a0b-9c2f-e0ea2729c83c req-f75860de-65ce-4ca7-9058-7f096bca242c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0", "tag": "b11cc5b4-996e-44be-b5e9-d3ff403d692f"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:23.387414 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f49345b3-0adb-4a0b-9c2f-e0ea2729c83c req-f75860de-65ce-4ca7-9058-7f096bca242c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:23.394439 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f49345b3-0adb-4a0b-9c2f-e0ea2729c83c req-f75860de-65ce-4ca7-9058-7f096bca242c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:23.419781 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-f49345b3-0adb-4a0b-9c2f-e0ea2729c83c req-f75860de-65ce-4ca7-9058-7f096bca242c service nova] Creating event network-changed:b11cc5b4-996e-44be-b5e9-d3ff403d692f for instance 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 on n-h1-846466-12 Aug 04 16:54:23.432608 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-f49345b3-0adb-4a0b-9c2f-e0ea2729c83c req-f75860de-65ce-4ca7-9058-7f096bca242c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070856 Aug 04 16:54:23.433464 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1762/3586] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:54:23.452546 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-eb328ec4-92dc-460b-b179-4af8b81a4ad4 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:23.453574 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-eb328ec4-92dc-460b-b179-4af8b81a4ad4 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:23.461151 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eb328ec4-92dc-460b-b179-4af8b81a4ad4 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:23.467900 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eb328ec4-92dc-460b-b179-4af8b81a4ad4 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:23.469112 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eb328ec4-92dc-460b-b179-4af8b81a4ad4 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:23.469756 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eb328ec4-92dc-460b-b179-4af8b81a4ad4 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:23.572290 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6340a806-354e-4372-83fc-0ff330dced2a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:23.575576 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=8 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:23.586179 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6340a806-354e-4372-83fc-0ff330dced2a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1318 microversion: 2.1 time: 0.721423 Aug 04 16:54:23.600926 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1825/3587] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:22 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1318 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:23.769459 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=8 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:23.886058 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-680d7682-71b2-4815-a233-a0a841fb370f tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:23.886677 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-680d7682-71b2-4815-a233-a0a841fb370f tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:23.904953 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-680d7682-71b2-4815-a233-a0a841fb370f tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:23.905614 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-680d7682-71b2-4815-a233-a0a841fb370f tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:23.906475 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-680d7682-71b2-4815-a233-a0a841fb370f tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:23.906926 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-680d7682-71b2-4815-a233-a0a841fb370f tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:24.000000 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-eb328ec4-92dc-460b-b179-4af8b81a4ad4 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:24.020936 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-eb328ec4-92dc-460b-b179-4af8b81a4ad4 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 200 len: 1807 microversion: 2.1 time: 0.585681 Aug 04 16:54:24.026558 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1763/3588] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:23 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 1807 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:24.046574 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c3601665-f31e-459f-89e5-c95d33ce5708 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:24.047900 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c3601665-f31e-459f-89e5-c95d33ce5708 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:24.059774 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c3601665-f31e-459f-89e5-c95d33ce5708 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:24.060394 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c3601665-f31e-459f-89e5-c95d33ce5708 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:24.061351 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c3601665-f31e-459f-89e5-c95d33ce5708 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:24.061885 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c3601665-f31e-459f-89e5-c95d33ce5708 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:24.094008 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c3601665-f31e-459f-89e5-c95d33ce5708 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8/ips" status: 200 len: 220 microversion: 2.1 time: 0.053571 Aug 04 16:54:24.095364 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1764/3589] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Aug 4 16:54:24 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8/ips => generated 220 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:24.113007 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b13810f4-d89d-4394-ab87-7c293fe5d994 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:24.115641 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b13810f4-d89d-4394-ab87-7c293fe5d994 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:24.134788 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b13810f4-d89d-4394-ab87-7c293fe5d994 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:24.138697 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-680d7682-71b2-4815-a233-a0a841fb370f tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:24.139174 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b13810f4-d89d-4394-ab87-7c293fe5d994 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:24.142749 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b13810f4-d89d-4394-ab87-7c293fe5d994 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:24.143202 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b13810f4-d89d-4394-ab87-7c293fe5d994 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:24.152610 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-680d7682-71b2-4815-a233-a0a841fb370f tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:24.154667 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-680d7682-71b2-4815-a233-a0a841fb370f tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:24.161242 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-680d7682-71b2-4815-a233-a0a841fb370f tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192" status: 200 len: 1366 microversion: 2.47 time: 0.277546 Aug 04 16:54:24.163939 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1826/3590] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:54:23 2022] GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192 => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:54:24.186223 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cfd0f99c-ab67-479e-8088-e9802b8cae02 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:24.187106 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cfd0f99c-ab67-479e-8088-e9802b8cae02 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] [instance: 10cfa2cd-b0d6-415e-aa30-74a440d1c754] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:24.193770 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cfd0f99c-ab67-479e-8088-e9802b8cae02 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:24.194216 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cfd0f99c-ab67-479e-8088-e9802b8cae02 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:24.195219 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cfd0f99c-ab67-479e-8088-e9802b8cae02 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:24.195754 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cfd0f99c-ab67-479e-8088-e9802b8cae02 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:24.224656 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b13810f4-d89d-4394-ab87-7c293fe5d994 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:54:24.449186 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b13810f4-d89d-4394-ab87-7c293fe5d994 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "DELETE /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 204 len: 0 microversion: 2.1 time: 0.344011 Aug 04 16:54:24.455178 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1765/3591] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:54:24 2022] DELETE /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 16:54:24.465015 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1b7d1c3f-e870-458e-af87-2bdfbed9206e tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:24.467239 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1b7d1c3f-e870-458e-af87-2bdfbed9206e tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:24.482786 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1b7d1c3f-e870-458e-af87-2bdfbed9206e tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:24.483921 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1b7d1c3f-e870-458e-af87-2bdfbed9206e tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:24.484774 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1b7d1c3f-e870-458e-af87-2bdfbed9206e tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:24.485207 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1b7d1c3f-e870-458e-af87-2bdfbed9206e tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:25.022297 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cfd0f99c-ab67-479e-8088-e9802b8cae02 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1a321017d04de0a62b3660623ded61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1878c64d978e4a059943138584ce96e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:25.041912 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cfd0f99c-ab67-479e-8088-e9802b8cae02 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] 10.222.0.23 "GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754" status: 200 len: 1317 microversion: 2.1 time: 0.874180 Aug 04 16:54:25.042866 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1827/3592] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:24 2022] GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754 => generated 1317 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:25.053717 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a6581f10-30f3-4f1f-b473-58aecddd0fa5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:25.059803 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a6581f10-30f3-4f1f-b473-58aecddd0fa5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:25.068416 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6581f10-30f3-4f1f-b473-58aecddd0fa5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:25.069024 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6581f10-30f3-4f1f-b473-58aecddd0fa5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:25.070517 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6581f10-30f3-4f1f-b473-58aecddd0fa5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:25.071067 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6581f10-30f3-4f1f-b473-58aecddd0fa5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:25.091041 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1b7d1c3f-e870-458e-af87-2bdfbed9206e tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:25.099981 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1b7d1c3f-e870-458e-af87-2bdfbed9206e tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 200 len: 1813 microversion: 2.1 time: 0.642502 Aug 04 16:54:25.100577 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1766/3593] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:24 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 1813 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:25.188962 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-13f154b2-63fe-469c-96e4-2cd0f66ed4dc tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:25.189628 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-13f154b2-63fe-469c-96e4-2cd0f66ed4dc tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:25.198604 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-13f154b2-63fe-469c-96e4-2cd0f66ed4dc tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:25.199087 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-13f154b2-63fe-469c-96e4-2cd0f66ed4dc tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:25.199994 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-13f154b2-63fe-469c-96e4-2cd0f66ed4dc tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:25.200436 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-13f154b2-63fe-469c-96e4-2cd0f66ed4dc tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:25.463273 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-13f154b2-63fe-469c-96e4-2cd0f66ed4dc tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:25.476803 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-13f154b2-63fe-469c-96e4-2cd0f66ed4dc tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:25.476803 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-13f154b2-63fe-469c-96e4-2cd0f66ed4dc tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:25.478903 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-13f154b2-63fe-469c-96e4-2cd0f66ed4dc tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192" status: 200 len: 1366 microversion: 2.47 time: 0.293900 Aug 04 16:54:25.494462 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1767/3594] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:54:25 2022] GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192 => generated 1366 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:54:25.527448 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-f7d52e87-88f5-42a4-b3be-0d34f3aa4894 req-4258c482-1e97-4c0d-b46f-7b24d7056c4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10cfa2cd-b0d6-415e-aa30-74a440d1c754", "tag": "82c65cf6-2f98-47eb-b209-c6fbc06b8ca9"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:25.540121 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f7d52e87-88f5-42a4-b3be-0d34f3aa4894 req-4258c482-1e97-4c0d-b46f-7b24d7056c4f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:25.540121 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f7d52e87-88f5-42a4-b3be-0d34f3aa4894 req-4258c482-1e97-4c0d-b46f-7b24d7056c4f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:25.554555 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-f7d52e87-88f5-42a4-b3be-0d34f3aa4894 req-4258c482-1e97-4c0d-b46f-7b24d7056c4f service nova] Creating event network-changed:82c65cf6-2f98-47eb-b209-c6fbc06b8ca9 for instance 10cfa2cd-b0d6-415e-aa30-74a440d1c754 on n-h1-846466-12 Aug 04 16:54:25.559577 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-f7d52e87-88f5-42a4-b3be-0d34f3aa4894 req-4258c482-1e97-4c0d-b46f-7b24d7056c4f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036469 Aug 04 16:54:25.560197 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1768/3595] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:25.746780 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a6581f10-30f3-4f1f-b473-58aecddd0fa5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:25.791894 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a6581f10-30f3-4f1f-b473-58aecddd0fa5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1318 microversion: 2.1 time: 0.744867 Aug 04 16:54:25.810281 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1828/3596] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:25 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1318 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:26.071276 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bb0ebdf3-c198-4deb-ab8f-04278c21a9af tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:26.072270 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bb0ebdf3-c198-4deb-ab8f-04278c21a9af tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] [instance: 10cfa2cd-b0d6-415e-aa30-74a440d1c754] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:26.079655 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bb0ebdf3-c198-4deb-ab8f-04278c21a9af tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:26.080080 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bb0ebdf3-c198-4deb-ab8f-04278c21a9af tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:26.081224 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bb0ebdf3-c198-4deb-ab8f-04278c21a9af tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:26.082359 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bb0ebdf3-c198-4deb-ab8f-04278c21a9af tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:26.122120 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c7f1204d-3db2-462a-8e27-1eb915d0b08f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:26.123046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c7f1204d-3db2-462a-8e27-1eb915d0b08f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:26.133693 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c7f1204d-3db2-462a-8e27-1eb915d0b08f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:26.134811 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c7f1204d-3db2-462a-8e27-1eb915d0b08f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:26.136213 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c7f1204d-3db2-462a-8e27-1eb915d0b08f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:26.136788 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c7f1204d-3db2-462a-8e27-1eb915d0b08f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:27.127045 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c7f1204d-3db2-462a-8e27-1eb915d0b08f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:27.133739 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=100 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:27.136248 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c7f1204d-3db2-462a-8e27-1eb915d0b08f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 200 len: 1813 microversion: 2.1 time: 1.017987 Aug 04 16:54:27.142173 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1829/3597] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:26 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 1813 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:27.154533 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ccf48175-f4c3-404c-bcdc-eca3b997b557 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:27.156253 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ccf48175-f4c3-404c-bcdc-eca3b997b557 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:27.164720 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ccf48175-f4c3-404c-bcdc-eca3b997b557 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:27.165169 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ccf48175-f4c3-404c-bcdc-eca3b997b557 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:27.166001 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ccf48175-f4c3-404c-bcdc-eca3b997b557 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:27.168868 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ccf48175-f4c3-404c-bcdc-eca3b997b557 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:27.262890 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bb0ebdf3-c198-4deb-ab8f-04278c21a9af tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1a321017d04de0a62b3660623ded61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1878c64d978e4a059943138584ce96e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:27.278419 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bb0ebdf3-c198-4deb-ab8f-04278c21a9af tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] 10.222.0.23 "GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754" status: 200 len: 1317 microversion: 2.1 time: 1.216569 Aug 04 16:54:27.279449 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1769/3598] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:26 2022] GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754 => generated 1317 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:27.292572 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c5b4beac-120f-48b3-8020-087839ac2ae5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:27.293667 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c5b4beac-120f-48b3-8020-087839ac2ae5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:27.309766 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c5b4beac-120f-48b3-8020-087839ac2ae5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:27.310553 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c5b4beac-120f-48b3-8020-087839ac2ae5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:27.311791 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c5b4beac-120f-48b3-8020-087839ac2ae5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:27.312405 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c5b4beac-120f-48b3-8020-087839ac2ae5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:27.466638 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ccf48175-f4c3-404c-bcdc-eca3b997b557 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:27.488832 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ccf48175-f4c3-404c-bcdc-eca3b997b557 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:27.499524 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ccf48175-f4c3-404c-bcdc-eca3b997b557 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:27.503975 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ccf48175-f4c3-404c-bcdc-eca3b997b557 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192" status: 200 len: 1366 microversion: 2.47 time: 0.358771 Aug 04 16:54:27.507714 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1830/3599] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:54:27 2022] GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192 => generated 1366 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:54:27.822083 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c5b4beac-120f-48b3-8020-087839ac2ae5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:27.847462 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c5b4beac-120f-48b3-8020-087839ac2ae5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1318 microversion: 2.1 time: 0.562398 Aug 04 16:54:27.849760 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1770/3600] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:27 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1318 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:28.174699 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-87e18bd5-1650-4238-9acc-9ca1d989c85d tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:28.176049 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-87e18bd5-1650-4238-9acc-9ca1d989c85d tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:28.203854 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-87e18bd5-1650-4238-9acc-9ca1d989c85d tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:28.204716 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-87e18bd5-1650-4238-9acc-9ca1d989c85d tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:28.205980 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-87e18bd5-1650-4238-9acc-9ca1d989c85d tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:28.206591 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-87e18bd5-1650-4238-9acc-9ca1d989c85d tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:28.313782 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9f317c78-c4a4-4230-8fcb-8f75dc81633c tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:28.316411 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9f317c78-c4a4-4230-8fcb-8f75dc81633c tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] [instance: 10cfa2cd-b0d6-415e-aa30-74a440d1c754] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:28.335713 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f317c78-c4a4-4230-8fcb-8f75dc81633c tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:28.345938 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f317c78-c4a4-4230-8fcb-8f75dc81633c tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:28.347971 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f317c78-c4a4-4230-8fcb-8f75dc81633c tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:28.348936 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f317c78-c4a4-4230-8fcb-8f75dc81633c tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:28.973543 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9f317c78-c4a4-4230-8fcb-8f75dc81633c tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1a321017d04de0a62b3660623ded61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1878c64d978e4a059943138584ce96e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:28.989811 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9f317c78-c4a4-4230-8fcb-8f75dc81633c tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] 10.222.0.23 "GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754" status: 200 len: 1317 microversion: 2.1 time: 0.693096 Aug 04 16:54:28.990922 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1771/3601] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:28 2022] GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754 => generated 1317 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:28.996773 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-553e583b-09a6-44e1-ab69-198439a717fe req-93cce6d8-b88b-4cc2-87ef-174590d85d0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "329e3811-2d1f-43ac-8c22-c2675ae6b9b8", "name": "network-vif-deleted", "tag": "9ec644e9-34d2-4286-ac9f-d87c2adc2000"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:29.019389 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-553e583b-09a6-44e1-ab69-198439a717fe req-93cce6d8-b88b-4cc2-87ef-174590d85d0e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:29.026253 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-553e583b-09a6-44e1-ab69-198439a717fe req-93cce6d8-b88b-4cc2-87ef-174590d85d0e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:29.051249 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-553e583b-09a6-44e1-ab69-198439a717fe req-93cce6d8-b88b-4cc2-87ef-174590d85d0e service nova] Creating event network-vif-deleted:9ec644e9-34d2-4286-ac9f-d87c2adc2000 for instance 329e3811-2d1f-43ac-8c22-c2675ae6b9b8 on n-h2-846466-12 Aug 04 16:54:29.072910 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-553e583b-09a6-44e1-ab69-198439a717fe req-93cce6d8-b88b-4cc2-87ef-174590d85d0e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080302 Aug 04 16:54:29.100351 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1772/3602] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:29.136757 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d73a2cde-e5b6-407f-b7ed-e7c5cf8b8be3 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:29.138265 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d73a2cde-e5b6-407f-b7ed-e7c5cf8b8be3 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:29.158130 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d73a2cde-e5b6-407f-b7ed-e7c5cf8b8be3 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:29.159081 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d73a2cde-e5b6-407f-b7ed-e7c5cf8b8be3 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:29.160799 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d73a2cde-e5b6-407f-b7ed-e7c5cf8b8be3 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:29.163272 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d73a2cde-e5b6-407f-b7ed-e7c5cf8b8be3 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:29.312825 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d73a2cde-e5b6-407f-b7ed-e7c5cf8b8be3 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:29.324417 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d73a2cde-e5b6-407f-b7ed-e7c5cf8b8be3 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:29.326570 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d73a2cde-e5b6-407f-b7ed-e7c5cf8b8be3 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:29.328635 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d73a2cde-e5b6-407f-b7ed-e7c5cf8b8be3 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192" status: 200 len: 1366 microversion: 2.47 time: 0.237452 Aug 04 16:54:29.329218 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1773/3603] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:54:29 2022] GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:54:29.335105 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-07edbee2-ea95-4750-9f28-a7b4c944cc24 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:29.335963 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-07edbee2-ea95-4750-9f28-a7b4c944cc24 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:29.347998 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-07edbee2-ea95-4750-9f28-a7b4c944cc24 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:29.349521 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-07edbee2-ea95-4750-9f28-a7b4c944cc24 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:29.351009 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-07edbee2-ea95-4750-9f28-a7b4c944cc24 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:29.351635 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-07edbee2-ea95-4750-9f28-a7b4c944cc24 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:29.477876 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-87e18bd5-1650-4238-9acc-9ca1d989c85d tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:29.486732 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-87e18bd5-1650-4238-9acc-9ca1d989c85d tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 200 len: 1792 microversion: 2.1 time: 1.321601 Aug 04 16:54:29.502746 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1831/3604] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:28 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 1792 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:30.018497 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-80ec72c4-e81e-4148-8da6-578b0a346be5 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:30.019446 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-80ec72c4-e81e-4148-8da6-578b0a346be5 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] [instance: 10cfa2cd-b0d6-415e-aa30-74a440d1c754] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:30.042020 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-80ec72c4-e81e-4148-8da6-578b0a346be5 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:30.044868 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-80ec72c4-e81e-4148-8da6-578b0a346be5 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:30.046165 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-80ec72c4-e81e-4148-8da6-578b0a346be5 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:30.047900 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-80ec72c4-e81e-4148-8da6-578b0a346be5 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:30.399857 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-07edbee2-ea95-4750-9f28-a7b4c944cc24 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:30.413826 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-07edbee2-ea95-4750-9f28-a7b4c944cc24 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1318 microversion: 2.1 time: 1.082803 Aug 04 16:54:30.414764 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1774/3605] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:29 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1318 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:30.421045 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-63bf9f45-04ca-4586-8ad7-b327ccb3fa15 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:30.422271 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-63bf9f45-04ca-4586-8ad7-b327ccb3fa15 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:30.432467 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63bf9f45-04ca-4586-8ad7-b327ccb3fa15 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:30.433172 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63bf9f45-04ca-4586-8ad7-b327ccb3fa15 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:30.434302 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63bf9f45-04ca-4586-8ad7-b327ccb3fa15 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:30.435007 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63bf9f45-04ca-4586-8ad7-b327ccb3fa15 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:30.790037 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-80ec72c4-e81e-4148-8da6-578b0a346be5 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1a321017d04de0a62b3660623ded61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1878c64d978e4a059943138584ce96e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:30.803164 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-80ec72c4-e81e-4148-8da6-578b0a346be5 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] 10.222.0.23 "GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754" status: 200 len: 1317 microversion: 2.1 time: 0.791277 Aug 04 16:54:30.816901 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-63bf9f45-04ca-4586-8ad7-b327ccb3fa15 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:30.824027 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1832/3606] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:30 2022] GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754 => generated 1317 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:54:30.827586 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-63bf9f45-04ca-4586-8ad7-b327ccb3fa15 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:30.829613 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-63bf9f45-04ca-4586-8ad7-b327ccb3fa15 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:30.831079 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-63bf9f45-04ca-4586-8ad7-b327ccb3fa15 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192" status: 200 len: 1366 microversion: 2.47 time: 0.414387 Aug 04 16:54:30.831893 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1775/3607] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:54:30 2022] GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192 => generated 1366 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:54:30.839832 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ef94d81a-80a0-4ac4-a330-135e9e70d7a3 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:30.840652 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ef94d81a-80a0-4ac4-a330-135e9e70d7a3 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:30.859349 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef94d81a-80a0-4ac4-a330-135e9e70d7a3 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:30.860952 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef94d81a-80a0-4ac4-a330-135e9e70d7a3 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:30.862608 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef94d81a-80a0-4ac4-a330-135e9e70d7a3 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:30.864068 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef94d81a-80a0-4ac4-a330-135e9e70d7a3 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:31.110653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-e198dee0-cea0-4c01-ba90-855d1310645c req-c360c62e-3d15-44c1-97c1-254976344607 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "329e3811-2d1f-43ac-8c22-c2675ae6b9b8", "name": "network-vif-unplugged", "status": "completed", "tag": "804d18b1-8d51-45f4-befe-8fc753241f09"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:31.129598 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-e198dee0-cea0-4c01-ba90-855d1310645c req-c360c62e-3d15-44c1-97c1-254976344607 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:31.130048 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-e198dee0-cea0-4c01-ba90-855d1310645c req-c360c62e-3d15-44c1-97c1-254976344607 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:31.156398 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-e198dee0-cea0-4c01-ba90-855d1310645c req-c360c62e-3d15-44c1-97c1-254976344607 service nova] Creating event network-vif-unplugged:804d18b1-8d51-45f4-befe-8fc753241f09 for instance 329e3811-2d1f-43ac-8c22-c2675ae6b9b8 on n-h2-846466-12 Aug 04 16:54:31.173261 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-e198dee0-cea0-4c01-ba90-855d1310645c req-c360c62e-3d15-44c1-97c1-254976344607 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066267 Aug 04 16:54:31.174199 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1776/3608] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:31.438515 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1349f59c-9a29-4a04-abd9-fcc874a6020d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:31.440220 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1349f59c-9a29-4a04-abd9-fcc874a6020d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:31.453766 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1349f59c-9a29-4a04-abd9-fcc874a6020d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:31.457489 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1349f59c-9a29-4a04-abd9-fcc874a6020d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:31.462960 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1349f59c-9a29-4a04-abd9-fcc874a6020d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:31.465458 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1349f59c-9a29-4a04-abd9-fcc874a6020d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:31.475647 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ef94d81a-80a0-4ac4-a330-135e9e70d7a3 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:31.489970 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ef94d81a-80a0-4ac4-a330-135e9e70d7a3 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 200 len: 1633 microversion: 2.1 time: 0.664316 Aug 04 16:54:31.492982 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1833/3609] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:30 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 1633 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:31.843052 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c22e0e5c-416d-444e-9a8c-5b3d16557a87 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:31.844617 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c22e0e5c-416d-444e-9a8c-5b3d16557a87 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] [instance: 10cfa2cd-b0d6-415e-aa30-74a440d1c754] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:31.855182 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:31.864123 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c22e0e5c-416d-444e-9a8c-5b3d16557a87 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:31.864784 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c22e0e5c-416d-444e-9a8c-5b3d16557a87 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:31.865727 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c22e0e5c-416d-444e-9a8c-5b3d16557a87 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:31.866264 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c22e0e5c-416d-444e-9a8c-5b3d16557a87 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:32.857015 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1349f59c-9a29-4a04-abd9-fcc874a6020d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:32.876551 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1349f59c-9a29-4a04-abd9-fcc874a6020d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1318 microversion: 2.1 time: 1.440555 Aug 04 16:54:32.880306 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1777/3610] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:31 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1318 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:54:32.899717 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-29f674f6-401d-4bc1-ab45-02b9afbef700 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:32.900620 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-29f674f6-401d-4bc1-ab45-02b9afbef700 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:32.910789 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:32.917392 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-29f674f6-401d-4bc1-ab45-02b9afbef700 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:32.918104 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-29f674f6-401d-4bc1-ab45-02b9afbef700 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:32.922454 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-29f674f6-401d-4bc1-ab45-02b9afbef700 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:32.923206 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-29f674f6-401d-4bc1-ab45-02b9afbef700 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:33.157106 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-29f674f6-401d-4bc1-ab45-02b9afbef700 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:33.165607 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:33.171018 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-29f674f6-401d-4bc1-ab45-02b9afbef700 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:33.180039 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-29f674f6-401d-4bc1-ab45-02b9afbef700 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:33.184225 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-29f674f6-401d-4bc1-ab45-02b9afbef700 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192" status: 200 len: 1366 microversion: 2.47 time: 0.301373 Aug 04 16:54:33.185695 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1778/3611] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:54:32 2022] GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192 => generated 1366 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:54:33.204949 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-4f68c987-5e2f-476d-b303-9decf6a83224 req-fdec6bda-a6cc-4ab2-b9a2-4992647df4e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "329e3811-2d1f-43ac-8c22-c2675ae6b9b8", "name": "network-vif-deleted", "tag": "804d18b1-8d51-45f4-befe-8fc753241f09"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:33.242630 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-4f68c987-5e2f-476d-b303-9decf6a83224 req-fdec6bda-a6cc-4ab2-b9a2-4992647df4e1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:33.243788 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-4f68c987-5e2f-476d-b303-9decf6a83224 req-fdec6bda-a6cc-4ab2-b9a2-4992647df4e1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:33.287524 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-4f68c987-5e2f-476d-b303-9decf6a83224 req-fdec6bda-a6cc-4ab2-b9a2-4992647df4e1 service nova] Creating event network-vif-deleted:804d18b1-8d51-45f4-befe-8fc753241f09 for instance 329e3811-2d1f-43ac-8c22-c2675ae6b9b8 on n-h2-846466-12 Aug 04 16:54:33.296253 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-4f68c987-5e2f-476d-b303-9decf6a83224 req-fdec6bda-a6cc-4ab2-b9a2-4992647df4e1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108289 Aug 04 16:54:33.297642 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1779/3612] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:33.307782 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c22e0e5c-416d-444e-9a8c-5b3d16557a87 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1a321017d04de0a62b3660623ded61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1878c64d978e4a059943138584ce96e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:33.322679 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c702e10a-5d94-468e-abb4-a998c3a1f8bc tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:33.324864 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c702e10a-5d94-468e-abb4-a998c3a1f8bc tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:33.333825 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c22e0e5c-416d-444e-9a8c-5b3d16557a87 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] 10.222.0.23 "GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754" status: 200 len: 1317 microversion: 2.1 time: 1.494549 Aug 04 16:54:33.337337 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c702e10a-5d94-468e-abb4-a998c3a1f8bc tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:33.338114 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1834/3613] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:31 2022] GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754 => generated 1317 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:54:33.354137 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c702e10a-5d94-468e-abb4-a998c3a1f8bc tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:33.355408 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c702e10a-5d94-468e-abb4-a998c3a1f8bc tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:33.358899 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c702e10a-5d94-468e-abb4-a998c3a1f8bc tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:33.552989 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-62f48064-f7aa-495b-8f27-e1ef6cc6b0da req-b26ada9d-f812-4187-bdf5-b19f3c899a30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0", "name": "network-vif-plugged", "status": "completed", "tag": "b11cc5b4-996e-44be-b5e9-d3ff403d692f"}, {"server_uuid": "329e3811-2d1f-43ac-8c22-c2675ae6b9b8", "name": "network-vif-unplugged", "status": "completed", "tag": "a718ac0b-984d-48a3-81aa-93b60f1cfb88"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:33.580478 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-62f48064-f7aa-495b-8f27-e1ef6cc6b0da req-b26ada9d-f812-4187-bdf5-b19f3c899a30 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:33.581080 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-62f48064-f7aa-495b-8f27-e1ef6cc6b0da req-b26ada9d-f812-4187-bdf5-b19f3c899a30 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:33.606852 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-62f48064-f7aa-495b-8f27-e1ef6cc6b0da req-b26ada9d-f812-4187-bdf5-b19f3c899a30 service nova] Creating event network-vif-plugged:b11cc5b4-996e-44be-b5e9-d3ff403d692f for instance 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 on n-h1-846466-12 Aug 04 16:54:33.624357 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-62f48064-f7aa-495b-8f27-e1ef6cc6b0da req-b26ada9d-f812-4187-bdf5-b19f3c899a30 service nova] Creating event network-vif-unplugged:a718ac0b-984d-48a3-81aa-93b60f1cfb88 for instance 329e3811-2d1f-43ac-8c22-c2675ae6b9b8 on n-h2-846466-12 Aug 04 16:54:33.649896 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-62f48064-f7aa-495b-8f27-e1ef6cc6b0da req-b26ada9d-f812-4187-bdf5-b19f3c899a30 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.101238 Aug 04 16:54:33.651439 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1835/3614] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:54:33.923504 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c702e10a-5d94-468e-abb4-a998c3a1f8bc tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:33.930122 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7f5986f8-dda5-4b78-8601-22c41d5c6bb5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:33.931469 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7f5986f8-dda5-4b78-8601-22c41d5c6bb5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:33.934447 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c702e10a-5d94-468e-abb4-a998c3a1f8bc tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 200 len: 1497 microversion: 2.1 time: 0.635309 Aug 04 16:54:33.935868 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1780/3615] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:33 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 1497 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:33.960970 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7f5986f8-dda5-4b78-8601-22c41d5c6bb5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:33.961507 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7f5986f8-dda5-4b78-8601-22c41d5c6bb5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:33.966534 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7f5986f8-dda5-4b78-8601-22c41d5c6bb5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:33.967824 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7f5986f8-dda5-4b78-8601-22c41d5c6bb5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:34.209793 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-34ce8c3d-2c8e-4ddf-b028-318dea9a683c tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:34.210506 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-34ce8c3d-2c8e-4ddf-b028-318dea9a683c tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:34.222829 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-34ce8c3d-2c8e-4ddf-b028-318dea9a683c tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:34.230193 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-34ce8c3d-2c8e-4ddf-b028-318dea9a683c tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:34.231696 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-34ce8c3d-2c8e-4ddf-b028-318dea9a683c tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:34.232151 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-34ce8c3d-2c8e-4ddf-b028-318dea9a683c tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:34.402661 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-34ce8c3d-2c8e-4ddf-b028-318dea9a683c tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:34.427410 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-34ce8c3d-2c8e-4ddf-b028-318dea9a683c tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:34.429259 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-34ce8c3d-2c8e-4ddf-b028-318dea9a683c tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:34.430685 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-34ce8c3d-2c8e-4ddf-b028-318dea9a683c tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192" status: 200 len: 1366 microversion: 2.47 time: 0.226424 Aug 04 16:54:34.431730 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1781/3616] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:54:34 2022] GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:54:34.453625 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-24fb52de-ab34-49b1-8a8d-98a484130e34 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:34.454547 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-24fb52de-ab34-49b1-8a8d-98a484130e34 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] [instance: 10cfa2cd-b0d6-415e-aa30-74a440d1c754] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:34.462240 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-24fb52de-ab34-49b1-8a8d-98a484130e34 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:34.462398 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7f5986f8-dda5-4b78-8601-22c41d5c6bb5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:34.466671 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-24fb52de-ab34-49b1-8a8d-98a484130e34 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:34.467842 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-24fb52de-ab34-49b1-8a8d-98a484130e34 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:34.468993 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-24fb52de-ab34-49b1-8a8d-98a484130e34 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:34.481874 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7f5986f8-dda5-4b78-8601-22c41d5c6bb5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1318 microversion: 2.1 time: 0.576880 Aug 04 16:54:34.484115 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1836/3617] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:33 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1318 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:34.957933 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-899ded7c-63b6-45db-a9f8-c46e1adf9099 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:34.958548 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-899ded7c-63b6-45db-a9f8-c46e1adf9099 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:34.979553 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-899ded7c-63b6-45db-a9f8-c46e1adf9099 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:34.985798 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-899ded7c-63b6-45db-a9f8-c46e1adf9099 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:34.987358 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-899ded7c-63b6-45db-a9f8-c46e1adf9099 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:34.987814 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-899ded7c-63b6-45db-a9f8-c46e1adf9099 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:35.107134 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-899ded7c-63b6-45db-a9f8-c46e1adf9099 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:35.107589 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-899ded7c-63b6-45db-a9f8-c46e1adf9099 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:35.108042 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-899ded7c-63b6-45db-a9f8-c46e1adf9099 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lazy-loading 'fault' on Instance uuid 329e3811-2d1f-43ac-8c22-c2675ae6b9b8 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:54:35.381661 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-899ded7c-63b6-45db-a9f8-c46e1adf9099 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:35.390416 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-899ded7c-63b6-45db-a9f8-c46e1adf9099 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 200 len: 1303 microversion: 2.1 time: 0.437604 Aug 04 16:54:35.405875 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1837/3618] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:34 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 1303 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:35.432447 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-6119d5a5-f3ab-43a2-af6b-7ddfa5d64d2f req-edf27d65-0318-422d-9a52-c6352a5eddf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "329e3811-2d1f-43ac-8c22-c2675ae6b9b8", "name": "network-vif-deleted", "tag": "a718ac0b-984d-48a3-81aa-93b60f1cfb88"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:35.438920 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-24fb52de-ab34-49b1-8a8d-98a484130e34 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1a321017d04de0a62b3660623ded61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1878c64d978e4a059943138584ce96e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:35.453725 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-24fb52de-ab34-49b1-8a8d-98a484130e34 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] 10.222.0.23 "GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754" status: 200 len: 1317 microversion: 2.1 time: 1.020574 Aug 04 16:54:35.454344 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1782/3619] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:34 2022] GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754 => generated 1317 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:35.479030 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6119d5a5-f3ab-43a2-af6b-7ddfa5d64d2f req-edf27d65-0318-422d-9a52-c6352a5eddf7 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:35.479639 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6119d5a5-f3ab-43a2-af6b-7ddfa5d64d2f req-edf27d65-0318-422d-9a52-c6352a5eddf7 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:35.502608 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-06ceab7d-edcd-4902-9dfe-92e7bf490227 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:35.507271 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-06ceab7d-edcd-4902-9dfe-92e7bf490227 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:35.531662 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-06ceab7d-edcd-4902-9dfe-92e7bf490227 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:35.532119 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-06ceab7d-edcd-4902-9dfe-92e7bf490227 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:35.541582 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-06ceab7d-edcd-4902-9dfe-92e7bf490227 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:35.543144 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-06ceab7d-edcd-4902-9dfe-92e7bf490227 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:35.554603 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-6119d5a5-f3ab-43a2-af6b-7ddfa5d64d2f req-edf27d65-0318-422d-9a52-c6352a5eddf7 service nova] Creating event network-vif-deleted:a718ac0b-984d-48a3-81aa-93b60f1cfb88 for instance 329e3811-2d1f-43ac-8c22-c2675ae6b9b8 on n-h2-846466-12 Aug 04 16:54:35.579232 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-6119d5a5-f3ab-43a2-af6b-7ddfa5d64d2f req-edf27d65-0318-422d-9a52-c6352a5eddf7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169199 Aug 04 16:54:35.583773 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1838/3620] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:35.614149 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-35797377-5c8f-40be-8d7a-7af17d5da658 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:35.616183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-35797377-5c8f-40be-8d7a-7af17d5da658 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:35.641712 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-35797377-5c8f-40be-8d7a-7af17d5da658 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:35.642503 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-35797377-5c8f-40be-8d7a-7af17d5da658 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:35.643880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-35797377-5c8f-40be-8d7a-7af17d5da658 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:35.644696 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-35797377-5c8f-40be-8d7a-7af17d5da658 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:35.906777 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-06ceab7d-edcd-4902-9dfe-92e7bf490227 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:35.916905 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-06ceab7d-edcd-4902-9dfe-92e7bf490227 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:35.918369 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-06ceab7d-edcd-4902-9dfe-92e7bf490227 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:35.927612 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-06ceab7d-edcd-4902-9dfe-92e7bf490227 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192" status: 200 len: 1366 microversion: 2.47 time: 0.447726 Aug 04 16:54:35.929142 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1783/3621] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:54:35 2022] GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192 => generated 1366 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:54:35.942367 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-204ec23a-5a9a-4880-9417-79bde8ee63ea req-cdbb503c-35a8-423c-b2fc-23c71eb6b2f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10cfa2cd-b0d6-415e-aa30-74a440d1c754", "name": "network-vif-plugged", "status": "completed", "tag": "82c65cf6-2f98-47eb-b209-c6fbc06b8ca9"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:35.968726 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-204ec23a-5a9a-4880-9417-79bde8ee63ea req-cdbb503c-35a8-423c-b2fc-23c71eb6b2f8 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:35.969653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-204ec23a-5a9a-4880-9417-79bde8ee63ea req-cdbb503c-35a8-423c-b2fc-23c71eb6b2f8 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:36.006586 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-204ec23a-5a9a-4880-9417-79bde8ee63ea req-cdbb503c-35a8-423c-b2fc-23c71eb6b2f8 service nova] Creating event network-vif-plugged:82c65cf6-2f98-47eb-b209-c6fbc06b8ca9 for instance 10cfa2cd-b0d6-415e-aa30-74a440d1c754 on n-h1-846466-12 Aug 04 16:54:36.016674 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-204ec23a-5a9a-4880-9417-79bde8ee63ea req-cdbb503c-35a8-423c-b2fc-23c71eb6b2f8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085521 Aug 04 16:54:36.017366 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1784/3622] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:36.047499 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-35797377-5c8f-40be-8d7a-7af17d5da658 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:36.056781 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-35797377-5c8f-40be-8d7a-7af17d5da658 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1318 microversion: 2.1 time: 0.471576 Aug 04 16:54:36.061373 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1839/3623] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:35 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1318 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:36.413111 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c7234360-1e81-4fe3-b302-10b6e000d01e tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:36.414220 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c7234360-1e81-4fe3-b302-10b6e000d01e tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:36.436724 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c7234360-1e81-4fe3-b302-10b6e000d01e tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:36.444745 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c7234360-1e81-4fe3-b302-10b6e000d01e tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:36.446359 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c7234360-1e81-4fe3-b302-10b6e000d01e tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:36.447910 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c7234360-1e81-4fe3-b302-10b6e000d01e tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:36.475197 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4aa80bdb-60c7-4c92-abfd-824d60c6217b tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:36.476495 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4aa80bdb-60c7-4c92-abfd-824d60c6217b tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] [instance: 10cfa2cd-b0d6-415e-aa30-74a440d1c754] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:36.487127 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-c7234360-1e81-4fe3-b302-10b6e000d01e tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] HTTP exception thrown: Instance 329e3811-2d1f-43ac-8c22-c2675ae6b9b8 could not be found. Aug 04 16:54:36.493583 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4aa80bdb-60c7-4c92-abfd-824d60c6217b tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:36.496193 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4aa80bdb-60c7-4c92-abfd-824d60c6217b tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c7234360-1e81-4fe3-b302-10b6e000d01e tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Request method failure captured: Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 HTTP/1.1 Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_l2g4KtumvV9QQUUZUrINZS8hwWh28SywFMo8l6KpFQ3BO4CjPHxGwOX5o8jJgOQOoRwDIYhrSDz6njBuvdTekquUqSiX2ItNkMLxUncmMidO9p3h5iqlPNycA5mDNVFsrpk9m7q-tkUQKfSJMbEYCUloL0JUt_MYxZnEs7Ln6JKfc Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: dc0ad871e21842a19511864aa9cd26c6 Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersTestMultiNic-1393454007 Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc0ad871e21842a19511864aa9cd26c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dc0ad871e21842a19511864aa9cd26c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc0ad871e21842a19511864aa9cd26c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dc0ad871e21842a19511864aa9cd26c6"}]}] Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersTestMultiNic-1393454007 Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: dc0ad871e21842a19511864aa9cd26c6 Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersTestMultiNic-1393454007 Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersTestMultiNic-1393454007-project Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 33f7d4658f514bda8e64382fd5e42bf1 Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersTestMultiNic-1393454007-project Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 329e3811-2d1f-43ac-8c22-c2675ae6b9b8 could not be found. Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '329e3811-2d1f-43ac-8c22-c2675ae6b9b8'} Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 329e3811-2d1f-43ac-8c22-c2675ae6b9b8 could not be found. Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 329e3811-2d1f-43ac-8c22-c2675ae6b9b8 could not be found. Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:36.496313 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:54:36.499796 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:36.499796 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:36.499796 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:36.499796 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:54:36.499796 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:54:36.499796 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 329e3811-2d1f-43ac-8c22-c2675ae6b9b8 could not be found. Aug 04 16:54:36.499796 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:54:36.499796 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c7234360-1e81-4fe3-b302-10b6e000d01e tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Returning 404 to user: Instance 329e3811-2d1f-43ac-8c22-c2675ae6b9b8 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:54:36.504152 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4aa80bdb-60c7-4c92-abfd-824d60c6217b tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:36.506478 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4aa80bdb-60c7-4c92-abfd-824d60c6217b tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:36.511267 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c7234360-1e81-4fe3-b302-10b6e000d01e tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 404 len: 111 microversion: 2.1 time: 0.097854 Aug 04 16:54:36.512086 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1785/3624] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:36 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:54:36.956208 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-925f5083-1f6e-40cf-b4f9-030976f979fc tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:36.956694 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-925f5083-1f6e-40cf-b4f9-030976f979fc tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:36.970620 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-925f5083-1f6e-40cf-b4f9-030976f979fc tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:36.973628 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-925f5083-1f6e-40cf-b4f9-030976f979fc tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:36.977208 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-925f5083-1f6e-40cf-b4f9-030976f979fc tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:36.977910 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-925f5083-1f6e-40cf-b4f9-030976f979fc tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:37.318900 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-925f5083-1f6e-40cf-b4f9-030976f979fc tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:37.332373 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-925f5083-1f6e-40cf-b4f9-030976f979fc tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:37.334819 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-925f5083-1f6e-40cf-b4f9-030976f979fc tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:37.336538 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-925f5083-1f6e-40cf-b4f9-030976f979fc tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192" status: 200 len: 1372 microversion: 2.47 time: 0.384989 Aug 04 16:54:37.339409 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1786/3625] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:54:36 2022] GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192 => generated 1372 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:54:37.345055 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-59eb8bdc-b4e1-4dbb-9646-50bce105e0d7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:37.345962 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-59eb8bdc-b4e1-4dbb-9646-50bce105e0d7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:37.355809 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-59eb8bdc-b4e1-4dbb-9646-50bce105e0d7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:37.356508 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-59eb8bdc-b4e1-4dbb-9646-50bce105e0d7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:37.357475 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-59eb8bdc-b4e1-4dbb-9646-50bce105e0d7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:37.358044 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-59eb8bdc-b4e1-4dbb-9646-50bce105e0d7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:37.416651 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4aa80bdb-60c7-4c92-abfd-824d60c6217b tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1a321017d04de0a62b3660623ded61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1878c64d978e4a059943138584ce96e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:37.427438 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4aa80bdb-60c7-4c92-abfd-824d60c6217b tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] 10.222.0.23 "GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754" status: 200 len: 1317 microversion: 2.1 time: 0.956387 Aug 04 16:54:37.431611 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1840/3626] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:36 2022] GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754 => generated 1317 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:37.627495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-59eb8bdc-b4e1-4dbb-9646-50bce105e0d7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:37.649643 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-59eb8bdc-b4e1-4dbb-9646-50bce105e0d7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1508 microversion: 2.1 time: 0.308875 Aug 04 16:54:37.652299 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1787/3627] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:37 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1508 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:37.674990 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-93e18c2f-da53-4c1e-963f-6fdba476dc3a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:37.677945 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-93e18c2f-da53-4c1e-963f-6fdba476dc3a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:37.689754 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-93e18c2f-da53-4c1e-963f-6fdba476dc3a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:37.690496 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-93e18c2f-da53-4c1e-963f-6fdba476dc3a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:37.691495 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-93e18c2f-da53-4c1e-963f-6fdba476dc3a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:37.692687 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-93e18c2f-da53-4c1e-963f-6fdba476dc3a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:38.366668 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-93e18c2f-da53-4c1e-963f-6fdba476dc3a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:38.369143 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5e90b3bd-9d65-4f40-956b-321d365dfb7a tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:38.379250 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5e90b3bd-9d65-4f40-956b-321d365dfb7a tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:38.399136 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-93e18c2f-da53-4c1e-963f-6fdba476dc3a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1508 microversion: 2.1 time: 0.728336 Aug 04 16:54:38.405682 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1841/3628] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:37 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1508 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:38.421155 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e90b3bd-9d65-4f40-956b-321d365dfb7a tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:38.423336 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6753417a-76e5-4d56-9353-5a8406d47abf tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "OS-DCF:diskConfig": "AUTO"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:38.427283 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6753417a-76e5-4d56-9353-5a8406d47abf tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:38.427669 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e90b3bd-9d65-4f40-956b-321d365dfb7a tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:38.428735 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e90b3bd-9d65-4f40-956b-321d365dfb7a tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:38.429429 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e90b3bd-9d65-4f40-956b-321d365dfb7a tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:38.442533 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6753417a-76e5-4d56-9353-5a8406d47abf tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:38.442988 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6753417a-76e5-4d56-9353-5a8406d47abf tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:38.443788 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6753417a-76e5-4d56-9353-5a8406d47abf tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:38.444221 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6753417a-76e5-4d56-9353-5a8406d47abf tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:38.593944 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-6753417a-76e5-4d56-9353-5a8406d47abf tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:54:38.606063 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-6753417a-76e5-4d56-9353-5a8406d47abf tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:54:38.608075 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-6753417a-76e5-4d56-9353-5a8406d47abf tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:54:38.608643 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-6753417a-76e5-4d56-9353-5a8406d47abf tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:54:38.609275 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-6753417a-76e5-4d56-9353-5a8406d47abf tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:54:38.670215 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5e90b3bd-9d65-4f40-956b-321d365dfb7a tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:38.685065 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5e90b3bd-9d65-4f40-956b-321d365dfb7a tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:38.687806 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5e90b3bd-9d65-4f40-956b-321d365dfb7a tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:38.694378 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5e90b3bd-9d65-4f40-956b-321d365dfb7a tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192" status: 200 len: 1372 microversion: 2.47 time: 0.330595 Aug 04 16:54:38.710098 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1788/3629] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:54:38 2022] GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192 => generated 1372 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:54:38.715350 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-369027ef-9595-4d88-8bcd-eb823990e1f7 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:38.716234 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-369027ef-9595-4d88-8bcd-eb823990e1f7 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] [instance: 10cfa2cd-b0d6-415e-aa30-74a440d1c754] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:38.723433 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-369027ef-9595-4d88-8bcd-eb823990e1f7 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:38.724137 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-369027ef-9595-4d88-8bcd-eb823990e1f7 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:38.725077 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-369027ef-9595-4d88-8bcd-eb823990e1f7 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:38.725679 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-369027ef-9595-4d88-8bcd-eb823990e1f7 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:38.791006 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6753417a-76e5-4d56-9353-5a8406d47abf tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:38.805665 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6753417a-76e5-4d56-9353-5a8406d47abf tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:38.806121 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6753417a-76e5-4d56-9353-5a8406d47abf tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:38.807945 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6753417a-76e5-4d56-9353-5a8406d47abf tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:38.809600 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6753417a-76e5-4d56-9353-5a8406d47abf tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:38.885214 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6753417a-76e5-4d56-9353-5a8406d47abf tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "POST /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0/action" status: 202 len: 1110 microversion: 2.1 time: 0.466060 Aug 04 16:54:38.886704 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1842/3630] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:54:38 2022] POST /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0/action => generated 1110 bytes in 468 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 16:54:38.903928 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6d66b04f-bbff-44d1-9851-063c60c24bed tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:38.904961 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6d66b04f-bbff-44d1-9851-063c60c24bed tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:38.921148 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d66b04f-bbff-44d1-9851-063c60c24bed tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:38.921980 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d66b04f-bbff-44d1-9851-063c60c24bed tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:38.923151 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d66b04f-bbff-44d1-9851-063c60c24bed tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:38.923752 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d66b04f-bbff-44d1-9851-063c60c24bed tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:39.284564 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-369027ef-9595-4d88-8bcd-eb823990e1f7 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1a321017d04de0a62b3660623ded61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1878c64d978e4a059943138584ce96e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:39.298798 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-369027ef-9595-4d88-8bcd-eb823990e1f7 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] 10.222.0.23 "GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754" status: 200 len: 1317 microversion: 2.1 time: 0.587202 Aug 04 16:54:39.302018 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1789/3631] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:38 2022] GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754 => generated 1317 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:39.624652 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6d66b04f-bbff-44d1-9851-063c60c24bed tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:39.660621 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6d66b04f-bbff-44d1-9851-063c60c24bed tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1515 microversion: 2.1 time: 0.760719 Aug 04 16:54:39.665735 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1843/3632] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:38 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1515 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:54:39.729377 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-631ffc9e-ed58-4325-a49c-d165888e42ed tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:39.731755 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-631ffc9e-ed58-4325-a49c-d165888e42ed tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:39.755577 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-631ffc9e-ed58-4325-a49c-d165888e42ed tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:39.757784 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-631ffc9e-ed58-4325-a49c-d165888e42ed tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:39.760697 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-631ffc9e-ed58-4325-a49c-d165888e42ed tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:39.761468 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-631ffc9e-ed58-4325-a49c-d165888e42ed tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:39.964459 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-631ffc9e-ed58-4325-a49c-d165888e42ed tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:39.979591 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-631ffc9e-ed58-4325-a49c-d165888e42ed tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:39.986002 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-631ffc9e-ed58-4325-a49c-d165888e42ed tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:39.989559 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-631ffc9e-ed58-4325-a49c-d165888e42ed tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192" status: 200 len: 1372 microversion: 2.47 time: 0.275141 Aug 04 16:54:39.997006 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1790/3633] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:54:39 2022] GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192 => generated 1372 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:54:40.328504 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-659298f1-629e-4993-a029-9801ed74a4ff tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:40.329116 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-659298f1-629e-4993-a029-9801ed74a4ff tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] [instance: 10cfa2cd-b0d6-415e-aa30-74a440d1c754] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:40.339989 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-659298f1-629e-4993-a029-9801ed74a4ff tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:40.342290 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-659298f1-629e-4993-a029-9801ed74a4ff tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:40.348013 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-659298f1-629e-4993-a029-9801ed74a4ff tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:40.351845 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-659298f1-629e-4993-a029-9801ed74a4ff tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:40.683844 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-08e3abd7-4950-4c4b-94ed-e0c1f7c09bf0 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:40.685247 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-08e3abd7-4950-4c4b-94ed-e0c1f7c09bf0 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:40.698429 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-08e3abd7-4950-4c4b-94ed-e0c1f7c09bf0 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:40.700123 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-08e3abd7-4950-4c4b-94ed-e0c1f7c09bf0 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:40.700994 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-08e3abd7-4950-4c4b-94ed-e0c1f7c09bf0 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:40.703584 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-08e3abd7-4950-4c4b-94ed-e0c1f7c09bf0 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:40.850455 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-659298f1-629e-4993-a029-9801ed74a4ff tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1a321017d04de0a62b3660623ded61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1878c64d978e4a059943138584ce96e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:40.864237 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-659298f1-629e-4993-a029-9801ed74a4ff tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] 10.222.0.23 "GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754" status: 200 len: 1506 microversion: 2.1 time: 0.539953 Aug 04 16:54:40.867009 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1844/3634] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:40 2022] GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754 => generated 1506 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:41.117327 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0c6991f2-93b1-48ac-bc9e-d6c8a0195b1e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-573906738", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "b83d6df0-d970-41bd-ae99-1dfc6211d426"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:41.199346 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-0c6991f2-93b1-48ac-bc9e-d6c8a0195b1e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] validate_networks() for [('b83d6df0-d970-41bd-ae99-1dfc6211d426', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:54:41.585508 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-08e3abd7-4950-4c4b-94ed-e0c1f7c09bf0 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:41.614807 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-08e3abd7-4950-4c4b-94ed-e0c1f7c09bf0 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1515 microversion: 2.1 time: 0.934439 Aug 04 16:54:41.616316 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1791/3635] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:40 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1515 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:41.625596 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-78341b5e-8f33-4171-a535-164ea00a19b0 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:41.626721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-78341b5e-8f33-4171-a535-164ea00a19b0 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] [instance: 10cfa2cd-b0d6-415e-aa30-74a440d1c754] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:41.637973 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-78341b5e-8f33-4171-a535-164ea00a19b0 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:41.639558 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-78341b5e-8f33-4171-a535-164ea00a19b0 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:41.641373 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-78341b5e-8f33-4171-a535-164ea00a19b0 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:41.642474 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-78341b5e-8f33-4171-a535-164ea00a19b0 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:41.684007 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-78341b5e-8f33-4171-a535-164ea00a19b0 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] 10.222.0.23 "GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754/ips" status: 200 len: 109 microversion: 2.1 time: 0.065857 Aug 04 16:54:41.684981 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1792/3636] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Aug 4 16:54:41 2022] GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754/ips => generated 109 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:41.690071 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-49f1e04f-9110-48f8-9c9d-a2d549146a59 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:41.690905 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-49f1e04f-9110-48f8-9c9d-a2d549146a59 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:41.699021 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-49f1e04f-9110-48f8-9c9d-a2d549146a59 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:41.700429 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-49f1e04f-9110-48f8-9c9d-a2d549146a59 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:41.701480 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-49f1e04f-9110-48f8-9c9d-a2d549146a59 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:41.702060 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-49f1e04f-9110-48f8-9c9d-a2d549146a59 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:41.838690 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-49f1e04f-9110-48f8-9c9d-a2d549146a59 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:41.857635 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-49f1e04f-9110-48f8-9c9d-a2d549146a59 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:41.867357 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-49f1e04f-9110-48f8-9c9d-a2d549146a59 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:41.871957 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-49f1e04f-9110-48f8-9c9d-a2d549146a59 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192" status: 200 len: 1357 microversion: 2.47 time: 0.185586 Aug 04 16:54:41.873254 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1793/3637] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:54:41 2022] GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192 => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:54:41.889916 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-16bfb2b3-fa7d-405d-b5ba-b7eb87ccfbea tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:41.892472 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-16bfb2b3-fa7d-405d-b5ba-b7eb87ccfbea tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] [instance: 10cfa2cd-b0d6-415e-aa30-74a440d1c754] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:41.912698 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-16bfb2b3-fa7d-405d-b5ba-b7eb87ccfbea tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:41.914530 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-16bfb2b3-fa7d-405d-b5ba-b7eb87ccfbea tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:41.917908 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-16bfb2b3-fa7d-405d-b5ba-b7eb87ccfbea tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:41.919757 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-16bfb2b3-fa7d-405d-b5ba-b7eb87ccfbea tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:41.976251 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-16bfb2b3-fa7d-405d-b5ba-b7eb87ccfbea tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] 10.222.0.23 "GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754/ips" status: 200 len: 109 microversion: 2.1 time: 0.100388 Aug 04 16:54:41.977038 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1794/3638] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Aug 4 16:54:41 2022] GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754/ips => generated 109 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:41.981568 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d5f146ed-9d31-4996-804d-a4dd14cdc65b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:42.002094 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d5f146ed-9d31-4996-804d-a4dd14cdc65b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:42.004768 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d5f146ed-9d31-4996-804d-a4dd14cdc65b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Searching by: {'deleted': False, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99'} {{(pid=126126) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:54:42.017509 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d5f146ed-9d31-4996-804d-a4dd14cdc65b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:42.017953 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d5f146ed-9d31-4996-804d-a4dd14cdc65b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:42.018756 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d5f146ed-9d31-4996-804d-a4dd14cdc65b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:42.019162 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d5f146ed-9d31-4996-804d-a4dd14cdc65b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:42.274281 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.multi_cell_list [None req-d5f146ed-9d31-4996-804d-a4dd14cdc65b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126126) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:54:42.399931 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-0c6991f2-93b1-48ac-bc9e-d6c8a0195b1e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:54:42.400680 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-0c6991f2-93b1-48ac-bc9e-d6c8a0195b1e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:54:42.401824 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-0c6991f2-93b1-48ac-bc9e-d6c8a0195b1e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:54:42.402740 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-0c6991f2-93b1-48ac-bc9e-d6c8a0195b1e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:54:42.403897 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-0c6991f2-93b1-48ac-bc9e-d6c8a0195b1e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:54:42.436836 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0c6991f2-93b1-48ac-bc9e-d6c8a0195b1e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:42.438273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0c6991f2-93b1-48ac-bc9e-d6c8a0195b1e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:42.440709 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0c6991f2-93b1-48ac-bc9e-d6c8a0195b1e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:42.442610 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0c6991f2-93b1-48ac-bc9e-d6c8a0195b1e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:42.487142 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-0c6991f2-93b1-48ac-bc9e-d6c8a0195b1e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Getting quotas for project fa4bb1fda4ef4267829850c4c616df77. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:54:42.503133 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-0c6991f2-93b1-48ac-bc9e-d6c8a0195b1e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Getting quotas for user db8a96da1d7943599ee6ca9df18f5148 and project fa4bb1fda4ef4267829850c4c616df77. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:54:42.513163 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d5f146ed-9d31-4996-804d-a4dd14cdc65b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:42.541963 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0c6991f2-93b1-48ac-bc9e-d6c8a0195b1e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:54:42.545247 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0c6991f2-93b1-48ac-bc9e-d6c8a0195b1e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:54:42.547345 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d5f146ed-9d31-4996-804d-a4dd14cdc65b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:42.550299 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d5f146ed-9d31-4996-804d-a4dd14cdc65b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:42.596537 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d5f146ed-9d31-4996-804d-a4dd14cdc65b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:42.603028 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d5f146ed-9d31-4996-804d-a4dd14cdc65b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:42.709727 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0c6991f2-93b1-48ac-bc9e-d6c8a0195b1e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.841190 Aug 04 16:54:42.710599 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d5f146ed-9d31-4996-804d-a4dd14cdc65b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.731768 Aug 04 16:54:42.712120 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1795/3639] 10.222.0.23 () {60 vars in 1187 bytes} [Thu Aug 4 16:54:41 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:54:42.740968 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1845/3640] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:54:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:54:42.745801 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1d7137fd-331f-4e80-9b76-906af5b41abc tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:42.746911 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1d7137fd-331f-4e80-9b76-906af5b41abc tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] [instance: 10cfa2cd-b0d6-415e-aa30-74a440d1c754] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:42.755871 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-99ce5488-77f3-427f-84b1-043f0cfab98d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:42.756526 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-99ce5488-77f3-427f-84b1-043f0cfab98d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:42.758674 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d7137fd-331f-4e80-9b76-906af5b41abc tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:42.759534 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d7137fd-331f-4e80-9b76-906af5b41abc tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:42.760874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d7137fd-331f-4e80-9b76-906af5b41abc tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:42.761642 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d7137fd-331f-4e80-9b76-906af5b41abc tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:42.789004 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-99ce5488-77f3-427f-84b1-043f0cfab98d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:42.789818 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-99ce5488-77f3-427f-84b1-043f0cfab98d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:42.790832 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-99ce5488-77f3-427f-84b1-043f0cfab98d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:42.791374 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-99ce5488-77f3-427f-84b1-043f0cfab98d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:42.814122 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1d7137fd-331f-4e80-9b76-906af5b41abc tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] 10.222.0.23 "GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754/ips/tempest-ServerAddressesTestJSON-2097805276-network" status: 200 len: 94 microversion: 2.1 time: 0.100402 Aug 04 16:54:42.824803 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1796/3641] 10.222.0.23 () {58 vars in 1401 bytes} [Thu Aug 4 16:54:42 2022] GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754/ips/tempest-ServerAddressesTestJSON-2097805276-network => generated 94 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:54:42.831709 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2a8a0107-5567-4ea3-90a6-73d2085332df tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:42.832600 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2a8a0107-5567-4ea3-90a6-73d2085332df tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:42.851345 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:42.855757 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a8a0107-5567-4ea3-90a6-73d2085332df tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:42.857233 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a8a0107-5567-4ea3-90a6-73d2085332df tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:42.861718 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a8a0107-5567-4ea3-90a6-73d2085332df tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:42.862517 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a8a0107-5567-4ea3-90a6-73d2085332df tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:42.952928 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2a8a0107-5567-4ea3-90a6-73d2085332df tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:54:42.957223 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=100 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:43.099637 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2a8a0107-5567-4ea3-90a6-73d2085332df tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192" status: 204 len: 0 microversion: 2.47 time: 0.270750 Aug 04 16:54:43.102251 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1797/3642] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Aug 4 16:54:42 2022] DELETE /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 16:54:43.118555 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-aa5a2e70-7d46-4731-9bcb-c0ba18756cfc tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:43.121628 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-aa5a2e70-7d46-4731-9bcb-c0ba18756cfc tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:43.305614 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-99ce5488-77f3-427f-84b1-043f0cfab98d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:43.318959 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-99ce5488-77f3-427f-84b1-043f0cfab98d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1515 microversion: 2.1 time: 0.568447 Aug 04 16:54:43.320880 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1846/3643] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:42 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1515 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:43.327822 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-40c1b208-9a6e-4efe-8baa-f45471c5c041 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:43.336138 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-40c1b208-9a6e-4efe-8baa-f45471c5c041 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] [instance: 10cfa2cd-b0d6-415e-aa30-74a440d1c754] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:43.355332 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-aa5a2e70-7d46-4731-9bcb-c0ba18756cfc tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:43.356372 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-40c1b208-9a6e-4efe-8baa-f45471c5c041 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:43.358380 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-40c1b208-9a6e-4efe-8baa-f45471c5c041 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:43.360191 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-40c1b208-9a6e-4efe-8baa-f45471c5c041 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:43.361859 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-40c1b208-9a6e-4efe-8baa-f45471c5c041 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:43.370154 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-aa5a2e70-7d46-4731-9bcb-c0ba18756cfc tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52" status: 200 len: 1192 microversion: 2.1 time: 0.263164 Aug 04 16:54:43.371586 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1798/3644] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:43 2022] GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52 => generated 1192 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:43.412265 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-936ae4b3-ae61-43de-bd24-c992d67d07b9 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:43.418235 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-936ae4b3-ae61-43de-bd24-c992d67d07b9 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:43.438943 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-936ae4b3-ae61-43de-bd24-c992d67d07b9 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:43.441222 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-936ae4b3-ae61-43de-bd24-c992d67d07b9 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:43.446196 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-936ae4b3-ae61-43de-bd24-c992d67d07b9 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:43.447123 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-936ae4b3-ae61-43de-bd24-c992d67d07b9 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:43.469726 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-40c1b208-9a6e-4efe-8baa-f45471c5c041 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] [instance: 10cfa2cd-b0d6-415e-aa30-74a440d1c754] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:54:43.643700 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-936ae4b3-ae61-43de-bd24-c992d67d07b9 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:43.659997 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-936ae4b3-ae61-43de-bd24-c992d67d07b9 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:43.669403 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-936ae4b3-ae61-43de-bd24-c992d67d07b9 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:43.679321 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-936ae4b3-ae61-43de-bd24-c992d67d07b9 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192" status: 200 len: 1363 microversion: 2.47 time: 0.287884 Aug 04 16:54:43.680386 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1799/3645] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:54:43 2022] GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192 => generated 1363 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:54:43.702725 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-40c1b208-9a6e-4efe-8baa-f45471c5c041 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] 10.222.0.23 "DELETE /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754" status: 204 len: 0 microversion: 2.1 time: 0.380210 Aug 04 16:54:43.706636 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1847/3646] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:54:43 2022] DELETE /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:54:43.713376 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a071b724-d97b-40ec-b81c-22b17a37b7ee tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:43.714069 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a071b724-d97b-40ec-b81c-22b17a37b7ee tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] [instance: 10cfa2cd-b0d6-415e-aa30-74a440d1c754] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:43.730473 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a071b724-d97b-40ec-b81c-22b17a37b7ee tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:43.732883 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a071b724-d97b-40ec-b81c-22b17a37b7ee tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:43.736628 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a071b724-d97b-40ec-b81c-22b17a37b7ee tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:43.737347 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a071b724-d97b-40ec-b81c-22b17a37b7ee tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:44.344515 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-119a69f0-2eb4-4875-b68f-340a77f3753a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:44.345301 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-119a69f0-2eb4-4875-b68f-340a77f3753a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:44.366947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-119a69f0-2eb4-4875-b68f-340a77f3753a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:44.369490 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-119a69f0-2eb4-4875-b68f-340a77f3753a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:44.378734 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-119a69f0-2eb4-4875-b68f-340a77f3753a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:44.380047 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-119a69f0-2eb4-4875-b68f-340a77f3753a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:44.536468 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a071b724-d97b-40ec-b81c-22b17a37b7ee tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1a321017d04de0a62b3660623ded61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1878c64d978e4a059943138584ce96e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:44.553470 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a071b724-d97b-40ec-b81c-22b17a37b7ee tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] 10.222.0.23 "GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754" status: 200 len: 1512 microversion: 2.1 time: 0.844536 Aug 04 16:54:44.562163 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1800/3647] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:43 2022] GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754 => generated 1512 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:54:44.573642 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0c5381e5-2011-4203-9d6c-9511f2eb445d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:44.582903 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0c5381e5-2011-4203-9d6c-9511f2eb445d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:44.600057 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c5381e5-2011-4203-9d6c-9511f2eb445d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:44.600785 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c5381e5-2011-4203-9d6c-9511f2eb445d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:44.602058 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c5381e5-2011-4203-9d6c-9511f2eb445d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:44.611144 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c5381e5-2011-4203-9d6c-9511f2eb445d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:44.904907 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0c5381e5-2011-4203-9d6c-9511f2eb445d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:44.931311 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0c5381e5-2011-4203-9d6c-9511f2eb445d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52" status: 200 len: 1244 microversion: 2.1 time: 0.362116 Aug 04 16:54:44.935189 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1801/3648] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:44 2022] GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52 => generated 1244 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:44.960012 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d4dc8809-d9fd-4fa6-91cb-f1734f3e2593 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:44.960905 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d4dc8809-d9fd-4fa6-91cb-f1734f3e2593 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:44.990223 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d4dc8809-d9fd-4fa6-91cb-f1734f3e2593 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:44.990669 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d4dc8809-d9fd-4fa6-91cb-f1734f3e2593 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:44.996709 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d4dc8809-d9fd-4fa6-91cb-f1734f3e2593 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:44.997237 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d4dc8809-d9fd-4fa6-91cb-f1734f3e2593 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:45.240012 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d4dc8809-d9fd-4fa6-91cb-f1734f3e2593 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:45.290438 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d4dc8809-d9fd-4fa6-91cb-f1734f3e2593 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:45.304833 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-119a69f0-2eb4-4875-b68f-340a77f3753a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:45.315858 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-119a69f0-2eb4-4875-b68f-340a77f3753a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1515 microversion: 2.1 time: 0.978835 Aug 04 16:54:45.333667 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1848/3649] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:44 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1515 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:45.334937 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d4dc8809-d9fd-4fa6-91cb-f1734f3e2593 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:45.336181 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d4dc8809-d9fd-4fa6-91cb-f1734f3e2593 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192" status: 200 len: 1363 microversion: 2.47 time: 0.399129 Aug 04 16:54:45.336753 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1802/3650] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:54:44 2022] GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192 => generated 1363 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:54:45.595097 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b37cfe8e-cb7d-479a-9f04-b511e7b02c1d tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:45.598565 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b37cfe8e-cb7d-479a-9f04-b511e7b02c1d tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] [instance: 10cfa2cd-b0d6-415e-aa30-74a440d1c754] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:45.634933 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b37cfe8e-cb7d-479a-9f04-b511e7b02c1d tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:45.635954 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b37cfe8e-cb7d-479a-9f04-b511e7b02c1d tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:45.637659 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b37cfe8e-cb7d-479a-9f04-b511e7b02c1d tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:45.638418 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b37cfe8e-cb7d-479a-9f04-b511e7b02c1d tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:45.956079 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0c63100e-d601-4579-be62-eebe0192982b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:45.957875 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0c63100e-d601-4579-be62-eebe0192982b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:45.996472 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c63100e-d601-4579-be62-eebe0192982b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:45.997960 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c63100e-d601-4579-be62-eebe0192982b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:46.000546 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c63100e-d601-4579-be62-eebe0192982b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:46.001027 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c63100e-d601-4579-be62-eebe0192982b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:46.340042 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0c63100e-d601-4579-be62-eebe0192982b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:46.353733 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0c63100e-d601-4579-be62-eebe0192982b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52" status: 200 len: 1250 microversion: 2.1 time: 0.403497 Aug 04 16:54:46.365863 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1803/3651] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:45 2022] GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52 => generated 1250 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:46.376445 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4ea18a64-08b4-4365-bddf-54209b9609f3 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:46.377408 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4ea18a64-08b4-4365-bddf-54209b9609f3 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:46.380231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b37cfe8e-cb7d-479a-9f04-b511e7b02c1d tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1a321017d04de0a62b3660623ded61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1878c64d978e4a059943138584ce96e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:46.386721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4ea18a64-08b4-4365-bddf-54209b9609f3 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:46.387688 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4ea18a64-08b4-4365-bddf-54209b9609f3 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:46.389057 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4ea18a64-08b4-4365-bddf-54209b9609f3 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:46.389970 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4ea18a64-08b4-4365-bddf-54209b9609f3 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:46.398128 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b37cfe8e-cb7d-479a-9f04-b511e7b02c1d tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] 10.222.0.23 "GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754" status: 200 len: 1512 microversion: 2.1 time: 0.808195 Aug 04 16:54:46.400307 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1849/3652] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:45 2022] GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754 => generated 1512 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:46.412922 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e49a465c-bff4-4871-88a6-33dde25bdc8b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:46.415419 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e49a465c-bff4-4871-88a6-33dde25bdc8b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:46.423196 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e49a465c-bff4-4871-88a6-33dde25bdc8b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:46.424004 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e49a465c-bff4-4871-88a6-33dde25bdc8b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:46.425252 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e49a465c-bff4-4871-88a6-33dde25bdc8b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:46.426321 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e49a465c-bff4-4871-88a6-33dde25bdc8b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:46.474577 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e49a465c-bff4-4871-88a6-33dde25bdc8b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:46.475312 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e49a465c-bff4-4871-88a6-33dde25bdc8b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:46.475959 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-e49a465c-bff4-4871-88a6-33dde25bdc8b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lazy-loading 'fault' on Instance uuid f00fb5de-248c-4a5e-a22e-d11c33d99192 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:54:46.650369 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e49a465c-bff4-4871-88a6-33dde25bdc8b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:46.660989 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e49a465c-bff4-4871-88a6-33dde25bdc8b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:46.662890 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e49a465c-bff4-4871-88a6-33dde25bdc8b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:46.664362 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e49a465c-bff4-4871-88a6-33dde25bdc8b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192" status: 200 len: 1368 microversion: 2.47 time: 0.262425 Aug 04 16:54:46.664936 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1850/3653] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:54:46 2022] GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192 => generated 1368 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:54:47.064719 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4ea18a64-08b4-4365-bddf-54209b9609f3 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:47.082661 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4ea18a64-08b4-4365-bddf-54209b9609f3 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1515 microversion: 2.1 time: 0.715136 Aug 04 16:54:47.089111 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1804/3654] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:46 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1515 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:47.383439 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-db0f240b-034d-4971-8a41-cc19d9730bc8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:47.385059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-db0f240b-034d-4971-8a41-cc19d9730bc8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:47.395312 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-db0f240b-034d-4971-8a41-cc19d9730bc8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:47.396234 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-db0f240b-034d-4971-8a41-cc19d9730bc8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:47.397670 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-db0f240b-034d-4971-8a41-cc19d9730bc8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:47.398407 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-db0f240b-034d-4971-8a41-cc19d9730bc8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:47.420387 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bf6eb1f1-5866-4fa1-9ba9-52e7f5ed6ba3 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:47.421358 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bf6eb1f1-5866-4fa1-9ba9-52e7f5ed6ba3 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] [instance: 10cfa2cd-b0d6-415e-aa30-74a440d1c754] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:47.433144 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf6eb1f1-5866-4fa1-9ba9-52e7f5ed6ba3 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:47.434322 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf6eb1f1-5866-4fa1-9ba9-52e7f5ed6ba3 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:47.437819 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf6eb1f1-5866-4fa1-9ba9-52e7f5ed6ba3 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:47.438489 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf6eb1f1-5866-4fa1-9ba9-52e7f5ed6ba3 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:47.661711 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-db0f240b-034d-4971-8a41-cc19d9730bc8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:47.673844 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-db0f240b-034d-4971-8a41-cc19d9730bc8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52" status: 200 len: 1250 microversion: 2.1 time: 0.295739 Aug 04 16:54:47.697331 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1851/3655] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:47 2022] GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52 => generated 1250 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:47.705427 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a8d5f992-315e-4820-9422-b32360127dd6 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:47.714129 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a8d5f992-315e-4820-9422-b32360127dd6 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: f00fb5de-248c-4a5e-a22e-d11c33d99192] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:47.727377 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8d5f992-315e-4820-9422-b32360127dd6 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:47.727838 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8d5f992-315e-4820-9422-b32360127dd6 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:47.729322 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8d5f992-315e-4820-9422-b32360127dd6 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:47.736900 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8d5f992-315e-4820-9422-b32360127dd6 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:47.759970 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-a8d5f992-315e-4820-9422-b32360127dd6 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] HTTP exception thrown: Instance f00fb5de-248c-4a5e-a22e-d11c33d99192 could not be found. Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a8d5f992-315e-4820-9422-b32360127dd6 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Request method failure captured: Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192 HTTP/1.1 Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_mj9IuFxFbNwMnGu5PoBTkXnocb9PaRbeLo2j2AJxf-OukZOA_QsTIgpi6G0PUq0ymN4Yugk7AcetyxqQKrFsJD2QxTqjMHfwHW7nfKSLGgfgeerv3R-V4K8TfZ0_KAAzTflu8F5Z9bDRVgfiRxqA8KsDZyXwmn7cUNWA8qEgdr7FM Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: X-Openstack-Nova-Api-Version: 2.47 Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 1a0f43fe131c471f96682a4fcd03ac99 Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerShowV247Test-1547202948 Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a0f43fe131c471f96682a4fcd03ac99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a0f43fe131c471f96682a4fcd03ac99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a0f43fe131c471f96682a4fcd03ac99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a0f43fe131c471f96682a4fcd03ac99"}]}] Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerShowV247Test-1547202948 Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 1a0f43fe131c471f96682a4fcd03ac99 Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerShowV247Test-1547202948 Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerShowV247Test-1547202948-project Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: bb62865fda96428f92859aa585c6bae9 Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerShowV247Test-1547202948-project Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance f00fb5de-248c-4a5e-a22e-d11c33d99192 could not be found. Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'f00fb5de-248c-4a5e-a22e-d11c33d99192'} Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f00fb5de-248c-4a5e-a22e-d11c33d99192 could not be found. Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f00fb5de-248c-4a5e-a22e-d11c33d99192 could not be found. Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:47.762024 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:54:47.767870 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:47.767870 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:47.767870 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:47.767870 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:54:47.767870 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:54:47.767870 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f00fb5de-248c-4a5e-a22e-d11c33d99192 could not be found. Aug 04 16:54:47.767870 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:54:47.767870 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a8d5f992-315e-4820-9422-b32360127dd6 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Returning 404 to user: Instance f00fb5de-248c-4a5e-a22e-d11c33d99192 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:54:47.767870 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a8d5f992-315e-4820-9422-b32360127dd6 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192" status: 404 len: 111 microversion: 2.47 time: 0.062702 Aug 04 16:54:47.767870 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1852/3656] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:54:47 2022] GET /compute/v2.1/servers/f00fb5de-248c-4a5e-a22e-d11c33d99192 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:54:47.776020 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-639445fc-7f67-40ee-82fa-2be2daeaf76a tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:47.776826 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-639445fc-7f67-40ee-82fa-2be2daeaf76a tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: 4cedf22c-90c4-4dcd-8983-4ac09ba94d70] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:47.785012 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-639445fc-7f67-40ee-82fa-2be2daeaf76a tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:47.785911 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-639445fc-7f67-40ee-82fa-2be2daeaf76a tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:47.786976 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-639445fc-7f67-40ee-82fa-2be2daeaf76a tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:47.787660 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-639445fc-7f67-40ee-82fa-2be2daeaf76a tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:47.828023 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-639445fc-7f67-40ee-82fa-2be2daeaf76a tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: 4cedf22c-90c4-4dcd-8983-4ac09ba94d70] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:54:47.980072 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-639445fc-7f67-40ee-82fa-2be2daeaf76a tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4cedf22c-90c4-4dcd-8983-4ac09ba94d70" status: 204 len: 0 microversion: 2.47 time: 0.209842 Aug 04 16:54:47.981554 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1853/3657] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Aug 4 16:54:47 2022] DELETE /compute/v2.1/servers/4cedf22c-90c4-4dcd-8983-4ac09ba94d70 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 16:54:47.991293 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ff92f9d0-32e9-4e17-b979-b9eee95cdb27 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:47.992420 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ff92f9d0-32e9-4e17-b979-b9eee95cdb27 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: 4cedf22c-90c4-4dcd-8983-4ac09ba94d70] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:48.001086 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ff92f9d0-32e9-4e17-b979-b9eee95cdb27 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:48.002134 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ff92f9d0-32e9-4e17-b979-b9eee95cdb27 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:48.003252 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ff92f9d0-32e9-4e17-b979-b9eee95cdb27 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:48.004191 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ff92f9d0-32e9-4e17-b979-b9eee95cdb27 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:48.329200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ff92f9d0-32e9-4e17-b979-b9eee95cdb27 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:48.341220 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ff92f9d0-32e9-4e17-b979-b9eee95cdb27 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:48.345906 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ff92f9d0-32e9-4e17-b979-b9eee95cdb27 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:48.351156 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ff92f9d0-32e9-4e17-b979-b9eee95cdb27 tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "GET /compute/v2.1/servers/4cedf22c-90c4-4dcd-8983-4ac09ba94d70" status: 200 len: 1362 microversion: 2.47 time: 0.365245 Aug 04 16:54:48.352133 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1854/3658] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:54:47 2022] GET /compute/v2.1/servers/4cedf22c-90c4-4dcd-8983-4ac09ba94d70 => generated 1362 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:54:48.364722 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a95b28b8-65a2-4932-90d5-3fca7b9c6d90 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:48.369609 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a95b28b8-65a2-4932-90d5-3fca7b9c6d90 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:48.387631 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a95b28b8-65a2-4932-90d5-3fca7b9c6d90 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:48.388271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a95b28b8-65a2-4932-90d5-3fca7b9c6d90 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:48.390877 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a95b28b8-65a2-4932-90d5-3fca7b9c6d90 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:48.392994 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a95b28b8-65a2-4932-90d5-3fca7b9c6d90 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:48.409974 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bf6eb1f1-5866-4fa1-9ba9-52e7f5ed6ba3 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1a321017d04de0a62b3660623ded61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1878c64d978e4a059943138584ce96e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:48.421489 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bf6eb1f1-5866-4fa1-9ba9-52e7f5ed6ba3 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] 10.222.0.23 "GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754" status: 200 len: 1512 microversion: 2.1 time: 1.005094 Aug 04 16:54:48.421993 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1805/3659] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:47 2022] GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754 => generated 1512 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:48.708848 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4916d7c5-5d72-4513-a53b-7277eb8625c6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:48.709514 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4916d7c5-5d72-4513-a53b-7277eb8625c6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:48.723624 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4916d7c5-5d72-4513-a53b-7277eb8625c6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:48.724283 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4916d7c5-5d72-4513-a53b-7277eb8625c6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:48.728777 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4916d7c5-5d72-4513-a53b-7277eb8625c6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:48.729462 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4916d7c5-5d72-4513-a53b-7277eb8625c6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:48.901993 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4916d7c5-5d72-4513-a53b-7277eb8625c6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:48.922781 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4916d7c5-5d72-4513-a53b-7277eb8625c6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52" status: 200 len: 1250 microversion: 2.1 time: 0.220773 Aug 04 16:54:48.923384 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1806/3660] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:48 2022] GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52 => generated 1250 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:48.974301 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a95b28b8-65a2-4932-90d5-3fca7b9c6d90 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:48.989842 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a95b28b8-65a2-4932-90d5-3fca7b9c6d90 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1515 microversion: 2.1 time: 0.635362 Aug 04 16:54:49.003290 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1855/3661] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:48 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1515 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:49.137086 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e6682b3c-7962-4e55-b386-7139f9b36be2 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1788857115", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "daed3df4-08a6-4dd7-a9e8-cc95e6fe8e57"}, {"uuid": "fad9d409-1543-4590-880f-f5c4fa150a0b"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:49.232282 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-e6682b3c-7962-4e55-b386-7139f9b36be2 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] validate_networks() for [('daed3df4-08a6-4dd7-a9e8-cc95e6fe8e57', None, None, None, None, None), ('fad9d409-1543-4590-880f-f5c4fa150a0b', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:54:49.382910 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2269f6b7-242c-4072-b7c4-e87570d9215b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:49.383623 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2269f6b7-242c-4072-b7c4-e87570d9215b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: 4cedf22c-90c4-4dcd-8983-4ac09ba94d70] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:49.408290 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2269f6b7-242c-4072-b7c4-e87570d9215b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:49.415146 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2269f6b7-242c-4072-b7c4-e87570d9215b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:49.420328 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2269f6b7-242c-4072-b7c4-e87570d9215b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:49.421046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2269f6b7-242c-4072-b7c4-e87570d9215b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:49.681916 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2269f6b7-242c-4072-b7c4-e87570d9215b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:49.696005 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2269f6b7-242c-4072-b7c4-e87570d9215b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:49.711973 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2269f6b7-242c-4072-b7c4-e87570d9215b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb62865fda96428f92859aa585c6bae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0f43fe131c471f96682a4fcd03ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:49.713542 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2269f6b7-242c-4072-b7c4-e87570d9215b tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "GET /compute/v2.1/servers/4cedf22c-90c4-4dcd-8983-4ac09ba94d70" status: 200 len: 1362 microversion: 2.47 time: 0.337747 Aug 04 16:54:49.715793 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1856/3662] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:54:49 2022] GET /compute/v2.1/servers/4cedf22c-90c4-4dcd-8983-4ac09ba94d70 => generated 1362 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:54:49.723096 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-429d2c8f-977e-41f6-9b5a-3462249a66d9 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:49.724114 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-429d2c8f-977e-41f6-9b5a-3462249a66d9 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] [instance: 10cfa2cd-b0d6-415e-aa30-74a440d1c754] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:49.743307 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-429d2c8f-977e-41f6-9b5a-3462249a66d9 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:49.743985 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-429d2c8f-977e-41f6-9b5a-3462249a66d9 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:49.747652 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-429d2c8f-977e-41f6-9b5a-3462249a66d9 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:49.748389 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-429d2c8f-977e-41f6-9b5a-3462249a66d9 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:49.800521 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-429d2c8f-977e-41f6-9b5a-3462249a66d9 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:49.801528 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-429d2c8f-977e-41f6-9b5a-3462249a66d9 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:49.802217 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-429d2c8f-977e-41f6-9b5a-3462249a66d9 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lazy-loading 'fault' on Instance uuid 10cfa2cd-b0d6-415e-aa30-74a440d1c754 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:54:50.497883 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-429d2c8f-977e-41f6-9b5a-3462249a66d9 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1a321017d04de0a62b3660623ded61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1878c64d978e4a059943138584ce96e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:50.528721 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-429d2c8f-977e-41f6-9b5a-3462249a66d9 tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] 10.222.0.23 "GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754" status: 200 len: 1307 microversion: 2.1 time: 0.811200 Aug 04 16:54:50.534189 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1857/3663] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:49 2022] GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754 => generated 1307 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:50.546133 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-6795bff9-f30c-4239-bcf0-b1d31eb62b78 req-c3bb672f-f05f-4507-82d7-d246257b0168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10cfa2cd-b0d6-415e-aa30-74a440d1c754", "name": "network-vif-deleted", "tag": "82c65cf6-2f98-47eb-b209-c6fbc06b8ca9"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:50.565591 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6795bff9-f30c-4239-bcf0-b1d31eb62b78 req-c3bb672f-f05f-4507-82d7-d246257b0168 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:50.566265 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6795bff9-f30c-4239-bcf0-b1d31eb62b78 req-c3bb672f-f05f-4507-82d7-d246257b0168 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:50.597782 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-6795bff9-f30c-4239-bcf0-b1d31eb62b78 req-c3bb672f-f05f-4507-82d7-d246257b0168 service nova] Creating event network-vif-deleted:82c65cf6-2f98-47eb-b209-c6fbc06b8ca9 for instance 10cfa2cd-b0d6-415e-aa30-74a440d1c754 on n-h1-846466-12 Aug 04 16:54:50.615315 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-6795bff9-f30c-4239-bcf0-b1d31eb62b78 req-c3bb672f-f05f-4507-82d7-d246257b0168 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077473 Aug 04 16:54:50.616691 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1858/3664] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:50.622713 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5ce6f1f0-1175-47fa-8aea-b50688db151f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:50.623424 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5ce6f1f0-1175-47fa-8aea-b50688db151f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:50.643716 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ce6f1f0-1175-47fa-8aea-b50688db151f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:50.645127 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ce6f1f0-1175-47fa-8aea-b50688db151f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:50.646396 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ce6f1f0-1175-47fa-8aea-b50688db151f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:50.654117 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ce6f1f0-1175-47fa-8aea-b50688db151f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:51.216412 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5ce6f1f0-1175-47fa-8aea-b50688db151f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:51.233400 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5ce6f1f0-1175-47fa-8aea-b50688db151f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52" status: 200 len: 1292 microversion: 2.1 time: 0.614743 Aug 04 16:54:51.235568 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1859/3665] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:50 2022] GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52 => generated 1292 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:51.247153 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-759b001c-3c15-482a-8267-9f10982c94b5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:51.253572 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-759b001c-3c15-482a-8267-9f10982c94b5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:51.280343 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-759b001c-3c15-482a-8267-9f10982c94b5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:51.281310 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-759b001c-3c15-482a-8267-9f10982c94b5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:51.282910 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-759b001c-3c15-482a-8267-9f10982c94b5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:51.284085 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-759b001c-3c15-482a-8267-9f10982c94b5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:51.297610 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:51.956670 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-759b001c-3c15-482a-8267-9f10982c94b5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:51.971447 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-759b001c-3c15-482a-8267-9f10982c94b5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1515 microversion: 2.1 time: 0.733872 Aug 04 16:54:51.989876 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1860/3666] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:51 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1515 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:52.000771 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f7b36a9b-dba2-4320-9651-961befcbf72e tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:52.001577 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f7b36a9b-dba2-4320-9651-961befcbf72e tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] [instance: 4cedf22c-90c4-4dcd-8983-4ac09ba94d70] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:52.016454 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f7b36a9b-dba2-4320-9651-961befcbf72e tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:52.017155 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f7b36a9b-dba2-4320-9651-961befcbf72e tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:52.018288 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f7b36a9b-dba2-4320-9651-961befcbf72e tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:52.020144 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f7b36a9b-dba2-4320-9651-961befcbf72e tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:52.057032 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-f7b36a9b-dba2-4320-9651-961befcbf72e tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] HTTP exception thrown: Instance 4cedf22c-90c4-4dcd-8983-4ac09ba94d70 could not be found. Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f7b36a9b-dba2-4320-9651-961befcbf72e tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Request method failure captured: Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/4cedf22c-90c4-4dcd-8983-4ac09ba94d70 HTTP/1.1 Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_mj9IuFxFbNwMnGu5PoBTkXnocb9PaRbeLo2j2AJxf-OukZOA_QsTIgpi6G0PUq0ymN4Yugk7AcetyxqQKrFsJD2QxTqjMHfwHW7nfKSLGgfgeerv3R-V4K8TfZ0_KAAzTflu8F5Z9bDRVgfiRxqA8KsDZyXwmn7cUNWA8qEgdr7FM Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: X-Openstack-Nova-Api-Version: 2.47 Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 1a0f43fe131c471f96682a4fcd03ac99 Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerShowV247Test-1547202948 Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a0f43fe131c471f96682a4fcd03ac99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a0f43fe131c471f96682a4fcd03ac99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a0f43fe131c471f96682a4fcd03ac99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a0f43fe131c471f96682a4fcd03ac99"}]}] Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerShowV247Test-1547202948 Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 1a0f43fe131c471f96682a4fcd03ac99 Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerShowV247Test-1547202948 Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerShowV247Test-1547202948-project Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: bb62865fda96428f92859aa585c6bae9 Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerShowV247Test-1547202948-project Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 4cedf22c-90c4-4dcd-8983-4ac09ba94d70 could not be found. Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '4cedf22c-90c4-4dcd-8983-4ac09ba94d70'} Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cedf22c-90c4-4dcd-8983-4ac09ba94d70 could not be found. Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cedf22c-90c4-4dcd-8983-4ac09ba94d70 could not be found. Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:52.061475 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:54:52.070045 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:52.070045 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:52.070045 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:52.070045 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:54:52.070045 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:54:52.070045 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cedf22c-90c4-4dcd-8983-4ac09ba94d70 could not be found. Aug 04 16:54:52.070045 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:54:52.074383 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f7b36a9b-dba2-4320-9651-961befcbf72e tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] Returning 404 to user: Instance 4cedf22c-90c4-4dcd-8983-4ac09ba94d70 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:54:52.076454 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f7b36a9b-dba2-4320-9651-961befcbf72e tempest-ServerShowV247Test-1547202948 tempest-ServerShowV247Test-1547202948-project] 10.222.0.23 "GET /compute/v2.1/servers/4cedf22c-90c4-4dcd-8983-4ac09ba94d70" status: 404 len: 111 microversion: 2.47 time: 0.084108 Aug 04 16:54:52.078152 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1861/3667] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:54:51 2022] GET /compute/v2.1/servers/4cedf22c-90c4-4dcd-8983-4ac09ba94d70 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:54:52.088700 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-00c48a5a-28ce-41d8-b5fa-0c226e1986ef tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:52.090097 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-00c48a5a-28ce-41d8-b5fa-0c226e1986ef tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] [instance: 10cfa2cd-b0d6-415e-aa30-74a440d1c754] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:52.100155 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-00c48a5a-28ce-41d8-b5fa-0c226e1986ef tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:52.101058 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-00c48a5a-28ce-41d8-b5fa-0c226e1986ef tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:52.102992 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-00c48a5a-28ce-41d8-b5fa-0c226e1986ef tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:52.104466 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-00c48a5a-28ce-41d8-b5fa-0c226e1986ef tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:52.105471 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:52.125953 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-00c48a5a-28ce-41d8-b5fa-0c226e1986ef tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] HTTP exception thrown: Instance 10cfa2cd-b0d6-415e-aa30-74a440d1c754 could not be found. Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-00c48a5a-28ce-41d8-b5fa-0c226e1986ef tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Request method failure captured: Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754 HTTP/1.1 Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_mxu095XHCjvkc3I1GtMIZnYs7e9-CDFSz9APslmf58DegH6qjQC-hKkZRpEc_5Z1P5PyVZc3tWzCK2urDeTlX6EYG55bvGT5tg5Wt9eQ55AxhVoFRYYSgmRHgZlXEGfKEqXa6Tra29n8IIi3CfsxhJS2EgvlSGmdOreHIU_IQdajE Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 1878c64d978e4a059943138584ce96e9 Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerAddressesTestJSON-218041335 Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1878c64d978e4a059943138584ce96e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1878c64d978e4a059943138584ce96e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1878c64d978e4a059943138584ce96e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1878c64d978e4a059943138584ce96e9"}]}] Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerAddressesTestJSON-218041335 Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 1878c64d978e4a059943138584ce96e9 Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerAddressesTestJSON-218041335 Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerAddressesTestJSON-218041335-project Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 2c1a321017d04de0a62b3660623ded61 Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerAddressesTestJSON-218041335-project Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 10cfa2cd-b0d6-415e-aa30-74a440d1c754 could not be found. Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '10cfa2cd-b0d6-415e-aa30-74a440d1c754'} Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10cfa2cd-b0d6-415e-aa30-74a440d1c754 could not be found. Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10cfa2cd-b0d6-415e-aa30-74a440d1c754 could not be found. Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:52.156836 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:54:52.161434 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:52.161434 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:52.161434 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:52.161434 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:54:52.161434 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:54:52.161434 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10cfa2cd-b0d6-415e-aa30-74a440d1c754 could not be found. Aug 04 16:54:52.161434 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:54:52.165069 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-00c48a5a-28ce-41d8-b5fa-0c226e1986ef tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] Returning 404 to user: Instance 10cfa2cd-b0d6-415e-aa30-74a440d1c754 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:54:52.168863 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-00c48a5a-28ce-41d8-b5fa-0c226e1986ef tempest-ServerAddressesTestJSON-218041335 tempest-ServerAddressesTestJSON-218041335-project] 10.222.0.23 "GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754" status: 404 len: 111 microversion: 2.1 time: 0.088270 Aug 04 16:54:52.171619 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1862/3668] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:52 2022] GET /compute/v2.1/servers/10cfa2cd-b0d6-415e-aa30-74a440d1c754 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:54:52.264953 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1a07f605-2f92-4b20-9785-5a49a1d97b3d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:52.266012 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1a07f605-2f92-4b20-9785-5a49a1d97b3d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:52.280693 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1a07f605-2f92-4b20-9785-5a49a1d97b3d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:52.281810 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1a07f605-2f92-4b20-9785-5a49a1d97b3d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:52.283885 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1a07f605-2f92-4b20-9785-5a49a1d97b3d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:52.289431 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1a07f605-2f92-4b20-9785-5a49a1d97b3d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:52.465666 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:52.523741 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:52.609897 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-e6682b3c-7962-4e55-b386-7139f9b36be2 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:54:52.610669 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-e6682b3c-7962-4e55-b386-7139f9b36be2 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:54:52.611512 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-e6682b3c-7962-4e55-b386-7139f9b36be2 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:54:52.613839 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-e6682b3c-7962-4e55-b386-7139f9b36be2 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:54:52.614841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-e6682b3c-7962-4e55-b386-7139f9b36be2 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:54:52.647659 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e6682b3c-7962-4e55-b386-7139f9b36be2 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:52.650116 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e6682b3c-7962-4e55-b386-7139f9b36be2 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:52.651532 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e6682b3c-7962-4e55-b386-7139f9b36be2 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:52.654493 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e6682b3c-7962-4e55-b386-7139f9b36be2 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:52.720565 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-e6682b3c-7962-4e55-b386-7139f9b36be2 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Getting quotas for project dc0ad871e21842a19511864aa9cd26c6. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:54:52.750841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-e6682b3c-7962-4e55-b386-7139f9b36be2 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Getting quotas for user 33f7d4658f514bda8e64382fd5e42bf1 and project dc0ad871e21842a19511864aa9cd26c6. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:54:52.799165 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e6682b3c-7962-4e55-b386-7139f9b36be2 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:54:52.806576 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e6682b3c-7962-4e55-b386-7139f9b36be2 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:54:52.931049 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1a07f605-2f92-4b20-9785-5a49a1d97b3d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:52.947550 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1a07f605-2f92-4b20-9785-5a49a1d97b3d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52" status: 200 len: 1292 microversion: 2.1 time: 0.688994 Aug 04 16:54:52.948466 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1863/3669] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:52 2022] GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52 => generated 1292 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:52.961685 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e6682b3c-7962-4e55-b386-7139f9b36be2 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.821324 Aug 04 16:54:52.963271 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1807/3670] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:54:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 3831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:54:52.972447 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d8f6498e-1575-4a09-a509-e8781196a2b4 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:52.974817 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d8f6498e-1575-4a09-a509-e8781196a2b4 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:52.997046 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f22e4bc6-feec-4fcd-a48d-d970b7f99f08 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:52.997890 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f22e4bc6-feec-4fcd-a48d-d970b7f99f08 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:53.009320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f22e4bc6-feec-4fcd-a48d-d970b7f99f08 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:53.012130 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f22e4bc6-feec-4fcd-a48d-d970b7f99f08 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:53.014650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f22e4bc6-feec-4fcd-a48d-d970b7f99f08 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:53.017256 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f22e4bc6-feec-4fcd-a48d-d970b7f99f08 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:53.314054 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d8f6498e-1575-4a09-a509-e8781196a2b4 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:53.325851 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d8f6498e-1575-4a09-a509-e8781196a2b4 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7" status: 200 len: 1213 microversion: 2.1 time: 0.357090 Aug 04 16:54:53.339354 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1864/3671] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:52 2022] GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 => generated 1213 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:53.587436 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-7be84fa3-9ed1-48d4-af04-2ea295e22f7b req-42daa189-318f-46ec-88ac-10ae5c01df23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52", "tag": "5aa14c21-5452-41b2-a399-520f9a642bad"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:53.599692 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:53.630198 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7be84fa3-9ed1-48d4-af04-2ea295e22f7b req-42daa189-318f-46ec-88ac-10ae5c01df23 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:53.632411 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7be84fa3-9ed1-48d4-af04-2ea295e22f7b req-42daa189-318f-46ec-88ac-10ae5c01df23 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:53.677045 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-7be84fa3-9ed1-48d4-af04-2ea295e22f7b req-42daa189-318f-46ec-88ac-10ae5c01df23 service nova] Creating event network-changed:5aa14c21-5452-41b2-a399-520f9a642bad for instance e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52 on n-h2-846466-12 Aug 04 16:54:53.709317 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-7be84fa3-9ed1-48d4-af04-2ea295e22f7b req-42daa189-318f-46ec-88ac-10ae5c01df23 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126064 Aug 04 16:54:53.711848 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1865/3672] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:53.828576 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f22e4bc6-feec-4fcd-a48d-d970b7f99f08 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:53.842141 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f22e4bc6-feec-4fcd-a48d-d970b7f99f08 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1515 microversion: 2.1 time: 0.850113 Aug 04 16:54:53.862892 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1808/3673] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:52 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1515 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:54:53.976299 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-514429fa-34ee-4cad-89e7-e25f7caecd51 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:53.980507 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-514429fa-34ee-4cad-89e7-e25f7caecd51 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:54.009200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-514429fa-34ee-4cad-89e7-e25f7caecd51 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:54.014049 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-514429fa-34ee-4cad-89e7-e25f7caecd51 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:54.015119 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-514429fa-34ee-4cad-89e7-e25f7caecd51 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:54.017536 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-514429fa-34ee-4cad-89e7-e25f7caecd51 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:54.352322 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3e581b62-fe58-4068-9aa7-bfb10affc232 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:54.353645 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3e581b62-fe58-4068-9aa7-bfb10affc232 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:54.364861 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3e581b62-fe58-4068-9aa7-bfb10affc232 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:54.365518 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3e581b62-fe58-4068-9aa7-bfb10affc232 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:54.366547 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3e581b62-fe58-4068-9aa7-bfb10affc232 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:54.366985 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3e581b62-fe58-4068-9aa7-bfb10affc232 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:54.402807 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-514429fa-34ee-4cad-89e7-e25f7caecd51 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:54.421996 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-514429fa-34ee-4cad-89e7-e25f7caecd51 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52" status: 200 len: 1292 microversion: 2.1 time: 0.456577 Aug 04 16:54:54.423453 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1866/3674] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:53 2022] GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52 => generated 1292 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:54.528727 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3e581b62-fe58-4068-9aa7-bfb10affc232 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:54.541749 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3e581b62-fe58-4068-9aa7-bfb10affc232 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7" status: 200 len: 1209 microversion: 2.1 time: 0.197807 Aug 04 16:54:54.543512 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1809/3675] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:54 2022] GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 => generated 1209 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:54.882943 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6de155c8-4bd4-458f-98b3-a8d4b7eace1e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:54.885108 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6de155c8-4bd4-458f-98b3-a8d4b7eace1e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:54.903464 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6de155c8-4bd4-458f-98b3-a8d4b7eace1e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:54.904571 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6de155c8-4bd4-458f-98b3-a8d4b7eace1e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:54.905880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6de155c8-4bd4-458f-98b3-a8d4b7eace1e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:54.906933 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6de155c8-4bd4-458f-98b3-a8d4b7eace1e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:55.467532 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-339b00e3-e9f7-42bd-b191-32b2831fb02d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:55.476332 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-339b00e3-e9f7-42bd-b191-32b2831fb02d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:55.524788 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6de155c8-4bd4-458f-98b3-a8d4b7eace1e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:55.539396 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6de155c8-4bd4-458f-98b3-a8d4b7eace1e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1515 microversion: 2.1 time: 0.666167 Aug 04 16:54:55.543667 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1867/3676] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:54 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1515 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:55.551212 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-339b00e3-e9f7-42bd-b191-32b2831fb02d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:55.553393 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-339b00e3-e9f7-42bd-b191-32b2831fb02d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:55.561684 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-339b00e3-e9f7-42bd-b191-32b2831fb02d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:55.562942 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-339b00e3-e9f7-42bd-b191-32b2831fb02d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:55.566459 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0b992e10-d695-48ef-946e-f05a0713d5cc tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:55.567082 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0b992e10-d695-48ef-946e-f05a0713d5cc tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:55.604345 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0b992e10-d695-48ef-946e-f05a0713d5cc tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:55.607416 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0b992e10-d695-48ef-946e-f05a0713d5cc tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:55.610238 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0b992e10-d695-48ef-946e-f05a0713d5cc tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:55.616337 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0b992e10-d695-48ef-946e-f05a0713d5cc tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:55.910365 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0b992e10-d695-48ef-946e-f05a0713d5cc tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:55.938790 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0b992e10-d695-48ef-946e-f05a0713d5cc tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7" status: 200 len: 1283 microversion: 2.1 time: 0.377348 Aug 04 16:54:55.948366 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1868/3677] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:55 2022] GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 => generated 1283 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:56.069634 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-339b00e3-e9f7-42bd-b191-32b2831fb02d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:56.080536 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-339b00e3-e9f7-42bd-b191-32b2831fb02d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52" status: 200 len: 1292 microversion: 2.1 time: 0.622925 Aug 04 16:54:56.083396 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1810/3678] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:55 2022] GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52 => generated 1292 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:56.580276 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bcfb95db-aa02-4dd1-a8f4-7bd636e497e2 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:56.581591 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bcfb95db-aa02-4dd1-a8f4-7bd636e497e2 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:56.598218 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bcfb95db-aa02-4dd1-a8f4-7bd636e497e2 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:56.598930 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bcfb95db-aa02-4dd1-a8f4-7bd636e497e2 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:56.599948 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bcfb95db-aa02-4dd1-a8f4-7bd636e497e2 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:56.600560 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bcfb95db-aa02-4dd1-a8f4-7bd636e497e2 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:56.986098 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7abd0103-7c79-4ae7-b2a5-88e6e17fe703 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:56.989681 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7abd0103-7c79-4ae7-b2a5-88e6e17fe703 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:57.007718 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7abd0103-7c79-4ae7-b2a5-88e6e17fe703 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:57.009222 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7abd0103-7c79-4ae7-b2a5-88e6e17fe703 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:57.010051 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7abd0103-7c79-4ae7-b2a5-88e6e17fe703 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:57.011098 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7abd0103-7c79-4ae7-b2a5-88e6e17fe703 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:57.723629 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7abd0103-7c79-4ae7-b2a5-88e6e17fe703 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:57.741886 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7abd0103-7c79-4ae7-b2a5-88e6e17fe703 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7" status: 200 len: 1313 microversion: 2.1 time: 0.760954 Aug 04 16:54:57.745153 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1811/3679] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:56 2022] GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 => generated 1313 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:57.758482 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-aea8ce83-8fc3-4609-a08b-4e9f7a1e5711 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:57.759111 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-aea8ce83-8fc3-4609-a08b-4e9f7a1e5711 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:57.770949 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aea8ce83-8fc3-4609-a08b-4e9f7a1e5711 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:57.771629 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aea8ce83-8fc3-4609-a08b-4e9f7a1e5711 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:57.773338 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aea8ce83-8fc3-4609-a08b-4e9f7a1e5711 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:57.773927 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aea8ce83-8fc3-4609-a08b-4e9f7a1e5711 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:57.873917 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bcfb95db-aa02-4dd1-a8f4-7bd636e497e2 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:57.894023 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bcfb95db-aa02-4dd1-a8f4-7bd636e497e2 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1515 microversion: 2.1 time: 1.316053 Aug 04 16:54:57.901344 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1869/3680] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:56 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1515 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:58.265499 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-aea8ce83-8fc3-4609-a08b-4e9f7a1e5711 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:58.278211 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-aea8ce83-8fc3-4609-a08b-4e9f7a1e5711 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52" status: 200 len: 1292 microversion: 2.1 time: 0.531769 Aug 04 16:54:58.279250 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1812/3681] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:57 2022] GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52 => generated 1292 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:58.773115 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d0557600-06b2-4bda-8bbf-460d35d14ebd tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:58.778023 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d0557600-06b2-4bda-8bbf-460d35d14ebd tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:58.802861 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d0557600-06b2-4bda-8bbf-460d35d14ebd tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:58.806311 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d0557600-06b2-4bda-8bbf-460d35d14ebd tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:58.807303 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d0557600-06b2-4bda-8bbf-460d35d14ebd tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:58.807851 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d0557600-06b2-4bda-8bbf-460d35d14ebd tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:58.927643 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-48e513b1-7dea-4a3d-baba-3668cc4e8283 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:58.928423 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-48e513b1-7dea-4a3d-baba-3668cc4e8283 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:58.945820 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-48e513b1-7dea-4a3d-baba-3668cc4e8283 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:58.951721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-48e513b1-7dea-4a3d-baba-3668cc4e8283 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:58.952807 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-48e513b1-7dea-4a3d-baba-3668cc4e8283 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:58.953253 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-48e513b1-7dea-4a3d-baba-3668cc4e8283 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:59.694177 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d0557600-06b2-4bda-8bbf-460d35d14ebd tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:59.715795 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d0557600-06b2-4bda-8bbf-460d35d14ebd tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7" status: 200 len: 1313 microversion: 2.1 time: 0.950612 Aug 04 16:54:59.717444 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1870/3682] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:58 2022] GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 => generated 1313 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:59.726982 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-181ff57b-3528-42a0-8d69-c2a130ebfa69 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:59.727799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-181ff57b-3528-42a0-8d69-c2a130ebfa69 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:59.747134 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-181ff57b-3528-42a0-8d69-c2a130ebfa69 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:59.747798 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-181ff57b-3528-42a0-8d69-c2a130ebfa69 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:59.748753 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-181ff57b-3528-42a0-8d69-c2a130ebfa69 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:54:59.749379 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-181ff57b-3528-42a0-8d69-c2a130ebfa69 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:54:59.799800 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-48e513b1-7dea-4a3d-baba-3668cc4e8283 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:59.821371 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-48e513b1-7dea-4a3d-baba-3668cc4e8283 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1515 microversion: 2.1 time: 0.891340 Aug 04 16:54:59.823596 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1813/3683] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:58 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1515 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:00.069249 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fa1a0b02-a0c9-47c3-ad9c-684f0f404d08 tempest-VolumesTestJSON-2078126759 tempest-VolumesTestJSON-2078126759-project] Calling method '.version_select at 0x7f7e77c2f040>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:00.156540 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-181ff57b-3528-42a0-8d69-c2a130ebfa69 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:00.166285 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fa1a0b02-a0c9-47c3-ad9c-684f0f404d08 tempest-VolumesTestJSON-2078126759 tempest-VolumesTestJSON-2078126759-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/b8c7b762-2b68-4743-a160-39e5492ada54" status: 200 len: 351 microversion: 2.1 time: 0.101003 Aug 04 16:55:00.166864 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1814/3684] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Aug 4 16:55:00 2022] GET /compute/v2.1/os-volumes/b8c7b762-2b68-4743-a160-39e5492ada54 => generated 351 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:00.185455 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-181ff57b-3528-42a0-8d69-c2a130ebfa69 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52" status: 200 len: 1292 microversion: 2.1 time: 0.455659 Aug 04 16:55:00.198417 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1871/3685] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:59 2022] GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52 => generated 1292 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:00.740958 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bbc92973-ca72-4888-810e-d075f476adf3 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:00.741794 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bbc92973-ca72-4888-810e-d075f476adf3 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:00.755691 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bbc92973-ca72-4888-810e-d075f476adf3 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:00.756140 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bbc92973-ca72-4888-810e-d075f476adf3 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:00.760626 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bbc92973-ca72-4888-810e-d075f476adf3 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:00.761363 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bbc92973-ca72-4888-810e-d075f476adf3 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:00.827959 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:00.844875 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-86c5398a-79f3-4911-bbca-f8dacc601ed6 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:00.845896 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-86c5398a-79f3-4911-bbca-f8dacc601ed6 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:00.874449 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-86c5398a-79f3-4911-bbca-f8dacc601ed6 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:00.874840 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-86c5398a-79f3-4911-bbca-f8dacc601ed6 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:00.875639 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-86c5398a-79f3-4911-bbca-f8dacc601ed6 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:00.876073 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-86c5398a-79f3-4911-bbca-f8dacc601ed6 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:01.493520 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bbc92973-ca72-4888-810e-d075f476adf3 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:01.516698 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bbc92973-ca72-4888-810e-d075f476adf3 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7" status: 200 len: 1334 microversion: 2.1 time: 0.780870 Aug 04 16:55:01.521089 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-86c5398a-79f3-4911-bbca-f8dacc601ed6 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:01.524252 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1815/3686] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:00 2022] GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 => generated 1334 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:01.530024 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-86c5398a-79f3-4911-bbca-f8dacc601ed6 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1515 microversion: 2.1 time: 0.689583 Aug 04 16:55:01.533503 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-f9db8b16-5096-4799-b1f1-c626a3f760a2 req-7588e031-4770-4aff-9d65-172cb50a4275 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52", "name": "network-vif-plugged", "status": "completed", "tag": "5aa14c21-5452-41b2-a399-520f9a642bad"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:01.549988 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1872/3687] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:00 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1515 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:55:01.558159 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-46b4a158-675b-49bb-a811-d3833d40bb96 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:01.558770 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-46b4a158-675b-49bb-a811-d3833d40bb96 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:01.560976 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f9db8b16-5096-4799-b1f1-c626a3f760a2 req-7588e031-4770-4aff-9d65-172cb50a4275 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:01.563591 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f9db8b16-5096-4799-b1f1-c626a3f760a2 req-7588e031-4770-4aff-9d65-172cb50a4275 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:01.578871 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46b4a158-675b-49bb-a811-d3833d40bb96 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:01.579551 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46b4a158-675b-49bb-a811-d3833d40bb96 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:01.580480 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46b4a158-675b-49bb-a811-d3833d40bb96 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:01.586421 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46b4a158-675b-49bb-a811-d3833d40bb96 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:01.590742 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-f9db8b16-5096-4799-b1f1-c626a3f760a2 req-7588e031-4770-4aff-9d65-172cb50a4275 service nova] Creating event network-vif-plugged:5aa14c21-5452-41b2-a399-520f9a642bad for instance e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52 on n-h2-846466-12 Aug 04 16:55:01.619231 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-f9db8b16-5096-4799-b1f1-c626a3f760a2 req-7588e031-4770-4aff-9d65-172cb50a4275 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089720 Aug 04 16:55:01.620111 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1816/3688] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:02.058339 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-46b4a158-675b-49bb-a811-d3833d40bb96 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:02.074753 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-46b4a158-675b-49bb-a811-d3833d40bb96 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52" status: 200 len: 1292 microversion: 2.1 time: 0.523461 Aug 04 16:55:02.075371 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1873/3689] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:01 2022] GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52 => generated 1292 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:02.549378 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6c072dab-9076-4f35-848f-351c1f431f35 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:02.550235 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6c072dab-9076-4f35-848f-351c1f431f35 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:02.553066 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7ed6e8d2-6714-43d9-bb27-0c0102f39dad tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:02.553948 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7ed6e8d2-6714-43d9-bb27-0c0102f39dad tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:02.558156 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:02.561768 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ed6e8d2-6714-43d9-bb27-0c0102f39dad tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:02.562468 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ed6e8d2-6714-43d9-bb27-0c0102f39dad tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:02.563514 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ed6e8d2-6714-43d9-bb27-0c0102f39dad tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:02.564282 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ed6e8d2-6714-43d9-bb27-0c0102f39dad tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:02.571406 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c072dab-9076-4f35-848f-351c1f431f35 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:02.571875 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c072dab-9076-4f35-848f-351c1f431f35 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:02.572720 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c072dab-9076-4f35-848f-351c1f431f35 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:02.573166 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c072dab-9076-4f35-848f-351c1f431f35 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:02.687805 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:02.772491 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=10 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:02.951794 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6c072dab-9076-4f35-848f-351c1f431f35 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:02.971779 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6c072dab-9076-4f35-848f-351c1f431f35 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7" status: 200 len: 1334 microversion: 2.1 time: 0.426698 Aug 04 16:55:02.973202 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1817/3690] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:02 2022] GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 => generated 1334 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:02.979049 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-01bbe6d3-d06e-4c1e-a9db-326bdd0d2eeb tempest-VolumesTestJSON-2078126759 tempest-VolumesTestJSON-2078126759-project] Calling method '.version_select at 0x7f7e77d64a60>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:03.052260 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7ed6e8d2-6714-43d9-bb27-0c0102f39dad tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:03.063851 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7ed6e8d2-6714-43d9-bb27-0c0102f39dad tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1515 microversion: 2.1 time: 0.515955 Aug 04 16:55:03.072955 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1874/3691] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:02 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1515 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:03.098812 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-30090dac-3f2d-4346-86a8-4c109ee6981b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:03.099621 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-30090dac-3f2d-4346-86a8-4c109ee6981b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:03.104257 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-01bbe6d3-d06e-4c1e-a9db-326bdd0d2eeb tempest-VolumesTestJSON-2078126759 tempest-VolumesTestJSON-2078126759-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/f33a6510-c51a-4cbd-b945-3328ab9bd80d" status: 200 len: 350 microversion: 2.1 time: 0.129879 Aug 04 16:55:03.112731 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1818/3692] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Aug 4 16:55:02 2022] GET /compute/v2.1/os-volumes/f33a6510-c51a-4cbd-b945-3328ab9bd80d => generated 350 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:03.126866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-30090dac-3f2d-4346-86a8-4c109ee6981b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:03.133098 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-30090dac-3f2d-4346-86a8-4c109ee6981b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:03.134009 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-30090dac-3f2d-4346-86a8-4c109ee6981b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:03.134560 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-30090dac-3f2d-4346-86a8-4c109ee6981b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:03.321654 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:03.710147 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-257872f0-7227-41f2-99cb-ea84b1529607 req-f89c58d5-7ce4-43be-b882-253058c04c85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35b8c051-c8b6-47ee-966f-ad9c3c4a94d7", "tag": "979ecb32-ee50-4784-9b30-6bd178622a78"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:03.754650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-257872f0-7227-41f2-99cb-ea84b1529607 req-f89c58d5-7ce4-43be-b882-253058c04c85 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:03.759302 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-257872f0-7227-41f2-99cb-ea84b1529607 req-f89c58d5-7ce4-43be-b882-253058c04c85 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:03.816034 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-257872f0-7227-41f2-99cb-ea84b1529607 req-f89c58d5-7ce4-43be-b882-253058c04c85 service nova] Creating event network-changed:979ecb32-ee50-4784-9b30-6bd178622a78 for instance 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 on n-h1-846466-12 Aug 04 16:55:03.831292 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-257872f0-7227-41f2-99cb-ea84b1529607 req-f89c58d5-7ce4-43be-b882-253058c04c85 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127229 Aug 04 16:55:03.835817 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1819/3693] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:55:03.905876 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-30090dac-3f2d-4346-86a8-4c109ee6981b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:03.918410 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-30090dac-3f2d-4346-86a8-4c109ee6981b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52" status: 200 len: 1292 microversion: 2.1 time: 0.825832 Aug 04 16:55:03.921468 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1875/3694] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:03 2022] GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52 => generated 1292 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:55:03.999023 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-91b9ae59-7f64-4f63-9bfb-866979070298 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:03.999982 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-91b9ae59-7f64-4f63-9bfb-866979070298 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:04.022761 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-91b9ae59-7f64-4f63-9bfb-866979070298 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:04.030057 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-91b9ae59-7f64-4f63-9bfb-866979070298 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:04.033395 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-91b9ae59-7f64-4f63-9bfb-866979070298 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:04.035875 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-91b9ae59-7f64-4f63-9bfb-866979070298 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:04.092656 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8a2cb183-87f2-456c-b82c-c0df3ce476a4 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:04.093276 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8a2cb183-87f2-456c-b82c-c0df3ce476a4 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:04.109800 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8a2cb183-87f2-456c-b82c-c0df3ce476a4 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:04.110524 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8a2cb183-87f2-456c-b82c-c0df3ce476a4 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:04.112772 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8a2cb183-87f2-456c-b82c-c0df3ce476a4 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:04.113933 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8a2cb183-87f2-456c-b82c-c0df3ce476a4 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:05.462133 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-91b9ae59-7f64-4f63-9bfb-866979070298 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:05.473980 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-91b9ae59-7f64-4f63-9bfb-866979070298 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7" status: 200 len: 1334 microversion: 2.1 time: 1.479762 Aug 04 16:55:05.480786 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1820/3695] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:03 2022] GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 => generated 1334 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:05.489246 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7513ca52-bb3a-45b3-a710-32eeb03e80ed tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:05.491692 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7513ca52-bb3a-45b3-a710-32eeb03e80ed tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:05.515366 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7513ca52-bb3a-45b3-a710-32eeb03e80ed tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:05.518575 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7513ca52-bb3a-45b3-a710-32eeb03e80ed tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:05.520597 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7513ca52-bb3a-45b3-a710-32eeb03e80ed tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:05.521769 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7513ca52-bb3a-45b3-a710-32eeb03e80ed tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:05.581696 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8a2cb183-87f2-456c-b82c-c0df3ce476a4 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:05.603301 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8a2cb183-87f2-456c-b82c-c0df3ce476a4 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1515 microversion: 2.1 time: 1.514776 Aug 04 16:55:05.619833 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1876/3696] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:04 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1515 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:55:05.914586 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7513ca52-bb3a-45b3-a710-32eeb03e80ed tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:05.930467 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7513ca52-bb3a-45b3-a710-32eeb03e80ed tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52" status: 200 len: 1473 microversion: 2.1 time: 0.446090 Aug 04 16:55:05.934949 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1821/3697] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:05 2022] GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52 => generated 1473 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:06.215309 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0e1f7aee-21d6-4359-a66e-226336d68bd9 tempest-VolumesTestJSON-2078126759 tempest-VolumesTestJSON-2078126759-project] Calling method '.version_select at 0x7f7e77cab790>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:06.335674 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dc7e9388-f2c2-44ba-9a9b-d356829721b8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1491594194", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:06.352220 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0e1f7aee-21d6-4359-a66e-226336d68bd9 tempest-VolumesTestJSON-2078126759 tempest-VolumesTestJSON-2078126759-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/72494bba-0102-4409-abe9-89d0f46aee75" status: 200 len: 351 microversion: 2.1 time: 0.142392 Aug 04 16:55:06.352925 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1877/3698] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Aug 4 16:55:06 2022] GET /compute/v2.1/os-volumes/72494bba-0102-4409-abe9-89d0f46aee75 => generated 351 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:06.371388 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2b37a4b6-9246-473c-8730-0cc4db2de719 tempest-VolumesTestJSON-2078126759 tempest-VolumesTestJSON-2078126759-project] Calling method '.version_select at 0x7f7e89ba7160>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:06.453501 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-dc7e9388-f2c2-44ba-9a9b-d356829721b8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] validate_networks() for [('b83d6df0-d970-41bd-ae99-1dfc6211d426', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:55:06.587251 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2b37a4b6-9246-473c-8730-0cc4db2de719 tempest-VolumesTestJSON-2078126759 tempest-VolumesTestJSON-2078126759-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.223535 Aug 04 16:55:06.598551 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1878/3699] 10.222.0.23 () {58 vars in 1134 bytes} [Thu Aug 4 16:55:06 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:06.603493 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c2d88e1b-d705-43dc-87b8-aaccc717dd91 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:06.604362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c2d88e1b-d705-43dc-87b8-aaccc717dd91 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:06.614425 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2d88e1b-d705-43dc-87b8-aaccc717dd91 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:06.614865 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2d88e1b-d705-43dc-87b8-aaccc717dd91 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:06.615654 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2d88e1b-d705-43dc-87b8-aaccc717dd91 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:06.616105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2d88e1b-d705-43dc-87b8-aaccc717dd91 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:07.209303 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c2d88e1b-d705-43dc-87b8-aaccc717dd91 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:07.224568 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c2d88e1b-d705-43dc-87b8-aaccc717dd91 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7" status: 200 len: 1334 microversion: 2.1 time: 0.634699 Aug 04 16:55:07.225326 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1879/3700] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:06 2022] GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 => generated 1334 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:07.252179 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8476f79d-cdf2-4fea-9e42-e46249a4b19f tempest-VolumesTestJSON-2078126759 tempest-VolumesTestJSON-2078126759-project] Calling method '.version_select at 0x7f7e77cbd790>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:07.359786 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8476f79d-cdf2-4fea-9e42-e46249a4b19f tempest-VolumesTestJSON-2078126759 tempest-VolumesTestJSON-2078126759-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.118741 Aug 04 16:55:07.360791 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1880/3701] 10.222.0.23 () {58 vars in 1149 bytes} [Thu Aug 4 16:55:07 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:07.370935 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-27f06924-d33d-4e2d-a952-1b7f1cfe4aab tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:07.375907 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-27f06924-d33d-4e2d-a952-1b7f1cfe4aab tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:07.386383 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-27f06924-d33d-4e2d-a952-1b7f1cfe4aab tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:07.387360 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-27f06924-d33d-4e2d-a952-1b7f1cfe4aab tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:07.388415 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-27f06924-d33d-4e2d-a952-1b7f1cfe4aab tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:07.389440 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-27f06924-d33d-4e2d-a952-1b7f1cfe4aab tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:07.627316 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-27f06924-d33d-4e2d-a952-1b7f1cfe4aab tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:07.648505 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-27f06924-d33d-4e2d-a952-1b7f1cfe4aab tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1521 microversion: 2.1 time: 0.286309 Aug 04 16:55:07.649369 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1881/3702] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:07 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:07.757016 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-dc7e9388-f2c2-44ba-9a9b-d356829721b8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:55:07.758215 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-dc7e9388-f2c2-44ba-9a9b-d356829721b8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:55:07.758215 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-dc7e9388-f2c2-44ba-9a9b-d356829721b8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:55:07.758529 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-dc7e9388-f2c2-44ba-9a9b-d356829721b8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:55:07.759405 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-dc7e9388-f2c2-44ba-9a9b-d356829721b8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:55:07.778359 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dc7e9388-f2c2-44ba-9a9b-d356829721b8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:07.778898 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dc7e9388-f2c2-44ba-9a9b-d356829721b8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:07.781112 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dc7e9388-f2c2-44ba-9a9b-d356829721b8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:07.781629 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dc7e9388-f2c2-44ba-9a9b-d356829721b8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:07.837334 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-dc7e9388-f2c2-44ba-9a9b-d356829721b8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Getting quotas for project fa4bb1fda4ef4267829850c4c616df77. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:55:07.893913 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-dc7e9388-f2c2-44ba-9a9b-d356829721b8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Getting quotas for user db8a96da1d7943599ee6ca9df18f5148 and project fa4bb1fda4ef4267829850c4c616df77. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:55:07.920802 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-dc7e9388-f2c2-44ba-9a9b-d356829721b8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:55:07.924382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-dc7e9388-f2c2-44ba-9a9b-d356829721b8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 1db79b76-1967-4f0e-a07c-c66e82f890d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:55:07.949904 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-df52fa99-da1d-41e7-848e-33cd47704109 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1455800773", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": "none"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:08.017121 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dc7e9388-f2c2-44ba-9a9b-d356829721b8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.686954 Aug 04 16:55:08.018665 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1822/3703] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:55:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:55:08.024319 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-02e503d8-a491-45f9-9fff-7906c82174ca req-c4e5cf22-d4d5-4e5b-a45a-c71dbc73dcae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35b8c051-c8b6-47ee-966f-ad9c3c4a94d7", "tag": "8511ad65-5a63-4792-bf48-3e6a61884e35"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:08.039506 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-02e503d8-a491-45f9-9fff-7906c82174ca req-c4e5cf22-d4d5-4e5b-a45a-c71dbc73dcae service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:08.040282 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-02e503d8-a491-45f9-9fff-7906c82174ca req-c4e5cf22-d4d5-4e5b-a45a-c71dbc73dcae service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:08.045045 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-df52fa99-da1d-41e7-848e-33cd47704109 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:55:08.047969 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-df52fa99-da1d-41e7-848e-33cd47704109 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:55:08.048767 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-df52fa99-da1d-41e7-848e-33cd47704109 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:55:08.049548 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-df52fa99-da1d-41e7-848e-33cd47704109 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:55:08.051598 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-df52fa99-da1d-41e7-848e-33cd47704109 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:55:08.058707 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-02e503d8-a491-45f9-9fff-7906c82174ca req-c4e5cf22-d4d5-4e5b-a45a-c71dbc73dcae service nova] Creating event network-changed:8511ad65-5a63-4792-bf48-3e6a61884e35 for instance 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 on n-h1-846466-12 Aug 04 16:55:08.066405 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-02e503d8-a491-45f9-9fff-7906c82174ca req-c4e5cf22-d4d5-4e5b-a45a-c71dbc73dcae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045799 Aug 04 16:55:08.067103 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1823/3704] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:08.080650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4663ac17-8a29-476b-b6f1-2fca94039ec3 tempest-VolumesTestJSON-2078126759 tempest-VolumesTestJSON-2078126759-project] Calling method '.version_select at 0x7f7e77d26f70>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:08.102654 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df52fa99-da1d-41e7-848e-33cd47704109 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:08.103150 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df52fa99-da1d-41e7-848e-33cd47704109 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:08.103972 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df52fa99-da1d-41e7-848e-33cd47704109 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:08.104415 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df52fa99-da1d-41e7-848e-33cd47704109 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:08.180274 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-df52fa99-da1d-41e7-848e-33cd47704109 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Getting quotas for project 61b081621f384220a8becdeeb0bfd3cd. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:55:08.194909 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-df52fa99-da1d-41e7-848e-33cd47704109 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Getting quotas for user 1bd94200a6b94531b8ea725981c9a06e and project 61b081621f384220a8becdeeb0bfd3cd. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:55:08.204341 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4663ac17-8a29-476b-b6f1-2fca94039ec3 tempest-VolumesTestJSON-2078126759 tempest-VolumesTestJSON-2078126759-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.130632 Aug 04 16:55:08.206150 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1824/3705] 10.222.0.23 () {58 vars in 1134 bytes} [Thu Aug 4 16:55:08 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:08.213968 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5cde4516-9e94-4d66-bbee-8f692f793121 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:08.217791 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5cde4516-9e94-4d66-bbee-8f692f793121 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 1db79b76-1967-4f0e-a07c-c66e82f890d4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:08.227987 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-df52fa99-da1d-41e7-848e-33cd47704109 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:55:08.231276 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-df52fa99-da1d-41e7-848e-33cd47704109 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] [instance: 22374f24-f9d2-434f-9a38-fa08620e5032] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:55:08.271332 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5cde4516-9e94-4d66-bbee-8f692f793121 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 1db79b76-1967-4f0e-a07c-c66e82f890d4] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:55:08.316940 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-df52fa99-da1d-41e7-848e-33cd47704109 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.666134 Aug 04 16:55:08.319650 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1882/3706] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Aug 4 16:55:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 16:55:08.330488 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ca6757b4-04de-4381-87aa-7b58e4eabf97 tempest-VolumesTestJSON-2078126759 tempest-VolumesTestJSON-2078126759-project] Calling method '.version_select at 0x7f7e89b7a700>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:08.511411 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ca6757b4-04de-4381-87aa-7b58e4eabf97 tempest-VolumesTestJSON-2078126759 tempest-VolumesTestJSON-2078126759-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.190368 Aug 04 16:55:08.512459 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1883/3707] 10.222.0.23 () {58 vars in 1167 bytes} [Thu Aug 4 16:55:08 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:08.522124 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cee40999-f2e7-430d-9bad-e9c6d7e10570 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:08.524195 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cee40999-f2e7-430d-9bad-e9c6d7e10570 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:08.545501 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cee40999-f2e7-430d-9bad-e9c6d7e10570 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:08.547333 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cee40999-f2e7-430d-9bad-e9c6d7e10570 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:08.549708 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cee40999-f2e7-430d-9bad-e9c6d7e10570 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:08.550787 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cee40999-f2e7-430d-9bad-e9c6d7e10570 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:08.592907 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=100 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:08.600067 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5cde4516-9e94-4d66-bbee-8f692f793121 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1db79b76-1967-4f0e-a07c-c66e82f890d4" status: 204 len: 0 microversion: 2.1 time: 0.391595 Aug 04 16:55:08.601734 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1825/3708] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:55:08 2022] DELETE /compute/v2.1/servers/1db79b76-1967-4f0e-a07c-c66e82f890d4 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:55:08.608726 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a7c2c989-d88e-4e8e-bbc1-b7420725bf75 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:08.609911 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a7c2c989-d88e-4e8e-bbc1-b7420725bf75 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] [instance: 22374f24-f9d2-434f-9a38-fa08620e5032] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:08.727549 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a7c2c989-d88e-4e8e-bbc1-b7420725bf75 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:08.762337 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a7c2c989-d88e-4e8e-bbc1-b7420725bf75 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:08.765876 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a7c2c989-d88e-4e8e-bbc1-b7420725bf75 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:08.772006 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a7c2c989-d88e-4e8e-bbc1-b7420725bf75 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] 10.222.0.23 "GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032" status: 200 len: 1278 microversion: 2.57 time: 0.168189 Aug 04 16:55:08.792434 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1826/3709] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:08 2022] GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032 => generated 1278 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:08.797841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-22eae147-7781-4a24-be28-92dca52eafa1 tempest-VolumesTestJSON-2078126759 tempest-VolumesTestJSON-2078126759-project] Calling method '.version_select at 0x7f7e77d17f70>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:09.032186 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-22eae147-7781-4a24-be28-92dca52eafa1 tempest-VolumesTestJSON-2078126759 tempest-VolumesTestJSON-2078126759-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.238232 Aug 04 16:55:09.033046 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1827/3710] 10.222.0.23 () {58 vars in 1170 bytes} [Thu Aug 4 16:55:08 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:09.039809 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5e0f96ef-4b96-4e7f-9891-aa2480dcb7e4 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:09.041232 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5e0f96ef-4b96-4e7f-9891-aa2480dcb7e4 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 1db79b76-1967-4f0e-a07c-c66e82f890d4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:09.056166 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-5e0f96ef-4b96-4e7f-9891-aa2480dcb7e4 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] HTTP exception thrown: Instance 1db79b76-1967-4f0e-a07c-c66e82f890d4 could not be found. Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5e0f96ef-4b96-4e7f-9891-aa2480dcb7e4 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Request method failure captured: Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/1db79b76-1967-4f0e-a07c-c66e82f890d4 HTTP/1.1 Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_nQAsIL8Gtig2JiDfXWtIJ3WPqwL_iDK7Lzq6TGktfJLC3h9uoTgZsXj24J3msyyZQB5KWPirQK_R6x2-eYME28EQ_2bgNAh7DlNXEg7JFJsdnvAdfZMaqCmRUibanDLQxQgidHpyXwUg784UXcgxKrIZzuzT1AuaLsb_WysQnZpiA Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersTestJSON-750208524 Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa4bb1fda4ef4267829850c4c616df77"}]}] Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersTestJSON-750208524 Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersTestJSON-750208524 Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersTestJSON-750208524-project Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: db8a96da1d7943599ee6ca9df18f5148 Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersTestJSON-750208524-project Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 1db79b76-1967-4f0e-a07c-c66e82f890d4 could not be found. Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '1db79b76-1967-4f0e-a07c-c66e82f890d4'} Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1db79b76-1967-4f0e-a07c-c66e82f890d4 could not be found. Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1db79b76-1967-4f0e-a07c-c66e82f890d4 could not be found. Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:09.062155 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:09.067488 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:55:09.067488 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:55:09.067488 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1db79b76-1967-4f0e-a07c-c66e82f890d4 could not be found. Aug 04 16:55:09.067488 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:55:09.067488 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5e0f96ef-4b96-4e7f-9891-aa2480dcb7e4 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Returning 404 to user: Instance 1db79b76-1967-4f0e-a07c-c66e82f890d4 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:09.071055 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5e0f96ef-4b96-4e7f-9891-aa2480dcb7e4 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/1db79b76-1967-4f0e-a07c-c66e82f890d4" status: 404 len: 111 microversion: 2.1 time: 0.034694 Aug 04 16:55:09.084447 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1828/3711] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:09 2022] GET /compute/v2.1/servers/1db79b76-1967-4f0e-a07c-c66e82f890d4 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:55:09.091342 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7b928c73-d635-4a28-b124-49dd2eff9a15 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:09.092584 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7b928c73-d635-4a28-b124-49dd2eff9a15 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:09.109933 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b928c73-d635-4a28-b124-49dd2eff9a15 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:09.110895 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b928c73-d635-4a28-b124-49dd2eff9a15 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:09.113669 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b928c73-d635-4a28-b124-49dd2eff9a15 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:09.117245 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b928c73-d635-4a28-b124-49dd2eff9a15 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:09.156970 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cee40999-f2e7-430d-9bad-e9c6d7e10570 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:09.170233 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cee40999-f2e7-430d-9bad-e9c6d7e10570 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7" status: 200 len: 1334 microversion: 2.1 time: 0.656362 Aug 04 16:55:09.173894 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1884/3712] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:08 2022] GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 => generated 1334 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:09.181970 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f46f9851-c52b-4fa5-99b4-17588b7bcb31 tempest-VolumesTestJSON-2078126759 tempest-VolumesTestJSON-2078126759-project] Calling method '.version_select at 0x7f7e89b7a820>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:09.403906 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f46f9851-c52b-4fa5-99b4-17588b7bcb31 tempest-VolumesTestJSON-2078126759 tempest-VolumesTestJSON-2078126759-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.228395 Aug 04 16:55:09.404664 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1885/3713] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Aug 4 16:55:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:09.421972 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ee267250-c7cf-4b70-9796-ad5b058b584a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-969972628", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "b83d6df0-d970-41bd-ae99-1dfc6211d426"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:09.552735 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-ee267250-c7cf-4b70-9796-ad5b058b584a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] validate_networks() for [('b83d6df0-d970-41bd-ae99-1dfc6211d426', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:55:09.735486 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7b928c73-d635-4a28-b124-49dd2eff9a15 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:09.763784 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7b928c73-d635-4a28-b124-49dd2eff9a15 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1521 microversion: 2.1 time: 0.677367 Aug 04 16:55:09.779562 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1829/3714] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:09 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1521 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:09.785247 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2d349107-6843-41c1-a6cd-59e04c0dc102 tempest-VolumesTestJSON-2078126759 tempest-VolumesTestJSON-2078126759-project] Calling method '.version_select at 0x7f7e77d17b80>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:09.952839 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2d349107-6843-41c1-a6cd-59e04c0dc102 tempest-VolumesTestJSON-2078126759 tempest-VolumesTestJSON-2078126759-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.172031 Aug 04 16:55:09.954159 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1830/3715] 10.222.0.23 () {58 vars in 1188 bytes} [Thu Aug 4 16:55:09 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:09.959404 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8a7ee13c-ecdb-467a-978f-cd62539e1512 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:09.960293 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8a7ee13c-ecdb-467a-978f-cd62539e1512 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] [instance: 22374f24-f9d2-434f-9a38-fa08620e5032] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:09.988470 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a7ee13c-ecdb-467a-978f-cd62539e1512 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:09.989152 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a7ee13c-ecdb-467a-978f-cd62539e1512 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:09.990733 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a7ee13c-ecdb-467a-978f-cd62539e1512 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:09.995906 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a7ee13c-ecdb-467a-978f-cd62539e1512 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:10.184889 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8a7ee13c-ecdb-467a-978f-cd62539e1512 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:10.205759 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8a7ee13c-ecdb-467a-978f-cd62539e1512 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:10.210038 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8a7ee13c-ecdb-467a-978f-cd62539e1512 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:10.211285 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8a7ee13c-ecdb-467a-978f-cd62539e1512 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] 10.222.0.23 "GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032" status: 200 len: 1330 microversion: 2.57 time: 0.255978 Aug 04 16:55:10.212173 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1831/3716] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:09 2022] GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032 => generated 1330 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:10.220166 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-16597dcd-5ba1-4e80-93da-7f18c4984635 tempest-VolumesTestJSON-2078126759 tempest-VolumesTestJSON-2078126759-project] Calling method '.version_select at 0x7f7e77c2fb80>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:10.448745 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-16597dcd-5ba1-4e80-93da-7f18c4984635 tempest-VolumesTestJSON-2078126759 tempest-VolumesTestJSON-2078126759-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.235493 Aug 04 16:55:10.449063 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1832/3717] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Aug 4 16:55:10 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:10.457680 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a1473fb3-5f78-418e-ae7a-d4d641c92edc tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:10.457680 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a1473fb3-5f78-418e-ae7a-d4d641c92edc tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:10.467241 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a1473fb3-5f78-418e-ae7a-d4d641c92edc tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:10.467736 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a1473fb3-5f78-418e-ae7a-d4d641c92edc tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:10.468522 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a1473fb3-5f78-418e-ae7a-d4d641c92edc tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:10.468953 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a1473fb3-5f78-418e-ae7a-d4d641c92edc tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:10.717740 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-ee267250-c7cf-4b70-9796-ad5b058b584a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:55:10.717740 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-ee267250-c7cf-4b70-9796-ad5b058b584a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:55:10.718497 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-ee267250-c7cf-4b70-9796-ad5b058b584a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:55:10.718844 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-ee267250-c7cf-4b70-9796-ad5b058b584a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:55:10.719369 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-ee267250-c7cf-4b70-9796-ad5b058b584a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:55:10.738050 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ee267250-c7cf-4b70-9796-ad5b058b584a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:10.744627 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ee267250-c7cf-4b70-9796-ad5b058b584a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:10.754367 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ee267250-c7cf-4b70-9796-ad5b058b584a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:10.755147 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ee267250-c7cf-4b70-9796-ad5b058b584a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:10.786941 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-ee267250-c7cf-4b70-9796-ad5b058b584a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Getting quotas for project fa4bb1fda4ef4267829850c4c616df77. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:55:10.823475 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-ee267250-c7cf-4b70-9796-ad5b058b584a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Getting quotas for user db8a96da1d7943599ee6ca9df18f5148 and project fa4bb1fda4ef4267829850c4c616df77. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:55:10.881144 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ee267250-c7cf-4b70-9796-ad5b058b584a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:55:10.894792 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ee267250-c7cf-4b70-9796-ad5b058b584a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:55:11.045369 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ee267250-c7cf-4b70-9796-ad5b058b584a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.630308 Aug 04 16:55:11.046382 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1886/3718] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:55:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:55:11.057627 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2e997510-f14a-424a-870b-0196edeea7dd tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:11.059345 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2e997510-f14a-424a-870b-0196edeea7dd tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:11.077099 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e997510-f14a-424a-870b-0196edeea7dd tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:11.077404 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e997510-f14a-424a-870b-0196edeea7dd tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:11.079705 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e997510-f14a-424a-870b-0196edeea7dd tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:11.080938 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e997510-f14a-424a-870b-0196edeea7dd tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:11.090426 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a1473fb3-5f78-418e-ae7a-d4d641c92edc tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:11.108620 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a1473fb3-5f78-418e-ae7a-d4d641c92edc tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7" status: 200 len: 1334 microversion: 2.1 time: 0.655950 Aug 04 16:55:11.108620 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1833/3719] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:10 2022] GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 => generated 1334 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:11.150859 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-56b018d3-fcdb-4bf1-a2b7-317102bae516 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:11.150859 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-56b018d3-fcdb-4bf1-a2b7-317102bae516 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:11.348301 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-56b018d3-fcdb-4bf1-a2b7-317102bae516 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:11.363473 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-56b018d3-fcdb-4bf1-a2b7-317102bae516 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854" status: 200 len: 1220 microversion: 2.1 time: 0.234059 Aug 04 16:55:11.377437 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1834/3720] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:11 2022] GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 => generated 1220 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:11.393055 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f77c6871-0a43-4c8f-8cb5-3b2799b941bf tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:11.426322 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f77c6871-0a43-4c8f-8cb5-3b2799b941bf tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] [instance: 22374f24-f9d2-434f-9a38-fa08620e5032] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:11.449969 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f77c6871-0a43-4c8f-8cb5-3b2799b941bf tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:11.450423 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f77c6871-0a43-4c8f-8cb5-3b2799b941bf tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:11.452449 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f77c6871-0a43-4c8f-8cb5-3b2799b941bf tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:11.455059 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f77c6871-0a43-4c8f-8cb5-3b2799b941bf tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:11.727106 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f77c6871-0a43-4c8f-8cb5-3b2799b941bf tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:11.736495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f77c6871-0a43-4c8f-8cb5-3b2799b941bf tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:11.740944 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f77c6871-0a43-4c8f-8cb5-3b2799b941bf tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:11.744567 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f77c6871-0a43-4c8f-8cb5-3b2799b941bf tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] 10.222.0.23 "GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032" status: 200 len: 1336 microversion: 2.57 time: 0.365522 Aug 04 16:55:11.747287 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1835/3721] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:11 2022] GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032 => generated 1336 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:12.030630 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2e997510-f14a-424a-870b-0196edeea7dd tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:12.045254 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2e997510-f14a-424a-870b-0196edeea7dd tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1521 microversion: 2.1 time: 0.995289 Aug 04 16:55:12.059466 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1887/3722] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:11 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1521 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:12.137925 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e5b89cee-f866-4fd1-a528-6a7c4702bd15 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:12.138877 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e5b89cee-f866-4fd1-a528-6a7c4702bd15 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:12.152910 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5b89cee-f866-4fd1-a528-6a7c4702bd15 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:12.153665 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5b89cee-f866-4fd1-a528-6a7c4702bd15 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:12.171564 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5b89cee-f866-4fd1-a528-6a7c4702bd15 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:12.172407 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5b89cee-f866-4fd1-a528-6a7c4702bd15 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:12.410323 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6e7e6113-7e1a-4812-8ac5-956215a2afcd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:12.411304 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6e7e6113-7e1a-4812-8ac5-956215a2afcd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:12.418430 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6e7e6113-7e1a-4812-8ac5-956215a2afcd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:12.430109 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6e7e6113-7e1a-4812-8ac5-956215a2afcd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:12.431234 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6e7e6113-7e1a-4812-8ac5-956215a2afcd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:12.431817 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6e7e6113-7e1a-4812-8ac5-956215a2afcd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:12.694332 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6e7e6113-7e1a-4812-8ac5-956215a2afcd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:12.711666 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6e7e6113-7e1a-4812-8ac5-956215a2afcd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854" status: 200 len: 1216 microversion: 2.1 time: 0.303442 Aug 04 16:55:12.728300 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1888/3723] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:12 2022] GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 => generated 1216 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:12.794671 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9f8afd21-95f6-4992-91cd-0fdb411d9edc tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:12.812714 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9f8afd21-95f6-4992-91cd-0fdb411d9edc tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] [instance: 22374f24-f9d2-434f-9a38-fa08620e5032] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:12.828783 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9f8afd21-95f6-4992-91cd-0fdb411d9edc tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:12.829548 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9f8afd21-95f6-4992-91cd-0fdb411d9edc tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:12.830875 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9f8afd21-95f6-4992-91cd-0fdb411d9edc tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:12.835848 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9f8afd21-95f6-4992-91cd-0fdb411d9edc tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:13.089574 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9f8afd21-95f6-4992-91cd-0fdb411d9edc tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:13.114623 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9f8afd21-95f6-4992-91cd-0fdb411d9edc tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:13.122066 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9f8afd21-95f6-4992-91cd-0fdb411d9edc tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:13.127460 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9f8afd21-95f6-4992-91cd-0fdb411d9edc tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] 10.222.0.23 "GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032" status: 200 len: 1357 microversion: 2.57 time: 0.343224 Aug 04 16:55:13.133701 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1889/3724] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:12 2022] GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032 => generated 1357 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:13.150846 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4b207937-a89f-42b9-bc98-27b1e9ee598d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:13.155547 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4b207937-a89f-42b9-bc98-27b1e9ee598d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:13.187491 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4b207937-a89f-42b9-bc98-27b1e9ee598d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:13.195166 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4b207937-a89f-42b9-bc98-27b1e9ee598d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:13.196361 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4b207937-a89f-42b9-bc98-27b1e9ee598d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:13.206577 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4b207937-a89f-42b9-bc98-27b1e9ee598d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:13.239904 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e5b89cee-f866-4fd1-a528-6a7c4702bd15 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:13.259266 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e5b89cee-f866-4fd1-a528-6a7c4702bd15 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7" status: 200 len: 1334 microversion: 2.1 time: 1.127029 Aug 04 16:55:13.262247 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1836/3725] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:12 2022] GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 => generated 1334 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:13.287876 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-869579dd-937b-4da8-86a2-f264bce4e9a8 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:13.309469 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-869579dd-937b-4da8-86a2-f264bce4e9a8 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] [instance: 22374f24-f9d2-434f-9a38-fa08620e5032] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:13.328372 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-869579dd-937b-4da8-86a2-f264bce4e9a8 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:13.334049 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-869579dd-937b-4da8-86a2-f264bce4e9a8 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:13.337311 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-869579dd-937b-4da8-86a2-f264bce4e9a8 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:13.337981 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-869579dd-937b-4da8-86a2-f264bce4e9a8 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:13.522117 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-869579dd-937b-4da8-86a2-f264bce4e9a8 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:55:13.525159 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-869579dd-937b-4da8-86a2-f264bce4e9a8 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:55:13.525794 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-869579dd-937b-4da8-86a2-f264bce4e9a8 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:55:13.526210 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-869579dd-937b-4da8-86a2-f264bce4e9a8 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:55:13.527192 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-869579dd-937b-4da8-86a2-f264bce4e9a8 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:55:13.717025 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-869579dd-937b-4da8-86a2-f264bce4e9a8 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] [instance: 22374f24-f9d2-434f-9a38-fa08620e5032] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:13.730688 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-869579dd-937b-4da8-86a2-f264bce4e9a8 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:13.735202 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-869579dd-937b-4da8-86a2-f264bce4e9a8 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:13.736253 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-869579dd-937b-4da8-86a2-f264bce4e9a8 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:13.737486 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-869579dd-937b-4da8-86a2-f264bce4e9a8 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:13.814266 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4b207937-a89f-42b9-bc98-27b1e9ee598d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:13.823312 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4b207937-a89f-42b9-bc98-27b1e9ee598d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1521 microversion: 2.1 time: 0.686018 Aug 04 16:55:13.842044 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1890/3726] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:13 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1521 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:13.852292 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-869579dd-937b-4da8-86a2-f264bce4e9a8 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] 10.222.0.23 "POST /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032/action" status: 202 len: 1138 microversion: 2.57 time: 0.581465 Aug 04 16:55:13.864020 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1837/3727] 10.222.0.23 () {62 vars in 1320 bytes} [Thu Aug 4 16:55:13 2022] POST /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032/action => generated 1138 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 04 16:55:13.881253 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-433924e2-7f7a-4750-81da-209c52223327 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:13.883458 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-433924e2-7f7a-4750-81da-209c52223327 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:13.903254 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2599d933-fbac-4066-9e1f-dda2d1092740 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:13.903782 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2599d933-fbac-4066-9e1f-dda2d1092740 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] [instance: 22374f24-f9d2-434f-9a38-fa08620e5032] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:13.923917 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-433924e2-7f7a-4750-81da-209c52223327 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:13.928838 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-433924e2-7f7a-4750-81da-209c52223327 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:13.929946 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-433924e2-7f7a-4750-81da-209c52223327 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:13.930399 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-433924e2-7f7a-4750-81da-209c52223327 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:13.958470 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2599d933-fbac-4066-9e1f-dda2d1092740 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:13.959616 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2599d933-fbac-4066-9e1f-dda2d1092740 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:13.963287 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2599d933-fbac-4066-9e1f-dda2d1092740 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:13.964050 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2599d933-fbac-4066-9e1f-dda2d1092740 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:14.147542 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-433924e2-7f7a-4750-81da-209c52223327 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:14.161713 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-433924e2-7f7a-4750-81da-209c52223327 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854" status: 200 len: 1278 microversion: 2.1 time: 0.317098 Aug 04 16:55:14.177917 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1891/3728] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:13 2022] GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 => generated 1278 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:14.287577 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2abbc356-fb5a-4831-9850-b489a26ff4fa tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:14.288310 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2abbc356-fb5a-4831-9850-b489a26ff4fa tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:14.309681 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2abbc356-fb5a-4831-9850-b489a26ff4fa tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:14.312821 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2abbc356-fb5a-4831-9850-b489a26ff4fa tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:14.315554 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2abbc356-fb5a-4831-9850-b489a26ff4fa tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:14.318895 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2abbc356-fb5a-4831-9850-b489a26ff4fa tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:14.460094 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2599d933-fbac-4066-9e1f-dda2d1092740 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:14.471677 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2599d933-fbac-4066-9e1f-dda2d1092740 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:14.482646 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2599d933-fbac-4066-9e1f-dda2d1092740 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:14.483998 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2599d933-fbac-4066-9e1f-dda2d1092740 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] 10.222.0.23 "GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032" status: 200 len: 1366 microversion: 2.57 time: 0.604748 Aug 04 16:55:14.484618 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1838/3729] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:13 2022] GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032 => generated 1366 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:14.697863 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2abbc356-fb5a-4831-9850-b489a26ff4fa tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:14.715373 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2abbc356-fb5a-4831-9850-b489a26ff4fa tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7" status: 200 len: 1334 microversion: 2.1 time: 0.432610 Aug 04 16:55:14.727405 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1892/3730] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:14 2022] GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 => generated 1334 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:14.863987 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9cd43784-0cd4-44b7-937b-e3f0b44df642 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:14.865011 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9cd43784-0cd4-44b7-937b-e3f0b44df642 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:14.879691 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9cd43784-0cd4-44b7-937b-e3f0b44df642 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:14.881344 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9cd43784-0cd4-44b7-937b-e3f0b44df642 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:14.885214 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9cd43784-0cd4-44b7-937b-e3f0b44df642 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:14.887500 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9cd43784-0cd4-44b7-937b-e3f0b44df642 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:15.187246 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-63fb9a6a-5c0b-421f-bf2d-adcd895220f8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:15.188276 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-63fb9a6a-5c0b-421f-bf2d-adcd895220f8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:15.223531 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-63fb9a6a-5c0b-421f-bf2d-adcd895220f8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:15.225502 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-63fb9a6a-5c0b-421f-bf2d-adcd895220f8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:15.226470 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-63fb9a6a-5c0b-421f-bf2d-adcd895220f8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:15.232576 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-63fb9a6a-5c0b-421f-bf2d-adcd895220f8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:15.652408 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9cd43784-0cd4-44b7-937b-e3f0b44df642 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:15.662150 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9cd43784-0cd4-44b7-937b-e3f0b44df642 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1521 microversion: 2.1 time: 0.802448 Aug 04 16:55:15.670206 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1839/3731] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:14 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1521 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:15.688029 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-389c1016-fba5-4538-9c85-795e3213a2f2 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:15.693462 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-389c1016-fba5-4538-9c85-795e3213a2f2 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] [instance: 22374f24-f9d2-434f-9a38-fa08620e5032] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:15.712458 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-389c1016-fba5-4538-9c85-795e3213a2f2 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:15.712904 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-389c1016-fba5-4538-9c85-795e3213a2f2 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:15.717493 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-389c1016-fba5-4538-9c85-795e3213a2f2 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:15.718878 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-389c1016-fba5-4538-9c85-795e3213a2f2 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:16.007613 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-389c1016-fba5-4538-9c85-795e3213a2f2 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:16.015606 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-63fb9a6a-5c0b-421f-bf2d-adcd895220f8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:16.033747 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-63fb9a6a-5c0b-421f-bf2d-adcd895220f8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854" status: 200 len: 1320 microversion: 2.1 time: 0.846354 Aug 04 16:55:16.035225 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1893/3732] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:15 2022] GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 => generated 1320 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:16.035928 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-389c1016-fba5-4538-9c85-795e3213a2f2 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:16.040859 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-389c1016-fba5-4538-9c85-795e3213a2f2 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:16.052259 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-389c1016-fba5-4538-9c85-795e3213a2f2 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] 10.222.0.23 "GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032" status: 200 len: 1366 microversion: 2.57 time: 0.370763 Aug 04 16:55:16.053217 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1840/3733] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:15 2022] GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032 => generated 1366 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:16.054176 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-70fadcc0-8a7d-46f6-bf69-c0a570e29102 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:16.055422 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-70fadcc0-8a7d-46f6-bf69-c0a570e29102 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:16.070371 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-70fadcc0-8a7d-46f6-bf69-c0a570e29102 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:16.071061 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-70fadcc0-8a7d-46f6-bf69-c0a570e29102 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:16.072022 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-70fadcc0-8a7d-46f6-bf69-c0a570e29102 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:16.073701 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-70fadcc0-8a7d-46f6-bf69-c0a570e29102 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:16.559037 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-70fadcc0-8a7d-46f6-bf69-c0a570e29102 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:16.570972 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-70fadcc0-8a7d-46f6-bf69-c0a570e29102 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7" status: 200 len: 1334 microversion: 2.1 time: 0.532130 Aug 04 16:55:16.573564 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1894/3734] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:16 2022] GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 => generated 1334 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:16.699536 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-70fb8205-e8d0-493d-bcd6-bb5696345f18 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:16.701161 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-70fb8205-e8d0-493d-bcd6-bb5696345f18 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:16.711304 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70fb8205-e8d0-493d-bcd6-bb5696345f18 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:16.712037 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70fb8205-e8d0-493d-bcd6-bb5696345f18 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:16.713565 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70fb8205-e8d0-493d-bcd6-bb5696345f18 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:16.714143 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70fb8205-e8d0-493d-bcd6-bb5696345f18 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:16.973207 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-6f051660-fe65-43fe-9105-205fe600f805 req-a7e4f9a4-62db-4e04-ad4d-3bed7ff65686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854", "tag": "29af2bea-2dc6-47f3-8165-35426694e0f6"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:17.016711 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6f051660-fe65-43fe-9105-205fe600f805 req-a7e4f9a4-62db-4e04-ad4d-3bed7ff65686 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:17.028382 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6f051660-fe65-43fe-9105-205fe600f805 req-a7e4f9a4-62db-4e04-ad4d-3bed7ff65686 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:17.067917 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-6f051660-fe65-43fe-9105-205fe600f805 req-a7e4f9a4-62db-4e04-ad4d-3bed7ff65686 service nova] Creating event network-changed:29af2bea-2dc6-47f3-8165-35426694e0f6 for instance d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 on n-h1-846466-12 Aug 04 16:55:17.099758 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-6f051660-fe65-43fe-9105-205fe600f805 req-a7e4f9a4-62db-4e04-ad4d-3bed7ff65686 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126981 Aug 04 16:55:17.100728 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1895/3735] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:55:17.124395 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b9cfff3b-e333-46c9-9bed-dfa2cf1c508b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:17.133391 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b9cfff3b-e333-46c9-9bed-dfa2cf1c508b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:17.154578 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b9cfff3b-e333-46c9-9bed-dfa2cf1c508b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:17.154989 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b9cfff3b-e333-46c9-9bed-dfa2cf1c508b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:17.161347 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b9cfff3b-e333-46c9-9bed-dfa2cf1c508b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:17.166115 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b9cfff3b-e333-46c9-9bed-dfa2cf1c508b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:17.805264 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:18.160981 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b9cfff3b-e333-46c9-9bed-dfa2cf1c508b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:18.177509 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b9cfff3b-e333-46c9-9bed-dfa2cf1c508b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854" status: 200 len: 1320 microversion: 2.1 time: 1.072646 Aug 04 16:55:18.178426 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1896/3736] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:17 2022] GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 => generated 1320 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:18.180653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-70fb8205-e8d0-493d-bcd6-bb5696345f18 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:18.183246 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-90427659-954c-43a9-91ef-3091a0a78455 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:18.183884 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-90427659-954c-43a9-91ef-3091a0a78455 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] [instance: 22374f24-f9d2-434f-9a38-fa08620e5032] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:18.189060 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:18.191909 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-90427659-954c-43a9-91ef-3091a0a78455 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:18.192489 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-90427659-954c-43a9-91ef-3091a0a78455 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:18.194924 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-90427659-954c-43a9-91ef-3091a0a78455 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:18.195416 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-90427659-954c-43a9-91ef-3091a0a78455 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:18.196728 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-70fb8205-e8d0-493d-bcd6-bb5696345f18 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1521 microversion: 2.1 time: 1.505270 Aug 04 16:55:18.201680 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1841/3737] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:16 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1521 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:18.210799 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-1cdeac86-eb6f-4fe2-9b9e-1d5bd9928e28 req-c97ef08b-ff13-4c6e-9edb-6f209a58459a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0", "name": "network-vif-plugged", "status": "completed", "tag": "b11cc5b4-996e-44be-b5e9-d3ff403d692f"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:18.254864 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-1cdeac86-eb6f-4fe2-9b9e-1d5bd9928e28 req-c97ef08b-ff13-4c6e-9edb-6f209a58459a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:18.255560 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-1cdeac86-eb6f-4fe2-9b9e-1d5bd9928e28 req-c97ef08b-ff13-4c6e-9edb-6f209a58459a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:18.293689 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-1cdeac86-eb6f-4fe2-9b9e-1d5bd9928e28 req-c97ef08b-ff13-4c6e-9edb-6f209a58459a service nova] Creating event network-vif-plugged:b11cc5b4-996e-44be-b5e9-d3ff403d692f for instance 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 on n-h1-846466-12 Aug 04 16:55:18.303524 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-90427659-954c-43a9-91ef-3091a0a78455 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:18.311481 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-1cdeac86-eb6f-4fe2-9b9e-1d5bd9928e28 req-c97ef08b-ff13-4c6e-9edb-6f209a58459a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108224 Aug 04 16:55:18.315444 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1842/3738] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:18.323981 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-90fa32f4-56dc-4432-9c7e-e9e1559fd2fe tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:18.329812 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-90fa32f4-56dc-4432-9c7e-e9e1559fd2fe tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:18.331915 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-90427659-954c-43a9-91ef-3091a0a78455 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:18.334452 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-90427659-954c-43a9-91ef-3091a0a78455 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:18.337082 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-90427659-954c-43a9-91ef-3091a0a78455 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] 10.222.0.23 "GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032" status: 200 len: 1366 microversion: 2.57 time: 0.157018 Aug 04 16:55:18.338291 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1897/3739] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:18 2022] GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:18.348022 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-90fa32f4-56dc-4432-9c7e-e9e1559fd2fe tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:18.352345 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-90fa32f4-56dc-4432-9c7e-e9e1559fd2fe tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:18.356859 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-90fa32f4-56dc-4432-9c7e-e9e1559fd2fe tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:18.357541 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-90fa32f4-56dc-4432-9c7e-e9e1559fd2fe tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:18.872442 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-90fa32f4-56dc-4432-9c7e-e9e1559fd2fe tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:18.885926 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-90fa32f4-56dc-4432-9c7e-e9e1559fd2fe tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7" status: 200 len: 1334 microversion: 2.1 time: 0.568880 Aug 04 16:55:18.894076 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1843/3740] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:18 2022] GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 => generated 1334 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:19.200879 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1212c583-1786-4775-94f7-367aa5cdaae9 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:19.201587 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1212c583-1786-4775-94f7-367aa5cdaae9 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:19.221471 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b776aec8-fa27-4213-b453-5b479a33c73e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:19.222113 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b776aec8-fa27-4213-b453-5b479a33c73e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:19.235294 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1212c583-1786-4775-94f7-367aa5cdaae9 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:19.235738 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1212c583-1786-4775-94f7-367aa5cdaae9 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:19.238124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b776aec8-fa27-4213-b453-5b479a33c73e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:19.238416 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b776aec8-fa27-4213-b453-5b479a33c73e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:19.242860 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b776aec8-fa27-4213-b453-5b479a33c73e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:19.243364 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b776aec8-fa27-4213-b453-5b479a33c73e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:19.246384 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1212c583-1786-4775-94f7-367aa5cdaae9 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:19.246905 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1212c583-1786-4775-94f7-367aa5cdaae9 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:19.720213 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b776aec8-fa27-4213-b453-5b479a33c73e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:19.731893 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b776aec8-fa27-4213-b453-5b479a33c73e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1521 microversion: 2.1 time: 0.516188 Aug 04 16:55:19.734546 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1844/3741] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:19 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1521 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:55:19.740666 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-12ae5b8d-6b8f-4711-94fd-3e09e95f01ab tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:19.741879 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-12ae5b8d-6b8f-4711-94fd-3e09e95f01ab tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] [instance: 22374f24-f9d2-434f-9a38-fa08620e5032] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:19.751598 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-12ae5b8d-6b8f-4711-94fd-3e09e95f01ab tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:19.752608 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-12ae5b8d-6b8f-4711-94fd-3e09e95f01ab tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:19.754050 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-12ae5b8d-6b8f-4711-94fd-3e09e95f01ab tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:19.754738 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-12ae5b8d-6b8f-4711-94fd-3e09e95f01ab tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:19.801015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1212c583-1786-4775-94f7-367aa5cdaae9 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:19.812214 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1212c583-1786-4775-94f7-367aa5cdaae9 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854" status: 200 len: 1320 microversion: 2.1 time: 0.617560 Aug 04 16:55:19.813951 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1898/3742] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:19 2022] GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 => generated 1320 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:19.878302 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-12ae5b8d-6b8f-4711-94fd-3e09e95f01ab tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:19.890156 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-12ae5b8d-6b8f-4711-94fd-3e09e95f01ab tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:19.891819 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-12ae5b8d-6b8f-4711-94fd-3e09e95f01ab tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:19.893632 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-12ae5b8d-6b8f-4711-94fd-3e09e95f01ab tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] 10.222.0.23 "GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032" status: 200 len: 1366 microversion: 2.57 time: 0.157604 Aug 04 16:55:19.894609 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1845/3743] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:19 2022] GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:19.919970 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6d70bcaa-4bf0-4074-99f2-3d4a8ece4a42 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:19.920929 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6d70bcaa-4bf0-4074-99f2-3d4a8ece4a42 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:19.930699 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d70bcaa-4bf0-4074-99f2-3d4a8ece4a42 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:19.933872 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d70bcaa-4bf0-4074-99f2-3d4a8ece4a42 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:19.934894 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d70bcaa-4bf0-4074-99f2-3d4a8ece4a42 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:19.935509 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d70bcaa-4bf0-4074-99f2-3d4a8ece4a42 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:20.367928 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-fc2bf50f-7126-4491-9409-58d1c6acfd8c req-3014fdf3-ad26-44c0-9adb-ff7b4396591c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b8c051-c8b6-47ee-966f-ad9c3c4a94d7", "name": "network-vif-plugged", "status": "completed", "tag": "8511ad65-5a63-4792-bf48-3e6a61884e35"}, {"server_uuid": "35b8c051-c8b6-47ee-966f-ad9c3c4a94d7", "name": "network-vif-plugged", "status": "completed", "tag": "979ecb32-ee50-4784-9b30-6bd178622a78"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:20.391625 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6d70bcaa-4bf0-4074-99f2-3d4a8ece4a42 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:20.404005 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6d70bcaa-4bf0-4074-99f2-3d4a8ece4a42 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7" status: 200 len: 1334 microversion: 2.1 time: 0.487770 Aug 04 16:55:20.407108 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-fc2bf50f-7126-4491-9409-58d1c6acfd8c req-3014fdf3-ad26-44c0-9adb-ff7b4396591c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:20.407466 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1899/3744] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:19 2022] GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 => generated 1334 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:20.409186 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-fc2bf50f-7126-4491-9409-58d1c6acfd8c req-3014fdf3-ad26-44c0-9adb-ff7b4396591c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:20.437587 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-fc2bf50f-7126-4491-9409-58d1c6acfd8c req-3014fdf3-ad26-44c0-9adb-ff7b4396591c service nova] Creating event network-vif-plugged:8511ad65-5a63-4792-bf48-3e6a61884e35 for instance 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 on n-h1-846466-12 Aug 04 16:55:20.438651 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-fc2bf50f-7126-4491-9409-58d1c6acfd8c req-3014fdf3-ad26-44c0-9adb-ff7b4396591c service nova] Creating event network-vif-plugged:979ecb32-ee50-4784-9b30-6bd178622a78 for instance 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 on n-h1-846466-12 Aug 04 16:55:20.445364 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-fc2bf50f-7126-4491-9409-58d1c6acfd8c req-3014fdf3-ad26-44c0-9adb-ff7b4396591c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.080756 Aug 04 16:55:20.446539 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1846/3745] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:20.761417 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-56bd232b-4292-45c9-a91e-f326a475b30c tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:20.762258 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-56bd232b-4292-45c9-a91e-f326a475b30c tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:20.775329 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:20.784115 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-56bd232b-4292-45c9-a91e-f326a475b30c tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:20.784869 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-56bd232b-4292-45c9-a91e-f326a475b30c tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:20.787484 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-56bd232b-4292-45c9-a91e-f326a475b30c tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:20.788097 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-56bd232b-4292-45c9-a91e-f326a475b30c tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:20.835620 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9d5fdc7d-b0e2-4f38-b176-833928d6cb6b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:20.837057 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9d5fdc7d-b0e2-4f38-b176-833928d6cb6b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:20.852809 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d5fdc7d-b0e2-4f38-b176-833928d6cb6b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:20.854470 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d5fdc7d-b0e2-4f38-b176-833928d6cb6b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:20.857841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d5fdc7d-b0e2-4f38-b176-833928d6cb6b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:20.859380 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d5fdc7d-b0e2-4f38-b176-833928d6cb6b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:20.868742 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=12 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:21.212105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-56bd232b-4292-45c9-a91e-f326a475b30c tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:21.231108 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-56bd232b-4292-45c9-a91e-f326a475b30c tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1521 microversion: 2.1 time: 0.472177 Aug 04 16:55:21.249947 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1900/3746] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:20 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1521 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:21.266922 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ff4150c4-7aed-4b60-90cf-da933a498add tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:21.270758 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ff4150c4-7aed-4b60-90cf-da933a498add tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] [instance: 22374f24-f9d2-434f-9a38-fa08620e5032] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:21.295071 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ff4150c4-7aed-4b60-90cf-da933a498add tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:21.295971 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ff4150c4-7aed-4b60-90cf-da933a498add tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:21.301464 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ff4150c4-7aed-4b60-90cf-da933a498add tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:21.304375 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ff4150c4-7aed-4b60-90cf-da933a498add tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:21.353098 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9d5fdc7d-b0e2-4f38-b176-833928d6cb6b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:21.376957 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=12 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:21.388821 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9d5fdc7d-b0e2-4f38-b176-833928d6cb6b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854" status: 200 len: 1320 microversion: 2.1 time: 0.553564 Aug 04 16:55:21.389708 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1847/3747] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:20 2022] GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 => generated 1320 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:55:21.429674 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d139549c-c4fc-485b-8a38-0ef3dd74db7a tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:21.430284 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d139549c-c4fc-485b-8a38-0ef3dd74db7a tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:21.454961 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d139549c-c4fc-485b-8a38-0ef3dd74db7a tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:21.455410 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d139549c-c4fc-485b-8a38-0ef3dd74db7a tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:21.461489 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d139549c-c4fc-485b-8a38-0ef3dd74db7a tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:21.465237 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d139549c-c4fc-485b-8a38-0ef3dd74db7a tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:21.496350 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ff4150c4-7aed-4b60-90cf-da933a498add tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:21.514364 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ff4150c4-7aed-4b60-90cf-da933a498add tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:21.517535 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ff4150c4-7aed-4b60-90cf-da933a498add tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:21.518934 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ff4150c4-7aed-4b60-90cf-da933a498add tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] 10.222.0.23 "GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032" status: 200 len: 1366 microversion: 2.57 time: 0.266411 Aug 04 16:55:21.519505 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1901/3748] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:21 2022] GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032 => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:21.857661 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d139549c-c4fc-485b-8a38-0ef3dd74db7a tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:21.867406 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d139549c-c4fc-485b-8a38-0ef3dd74db7a tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7" status: 200 len: 1334 microversion: 2.1 time: 0.443321 Aug 04 16:55:21.877783 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1848/3749] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:21 2022] GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 => generated 1334 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:22.253744 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d899bf1b-13e0-41dd-b48c-5659485a565e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:22.259844 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d899bf1b-13e0-41dd-b48c-5659485a565e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:22.282462 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d899bf1b-13e0-41dd-b48c-5659485a565e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:22.283216 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d899bf1b-13e0-41dd-b48c-5659485a565e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:22.284288 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d899bf1b-13e0-41dd-b48c-5659485a565e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:22.284998 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d899bf1b-13e0-41dd-b48c-5659485a565e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:22.415632 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b88e11be-fcb5-4b64-9e6a-f88da0398476 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:22.416289 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b88e11be-fcb5-4b64-9e6a-f88da0398476 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:22.429217 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b88e11be-fcb5-4b64-9e6a-f88da0398476 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:22.429541 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b88e11be-fcb5-4b64-9e6a-f88da0398476 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:22.430332 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b88e11be-fcb5-4b64-9e6a-f88da0398476 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:22.430764 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b88e11be-fcb5-4b64-9e6a-f88da0398476 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:22.487124 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d899bf1b-13e0-41dd-b48c-5659485a565e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:22.498017 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d899bf1b-13e0-41dd-b48c-5659485a565e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1506 microversion: 2.1 time: 0.248226 Aug 04 16:55:22.499926 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1902/3750] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:22 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1506 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:22.524348 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9c369690-30d2-4a73-bf52-8208f6d3d642 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:22.526029 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9c369690-30d2-4a73-bf52-8208f6d3d642 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:22.537620 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c369690-30d2-4a73-bf52-8208f6d3d642 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:22.538279 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c369690-30d2-4a73-bf52-8208f6d3d642 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:22.539650 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c369690-30d2-4a73-bf52-8208f6d3d642 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:22.541464 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c369690-30d2-4a73-bf52-8208f6d3d642 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:22.575156 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=100 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:22.860925 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b88e11be-fcb5-4b64-9e6a-f88da0398476 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:22.873823 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b88e11be-fcb5-4b64-9e6a-f88da0398476 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854" status: 200 len: 1320 microversion: 2.1 time: 0.463313 Aug 04 16:55:22.874410 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1849/3751] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:22 2022] GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 => generated 1320 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:55:22.891172 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ae5c2b23-3a01-4baa-81d1-26ad4b790930 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:22.891687 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ae5c2b23-3a01-4baa-81d1-26ad4b790930 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] [instance: 22374f24-f9d2-434f-9a38-fa08620e5032] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:22.900693 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ae5c2b23-3a01-4baa-81d1-26ad4b790930 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:22.901127 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ae5c2b23-3a01-4baa-81d1-26ad4b790930 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:22.914099 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ae5c2b23-3a01-4baa-81d1-26ad4b790930 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:22.914782 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ae5c2b23-3a01-4baa-81d1-26ad4b790930 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:22.983986 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9c369690-30d2-4a73-bf52-8208f6d3d642 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:22.996963 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9c369690-30d2-4a73-bf52-8208f6d3d642 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 200 len: 1506 microversion: 2.1 time: 0.480187 Aug 04 16:55:22.998757 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1903/3752] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:22 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 1506 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:23.015240 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5c80979d-0841-4fae-9bb9-14f41b061ede tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:23.019177 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5c80979d-0841-4fae-9bb9-14f41b061ede tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:23.043590 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ae5c2b23-3a01-4baa-81d1-26ad4b790930 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:23.046703 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5c80979d-0841-4fae-9bb9-14f41b061ede tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:23.047337 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5c80979d-0841-4fae-9bb9-14f41b061ede tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:23.048287 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5c80979d-0841-4fae-9bb9-14f41b061ede tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:23.048875 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5c80979d-0841-4fae-9bb9-14f41b061ede tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:23.056370 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ae5c2b23-3a01-4baa-81d1-26ad4b790930 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:23.058079 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ae5c2b23-3a01-4baa-81d1-26ad4b790930 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:23.062064 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ae5c2b23-3a01-4baa-81d1-26ad4b790930 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] 10.222.0.23 "GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032" status: 200 len: 1366 microversion: 2.57 time: 0.186641 Aug 04 16:55:23.065894 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1850/3753] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:22 2022] GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:23.070680 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-42f45613-f091-45f1-be90-1052cc576f77 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:23.071206 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-42f45613-f091-45f1-be90-1052cc576f77 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:23.089639 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-42f45613-f091-45f1-be90-1052cc576f77 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:23.102034 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-42f45613-f091-45f1-be90-1052cc576f77 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:23.106226 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-42f45613-f091-45f1-be90-1052cc576f77 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:23.106885 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-42f45613-f091-45f1-be90-1052cc576f77 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:23.153243 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-42f45613-f091-45f1-be90-1052cc576f77 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:55:23.303530 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:23.310363 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-42f45613-f091-45f1-be90-1052cc576f77 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 204 len: 0 microversion: 2.1 time: 0.241930 Aug 04 16:55:23.311661 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1851/3754] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:55:23 2022] DELETE /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:55:23.322137 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-94dca7bd-8704-4e2e-a07d-0c95815a2145 req-7dcf9ed4-3772-444d-ab6d-031788463f93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854", "name": "network-vif-plugged", "status": "completed", "tag": "29af2bea-2dc6-47f3-8165-35426694e0f6"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:23.352790 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-94dca7bd-8704-4e2e-a07d-0c95815a2145 req-7dcf9ed4-3772-444d-ab6d-031788463f93 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:23.355789 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-94dca7bd-8704-4e2e-a07d-0c95815a2145 req-7dcf9ed4-3772-444d-ab6d-031788463f93 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:23.611112 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5c80979d-0841-4fae-9bb9-14f41b061ede tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:23.622033 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5c80979d-0841-4fae-9bb9-14f41b061ede tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7" status: 200 len: 1670 microversion: 2.1 time: 0.621464 Aug 04 16:55:23.636266 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1904/3755] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:22 2022] GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 => generated 1670 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:23.654741 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-851cad41-78b1-463b-b36a-96773daeacc7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1651529435", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "684d9347-862c-4a28-a98b-94e8785b69ab"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:23.686844 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:23.748339 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-851cad41-78b1-463b-b36a-96773daeacc7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] validate_networks() for [('684d9347-862c-4a28-a98b-94e8785b69ab', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:55:23.768236 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-94dca7bd-8704-4e2e-a07d-0c95815a2145 req-7dcf9ed4-3772-444d-ab6d-031788463f93 service nova] Creating event network-vif-plugged:29af2bea-2dc6-47f3-8165-35426694e0f6 for instance d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 on n-h1-846466-12 Aug 04 16:55:23.780331 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-94dca7bd-8704-4e2e-a07d-0c95815a2145 req-7dcf9ed4-3772-444d-ab6d-031788463f93 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.466363 Aug 04 16:55:23.786317 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1852/3756] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:23.797117 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ddbbd6f5-a889-4105-b472-7cee4878ced4 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:23.800938 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ddbbd6f5-a889-4105-b472-7cee4878ced4 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:23.814104 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ddbbd6f5-a889-4105-b472-7cee4878ced4 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:23.815210 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ddbbd6f5-a889-4105-b472-7cee4878ced4 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:23.818231 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ddbbd6f5-a889-4105-b472-7cee4878ced4 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:23.819617 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ddbbd6f5-a889-4105-b472-7cee4878ced4 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:23.865699 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ddbbd6f5-a889-4105-b472-7cee4878ced4 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7/ips" status: 200 len: 180 microversion: 2.1 time: 0.077766 Aug 04 16:55:23.866886 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1853/3757] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Aug 4 16:55:23 2022] GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7/ips => generated 180 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:23.885541 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2fda6c49-f4b0-49a2-a58a-83559d63cb19 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:23.886238 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2fda6c49-f4b0-49a2-a58a-83559d63cb19 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:23.901931 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2fda6c49-f4b0-49a2-a58a-83559d63cb19 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:23.902849 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2fda6c49-f4b0-49a2-a58a-83559d63cb19 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:23.905090 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2fda6c49-f4b0-49a2-a58a-83559d63cb19 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:23.905957 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2fda6c49-f4b0-49a2-a58a-83559d63cb19 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:23.953248 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2fda6c49-f4b0-49a2-a58a-83559d63cb19 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:55:24.083599 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2fda6c49-f4b0-49a2-a58a-83559d63cb19 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "DELETE /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7" status: 204 len: 0 microversion: 2.1 time: 0.203983 Aug 04 16:55:24.088134 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1854/3758] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:55:23 2022] DELETE /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:55:24.094983 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b45ce140-64d8-48ea-bbc4-de97ab5f1039 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:24.096250 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b45ce140-64d8-48ea-bbc4-de97ab5f1039 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:24.106510 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b45ce140-64d8-48ea-bbc4-de97ab5f1039 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:24.107231 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b45ce140-64d8-48ea-bbc4-de97ab5f1039 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:24.108256 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b45ce140-64d8-48ea-bbc4-de97ab5f1039 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:24.109133 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b45ce140-64d8-48ea-bbc4-de97ab5f1039 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:24.581308 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-851cad41-78b1-463b-b36a-96773daeacc7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:55:24.581747 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-851cad41-78b1-463b-b36a-96773daeacc7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:55:24.582254 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-851cad41-78b1-463b-b36a-96773daeacc7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:55:24.583209 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-851cad41-78b1-463b-b36a-96773daeacc7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:55:24.583626 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-851cad41-78b1-463b-b36a-96773daeacc7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:55:24.600744 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-851cad41-78b1-463b-b36a-96773daeacc7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:24.601200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-851cad41-78b1-463b-b36a-96773daeacc7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:24.602036 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-851cad41-78b1-463b-b36a-96773daeacc7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:24.602472 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-851cad41-78b1-463b-b36a-96773daeacc7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:24.642335 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-851cad41-78b1-463b-b36a-96773daeacc7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Getting quotas for project fac13585fd514c8390f32d1104a19c0d. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:55:24.645698 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b45ce140-64d8-48ea-bbc4-de97ab5f1039 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:24.658555 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-851cad41-78b1-463b-b36a-96773daeacc7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Getting quotas for user 9a7e71c772ce49388bc47daf929ab9e1 and project fac13585fd514c8390f32d1104a19c0d. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:55:24.667152 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b45ce140-64d8-48ea-bbc4-de97ab5f1039 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854" status: 200 len: 1320 microversion: 2.1 time: 0.577351 Aug 04 16:55:24.676021 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-851cad41-78b1-463b-b36a-96773daeacc7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:55:24.679104 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-851cad41-78b1-463b-b36a-96773daeacc7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:55:24.686636 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1855/3759] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:24 2022] GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 => generated 1320 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:24.691966 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d592b2ab-6890-46e6-812b-ec0ab213f705 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:24.702984 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d592b2ab-6890-46e6-812b-ec0ab213f705 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] [instance: 22374f24-f9d2-434f-9a38-fa08620e5032] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:24.727446 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d592b2ab-6890-46e6-812b-ec0ab213f705 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:24.728164 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d592b2ab-6890-46e6-812b-ec0ab213f705 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:24.728963 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d592b2ab-6890-46e6-812b-ec0ab213f705 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:24.729429 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d592b2ab-6890-46e6-812b-ec0ab213f705 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:24.776208 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-851cad41-78b1-463b-b36a-96773daeacc7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.138326 Aug 04 16:55:24.777508 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1905/3760] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:55:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1141 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:55:24.782985 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a3162aa6-de03-43ea-9e73-64b2698174bf tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:24.785655 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a3162aa6-de03-43ea-9e73-64b2698174bf tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:24.793871 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a3162aa6-de03-43ea-9e73-64b2698174bf tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:24.795353 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a3162aa6-de03-43ea-9e73-64b2698174bf tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:24.796672 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a3162aa6-de03-43ea-9e73-64b2698174bf tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:24.797621 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a3162aa6-de03-43ea-9e73-64b2698174bf tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:24.877947 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d592b2ab-6890-46e6-812b-ec0ab213f705 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:24.888936 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d592b2ab-6890-46e6-812b-ec0ab213f705 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:24.904309 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d592b2ab-6890-46e6-812b-ec0ab213f705 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:24.910266 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d592b2ab-6890-46e6-812b-ec0ab213f705 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] 10.222.0.23 "GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032" status: 200 len: 1366 microversion: 2.57 time: 0.217830 Aug 04 16:55:24.910907 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1856/3761] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:24 2022] GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:24.932357 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-047e9c21-fcfc-4c27-bf7e-7a446fee0950 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:24.932972 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-047e9c21-fcfc-4c27-bf7e-7a446fee0950 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:25.009940 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-047e9c21-fcfc-4c27-bf7e-7a446fee0950 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:25.018465 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-047e9c21-fcfc-4c27-bf7e-7a446fee0950 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1" status: 200 len: 1218 microversion: 2.1 time: 0.096030 Aug 04 16:55:25.036557 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1857/3762] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:24 2022] GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 => generated 1218 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:25.191887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a3162aa6-de03-43ea-9e73-64b2698174bf tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:25.206689 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a3162aa6-de03-43ea-9e73-64b2698174bf tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7" status: 200 len: 1676 microversion: 2.1 time: 0.424604 Aug 04 16:55:25.208498 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1906/3763] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:24 2022] GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 => generated 1676 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:25.694896 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-65bd1721-0cbc-4c9a-bc28-28dd5b199c27 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:25.695917 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-65bd1721-0cbc-4c9a-bc28-28dd5b199c27 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:25.706802 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65bd1721-0cbc-4c9a-bc28-28dd5b199c27 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:25.707257 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65bd1721-0cbc-4c9a-bc28-28dd5b199c27 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:25.709618 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65bd1721-0cbc-4c9a-bc28-28dd5b199c27 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:25.710905 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65bd1721-0cbc-4c9a-bc28-28dd5b199c27 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:25.822823 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:25.937622 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c89d824a-c704-4ba9-a0c2-041ee7ca5a02 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:25.939111 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c89d824a-c704-4ba9-a0c2-041ee7ca5a02 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] [instance: 22374f24-f9d2-434f-9a38-fa08620e5032] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:25.948306 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c89d824a-c704-4ba9-a0c2-041ee7ca5a02 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:25.949273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c89d824a-c704-4ba9-a0c2-041ee7ca5a02 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:25.950503 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c89d824a-c704-4ba9-a0c2-041ee7ca5a02 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:25.951204 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c89d824a-c704-4ba9-a0c2-041ee7ca5a02 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:26.424256 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c89d824a-c704-4ba9-a0c2-041ee7ca5a02 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:26.434510 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c89d824a-c704-4ba9-a0c2-041ee7ca5a02 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:26.456322 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c89d824a-c704-4ba9-a0c2-041ee7ca5a02 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:26.456322 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c89d824a-c704-4ba9-a0c2-041ee7ca5a02 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] 10.222.0.23 "GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032" status: 200 len: 1366 microversion: 2.57 time: 0.523015 Aug 04 16:55:26.465943 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1907/3764] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:25 2022] GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032 => generated 1366 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:55:26.480486 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2458e240-3f00-4fe2-bbc4-450b3d099189 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:26.481538 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2458e240-3f00-4fe2-bbc4-450b3d099189 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:26.499929 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2458e240-3f00-4fe2-bbc4-450b3d099189 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:26.504748 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2458e240-3f00-4fe2-bbc4-450b3d099189 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:26.505866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2458e240-3f00-4fe2-bbc4-450b3d099189 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:26.506460 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2458e240-3f00-4fe2-bbc4-450b3d099189 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:26.866616 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2458e240-3f00-4fe2-bbc4-450b3d099189 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:26.878348 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2458e240-3f00-4fe2-bbc4-450b3d099189 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1" status: 200 len: 1278 microversion: 2.1 time: 0.406352 Aug 04 16:55:26.882227 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1908/3765] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:26 2022] GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 => generated 1278 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:26.893953 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8a3d5f57-4af9-4bdb-be57-f0c71973e7c6 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:26.896119 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8a3d5f57-4af9-4bdb-be57-f0c71973e7c6 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:26.911834 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8a3d5f57-4af9-4bdb-be57-f0c71973e7c6 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:26.914002 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8a3d5f57-4af9-4bdb-be57-f0c71973e7c6 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:26.914693 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8a3d5f57-4af9-4bdb-be57-f0c71973e7c6 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:26.915130 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8a3d5f57-4af9-4bdb-be57-f0c71973e7c6 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:27.119862 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-65bd1721-0cbc-4c9a-bc28-28dd5b199c27 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:27.133834 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-65bd1721-0cbc-4c9a-bc28-28dd5b199c27 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854" status: 200 len: 1320 microversion: 2.1 time: 1.443042 Aug 04 16:55:27.135110 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1858/3766] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:25 2022] GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 => generated 1320 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:27.407027 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8a3d5f57-4af9-4bdb-be57-f0c71973e7c6 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:27.444547 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8a3d5f57-4af9-4bdb-be57-f0c71973e7c6 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7" status: 200 len: 1676 microversion: 2.1 time: 0.543854 Aug 04 16:55:27.445800 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1909/3767] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:26 2022] GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 => generated 1676 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:27.492923 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-df88ff1a-855b-471e-b4f3-88207511edc2 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:27.493575 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-df88ff1a-855b-471e-b4f3-88207511edc2 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] [instance: 22374f24-f9d2-434f-9a38-fa08620e5032] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:27.505191 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-df88ff1a-855b-471e-b4f3-88207511edc2 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:27.506183 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-df88ff1a-855b-471e-b4f3-88207511edc2 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:27.512472 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-df88ff1a-855b-471e-b4f3-88207511edc2 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:27.513230 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-df88ff1a-855b-471e-b4f3-88207511edc2 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:27.837708 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-df88ff1a-855b-471e-b4f3-88207511edc2 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:27.850083 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-df88ff1a-855b-471e-b4f3-88207511edc2 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:27.853575 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-df88ff1a-855b-471e-b4f3-88207511edc2 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:27.855085 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-df88ff1a-855b-471e-b4f3-88207511edc2 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] 10.222.0.23 "GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032" status: 200 len: 1366 microversion: 2.57 time: 0.367397 Aug 04 16:55:27.866822 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1859/3768] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:27 2022] GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032 => generated 1366 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:27.904903 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b2b936b6-8365-4ea7-972b-cac9ba47c309 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:27.906097 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b2b936b6-8365-4ea7-972b-cac9ba47c309 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:27.930654 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2b936b6-8365-4ea7-972b-cac9ba47c309 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:27.931683 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2b936b6-8365-4ea7-972b-cac9ba47c309 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:27.933030 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2b936b6-8365-4ea7-972b-cac9ba47c309 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:27.933030 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2b936b6-8365-4ea7-972b-cac9ba47c309 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:28.130056 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b2b936b6-8365-4ea7-972b-cac9ba47c309 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:28.139890 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b2b936b6-8365-4ea7-972b-cac9ba47c309 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1" status: 200 len: 1276 microversion: 2.1 time: 0.239533 Aug 04 16:55:28.141340 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1910/3769] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:27 2022] GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 => generated 1276 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:28.155787 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-190fa318-460b-4210-9127-8cafc7ee362e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:28.156398 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-190fa318-460b-4210-9127-8cafc7ee362e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:28.164877 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-190fa318-460b-4210-9127-8cafc7ee362e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:28.165650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-190fa318-460b-4210-9127-8cafc7ee362e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:28.166705 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-190fa318-460b-4210-9127-8cafc7ee362e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:28.167392 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-190fa318-460b-4210-9127-8cafc7ee362e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:28.470774 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0b9b3b68-5824-42d7-8027-c609a3e17e98 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:28.472146 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0b9b3b68-5824-42d7-8027-c609a3e17e98 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:28.487423 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0b9b3b68-5824-42d7-8027-c609a3e17e98 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:28.488325 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0b9b3b68-5824-42d7-8027-c609a3e17e98 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:28.490036 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0b9b3b68-5824-42d7-8027-c609a3e17e98 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:28.492965 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0b9b3b68-5824-42d7-8027-c609a3e17e98 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:29.791855 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-190fa318-460b-4210-9127-8cafc7ee362e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:29.808942 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-190fa318-460b-4210-9127-8cafc7ee362e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854" status: 200 len: 1501 microversion: 2.1 time: 1.652191 Aug 04 16:55:29.809927 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1860/3770] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:28 2022] GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 => generated 1501 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:29.941119 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0b9b3b68-5824-42d7-8027-c609a3e17e98 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:29.958401 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0b9b3b68-5824-42d7-8027-c609a3e17e98 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7" status: 200 len: 1655 microversion: 2.1 time: 1.494067 Aug 04 16:55:29.960085 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1911/3771] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:28 2022] GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 => generated 1655 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:29.967642 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-47319478-7bec-48a5-a45c-3cfb07b0fb02 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:29.968357 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-47319478-7bec-48a5-a45c-3cfb07b0fb02 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] [instance: 22374f24-f9d2-434f-9a38-fa08620e5032] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:29.976834 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-47319478-7bec-48a5-a45c-3cfb07b0fb02 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:29.977475 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-47319478-7bec-48a5-a45c-3cfb07b0fb02 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:29.978344 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-47319478-7bec-48a5-a45c-3cfb07b0fb02 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:29.979683 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-47319478-7bec-48a5-a45c-3cfb07b0fb02 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:30.082219 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-47319478-7bec-48a5-a45c-3cfb07b0fb02 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:30.099780 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-47319478-7bec-48a5-a45c-3cfb07b0fb02 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:30.107386 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-47319478-7bec-48a5-a45c-3cfb07b0fb02 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:30.110288 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-47319478-7bec-48a5-a45c-3cfb07b0fb02 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] 10.222.0.23 "GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032" status: 200 len: 1366 microversion: 2.57 time: 0.147804 Aug 04 16:55:30.113123 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1912/3772] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:29 2022] GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:30.123579 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-8ab48188-2482-4832-9154-bf10cb7d6d9b req-cbf305f0-7562-4d0e-91fa-5f2c60dea066 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b8c051-c8b6-47ee-966f-ad9c3c4a94d7", "name": "network-vif-deleted", "tag": "8511ad65-5a63-4792-bf48-3e6a61884e35"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:30.139021 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-8ab48188-2482-4832-9154-bf10cb7d6d9b req-cbf305f0-7562-4d0e-91fa-5f2c60dea066 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:30.139459 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-8ab48188-2482-4832-9154-bf10cb7d6d9b req-cbf305f0-7562-4d0e-91fa-5f2c60dea066 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:30.161557 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-8ab48188-2482-4832-9154-bf10cb7d6d9b req-cbf305f0-7562-4d0e-91fa-5f2c60dea066 service nova] Creating event network-vif-deleted:8511ad65-5a63-4792-bf48-3e6a61884e35 for instance 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 on n-h1-846466-12 Aug 04 16:55:30.169770 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-8ab48188-2482-4832-9154-bf10cb7d6d9b req-cbf305f0-7562-4d0e-91fa-5f2c60dea066 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054886 Aug 04 16:55:30.170584 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1913/3773] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:30.177106 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ec1434d9-1024-4e5b-b242-f8ba946eac06 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:30.178420 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ec1434d9-1024-4e5b-b242-f8ba946eac06 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:30.187188 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec1434d9-1024-4e5b-b242-f8ba946eac06 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:30.187980 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec1434d9-1024-4e5b-b242-f8ba946eac06 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:30.190035 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec1434d9-1024-4e5b-b242-f8ba946eac06 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:30.190613 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec1434d9-1024-4e5b-b242-f8ba946eac06 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:30.365205 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-411801d1-9130-4bd4-9b95-0c1d6d3317fa tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:30.365743 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-411801d1-9130-4bd4-9b95-0c1d6d3317fa tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:30.404547 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-411801d1-9130-4bd4-9b95-0c1d6d3317fa tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:30.409836 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-411801d1-9130-4bd4-9b95-0c1d6d3317fa tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:30.415937 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-411801d1-9130-4bd4-9b95-0c1d6d3317fa tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:30.416442 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-411801d1-9130-4bd4-9b95-0c1d6d3317fa tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:30.486352 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-411801d1-9130-4bd4-9b95-0c1d6d3317fa tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:55:30.639346 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ec1434d9-1024-4e5b-b242-f8ba946eac06 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:30.657723 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ec1434d9-1024-4e5b-b242-f8ba946eac06 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1" status: 200 len: 1318 microversion: 2.1 time: 0.484627 Aug 04 16:55:30.659369 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1914/3774] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:30 2022] GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 => generated 1318 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:30.661810 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-411801d1-9130-4bd4-9b95-0c1d6d3317fa tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 204 len: 0 microversion: 2.42 time: 0.847701 Aug 04 16:55:30.665702 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1861/3775] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Aug 4 16:55:29 2022] DELETE /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 0 bytes in 854 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 16:55:30.671872 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-856f5132-fda3-4bb6-b22b-081a22d97902 req-51f536d1-b076-4350-995f-cae57bcd3dd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b8c051-c8b6-47ee-966f-ad9c3c4a94d7", "name": "network-vif-unplugged", "status": "completed", "tag": "979ecb32-ee50-4784-9b30-6bd178622a78"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:30.681694 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6d0dd66b-0045-470d-aa15-0abb27a4a7c8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:30.684214 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6d0dd66b-0045-470d-aa15-0abb27a4a7c8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:30.696452 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d0dd66b-0045-470d-aa15-0abb27a4a7c8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:30.699552 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d0dd66b-0045-470d-aa15-0abb27a4a7c8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:30.701204 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d0dd66b-0045-470d-aa15-0abb27a4a7c8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:30.702225 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d0dd66b-0045-470d-aa15-0abb27a4a7c8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:30.708187 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-856f5132-fda3-4bb6-b22b-081a22d97902 req-51f536d1-b076-4350-995f-cae57bcd3dd8 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:30.708187 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-856f5132-fda3-4bb6-b22b-081a22d97902 req-51f536d1-b076-4350-995f-cae57bcd3dd8 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:30.747839 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-856f5132-fda3-4bb6-b22b-081a22d97902 req-51f536d1-b076-4350-995f-cae57bcd3dd8 service nova] Creating event network-vif-unplugged:979ecb32-ee50-4784-9b30-6bd178622a78 for instance 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 on n-h1-846466-12 Aug 04 16:55:30.760542 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-856f5132-fda3-4bb6-b22b-081a22d97902 req-51f536d1-b076-4350-995f-cae57bcd3dd8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095124 Aug 04 16:55:30.765424 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1915/3776] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:30.771350 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-987e0049-026b-4bc1-84ee-12f4596db35d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:30.777056 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-987e0049-026b-4bc1-84ee-12f4596db35d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:30.790441 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-987e0049-026b-4bc1-84ee-12f4596db35d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:30.791267 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-987e0049-026b-4bc1-84ee-12f4596db35d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:30.792208 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-987e0049-026b-4bc1-84ee-12f4596db35d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:30.792912 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-987e0049-026b-4bc1-84ee-12f4596db35d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:31.210439 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6d0dd66b-0045-470d-aa15-0abb27a4a7c8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:31.219408 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6d0dd66b-0045-470d-aa15-0abb27a4a7c8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854" status: 200 len: 1501 microversion: 2.1 time: 0.552127 Aug 04 16:55:31.234975 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1862/3777] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:30 2022] GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 => generated 1501 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:31.241498 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e7182c44-1d66-4936-a103-816d6053ad65 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:31.249631 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e7182c44-1d66-4936-a103-816d6053ad65 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:31.267386 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e7182c44-1d66-4936-a103-816d6053ad65 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:31.268092 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e7182c44-1d66-4936-a103-816d6053ad65 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:31.269208 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e7182c44-1d66-4936-a103-816d6053ad65 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:31.269758 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e7182c44-1d66-4936-a103-816d6053ad65 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:31.377038 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e7182c44-1d66-4936-a103-816d6053ad65 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:31.386775 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e7182c44-1d66-4936-a103-816d6053ad65 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7" status: 200 len: 1455 microversion: 2.1 time: 0.150372 Aug 04 16:55:31.397317 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-987e0049-026b-4bc1-84ee-12f4596db35d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:31.397862 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1863/3778] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:31 2022] GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 => generated 1455 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:31.398253 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-94c27eef-1ae7-4ead-aa27-66464be09483 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:31.401006 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-94c27eef-1ae7-4ead-aa27-66464be09483 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] [instance: 22374f24-f9d2-434f-9a38-fa08620e5032] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:31.411052 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-987e0049-026b-4bc1-84ee-12f4596db35d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:31.418726 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-94c27eef-1ae7-4ead-aa27-66464be09483 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:31.420546 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-94c27eef-1ae7-4ead-aa27-66464be09483 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:31.421503 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-94c27eef-1ae7-4ead-aa27-66464be09483 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:31.425506 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-987e0049-026b-4bc1-84ee-12f4596db35d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:31.425752 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-94c27eef-1ae7-4ead-aa27-66464be09483 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:31.427293 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-987e0049-026b-4bc1-84ee-12f4596db35d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 2955 microversion: 2.42 time: 0.660559 Aug 04 16:55:31.441640 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1916/3779] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:30 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 2955 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:31.454505 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dc940eba-fa66-4f83-882e-a2ee4e2da759 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:31.455052 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dc940eba-fa66-4f83-882e-a2ee4e2da759 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:31.480469 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dc940eba-fa66-4f83-882e-a2ee4e2da759 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:31.481185 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dc940eba-fa66-4f83-882e-a2ee4e2da759 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:31.482274 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dc940eba-fa66-4f83-882e-a2ee4e2da759 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:31.482703 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dc940eba-fa66-4f83-882e-a2ee4e2da759 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:31.525618 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dc940eba-fa66-4f83-882e-a2ee4e2da759 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:55:31.570078 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-94c27eef-1ae7-4ead-aa27-66464be09483 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:31.580333 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-94c27eef-1ae7-4ead-aa27-66464be09483 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:31.581861 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-94c27eef-1ae7-4ead-aa27-66464be09483 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:31.583056 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-94c27eef-1ae7-4ead-aa27-66464be09483 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] 10.222.0.23 "GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032" status: 200 len: 1366 microversion: 2.57 time: 0.191518 Aug 04 16:55:31.586470 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1864/3780] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:31 2022] GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:31.674134 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dc940eba-fa66-4f83-882e-a2ee4e2da759 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854" status: 204 len: 0 microversion: 2.1 time: 0.238632 Aug 04 16:55:31.677784 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1917/3781] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:55:31 2022] DELETE /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:55:31.679957 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c12b654e-ebd6-404e-af90-9a1997185ac5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:31.680665 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c12b654e-ebd6-404e-af90-9a1997185ac5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:31.687666 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c12b654e-ebd6-404e-af90-9a1997185ac5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:31.688452 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c12b654e-ebd6-404e-af90-9a1997185ac5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:31.689712 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c12b654e-ebd6-404e-af90-9a1997185ac5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:31.690265 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c12b654e-ebd6-404e-af90-9a1997185ac5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:31.693061 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5f84eb06-861d-4d1a-ab04-22be4a2991c1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:31.693798 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5f84eb06-861d-4d1a-ab04-22be4a2991c1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:31.709794 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5f84eb06-861d-4d1a-ab04-22be4a2991c1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:31.710615 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5f84eb06-861d-4d1a-ab04-22be4a2991c1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:31.711777 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5f84eb06-861d-4d1a-ab04-22be4a2991c1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:31.718301 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5f84eb06-861d-4d1a-ab04-22be4a2991c1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:32.005440 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5f84eb06-861d-4d1a-ab04-22be4a2991c1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:32.025409 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5f84eb06-861d-4d1a-ab04-22be4a2991c1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854" status: 200 len: 1507 microversion: 2.1 time: 0.344020 Aug 04 16:55:32.026735 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1918/3782] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:31 2022] GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 => generated 1507 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:32.047250 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c12b654e-ebd6-404e-af90-9a1997185ac5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:32.059000 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c12b654e-ebd6-404e-af90-9a1997185ac5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1" status: 200 len: 1318 microversion: 2.1 time: 0.382955 Aug 04 16:55:32.074686 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1865/3783] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:31 2022] GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 => generated 1318 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:32.261141 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-bd997fce-c0f3-4bf4-b9f9-7edb0ea05890 req-3cdc7c6f-1828-42ef-b978-2e38cdfa7442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0", "name": "network-vif-deleted", "tag": "b11cc5b4-996e-44be-b5e9-d3ff403d692f"}, {"server_uuid": "35b8c051-c8b6-47ee-966f-ad9c3c4a94d7", "name": "network-vif-deleted", "tag": "979ecb32-ee50-4784-9b30-6bd178622a78"}, {"name": "network-changed", "server_uuid": "14749b47-d48c-46f0-a650-27ee70f5edf1", "tag": "d1f06683-5886-4ea6-87e1-00a459987356"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:32.275936 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-bd997fce-c0f3-4bf4-b9f9-7edb0ea05890 req-3cdc7c6f-1828-42ef-b978-2e38cdfa7442 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:32.276781 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-bd997fce-c0f3-4bf4-b9f9-7edb0ea05890 req-3cdc7c6f-1828-42ef-b978-2e38cdfa7442 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:32.298338 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-bd997fce-c0f3-4bf4-b9f9-7edb0ea05890 req-3cdc7c6f-1828-42ef-b978-2e38cdfa7442 service nova] Creating event network-vif-deleted:b11cc5b4-996e-44be-b5e9-d3ff403d692f for instance 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 on n-h1-846466-12 Aug 04 16:55:32.299560 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-bd997fce-c0f3-4bf4-b9f9-7edb0ea05890 req-3cdc7c6f-1828-42ef-b978-2e38cdfa7442 service nova] Creating event network-vif-deleted:979ecb32-ee50-4784-9b30-6bd178622a78 for instance 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 on n-h1-846466-12 Aug 04 16:55:32.300118 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-bd997fce-c0f3-4bf4-b9f9-7edb0ea05890 req-3cdc7c6f-1828-42ef-b978-2e38cdfa7442 service nova] Creating event network-changed:d1f06683-5886-4ea6-87e1-00a459987356 for instance 14749b47-d48c-46f0-a650-27ee70f5edf1 on n-h2-846466-12 Aug 04 16:55:32.312743 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-bd997fce-c0f3-4bf4-b9f9-7edb0ea05890 req-3cdc7c6f-1828-42ef-b978-2e38cdfa7442 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.054849 Aug 04 16:55:32.313779 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1919/3784] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:32.411150 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-16e4e2ea-708f-4f79-ada1-48fd998c231a tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:32.411943 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-16e4e2ea-708f-4f79-ada1-48fd998c231a tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:32.419072 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-16e4e2ea-708f-4f79-ada1-48fd998c231a tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:32.419513 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-16e4e2ea-708f-4f79-ada1-48fd998c231a tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:32.420283 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-16e4e2ea-708f-4f79-ada1-48fd998c231a tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:32.420864 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-16e4e2ea-708f-4f79-ada1-48fd998c231a tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:32.459850 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-46432451-9d65-461f-b544-87b3f194702d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:32.460544 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-46432451-9d65-461f-b544-87b3f194702d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:32.472848 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46432451-9d65-461f-b544-87b3f194702d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:32.473591 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46432451-9d65-461f-b544-87b3f194702d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:32.474588 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46432451-9d65-461f-b544-87b3f194702d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:32.476230 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46432451-9d65-461f-b544-87b3f194702d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:32.501496 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-16e4e2ea-708f-4f79-ada1-48fd998c231a tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:32.513116 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-16e4e2ea-708f-4f79-ada1-48fd998c231a tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7" status: 200 len: 1455 microversion: 2.1 time: 0.106796 Aug 04 16:55:32.514503 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1866/3785] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:32 2022] GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 => generated 1455 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:32.611297 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7bf99caf-3bf8-4800-9656-458b73bceab0 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:32.612481 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7bf99caf-3bf8-4800-9656-458b73bceab0 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] [instance: 22374f24-f9d2-434f-9a38-fa08620e5032] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:32.625482 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7bf99caf-3bf8-4800-9656-458b73bceab0 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:32.626960 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7bf99caf-3bf8-4800-9656-458b73bceab0 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:32.630313 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7bf99caf-3bf8-4800-9656-458b73bceab0 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:32.631840 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7bf99caf-3bf8-4800-9656-458b73bceab0 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:32.787509 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7bf99caf-3bf8-4800-9656-458b73bceab0 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:32.806670 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7bf99caf-3bf8-4800-9656-458b73bceab0 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:32.809703 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7bf99caf-3bf8-4800-9656-458b73bceab0 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:32.818810 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7bf99caf-3bf8-4800-9656-458b73bceab0 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] 10.222.0.23 "GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032" status: 200 len: 1366 microversion: 2.57 time: 0.210437 Aug 04 16:55:32.838460 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1867/3786] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:32 2022] GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:32.911344 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-46432451-9d65-461f-b544-87b3f194702d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:32.922813 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-46432451-9d65-461f-b544-87b3f194702d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:32.925503 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-46432451-9d65-461f-b544-87b3f194702d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:32.927130 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-46432451-9d65-461f-b544-87b3f194702d tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 2955 microversion: 2.42 time: 0.472463 Aug 04 16:55:32.942181 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1920/3787] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:32 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 2955 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:55:33.049334 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-827a1138-9c46-49b1-af96-0d7e9824dd1f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:33.050454 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-827a1138-9c46-49b1-af96-0d7e9824dd1f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:33.059961 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-827a1138-9c46-49b1-af96-0d7e9824dd1f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:33.062019 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-827a1138-9c46-49b1-af96-0d7e9824dd1f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:33.063237 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-827a1138-9c46-49b1-af96-0d7e9824dd1f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:33.063666 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-827a1138-9c46-49b1-af96-0d7e9824dd1f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:33.084018 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-024d963b-1cda-4878-915c-e3380aa332af tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:33.085368 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-024d963b-1cda-4878-915c-e3380aa332af tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:33.100553 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-024d963b-1cda-4878-915c-e3380aa332af tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:33.101015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-024d963b-1cda-4878-915c-e3380aa332af tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:33.104343 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-024d963b-1cda-4878-915c-e3380aa332af tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:33.104756 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-024d963b-1cda-4878-915c-e3380aa332af tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:33.117396 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:33.483099 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-024d963b-1cda-4878-915c-e3380aa332af tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:33.505448 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-024d963b-1cda-4878-915c-e3380aa332af tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1" status: 200 len: 1318 microversion: 2.1 time: 0.424101 Aug 04 16:55:33.511602 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1921/3788] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:33 2022] GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 => generated 1318 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:55:33.522819 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-827a1138-9c46-49b1-af96-0d7e9824dd1f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:33.541518 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-555dedb1-d4d8-437a-97c4-9e9b196a5e2a tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:33.542340 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-555dedb1-d4d8-437a-97c4-9e9b196a5e2a tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:33.543973 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-827a1138-9c46-49b1-af96-0d7e9824dd1f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854" status: 200 len: 1507 microversion: 2.1 time: 0.500061 Aug 04 16:55:33.547896 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1868/3789] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:33 2022] GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 => generated 1507 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:33.553216 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-555dedb1-d4d8-437a-97c4-9e9b196a5e2a tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:33.554056 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-555dedb1-d4d8-437a-97c4-9e9b196a5e2a tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:33.555732 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-555dedb1-d4d8-437a-97c4-9e9b196a5e2a tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:33.557242 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-555dedb1-d4d8-437a-97c4-9e9b196a5e2a tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:33.794207 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-555dedb1-d4d8-437a-97c4-9e9b196a5e2a tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f7d4658f514bda8e64382fd5e42bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0ad871e21842a19511864aa9cd26c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:33.839820 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-555dedb1-d4d8-437a-97c4-9e9b196a5e2a tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7" status: 200 len: 1298 microversion: 2.1 time: 0.307835 Aug 04 16:55:33.841248 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1922/3790] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:33 2022] GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 => generated 1298 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:33.845017 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cba6ea4c-08e2-4b7e-8e62-f8b4ca3f5c2a tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:33.845733 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cba6ea4c-08e2-4b7e-8e62-f8b4ca3f5c2a tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] [instance: 22374f24-f9d2-434f-9a38-fa08620e5032] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:33.852812 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cba6ea4c-08e2-4b7e-8e62-f8b4ca3f5c2a tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:33.853308 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cba6ea4c-08e2-4b7e-8e62-f8b4ca3f5c2a tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:33.859156 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cba6ea4c-08e2-4b7e-8e62-f8b4ca3f5c2a tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:33.860265 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cba6ea4c-08e2-4b7e-8e62-f8b4ca3f5c2a tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:33.956116 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d2f43733-7467-45b4-bb23-4d19c9d3a1c7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:33.957105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d2f43733-7467-45b4-bb23-4d19c9d3a1c7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:33.968897 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d2f43733-7467-45b4-bb23-4d19c9d3a1c7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:33.969327 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d2f43733-7467-45b4-bb23-4d19c9d3a1c7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:33.988055 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d2f43733-7467-45b4-bb23-4d19c9d3a1c7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:33.989555 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d2f43733-7467-45b4-bb23-4d19c9d3a1c7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:33.996422 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cba6ea4c-08e2-4b7e-8e62-f8b4ca3f5c2a tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:34.011626 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cba6ea4c-08e2-4b7e-8e62-f8b4ca3f5c2a tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:34.015640 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cba6ea4c-08e2-4b7e-8e62-f8b4ca3f5c2a tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:34.019387 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cba6ea4c-08e2-4b7e-8e62-f8b4ca3f5c2a tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] 10.222.0.23 "GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032" status: 200 len: 1366 microversion: 2.57 time: 0.177360 Aug 04 16:55:34.020730 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1869/3791] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:33 2022] GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:34.494175 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d2f43733-7467-45b4-bb23-4d19c9d3a1c7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:34.515066 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d2f43733-7467-45b4-bb23-4d19c9d3a1c7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:34.521496 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d2f43733-7467-45b4-bb23-4d19c9d3a1c7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:34.544064 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-69dfdd45-1e6a-46fe-b869-78640dc5ecad tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:34.566471 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-69dfdd45-1e6a-46fe-b869-78640dc5ecad tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:34.579495 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d2f43733-7467-45b4-bb23-4d19c9d3a1c7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 2955 microversion: 2.42 time: 0.572905 Aug 04 16:55:34.586302 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1923/3792] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:33 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 2955 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:55:34.609547 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6a4218a1-a060-4add-a411-e70b2a5622af tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:34.610369 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6a4218a1-a060-4add-a411-e70b2a5622af tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:34.617594 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a4218a1-a060-4add-a411-e70b2a5622af tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:34.618361 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a4218a1-a060-4add-a411-e70b2a5622af tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:34.619339 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a4218a1-a060-4add-a411-e70b2a5622af tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:34.619970 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a4218a1-a060-4add-a411-e70b2a5622af tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:34.624117 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-69dfdd45-1e6a-46fe-b869-78640dc5ecad tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:34.624885 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:34.628934 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-69dfdd45-1e6a-46fe-b869-78640dc5ecad tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:34.629905 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-69dfdd45-1e6a-46fe-b869-78640dc5ecad tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:34.631035 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-69dfdd45-1e6a-46fe-b869-78640dc5ecad tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:34.673347 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:35.018450 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:35.937153 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6a4218a1-a060-4add-a411-e70b2a5622af tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:35.948508 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6a4218a1-a060-4add-a411-e70b2a5622af tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854" status: 200 len: 1507 microversion: 2.1 time: 1.360067 Aug 04 16:55:35.949457 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1924/3793] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:34 2022] GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 => generated 1507 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:35.964878 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a6cdf39e-2675-4e5e-9edf-9724e513a15f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:35.965454 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a6cdf39e-2675-4e5e-9edf-9724e513a15f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:35.974126 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6cdf39e-2675-4e5e-9edf-9724e513a15f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:35.974586 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6cdf39e-2675-4e5e-9edf-9724e513a15f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:35.977496 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6cdf39e-2675-4e5e-9edf-9724e513a15f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:35.977962 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6cdf39e-2675-4e5e-9edf-9724e513a15f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:36.000034 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-a6cdf39e-2675-4e5e-9edf-9724e513a15f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] HTTP exception thrown: Instance 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 could not be found. Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a6cdf39e-2675-4e5e-9edf-9724e513a15f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Request method failure captured: Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 HTTP/1.1 Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_l2g4KtumvV9QQUUZUrINZS8hwWh28SywFMo8l6KpFQ3BO4CjPHxGwOX5o8jJgOQOoRwDIYhrSDz6njBuvdTekquUqSiX2ItNkMLxUncmMidO9p3h5iqlPNycA5mDNVFsrpk9m7q-tkUQKfSJMbEYCUloL0JUt_MYxZnEs7Ln6JKfc Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: dc0ad871e21842a19511864aa9cd26c6 Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersTestMultiNic-1393454007 Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc0ad871e21842a19511864aa9cd26c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dc0ad871e21842a19511864aa9cd26c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc0ad871e21842a19511864aa9cd26c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dc0ad871e21842a19511864aa9cd26c6"}]}] Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersTestMultiNic-1393454007 Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: dc0ad871e21842a19511864aa9cd26c6 Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersTestMultiNic-1393454007 Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersTestMultiNic-1393454007-project Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 33f7d4658f514bda8e64382fd5e42bf1 Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersTestMultiNic-1393454007-project Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 could not be found. Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '35b8c051-c8b6-47ee-966f-ad9c3c4a94d7'} Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 could not be found. Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 could not be found. Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:36.004337 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:55:36.009191 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:36.009191 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:36.009191 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:36.009191 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:55:36.009191 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:55:36.009191 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 could not be found. Aug 04 16:55:36.009191 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:55:36.012484 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a6cdf39e-2675-4e5e-9edf-9724e513a15f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Returning 404 to user: Instance 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:36.014546 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a6cdf39e-2675-4e5e-9edf-9724e513a15f tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7" status: 404 len: 111 microversion: 2.1 time: 0.064000 Aug 04 16:55:36.015323 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1925/3794] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:35 2022] GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:55:36.025711 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7fef8abc-6361-49e9-b479-b9f3bf632150 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:36.027880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7fef8abc-6361-49e9-b479-b9f3bf632150 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] [instance: 22374f24-f9d2-434f-9a38-fa08620e5032] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:36.038033 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7fef8abc-6361-49e9-b479-b9f3bf632150 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:36.038784 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7fef8abc-6361-49e9-b479-b9f3bf632150 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:36.040718 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7fef8abc-6361-49e9-b479-b9f3bf632150 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:36.042091 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7fef8abc-6361-49e9-b479-b9f3bf632150 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:36.068111 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-69dfdd45-1e6a-46fe-b869-78640dc5ecad tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:36.096459 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-69dfdd45-1e6a-46fe-b869-78640dc5ecad tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1" status: 200 len: 1318 microversion: 2.1 time: 1.566888 Aug 04 16:55:36.120338 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1870/3795] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:34 2022] GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 => generated 1318 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:36.129718 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f92aeb71-672a-45bc-ab48-5460c86fe2c0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:36.130826 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f92aeb71-672a-45bc-ab48-5460c86fe2c0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:36.143547 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f92aeb71-672a-45bc-ab48-5460c86fe2c0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:36.146788 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f92aeb71-672a-45bc-ab48-5460c86fe2c0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:36.148098 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f92aeb71-672a-45bc-ab48-5460c86fe2c0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:36.148773 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f92aeb71-672a-45bc-ab48-5460c86fe2c0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:36.309831 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7fef8abc-6361-49e9-b479-b9f3bf632150 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:36.324463 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7fef8abc-6361-49e9-b479-b9f3bf632150 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:36.327802 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7fef8abc-6361-49e9-b479-b9f3bf632150 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:36.329071 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7fef8abc-6361-49e9-b479-b9f3bf632150 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] 10.222.0.23 "GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032" status: 200 len: 1366 microversion: 2.57 time: 0.312522 Aug 04 16:55:36.331382 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1926/3796] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:36 2022] GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032 => generated 1366 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:36.972318 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-39068bbd-8d89-49bd-95c7-5e26c64c18a4 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:36.973003 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-39068bbd-8d89-49bd-95c7-5e26c64c18a4 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:36.983332 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-39068bbd-8d89-49bd-95c7-5e26c64c18a4 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:36.983797 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-39068bbd-8d89-49bd-95c7-5e26c64c18a4 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:36.984557 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-39068bbd-8d89-49bd-95c7-5e26c64c18a4 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:36.989092 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-39068bbd-8d89-49bd-95c7-5e26c64c18a4 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:37.247236 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f92aeb71-672a-45bc-ab48-5460c86fe2c0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:37.266239 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f92aeb71-672a-45bc-ab48-5460c86fe2c0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:37.268188 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f92aeb71-672a-45bc-ab48-5460c86fe2c0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:37.272399 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f92aeb71-672a-45bc-ab48-5460c86fe2c0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 2955 microversion: 2.42 time: 1.149884 Aug 04 16:55:37.289310 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1871/3797] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:36 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 2955 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:37.294796 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-69324d94-a85f-4315-83d9-2d50f05175d1 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:37.295614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-69324d94-a85f-4315-83d9-2d50f05175d1 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:37.322323 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-69324d94-a85f-4315-83d9-2d50f05175d1 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:37.324321 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-69324d94-a85f-4315-83d9-2d50f05175d1 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:37.326034 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-69324d94-a85f-4315-83d9-2d50f05175d1 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:37.326671 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-69324d94-a85f-4315-83d9-2d50f05175d1 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:38.120103 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-69324d94-a85f-4315-83d9-2d50f05175d1 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:38.169539 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-69324d94-a85f-4315-83d9-2d50f05175d1 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1" status: 200 len: 1318 microversion: 2.1 time: 0.888339 Aug 04 16:55:38.170215 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1872/3798] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:37 2022] GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 => generated 1318 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:38.187455 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-43426df4-2e7b-47f5-8686-4bc34d3a7f24 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:38.188170 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-43426df4-2e7b-47f5-8686-4bc34d3a7f24 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] [instance: 22374f24-f9d2-434f-9a38-fa08620e5032] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:38.200546 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-43426df4-2e7b-47f5-8686-4bc34d3a7f24 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:38.201839 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-43426df4-2e7b-47f5-8686-4bc34d3a7f24 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:38.205303 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-43426df4-2e7b-47f5-8686-4bc34d3a7f24 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:38.207690 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-43426df4-2e7b-47f5-8686-4bc34d3a7f24 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:38.270928 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:38.466371 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-39068bbd-8d89-49bd-95c7-5e26c64c18a4 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:38.482405 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-39068bbd-8d89-49bd-95c7-5e26c64c18a4 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854" status: 200 len: 1507 microversion: 2.1 time: 1.509875 Aug 04 16:55:38.486158 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1927/3799] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:36 2022] GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 => generated 1507 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:38.511544 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6b45dee5-a61d-4645-ba45-8f32e677b0e7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:38.512285 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6b45dee5-a61d-4645-ba45-8f32e677b0e7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:38.528626 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6b45dee5-a61d-4645-ba45-8f32e677b0e7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:38.529082 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6b45dee5-a61d-4645-ba45-8f32e677b0e7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:38.534486 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6b45dee5-a61d-4645-ba45-8f32e677b0e7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:38.534814 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6b45dee5-a61d-4645-ba45-8f32e677b0e7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:38.600198 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-43426df4-2e7b-47f5-8686-4bc34d3a7f24 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:38.654488 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-43426df4-2e7b-47f5-8686-4bc34d3a7f24 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:38.667945 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-43426df4-2e7b-47f5-8686-4bc34d3a7f24 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:38.672319 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-43426df4-2e7b-47f5-8686-4bc34d3a7f24 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] 10.222.0.23 "GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032" status: 200 len: 1366 microversion: 2.57 time: 0.498043 Aug 04 16:55:38.675796 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1873/3800] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:38 2022] GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032 => generated 1366 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:38.699859 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-2f9fd953-bd8d-48a9-884b-9116213e4318 req-d33bf268-b56d-4bad-a76c-b55801c67f41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854", "name": "network-vif-deleted", "tag": "29af2bea-2dc6-47f3-8165-35426694e0f6"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:38.738628 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-2f9fd953-bd8d-48a9-884b-9116213e4318 req-d33bf268-b56d-4bad-a76c-b55801c67f41 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:38.740573 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-2f9fd953-bd8d-48a9-884b-9116213e4318 req-d33bf268-b56d-4bad-a76c-b55801c67f41 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:38.780899 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-2f9fd953-bd8d-48a9-884b-9116213e4318 req-d33bf268-b56d-4bad-a76c-b55801c67f41 service nova] Creating event network-vif-deleted:29af2bea-2dc6-47f3-8165-35426694e0f6 for instance d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 on n-h1-846466-12 Aug 04 16:55:38.791033 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-2f9fd953-bd8d-48a9-884b-9116213e4318 req-d33bf268-b56d-4bad-a76c-b55801c67f41 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110617 Aug 04 16:55:38.803137 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1874/3801] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:39.195354 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-055edf11-1fe8-4243-91b0-d31d1099b976 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:39.195723 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-055edf11-1fe8-4243-91b0-d31d1099b976 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:39.204304 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-055edf11-1fe8-4243-91b0-d31d1099b976 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:39.205620 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-055edf11-1fe8-4243-91b0-d31d1099b976 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:39.206648 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-055edf11-1fe8-4243-91b0-d31d1099b976 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:39.207301 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-055edf11-1fe8-4243-91b0-d31d1099b976 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:39.647335 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6b45dee5-a61d-4645-ba45-8f32e677b0e7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:39.667128 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6b45dee5-a61d-4645-ba45-8f32e677b0e7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:39.668930 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-055edf11-1fe8-4243-91b0-d31d1099b976 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:39.671019 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6b45dee5-a61d-4645-ba45-8f32e677b0e7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:39.675174 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6b45dee5-a61d-4645-ba45-8f32e677b0e7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 2955 microversion: 2.42 time: 1.184502 Aug 04 16:55:39.676200 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1928/3802] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:38 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 2955 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:39.688643 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-948b9ee4-d1e8-4c78-ba56-5c17878de172 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:39.690407 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-948b9ee4-d1e8-4c78-ba56-5c17878de172 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:39.696434 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-055edf11-1fe8-4243-91b0-d31d1099b976 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1" status: 200 len: 1318 microversion: 2.1 time: 0.506318 Aug 04 16:55:39.699241 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1875/3803] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:39 2022] GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 => generated 1318 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:55:39.715850 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-948b9ee4-d1e8-4c78-ba56-5c17878de172 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:39.716666 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-948b9ee4-d1e8-4c78-ba56-5c17878de172 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:39.717704 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-948b9ee4-d1e8-4c78-ba56-5c17878de172 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:39.718363 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-948b9ee4-d1e8-4c78-ba56-5c17878de172 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:39.722904 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3b178cec-e7f5-4556-a21f-ee8c60c9998b tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:39.723644 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3b178cec-e7f5-4556-a21f-ee8c60c9998b tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] [instance: 22374f24-f9d2-434f-9a38-fa08620e5032] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:39.735657 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-948b9ee4-d1e8-4c78-ba56-5c17878de172 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] HTTP exception thrown: Instance d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 could not be found. Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-948b9ee4-d1e8-4c78-ba56-5c17878de172 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Request method failure captured: Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 HTTP/1.1 Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_nQAsIL8Gtig2JiDfXWtIJ3WPqwL_iDK7Lzq6TGktfJLC3h9uoTgZsXj24J3msyyZQB5KWPirQK_R6x2-eYME28EQ_2bgNAh7DlNXEg7JFJsdnvAdfZMaqCmRUibanDLQxQgidHpyXwUg784UXcgxKrIZzuzT1AuaLsb_WysQnZpiA Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersTestJSON-750208524 Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa4bb1fda4ef4267829850c4c616df77"}]}] Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersTestJSON-750208524 Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersTestJSON-750208524 Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersTestJSON-750208524-project Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: db8a96da1d7943599ee6ca9df18f5148 Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersTestJSON-750208524-project Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 could not be found. Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'd752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854'} Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 could not be found. Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 could not be found. Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:55:39.738424 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:39.742079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:39.742079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:39.742079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:55:39.742079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:55:39.742079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 could not be found. Aug 04 16:55:39.742079 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:55:39.744972 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-948b9ee4-d1e8-4c78-ba56-5c17878de172 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Returning 404 to user: Instance d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:39.746806 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-948b9ee4-d1e8-4c78-ba56-5c17878de172 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854" status: 404 len: 111 microversion: 2.1 time: 0.068299 Aug 04 16:55:39.747304 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b178cec-e7f5-4556-a21f-ee8c60c9998b tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:39.747757 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b178cec-e7f5-4556-a21f-ee8c60c9998b tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:39.748078 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1929/3804] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:39 2022] GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:55:39.761420 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b178cec-e7f5-4556-a21f-ee8c60c9998b tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:39.761894 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b178cec-e7f5-4556-a21f-ee8c60c9998b tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:39.764641 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-14b97ad9-2b59-48a2-89d7-a32d74bedf00 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Action: 'create', calling method: .version_select at 0x7f7e77cbda60>, body: {"keypair": {"name": "tempest-key-1508278640", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1+S9qYhNU7XF1x/T3FYWIWlYCHmZbvzRtPNp0x53HYKpoQSbaq1aGJz3p3KIkaEtzSCCGIl+OCwJgSm1Hv9lA6dAPVlztTNukh49CBrIRByEKisOucyuO08t/GwZk7xA=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:39.785684 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-14b97ad9-2b59-48a2-89d7-a32d74bedf00 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Getting quotas for project fa4bb1fda4ef4267829850c4c616df77. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:55:39.792669 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-14b97ad9-2b59-48a2-89d7-a32d74bedf00 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Getting quotas for user db8a96da1d7943599ee6ca9df18f5148 and project fa4bb1fda4ef4267829850c4c616df77. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:55:39.859049 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-14b97ad9-2b59-48a2-89d7-a32d74bedf00 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.099328 Aug 04 16:55:39.861056 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1930/3805] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 16:55:39 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:39.873042 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ae7f63fb-d8f5-4d4a-abd6-2d2b5e16784f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '.version_select at 0x7f7e89b1dee0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:39.877837 n-d-846466-12 devstack@n-api.service[126125]: WARNING oslo_db.sqlalchemy.utils [None req-ae7f63fb-d8f5-4d4a-abd6-2d2b5e16784f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 04 16:55:39.893880 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ae7f63fb-d8f5-4d4a-abd6-2d2b5e16784f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.025700 Aug 04 16:55:39.897065 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1931/3806] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Aug 4 16:55:39 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:40.036838 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9e1c6105-91b1-497a-b4dc-e47adb2971c8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2047746473", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "key_name": "tempest-key-1508278640", "networks": [{"uuid": "b83d6df0-d970-41bd-ae99-1dfc6211d426"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:40.191123 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-9e1c6105-91b1-497a-b4dc-e47adb2971c8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] validate_networks() for [('b83d6df0-d970-41bd-ae99-1dfc6211d426', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:55:40.394954 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3b178cec-e7f5-4556-a21f-ee8c60c9998b tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:40.410948 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3b178cec-e7f5-4556-a21f-ee8c60c9998b tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:40.415348 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3b178cec-e7f5-4556-a21f-ee8c60c9998b tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:40.419397 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3b178cec-e7f5-4556-a21f-ee8c60c9998b tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] 10.222.0.23 "GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032" status: 200 len: 1366 microversion: 2.57 time: 0.714202 Aug 04 16:55:40.420264 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1876/3807] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:39 2022] GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032 => generated 1366 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:40.705049 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-361f3baf-3c4f-4258-98f4-e5e22b496116 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:40.706700 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-361f3baf-3c4f-4258-98f4-e5e22b496116 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:40.725202 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-361f3baf-3c4f-4258-98f4-e5e22b496116 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:40.730775 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-361f3baf-3c4f-4258-98f4-e5e22b496116 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:40.738977 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-361f3baf-3c4f-4258-98f4-e5e22b496116 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:40.743644 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-361f3baf-3c4f-4258-98f4-e5e22b496116 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:41.730654 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-361f3baf-3c4f-4258-98f4-e5e22b496116 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:41.746554 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-361f3baf-3c4f-4258-98f4-e5e22b496116 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:41.751022 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-361f3baf-3c4f-4258-98f4-e5e22b496116 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:41.752649 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-361f3baf-3c4f-4258-98f4-e5e22b496116 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 2934 microversion: 2.42 time: 1.054202 Aug 04 16:55:41.760990 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1877/3808] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:40 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 2934 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:41.778468 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2c9a59a2-4b12-47d8-9c7d-1735c50f0561 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:41.781661 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2c9a59a2-4b12-47d8-9c7d-1735c50f0561 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:41.797690 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2c9a59a2-4b12-47d8-9c7d-1735c50f0561 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:41.798443 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2c9a59a2-4b12-47d8-9c7d-1735c50f0561 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:41.799450 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2c9a59a2-4b12-47d8-9c7d-1735c50f0561 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:41.800230 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2c9a59a2-4b12-47d8-9c7d-1735c50f0561 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:42.524916 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-9e1c6105-91b1-497a-b4dc-e47adb2971c8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:55:42.530445 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-9e1c6105-91b1-497a-b4dc-e47adb2971c8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:55:42.531485 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-9e1c6105-91b1-497a-b4dc-e47adb2971c8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:55:42.532052 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-9e1c6105-91b1-497a-b4dc-e47adb2971c8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:55:42.532720 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-9e1c6105-91b1-497a-b4dc-e47adb2971c8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:55:42.552130 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9e1c6105-91b1-497a-b4dc-e47adb2971c8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:42.552858 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9e1c6105-91b1-497a-b4dc-e47adb2971c8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:42.554563 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9e1c6105-91b1-497a-b4dc-e47adb2971c8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:42.555927 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9e1c6105-91b1-497a-b4dc-e47adb2971c8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:42.598048 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-9e1c6105-91b1-497a-b4dc-e47adb2971c8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Getting quotas for project fa4bb1fda4ef4267829850c4c616df77. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:55:42.605057 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-9e1c6105-91b1-497a-b4dc-e47adb2971c8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Getting quotas for user db8a96da1d7943599ee6ca9df18f5148 and project fa4bb1fda4ef4267829850c4c616df77. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:55:42.624045 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9e1c6105-91b1-497a-b4dc-e47adb2971c8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:55:42.626868 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9e1c6105-91b1-497a-b4dc-e47adb2971c8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69500bda-7084-4ba9-abc9-64d6fc905b72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:55:42.677042 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:42.742736 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9e1c6105-91b1-497a-b4dc-e47adb2971c8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.710025 Aug 04 16:55:42.743944 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1932/3809] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:55:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 16:55:42.752873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-6f4c521d-2b34-4e64-9420-26a819729ed8 req-67136cfb-33ae-4fe0-b078-a7d6ee015023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e273267-ae4b-4a99-821e-1c02c3440610", "name": "network-vif-unplugged", "status": "completed", "tag": "cbcf974f-adce-4699-820a-253d13eee06d"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:42.777440 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6f4c521d-2b34-4e64-9420-26a819729ed8 req-67136cfb-33ae-4fe0-b078-a7d6ee015023 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:42.778152 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6f4c521d-2b34-4e64-9420-26a819729ed8 req-67136cfb-33ae-4fe0-b078-a7d6ee015023 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:42.833634 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-6f4c521d-2b34-4e64-9420-26a819729ed8 req-67136cfb-33ae-4fe0-b078-a7d6ee015023 service nova] Creating event network-vif-unplugged:cbcf974f-adce-4699-820a-253d13eee06d for instance 8e273267-ae4b-4a99-821e-1c02c3440610 on n-h1-846466-12 Aug 04 16:55:42.848908 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-6f4c521d-2b34-4e64-9420-26a819729ed8 req-67136cfb-33ae-4fe0-b078-a7d6ee015023 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098447 Aug 04 16:55:42.850290 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1933/3810] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:42.861701 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0e1f0768-af57-447e-b55e-7fd51cb5ee10 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:42.866630 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0e1f0768-af57-447e-b55e-7fd51cb5ee10 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] [instance: 22374f24-f9d2-434f-9a38-fa08620e5032] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:42.885555 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0e1f0768-af57-447e-b55e-7fd51cb5ee10 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:42.886005 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0e1f0768-af57-447e-b55e-7fd51cb5ee10 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:42.888672 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0e1f0768-af57-447e-b55e-7fd51cb5ee10 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:42.889372 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0e1f0768-af57-447e-b55e-7fd51cb5ee10 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:42.933821 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2c9a59a2-4b12-47d8-9c7d-1735c50f0561 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:42.945273 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2c9a59a2-4b12-47d8-9c7d-1735c50f0561 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1" status: 200 len: 1318 microversion: 2.1 time: 1.182635 Aug 04 16:55:42.946405 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1878/3811] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:41 2022] GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 => generated 1318 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:42.957900 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1bcc8302-c43b-4d09-9e33-a61042a45def tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:42.961473 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1bcc8302-c43b-4d09-9e33-a61042a45def tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69500bda-7084-4ba9-abc9-64d6fc905b72] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:43.428446 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0e1f0768-af57-447e-b55e-7fd51cb5ee10 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:43.451394 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0e1f0768-af57-447e-b55e-7fd51cb5ee10 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:43.454990 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0e1f0768-af57-447e-b55e-7fd51cb5ee10 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:43.457773 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0e1f0768-af57-447e-b55e-7fd51cb5ee10 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] 10.222.0.23 "GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032" status: 200 len: 1366 microversion: 2.57 time: 0.604945 Aug 04 16:55:43.461191 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1934/3812] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:42 2022] GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032 => generated 1366 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:43.468858 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-58432160-73c5-4380-bbda-09ef93130962 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:43.469922 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-58432160-73c5-4380-bbda-09ef93130962 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:43.479947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58432160-73c5-4380-bbda-09ef93130962 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:43.481046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58432160-73c5-4380-bbda-09ef93130962 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:43.482097 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58432160-73c5-4380-bbda-09ef93130962 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:43.482730 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58432160-73c5-4380-bbda-09ef93130962 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:43.718136 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1bcc8302-c43b-4d09-9e33-a61042a45def tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:43.725890 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1bcc8302-c43b-4d09-9e33-a61042a45def tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72" status: 200 len: 1229 microversion: 2.1 time: 0.776561 Aug 04 16:55:43.726575 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1879/3813] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:42 2022] GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72 => generated 1229 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:43.967112 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3541954f-5afe-45b2-97f2-fdaa878131fa tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:43.971329 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3541954f-5afe-45b2-97f2-fdaa878131fa tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:44.007007 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3541954f-5afe-45b2-97f2-fdaa878131fa tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:44.007458 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3541954f-5afe-45b2-97f2-fdaa878131fa tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:44.014594 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3541954f-5afe-45b2-97f2-fdaa878131fa tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:44.015288 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3541954f-5afe-45b2-97f2-fdaa878131fa tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:44.110994 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-58432160-73c5-4380-bbda-09ef93130962 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:44.129928 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-58432160-73c5-4380-bbda-09ef93130962 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:44.132321 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-58432160-73c5-4380-bbda-09ef93130962 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:44.135156 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-58432160-73c5-4380-bbda-09ef93130962 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 2913 microversion: 2.42 time: 0.671607 Aug 04 16:55:44.138631 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1935/3814] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:43 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 2913 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:44.488321 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3b771a72-6143-4471-845c-948da0078f60 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:44.489058 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3b771a72-6143-4471-845c-948da0078f60 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] [instance: 22374f24-f9d2-434f-9a38-fa08620e5032] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:44.505505 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b771a72-6143-4471-845c-948da0078f60 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:44.506069 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b771a72-6143-4471-845c-948da0078f60 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:44.507227 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b771a72-6143-4471-845c-948da0078f60 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:44.507227 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b771a72-6143-4471-845c-948da0078f60 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:44.572412 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3541954f-5afe-45b2-97f2-fdaa878131fa tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:44.584325 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3541954f-5afe-45b2-97f2-fdaa878131fa tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1" status: 200 len: 1318 microversion: 2.1 time: 0.621011 Aug 04 16:55:44.589779 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1880/3815] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:43 2022] GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 => generated 1318 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:55:44.684589 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3b771a72-6143-4471-845c-948da0078f60 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:44.700440 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3b771a72-6143-4471-845c-948da0078f60 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:44.705604 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3b771a72-6143-4471-845c-948da0078f60 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:44.707976 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3b771a72-6143-4471-845c-948da0078f60 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] 10.222.0.23 "GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032" status: 200 len: 1366 microversion: 2.57 time: 0.223841 Aug 04 16:55:44.710765 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1936/3816] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:44 2022] GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:55:44.748756 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-179d1584-409c-4c0a-8266-99bc228412b0 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:44.750778 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-179d1584-409c-4c0a-8266-99bc228412b0 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69500bda-7084-4ba9-abc9-64d6fc905b72] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:44.764317 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-179d1584-409c-4c0a-8266-99bc228412b0 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:44.766453 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-179d1584-409c-4c0a-8266-99bc228412b0 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:44.770415 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-179d1584-409c-4c0a-8266-99bc228412b0 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:44.774255 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-179d1584-409c-4c0a-8266-99bc228412b0 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:45.033861 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-179d1584-409c-4c0a-8266-99bc228412b0 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:45.052925 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-179d1584-409c-4c0a-8266-99bc228412b0 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72" status: 200 len: 1289 microversion: 2.1 time: 0.309373 Aug 04 16:55:45.073843 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-f6243f93-e526-4a83-b718-72ddc771d7e0 req-50d49f62-91ca-4225-84f6-dbc9cd1f7ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e273267-ae4b-4a99-821e-1c02c3440610", "name": "network-vif-unplugged", "status": "completed", "tag": "60a27540-9c7c-46c8-a5bc-7d1e309c4659"}, {"server_uuid": "8e273267-ae4b-4a99-821e-1c02c3440610", "name": "network-vif-unplugged", "status": "completed", "tag": "1d3e9f84-9473-48e1-a53e-66949e923559"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:45.081654 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1881/3817] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:44 2022] GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72 => generated 1289 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:45.101930 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-f6243f93-e526-4a83-b718-72ddc771d7e0 req-50d49f62-91ca-4225-84f6-dbc9cd1f7ed3 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:45.111747 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-f6243f93-e526-4a83-b718-72ddc771d7e0 req-50d49f62-91ca-4225-84f6-dbc9cd1f7ed3 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:45.166590 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1f1adafa-1a28-4a60-9cec-f69b38f318dd tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:45.167469 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1f1adafa-1a28-4a60-9cec-f69b38f318dd tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:45.172540 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-f6243f93-e526-4a83-b718-72ddc771d7e0 req-50d49f62-91ca-4225-84f6-dbc9cd1f7ed3 service nova] Creating event network-vif-unplugged:60a27540-9c7c-46c8-a5bc-7d1e309c4659 for instance 8e273267-ae4b-4a99-821e-1c02c3440610 on n-h1-846466-12 Aug 04 16:55:45.180748 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-f6243f93-e526-4a83-b718-72ddc771d7e0 req-50d49f62-91ca-4225-84f6-dbc9cd1f7ed3 service nova] Creating event network-vif-unplugged:1d3e9f84-9473-48e1-a53e-66949e923559 for instance 8e273267-ae4b-4a99-821e-1c02c3440610 on n-h1-846466-12 Aug 04 16:55:45.187062 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1f1adafa-1a28-4a60-9cec-f69b38f318dd tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:45.193364 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1f1adafa-1a28-4a60-9cec-f69b38f318dd tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:45.194682 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1f1adafa-1a28-4a60-9cec-f69b38f318dd tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:45.196191 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1f1adafa-1a28-4a60-9cec-f69b38f318dd tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:45.203236 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-f6243f93-e526-4a83-b718-72ddc771d7e0 req-50d49f62-91ca-4225-84f6-dbc9cd1f7ed3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.140739 Aug 04 16:55:45.210104 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1937/3818] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:45.610289 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8fd863ad-50dd-4140-b698-062714866e81 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:45.611012 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8fd863ad-50dd-4140-b698-062714866e81 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:45.624383 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8fd863ad-50dd-4140-b698-062714866e81 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:45.624857 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8fd863ad-50dd-4140-b698-062714866e81 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:45.626435 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8fd863ad-50dd-4140-b698-062714866e81 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:45.626915 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8fd863ad-50dd-4140-b698-062714866e81 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:46.083662 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1f1adafa-1a28-4a60-9cec-f69b38f318dd tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:46.100308 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1f1adafa-1a28-4a60-9cec-f69b38f318dd tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:46.123498 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1f1adafa-1a28-4a60-9cec-f69b38f318dd tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:46.125988 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1f1adafa-1a28-4a60-9cec-f69b38f318dd tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 2913 microversion: 2.42 time: 0.963373 Aug 04 16:55:46.132541 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1882/3819] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:45 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 2913 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:55:46.149482 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-22e2cb5e-c565-4d32-8538-f6f388c83962 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:46.150364 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-22e2cb5e-c565-4d32-8538-f6f388c83962 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] [instance: 22374f24-f9d2-434f-9a38-fa08620e5032] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:46.158908 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-22e2cb5e-c565-4d32-8538-f6f388c83962 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:46.159602 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-22e2cb5e-c565-4d32-8538-f6f388c83962 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:46.165681 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-22e2cb5e-c565-4d32-8538-f6f388c83962 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:46.166614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-22e2cb5e-c565-4d32-8538-f6f388c83962 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:47.353561 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-22e2cb5e-c565-4d32-8538-f6f388c83962 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:47.369690 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-22e2cb5e-c565-4d32-8538-f6f388c83962 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:47.378750 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-22e2cb5e-c565-4d32-8538-f6f388c83962 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:47.379991 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-22e2cb5e-c565-4d32-8538-f6f388c83962 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] 10.222.0.23 "GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032" status: 200 len: 1372 microversion: 2.57 time: 1.246017 Aug 04 16:55:47.394454 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1883/3820] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:46 2022] GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032 => generated 1372 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:47.417494 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e835f61a-7ea3-44d7-89b5-0930e2219804 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:47.418398 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e835f61a-7ea3-44d7-89b5-0930e2219804 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69500bda-7084-4ba9-abc9-64d6fc905b72] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:47.429109 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e835f61a-7ea3-44d7-89b5-0930e2219804 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:47.435549 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e835f61a-7ea3-44d7-89b5-0930e2219804 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:47.436642 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e835f61a-7ea3-44d7-89b5-0930e2219804 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:47.437333 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e835f61a-7ea3-44d7-89b5-0930e2219804 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:47.589770 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8fd863ad-50dd-4140-b698-062714866e81 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:47.592118 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e835f61a-7ea3-44d7-89b5-0930e2219804 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:47.604044 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8fd863ad-50dd-4140-b698-062714866e81 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1" status: 200 len: 1318 microversion: 2.1 time: 1.997991 Aug 04 16:55:47.606315 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e835f61a-7ea3-44d7-89b5-0930e2219804 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72" status: 200 len: 1287 microversion: 2.1 time: 0.210208 Aug 04 16:55:47.608312 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1938/3821] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:45 2022] GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 => generated 1318 bytes in 2005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:47.620939 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1884/3822] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:47 2022] GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72 => generated 1287 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:47.625801 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8ca3001a-b6ce-4394-884b-b1b512eb80e8 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:47.626183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8ca3001a-b6ce-4394-884b-b1b512eb80e8 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:47.632446 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a253b84f-1c8d-463e-bb17-65e16fd638ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:47.633246 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a253b84f-1c8d-463e-bb17-65e16fd638ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:47.644841 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8ca3001a-b6ce-4394-884b-b1b512eb80e8 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:47.645324 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8ca3001a-b6ce-4394-884b-b1b512eb80e8 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:47.646088 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8ca3001a-b6ce-4394-884b-b1b512eb80e8 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:47.647207 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a253b84f-1c8d-463e-bb17-65e16fd638ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:47.653194 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8ca3001a-b6ce-4394-884b-b1b512eb80e8 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:47.654144 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a253b84f-1c8d-463e-bb17-65e16fd638ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:47.655167 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a253b84f-1c8d-463e-bb17-65e16fd638ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:47.655766 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a253b84f-1c8d-463e-bb17-65e16fd638ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:47.691920 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-8ca3001a-b6ce-4394-884b-b1b512eb80e8 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] HTTP exception thrown: Instance 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 could not be found. Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8ca3001a-b6ce-4394-884b-b1b512eb80e8 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Request method failure captured: Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 HTTP/1.1 Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_l2g4KtumvV9QQUUZUrINZS8hwWh28SywFMo8l6KpFQ3BO4CjPHxGwOX5o8jJgOQOoRwDIYhrSDz6njBuvdTekquUqSiX2ItNkMLxUncmMidO9p3h5iqlPNycA5mDNVFsrpk9m7q-tkUQKfSJMbEYCUloL0JUt_MYxZnEs7Ln6JKfc Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: dc0ad871e21842a19511864aa9cd26c6 Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersTestMultiNic-1393454007 Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc0ad871e21842a19511864aa9cd26c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dc0ad871e21842a19511864aa9cd26c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc0ad871e21842a19511864aa9cd26c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dc0ad871e21842a19511864aa9cd26c6"}]}] Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersTestMultiNic-1393454007 Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: dc0ad871e21842a19511864aa9cd26c6 Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersTestMultiNic-1393454007 Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersTestMultiNic-1393454007-project Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 33f7d4658f514bda8e64382fd5e42bf1 Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersTestMultiNic-1393454007-project Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 could not be found. Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '35b8c051-c8b6-47ee-966f-ad9c3c4a94d7'} Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 could not be found. Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:55:47.695035 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:55:47.699140 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 could not be found. Aug 04 16:55:47.699140 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:55:47.699140 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:47.699140 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:55:47.699140 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:47.699140 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:47.699140 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:47.699140 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:55:47.699140 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:55:47.699140 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 could not be found. Aug 04 16:55:47.699140 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:55:47.702071 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8ca3001a-b6ce-4394-884b-b1b512eb80e8 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Returning 404 to user: Instance 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:47.705221 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8ca3001a-b6ce-4394-884b-b1b512eb80e8 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "DELETE /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7" status: 404 len: 111 microversion: 2.1 time: 0.093091 Aug 04 16:55:47.705738 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1939/3823] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:55:47 2022] DELETE /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:55:47.712331 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-04271d3b-07c9-4f41-bc37-bc78a5b9a2f5 req-007e17f2-a877-4060-bbc8-1c56dc34ac06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14749b47-d48c-46f0-a650-27ee70f5edf1", "name": "network-vif-plugged", "status": "completed", "tag": "d1f06683-5886-4ea6-87e1-00a459987356"}, {"server_uuid": "8e273267-ae4b-4a99-821e-1c02c3440610", "name": "network-vif-unplugged", "status": "completed", "tag": "43dba39e-c390-493c-9f63-1beb4d7fbdf4"}, {"server_uuid": "8e273267-ae4b-4a99-821e-1c02c3440610", "name": "network-vif-unplugged", "status": "completed", "tag": "1155cb3d-57af-4e24-82ea-543e08adca46"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:47.732555 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-04271d3b-07c9-4f41-bc37-bc78a5b9a2f5 req-007e17f2-a877-4060-bbc8-1c56dc34ac06 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:47.734455 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-04271d3b-07c9-4f41-bc37-bc78a5b9a2f5 req-007e17f2-a877-4060-bbc8-1c56dc34ac06 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:47.754331 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-04271d3b-07c9-4f41-bc37-bc78a5b9a2f5 req-007e17f2-a877-4060-bbc8-1c56dc34ac06 service nova] Creating event network-vif-plugged:d1f06683-5886-4ea6-87e1-00a459987356 for instance 14749b47-d48c-46f0-a650-27ee70f5edf1 on n-h2-846466-12 Aug 04 16:55:47.755232 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-04271d3b-07c9-4f41-bc37-bc78a5b9a2f5 req-007e17f2-a877-4060-bbc8-1c56dc34ac06 service nova] Creating event network-vif-unplugged:43dba39e-c390-493c-9f63-1beb4d7fbdf4 for instance 8e273267-ae4b-4a99-821e-1c02c3440610 on n-h1-846466-12 Aug 04 16:55:47.756307 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-04271d3b-07c9-4f41-bc37-bc78a5b9a2f5 req-007e17f2-a877-4060-bbc8-1c56dc34ac06 service nova] Creating event network-vif-unplugged:1155cb3d-57af-4e24-82ea-543e08adca46 for instance 8e273267-ae4b-4a99-821e-1c02c3440610 on n-h1-846466-12 Aug 04 16:55:47.783107 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-04271d3b-07c9-4f41-bc37-bc78a5b9a2f5 req-007e17f2-a877-4060-bbc8-1c56dc34ac06 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 529 microversion: 2.1 time: 0.076001 Aug 04 16:55:47.787843 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1940/3824] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 529 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:47.812037 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7a245985-3f6c-4080-8973-e5db52897a49 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:47.812952 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7a245985-3f6c-4080-8973-e5db52897a49 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:47.836423 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a245985-3f6c-4080-8973-e5db52897a49 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:47.852729 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a245985-3f6c-4080-8973-e5db52897a49 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:47.854355 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a245985-3f6c-4080-8973-e5db52897a49 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:47.856144 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a245985-3f6c-4080-8973-e5db52897a49 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:47.907734 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-7a245985-3f6c-4080-8973-e5db52897a49 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] HTTP exception thrown: Instance 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 could not be found. Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7a245985-3f6c-4080-8973-e5db52897a49 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Request method failure captured: Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 HTTP/1.1 Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_l2g4KtumvV9QQUUZUrINZS8hwWh28SywFMo8l6KpFQ3BO4CjPHxGwOX5o8jJgOQOoRwDIYhrSDz6njBuvdTekquUqSiX2ItNkMLxUncmMidO9p3h5iqlPNycA5mDNVFsrpk9m7q-tkUQKfSJMbEYCUloL0JUt_MYxZnEs7Ln6JKfc Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: dc0ad871e21842a19511864aa9cd26c6 Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersTestMultiNic-1393454007 Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc0ad871e21842a19511864aa9cd26c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dc0ad871e21842a19511864aa9cd26c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc0ad871e21842a19511864aa9cd26c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dc0ad871e21842a19511864aa9cd26c6"}]}] Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersTestMultiNic-1393454007 Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: dc0ad871e21842a19511864aa9cd26c6 Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersTestMultiNic-1393454007 Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersTestMultiNic-1393454007-project Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 33f7d4658f514bda8e64382fd5e42bf1 Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersTestMultiNic-1393454007-project Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 could not be found. Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '35b8c051-c8b6-47ee-966f-ad9c3c4a94d7'} Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 could not be found. Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 could not be found. Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:47.910517 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:55:47.914222 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:47.914222 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:47.914222 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:47.914222 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:55:47.914222 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:55:47.914222 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 could not be found. Aug 04 16:55:47.914222 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:55:47.919290 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7a245985-3f6c-4080-8973-e5db52897a49 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Returning 404 to user: Instance 35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:47.922955 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7a245985-3f6c-4080-8973-e5db52897a49 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7" status: 404 len: 111 microversion: 2.1 time: 0.132198 Aug 04 16:55:47.926582 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1941/3825] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:47 2022] GET /compute/v2.1/servers/35b8c051-c8b6-47ee-966f-ad9c3c4a94d7 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:55:47.937153 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f44ff4a2-074d-40ba-8aae-e76794d2b0eb tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:47.943950 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f44ff4a2-074d-40ba-8aae-e76794d2b0eb tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:47.962739 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f44ff4a2-074d-40ba-8aae-e76794d2b0eb tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:47.964718 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f44ff4a2-074d-40ba-8aae-e76794d2b0eb tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:47.969716 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f44ff4a2-074d-40ba-8aae-e76794d2b0eb tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:47.970653 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f44ff4a2-074d-40ba-8aae-e76794d2b0eb tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:48.001796 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-f44ff4a2-074d-40ba-8aae-e76794d2b0eb tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] HTTP exception thrown: Instance 329e3811-2d1f-43ac-8c22-c2675ae6b9b8 could not be found. Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f44ff4a2-074d-40ba-8aae-e76794d2b0eb tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Request method failure captured: Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 HTTP/1.1 Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_l2g4KtumvV9QQUUZUrINZS8hwWh28SywFMo8l6KpFQ3BO4CjPHxGwOX5o8jJgOQOoRwDIYhrSDz6njBuvdTekquUqSiX2ItNkMLxUncmMidO9p3h5iqlPNycA5mDNVFsrpk9m7q-tkUQKfSJMbEYCUloL0JUt_MYxZnEs7Ln6JKfc Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: dc0ad871e21842a19511864aa9cd26c6 Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersTestMultiNic-1393454007 Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc0ad871e21842a19511864aa9cd26c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dc0ad871e21842a19511864aa9cd26c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc0ad871e21842a19511864aa9cd26c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dc0ad871e21842a19511864aa9cd26c6"}]}] Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersTestMultiNic-1393454007 Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: dc0ad871e21842a19511864aa9cd26c6 Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersTestMultiNic-1393454007 Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersTestMultiNic-1393454007-project Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 33f7d4658f514bda8e64382fd5e42bf1 Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersTestMultiNic-1393454007-project Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 329e3811-2d1f-43ac-8c22-c2675ae6b9b8 could not be found. Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '329e3811-2d1f-43ac-8c22-c2675ae6b9b8'} Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 329e3811-2d1f-43ac-8c22-c2675ae6b9b8 could not be found. Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:55:48.004083 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:55:48.007467 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 329e3811-2d1f-43ac-8c22-c2675ae6b9b8 could not be found. Aug 04 16:55:48.007467 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:55:48.007467 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:48.007467 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:55:48.007467 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:48.007467 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:48.007467 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:48.007467 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:55:48.007467 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:55:48.007467 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 329e3811-2d1f-43ac-8c22-c2675ae6b9b8 could not be found. Aug 04 16:55:48.007467 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:55:48.010032 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f44ff4a2-074d-40ba-8aae-e76794d2b0eb tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Returning 404 to user: Instance 329e3811-2d1f-43ac-8c22-c2675ae6b9b8 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:48.011213 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f44ff4a2-074d-40ba-8aae-e76794d2b0eb tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "DELETE /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 404 len: 111 microversion: 2.1 time: 0.082509 Aug 04 16:55:48.012288 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1942/3826] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:55:47 2022] DELETE /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:55:48.028043 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6627f67b-e3fd-4013-b911-43ba399a8091 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:48.029772 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6627f67b-e3fd-4013-b911-43ba399a8091 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] [instance: 329e3811-2d1f-43ac-8c22-c2675ae6b9b8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:48.039675 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6627f67b-e3fd-4013-b911-43ba399a8091 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:48.040948 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6627f67b-e3fd-4013-b911-43ba399a8091 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:48.041986 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6627f67b-e3fd-4013-b911-43ba399a8091 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:48.042603 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6627f67b-e3fd-4013-b911-43ba399a8091 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:48.066913 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-6627f67b-e3fd-4013-b911-43ba399a8091 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] HTTP exception thrown: Instance 329e3811-2d1f-43ac-8c22-c2675ae6b9b8 could not be found. Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6627f67b-e3fd-4013-b911-43ba399a8091 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Request method failure captured: Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 HTTP/1.1 Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_l2g4KtumvV9QQUUZUrINZS8hwWh28SywFMo8l6KpFQ3BO4CjPHxGwOX5o8jJgOQOoRwDIYhrSDz6njBuvdTekquUqSiX2ItNkMLxUncmMidO9p3h5iqlPNycA5mDNVFsrpk9m7q-tkUQKfSJMbEYCUloL0JUt_MYxZnEs7Ln6JKfc Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: dc0ad871e21842a19511864aa9cd26c6 Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersTestMultiNic-1393454007 Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc0ad871e21842a19511864aa9cd26c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dc0ad871e21842a19511864aa9cd26c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc0ad871e21842a19511864aa9cd26c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dc0ad871e21842a19511864aa9cd26c6"}]}] Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersTestMultiNic-1393454007 Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: dc0ad871e21842a19511864aa9cd26c6 Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersTestMultiNic-1393454007 Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersTestMultiNic-1393454007-project Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 33f7d4658f514bda8e64382fd5e42bf1 Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersTestMultiNic-1393454007-project Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 329e3811-2d1f-43ac-8c22-c2675ae6b9b8 could not be found. Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '329e3811-2d1f-43ac-8c22-c2675ae6b9b8'} Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 329e3811-2d1f-43ac-8c22-c2675ae6b9b8 could not be found. Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 329e3811-2d1f-43ac-8c22-c2675ae6b9b8 could not be found. Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:48.070360 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:55:48.075223 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:48.075223 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:48.075223 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:48.075223 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:55:48.075223 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:55:48.075223 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 329e3811-2d1f-43ac-8c22-c2675ae6b9b8 could not be found. Aug 04 16:55:48.075223 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:55:48.077347 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6627f67b-e3fd-4013-b911-43ba399a8091 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] Returning 404 to user: Instance 329e3811-2d1f-43ac-8c22-c2675ae6b9b8 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:48.079092 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6627f67b-e3fd-4013-b911-43ba399a8091 tempest-ServersTestMultiNic-1393454007 tempest-ServersTestMultiNic-1393454007-project] 10.222.0.23 "GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8" status: 404 len: 111 microversion: 2.1 time: 0.055978 Aug 04 16:55:48.084316 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1943/3827] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:48 2022] GET /compute/v2.1/servers/329e3811-2d1f-43ac-8c22-c2675ae6b9b8 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:55:48.336813 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a253b84f-1c8d-463e-bb17-65e16fd638ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:48.355309 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a253b84f-1c8d-463e-bb17-65e16fd638ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:48.356454 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a253b84f-1c8d-463e-bb17-65e16fd638ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:48.366847 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a253b84f-1c8d-463e-bb17-65e16fd638ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 2867 microversion: 2.42 time: 0.742459 Aug 04 16:55:48.377828 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1885/3828] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:47 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 2867 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:48.408409 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e8c2e765-82e5-4e68-bb90-ea81a49e11b5 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:48.409160 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e8c2e765-82e5-4e68-bb90-ea81a49e11b5 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] [instance: 22374f24-f9d2-434f-9a38-fa08620e5032] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:48.421459 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e8c2e765-82e5-4e68-bb90-ea81a49e11b5 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:48.421916 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e8c2e765-82e5-4e68-bb90-ea81a49e11b5 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:48.422712 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e8c2e765-82e5-4e68-bb90-ea81a49e11b5 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:48.423145 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e8c2e765-82e5-4e68-bb90-ea81a49e11b5 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:48.629239 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c599a6b6-671f-421f-aaa2-ad7aa176300c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:48.629893 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c599a6b6-671f-421f-aaa2-ad7aa176300c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69500bda-7084-4ba9-abc9-64d6fc905b72] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:48.641906 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c599a6b6-671f-421f-aaa2-ad7aa176300c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:48.642583 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c599a6b6-671f-421f-aaa2-ad7aa176300c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:48.645341 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c599a6b6-671f-421f-aaa2-ad7aa176300c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:48.651800 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c599a6b6-671f-421f-aaa2-ad7aa176300c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:48.800567 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e8c2e765-82e5-4e68-bb90-ea81a49e11b5 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:48.818641 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e8c2e765-82e5-4e68-bb90-ea81a49e11b5 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:48.821267 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e8c2e765-82e5-4e68-bb90-ea81a49e11b5 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:48.826612 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e8c2e765-82e5-4e68-bb90-ea81a49e11b5 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] 10.222.0.23 "GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032" status: 200 len: 1357 microversion: 2.57 time: 0.422436 Aug 04 16:55:48.828093 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1944/3829] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:48 2022] GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032 => generated 1357 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:48.836567 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1b7d4030-10d7-438e-bbdf-c589564ea452 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:48.837790 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1b7d4030-10d7-438e-bbdf-c589564ea452 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:48.874977 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1b7d4030-10d7-438e-bbdf-c589564ea452 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:48.875362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1b7d4030-10d7-438e-bbdf-c589564ea452 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:48.877551 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1b7d4030-10d7-438e-bbdf-c589564ea452 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:48.877551 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1b7d4030-10d7-438e-bbdf-c589564ea452 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:49.279029 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c599a6b6-671f-421f-aaa2-ad7aa176300c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:49.297499 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c599a6b6-671f-421f-aaa2-ad7aa176300c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72" status: 200 len: 1329 microversion: 2.1 time: 0.672643 Aug 04 16:55:49.302936 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1886/3830] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:48 2022] GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72 => generated 1329 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:49.313566 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-5b57ef59-87e1-4b26-9fce-9243b514a6ed req-035040d8-520e-4806-b188-180bd4e70318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e273267-ae4b-4a99-821e-1c02c3440610", "name": "network-vif-deleted", "tag": "cbcf974f-adce-4699-820a-253d13eee06d"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:49.325772 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1b7d4030-10d7-438e-bbdf-c589564ea452 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:49.333574 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-5b57ef59-87e1-4b26-9fce-9243b514a6ed req-035040d8-520e-4806-b188-180bd4e70318 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:49.333574 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-5b57ef59-87e1-4b26-9fce-9243b514a6ed req-035040d8-520e-4806-b188-180bd4e70318 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:49.342186 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1b7d4030-10d7-438e-bbdf-c589564ea452 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1" status: 200 len: 1318 microversion: 2.1 time: 0.511975 Aug 04 16:55:49.342787 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1945/3831] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:48 2022] GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 => generated 1318 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:49.347580 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-675666b6-1abd-4e0a-9653-e0a9b734b11f tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:49.348077 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-675666b6-1abd-4e0a-9653-e0a9b734b11f tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] [instance: 22374f24-f9d2-434f-9a38-fa08620e5032] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:49.369324 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-675666b6-1abd-4e0a-9653-e0a9b734b11f tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:49.369813 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-675666b6-1abd-4e0a-9653-e0a9b734b11f tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:49.370608 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-675666b6-1abd-4e0a-9653-e0a9b734b11f tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:49.371039 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-675666b6-1abd-4e0a-9653-e0a9b734b11f tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:49.379800 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-5b57ef59-87e1-4b26-9fce-9243b514a6ed req-035040d8-520e-4806-b188-180bd4e70318 service nova] Creating event network-vif-deleted:cbcf974f-adce-4699-820a-253d13eee06d for instance 8e273267-ae4b-4a99-821e-1c02c3440610 on n-h1-846466-12 Aug 04 16:55:49.400022 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-5b57ef59-87e1-4b26-9fce-9243b514a6ed req-035040d8-520e-4806-b188-180bd4e70318 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093521 Aug 04 16:55:49.401251 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1887/3832] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:49.410281 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=100 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:49.422541 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7c9683f5-e910-4ba9-8bfb-20d3fd2e96d5 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:49.423685 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7c9683f5-e910-4ba9-8bfb-20d3fd2e96d5 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:49.435062 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-675666b6-1abd-4e0a-9653-e0a9b734b11f tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] [instance: 22374f24-f9d2-434f-9a38-fa08620e5032] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:55:49.436361 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7c9683f5-e910-4ba9-8bfb-20d3fd2e96d5 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:49.439017 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7c9683f5-e910-4ba9-8bfb-20d3fd2e96d5 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:49.440262 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7c9683f5-e910-4ba9-8bfb-20d3fd2e96d5 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:49.440929 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7c9683f5-e910-4ba9-8bfb-20d3fd2e96d5 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:49.660313 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-675666b6-1abd-4e0a-9653-e0a9b734b11f tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] 10.222.0.23 "DELETE /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032" status: 204 len: 0 microversion: 2.57 time: 0.313193 Aug 04 16:55:49.661361 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1946/3833] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Aug 4 16:55:49 2022] DELETE /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 16:55:49.686463 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1ffe87da-e400-487b-b94f-e23386e1ce28 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:49.690279 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1ffe87da-e400-487b-b94f-e23386e1ce28 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] [instance: 22374f24-f9d2-434f-9a38-fa08620e5032] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:49.715083 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1ffe87da-e400-487b-b94f-e23386e1ce28 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:49.716371 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1ffe87da-e400-487b-b94f-e23386e1ce28 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:49.722126 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1ffe87da-e400-487b-b94f-e23386e1ce28 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:49.728222 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1ffe87da-e400-487b-b94f-e23386e1ce28 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:50.005341 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1ffe87da-e400-487b-b94f-e23386e1ce28 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:50.007901 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7c9683f5-e910-4ba9-8bfb-20d3fd2e96d5 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:50.019834 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1ffe87da-e400-487b-b94f-e23386e1ce28 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:50.021970 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1ffe87da-e400-487b-b94f-e23386e1ce28 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:50.023505 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1ffe87da-e400-487b-b94f-e23386e1ce28 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] 10.222.0.23 "GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032" status: 200 len: 1363 microversion: 2.57 time: 0.355497 Aug 04 16:55:50.024416 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1947/3834] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:49 2022] GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032 => generated 1363 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:50.025170 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7c9683f5-e910-4ba9-8bfb-20d3fd2e96d5 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:50.026792 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7c9683f5-e910-4ba9-8bfb-20d3fd2e96d5 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:50.039224 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7c9683f5-e910-4ba9-8bfb-20d3fd2e96d5 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 2576 microversion: 2.42 time: 0.636468 Aug 04 16:55:50.040070 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1888/3835] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:49 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 2576 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:50.324461 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d4a3c595-6ceb-4953-af4d-27198596d905 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:50.325083 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d4a3c595-6ceb-4953-af4d-27198596d905 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69500bda-7084-4ba9-abc9-64d6fc905b72] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:50.332053 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d4a3c595-6ceb-4953-af4d-27198596d905 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:50.332497 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d4a3c595-6ceb-4953-af4d-27198596d905 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:50.333322 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d4a3c595-6ceb-4953-af4d-27198596d905 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:50.333729 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d4a3c595-6ceb-4953-af4d-27198596d905 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:50.374810 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-eb70ca9f-e1e5-4a56-b0a3-9317fb1f8c51 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:50.375754 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-eb70ca9f-e1e5-4a56-b0a3-9317fb1f8c51 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:50.392993 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eb70ca9f-e1e5-4a56-b0a3-9317fb1f8c51 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:50.393846 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eb70ca9f-e1e5-4a56-b0a3-9317fb1f8c51 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:50.394296 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eb70ca9f-e1e5-4a56-b0a3-9317fb1f8c51 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:50.398695 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eb70ca9f-e1e5-4a56-b0a3-9317fb1f8c51 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:50.889808 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d4a3c595-6ceb-4953-af4d-27198596d905 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:50.897586 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d4a3c595-6ceb-4953-af4d-27198596d905 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72" status: 200 len: 1329 microversion: 2.1 time: 0.577273 Aug 04 16:55:50.910129 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1948/3836] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:50 2022] GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72 => generated 1329 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:50.961387 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-eb70ca9f-e1e5-4a56-b0a3-9317fb1f8c51 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:50.975720 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-eb70ca9f-e1e5-4a56-b0a3-9317fb1f8c51 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1" status: 200 len: 1509 microversion: 2.1 time: 0.606838 Aug 04 16:55:50.976319 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1889/3837] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:50 2022] GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 => generated 1509 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:55:50.997462 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bfb7e480-71e3-4167-9a2a-9643774d94f6 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:50.998269 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bfb7e480-71e3-4167-9a2a-9643774d94f6 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:51.016023 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bfb7e480-71e3-4167-9a2a-9643774d94f6 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:51.017361 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bfb7e480-71e3-4167-9a2a-9643774d94f6 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:51.018392 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bfb7e480-71e3-4167-9a2a-9643774d94f6 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:51.018987 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bfb7e480-71e3-4167-9a2a-9643774d94f6 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:51.048446 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6d4bbb80-059b-4380-97b4-befc90b3bd2a tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:51.049371 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6d4bbb80-059b-4380-97b4-befc90b3bd2a tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] [instance: 22374f24-f9d2-434f-9a38-fa08620e5032] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:51.061005 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d4bbb80-059b-4380-97b4-befc90b3bd2a tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:51.061485 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d4bbb80-059b-4380-97b4-befc90b3bd2a tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:51.062280 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d4bbb80-059b-4380-97b4-befc90b3bd2a tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:51.062715 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d4bbb80-059b-4380-97b4-befc90b3bd2a tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:51.223452 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6d4bbb80-059b-4380-97b4-befc90b3bd2a tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:51.239253 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6d4bbb80-059b-4380-97b4-befc90b3bd2a tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:51.241499 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6d4bbb80-059b-4380-97b4-befc90b3bd2a tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bd94200a6b94531b8ea725981c9a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b081621f384220a8becdeeb0bfd3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:51.242729 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6d4bbb80-059b-4380-97b4-befc90b3bd2a tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] 10.222.0.23 "GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032" status: 200 len: 1363 microversion: 2.57 time: 0.199611 Aug 04 16:55:51.243451 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1890/3838] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:51 2022] GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032 => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:55:51.248680 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5230212b-ec5c-4a79-9be8-4ed007c2a9ff tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:51.249556 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5230212b-ec5c-4a79-9be8-4ed007c2a9ff tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:51.256843 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5230212b-ec5c-4a79-9be8-4ed007c2a9ff tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:51.258244 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5230212b-ec5c-4a79-9be8-4ed007c2a9ff tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:51.259239 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5230212b-ec5c-4a79-9be8-4ed007c2a9ff tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:51.259830 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5230212b-ec5c-4a79-9be8-4ed007c2a9ff tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:51.506271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bfb7e480-71e3-4167-9a2a-9643774d94f6 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:51.515388 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bfb7e480-71e3-4167-9a2a-9643774d94f6 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1" status: 200 len: 1509 microversion: 2.1 time: 0.522449 Aug 04 16:55:51.530913 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1949/3839] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:50 2022] GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 => generated 1509 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:51.539713 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-fa6b2bfa-b6ef-4a01-ba39-bea22ca03c93 req-42198fd1-5c7c-49f6-8add-f52f42044b97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e273267-ae4b-4a99-821e-1c02c3440610", "name": "network-vif-deleted", "tag": "43dba39e-c390-493c-9f63-1beb4d7fbdf4"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:51.551399 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-fa6b2bfa-b6ef-4a01-ba39-bea22ca03c93 req-42198fd1-5c7c-49f6-8add-f52f42044b97 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:51.552143 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-fa6b2bfa-b6ef-4a01-ba39-bea22ca03c93 req-42198fd1-5c7c-49f6-8add-f52f42044b97 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:51.569464 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-fa6b2bfa-b6ef-4a01-ba39-bea22ca03c93 req-42198fd1-5c7c-49f6-8add-f52f42044b97 service nova] Creating event network-vif-deleted:43dba39e-c390-493c-9f63-1beb4d7fbdf4 for instance 8e273267-ae4b-4a99-821e-1c02c3440610 on n-h1-846466-12 Aug 04 16:55:51.575741 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-fa6b2bfa-b6ef-4a01-ba39-bea22ca03c93 req-42198fd1-5c7c-49f6-8add-f52f42044b97 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043081 Aug 04 16:55:51.576789 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1950/3840] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:51.583951 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-68fc64aa-2a00-4c70-88d1-e562d2bb3645 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:51.586630 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-68fc64aa-2a00-4c70-88d1-e562d2bb3645 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:51.593598 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-68fc64aa-2a00-4c70-88d1-e562d2bb3645 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:51.594040 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-68fc64aa-2a00-4c70-88d1-e562d2bb3645 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:51.595532 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-68fc64aa-2a00-4c70-88d1-e562d2bb3645 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:51.597367 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-68fc64aa-2a00-4c70-88d1-e562d2bb3645 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:51.689331 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5230212b-ec5c-4a79-9be8-4ed007c2a9ff tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:51.702539 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-68fc64aa-2a00-4c70-88d1-e562d2bb3645 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "PUT /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1" status: 200 len: 1081 microversion: 2.1 time: 0.124362 Aug 04 16:55:51.717797 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5230212b-ec5c-4a79-9be8-4ed007c2a9ff tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:51.717797 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5230212b-ec5c-4a79-9be8-4ed007c2a9ff tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:51.724993 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5230212b-ec5c-4a79-9be8-4ed007c2a9ff tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 2530 microversion: 2.42 time: 0.479821 Aug 04 16:55:51.726178 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1951/3841] 10.222.0.23 () {60 vars in 1256 bytes} [Thu Aug 4 16:55:51 2022] PUT /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 => generated 1081 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:51.727422 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1891/3842] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:51 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 2530 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:51.736292 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4926c324-0694-4636-8623-5e9ddc4ef6d5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:51.737231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4926c324-0694-4636-8623-5e9ddc4ef6d5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:51.745213 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4926c324-0694-4636-8623-5e9ddc4ef6d5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:51.745908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4926c324-0694-4636-8623-5e9ddc4ef6d5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:51.746967 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4926c324-0694-4636-8623-5e9ddc4ef6d5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:51.747626 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4926c324-0694-4636-8623-5e9ddc4ef6d5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:51.935603 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1d8b8d7c-059b-41d2-9ebd-5b9b73edbd10 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:51.936536 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1d8b8d7c-059b-41d2-9ebd-5b9b73edbd10 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69500bda-7084-4ba9-abc9-64d6fc905b72] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:51.953391 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d8b8d7c-059b-41d2-9ebd-5b9b73edbd10 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:51.954636 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d8b8d7c-059b-41d2-9ebd-5b9b73edbd10 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:51.956103 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d8b8d7c-059b-41d2-9ebd-5b9b73edbd10 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:51.961178 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d8b8d7c-059b-41d2-9ebd-5b9b73edbd10 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:52.035569 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=100 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:52.585902 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:52.616623 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=10 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:53.725765 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:53.739898 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4926c324-0694-4636-8623-5e9ddc4ef6d5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:53.750171 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4926c324-0694-4636-8623-5e9ddc4ef6d5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1" status: 200 len: 1507 microversion: 2.1 time: 2.018229 Aug 04 16:55:53.759845 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1952/3843] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:51 2022] GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 => generated 1507 bytes in 2033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:53.773984 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e54bd196-1920-49c7-9d38-3370d6b8a2d9 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:53.777864 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e54bd196-1920-49c7-9d38-3370d6b8a2d9 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] [instance: 22374f24-f9d2-434f-9a38-fa08620e5032] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:53.807067 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e54bd196-1920-49c7-9d38-3370d6b8a2d9 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:53.807723 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e54bd196-1920-49c7-9d38-3370d6b8a2d9 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:53.808752 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e54bd196-1920-49c7-9d38-3370d6b8a2d9 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:53.809500 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e54bd196-1920-49c7-9d38-3370d6b8a2d9 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:53.828996 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-e54bd196-1920-49c7-9d38-3370d6b8a2d9 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] HTTP exception thrown: Instance 22374f24-f9d2-434f-9a38-fa08620e5032 could not be found. Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e54bd196-1920-49c7-9d38-3370d6b8a2d9 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Request method failure captured: Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032 HTTP/1.1 Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_nqaWLuk-ZLNaYJhI_DOa0emMzVquhaT8ibcgY8np49WH74DB_f07e4fnHmey6tdNPgxf47fKnlVZkhp4Qz_BP0YG_n8q-DkrJ5VVb5jzZ7sovSw0PEP5UO9pcGFMNVFUehxEHAQvl97JFF-OtgGysGUvzZcPawBy502XPiP4_j88o Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: X-Openstack-Nova-Api-Version: 2.57 Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 61b081621f384220a8becdeeb0bfd3cd Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerShowV257Test-1389459956 Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/61b081621f384220a8becdeeb0bfd3cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_61b081621f384220a8becdeeb0bfd3cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/61b081621f384220a8becdeeb0bfd3cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/61b081621f384220a8becdeeb0bfd3cd"}]}] Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerShowV257Test-1389459956 Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 61b081621f384220a8becdeeb0bfd3cd Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerShowV257Test-1389459956 Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerShowV257Test-1389459956-project Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 1bd94200a6b94531b8ea725981c9a06e Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerShowV257Test-1389459956-project Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 22374f24-f9d2-434f-9a38-fa08620e5032 could not be found. Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '22374f24-f9d2-434f-9a38-fa08620e5032'} Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22374f24-f9d2-434f-9a38-fa08620e5032 could not be found. Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22374f24-f9d2-434f-9a38-fa08620e5032 could not be found. Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:53.831343 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:55:53.836030 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:53.836030 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:53.836030 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:53.836030 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:55:53.836030 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:55:53.836030 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22374f24-f9d2-434f-9a38-fa08620e5032 could not be found. Aug 04 16:55:53.836030 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:55:53.836030 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e54bd196-1920-49c7-9d38-3370d6b8a2d9 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] Returning 404 to user: Instance 22374f24-f9d2-434f-9a38-fa08620e5032 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:53.836030 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e54bd196-1920-49c7-9d38-3370d6b8a2d9 tempest-ServerShowV257Test-1389459956 tempest-ServerShowV257Test-1389459956-project] 10.222.0.23 "GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032" status: 404 len: 111 microversion: 2.57 time: 0.071166 Aug 04 16:55:53.836030 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1953/3844] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:53 2022] GET /compute/v2.1/servers/22374f24-f9d2-434f-9a38-fa08620e5032 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:55:53.846203 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5a90aa05-062d-4919-ad8c-a0fe399bfac7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:53.851761 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5a90aa05-062d-4919-ad8c-a0fe399bfac7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:53.871378 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1d8b8d7c-059b-41d2-9ebd-5b9b73edbd10 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:53.880307 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5a90aa05-062d-4919-ad8c-a0fe399bfac7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:53.881439 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5a90aa05-062d-4919-ad8c-a0fe399bfac7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:53.882682 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5a90aa05-062d-4919-ad8c-a0fe399bfac7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:53.883411 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5a90aa05-062d-4919-ad8c-a0fe399bfac7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:53.886006 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1d8b8d7c-059b-41d2-9ebd-5b9b73edbd10 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72" status: 200 len: 1329 microversion: 2.1 time: 1.959504 Aug 04 16:55:53.886612 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1892/3845] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:51 2022] GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72 => generated 1329 bytes in 1961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:55:53.931341 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-3f2ae893-6739-49e4-93a3-c3509e9a2061 req-21dcda36-4b5c-40ad-a6fa-cf3b65543ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69500bda-7084-4ba9-abc9-64d6fc905b72", "tag": "cfb10957-085e-44a4-92f8-bba19149e905"}, {"server_uuid": "8e273267-ae4b-4a99-821e-1c02c3440610", "name": "network-vif-deleted", "tag": "1d3e9f84-9473-48e1-a53e-66949e923559"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:53.951295 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:53.967416 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-3f2ae893-6739-49e4-93a3-c3509e9a2061 req-21dcda36-4b5c-40ad-a6fa-cf3b65543ba0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:53.968023 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-3f2ae893-6739-49e4-93a3-c3509e9a2061 req-21dcda36-4b5c-40ad-a6fa-cf3b65543ba0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:54.019903 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-3f2ae893-6739-49e4-93a3-c3509e9a2061 req-21dcda36-4b5c-40ad-a6fa-cf3b65543ba0 service nova] Creating event network-changed:cfb10957-085e-44a4-92f8-bba19149e905 for instance 69500bda-7084-4ba9-abc9-64d6fc905b72 on n-h1-846466-12 Aug 04 16:55:54.020403 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-3f2ae893-6739-49e4-93a3-c3509e9a2061 req-21dcda36-4b5c-40ad-a6fa-cf3b65543ba0 service nova] Creating event network-vif-deleted:1d3e9f84-9473-48e1-a53e-66949e923559 for instance 8e273267-ae4b-4a99-821e-1c02c3440610 on n-h1-846466-12 Aug 04 16:55:54.043810 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-3f2ae893-6739-49e4-93a3-c3509e9a2061 req-21dcda36-4b5c-40ad-a6fa-cf3b65543ba0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.122031 Aug 04 16:55:54.055927 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1893/3846] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:54.074661 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ae0a2428-a9e0-4fca-96e5-f578bf661845 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:54.075644 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ae0a2428-a9e0-4fca-96e5-f578bf661845 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:54.101450 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ae0a2428-a9e0-4fca-96e5-f578bf661845 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:54.104588 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ae0a2428-a9e0-4fca-96e5-f578bf661845 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:54.105781 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ae0a2428-a9e0-4fca-96e5-f578bf661845 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:54.106371 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ae0a2428-a9e0-4fca-96e5-f578bf661845 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:54.484059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5a90aa05-062d-4919-ad8c-a0fe399bfac7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:54.508172 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5a90aa05-062d-4919-ad8c-a0fe399bfac7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:54.510193 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5a90aa05-062d-4919-ad8c-a0fe399bfac7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:54.515751 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5a90aa05-062d-4919-ad8c-a0fe399bfac7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 2371 microversion: 2.42 time: 0.677154 Aug 04 16:55:54.518332 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1954/3847] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:53 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 2371 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:54.664716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ae0a2428-a9e0-4fca-96e5-f578bf661845 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:54.691880 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ae0a2428-a9e0-4fca-96e5-f578bf661845 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1" status: 200 len: 1507 microversion: 2.1 time: 0.631739 Aug 04 16:55:54.694598 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1894/3848] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:54 2022] GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 => generated 1507 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:54.714763 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-74ac7825-7cdf-49c5-952f-a8a5561bef12 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:54.724319 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-74ac7825-7cdf-49c5-952f-a8a5561bef12 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:54.742436 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-74ac7825-7cdf-49c5-952f-a8a5561bef12 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:54.743983 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-74ac7825-7cdf-49c5-952f-a8a5561bef12 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:54.747009 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-74ac7825-7cdf-49c5-952f-a8a5561bef12 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:54.750153 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-74ac7825-7cdf-49c5-952f-a8a5561bef12 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:54.907293 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bb23b440-72e5-4c93-bad7-a99c94a1d0ad tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:54.911455 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bb23b440-72e5-4c93-bad7-a99c94a1d0ad tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69500bda-7084-4ba9-abc9-64d6fc905b72] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:54.922436 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bb23b440-72e5-4c93-bad7-a99c94a1d0ad tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:54.922901 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bb23b440-72e5-4c93-bad7-a99c94a1d0ad tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:54.928294 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bb23b440-72e5-4c93-bad7-a99c94a1d0ad tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:54.929036 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bb23b440-72e5-4c93-bad7-a99c94a1d0ad tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:54.962065 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-74ac7825-7cdf-49c5-952f-a8a5561bef12 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:55:54.964152 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-74ac7825-7cdf-49c5-952f-a8a5561bef12 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:55:54.965147 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-74ac7825-7cdf-49c5-952f-a8a5561bef12 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:55:54.972582 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-74ac7825-7cdf-49c5-952f-a8a5561bef12 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:55:54.974344 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-74ac7825-7cdf-49c5-952f-a8a5561bef12 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:55:55.156875 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-74ac7825-7cdf-49c5-952f-a8a5561bef12 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:55.166450 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-74ac7825-7cdf-49c5-952f-a8a5561bef12 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:55.167305 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-74ac7825-7cdf-49c5-952f-a8a5561bef12 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:55.168379 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-74ac7825-7cdf-49c5-952f-a8a5561bef12 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:55.169402 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-74ac7825-7cdf-49c5-952f-a8a5561bef12 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:55.233520 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-74ac7825-7cdf-49c5-952f-a8a5561bef12 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "POST /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1/action" status: 202 len: 1113 microversion: 2.1 time: 0.524409 Aug 04 16:55:55.238768 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1955/3849] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:55:54 2022] POST /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1/action => generated 1113 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 16:55:55.257865 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4398acfc-d0c3-41c1-ad08-846081d75a6f tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:55.259158 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4398acfc-d0c3-41c1-ad08-846081d75a6f tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:55.273710 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4398acfc-d0c3-41c1-ad08-846081d75a6f tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:55.274158 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4398acfc-d0c3-41c1-ad08-846081d75a6f tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:55.274935 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4398acfc-d0c3-41c1-ad08-846081d75a6f tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:55.275366 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4398acfc-d0c3-41c1-ad08-846081d75a6f tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:56.394548 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bb23b440-72e5-4c93-bad7-a99c94a1d0ad tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:56.405033 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bb23b440-72e5-4c93-bad7-a99c94a1d0ad tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72" status: 200 len: 1329 microversion: 2.1 time: 1.501095 Aug 04 16:55:56.405033 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1895/3850] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:54 2022] GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72 => generated 1329 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:56.441742 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-eeb705de-c707-4c41-9c02-09d1c569eaa5 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:56.445706 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-eeb705de-c707-4c41-9c02-09d1c569eaa5 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:56.469012 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eeb705de-c707-4c41-9c02-09d1c569eaa5 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:56.471709 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eeb705de-c707-4c41-9c02-09d1c569eaa5 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:56.475819 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eeb705de-c707-4c41-9c02-09d1c569eaa5 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:56.477823 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eeb705de-c707-4c41-9c02-09d1c569eaa5 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:56.606245 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4398acfc-d0c3-41c1-ad08-846081d75a6f tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:56.617679 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4398acfc-d0c3-41c1-ad08-846081d75a6f tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1" status: 200 len: 1518 microversion: 2.1 time: 1.365035 Aug 04 16:55:56.618265 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1956/3851] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:55 2022] GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 => generated 1518 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:55:56.632873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-21a1262d-b825-4705-8dc6-ca23c2231113 req-dc916234-95cc-4ffa-ac93-9e2c81da7ffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e273267-ae4b-4a99-821e-1c02c3440610", "name": "network-vif-deleted", "tag": "60a27540-9c7c-46c8-a5bc-7d1e309c4659"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:56.655970 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-21a1262d-b825-4705-8dc6-ca23c2231113 req-dc916234-95cc-4ffa-ac93-9e2c81da7ffe service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:56.656410 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-21a1262d-b825-4705-8dc6-ca23c2231113 req-dc916234-95cc-4ffa-ac93-9e2c81da7ffe service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:56.692923 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-21a1262d-b825-4705-8dc6-ca23c2231113 req-dc916234-95cc-4ffa-ac93-9e2c81da7ffe service nova] Creating event network-vif-deleted:60a27540-9c7c-46c8-a5bc-7d1e309c4659 for instance 8e273267-ae4b-4a99-821e-1c02c3440610 on n-h1-846466-12 Aug 04 16:55:56.698562 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-21a1262d-b825-4705-8dc6-ca23c2231113 req-dc916234-95cc-4ffa-ac93-9e2c81da7ffe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075905 Aug 04 16:55:56.699169 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1957/3852] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:57.336802 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-eeb705de-c707-4c41-9c02-09d1c569eaa5 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:57.351656 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-eeb705de-c707-4c41-9c02-09d1c569eaa5 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:57.353556 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-eeb705de-c707-4c41-9c02-09d1c569eaa5 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:57.359625 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-eeb705de-c707-4c41-9c02-09d1c569eaa5 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 2325 microversion: 2.42 time: 0.925126 Aug 04 16:55:57.363979 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1896/3853] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:56 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 2325 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:57.433112 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e44c9b3a-346b-4e2f-aaa5-6411b0a27620 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:57.434227 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e44c9b3a-346b-4e2f-aaa5-6411b0a27620 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69500bda-7084-4ba9-abc9-64d6fc905b72] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:57.450142 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e44c9b3a-346b-4e2f-aaa5-6411b0a27620 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:57.468050 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e44c9b3a-346b-4e2f-aaa5-6411b0a27620 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:57.469396 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e44c9b3a-346b-4e2f-aaa5-6411b0a27620 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:57.470587 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e44c9b3a-346b-4e2f-aaa5-6411b0a27620 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:57.642758 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-363317d0-032b-474a-8160-6267210f05d3 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:57.643584 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-363317d0-032b-474a-8160-6267210f05d3 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:57.652802 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-363317d0-032b-474a-8160-6267210f05d3 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:57.653261 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-363317d0-032b-474a-8160-6267210f05d3 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:57.654085 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-363317d0-032b-474a-8160-6267210f05d3 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:57.654525 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-363317d0-032b-474a-8160-6267210f05d3 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:58.113519 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e44c9b3a-346b-4e2f-aaa5-6411b0a27620 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:58.130534 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e44c9b3a-346b-4e2f-aaa5-6411b0a27620 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72" status: 200 len: 1329 microversion: 2.1 time: 0.703428 Aug 04 16:55:58.133112 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1958/3854] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:57 2022] GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72 => generated 1329 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:58.348307 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-363317d0-032b-474a-8160-6267210f05d3 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:58.361493 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-363317d0-032b-474a-8160-6267210f05d3 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1" status: 200 len: 1518 microversion: 2.1 time: 0.721285 Aug 04 16:55:58.377352 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1897/3855] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:57 2022] GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 => generated 1518 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:58.393441 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-34c3c1fc-f2c6-434b-b39e-c05772ae8301 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:58.393617 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-34c3c1fc-f2c6-434b-b39e-c05772ae8301 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:58.403524 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-34c3c1fc-f2c6-434b-b39e-c05772ae8301 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:58.403971 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-34c3c1fc-f2c6-434b-b39e-c05772ae8301 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:58.407046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-34c3c1fc-f2c6-434b-b39e-c05772ae8301 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:58.407436 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-34c3c1fc-f2c6-434b-b39e-c05772ae8301 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:58.600569 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-34c3c1fc-f2c6-434b-b39e-c05772ae8301 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:58.619101 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-34c3c1fc-f2c6-434b-b39e-c05772ae8301 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:58.624096 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-34c3c1fc-f2c6-434b-b39e-c05772ae8301 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:58.630174 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-34c3c1fc-f2c6-434b-b39e-c05772ae8301 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 2145 microversion: 2.42 time: 0.241914 Aug 04 16:55:58.631392 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1959/3856] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:58 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 2145 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:58.885694 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-f9764474-8350-490b-9661-6169363676ac req-1edf8921-fe61-417a-9d34-045342b66012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e273267-ae4b-4a99-821e-1c02c3440610", "name": "network-vif-deleted", "tag": "1155cb3d-57af-4e24-82ea-543e08adca46"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:58.909124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f9764474-8350-490b-9661-6169363676ac req-1edf8921-fe61-417a-9d34-045342b66012 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:58.909925 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f9764474-8350-490b-9661-6169363676ac req-1edf8921-fe61-417a-9d34-045342b66012 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:58.938017 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-f9764474-8350-490b-9661-6169363676ac req-1edf8921-fe61-417a-9d34-045342b66012 service nova] Creating event network-vif-deleted:1155cb3d-57af-4e24-82ea-543e08adca46 for instance 8e273267-ae4b-4a99-821e-1c02c3440610 on n-h1-846466-12 Aug 04 16:55:58.944022 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-f9764474-8350-490b-9661-6169363676ac req-1edf8921-fe61-417a-9d34-045342b66012 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061948 Aug 04 16:55:58.945398 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1898/3857] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:59.154157 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f19ca679-4dbc-4c6c-ad6e-af09c01087fa tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:59.154898 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f19ca679-4dbc-4c6c-ad6e-af09c01087fa tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69500bda-7084-4ba9-abc9-64d6fc905b72] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:59.169072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f19ca679-4dbc-4c6c-ad6e-af09c01087fa tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:59.170310 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f19ca679-4dbc-4c6c-ad6e-af09c01087fa tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:59.174102 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f19ca679-4dbc-4c6c-ad6e-af09c01087fa tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:59.174557 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f19ca679-4dbc-4c6c-ad6e-af09c01087fa tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:59.393222 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-37701260-fb11-46f8-a51b-6201b919913d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:59.394924 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-37701260-fb11-46f8-a51b-6201b919913d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:59.422075 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-37701260-fb11-46f8-a51b-6201b919913d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:59.427076 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-37701260-fb11-46f8-a51b-6201b919913d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:55:59.428236 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-37701260-fb11-46f8-a51b-6201b919913d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:55:59.431940 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-37701260-fb11-46f8-a51b-6201b919913d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:00.618029 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f19ca679-4dbc-4c6c-ad6e-af09c01087fa tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:00.621031 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:00.634098 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f19ca679-4dbc-4c6c-ad6e-af09c01087fa tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72" status: 200 len: 1329 microversion: 2.1 time: 1.485834 Aug 04 16:56:00.634948 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1960/3858] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:59 2022] GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72 => generated 1329 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:00.655604 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1298405a-033d-4e7e-a9cd-67532100a821 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:00.658314 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1298405a-033d-4e7e-a9cd-67532100a821 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:00.671306 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1298405a-033d-4e7e-a9cd-67532100a821 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:00.673191 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1298405a-033d-4e7e-a9cd-67532100a821 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:00.674390 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1298405a-033d-4e7e-a9cd-67532100a821 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:00.674994 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1298405a-033d-4e7e-a9cd-67532100a821 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:00.806469 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1298405a-033d-4e7e-a9cd-67532100a821 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:00.819725 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1298405a-033d-4e7e-a9cd-67532100a821 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:00.826535 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1298405a-033d-4e7e-a9cd-67532100a821 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:00.835565 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1298405a-033d-4e7e-a9cd-67532100a821 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 2031 microversion: 2.42 time: 0.198823 Aug 04 16:56:00.835565 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1961/3859] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:00 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 2031 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:00.951090 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-37701260-fb11-46f8-a51b-6201b919913d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:00.992992 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-37701260-fb11-46f8-a51b-6201b919913d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1" status: 200 len: 1518 microversion: 2.1 time: 1.606385 Aug 04 16:56:01.001833 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1899/3860] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:59 2022] GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 => generated 1518 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:01.660413 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d1136bcd-5cb6-43fb-806b-834af25ba335 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:01.661026 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d1136bcd-5cb6-43fb-806b-834af25ba335 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69500bda-7084-4ba9-abc9-64d6fc905b72] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:01.678232 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d1136bcd-5cb6-43fb-806b-834af25ba335 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:01.678998 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d1136bcd-5cb6-43fb-806b-834af25ba335 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:01.683721 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d1136bcd-5cb6-43fb-806b-834af25ba335 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:01.685361 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d1136bcd-5cb6-43fb-806b-834af25ba335 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:01.789232 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-be26f9bf-c54c-4818-b20d-bcec2abb8446 req-88f8f64a-292d-495a-aba5-524e4937e86b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69500bda-7084-4ba9-abc9-64d6fc905b72", "name": "network-vif-plugged", "status": "completed", "tag": "cfb10957-085e-44a4-92f8-bba19149e905"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:01.815728 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-be26f9bf-c54c-4818-b20d-bcec2abb8446 req-88f8f64a-292d-495a-aba5-524e4937e86b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:01.816363 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-be26f9bf-c54c-4818-b20d-bcec2abb8446 req-88f8f64a-292d-495a-aba5-524e4937e86b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:01.844591 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-be26f9bf-c54c-4818-b20d-bcec2abb8446 req-88f8f64a-292d-495a-aba5-524e4937e86b service nova] Creating event network-vif-plugged:cfb10957-085e-44a4-92f8-bba19149e905 for instance 69500bda-7084-4ba9-abc9-64d6fc905b72 on n-h1-846466-12 Aug 04 16:56:01.857569 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-be26f9bf-c54c-4818-b20d-bcec2abb8446 req-88f8f64a-292d-495a-aba5-524e4937e86b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072911 Aug 04 16:56:01.858829 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1900/3861] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:01.867925 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-03cf83fa-b8ab-4a90-8f56-3e5a21fcc385 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:01.872223 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-03cf83fa-b8ab-4a90-8f56-3e5a21fcc385 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:01.885478 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03cf83fa-b8ab-4a90-8f56-3e5a21fcc385 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:01.885936 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03cf83fa-b8ab-4a90-8f56-3e5a21fcc385 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:01.886723 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03cf83fa-b8ab-4a90-8f56-3e5a21fcc385 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:01.887178 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03cf83fa-b8ab-4a90-8f56-3e5a21fcc385 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:02.248622 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-03cf83fa-b8ab-4a90-8f56-3e5a21fcc385 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:02.271237 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d1136bcd-5cb6-43fb-806b-834af25ba335 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:02.275158 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-03cf83fa-b8ab-4a90-8f56-3e5a21fcc385 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:02.278684 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-03cf83fa-b8ab-4a90-8f56-3e5a21fcc385 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:02.282665 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d1136bcd-5cb6-43fb-806b-834af25ba335 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72" status: 200 len: 1329 microversion: 2.1 time: 0.626292 Aug 04 16:56:02.285681 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-03cf83fa-b8ab-4a90-8f56-3e5a21fcc385 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 2031 microversion: 2.42 time: 0.422471 Aug 04 16:56:02.301408 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1901/3862] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:01 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 2031 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:02.301702 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1962/3863] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:01 2022] GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72 => generated 1329 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:02.313274 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a10a51e4-d9e3-4bea-abf8-f1098b8ba3b1 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:02.315366 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a10a51e4-d9e3-4bea-abf8-f1098b8ba3b1 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:02.336962 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a10a51e4-d9e3-4bea-abf8-f1098b8ba3b1 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:02.341737 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a10a51e4-d9e3-4bea-abf8-f1098b8ba3b1 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:02.350008 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a10a51e4-d9e3-4bea-abf8-f1098b8ba3b1 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:02.353134 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a10a51e4-d9e3-4bea-abf8-f1098b8ba3b1 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:02.676547 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a10a51e4-d9e3-4bea-abf8-f1098b8ba3b1 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:02.689534 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a10a51e4-d9e3-4bea-abf8-f1098b8ba3b1 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1" status: 200 len: 1518 microversion: 2.1 time: 0.394252 Aug 04 16:56:02.693649 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1902/3864] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:02 2022] GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 => generated 1518 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:03.307495 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-550782c9-d5b2-4dc2-ab80-615695b91849 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:03.310882 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-550782c9-d5b2-4dc2-ab80-615695b91849 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69500bda-7084-4ba9-abc9-64d6fc905b72] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:03.321378 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6441a23c-0179-46f9-8882-997d8e175a5e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:03.322003 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6441a23c-0179-46f9-8882-997d8e175a5e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:03.323557 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-550782c9-d5b2-4dc2-ab80-615695b91849 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:03.324133 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-550782c9-d5b2-4dc2-ab80-615695b91849 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:03.332978 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-550782c9-d5b2-4dc2-ab80-615695b91849 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:03.333661 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-550782c9-d5b2-4dc2-ab80-615695b91849 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:03.338377 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6441a23c-0179-46f9-8882-997d8e175a5e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:03.338837 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6441a23c-0179-46f9-8882-997d8e175a5e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:03.339631 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6441a23c-0179-46f9-8882-997d8e175a5e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:03.343534 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6441a23c-0179-46f9-8882-997d8e175a5e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:03.601624 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6441a23c-0179-46f9-8882-997d8e175a5e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:03.638963 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6441a23c-0179-46f9-8882-997d8e175a5e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:03.653772 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6441a23c-0179-46f9-8882-997d8e175a5e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:03.661483 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6441a23c-0179-46f9-8882-997d8e175a5e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 2031 microversion: 2.42 time: 0.341861 Aug 04 16:56:03.662960 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1903/3865] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:03 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 2031 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:03.721107 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3d119de6-1856-459c-9a92-26052d7a7ac3 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:03.722219 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3d119de6-1856-459c-9a92-26052d7a7ac3 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:03.740757 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3d119de6-1856-459c-9a92-26052d7a7ac3 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:03.744599 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3d119de6-1856-459c-9a92-26052d7a7ac3 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:03.745941 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3d119de6-1856-459c-9a92-26052d7a7ac3 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:03.746792 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3d119de6-1856-459c-9a92-26052d7a7ac3 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:04.457984 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-550782c9-d5b2-4dc2-ab80-615695b91849 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:04.466779 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-550782c9-d5b2-4dc2-ab80-615695b91849 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72" status: 200 len: 1329 microversion: 2.1 time: 1.166669 Aug 04 16:56:04.485757 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1963/3866] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:03 2022] GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72 => generated 1329 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:04.700717 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dae77439-ea43-4a4e-a464-de0b5e9f3e88 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:04.701950 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dae77439-ea43-4a4e-a464-de0b5e9f3e88 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:04.729169 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dae77439-ea43-4a4e-a464-de0b5e9f3e88 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:04.735100 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3d119de6-1856-459c-9a92-26052d7a7ac3 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:04.749890 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dae77439-ea43-4a4e-a464-de0b5e9f3e88 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:04.755804 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3d119de6-1856-459c-9a92-26052d7a7ac3 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1" status: 200 len: 1518 microversion: 2.1 time: 1.040816 Aug 04 16:56:04.756443 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1904/3867] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:03 2022] GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 => generated 1518 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:56:04.756790 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dae77439-ea43-4a4e-a464-de0b5e9f3e88 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:04.757466 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dae77439-ea43-4a4e-a464-de0b5e9f3e88 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:04.899524 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dae77439-ea43-4a4e-a464-de0b5e9f3e88 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:04.920628 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dae77439-ea43-4a4e-a464-de0b5e9f3e88 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:04.929128 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dae77439-ea43-4a4e-a464-de0b5e9f3e88 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:04.933709 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dae77439-ea43-4a4e-a464-de0b5e9f3e88 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 2031 microversion: 2.42 time: 0.236099 Aug 04 16:56:04.934924 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1964/3868] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:04 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 2031 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:56:05.488427 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5db1efdc-97dd-4cb8-8093-5f0fa2afaa38 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:05.489536 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5db1efdc-97dd-4cb8-8093-5f0fa2afaa38 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69500bda-7084-4ba9-abc9-64d6fc905b72] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:05.507531 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5db1efdc-97dd-4cb8-8093-5f0fa2afaa38 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:05.508546 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5db1efdc-97dd-4cb8-8093-5f0fa2afaa38 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:05.510059 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5db1efdc-97dd-4cb8-8093-5f0fa2afaa38 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:05.510525 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5db1efdc-97dd-4cb8-8093-5f0fa2afaa38 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:05.791102 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-140ee390-a78e-4991-9418-5decd60ad87a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:05.791774 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-140ee390-a78e-4991-9418-5decd60ad87a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:05.850239 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-140ee390-a78e-4991-9418-5decd60ad87a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:05.850772 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-140ee390-a78e-4991-9418-5decd60ad87a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:05.851610 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-140ee390-a78e-4991-9418-5decd60ad87a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:05.852045 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-140ee390-a78e-4991-9418-5decd60ad87a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:06.011137 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5db1efdc-97dd-4cb8-8093-5f0fa2afaa38 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:06.041350 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5db1efdc-97dd-4cb8-8093-5f0fa2afaa38 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72" status: 200 len: 1510 microversion: 2.1 time: 0.557334 Aug 04 16:56:06.054130 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1905/3869] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:05 2022] GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72 => generated 1510 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:06.065925 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-67af8b5f-9fbc-4e0d-95bc-32f480b81b29 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:06.067301 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-67af8b5f-9fbc-4e0d-95bc-32f480b81b29 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:06.075295 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-67af8b5f-9fbc-4e0d-95bc-32f480b81b29 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:06.076241 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-67af8b5f-9fbc-4e0d-95bc-32f480b81b29 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:06.077740 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-67af8b5f-9fbc-4e0d-95bc-32f480b81b29 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:06.078455 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-67af8b5f-9fbc-4e0d-95bc-32f480b81b29 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:06.554765 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-67af8b5f-9fbc-4e0d-95bc-32f480b81b29 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:06.581779 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-67af8b5f-9fbc-4e0d-95bc-32f480b81b29 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:06.584443 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-67af8b5f-9fbc-4e0d-95bc-32f480b81b29 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:06.586206 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-67af8b5f-9fbc-4e0d-95bc-32f480b81b29 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 2031 microversion: 2.42 time: 0.529897 Aug 04 16:56:06.589458 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1906/3870] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:06 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 2031 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:06.622909 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ff863bb4-d5a0-495b-ad94-e7992adc3da4 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:06.623801 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ff863bb4-d5a0-495b-ad94-e7992adc3da4 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69500bda-7084-4ba9-abc9-64d6fc905b72] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:06.633657 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ff863bb4-d5a0-495b-ad94-e7992adc3da4 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:06.637324 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ff863bb4-d5a0-495b-ad94-e7992adc3da4 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:06.639240 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ff863bb4-d5a0-495b-ad94-e7992adc3da4 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:06.640939 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ff863bb4-d5a0-495b-ad94-e7992adc3da4 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:06.783328 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-140ee390-a78e-4991-9418-5decd60ad87a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:06.792099 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-140ee390-a78e-4991-9418-5decd60ad87a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1" status: 200 len: 1518 microversion: 2.1 time: 1.013409 Aug 04 16:56:06.792718 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1965/3871] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:05 2022] GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 => generated 1518 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:07.018475 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ff863bb4-d5a0-495b-ad94-e7992adc3da4 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:07.045010 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ff863bb4-d5a0-495b-ad94-e7992adc3da4 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72" status: 200 len: 1510 microversion: 2.1 time: 0.437358 Aug 04 16:56:07.066361 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1907/3872] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:06 2022] GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72 => generated 1510 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:07.073698 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6e7fa0ad-8925-4771-8e79-9c4eebbe2704 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:07.074694 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6e7fa0ad-8925-4771-8e79-9c4eebbe2704 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69500bda-7084-4ba9-abc9-64d6fc905b72] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:07.099423 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6e7fa0ad-8925-4771-8e79-9c4eebbe2704 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:07.112609 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6e7fa0ad-8925-4771-8e79-9c4eebbe2704 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:07.113800 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6e7fa0ad-8925-4771-8e79-9c4eebbe2704 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:07.114606 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6e7fa0ad-8925-4771-8e79-9c4eebbe2704 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:07.199687 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6e7fa0ad-8925-4771-8e79-9c4eebbe2704 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69500bda-7084-4ba9-abc9-64d6fc905b72] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:56:07.500238 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6e7fa0ad-8925-4771-8e79-9c4eebbe2704 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "DELETE /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72" status: 204 len: 0 microversion: 2.1 time: 0.428619 Aug 04 16:56:07.505154 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1966/3873] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:56:07 2022] DELETE /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:56:07.521733 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c79903eb-13a0-4c40-b505-43c81810cc51 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:07.524678 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c79903eb-13a0-4c40-b505-43c81810cc51 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69500bda-7084-4ba9-abc9-64d6fc905b72] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:07.542093 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c79903eb-13a0-4c40-b505-43c81810cc51 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:07.542533 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c79903eb-13a0-4c40-b505-43c81810cc51 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:07.543323 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c79903eb-13a0-4c40-b505-43c81810cc51 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:07.543750 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c79903eb-13a0-4c40-b505-43c81810cc51 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:07.669028 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0d17d325-b3a1-4134-b503-e011ec783c15 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Action: 'create', calling method: .version_select at 0x7f7e89c79af0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1780717108", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAXK91Fw64HeitE0gbuWOmTzrnR8QYZplkufY7Cf8JjJtF2IjtvRKW/ZNmK/VKvlOYMn1PuYdsokZsZN//3PVckq5i/Cb6bye/bXhsSiWGqWj0N70GdrqYGG/ONfo1K3A=="}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:07.717457 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-0d17d325-b3a1-4134-b503-e011ec783c15 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Getting quotas for project 7c93b891c0324a8cace12fb77490ad16. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:56:07.734245 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-0d17d325-b3a1-4134-b503-e011ec783c15 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Getting quotas for user 34126dbe898545fd9d7e03b55880ab53 and project 7c93b891c0324a8cace12fb77490ad16. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:56:07.836794 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0d17d325-b3a1-4134-b503-e011ec783c15 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.681994 Aug 04 16:56:07.843574 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1908/3874] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 16:56:07 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:07.863347 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-731c7a91-20ba-47ee-8f6e-003317e58b68 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:07.865594 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-731c7a91-20ba-47ee-8f6e-003317e58b68 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:07.882034 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-731c7a91-20ba-47ee-8f6e-003317e58b68 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:07.882848 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-731c7a91-20ba-47ee-8f6e-003317e58b68 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:07.890128 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-731c7a91-20ba-47ee-8f6e-003317e58b68 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:07.891017 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-731c7a91-20ba-47ee-8f6e-003317e58b68 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:08.452308 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c79903eb-13a0-4c40-b505-43c81810cc51 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:08.457096 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-731c7a91-20ba-47ee-8f6e-003317e58b68 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:08.462450 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c79903eb-13a0-4c40-b505-43c81810cc51 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72" status: 200 len: 1516 microversion: 2.1 time: 0.954766 Aug 04 16:56:08.463032 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1967/3875] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:07 2022] GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72 => generated 1516 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:08.489203 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1dcd4804-b583-4223-a960-65ff5c3e2499 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:08.489203 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1dcd4804-b583-4223-a960-65ff5c3e2499 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:08.516023 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-731c7a91-20ba-47ee-8f6e-003317e58b68 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:08.525448 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-731c7a91-20ba-47ee-8f6e-003317e58b68 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:08.532079 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-731c7a91-20ba-47ee-8f6e-003317e58b68 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 2031 microversion: 2.42 time: 0.690985 Aug 04 16:56:08.536653 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1dcd4804-b583-4223-a960-65ff5c3e2499 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:08.537114 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1909/3876] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:07 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 2031 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:08.539796 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1dcd4804-b583-4223-a960-65ff5c3e2499 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:08.540602 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1dcd4804-b583-4223-a960-65ff5c3e2499 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:08.541031 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1dcd4804-b583-4223-a960-65ff5c3e2499 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:09.491315 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-be0d1773-2f67-4d1c-902f-55b8b90243fe tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:09.492105 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-be0d1773-2f67-4d1c-902f-55b8b90243fe tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69500bda-7084-4ba9-abc9-64d6fc905b72] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:09.510867 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be0d1773-2f67-4d1c-902f-55b8b90243fe tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:09.517641 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be0d1773-2f67-4d1c-902f-55b8b90243fe tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:09.526950 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be0d1773-2f67-4d1c-902f-55b8b90243fe tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:09.535515 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be0d1773-2f67-4d1c-902f-55b8b90243fe tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:10.132751 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1dcd4804-b583-4223-a960-65ff5c3e2499 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:10.141300 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1dcd4804-b583-4223-a960-65ff5c3e2499 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1" status: 200 len: 1518 microversion: 2.1 time: 1.661968 Aug 04 16:56:10.143232 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1968/3877] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:08 2022] GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 => generated 1518 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:10.153692 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7a1a6028-3110-458a-8085-ee2160f9b1d1 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:10.154488 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7a1a6028-3110-458a-8085-ee2160f9b1d1 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:10.163226 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a1a6028-3110-458a-8085-ee2160f9b1d1 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:10.163979 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a1a6028-3110-458a-8085-ee2160f9b1d1 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:10.167529 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a1a6028-3110-458a-8085-ee2160f9b1d1 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:10.170303 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a1a6028-3110-458a-8085-ee2160f9b1d1 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:10.399528 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-be0d1773-2f67-4d1c-902f-55b8b90243fe tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:10.410082 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7a1a6028-3110-458a-8085-ee2160f9b1d1 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:10.416766 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-be0d1773-2f67-4d1c-902f-55b8b90243fe tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72" status: 200 len: 1516 microversion: 2.1 time: 0.932497 Aug 04 16:56:10.438367 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7a1a6028-3110-458a-8085-ee2160f9b1d1 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:10.439928 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1910/3878] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:09 2022] GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72 => generated 1516 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:56:10.441093 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7a1a6028-3110-458a-8085-ee2160f9b1d1 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:10.445455 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7a1a6028-3110-458a-8085-ee2160f9b1d1 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 2031 microversion: 2.42 time: 0.298174 Aug 04 16:56:10.451933 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1969/3879] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:10 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 2031 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:11.165756 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-354a9f04-7d1d-4970-97f1-4800966f7d6c tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:11.167334 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-354a9f04-7d1d-4970-97f1-4800966f7d6c tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:11.178364 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-354a9f04-7d1d-4970-97f1-4800966f7d6c tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:11.179166 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-354a9f04-7d1d-4970-97f1-4800966f7d6c tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:11.180527 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-354a9f04-7d1d-4970-97f1-4800966f7d6c tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:11.181162 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-354a9f04-7d1d-4970-97f1-4800966f7d6c tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:11.448059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-387234bd-6873-4d4d-84d6-65795afc1687 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:11.448817 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-387234bd-6873-4d4d-84d6-65795afc1687 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69500bda-7084-4ba9-abc9-64d6fc905b72] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:11.461599 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-387234bd-6873-4d4d-84d6-65795afc1687 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:11.465622 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-387234bd-6873-4d4d-84d6-65795afc1687 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:11.466944 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-387234bd-6873-4d4d-84d6-65795afc1687 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:11.467661 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-387234bd-6873-4d4d-84d6-65795afc1687 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:12.000007 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-387234bd-6873-4d4d-84d6-65795afc1687 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:12.008893 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-387234bd-6873-4d4d-84d6-65795afc1687 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72" status: 200 len: 1474 microversion: 2.1 time: 0.565221 Aug 04 16:56:12.014515 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1970/3880] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:11 2022] GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72 => generated 1474 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:12.022815 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-77a4afc7-f340-4298-950a-bcebab198f66 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:12.026003 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-77a4afc7-f340-4298-950a-bcebab198f66 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:12.038578 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-77a4afc7-f340-4298-950a-bcebab198f66 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:12.040876 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-77a4afc7-f340-4298-950a-bcebab198f66 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:12.047730 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-77a4afc7-f340-4298-950a-bcebab198f66 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:12.048421 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-77a4afc7-f340-4298-950a-bcebab198f66 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:12.323494 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-77a4afc7-f340-4298-950a-bcebab198f66 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:12.336346 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-77a4afc7-f340-4298-950a-bcebab198f66 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:12.347389 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-77a4afc7-f340-4298-950a-bcebab198f66 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:12.350964 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-77a4afc7-f340-4298-950a-bcebab198f66 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 2031 microversion: 2.42 time: 0.335189 Aug 04 16:56:12.375482 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1971/3881] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:12 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 2031 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:12.587366 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-354a9f04-7d1d-4970-97f1-4800966f7d6c tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:12.597105 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-354a9f04-7d1d-4970-97f1-4800966f7d6c tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1" status: 200 len: 1518 microversion: 2.1 time: 1.436091 Aug 04 16:56:12.601839 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1911/3882] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:11 2022] GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 => generated 1518 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:12.666542 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-e3a8e3f3-3c3f-4ad2-9ae3-76dcffc73432 req-9c44d98c-f82b-4d6c-88d1-3ffd751f3884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69500bda-7084-4ba9-abc9-64d6fc905b72", "name": "network-vif-deleted", "tag": "cfb10957-085e-44a4-92f8-bba19149e905"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:12.703836 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-e3a8e3f3-3c3f-4ad2-9ae3-76dcffc73432 req-9c44d98c-f82b-4d6c-88d1-3ffd751f3884 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:12.704759 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-e3a8e3f3-3c3f-4ad2-9ae3-76dcffc73432 req-9c44d98c-f82b-4d6c-88d1-3ffd751f3884 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:12.730829 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-e3a8e3f3-3c3f-4ad2-9ae3-76dcffc73432 req-9c44d98c-f82b-4d6c-88d1-3ffd751f3884 service nova] Creating event network-vif-deleted:cfb10957-085e-44a4-92f8-bba19149e905 for instance 69500bda-7084-4ba9-abc9-64d6fc905b72 on n-h1-846466-12 Aug 04 16:56:12.742015 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-e3a8e3f3-3c3f-4ad2-9ae3-76dcffc73432 req-9c44d98c-f82b-4d6c-88d1-3ffd751f3884 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080494 Aug 04 16:56:12.742957 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1972/3883] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:13.038185 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1fbffbde-fcc0-4504-b42a-1ea554c9ae24 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:13.040217 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1fbffbde-fcc0-4504-b42a-1ea554c9ae24 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69500bda-7084-4ba9-abc9-64d6fc905b72] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:13.053116 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1fbffbde-fcc0-4504-b42a-1ea554c9ae24 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:13.062975 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1fbffbde-fcc0-4504-b42a-1ea554c9ae24 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:13.068696 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1fbffbde-fcc0-4504-b42a-1ea554c9ae24 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:13.070638 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1fbffbde-fcc0-4504-b42a-1ea554c9ae24 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:13.116480 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=100 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:13.260309 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1fbffbde-fcc0-4504-b42a-1ea554c9ae24 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:13.268744 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1fbffbde-fcc0-4504-b42a-1ea554c9ae24 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:13.276661 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-1fbffbde-fcc0-4504-b42a-1ea554c9ae24 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lazy-loading 'fault' on Instance uuid 69500bda-7084-4ba9-abc9-64d6fc905b72 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:56:13.389787 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3ec05beb-c6f2-496d-9a45-6929e430bf44 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:13.390505 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3ec05beb-c6f2-496d-9a45-6929e430bf44 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:13.401769 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1fbffbde-fcc0-4504-b42a-1ea554c9ae24 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:13.404597 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=95,nova_api:UPDATE=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:13.410019 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3ec05beb-c6f2-496d-9a45-6929e430bf44 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:13.410715 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3ec05beb-c6f2-496d-9a45-6929e430bf44 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:13.413354 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1fbffbde-fcc0-4504-b42a-1ea554c9ae24 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72" status: 200 len: 1319 microversion: 2.1 time: 0.379915 Aug 04 16:56:13.413963 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1912/3884] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:13 2022] GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72 => generated 1319 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:13.417496 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3ec05beb-c6f2-496d-9a45-6929e430bf44 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:13.418340 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3ec05beb-c6f2-496d-9a45-6929e430bf44 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:13.624115 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-69603023-c356-4035-b0f1-49c289e469a3 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:13.624745 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-69603023-c356-4035-b0f1-49c289e469a3 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:13.640467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3ec05beb-c6f2-496d-9a45-6929e430bf44 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:13.648351 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-69603023-c356-4035-b0f1-49c289e469a3 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:13.648806 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-69603023-c356-4035-b0f1-49c289e469a3 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:13.649624 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-69603023-c356-4035-b0f1-49c289e469a3 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:13.650064 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-69603023-c356-4035-b0f1-49c289e469a3 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:13.659376 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3ec05beb-c6f2-496d-9a45-6929e430bf44 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:13.667084 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3ec05beb-c6f2-496d-9a45-6929e430bf44 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:13.674610 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3ec05beb-c6f2-496d-9a45-6929e430bf44 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 2031 microversion: 2.42 time: 0.285726 Aug 04 16:56:13.694039 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1973/3885] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:13 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 2031 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:56:14.164671 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9896dc6d-9852-449d-8cc7-ed32d8a02462 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-651531158", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "5b3a9297-8ec1-4a18-9bd7-9544ef446197"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:14.212816 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-69603023-c356-4035-b0f1-49c289e469a3 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:14.227269 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-69603023-c356-4035-b0f1-49c289e469a3 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1" status: 200 len: 1524 microversion: 2.1 time: 0.607089 Aug 04 16:56:14.231082 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1913/3886] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:13 2022] GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 => generated 1524 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:14.305844 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-9896dc6d-9852-449d-8cc7-ed32d8a02462 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] validate_networks() for [('5b3a9297-8ec1-4a18-9bd7-9544ef446197', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:56:14.436752 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f774b203-7624-47d1-b502-429d59a6649b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:14.437625 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f774b203-7624-47d1-b502-429d59a6649b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69500bda-7084-4ba9-abc9-64d6fc905b72] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:14.452849 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f774b203-7624-47d1-b502-429d59a6649b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:14.456155 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f774b203-7624-47d1-b502-429d59a6649b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:14.457559 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f774b203-7624-47d1-b502-429d59a6649b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:14.458171 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f774b203-7624-47d1-b502-429d59a6649b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:14.516016 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-f774b203-7624-47d1-b502-429d59a6649b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] HTTP exception thrown: Instance 69500bda-7084-4ba9-abc9-64d6fc905b72 could not be found. Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f774b203-7624-47d1-b502-429d59a6649b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Request method failure captured: Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72 HTTP/1.1 Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_nQAsIL8Gtig2JiDfXWtIJ3WPqwL_iDK7Lzq6TGktfJLC3h9uoTgZsXj24J3msyyZQB5KWPirQK_R6x2-eYME28EQ_2bgNAh7DlNXEg7JFJsdnvAdfZMaqCmRUibanDLQxQgidHpyXwUg784UXcgxKrIZzuzT1AuaLsb_WysQnZpiA Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersTestJSON-750208524 Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa4bb1fda4ef4267829850c4c616df77"}]}] Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersTestJSON-750208524 Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersTestJSON-750208524 Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersTestJSON-750208524-project Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: db8a96da1d7943599ee6ca9df18f5148 Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersTestJSON-750208524-project Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 69500bda-7084-4ba9-abc9-64d6fc905b72 could not be found. Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '69500bda-7084-4ba9-abc9-64d6fc905b72'} Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69500bda-7084-4ba9-abc9-64d6fc905b72 could not be found. Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69500bda-7084-4ba9-abc9-64d6fc905b72 could not be found. Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:56:14.525341 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:14.529677 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:14.529677 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:14.529677 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:56:14.529677 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:56:14.529677 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69500bda-7084-4ba9-abc9-64d6fc905b72 could not be found. Aug 04 16:56:14.529677 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:56:14.529677 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f774b203-7624-47d1-b502-429d59a6649b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Returning 404 to user: Instance 69500bda-7084-4ba9-abc9-64d6fc905b72 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:14.530164 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f774b203-7624-47d1-b502-429d59a6649b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72" status: 404 len: 111 microversion: 2.1 time: 0.097426 Aug 04 16:56:14.532377 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1914/3887] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:14 2022] GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:56:14.547697 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2e67641f-92c2-41ee-9ec3-8feb5ee14d8a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '.version_select at 0x7f7e77b94ca0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:14.591745 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2e67641f-92c2-41ee-9ec3-8feb5ee14d8a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-key-1508278640" status: 202 len: 0 microversion: 2.1 time: 0.056802 Aug 04 16:56:14.593188 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1915/3888] 10.222.0.23 () {58 vars in 1209 bytes} [Thu Aug 4 16:56:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1508278640 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:56:14.705846 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f6fe7862-309b-40fa-9ffd-a11d229c13a7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:14.707412 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f6fe7862-309b-40fa-9ffd-a11d229c13a7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:14.723527 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6fe7862-309b-40fa-9ffd-a11d229c13a7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:14.728024 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6fe7862-309b-40fa-9ffd-a11d229c13a7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:14.729160 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6fe7862-309b-40fa-9ffd-a11d229c13a7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:14.729783 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6fe7862-309b-40fa-9ffd-a11d229c13a7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:14.912143 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f6fe7862-309b-40fa-9ffd-a11d229c13a7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:14.937674 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f6fe7862-309b-40fa-9ffd-a11d229c13a7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:14.941802 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f6fe7862-309b-40fa-9ffd-a11d229c13a7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:14.945463 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f6fe7862-309b-40fa-9ffd-a11d229c13a7 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 2031 microversion: 2.42 time: 0.246449 Aug 04 16:56:14.950161 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1916/3889] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:14 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 2031 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:14.965854 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-599ac937-9bcb-4c54-80a9-be34cc30bea8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1349265217", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "b83d6df0-d970-41bd-ae99-1dfc6211d426"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:15.131090 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-599ac937-9bcb-4c54-80a9-be34cc30bea8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] validate_networks() for [('b83d6df0-d970-41bd-ae99-1dfc6211d426', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:56:16.255299 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-9896dc6d-9852-449d-8cc7-ed32d8a02462 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:56:16.255837 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-9896dc6d-9852-449d-8cc7-ed32d8a02462 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:56:16.256397 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-9896dc6d-9852-449d-8cc7-ed32d8a02462 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:56:16.256973 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-9896dc6d-9852-449d-8cc7-ed32d8a02462 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:56:16.257884 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-9896dc6d-9852-449d-8cc7-ed32d8a02462 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:56:16.282667 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9896dc6d-9852-449d-8cc7-ed32d8a02462 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:16.283117 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9896dc6d-9852-449d-8cc7-ed32d8a02462 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:16.284479 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9896dc6d-9852-449d-8cc7-ed32d8a02462 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:16.284937 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9896dc6d-9852-449d-8cc7-ed32d8a02462 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:16.331640 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-9896dc6d-9852-449d-8cc7-ed32d8a02462 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Getting quotas for project 1c89cc0bcf344df1a27f675fd1fa387a. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:56:16.342327 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-9896dc6d-9852-449d-8cc7-ed32d8a02462 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Getting quotas for user 176b01b667bd4f38b8d0438206a0deb5 and project 1c89cc0bcf344df1a27f675fd1fa387a. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:56:16.383785 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9896dc6d-9852-449d-8cc7-ed32d8a02462 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:56:16.391942 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9896dc6d-9852-449d-8cc7-ed32d8a02462 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 35e71704-0700-4b89-a138-a0d8590f47d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:56:16.481635 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9896dc6d-9852-449d-8cc7-ed32d8a02462 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.786227 Aug 04 16:56:16.482713 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1974/3890] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:56:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:56:16.487784 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dba5c51a-d41c-4179-91a2-56e190776d02 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:16.488404 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dba5c51a-d41c-4179-91a2-56e190776d02 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:16.513363 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dba5c51a-d41c-4179-91a2-56e190776d02 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:16.513815 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dba5c51a-d41c-4179-91a2-56e190776d02 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:16.514775 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dba5c51a-d41c-4179-91a2-56e190776d02 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:16.515363 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dba5c51a-d41c-4179-91a2-56e190776d02 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:16.861225 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-599ac937-9bcb-4c54-80a9-be34cc30bea8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:56:16.861744 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-599ac937-9bcb-4c54-80a9-be34cc30bea8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:56:16.862262 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-599ac937-9bcb-4c54-80a9-be34cc30bea8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:56:16.864502 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-599ac937-9bcb-4c54-80a9-be34cc30bea8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:56:16.865458 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-599ac937-9bcb-4c54-80a9-be34cc30bea8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:56:16.878919 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-599ac937-9bcb-4c54-80a9-be34cc30bea8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:16.879673 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-599ac937-9bcb-4c54-80a9-be34cc30bea8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:16.881506 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-599ac937-9bcb-4c54-80a9-be34cc30bea8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:16.885739 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-599ac937-9bcb-4c54-80a9-be34cc30bea8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:16.896877 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dba5c51a-d41c-4179-91a2-56e190776d02 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:16.919637 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-599ac937-9bcb-4c54-80a9-be34cc30bea8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Getting quotas for project fa4bb1fda4ef4267829850c4c616df77. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:56:16.919945 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dba5c51a-d41c-4179-91a2-56e190776d02 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1" status: 200 len: 1524 microversion: 2.1 time: 0.435840 Aug 04 16:56:16.931668 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-599ac937-9bcb-4c54-80a9-be34cc30bea8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Getting quotas for user db8a96da1d7943599ee6ca9df18f5148 and project fa4bb1fda4ef4267829850c4c616df77. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:56:16.940794 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1975/3891] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:16 2022] GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 => generated 1524 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:16.950486 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-599ac937-9bcb-4c54-80a9-be34cc30bea8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:56:16.953662 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-599ac937-9bcb-4c54-80a9-be34cc30bea8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 9c37f5dc-fee0-447d-bc96-db9b59933f8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:56:16.959890 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b66ef465-e883-4f16-80b7-a1a624e0e9a1 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:16.961094 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b66ef465-e883-4f16-80b7-a1a624e0e9a1 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:16.979670 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b66ef465-e883-4f16-80b7-a1a624e0e9a1 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:16.980414 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b66ef465-e883-4f16-80b7-a1a624e0e9a1 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:16.983321 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b66ef465-e883-4f16-80b7-a1a624e0e9a1 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:16.985850 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b66ef465-e883-4f16-80b7-a1a624e0e9a1 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:17.044453 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-599ac937-9bcb-4c54-80a9-be34cc30bea8 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.087639 Aug 04 16:56:17.047522 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1917/3892] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:56:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:56:17.060871 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-41ed93c1-ea48-4018-a1c8-d12236c9861f tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1970685949", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1780717108", "security_groups": [{"name": "tempest-secgroup-smoke-341242677"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "eff60721-912f-41c2-947c-f38abbb2022c"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:17.390587 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b66ef465-e883-4f16-80b7-a1a624e0e9a1 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:17.417837 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b66ef465-e883-4f16-80b7-a1a624e0e9a1 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:17.448781 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b66ef465-e883-4f16-80b7-a1a624e0e9a1 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:17.461175 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b66ef465-e883-4f16-80b7-a1a624e0e9a1 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 2031 microversion: 2.42 time: 0.513505 Aug 04 16:56:17.465202 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1976/3893] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:16 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 2031 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:17.557602 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-41ed93c1-ea48-4018-a1c8-d12236c9861f tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] validate_networks() for [('eff60721-912f-41c2-947c-f38abbb2022c', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:56:18.333922 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-02c39e73-a48f-406e-a620-7b0e5e17640e tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Action: 'create', calling method: .version_select at 0x7f7e89b8d940>, body: {"keypair": {"name": "tempest-keypair-1364397205", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLrdOFKzf54biJVzdST1Nv4QnZ+VQzBk2wiBPRwbVStBJD3N4dB/7fXwesbDQ/9y8b8z0fSVuT8GrqXdrUTc0AKkNU/Wg9usN5Uap+791G45DUu9TaL6c7ylfySWTH1zQ=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:18.399749 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-02c39e73-a48f-406e-a620-7b0e5e17640e tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Getting quotas for project 2534921e8a2f47d394059fee872426a8. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:56:18.433586 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-02c39e73-a48f-406e-a620-7b0e5e17640e tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Getting quotas for user d82f4a672b154291a412a282d1a88208 and project 2534921e8a2f47d394059fee872426a8. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:56:18.523276 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-02c39e73-a48f-406e-a620-7b0e5e17640e tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.051498 Aug 04 16:56:18.535317 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1977/3894] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 16:56:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:18.543341 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-79dc7281-1628-43c3-b4f8-a1a6a5ce083a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1078916236", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "5b3a9297-8ec1-4a18-9bd7-9544ef446197"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:18.713862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-79dc7281-1628-43c3-b4f8-a1a6a5ce083a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] validate_networks() for [('5b3a9297-8ec1-4a18-9bd7-9544ef446197', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:56:19.164738 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-41ed93c1-ea48-4018-a1c8-d12236c9861f tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Getting quotas for project 7c93b891c0324a8cace12fb77490ad16. Resources: dict_keys(['metadata_items']) {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:56:19.182183 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-41ed93c1-ea48-4018-a1c8-d12236c9861f tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Getting quotas for user 34126dbe898545fd9d7e03b55880ab53 and project 7c93b891c0324a8cace12fb77490ad16. Resources: dict_keys(['metadata_items']) {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:56:19.230998 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-41ed93c1-ea48-4018-a1c8-d12236c9861f tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:56:19.254568 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-41ed93c1-ea48-4018-a1c8-d12236c9861f tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:56:19.255301 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-41ed93c1-ea48-4018-a1c8-d12236c9861f tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:56:19.265824 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-41ed93c1-ea48-4018-a1c8-d12236c9861f tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:56:19.266569 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-41ed93c1-ea48-4018-a1c8-d12236c9861f tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:56:19.292784 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-41ed93c1-ea48-4018-a1c8-d12236c9861f tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:19.293536 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-41ed93c1-ea48-4018-a1c8-d12236c9861f tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:19.297019 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-41ed93c1-ea48-4018-a1c8-d12236c9861f tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:19.299735 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-41ed93c1-ea48-4018-a1c8-d12236c9861f tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:19.376496 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-41ed93c1-ea48-4018-a1c8-d12236c9861f tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Getting quotas for project 7c93b891c0324a8cace12fb77490ad16. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:56:19.406215 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-41ed93c1-ea48-4018-a1c8-d12236c9861f tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Getting quotas for user 34126dbe898545fd9d7e03b55880ab53 and project 7c93b891c0324a8cace12fb77490ad16. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:56:19.463460 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-41ed93c1-ea48-4018-a1c8-d12236c9861f tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:56:19.491982 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-41ed93c1-ea48-4018-a1c8-d12236c9861f tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] [instance: cab40427-161a-4071-8c75-1a402c924402] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:56:19.537412 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:19.661247 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-41ed93c1-ea48-4018-a1c8-d12236c9861f tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.605820 Aug 04 16:56:19.670984 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1918/3895] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:56:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 2616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:56:19.751738 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bab428e7-b5e7-4d4e-a38d-fa611b4e160e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:19.752525 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bab428e7-b5e7-4d4e-a38d-fa611b4e160e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 9c37f5dc-fee0-447d-bc96-db9b59933f8f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:19.776730 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bab428e7-b5e7-4d4e-a38d-fa611b4e160e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:19.794185 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bab428e7-b5e7-4d4e-a38d-fa611b4e160e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:19.804988 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bab428e7-b5e7-4d4e-a38d-fa611b4e160e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:19.807408 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bab428e7-b5e7-4d4e-a38d-fa611b4e160e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:21.996101 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bab428e7-b5e7-4d4e-a38d-fa611b4e160e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:22.037807 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bab428e7-b5e7-4d4e-a38d-fa611b4e160e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f" status: 200 len: 1261 microversion: 2.1 time: 2.353457 Aug 04 16:56:22.044661 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1919/3896] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:19 2022] GET /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f => generated 1261 bytes in 2372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:22.078124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c2806a87-2e53-43dc-8cbe-161237c43392 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:22.079213 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c2806a87-2e53-43dc-8cbe-161237c43392 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:22.095500 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c2806a87-2e53-43dc-8cbe-161237c43392 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:22.097631 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c2806a87-2e53-43dc-8cbe-161237c43392 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:22.110755 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c2806a87-2e53-43dc-8cbe-161237c43392 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:22.118062 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c2806a87-2e53-43dc-8cbe-161237c43392 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:23.624545 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c2806a87-2e53-43dc-8cbe-161237c43392 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:23.644222 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c2806a87-2e53-43dc-8cbe-161237c43392 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1" status: 200 len: 1524 microversion: 2.1 time: 1.595662 Aug 04 16:56:23.648491 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1920/3897] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:22 2022] GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 => generated 1524 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:23.681997 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8a32afe5-10d5-4c35-ac92-cc34316e44e6 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:23.682612 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8a32afe5-10d5-4c35-ac92-cc34316e44e6 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:23.703116 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a32afe5-10d5-4c35-ac92-cc34316e44e6 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:23.704294 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a32afe5-10d5-4c35-ac92-cc34316e44e6 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:23.706267 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a32afe5-10d5-4c35-ac92-cc34316e44e6 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:23.707051 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a32afe5-10d5-4c35-ac92-cc34316e44e6 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:24.003511 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8a32afe5-10d5-4c35-ac92-cc34316e44e6 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:24.031432 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8a32afe5-10d5-4c35-ac92-cc34316e44e6 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:24.038195 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8a32afe5-10d5-4c35-ac92-cc34316e44e6 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:24.040838 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8a32afe5-10d5-4c35-ac92-cc34316e44e6 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 2031 microversion: 2.42 time: 0.376503 Aug 04 16:56:24.043131 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1921/3898] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:23 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 2031 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:24.054609 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-14a7a335-38c8-437b-a2ac-faaefb61d0b7 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:24.062546 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-14a7a335-38c8-437b-a2ac-faaefb61d0b7 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] [instance: cab40427-161a-4071-8c75-1a402c924402] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:24.083808 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-14a7a335-38c8-437b-a2ac-faaefb61d0b7 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:24.084256 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-14a7a335-38c8-437b-a2ac-faaefb61d0b7 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:24.085079 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-14a7a335-38c8-437b-a2ac-faaefb61d0b7 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:24.107925 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-14a7a335-38c8-437b-a2ac-faaefb61d0b7 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:24.408755 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-14a7a335-38c8-437b-a2ac-faaefb61d0b7 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34126dbe898545fd9d7e03b55880ab53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c93b891c0324a8cace12fb77490ad16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:24.425832 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-14a7a335-38c8-437b-a2ac-faaefb61d0b7 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] 10.222.0.23 "GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402" status: 200 len: 1361 microversion: 2.1 time: 0.373136 Aug 04 16:56:24.439241 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1922/3899] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:24 2022] GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402 => generated 1361 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:24.439241 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c0ac5c31-0bb7-4143-9586-3bdddb25c13d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:24.439241 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c0ac5c31-0bb7-4143-9586-3bdddb25c13d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 9c37f5dc-fee0-447d-bc96-db9b59933f8f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:24.450218 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c0ac5c31-0bb7-4143-9586-3bdddb25c13d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:24.450570 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c0ac5c31-0bb7-4143-9586-3bdddb25c13d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:24.451404 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c0ac5c31-0bb7-4143-9586-3bdddb25c13d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:24.451843 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c0ac5c31-0bb7-4143-9586-3bdddb25c13d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:24.613661 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-79dc7281-1628-43c3-b4f8-a1a6a5ce083a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:56:24.614221 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-79dc7281-1628-43c3-b4f8-a1a6a5ce083a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:56:24.614539 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-79dc7281-1628-43c3-b4f8-a1a6a5ce083a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:56:24.614947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-79dc7281-1628-43c3-b4f8-a1a6a5ce083a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:56:24.615533 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-79dc7281-1628-43c3-b4f8-a1a6a5ce083a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:56:24.637105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-79dc7281-1628-43c3-b4f8-a1a6a5ce083a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:24.638762 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-79dc7281-1628-43c3-b4f8-a1a6a5ce083a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:24.640648 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-79dc7281-1628-43c3-b4f8-a1a6a5ce083a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:24.641535 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-79dc7281-1628-43c3-b4f8-a1a6a5ce083a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:24.662857 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:24.699638 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-79dc7281-1628-43c3-b4f8-a1a6a5ce083a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Getting quotas for project 1c89cc0bcf344df1a27f675fd1fa387a. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:56:24.713646 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-79dc7281-1628-43c3-b4f8-a1a6a5ce083a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Getting quotas for user 176b01b667bd4f38b8d0438206a0deb5 and project 1c89cc0bcf344df1a27f675fd1fa387a. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:56:24.751977 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-79dc7281-1628-43c3-b4f8-a1a6a5ce083a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:56:24.761302 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-79dc7281-1628-43c3-b4f8-a1a6a5ce083a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 3ea25507-d70a-43c8-9491-19c8f4435217] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:56:24.876308 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-79dc7281-1628-43c3-b4f8-a1a6a5ce083a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.345031 Aug 04 16:56:24.881637 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1978/3900] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:56:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 6352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:56:24.902283 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-807f89bd-117e-4f60-8b1d-78e2c13c304b req-57b1491e-12ba-4d91-bf9d-5f192ce175ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14749b47-d48c-46f0-a650-27ee70f5edf1", "name": "network-vif-plugged", "status": "completed", "tag": "d1f06683-5886-4ea6-87e1-00a459987356"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:24.944740 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-807f89bd-117e-4f60-8b1d-78e2c13c304b req-57b1491e-12ba-4d91-bf9d-5f192ce175ba service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:24.945193 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-807f89bd-117e-4f60-8b1d-78e2c13c304b req-57b1491e-12ba-4d91-bf9d-5f192ce175ba service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:24.992774 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-807f89bd-117e-4f60-8b1d-78e2c13c304b req-57b1491e-12ba-4d91-bf9d-5f192ce175ba service nova] Creating event network-vif-plugged:d1f06683-5886-4ea6-87e1-00a459987356 for instance 14749b47-d48c-46f0-a650-27ee70f5edf1 on n-h2-846466-12 Aug 04 16:56:25.009630 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-807f89bd-117e-4f60-8b1d-78e2c13c304b req-57b1491e-12ba-4d91-bf9d-5f192ce175ba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126625 Aug 04 16:56:25.013636 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c0ac5c31-0bb7-4143-9586-3bdddb25c13d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:25.015410 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1979/3901] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:25.045314 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c0ac5c31-0bb7-4143-9586-3bdddb25c13d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f" status: 200 len: 1267 microversion: 2.1 time: 0.614911 Aug 04 16:56:25.049236 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1923/3902] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:24 2022] GET /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f => generated 1267 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:25.054438 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f397a609-35fb-40c1-bd19-232240dba358 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:25.055192 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f397a609-35fb-40c1-bd19-232240dba358 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:25.073738 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2e83f25a-b747-4208-8fbc-aad92f58893e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:25.074776 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2e83f25a-b747-4208-8fbc-aad92f58893e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:25.077844 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f397a609-35fb-40c1-bd19-232240dba358 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:25.078297 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f397a609-35fb-40c1-bd19-232240dba358 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:25.090626 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2e83f25a-b747-4208-8fbc-aad92f58893e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:25.091384 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2e83f25a-b747-4208-8fbc-aad92f58893e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:25.092455 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2e83f25a-b747-4208-8fbc-aad92f58893e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:25.093912 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f397a609-35fb-40c1-bd19-232240dba358 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:25.095093 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f397a609-35fb-40c1-bd19-232240dba358 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:25.096563 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2e83f25a-b747-4208-8fbc-aad92f58893e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:25.650088 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2e83f25a-b747-4208-8fbc-aad92f58893e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:25.661368 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2e83f25a-b747-4208-8fbc-aad92f58893e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:25.667368 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2e83f25a-b747-4208-8fbc-aad92f58893e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:25.683995 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2e83f25a-b747-4208-8fbc-aad92f58893e tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 2031 microversion: 2.42 time: 0.616436 Aug 04 16:56:25.689617 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1924/3903] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:25 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 2031 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:56:25.706525 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4a614e41-9b10-42b1-aa28-45910c1547b7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2018643451", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "451", "networks": [{"uuid": "5b3a9297-8ec1-4a18-9bd7-9544ef446197"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:25.874566 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-4a614e41-9b10-42b1-aa28-45910c1547b7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] validate_networks() for [('5b3a9297-8ec1-4a18-9bd7-9544ef446197', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:56:26.945562 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f397a609-35fb-40c1-bd19-232240dba358 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:26.975455 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f397a609-35fb-40c1-bd19-232240dba358 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1" status: 200 len: 1524 microversion: 2.1 time: 1.954860 Aug 04 16:56:26.989314 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1980/3904] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:25 2022] GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 => generated 1524 bytes in 1962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:26.994993 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-863ed0a2-0002-4264-9542-423ffcef9123 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:27.001714 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-863ed0a2-0002-4264-9542-423ffcef9123 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] [instance: cab40427-161a-4071-8c75-1a402c924402] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:27.023953 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-863ed0a2-0002-4264-9542-423ffcef9123 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:27.028889 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-863ed0a2-0002-4264-9542-423ffcef9123 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:27.032962 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-863ed0a2-0002-4264-9542-423ffcef9123 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:27.035672 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-863ed0a2-0002-4264-9542-423ffcef9123 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:27.733724 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-863ed0a2-0002-4264-9542-423ffcef9123 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34126dbe898545fd9d7e03b55880ab53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c93b891c0324a8cace12fb77490ad16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:27.766435 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-863ed0a2-0002-4264-9542-423ffcef9123 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] 10.222.0.23 "GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402" status: 200 len: 1361 microversion: 2.1 time: 0.765892 Aug 04 16:56:27.767137 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1981/3905] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:26 2022] GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402 => generated 1361 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:27.793712 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-67b61476-2486-4355-8b23-37247b1f8477 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:27.794467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-67b61476-2486-4355-8b23-37247b1f8477 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 9c37f5dc-fee0-447d-bc96-db9b59933f8f] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:27.813956 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-67b61476-2486-4355-8b23-37247b1f8477 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:27.814887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-67b61476-2486-4355-8b23-37247b1f8477 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:27.824707 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-67b61476-2486-4355-8b23-37247b1f8477 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:27.825796 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-67b61476-2486-4355-8b23-37247b1f8477 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:29.324367 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=4 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:29.441246 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=20 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:29.518425 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-67b61476-2486-4355-8b23-37247b1f8477 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:29.557691 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-67b61476-2486-4355-8b23-37247b1f8477 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f" status: 200 len: 1309 microversion: 2.1 time: 1.789350 Aug 04 16:56:29.560519 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1982/3906] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:27 2022] GET /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f => generated 1309 bytes in 1793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:29.570359 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-92c44f6d-6b7a-4ec4-86e0-291a3657bfc0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:29.572131 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-92c44f6d-6b7a-4ec4-86e0-291a3657bfc0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:29.582523 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-92c44f6d-6b7a-4ec4-86e0-291a3657bfc0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:29.583798 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-92c44f6d-6b7a-4ec4-86e0-291a3657bfc0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:29.585354 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-92c44f6d-6b7a-4ec4-86e0-291a3657bfc0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:29.586022 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-92c44f6d-6b7a-4ec4-86e0-291a3657bfc0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:29.977214 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-92c44f6d-6b7a-4ec4-86e0-291a3657bfc0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:29.977766 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-92c44f6d-6b7a-4ec4-86e0-291a3657bfc0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:29.978422 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-92c44f6d-6b7a-4ec4-86e0-291a3657bfc0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lazy-loading 'fault' on Instance uuid 8e273267-ae4b-4a99-821e-1c02c3440610 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:56:30.037498 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-4a614e41-9b10-42b1-aa28-45910c1547b7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:56:30.037998 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-4a614e41-9b10-42b1-aa28-45910c1547b7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:56:30.038590 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-4a614e41-9b10-42b1-aa28-45910c1547b7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:56:30.039058 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-4a614e41-9b10-42b1-aa28-45910c1547b7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:56:30.039763 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-4a614e41-9b10-42b1-aa28-45910c1547b7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:56:30.063894 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4a614e41-9b10-42b1-aa28-45910c1547b7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:30.064592 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4a614e41-9b10-42b1-aa28-45910c1547b7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:30.066507 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4a614e41-9b10-42b1-aa28-45910c1547b7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:30.067229 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4a614e41-9b10-42b1-aa28-45910c1547b7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:30.085460 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-92c44f6d-6b7a-4ec4-86e0-291a3657bfc0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:30.105419 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-4a614e41-9b10-42b1-aa28-45910c1547b7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Getting quotas for project 1c89cc0bcf344df1a27f675fd1fa387a. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:56:30.114188 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-92c44f6d-6b7a-4ec4-86e0-291a3657bfc0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:30.116771 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-4a614e41-9b10-42b1-aa28-45910c1547b7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Getting quotas for user 176b01b667bd4f38b8d0438206a0deb5 and project 1c89cc0bcf344df1a27f675fd1fa387a. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:56:30.118921 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-92c44f6d-6b7a-4ec4-86e0-291a3657bfc0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb42db61b34dd2a4ba2a8ffa984684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fcc0fe6bb74058a0125be27a3a7090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:30.120767 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-92c44f6d-6b7a-4ec4-86e0-291a3657bfc0 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 200 len: 1798 microversion: 2.42 time: 0.557891 Aug 04 16:56:30.122627 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1983/3907] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:29 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 1798 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:30.131303 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8a100c20-9599-4d78-be10-d0b3600ed7b3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-930974696", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ceca6d76-bb57-49ce-899c-2985b37b1ce6"}], "security_groups": [{"name": "tempest-securitygroup--1406307788"}], "key_name": "tempest-keypair-1364397205", "user_data": "}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:30.157904 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4a614e41-9b10-42b1-aa28-45910c1547b7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:56:30.160239 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4a614e41-9b10-42b1-aa28-45910c1547b7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 1664bfb4-4517-4700-ac66-79dc4586b387] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:56:30.297387 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4a614e41-9b10-42b1-aa28-45910c1547b7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.605550 Aug 04 16:56:30.304666 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1925/3908] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:56:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 4608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:56:30.309959 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1fb22c87-1507-4790-b974-60c4c66cbf9a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:30.312220 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1fb22c87-1507-4790-b974-60c4c66cbf9a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:30.323623 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1fb22c87-1507-4790-b974-60c4c66cbf9a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:30.324760 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1fb22c87-1507-4790-b974-60c4c66cbf9a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:30.327481 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1fb22c87-1507-4790-b974-60c4c66cbf9a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:30.328249 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1fb22c87-1507-4790-b974-60c4c66cbf9a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:30.498476 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-8a100c20-9599-4d78-be10-d0b3600ed7b3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] validate_networks() for [('ceca6d76-bb57-49ce-899c-2985b37b1ce6', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:56:31.036402 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1fb22c87-1507-4790-b974-60c4c66cbf9a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:31.056530 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1fb22c87-1507-4790-b974-60c4c66cbf9a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1" status: 200 len: 1509 microversion: 2.1 time: 0.756462 Aug 04 16:56:31.057460 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1926/3909] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:30 2022] GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 => generated 1509 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:31.079143 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3be20ee4-8f33-4c97-a79a-785a8638b043 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:31.080391 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3be20ee4-8f33-4c97-a79a-785a8638b043 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] [instance: cab40427-161a-4071-8c75-1a402c924402] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:31.102338 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3be20ee4-8f33-4c97-a79a-785a8638b043 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:31.103615 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3be20ee4-8f33-4c97-a79a-785a8638b043 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:31.106710 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3be20ee4-8f33-4c97-a79a-785a8638b043 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:31.107574 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3be20ee4-8f33-4c97-a79a-785a8638b043 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:31.806767 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3be20ee4-8f33-4c97-a79a-785a8638b043 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34126dbe898545fd9d7e03b55880ab53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c93b891c0324a8cace12fb77490ad16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:31.823072 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3be20ee4-8f33-4c97-a79a-785a8638b043 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] 10.222.0.23 "GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402" status: 200 len: 1428 microversion: 2.1 time: 0.763944 Aug 04 16:56:31.834158 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1927/3910] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:31 2022] GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402 => generated 1428 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:31.839523 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-39338466-2e5c-491a-b3fa-1dda87846e23 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:31.839523 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-39338466-2e5c-491a-b3fa-1dda87846e23 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 1664bfb4-4517-4700-ac66-79dc4586b387] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:31.853352 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39338466-2e5c-491a-b3fa-1dda87846e23 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:31.854109 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39338466-2e5c-491a-b3fa-1dda87846e23 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:31.855122 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39338466-2e5c-491a-b3fa-1dda87846e23 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:31.856121 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39338466-2e5c-491a-b3fa-1dda87846e23 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:32.011247 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-39338466-2e5c-491a-b3fa-1dda87846e23 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:32.026085 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-39338466-2e5c-491a-b3fa-1dda87846e23 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387" status: 200 len: 1281 microversion: 2.1 time: 0.199867 Aug 04 16:56:32.043617 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1928/3911] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:31 2022] GET /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387 => generated 1281 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:32.055895 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-1cb6bcb0-e24c-4bdd-833a-c42ad7539580 req-6ef0c0fb-8a0e-4702-bffd-07fa2eb2c248 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35e71704-0700-4b89-a138-a0d8590f47d7", "tag": "77a2d853-c3b5-4de0-abfc-fa285b54172d"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:32.070624 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-1cb6bcb0-e24c-4bdd-833a-c42ad7539580 req-6ef0c0fb-8a0e-4702-bffd-07fa2eb2c248 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:32.071357 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-1cb6bcb0-e24c-4bdd-833a-c42ad7539580 req-6ef0c0fb-8a0e-4702-bffd-07fa2eb2c248 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:32.093797 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-1cb6bcb0-e24c-4bdd-833a-c42ad7539580 req-6ef0c0fb-8a0e-4702-bffd-07fa2eb2c248 service nova] Creating event network-changed:77a2d853-c3b5-4de0-abfc-fa285b54172d for instance 35e71704-0700-4b89-a138-a0d8590f47d7 on n-h1-846466-12 Aug 04 16:56:32.101387 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-1cb6bcb0-e24c-4bdd-833a-c42ad7539580 req-6ef0c0fb-8a0e-4702-bffd-07fa2eb2c248 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051440 Aug 04 16:56:32.102279 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1929/3912] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:32.110116 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-002b3fca-e579-4fb5-8d6d-597fb73cc84c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:32.111112 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-002b3fca-e579-4fb5-8d6d-597fb73cc84c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 9c37f5dc-fee0-447d-bc96-db9b59933f8f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:32.126951 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-002b3fca-e579-4fb5-8d6d-597fb73cc84c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:32.127895 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-002b3fca-e579-4fb5-8d6d-597fb73cc84c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:32.129351 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-002b3fca-e579-4fb5-8d6d-597fb73cc84c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:32.130152 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-002b3fca-e579-4fb5-8d6d-597fb73cc84c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:32.408152 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-8a100c20-9599-4d78-be10-d0b3600ed7b3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:56:32.409025 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-8a100c20-9599-4d78-be10-d0b3600ed7b3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:56:32.410086 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-8a100c20-9599-4d78-be10-d0b3600ed7b3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:56:32.410505 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-8a100c20-9599-4d78-be10-d0b3600ed7b3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:56:32.411298 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-8a100c20-9599-4d78-be10-d0b3600ed7b3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:56:32.437366 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8a100c20-9599-4d78-be10-d0b3600ed7b3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:32.439825 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8a100c20-9599-4d78-be10-d0b3600ed7b3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:32.442113 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8a100c20-9599-4d78-be10-d0b3600ed7b3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:32.444212 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8a100c20-9599-4d78-be10-d0b3600ed7b3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:32.484660 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-8a100c20-9599-4d78-be10-d0b3600ed7b3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Getting quotas for project 2534921e8a2f47d394059fee872426a8. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:56:32.498168 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-8a100c20-9599-4d78-be10-d0b3600ed7b3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Getting quotas for user d82f4a672b154291a412a282d1a88208 and project 2534921e8a2f47d394059fee872426a8. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:56:32.523964 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8a100c20-9599-4d78-be10-d0b3600ed7b3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:56:32.529800 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8a100c20-9599-4d78-be10-d0b3600ed7b3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 760130d2-374e-4f4c-a73b-d7a99449e324] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:56:32.553557 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-002b3fca-e579-4fb5-8d6d-597fb73cc84c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:32.571737 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-002b3fca-e579-4fb5-8d6d-597fb73cc84c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f" status: 200 len: 1309 microversion: 2.1 time: 0.467339 Aug 04 16:56:32.573372 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1930/3913] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:32 2022] GET /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f => generated 1309 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:32.589564 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-35024c19-766b-4f43-a25f-685c03c67b90 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:32.590496 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-35024c19-766b-4f43-a25f-685c03c67b90 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:32.597903 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-35024c19-766b-4f43-a25f-685c03c67b90 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:32.598731 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-35024c19-766b-4f43-a25f-685c03c67b90 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:32.599760 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-35024c19-766b-4f43-a25f-685c03c67b90 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:32.600364 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-35024c19-766b-4f43-a25f-685c03c67b90 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:32.672110 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8a100c20-9599-4d78-be10-d0b3600ed7b3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.547917 Aug 04 16:56:32.673310 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1984/3914] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:56:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 2550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:56:32.694623 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ebc82260-2ff1-484b-a313-2f1618b618ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:32.697213 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ebc82260-2ff1-484b-a313-2f1618b618ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:32.705920 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ebc82260-2ff1-484b-a313-2f1618b618ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:32.706895 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ebc82260-2ff1-484b-a313-2f1618b618ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:32.707887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ebc82260-2ff1-484b-a313-2f1618b618ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:32.708509 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ebc82260-2ff1-484b-a313-2f1618b618ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:32.728440 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-ebc82260-2ff1-484b-a313-2f1618b618ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] HTTP exception thrown: Instance 8e273267-ae4b-4a99-821e-1c02c3440610 could not be found. Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ebc82260-2ff1-484b-a313-2f1618b618ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Request method failure captured: Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 HTTP/1.1 Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_hgQoldjm4_S3D94fDziXOCZOUcaEPIkok-kHbJHwUIzdGtcvkeBillRoIFaYXJsu7Tk4pMCR2QNHeQAvXq9QWucd4UqSLiPvzhfZDHUM-vqwSlXnpNF9f6diokGYUDCYY9TLy2cAYVevZKnVsF5LRgOY_zzwpHs1nxXrYIShHutYI Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: X-Openstack-Nova-Api-Version: 2.42 Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: b9fcc0fe6bb74058a0125be27a3a7090 Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1525214697 Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9fcc0fe6bb74058a0125be27a3a7090"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b9fcc0fe6bb74058a0125be27a3a7090"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9fcc0fe6bb74058a0125be27a3a7090"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b9fcc0fe6bb74058a0125be27a3a7090"}]}] Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1525214697 Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: b9fcc0fe6bb74058a0125be27a3a7090 Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1525214697 Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-TaggedBootDevicesTest_v242-1525214697-project Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 1ebb42db61b34dd2a4ba2a8ffa984684 Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1525214697-project Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 8e273267-ae4b-4a99-821e-1c02c3440610 could not be found. Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '8e273267-ae4b-4a99-821e-1c02c3440610'} Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e273267-ae4b-4a99-821e-1c02c3440610 could not be found. Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e273267-ae4b-4a99-821e-1c02c3440610 could not be found. Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:56:32.730531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:32.734372 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:56:32.734372 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:32.734372 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:32.734372 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:32.734372 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:56:32.734372 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:56:32.734372 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e273267-ae4b-4a99-821e-1c02c3440610 could not be found. Aug 04 16:56:32.734372 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:56:32.736761 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ebc82260-2ff1-484b-a313-2f1618b618ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Returning 404 to user: Instance 8e273267-ae4b-4a99-821e-1c02c3440610 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:32.738682 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ebc82260-2ff1-484b-a313-2f1618b618ea tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 404 len: 111 microversion: 2.42 time: 0.064226 Aug 04 16:56:32.739935 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1985/3915] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:32 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:56:32.745198 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b5bdd3aa-5747-44dc-a243-5937c385c414 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:32.746358 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b5bdd3aa-5747-44dc-a243-5937c385c414 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 760130d2-374e-4f4c-a73b-d7a99449e324] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:33.123174 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b5bdd3aa-5747-44dc-a243-5937c385c414 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:33.132993 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b5bdd3aa-5747-44dc-a243-5937c385c414 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324" status: 200 len: 1241 microversion: 2.1 time: 0.391602 Aug 04 16:56:33.134265 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1986/3916] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:32 2022] GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324 => generated 1241 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:33.139661 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7a35db2a-c8e2-40f6-b821-46b39f1686a2 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '.version_select at 0x7f7e775e2040>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:33.186519 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7a35db2a-c8e2-40f6-b821-46b39f1686a2 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1732731097" status: 204 len: 0 microversion: 2.42 time: 0.050860 Aug 04 16:56:33.187933 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1987/3917] 10.222.0.23 () {60 vars in 1262 bytes} [Thu Aug 4 16:56:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1732731097 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 16:56:33.210705 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a1a9fdc4-6101-4950-86ae-de52a928c6a6 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:33.216742 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a1a9fdc4-6101-4950-86ae-de52a928c6a6 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] [instance: cab40427-161a-4071-8c75-1a402c924402] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:33.237193 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a1a9fdc4-6101-4950-86ae-de52a928c6a6 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:33.238112 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a1a9fdc4-6101-4950-86ae-de52a928c6a6 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:33.239928 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a1a9fdc4-6101-4950-86ae-de52a928c6a6 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:33.250314 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a1a9fdc4-6101-4950-86ae-de52a928c6a6 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:33.575790 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-35024c19-766b-4f43-a25f-685c03c67b90 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:33.591675 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-35024c19-766b-4f43-a25f-685c03c67b90 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1" status: 200 len: 1509 microversion: 2.1 time: 1.014512 Aug 04 16:56:33.609967 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1931/3918] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:32 2022] GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 => generated 1509 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:33.618124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-70d9d647-d99f-49b4-bb38-846beca14d96 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:33.618805 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-70d9d647-d99f-49b4-bb38-846beca14d96 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 1664bfb4-4517-4700-ac66-79dc4586b387] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:33.628175 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70d9d647-d99f-49b4-bb38-846beca14d96 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:33.628919 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70d9d647-d99f-49b4-bb38-846beca14d96 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:33.629965 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70d9d647-d99f-49b4-bb38-846beca14d96 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:33.630599 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70d9d647-d99f-49b4-bb38-846beca14d96 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:34.240958 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a1a9fdc4-6101-4950-86ae-de52a928c6a6 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34126dbe898545fd9d7e03b55880ab53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c93b891c0324a8cace12fb77490ad16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:34.261566 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a1a9fdc4-6101-4950-86ae-de52a928c6a6 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] 10.222.0.23 "GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402" status: 200 len: 1428 microversion: 2.1 time: 1.070936 Aug 04 16:56:34.277139 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1988/3919] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:33 2022] GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402 => generated 1428 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:34.385677 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-70d9d647-d99f-49b4-bb38-846beca14d96 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:34.392672 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=100 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:34.414466 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-70d9d647-d99f-49b4-bb38-846beca14d96 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387" status: 200 len: 1321 microversion: 2.1 time: 0.805540 Aug 04 16:56:34.420875 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1932/3920] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:33 2022] GET /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387 => generated 1321 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:34.433047 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2064d67b-8501-41c8-a176-d6a3f0f82e40 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:34.441820 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2064d67b-8501-41c8-a176-d6a3f0f82e40 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 9c37f5dc-fee0-447d-bc96-db9b59933f8f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:34.466025 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2064d67b-8501-41c8-a176-d6a3f0f82e40 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:34.478294 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2064d67b-8501-41c8-a176-d6a3f0f82e40 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:34.479647 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2064d67b-8501-41c8-a176-d6a3f0f82e40 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:34.480577 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2064d67b-8501-41c8-a176-d6a3f0f82e40 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:34.824783 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-7678b0a3-cbf2-4b41-8cf1-5d899ac230f9 req-5075c25d-f715-48a7-be5a-9aebc36998dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ea25507-d70a-43c8-9491-19c8f4435217", "tag": "b7fcb75c-4b1b-41e5-912a-b6cf602b3474"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:34.862884 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7678b0a3-cbf2-4b41-8cf1-5d899ac230f9 req-5075c25d-f715-48a7-be5a-9aebc36998dc service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:34.865385 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7678b0a3-cbf2-4b41-8cf1-5d899ac230f9 req-5075c25d-f715-48a7-be5a-9aebc36998dc service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:34.891928 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-7678b0a3-cbf2-4b41-8cf1-5d899ac230f9 req-5075c25d-f715-48a7-be5a-9aebc36998dc service nova] Creating event network-changed:b7fcb75c-4b1b-41e5-912a-b6cf602b3474 for instance 3ea25507-d70a-43c8-9491-19c8f4435217 on n-h2-846466-12 Aug 04 16:56:34.904285 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-7678b0a3-cbf2-4b41-8cf1-5d899ac230f9 req-5075c25d-f715-48a7-be5a-9aebc36998dc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.623266 Aug 04 16:56:34.906149 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1989/3921] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:34.919940 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ef3a042d-65fe-4817-b2e3-babb285c9f91 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:34.921696 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ef3a042d-65fe-4817-b2e3-babb285c9f91 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:34.936018 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef3a042d-65fe-4817-b2e3-babb285c9f91 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:34.938818 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef3a042d-65fe-4817-b2e3-babb285c9f91 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:34.942422 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef3a042d-65fe-4817-b2e3-babb285c9f91 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:34.943905 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef3a042d-65fe-4817-b2e3-babb285c9f91 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:35.003564 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ef3a042d-65fe-4817-b2e3-babb285c9f91 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:56:35.123838 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2064d67b-8501-41c8-a176-d6a3f0f82e40 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:35.147022 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2064d67b-8501-41c8-a176-d6a3f0f82e40 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f" status: 200 len: 1309 microversion: 2.1 time: 0.722521 Aug 04 16:56:35.148372 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1933/3922] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:34 2022] GET /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f => generated 1309 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:35.155180 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4d7b7e82-8e5b-4f6b-9afe-adf106a4ae36 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:35.157553 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4d7b7e82-8e5b-4f6b-9afe-adf106a4ae36 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 760130d2-374e-4f4c-a73b-d7a99449e324] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:35.166057 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4d7b7e82-8e5b-4f6b-9afe-adf106a4ae36 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:35.167320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4d7b7e82-8e5b-4f6b-9afe-adf106a4ae36 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:35.168509 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4d7b7e82-8e5b-4f6b-9afe-adf106a4ae36 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:35.169466 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4d7b7e82-8e5b-4f6b-9afe-adf106a4ae36 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:35.231902 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=10,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:35.256367 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ef3a042d-65fe-4817-b2e3-babb285c9f91 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "DELETE /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1" status: 204 len: 0 microversion: 2.1 time: 0.347240 Aug 04 16:56:35.265227 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1990/3923] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:56:34 2022] DELETE /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:56:35.282787 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-cca42f34-48aa-4eaa-b12a-48a63484539a req-28901054-3aeb-4f45-9d43-f3633068d611 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c37f5dc-fee0-447d-bc96-db9b59933f8f", "tag": "b214ecba-8002-4e67-9903-a9531c89a2c0"}, {"name": "network-changed", "server_uuid": "cab40427-161a-4071-8c75-1a402c924402", "tag": "48c095fd-d4cb-401f-b1ff-0380e65dd15f"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:35.307422 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-cca42f34-48aa-4eaa-b12a-48a63484539a req-28901054-3aeb-4f45-9d43-f3633068d611 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:35.307881 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-cca42f34-48aa-4eaa-b12a-48a63484539a req-28901054-3aeb-4f45-9d43-f3633068d611 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:35.326373 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-cca42f34-48aa-4eaa-b12a-48a63484539a req-28901054-3aeb-4f45-9d43-f3633068d611 service nova] Creating event network-changed:b214ecba-8002-4e67-9903-a9531c89a2c0 for instance 9c37f5dc-fee0-447d-bc96-db9b59933f8f on n-h1-846466-12 Aug 04 16:56:35.327191 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-cca42f34-48aa-4eaa-b12a-48a63484539a req-28901054-3aeb-4f45-9d43-f3633068d611 service nova] Creating event network-changed:48c095fd-d4cb-401f-b1ff-0380e65dd15f for instance cab40427-161a-4071-8c75-1a402c924402 on n-h2-846466-12 Aug 04 16:56:35.341466 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-cca42f34-48aa-4eaa-b12a-48a63484539a req-28901054-3aeb-4f45-9d43-f3633068d611 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.073950 Aug 04 16:56:35.343471 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1991/3924] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:35.351218 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6eaa89d7-33b5-4843-ab7d-40cab71117e5 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:35.352139 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6eaa89d7-33b5-4843-ab7d-40cab71117e5 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] [instance: cab40427-161a-4071-8c75-1a402c924402] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:35.358221 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4d7b7e82-8e5b-4f6b-9afe-adf106a4ae36 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:35.364716 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6eaa89d7-33b5-4843-ab7d-40cab71117e5 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:35.365694 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6eaa89d7-33b5-4843-ab7d-40cab71117e5 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:35.366980 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6eaa89d7-33b5-4843-ab7d-40cab71117e5 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:35.368413 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6eaa89d7-33b5-4843-ab7d-40cab71117e5 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:35.374135 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4d7b7e82-8e5b-4f6b-9afe-adf106a4ae36 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324" status: 200 len: 1299 microversion: 2.1 time: 0.223443 Aug 04 16:56:35.390027 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1934/3925] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:35 2022] GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324 => generated 1299 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:35.473651 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-517ad80a-9b79-49bb-92ed-d30b666a2ffd tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:35.474636 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-517ad80a-9b79-49bb-92ed-d30b666a2ffd tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 1664bfb4-4517-4700-ac66-79dc4586b387] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:35.517560 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-517ad80a-9b79-49bb-92ed-d30b666a2ffd tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:35.518671 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-517ad80a-9b79-49bb-92ed-d30b666a2ffd tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:35.528033 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-517ad80a-9b79-49bb-92ed-d30b666a2ffd tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:35.528902 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-517ad80a-9b79-49bb-92ed-d30b666a2ffd tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:36.180368 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-517ad80a-9b79-49bb-92ed-d30b666a2ffd tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:36.190542 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-517ad80a-9b79-49bb-92ed-d30b666a2ffd tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387" status: 200 len: 1321 microversion: 2.1 time: 0.731657 Aug 04 16:56:36.194318 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1935/3926] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:35 2022] GET /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387 => generated 1321 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:36.207299 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9357cbcc-1816-4a6b-96b8-f419807018b8 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1634280191", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "684d9347-862c-4a28-a98b-94e8785b69ab"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:36.252092 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6eaa89d7-33b5-4843-ab7d-40cab71117e5 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34126dbe898545fd9d7e03b55880ab53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c93b891c0324a8cace12fb77490ad16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:36.267257 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6eaa89d7-33b5-4843-ab7d-40cab71117e5 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] 10.222.0.23 "GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402" status: 200 len: 1428 microversion: 2.1 time: 0.922002 Aug 04 16:56:36.270116 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1992/3927] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:35 2022] GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402 => generated 1428 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:36.283312 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-53f5c344-6584-4e7c-9d3e-79593daea65b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:36.284189 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-53f5c344-6584-4e7c-9d3e-79593daea65b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 9c37f5dc-fee0-447d-bc96-db9b59933f8f] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:36.299181 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-53f5c344-6584-4e7c-9d3e-79593daea65b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:36.302124 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-53f5c344-6584-4e7c-9d3e-79593daea65b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:36.303170 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-53f5c344-6584-4e7c-9d3e-79593daea65b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:36.305149 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-53f5c344-6584-4e7c-9d3e-79593daea65b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:36.371391 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-9357cbcc-1816-4a6b-96b8-f419807018b8 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] validate_networks() for [('684d9347-862c-4a28-a98b-94e8785b69ab', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:56:37.441156 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-53f5c344-6584-4e7c-9d3e-79593daea65b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:37.477544 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-53f5c344-6584-4e7c-9d3e-79593daea65b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f" status: 200 len: 1309 microversion: 2.1 time: 1.193722 Aug 04 16:56:37.479542 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1993/3928] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:36 2022] GET /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f => generated 1309 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:37.494074 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-be276fcc-948f-47f8-9510-96dd1be5b093 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:37.498200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-be276fcc-948f-47f8-9510-96dd1be5b093 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 760130d2-374e-4f4c-a73b-d7a99449e324] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:37.518942 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be276fcc-948f-47f8-9510-96dd1be5b093 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:37.519927 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be276fcc-948f-47f8-9510-96dd1be5b093 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:37.522100 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be276fcc-948f-47f8-9510-96dd1be5b093 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:37.522771 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be276fcc-948f-47f8-9510-96dd1be5b093 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:37.762005 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-be276fcc-948f-47f8-9510-96dd1be5b093 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:37.773925 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-be276fcc-948f-47f8-9510-96dd1be5b093 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324" status: 200 len: 1299 microversion: 2.1 time: 0.291535 Aug 04 16:56:37.778352 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1994/3929] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:37 2022] GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324 => generated 1299 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:37.783716 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fa2ce114-3213-437b-b0a0-2ac0a1b9ad3a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:37.784603 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fa2ce114-3213-437b-b0a0-2ac0a1b9ad3a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 1664bfb4-4517-4700-ac66-79dc4586b387] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:37.792473 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fa2ce114-3213-437b-b0a0-2ac0a1b9ad3a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:37.793177 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fa2ce114-3213-437b-b0a0-2ac0a1b9ad3a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:37.794193 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fa2ce114-3213-437b-b0a0-2ac0a1b9ad3a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:37.794777 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fa2ce114-3213-437b-b0a0-2ac0a1b9ad3a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:38.354925 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9357cbcc-1816-4a6b-96b8-f419807018b8 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:56:38.355995 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9357cbcc-1816-4a6b-96b8-f419807018b8 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:56:38.356959 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9357cbcc-1816-4a6b-96b8-f419807018b8 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:56:38.357887 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9357cbcc-1816-4a6b-96b8-f419807018b8 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:56:38.358612 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9357cbcc-1816-4a6b-96b8-f419807018b8 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:56:38.361354 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fa2ce114-3213-437b-b0a0-2ac0a1b9ad3a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:38.373888 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fa2ce114-3213-437b-b0a0-2ac0a1b9ad3a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387" status: 200 len: 1321 microversion: 2.1 time: 0.593990 Aug 04 16:56:38.378974 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1995/3930] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:37 2022] GET /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387 => generated 1321 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:38.384024 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9357cbcc-1816-4a6b-96b8-f419807018b8 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:38.385042 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9357cbcc-1816-4a6b-96b8-f419807018b8 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:38.386695 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9357cbcc-1816-4a6b-96b8-f419807018b8 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:38.388379 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-acb3c11c-b080-4f80-9746-8191d58ef764 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:38.389034 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-acb3c11c-b080-4f80-9746-8191d58ef764 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] [instance: cab40427-161a-4071-8c75-1a402c924402] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:38.389578 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9357cbcc-1816-4a6b-96b8-f419807018b8 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:38.406143 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-acb3c11c-b080-4f80-9746-8191d58ef764 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:38.406143 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-acb3c11c-b080-4f80-9746-8191d58ef764 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:38.407068 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-acb3c11c-b080-4f80-9746-8191d58ef764 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:38.407442 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-acb3c11c-b080-4f80-9746-8191d58ef764 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:38.459705 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-9357cbcc-1816-4a6b-96b8-f419807018b8 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Getting quotas for project fac13585fd514c8390f32d1104a19c0d. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:56:38.478936 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-9357cbcc-1816-4a6b-96b8-f419807018b8 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Getting quotas for user 9a7e71c772ce49388bc47daf929ab9e1 and project fac13585fd514c8390f32d1104a19c0d. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:56:38.516706 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9357cbcc-1816-4a6b-96b8-f419807018b8 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:56:38.524175 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9357cbcc-1816-4a6b-96b8-f419807018b8 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: ab4b676b-65f5-4c5f-bef2-2ce3934dfe64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:56:38.633170 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9357cbcc-1816-4a6b-96b8-f419807018b8 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.430415 Aug 04 16:56:38.641084 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1936/3931] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:56:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2439 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:56:38.647417 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-06b9050c-a6e3-4cb0-b971-69be78dc8d36 req-9c632e4f-d95e-4dc5-ab1a-118e7b07bf92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35e71704-0700-4b89-a138-a0d8590f47d7", "name": "network-vif-plugged", "status": "completed", "tag": "77a2d853-c3b5-4de0-abfc-fa285b54172d"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:38.706267 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-06b9050c-a6e3-4cb0-b971-69be78dc8d36 req-9c632e4f-d95e-4dc5-ab1a-118e7b07bf92 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:38.708641 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-06b9050c-a6e3-4cb0-b971-69be78dc8d36 req-9c632e4f-d95e-4dc5-ab1a-118e7b07bf92 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:38.713208 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-acb3c11c-b080-4f80-9746-8191d58ef764 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34126dbe898545fd9d7e03b55880ab53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c93b891c0324a8cace12fb77490ad16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:38.731493 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-acb3c11c-b080-4f80-9746-8191d58ef764 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] 10.222.0.23 "GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402" status: 200 len: 1428 microversion: 2.1 time: 0.351814 Aug 04 16:56:38.732244 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1996/3932] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:38 2022] GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402 => generated 1428 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:38.744582 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-06b9050c-a6e3-4cb0-b971-69be78dc8d36 req-9c632e4f-d95e-4dc5-ab1a-118e7b07bf92 service nova] Creating event network-vif-plugged:77a2d853-c3b5-4de0-abfc-fa285b54172d for instance 35e71704-0700-4b89-a138-a0d8590f47d7 on n-h1-846466-12 Aug 04 16:56:38.755512 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-69ea4625-a443-4d1b-b906-c6545dac9853 req-807246dc-d28d-47af-9d5b-11ee50974c1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1664bfb4-4517-4700-ac66-79dc4586b387", "tag": "f01143f7-1e08-411e-9c6a-290949acb645"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:38.759907 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-06b9050c-a6e3-4cb0-b971-69be78dc8d36 req-9c632e4f-d95e-4dc5-ab1a-118e7b07bf92 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115456 Aug 04 16:56:38.760561 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1937/3933] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:38.776219 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-69ea4625-a443-4d1b-b906-c6545dac9853 req-807246dc-d28d-47af-9d5b-11ee50974c1c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:38.776676 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-69ea4625-a443-4d1b-b906-c6545dac9853 req-807246dc-d28d-47af-9d5b-11ee50974c1c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:38.787620 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6f9022ad-4ab2-4fe7-8314-da1d4b0aab9a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:38.790192 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6f9022ad-4ab2-4fe7-8314-da1d4b0aab9a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 9c37f5dc-fee0-447d-bc96-db9b59933f8f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:38.806400 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-69ea4625-a443-4d1b-b906-c6545dac9853 req-807246dc-d28d-47af-9d5b-11ee50974c1c service nova] Creating event network-changed:f01143f7-1e08-411e-9c6a-290949acb645 for instance 1664bfb4-4517-4700-ac66-79dc4586b387 on n-h1-846466-12 Aug 04 16:56:38.812602 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6f9022ad-4ab2-4fe7-8314-da1d4b0aab9a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:38.813073 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6f9022ad-4ab2-4fe7-8314-da1d4b0aab9a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:38.813927 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6f9022ad-4ab2-4fe7-8314-da1d4b0aab9a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:38.814405 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6f9022ad-4ab2-4fe7-8314-da1d4b0aab9a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:38.826641 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-69ea4625-a443-4d1b-b906-c6545dac9853 req-807246dc-d28d-47af-9d5b-11ee50974c1c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092910 Aug 04 16:56:38.827806 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1997/3934] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:38.834356 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0feb6879-7f90-4fb5-98f5-4a5a558a4152 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:38.835064 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0feb6879-7f90-4fb5-98f5-4a5a558a4152 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: ab4b676b-65f5-4c5f-bef2-2ce3934dfe64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:39.044142 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0feb6879-7f90-4fb5-98f5-4a5a558a4152 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:39.051945 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0feb6879-7f90-4fb5-98f5-4a5a558a4152 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64" status: 200 len: 1218 microversion: 2.1 time: 0.222641 Aug 04 16:56:39.065669 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1998/3935] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:38 2022] GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64 => generated 1218 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:39.071089 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f6c380a9-6a46-40f4-a549-9050e5979ef3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:39.071918 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f6c380a9-6a46-40f4-a549-9050e5979ef3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 760130d2-374e-4f4c-a73b-d7a99449e324] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:39.080990 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f6c380a9-6a46-40f4-a549-9050e5979ef3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:39.081865 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f6c380a9-6a46-40f4-a549-9050e5979ef3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:39.084220 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f6c380a9-6a46-40f4-a549-9050e5979ef3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:39.084674 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f6c380a9-6a46-40f4-a549-9050e5979ef3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:39.664502 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6f9022ad-4ab2-4fe7-8314-da1d4b0aab9a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:39.677598 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6f9022ad-4ab2-4fe7-8314-da1d4b0aab9a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f" status: 200 len: 1309 microversion: 2.1 time: 0.913101 Aug 04 16:56:39.679563 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1938/3936] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:38 2022] GET /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f => generated 1309 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:39.704759 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dfadfcc1-c878-4a65-b1ae-97da2ca80607 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:39.705830 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-dfadfcc1-c878-4a65-b1ae-97da2ca80607 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 1664bfb4-4517-4700-ac66-79dc4586b387] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:39.726426 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dfadfcc1-c878-4a65-b1ae-97da2ca80607 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:39.732618 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dfadfcc1-c878-4a65-b1ae-97da2ca80607 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:39.734201 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dfadfcc1-c878-4a65-b1ae-97da2ca80607 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:39.734912 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dfadfcc1-c878-4a65-b1ae-97da2ca80607 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:39.799515 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f6c380a9-6a46-40f4-a549-9050e5979ef3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:39.813418 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f6c380a9-6a46-40f4-a549-9050e5979ef3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324" status: 200 len: 1367 microversion: 2.1 time: 0.742036 Aug 04 16:56:39.833377 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 1999/3937] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:39 2022] GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324 => generated 1367 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:39.851467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0006c809-bff6-4081-b5a9-493601e73bb7 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:39.852248 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0006c809-bff6-4081-b5a9-493601e73bb7 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] [instance: cab40427-161a-4071-8c75-1a402c924402] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:39.859046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0006c809-bff6-4081-b5a9-493601e73bb7 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:39.886200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0006c809-bff6-4081-b5a9-493601e73bb7 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:39.887403 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0006c809-bff6-4081-b5a9-493601e73bb7 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:39.888361 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0006c809-bff6-4081-b5a9-493601e73bb7 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:39.942842 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:40.613647 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-dfadfcc1-c878-4a65-b1ae-97da2ca80607 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:40.614930 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0006c809-bff6-4081-b5a9-493601e73bb7 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34126dbe898545fd9d7e03b55880ab53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c93b891c0324a8cace12fb77490ad16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:40.626186 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0006c809-bff6-4081-b5a9-493601e73bb7 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] 10.222.0.23 "GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402" status: 200 len: 1428 microversion: 2.1 time: 0.791385 Aug 04 16:56:40.630799 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dfadfcc1-c878-4a65-b1ae-97da2ca80607 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387" status: 200 len: 1321 microversion: 2.1 time: 0.948979 Aug 04 16:56:40.631682 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2000/3938] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:39 2022] GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402 => generated 1428 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:40.636928 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ab3f4524-2f7a-4a08-98e7-1d0f9222c938 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:40.639552 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1939/3939] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:39 2022] GET /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387 => generated 1321 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:40.644281 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ab3f4524-2f7a-4a08-98e7-1d0f9222c938 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: ab4b676b-65f5-4c5f-bef2-2ce3934dfe64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:40.664395 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab3f4524-2f7a-4a08-98e7-1d0f9222c938 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:40.665245 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab3f4524-2f7a-4a08-98e7-1d0f9222c938 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:40.666377 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab3f4524-2f7a-4a08-98e7-1d0f9222c938 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:40.667032 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab3f4524-2f7a-4a08-98e7-1d0f9222c938 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:40.702883 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-555a92bd-93c5-4e70-8ff9-273d53f173c6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:40.703872 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-555a92bd-93c5-4e70-8ff9-273d53f173c6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 9c37f5dc-fee0-447d-bc96-db9b59933f8f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:40.721691 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-555a92bd-93c5-4e70-8ff9-273d53f173c6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:40.722150 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-555a92bd-93c5-4e70-8ff9-273d53f173c6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:40.722978 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-555a92bd-93c5-4e70-8ff9-273d53f173c6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:40.723418 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-555a92bd-93c5-4e70-8ff9-273d53f173c6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:40.755866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ab3f4524-2f7a-4a08-98e7-1d0f9222c938 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:40.770500 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ab3f4524-2f7a-4a08-98e7-1d0f9222c938 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64" status: 200 len: 1270 microversion: 2.1 time: 0.137390 Aug 04 16:56:40.771709 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2001/3940] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:40 2022] GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64 => generated 1270 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:40.849635 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e0dc58db-7db2-4072-9f70-3217f82d5d82 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:40.850317 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e0dc58db-7db2-4072-9f70-3217f82d5d82 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 760130d2-374e-4f4c-a73b-d7a99449e324] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:40.857456 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e0dc58db-7db2-4072-9f70-3217f82d5d82 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:40.857909 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e0dc58db-7db2-4072-9f70-3217f82d5d82 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:40.858698 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e0dc58db-7db2-4072-9f70-3217f82d5d82 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:40.859135 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e0dc58db-7db2-4072-9f70-3217f82d5d82 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:41.327932 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-555a92bd-93c5-4e70-8ff9-273d53f173c6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:41.337969 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-555a92bd-93c5-4e70-8ff9-273d53f173c6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f" status: 200 len: 1309 microversion: 2.1 time: 0.641217 Aug 04 16:56:41.338578 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1940/3941] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:40 2022] GET /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f => generated 1309 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:41.359209 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-46d0212f-5660-4f89-8534-bc46f3d32e58 req-562d69bf-b069-4828-82ba-6252cdfcc78c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ea25507-d70a-43c8-9491-19c8f4435217", "name": "network-vif-plugged", "status": "completed", "tag": "b7fcb75c-4b1b-41e5-912a-b6cf602b3474"}, {"server_uuid": "14749b47-d48c-46f0-a650-27ee70f5edf1", "name": "network-vif-unplugged", "status": "completed", "tag": "d1f06683-5886-4ea6-87e1-00a459987356"}, {"server_uuid": "9c37f5dc-fee0-447d-bc96-db9b59933f8f", "name": "network-vif-plugged", "status": "completed", "tag": "b214ecba-8002-4e67-9903-a9531c89a2c0"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:41.387160 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-46d0212f-5660-4f89-8534-bc46f3d32e58 req-562d69bf-b069-4828-82ba-6252cdfcc78c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:41.388251 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-46d0212f-5660-4f89-8534-bc46f3d32e58 req-562d69bf-b069-4828-82ba-6252cdfcc78c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:41.406428 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-46d0212f-5660-4f89-8534-bc46f3d32e58 req-562d69bf-b069-4828-82ba-6252cdfcc78c service nova] Creating event network-vif-plugged:b7fcb75c-4b1b-41e5-912a-b6cf602b3474 for instance 3ea25507-d70a-43c8-9491-19c8f4435217 on n-h2-846466-12 Aug 04 16:56:41.407658 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-46d0212f-5660-4f89-8534-bc46f3d32e58 req-562d69bf-b069-4828-82ba-6252cdfcc78c service nova] Creating event network-vif-unplugged:d1f06683-5886-4ea6-87e1-00a459987356 for instance 14749b47-d48c-46f0-a650-27ee70f5edf1 on n-h2-846466-12 Aug 04 16:56:41.408345 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-46d0212f-5660-4f89-8534-bc46f3d32e58 req-562d69bf-b069-4828-82ba-6252cdfcc78c service nova] Creating event network-vif-plugged:b214ecba-8002-4e67-9903-a9531c89a2c0 for instance 9c37f5dc-fee0-447d-bc96-db9b59933f8f on n-h1-846466-12 Aug 04 16:56:41.428287 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-46d0212f-5660-4f89-8534-bc46f3d32e58 req-562d69bf-b069-4828-82ba-6252cdfcc78c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.088472 Aug 04 16:56:41.432953 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1941/3942] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:41.440244 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-f8addf6d-dde3-4585-a776-299957009c65 req-85a171d0-c5f1-4cff-a6d8-5f836d8818a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14749b47-d48c-46f0-a650-27ee70f5edf1", "name": "network-vif-deleted", "tag": "d1f06683-5886-4ea6-87e1-00a459987356"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:41.462039 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e0dc58db-7db2-4072-9f70-3217f82d5d82 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:41.473067 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f8addf6d-dde3-4585-a776-299957009c65 req-85a171d0-c5f1-4cff-a6d8-5f836d8818a9 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:41.474039 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e0dc58db-7db2-4072-9f70-3217f82d5d82 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324" status: 200 len: 1367 microversion: 2.1 time: 0.628348 Aug 04 16:56:41.475002 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2002/3943] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:40 2022] GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324 => generated 1367 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:41.475818 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f8addf6d-dde3-4585-a776-299957009c65 req-85a171d0-c5f1-4cff-a6d8-5f836d8818a9 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:41.497627 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-f8addf6d-dde3-4585-a776-299957009c65 req-85a171d0-c5f1-4cff-a6d8-5f836d8818a9 service nova] Creating event network-vif-deleted:d1f06683-5886-4ea6-87e1-00a459987356 for instance 14749b47-d48c-46f0-a650-27ee70f5edf1 on n-h2-846466-12 Aug 04 16:56:41.518624 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-f8addf6d-dde3-4585-a776-299957009c65 req-85a171d0-c5f1-4cff-a6d8-5f836d8818a9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083741 Aug 04 16:56:41.519818 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1942/3944] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:41.669985 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3f80cce7-cb02-4492-a060-420336d4d82f tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:41.670622 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3f80cce7-cb02-4492-a060-420336d4d82f tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] [instance: cab40427-161a-4071-8c75-1a402c924402] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:41.676662 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-79961859-cb6b-486e-a94a-3da7741105ce tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:41.678974 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-79961859-cb6b-486e-a94a-3da7741105ce tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 1664bfb4-4517-4700-ac66-79dc4586b387] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:41.680683 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3f80cce7-cb02-4492-a060-420336d4d82f tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:41.681221 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3f80cce7-cb02-4492-a060-420336d4d82f tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:41.685534 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3f80cce7-cb02-4492-a060-420336d4d82f tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:41.685980 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3f80cce7-cb02-4492-a060-420336d4d82f tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:41.694400 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-79961859-cb6b-486e-a94a-3da7741105ce tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:41.695354 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-79961859-cb6b-486e-a94a-3da7741105ce tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:41.698804 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-79961859-cb6b-486e-a94a-3da7741105ce tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:41.699535 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-79961859-cb6b-486e-a94a-3da7741105ce tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:42.466568 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:43.092894 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-79961859-cb6b-486e-a94a-3da7741105ce tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:43.103285 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-79961859-cb6b-486e-a94a-3da7741105ce tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387" status: 200 len: 1321 microversion: 2.1 time: 1.437080 Aug 04 16:56:43.104392 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3f80cce7-cb02-4492-a060-420336d4d82f tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34126dbe898545fd9d7e03b55880ab53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c93b891c0324a8cace12fb77490ad16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:43.106534 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1943/3945] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:41 2022] GET /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387 => generated 1321 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:56:43.114062 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b7b19d0e-9ac4-406f-b028-7bcd90b6bd20 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:43.133273 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b7b19d0e-9ac4-406f-b028-7bcd90b6bd20 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: ab4b676b-65f5-4c5f-bef2-2ce3934dfe64] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:43.142542 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3f80cce7-cb02-4492-a060-420336d4d82f tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] 10.222.0.23 "GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402" status: 200 len: 1428 microversion: 2.1 time: 1.477860 Aug 04 16:56:43.144168 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2003/3946] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:41 2022] GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402 => generated 1428 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:43.149710 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7b19d0e-9ac4-406f-b028-7bcd90b6bd20 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:43.150842 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7b19d0e-9ac4-406f-b028-7bcd90b6bd20 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:43.151892 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7b19d0e-9ac4-406f-b028-7bcd90b6bd20 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:43.152748 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7b19d0e-9ac4-406f-b028-7bcd90b6bd20 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:43.152914 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9e435443-a4d5-4122-a561-ede670a84913 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:43.154046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9e435443-a4d5-4122-a561-ede670a84913 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 9c37f5dc-fee0-447d-bc96-db9b59933f8f] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:43.170186 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9e435443-a4d5-4122-a561-ede670a84913 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:43.170654 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9e435443-a4d5-4122-a561-ede670a84913 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:43.171642 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9e435443-a4d5-4122-a561-ede670a84913 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:43.172446 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9e435443-a4d5-4122-a561-ede670a84913 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:43.400959 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b7b19d0e-9ac4-406f-b028-7bcd90b6bd20 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:43.417533 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b7b19d0e-9ac4-406f-b028-7bcd90b6bd20 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64" status: 200 len: 1276 microversion: 2.1 time: 0.309281 Aug 04 16:56:43.420003 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1944/3947] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:43 2022] GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64 => generated 1276 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:43.448293 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6d5f2a05-e4dd-4f76-8624-6fc010a33a23 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:43.449269 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6d5f2a05-e4dd-4f76-8624-6fc010a33a23 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 760130d2-374e-4f4c-a73b-d7a99449e324] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:43.475718 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d5f2a05-e4dd-4f76-8624-6fc010a33a23 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:43.478359 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d5f2a05-e4dd-4f76-8624-6fc010a33a23 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:43.481035 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d5f2a05-e4dd-4f76-8624-6fc010a33a23 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:43.483609 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d5f2a05-e4dd-4f76-8624-6fc010a33a23 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:43.917377 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9e435443-a4d5-4122-a561-ede670a84913 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:43.928302 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9e435443-a4d5-4122-a561-ede670a84913 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f" status: 200 len: 1309 microversion: 2.1 time: 0.781853 Aug 04 16:56:43.929151 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2004/3948] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:43 2022] GET /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f => generated 1309 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:43.934663 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-075ce8de-f9e3-44cc-875e-be9a7ed24cf9 req-795a326e-b9a7-478b-8af7-7f34ad0ccf58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab40427-161a-4071-8c75-1a402c924402", "name": "network-vif-plugged", "status": "completed", "tag": "48c095fd-d4cb-401f-b1ff-0380e65dd15f"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:43.952934 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-075ce8de-f9e3-44cc-875e-be9a7ed24cf9 req-795a326e-b9a7-478b-8af7-7f34ad0ccf58 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:43.953876 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-075ce8de-f9e3-44cc-875e-be9a7ed24cf9 req-795a326e-b9a7-478b-8af7-7f34ad0ccf58 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:43.969955 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-075ce8de-f9e3-44cc-875e-be9a7ed24cf9 req-795a326e-b9a7-478b-8af7-7f34ad0ccf58 service nova] Creating event network-vif-plugged:48c095fd-d4cb-401f-b1ff-0380e65dd15f for instance cab40427-161a-4071-8c75-1a402c924402 on n-h2-846466-12 Aug 04 16:56:43.978555 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-075ce8de-f9e3-44cc-875e-be9a7ed24cf9 req-795a326e-b9a7-478b-8af7-7f34ad0ccf58 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047238 Aug 04 16:56:43.980354 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2005/3949] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:43.986926 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-dd428d30-013c-49e7-8d5f-22f965d25286 req-00dbb039-e61a-4e08-8b46-505f2b6a3295 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "760130d2-374e-4f4c-a73b-d7a99449e324", "tag": "cbfa4f3b-18b3-43da-9dc1-bb3c05508ec3"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:44.000326 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-dd428d30-013c-49e7-8d5f-22f965d25286 req-00dbb039-e61a-4e08-8b46-505f2b6a3295 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:44.001136 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-dd428d30-013c-49e7-8d5f-22f965d25286 req-00dbb039-e61a-4e08-8b46-505f2b6a3295 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:44.017096 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-dd428d30-013c-49e7-8d5f-22f965d25286 req-00dbb039-e61a-4e08-8b46-505f2b6a3295 service nova] Creating event network-changed:cbfa4f3b-18b3-43da-9dc1-bb3c05508ec3 for instance 760130d2-374e-4f4c-a73b-d7a99449e324 on n-h2-846466-12 Aug 04 16:56:44.041159 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-dd428d30-013c-49e7-8d5f-22f965d25286 req-00dbb039-e61a-4e08-8b46-505f2b6a3295 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057866 Aug 04 16:56:44.042372 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2006/3950] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:44.130286 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ae4a63d5-665e-4193-a622-b5d8ef86ab0c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:44.131043 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ae4a63d5-665e-4193-a622-b5d8ef86ab0c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 1664bfb4-4517-4700-ac66-79dc4586b387] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:44.159160 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ae4a63d5-665e-4193-a622-b5d8ef86ab0c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:44.159623 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ae4a63d5-665e-4193-a622-b5d8ef86ab0c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:44.171081 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ae4a63d5-665e-4193-a622-b5d8ef86ab0c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:44.173046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ae4a63d5-665e-4193-a622-b5d8ef86ab0c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:44.583557 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6d5f2a05-e4dd-4f76-8624-6fc010a33a23 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:44.598513 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6d5f2a05-e4dd-4f76-8624-6fc010a33a23 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324" status: 200 len: 1367 microversion: 2.1 time: 1.173291 Aug 04 16:56:44.610877 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1945/3951] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:43 2022] GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324 => generated 1367 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:44.617370 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-88d4e042-179a-457f-9f6b-362ab27b63d1 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:44.619395 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-88d4e042-179a-457f-9f6b-362ab27b63d1 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] [instance: cab40427-161a-4071-8c75-1a402c924402] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:44.628548 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-88d4e042-179a-457f-9f6b-362ab27b63d1 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:44.641732 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-88d4e042-179a-457f-9f6b-362ab27b63d1 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:44.642726 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-88d4e042-179a-457f-9f6b-362ab27b63d1 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:44.643181 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-88d4e042-179a-457f-9f6b-362ab27b63d1 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:44.681698 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ae4a63d5-665e-4193-a622-b5d8ef86ab0c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:44.690870 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ae4a63d5-665e-4193-a622-b5d8ef86ab0c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387" status: 200 len: 1321 microversion: 2.1 time: 0.564925 Aug 04 16:56:44.691950 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2007/3952] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:44 2022] GET /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387 => generated 1321 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:44.697206 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8ad51b29-98bb-4588-8ae3-56aa2160f05d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:44.698042 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8ad51b29-98bb-4588-8ae3-56aa2160f05d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: ab4b676b-65f5-4c5f-bef2-2ce3934dfe64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:44.707868 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8ad51b29-98bb-4588-8ae3-56aa2160f05d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:44.708796 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8ad51b29-98bb-4588-8ae3-56aa2160f05d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:44.710071 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8ad51b29-98bb-4588-8ae3-56aa2160f05d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:44.710881 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8ad51b29-98bb-4588-8ae3-56aa2160f05d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:44.871710 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8ad51b29-98bb-4588-8ae3-56aa2160f05d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:44.883940 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8ad51b29-98bb-4588-8ae3-56aa2160f05d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64" status: 200 len: 1276 microversion: 2.1 time: 0.190198 Aug 04 16:56:44.888421 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2008/3953] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:44 2022] GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64 => generated 1276 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:45.116942 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-88d4e042-179a-457f-9f6b-362ab27b63d1 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34126dbe898545fd9d7e03b55880ab53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c93b891c0324a8cace12fb77490ad16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:45.131987 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-88d4e042-179a-457f-9f6b-362ab27b63d1 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] 10.222.0.23 "GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402" status: 200 len: 1428 microversion: 2.1 time: 0.517650 Aug 04 16:56:45.133142 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1946/3954] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:44 2022] GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402 => generated 1428 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:45.163455 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b445f970-0f3d-49db-9630-3e342dbe7cde tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:45.164340 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b445f970-0f3d-49db-9630-3e342dbe7cde tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 9c37f5dc-fee0-447d-bc96-db9b59933f8f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:45.178844 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b445f970-0f3d-49db-9630-3e342dbe7cde tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:45.180962 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b445f970-0f3d-49db-9630-3e342dbe7cde tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:45.182069 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b445f970-0f3d-49db-9630-3e342dbe7cde tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:45.182721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b445f970-0f3d-49db-9630-3e342dbe7cde tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:45.206112 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8ad9b774-5cdf-4a14-9e60-0ab378d30b71 tempest-PortsAdminExtendedAttrsTestJSON-263537667 tempest-PortsAdminExtendedAttrsTestJSON-263537667-project-admin] Calling method '.version_select at 0x7f7e8414d4c0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:45.207961 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:56:45.207961 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 16:56:45.210969 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8ad9b774-5cdf-4a14-9e60-0ab378d30b71 tempest-PortsAdminExtendedAttrsTestJSON-263537667 tempest-PortsAdminExtendedAttrsTestJSON-263537667-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:45.212665 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8ad9b774-5cdf-4a14-9e60-0ab378d30b71 tempest-PortsAdminExtendedAttrsTestJSON-263537667 tempest-PortsAdminExtendedAttrsTestJSON-263537667-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:45.235712 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8ad9b774-5cdf-4a14-9e60-0ab378d30b71 tempest-PortsAdminExtendedAttrsTestJSON-263537667 tempest-PortsAdminExtendedAttrsTestJSON-263537667-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:45.236734 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8ad9b774-5cdf-4a14-9e60-0ab378d30b71 tempest-PortsAdminExtendedAttrsTestJSON-263537667 tempest-PortsAdminExtendedAttrsTestJSON-263537667-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:45.257143 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8ad9b774-5cdf-4a14-9e60-0ab378d30b71 tempest-PortsAdminExtendedAttrsTestJSON-263537667 tempest-PortsAdminExtendedAttrsTestJSON-263537667-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:45.265100 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8ad9b774-5cdf-4a14-9e60-0ab378d30b71 tempest-PortsAdminExtendedAttrsTestJSON-263537667 tempest-PortsAdminExtendedAttrsTestJSON-263537667-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:45.273693 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8ad9b774-5cdf-4a14-9e60-0ab378d30b71 tempest-PortsAdminExtendedAttrsTestJSON-263537667 tempest-PortsAdminExtendedAttrsTestJSON-263537667-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.383991 Aug 04 16:56:45.275113 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2009/3955] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:56:44 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:45.544702 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b445f970-0f3d-49db-9630-3e342dbe7cde tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:45.554207 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b445f970-0f3d-49db-9630-3e342dbe7cde tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f" status: 200 len: 1491 microversion: 2.1 time: 0.417471 Aug 04 16:56:45.565333 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1947/3956] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:45 2022] GET /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f => generated 1491 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:45.619723 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-39415425-0b9c-46ea-a412-dbaae596ca6c tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:45.620354 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-39415425-0b9c-46ea-a412-dbaae596ca6c tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 760130d2-374e-4f4c-a73b-d7a99449e324] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:45.638359 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-39415425-0b9c-46ea-a412-dbaae596ca6c tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:45.638796 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-39415425-0b9c-46ea-a412-dbaae596ca6c tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:45.639592 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-39415425-0b9c-46ea-a412-dbaae596ca6c tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:45.640030 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-39415425-0b9c-46ea-a412-dbaae596ca6c tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:45.691722 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9640b31a-1387-4ce9-b90b-49a6079a9900 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1349265217", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "b83d6df0-d970-41bd-ae99-1dfc6211d426"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:45.795403 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-9640b31a-1387-4ce9-b90b-49a6079a9900 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] validate_networks() for [('b83d6df0-d970-41bd-ae99-1dfc6211d426', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:56:46.131843 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-39415425-0b9c-46ea-a412-dbaae596ca6c tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:46.148128 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-39415425-0b9c-46ea-a412-dbaae596ca6c tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324" status: 200 len: 1367 microversion: 2.1 time: 0.531839 Aug 04 16:56:46.150813 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2010/3957] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:45 2022] GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324 => generated 1367 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:46.156535 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3cc913ad-8272-432c-88f7-74c803b6a3e8 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:46.157215 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3cc913ad-8272-432c-88f7-74c803b6a3e8 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 1664bfb4-4517-4700-ac66-79dc4586b387] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:46.180772 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3cc913ad-8272-432c-88f7-74c803b6a3e8 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:46.181660 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3cc913ad-8272-432c-88f7-74c803b6a3e8 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:46.183111 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3cc913ad-8272-432c-88f7-74c803b6a3e8 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:46.184025 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3cc913ad-8272-432c-88f7-74c803b6a3e8 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:46.588051 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3cc913ad-8272-432c-88f7-74c803b6a3e8 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:46.606061 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3cc913ad-8272-432c-88f7-74c803b6a3e8 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387" status: 200 len: 1321 microversion: 2.1 time: 0.453513 Aug 04 16:56:46.620295 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2011/3958] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:46 2022] GET /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387 => generated 1321 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:46.626942 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-50190c99-ec0a-4dff-a1fa-44367de309d4 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:46.628074 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-50190c99-ec0a-4dff-a1fa-44367de309d4 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:46.637471 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50190c99-ec0a-4dff-a1fa-44367de309d4 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:46.638900 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50190c99-ec0a-4dff-a1fa-44367de309d4 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:46.640283 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50190c99-ec0a-4dff-a1fa-44367de309d4 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:46.640989 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50190c99-ec0a-4dff-a1fa-44367de309d4 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:46.674590 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-50190c99-ec0a-4dff-a1fa-44367de309d4 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] HTTP exception thrown: Instance 8e273267-ae4b-4a99-821e-1c02c3440610 could not be found. Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-50190c99-ec0a-4dff-a1fa-44367de309d4 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Request method failure captured: Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 HTTP/1.1 Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_hgQoldjm4_S3D94fDziXOCZOUcaEPIkok-kHbJHwUIzdGtcvkeBillRoIFaYXJsu7Tk4pMCR2QNHeQAvXq9QWucd4UqSLiPvzhfZDHUM-vqwSlXnpNF9f6diokGYUDCYY9TLy2cAYVevZKnVsF5LRgOY_zzwpHs1nxXrYIShHutYI Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: X-Openstack-Nova-Api-Version: 2.42 Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: b9fcc0fe6bb74058a0125be27a3a7090 Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1525214697 Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9fcc0fe6bb74058a0125be27a3a7090"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b9fcc0fe6bb74058a0125be27a3a7090"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9fcc0fe6bb74058a0125be27a3a7090"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b9fcc0fe6bb74058a0125be27a3a7090"}]}] Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1525214697 Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: b9fcc0fe6bb74058a0125be27a3a7090 Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1525214697 Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-TaggedBootDevicesTest_v242-1525214697-project Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 1ebb42db61b34dd2a4ba2a8ffa984684 Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1525214697-project Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 8e273267-ae4b-4a99-821e-1c02c3440610 could not be found. Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '8e273267-ae4b-4a99-821e-1c02c3440610'} Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e273267-ae4b-4a99-821e-1c02c3440610 could not be found. Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:56:46.677720 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:56:46.682218 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e273267-ae4b-4a99-821e-1c02c3440610 could not be found. Aug 04 16:56:46.682218 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:56:46.682218 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:46.682218 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:56:46.682218 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:46.682218 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:46.682218 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:46.682218 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:56:46.682218 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:56:46.682218 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e273267-ae4b-4a99-821e-1c02c3440610 could not be found. Aug 04 16:56:46.682218 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:56:46.684626 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-50190c99-ec0a-4dff-a1fa-44367de309d4 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Returning 404 to user: Instance 8e273267-ae4b-4a99-821e-1c02c3440610 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:46.685773 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-50190c99-ec0a-4dff-a1fa-44367de309d4 tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 404 len: 111 microversion: 2.42 time: 0.064167 Aug 04 16:56:46.691902 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2012/3959] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Aug 4 16:56:46 2022] DELETE /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:56:46.699139 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8f89490a-3827-4204-8968-80d684dbcfcc tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:46.699856 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8f89490a-3827-4204-8968-80d684dbcfcc tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: ab4b676b-65f5-4c5f-bef2-2ce3934dfe64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:46.708606 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8f89490a-3827-4204-8968-80d684dbcfcc tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:46.709094 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8f89490a-3827-4204-8968-80d684dbcfcc tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:46.710439 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8f89490a-3827-4204-8968-80d684dbcfcc tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:46.710882 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8f89490a-3827-4204-8968-80d684dbcfcc tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:47.305108 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9640b31a-1387-4ce9-b90b-49a6079a9900 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:56:47.305721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9640b31a-1387-4ce9-b90b-49a6079a9900 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:56:47.306000 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9640b31a-1387-4ce9-b90b-49a6079a9900 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:56:47.308840 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9640b31a-1387-4ce9-b90b-49a6079a9900 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:56:47.309449 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9640b31a-1387-4ce9-b90b-49a6079a9900 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:56:47.321664 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9640b31a-1387-4ce9-b90b-49a6079a9900 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:47.322274 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9640b31a-1387-4ce9-b90b-49a6079a9900 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:47.323495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9640b31a-1387-4ce9-b90b-49a6079a9900 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:47.323495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9640b31a-1387-4ce9-b90b-49a6079a9900 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:47.343724 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-9640b31a-1387-4ce9-b90b-49a6079a9900 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Getting quotas for project fa4bb1fda4ef4267829850c4c616df77. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:56:47.350154 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-9640b31a-1387-4ce9-b90b-49a6079a9900 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Getting quotas for user db8a96da1d7943599ee6ca9df18f5148 and project fa4bb1fda4ef4267829850c4c616df77. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:56:47.361522 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=92 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:47.368673 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9640b31a-1387-4ce9-b90b-49a6079a9900 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:56:47.371771 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9640b31a-1387-4ce9-b90b-49a6079a9900 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: ddc73e5e-fb45-4781-959e-c951fb5f2e6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:56:47.435644 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9640b31a-1387-4ce9-b90b-49a6079a9900 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.748557 Aug 04 16:56:47.437048 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1948/3960] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:56:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:56:47.447592 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9d955742-0dc0-4513-a734-daa905be1287 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:47.448631 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9d955742-0dc0-4513-a734-daa905be1287 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] [instance: cab40427-161a-4071-8c75-1a402c924402] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:47.457528 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d955742-0dc0-4513-a734-daa905be1287 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:47.458373 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d955742-0dc0-4513-a734-daa905be1287 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:47.459473 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d955742-0dc0-4513-a734-daa905be1287 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:47.462031 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d955742-0dc0-4513-a734-daa905be1287 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:47.560482 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8f89490a-3827-4204-8968-80d684dbcfcc tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:47.577821 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8f89490a-3827-4204-8968-80d684dbcfcc tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64" status: 200 len: 1318 microversion: 2.1 time: 0.884358 Aug 04 16:56:47.579288 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2013/3961] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:46 2022] GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64 => generated 1318 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:47.590057 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-88747195-4b3d-499e-83f5-554d2cd563a9 req-622e068f-0fdb-4096-be78-ea3a3ab21cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1664bfb4-4517-4700-ac66-79dc4586b387", "name": "network-vif-plugged", "status": "completed", "tag": "f01143f7-1e08-411e-9c6a-290949acb645"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:47.603310 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-88747195-4b3d-499e-83f5-554d2cd563a9 req-622e068f-0fdb-4096-be78-ea3a3ab21cd4 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:47.603767 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-88747195-4b3d-499e-83f5-554d2cd563a9 req-622e068f-0fdb-4096-be78-ea3a3ab21cd4 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:47.617110 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-88747195-4b3d-499e-83f5-554d2cd563a9 req-622e068f-0fdb-4096-be78-ea3a3ab21cd4 service nova] Creating event network-vif-plugged:f01143f7-1e08-411e-9c6a-290949acb645 for instance 1664bfb4-4517-4700-ac66-79dc4586b387 on n-h1-846466-12 Aug 04 16:56:47.626748 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-88747195-4b3d-499e-83f5-554d2cd563a9 req-622e068f-0fdb-4096-be78-ea3a3ab21cd4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045538 Aug 04 16:56:47.627572 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2014/3962] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:47.634758 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c2671988-f1e9-4b2f-8e23-37b0a121300f tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:47.635794 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c2671988-f1e9-4b2f-8e23-37b0a121300f tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] [instance: 8e273267-ae4b-4a99-821e-1c02c3440610] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:47.646698 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2671988-f1e9-4b2f-8e23-37b0a121300f tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:47.647123 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2671988-f1e9-4b2f-8e23-37b0a121300f tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:47.666724 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2671988-f1e9-4b2f-8e23-37b0a121300f tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:47.667507 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2671988-f1e9-4b2f-8e23-37b0a121300f tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:47.719777 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-c2671988-f1e9-4b2f-8e23-37b0a121300f tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] HTTP exception thrown: Instance 8e273267-ae4b-4a99-821e-1c02c3440610 could not be found. Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c2671988-f1e9-4b2f-8e23-37b0a121300f tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Request method failure captured: Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 HTTP/1.1 Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_hgQoldjm4_S3D94fDziXOCZOUcaEPIkok-kHbJHwUIzdGtcvkeBillRoIFaYXJsu7Tk4pMCR2QNHeQAvXq9QWucd4UqSLiPvzhfZDHUM-vqwSlXnpNF9f6diokGYUDCYY9TLy2cAYVevZKnVsF5LRgOY_zzwpHs1nxXrYIShHutYI Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: X-Openstack-Nova-Api-Version: 2.42 Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: b9fcc0fe6bb74058a0125be27a3a7090 Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1525214697 Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9fcc0fe6bb74058a0125be27a3a7090"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b9fcc0fe6bb74058a0125be27a3a7090"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9fcc0fe6bb74058a0125be27a3a7090"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b9fcc0fe6bb74058a0125be27a3a7090"}]}] Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1525214697 Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: b9fcc0fe6bb74058a0125be27a3a7090 Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1525214697 Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-TaggedBootDevicesTest_v242-1525214697-project Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 1ebb42db61b34dd2a4ba2a8ffa984684 Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1525214697-project Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 8e273267-ae4b-4a99-821e-1c02c3440610 could not be found. Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '8e273267-ae4b-4a99-821e-1c02c3440610'} Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e273267-ae4b-4a99-821e-1c02c3440610 could not be found. Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e273267-ae4b-4a99-821e-1c02c3440610 could not be found. Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:56:47.723784 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:47.728052 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:56:47.728052 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:47.728052 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:47.728052 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:47.728052 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:56:47.728052 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:56:47.728052 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e273267-ae4b-4a99-821e-1c02c3440610 could not be found. Aug 04 16:56:47.728052 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:56:47.730474 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c2671988-f1e9-4b2f-8e23-37b0a121300f tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] Returning 404 to user: Instance 8e273267-ae4b-4a99-821e-1c02c3440610 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:47.731872 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c2671988-f1e9-4b2f-8e23-37b0a121300f tempest-TaggedBootDevicesTest_v242-1525214697 tempest-TaggedBootDevicesTest_v242-1525214697-project] 10.222.0.23 "GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610" status: 404 len: 111 microversion: 2.42 time: 0.102659 Aug 04 16:56:47.736417 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2015/3963] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:47 2022] GET /compute/v2.1/servers/8e273267-ae4b-4a99-821e-1c02c3440610 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:56:47.743503 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c7e51bde-4451-49c9-8441-7a6ffd2dc279 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:47.744210 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c7e51bde-4451-49c9-8441-7a6ffd2dc279 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 760130d2-374e-4f4c-a73b-d7a99449e324] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:47.751278 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c7e51bde-4451-49c9-8441-7a6ffd2dc279 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:47.752012 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c7e51bde-4451-49c9-8441-7a6ffd2dc279 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:47.753999 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c7e51bde-4451-49c9-8441-7a6ffd2dc279 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:47.755165 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c7e51bde-4451-49c9-8441-7a6ffd2dc279 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:48.388326 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9d955742-0dc0-4513-a734-daa905be1287 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34126dbe898545fd9d7e03b55880ab53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c93b891c0324a8cace12fb77490ad16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:48.423624 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9d955742-0dc0-4513-a734-daa905be1287 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] 10.222.0.23 "GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402" status: 200 len: 1608 microversion: 2.1 time: 0.984286 Aug 04 16:56:48.424919 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1949/3964] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:47 2022] GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402 => generated 1608 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:48.449945 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ea02c790-8adc-4f17-9ce6-8052a46be1ef tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:48.457525 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ea02c790-8adc-4f17-9ce6-8052a46be1ef tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: ddc73e5e-fb45-4781-959e-c951fb5f2e6b] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:48.477052 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea02c790-8adc-4f17-9ce6-8052a46be1ef tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:48.478045 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea02c790-8adc-4f17-9ce6-8052a46be1ef tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:48.480504 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea02c790-8adc-4f17-9ce6-8052a46be1ef tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:48.482166 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea02c790-8adc-4f17-9ce6-8052a46be1ef tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:48.542434 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c7e51bde-4451-49c9-8441-7a6ffd2dc279 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:48.551443 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c7e51bde-4451-49c9-8441-7a6ffd2dc279 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324" status: 200 len: 1367 microversion: 2.1 time: 0.813495 Aug 04 16:56:48.552926 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2016/3965] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:47 2022] GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324 => generated 1367 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:48.564781 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-57b8caac-5897-40e2-b16a-2c88c05872a7 req-d8292699-50b3-4815-a848-6870d7fa978b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab4b676b-65f5-4c5f-bef2-2ce3934dfe64", "tag": "964a3091-95cd-4779-b384-92ad70837ad6"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:48.579891 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-57b8caac-5897-40e2-b16a-2c88c05872a7 req-d8292699-50b3-4815-a848-6870d7fa978b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:48.580350 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-57b8caac-5897-40e2-b16a-2c88c05872a7 req-d8292699-50b3-4815-a848-6870d7fa978b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:48.593774 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-57b8caac-5897-40e2-b16a-2c88c05872a7 req-d8292699-50b3-4815-a848-6870d7fa978b service nova] Creating event network-changed:964a3091-95cd-4779-b384-92ad70837ad6 for instance ab4b676b-65f5-4c5f-bef2-2ce3934dfe64 on n-h1-846466-12 Aug 04 16:56:48.601946 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-57b8caac-5897-40e2-b16a-2c88c05872a7 req-d8292699-50b3-4815-a848-6870d7fa978b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046235 Aug 04 16:56:48.602859 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2017/3966] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:48.612338 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-547cb341-8a56-4f58-9eea-7b656d24796d tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:48.626658 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-547cb341-8a56-4f58-9eea-7b656d24796d tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 1664bfb4-4517-4700-ac66-79dc4586b387] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:48.639968 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-547cb341-8a56-4f58-9eea-7b656d24796d tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:48.640735 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-547cb341-8a56-4f58-9eea-7b656d24796d tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:48.643437 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-547cb341-8a56-4f58-9eea-7b656d24796d tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:48.645438 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-547cb341-8a56-4f58-9eea-7b656d24796d tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:48.694779 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ea02c790-8adc-4f17-9ce6-8052a46be1ef tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:48.703680 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ea02c790-8adc-4f17-9ce6-8052a46be1ef tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b" status: 200 len: 1205 microversion: 2.1 time: 0.271656 Aug 04 16:56:48.716326 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1950/3967] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:48 2022] GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b => generated 1205 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:48.728327 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c37148cc-3a4c-4d8f-922f-f48df8269a8d tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:48.741426 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c37148cc-3a4c-4d8f-922f-f48df8269a8d tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] [instance: cab40427-161a-4071-8c75-1a402c924402] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:48.750314 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c37148cc-3a4c-4d8f-922f-f48df8269a8d tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:48.751257 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c37148cc-3a4c-4d8f-922f-f48df8269a8d tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:48.752944 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c37148cc-3a4c-4d8f-922f-f48df8269a8d tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:48.753640 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c37148cc-3a4c-4d8f-922f-f48df8269a8d tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:49.049374 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=26 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:49.186785 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-547cb341-8a56-4f58-9eea-7b656d24796d tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:49.195924 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-547cb341-8a56-4f58-9eea-7b656d24796d tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387" status: 200 len: 1321 microversion: 2.1 time: 0.591801 Aug 04 16:56:49.201271 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2018/3968] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:48 2022] GET /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387 => generated 1321 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:49.218346 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7b9cfa8a-6d9a-44ce-8ff0-f8cfa2311b15 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:49.219337 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7b9cfa8a-6d9a-44ce-8ff0-f8cfa2311b15 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: ab4b676b-65f5-4c5f-bef2-2ce3934dfe64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:49.226104 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b9cfa8a-6d9a-44ce-8ff0-f8cfa2311b15 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:49.226859 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b9cfa8a-6d9a-44ce-8ff0-f8cfa2311b15 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:49.229734 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b9cfa8a-6d9a-44ce-8ff0-f8cfa2311b15 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:49.230466 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b9cfa8a-6d9a-44ce-8ff0-f8cfa2311b15 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:49.369484 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c37148cc-3a4c-4d8f-922f-f48df8269a8d tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34126dbe898545fd9d7e03b55880ab53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c93b891c0324a8cace12fb77490ad16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:49.386290 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c37148cc-3a4c-4d8f-922f-f48df8269a8d tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] 10.222.0.23 "GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402" status: 200 len: 1608 microversion: 2.1 time: 0.667332 Aug 04 16:56:49.402237 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1951/3969] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:48 2022] GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402 => generated 1608 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:49.412855 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8cf20266-cca4-44ec-9275-7414ccc1287a tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:49.413716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8cf20266-cca4-44ec-9275-7414ccc1287a tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] [instance: cab40427-161a-4071-8c75-1a402c924402] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:49.422578 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8cf20266-cca4-44ec-9275-7414ccc1287a tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:49.423332 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8cf20266-cca4-44ec-9275-7414ccc1287a tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:49.424286 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8cf20266-cca4-44ec-9275-7414ccc1287a tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:49.424955 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8cf20266-cca4-44ec-9275-7414ccc1287a tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:49.651764 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7b9cfa8a-6d9a-44ce-8ff0-f8cfa2311b15 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:49.672305 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7b9cfa8a-6d9a-44ce-8ff0-f8cfa2311b15 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64" status: 200 len: 1318 microversion: 2.1 time: 0.467695 Aug 04 16:56:49.673594 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2019/3970] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:49 2022] GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64 => generated 1318 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:49.683622 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-69a675b3-b9ed-47ca-adf3-44c906192992 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:49.684902 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-69a675b3-b9ed-47ca-adf3-44c906192992 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 760130d2-374e-4f4c-a73b-d7a99449e324] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:49.700424 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-69a675b3-b9ed-47ca-adf3-44c906192992 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:49.702310 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-69a675b3-b9ed-47ca-adf3-44c906192992 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:49.704690 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-69a675b3-b9ed-47ca-adf3-44c906192992 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:49.705933 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-69a675b3-b9ed-47ca-adf3-44c906192992 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:49.741944 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8cf20266-cca4-44ec-9275-7414ccc1287a tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34126dbe898545fd9d7e03b55880ab53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c93b891c0324a8cace12fb77490ad16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:49.748711 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=100 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:49.754214 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8cf20266-cca4-44ec-9275-7414ccc1287a tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] 10.222.0.23 "GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402" status: 200 len: 1608 microversion: 2.1 time: 0.349605 Aug 04 16:56:49.754824 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1952/3971] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:49 2022] GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402 => generated 1608 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:49.775307 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-883ad5d1-263e-4d63-bb90-9f361a2f1fbd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:49.776123 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-883ad5d1-263e-4d63-bb90-9f361a2f1fbd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: ddc73e5e-fb45-4781-959e-c951fb5f2e6b] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:49.788791 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-883ad5d1-263e-4d63-bb90-9f361a2f1fbd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:49.792639 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-883ad5d1-263e-4d63-bb90-9f361a2f1fbd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:49.794560 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-883ad5d1-263e-4d63-bb90-9f361a2f1fbd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:49.795075 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-883ad5d1-263e-4d63-bb90-9f361a2f1fbd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:49.911541 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-883ad5d1-263e-4d63-bb90-9f361a2f1fbd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:49.921763 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-883ad5d1-263e-4d63-bb90-9f361a2f1fbd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b" status: 200 len: 1267 microversion: 2.1 time: 0.151132 Aug 04 16:56:49.935541 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1953/3972] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:49 2022] GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:50.010733 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-69a675b3-b9ed-47ca-adf3-44c906192992 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:50.022623 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-69a675b3-b9ed-47ca-adf3-44c906192992 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324" status: 200 len: 1367 microversion: 2.1 time: 0.347478 Aug 04 16:56:50.026893 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2020/3973] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:49 2022] GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324 => generated 1367 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:50.228448 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6da947f3-948c-4f32-8c65-ff97d8afeef2 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:50.229507 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6da947f3-948c-4f32-8c65-ff97d8afeef2 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 1664bfb4-4517-4700-ac66-79dc4586b387] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:50.238557 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6da947f3-948c-4f32-8c65-ff97d8afeef2 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:50.244526 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6da947f3-948c-4f32-8c65-ff97d8afeef2 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:50.246226 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6da947f3-948c-4f32-8c65-ff97d8afeef2 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:50.246840 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6da947f3-948c-4f32-8c65-ff97d8afeef2 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:50.348550 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-f4aed4e2-4b31-495d-89f7-6a1a3a6b2bc4 req-c69f1a96-c7d7-4c2c-bef2-51767ea7c697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "760130d2-374e-4f4c-a73b-d7a99449e324", "name": "network-vif-plugged", "status": "completed", "tag": "cbfa4f3b-18b3-43da-9dc1-bb3c05508ec3"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:50.372913 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-f4aed4e2-4b31-495d-89f7-6a1a3a6b2bc4 req-c69f1a96-c7d7-4c2c-bef2-51767ea7c697 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:50.373824 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-f4aed4e2-4b31-495d-89f7-6a1a3a6b2bc4 req-c69f1a96-c7d7-4c2c-bef2-51767ea7c697 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:50.395594 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=100 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:50.409429 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-f4aed4e2-4b31-495d-89f7-6a1a3a6b2bc4 req-c69f1a96-c7d7-4c2c-bef2-51767ea7c697 service nova] Creating event network-vif-plugged:cbfa4f3b-18b3-43da-9dc1-bb3c05508ec3 for instance 760130d2-374e-4f4c-a73b-d7a99449e324 on n-h2-846466-12 Aug 04 16:56:50.418331 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-f4aed4e2-4b31-495d-89f7-6a1a3a6b2bc4 req-c69f1a96-c7d7-4c2c-bef2-51767ea7c697 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076119 Aug 04 16:56:50.421335 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2021/3974] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:56:50.700107 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3b913808-c160-4bbe-bcbf-b87cc6326820 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:50.701006 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3b913808-c160-4bbe-bcbf-b87cc6326820 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: ab4b676b-65f5-4c5f-bef2-2ce3934dfe64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:50.710789 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b913808-c160-4bbe-bcbf-b87cc6326820 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:50.711947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b913808-c160-4bbe-bcbf-b87cc6326820 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:50.714731 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b913808-c160-4bbe-bcbf-b87cc6326820 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:50.715865 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b913808-c160-4bbe-bcbf-b87cc6326820 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:51.052473 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6da947f3-948c-4f32-8c65-ff97d8afeef2 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:51.062760 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6da947f3-948c-4f32-8c65-ff97d8afeef2 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387" status: 200 len: 1321 microversion: 2.1 time: 0.838693 Aug 04 16:56:51.064442 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1954/3975] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:50 2022] GET /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387 => generated 1321 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:51.074852 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2bef79d0-aa02-487d-ba27-d334c9e07a87 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:51.076576 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2bef79d0-aa02-487d-ba27-d334c9e07a87 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: ddc73e5e-fb45-4781-959e-c951fb5f2e6b] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:51.089541 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2bef79d0-aa02-487d-ba27-d334c9e07a87 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:51.092871 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2bef79d0-aa02-487d-ba27-d334c9e07a87 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:51.094951 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2bef79d0-aa02-487d-ba27-d334c9e07a87 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:51.095643 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2bef79d0-aa02-487d-ba27-d334c9e07a87 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:51.685156 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2bef79d0-aa02-487d-ba27-d334c9e07a87 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:51.699331 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2bef79d0-aa02-487d-ba27-d334c9e07a87 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b" status: 200 len: 1267 microversion: 2.1 time: 0.633333 Aug 04 16:56:51.713097 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1955/3976] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:51 2022] GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b => generated 1267 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:51.713097 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6ac78680-0ec6-43b8-ae52-b68750bdc47b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:51.713097 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6ac78680-0ec6-43b8-ae52-b68750bdc47b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 760130d2-374e-4f4c-a73b-d7a99449e324] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:51.718703 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3b913808-c160-4bbe-bcbf-b87cc6326820 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:51.730101 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6ac78680-0ec6-43b8-ae52-b68750bdc47b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:51.732371 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3b913808-c160-4bbe-bcbf-b87cc6326820 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64" status: 200 len: 1318 microversion: 2.1 time: 1.039757 Aug 04 16:56:51.733585 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6ac78680-0ec6-43b8-ae52-b68750bdc47b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:51.734756 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6ac78680-0ec6-43b8-ae52-b68750bdc47b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:51.736071 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6ac78680-0ec6-43b8-ae52-b68750bdc47b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:51.736962 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2022/3977] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:50 2022] GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64 => generated 1318 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:52.090853 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-27ee3a3e-0fa3-42ba-8f3d-1dc05f155f4c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:52.091670 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-27ee3a3e-0fa3-42ba-8f3d-1dc05f155f4c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 1664bfb4-4517-4700-ac66-79dc4586b387] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:52.106558 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-27ee3a3e-0fa3-42ba-8f3d-1dc05f155f4c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:52.109950 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-27ee3a3e-0fa3-42ba-8f3d-1dc05f155f4c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:52.116049 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-27ee3a3e-0fa3-42ba-8f3d-1dc05f155f4c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:52.116893 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-27ee3a3e-0fa3-42ba-8f3d-1dc05f155f4c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:52.802821 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6ac78680-0ec6-43b8-ae52-b68750bdc47b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:52.832352 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6ac78680-0ec6-43b8-ae52-b68750bdc47b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324" status: 200 len: 1367 microversion: 2.1 time: 1.130397 Aug 04 16:56:52.840471 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1956/3978] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:51 2022] GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324 => generated 1367 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:52.856175 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c5bd6cee-0f38-49ac-8461-976200926308 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:52.856720 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c5bd6cee-0f38-49ac-8461-976200926308 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: ddc73e5e-fb45-4781-959e-c951fb5f2e6b] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:52.886631 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c5bd6cee-0f38-49ac-8461-976200926308 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:52.886981 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c5bd6cee-0f38-49ac-8461-976200926308 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:52.888357 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c5bd6cee-0f38-49ac-8461-976200926308 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:52.888517 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c5bd6cee-0f38-49ac-8461-976200926308 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:53.250940 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-27ee3a3e-0fa3-42ba-8f3d-1dc05f155f4c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:53.263781 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-27ee3a3e-0fa3-42ba-8f3d-1dc05f155f4c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387" status: 200 len: 1512 microversion: 2.1 time: 1.179339 Aug 04 16:56:53.268706 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2023/3979] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:52 2022] GET /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387 => generated 1512 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:56:53.274053 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d85d73a0-4f84-45de-bdfa-12751295b1d7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:53.282361 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d85d73a0-4f84-45de-bdfa-12751295b1d7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: ab4b676b-65f5-4c5f-bef2-2ce3934dfe64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:53.294252 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d85d73a0-4f84-45de-bdfa-12751295b1d7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:53.299635 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d85d73a0-4f84-45de-bdfa-12751295b1d7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:53.302788 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d85d73a0-4f84-45de-bdfa-12751295b1d7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:53.303271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d85d73a0-4f84-45de-bdfa-12751295b1d7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:53.740867 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c5bd6cee-0f38-49ac-8461-976200926308 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:53.768799 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c5bd6cee-0f38-49ac-8461-976200926308 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b" status: 200 len: 1309 microversion: 2.1 time: 0.924846 Aug 04 16:56:53.776687 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1957/3980] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:52 2022] GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b => generated 1309 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:53.813495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3d520a20-4c2e-482a-ae9c-05b91907792c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:53.816139 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3d520a20-4c2e-482a-ae9c-05b91907792c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 35e71704-0700-4b89-a138-a0d8590f47d7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:53.840841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3d520a20-4c2e-482a-ae9c-05b91907792c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:53.841318 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3d520a20-4c2e-482a-ae9c-05b91907792c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:53.842294 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3d520a20-4c2e-482a-ae9c-05b91907792c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:53.842744 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3d520a20-4c2e-482a-ae9c-05b91907792c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:54.063064 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d85d73a0-4f84-45de-bdfa-12751295b1d7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:54.089126 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d85d73a0-4f84-45de-bdfa-12751295b1d7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64" status: 200 len: 1318 microversion: 2.1 time: 0.818805 Aug 04 16:56:54.090093 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2024/3981] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:53 2022] GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64 => generated 1318 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:54.110841 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c5bd2fb8-254c-4479-8d6b-2f47b35e32e8 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:54.112242 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c5bd2fb8-254c-4479-8d6b-2f47b35e32e8 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 760130d2-374e-4f4c-a73b-d7a99449e324] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:54.120007 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c5bd2fb8-254c-4479-8d6b-2f47b35e32e8 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:54.120718 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c5bd2fb8-254c-4479-8d6b-2f47b35e32e8 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:54.121727 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c5bd2fb8-254c-4479-8d6b-2f47b35e32e8 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:54.122343 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c5bd2fb8-254c-4479-8d6b-2f47b35e32e8 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:54.204798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3d520a20-4c2e-482a-ae9c-05b91907792c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:54.217638 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3d520a20-4c2e-482a-ae9c-05b91907792c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7" status: 200 len: 1511 microversion: 2.1 time: 0.426942 Aug 04 16:56:54.218612 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1958/3982] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:53 2022] GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7 => generated 1511 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:54.250725 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0f9b055d-a40e-495d-9abb-15bbc48ac0e7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:54.251905 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0f9b055d-a40e-495d-9abb-15bbc48ac0e7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 3ea25507-d70a-43c8-9491-19c8f4435217] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:54.279211 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0f9b055d-a40e-495d-9abb-15bbc48ac0e7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:54.280152 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0f9b055d-a40e-495d-9abb-15bbc48ac0e7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:54.287936 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0f9b055d-a40e-495d-9abb-15bbc48ac0e7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:54.288653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0f9b055d-a40e-495d-9abb-15bbc48ac0e7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:54.632504 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c5bd2fb8-254c-4479-8d6b-2f47b35e32e8 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:54.643061 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c5bd2fb8-254c-4479-8d6b-2f47b35e32e8 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324" status: 200 len: 1556 microversion: 2.1 time: 0.536947 Aug 04 16:56:54.646577 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2025/3983] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:54 2022] GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324 => generated 1556 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:54.667210 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1bbf9ffd-2c55-4362-959e-0187b4654788 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:54.667860 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1bbf9ffd-2c55-4362-959e-0187b4654788 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 760130d2-374e-4f4c-a73b-d7a99449e324] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:54.675110 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1bbf9ffd-2c55-4362-959e-0187b4654788 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:54.676172 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1bbf9ffd-2c55-4362-959e-0187b4654788 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:54.677224 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1bbf9ffd-2c55-4362-959e-0187b4654788 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:54.677775 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1bbf9ffd-2c55-4362-959e-0187b4654788 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:54.897113 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0f9b055d-a40e-495d-9abb-15bbc48ac0e7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:54.906087 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0f9b055d-a40e-495d-9abb-15bbc48ac0e7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/3ea25507-d70a-43c8-9491-19c8f4435217" status: 200 len: 1513 microversion: 2.1 time: 0.669724 Aug 04 16:56:54.919124 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1959/3984] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:54 2022] GET /compute/v2.1/servers/3ea25507-d70a-43c8-9491-19c8f4435217 => generated 1513 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:54.919124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fc0ad266-558f-485d-bf02-098818975f61 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:54.919124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fc0ad266-558f-485d-bf02-098818975f61 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: ddc73e5e-fb45-4781-959e-c951fb5f2e6b] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:54.920369 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fc0ad266-558f-485d-bf02-098818975f61 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:54.921136 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fc0ad266-558f-485d-bf02-098818975f61 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:54.922344 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fc0ad266-558f-485d-bf02-098818975f61 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:54.923263 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fc0ad266-558f-485d-bf02-098818975f61 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:54.929683 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1bbf9ffd-2c55-4362-959e-0187b4654788 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.267037 Aug 04 16:56:54.930248 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2026/3985] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Aug 4 16:56:54 2022] GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324/os-interface => generated 284 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:54.935793 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5bfcfdea-58fc-46b1-9ab4-5272a446469c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:54.951018 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5bfcfdea-58fc-46b1-9ab4-5272a446469c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:54.951907 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5bfcfdea-58fc-46b1-9ab4-5272a446469c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a'} {{(pid=126125) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:56:54.966922 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5bfcfdea-58fc-46b1-9ab4-5272a446469c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:54.967647 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5bfcfdea-58fc-46b1-9ab4-5272a446469c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:54.968766 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5bfcfdea-58fc-46b1-9ab4-5272a446469c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:54.969635 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5bfcfdea-58fc-46b1-9ab4-5272a446469c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:55.091106 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.multi_cell_list [None req-5bfcfdea-58fc-46b1-9ab4-5272a446469c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:56:55.178545 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5bfcfdea-58fc-46b1-9ab4-5272a446469c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:55.186272 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5bfcfdea-58fc-46b1-9ab4-5272a446469c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:55.186961 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5bfcfdea-58fc-46b1-9ab4-5272a446469c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:56.023727 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fc0ad266-558f-485d-bf02-098818975f61 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:56.034632 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fc0ad266-558f-485d-bf02-098818975f61 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b" status: 200 len: 1309 microversion: 2.1 time: 1.126380 Aug 04 16:56:56.035570 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1960/3986] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:54 2022] GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b => generated 1309 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:56.040478 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1508f412-ff4e-4775-9ee0-e299754707e7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:56.041189 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1508f412-ff4e-4775-9ee0-e299754707e7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: ab4b676b-65f5-4c5f-bef2-2ce3934dfe64] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:56.047644 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1508f412-ff4e-4775-9ee0-e299754707e7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:56.048094 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1508f412-ff4e-4775-9ee0-e299754707e7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:56.048953 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1508f412-ff4e-4775-9ee0-e299754707e7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:56.049538 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1508f412-ff4e-4775-9ee0-e299754707e7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:56.090048 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5bfcfdea-58fc-46b1-9ab4-5272a446469c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 1.158188 Aug 04 16:56:56.091327 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2027/3987] 10.222.0.23 () {58 vars in 1167 bytes} [Thu Aug 4 16:56:54 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:56.117404 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-ee6cb6dd-92ed-4ff1-a4df-b96b32fc71a0 req-fb5ce5f2-3238-4e64-ab12-3b29a3b2632f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab4b676b-65f5-4c5f-bef2-2ce3934dfe64", "name": "network-vif-plugged", "status": "completed", "tag": "964a3091-95cd-4779-b384-92ad70837ad6"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:56.128788 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-ee6cb6dd-92ed-4ff1-a4df-b96b32fc71a0 req-fb5ce5f2-3238-4e64-ab12-3b29a3b2632f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:56.129580 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-ee6cb6dd-92ed-4ff1-a4df-b96b32fc71a0 req-fb5ce5f2-3238-4e64-ab12-3b29a3b2632f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:56.145426 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-ee6cb6dd-92ed-4ff1-a4df-b96b32fc71a0 req-fb5ce5f2-3238-4e64-ab12-3b29a3b2632f service nova] Creating event network-vif-plugged:964a3091-95cd-4779-b384-92ad70837ad6 for instance ab4b676b-65f5-4c5f-bef2-2ce3934dfe64 on n-h1-846466-12 Aug 04 16:56:56.152848 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-ee6cb6dd-92ed-4ff1-a4df-b96b32fc71a0 req-fb5ce5f2-3238-4e64-ab12-3b29a3b2632f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044605 Aug 04 16:56:56.153814 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2028/3988] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:56.160166 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2734e4e5-c004-4c72-8164-73b894a6b5af tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:56.166948 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2734e4e5-c004-4c72-8164-73b894a6b5af tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:56.168086 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2734e4e5-c004-4c72-8164-73b894a6b5af tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-651531158', 'deleted': False, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a'} {{(pid=126125) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:56:56.175994 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2734e4e5-c004-4c72-8164-73b894a6b5af tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:56.176750 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2734e4e5-c004-4c72-8164-73b894a6b5af tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:56.177891 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2734e4e5-c004-4c72-8164-73b894a6b5af tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:56.178800 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2734e4e5-c004-4c72-8164-73b894a6b5af tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:56.337253 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.multi_cell_list [None req-2734e4e5-c004-4c72-8164-73b894a6b5af tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:56:56.432694 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2734e4e5-c004-4c72-8164-73b894a6b5af tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:56.441874 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2734e4e5-c004-4c72-8164-73b894a6b5af tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:56.442523 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2734e4e5-c004-4c72-8164-73b894a6b5af tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:56.926456 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1508f412-ff4e-4775-9ee0-e299754707e7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:56.935842 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1508f412-ff4e-4775-9ee0-e299754707e7 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64" status: 200 len: 1318 microversion: 2.1 time: 0.898880 Aug 04 16:56:56.953267 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1961/3989] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:56 2022] GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64 => generated 1318 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:56.963617 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-973c4682-c572-4223-af3d-51ba33ff15fe req-be3ebc02-d7a2-475d-b9a0-f83842ad8b90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddc73e5e-fb45-4781-959e-c951fb5f2e6b", "tag": "9676cb23-ecc3-41d9-bf6a-e43df75d4e96"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:56.984075 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2734e4e5-c004-4c72-8164-73b894a6b5af tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-651531158" status: 200 len: 1514 microversion: 2.1 time: 0.828739 Aug 04 16:56:56.985221 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2029/3990] 10.222.0.23 () {58 vars in 1261 bytes} [Thu Aug 4 16:56:56 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-651531158 => generated 1514 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:56.985635 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-973c4682-c572-4223-af3d-51ba33ff15fe req-be3ebc02-d7a2-475d-b9a0-f83842ad8b90 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:56.986073 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-973c4682-c572-4223-af3d-51ba33ff15fe req-be3ebc02-d7a2-475d-b9a0-f83842ad8b90 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:56.991736 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-98759af3-6002-499c-a7a1-9f873bb8a482 req-38e25507-cf59-400d-b769-d3764a0ff615 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "760130d2-374e-4f4c-a73b-d7a99449e324", "tag": "cbfa4f3b-18b3-43da-9dc1-bb3c05508ec3"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:57.010691 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-98759af3-6002-499c-a7a1-9f873bb8a482 req-38e25507-cf59-400d-b769-d3764a0ff615 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:57.011152 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-98759af3-6002-499c-a7a1-9f873bb8a482 req-38e25507-cf59-400d-b769-d3764a0ff615 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:57.025198 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-973c4682-c572-4223-af3d-51ba33ff15fe req-be3ebc02-d7a2-475d-b9a0-f83842ad8b90 service nova] Creating event network-changed:9676cb23-ecc3-41d9-bf6a-e43df75d4e96 for instance ddc73e5e-fb45-4781-959e-c951fb5f2e6b on n-h2-846466-12 Aug 04 16:56:57.025950 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-98759af3-6002-499c-a7a1-9f873bb8a482 req-38e25507-cf59-400d-b769-d3764a0ff615 service nova] Creating event network-changed:cbfa4f3b-18b3-43da-9dc1-bb3c05508ec3 for instance 760130d2-374e-4f4c-a73b-d7a99449e324 on n-h2-846466-12 Aug 04 16:56:57.034701 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-98759af3-6002-499c-a7a1-9f873bb8a482 req-38e25507-cf59-400d-b769-d3764a0ff615 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047136 Aug 04 16:56:57.035713 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2030/3991] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:57.043392 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-973c4682-c572-4223-af3d-51ba33ff15fe req-be3ebc02-d7a2-475d-b9a0-f83842ad8b90 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096323 Aug 04 16:56:57.044733 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1962/3992] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:57.060461 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-04aa9264-d61b-44dc-bcdb-8b43d86e01ee tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:57.061621 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-14eb1579-5277-40f8-94ae-6be318691717 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:57.070947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-04aa9264-d61b-44dc-bcdb-8b43d86e01ee tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:57.072221 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-04aa9264-d61b-44dc-bcdb-8b43d86e01ee tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a'} {{(pid=126125) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:56:57.072347 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-14eb1579-5277-40f8-94ae-6be318691717 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: ddc73e5e-fb45-4781-959e-c951fb5f2e6b] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:57.079061 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-14eb1579-5277-40f8-94ae-6be318691717 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:57.079504 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-14eb1579-5277-40f8-94ae-6be318691717 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:57.080360 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-14eb1579-5277-40f8-94ae-6be318691717 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:57.080818 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-14eb1579-5277-40f8-94ae-6be318691717 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:57.086875 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-04aa9264-d61b-44dc-bcdb-8b43d86e01ee tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:57.088025 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-04aa9264-d61b-44dc-bcdb-8b43d86e01ee tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:57.089206 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-04aa9264-d61b-44dc-bcdb-8b43d86e01ee tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:57.090245 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-04aa9264-d61b-44dc-bcdb-8b43d86e01ee tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:57.252096 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.multi_cell_list [None req-04aa9264-d61b-44dc-bcdb-8b43d86e01ee tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:56:57.332882 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:57.344789 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-04aa9264-d61b-44dc-bcdb-8b43d86e01ee tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:57.353832 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-04aa9264-d61b-44dc-bcdb-8b43d86e01ee tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:57.354887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-04aa9264-d61b-44dc-bcdb-8b43d86e01ee tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:57.359292 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=18 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:58.459685 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-04aa9264-d61b-44dc-bcdb-8b43d86e01ee tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4519 microversion: 2.1 time: 1.422242 Aug 04 16:56:58.462899 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2031/3993] 10.222.0.23 () {58 vars in 1173 bytes} [Thu Aug 4 16:56:57 2022] GET /compute/v2.1/servers/detail?status=active => generated 4519 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:58.470784 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1641b5c7-3d0c-4d46-b41d-0255cda27d1c tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:58.472163 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1641b5c7-3d0c-4d46-b41d-0255cda27d1c tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: ab4b676b-65f5-4c5f-bef2-2ce3934dfe64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:58.480726 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1641b5c7-3d0c-4d46-b41d-0255cda27d1c tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:58.481874 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1641b5c7-3d0c-4d46-b41d-0255cda27d1c tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:58.482950 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1641b5c7-3d0c-4d46-b41d-0255cda27d1c tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:58.483616 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1641b5c7-3d0c-4d46-b41d-0255cda27d1c tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:58.521669 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-14eb1579-5277-40f8-94ae-6be318691717 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:58.533239 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-14eb1579-5277-40f8-94ae-6be318691717 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b" status: 200 len: 1309 microversion: 2.1 time: 1.475478 Aug 04 16:56:58.537242 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1963/3994] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:57 2022] GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b => generated 1309 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:56:58.554793 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6f15bd1e-6781-479a-95bd-28ac8fb16118 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:58.574526 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6f15bd1e-6781-479a-95bd-28ac8fb16118 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:58.574983 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.compute.servers [None req-6f15bd1e-6781-479a-95bd-28ac8fb16118 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Removing options 'limit' from query {{(pid=126126) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 04 16:56:58.575879 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6f15bd1e-6781-479a-95bd-28ac8fb16118 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Searching by: {'deleted': False, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a'} {{(pid=126126) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:56:58.594316 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6f15bd1e-6781-479a-95bd-28ac8fb16118 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:58.594556 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6f15bd1e-6781-479a-95bd-28ac8fb16118 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:58.595355 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6f15bd1e-6781-479a-95bd-28ac8fb16118 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:58.595775 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6f15bd1e-6781-479a-95bd-28ac8fb16118 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:58.688412 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6f15bd1e-6781-479a-95bd-28ac8fb16118 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:58.702668 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6f15bd1e-6781-479a-95bd-28ac8fb16118 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:58.704056 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6f15bd1e-6781-479a-95bd-28ac8fb16118 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:59.136690 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1641b5c7-3d0c-4d46-b41d-0255cda27d1c tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:59.149420 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1641b5c7-3d0c-4d46-b41d-0255cda27d1c tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64" status: 200 len: 1508 microversion: 2.1 time: 0.684760 Aug 04 16:56:59.150015 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2032/3995] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:58 2022] GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64 => generated 1508 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:59.170214 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2fd9c1a0-6475-4431-a729-ca5d6331fd05 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:59.175473 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2fd9c1a0-6475-4431-a729-ca5d6331fd05 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: ab4b676b-65f5-4c5f-bef2-2ce3934dfe64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:59.193864 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2fd9c1a0-6475-4431-a729-ca5d6331fd05 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:59.194320 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2fd9c1a0-6475-4431-a729-ca5d6331fd05 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:59.195759 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2fd9c1a0-6475-4431-a729-ca5d6331fd05 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:59.196200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2fd9c1a0-6475-4431-a729-ca5d6331fd05 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:59.285771 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6f15bd1e-6781-479a-95bd-28ac8fb16118 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.746290 Aug 04 16:56:59.287146 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1964/3996] 10.222.0.23 () {58 vars in 1161 bytes} [Thu Aug 4 16:56:58 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:59.312527 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3732d889-1124-41ac-9ad0-2e095c9c9cb4 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:59.317035 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3732d889-1124-41ac-9ad0-2e095c9c9cb4 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:59.317922 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3732d889-1124-41ac-9ad0-2e095c9c9cb4 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a'} {{(pid=126126) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:56:59.324452 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3732d889-1124-41ac-9ad0-2e095c9c9cb4 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:59.325000 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3732d889-1124-41ac-9ad0-2e095c9c9cb4 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:59.325894 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3732d889-1124-41ac-9ad0-2e095c9c9cb4 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:59.326569 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3732d889-1124-41ac-9ad0-2e095c9c9cb4 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:59.536202 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.multi_cell_list [None req-3732d889-1124-41ac-9ad0-2e095c9c9cb4 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126126) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:56:59.683258 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3732d889-1124-41ac-9ad0-2e095c9c9cb4 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.376044 Aug 04 16:56:59.684697 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1965/3997] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Aug 4 16:56:59 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:59.707120 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1109db27-be47-4d6b-a133-8a2ac9358aa2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:59.708613 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1109db27-be47-4d6b-a133-8a2ac9358aa2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: ddc73e5e-fb45-4781-959e-c951fb5f2e6b] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:59.732090 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1109db27-be47-4d6b-a133-8a2ac9358aa2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:59.732645 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1109db27-be47-4d6b-a133-8a2ac9358aa2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:59.734484 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1109db27-be47-4d6b-a133-8a2ac9358aa2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:56:59.734943 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1109db27-be47-4d6b-a133-8a2ac9358aa2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:56:59.977885 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2fd9c1a0-6475-4431-a729-ca5d6331fd05 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:59.987231 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2fd9c1a0-6475-4431-a729-ca5d6331fd05 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64" status: 200 len: 1508 microversion: 2.1 time: 0.821283 Aug 04 16:56:59.987823 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2033/3998] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:59 2022] GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64 => generated 1508 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:56:59.992625 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-58a25ebd-6b53-4242-b66a-747688d4d44b tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:00.002239 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-58a25ebd-6b53-4242-b66a-747688d4d44b tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:00.002815 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.compute.servers [None req-58a25ebd-6b53-4242-b66a-747688d4d44b tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Removing options 'limit' from query {{(pid=126125) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 04 16:57:00.018297 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-58a25ebd-6b53-4242-b66a-747688d4d44b tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Searching by: {'deleted': False, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a'} {{(pid=126125) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:57:00.022804 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=100 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:00.024959 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58a25ebd-6b53-4242-b66a-747688d4d44b tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:00.025436 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58a25ebd-6b53-4242-b66a-747688d4d44b tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:00.026252 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58a25ebd-6b53-4242-b66a-747688d4d44b tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:00.026783 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58a25ebd-6b53-4242-b66a-747688d4d44b tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:00.072602 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.multi_cell_list [None req-58a25ebd-6b53-4242-b66a-747688d4d44b tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:57:00.139021 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-58a25ebd-6b53-4242-b66a-747688d4d44b tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.149846 Aug 04 16:57:00.146687 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2034/3999] 10.222.0.23 () {58 vars in 1150 bytes} [Thu Aug 4 16:56:59 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:00.154894 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d6d95c97-c548-489a-8590-8b06b9b168d8 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:00.161198 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d6d95c97-c548-489a-8590-8b06b9b168d8 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: ab4b676b-65f5-4c5f-bef2-2ce3934dfe64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:00.168779 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d6d95c97-c548-489a-8590-8b06b9b168d8 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:00.170059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d6d95c97-c548-489a-8590-8b06b9b168d8 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:00.172217 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d6d95c97-c548-489a-8590-8b06b9b168d8 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:00.172825 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d6d95c97-c548-489a-8590-8b06b9b168d8 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:00.247496 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1109db27-be47-4d6b-a133-8a2ac9358aa2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:00.261766 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1109db27-be47-4d6b-a133-8a2ac9358aa2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b" status: 200 len: 1309 microversion: 2.1 time: 0.570664 Aug 04 16:57:00.270110 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d6d95c97-c548-489a-8590-8b06b9b168d8 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "PUT /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64" status: 200 len: 1080 microversion: 2.1 time: 0.119554 Aug 04 16:57:00.271463 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2035/4000] 10.222.0.23 () {60 vars in 1256 bytes} [Thu Aug 4 16:57:00 2022] PUT /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64 => generated 1080 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:00.277115 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-1ab17ef9-3584-433d-9b05-c8943d4f2ef9 req-43fb38b6-a4c5-4611-9058-64cb95162d97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cab40427-161a-4071-8c75-1a402c924402", "tag": "48c095fd-d4cb-401f-b1ff-0380e65dd15f"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:00.283288 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1966/4001] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:59 2022] GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b => generated 1309 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:00.290934 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ae61c4e8-3837-4de6-86ff-692770fbbaab tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:00.295384 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-1ab17ef9-3584-433d-9b05-c8943d4f2ef9 req-43fb38b6-a4c5-4611-9058-64cb95162d97 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:00.297609 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-1ab17ef9-3584-433d-9b05-c8943d4f2ef9 req-43fb38b6-a4c5-4611-9058-64cb95162d97 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:00.308292 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ae61c4e8-3837-4de6-86ff-692770fbbaab tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:00.308960 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ae61c4e8-3837-4de6-86ff-692770fbbaab tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Searching by: {'deleted': False, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a'} {{(pid=126126) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:57:00.314062 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-1ab17ef9-3584-433d-9b05-c8943d4f2ef9 req-43fb38b6-a4c5-4611-9058-64cb95162d97 service nova] Creating event network-changed:48c095fd-d4cb-401f-b1ff-0380e65dd15f for instance cab40427-161a-4071-8c75-1a402c924402 on n-h2-846466-12 Aug 04 16:57:00.319788 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-1ab17ef9-3584-433d-9b05-c8943d4f2ef9 req-43fb38b6-a4c5-4611-9058-64cb95162d97 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046364 Aug 04 16:57:00.321790 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2036/4002] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:00.327409 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ae61c4e8-3837-4de6-86ff-692770fbbaab tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:00.328342 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0f0f4d81-cd11-4e8e-8691-ad025153133a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:00.329866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0f0f4d81-cd11-4e8e-8691-ad025153133a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: ab4b676b-65f5-4c5f-bef2-2ce3934dfe64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:00.333091 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ae61c4e8-3837-4de6-86ff-692770fbbaab tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:00.333995 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ae61c4e8-3837-4de6-86ff-692770fbbaab tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:00.334592 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ae61c4e8-3837-4de6-86ff-692770fbbaab tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:00.338325 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0f0f4d81-cd11-4e8e-8691-ad025153133a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:00.339031 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0f0f4d81-cd11-4e8e-8691-ad025153133a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:00.342244 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0f0f4d81-cd11-4e8e-8691-ad025153133a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:00.343424 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0f0f4d81-cd11-4e8e-8691-ad025153133a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:00.399783 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.multi_cell_list [None req-ae61c4e8-3837-4de6-86ff-692770fbbaab tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126126) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:57:00.483381 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ae61c4e8-3837-4de6-86ff-692770fbbaab tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.198815 Aug 04 16:57:00.483997 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1967/4003] 10.222.0.23 () {58 vars in 1125 bytes} [Thu Aug 4 16:57:00 2022] GET /compute/v2.1/servers => generated 1011 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:00.506880 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fe818feb-c233-4cca-ad3f-305787323de3 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:00.511754 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fe818feb-c233-4cca-ad3f-305787323de3 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:00.512422 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fe818feb-c233-4cca-ad3f-305787323de3 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a'} {{(pid=126126) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:57:00.560580 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fe818feb-c233-4cca-ad3f-305787323de3 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:00.561127 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fe818feb-c233-4cca-ad3f-305787323de3 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:00.562517 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fe818feb-c233-4cca-ad3f-305787323de3 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:00.562952 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fe818feb-c233-4cca-ad3f-305787323de3 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:00.773814 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.multi_cell_list [None req-fe818feb-c233-4cca-ad3f-305787323de3 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126126) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:57:00.956705 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fe818feb-c233-4cca-ad3f-305787323de3 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.452153 Aug 04 16:57:00.957800 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1968/4004] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:57:00 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:00.978370 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5e478abc-eccb-4006-9ba1-b9e6b68c7819 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:00.996150 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5e478abc-eccb-4006-9ba1-b9e6b68c7819 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:00.996813 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.compute.servers [None req-5e478abc-eccb-4006-9ba1-b9e6b68c7819 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Removing options 'limit' from query {{(pid=126126) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 04 16:57:00.997882 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5e478abc-eccb-4006-9ba1-b9e6b68c7819 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Searching by: {'deleted': False, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a'} {{(pid=126126) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:57:01.006806 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e478abc-eccb-4006-9ba1-b9e6b68c7819 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:01.007518 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e478abc-eccb-4006-9ba1-b9e6b68c7819 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:01.008793 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e478abc-eccb-4006-9ba1-b9e6b68c7819 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:01.009488 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e478abc-eccb-4006-9ba1-b9e6b68c7819 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:01.035165 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=100 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:01.040812 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5e478abc-eccb-4006-9ba1-b9e6b68c7819 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.071739 Aug 04 16:57:01.041816 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1969/4005] 10.222.0.23 () {58 vars in 1140 bytes} [Thu Aug 4 16:57:00 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:01.057178 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7c66b188-94d2-4a75-ab64-7c60e027945a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:01.080993 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7c66b188-94d2-4a75-ab64-7c60e027945a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:01.083235 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7c66b188-94d2-4a75-ab64-7c60e027945a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-651531158', 'deleted': False, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a'} {{(pid=126126) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:57:01.093535 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7c66b188-94d2-4a75-ab64-7c60e027945a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:01.094242 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7c66b188-94d2-4a75-ab64-7c60e027945a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:01.114592 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7c66b188-94d2-4a75-ab64-7c60e027945a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:01.115840 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7c66b188-94d2-4a75-ab64-7c60e027945a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:01.256758 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0f0f4d81-cd11-4e8e-8691-ad025153133a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:01.262179 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:01.306049 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0f0f4d81-cd11-4e8e-8691-ad025153133a tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64" status: 200 len: 1506 microversion: 2.1 time: 0.982557 Aug 04 16:57:01.308562 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.multi_cell_list [None req-7c66b188-94d2-4a75-ab64-7c60e027945a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126126) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:57:01.333883 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2037/4006] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:00 2022] GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64 => generated 1506 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:01.354159 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e3cb8463-cf37-4a57-bf9f-1bb393eea38f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:01.354630 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e3cb8463-cf37-4a57-bf9f-1bb393eea38f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: ddc73e5e-fb45-4781-959e-c951fb5f2e6b] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:01.386221 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3cb8463-cf37-4a57-bf9f-1bb393eea38f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:01.387079 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3cb8463-cf37-4a57-bf9f-1bb393eea38f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:01.391425 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7c66b188-94d2-4a75-ab64-7c60e027945a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-651531158" status: 200 len: 345 microversion: 2.1 time: 0.339775 Aug 04 16:57:01.393481 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1970/4007] 10.222.0.23 () {58 vars in 1240 bytes} [Thu Aug 4 16:57:01 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-651531158 => generated 345 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:01.405595 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3cb8463-cf37-4a57-bf9f-1bb393eea38f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:01.406399 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3cb8463-cf37-4a57-bf9f-1bb393eea38f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:01.411767 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fd559fe4-fd03-45ea-8f6c-9488eab5c0fa tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:01.416428 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fd559fe4-fd03-45ea-8f6c-9488eab5c0fa tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: ab4b676b-65f5-4c5f-bef2-2ce3934dfe64] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:01.430042 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fd559fe4-fd03-45ea-8f6c-9488eab5c0fa tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:01.430780 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fd559fe4-fd03-45ea-8f6c-9488eab5c0fa tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:01.431993 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fd559fe4-fd03-45ea-8f6c-9488eab5c0fa tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:01.434546 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fd559fe4-fd03-45ea-8f6c-9488eab5c0fa tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:01.880529 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e3cb8463-cf37-4a57-bf9f-1bb393eea38f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:01.890982 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e3cb8463-cf37-4a57-bf9f-1bb393eea38f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b" status: 200 len: 1309 microversion: 2.1 time: 0.555824 Aug 04 16:57:01.895953 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2038/4008] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:01 2022] GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b => generated 1309 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:01.910182 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a3a64d66-4d3a-4e17-8168-2094c95863dc tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:01.938525 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a3a64d66-4d3a-4e17-8168-2094c95863dc tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:01.938980 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a3a64d66-4d3a-4e17-8168-2094c95863dc tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:01.967333 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fd559fe4-fd03-45ea-8f6c-9488eab5c0fa tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:01.979784 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fd559fe4-fd03-45ea-8f6c-9488eab5c0fa tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64" status: 200 len: 1506 microversion: 2.1 time: 0.585059 Aug 04 16:57:01.981251 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1971/4009] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:01 2022] GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64 => generated 1506 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:02.010054 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-066445b8-c254-4a47-a5b7-453b50beeba5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:02.014402 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a3a64d66-4d3a-4e17-8168-2094c95863dc tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 35e71704-0700-4b89-a138-a0d8590f47d7] Going to try to stop instance {{(pid=126125) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 16:57:02.014612 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-066445b8-c254-4a47-a5b7-453b50beeba5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: ab4b676b-65f5-4c5f-bef2-2ce3934dfe64] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:02.038444 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-066445b8-c254-4a47-a5b7-453b50beeba5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:02.039166 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-066445b8-c254-4a47-a5b7-453b50beeba5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:02.041325 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-066445b8-c254-4a47-a5b7-453b50beeba5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:02.041912 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-066445b8-c254-4a47-a5b7-453b50beeba5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:02.143309 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a3a64d66-4d3a-4e17-8168-2094c95863dc tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "POST /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7/action" status: 202 len: 0 microversion: 2.1 time: 0.230150 Aug 04 16:57:02.148878 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2039/4010] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:57:01 2022] POST /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:57:02.176708 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ddaeab20-f85c-4dca-8e05-d4f6e992eee5 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:02.179198 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ddaeab20-f85c-4dca-8e05-d4f6e992eee5 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 35e71704-0700-4b89-a138-a0d8590f47d7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:02.203300 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ddaeab20-f85c-4dca-8e05-d4f6e992eee5 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:02.203488 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-066445b8-c254-4a47-a5b7-453b50beeba5 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "PUT /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64" status: 200 len: 1082 microversion: 2.1 time: 0.199607 Aug 04 16:57:02.205334 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ddaeab20-f85c-4dca-8e05-d4f6e992eee5 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:02.207613 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1972/4011] 10.222.0.23 () {60 vars in 1256 bytes} [Thu Aug 4 16:57:02 2022] PUT /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64 => generated 1082 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:02.227479 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6c48ce86-5167-447f-bc34-7b60ae73903b tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:02.232182 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6c48ce86-5167-447f-bc34-7b60ae73903b tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: ab4b676b-65f5-4c5f-bef2-2ce3934dfe64] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:02.236025 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ddaeab20-f85c-4dca-8e05-d4f6e992eee5 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:02.240575 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ddaeab20-f85c-4dca-8e05-d4f6e992eee5 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:02.266757 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c48ce86-5167-447f-bc34-7b60ae73903b tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:02.267092 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c48ce86-5167-447f-bc34-7b60ae73903b tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:02.267864 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c48ce86-5167-447f-bc34-7b60ae73903b tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:02.268287 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c48ce86-5167-447f-bc34-7b60ae73903b tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:02.743360 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ddaeab20-f85c-4dca-8e05-d4f6e992eee5 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:02.759540 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ddaeab20-f85c-4dca-8e05-d4f6e992eee5 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7" status: 200 len: 1521 microversion: 2.1 time: 0.601416 Aug 04 16:57:02.760252 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2040/4012] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:02 2022] GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7 => generated 1521 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:02.877027 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6c48ce86-5167-447f-bc34-7b60ae73903b tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:02.888302 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6c48ce86-5167-447f-bc34-7b60ae73903b tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64" status: 200 len: 1508 microversion: 2.1 time: 0.664332 Aug 04 16:57:02.893111 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1973/4013] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:02 2022] GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64 => generated 1508 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:02.911464 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-725ce6f7-f33c-45ee-bbc3-578dd8fd95b2 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:02.912124 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-725ce6f7-f33c-45ee-bbc3-578dd8fd95b2 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: ab4b676b-65f5-4c5f-bef2-2ce3934dfe64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:02.917540 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f57f05f1-7fc3-4f6a-8256-11f7e02a6b2c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:02.918360 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f57f05f1-7fc3-4f6a-8256-11f7e02a6b2c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: ddc73e5e-fb45-4781-959e-c951fb5f2e6b] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:02.926679 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f57f05f1-7fc3-4f6a-8256-11f7e02a6b2c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:02.927514 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f57f05f1-7fc3-4f6a-8256-11f7e02a6b2c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:02.928247 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-725ce6f7-f33c-45ee-bbc3-578dd8fd95b2 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:02.928628 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f57f05f1-7fc3-4f6a-8256-11f7e02a6b2c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:02.928780 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-725ce6f7-f33c-45ee-bbc3-578dd8fd95b2 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:02.929308 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f57f05f1-7fc3-4f6a-8256-11f7e02a6b2c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:02.942231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-725ce6f7-f33c-45ee-bbc3-578dd8fd95b2 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:02.942664 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-725ce6f7-f33c-45ee-bbc3-578dd8fd95b2 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:03.347276 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f57f05f1-7fc3-4f6a-8256-11f7e02a6b2c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:03.356095 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-725ce6f7-f33c-45ee-bbc3-578dd8fd95b2 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:03.363944 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f57f05f1-7fc3-4f6a-8256-11f7e02a6b2c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b" status: 200 len: 1309 microversion: 2.1 time: 0.452857 Aug 04 16:57:03.366120 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-725ce6f7-f33c-45ee-bbc3-578dd8fd95b2 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64" status: 200 len: 1508 microversion: 2.1 time: 0.459598 Aug 04 16:57:03.372805 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2041/4014] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:02 2022] GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64 => generated 1508 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:03.384460 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1974/4015] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:02 2022] GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b => generated 1309 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:03.388365 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7021758e-2172-4fea-896d-fc60cd9f0272 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:03.389443 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7021758e-2172-4fea-896d-fc60cd9f0272 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: ab4b676b-65f5-4c5f-bef2-2ce3934dfe64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:03.405125 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7021758e-2172-4fea-896d-fc60cd9f0272 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:03.414757 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7021758e-2172-4fea-896d-fc60cd9f0272 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:03.415875 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7021758e-2172-4fea-896d-fc60cd9f0272 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:03.417854 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7021758e-2172-4fea-896d-fc60cd9f0272 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:03.483865 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7021758e-2172-4fea-896d-fc60cd9f0272 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: ab4b676b-65f5-4c5f-bef2-2ce3934dfe64] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:57:03.684538 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7021758e-2172-4fea-896d-fc60cd9f0272 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64" status: 204 len: 0 microversion: 2.1 time: 0.299618 Aug 04 16:57:03.685657 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2042/4016] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:57:03 2022] DELETE /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:57:03.698303 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-315edde0-dc8f-4746-9435-c9b0a7c711cb tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:03.698931 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-315edde0-dc8f-4746-9435-c9b0a7c711cb tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: ab4b676b-65f5-4c5f-bef2-2ce3934dfe64] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:03.706224 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-315edde0-dc8f-4746-9435-c9b0a7c711cb tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:03.706758 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-315edde0-dc8f-4746-9435-c9b0a7c711cb tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:03.707924 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-315edde0-dc8f-4746-9435-c9b0a7c711cb tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:03.708419 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-315edde0-dc8f-4746-9435-c9b0a7c711cb tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:03.745257 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-315edde0-dc8f-4746-9435-c9b0a7c711cb tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: ab4b676b-65f5-4c5f-bef2-2ce3934dfe64] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:57:03.785710 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-829d8230-de3a-4cff-859d-baafa48f8327 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:03.786756 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-829d8230-de3a-4cff-859d-baafa48f8327 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 35e71704-0700-4b89-a138-a0d8590f47d7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:03.803595 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-829d8230-de3a-4cff-859d-baafa48f8327 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:03.805750 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-829d8230-de3a-4cff-859d-baafa48f8327 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:03.807875 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-829d8230-de3a-4cff-859d-baafa48f8327 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:03.809352 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-829d8230-de3a-4cff-859d-baafa48f8327 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:03.862231 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.compute.api [None req-315edde0-dc8f-4746-9435-c9b0a7c711cb tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: ab4b676b-65f5-4c5f-bef2-2ce3934dfe64] Instance is already in deleting state, ignoring this request Aug 04 16:57:03.863223 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-315edde0-dc8f-4746-9435-c9b0a7c711cb tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64" status: 204 len: 0 microversion: 2.1 time: 0.169556 Aug 04 16:57:03.869578 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1975/4017] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:57:03 2022] DELETE /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:57:03.879749 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7b1b422e-c251-414e-9397-d2938cd0e93e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:03.881016 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7b1b422e-c251-414e-9397-d2938cd0e93e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: ab4b676b-65f5-4c5f-bef2-2ce3934dfe64] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:03.911070 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b1b422e-c251-414e-9397-d2938cd0e93e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:03.913222 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b1b422e-c251-414e-9397-d2938cd0e93e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:03.916603 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b1b422e-c251-414e-9397-d2938cd0e93e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:03.917272 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b1b422e-c251-414e-9397-d2938cd0e93e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:04.252928 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-829d8230-de3a-4cff-859d-baafa48f8327 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:04.275195 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-829d8230-de3a-4cff-859d-baafa48f8327 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7" status: 200 len: 1521 microversion: 2.1 time: 0.493912 Aug 04 16:57:04.288711 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2043/4018] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:03 2022] GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7 => generated 1521 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:04.372324 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7b1b422e-c251-414e-9397-d2938cd0e93e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:04.389645 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c6ce68e0-c5aa-4ec1-ae74-feeef058f4c5 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:04.390276 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7b1b422e-c251-414e-9397-d2938cd0e93e tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64" status: 200 len: 1514 microversion: 2.1 time: 0.519069 Aug 04 16:57:04.391079 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c6ce68e0-c5aa-4ec1-ae74-feeef058f4c5 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: ddc73e5e-fb45-4781-959e-c951fb5f2e6b] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:04.395515 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1976/4019] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:03 2022] GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64 => generated 1514 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:04.408155 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c6ce68e0-c5aa-4ec1-ae74-feeef058f4c5 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:04.413550 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c6ce68e0-c5aa-4ec1-ae74-feeef058f4c5 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:04.415075 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c6ce68e0-c5aa-4ec1-ae74-feeef058f4c5 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:04.415696 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c6ce68e0-c5aa-4ec1-ae74-feeef058f4c5 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:04.722793 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-34350cf5-d8f7-4744-b39f-6dd34fea9941 req-1ef45ce6-3f24-4bc1-b56c-45e35b03ff38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddc73e5e-fb45-4781-959e-c951fb5f2e6b", "name": "network-vif-plugged", "status": "completed", "tag": "9676cb23-ecc3-41d9-bf6a-e43df75d4e96"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:04.731291 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c6ce68e0-c5aa-4ec1-ae74-feeef058f4c5 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:04.740407 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c6ce68e0-c5aa-4ec1-ae74-feeef058f4c5 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b" status: 200 len: 1309 microversion: 2.1 time: 0.355358 Aug 04 16:57:04.740624 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-34350cf5-d8f7-4744-b39f-6dd34fea9941 req-1ef45ce6-3f24-4bc1-b56c-45e35b03ff38 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:04.741218 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-34350cf5-d8f7-4744-b39f-6dd34fea9941 req-1ef45ce6-3f24-4bc1-b56c-45e35b03ff38 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:04.755179 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2044/4020] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:04 2022] GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b => generated 1309 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:04.772482 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-34350cf5-d8f7-4744-b39f-6dd34fea9941 req-1ef45ce6-3f24-4bc1-b56c-45e35b03ff38 service nova] Creating event network-vif-plugged:9676cb23-ecc3-41d9-bf6a-e43df75d4e96 for instance ddc73e5e-fb45-4781-959e-c951fb5f2e6b on n-h2-846466-12 Aug 04 16:57:04.780895 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-34350cf5-d8f7-4744-b39f-6dd34fea9941 req-1ef45ce6-3f24-4bc1-b56c-45e35b03ff38 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061860 Aug 04 16:57:04.782559 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1977/4021] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:57:05.298517 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a8d13b6f-c029-4152-83c3-7c2e2d91cea8 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:05.301859 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a8d13b6f-c029-4152-83c3-7c2e2d91cea8 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 35e71704-0700-4b89-a138-a0d8590f47d7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:05.313635 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8d13b6f-c029-4152-83c3-7c2e2d91cea8 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:05.314476 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8d13b6f-c029-4152-83c3-7c2e2d91cea8 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:05.315917 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8d13b6f-c029-4152-83c3-7c2e2d91cea8 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:05.316566 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8d13b6f-c029-4152-83c3-7c2e2d91cea8 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:05.416096 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6cb74745-7b8f-420f-9f18-f93f4c983a94 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:05.417420 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6cb74745-7b8f-420f-9f18-f93f4c983a94 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: ab4b676b-65f5-4c5f-bef2-2ce3934dfe64] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:05.424374 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6cb74745-7b8f-420f-9f18-f93f4c983a94 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:05.425159 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6cb74745-7b8f-420f-9f18-f93f4c983a94 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:05.426145 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6cb74745-7b8f-420f-9f18-f93f4c983a94 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:05.426721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6cb74745-7b8f-420f-9f18-f93f4c983a94 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:05.701459 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a8d13b6f-c029-4152-83c3-7c2e2d91cea8 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:05.712110 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6cb74745-7b8f-420f-9f18-f93f4c983a94 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:05.714663 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a8d13b6f-c029-4152-83c3-7c2e2d91cea8 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7" status: 200 len: 1521 microversion: 2.1 time: 0.421505 Aug 04 16:57:05.719868 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2045/4022] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:05 2022] GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7 => generated 1521 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:05.742401 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6cb74745-7b8f-420f-9f18-f93f4c983a94 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64" status: 200 len: 1514 microversion: 2.1 time: 0.330872 Aug 04 16:57:05.743668 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1978/4023] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:05 2022] GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64 => generated 1514 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:05.764417 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-87785f22-5fc5-4ff0-91d4-fb11ef54ca0c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:05.765492 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-87785f22-5fc5-4ff0-91d4-fb11ef54ca0c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: ddc73e5e-fb45-4781-959e-c951fb5f2e6b] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:05.772378 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-87785f22-5fc5-4ff0-91d4-fb11ef54ca0c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:05.773040 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-87785f22-5fc5-4ff0-91d4-fb11ef54ca0c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:05.774015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-87785f22-5fc5-4ff0-91d4-fb11ef54ca0c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:05.774604 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-87785f22-5fc5-4ff0-91d4-fb11ef54ca0c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:06.199976 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-a6f4bac0-f3b3-4a49-807c-751678158480 req-9ae6cfa1-5930-47c1-8da3-9679d664ca3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab4b676b-65f5-4c5f-bef2-2ce3934dfe64", "name": "network-vif-deleted", "tag": "964a3091-95cd-4779-b384-92ad70837ad6"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:06.222845 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a6f4bac0-f3b3-4a49-807c-751678158480 req-9ae6cfa1-5930-47c1-8da3-9679d664ca3c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:06.227295 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-87785f22-5fc5-4ff0-91d4-fb11ef54ca0c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:06.236896 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a6f4bac0-f3b3-4a49-807c-751678158480 req-9ae6cfa1-5930-47c1-8da3-9679d664ca3c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:06.258054 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-87785f22-5fc5-4ff0-91d4-fb11ef54ca0c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b" status: 200 len: 1309 microversion: 2.1 time: 0.495846 Aug 04 16:57:06.259380 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2046/4024] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:05 2022] GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b => generated 1309 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:06.291361 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-a6f4bac0-f3b3-4a49-807c-751678158480 req-9ae6cfa1-5930-47c1-8da3-9679d664ca3c service nova] Creating event network-vif-deleted:964a3091-95cd-4779-b384-92ad70837ad6 for instance ab4b676b-65f5-4c5f-bef2-2ce3934dfe64 on n-h1-846466-12 Aug 04 16:57:06.319011 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-a6f4bac0-f3b3-4a49-807c-751678158480 req-9ae6cfa1-5930-47c1-8da3-9679d664ca3c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122937 Aug 04 16:57:06.320723 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1979/4025] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:57:06.744634 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-994023b7-34fb-457b-9d15-0a6e9dd3e468 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:06.745247 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-994023b7-34fb-457b-9d15-0a6e9dd3e468 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 35e71704-0700-4b89-a138-a0d8590f47d7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:06.754960 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-994023b7-34fb-457b-9d15-0a6e9dd3e468 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:06.756081 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-994023b7-34fb-457b-9d15-0a6e9dd3e468 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:06.758817 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-994023b7-34fb-457b-9d15-0a6e9dd3e468 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:06.766259 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-207f8d2e-437c-4397-9d25-62f631ba0dbb tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:06.769683 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-207f8d2e-437c-4397-9d25-62f631ba0dbb tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: ab4b676b-65f5-4c5f-bef2-2ce3934dfe64] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:06.775789 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-994023b7-34fb-457b-9d15-0a6e9dd3e468 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:06.806595 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-207f8d2e-437c-4397-9d25-62f631ba0dbb tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:06.807969 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-207f8d2e-437c-4397-9d25-62f631ba0dbb tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:06.818254 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-207f8d2e-437c-4397-9d25-62f631ba0dbb tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:06.818698 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-207f8d2e-437c-4397-9d25-62f631ba0dbb tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:06.860526 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-207f8d2e-437c-4397-9d25-62f631ba0dbb tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:06.862002 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-207f8d2e-437c-4397-9d25-62f631ba0dbb tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:06.862648 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-207f8d2e-437c-4397-9d25-62f631ba0dbb tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lazy-loading 'fault' on Instance uuid ab4b676b-65f5-4c5f-bef2-2ce3934dfe64 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:57:06.988663 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-207f8d2e-437c-4397-9d25-62f631ba0dbb tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7e71c772ce49388bc47daf929ab9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac13585fd514c8390f32d1104a19c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:06.997613 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-207f8d2e-437c-4397-9d25-62f631ba0dbb tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64" status: 200 len: 1308 microversion: 2.1 time: 0.237031 Aug 04 16:57:06.998272 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1980/4026] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:06 2022] GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64 => generated 1308 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:07.094140 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-994023b7-34fb-457b-9d15-0a6e9dd3e468 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:07.113685 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-994023b7-34fb-457b-9d15-0a6e9dd3e468 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7" status: 200 len: 1521 microversion: 2.1 time: 0.373175 Aug 04 16:57:07.114274 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2047/4027] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:06 2022] GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7 => generated 1521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:07.287921 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-42131e3d-1dbb-4ff8-b682-3c6ce186ae8e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:07.288949 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-42131e3d-1dbb-4ff8-b682-3c6ce186ae8e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: ddc73e5e-fb45-4781-959e-c951fb5f2e6b] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:07.295806 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-42131e3d-1dbb-4ff8-b682-3c6ce186ae8e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:07.296536 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-42131e3d-1dbb-4ff8-b682-3c6ce186ae8e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:07.297264 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-42131e3d-1dbb-4ff8-b682-3c6ce186ae8e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:07.298798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-42131e3d-1dbb-4ff8-b682-3c6ce186ae8e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:07.476210 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-42131e3d-1dbb-4ff8-b682-3c6ce186ae8e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:07.485655 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-42131e3d-1dbb-4ff8-b682-3c6ce186ae8e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b" status: 200 len: 1491 microversion: 2.1 time: 0.201932 Aug 04 16:57:07.498504 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1981/4028] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:07 2022] GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b => generated 1491 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:07.510681 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-be66ed58-23c8-41c4-b8a3-41c2fe0858cf tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:07.511289 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-be66ed58-23c8-41c4-b8a3-41c2fe0858cf tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 9c37f5dc-fee0-447d-bc96-db9b59933f8f] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:07.513694 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:07.523957 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be66ed58-23c8-41c4-b8a3-41c2fe0858cf tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:07.524407 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be66ed58-23c8-41c4-b8a3-41c2fe0858cf tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:07.525183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be66ed58-23c8-41c4-b8a3-41c2fe0858cf tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:07.525638 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be66ed58-23c8-41c4-b8a3-41c2fe0858cf tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:07.676284 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-be66ed58-23c8-41c4-b8a3-41c2fe0858cf tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:07.685977 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-be66ed58-23c8-41c4-b8a3-41c2fe0858cf tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f" status: 200 len: 1491 microversion: 2.1 time: 0.179115 Aug 04 16:57:07.686578 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2048/4029] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:07 2022] GET /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f => generated 1491 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:07.707296 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4894b451-6c3a-4045-a0f9-150279703d9b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:07.707905 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4894b451-6c3a-4045-a0f9-150279703d9b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: ddc73e5e-fb45-4781-959e-c951fb5f2e6b] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:07.715255 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4894b451-6c3a-4045-a0f9-150279703d9b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:07.716013 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4894b451-6c3a-4045-a0f9-150279703d9b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:07.716792 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4894b451-6c3a-4045-a0f9-150279703d9b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:07.717215 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4894b451-6c3a-4045-a0f9-150279703d9b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:07.981863 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4894b451-6c3a-4045-a0f9-150279703d9b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:07.991411 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4894b451-6c3a-4045-a0f9-150279703d9b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b" status: 200 len: 1491 microversion: 2.1 time: 0.288058 Aug 04 16:57:07.992687 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1982/4030] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:07 2022] GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b => generated 1491 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:08.011725 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7a70f403-c4d2-4c24-b048-fa4cb7ccad85 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:08.014266 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7a70f403-c4d2-4c24-b048-fa4cb7ccad85 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: ddc73e5e-fb45-4781-959e-c951fb5f2e6b] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:08.018937 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1b0f3b15-69cb-426e-b92e-c60e98555649 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:08.019817 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1b0f3b15-69cb-426e-b92e-c60e98555649 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: ab4b676b-65f5-4c5f-bef2-2ce3934dfe64] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:08.028815 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a70f403-c4d2-4c24-b048-fa4cb7ccad85 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:08.029236 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a70f403-c4d2-4c24-b048-fa4cb7ccad85 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:08.029512 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1b0f3b15-69cb-426e-b92e-c60e98555649 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:08.029988 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1b0f3b15-69cb-426e-b92e-c60e98555649 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:08.030636 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a70f403-c4d2-4c24-b048-fa4cb7ccad85 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:08.031037 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1b0f3b15-69cb-426e-b92e-c60e98555649 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:08.031530 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a70f403-c4d2-4c24-b048-fa4cb7ccad85 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:08.031621 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1b0f3b15-69cb-426e-b92e-c60e98555649 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:08.055397 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-1b0f3b15-69cb-426e-b92e-c60e98555649 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] HTTP exception thrown: Instance ab4b676b-65f5-4c5f-bef2-2ce3934dfe64 could not be found. Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1b0f3b15-69cb-426e-b92e-c60e98555649 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Request method failure captured: Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64 HTTP/1.1 Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_myygf9VVlpf7lyXGMj6e06OssVYT2HXGC35cm6V-hexdsg9d--WJ95Unc_2WjqXzEf_PJD1YiNkNC2BTWaA2nNEoLrZhPk-DFEfBj9_5KbqMd22rMaxy-YcZ3HsGidgkmdCdi1yKSZnWAvXEqy7iv4sKOPHYR4_xZzhQ4UZCABDlY Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: fac13585fd514c8390f32d1104a19c0d Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1652875150 Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fac13585fd514c8390f32d1104a19c0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fac13585fd514c8390f32d1104a19c0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fac13585fd514c8390f32d1104a19c0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fac13585fd514c8390f32d1104a19c0d"}]}] Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServerDiskConfigTestJSON-1652875150 Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: fac13585fd514c8390f32d1104a19c0d Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1652875150 Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServerDiskConfigTestJSON-1652875150-project Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 9a7e71c772ce49388bc47daf929ab9e1 Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServerDiskConfigTestJSON-1652875150-project Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance ab4b676b-65f5-4c5f-bef2-2ce3934dfe64 could not be found. Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'ab4b676b-65f5-4c5f-bef2-2ce3934dfe64'} Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab4b676b-65f5-4c5f-bef2-2ce3934dfe64 could not be found. Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab4b676b-65f5-4c5f-bef2-2ce3934dfe64 could not be found. Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:08.062443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:08.067382 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:08.067382 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:08.067382 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:08.067382 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:57:08.067382 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:57:08.067382 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab4b676b-65f5-4c5f-bef2-2ce3934dfe64 could not be found. Aug 04 16:57:08.067382 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:08.073269 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1b0f3b15-69cb-426e-b92e-c60e98555649 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Returning 404 to user: Instance ab4b676b-65f5-4c5f-bef2-2ce3934dfe64 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:57:08.074462 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1b0f3b15-69cb-426e-b92e-c60e98555649 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64" status: 404 len: 111 microversion: 2.1 time: 0.059424 Aug 04 16:57:08.075593 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1983/4031] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:08 2022] GET /compute/v2.1/servers/ab4b676b-65f5-4c5f-bef2-2ce3934dfe64 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:57:08.084161 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7a70f403-c4d2-4c24-b048-fa4cb7ccad85 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: ddc73e5e-fb45-4781-959e-c951fb5f2e6b] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:57:08.085855 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2a1596a4-e470-40a5-a5ed-339f8eec307d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:08.086580 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2a1596a4-e470-40a5-a5ed-339f8eec307d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:08.093715 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a1596a4-e470-40a5-a5ed-339f8eec307d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:08.094860 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a1596a4-e470-40a5-a5ed-339f8eec307d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:08.095909 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a1596a4-e470-40a5-a5ed-339f8eec307d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:08.096526 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a1596a4-e470-40a5-a5ed-339f8eec307d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:08.126553 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-2a1596a4-e470-40a5-a5ed-339f8eec307d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] HTTP exception thrown: Instance 14749b47-d48c-46f0-a650-27ee70f5edf1 could not be found. Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2a1596a4-e470-40a5-a5ed-339f8eec307d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Request method failure captured: Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 HTTP/1.1 Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_myygf9VVlpf7lyXGMj6e06OssVYT2HXGC35cm6V-hexdsg9d--WJ95Unc_2WjqXzEf_PJD1YiNkNC2BTWaA2nNEoLrZhPk-DFEfBj9_5KbqMd22rMaxy-YcZ3HsGidgkmdCdi1yKSZnWAvXEqy7iv4sKOPHYR4_xZzhQ4UZCABDlY Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: fac13585fd514c8390f32d1104a19c0d Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1652875150 Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fac13585fd514c8390f32d1104a19c0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fac13585fd514c8390f32d1104a19c0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fac13585fd514c8390f32d1104a19c0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fac13585fd514c8390f32d1104a19c0d"}]}] Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServerDiskConfigTestJSON-1652875150 Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: fac13585fd514c8390f32d1104a19c0d Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1652875150 Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServerDiskConfigTestJSON-1652875150-project Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 9a7e71c772ce49388bc47daf929ab9e1 Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServerDiskConfigTestJSON-1652875150-project Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 14749b47-d48c-46f0-a650-27ee70f5edf1 could not be found. Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '14749b47-d48c-46f0-a650-27ee70f5edf1'} Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14749b47-d48c-46f0-a650-27ee70f5edf1 could not be found. Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:57:08.131523 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:57:08.135287 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14749b47-d48c-46f0-a650-27ee70f5edf1 could not be found. Aug 04 16:57:08.135287 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:08.135287 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:08.135287 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:08.135287 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:08.135287 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:08.135287 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:08.135287 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:57:08.135287 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:57:08.135287 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14749b47-d48c-46f0-a650-27ee70f5edf1 could not be found. Aug 04 16:57:08.135287 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:08.137294 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2a1596a4-e470-40a5-a5ed-339f8eec307d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Returning 404 to user: Instance 14749b47-d48c-46f0-a650-27ee70f5edf1 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:57:08.138777 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2a1596a4-e470-40a5-a5ed-339f8eec307d tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "DELETE /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1" status: 404 len: 111 microversion: 2.1 time: 0.058167 Aug 04 16:57:08.139932 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1984/4032] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:57:08 2022] DELETE /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:57:08.153495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-03dc35d9-b52a-4c2a-baac-06d7cbad7719 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:08.154236 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-03dc35d9-b52a-4c2a-baac-06d7cbad7719 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 35e71704-0700-4b89-a138-a0d8590f47d7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:08.164537 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03dc35d9-b52a-4c2a-baac-06d7cbad7719 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:08.165055 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03dc35d9-b52a-4c2a-baac-06d7cbad7719 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:08.165938 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03dc35d9-b52a-4c2a-baac-06d7cbad7719 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:08.166448 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03dc35d9-b52a-4c2a-baac-06d7cbad7719 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:08.228569 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7a70f403-c4d2-4c24-b048-fa4cb7ccad85 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b" status: 204 len: 0 microversion: 2.1 time: 0.220181 Aug 04 16:57:08.229183 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2049/4033] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:57:08 2022] DELETE /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:57:08.234636 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-58b825cf-bfe4-4e01-9380-e2e34151bc24 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:08.235356 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-58b825cf-bfe4-4e01-9380-e2e34151bc24 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 14749b47-d48c-46f0-a650-27ee70f5edf1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:08.241951 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58b825cf-bfe4-4e01-9380-e2e34151bc24 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:08.242395 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58b825cf-bfe4-4e01-9380-e2e34151bc24 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:08.243429 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58b825cf-bfe4-4e01-9380-e2e34151bc24 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:08.243863 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58b825cf-bfe4-4e01-9380-e2e34151bc24 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:08.258496 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:08.260693 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-58b825cf-bfe4-4e01-9380-e2e34151bc24 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] HTTP exception thrown: Instance 14749b47-d48c-46f0-a650-27ee70f5edf1 could not be found. Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-58b825cf-bfe4-4e01-9380-e2e34151bc24 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Request method failure captured: Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 HTTP/1.1 Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_myygf9VVlpf7lyXGMj6e06OssVYT2HXGC35cm6V-hexdsg9d--WJ95Unc_2WjqXzEf_PJD1YiNkNC2BTWaA2nNEoLrZhPk-DFEfBj9_5KbqMd22rMaxy-YcZ3HsGidgkmdCdi1yKSZnWAvXEqy7iv4sKOPHYR4_xZzhQ4UZCABDlY Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: fac13585fd514c8390f32d1104a19c0d Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1652875150 Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fac13585fd514c8390f32d1104a19c0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fac13585fd514c8390f32d1104a19c0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fac13585fd514c8390f32d1104a19c0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fac13585fd514c8390f32d1104a19c0d"}]}] Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerDiskConfigTestJSON-1652875150 Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: fac13585fd514c8390f32d1104a19c0d Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1652875150 Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerDiskConfigTestJSON-1652875150-project Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 9a7e71c772ce49388bc47daf929ab9e1 Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerDiskConfigTestJSON-1652875150-project Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 14749b47-d48c-46f0-a650-27ee70f5edf1 could not be found. Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '14749b47-d48c-46f0-a650-27ee70f5edf1'} Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14749b47-d48c-46f0-a650-27ee70f5edf1 could not be found. Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14749b47-d48c-46f0-a650-27ee70f5edf1 could not be found. Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:08.263289 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:57:08.268725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:08.268725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:08.268725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:08.268725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:57:08.268725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:57:08.268725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14749b47-d48c-46f0-a650-27ee70f5edf1 could not be found. Aug 04 16:57:08.268725 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:57:08.272525 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-58b825cf-bfe4-4e01-9380-e2e34151bc24 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Returning 404 to user: Instance 14749b47-d48c-46f0-a650-27ee70f5edf1 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:57:08.273631 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-58b825cf-bfe4-4e01-9380-e2e34151bc24 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1" status: 404 len: 111 microversion: 2.1 time: 0.043312 Aug 04 16:57:08.275497 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2050/4034] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:08 2022] GET /compute/v2.1/servers/14749b47-d48c-46f0-a650-27ee70f5edf1 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:57:08.282917 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8adfafbd-0b6c-4ef3-89e2-1e445b937fd3 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:08.283528 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8adfafbd-0b6c-4ef3-89e2-1e445b937fd3 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: ddc73e5e-fb45-4781-959e-c951fb5f2e6b] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:08.294047 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8adfafbd-0b6c-4ef3-89e2-1e445b937fd3 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:08.294493 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8adfafbd-0b6c-4ef3-89e2-1e445b937fd3 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:08.295278 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8adfafbd-0b6c-4ef3-89e2-1e445b937fd3 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:08.295703 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8adfafbd-0b6c-4ef3-89e2-1e445b937fd3 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:08.587060 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-03dc35d9-b52a-4c2a-baac-06d7cbad7719 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:08.596415 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-03dc35d9-b52a-4c2a-baac-06d7cbad7719 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7" status: 200 len: 1521 microversion: 2.1 time: 0.455015 Aug 04 16:57:08.597054 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1985/4035] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:08 2022] GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7 => generated 1521 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:08.602718 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7c8a01b2-226d-4c19-b7a1-60680682cef0 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:08.603591 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7c8a01b2-226d-4c19-b7a1-60680682cef0 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:08.619041 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7c8a01b2-226d-4c19-b7a1-60680682cef0 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:08.619760 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7c8a01b2-226d-4c19-b7a1-60680682cef0 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:08.620920 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7c8a01b2-226d-4c19-b7a1-60680682cef0 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:08.621758 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7c8a01b2-226d-4c19-b7a1-60680682cef0 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:08.642172 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-7c8a01b2-226d-4c19-b7a1-60680682cef0 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] HTTP exception thrown: Instance 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 could not be found. Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7c8a01b2-226d-4c19-b7a1-60680682cef0 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Request method failure captured: Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 HTTP/1.1 Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_myygf9VVlpf7lyXGMj6e06OssVYT2HXGC35cm6V-hexdsg9d--WJ95Unc_2WjqXzEf_PJD1YiNkNC2BTWaA2nNEoLrZhPk-DFEfBj9_5KbqMd22rMaxy-YcZ3HsGidgkmdCdi1yKSZnWAvXEqy7iv4sKOPHYR4_xZzhQ4UZCABDlY Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: fac13585fd514c8390f32d1104a19c0d Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1652875150 Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fac13585fd514c8390f32d1104a19c0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fac13585fd514c8390f32d1104a19c0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fac13585fd514c8390f32d1104a19c0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fac13585fd514c8390f32d1104a19c0d"}]}] Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServerDiskConfigTestJSON-1652875150 Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: fac13585fd514c8390f32d1104a19c0d Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1652875150 Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServerDiskConfigTestJSON-1652875150-project Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 9a7e71c772ce49388bc47daf929ab9e1 Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServerDiskConfigTestJSON-1652875150-project Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 could not be found. Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0'} Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 could not be found. Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:57:08.644141 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:57:08.648081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 could not be found. Aug 04 16:57:08.648081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:08.648081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:08.648081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:08.648081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:08.648081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:08.648081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:08.648081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:57:08.648081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:57:08.648081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 could not be found. Aug 04 16:57:08.648081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:08.648081 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7c8a01b2-226d-4c19-b7a1-60680682cef0 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Returning 404 to user: Instance 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:57:08.648081 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7c8a01b2-226d-4c19-b7a1-60680682cef0 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 404 len: 111 microversion: 2.1 time: 0.047784 Aug 04 16:57:08.648081 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1986/4036] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:57:08 2022] DELETE /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:57:08.655702 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5711fdb9-1c9b-40d1-bc22-fb3d25f674a0 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:08.656298 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5711fdb9-1c9b-40d1-bc22-fb3d25f674a0 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] [instance: 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:08.681927 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8adfafbd-0b6c-4ef3-89e2-1e445b937fd3 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:08.682432 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5711fdb9-1c9b-40d1-bc22-fb3d25f674a0 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:08.684809 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5711fdb9-1c9b-40d1-bc22-fb3d25f674a0 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:08.685935 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5711fdb9-1c9b-40d1-bc22-fb3d25f674a0 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:08.689777 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5711fdb9-1c9b-40d1-bc22-fb3d25f674a0 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:08.690736 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:08.693315 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8adfafbd-0b6c-4ef3-89e2-1e445b937fd3 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b" status: 200 len: 1497 microversion: 2.1 time: 0.416526 Aug 04 16:57:08.693974 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2051/4037] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:08 2022] GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b => generated 1497 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:08.711910 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:08.726974 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-5711fdb9-1c9b-40d1-bc22-fb3d25f674a0 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] HTTP exception thrown: Instance 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 could not be found. Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5711fdb9-1c9b-40d1-bc22-fb3d25f674a0 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Request method failure captured: Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 HTTP/1.1 Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_myygf9VVlpf7lyXGMj6e06OssVYT2HXGC35cm6V-hexdsg9d--WJ95Unc_2WjqXzEf_PJD1YiNkNC2BTWaA2nNEoLrZhPk-DFEfBj9_5KbqMd22rMaxy-YcZ3HsGidgkmdCdi1yKSZnWAvXEqy7iv4sKOPHYR4_xZzhQ4UZCABDlY Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: fac13585fd514c8390f32d1104a19c0d Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1652875150 Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fac13585fd514c8390f32d1104a19c0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fac13585fd514c8390f32d1104a19c0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fac13585fd514c8390f32d1104a19c0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fac13585fd514c8390f32d1104a19c0d"}]}] Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServerDiskConfigTestJSON-1652875150 Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: fac13585fd514c8390f32d1104a19c0d Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1652875150 Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServerDiskConfigTestJSON-1652875150-project Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 9a7e71c772ce49388bc47daf929ab9e1 Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServerDiskConfigTestJSON-1652875150-project Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 could not be found. Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0'} Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 could not be found. Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 could not be found. Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:08.729913 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:08.734067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:08.734067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:08.734067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:08.734067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:57:08.734067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:57:08.734067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 could not be found. Aug 04 16:57:08.734067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:08.737976 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5711fdb9-1c9b-40d1-bc22-fb3d25f674a0 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] Returning 404 to user: Instance 7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:57:08.739450 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5711fdb9-1c9b-40d1-bc22-fb3d25f674a0 tempest-ServerDiskConfigTestJSON-1652875150 tempest-ServerDiskConfigTestJSON-1652875150-project] 10.222.0.23 "GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0" status: 404 len: 111 microversion: 2.1 time: 0.088087 Aug 04 16:57:08.741109 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1987/4038] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:08 2022] GET /compute/v2.1/servers/7d4bdc48-f80f-45a9-a9ac-2e5f55e631a0 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:57:09.620094 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c419ff89-0c07-447b-83aa-7455c1ffaf4a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:09.622059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c419ff89-0c07-447b-83aa-7455c1ffaf4a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 35e71704-0700-4b89-a138-a0d8590f47d7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:09.631312 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c419ff89-0c07-447b-83aa-7455c1ffaf4a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:09.631760 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c419ff89-0c07-447b-83aa-7455c1ffaf4a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:09.632623 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c419ff89-0c07-447b-83aa-7455c1ffaf4a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:09.633067 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c419ff89-0c07-447b-83aa-7455c1ffaf4a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:09.716453 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-aedbc378-4351-46f0-ab60-1df9b6f8fe5e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:09.717073 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-aedbc378-4351-46f0-ab60-1df9b6f8fe5e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: ddc73e5e-fb45-4781-959e-c951fb5f2e6b] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:09.730066 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aedbc378-4351-46f0-ab60-1df9b6f8fe5e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:09.730788 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aedbc378-4351-46f0-ab60-1df9b6f8fe5e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:09.731798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aedbc378-4351-46f0-ab60-1df9b6f8fe5e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:09.732443 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aedbc378-4351-46f0-ab60-1df9b6f8fe5e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:10.033266 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=8 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:10.205588 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c419ff89-0c07-447b-83aa-7455c1ffaf4a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:10.217219 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c419ff89-0c07-447b-83aa-7455c1ffaf4a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7" status: 200 len: 1521 microversion: 2.1 time: 0.601296 Aug 04 16:57:10.218596 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2052/4039] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:09 2022] GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7 => generated 1521 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:10.267481 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-aedbc378-4351-46f0-ab60-1df9b6f8fe5e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:10.278705 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-aedbc378-4351-46f0-ab60-1df9b6f8fe5e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b" status: 200 len: 1497 microversion: 2.1 time: 0.567570 Aug 04 16:57:10.279294 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1988/4040] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:09 2022] GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b => generated 1497 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:11.240866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4d528559-5dbd-4fa2-9e78-c013de5023d1 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:11.242513 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4d528559-5dbd-4fa2-9e78-c013de5023d1 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 35e71704-0700-4b89-a138-a0d8590f47d7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:11.267620 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d528559-5dbd-4fa2-9e78-c013de5023d1 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:11.268074 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d528559-5dbd-4fa2-9e78-c013de5023d1 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:11.268872 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d528559-5dbd-4fa2-9e78-c013de5023d1 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:11.273120 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d528559-5dbd-4fa2-9e78-c013de5023d1 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:11.287273 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-a064c8d8-c8dc-4be5-95c3-1778785989f0 req-f842f04e-eae9-4ea2-9b17-9c6b3487c2bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddc73e5e-fb45-4781-959e-c951fb5f2e6b", "name": "network-vif-deleted", "tag": "9676cb23-ecc3-41d9-bf6a-e43df75d4e96"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:11.309944 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=12 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:11.312870 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a064c8d8-c8dc-4be5-95c3-1778785989f0 req-f842f04e-eae9-4ea2-9b17-9c6b3487c2bf service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:11.317362 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a064c8d8-c8dc-4be5-95c3-1778785989f0 req-f842f04e-eae9-4ea2-9b17-9c6b3487c2bf service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:11.356940 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-a064c8d8-c8dc-4be5-95c3-1778785989f0 req-f842f04e-eae9-4ea2-9b17-9c6b3487c2bf service nova] Creating event network-vif-deleted:9676cb23-ecc3-41d9-bf6a-e43df75d4e96 for instance ddc73e5e-fb45-4781-959e-c951fb5f2e6b on n-h2-846466-12 Aug 04 16:57:11.367668 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-a064c8d8-c8dc-4be5-95c3-1778785989f0 req-f842f04e-eae9-4ea2-9b17-9c6b3487c2bf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084856 Aug 04 16:57:11.377398 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1989/4041] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:11.383517 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2b663803-4594-4b57-a3bc-55b98939d7be tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:11.384620 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2b663803-4594-4b57-a3bc-55b98939d7be tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: ddc73e5e-fb45-4781-959e-c951fb5f2e6b] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:11.403517 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2b663803-4594-4b57-a3bc-55b98939d7be tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:11.405861 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2b663803-4594-4b57-a3bc-55b98939d7be tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:11.406985 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2b663803-4594-4b57-a3bc-55b98939d7be tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:11.410454 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2b663803-4594-4b57-a3bc-55b98939d7be tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:11.765777 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2b663803-4594-4b57-a3bc-55b98939d7be tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:11.778513 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2b663803-4594-4b57-a3bc-55b98939d7be tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b" status: 200 len: 1294 microversion: 2.1 time: 0.399410 Aug 04 16:57:11.779731 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1990/4042] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:11 2022] GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b => generated 1294 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:12.097090 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4d528559-5dbd-4fa2-9e78-c013de5023d1 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:12.108516 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4d528559-5dbd-4fa2-9e78-c013de5023d1 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7" status: 200 len: 1521 microversion: 2.1 time: 0.872170 Aug 04 16:57:12.123213 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2053/4043] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:11 2022] GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7 => generated 1521 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:12.801931 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-afde55d6-2fea-4404-979f-97a6680010f2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:12.802547 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-afde55d6-2fea-4404-979f-97a6680010f2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: ddc73e5e-fb45-4781-959e-c951fb5f2e6b] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:12.814065 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-afde55d6-2fea-4404-979f-97a6680010f2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:12.820319 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-afde55d6-2fea-4404-979f-97a6680010f2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:12.821561 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-afde55d6-2fea-4404-979f-97a6680010f2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:12.822248 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-afde55d6-2fea-4404-979f-97a6680010f2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:12.858791 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-afde55d6-2fea-4404-979f-97a6680010f2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] HTTP exception thrown: Instance ddc73e5e-fb45-4781-959e-c951fb5f2e6b could not be found. Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-afde55d6-2fea-4404-979f-97a6680010f2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Request method failure captured: Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b HTTP/1.1 Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_nQAsIL8Gtig2JiDfXWtIJ3WPqwL_iDK7Lzq6TGktfJLC3h9uoTgZsXj24J3msyyZQB5KWPirQK_R6x2-eYME28EQ_2bgNAh7DlNXEg7JFJsdnvAdfZMaqCmRUibanDLQxQgidHpyXwUg784UXcgxKrIZzuzT1AuaLsb_WysQnZpiA Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersTestJSON-750208524 Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa4bb1fda4ef4267829850c4c616df77"}]}] Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersTestJSON-750208524 Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersTestJSON-750208524 Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersTestJSON-750208524-project Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: db8a96da1d7943599ee6ca9df18f5148 Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersTestJSON-750208524-project Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance ddc73e5e-fb45-4781-959e-c951fb5f2e6b could not be found. Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'ddc73e5e-fb45-4781-959e-c951fb5f2e6b'} Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddc73e5e-fb45-4781-959e-c951fb5f2e6b could not be found. Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddc73e5e-fb45-4781-959e-c951fb5f2e6b could not be found. Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:12.867772 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:12.871680 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:12.871680 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:12.871680 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:57:12.871680 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:57:12.871680 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddc73e5e-fb45-4781-959e-c951fb5f2e6b could not be found. Aug 04 16:57:12.871680 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:12.873747 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-afde55d6-2fea-4404-979f-97a6680010f2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Returning 404 to user: Instance ddc73e5e-fb45-4781-959e-c951fb5f2e6b could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:57:12.879131 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-afde55d6-2fea-4404-979f-97a6680010f2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b" status: 404 len: 111 microversion: 2.1 time: 0.081486 Aug 04 16:57:12.880451 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1991/4044] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:12 2022] GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:57:12.888999 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-60e6162a-85ca-4f26-9f43-e4500d212a06 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:12.889868 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-60e6162a-85ca-4f26-9f43-e4500d212a06 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 9c37f5dc-fee0-447d-bc96-db9b59933f8f] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:12.908179 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-60e6162a-85ca-4f26-9f43-e4500d212a06 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:12.908633 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-60e6162a-85ca-4f26-9f43-e4500d212a06 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:12.913890 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-60e6162a-85ca-4f26-9f43-e4500d212a06 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:12.914269 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-60e6162a-85ca-4f26-9f43-e4500d212a06 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:13.010719 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-60e6162a-85ca-4f26-9f43-e4500d212a06 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 9c37f5dc-fee0-447d-bc96-db9b59933f8f] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:57:13.134102 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5d6ded1c-adb9-4e8a-886e-9ef364cee6bf tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:13.135011 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5d6ded1c-adb9-4e8a-886e-9ef364cee6bf tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 35e71704-0700-4b89-a138-a0d8590f47d7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:13.141978 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5d6ded1c-adb9-4e8a-886e-9ef364cee6bf tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:13.142794 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5d6ded1c-adb9-4e8a-886e-9ef364cee6bf tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:13.143820 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5d6ded1c-adb9-4e8a-886e-9ef364cee6bf tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:13.144565 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5d6ded1c-adb9-4e8a-886e-9ef364cee6bf tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:13.248355 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-60e6162a-85ca-4f26-9f43-e4500d212a06 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f" status: 204 len: 0 microversion: 2.1 time: 0.363517 Aug 04 16:57:13.249798 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2054/4045] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:57:12 2022] DELETE /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:57:13.260760 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5be2806d-c365-4f62-b447-5456cde8f09c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:13.266833 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5be2806d-c365-4f62-b447-5456cde8f09c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 9c37f5dc-fee0-447d-bc96-db9b59933f8f] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:13.281889 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5be2806d-c365-4f62-b447-5456cde8f09c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:13.282719 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5be2806d-c365-4f62-b447-5456cde8f09c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:13.283958 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5be2806d-c365-4f62-b447-5456cde8f09c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:13.284642 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5be2806d-c365-4f62-b447-5456cde8f09c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:13.797795 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5be2806d-c365-4f62-b447-5456cde8f09c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:13.804729 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5d6ded1c-adb9-4e8a-886e-9ef364cee6bf tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:13.807162 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5be2806d-c365-4f62-b447-5456cde8f09c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f" status: 200 len: 1497 microversion: 2.1 time: 0.553020 Aug 04 16:57:13.808827 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2055/4046] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:13 2022] GET /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f => generated 1497 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:13.834907 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5d6ded1c-adb9-4e8a-886e-9ef364cee6bf tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7" status: 200 len: 1498 microversion: 2.1 time: 0.703118 Aug 04 16:57:13.835525 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1992/4047] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:13 2022] GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7 => generated 1498 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:13.856623 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-461583f7-618e-4f93-8a16-3fb1188c985e tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:13.864210 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-461583f7-618e-4f93-8a16-3fb1188c985e tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:13.865425 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-461583f7-618e-4f93-8a16-3fb1188c985e tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a'} {{(pid=126125) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:57:13.874214 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-461583f7-618e-4f93-8a16-3fb1188c985e tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:13.874901 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-461583f7-618e-4f93-8a16-3fb1188c985e tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:13.875897 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-461583f7-618e-4f93-8a16-3fb1188c985e tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:13.876336 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-461583f7-618e-4f93-8a16-3fb1188c985e tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:13.935823 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.multi_cell_list [None req-461583f7-618e-4f93-8a16-3fb1188c985e tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:57:13.976953 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-461583f7-618e-4f93-8a16-3fb1188c985e tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.124996 Aug 04 16:57:13.986160 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2056/4048] 10.222.0.23 () {58 vars in 1154 bytes} [Thu Aug 4 16:57:13 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:13.989987 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-032f6c26-263c-41e0-8db4-49977eb657a2 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:13.994436 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:14.001240 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-032f6c26-263c-41e0-8db4-49977eb657a2 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:14.003275 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-032f6c26-263c-41e0-8db4-49977eb657a2 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:14.036035 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-032f6c26-263c-41e0-8db4-49977eb657a2 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 35e71704-0700-4b89-a138-a0d8590f47d7] Going to try to start instance {{(pid=126126) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 16:57:14.101848 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-032f6c26-263c-41e0-8db4-49977eb657a2 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "POST /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7/action" status: 202 len: 0 microversion: 2.1 time: 0.115952 Aug 04 16:57:14.107929 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1993/4049] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:57:13 2022] POST /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:57:14.113039 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4fab66c6-fc4a-4989-a06d-c693d298ab3a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:14.113940 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4fab66c6-fc4a-4989-a06d-c693d298ab3a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 35e71704-0700-4b89-a138-a0d8590f47d7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:14.124935 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4fab66c6-fc4a-4989-a06d-c693d298ab3a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:14.125699 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4fab66c6-fc4a-4989-a06d-c693d298ab3a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:14.127087 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4fab66c6-fc4a-4989-a06d-c693d298ab3a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:14.128022 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4fab66c6-fc4a-4989-a06d-c693d298ab3a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:14.837388 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0171b6e9-dc7a-4bd6-b620-127fc9b8b38d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:14.838756 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0171b6e9-dc7a-4bd6-b620-127fc9b8b38d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 9c37f5dc-fee0-447d-bc96-db9b59933f8f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:14.846972 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0171b6e9-dc7a-4bd6-b620-127fc9b8b38d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:14.847650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0171b6e9-dc7a-4bd6-b620-127fc9b8b38d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:14.848571 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0171b6e9-dc7a-4bd6-b620-127fc9b8b38d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:14.849145 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0171b6e9-dc7a-4bd6-b620-127fc9b8b38d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:14.874712 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4fab66c6-fc4a-4989-a06d-c693d298ab3a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:14.883829 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4fab66c6-fc4a-4989-a06d-c693d298ab3a tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7" status: 200 len: 1507 microversion: 2.1 time: 0.775951 Aug 04 16:57:14.890927 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2057/4050] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:14 2022] GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7 => generated 1507 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:15.563053 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0171b6e9-dc7a-4bd6-b620-127fc9b8b38d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:15.589079 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0171b6e9-dc7a-4bd6-b620-127fc9b8b38d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f" status: 200 len: 1497 microversion: 2.1 time: 0.762848 Aug 04 16:57:15.591254 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1994/4051] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:14 2022] GET /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f => generated 1497 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:15.908215 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5e837749-c01e-4c63-bf88-4c0b05728449 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:15.909692 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5e837749-c01e-4c63-bf88-4c0b05728449 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 35e71704-0700-4b89-a138-a0d8590f47d7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:15.924789 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5e837749-c01e-4c63-bf88-4c0b05728449 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:15.926931 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5e837749-c01e-4c63-bf88-4c0b05728449 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:15.929152 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5e837749-c01e-4c63-bf88-4c0b05728449 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:15.930840 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5e837749-c01e-4c63-bf88-4c0b05728449 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:16.390772 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-c3a2efe2-1bc3-465c-a7b1-b5c1cca5947e req-ce9d4955-9b9f-4eac-9244-e4001502ebff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c37f5dc-fee0-447d-bc96-db9b59933f8f", "name": "network-vif-deleted", "tag": "b214ecba-8002-4e67-9903-a9531c89a2c0"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:16.411789 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-c3a2efe2-1bc3-465c-a7b1-b5c1cca5947e req-ce9d4955-9b9f-4eac-9244-e4001502ebff service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:16.412286 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-c3a2efe2-1bc3-465c-a7b1-b5c1cca5947e req-ce9d4955-9b9f-4eac-9244-e4001502ebff service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:16.436806 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5e837749-c01e-4c63-bf88-4c0b05728449 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:16.438329 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-c3a2efe2-1bc3-465c-a7b1-b5c1cca5947e req-ce9d4955-9b9f-4eac-9244-e4001502ebff service nova] Creating event network-vif-deleted:b214ecba-8002-4e67-9903-a9531c89a2c0 for instance 9c37f5dc-fee0-447d-bc96-db9b59933f8f on n-h1-846466-12 Aug 04 16:57:16.455042 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-c3a2efe2-1bc3-465c-a7b1-b5c1cca5947e req-ce9d4955-9b9f-4eac-9244-e4001502ebff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069443 Aug 04 16:57:16.458107 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1995/4052] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:57:16.466473 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5e837749-c01e-4c63-bf88-4c0b05728449 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7" status: 200 len: 1507 microversion: 2.1 time: 0.561806 Aug 04 16:57:16.467740 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2058/4053] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:15 2022] GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7 => generated 1507 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:16.613148 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-670ec336-0105-4f58-838f-92920a63e4cd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:16.613782 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-670ec336-0105-4f58-838f-92920a63e4cd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 9c37f5dc-fee0-447d-bc96-db9b59933f8f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:16.625328 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-670ec336-0105-4f58-838f-92920a63e4cd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:16.626943 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-670ec336-0105-4f58-838f-92920a63e4cd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:16.629145 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-670ec336-0105-4f58-838f-92920a63e4cd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:16.629895 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-670ec336-0105-4f58-838f-92920a63e4cd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:16.684797 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-670ec336-0105-4f58-838f-92920a63e4cd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:16.687423 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-670ec336-0105-4f58-838f-92920a63e4cd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:16.688464 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-670ec336-0105-4f58-838f-92920a63e4cd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lazy-loading 'fault' on Instance uuid 9c37f5dc-fee0-447d-bc96-db9b59933f8f {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:57:16.747581 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-670ec336-0105-4f58-838f-92920a63e4cd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:16.757786 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-670ec336-0105-4f58-838f-92920a63e4cd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f" status: 200 len: 1299 microversion: 2.1 time: 0.149193 Aug 04 16:57:16.759235 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1996/4054] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:16 2022] GET /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f => generated 1299 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:17.489610 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a4c71ee6-0c0e-4976-857f-60eefe1132bb tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:17.490257 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a4c71ee6-0c0e-4976-857f-60eefe1132bb tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 35e71704-0700-4b89-a138-a0d8590f47d7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:17.502622 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a4c71ee6-0c0e-4976-857f-60eefe1132bb tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:17.504696 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a4c71ee6-0c0e-4976-857f-60eefe1132bb tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:17.507046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a4c71ee6-0c0e-4976-857f-60eefe1132bb tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:17.509750 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a4c71ee6-0c0e-4976-857f-60eefe1132bb tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:17.781744 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7865862e-7e9a-4e3c-ada5-1dc55b2b762d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:17.782595 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7865862e-7e9a-4e3c-ada5-1dc55b2b762d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 9c37f5dc-fee0-447d-bc96-db9b59933f8f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:17.796032 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7865862e-7e9a-4e3c-ada5-1dc55b2b762d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:17.798069 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7865862e-7e9a-4e3c-ada5-1dc55b2b762d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:17.801231 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7865862e-7e9a-4e3c-ada5-1dc55b2b762d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:17.802359 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7865862e-7e9a-4e3c-ada5-1dc55b2b762d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:17.836721 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-7865862e-7e9a-4e3c-ada5-1dc55b2b762d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] HTTP exception thrown: Instance 9c37f5dc-fee0-447d-bc96-db9b59933f8f could not be found. Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7865862e-7e9a-4e3c-ada5-1dc55b2b762d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Request method failure captured: Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f HTTP/1.1 Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_nQAsIL8Gtig2JiDfXWtIJ3WPqwL_iDK7Lzq6TGktfJLC3h9uoTgZsXj24J3msyyZQB5KWPirQK_R6x2-eYME28EQ_2bgNAh7DlNXEg7JFJsdnvAdfZMaqCmRUibanDLQxQgidHpyXwUg784UXcgxKrIZzuzT1AuaLsb_WysQnZpiA Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersTestJSON-750208524 Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa4bb1fda4ef4267829850c4c616df77"}]}] Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersTestJSON-750208524 Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersTestJSON-750208524 Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersTestJSON-750208524-project Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: db8a96da1d7943599ee6ca9df18f5148 Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersTestJSON-750208524-project Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 9c37f5dc-fee0-447d-bc96-db9b59933f8f could not be found. Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '9c37f5dc-fee0-447d-bc96-db9b59933f8f'} Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c37f5dc-fee0-447d-bc96-db9b59933f8f could not be found. Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c37f5dc-fee0-447d-bc96-db9b59933f8f could not be found. Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:17.842573 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:17.847799 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:17.847799 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:17.847799 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:57:17.847799 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:57:17.847799 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c37f5dc-fee0-447d-bc96-db9b59933f8f could not be found. Aug 04 16:57:17.847799 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:17.851230 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7865862e-7e9a-4e3c-ada5-1dc55b2b762d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Returning 404 to user: Instance 9c37f5dc-fee0-447d-bc96-db9b59933f8f could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:57:17.852880 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7865862e-7e9a-4e3c-ada5-1dc55b2b762d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f" status: 404 len: 111 microversion: 2.1 time: 0.075789 Aug 04 16:57:17.853855 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1997/4055] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:17 2022] GET /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:57:18.000954 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a8874ec3-37c4-4c8b-83a2-e66553967d7f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1702792281", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "b83d6df0-d970-41bd-ae99-1dfc6211d426"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:18.073580 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-a8874ec3-37c4-4c8b-83a2-e66553967d7f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] validate_networks() for [('b83d6df0-d970-41bd-ae99-1dfc6211d426', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:57:18.481793 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a4c71ee6-0c0e-4976-857f-60eefe1132bb tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:18.489905 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a4c71ee6-0c0e-4976-857f-60eefe1132bb tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7" status: 200 len: 1511 microversion: 2.1 time: 1.006332 Aug 04 16:57:18.490578 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2059/4056] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:17 2022] GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7 => generated 1511 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:18.515338 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-46bd6764-5d79-469a-9f6f-4e3b59e6d7b3 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:18.529798 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-46bd6764-5d79-469a-9f6f-4e3b59e6d7b3 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:18.530365 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.compute.servers [None req-46bd6764-5d79-469a-9f6f-4e3b59e6d7b3 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Removing options 'limit' from query {{(pid=126125) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 04 16:57:18.538439 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-46bd6764-5d79-469a-9f6f-4e3b59e6d7b3 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Searching by: {'deleted': False, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a'} {{(pid=126125) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:57:18.539350 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46bd6764-5d79-469a-9f6f-4e3b59e6d7b3 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:18.539802 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46bd6764-5d79-469a-9f6f-4e3b59e6d7b3 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:18.540617 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46bd6764-5d79-469a-9f6f-4e3b59e6d7b3 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:18.541144 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46bd6764-5d79-469a-9f6f-4e3b59e6d7b3 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:18.543352 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-46bd6764-5d79-469a-9f6f-4e3b59e6d7b3 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.033955 Aug 04 16:57:18.543945 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2060/4057] 10.222.0.23 () {58 vars in 1140 bytes} [Thu Aug 4 16:57:18 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:57:18.580497 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ef5a9161-0dcd-470f-93c0-05efb6148d8f tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:18.581110 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ef5a9161-0dcd-470f-93c0-05efb6148d8f tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 35e71704-0700-4b89-a138-a0d8590f47d7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:18.613090 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef5a9161-0dcd-470f-93c0-05efb6148d8f tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:18.614310 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef5a9161-0dcd-470f-93c0-05efb6148d8f tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:18.615304 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef5a9161-0dcd-470f-93c0-05efb6148d8f tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:18.615800 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef5a9161-0dcd-470f-93c0-05efb6148d8f tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:19.102397 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ef5a9161-0dcd-470f-93c0-05efb6148d8f tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:19.117718 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ef5a9161-0dcd-470f-93c0-05efb6148d8f tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7" status: 200 len: 1511 microversion: 2.1 time: 0.559560 Aug 04 16:57:19.118927 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2061/4058] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:18 2022] GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7 => generated 1511 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:19.138987 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1ef0ad94-ad94-4797-915b-65155bffd738 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:19.140048 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1ef0ad94-ad94-4797-915b-65155bffd738 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 3ea25507-d70a-43c8-9491-19c8f4435217] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:19.148875 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1ef0ad94-ad94-4797-915b-65155bffd738 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:19.151805 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1ef0ad94-ad94-4797-915b-65155bffd738 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:19.152610 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1ef0ad94-ad94-4797-915b-65155bffd738 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:19.156450 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1ef0ad94-ad94-4797-915b-65155bffd738 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:19.260489 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-a8874ec3-37c4-4c8b-83a2-e66553967d7f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:57:19.261001 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-a8874ec3-37c4-4c8b-83a2-e66553967d7f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:57:19.261379 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-a8874ec3-37c4-4c8b-83a2-e66553967d7f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:57:19.261777 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-a8874ec3-37c4-4c8b-83a2-e66553967d7f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:57:19.262176 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-a8874ec3-37c4-4c8b-83a2-e66553967d7f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:57:19.285849 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a8874ec3-37c4-4c8b-83a2-e66553967d7f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:19.286582 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a8874ec3-37c4-4c8b-83a2-e66553967d7f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:19.287577 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a8874ec3-37c4-4c8b-83a2-e66553967d7f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:19.288217 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a8874ec3-37c4-4c8b-83a2-e66553967d7f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:19.332865 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-a8874ec3-37c4-4c8b-83a2-e66553967d7f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Getting quotas for project fa4bb1fda4ef4267829850c4c616df77. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:57:19.347623 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-a8874ec3-37c4-4c8b-83a2-e66553967d7f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Getting quotas for user db8a96da1d7943599ee6ca9df18f5148 and project fa4bb1fda4ef4267829850c4c616df77. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:57:19.384857 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a8874ec3-37c4-4c8b-83a2-e66553967d7f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:57:19.388273 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a8874ec3-37c4-4c8b-83a2-e66553967d7f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: c323d329-0169-4914-96a5-1532bc922c05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:57:19.504204 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a8874ec3-37c4-4c8b-83a2-e66553967d7f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.513355 Aug 04 16:57:19.508188 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1998/4059] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:57:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:57:19.538703 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6c52834b-46d6-48dd-b017-a4a8be953d51 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:19.540513 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6c52834b-46d6-48dd-b017-a4a8be953d51 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: c323d329-0169-4914-96a5-1532bc922c05] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:19.580118 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1ef0ad94-ad94-4797-915b-65155bffd738 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:19.594392 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1ef0ad94-ad94-4797-915b-65155bffd738 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/3ea25507-d70a-43c8-9491-19c8f4435217" status: 200 len: 1513 microversion: 2.1 time: 0.455376 Aug 04 16:57:19.595715 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2062/4060] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:19 2022] GET /compute/v2.1/servers/3ea25507-d70a-43c8-9491-19c8f4435217 => generated 1513 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:19.626596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2be8ba02-cefc-4679-a50a-0d4820db55d4 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:19.627278 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2be8ba02-cefc-4679-a50a-0d4820db55d4 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 1664bfb4-4517-4700-ac66-79dc4586b387] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:19.639763 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2be8ba02-cefc-4679-a50a-0d4820db55d4 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:19.640522 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2be8ba02-cefc-4679-a50a-0d4820db55d4 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:19.641386 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2be8ba02-cefc-4679-a50a-0d4820db55d4 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:19.644865 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2be8ba02-cefc-4679-a50a-0d4820db55d4 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:19.873849 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6c52834b-46d6-48dd-b017-a4a8be953d51 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:19.888540 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6c52834b-46d6-48dd-b017-a4a8be953d51 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05" status: 200 len: 1209 microversion: 2.1 time: 0.374187 Aug 04 16:57:19.890627 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 1999/4061] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:19 2022] GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05 => generated 1209 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:20.045559 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2be8ba02-cefc-4679-a50a-0d4820db55d4 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:20.055515 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2be8ba02-cefc-4679-a50a-0d4820db55d4 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387" status: 200 len: 1512 microversion: 2.1 time: 0.434506 Aug 04 16:57:20.055996 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2063/4062] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:19 2022] GET /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387 => generated 1512 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:20.084647 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a3552659-7d15-4a31-97db-36bde563a8ad tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:20.107669 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a3552659-7d15-4a31-97db-36bde563a8ad tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:20.109169 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a3552659-7d15-4a31-97db-36bde563a8ad tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a'} {{(pid=126126) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:57:20.190065 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a3552659-7d15-4a31-97db-36bde563a8ad tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:20.191094 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a3552659-7d15-4a31-97db-36bde563a8ad tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:20.192428 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a3552659-7d15-4a31-97db-36bde563a8ad tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:20.192917 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a3552659-7d15-4a31-97db-36bde563a8ad tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:20.322724 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.multi_cell_list [None req-a3552659-7d15-4a31-97db-36bde563a8ad tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126126) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:57:20.407724 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a3552659-7d15-4a31-97db-36bde563a8ad tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 346 microversion: 2.1 time: 0.330390 Aug 04 16:57:20.408381 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2000/4063] 10.222.0.23 () {58 vars in 1154 bytes} [Thu Aug 4 16:57:20 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 346 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:20.423679 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d53e4064-bbff-4932-8f17-e8a937a87e18 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:20.424295 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d53e4064-bbff-4932-8f17-e8a937a87e18 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 35e71704-0700-4b89-a138-a0d8590f47d7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:20.433012 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d53e4064-bbff-4932-8f17-e8a937a87e18 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:20.434073 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d53e4064-bbff-4932-8f17-e8a937a87e18 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:20.435075 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d53e4064-bbff-4932-8f17-e8a937a87e18 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:20.435930 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d53e4064-bbff-4932-8f17-e8a937a87e18 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:20.623025 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d53e4064-bbff-4932-8f17-e8a937a87e18 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:20.633796 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d53e4064-bbff-4932-8f17-e8a937a87e18 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7" status: 200 len: 1511 microversion: 2.1 time: 0.214376 Aug 04 16:57:20.634388 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2064/4064] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:20 2022] GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7 => generated 1511 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:20.656581 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-19bdbbe7-caa2-4e08-8ff4-b430a962758d tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:20.657402 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-19bdbbe7-caa2-4e08-8ff4-b430a962758d tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 3ea25507-d70a-43c8-9491-19c8f4435217] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:20.665817 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-19bdbbe7-caa2-4e08-8ff4-b430a962758d tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:20.666260 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-19bdbbe7-caa2-4e08-8ff4-b430a962758d tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:20.667031 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-19bdbbe7-caa2-4e08-8ff4-b430a962758d tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:20.667463 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-19bdbbe7-caa2-4e08-8ff4-b430a962758d tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:20.892164 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-19bdbbe7-caa2-4e08-8ff4-b430a962758d tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:20.900035 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-19bdbbe7-caa2-4e08-8ff4-b430a962758d tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/3ea25507-d70a-43c8-9491-19c8f4435217" status: 200 len: 1513 microversion: 2.1 time: 0.248655 Aug 04 16:57:20.900619 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2001/4065] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:20 2022] GET /compute/v2.1/servers/3ea25507-d70a-43c8-9491-19c8f4435217 => generated 1513 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:20.918492 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0bc934e2-91ae-431a-be3c-b81cf5793479 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:20.919107 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0bc934e2-91ae-431a-be3c-b81cf5793479 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: c323d329-0169-4914-96a5-1532bc922c05] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:20.928576 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0bc934e2-91ae-431a-be3c-b81cf5793479 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:20.929026 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0bc934e2-91ae-431a-be3c-b81cf5793479 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:20.934165 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0bc934e2-91ae-431a-be3c-b81cf5793479 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:20.936918 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0bc934e2-91ae-431a-be3c-b81cf5793479 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:20.941207 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a25825e0-b18f-478f-89a9-9d95ff5db5fe tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:20.944360 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a25825e0-b18f-478f-89a9-9d95ff5db5fe tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 1664bfb4-4517-4700-ac66-79dc4586b387] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:20.967268 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a25825e0-b18f-478f-89a9-9d95ff5db5fe tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:20.967968 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a25825e0-b18f-478f-89a9-9d95ff5db5fe tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:20.976589 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a25825e0-b18f-478f-89a9-9d95ff5db5fe tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:20.977037 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a25825e0-b18f-478f-89a9-9d95ff5db5fe tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:21.120507 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0bc934e2-91ae-431a-be3c-b81cf5793479 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:21.128942 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0bc934e2-91ae-431a-be3c-b81cf5793479 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05" status: 200 len: 1269 microversion: 2.1 time: 0.220506 Aug 04 16:57:21.143150 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2065/4066] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:20 2022] GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05 => generated 1269 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:21.519086 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a25825e0-b18f-478f-89a9-9d95ff5db5fe tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:21.537531 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a25825e0-b18f-478f-89a9-9d95ff5db5fe tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387" status: 200 len: 1512 microversion: 2.1 time: 0.609865 Aug 04 16:57:21.538398 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2002/4067] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:20 2022] GET /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387 => generated 1512 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:21.559799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-02acac69-417e-4d9b-8561-8075a3bbbd91 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:21.567848 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-02acac69-417e-4d9b-8561-8075a3bbbd91 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:21.569699 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-02acac69-417e-4d9b-8561-8075a3bbbd91 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Searching by: {'deleted': False, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a'} {{(pid=126125) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:57:21.579249 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02acac69-417e-4d9b-8561-8075a3bbbd91 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:21.579989 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02acac69-417e-4d9b-8561-8075a3bbbd91 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:21.580970 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02acac69-417e-4d9b-8561-8075a3bbbd91 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:21.581645 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02acac69-417e-4d9b-8561-8075a3bbbd91 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:21.636874 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:21.645929 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.multi_cell_list [None req-02acac69-417e-4d9b-8561-8075a3bbbd91 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:57:21.728036 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-02acac69-417e-4d9b-8561-8075a3bbbd91 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:21.767946 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02acac69-417e-4d9b-8561-8075a3bbbd91 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:21.770745 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02acac69-417e-4d9b-8561-8075a3bbbd91 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:22.153138 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d4012b7c-c39d-4d68-b0ae-f4c00b45189b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:22.154271 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d4012b7c-c39d-4d68-b0ae-f4c00b45189b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: c323d329-0169-4914-96a5-1532bc922c05] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:22.167920 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d4012b7c-c39d-4d68-b0ae-f4c00b45189b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:22.169805 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d4012b7c-c39d-4d68-b0ae-f4c00b45189b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:22.175647 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d4012b7c-c39d-4d68-b0ae-f4c00b45189b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:22.176385 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d4012b7c-c39d-4d68-b0ae-f4c00b45189b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:22.448657 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d4012b7c-c39d-4d68-b0ae-f4c00b45189b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:22.459809 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d4012b7c-c39d-4d68-b0ae-f4c00b45189b tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05" status: 200 len: 1267 microversion: 2.1 time: 0.308543 Aug 04 16:57:22.460732 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2003/4068] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:22 2022] GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05 => generated 1267 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:22.561639 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-02acac69-417e-4d9b-8561-8075a3bbbd91 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 4519 microversion: 2.1 time: 1.005358 Aug 04 16:57:22.563225 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2066/4069] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:57:21 2022] GET /compute/v2.1/servers/detail => generated 4519 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:22.586517 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1d2a93d1-49c7-40f6-9c82-675866849862 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:22.591722 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1d2a93d1-49c7-40f6-9c82-675866849862 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:22.592813 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1d2a93d1-49c7-40f6-9c82-675866849862 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a'} {{(pid=126126) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:57:22.901936 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d2a93d1-49c7-40f6-9c82-675866849862 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:22.902678 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d2a93d1-49c7-40f6-9c82-675866849862 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:22.904153 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d2a93d1-49c7-40f6-9c82-675866849862 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:22.904836 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d2a93d1-49c7-40f6-9c82-675866849862 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:23.021329 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.multi_cell_list [None req-1d2a93d1-49c7-40f6-9c82-675866849862 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126126) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:57:23.111570 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1d2a93d1-49c7-40f6-9c82-675866849862 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.526097 Aug 04 16:57:23.114291 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2004/4070] 10.222.0.23 () {58 vars in 1150 bytes} [Thu Aug 4 16:57:22 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:23.130075 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f335d493-5d21-44f4-b6cd-1388a7c114e7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:23.135862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f335d493-5d21-44f4-b6cd-1388a7c114e7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:23.136530 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f335d493-5d21-44f4-b6cd-1388a7c114e7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a'} {{(pid=126125) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:57:23.164241 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f335d493-5d21-44f4-b6cd-1388a7c114e7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:23.167091 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f335d493-5d21-44f4-b6cd-1388a7c114e7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:23.168831 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f335d493-5d21-44f4-b6cd-1388a7c114e7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:23.169998 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f335d493-5d21-44f4-b6cd-1388a7c114e7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:23.428362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.multi_cell_list [None req-f335d493-5d21-44f4-b6cd-1388a7c114e7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:57:23.486823 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2432a9f7-8cee-4297-a291-97f7a2dc0e91 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:23.487330 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2432a9f7-8cee-4297-a291-97f7a2dc0e91 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: c323d329-0169-4914-96a5-1532bc922c05] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:23.501205 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2432a9f7-8cee-4297-a291-97f7a2dc0e91 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:23.505131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2432a9f7-8cee-4297-a291-97f7a2dc0e91 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:23.506694 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2432a9f7-8cee-4297-a291-97f7a2dc0e91 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:23.507144 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2432a9f7-8cee-4297-a291-97f7a2dc0e91 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:23.569218 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f335d493-5d21-44f4-b6cd-1388a7c114e7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.442256 Aug 04 16:57:23.571533 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2067/4071] 10.222.0.23 () {58 vars in 1212 bytes} [Thu Aug 4 16:57:23 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:23.582200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6b002f01-4874-4ca7-b7c0-30c26dbe5bbf tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:23.588285 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6b002f01-4874-4ca7-b7c0-30c26dbe5bbf tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:23.589980 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6b002f01-4874-4ca7-b7c0-30c26dbe5bbf tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a'} {{(pid=126125) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:57:23.596321 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6b002f01-4874-4ca7-b7c0-30c26dbe5bbf tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:23.597006 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6b002f01-4874-4ca7-b7c0-30c26dbe5bbf tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:23.598096 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6b002f01-4874-4ca7-b7c0-30c26dbe5bbf tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:23.599384 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6b002f01-4874-4ca7-b7c0-30c26dbe5bbf tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:23.772805 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.multi_cell_list [None req-6b002f01-4874-4ca7-b7c0-30c26dbe5bbf tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:57:23.908494 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6b002f01-4874-4ca7-b7c0-30c26dbe5bbf tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.330332 Aug 04 16:57:23.916119 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2068/4072] 10.222.0.23 () {58 vars in 1196 bytes} [Thu Aug 4 16:57:23 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:23.922164 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e3efa3d5-5712-40d1-8760-05ee437c60c8 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:23.928150 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e3efa3d5-5712-40d1-8760-05ee437c60c8 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:23.928962 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e3efa3d5-5712-40d1-8760-05ee437c60c8 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Searching by: {'name': '-651531158', 'deleted': False, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a'} {{(pid=126125) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:57:23.934924 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3efa3d5-5712-40d1-8760-05ee437c60c8 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:23.935363 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3efa3d5-5712-40d1-8760-05ee437c60c8 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:23.936606 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3efa3d5-5712-40d1-8760-05ee437c60c8 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:23.937195 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3efa3d5-5712-40d1-8760-05ee437c60c8 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:24.090694 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.multi_cell_list [None req-e3efa3d5-5712-40d1-8760-05ee437c60c8 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:57:24.189450 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e3efa3d5-5712-40d1-8760-05ee437c60c8 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers?name=-651531158" status: 200 len: 345 microversion: 2.1 time: 0.271091 Aug 04 16:57:24.196553 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2069/4073] 10.222.0.23 () {58 vars in 1156 bytes} [Thu Aug 4 16:57:23 2022] GET /compute/v2.1/servers?name=-651531158 => generated 345 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:24.211329 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b2ecac90-95c5-4590-9a9c-c0f31526c20f tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:24.218471 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b2ecac90-95c5-4590-9a9c-c0f31526c20f tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:24.220446 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b2ecac90-95c5-4590-9a9c-c0f31526c20f tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a'} {{(pid=126125) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:57:24.229490 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2ecac90-95c5-4590-9a9c-c0f31526c20f tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:24.230252 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2ecac90-95c5-4590-9a9c-c0f31526c20f tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:24.231299 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2ecac90-95c5-4590-9a9c-c0f31526c20f tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:24.231929 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2ecac90-95c5-4590-9a9c-c0f31526c20f tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:24.459410 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2432a9f7-8cee-4297-a291-97f7a2dc0e91 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:24.469390 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2432a9f7-8cee-4297-a291-97f7a2dc0e91 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05" status: 200 len: 1309 microversion: 2.1 time: 0.986557 Aug 04 16:57:24.470029 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.multi_cell_list [None req-b2ecac90-95c5-4590-9a9c-c0f31526c20f tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:57:24.472812 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2005/4074] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:23 2022] GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05 => generated 1309 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:24.537263 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b2ecac90-95c5-4590-9a9c-c0f31526c20f tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.330459 Aug 04 16:57:24.538343 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2070/4075] 10.222.0.23 () {58 vars in 1154 bytes} [Thu Aug 4 16:57:24 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:24.551659 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e9bb9737-20fe-4dfc-bfe4-10ad7c457631 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:24.558816 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e9bb9737-20fe-4dfc-bfe4-10ad7c457631 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:24.559794 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e9bb9737-20fe-4dfc-bfe4-10ad7c457631 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-65153115', 'deleted': False, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a'} {{(pid=126126) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:57:24.567772 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e9bb9737-20fe-4dfc-bfe4-10ad7c457631 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:24.569368 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e9bb9737-20fe-4dfc-bfe4-10ad7c457631 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:24.570519 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e9bb9737-20fe-4dfc-bfe4-10ad7c457631 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:24.572638 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e9bb9737-20fe-4dfc-bfe4-10ad7c457631 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:24.704850 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.multi_cell_list [None req-e9bb9737-20fe-4dfc-bfe4-10ad7c457631 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126126) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:57:24.727301 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:24.808926 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e9bb9737-20fe-4dfc-bfe4-10ad7c457631 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-65153115" status: 200 len: 345 microversion: 2.1 time: 0.261645 Aug 04 16:57:24.810510 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2006/4076] 10.222.0.23 () {58 vars in 1226 bytes} [Thu Aug 4 16:57:24 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-65153115 => generated 345 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:24.824936 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f9f2c1a4-1ce6-4e08-985d-78291d0b4c30 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:24.825572 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f9f2c1a4-1ce6-4e08-985d-78291d0b4c30 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 1664bfb4-4517-4700-ac66-79dc4586b387] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:24.846204 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9f2c1a4-1ce6-4e08-985d-78291d0b4c30 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:24.846976 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9f2c1a4-1ce6-4e08-985d-78291d0b4c30 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:24.850239 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9f2c1a4-1ce6-4e08-985d-78291d0b4c30 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:24.850952 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9f2c1a4-1ce6-4e08-985d-78291d0b4c30 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:24.890999 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f9f2c1a4-1ce6-4e08-985d-78291d0b4c30 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 1664bfb4-4517-4700-ac66-79dc4586b387] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:57:25.072085 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f9f2c1a4-1ce6-4e08-985d-78291d0b4c30 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387" status: 204 len: 0 microversion: 2.1 time: 0.251135 Aug 04 16:57:25.072937 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2071/4077] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:57:24 2022] DELETE /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 16:57:25.081092 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-06d70448-05a9-400e-9d84-c24543d3f16d tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:25.085130 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-06d70448-05a9-400e-9d84-c24543d3f16d tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 1664bfb4-4517-4700-ac66-79dc4586b387] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:25.093686 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-06d70448-05a9-400e-9d84-c24543d3f16d tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:25.108811 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-06d70448-05a9-400e-9d84-c24543d3f16d tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:25.109832 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-06d70448-05a9-400e-9d84-c24543d3f16d tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:25.110301 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-06d70448-05a9-400e-9d84-c24543d3f16d tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:25.355160 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-06d70448-05a9-400e-9d84-c24543d3f16d tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:25.367656 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-06d70448-05a9-400e-9d84-c24543d3f16d tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387" status: 200 len: 1518 microversion: 2.1 time: 0.290088 Aug 04 16:57:25.373798 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2007/4078] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:25 2022] GET /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387 => generated 1518 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:25.493703 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e5ec500d-18f4-4303-aa49-028a7d17570f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:25.494427 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e5ec500d-18f4-4303-aa49-028a7d17570f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: c323d329-0169-4914-96a5-1532bc922c05] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:25.502766 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:25.513689 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e5ec500d-18f4-4303-aa49-028a7d17570f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:25.515371 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e5ec500d-18f4-4303-aa49-028a7d17570f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:25.516948 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e5ec500d-18f4-4303-aa49-028a7d17570f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:25.522029 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e5ec500d-18f4-4303-aa49-028a7d17570f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:25.532382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-7d7e9bb6-4e9c-46e2-9fcf-f83e70b47c34 req-b26b7cf2-8b2b-4bf0-b24e-d4d73521d994 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c323d329-0169-4914-96a5-1532bc922c05", "tag": "6c6d264c-5ac0-48d3-bda9-b43c8ed49afc"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:25.566421 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-7d7e9bb6-4e9c-46e2-9fcf-f83e70b47c34 req-b26b7cf2-8b2b-4bf0-b24e-d4d73521d994 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:25.568907 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-7d7e9bb6-4e9c-46e2-9fcf-f83e70b47c34 req-b26b7cf2-8b2b-4bf0-b24e-d4d73521d994 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:25.615844 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-7d7e9bb6-4e9c-46e2-9fcf-f83e70b47c34 req-b26b7cf2-8b2b-4bf0-b24e-d4d73521d994 service nova] Creating event network-changed:6c6d264c-5ac0-48d3-bda9-b43c8ed49afc for instance c323d329-0169-4914-96a5-1532bc922c05 on n-h1-846466-12 Aug 04 16:57:25.628334 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-7d7e9bb6-4e9c-46e2-9fcf-f83e70b47c34 req-b26b7cf2-8b2b-4bf0-b24e-d4d73521d994 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106293 Aug 04 16:57:25.631827 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2008/4079] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:26.202137 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e5ec500d-18f4-4303-aa49-028a7d17570f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:26.215114 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e5ec500d-18f4-4303-aa49-028a7d17570f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05" status: 200 len: 1309 microversion: 2.1 time: 0.724788 Aug 04 16:57:26.215907 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2072/4080] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:25 2022] GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05 => generated 1309 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:26.393060 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4b3c0878-a161-48aa-a9a7-fee58a46b7ae tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:26.393821 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4b3c0878-a161-48aa-a9a7-fee58a46b7ae tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 1664bfb4-4517-4700-ac66-79dc4586b387] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:26.420149 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b3c0878-a161-48aa-a9a7-fee58a46b7ae tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:26.420716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b3c0878-a161-48aa-a9a7-fee58a46b7ae tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:26.421522 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b3c0878-a161-48aa-a9a7-fee58a46b7ae tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:26.422040 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b3c0878-a161-48aa-a9a7-fee58a46b7ae tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:27.236669 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-861e16ce-8d91-4d0e-b85c-a38e915a7070 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:27.238054 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-861e16ce-8d91-4d0e-b85c-a38e915a7070 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: c323d329-0169-4914-96a5-1532bc922c05] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:27.255923 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-861e16ce-8d91-4d0e-b85c-a38e915a7070 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:27.256569 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-861e16ce-8d91-4d0e-b85c-a38e915a7070 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:27.257697 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-861e16ce-8d91-4d0e-b85c-a38e915a7070 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:27.258680 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-861e16ce-8d91-4d0e-b85c-a38e915a7070 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:27.610869 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4b3c0878-a161-48aa-a9a7-fee58a46b7ae tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:27.621983 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4b3c0878-a161-48aa-a9a7-fee58a46b7ae tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387" status: 200 len: 1518 microversion: 2.1 time: 1.233584 Aug 04 16:57:27.633689 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2009/4081] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:26 2022] GET /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387 => generated 1518 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:28.340453 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-861e16ce-8d91-4d0e-b85c-a38e915a7070 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:28.353018 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-861e16ce-8d91-4d0e-b85c-a38e915a7070 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05" status: 200 len: 1309 microversion: 2.1 time: 1.120485 Aug 04 16:57:28.353895 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2073/4082] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:27 2022] GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05 => generated 1309 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:28.643496 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-29538a6d-636c-4821-98ca-7dc033b33b40 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:28.644120 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-29538a6d-636c-4821-98ca-7dc033b33b40 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 1664bfb4-4517-4700-ac66-79dc4586b387] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:28.663734 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-29538a6d-636c-4821-98ca-7dc033b33b40 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:28.664181 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-29538a6d-636c-4821-98ca-7dc033b33b40 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:28.664967 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-29538a6d-636c-4821-98ca-7dc033b33b40 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:28.665604 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-29538a6d-636c-4821-98ca-7dc033b33b40 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:29.304446 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-29538a6d-636c-4821-98ca-7dc033b33b40 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:29.321691 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-29538a6d-636c-4821-98ca-7dc033b33b40 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387" status: 200 len: 1518 microversion: 2.1 time: 0.681938 Aug 04 16:57:29.324602 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2010/4083] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:28 2022] GET /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387 => generated 1518 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:29.385828 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2482957a-47d6-4bd9-90ae-996f43671036 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:29.386473 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2482957a-47d6-4bd9-90ae-996f43671036 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: c323d329-0169-4914-96a5-1532bc922c05] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:29.414440 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2482957a-47d6-4bd9-90ae-996f43671036 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:29.419784 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2482957a-47d6-4bd9-90ae-996f43671036 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:29.421818 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2482957a-47d6-4bd9-90ae-996f43671036 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:29.422545 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2482957a-47d6-4bd9-90ae-996f43671036 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:29.465468 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-15fbd9f0-657f-4c7c-ae42-f699eb0b3256 req-79caa626-37ca-4ecc-98d4-daabdf895b50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1664bfb4-4517-4700-ac66-79dc4586b387", "name": "network-vif-deleted", "tag": "f01143f7-1e08-411e-9c6a-290949acb645"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:29.487415 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-15fbd9f0-657f-4c7c-ae42-f699eb0b3256 req-79caa626-37ca-4ecc-98d4-daabdf895b50 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:29.487925 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-15fbd9f0-657f-4c7c-ae42-f699eb0b3256 req-79caa626-37ca-4ecc-98d4-daabdf895b50 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:29.526238 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-15fbd9f0-657f-4c7c-ae42-f699eb0b3256 req-79caa626-37ca-4ecc-98d4-daabdf895b50 service nova] Creating event network-vif-deleted:f01143f7-1e08-411e-9c6a-290949acb645 for instance 1664bfb4-4517-4700-ac66-79dc4586b387 on n-h1-846466-12 Aug 04 16:57:29.541832 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-15fbd9f0-657f-4c7c-ae42-f699eb0b3256 req-79caa626-37ca-4ecc-98d4-daabdf895b50 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080624 Aug 04 16:57:29.543270 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2011/4084] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:30.050690 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2482957a-47d6-4bd9-90ae-996f43671036 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:30.067943 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2482957a-47d6-4bd9-90ae-996f43671036 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05" status: 200 len: 1309 microversion: 2.1 time: 0.689846 Aug 04 16:57:30.087709 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2074/4085] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:29 2022] GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05 => generated 1309 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:30.351726 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1f8452ed-b279-4606-acc5-1ee962ae51c8 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:30.352429 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1f8452ed-b279-4606-acc5-1ee962ae51c8 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 1664bfb4-4517-4700-ac66-79dc4586b387] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:30.363433 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=8 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:30.375855 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1f8452ed-b279-4606-acc5-1ee962ae51c8 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:30.376616 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1f8452ed-b279-4606-acc5-1ee962ae51c8 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:30.377842 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1f8452ed-b279-4606-acc5-1ee962ae51c8 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:30.378430 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1f8452ed-b279-4606-acc5-1ee962ae51c8 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:30.428416 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-1f8452ed-b279-4606-acc5-1ee962ae51c8 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] HTTP exception thrown: Instance 1664bfb4-4517-4700-ac66-79dc4586b387 could not be found. Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1f8452ed-b279-4606-acc5-1ee962ae51c8 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Request method failure captured: Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387 HTTP/1.1 Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_otXIij24BrnOqCPWE5XiDT4Rx5uZZRnDRhTWiWUhMmS2DUAyH5n2O0Vkmezb5hOy0fctyqnfe7ZbaSNJnnnczoF5HyWbfANNOpLvurLzoVNNSqeZvLUHGfQxxo9XThJWFytr9MwnX2dWjrrodEpNU2X1pToxt_2DqzrpMDM7Uw2GY Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 1c89cc0bcf344df1a27f675fd1fa387a Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ListServerFiltersTestJSON-2057200264 Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c89cc0bcf344df1a27f675fd1fa387a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1c89cc0bcf344df1a27f675fd1fa387a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c89cc0bcf344df1a27f675fd1fa387a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1c89cc0bcf344df1a27f675fd1fa387a"}]}] Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ListServerFiltersTestJSON-2057200264 Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 1c89cc0bcf344df1a27f675fd1fa387a Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2057200264 Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ListServerFiltersTestJSON-2057200264-project Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 176b01b667bd4f38b8d0438206a0deb5 Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ListServerFiltersTestJSON-2057200264-project Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 1664bfb4-4517-4700-ac66-79dc4586b387 could not be found. Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '1664bfb4-4517-4700-ac66-79dc4586b387'} Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1664bfb4-4517-4700-ac66-79dc4586b387 could not be found. Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1664bfb4-4517-4700-ac66-79dc4586b387 could not be found. Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:30.430165 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:30.435163 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:30.435163 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:30.435163 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:30.435163 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:57:30.435163 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:57:30.435163 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1664bfb4-4517-4700-ac66-79dc4586b387 could not be found. Aug 04 16:57:30.435163 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:30.435163 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1f8452ed-b279-4606-acc5-1ee962ae51c8 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Returning 404 to user: Instance 1664bfb4-4517-4700-ac66-79dc4586b387 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:57:30.435163 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1f8452ed-b279-4606-acc5-1ee962ae51c8 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387" status: 404 len: 111 microversion: 2.1 time: 0.084011 Aug 04 16:57:30.435163 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2012/4086] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:30 2022] GET /compute/v2.1/servers/1664bfb4-4517-4700-ac66-79dc4586b387 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:57:30.445526 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9d69e337-f86c-4204-ac83-a9bdaafe68bd tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:30.447065 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9d69e337-f86c-4204-ac83-a9bdaafe68bd tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 3ea25507-d70a-43c8-9491-19c8f4435217] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:30.465015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9d69e337-f86c-4204-ac83-a9bdaafe68bd tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:30.467369 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9d69e337-f86c-4204-ac83-a9bdaafe68bd tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:30.470521 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9d69e337-f86c-4204-ac83-a9bdaafe68bd tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:30.472019 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9d69e337-f86c-4204-ac83-a9bdaafe68bd tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:30.543453 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9d69e337-f86c-4204-ac83-a9bdaafe68bd tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 3ea25507-d70a-43c8-9491-19c8f4435217] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:57:30.810537 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fe112895-5ef6-49d7-af01-536b2d2cb4bd tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:30.811434 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fe112895-5ef6-49d7-af01-536b2d2cb4bd tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] [instance: cab40427-161a-4071-8c75-1a402c924402] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:30.821596 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fe112895-5ef6-49d7-af01-536b2d2cb4bd tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:30.822110 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fe112895-5ef6-49d7-af01-536b2d2cb4bd tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:30.822715 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9d69e337-f86c-4204-ac83-a9bdaafe68bd tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3ea25507-d70a-43c8-9491-19c8f4435217" status: 204 len: 0 microversion: 2.1 time: 0.383245 Aug 04 16:57:30.823851 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2075/4087] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:57:30 2022] DELETE /compute/v2.1/servers/3ea25507-d70a-43c8-9491-19c8f4435217 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:57:30.824329 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fe112895-5ef6-49d7-af01-536b2d2cb4bd tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:30.824843 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fe112895-5ef6-49d7-af01-536b2d2cb4bd tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:30.840182 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b662b0f8-dd09-428b-9774-09678edcac7c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:30.843531 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b662b0f8-dd09-428b-9774-09678edcac7c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 3ea25507-d70a-43c8-9491-19c8f4435217] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:30.854923 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b662b0f8-dd09-428b-9774-09678edcac7c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:30.855280 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b662b0f8-dd09-428b-9774-09678edcac7c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:30.862323 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b662b0f8-dd09-428b-9774-09678edcac7c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:30.862766 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b662b0f8-dd09-428b-9774-09678edcac7c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:30.913534 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fe112895-5ef6-49d7-af01-536b2d2cb4bd tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] 10.222.0.23 "GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.107369 Aug 04 16:57:30.920666 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2013/4088] 10.222.0.23 () {58 vars in 1293 bytes} [Thu Aug 4 16:57:30 2022] GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402/os-server-password => generated 116 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:31.095813 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3381fff6-333f-43b7-b809-a011a7bfc414 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:31.096424 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3381fff6-333f-43b7-b809-a011a7bfc414 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: c323d329-0169-4914-96a5-1532bc922c05] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:31.110235 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3381fff6-333f-43b7-b809-a011a7bfc414 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:31.110677 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3381fff6-333f-43b7-b809-a011a7bfc414 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:31.111683 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3381fff6-333f-43b7-b809-a011a7bfc414 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:31.112515 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3381fff6-333f-43b7-b809-a011a7bfc414 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:31.646094 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b662b0f8-dd09-428b-9774-09678edcac7c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:31.670260 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b662b0f8-dd09-428b-9774-09678edcac7c tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/3ea25507-d70a-43c8-9491-19c8f4435217" status: 200 len: 1519 microversion: 2.1 time: 0.838977 Aug 04 16:57:31.671403 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2076/4089] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:30 2022] GET /compute/v2.1/servers/3ea25507-d70a-43c8-9491-19c8f4435217 => generated 1519 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:31.728590 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3381fff6-333f-43b7-b809-a011a7bfc414 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:31.740669 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3381fff6-333f-43b7-b809-a011a7bfc414 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05" status: 200 len: 1309 microversion: 2.1 time: 0.648005 Aug 04 16:57:31.766471 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2014/4090] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:31 2022] GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05 => generated 1309 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:32.693885 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b3cf4872-b9e5-4778-b836-913bc3c975a7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:32.694819 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b3cf4872-b9e5-4778-b836-913bc3c975a7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 3ea25507-d70a-43c8-9491-19c8f4435217] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:32.698193 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:32.715301 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b3cf4872-b9e5-4778-b836-913bc3c975a7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:32.717398 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b3cf4872-b9e5-4778-b836-913bc3c975a7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:32.718522 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b3cf4872-b9e5-4778-b836-913bc3c975a7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:32.718962 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b3cf4872-b9e5-4778-b836-913bc3c975a7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:32.768702 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-04735b91-0a48-4242-aeb9-fb44ad1085bd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:32.769235 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-04735b91-0a48-4242-aeb9-fb44ad1085bd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: c323d329-0169-4914-96a5-1532bc922c05] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:32.797754 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-04735b91-0a48-4242-aeb9-fb44ad1085bd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:32.798612 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-04735b91-0a48-4242-aeb9-fb44ad1085bd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:32.799983 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-04735b91-0a48-4242-aeb9-fb44ad1085bd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:32.800688 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-04735b91-0a48-4242-aeb9-fb44ad1085bd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:34.135486 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-04735b91-0a48-4242-aeb9-fb44ad1085bd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:34.152434 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-04735b91-0a48-4242-aeb9-fb44ad1085bd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05" status: 200 len: 1309 microversion: 2.1 time: 1.388605 Aug 04 16:57:34.155330 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2015/4091] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:32 2022] GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05 => generated 1309 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:34.157707 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b3cf4872-b9e5-4778-b836-913bc3c975a7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:34.166002 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:34.187458 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b3cf4872-b9e5-4778-b836-913bc3c975a7 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/3ea25507-d70a-43c8-9491-19c8f4435217" status: 200 len: 1519 microversion: 2.1 time: 1.500129 Aug 04 16:57:34.188634 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2077/4092] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:32 2022] GET /compute/v2.1/servers/3ea25507-d70a-43c8-9491-19c8f4435217 => generated 1519 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:34.197910 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-be633417-b19d-4c94-893f-8909a1fe942f tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:34.198664 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-be633417-b19d-4c94-893f-8909a1fe942f tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 760130d2-374e-4f4c-a73b-d7a99449e324] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:34.216485 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be633417-b19d-4c94-893f-8909a1fe942f tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:34.216485 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be633417-b19d-4c94-893f-8909a1fe942f tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:34.216485 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be633417-b19d-4c94-893f-8909a1fe942f tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:34.216485 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be633417-b19d-4c94-893f-8909a1fe942f tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:34.271826 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-be633417-b19d-4c94-893f-8909a1fe942f tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324/ips" status: 200 len: 148 microversion: 2.1 time: 0.078399 Aug 04 16:57:34.275302 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2078/4093] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Aug 4 16:57:34 2022] GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324/ips => generated 148 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:34.589272 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-829cea92-f21e-4ea9-90f5-f1ad42fa7346 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1583741229", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "62219716-9485-4729-b4e0-11886d853a92"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:34.658599 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=8 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:34.759953 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-829cea92-f21e-4ea9-90f5-f1ad42fa7346 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] validate_networks() for [('62219716-9485-4729-b4e0-11886d853a92', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:57:35.177267 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b673fa93-9875-42aa-9589-2158f26a856c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:35.177898 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b673fa93-9875-42aa-9589-2158f26a856c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: c323d329-0169-4914-96a5-1532bc922c05] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:35.180059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=12 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:35.214375 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b673fa93-9875-42aa-9589-2158f26a856c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:35.215080 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b673fa93-9875-42aa-9589-2158f26a856c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:35.215979 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b673fa93-9875-42aa-9589-2158f26a856c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:35.216415 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b673fa93-9875-42aa-9589-2158f26a856c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:35.745992 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b673fa93-9875-42aa-9589-2158f26a856c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:35.756782 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b673fa93-9875-42aa-9589-2158f26a856c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05" status: 200 len: 1309 microversion: 2.1 time: 0.586043 Aug 04 16:57:35.761613 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2079/4094] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:35 2022] GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05 => generated 1309 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:35.774458 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-37b49979-29bd-468a-8aa1-0a897a121cdf tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:35.777943 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-37b49979-29bd-468a-8aa1-0a897a121cdf tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 3ea25507-d70a-43c8-9491-19c8f4435217] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:35.792075 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-37b49979-29bd-468a-8aa1-0a897a121cdf tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:35.800601 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-37b49979-29bd-468a-8aa1-0a897a121cdf tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:35.802362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-37b49979-29bd-468a-8aa1-0a897a121cdf tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:35.803024 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-37b49979-29bd-468a-8aa1-0a897a121cdf tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:35.969125 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-37b49979-29bd-468a-8aa1-0a897a121cdf tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:35.979736 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-37b49979-29bd-468a-8aa1-0a897a121cdf tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/3ea25507-d70a-43c8-9491-19c8f4435217" status: 200 len: 1477 microversion: 2.1 time: 0.216348 Aug 04 16:57:35.987844 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2080/4095] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:35 2022] GET /compute/v2.1/servers/3ea25507-d70a-43c8-9491-19c8f4435217 => generated 1477 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:35.996238 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-bf9d3a13-3e95-4b76-95c9-74ff42f49cef req-6d11cb32-e21a-4468-8d8b-9ebacc374f2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ea25507-d70a-43c8-9491-19c8f4435217", "name": "network-vif-deleted", "tag": "b7fcb75c-4b1b-41e5-912a-b6cf602b3474"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:36.009207 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-bf9d3a13-3e95-4b76-95c9-74ff42f49cef req-6d11cb32-e21a-4468-8d8b-9ebacc374f2a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:36.009676 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-bf9d3a13-3e95-4b76-95c9-74ff42f49cef req-6d11cb32-e21a-4468-8d8b-9ebacc374f2a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:36.093510 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-bf9d3a13-3e95-4b76-95c9-74ff42f49cef req-6d11cb32-e21a-4468-8d8b-9ebacc374f2a service nova] Creating event network-vif-deleted:b7fcb75c-4b1b-41e5-912a-b6cf602b3474 for instance 3ea25507-d70a-43c8-9491-19c8f4435217 on n-h2-846466-12 Aug 04 16:57:36.103179 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-bf9d3a13-3e95-4b76-95c9-74ff42f49cef req-6d11cb32-e21a-4468-8d8b-9ebacc374f2a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113560 Aug 04 16:57:36.103806 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2081/4096] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:36.461034 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-bf9d3a13-3e95-4b76-95c9-74ff42f49cef req-6d11cb32-e21a-4468-8d8b-9ebacc374f2a service nova] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:36.462279 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-bf9d3a13-3e95-4b76-95c9-74ff42f49cef req-6d11cb32-e21a-4468-8d8b-9ebacc374f2a service nova] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001908 Aug 04 16:57:36.468460 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2082/4097] 10.222.0.23 () {56 vars in 886 bytes} [Thu Aug 4 16:57:36 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 04 16:57:36.719970 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-829cea92-f21e-4ea9-90f5-f1ad42fa7346 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:57:36.720570 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-829cea92-f21e-4ea9-90f5-f1ad42fa7346 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:57:36.720844 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-829cea92-f21e-4ea9-90f5-f1ad42fa7346 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:57:36.721248 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-829cea92-f21e-4ea9-90f5-f1ad42fa7346 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:57:36.721680 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-829cea92-f21e-4ea9-90f5-f1ad42fa7346 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:57:36.736629 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-829cea92-f21e-4ea9-90f5-f1ad42fa7346 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:36.740417 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-829cea92-f21e-4ea9-90f5-f1ad42fa7346 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:36.743793 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-829cea92-f21e-4ea9-90f5-f1ad42fa7346 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:36.745762 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-829cea92-f21e-4ea9-90f5-f1ad42fa7346 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:36.782965 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-eec47890-fa38-42b7-b84f-84f26cd3bcab tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:36.783714 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-eec47890-fa38-42b7-b84f-84f26cd3bcab tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: c323d329-0169-4914-96a5-1532bc922c05] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:36.800616 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eec47890-fa38-42b7-b84f-84f26cd3bcab tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:36.801071 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eec47890-fa38-42b7-b84f-84f26cd3bcab tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:36.801938 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eec47890-fa38-42b7-b84f-84f26cd3bcab tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:36.805033 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-829cea92-f21e-4ea9-90f5-f1ad42fa7346 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Getting quotas for project 215c4dead77c4db19551a0340cec130b. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:57:36.805557 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eec47890-fa38-42b7-b84f-84f26cd3bcab tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:36.824021 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-829cea92-f21e-4ea9-90f5-f1ad42fa7346 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Getting quotas for user 24ac5aa517704e599b7ebb22cae71ecd and project 215c4dead77c4db19551a0340cec130b. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:57:36.861522 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-829cea92-f21e-4ea9-90f5-f1ad42fa7346 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Going to run 3 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:57:36.869565 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-829cea92-f21e-4ea9-90f5-f1ad42fa7346 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] [instance: d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:57:36.965892 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-829cea92-f21e-4ea9-90f5-f1ad42fa7346 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] [instance: ddddc764-2d86-4950-849a-7da51eaf37c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:57:37.059644 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-829cea92-f21e-4ea9-90f5-f1ad42fa7346 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] [instance: 32ad59ea-210c-4726-af7f-669fedaef542] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=ddddc764-2d86-4950-849a-7da51eaf37c6,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:57:37.070889 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-eec47890-fa38-42b7-b84f-84f26cd3bcab tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:37.082753 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-eec47890-fa38-42b7-b84f-84f26cd3bcab tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05" status: 200 len: 1309 microversion: 2.1 time: 0.304131 Aug 04 16:57:37.083360 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2083/4098] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:36 2022] GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05 => generated 1309 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:37.092616 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7ffa74ad-eb64-45ef-96d7-39ad1afedc56 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:37.099449 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7ffa74ad-eb64-45ef-96d7-39ad1afedc56 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 3ea25507-d70a-43c8-9491-19c8f4435217] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:37.114366 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ffa74ad-eb64-45ef-96d7-39ad1afedc56 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:37.119313 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ffa74ad-eb64-45ef-96d7-39ad1afedc56 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:37.121030 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ffa74ad-eb64-45ef-96d7-39ad1afedc56 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:37.122384 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ffa74ad-eb64-45ef-96d7-39ad1afedc56 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:37.159123 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-7ffa74ad-eb64-45ef-96d7-39ad1afedc56 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] HTTP exception thrown: Instance 3ea25507-d70a-43c8-9491-19c8f4435217 could not be found. Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7ffa74ad-eb64-45ef-96d7-39ad1afedc56 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Request method failure captured: Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/3ea25507-d70a-43c8-9491-19c8f4435217 HTTP/1.1 Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_otXIij24BrnOqCPWE5XiDT4Rx5uZZRnDRhTWiWUhMmS2DUAyH5n2O0Vkmezb5hOy0fctyqnfe7ZbaSNJnnnczoF5HyWbfANNOpLvurLzoVNNSqeZvLUHGfQxxo9XThJWFytr9MwnX2dWjrrodEpNU2X1pToxt_2DqzrpMDM7Uw2GY Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 1c89cc0bcf344df1a27f675fd1fa387a Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ListServerFiltersTestJSON-2057200264 Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c89cc0bcf344df1a27f675fd1fa387a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1c89cc0bcf344df1a27f675fd1fa387a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c89cc0bcf344df1a27f675fd1fa387a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1c89cc0bcf344df1a27f675fd1fa387a"}]}] Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ListServerFiltersTestJSON-2057200264 Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 1c89cc0bcf344df1a27f675fd1fa387a Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2057200264 Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ListServerFiltersTestJSON-2057200264-project Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 176b01b667bd4f38b8d0438206a0deb5 Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ListServerFiltersTestJSON-2057200264-project Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 3ea25507-d70a-43c8-9491-19c8f4435217 could not be found. Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '3ea25507-d70a-43c8-9491-19c8f4435217'} Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ea25507-d70a-43c8-9491-19c8f4435217 could not be found. Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ea25507-d70a-43c8-9491-19c8f4435217 could not be found. Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:37.161169 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:57:37.166257 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:37.166257 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:37.166257 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:37.166257 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:57:37.166257 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:57:37.166257 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ea25507-d70a-43c8-9491-19c8f4435217 could not be found. Aug 04 16:57:37.166257 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:57:37.173046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7ffa74ad-eb64-45ef-96d7-39ad1afedc56 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Returning 404 to user: Instance 3ea25507-d70a-43c8-9491-19c8f4435217 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:57:37.177845 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7ffa74ad-eb64-45ef-96d7-39ad1afedc56 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/3ea25507-d70a-43c8-9491-19c8f4435217" status: 404 len: 111 microversion: 2.1 time: 0.087235 Aug 04 16:57:37.179508 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2084/4099] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:37 2022] GET /compute/v2.1/servers/3ea25507-d70a-43c8-9491-19c8f4435217 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:57:37.190656 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f0aee6ed-69d7-4511-a55c-67b74fd6a883 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:37.193841 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f0aee6ed-69d7-4511-a55c-67b74fd6a883 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 35e71704-0700-4b89-a138-a0d8590f47d7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:37.207849 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f0aee6ed-69d7-4511-a55c-67b74fd6a883 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:37.208731 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f0aee6ed-69d7-4511-a55c-67b74fd6a883 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:37.211992 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f0aee6ed-69d7-4511-a55c-67b74fd6a883 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:37.214803 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f0aee6ed-69d7-4511-a55c-67b74fd6a883 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:37.238146 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-829cea92-f21e-4ea9-90f5-f1ad42fa7346 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.081374 Aug 04 16:57:37.268727 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2016/4100] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:57:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 3112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:57:37.286759 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e34edfc0-515a-418a-ab72-5ab96e831479 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:37.307594 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f0aee6ed-69d7-4511-a55c-67b74fd6a883 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 35e71704-0700-4b89-a138-a0d8590f47d7] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:57:37.316138 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e34edfc0-515a-418a-ab72-5ab96e831479 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '24ac5aa517704e599b7ebb22cae71ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215c4dead77c4db19551a0340cec130b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:37.317459 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e34edfc0-515a-418a-ab72-5ab96e831479 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Searching by: {'deleted': False, 'project_id': '215c4dead77c4db19551a0340cec130b'} {{(pid=126126) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:57:37.342585 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e34edfc0-515a-418a-ab72-5ab96e831479 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:37.343393 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e34edfc0-515a-418a-ab72-5ab96e831479 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:37.344442 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e34edfc0-515a-418a-ab72-5ab96e831479 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:37.345044 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e34edfc0-515a-418a-ab72-5ab96e831479 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:37.376655 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e34edfc0-515a-418a-ab72-5ab96e831479 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.101048 Aug 04 16:57:37.377887 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2017/4101] 10.222.0.23 () {58 vars in 1125 bytes} [Thu Aug 4 16:57:37 2022] GET /compute/v2.1/servers => generated 1018 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:37.394075 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-946db998-ff6d-4134-86c6-41ae5516be80 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03279f98-526c-4c50-a56a-b778a5227b21"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:37.397415 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-946db998-ff6d-4134-86c6-41ae5516be80 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 760130d2-374e-4f4c-a73b-d7a99449e324] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:37.404997 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-946db998-ff6d-4134-86c6-41ae5516be80 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:37.405789 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-946db998-ff6d-4134-86c6-41ae5516be80 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:37.407329 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-946db998-ff6d-4134-86c6-41ae5516be80 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:37.407925 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-946db998-ff6d-4134-86c6-41ae5516be80 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:37.529470 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f0aee6ed-69d7-4511-a55c-67b74fd6a883 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "DELETE /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7" status: 204 len: 0 microversion: 2.1 time: 0.346175 Aug 04 16:57:37.532161 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2085/4102] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:57:37 2022] DELETE /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:57:37.538791 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2d7ae63c-a619-4d3e-890b-dfa33aaf7634 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:37.539531 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2d7ae63c-a619-4d3e-890b-dfa33aaf7634 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] [instance: 32ad59ea-210c-4726-af7f-669fedaef542] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:37.635397 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2d7ae63c-a619-4d3e-890b-dfa33aaf7634 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ac5aa517704e599b7ebb22cae71ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215c4dead77c4db19551a0340cec130b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:37.684626 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2d7ae63c-a619-4d3e-890b-dfa33aaf7634 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers/32ad59ea-210c-4726-af7f-669fedaef542" status: 200 len: 1223 microversion: 2.1 time: 0.143461 Aug 04 16:57:37.686007 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2086/4103] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:37 2022] GET /compute/v2.1/servers/32ad59ea-210c-4726-af7f-669fedaef542 => generated 1223 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:37.720878 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-51f7ce6e-0d4f-49b3-bc78-538247ee3b70 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:37.721466 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-51f7ce6e-0d4f-49b3-bc78-538247ee3b70 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 35e71704-0700-4b89-a138-a0d8590f47d7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:37.749422 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-51f7ce6e-0d4f-49b3-bc78-538247ee3b70 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:37.753259 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-51f7ce6e-0d4f-49b3-bc78-538247ee3b70 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:37.760617 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-51f7ce6e-0d4f-49b3-bc78-538247ee3b70 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:37.761351 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-51f7ce6e-0d4f-49b3-bc78-538247ee3b70 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:37.888388 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-946db998-ff6d-4134-86c6-41ae5516be80 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "POST /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.498904 Aug 04 16:57:37.898302 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2018/4104] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Aug 4 16:57:37 2022] POST /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324/os-volume_attachments => generated 194 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:38.096031 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-51f7ce6e-0d4f-49b3-bc78-538247ee3b70 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:38.106466 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-51f7ce6e-0d4f-49b3-bc78-538247ee3b70 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7" status: 200 len: 1517 microversion: 2.1 time: 0.418620 Aug 04 16:57:38.107062 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2087/4105] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:37 2022] GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7 => generated 1517 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:38.119981 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1ed8faf3-7d93-45ee-b888-9d3f1f2f3e42 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:38.119981 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1ed8faf3-7d93-45ee-b888-9d3f1f2f3e42 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: c323d329-0169-4914-96a5-1532bc922c05] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:38.137990 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1ed8faf3-7d93-45ee-b888-9d3f1f2f3e42 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:38.138595 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1ed8faf3-7d93-45ee-b888-9d3f1f2f3e42 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:38.141011 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1ed8faf3-7d93-45ee-b888-9d3f1f2f3e42 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:38.143706 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1ed8faf3-7d93-45ee-b888-9d3f1f2f3e42 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:38.540064 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1ed8faf3-7d93-45ee-b888-9d3f1f2f3e42 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:38.548176 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1ed8faf3-7d93-45ee-b888-9d3f1f2f3e42 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05" status: 200 len: 1309 microversion: 2.1 time: 0.447204 Aug 04 16:57:38.562536 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2019/4106] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:38 2022] GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05 => generated 1309 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:38.711319 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-66f1015a-619f-4ec0-8722-9c1a8b92e853 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:38.712885 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-66f1015a-619f-4ec0-8722-9c1a8b92e853 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] [instance: 32ad59ea-210c-4726-af7f-669fedaef542] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:38.857424 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-66f1015a-619f-4ec0-8722-9c1a8b92e853 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ac5aa517704e599b7ebb22cae71ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215c4dead77c4db19551a0340cec130b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:38.869612 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-66f1015a-619f-4ec0-8722-9c1a8b92e853 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers/32ad59ea-210c-4726-af7f-669fedaef542" status: 200 len: 1223 microversion: 2.1 time: 0.160357 Aug 04 16:57:38.870527 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2088/4107] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:38 2022] GET /compute/v2.1/servers/32ad59ea-210c-4726-af7f-669fedaef542 => generated 1223 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:39.129065 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-858f4e88-6057-4e12-8006-18620c8f1752 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:39.129754 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-858f4e88-6057-4e12-8006-18620c8f1752 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 35e71704-0700-4b89-a138-a0d8590f47d7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:39.166556 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-858f4e88-6057-4e12-8006-18620c8f1752 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:39.167140 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-858f4e88-6057-4e12-8006-18620c8f1752 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:39.167990 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-858f4e88-6057-4e12-8006-18620c8f1752 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:39.174178 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-858f4e88-6057-4e12-8006-18620c8f1752 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:39.572132 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e3406570-027f-4d5a-b8ec-569e82733367 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:39.573029 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e3406570-027f-4d5a-b8ec-569e82733367 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: c323d329-0169-4914-96a5-1532bc922c05] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:39.581965 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3406570-027f-4d5a-b8ec-569e82733367 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:39.582412 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3406570-027f-4d5a-b8ec-569e82733367 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:39.583195 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3406570-027f-4d5a-b8ec-569e82733367 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:39.583627 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3406570-027f-4d5a-b8ec-569e82733367 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:40.908615 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-858f4e88-6057-4e12-8006-18620c8f1752 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:40.927505 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-858f4e88-6057-4e12-8006-18620c8f1752 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7" status: 200 len: 1517 microversion: 2.1 time: 1.803758 Aug 04 16:57:40.932646 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2020/4108] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:39 2022] GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7 => generated 1517 bytes in 1810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:40.947248 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a17ebb29-b933-47ae-8cb3-df71834a5cbf tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:40.950034 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a17ebb29-b933-47ae-8cb3-df71834a5cbf tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] [instance: 32ad59ea-210c-4726-af7f-669fedaef542] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:40.973511 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a17ebb29-b933-47ae-8cb3-df71834a5cbf tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:40.974395 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a17ebb29-b933-47ae-8cb3-df71834a5cbf tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:40.975445 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a17ebb29-b933-47ae-8cb3-df71834a5cbf tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:40.976048 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a17ebb29-b933-47ae-8cb3-df71834a5cbf tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:41.501632 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e3406570-027f-4d5a-b8ec-569e82733367 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:41.514951 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e3406570-027f-4d5a-b8ec-569e82733367 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05" status: 200 len: 1309 microversion: 2.1 time: 1.946438 Aug 04 16:57:41.516185 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2089/4109] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:39 2022] GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05 => generated 1309 bytes in 1948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:41.521600 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-6dc4974e-7e7f-4b2a-9416-3c25dcaf286a req-c15b83fa-895a-46f1-b373-796bc0b2bcd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c323d329-0169-4914-96a5-1532bc922c05", "name": "network-vif-plugged", "status": "completed", "tag": "6c6d264c-5ac0-48d3-bda9-b43c8ed49afc"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:41.549401 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6dc4974e-7e7f-4b2a-9416-3c25dcaf286a req-c15b83fa-895a-46f1-b373-796bc0b2bcd1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:41.550959 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6dc4974e-7e7f-4b2a-9416-3c25dcaf286a req-c15b83fa-895a-46f1-b373-796bc0b2bcd1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:41.590026 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-6dc4974e-7e7f-4b2a-9416-3c25dcaf286a req-c15b83fa-895a-46f1-b373-796bc0b2bcd1 service nova] Creating event network-vif-plugged:6c6d264c-5ac0-48d3-bda9-b43c8ed49afc for instance c323d329-0169-4914-96a5-1532bc922c05 on n-h1-846466-12 Aug 04 16:57:41.602784 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-6dc4974e-7e7f-4b2a-9416-3c25dcaf286a req-c15b83fa-895a-46f1-b373-796bc0b2bcd1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081672 Aug 04 16:57:41.606230 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2090/4110] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:41.849153 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a17ebb29-b933-47ae-8cb3-df71834a5cbf tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ac5aa517704e599b7ebb22cae71ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215c4dead77c4db19551a0340cec130b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:41.859299 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a17ebb29-b933-47ae-8cb3-df71834a5cbf tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers/32ad59ea-210c-4726-af7f-669fedaef542" status: 200 len: 1283 microversion: 2.1 time: 0.921579 Aug 04 16:57:41.879567 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2021/4111] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:40 2022] GET /compute/v2.1/servers/32ad59ea-210c-4726-af7f-669fedaef542 => generated 1283 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:41.952737 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c7732538-c54a-4547-bfb3-bfd4bfd7c735 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:41.953643 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c7732538-c54a-4547-bfb3-bfd4bfd7c735 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 35e71704-0700-4b89-a138-a0d8590f47d7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:41.984240 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c7732538-c54a-4547-bfb3-bfd4bfd7c735 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:41.984762 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c7732538-c54a-4547-bfb3-bfd4bfd7c735 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:41.991618 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c7732538-c54a-4547-bfb3-bfd4bfd7c735 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:41.992083 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c7732538-c54a-4547-bfb3-bfd4bfd7c735 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:42.536892 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c07cfc72-c6f9-4153-9f57-afa058eef033 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:42.538377 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c07cfc72-c6f9-4153-9f57-afa058eef033 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: c323d329-0169-4914-96a5-1532bc922c05] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:42.553421 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c07cfc72-c6f9-4153-9f57-afa058eef033 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:42.555052 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c07cfc72-c6f9-4153-9f57-afa058eef033 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:42.557582 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c07cfc72-c6f9-4153-9f57-afa058eef033 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:42.560113 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c07cfc72-c6f9-4153-9f57-afa058eef033 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:44.154128 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c7732538-c54a-4547-bfb3-bfd4bfd7c735 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176b01b667bd4f38b8d0438206a0deb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c89cc0bcf344df1a27f675fd1fa387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:44.170974 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c7732538-c54a-4547-bfb3-bfd4bfd7c735 tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7" status: 200 len: 1517 microversion: 2.1 time: 2.223277 Aug 04 16:57:44.173580 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2091/4112] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:41 2022] GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7 => generated 1517 bytes in 2227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:44.187110 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f6ae8674-0441-452b-86be-056d5ed01ded tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:44.189855 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f6ae8674-0441-452b-86be-056d5ed01ded tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] [instance: 32ad59ea-210c-4726-af7f-669fedaef542] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:44.210236 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f6ae8674-0441-452b-86be-056d5ed01ded tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:44.211944 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f6ae8674-0441-452b-86be-056d5ed01ded tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:44.212800 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f6ae8674-0441-452b-86be-056d5ed01ded tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:44.215704 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f6ae8674-0441-452b-86be-056d5ed01ded tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:44.461959 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c07cfc72-c6f9-4153-9f57-afa058eef033 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:44.474811 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c07cfc72-c6f9-4153-9f57-afa058eef033 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05" status: 200 len: 1309 microversion: 2.1 time: 1.939207 Aug 04 16:57:44.478301 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2022/4113] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:42 2022] GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05 => generated 1309 bytes in 1945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:44.498265 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-1676f3c3-9d50-4f33-a942-e70989e0c3cf req-90243e71-78cf-4a7b-9093-b4089a13faba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35e71704-0700-4b89-a138-a0d8590f47d7", "name": "network-vif-deleted", "tag": "77a2d853-c3b5-4de0-abfc-fa285b54172d"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:44.521680 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=12 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:44.556784 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-1676f3c3-9d50-4f33-a942-e70989e0c3cf req-90243e71-78cf-4a7b-9093-b4089a13faba service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:44.557406 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-1676f3c3-9d50-4f33-a942-e70989e0c3cf req-90243e71-78cf-4a7b-9093-b4089a13faba service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:44.575003 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-1676f3c3-9d50-4f33-a942-e70989e0c3cf req-90243e71-78cf-4a7b-9093-b4089a13faba service nova] Creating event network-vif-deleted:77a2d853-c3b5-4de0-abfc-fa285b54172d for instance 35e71704-0700-4b89-a138-a0d8590f47d7 on n-h1-846466-12 Aug 04 16:57:44.603402 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-1676f3c3-9d50-4f33-a942-e70989e0c3cf req-90243e71-78cf-4a7b-9093-b4089a13faba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123567 Aug 04 16:57:44.604277 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2023/4114] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:45.198619 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-327887ff-e9ee-4e88-801c-07dd69829e0d tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:45.199320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-327887ff-e9ee-4e88-801c-07dd69829e0d tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] [instance: 35e71704-0700-4b89-a138-a0d8590f47d7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:45.215410 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-327887ff-e9ee-4e88-801c-07dd69829e0d tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:45.216122 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-327887ff-e9ee-4e88-801c-07dd69829e0d tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:45.218750 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-327887ff-e9ee-4e88-801c-07dd69829e0d tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:45.222024 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-327887ff-e9ee-4e88-801c-07dd69829e0d tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:45.255207 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-327887ff-e9ee-4e88-801c-07dd69829e0d tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] HTTP exception thrown: Instance 35e71704-0700-4b89-a138-a0d8590f47d7 could not be found. Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-327887ff-e9ee-4e88-801c-07dd69829e0d tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Request method failure captured: Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7 HTTP/1.1 Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_otXIij24BrnOqCPWE5XiDT4Rx5uZZRnDRhTWiWUhMmS2DUAyH5n2O0Vkmezb5hOy0fctyqnfe7ZbaSNJnnnczoF5HyWbfANNOpLvurLzoVNNSqeZvLUHGfQxxo9XThJWFytr9MwnX2dWjrrodEpNU2X1pToxt_2DqzrpMDM7Uw2GY Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 1c89cc0bcf344df1a27f675fd1fa387a Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ListServerFiltersTestJSON-2057200264 Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c89cc0bcf344df1a27f675fd1fa387a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1c89cc0bcf344df1a27f675fd1fa387a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c89cc0bcf344df1a27f675fd1fa387a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1c89cc0bcf344df1a27f675fd1fa387a"}]}] Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ListServerFiltersTestJSON-2057200264 Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 1c89cc0bcf344df1a27f675fd1fa387a Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2057200264 Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ListServerFiltersTestJSON-2057200264-project Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 176b01b667bd4f38b8d0438206a0deb5 Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ListServerFiltersTestJSON-2057200264-project Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 35e71704-0700-4b89-a138-a0d8590f47d7 could not be found. Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '35e71704-0700-4b89-a138-a0d8590f47d7'} Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35e71704-0700-4b89-a138-a0d8590f47d7 could not be found. Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35e71704-0700-4b89-a138-a0d8590f47d7 could not be found. Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:45.257100 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:45.260883 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:45.260883 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:45.260883 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:45.260883 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:57:45.260883 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:57:45.260883 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35e71704-0700-4b89-a138-a0d8590f47d7 could not be found. Aug 04 16:57:45.260883 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:57:45.271674 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-327887ff-e9ee-4e88-801c-07dd69829e0d tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] Returning 404 to user: Instance 35e71704-0700-4b89-a138-a0d8590f47d7 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:57:45.274234 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-327887ff-e9ee-4e88-801c-07dd69829e0d tempest-ListServerFiltersTestJSON-2057200264 tempest-ListServerFiltersTestJSON-2057200264-project] 10.222.0.23 "GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7" status: 404 len: 111 microversion: 2.1 time: 0.080853 Aug 04 16:57:45.281692 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2024/4115] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:45 2022] GET /compute/v2.1/servers/35e71704-0700-4b89-a138-a0d8590f47d7 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:57:45.281793 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f6ae8674-0441-452b-86be-056d5ed01ded tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ac5aa517704e599b7ebb22cae71ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215c4dead77c4db19551a0340cec130b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:45.294241 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f6ae8674-0441-452b-86be-056d5ed01ded tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers/32ad59ea-210c-4726-af7f-669fedaef542" status: 200 len: 1323 microversion: 2.1 time: 1.116968 Aug 04 16:57:45.295235 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2092/4116] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:44 2022] GET /compute/v2.1/servers/32ad59ea-210c-4726-af7f-669fedaef542 => generated 1323 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:45.314676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-667af9cf-04c8-46d2-a6d4-c23812a60957 req-a95cb112-20d3-4b21-a15d-bf11549c4ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32ad59ea-210c-4726-af7f-669fedaef542", "tag": "55138bec-fad1-4ed9-9165-1fc62358e3a4"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:45.326616 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-667af9cf-04c8-46d2-a6d4-c23812a60957 req-a95cb112-20d3-4b21-a15d-bf11549c4ef7 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:45.327734 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-667af9cf-04c8-46d2-a6d4-c23812a60957 req-a95cb112-20d3-4b21-a15d-bf11549c4ef7 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:45.344359 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-667af9cf-04c8-46d2-a6d4-c23812a60957 req-a95cb112-20d3-4b21-a15d-bf11549c4ef7 service nova] Creating event network-changed:55138bec-fad1-4ed9-9165-1fc62358e3a4 for instance 32ad59ea-210c-4726-af7f-669fedaef542 on n-h2-846466-12 Aug 04 16:57:45.375662 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-667af9cf-04c8-46d2-a6d4-c23812a60957 req-a95cb112-20d3-4b21-a15d-bf11549c4ef7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065029 Aug 04 16:57:45.376365 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2025/4117] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:45.498345 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-99110ffb-5144-4643-bf22-c0a1564ddb8e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:45.499011 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-99110ffb-5144-4643-bf22-c0a1564ddb8e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: c323d329-0169-4914-96a5-1532bc922c05] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:45.516819 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-99110ffb-5144-4643-bf22-c0a1564ddb8e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:45.517261 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-99110ffb-5144-4643-bf22-c0a1564ddb8e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:45.518064 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-99110ffb-5144-4643-bf22-c0a1564ddb8e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:45.518485 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-99110ffb-5144-4643-bf22-c0a1564ddb8e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:46.317555 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-18e75816-e52c-46be-8486-abbfb26cd210 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:46.318887 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-18e75816-e52c-46be-8486-abbfb26cd210 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] [instance: 32ad59ea-210c-4726-af7f-669fedaef542] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:46.335304 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-18e75816-e52c-46be-8486-abbfb26cd210 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:46.336046 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-18e75816-e52c-46be-8486-abbfb26cd210 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:46.336994 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-18e75816-e52c-46be-8486-abbfb26cd210 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:46.337606 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-18e75816-e52c-46be-8486-abbfb26cd210 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:46.419950 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-99110ffb-5144-4643-bf22-c0a1564ddb8e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:46.433349 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-99110ffb-5144-4643-bf22-c0a1564ddb8e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05" status: 200 len: 1490 microversion: 2.1 time: 0.939144 Aug 04 16:57:46.435651 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2093/4118] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:45 2022] GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05 => generated 1490 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:46.457409 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-738e3493-e33a-4c4b-9eb3-9fa07a9e82cb tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:46.460492 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-738e3493-e33a-4c4b-9eb3-9fa07a9e82cb tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: c323d329-0169-4914-96a5-1532bc922c05] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:46.481938 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-738e3493-e33a-4c4b-9eb3-9fa07a9e82cb tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:46.483202 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-738e3493-e33a-4c4b-9eb3-9fa07a9e82cb tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:46.486240 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-738e3493-e33a-4c4b-9eb3-9fa07a9e82cb tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:46.488022 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-738e3493-e33a-4c4b-9eb3-9fa07a9e82cb tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:46.669482 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-738e3493-e33a-4c4b-9eb3-9fa07a9e82cb tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "PUT /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05" status: 200 len: 1085 microversion: 2.1 time: 0.214835 Aug 04 16:57:46.672372 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2094/4119] 10.222.0.23 () {60 vars in 1256 bytes} [Thu Aug 4 16:57:46 2022] PUT /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05 => generated 1085 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:46.691608 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ce0087ba-fc31-43ef-82fe-1895cacc14fa tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:46.692123 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ce0087ba-fc31-43ef-82fe-1895cacc14fa tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: c323d329-0169-4914-96a5-1532bc922c05] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:46.704605 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ce0087ba-fc31-43ef-82fe-1895cacc14fa tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:46.706184 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ce0087ba-fc31-43ef-82fe-1895cacc14fa tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:46.708298 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ce0087ba-fc31-43ef-82fe-1895cacc14fa tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:46.709862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ce0087ba-fc31-43ef-82fe-1895cacc14fa tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:46.847333 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:47.351589 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=4 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:48.601721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-18e75816-e52c-46be-8486-abbfb26cd210 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ac5aa517704e599b7ebb22cae71ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215c4dead77c4db19551a0340cec130b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:48.618087 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-18e75816-e52c-46be-8486-abbfb26cd210 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers/32ad59ea-210c-4726-af7f-669fedaef542" status: 200 len: 1323 microversion: 2.1 time: 2.304093 Aug 04 16:57:48.621452 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2026/4120] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:46 2022] GET /compute/v2.1/servers/32ad59ea-210c-4726-af7f-669fedaef542 => generated 1323 bytes in 2309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:48.735707 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ce0087ba-fc31-43ef-82fe-1895cacc14fa tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:48.759489 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ce0087ba-fc31-43ef-82fe-1895cacc14fa tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05" status: 200 len: 1511 microversion: 2.1 time: 2.067834 Aug 04 16:57:48.759489 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2095/4121] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:46 2022] GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05 => generated 1511 bytes in 2069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:48.782466 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-48cb65b4-f8d0-4752-8be1-ab67f9882e03 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:48.783472 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-48cb65b4-f8d0-4752-8be1-ab67f9882e03 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: c323d329-0169-4914-96a5-1532bc922c05] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:48.801510 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-48cb65b4-f8d0-4752-8be1-ab67f9882e03 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:48.802212 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-48cb65b4-f8d0-4752-8be1-ab67f9882e03 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:48.803248 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-48cb65b4-f8d0-4752-8be1-ab67f9882e03 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:48.803918 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-48cb65b4-f8d0-4752-8be1-ab67f9882e03 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:48.869657 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:49.643993 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-14db3f30-d036-49de-a879-84c9ac7445db tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:49.645189 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-14db3f30-d036-49de-a879-84c9ac7445db tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] [instance: 32ad59ea-210c-4726-af7f-669fedaef542] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:49.649094 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:49.667755 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14db3f30-d036-49de-a879-84c9ac7445db tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:49.669809 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14db3f30-d036-49de-a879-84c9ac7445db tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:49.673022 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14db3f30-d036-49de-a879-84c9ac7445db tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:49.673633 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14db3f30-d036-49de-a879-84c9ac7445db tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:50.544178 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-48cb65b4-f8d0-4752-8be1-ab67f9882e03 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:50.552340 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-48cb65b4-f8d0-4752-8be1-ab67f9882e03 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05" status: 200 len: 1511 microversion: 2.1 time: 1.776912 Aug 04 16:57:50.552914 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2027/4122] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:48 2022] GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05 => generated 1511 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:50.573777 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5414b40b-4b3c-4c03-b430-5628a9d70f73 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:50.574635 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5414b40b-4b3c-4c03-b430-5628a9d70f73 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: c323d329-0169-4914-96a5-1532bc922c05] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:50.582931 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5414b40b-4b3c-4c03-b430-5628a9d70f73 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:50.583368 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5414b40b-4b3c-4c03-b430-5628a9d70f73 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:50.584129 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5414b40b-4b3c-4c03-b430-5628a9d70f73 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:50.593588 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5414b40b-4b3c-4c03-b430-5628a9d70f73 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:50.651672 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5414b40b-4b3c-4c03-b430-5628a9d70f73 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: c323d329-0169-4914-96a5-1532bc922c05] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:57:50.809393 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5414b40b-4b3c-4c03-b430-5628a9d70f73 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05" status: 204 len: 0 microversion: 2.1 time: 0.239295 Aug 04 16:57:50.810355 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2028/4123] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:57:50 2022] DELETE /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:57:50.825861 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-75b034ce-a45c-4266-aeb6-6d4af528b258 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:50.828173 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-75b034ce-a45c-4266-aeb6-6d4af528b258 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: c323d329-0169-4914-96a5-1532bc922c05] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:50.849138 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-75b034ce-a45c-4266-aeb6-6d4af528b258 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:50.849618 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-75b034ce-a45c-4266-aeb6-6d4af528b258 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:50.850501 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-75b034ce-a45c-4266-aeb6-6d4af528b258 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:50.850929 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-75b034ce-a45c-4266-aeb6-6d4af528b258 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:51.313409 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-14db3f30-d036-49de-a879-84c9ac7445db tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ac5aa517704e599b7ebb22cae71ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215c4dead77c4db19551a0340cec130b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:51.327170 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-14db3f30-d036-49de-a879-84c9ac7445db tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers/32ad59ea-210c-4726-af7f-669fedaef542" status: 200 len: 1323 microversion: 2.1 time: 1.687242 Aug 04 16:57:51.329154 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2096/4124] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:49 2022] GET /compute/v2.1/servers/32ad59ea-210c-4726-af7f-669fedaef542 => generated 1323 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:51.587206 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-75b034ce-a45c-4266-aeb6-6d4af528b258 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:51.600843 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-75b034ce-a45c-4266-aeb6-6d4af528b258 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05" status: 200 len: 1517 microversion: 2.1 time: 0.785671 Aug 04 16:57:51.602295 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2029/4125] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:50 2022] GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05 => generated 1517 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:52.351735 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2e940973-f58f-4547-b691-290c2acf181b tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:52.353179 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2e940973-f58f-4547-b691-290c2acf181b tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] [instance: 32ad59ea-210c-4726-af7f-669fedaef542] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:52.361034 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e940973-f58f-4547-b691-290c2acf181b tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:52.361527 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e940973-f58f-4547-b691-290c2acf181b tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:52.371330 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e940973-f58f-4547-b691-290c2acf181b tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:52.372062 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e940973-f58f-4547-b691-290c2acf181b tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:52.400721 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:52.622495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-be5f6538-eac3-4c6c-84b8-65f6d57c022d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:52.623784 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-be5f6538-eac3-4c6c-84b8-65f6d57c022d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: c323d329-0169-4914-96a5-1532bc922c05] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:52.632203 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be5f6538-eac3-4c6c-84b8-65f6d57c022d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:52.633101 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be5f6538-eac3-4c6c-84b8-65f6d57c022d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:52.634678 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be5f6538-eac3-4c6c-84b8-65f6d57c022d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:52.635452 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be5f6538-eac3-4c6c-84b8-65f6d57c022d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:53.232194 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2e940973-f58f-4547-b691-290c2acf181b tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ac5aa517704e599b7ebb22cae71ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215c4dead77c4db19551a0340cec130b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:53.241804 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2e940973-f58f-4547-b691-290c2acf181b tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers/32ad59ea-210c-4726-af7f-669fedaef542" status: 200 len: 1323 microversion: 2.1 time: 0.893759 Aug 04 16:57:53.242988 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2097/4126] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:52 2022] GET /compute/v2.1/servers/32ad59ea-210c-4726-af7f-669fedaef542 => generated 1323 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:53.335561 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-91f5cff2-8f64-4855-9930-18e17021e227 req-4f6d6b5d-d5ff-48ba-8db0-8e68d55a1c94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32ad59ea-210c-4726-af7f-669fedaef542", "name": "network-vif-plugged", "status": "completed", "tag": "55138bec-fad1-4ed9-9165-1fc62358e3a4"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:53.350636 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-91f5cff2-8f64-4855-9930-18e17021e227 req-4f6d6b5d-d5ff-48ba-8db0-8e68d55a1c94 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:53.351079 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-91f5cff2-8f64-4855-9930-18e17021e227 req-4f6d6b5d-d5ff-48ba-8db0-8e68d55a1c94 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:53.380551 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-91f5cff2-8f64-4855-9930-18e17021e227 req-4f6d6b5d-d5ff-48ba-8db0-8e68d55a1c94 service nova] Creating event network-vif-plugged:55138bec-fad1-4ed9-9165-1fc62358e3a4 for instance 32ad59ea-210c-4726-af7f-669fedaef542 on n-h2-846466-12 Aug 04 16:57:53.391566 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-91f5cff2-8f64-4855-9930-18e17021e227 req-4f6d6b5d-d5ff-48ba-8db0-8e68d55a1c94 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059448 Aug 04 16:57:53.393786 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2098/4127] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:53.574680 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-be5f6538-eac3-4c6c-84b8-65f6d57c022d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:53.589715 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-be5f6538-eac3-4c6c-84b8-65f6d57c022d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05" status: 200 len: 1517 microversion: 2.1 time: 0.970889 Aug 04 16:57:53.601839 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2030/4128] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:52 2022] GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05 => generated 1517 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:53.653716 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-cda1216f-22de-4f59-89ef-5d3e3e0581fe req-46d17439-9828-49e9-9986-99cbe421798e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddddc764-2d86-4950-849a-7da51eaf37c6", "tag": "03e294e6-b45d-4cbf-be07-efbfbe5f603f"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:53.679787 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-cda1216f-22de-4f59-89ef-5d3e3e0581fe req-46d17439-9828-49e9-9986-99cbe421798e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:53.680239 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-cda1216f-22de-4f59-89ef-5d3e3e0581fe req-46d17439-9828-49e9-9986-99cbe421798e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:53.707894 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-cda1216f-22de-4f59-89ef-5d3e3e0581fe req-46d17439-9828-49e9-9986-99cbe421798e service nova] Creating event network-changed:03e294e6-b45d-4cbf-be07-efbfbe5f603f for instance ddddc764-2d86-4950-849a-7da51eaf37c6 on n-h1-846466-12 Aug 04 16:57:53.712947 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-cda1216f-22de-4f59-89ef-5d3e3e0581fe req-46d17439-9828-49e9-9986-99cbe421798e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063298 Aug 04 16:57:53.713735 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2099/4129] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:54.057094 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-be5f6538-eac3-4c6c-84b8-65f6d57c022d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:54.058406 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-be5f6538-eac3-4c6c-84b8-65f6d57c022d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001687 Aug 04 16:57:54.058754 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2031/4130] 10.222.0.23 () {56 vars in 886 bytes} [Thu Aug 4 16:57:54 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 04 16:57:54.266081 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9a74a9b6-6dfc-4a2e-8f4d-73b04161cb97 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:54.266955 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9a74a9b6-6dfc-4a2e-8f4d-73b04161cb97 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] [instance: 32ad59ea-210c-4726-af7f-669fedaef542] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:54.281956 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9a74a9b6-6dfc-4a2e-8f4d-73b04161cb97 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:54.282482 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9a74a9b6-6dfc-4a2e-8f4d-73b04161cb97 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:54.283383 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9a74a9b6-6dfc-4a2e-8f4d-73b04161cb97 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:54.284015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9a74a9b6-6dfc-4a2e-8f4d-73b04161cb97 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:54.616758 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-74fedd35-d888-422c-85a8-201f968e53a2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:54.617756 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-74fedd35-d888-422c-85a8-201f968e53a2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: c323d329-0169-4914-96a5-1532bc922c05] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:54.628236 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-74fedd35-d888-422c-85a8-201f968e53a2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:54.628966 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-74fedd35-d888-422c-85a8-201f968e53a2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:54.631492 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-74fedd35-d888-422c-85a8-201f968e53a2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:54.632120 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-74fedd35-d888-422c-85a8-201f968e53a2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:55.320693 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9a74a9b6-6dfc-4a2e-8f4d-73b04161cb97 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ac5aa517704e599b7ebb22cae71ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215c4dead77c4db19551a0340cec130b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:55.352520 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9a74a9b6-6dfc-4a2e-8f4d-73b04161cb97 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers/32ad59ea-210c-4726-af7f-669fedaef542" status: 200 len: 1323 microversion: 2.1 time: 1.089640 Aug 04 16:57:55.353178 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2100/4131] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:54 2022] GET /compute/v2.1/servers/32ad59ea-210c-4726-af7f-669fedaef542 => generated 1323 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:55.378305 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-74fedd35-d888-422c-85a8-201f968e53a2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:55.389784 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-74fedd35-d888-422c-85a8-201f968e53a2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05" status: 200 len: 1517 microversion: 2.1 time: 0.777902 Aug 04 16:57:55.390842 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2032/4132] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:54 2022] GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05 => generated 1517 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:55.750214 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-7cc1d9e6-ab09-465b-9c5c-390ccc194c26 req-db0ef9c6-d5ab-445c-bda3-af1b1258accd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8", "tag": "8ff64789-7be3-4edd-ad0f-b785bcae611c"}, {"server_uuid": "c323d329-0169-4914-96a5-1532bc922c05", "name": "network-vif-deleted", "tag": "6c6d264c-5ac0-48d3-bda9-b43c8ed49afc"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:55.757341 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:55.768955 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7cc1d9e6-ab09-465b-9c5c-390ccc194c26 req-db0ef9c6-d5ab-445c-bda3-af1b1258accd service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:55.769418 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7cc1d9e6-ab09-465b-9c5c-390ccc194c26 req-db0ef9c6-d5ab-445c-bda3-af1b1258accd service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:55.784567 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-7cc1d9e6-ab09-465b-9c5c-390ccc194c26 req-db0ef9c6-d5ab-445c-bda3-af1b1258accd service nova] Creating event network-changed:8ff64789-7be3-4edd-ad0f-b785bcae611c for instance d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8 on n-h2-846466-12 Aug 04 16:57:55.785073 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-7cc1d9e6-ab09-465b-9c5c-390ccc194c26 req-db0ef9c6-d5ab-445c-bda3-af1b1258accd service nova] Creating event network-vif-deleted:6c6d264c-5ac0-48d3-bda9-b43c8ed49afc for instance c323d329-0169-4914-96a5-1532bc922c05 on n-h1-846466-12 Aug 04 16:57:55.795551 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-7cc1d9e6-ab09-465b-9c5c-390ccc194c26 req-db0ef9c6-d5ab-445c-bda3-af1b1258accd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.049018 Aug 04 16:57:55.796352 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2101/4133] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:56.272907 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a63bbea4-f43f-4778-8980-102b8d4ac006 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Action: 'create', calling method: .version_select at 0x7f7e851cfb80>, body: {"keypair": {"name": "tempest-keypair-1573753905", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdNYrlS9vBfQqmPKjdQ6I3JBVzjwmg2nCmlaMLMgWEPM3tOs4oz1CrFVL8SUpCeyiErHyalHy7IrWD98SSlPFhGHMl17Q6cnLJBAkmdblRf7hSL7XxQRButrv5nF27DMA=="}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:56.325115 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-a63bbea4-f43f-4778-8980-102b8d4ac006 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Getting quotas for project 2534921e8a2f47d394059fee872426a8. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:57:56.341491 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-a63bbea4-f43f-4778-8980-102b8d4ac006 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Getting quotas for user d82f4a672b154291a412a282d1a88208 and project 2534921e8a2f47d394059fee872426a8. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:57:56.379281 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8eb84829-2315-49ee-91ce-9d6aee4cb12d tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:56.380030 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8eb84829-2315-49ee-91ce-9d6aee4cb12d tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] [instance: 32ad59ea-210c-4726-af7f-669fedaef542] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:56.401337 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a63bbea4-f43f-4778-8980-102b8d4ac006 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.134075 Aug 04 16:57:56.409730 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8eb84829-2315-49ee-91ce-9d6aee4cb12d tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:56.410213 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8eb84829-2315-49ee-91ce-9d6aee4cb12d tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:56.410822 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2033/4134] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 16:57:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:56.411036 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8eb84829-2315-49ee-91ce-9d6aee4cb12d tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:56.411469 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8eb84829-2315-49ee-91ce-9d6aee4cb12d tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:56.418336 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-abb1aeae-13ec-4e8a-9e57-6170a7ceea11 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:56.420402 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-abb1aeae-13ec-4e8a-9e57-6170a7ceea11 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: c323d329-0169-4914-96a5-1532bc922c05] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:56.443443 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-abb1aeae-13ec-4e8a-9e57-6170a7ceea11 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:56.446213 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-abb1aeae-13ec-4e8a-9e57-6170a7ceea11 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:56.447239 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-abb1aeae-13ec-4e8a-9e57-6170a7ceea11 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:56.450084 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-abb1aeae-13ec-4e8a-9e57-6170a7ceea11 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:56.494109 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-abb1aeae-13ec-4e8a-9e57-6170a7ceea11 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:56.495298 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-abb1aeae-13ec-4e8a-9e57-6170a7ceea11 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:56.496003 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-abb1aeae-13ec-4e8a-9e57-6170a7ceea11 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lazy-loading 'fault' on Instance uuid c323d329-0169-4914-96a5-1532bc922c05 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:57:56.590978 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-abb1aeae-13ec-4e8a-9e57-6170a7ceea11 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:56.611212 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-abb1aeae-13ec-4e8a-9e57-6170a7ceea11 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05" status: 200 len: 1320 microversion: 2.1 time: 0.196280 Aug 04 16:57:56.613325 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2034/4135] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:56 2022] GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05 => generated 1320 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:56.759991 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8eb84829-2315-49ee-91ce-9d6aee4cb12d tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ac5aa517704e599b7ebb22cae71ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215c4dead77c4db19551a0340cec130b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:56.775027 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8eb84829-2315-49ee-91ce-9d6aee4cb12d tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers/32ad59ea-210c-4726-af7f-669fedaef542" status: 200 len: 1516 microversion: 2.1 time: 0.403188 Aug 04 16:57:56.776215 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2102/4136] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:56 2022] GET /compute/v2.1/servers/32ad59ea-210c-4726-af7f-669fedaef542 => generated 1516 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:56.796420 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a6b25e36-8eba-4420-9b1d-9460321cd701 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:56.797031 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a6b25e36-8eba-4420-9b1d-9460321cd701 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] [instance: ddddc764-2d86-4950-849a-7da51eaf37c6] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:56.805276 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6b25e36-8eba-4420-9b1d-9460321cd701 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:56.806034 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6b25e36-8eba-4420-9b1d-9460321cd701 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:56.807080 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6b25e36-8eba-4420-9b1d-9460321cd701 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:56.807659 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6b25e36-8eba-4420-9b1d-9460321cd701 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:57.425871 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a6b25e36-8eba-4420-9b1d-9460321cd701 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ac5aa517704e599b7ebb22cae71ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215c4dead77c4db19551a0340cec130b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:57.441916 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a6b25e36-8eba-4420-9b1d-9460321cd701 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers/ddddc764-2d86-4950-849a-7da51eaf37c6" status: 200 len: 1323 microversion: 2.1 time: 0.649922 Aug 04 16:57:57.442771 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2035/4137] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:56 2022] GET /compute/v2.1/servers/ddddc764-2d86-4950-849a-7da51eaf37c6 => generated 1323 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:57.632596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-737b4f7a-9a79-4dde-9bde-0fa172cb9b69 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:57.633938 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-737b4f7a-9a79-4dde-9bde-0fa172cb9b69 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: c323d329-0169-4914-96a5-1532bc922c05] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:57.647142 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-737b4f7a-9a79-4dde-9bde-0fa172cb9b69 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:57.647883 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-737b4f7a-9a79-4dde-9bde-0fa172cb9b69 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:57.648826 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-737b4f7a-9a79-4dde-9bde-0fa172cb9b69 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:57.649433 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-737b4f7a-9a79-4dde-9bde-0fa172cb9b69 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:57.693962 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-737b4f7a-9a79-4dde-9bde-0fa172cb9b69 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] HTTP exception thrown: Instance c323d329-0169-4914-96a5-1532bc922c05 could not be found. Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-737b4f7a-9a79-4dde-9bde-0fa172cb9b69 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Request method failure captured: Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05 HTTP/1.1 Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_nQAsIL8Gtig2JiDfXWtIJ3WPqwL_iDK7Lzq6TGktfJLC3h9uoTgZsXj24J3msyyZQB5KWPirQK_R6x2-eYME28EQ_2bgNAh7DlNXEg7JFJsdnvAdfZMaqCmRUibanDLQxQgidHpyXwUg784UXcgxKrIZzuzT1AuaLsb_WysQnZpiA Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersTestJSON-750208524 Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa4bb1fda4ef4267829850c4c616df77"}]}] Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersTestJSON-750208524 Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersTestJSON-750208524 Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersTestJSON-750208524-project Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: db8a96da1d7943599ee6ca9df18f5148 Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersTestJSON-750208524-project Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance c323d329-0169-4914-96a5-1532bc922c05 could not be found. Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'c323d329-0169-4914-96a5-1532bc922c05'} Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c323d329-0169-4914-96a5-1532bc922c05 could not be found. Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c323d329-0169-4914-96a5-1532bc922c05 could not be found. Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:57:57.695825 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:57.700838 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:57.700838 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:57.700838 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:57:57.700838 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:57:57.700838 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c323d329-0169-4914-96a5-1532bc922c05 could not be found. Aug 04 16:57:57.700838 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:57:57.700838 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-737b4f7a-9a79-4dde-9bde-0fa172cb9b69 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Returning 404 to user: Instance c323d329-0169-4914-96a5-1532bc922c05 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:57:57.700838 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-737b4f7a-9a79-4dde-9bde-0fa172cb9b69 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05" status: 404 len: 111 microversion: 2.1 time: 0.069116 Aug 04 16:57:57.700838 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2103/4138] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:57 2022] GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:57:57.889528 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8672437e-f8a9-444e-8de7-5c4d6def02d6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-710722705", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "b83d6df0-d970-41bd-ae99-1dfc6211d426"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:57.995503 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-8672437e-f8a9-444e-8de7-5c4d6def02d6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] validate_networks() for [('b83d6df0-d970-41bd-ae99-1dfc6211d426', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:57:58.471166 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8b0f4d4e-dd8a-41ea-83a8-180742696fe6 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:58.472280 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8b0f4d4e-dd8a-41ea-83a8-180742696fe6 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] [instance: ddddc764-2d86-4950-849a-7da51eaf37c6] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:58.488925 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8b0f4d4e-dd8a-41ea-83a8-180742696fe6 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:58.494692 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8b0f4d4e-dd8a-41ea-83a8-180742696fe6 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:58.495973 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8b0f4d4e-dd8a-41ea-83a8-180742696fe6 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:58.498092 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8b0f4d4e-dd8a-41ea-83a8-180742696fe6 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:59.101130 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8b0f4d4e-dd8a-41ea-83a8-180742696fe6 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ac5aa517704e599b7ebb22cae71ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215c4dead77c4db19551a0340cec130b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:59.110637 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8b0f4d4e-dd8a-41ea-83a8-180742696fe6 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers/ddddc764-2d86-4950-849a-7da51eaf37c6" status: 200 len: 1323 microversion: 2.1 time: 0.651644 Aug 04 16:57:59.111234 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2104/4139] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:58 2022] GET /compute/v2.1/servers/ddddc764-2d86-4950-849a-7da51eaf37c6 => generated 1323 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:59.384321 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-8672437e-f8a9-444e-8de7-5c4d6def02d6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:57:59.389957 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-8672437e-f8a9-444e-8de7-5c4d6def02d6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:57:59.389957 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-8672437e-f8a9-444e-8de7-5c4d6def02d6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:57:59.389957 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-8672437e-f8a9-444e-8de7-5c4d6def02d6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:57:59.389957 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-8672437e-f8a9-444e-8de7-5c4d6def02d6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:57:59.407674 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8672437e-f8a9-444e-8de7-5c4d6def02d6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:59.408593 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8672437e-f8a9-444e-8de7-5c4d6def02d6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:59.409847 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8672437e-f8a9-444e-8de7-5c4d6def02d6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:57:59.411123 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8672437e-f8a9-444e-8de7-5c4d6def02d6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:57:59.444727 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-8672437e-f8a9-444e-8de7-5c4d6def02d6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Getting quotas for project fa4bb1fda4ef4267829850c4c616df77. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:57:59.470154 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-8672437e-f8a9-444e-8de7-5c4d6def02d6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Getting quotas for user db8a96da1d7943599ee6ca9df18f5148 and project fa4bb1fda4ef4267829850c4c616df77. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:57:59.495789 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8672437e-f8a9-444e-8de7-5c4d6def02d6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:57:59.499677 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8672437e-f8a9-444e-8de7-5c4d6def02d6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:57:59.603761 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8672437e-f8a9-444e-8de7-5c4d6def02d6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.718538 Aug 04 16:57:59.604752 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2036/4140] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:57:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:57:59.617943 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9729bb9a-5db4-42e3-ab7f-48b9d7774199 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:59.618584 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9729bb9a-5db4-42e3-ab7f-48b9d7774199 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:59.770965 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9729bb9a-5db4-42e3-ab7f-48b9d7774199 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:59.796005 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9729bb9a-5db4-42e3-ab7f-48b9d7774199 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1208 microversion: 2.1 time: 0.182893 Aug 04 16:57:59.816074 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2105/4141] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:59 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1208 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:00.132442 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3b305c51-f2f0-414e-9dc7-b32db689feee tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:00.134895 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3b305c51-f2f0-414e-9dc7-b32db689feee tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] [instance: ddddc764-2d86-4950-849a-7da51eaf37c6] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:00.154795 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b305c51-f2f0-414e-9dc7-b32db689feee tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:00.155527 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b305c51-f2f0-414e-9dc7-b32db689feee tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:00.156511 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b305c51-f2f0-414e-9dc7-b32db689feee tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:00.157381 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b305c51-f2f0-414e-9dc7-b32db689feee tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:00.708411 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3b305c51-f2f0-414e-9dc7-b32db689feee tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ac5aa517704e599b7ebb22cae71ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215c4dead77c4db19551a0340cec130b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:00.719261 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3b305c51-f2f0-414e-9dc7-b32db689feee tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers/ddddc764-2d86-4950-849a-7da51eaf37c6" status: 200 len: 1323 microversion: 2.1 time: 0.591362 Aug 04 16:58:00.724862 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2037/4142] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:00 2022] GET /compute/v2.1/servers/ddddc764-2d86-4950-849a-7da51eaf37c6 => generated 1323 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:00.825722 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-911096a1-7441-4136-a7ff-ffee542cf8c1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:00.827192 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-911096a1-7441-4136-a7ff-ffee542cf8c1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:00.843989 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-911096a1-7441-4136-a7ff-ffee542cf8c1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:00.845224 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-911096a1-7441-4136-a7ff-ffee542cf8c1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:00.846708 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-911096a1-7441-4136-a7ff-ffee542cf8c1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:00.847315 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-911096a1-7441-4136-a7ff-ffee542cf8c1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:00.954661 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-3b21327d-5da2-47b5-9be2-d2fd75640256 req-5770f232-ddf4-47da-b518-9e3530f1c55e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddddc764-2d86-4950-849a-7da51eaf37c6", "name": "network-vif-plugged", "status": "completed", "tag": "03e294e6-b45d-4cbf-be07-efbfbe5f603f"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:00.973830 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-3b21327d-5da2-47b5-9be2-d2fd75640256 req-5770f232-ddf4-47da-b518-9e3530f1c55e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:00.974956 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-3b21327d-5da2-47b5-9be2-d2fd75640256 req-5770f232-ddf4-47da-b518-9e3530f1c55e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:00.988366 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-3b21327d-5da2-47b5-9be2-d2fd75640256 req-5770f232-ddf4-47da-b518-9e3530f1c55e service nova] Creating event network-vif-plugged:03e294e6-b45d-4cbf-be07-efbfbe5f603f for instance ddddc764-2d86-4950-849a-7da51eaf37c6 on n-h1-846466-12 Aug 04 16:58:00.994142 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-3b21327d-5da2-47b5-9be2-d2fd75640256 req-5770f232-ddf4-47da-b518-9e3530f1c55e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045163 Aug 04 16:58:00.994995 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2038/4143] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:58:01.021850 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-911096a1-7441-4136-a7ff-ffee542cf8c1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:01.042380 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-911096a1-7441-4136-a7ff-ffee542cf8c1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1204 microversion: 2.1 time: 0.219928 Aug 04 16:58:01.043234 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2106/4144] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:00 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1204 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:01.750937 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e9360df9-897d-4fb4-b1c7-4a7b807572cd tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:01.756338 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e9360df9-897d-4fb4-b1c7-4a7b807572cd tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] [instance: ddddc764-2d86-4950-849a-7da51eaf37c6] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:01.772269 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e9360df9-897d-4fb4-b1c7-4a7b807572cd tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:01.773165 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e9360df9-897d-4fb4-b1c7-4a7b807572cd tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:01.776874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e9360df9-897d-4fb4-b1c7-4a7b807572cd tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:01.778785 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e9360df9-897d-4fb4-b1c7-4a7b807572cd tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:02.064751 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-51b8f4c6-6bd2-4c26-b57d-d66b849d3f29 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:02.065400 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-51b8f4c6-6bd2-4c26-b57d-d66b849d3f29 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:02.085144 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-51b8f4c6-6bd2-4c26-b57d-d66b849d3f29 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:02.086013 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-51b8f4c6-6bd2-4c26-b57d-d66b849d3f29 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:02.086979 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-51b8f4c6-6bd2-4c26-b57d-d66b849d3f29 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:02.087570 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-51b8f4c6-6bd2-4c26-b57d-d66b849d3f29 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:02.454381 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-51b8f4c6-6bd2-4c26-b57d-d66b849d3f29 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:02.471868 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-51b8f4c6-6bd2-4c26-b57d-d66b849d3f29 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1266 microversion: 2.1 time: 0.402431 Aug 04 16:58:02.486887 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2107/4145] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:02 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1266 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:03.035796 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-fe93ef23-7c2b-4e1f-bd77-03ce3f5018f7 req-8385c4fc-662e-4bdb-ba6b-f1a22661aa76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8", "name": "network-vif-plugged", "status": "completed", "tag": "8ff64789-7be3-4edd-ad0f-b785bcae611c"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:03.073014 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-fe93ef23-7c2b-4e1f-bd77-03ce3f5018f7 req-8385c4fc-662e-4bdb-ba6b-f1a22661aa76 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:03.073905 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-fe93ef23-7c2b-4e1f-bd77-03ce3f5018f7 req-8385c4fc-662e-4bdb-ba6b-f1a22661aa76 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:03.123195 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-fe93ef23-7c2b-4e1f-bd77-03ce3f5018f7 req-8385c4fc-662e-4bdb-ba6b-f1a22661aa76 service nova] Creating event network-vif-plugged:8ff64789-7be3-4edd-ad0f-b785bcae611c for instance d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8 on n-h2-846466-12 Aug 04 16:58:03.136623 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-fe93ef23-7c2b-4e1f-bd77-03ce3f5018f7 req-8385c4fc-662e-4bdb-ba6b-f1a22661aa76 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106693 Aug 04 16:58:03.139767 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2108/4146] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:03.329054 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e9360df9-897d-4fb4-b1c7-4a7b807572cd tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ac5aa517704e599b7ebb22cae71ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215c4dead77c4db19551a0340cec130b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:03.343404 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e9360df9-897d-4fb4-b1c7-4a7b807572cd tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers/ddddc764-2d86-4950-849a-7da51eaf37c6" status: 200 len: 1323 microversion: 2.1 time: 1.601610 Aug 04 16:58:03.344254 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2039/4147] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:01 2022] GET /compute/v2.1/servers/ddddc764-2d86-4950-849a-7da51eaf37c6 => generated 1323 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:03.504760 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-15c74e01-cf8c-405a-9c2d-8b779b343b34 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:03.505786 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-15c74e01-cf8c-405a-9c2d-8b779b343b34 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:03.520289 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-15c74e01-cf8c-405a-9c2d-8b779b343b34 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:03.523765 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-15c74e01-cf8c-405a-9c2d-8b779b343b34 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:03.524839 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-15c74e01-cf8c-405a-9c2d-8b779b343b34 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:03.525534 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-15c74e01-cf8c-405a-9c2d-8b779b343b34 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:03.729420 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4ffbcde2-7539-49f1-8a69-6318fccd7e45 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1186246347", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ceca6d76-bb57-49ce-899c-2985b37b1ce6"}], "security_groups": [{"name": "tempest-securitygroup--2068205786"}], "key_name": "tempest-keypair-1573753905", "user_data": "}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:03.862653 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-15c74e01-cf8c-405a-9c2d-8b779b343b34 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:03.879519 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-15c74e01-cf8c-405a-9c2d-8b779b343b34 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1266 microversion: 2.1 time: 0.380237 Aug 04 16:58:03.880129 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2109/4148] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:03 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1266 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:04.125938 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-4ffbcde2-7539-49f1-8a69-6318fccd7e45 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] validate_networks() for [('ceca6d76-bb57-49ce-899c-2985b37b1ce6', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:58:04.382858 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-83dfa2dd-e616-4df8-89e3-0aab6fda9ede tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:04.384250 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-83dfa2dd-e616-4df8-89e3-0aab6fda9ede tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] [instance: ddddc764-2d86-4950-849a-7da51eaf37c6] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:04.395750 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-83dfa2dd-e616-4df8-89e3-0aab6fda9ede tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:04.397008 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-83dfa2dd-e616-4df8-89e3-0aab6fda9ede tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:04.398085 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-83dfa2dd-e616-4df8-89e3-0aab6fda9ede tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:04.398701 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-83dfa2dd-e616-4df8-89e3-0aab6fda9ede tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:04.896887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-83dfa2dd-e616-4df8-89e3-0aab6fda9ede tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ac5aa517704e599b7ebb22cae71ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215c4dead77c4db19551a0340cec130b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:04.949318 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-83dfa2dd-e616-4df8-89e3-0aab6fda9ede tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers/ddddc764-2d86-4950-849a-7da51eaf37c6" status: 200 len: 1516 microversion: 2.1 time: 0.578176 Aug 04 16:58:04.986103 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2110/4149] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:04 2022] GET /compute/v2.1/servers/ddddc764-2d86-4950-849a-7da51eaf37c6 => generated 1516 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:04.991793 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f471fc15-43ae-44b2-8072-ff1d117a947c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:04.997758 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f471fc15-43ae-44b2-8072-ff1d117a947c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:05.017924 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f471fc15-43ae-44b2-8072-ff1d117a947c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:05.018791 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f471fc15-43ae-44b2-8072-ff1d117a947c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:05.019737 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f471fc15-43ae-44b2-8072-ff1d117a947c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:05.020330 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f471fc15-43ae-44b2-8072-ff1d117a947c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:06.066702 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f471fc15-43ae-44b2-8072-ff1d117a947c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:06.078678 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f471fc15-43ae-44b2-8072-ff1d117a947c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1308 microversion: 2.1 time: 1.091015 Aug 04 16:58:06.079283 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2111/4150] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:04 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1308 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:06.084176 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dcaccb94-dc81-42a7-9e20-2c3c7df5ec19 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:06.089027 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dcaccb94-dc81-42a7-9e20-2c3c7df5ec19 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] [instance: d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:06.099160 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dcaccb94-dc81-42a7-9e20-2c3c7df5ec19 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:06.102078 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dcaccb94-dc81-42a7-9e20-2c3c7df5ec19 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:06.103128 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dcaccb94-dc81-42a7-9e20-2c3c7df5ec19 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:06.103569 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dcaccb94-dc81-42a7-9e20-2c3c7df5ec19 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:06.518292 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-4ffbcde2-7539-49f1-8a69-6318fccd7e45 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:58:06.519557 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-4ffbcde2-7539-49f1-8a69-6318fccd7e45 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:58:06.520361 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-4ffbcde2-7539-49f1-8a69-6318fccd7e45 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:58:06.528931 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-4ffbcde2-7539-49f1-8a69-6318fccd7e45 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:58:06.530059 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-4ffbcde2-7539-49f1-8a69-6318fccd7e45 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:58:06.574314 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4ffbcde2-7539-49f1-8a69-6318fccd7e45 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:06.585896 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4ffbcde2-7539-49f1-8a69-6318fccd7e45 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:06.588066 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4ffbcde2-7539-49f1-8a69-6318fccd7e45 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:06.588854 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4ffbcde2-7539-49f1-8a69-6318fccd7e45 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:06.632786 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-4ffbcde2-7539-49f1-8a69-6318fccd7e45 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Getting quotas for project 2534921e8a2f47d394059fee872426a8. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:58:06.640931 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-4ffbcde2-7539-49f1-8a69-6318fccd7e45 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Getting quotas for user d82f4a672b154291a412a282d1a88208 and project 2534921e8a2f47d394059fee872426a8. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:58:06.663023 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4ffbcde2-7539-49f1-8a69-6318fccd7e45 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:58:06.665761 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4ffbcde2-7539-49f1-8a69-6318fccd7e45 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: e27ae6f5-5037-4714-b781-224113fa0859] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:58:06.763450 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4ffbcde2-7539-49f1-8a69-6318fccd7e45 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.038538 Aug 04 16:58:06.770340 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2040/4151] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:58:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 3046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:58:06.776643 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-427a9f60-95ab-432b-80c3-2e0f5f2113b9 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:06.777712 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-427a9f60-95ab-432b-80c3-2e0f5f2113b9 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: e27ae6f5-5037-4714-b781-224113fa0859] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:07.717777 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-427a9f60-95ab-432b-80c3-2e0f5f2113b9 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:07.776144 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-427a9f60-95ab-432b-80c3-2e0f5f2113b9 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859" status: 200 len: 1242 microversion: 2.1 time: 1.003688 Aug 04 16:58:07.780430 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2041/4152] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:06 2022] GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859 => generated 1242 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:07.811653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6e6ad2e9-f3bc-4476-b41d-46b1eaaacca1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:07.813816 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6e6ad2e9-f3bc-4476-b41d-46b1eaaacca1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:07.829895 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e6ad2e9-f3bc-4476-b41d-46b1eaaacca1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:07.830411 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dcaccb94-dc81-42a7-9e20-2c3c7df5ec19 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ac5aa517704e599b7ebb22cae71ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215c4dead77c4db19551a0340cec130b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:07.836418 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e6ad2e9-f3bc-4476-b41d-46b1eaaacca1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:07.837117 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e6ad2e9-f3bc-4476-b41d-46b1eaaacca1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:07.837586 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e6ad2e9-f3bc-4476-b41d-46b1eaaacca1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:07.838882 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dcaccb94-dc81-42a7-9e20-2c3c7df5ec19 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers/d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8" status: 200 len: 1516 microversion: 2.1 time: 1.758374 Aug 04 16:58:07.853999 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2112/4153] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:06 2022] GET /compute/v2.1/servers/d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8 => generated 1516 bytes in 1765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:07.859486 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d13e10b1-641a-4fdd-a34d-2a8129e41242 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:07.859987 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d13e10b1-641a-4fdd-a34d-2a8129e41242 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] [instance: d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:07.889624 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d13e10b1-641a-4fdd-a34d-2a8129e41242 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:07.890070 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d13e10b1-641a-4fdd-a34d-2a8129e41242 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:07.890858 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d13e10b1-641a-4fdd-a34d-2a8129e41242 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:07.891284 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d13e10b1-641a-4fdd-a34d-2a8129e41242 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:07.978550 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d13e10b1-641a-4fdd-a34d-2a8129e41242 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] [instance: d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:58:08.188491 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d13e10b1-641a-4fdd-a34d-2a8129e41242 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8" status: 204 len: 0 microversion: 2.1 time: 0.332929 Aug 04 16:58:08.190509 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2113/4154] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:58:07 2022] DELETE /compute/v2.1/servers/d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:58:08.203491 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e11a4268-ffcd-4930-891f-f9343c0582e3 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:08.204193 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e11a4268-ffcd-4930-891f-f9343c0582e3 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] [instance: d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:08.217956 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e11a4268-ffcd-4930-891f-f9343c0582e3 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:08.219040 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e11a4268-ffcd-4930-891f-f9343c0582e3 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:08.220180 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e11a4268-ffcd-4930-891f-f9343c0582e3 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:08.220631 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e11a4268-ffcd-4930-891f-f9343c0582e3 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:08.300261 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6e6ad2e9-f3bc-4476-b41d-46b1eaaacca1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:08.323167 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6e6ad2e9-f3bc-4476-b41d-46b1eaaacca1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1308 microversion: 2.1 time: 0.534818 Aug 04 16:58:08.324022 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2042/4155] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:07 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1308 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:08.686591 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3453b115-3877-4239-910c-116d40b53d02 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1814289206", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "9f25d9f7-53f7-4396-866d-98d00c1c85fe"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:08.787650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-3453b115-3877-4239-910c-116d40b53d02 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] validate_networks() for [('9f25d9f7-53f7-4396-866d-98d00c1c85fe', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:58:09.480453 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e11a4268-ffcd-4930-891f-f9343c0582e3 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ac5aa517704e599b7ebb22cae71ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215c4dead77c4db19551a0340cec130b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:09.497244 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e11a4268-ffcd-4930-891f-f9343c0582e3 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers/d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8" status: 200 len: 1522 microversion: 2.1 time: 1.300659 Aug 04 16:58:09.504993 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2114/4156] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:08 2022] GET /compute/v2.1/servers/d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8 => generated 1522 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:09.524372 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-efadf262-11fe-4ef2-a91d-43c30cbb597a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:09.525447 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-efadf262-11fe-4ef2-a91d-43c30cbb597a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: e27ae6f5-5037-4714-b781-224113fa0859] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:09.533775 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-efadf262-11fe-4ef2-a91d-43c30cbb597a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:09.534636 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-efadf262-11fe-4ef2-a91d-43c30cbb597a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:09.535660 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-efadf262-11fe-4ef2-a91d-43c30cbb597a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:09.536338 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-efadf262-11fe-4ef2-a91d-43c30cbb597a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:09.725370 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-efadf262-11fe-4ef2-a91d-43c30cbb597a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:09.740340 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-efadf262-11fe-4ef2-a91d-43c30cbb597a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859" status: 200 len: 1300 microversion: 2.1 time: 0.220691 Aug 04 16:58:09.742525 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2115/4157] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:09 2022] GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859 => generated 1300 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:09.758239 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-620c4a7c-f5bb-4f40-8ae1-a4ae62afa9b7 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:09.758239 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-620c4a7c-f5bb-4f40-8ae1-a4ae62afa9b7 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:09.776643 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-620c4a7c-f5bb-4f40-8ae1-a4ae62afa9b7 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:09.777457 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-620c4a7c-f5bb-4f40-8ae1-a4ae62afa9b7 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:09.781072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-620c4a7c-f5bb-4f40-8ae1-a4ae62afa9b7 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:09.782407 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-620c4a7c-f5bb-4f40-8ae1-a4ae62afa9b7 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:09.847996 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:11.118614 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-620c4a7c-f5bb-4f40-8ae1-a4ae62afa9b7 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:11.121166 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:11.150419 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-620c4a7c-f5bb-4f40-8ae1-a4ae62afa9b7 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1308 microversion: 2.1 time: 1.398536 Aug 04 16:58:11.151353 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2116/4158] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:09 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1308 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:11.157064 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-45b61c43-1f4a-4c83-b913-fea520a174dc tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:11.158290 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-45b61c43-1f4a-4c83-b913-fea520a174dc tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] [instance: d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:11.190321 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-45b61c43-1f4a-4c83-b913-fea520a174dc tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:11.191511 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-45b61c43-1f4a-4c83-b913-fea520a174dc tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:11.193520 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-45b61c43-1f4a-4c83-b913-fea520a174dc tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:11.194207 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-45b61c43-1f4a-4c83-b913-fea520a174dc tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:11.379185 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-3453b115-3877-4239-910c-116d40b53d02 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:58:11.380493 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-3453b115-3877-4239-910c-116d40b53d02 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:58:11.381318 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-3453b115-3877-4239-910c-116d40b53d02 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:58:11.382007 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-3453b115-3877-4239-910c-116d40b53d02 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:58:11.382608 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-3453b115-3877-4239-910c-116d40b53d02 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:58:11.407217 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3453b115-3877-4239-910c-116d40b53d02 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:11.408616 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3453b115-3877-4239-910c-116d40b53d02 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:11.411201 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3453b115-3877-4239-910c-116d40b53d02 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:11.411896 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3453b115-3877-4239-910c-116d40b53d02 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:11.476371 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-3453b115-3877-4239-910c-116d40b53d02 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Getting quotas for project b318eefcfdf344e1b97d6a81c93e73f8. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:58:11.494234 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-3453b115-3877-4239-910c-116d40b53d02 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Getting quotas for user cccc05e487794576a1a4ecd820fd6af6 and project b318eefcfdf344e1b97d6a81c93e73f8. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:58:11.531074 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3453b115-3877-4239-910c-116d40b53d02 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:58:11.539158 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3453b115-3877-4239-910c-116d40b53d02 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] [instance: e6db45a6-8552-48d5-b89f-08f706f51320] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:58:11.557974 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:11.667649 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3453b115-3877-4239-910c-116d40b53d02 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.183463 Aug 04 16:58:11.679227 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2043/4159] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:58:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 3196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:58:11.689123 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-2425ddf1-dcde-45e0-9aa1-3088328efa1a req-2545c57d-5937-4413-8aeb-b3c94fa75e22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8", "tag": "b4e4ca9c-a9e6-4bb3-a434-6a4bf14ba564"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:11.743165 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-2425ddf1-dcde-45e0-9aa1-3088328efa1a req-2545c57d-5937-4413-8aeb-b3c94fa75e22 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:11.743860 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-2425ddf1-dcde-45e0-9aa1-3088328efa1a req-2545c57d-5937-4413-8aeb-b3c94fa75e22 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:11.765408 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-2425ddf1-dcde-45e0-9aa1-3088328efa1a req-2545c57d-5937-4413-8aeb-b3c94fa75e22 service nova] Creating event network-changed:b4e4ca9c-a9e6-4bb3-a434-6a4bf14ba564 for instance 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 on n-h1-846466-12 Aug 04 16:58:11.787413 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-2425ddf1-dcde-45e0-9aa1-3088328efa1a req-2545c57d-5937-4413-8aeb-b3c94fa75e22 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106637 Aug 04 16:58:11.792375 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2044/4160] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:11.806799 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-99dd176d-775c-4a5c-a5f6-4b1b4b048910 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:11.807720 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-99dd176d-775c-4a5c-a5f6-4b1b4b048910 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: e27ae6f5-5037-4714-b781-224113fa0859] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:11.837689 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-99dd176d-775c-4a5c-a5f6-4b1b4b048910 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:11.839817 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-99dd176d-775c-4a5c-a5f6-4b1b4b048910 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:11.847610 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-99dd176d-775c-4a5c-a5f6-4b1b4b048910 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:11.848171 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-99dd176d-775c-4a5c-a5f6-4b1b4b048910 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:11.883096 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-45b61c43-1f4a-4c83-b913-fea520a174dc tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ac5aa517704e599b7ebb22cae71ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215c4dead77c4db19551a0340cec130b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:11.902837 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-45b61c43-1f4a-4c83-b913-fea520a174dc tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers/d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8" status: 200 len: 1522 microversion: 2.1 time: 0.744415 Aug 04 16:58:11.914985 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2117/4161] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:11 2022] GET /compute/v2.1/servers/d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8 => generated 1522 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:11.924186 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-83c92123-74e0-456d-86ad-85056ac21781 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:11.931826 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-83c92123-74e0-456d-86ad-85056ac21781 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] [instance: e6db45a6-8552-48d5-b89f-08f706f51320] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:12.625451 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-99dd176d-775c-4a5c-a5f6-4b1b4b048910 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:12.633426 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-83c92123-74e0-456d-86ad-85056ac21781 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccc05e487794576a1a4ecd820fd6af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b318eefcfdf344e1b97d6a81c93e73f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:12.641697 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-99dd176d-775c-4a5c-a5f6-4b1b4b048910 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859" status: 200 len: 1300 microversion: 2.1 time: 0.847562 Aug 04 16:58:12.643162 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2045/4162] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:11 2022] GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859 => generated 1300 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:12.662710 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f47635bf-84dc-4603-b42d-cccbccd5fd43 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:12.669136 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f47635bf-84dc-4603-b42d-cccbccd5fd43 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:12.670506 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-83c92123-74e0-456d-86ad-85056ac21781 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] 10.222.0.23 "GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320" status: 200 len: 1224 microversion: 2.1 time: 0.754023 Aug 04 16:58:12.671775 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2118/4163] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:11 2022] GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320 => generated 1224 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:12.699509 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f47635bf-84dc-4603-b42d-cccbccd5fd43 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:12.705636 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f47635bf-84dc-4603-b42d-cccbccd5fd43 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:12.706705 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f47635bf-84dc-4603-b42d-cccbccd5fd43 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:12.707355 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f47635bf-84dc-4603-b42d-cccbccd5fd43 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:12.935942 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-aa1ebf72-f0b1-464b-855b-39c4391d06f5 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:12.937553 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-aa1ebf72-f0b1-464b-855b-39c4391d06f5 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] [instance: d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:12.962673 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aa1ebf72-f0b1-464b-855b-39c4391d06f5 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:12.972185 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aa1ebf72-f0b1-464b-855b-39c4391d06f5 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:12.982147 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aa1ebf72-f0b1-464b-855b-39c4391d06f5 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:12.990659 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aa1ebf72-f0b1-464b-855b-39c4391d06f5 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:13.088127 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aa1ebf72-f0b1-464b-855b-39c4391d06f5 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:13.092789 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aa1ebf72-f0b1-464b-855b-39c4391d06f5 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:13.093384 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-aa1ebf72-f0b1-464b-855b-39c4391d06f5 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lazy-loading 'fault' on Instance uuid d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:58:13.521559 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-aa1ebf72-f0b1-464b-855b-39c4391d06f5 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ac5aa517704e599b7ebb22cae71ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215c4dead77c4db19551a0340cec130b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:13.539180 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-aa1ebf72-f0b1-464b-855b-39c4391d06f5 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers/d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8" status: 200 len: 1313 microversion: 2.1 time: 0.613990 Aug 04 16:58:13.547141 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2119/4164] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:12 2022] GET /compute/v2.1/servers/d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8 => generated 1313 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:58:13.640004 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f47635bf-84dc-4603-b42d-cccbccd5fd43 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:13.656658 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f47635bf-84dc-4603-b42d-cccbccd5fd43 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1308 microversion: 2.1 time: 1.006206 Aug 04 16:58:13.657544 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2046/4165] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:12 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1308 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:13.679713 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e05f26d9-f0f1-4ba1-96b0-8c4e0a81b591 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:13.685231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e05f26d9-f0f1-4ba1-96b0-8c4e0a81b591 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: e27ae6f5-5037-4714-b781-224113fa0859] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:13.695746 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-98b803be-9d9f-4a86-bee9-ad859d805c22 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:13.696391 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e05f26d9-f0f1-4ba1-96b0-8c4e0a81b591 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:13.696596 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-98b803be-9d9f-4a86-bee9-ad859d805c22 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] [instance: e6db45a6-8552-48d5-b89f-08f706f51320] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:13.696861 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e05f26d9-f0f1-4ba1-96b0-8c4e0a81b591 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:13.697690 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e05f26d9-f0f1-4ba1-96b0-8c4e0a81b591 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:13.698126 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e05f26d9-f0f1-4ba1-96b0-8c4e0a81b591 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:13.709816 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-98b803be-9d9f-4a86-bee9-ad859d805c22 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:13.712085 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-98b803be-9d9f-4a86-bee9-ad859d805c22 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:13.717167 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-98b803be-9d9f-4a86-bee9-ad859d805c22 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:13.717861 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-98b803be-9d9f-4a86-bee9-ad859d805c22 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:13.948222 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-98b803be-9d9f-4a86-bee9-ad859d805c22 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccc05e487794576a1a4ecd820fd6af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b318eefcfdf344e1b97d6a81c93e73f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:13.963922 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-98b803be-9d9f-4a86-bee9-ad859d805c22 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] 10.222.0.23 "GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320" status: 200 len: 1276 microversion: 2.1 time: 0.266259 Aug 04 16:58:13.967099 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2047/4166] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:13 2022] GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320 => generated 1276 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:13.987046 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-efa2c54d-722c-417f-8aae-9cc286273643 req-62c812cf-1191-4909-9e03-7922564cd63d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8", "name": "network-vif-deleted", "tag": "8ff64789-7be3-4edd-ad0f-b785bcae611c"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:14.022196 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-efa2c54d-722c-417f-8aae-9cc286273643 req-62c812cf-1191-4909-9e03-7922564cd63d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:14.025780 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-efa2c54d-722c-417f-8aae-9cc286273643 req-62c812cf-1191-4909-9e03-7922564cd63d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:14.068319 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-efa2c54d-722c-417f-8aae-9cc286273643 req-62c812cf-1191-4909-9e03-7922564cd63d service nova] Creating event network-vif-deleted:8ff64789-7be3-4edd-ad0f-b785bcae611c for instance d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8 on n-h2-846466-12 Aug 04 16:58:14.085160 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-efa2c54d-722c-417f-8aae-9cc286273643 req-62c812cf-1191-4909-9e03-7922564cd63d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115563 Aug 04 16:58:14.089012 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2048/4167] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:14.153060 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e05f26d9-f0f1-4ba1-96b0-8c4e0a81b591 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:14.165806 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e05f26d9-f0f1-4ba1-96b0-8c4e0a81b591 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859" status: 200 len: 1368 microversion: 2.1 time: 0.490388 Aug 04 16:58:14.181426 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2120/4168] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:13 2022] GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859 => generated 1368 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:14.568920 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-31e63d69-001f-4597-a0e0-a98b1dbb7142 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:14.572373 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-31e63d69-001f-4597-a0e0-a98b1dbb7142 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] [instance: d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:14.586708 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-31e63d69-001f-4597-a0e0-a98b1dbb7142 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:14.587862 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-31e63d69-001f-4597-a0e0-a98b1dbb7142 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:14.591229 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-31e63d69-001f-4597-a0e0-a98b1dbb7142 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:14.595336 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-31e63d69-001f-4597-a0e0-a98b1dbb7142 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:14.664748 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:14.667605 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-31e63d69-001f-4597-a0e0-a98b1dbb7142 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] HTTP exception thrown: Instance d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8 could not be found. Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-31e63d69-001f-4597-a0e0-a98b1dbb7142 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Request method failure captured: Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8 HTTP/1.1 Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_p8SsPlMe9Z0iyvVdhOjwPBAHZvL7JYQib57kezdlyIV0g3IXtexx1pwuxQqINiSQ6spgUeqsWFTaAusYYW5ZQZhCznQ2xreBwaw_rY9yB8jcaPh_4nbbHD1uUqP4h_tFkD-66SVVKFVbSzGtuEzm6HUxscvH99jvqge8uzxNte9G8 Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 215c4dead77c4db19551a0340cec130b Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ListServersNegativeTestJSON-1128649595 Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/215c4dead77c4db19551a0340cec130b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_215c4dead77c4db19551a0340cec130b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/215c4dead77c4db19551a0340cec130b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/215c4dead77c4db19551a0340cec130b"}]}] Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ListServersNegativeTestJSON-1128649595 Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 215c4dead77c4db19551a0340cec130b Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1128649595 Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ListServersNegativeTestJSON-1128649595-project Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 24ac5aa517704e599b7ebb22cae71ecd Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ListServersNegativeTestJSON-1128649595-project Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8 could not be found. Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'd0aeddad-4023-4fa8-bf2c-d6549fdf8fb8'} Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8 could not be found. Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8 could not be found. Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:14.676529 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:14.681590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:14.681590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:14.681590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:14.681590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:14.681590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:14.681590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:14.681590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8 could not be found. Aug 04 16:58:14.681590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:14.685215 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-61d9ea49-2557-416d-a97b-33d065e35772 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:14.687648 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-61d9ea49-2557-416d-a97b-33d065e35772 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:14.694334 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-31e63d69-001f-4597-a0e0-a98b1dbb7142 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Returning 404 to user: Instance d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:14.695584 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-31e63d69-001f-4597-a0e0-a98b1dbb7142 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers/d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8" status: 404 len: 111 microversion: 2.1 time: 0.131255 Aug 04 16:58:14.696934 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2049/4169] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:14 2022] GET /compute/v2.1/servers/d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:58:14.707826 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f146a658-30b3-4661-a33e-50b3e534866a tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:14.713661 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-61d9ea49-2557-416d-a97b-33d065e35772 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:14.716907 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-61d9ea49-2557-416d-a97b-33d065e35772 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:14.717933 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-61d9ea49-2557-416d-a97b-33d065e35772 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:14.722391 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-61d9ea49-2557-416d-a97b-33d065e35772 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:14.723964 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f146a658-30b3-4661-a33e-50b3e534866a tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '24ac5aa517704e599b7ebb22cae71ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215c4dead77c4db19551a0340cec130b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:14.725384 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f146a658-30b3-4661-a33e-50b3e534866a tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '215c4dead77c4db19551a0340cec130b'} {{(pid=126126) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:58:14.733191 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f146a658-30b3-4661-a33e-50b3e534866a tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:14.734103 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f146a658-30b3-4661-a33e-50b3e534866a tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:14.735329 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f146a658-30b3-4661-a33e-50b3e534866a tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:14.736014 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f146a658-30b3-4661-a33e-50b3e534866a tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:14.898524 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f146a658-30b3-4661-a33e-50b3e534866a tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.194966 Aug 04 16:58:14.899879 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2050/4170] 10.222.0.23 () {58 vars in 1230 bytes} [Thu Aug 4 16:58:14 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:58:14.912250 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f68bfdb9-9d54-4677-a834-0e23b789faa4 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f68bfdb9-9d54-4677-a834-0e23b789faa4 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Request method failure captured: Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_p8SsPlMe9Z0iyvVdhOjwPBAHZvL7JYQib57kezdlyIV0g3IXtexx1pwuxQqINiSQ6spgUeqsWFTaAusYYW5ZQZhCznQ2xreBwaw_rY9yB8jcaPh_4nbbHD1uUqP4h_tFkD-66SVVKFVbSzGtuEzm6HUxscvH99jvqge8uzxNte9G8 Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 215c4dead77c4db19551a0340cec130b Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ListServersNegativeTestJSON-1128649595 Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/215c4dead77c4db19551a0340cec130b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_215c4dead77c4db19551a0340cec130b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/215c4dead77c4db19551a0340cec130b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/215c4dead77c4db19551a0340cec130b"}]}] Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ListServersNegativeTestJSON-1128649595 Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 215c4dead77c4db19551a0340cec130b Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1128649595 Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ListServersNegativeTestJSON-1128649595-project Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 24ac5aa517704e599b7ebb22cae71ecd Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ListServersNegativeTestJSON-1128649595-project Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: action_args: {} Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 04 16:58:14.925230 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:58:14.929338 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:58:14.929338 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:58:14.929338 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:58:14.929338 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 04 16:58:14.929338 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:14.929338 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:14.929338 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:14.929338 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:14.929338 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:14.929338 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:14.929338 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:58:14.929338 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:58:14.929338 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 04 16:58:14.929338 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:14.932798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f68bfdb9-9d54-4677-a834-0e23b789faa4 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:14.937671 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f68bfdb9-9d54-4677-a834-0e23b789faa4 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.029133 Aug 04 16:58:14.938478 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2051/4171] 10.222.0.23 () {58 vars in 1182 bytes} [Thu Aug 4 16:58:14 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 16:58:14.951821 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bc705cd6-0159-4bca-9d6b-7b5ed7234f6b tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:14.964676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bc705cd6-0159-4bca-9d6b-7b5ed7234f6b tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '24ac5aa517704e599b7ebb22cae71ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215c4dead77c4db19551a0340cec130b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:14.973351 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bc705cd6-0159-4bca-9d6b-7b5ed7234f6b tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Searching by: {'deleted': False, 'project_id': '215c4dead77c4db19551a0340cec130b'} {{(pid=126126) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:58:14.984148 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bc705cd6-0159-4bca-9d6b-7b5ed7234f6b tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:14.984974 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bc705cd6-0159-4bca-9d6b-7b5ed7234f6b tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:14.986268 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bc705cd6-0159-4bca-9d6b-7b5ed7234f6b tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:14.986701 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bc705cd6-0159-4bca-9d6b-7b5ed7234f6b tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:15.042833 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.multi_cell_list [None req-bc705cd6-0159-4bca-9d6b-7b5ed7234f6b tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126126) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:58:15.092707 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bc705cd6-0159-4bca-9d6b-7b5ed7234f6b tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.148410 Aug 04 16:58:15.093756 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2052/4172] 10.222.0.23 () {58 vars in 1125 bytes} [Thu Aug 4 16:58:14 2022] GET /compute/v2.1/servers => generated 683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:15.108917 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ab24fbd2-e670-48f3-8abc-4dfd0ab6f270 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:15.119574 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ab24fbd2-e670-48f3-8abc-4dfd0ab6f270 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] [instance: e6db45a6-8552-48d5-b89f-08f706f51320] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:15.168135 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ab24fbd2-e670-48f3-8abc-4dfd0ab6f270 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:15.168740 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ab24fbd2-e670-48f3-8abc-4dfd0ab6f270 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:15.171273 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ab24fbd2-e670-48f3-8abc-4dfd0ab6f270 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:15.171726 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ab24fbd2-e670-48f3-8abc-4dfd0ab6f270 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:15.635002 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ab24fbd2-e670-48f3-8abc-4dfd0ab6f270 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccc05e487794576a1a4ecd820fd6af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b318eefcfdf344e1b97d6a81c93e73f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:15.668768 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ab24fbd2-e670-48f3-8abc-4dfd0ab6f270 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] 10.222.0.23 "GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320" status: 200 len: 1282 microversion: 2.1 time: 0.571712 Aug 04 16:58:15.669461 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2053/4173] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:15 2022] GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320 => generated 1282 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:15.686919 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d6168d23-c26f-44ac-b87f-189b4147019f tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:15.705626 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d6168d23-c26f-44ac-b87f-189b4147019f tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '24ac5aa517704e599b7ebb22cae71ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215c4dead77c4db19551a0340cec130b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:15.706168 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.compute.servers [None req-d6168d23-c26f-44ac-b87f-189b4147019f tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Removing options 'limit' from query {{(pid=126126) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 04 16:58:15.706856 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d6168d23-c26f-44ac-b87f-189b4147019f tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Searching by: {'deleted': False, 'project_id': '215c4dead77c4db19551a0340cec130b'} {{(pid=126126) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:58:15.726941 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d6168d23-c26f-44ac-b87f-189b4147019f tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:15.728495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d6168d23-c26f-44ac-b87f-189b4147019f tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:15.729914 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d6168d23-c26f-44ac-b87f-189b4147019f tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:15.730349 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d6168d23-c26f-44ac-b87f-189b4147019f tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:15.769365 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.multi_cell_list [None req-d6168d23-c26f-44ac-b87f-189b4147019f tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=126126) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:58:15.818813 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d6168d23-c26f-44ac-b87f-189b4147019f tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.144830 Aug 04 16:58:15.819812 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2054/4174] 10.222.0.23 () {58 vars in 1144 bytes} [Thu Aug 4 16:58:15 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:15.825697 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b71f4fb2-9273-47fa-88e0-7fddca7986ce tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:15.826718 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b71f4fb2-9273-47fa-88e0-7fddca7986ce tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: e27ae6f5-5037-4714-b781-224113fa0859] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:15.835216 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b71f4fb2-9273-47fa-88e0-7fddca7986ce tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:15.835877 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b71f4fb2-9273-47fa-88e0-7fddca7986ce tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:15.836821 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b71f4fb2-9273-47fa-88e0-7fddca7986ce tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:15.837425 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b71f4fb2-9273-47fa-88e0-7fddca7986ce tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:16.099601 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-61d9ea49-2557-416d-a97b-33d065e35772 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:16.114153 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-61d9ea49-2557-416d-a97b-33d065e35772 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1308 microversion: 2.1 time: 1.438826 Aug 04 16:58:16.129325 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2121/4175] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:14 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1308 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:16.593182 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8faaab18-0726-4c12-9a8c-cf3451ebe4d0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Action: 'create', calling method: .version_select at 0x7f7e859efa60>, body: {"keypair": {"name": "tempest-keypair-2017448656", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxqFpRDCJqcMWpkHg69K+uJrQxzjkFQUjrbXyhPZkVFRBVHy934/SS1BYuKChQQJOfPSdz6jBdH3ZjUrTQatEy0s7Nprjcn1GctpiUNrMKDt5I4mrG2SMWiqlOjY7ezzw=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:16.621972 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-8faaab18-0726-4c12-9a8c-cf3451ebe4d0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Getting quotas for project 470aa7b0a4464f9789d315176c4b7bc6. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:58:16.628533 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-8faaab18-0726-4c12-9a8c-cf3451ebe4d0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Getting quotas for user 6700990d94334afcac9adff62009d099 and project 470aa7b0a4464f9789d315176c4b7bc6. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:58:16.659389 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8faaab18-0726-4c12-9a8c-cf3451ebe4d0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.528017 Aug 04 16:58:16.661305 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2122/4176] 10.222.0.23 () {62 vars in 1200 bytes} [Thu Aug 4 16:58:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 531 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 16:58:16.666509 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ce7a50e4-ee5d-4672-8abf-16ed6a82f3d2 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ce7a50e4-ee5d-4672-8abf-16ed6a82f3d2 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Request method failure captured: Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_p8SsPlMe9Z0iyvVdhOjwPBAHZvL7JYQib57kezdlyIV0g3IXtexx1pwuxQqINiSQ6spgUeqsWFTaAusYYW5ZQZhCznQ2xreBwaw_rY9yB8jcaPh_4nbbHD1uUqP4h_tFkD-66SVVKFVbSzGtuEzm6HUxscvH99jvqge8uzxNte9G8 Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 215c4dead77c4db19551a0340cec130b Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ListServersNegativeTestJSON-1128649595 Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/215c4dead77c4db19551a0340cec130b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_215c4dead77c4db19551a0340cec130b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/215c4dead77c4db19551a0340cec130b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/215c4dead77c4db19551a0340cec130b"}]}] Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ListServersNegativeTestJSON-1128649595 Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 215c4dead77c4db19551a0340cec130b Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1128649595 Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ListServersNegativeTestJSON-1128649595-project Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 24ac5aa517704e599b7ebb22cae71ecd Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ListServersNegativeTestJSON-1128649595-project Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: action_args: {} Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi '-1' Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 04 16:58:16.675290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 04 16:58:16.680094 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:58:16.680094 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:58:16.680094 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:58:16.680094 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:58:16.680094 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 04 16:58:16.680094 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:16.680094 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:16.680094 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:16.680094 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:16.680094 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:16.680094 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:16.680094 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:58:16.680094 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:58:16.680094 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 04 16:58:16.680094 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:16.683471 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ce7a50e4-ee5d-4672-8abf-16ed6a82f3d2 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:16.684581 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ce7a50e4-ee5d-4672-8abf-16ed6a82f3d2 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.022125 Aug 04 16:58:16.685681 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2123/4177] 10.222.0.23 () {58 vars in 1142 bytes} [Thu Aug 4 16:58:16 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:58:16.697945 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ec4593f0-74a0-411a-ae63-691038eaeb0a tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:16.700372 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ec4593f0-74a0-411a-ae63-691038eaeb0a tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] [instance: e6db45a6-8552-48d5-b89f-08f706f51320] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:16.711894 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec4593f0-74a0-411a-ae63-691038eaeb0a tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:16.713729 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec4593f0-74a0-411a-ae63-691038eaeb0a tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:16.714882 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec4593f0-74a0-411a-ae63-691038eaeb0a tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:16.716150 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec4593f0-74a0-411a-ae63-691038eaeb0a tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:17.063454 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ec4593f0-74a0-411a-ae63-691038eaeb0a tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccc05e487794576a1a4ecd820fd6af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b318eefcfdf344e1b97d6a81c93e73f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:17.083973 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ec4593f0-74a0-411a-ae63-691038eaeb0a tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] 10.222.0.23 "GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320" status: 200 len: 1282 microversion: 2.1 time: 0.390292 Aug 04 16:58:17.088271 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2124/4178] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:16 2022] GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320 => generated 1282 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:17.109909 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7698dcd9-162e-486a-9895-c647fd8b6a26 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7698dcd9-162e-486a-9895-c647fd8b6a26 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Request method failure captured: Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_p8SsPlMe9Z0iyvVdhOjwPBAHZvL7JYQib57kezdlyIV0g3IXtexx1pwuxQqINiSQ6spgUeqsWFTaAusYYW5ZQZhCznQ2xreBwaw_rY9yB8jcaPh_4nbbHD1uUqP4h_tFkD-66SVVKFVbSzGtuEzm6HUxscvH99jvqge8uzxNte9G8 Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 215c4dead77c4db19551a0340cec130b Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ListServersNegativeTestJSON-1128649595 Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/215c4dead77c4db19551a0340cec130b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_215c4dead77c4db19551a0340cec130b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/215c4dead77c4db19551a0340cec130b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/215c4dead77c4db19551a0340cec130b"}]}] Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ListServersNegativeTestJSON-1128649595 Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 215c4dead77c4db19551a0340cec130b Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1128649595 Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ListServersNegativeTestJSON-1128649595-project Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 24ac5aa517704e599b7ebb22cae71ecd Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ListServersNegativeTestJSON-1128649595-project Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: action_args: {} Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'testing' Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 04 16:58:17.120130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 04 16:58:17.133685 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:58:17.133685 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:58:17.133685 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:58:17.133685 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:58:17.133685 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 04 16:58:17.133685 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:17.133685 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:17.133685 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:17.133685 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:17.133685 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:17.133685 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:17.133685 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:58:17.133685 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:58:17.133685 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 04 16:58:17.133685 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:17.137552 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7698dcd9-162e-486a-9895-c647fd8b6a26 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:17.138727 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7698dcd9-162e-486a-9895-c647fd8b6a26 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.048189 Aug 04 16:58:17.140052 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2125/4179] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Aug 4 16:58:17 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:58:17.148544 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-849135ce-ca89-42a1-a878-c7c60acc6fa0 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:17.149563 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-849135ce-ca89-42a1-a878-c7c60acc6fa0 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:17.161829 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-849135ce-ca89-42a1-a878-c7c60acc6fa0 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:17.162513 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-849135ce-ca89-42a1-a878-c7c60acc6fa0 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:17.172051 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-849135ce-ca89-42a1-a878-c7c60acc6fa0 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:17.172899 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-849135ce-ca89-42a1-a878-c7c60acc6fa0 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:17.189730 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b71f4fb2-9273-47fa-88e0-7fddca7986ce tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:17.214906 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b71f4fb2-9273-47fa-88e0-7fddca7986ce tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859" status: 200 len: 1368 microversion: 2.1 time: 1.393502 Aug 04 16:58:17.215528 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2055/4180] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:15 2022] GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859 => generated 1368 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:17.236637 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d643672b-64a5-48f8-a2d3-67eb7696af95 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:17.251427 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d643672b-64a5-48f8-a2d3-67eb7696af95 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '24ac5aa517704e599b7ebb22cae71ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215c4dead77c4db19551a0340cec130b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:17.252225 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d643672b-64a5-48f8-a2d3-67eb7696af95 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '215c4dead77c4db19551a0340cec130b'} {{(pid=126126) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:58:17.272919 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.compute.servers [None req-d643672b-64a5-48f8-a2d3-67eb7696af95 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Flavor 'non_existing_flavor' could not be found {{(pid=126126) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 04 16:58:17.274028 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d643672b-64a5-48f8-a2d3-67eb7696af95 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.057482 Aug 04 16:58:17.274619 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2056/4181] 10.222.0.23 () {58 vars in 1178 bytes} [Thu Aug 4 16:58:17 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:58:17.294594 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-68bb556e-04b2-412c-8add-5179e70cfa43 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:17.307087 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-68bb556e-04b2-412c-8add-5179e70cfa43 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '24ac5aa517704e599b7ebb22cae71ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215c4dead77c4db19551a0340cec130b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:17.307784 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-68bb556e-04b2-412c-8add-5179e70cfa43 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '215c4dead77c4db19551a0340cec130b'} {{(pid=126126) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:58:17.324792 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-68bb556e-04b2-412c-8add-5179e70cfa43 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:17.325322 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-68bb556e-04b2-412c-8add-5179e70cfa43 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:17.326131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-68bb556e-04b2-412c-8add-5179e70cfa43 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:17.326566 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-68bb556e-04b2-412c-8add-5179e70cfa43 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:17.466917 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-68bb556e-04b2-412c-8add-5179e70cfa43 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.176201 Aug 04 16:58:17.468518 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2057/4182] 10.222.0.23 () {58 vars in 1174 bytes} [Thu Aug 4 16:58:17 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:58:17.483649 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ae07d7d5-9ee6-4fd4-abfc-0441a30a10aa tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:17.489731 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ae07d7d5-9ee6-4fd4-abfc-0441a30a10aa tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '24ac5aa517704e599b7ebb22cae71ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215c4dead77c4db19551a0340cec130b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:17.490736 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ae07d7d5-9ee6-4fd4-abfc-0441a30a10aa tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '215c4dead77c4db19551a0340cec130b'} {{(pid=126126) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:58:17.498542 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ae07d7d5-9ee6-4fd4-abfc-0441a30a10aa tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:17.499575 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ae07d7d5-9ee6-4fd4-abfc-0441a30a10aa tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:17.501010 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ae07d7d5-9ee6-4fd4-abfc-0441a30a10aa tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:17.501699 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ae07d7d5-9ee6-4fd4-abfc-0441a30a10aa tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:17.714776 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ae07d7d5-9ee6-4fd4-abfc-0441a30a10aa tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.237088 Aug 04 16:58:17.733711 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2058/4183] 10.222.0.23 () {58 vars in 1184 bytes} [Thu Aug 4 16:58:17 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 16:58:17.739313 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ad066b50-0ad8-481b-908d-8d1ed000bbb6 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:17.744187 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ad066b50-0ad8-481b-908d-8d1ed000bbb6 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '24ac5aa517704e599b7ebb22cae71ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215c4dead77c4db19551a0340cec130b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:17.748106 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ad066b50-0ad8-481b-908d-8d1ed000bbb6 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Searching by: {'deleted': False, 'project_id': '215c4dead77c4db19551a0340cec130b'} {{(pid=126126) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:58:17.759824 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad066b50-0ad8-481b-908d-8d1ed000bbb6 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:17.762638 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad066b50-0ad8-481b-908d-8d1ed000bbb6 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:17.766504 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad066b50-0ad8-481b-908d-8d1ed000bbb6 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:17.766983 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad066b50-0ad8-481b-908d-8d1ed000bbb6 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:17.833556 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.multi_cell_list [None req-ad066b50-0ad8-481b-908d-8d1ed000bbb6 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126126) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:58:17.915623 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=25 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:17.920368 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ad066b50-0ad8-481b-908d-8d1ed000bbb6 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ac5aa517704e599b7ebb22cae71ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215c4dead77c4db19551a0340cec130b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:17.928916 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad066b50-0ad8-481b-908d-8d1ed000bbb6 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:17.930203 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad066b50-0ad8-481b-908d-8d1ed000bbb6 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:18.275538 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-849135ce-ca89-42a1-a878-c7c60acc6fa0 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:18.288636 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-849135ce-ca89-42a1-a878-c7c60acc6fa0 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1308 microversion: 2.1 time: 1.146998 Aug 04 16:58:18.289241 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2126/4184] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:17 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1308 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:18.296885 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e62e000d-5926-4f64-8a2b-0be518997623 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:18.304261 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e62e000d-5926-4f64-8a2b-0be518997623 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] [instance: e6db45a6-8552-48d5-b89f-08f706f51320] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:18.317328 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e62e000d-5926-4f64-8a2b-0be518997623 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:18.318773 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e62e000d-5926-4f64-8a2b-0be518997623 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:18.321676 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e62e000d-5926-4f64-8a2b-0be518997623 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:18.322385 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e62e000d-5926-4f64-8a2b-0be518997623 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:18.641911 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e62e000d-5926-4f64-8a2b-0be518997623 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccc05e487794576a1a4ecd820fd6af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b318eefcfdf344e1b97d6a81c93e73f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:18.660062 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e62e000d-5926-4f64-8a2b-0be518997623 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] 10.222.0.23 "GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320" status: 200 len: 1282 microversion: 2.1 time: 0.367846 Aug 04 16:58:18.662766 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2127/4185] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:18 2022] GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320 => generated 1282 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:18.682272 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c34eb0d9-be59-4bcb-b2a2-d3381c218621 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:18.693995 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c34eb0d9-be59-4bcb-b2a2-d3381c218621 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: e27ae6f5-5037-4714-b781-224113fa0859] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:18.713133 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ad066b50-0ad8-481b-908d-8d1ed000bbb6 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 3025 microversion: 2.1 time: 0.977833 Aug 04 16:58:18.714088 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2059/4186] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 16:58:17 2022] GET /compute/v2.1/servers/detail => generated 3025 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:18.732454 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c34eb0d9-be59-4bcb-b2a2-d3381c218621 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:18.733843 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c34eb0d9-be59-4bcb-b2a2-d3381c218621 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:18.740670 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c34eb0d9-be59-4bcb-b2a2-d3381c218621 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:18.743398 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c34eb0d9-be59-4bcb-b2a2-d3381c218621 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:19.003775 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-ca5466f1-a6a5-47b3-b03a-6ae265929069 req-e6672b9e-bf6d-4810-8250-7c0de3fa57cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e27ae6f5-5037-4714-b781-224113fa0859", "tag": "9fc22e1a-6c76-4ae5-ac92-4c33d8d04605"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:19.031219 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-ca5466f1-a6a5-47b3-b03a-6ae265929069 req-e6672b9e-bf6d-4810-8250-7c0de3fa57cc service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:19.031684 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-ca5466f1-a6a5-47b3-b03a-6ae265929069 req-e6672b9e-bf6d-4810-8250-7c0de3fa57cc service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:19.062763 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-ca5466f1-a6a5-47b3-b03a-6ae265929069 req-e6672b9e-bf6d-4810-8250-7c0de3fa57cc service nova] Creating event network-changed:9fc22e1a-6c76-4ae5-ac92-4c33d8d04605 for instance e27ae6f5-5037-4714-b781-224113fa0859 on n-h1-846466-12 Aug 04 16:58:19.077229 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-ca5466f1-a6a5-47b3-b03a-6ae265929069 req-e6672b9e-bf6d-4810-8250-7c0de3fa57cc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.361056 Aug 04 16:58:19.078510 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2060/4187] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:19.093212 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-22b3386a-f28c-465f-b403-7112f1a90b0f tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:19.108143 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-22b3386a-f28c-465f-b403-7112f1a90b0f tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '24ac5aa517704e599b7ebb22cae71ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215c4dead77c4db19551a0340cec130b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:19.109168 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-22b3386a-f28c-465f-b403-7112f1a90b0f tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.029395 Aug 04 16:58:19.110127 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2061/4188] 10.222.0.23 () {58 vars in 1178 bytes} [Thu Aug 4 16:58:19 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:58:19.126935 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-24b27f1d-1ebd-43c0-899a-b5cbc392e548 req-5733e6c1-ef96-4d41-8cac-b1dc42f987d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8", "name": "network-vif-plugged", "status": "completed", "tag": "b4e4ca9c-a9e6-4bb3-a434-6a4bf14ba564"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:19.148616 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-24b27f1d-1ebd-43c0-899a-b5cbc392e548 req-5733e6c1-ef96-4d41-8cac-b1dc42f987d9 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:19.149347 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-24b27f1d-1ebd-43c0-899a-b5cbc392e548 req-5733e6c1-ef96-4d41-8cac-b1dc42f987d9 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:19.168237 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-24b27f1d-1ebd-43c0-899a-b5cbc392e548 req-5733e6c1-ef96-4d41-8cac-b1dc42f987d9 service nova] Creating event network-vif-plugged:b4e4ca9c-a9e6-4bb3-a434-6a4bf14ba564 for instance 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 on n-h1-846466-12 Aug 04 16:58:19.188533 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c34eb0d9-be59-4bcb-b2a2-d3381c218621 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:19.197496 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-24b27f1d-1ebd-43c0-899a-b5cbc392e548 req-5733e6c1-ef96-4d41-8cac-b1dc42f987d9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082812 Aug 04 16:58:19.198565 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2062/4189] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:19.199576 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c34eb0d9-be59-4bcb-b2a2-d3381c218621 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859" status: 200 len: 1368 microversion: 2.1 time: 0.523445 Aug 04 16:58:19.200296 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2128/4190] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:18 2022] GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859 => generated 1368 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:19.246782 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a2281a6e-a243-4a74-a233-aac4d24ab690 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:19.314276 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-45901e4a-ed24-4ef9-a72d-91f47060ca71 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:19.316094 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-45901e4a-ed24-4ef9-a72d-91f47060ca71 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:19.319512 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a2281a6e-a243-4a74-a233-aac4d24ab690 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '24ac5aa517704e599b7ebb22cae71ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215c4dead77c4db19551a0340cec130b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:19.329106 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a2281a6e-a243-4a74-a233-aac4d24ab690 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Searching by: {'deleted': False, 'project_id': '215c4dead77c4db19551a0340cec130b'} {{(pid=126126) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:58:19.329720 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-45901e4a-ed24-4ef9-a72d-91f47060ca71 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:19.330401 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-45901e4a-ed24-4ef9-a72d-91f47060ca71 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:19.338356 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-45901e4a-ed24-4ef9-a72d-91f47060ca71 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:19.339044 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-45901e4a-ed24-4ef9-a72d-91f47060ca71 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:19.381270 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a2281a6e-a243-4a74-a233-aac4d24ab690 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:19.384555 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a2281a6e-a243-4a74-a233-aac4d24ab690 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:19.385506 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a2281a6e-a243-4a74-a233-aac4d24ab690 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:19.390093 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a2281a6e-a243-4a74-a233-aac4d24ab690 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:19.462606 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.multi_cell_list [None req-a2281a6e-a243-4a74-a233-aac4d24ab690 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126126) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:58:19.536867 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a2281a6e-a243-4a74-a233-aac4d24ab690 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.335224 Aug 04 16:58:19.537913 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2063/4191] 10.222.0.23 () {58 vars in 1125 bytes} [Thu Aug 4 16:58:19 2022] GET /compute/v2.1/servers => generated 683 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:19.551238 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-250615e8-83c1-4156-a967-a2c6ba1142a2 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:19.554136 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-250615e8-83c1-4156-a967-a2c6ba1142a2 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] [instance: d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:19.581207 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-250615e8-83c1-4156-a967-a2c6ba1142a2 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:19.585817 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-250615e8-83c1-4156-a967-a2c6ba1142a2 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:19.587611 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-250615e8-83c1-4156-a967-a2c6ba1142a2 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:19.588770 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-250615e8-83c1-4156-a967-a2c6ba1142a2 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:19.626284 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-250615e8-83c1-4156-a967-a2c6ba1142a2 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] HTTP exception thrown: Instance d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8 could not be found. Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-250615e8-83c1-4156-a967-a2c6ba1142a2 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Request method failure captured: Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/servers/d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8 HTTP/1.1 Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_p8SsPlMe9Z0iyvVdhOjwPBAHZvL7JYQib57kezdlyIV0g3IXtexx1pwuxQqINiSQ6spgUeqsWFTaAusYYW5ZQZhCznQ2xreBwaw_rY9yB8jcaPh_4nbbHD1uUqP4h_tFkD-66SVVKFVbSzGtuEzm6HUxscvH99jvqge8uzxNte9G8 Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 215c4dead77c4db19551a0340cec130b Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ListServersNegativeTestJSON-1128649595 Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/215c4dead77c4db19551a0340cec130b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_215c4dead77c4db19551a0340cec130b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/215c4dead77c4db19551a0340cec130b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/215c4dead77c4db19551a0340cec130b"}]}] Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ListServersNegativeTestJSON-1128649595 Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 215c4dead77c4db19551a0340cec130b Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1128649595 Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ListServersNegativeTestJSON-1128649595-project Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 24ac5aa517704e599b7ebb22cae71ecd Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ListServersNegativeTestJSON-1128649595-project Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8 could not be found. Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'd0aeddad-4023-4fa8-bf2c-d6549fdf8fb8'} Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8 could not be found. Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:58:19.635474 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:19.640675 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8 could not be found. Aug 04 16:58:19.640675 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:19.640675 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:19.640675 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:19.640675 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:19.640675 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:19.640675 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:19.640675 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:19.640675 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:19.640675 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8 could not be found. Aug 04 16:58:19.640675 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:19.640675 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-250615e8-83c1-4156-a967-a2c6ba1142a2 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Returning 404 to user: Instance d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:19.640675 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-250615e8-83c1-4156-a967-a2c6ba1142a2 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8" status: 404 len: 111 microversion: 2.1 time: 0.090105 Aug 04 16:58:19.640675 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2064/4192] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:58:19 2022] DELETE /compute/v2.1/servers/d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:58:19.648709 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ee199c73-7141-4bb3-af7c-51cc243e8960 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-222582249", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b5e40019-250e-43d9-8f31-7dbc366e4c24"}], "security_groups": [{"name": "tempest-securitygroup--107022467"}], "key_name": "tempest-keypair-2017448656", "user_data": "}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:20.148851 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-ee199c73-7141-4bb3-af7c-51cc243e8960 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] validate_networks() for [('b5e40019-250e-43d9-8f31-7dbc366e4c24', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:58:20.471101 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-45901e4a-ed24-4ef9-a72d-91f47060ca71 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:20.483126 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-45901e4a-ed24-4ef9-a72d-91f47060ca71 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1308 microversion: 2.1 time: 1.170961 Aug 04 16:58:20.483987 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2129/4193] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:19 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1308 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:58:20.502089 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1414ff96-ef60-410f-8706-16fdbd56e813 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:20.502881 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1414ff96-ef60-410f-8706-16fdbd56e813 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] [instance: ddddc764-2d86-4950-849a-7da51eaf37c6] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:20.517008 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1414ff96-ef60-410f-8706-16fdbd56e813 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:20.517762 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1414ff96-ef60-410f-8706-16fdbd56e813 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:20.518750 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1414ff96-ef60-410f-8706-16fdbd56e813 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:20.519191 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1414ff96-ef60-410f-8706-16fdbd56e813 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:20.557842 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1414ff96-ef60-410f-8706-16fdbd56e813 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] [instance: ddddc764-2d86-4950-849a-7da51eaf37c6] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:58:20.721304 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1414ff96-ef60-410f-8706-16fdbd56e813 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ddddc764-2d86-4950-849a-7da51eaf37c6" status: 204 len: 0 microversion: 2.1 time: 0.235318 Aug 04 16:58:20.722656 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2130/4194] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:58:20 2022] DELETE /compute/v2.1/servers/ddddc764-2d86-4950-849a-7da51eaf37c6 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:58:20.736513 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ba6165d3-89db-404b-b600-c47cb2d685bd tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:20.738013 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ba6165d3-89db-404b-b600-c47cb2d685bd tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] [instance: e6db45a6-8552-48d5-b89f-08f706f51320] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:20.754705 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba6165d3-89db-404b-b600-c47cb2d685bd tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:20.755480 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba6165d3-89db-404b-b600-c47cb2d685bd tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:20.758325 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba6165d3-89db-404b-b600-c47cb2d685bd tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:20.758942 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba6165d3-89db-404b-b600-c47cb2d685bd tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:21.133629 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ba6165d3-89db-404b-b600-c47cb2d685bd tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccc05e487794576a1a4ecd820fd6af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b318eefcfdf344e1b97d6a81c93e73f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:21.142673 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ba6165d3-89db-404b-b600-c47cb2d685bd tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] 10.222.0.23 "GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320" status: 200 len: 1324 microversion: 2.1 time: 0.418425 Aug 04 16:58:21.143528 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2131/4195] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:20 2022] GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320 => generated 1324 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:21.172820 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0394e1ca-8ac9-4518-baf6-a94a72d877c0 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:21.175192 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0394e1ca-8ac9-4518-baf6-a94a72d877c0 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: e27ae6f5-5037-4714-b781-224113fa0859] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:21.182907 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0394e1ca-8ac9-4518-baf6-a94a72d877c0 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:21.183648 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0394e1ca-8ac9-4518-baf6-a94a72d877c0 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:21.184779 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0394e1ca-8ac9-4518-baf6-a94a72d877c0 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:21.185435 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0394e1ca-8ac9-4518-baf6-a94a72d877c0 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:21.749394 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-ee199c73-7141-4bb3-af7c-51cc243e8960 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:58:21.750858 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-ee199c73-7141-4bb3-af7c-51cc243e8960 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:58:21.752310 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-ee199c73-7141-4bb3-af7c-51cc243e8960 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:58:21.752691 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-ee199c73-7141-4bb3-af7c-51cc243e8960 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:58:21.753446 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-ee199c73-7141-4bb3-af7c-51cc243e8960 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:58:21.766931 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ee199c73-7141-4bb3-af7c-51cc243e8960 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:21.767379 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ee199c73-7141-4bb3-af7c-51cc243e8960 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:21.768321 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ee199c73-7141-4bb3-af7c-51cc243e8960 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:21.768999 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ee199c73-7141-4bb3-af7c-51cc243e8960 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:21.789237 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-ee199c73-7141-4bb3-af7c-51cc243e8960 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Getting quotas for project 470aa7b0a4464f9789d315176c4b7bc6. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:58:21.797302 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-ee199c73-7141-4bb3-af7c-51cc243e8960 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Getting quotas for user 6700990d94334afcac9adff62009d099 and project 470aa7b0a4464f9789d315176c4b7bc6. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:58:21.798433 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0394e1ca-8ac9-4518-baf6-a94a72d877c0 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:21.811868 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0394e1ca-8ac9-4518-baf6-a94a72d877c0 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859" status: 200 len: 1368 microversion: 2.1 time: 0.656418 Aug 04 16:58:21.813172 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2132/4196] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:21 2022] GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859 => generated 1368 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:21.813789 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ee199c73-7141-4bb3-af7c-51cc243e8960 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:58:21.816159 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ee199c73-7141-4bb3-af7c-51cc243e8960 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:58:21.819736 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a4c35902-cdbe-4549-b726-aa8ec8d6167f tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:21.820481 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a4c35902-cdbe-4549-b726-aa8ec8d6167f tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] [instance: 32ad59ea-210c-4726-af7f-669fedaef542] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:21.827995 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a4c35902-cdbe-4549-b726-aa8ec8d6167f tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:21.828699 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a4c35902-cdbe-4549-b726-aa8ec8d6167f tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:21.829700 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a4c35902-cdbe-4549-b726-aa8ec8d6167f tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:21.830283 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a4c35902-cdbe-4549-b726-aa8ec8d6167f tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:21.863620 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a4c35902-cdbe-4549-b726-aa8ec8d6167f tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] [instance: 32ad59ea-210c-4726-af7f-669fedaef542] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:58:21.899832 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ee199c73-7141-4bb3-af7c-51cc243e8960 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.260332 Aug 04 16:58:21.908353 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2065/4197] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Aug 4 16:58:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 2269 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 16:58:21.914442 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-26dd3ac6-817c-4970-8f79-1c80602c345e tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1635157498", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:21.941071 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:22.004085 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a4c35902-cdbe-4549-b726-aa8ec8d6167f tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "DELETE /compute/v2.1/servers/32ad59ea-210c-4726-af7f-669fedaef542" status: 204 len: 0 microversion: 2.1 time: 0.188926 Aug 04 16:58:22.008185 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2133/4198] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:58:21 2022] DELETE /compute/v2.1/servers/32ad59ea-210c-4726-af7f-669fedaef542 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:58:22.012810 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e61573dd-610b-4ab1-9e5d-372004ba5538 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:22.013644 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e61573dd-610b-4ab1-9e5d-372004ba5538 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:22.022469 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e61573dd-610b-4ab1-9e5d-372004ba5538 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:22.022981 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e61573dd-610b-4ab1-9e5d-372004ba5538 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:22.023845 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e61573dd-610b-4ab1-9e5d-372004ba5538 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:22.024958 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e61573dd-610b-4ab1-9e5d-372004ba5538 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:22.028524 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-26dd3ac6-817c-4970-8f79-1c80602c345e tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] validate_networks() for None {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:58:22.335873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e61573dd-610b-4ab1-9e5d-372004ba5538 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:22.346834 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e61573dd-610b-4ab1-9e5d-372004ba5538 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1489 microversion: 2.1 time: 0.340013 Aug 04 16:58:22.367240 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2134/4199] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:22 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1489 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:22.373022 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-a8008d53-7869-4937-8ce3-3fd097d47277 req-6ef47313-cf82-44c1-89e5-5511a63f8652 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6db45a6-8552-48d5-b89f-08f706f51320", "tag": "7819fa2c-a3cb-4c0e-a913-ca15d09393ce"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:22.383370 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-a8008d53-7869-4937-8ce3-3fd097d47277 req-6ef47313-cf82-44c1-89e5-5511a63f8652 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:22.383804 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-a8008d53-7869-4937-8ce3-3fd097d47277 req-6ef47313-cf82-44c1-89e5-5511a63f8652 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:22.397890 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-a8008d53-7869-4937-8ce3-3fd097d47277 req-6ef47313-cf82-44c1-89e5-5511a63f8652 service nova] Creating event network-changed:7819fa2c-a3cb-4c0e-a913-ca15d09393ce for instance e6db45a6-8552-48d5-b89f-08f706f51320 on n-h2-846466-12 Aug 04 16:58:22.403784 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-a8008d53-7869-4937-8ce3-3fd097d47277 req-6ef47313-cf82-44c1-89e5-5511a63f8652 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035133 Aug 04 16:58:22.404520 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2135/4200] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:22.418473 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0007ec5b-aae4-49d8-91ca-0406019cbf6c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:22.419494 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0007ec5b-aae4-49d8-91ca-0406019cbf6c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:22.421672 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:22.514286 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-26dd3ac6-817c-4970-8f79-1c80602c345e tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:58:22.515604 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-26dd3ac6-817c-4970-8f79-1c80602c345e tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:58:22.516211 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-26dd3ac6-817c-4970-8f79-1c80602c345e tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:58:22.517671 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-26dd3ac6-817c-4970-8f79-1c80602c345e tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:58:22.518230 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-26dd3ac6-817c-4970-8f79-1c80602c345e tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:58:22.529994 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0007ec5b-aae4-49d8-91ca-0406019cbf6c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:22.530528 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-26dd3ac6-817c-4970-8f79-1c80602c345e tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:22.530985 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-26dd3ac6-817c-4970-8f79-1c80602c345e tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:22.532149 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-26dd3ac6-817c-4970-8f79-1c80602c345e tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:22.532958 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-26dd3ac6-817c-4970-8f79-1c80602c345e tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:22.539325 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0007ec5b-aae4-49d8-91ca-0406019cbf6c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:22.540914 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0007ec5b-aae4-49d8-91ca-0406019cbf6c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:22.542309 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0007ec5b-aae4-49d8-91ca-0406019cbf6c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1281 microversion: 2.20 time: 0.136714 Aug 04 16:58:22.543031 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2136/4201] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:22 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1281 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:22.547811 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c21a2657-a18f-4a52-a9d4-fa224dfc9119 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:22.548410 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c21a2657-a18f-4a52-a9d4-fa224dfc9119 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] [instance: d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:22.554764 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c21a2657-a18f-4a52-a9d4-fa224dfc9119 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:22.555199 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c21a2657-a18f-4a52-a9d4-fa224dfc9119 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:22.555952 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c21a2657-a18f-4a52-a9d4-fa224dfc9119 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:22.556375 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c21a2657-a18f-4a52-a9d4-fa224dfc9119 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:22.572584 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-c21a2657-a18f-4a52-a9d4-fa224dfc9119 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] HTTP exception thrown: Instance d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8 could not be found. Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c21a2657-a18f-4a52-a9d4-fa224dfc9119 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Request method failure captured: Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8 HTTP/1.1 Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_p8SsPlMe9Z0iyvVdhOjwPBAHZvL7JYQib57kezdlyIV0g3IXtexx1pwuxQqINiSQ6spgUeqsWFTaAusYYW5ZQZhCznQ2xreBwaw_rY9yB8jcaPh_4nbbHD1uUqP4h_tFkD-66SVVKFVbSzGtuEzm6HUxscvH99jvqge8uzxNte9G8 Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 215c4dead77c4db19551a0340cec130b Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ListServersNegativeTestJSON-1128649595 Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/215c4dead77c4db19551a0340cec130b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_215c4dead77c4db19551a0340cec130b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/215c4dead77c4db19551a0340cec130b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/215c4dead77c4db19551a0340cec130b"}]}] Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ListServersNegativeTestJSON-1128649595 Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 215c4dead77c4db19551a0340cec130b Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1128649595 Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ListServersNegativeTestJSON-1128649595-project Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 24ac5aa517704e599b7ebb22cae71ecd Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ListServersNegativeTestJSON-1128649595-project Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8 could not be found. Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'd0aeddad-4023-4fa8-bf2c-d6549fdf8fb8'} Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8 could not be found. Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8 could not be found. Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:22.574295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:22.578578 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:22.578578 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:22.578578 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:22.578578 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:22.578578 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:22.578578 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:22.578578 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8 could not be found. Aug 04 16:58:22.578578 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:22.579256 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-26dd3ac6-817c-4970-8f79-1c80602c345e tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Getting quotas for project 27fd156c09a24dc5bdb7e8897890b157. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:58:22.580158 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c21a2657-a18f-4a52-a9d4-fa224dfc9119 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Returning 404 to user: Instance d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:22.580158 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c21a2657-a18f-4a52-a9d4-fa224dfc9119 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers/d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8" status: 404 len: 111 microversion: 2.1 time: 0.031699 Aug 04 16:58:22.580158 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2137/4202] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:22 2022] GET /compute/v2.1/servers/d0aeddad-4023-4fa8-bf2c-d6549fdf8fb8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:58:22.588963 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a2d75c50-eb23-41ad-ab51-23618c2bba80 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:22.589687 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a2d75c50-eb23-41ad-ab51-23618c2bba80 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] [instance: e6db45a6-8552-48d5-b89f-08f706f51320] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:22.595380 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-26dd3ac6-817c-4970-8f79-1c80602c345e tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Getting quotas for user 689e7547be3c4c76beeeff391336e1f1 and project 27fd156c09a24dc5bdb7e8897890b157. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:58:22.597318 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a2d75c50-eb23-41ad-ab51-23618c2bba80 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:22.597836 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a2d75c50-eb23-41ad-ab51-23618c2bba80 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:22.598804 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a2d75c50-eb23-41ad-ab51-23618c2bba80 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:22.599297 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a2d75c50-eb23-41ad-ab51-23618c2bba80 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:22.612397 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-26dd3ac6-817c-4970-8f79-1c80602c345e tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:58:22.615047 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-26dd3ac6-817c-4970-8f79-1c80602c345e tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] [instance: e2ca7015-c972-40a6-bca5-2b1c1e56dcb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:58:22.663683 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-26dd3ac6-817c-4970-8f79-1c80602c345e tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.754096 Aug 04 16:58:22.664624 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2066/4203] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:58:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:58:22.669816 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d50d4810-1011-42b5-874e-c12dc8b94163 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-641865962"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:22.672591 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d50d4810-1011-42b5-874e-c12dc8b94163 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:22.679973 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d50d4810-1011-42b5-874e-c12dc8b94163 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:22.680681 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d50d4810-1011-42b5-874e-c12dc8b94163 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:22.681625 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d50d4810-1011-42b5-874e-c12dc8b94163 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:22.682229 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d50d4810-1011-42b5-874e-c12dc8b94163 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:22.783281 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a2d75c50-eb23-41ad-ab51-23618c2bba80 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccc05e487794576a1a4ecd820fd6af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b318eefcfdf344e1b97d6a81c93e73f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:22.785895 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d50d4810-1011-42b5-874e-c12dc8b94163 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "PUT /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1074 microversion: 2.1 time: 0.119982 Aug 04 16:58:22.792361 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2067/4204] 10.222.0.23 () {60 vars in 1256 bytes} [Thu Aug 4 16:58:22 2022] PUT /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1074 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:22.795413 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a2d75c50-eb23-41ad-ab51-23618c2bba80 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] 10.222.0.23 "GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320" status: 200 len: 1324 microversion: 2.1 time: 0.213848 Aug 04 16:58:22.796157 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2138/4205] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:22 2022] GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320 => generated 1324 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:22.802832 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9652e433-323d-4b58-a6f3-b4360cdd6810 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:22.803400 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-292d6cb6-c3cf-42c0-b58a-59505f3a750f tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:22.803783 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-292d6cb6-c3cf-42c0-b58a-59505f3a750f tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] [instance: ddddc764-2d86-4950-849a-7da51eaf37c6] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:22.804427 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9652e433-323d-4b58-a6f3-b4360cdd6810 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] [instance: e2ca7015-c972-40a6-bca5-2b1c1e56dcb1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:22.811966 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-292d6cb6-c3cf-42c0-b58a-59505f3a750f tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:22.812418 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-292d6cb6-c3cf-42c0-b58a-59505f3a750f tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:22.813550 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-292d6cb6-c3cf-42c0-b58a-59505f3a750f tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:22.813984 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-292d6cb6-c3cf-42c0-b58a-59505f3a750f tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:22.869831 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9652e433-323d-4b58-a6f3-b4360cdd6810 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689e7547be3c4c76beeeff391336e1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fd156c09a24dc5bdb7e8897890b157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:22.881801 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9652e433-323d-4b58-a6f3-b4360cdd6810 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] 10.222.0.23 "GET /compute/v2.1/servers/e2ca7015-c972-40a6-bca5-2b1c1e56dcb1" status: 200 len: 1215 microversion: 2.1 time: 0.084364 Aug 04 16:58:22.882378 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2139/4206] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:22 2022] GET /compute/v2.1/servers/e2ca7015-c972-40a6-bca5-2b1c1e56dcb1 => generated 1215 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:22.890513 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3a874554-c3ea-421a-9930-387b390ecd23 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:22.890513 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3a874554-c3ea-421a-9930-387b390ecd23 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:22.894812 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3a874554-c3ea-421a-9930-387b390ecd23 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:22.895255 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3a874554-c3ea-421a-9930-387b390ecd23 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:22.896013 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3a874554-c3ea-421a-9930-387b390ecd23 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:22.896460 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3a874554-c3ea-421a-9930-387b390ecd23 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:23.071324 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-292d6cb6-c3cf-42c0-b58a-59505f3a750f tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ac5aa517704e599b7ebb22cae71ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215c4dead77c4db19551a0340cec130b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:23.086891 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-292d6cb6-c3cf-42c0-b58a-59505f3a750f tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers/ddddc764-2d86-4950-849a-7da51eaf37c6" status: 200 len: 1522 microversion: 2.1 time: 0.293467 Aug 04 16:58:23.087479 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2068/4207] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:22 2022] GET /compute/v2.1/servers/ddddc764-2d86-4950-849a-7da51eaf37c6 => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:23.113101 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-65b66edc-8898-4903-a3ff-ba72a64356a8 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:23.114501 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-65b66edc-8898-4903-a3ff-ba72a64356a8 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: e27ae6f5-5037-4714-b781-224113fa0859] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:23.133910 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65b66edc-8898-4903-a3ff-ba72a64356a8 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:23.134993 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65b66edc-8898-4903-a3ff-ba72a64356a8 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:23.135900 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65b66edc-8898-4903-a3ff-ba72a64356a8 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:23.136357 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65b66edc-8898-4903-a3ff-ba72a64356a8 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:23.177692 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3a874554-c3ea-421a-9930-387b390ecd23 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:23.189392 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3a874554-c3ea-421a-9930-387b390ecd23 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1500 microversion: 2.1 time: 0.305646 Aug 04 16:58:23.189958 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2140/4208] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:22 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1500 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:23.209630 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-35116d5a-1179-44e7-a1c3-a23ce0c09ca9 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:23.210589 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-35116d5a-1179-44e7-a1c3-a23ce0c09ca9 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:23.219618 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-35116d5a-1179-44e7-a1c3-a23ce0c09ca9 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:23.220428 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-35116d5a-1179-44e7-a1c3-a23ce0c09ca9 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:23.221587 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-35116d5a-1179-44e7-a1c3-a23ce0c09ca9 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:23.222176 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-35116d5a-1179-44e7-a1c3-a23ce0c09ca9 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:23.714258 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-65b66edc-8898-4903-a3ff-ba72a64356a8 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:23.728715 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-65b66edc-8898-4903-a3ff-ba72a64356a8 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859" status: 200 len: 1368 microversion: 2.1 time: 0.632826 Aug 04 16:58:23.729476 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2069/4209] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:23 2022] GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859 => generated 1368 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:23.736138 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f789c08e-84cb-45e5-8609-2d10e7fe0e6e tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:23.736860 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f789c08e-84cb-45e5-8609-2d10e7fe0e6e tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:23.743974 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f789c08e-84cb-45e5-8609-2d10e7fe0e6e tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:23.745475 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f789c08e-84cb-45e5-8609-2d10e7fe0e6e tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:23.746487 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f789c08e-84cb-45e5-8609-2d10e7fe0e6e tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:23.747246 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f789c08e-84cb-45e5-8609-2d10e7fe0e6e tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:23.747459 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-35116d5a-1179-44e7-a1c3-a23ce0c09ca9 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:23.756510 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-35116d5a-1179-44e7-a1c3-a23ce0c09ca9 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1500 microversion: 2.1 time: 0.550776 Aug 04 16:58:23.777723 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2141/4210] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:23 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1500 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:58:23.793823 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9d5401fa-175c-4060-834e-29ecd51a8d61 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:23.815617 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9d5401fa-175c-4060-834e-29ecd51a8d61 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:23.816324 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9d5401fa-175c-4060-834e-29ecd51a8d61 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:23.882086 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9d5401fa-175c-4060-834e-29ecd51a8d61 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Going to try to stop instance {{(pid=126125) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 16:58:23.974381 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9d5401fa-175c-4060-834e-29ecd51a8d61 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "POST /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8/action" status: 202 len: 0 microversion: 2.1 time: 0.194866 Aug 04 16:58:23.980200 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2142/4211] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:58:23 2022] POST /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:58:23.986112 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ae7a82a7-3142-4e9b-8584-82c368f0fe64 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:23.988823 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ae7a82a7-3142-4e9b-8584-82c368f0fe64 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] [instance: e6db45a6-8552-48d5-b89f-08f706f51320] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:24.001043 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ae7a82a7-3142-4e9b-8584-82c368f0fe64 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:24.001758 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ae7a82a7-3142-4e9b-8584-82c368f0fe64 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:24.003435 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ae7a82a7-3142-4e9b-8584-82c368f0fe64 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:24.004115 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ae7a82a7-3142-4e9b-8584-82c368f0fe64 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:24.027432 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f789c08e-84cb-45e5-8609-2d10e7fe0e6e tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:24.038666 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f789c08e-84cb-45e5-8609-2d10e7fe0e6e tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:24.042014 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f789c08e-84cb-45e5-8609-2d10e7fe0e6e tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:24.054461 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f789c08e-84cb-45e5-8609-2d10e7fe0e6e tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1333 microversion: 2.20 time: 0.313202 Aug 04 16:58:24.055224 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2070/4212] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:23 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1333 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:24.076256 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f45dbfdd-d405-40c6-ba77-217d798234ca tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:24.077174 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f45dbfdd-d405-40c6-ba77-217d798234ca tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] [instance: e2ca7015-c972-40a6-bca5-2b1c1e56dcb1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:24.087992 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f45dbfdd-d405-40c6-ba77-217d798234ca tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:24.088735 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f45dbfdd-d405-40c6-ba77-217d798234ca tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:24.089763 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f45dbfdd-d405-40c6-ba77-217d798234ca tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:24.090414 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f45dbfdd-d405-40c6-ba77-217d798234ca tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:24.379012 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f45dbfdd-d405-40c6-ba77-217d798234ca tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689e7547be3c4c76beeeff391336e1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fd156c09a24dc5bdb7e8897890b157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:24.392580 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f45dbfdd-d405-40c6-ba77-217d798234ca tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] 10.222.0.23 "GET /compute/v2.1/servers/e2ca7015-c972-40a6-bca5-2b1c1e56dcb1" status: 200 len: 1267 microversion: 2.1 time: 0.321472 Aug 04 16:58:24.393994 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2071/4213] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:24 2022] GET /compute/v2.1/servers/e2ca7015-c972-40a6-bca5-2b1c1e56dcb1 => generated 1267 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:24.412006 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9bcd491b-f479-4401-9c59-dda8cc10b7ec tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:24.412878 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9bcd491b-f479-4401-9c59-dda8cc10b7ec tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:24.430117 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9bcd491b-f479-4401-9c59-dda8cc10b7ec tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:24.430987 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9bcd491b-f479-4401-9c59-dda8cc10b7ec tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:24.432294 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9bcd491b-f479-4401-9c59-dda8cc10b7ec tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:24.432954 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9bcd491b-f479-4401-9c59-dda8cc10b7ec tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:24.480014 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:24.766873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ae7a82a7-3142-4e9b-8584-82c368f0fe64 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccc05e487794576a1a4ecd820fd6af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b318eefcfdf344e1b97d6a81c93e73f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:24.780021 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ae7a82a7-3142-4e9b-8584-82c368f0fe64 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] 10.222.0.23 "GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320" status: 200 len: 1324 microversion: 2.1 time: 0.800342 Aug 04 16:58:24.780535 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2143/4214] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:23 2022] GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320 => generated 1324 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:24.793868 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-42bfc63c-4b24-42dc-b796-74cd21fd8948 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:24.796326 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-42bfc63c-4b24-42dc-b796-74cd21fd8948 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] [instance: ddddc764-2d86-4950-849a-7da51eaf37c6] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:24.820700 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-42bfc63c-4b24-42dc-b796-74cd21fd8948 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:24.825738 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-42bfc63c-4b24-42dc-b796-74cd21fd8948 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:24.827168 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-42bfc63c-4b24-42dc-b796-74cd21fd8948 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:24.827768 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-42bfc63c-4b24-42dc-b796-74cd21fd8948 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:25.373021 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9bcd491b-f479-4401-9c59-dda8cc10b7ec tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:25.383381 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9bcd491b-f479-4401-9c59-dda8cc10b7ec tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1510 microversion: 2.1 time: 0.984118 Aug 04 16:58:25.384437 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2072/4215] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:24 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1510 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:25.391697 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-e44c5271-0ec4-4793-8f65-d1e6f1d6c339 req-020fd300-1f75-4d47-9722-e23393fe7313 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32ad59ea-210c-4726-af7f-669fedaef542", "name": "network-vif-deleted", "tag": "55138bec-fad1-4ed9-9165-1fc62358e3a4"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:25.421874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-e44c5271-0ec4-4793-8f65-d1e6f1d6c339 req-020fd300-1f75-4d47-9722-e23393fe7313 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:25.422307 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-e44c5271-0ec4-4793-8f65-d1e6f1d6c339 req-020fd300-1f75-4d47-9722-e23393fe7313 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:25.435844 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-e44c5271-0ec4-4793-8f65-d1e6f1d6c339 req-020fd300-1f75-4d47-9722-e23393fe7313 service nova] Creating event network-vif-deleted:55138bec-fad1-4ed9-9165-1fc62358e3a4 for instance 32ad59ea-210c-4726-af7f-669fedaef542 on n-h2-846466-12 Aug 04 16:58:25.442283 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-e44c5271-0ec4-4793-8f65-d1e6f1d6c339 req-020fd300-1f75-4d47-9722-e23393fe7313 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055374 Aug 04 16:58:25.443492 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2073/4216] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:25.449497 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-db487b27-4d47-4b07-bede-969dccf503e3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:25.450501 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-db487b27-4d47-4b07-bede-969dccf503e3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: e27ae6f5-5037-4714-b781-224113fa0859] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:25.458164 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db487b27-4d47-4b07-bede-969dccf503e3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:25.458819 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db487b27-4d47-4b07-bede-969dccf503e3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:25.459869 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db487b27-4d47-4b07-bede-969dccf503e3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:25.460462 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db487b27-4d47-4b07-bede-969dccf503e3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:26.012398 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-42bfc63c-4b24-42dc-b796-74cd21fd8948 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ac5aa517704e599b7ebb22cae71ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215c4dead77c4db19551a0340cec130b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:26.026316 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-42bfc63c-4b24-42dc-b796-74cd21fd8948 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers/ddddc764-2d86-4950-849a-7da51eaf37c6" status: 200 len: 1522 microversion: 2.1 time: 1.243634 Aug 04 16:58:26.027863 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2144/4217] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:24 2022] GET /compute/v2.1/servers/ddddc764-2d86-4950-849a-7da51eaf37c6 => generated 1522 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:26.037273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-beb5481c-2c71-4b2d-961c-ed16f3e3a4a5 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:26.037925 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-beb5481c-2c71-4b2d-961c-ed16f3e3a4a5 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:26.048455 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-beb5481c-2c71-4b2d-961c-ed16f3e3a4a5 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:26.049664 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-beb5481c-2c71-4b2d-961c-ed16f3e3a4a5 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:26.050467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-beb5481c-2c71-4b2d-961c-ed16f3e3a4a5 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:26.050973 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-beb5481c-2c71-4b2d-961c-ed16f3e3a4a5 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:26.487760 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-db487b27-4d47-4b07-bede-969dccf503e3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:26.496983 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-db487b27-4d47-4b07-bede-969dccf503e3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859" status: 200 len: 1368 microversion: 2.1 time: 1.052157 Aug 04 16:58:26.499023 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2074/4218] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:25 2022] GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859 => generated 1368 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:26.504089 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9f0e1aaf-124c-4e8c-b499-7eb90ac615a5 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:26.504896 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9f0e1aaf-124c-4e8c-b499-7eb90ac615a5 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] [instance: e2ca7015-c972-40a6-bca5-2b1c1e56dcb1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:26.512566 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f0e1aaf-124c-4e8c-b499-7eb90ac615a5 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:26.513245 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f0e1aaf-124c-4e8c-b499-7eb90ac615a5 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:26.514601 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f0e1aaf-124c-4e8c-b499-7eb90ac615a5 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:26.515195 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f0e1aaf-124c-4e8c-b499-7eb90ac615a5 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:26.771333 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-beb5481c-2c71-4b2d-961c-ed16f3e3a4a5 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:26.781914 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-beb5481c-2c71-4b2d-961c-ed16f3e3a4a5 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:26.789326 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-beb5481c-2c71-4b2d-961c-ed16f3e3a4a5 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:26.790643 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-beb5481c-2c71-4b2d-961c-ed16f3e3a4a5 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1406 microversion: 2.20 time: 0.761587 Aug 04 16:58:26.794916 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2145/4219] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:26 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1406 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:26.810722 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-34f231a6-122c-42d8-9c6e-103fbc17c2ac tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:26.811816 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-34f231a6-122c-42d8-9c6e-103fbc17c2ac tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] [instance: e6db45a6-8552-48d5-b89f-08f706f51320] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:26.820772 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-34f231a6-122c-42d8-9c6e-103fbc17c2ac tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:26.833432 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-34f231a6-122c-42d8-9c6e-103fbc17c2ac tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:26.834513 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-34f231a6-122c-42d8-9c6e-103fbc17c2ac tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:26.835151 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-34f231a6-122c-42d8-9c6e-103fbc17c2ac tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:27.083474 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9f0e1aaf-124c-4e8c-b499-7eb90ac615a5 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689e7547be3c4c76beeeff391336e1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fd156c09a24dc5bdb7e8897890b157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:27.093120 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9f0e1aaf-124c-4e8c-b499-7eb90ac615a5 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] 10.222.0.23 "GET /compute/v2.1/servers/e2ca7015-c972-40a6-bca5-2b1c1e56dcb1" status: 200 len: 1315 microversion: 2.1 time: 0.592858 Aug 04 16:58:27.094101 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2075/4220] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:26 2022] GET /compute/v2.1/servers/e2ca7015-c972-40a6-bca5-2b1c1e56dcb1 => generated 1315 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:27.098929 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-1ff3ce30-2f48-470f-aa93-7cb5cd351ef9 req-5b43dbc6-0201-4114-b611-9106f11f4843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddddc764-2d86-4950-849a-7da51eaf37c6", "name": "network-vif-deleted", "tag": "03e294e6-b45d-4cbf-be07-efbfbe5f603f"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:27.111433 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-1ff3ce30-2f48-470f-aa93-7cb5cd351ef9 req-5b43dbc6-0201-4114-b611-9106f11f4843 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:27.111938 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-1ff3ce30-2f48-470f-aa93-7cb5cd351ef9 req-5b43dbc6-0201-4114-b611-9106f11f4843 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:27.126628 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-1ff3ce30-2f48-470f-aa93-7cb5cd351ef9 req-5b43dbc6-0201-4114-b611-9106f11f4843 service nova] Creating event network-vif-deleted:03e294e6-b45d-4cbf-be07-efbfbe5f603f for instance ddddc764-2d86-4950-849a-7da51eaf37c6 on n-h1-846466-12 Aug 04 16:58:27.132497 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-1ff3ce30-2f48-470f-aa93-7cb5cd351ef9 req-5b43dbc6-0201-4114-b611-9106f11f4843 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036700 Aug 04 16:58:27.134278 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2076/4221] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:27.143156 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9d9baf71-715d-45fe-989b-6133336cb4ab tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:27.144145 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9d9baf71-715d-45fe-989b-6133336cb4ab tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:27.154672 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-34f231a6-122c-42d8-9c6e-103fbc17c2ac tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccc05e487794576a1a4ecd820fd6af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b318eefcfdf344e1b97d6a81c93e73f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:27.165532 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d9baf71-715d-45fe-989b-6133336cb4ab tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:27.167360 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d9baf71-715d-45fe-989b-6133336cb4ab tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:27.169668 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-34f231a6-122c-42d8-9c6e-103fbc17c2ac tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] 10.222.0.23 "GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320" status: 200 len: 1324 microversion: 2.1 time: 0.372384 Aug 04 16:58:27.170453 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d9baf71-715d-45fe-989b-6133336cb4ab tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:27.171035 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d9baf71-715d-45fe-989b-6133336cb4ab tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:27.173707 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2146/4222] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:26 2022] GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320 => generated 1324 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:27.182732 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-144b09de-27f5-436e-9db0-870632996db9 req-f5cf7880-2e1f-49e8-8c5f-5bb60a362418 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e27ae6f5-5037-4714-b781-224113fa0859", "name": "network-vif-plugged", "status": "completed", "tag": "9fc22e1a-6c76-4ae5-ac92-4c33d8d04605"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:27.207496 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-144b09de-27f5-436e-9db0-870632996db9 req-f5cf7880-2e1f-49e8-8c5f-5bb60a362418 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:27.207933 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-144b09de-27f5-436e-9db0-870632996db9 req-f5cf7880-2e1f-49e8-8c5f-5bb60a362418 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:27.226057 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-144b09de-27f5-436e-9db0-870632996db9 req-f5cf7880-2e1f-49e8-8c5f-5bb60a362418 service nova] Creating event network-vif-plugged:9fc22e1a-6c76-4ae5-ac92-4c33d8d04605 for instance e27ae6f5-5037-4714-b781-224113fa0859 on n-h1-846466-12 Aug 04 16:58:27.244066 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-144b09de-27f5-436e-9db0-870632996db9 req-f5cf7880-2e1f-49e8-8c5f-5bb60a362418 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065948 Aug 04 16:58:27.244882 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2147/4223] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:27.274207 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1ff83dd7-8997-4900-a540-a9542cb4dee2 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:27.280249 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1ff83dd7-8997-4900-a540-a9542cb4dee2 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] [instance: ddddc764-2d86-4950-849a-7da51eaf37c6] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:27.294440 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1ff83dd7-8997-4900-a540-a9542cb4dee2 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:27.298114 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1ff83dd7-8997-4900-a540-a9542cb4dee2 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:27.299008 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1ff83dd7-8997-4900-a540-a9542cb4dee2 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:27.299545 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1ff83dd7-8997-4900-a540-a9542cb4dee2 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:27.337455 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-1ff83dd7-8997-4900-a540-a9542cb4dee2 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] HTTP exception thrown: Instance ddddc764-2d86-4950-849a-7da51eaf37c6 could not be found. Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1ff83dd7-8997-4900-a540-a9542cb4dee2 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Request method failure captured: Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/ddddc764-2d86-4950-849a-7da51eaf37c6 HTTP/1.1 Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_p8SsPlMe9Z0iyvVdhOjwPBAHZvL7JYQib57kezdlyIV0g3IXtexx1pwuxQqINiSQ6spgUeqsWFTaAusYYW5ZQZhCznQ2xreBwaw_rY9yB8jcaPh_4nbbHD1uUqP4h_tFkD-66SVVKFVbSzGtuEzm6HUxscvH99jvqge8uzxNte9G8 Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 215c4dead77c4db19551a0340cec130b Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ListServersNegativeTestJSON-1128649595 Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/215c4dead77c4db19551a0340cec130b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_215c4dead77c4db19551a0340cec130b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/215c4dead77c4db19551a0340cec130b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/215c4dead77c4db19551a0340cec130b"}]}] Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ListServersNegativeTestJSON-1128649595 Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 215c4dead77c4db19551a0340cec130b Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1128649595 Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ListServersNegativeTestJSON-1128649595-project Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 24ac5aa517704e599b7ebb22cae71ecd Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ListServersNegativeTestJSON-1128649595-project Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance ddddc764-2d86-4950-849a-7da51eaf37c6 could not be found. Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'ddddc764-2d86-4950-849a-7da51eaf37c6'} Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddddc764-2d86-4950-849a-7da51eaf37c6 could not be found. Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddddc764-2d86-4950-849a-7da51eaf37c6 could not be found. Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:27.339486 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:27.344716 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:27.344716 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:27.344716 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:27.344716 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:27.344716 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:27.344716 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:27.344716 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddddc764-2d86-4950-849a-7da51eaf37c6 could not be found. Aug 04 16:58:27.344716 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:27.344716 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1ff83dd7-8997-4900-a540-a9542cb4dee2 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Returning 404 to user: Instance ddddc764-2d86-4950-849a-7da51eaf37c6 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:27.344716 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1ff83dd7-8997-4900-a540-a9542cb4dee2 tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers/ddddc764-2d86-4950-849a-7da51eaf37c6" status: 404 len: 111 microversion: 2.1 time: 0.081349 Aug 04 16:58:27.344716 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2148/4224] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:27 2022] GET /compute/v2.1/servers/ddddc764-2d86-4950-849a-7da51eaf37c6 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:58:27.352004 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5438c0eb-0fbe-4cd9-ab2c-b6f5e0e8805e tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:27.353058 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5438c0eb-0fbe-4cd9-ab2c-b6f5e0e8805e tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] [instance: 32ad59ea-210c-4726-af7f-669fedaef542] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:27.361726 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5438c0eb-0fbe-4cd9-ab2c-b6f5e0e8805e tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:27.362927 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5438c0eb-0fbe-4cd9-ab2c-b6f5e0e8805e tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:27.363841 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5438c0eb-0fbe-4cd9-ab2c-b6f5e0e8805e tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:27.364371 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5438c0eb-0fbe-4cd9-ab2c-b6f5e0e8805e tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:27.381360 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-5438c0eb-0fbe-4cd9-ab2c-b6f5e0e8805e tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] HTTP exception thrown: Instance 32ad59ea-210c-4726-af7f-669fedaef542 could not be found. Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5438c0eb-0fbe-4cd9-ab2c-b6f5e0e8805e tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Request method failure captured: Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/32ad59ea-210c-4726-af7f-669fedaef542 HTTP/1.1 Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_p8SsPlMe9Z0iyvVdhOjwPBAHZvL7JYQib57kezdlyIV0g3IXtexx1pwuxQqINiSQ6spgUeqsWFTaAusYYW5ZQZhCznQ2xreBwaw_rY9yB8jcaPh_4nbbHD1uUqP4h_tFkD-66SVVKFVbSzGtuEzm6HUxscvH99jvqge8uzxNte9G8 Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 215c4dead77c4db19551a0340cec130b Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ListServersNegativeTestJSON-1128649595 Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/215c4dead77c4db19551a0340cec130b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_215c4dead77c4db19551a0340cec130b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/215c4dead77c4db19551a0340cec130b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/215c4dead77c4db19551a0340cec130b"}]}] Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ListServersNegativeTestJSON-1128649595 Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 215c4dead77c4db19551a0340cec130b Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1128649595 Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ListServersNegativeTestJSON-1128649595-project Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 24ac5aa517704e599b7ebb22cae71ecd Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ListServersNegativeTestJSON-1128649595-project Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 32ad59ea-210c-4726-af7f-669fedaef542 could not be found. Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '32ad59ea-210c-4726-af7f-669fedaef542'} Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32ad59ea-210c-4726-af7f-669fedaef542 could not be found. Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32ad59ea-210c-4726-af7f-669fedaef542 could not be found. Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:27.382880 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:27.387887 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:27.387887 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:27.387887 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:27.387887 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:27.387887 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:27.387887 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:27.387887 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32ad59ea-210c-4726-af7f-669fedaef542 could not be found. Aug 04 16:58:27.387887 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:27.389841 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5438c0eb-0fbe-4cd9-ab2c-b6f5e0e8805e tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] Returning 404 to user: Instance 32ad59ea-210c-4726-af7f-669fedaef542 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:27.390804 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5438c0eb-0fbe-4cd9-ab2c-b6f5e0e8805e tempest-ListServersNegativeTestJSON-1128649595 tempest-ListServersNegativeTestJSON-1128649595-project] 10.222.0.23 "GET /compute/v2.1/servers/32ad59ea-210c-4726-af7f-669fedaef542" status: 404 len: 111 microversion: 2.1 time: 0.043872 Aug 04 16:58:27.393122 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2149/4225] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:27 2022] GET /compute/v2.1/servers/32ad59ea-210c-4726-af7f-669fedaef542 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:58:27.519264 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c75599e0-4000-41ce-add4-8ca14f2e83b2 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:27.520180 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c75599e0-4000-41ce-add4-8ca14f2e83b2 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: e27ae6f5-5037-4714-b781-224113fa0859] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:27.526693 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c75599e0-4000-41ce-add4-8ca14f2e83b2 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:27.527423 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c75599e0-4000-41ce-add4-8ca14f2e83b2 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:27.528497 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c75599e0-4000-41ce-add4-8ca14f2e83b2 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:27.529131 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c75599e0-4000-41ce-add4-8ca14f2e83b2 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:27.771462 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9d9baf71-715d-45fe-989b-6133336cb4ab tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:27.790961 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9d9baf71-715d-45fe-989b-6133336cb4ab tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1510 microversion: 2.1 time: 0.655217 Aug 04 16:58:27.801342 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2077/4226] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:27 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1510 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:27.823991 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6a9680ce-40de-4a55-a801-cc8a08e4289d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:27.824699 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6a9680ce-40de-4a55-a801-cc8a08e4289d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:27.827612 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=91 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:27.836183 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a9680ce-40de-4a55-a801-cc8a08e4289d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:27.836969 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a9680ce-40de-4a55-a801-cc8a08e4289d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:27.838353 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a9680ce-40de-4a55-a801-cc8a08e4289d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:27.839673 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a9680ce-40de-4a55-a801-cc8a08e4289d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:28.070252 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c75599e0-4000-41ce-add4-8ca14f2e83b2 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:28.086291 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c75599e0-4000-41ce-add4-8ca14f2e83b2 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859" status: 200 len: 1368 microversion: 2.1 time: 0.570953 Aug 04 16:58:28.096222 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2150/4227] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:27 2022] GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859 => generated 1368 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:58:28.116218 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-632c1565-0ec3-4442-9298-572903642c13 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:28.116976 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-632c1565-0ec3-4442-9298-572903642c13 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] [instance: e2ca7015-c972-40a6-bca5-2b1c1e56dcb1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:28.124714 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-632c1565-0ec3-4442-9298-572903642c13 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:28.125709 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-632c1565-0ec3-4442-9298-572903642c13 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:28.126950 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-632c1565-0ec3-4442-9298-572903642c13 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:28.127599 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-632c1565-0ec3-4442-9298-572903642c13 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:28.254921 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6a9680ce-40de-4a55-a801-cc8a08e4289d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:28.298735 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6a9680ce-40de-4a55-a801-cc8a08e4289d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:28.306763 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6a9680ce-40de-4a55-a801-cc8a08e4289d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:28.309797 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6a9680ce-40de-4a55-a801-cc8a08e4289d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1406 microversion: 2.20 time: 0.491081 Aug 04 16:58:28.311001 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2078/4228] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:27 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1406 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:28.316740 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-435ab762-eb29-47b6-a002-26d2b5cd4a75 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:28.317716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-435ab762-eb29-47b6-a002-26d2b5cd4a75 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] [instance: e6db45a6-8552-48d5-b89f-08f706f51320] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:28.327902 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-435ab762-eb29-47b6-a002-26d2b5cd4a75 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:28.328850 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-435ab762-eb29-47b6-a002-26d2b5cd4a75 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:28.330132 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-435ab762-eb29-47b6-a002-26d2b5cd4a75 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:28.330766 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-435ab762-eb29-47b6-a002-26d2b5cd4a75 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:28.587398 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-632c1565-0ec3-4442-9298-572903642c13 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689e7547be3c4c76beeeff391336e1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fd156c09a24dc5bdb7e8897890b157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:28.607919 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-632c1565-0ec3-4442-9298-572903642c13 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] 10.222.0.23 "GET /compute/v2.1/servers/e2ca7015-c972-40a6-bca5-2b1c1e56dcb1" status: 200 len: 1315 microversion: 2.1 time: 0.495533 Aug 04 16:58:28.613976 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2151/4229] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:28 2022] GET /compute/v2.1/servers/e2ca7015-c972-40a6-bca5-2b1c1e56dcb1 => generated 1315 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:58:28.626109 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-1be45301-26e1-4116-b6a7-27307ffb25f5 req-48e01e3d-fe3d-4cb3-a47d-941e25674e78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2ca7015-c972-40a6-bca5-2b1c1e56dcb1", "tag": "598010eb-9ab0-4b4e-80ef-cda94c54294c"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:28.638664 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-1be45301-26e1-4116-b6a7-27307ffb25f5 req-48e01e3d-fe3d-4cb3-a47d-941e25674e78 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:28.639035 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-1be45301-26e1-4116-b6a7-27307ffb25f5 req-48e01e3d-fe3d-4cb3-a47d-941e25674e78 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:28.651312 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-1be45301-26e1-4116-b6a7-27307ffb25f5 req-48e01e3d-fe3d-4cb3-a47d-941e25674e78 service nova] Creating event network-changed:598010eb-9ab0-4b4e-80ef-cda94c54294c for instance e2ca7015-c972-40a6-bca5-2b1c1e56dcb1 on n-h2-846466-12 Aug 04 16:58:28.657082 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-1be45301-26e1-4116-b6a7-27307ffb25f5 req-48e01e3d-fe3d-4cb3-a47d-941e25674e78 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041813 Aug 04 16:58:28.658677 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2152/4230] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:28.665829 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-435ab762-eb29-47b6-a002-26d2b5cd4a75 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccc05e487794576a1a4ecd820fd6af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b318eefcfdf344e1b97d6a81c93e73f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:28.683711 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-435ab762-eb29-47b6-a002-26d2b5cd4a75 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] 10.222.0.23 "GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320" status: 200 len: 1324 microversion: 2.1 time: 0.371305 Aug 04 16:58:28.684760 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2079/4231] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:28 2022] GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320 => generated 1324 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:28.815949 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-714bbea1-5eec-4f70-839c-b7904d7c98d0 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:28.816649 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-714bbea1-5eec-4f70-839c-b7904d7c98d0 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:28.823304 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-714bbea1-5eec-4f70-839c-b7904d7c98d0 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:28.823734 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-714bbea1-5eec-4f70-839c-b7904d7c98d0 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:28.826737 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-714bbea1-5eec-4f70-839c-b7904d7c98d0 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:28.827374 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-714bbea1-5eec-4f70-839c-b7904d7c98d0 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:29.107965 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cba8fcf9-e03a-44dc-a887-085b2e12077b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:29.109514 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cba8fcf9-e03a-44dc-a887-085b2e12077b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: e27ae6f5-5037-4714-b781-224113fa0859] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:29.111961 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-714bbea1-5eec-4f70-839c-b7904d7c98d0 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:29.120279 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cba8fcf9-e03a-44dc-a887-085b2e12077b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:29.121272 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cba8fcf9-e03a-44dc-a887-085b2e12077b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:29.122405 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cba8fcf9-e03a-44dc-a887-085b2e12077b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:29.122994 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cba8fcf9-e03a-44dc-a887-085b2e12077b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:29.126761 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-714bbea1-5eec-4f70-839c-b7904d7c98d0 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1510 microversion: 2.1 time: 0.315933 Aug 04 16:58:29.131313 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2153/4232] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:28 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1510 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:29.338992 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ba38e707-f1d3-465b-aa53-7165e8b51e33 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:29.340344 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ba38e707-f1d3-465b-aa53-7165e8b51e33 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:29.354492 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba38e707-f1d3-465b-aa53-7165e8b51e33 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:29.355056 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba38e707-f1d3-465b-aa53-7165e8b51e33 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:29.356052 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba38e707-f1d3-465b-aa53-7165e8b51e33 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:29.356908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba38e707-f1d3-465b-aa53-7165e8b51e33 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:29.414029 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cba8fcf9-e03a-44dc-a887-085b2e12077b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:29.422801 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cba8fcf9-e03a-44dc-a887-085b2e12077b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859" status: 200 len: 1368 microversion: 2.1 time: 0.318758 Aug 04 16:58:29.424075 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2080/4233] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:29 2022] GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859 => generated 1368 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:58:29.623537 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ba38e707-f1d3-465b-aa53-7165e8b51e33 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:29.635130 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c95ba103-6543-40e3-bdde-2667f7806587 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:29.636167 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c95ba103-6543-40e3-bdde-2667f7806587 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] [instance: e2ca7015-c972-40a6-bca5-2b1c1e56dcb1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:29.653384 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c95ba103-6543-40e3-bdde-2667f7806587 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:29.654312 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ba38e707-f1d3-465b-aa53-7165e8b51e33 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:29.656394 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c95ba103-6543-40e3-bdde-2667f7806587 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:29.657359 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c95ba103-6543-40e3-bdde-2667f7806587 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:29.657845 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ba38e707-f1d3-465b-aa53-7165e8b51e33 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:29.660857 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ba38e707-f1d3-465b-aa53-7165e8b51e33 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1406 microversion: 2.20 time: 0.328288 Aug 04 16:58:29.661777 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c95ba103-6543-40e3-bdde-2667f7806587 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:29.664755 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2154/4234] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:29 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1406 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:58:29.680348 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-753d832d-b8c3-4b20-afb3-66050652bd41 req-2f69e0cc-7044-4ce9-ba58-306a93ef0c87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6db45a6-8552-48d5-b89f-08f706f51320", "name": "network-vif-plugged", "status": "completed", "tag": "7819fa2c-a3cb-4c0e-a913-ca15d09393ce"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:29.714525 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-753d832d-b8c3-4b20-afb3-66050652bd41 req-2f69e0cc-7044-4ce9-ba58-306a93ef0c87 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:29.725565 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-753d832d-b8c3-4b20-afb3-66050652bd41 req-2f69e0cc-7044-4ce9-ba58-306a93ef0c87 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:29.756396 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-753d832d-b8c3-4b20-afb3-66050652bd41 req-2f69e0cc-7044-4ce9-ba58-306a93ef0c87 service nova] Creating event network-vif-plugged:7819fa2c-a3cb-4c0e-a913-ca15d09393ce for instance e6db45a6-8552-48d5-b89f-08f706f51320 on n-h2-846466-12 Aug 04 16:58:29.772629 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-753d832d-b8c3-4b20-afb3-66050652bd41 req-2f69e0cc-7044-4ce9-ba58-306a93ef0c87 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099900 Aug 04 16:58:29.773527 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2155/4235] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:29.783416 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c02ae1b4-728f-4b2d-8a66-b3bc636f1c9d tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:29.784203 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c02ae1b4-728f-4b2d-8a66-b3bc636f1c9d tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] [instance: e6db45a6-8552-48d5-b89f-08f706f51320] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:29.791936 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c02ae1b4-728f-4b2d-8a66-b3bc636f1c9d tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:29.792534 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c02ae1b4-728f-4b2d-8a66-b3bc636f1c9d tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:29.793373 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c02ae1b4-728f-4b2d-8a66-b3bc636f1c9d tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:29.794036 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c02ae1b4-728f-4b2d-8a66-b3bc636f1c9d tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:29.798640 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:30.075429 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c95ba103-6543-40e3-bdde-2667f7806587 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689e7547be3c4c76beeeff391336e1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fd156c09a24dc5bdb7e8897890b157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:30.084506 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c95ba103-6543-40e3-bdde-2667f7806587 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] 10.222.0.23 "GET /compute/v2.1/servers/e2ca7015-c972-40a6-bca5-2b1c1e56dcb1" status: 200 len: 1315 microversion: 2.1 time: 0.453891 Aug 04 16:58:30.100738 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2081/4236] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:29 2022] GET /compute/v2.1/servers/e2ca7015-c972-40a6-bca5-2b1c1e56dcb1 => generated 1315 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:30.105697 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c02ae1b4-728f-4b2d-8a66-b3bc636f1c9d tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccc05e487794576a1a4ecd820fd6af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b318eefcfdf344e1b97d6a81c93e73f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:30.115667 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c02ae1b4-728f-4b2d-8a66-b3bc636f1c9d tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] 10.222.0.23 "GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320" status: 200 len: 1324 microversion: 2.1 time: 0.340726 Aug 04 16:58:30.116550 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2156/4237] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:29 2022] GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320 => generated 1324 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:30.161627 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f742b8f7-d8bc-4dab-9658-f775e51b0f8a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:30.162234 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f742b8f7-d8bc-4dab-9658-f775e51b0f8a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:30.183740 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f742b8f7-d8bc-4dab-9658-f775e51b0f8a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:30.184670 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f742b8f7-d8bc-4dab-9658-f775e51b0f8a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:30.185947 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f742b8f7-d8bc-4dab-9658-f775e51b0f8a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:30.187002 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f742b8f7-d8bc-4dab-9658-f775e51b0f8a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:30.444533 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d11eb73c-79f1-4aff-9bd1-4f16378e1e6b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:30.445152 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d11eb73c-79f1-4aff-9bd1-4f16378e1e6b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: e27ae6f5-5037-4714-b781-224113fa0859] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:30.452148 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d11eb73c-79f1-4aff-9bd1-4f16378e1e6b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:30.452973 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d11eb73c-79f1-4aff-9bd1-4f16378e1e6b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:30.453822 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d11eb73c-79f1-4aff-9bd1-4f16378e1e6b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:30.454256 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d11eb73c-79f1-4aff-9bd1-4f16378e1e6b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:30.894640 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f742b8f7-d8bc-4dab-9658-f775e51b0f8a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:30.908491 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d11eb73c-79f1-4aff-9bd1-4f16378e1e6b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:30.910119 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f742b8f7-d8bc-4dab-9658-f775e51b0f8a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1510 microversion: 2.1 time: 0.754984 Aug 04 16:58:30.927658 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d11eb73c-79f1-4aff-9bd1-4f16378e1e6b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859" status: 200 len: 1557 microversion: 2.1 time: 0.485616 Aug 04 16:58:30.929242 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2082/4238] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:30 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1510 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:30.935501 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2157/4239] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:30 2022] GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859 => generated 1557 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:30.946470 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-0d4f1dde-bf31-4adf-a31e-e871acbcf48c req-d3f485e8-fcdd-4bf0-92cb-43e316ed446e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdec5afc-3a3a-4d61-a934-5edf0c7c1397", "tag": "0762f466-ea31-44a7-9ac5-75aaf39b80a6"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:30.955510 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-24a51f51-e6a3-4cd9-9788-9bdda41764bf tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:30.958112 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-24a51f51-e6a3-4cd9-9788-9bdda41764bf tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:30.963882 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-0d4f1dde-bf31-4adf-a31e-e871acbcf48c req-d3f485e8-fcdd-4bf0-92cb-43e316ed446e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:30.964583 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-0d4f1dde-bf31-4adf-a31e-e871acbcf48c req-d3f485e8-fcdd-4bf0-92cb-43e316ed446e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:30.975481 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-24a51f51-e6a3-4cd9-9788-9bdda41764bf tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:30.976078 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-24a51f51-e6a3-4cd9-9788-9bdda41764bf tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:30.976937 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-24a51f51-e6a3-4cd9-9788-9bdda41764bf tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:30.977401 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-24a51f51-e6a3-4cd9-9788-9bdda41764bf tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:30.986296 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-0d4f1dde-bf31-4adf-a31e-e871acbcf48c req-d3f485e8-fcdd-4bf0-92cb-43e316ed446e service nova] Creating event network-changed:0762f466-ea31-44a7-9ac5-75aaf39b80a6 for instance fdec5afc-3a3a-4d61-a934-5edf0c7c1397 on n-h2-846466-12 Aug 04 16:58:31.001894 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-0d4f1dde-bf31-4adf-a31e-e871acbcf48c req-d3f485e8-fcdd-4bf0-92cb-43e316ed446e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068152 Aug 04 16:58:31.003119 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2083/4240] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:31.010359 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-24ffbe90-509c-4c5d-91de-c3fc21f4ed84 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:31.011431 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-24ffbe90-509c-4c5d-91de-c3fc21f4ed84 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: e27ae6f5-5037-4714-b781-224113fa0859] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:31.027714 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-24ffbe90-509c-4c5d-91de-c3fc21f4ed84 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:31.029333 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-24ffbe90-509c-4c5d-91de-c3fc21f4ed84 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:31.031211 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-24ffbe90-509c-4c5d-91de-c3fc21f4ed84 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:31.031896 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-24ffbe90-509c-4c5d-91de-c3fc21f4ed84 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:31.217759 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-24ffbe90-509c-4c5d-91de-c3fc21f4ed84 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.213196 Aug 04 16:58:31.218344 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2084/4241] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Aug 4 16:58:31 2022] GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859/os-interface => generated 284 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:31.223448 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-48181c0e-92de-4357-b633-6f3015cfe4d5 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:31.224331 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-48181c0e-92de-4357-b633-6f3015cfe4d5 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] [instance: e2ca7015-c972-40a6-bca5-2b1c1e56dcb1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:31.248415 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-48181c0e-92de-4357-b633-6f3015cfe4d5 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:31.248415 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-48181c0e-92de-4357-b633-6f3015cfe4d5 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:31.248415 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-48181c0e-92de-4357-b633-6f3015cfe4d5 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:31.248415 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-48181c0e-92de-4357-b633-6f3015cfe4d5 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:31.524921 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-24a51f51-e6a3-4cd9-9788-9bdda41764bf tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:31.540498 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-24a51f51-e6a3-4cd9-9788-9bdda41764bf tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:31.547106 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-24a51f51-e6a3-4cd9-9788-9bdda41764bf tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:31.551047 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-24a51f51-e6a3-4cd9-9788-9bdda41764bf tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1406 microversion: 2.20 time: 0.612035 Aug 04 16:58:31.551667 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2158/4242] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:30 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1406 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:31.564689 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b959c71b-bd47-4acb-b415-bbcad990980d tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:31.569485 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b959c71b-bd47-4acb-b415-bbcad990980d tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] [instance: e6db45a6-8552-48d5-b89f-08f706f51320] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:31.584039 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b959c71b-bd47-4acb-b415-bbcad990980d tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:31.585870 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b959c71b-bd47-4acb-b415-bbcad990980d tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:31.589977 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b959c71b-bd47-4acb-b415-bbcad990980d tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:31.590663 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b959c71b-bd47-4acb-b415-bbcad990980d tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:32.032720 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-48181c0e-92de-4357-b633-6f3015cfe4d5 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689e7547be3c4c76beeeff391336e1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fd156c09a24dc5bdb7e8897890b157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:32.047159 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-48181c0e-92de-4357-b633-6f3015cfe4d5 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] 10.222.0.23 "GET /compute/v2.1/servers/e2ca7015-c972-40a6-bca5-2b1c1e56dcb1" status: 200 len: 1315 microversion: 2.1 time: 0.827534 Aug 04 16:58:32.050339 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2085/4243] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:31 2022] GET /compute/v2.1/servers/e2ca7015-c972-40a6-bca5-2b1c1e56dcb1 => generated 1315 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:32.067880 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-568d1534-ca6c-4e8b-a989-26b7192972c1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:32.069050 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-568d1534-ca6c-4e8b-a989-26b7192972c1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:32.079921 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-568d1534-ca6c-4e8b-a989-26b7192972c1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:32.080631 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-568d1534-ca6c-4e8b-a989-26b7192972c1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:32.081638 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-568d1534-ca6c-4e8b-a989-26b7192972c1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:32.082227 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-568d1534-ca6c-4e8b-a989-26b7192972c1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:32.220330 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b959c71b-bd47-4acb-b415-bbcad990980d tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccc05e487794576a1a4ecd820fd6af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b318eefcfdf344e1b97d6a81c93e73f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:32.228857 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b959c71b-bd47-4acb-b415-bbcad990980d tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] 10.222.0.23 "GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320" status: 200 len: 1324 microversion: 2.1 time: 0.673774 Aug 04 16:58:32.229747 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2159/4244] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:31 2022] GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320 => generated 1324 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:32.503726 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-568d1534-ca6c-4e8b-a989-26b7192972c1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:32.513643 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-568d1534-ca6c-4e8b-a989-26b7192972c1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1510 microversion: 2.1 time: 0.461677 Aug 04 16:58:32.533973 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2086/4245] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:32 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1510 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:32.576558 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8a67e50e-5708-4376-9a5f-b207f8abdc6d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:32.577192 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8a67e50e-5708-4376-9a5f-b207f8abdc6d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:32.594983 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8a67e50e-5708-4376-9a5f-b207f8abdc6d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:32.595449 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8a67e50e-5708-4376-9a5f-b207f8abdc6d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:32.596225 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8a67e50e-5708-4376-9a5f-b207f8abdc6d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:32.596661 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8a67e50e-5708-4376-9a5f-b207f8abdc6d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:32.880553 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=10 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:32.888538 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8a67e50e-5708-4376-9a5f-b207f8abdc6d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:32.897898 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8a67e50e-5708-4376-9a5f-b207f8abdc6d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:32.899551 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8a67e50e-5708-4376-9a5f-b207f8abdc6d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:32.901088 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8a67e50e-5708-4376-9a5f-b207f8abdc6d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1406 microversion: 2.20 time: 0.330032 Aug 04 16:58:32.902044 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2160/4246] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:32 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1406 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:33.073126 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1193aeec-fb55-4a5f-97dd-73c97dc92de9 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:33.073692 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1193aeec-fb55-4a5f-97dd-73c97dc92de9 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] [instance: e2ca7015-c972-40a6-bca5-2b1c1e56dcb1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:33.081637 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=24 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:33.088217 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=13 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:33.091472 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1193aeec-fb55-4a5f-97dd-73c97dc92de9 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:33.091992 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1193aeec-fb55-4a5f-97dd-73c97dc92de9 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:33.092986 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1193aeec-fb55-4a5f-97dd-73c97dc92de9 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:33.100243 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1193aeec-fb55-4a5f-97dd-73c97dc92de9 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:33.255063 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f9c440b8-cf61-4374-a1c4-a02d46b1ce36 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:33.256079 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f9c440b8-cf61-4374-a1c4-a02d46b1ce36 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] [instance: e6db45a6-8552-48d5-b89f-08f706f51320] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:33.270340 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9c440b8-cf61-4374-a1c4-a02d46b1ce36 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:33.271068 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9c440b8-cf61-4374-a1c4-a02d46b1ce36 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:33.272560 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9c440b8-cf61-4374-a1c4-a02d46b1ce36 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:33.273165 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9c440b8-cf61-4374-a1c4-a02d46b1ce36 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:33.472785 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1193aeec-fb55-4a5f-97dd-73c97dc92de9 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689e7547be3c4c76beeeff391336e1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fd156c09a24dc5bdb7e8897890b157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:33.481947 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1193aeec-fb55-4a5f-97dd-73c97dc92de9 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] 10.222.0.23 "GET /compute/v2.1/servers/e2ca7015-c972-40a6-bca5-2b1c1e56dcb1" status: 200 len: 1315 microversion: 2.1 time: 0.413848 Aug 04 16:58:33.495499 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2087/4247] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:33 2022] GET /compute/v2.1/servers/e2ca7015-c972-40a6-bca5-2b1c1e56dcb1 => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:33.502104 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-dd9b63fb-d924-4f1d-9dba-4d1e6378d334 req-247d2004-bdf2-44cb-9c64-e7ea872813f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e27ae6f5-5037-4714-b781-224113fa0859", "tag": "9fc22e1a-6c76-4ae5-ac92-4c33d8d04605"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:33.519894 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-dd9b63fb-d924-4f1d-9dba-4d1e6378d334 req-247d2004-bdf2-44cb-9c64-e7ea872813f2 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:33.520443 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-dd9b63fb-d924-4f1d-9dba-4d1e6378d334 req-247d2004-bdf2-44cb-9c64-e7ea872813f2 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:33.554021 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-dd9b63fb-d924-4f1d-9dba-4d1e6378d334 req-247d2004-bdf2-44cb-9c64-e7ea872813f2 service nova] Creating event network-changed:9fc22e1a-6c76-4ae5-ac92-4c33d8d04605 for instance e27ae6f5-5037-4714-b781-224113fa0859 on n-h1-846466-12 Aug 04 16:58:33.564538 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-dd9b63fb-d924-4f1d-9dba-4d1e6378d334 req-247d2004-bdf2-44cb-9c64-e7ea872813f2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067107 Aug 04 16:58:33.565268 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2088/4248] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:33.571720 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f0906bc8-e6ff-428e-96be-28376be6e6aa tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:33.573371 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f0906bc8-e6ff-428e-96be-28376be6e6aa tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:33.582676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f0906bc8-e6ff-428e-96be-28376be6e6aa tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:33.583375 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f0906bc8-e6ff-428e-96be-28376be6e6aa tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:33.585048 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f0906bc8-e6ff-428e-96be-28376be6e6aa tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:33.586661 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f0906bc8-e6ff-428e-96be-28376be6e6aa tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:33.601528 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f9c440b8-cf61-4374-a1c4-a02d46b1ce36 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccc05e487794576a1a4ecd820fd6af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b318eefcfdf344e1b97d6a81c93e73f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:33.611298 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f9c440b8-cf61-4374-a1c4-a02d46b1ce36 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] 10.222.0.23 "GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320" status: 200 len: 1324 microversion: 2.1 time: 0.360459 Aug 04 16:58:33.611900 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2161/4249] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:33 2022] GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320 => generated 1324 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:33.864816 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f0906bc8-e6ff-428e-96be-28376be6e6aa tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:33.883426 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f0906bc8-e6ff-428e-96be-28376be6e6aa tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1510 microversion: 2.1 time: 0.316798 Aug 04 16:58:33.884220 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2089/4250] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:33 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1510 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:33.931764 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d586b022-b3fe-4e54-a0b6-2307a1969022 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:33.932378 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d586b022-b3fe-4e54-a0b6-2307a1969022 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:33.948835 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d586b022-b3fe-4e54-a0b6-2307a1969022 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:33.949275 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d586b022-b3fe-4e54-a0b6-2307a1969022 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:33.950152 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d586b022-b3fe-4e54-a0b6-2307a1969022 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:33.950680 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d586b022-b3fe-4e54-a0b6-2307a1969022 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:34.497977 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-3ac9d901-9294-4ec4-8a1f-e4caf4e64996 req-015f9669-f819-4df6-8eea-7e45301beddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2ca7015-c972-40a6-bca5-2b1c1e56dcb1", "name": "network-vif-plugged", "status": "completed", "tag": "598010eb-9ab0-4b4e-80ef-cda94c54294c"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:34.519862 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-3ac9d901-9294-4ec4-8a1f-e4caf4e64996 req-015f9669-f819-4df6-8eea-7e45301beddf service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:34.520679 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-3ac9d901-9294-4ec4-8a1f-e4caf4e64996 req-015f9669-f819-4df6-8eea-7e45301beddf service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:34.539810 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-3ac9d901-9294-4ec4-8a1f-e4caf4e64996 req-015f9669-f819-4df6-8eea-7e45301beddf service nova] Creating event network-vif-plugged:598010eb-9ab0-4b4e-80ef-cda94c54294c for instance e2ca7015-c972-40a6-bca5-2b1c1e56dcb1 on n-h2-846466-12 Aug 04 16:58:34.545672 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-3ac9d901-9294-4ec4-8a1f-e4caf4e64996 req-015f9669-f819-4df6-8eea-7e45301beddf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051410 Aug 04 16:58:34.547438 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2090/4251] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:58:34.552974 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9957ec49-e85c-4bb2-b4c0-362f69b178b3 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:34.564950 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9957ec49-e85c-4bb2-b4c0-362f69b178b3 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] [instance: e2ca7015-c972-40a6-bca5-2b1c1e56dcb1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:34.573682 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9957ec49-e85c-4bb2-b4c0-362f69b178b3 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:34.574600 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9957ec49-e85c-4bb2-b4c0-362f69b178b3 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:34.575711 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9957ec49-e85c-4bb2-b4c0-362f69b178b3 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:34.577028 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9957ec49-e85c-4bb2-b4c0-362f69b178b3 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:34.802508 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d586b022-b3fe-4e54-a0b6-2307a1969022 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:34.812535 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d586b022-b3fe-4e54-a0b6-2307a1969022 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:34.814639 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d586b022-b3fe-4e54-a0b6-2307a1969022 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:34.816087 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d586b022-b3fe-4e54-a0b6-2307a1969022 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1406 microversion: 2.20 time: 0.891789 Aug 04 16:58:34.817321 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2162/4252] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:33 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1406 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:34.822625 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bb341517-a386-4eb8-a027-fb3fd5e46fb9 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:34.823700 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bb341517-a386-4eb8-a027-fb3fd5e46fb9 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] [instance: e6db45a6-8552-48d5-b89f-08f706f51320] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:34.832755 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bb341517-a386-4eb8-a027-fb3fd5e46fb9 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:34.833889 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bb341517-a386-4eb8-a027-fb3fd5e46fb9 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:34.834876 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bb341517-a386-4eb8-a027-fb3fd5e46fb9 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:34.835473 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bb341517-a386-4eb8-a027-fb3fd5e46fb9 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:35.119244 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9957ec49-e85c-4bb2-b4c0-362f69b178b3 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689e7547be3c4c76beeeff391336e1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fd156c09a24dc5bdb7e8897890b157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:35.139451 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9957ec49-e85c-4bb2-b4c0-362f69b178b3 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] 10.222.0.23 "GET /compute/v2.1/servers/e2ca7015-c972-40a6-bca5-2b1c1e56dcb1" status: 200 len: 1315 microversion: 2.1 time: 0.590164 Aug 04 16:58:35.155694 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2091/4253] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:34 2022] GET /compute/v2.1/servers/e2ca7015-c972-40a6-bca5-2b1c1e56dcb1 => generated 1315 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:35.160817 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a8153227-7074-4436-8415-2156f8be378c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:35.161455 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a8153227-7074-4436-8415-2156f8be378c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:35.168762 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a8153227-7074-4436-8415-2156f8be378c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:35.171943 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a8153227-7074-4436-8415-2156f8be378c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:35.174339 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a8153227-7074-4436-8415-2156f8be378c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:35.176592 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a8153227-7074-4436-8415-2156f8be378c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:35.191923 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bb341517-a386-4eb8-a027-fb3fd5e46fb9 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccc05e487794576a1a4ecd820fd6af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b318eefcfdf344e1b97d6a81c93e73f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:35.208792 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bb341517-a386-4eb8-a027-fb3fd5e46fb9 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] 10.222.0.23 "GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320" status: 200 len: 1520 microversion: 2.1 time: 0.389779 Aug 04 16:58:35.224327 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2163/4254] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:34 2022] GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320 => generated 1520 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:35.463784 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ebaf8092-5b20-42f2-a403-aa0af8c2750a tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2021856498", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "9f25d9f7-53f7-4396-866d-98d00c1c85fe"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ebaf8092-5b20-42f2-a403-aa0af8c2750a tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Request method failure captured: Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 243 Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_qge7BtUV7jEMtrjlo9zs2LdrhsgNm16-3nEYJMDbpoXSBJ0R4syWewuz69h6x9Sfxudq5GAf-etC7fdaIaCkQeXLlIcOfgKKaQ222hKtDjO7DbbID_c-hs4ImKoNP3Sfr2x2Dnb_KzWeB1fqR2GsJX3QO1EKPsj5_yaQyZOPWk27I Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: b318eefcfdf344e1b97d6a81c93e73f8 Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-937734961 Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b318eefcfdf344e1b97d6a81c93e73f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b318eefcfdf344e1b97d6a81c93e73f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b318eefcfdf344e1b97d6a81c93e73f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b318eefcfdf344e1b97d6a81c93e73f8"}]}] Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-937734961 Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: b318eefcfdf344e1b97d6a81c93e73f8 Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-937734961 Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerMetadataNegativeTestJSON-937734961-project Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: cccc05e487794576a1a4ecd820fd6af6 Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-937734961-project Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2021856498", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "9f25d9f7-53f7-4396-866d-98d00c1c85fe"}]}} Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2021856498', 'imageRef': '58d80c01-1581-4a2f-bbb0-c2eaf1affa00', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '9f25d9f7-53f7-4396-866d-98d00c1c85fe'}]}}} Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:35.472082 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:58:35.476205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:58:35.476205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 16:58:35.476205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 16:58:35.476205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:58:35.476205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:58:35.476205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:58:35.476205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:58:35.476205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 16:58:35.476205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:35.476205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:35.476205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:35.476205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:35.476205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:35.476205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:35.476205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:58:35.476205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:58:35.476205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 16:58:35.476205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:35.476205 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ebaf8092-5b20-42f2-a403-aa0af8c2750a tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:35.476205 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ebaf8092-5b20-42f2-a403-aa0af8c2750a tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.018531 Aug 04 16:58:35.476205 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2164/4255] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:58:35 2022] POST /compute/v2.1/servers => generated 175 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:58:35.504857 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-164e6111-439e-4235-8d1c-add7bd05cc24 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:35.505871 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-164e6111-439e-4235-8d1c-add7bd05cc24 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] [instance: ec6c4e87-1a79-44a4-994d-8dea52b60c11] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:35.536518 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-164e6111-439e-4235-8d1c-add7bd05cc24 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] HTTP exception thrown: Instance ec6c4e87-1a79-44a4-994d-8dea52b60c11 could not be found. Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-164e6111-439e-4235-8d1c-add7bd05cc24 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Request method failure captured: Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/ec6c4e87-1a79-44a4-994d-8dea52b60c11/metadata HTTP/1.1 Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_qge7BtUV7jEMtrjlo9zs2LdrhsgNm16-3nEYJMDbpoXSBJ0R4syWewuz69h6x9Sfxudq5GAf-etC7fdaIaCkQeXLlIcOfgKKaQ222hKtDjO7DbbID_c-hs4ImKoNP3Sfr2x2Dnb_KzWeB1fqR2GsJX3QO1EKPsj5_yaQyZOPWk27I Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: b318eefcfdf344e1b97d6a81c93e73f8 Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-937734961 Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b318eefcfdf344e1b97d6a81c93e73f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b318eefcfdf344e1b97d6a81c93e73f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b318eefcfdf344e1b97d6a81c93e73f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b318eefcfdf344e1b97d6a81c93e73f8"}]}] Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-937734961 Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: b318eefcfdf344e1b97d6a81c93e73f8 Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-937734961 Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerMetadataNegativeTestJSON-937734961-project Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: cccc05e487794576a1a4ecd820fd6af6 Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-937734961-project Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance ec6c4e87-1a79-44a4-994d-8dea52b60c11 could not be found. Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'server_id': 'ec6c4e87-1a79-44a4-994d-8dea52b60c11'} Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec6c4e87-1a79-44a4-994d-8dea52b60c11 could not be found. Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec6c4e87-1a79-44a4-994d-8dea52b60c11 could not be found. Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:35.546841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:35.551627 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:35.551627 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:35.551627 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec6c4e87-1a79-44a4-994d-8dea52b60c11 could not be found. Aug 04 16:58:35.551627 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:35.553173 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-164e6111-439e-4235-8d1c-add7bd05cc24 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Returning 404 to user: Instance ec6c4e87-1a79-44a4-994d-8dea52b60c11 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:35.554439 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-164e6111-439e-4235-8d1c-add7bd05cc24 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] 10.222.0.23 "GET /compute/v2.1/servers/ec6c4e87-1a79-44a4-994d-8dea52b60c11/metadata" status: 404 len: 111 microversion: 2.1 time: 0.069123 Aug 04 16:58:35.555272 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2165/4256] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Aug 4 16:58:35 2022] GET /compute/v2.1/servers/ec6c4e87-1a79-44a4-994d-8dea52b60c11/metadata => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:58:35.567008 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a8153227-7074-4436-8415-2156f8be378c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:35.573129 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=100 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:35.580164 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a8153227-7074-4436-8415-2156f8be378c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1510 microversion: 2.1 time: 0.423070 Aug 04 16:58:35.581721 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2092/4257] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:35 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1510 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:35.622951 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4d6fa452-a0bb-483a-9a26-55bb6155b74a tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1485325420", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9f25d9f7-53f7-4396-866d-98d00c1c85fe"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4d6fa452-a0bb-483a-9a26-55bb6155b74a tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Request method failure captured: Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 499 Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_qge7BtUV7jEMtrjlo9zs2LdrhsgNm16-3nEYJMDbpoXSBJ0R4syWewuz69h6x9Sfxudq5GAf-etC7fdaIaCkQeXLlIcOfgKKaQ222hKtDjO7DbbID_c-hs4ImKoNP3Sfr2x2Dnb_KzWeB1fqR2GsJX3QO1EKPsj5_yaQyZOPWk27I Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: b318eefcfdf344e1b97d6a81c93e73f8 Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-937734961 Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b318eefcfdf344e1b97d6a81c93e73f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b318eefcfdf344e1b97d6a81c93e73f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b318eefcfdf344e1b97d6a81c93e73f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b318eefcfdf344e1b97d6a81c93e73f8"}]}] Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-937734961 Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: b318eefcfdf344e1b97d6a81c93e73f8 Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-937734961 Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerMetadataNegativeTestJSON-937734961-project Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: cccc05e487794576a1a4ecd820fd6af6 Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-937734961-project Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1485325420", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9f25d9f7-53f7-4396-866d-98d00c1c85fe"}]}} Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1485325420', 'imageRef': '58d80c01-1581-4a2f-bbb0-c2eaf1affa00', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '9f25d9f7-53f7-4396-866d-98d00c1c85fe'}]}}} Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 04 16:58:35.629550 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 04 16:58:35.633186 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 04 16:58:35.633186 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:35.633186 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 16:58:35.633186 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 04 16:58:35.633186 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:35.633186 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:35.633186 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:35.633186 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:35.633186 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:35.633186 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:35.633186 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:35.633186 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:35.633186 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:35.633186 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:35.633186 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:58:35.633186 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:58:35.633186 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 16:58:35.633186 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 16:58:35.633186 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:58:35.633186 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:58:35.633186 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:58:35.633186 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:58:35.633186 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 16:58:35.633186 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:35.633186 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:35.633186 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:35.633186 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:35.633186 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:35.633186 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:35.633186 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:58:35.633186 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:58:35.633186 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 16:58:35.633186 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:35.636401 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4d6fa452-a0bb-483a-9a26-55bb6155b74a tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:35.637907 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4d6fa452-a0bb-483a-9a26-55bb6155b74a tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.021407 Aug 04 16:58:35.638523 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2166/4258] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:58:35 2022] POST /compute/v2.1/servers => generated 687 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:58:35.738299 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7b05b103-2381-4beb-84da-3ec8aa53ea93 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1285593326", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9f25d9f7-53f7-4396-866d-98d00c1c85fe"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7b05b103-2381-4beb-84da-3ec8aa53ea93 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Request method failure captured: Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 500 Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_qge7BtUV7jEMtrjlo9zs2LdrhsgNm16-3nEYJMDbpoXSBJ0R4syWewuz69h6x9Sfxudq5GAf-etC7fdaIaCkQeXLlIcOfgKKaQ222hKtDjO7DbbID_c-hs4ImKoNP3Sfr2x2Dnb_KzWeB1fqR2GsJX3QO1EKPsj5_yaQyZOPWk27I Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: b318eefcfdf344e1b97d6a81c93e73f8 Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-937734961 Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b318eefcfdf344e1b97d6a81c93e73f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b318eefcfdf344e1b97d6a81c93e73f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b318eefcfdf344e1b97d6a81c93e73f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b318eefcfdf344e1b97d6a81c93e73f8"}]}] Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-937734961 Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: b318eefcfdf344e1b97d6a81c93e73f8 Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-937734961 Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServerMetadataNegativeTestJSON-937734961-project Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: cccc05e487794576a1a4ecd820fd6af6 Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-937734961-project Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1285593326", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9f25d9f7-53f7-4396-866d-98d00c1c85fe"}]}} Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1285593326', 'imageRef': '58d80c01-1581-4a2f-bbb0-c2eaf1affa00', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '9f25d9f7-53f7-4396-866d-98d00c1c85fe'}]}}} Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 04 16:58:35.742744 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7b05b103-2381-4beb-84da-3ec8aa53ea93 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7b05b103-2381-4beb-84da-3ec8aa53ea93 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.009758 Aug 04 16:58:35.752253 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2093/4259] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:58:35 2022] POST /compute/v2.1/servers => generated 689 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:58:35.797925 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d6ed5b37-b276-44ba-a438-85a412ae9194 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2038926847", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9f25d9f7-53f7-4396-866d-98d00c1c85fe"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d6ed5b37-b276-44ba-a438-85a412ae9194 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Request method failure captured: Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 754 Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_qge7BtUV7jEMtrjlo9zs2LdrhsgNm16-3nEYJMDbpoXSBJ0R4syWewuz69h6x9Sfxudq5GAf-etC7fdaIaCkQeXLlIcOfgKKaQ222hKtDjO7DbbID_c-hs4ImKoNP3Sfr2x2Dnb_KzWeB1fqR2GsJX3QO1EKPsj5_yaQyZOPWk27I Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: b318eefcfdf344e1b97d6a81c93e73f8 Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-937734961 Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b318eefcfdf344e1b97d6a81c93e73f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b318eefcfdf344e1b97d6a81c93e73f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b318eefcfdf344e1b97d6a81c93e73f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b318eefcfdf344e1b97d6a81c93e73f8"}]}] Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-937734961 Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: b318eefcfdf344e1b97d6a81c93e73f8 Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-937734961 Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerMetadataNegativeTestJSON-937734961-project Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: cccc05e487794576a1a4ecd820fd6af6 Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-937734961-project Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2038926847", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9f25d9f7-53f7-4396-866d-98d00c1c85fe"}]}} Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2038926847', 'imageRef': '58d80c01-1581-4a2f-bbb0-c2eaf1affa00', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '9f25d9f7-53f7-4396-866d-98d00c1c85fe'}]}}} Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:58:35.804487 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:58:35.808943 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:58:35.811238 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 16:58:35.811238 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:35.811238 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d6ed5b37-b276-44ba-a438-85a412ae9194 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:35.811238 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d6ed5b37-b276-44ba-a438-85a412ae9194 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.013227 Aug 04 16:58:35.811238 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2167/4260] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:58:35 2022] POST /compute/v2.1/servers => generated 1197 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 04 16:58:35.847004 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-44575d19-913f-4e92-b75f-7cd35afc5c05 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:35.847004 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-44575d19-913f-4e92-b75f-7cd35afc5c05 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:35.856962 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-44575d19-913f-4e92-b75f-7cd35afc5c05 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:35.857442 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-44575d19-913f-4e92-b75f-7cd35afc5c05 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:35.859196 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-44575d19-913f-4e92-b75f-7cd35afc5c05 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:35.859632 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-44575d19-913f-4e92-b75f-7cd35afc5c05 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:36.050900 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d57d97d2-8d2e-4e80-8437-060e3f24b109 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1454742944", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9f25d9f7-53f7-4396-866d-98d00c1c85fe"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:36.055407 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d57d97d2-8d2e-4e80-8437-060e3f24b109 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Request method failure captured: Aug 04 16:58:36.055407 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 16:58:36.055407 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:58:36.055407 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:58:36.055407 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:58:36.055407 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 1266 Aug 04 16:58:36.055407 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:58:36.055407 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:58:36.055407 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:58:36.055407 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:36.055407 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_qge7BtUV7jEMtrjlo9zs2LdrhsgNm16-3nEYJMDbpoXSBJ0R4syWewuz69h6x9Sfxudq5GAf-etC7fdaIaCkQeXLlIcOfgKKaQ222hKtDjO7DbbID_c-hs4ImKoNP3Sfr2x2Dnb_KzWeB1fqR2GsJX3QO1EKPsj5_yaQyZOPWk27I Aug 04 16:58:36.055407 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:58:36.055407 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:58:36.055407 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:58:36.055407 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:58:36.055407 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:58:36.055407 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:58:36.055407 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: b318eefcfdf344e1b97d6a81c93e73f8 Aug 04 16:58:36.055407 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-937734961 Aug 04 16:58:36.055407 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:58:36.055407 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:58:36.055407 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b318eefcfdf344e1b97d6a81c93e73f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b318eefcfdf344e1b97d6a81c93e73f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b318eefcfdf344e1b97d6a81c93e73f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b318eefcfdf344e1b97d6a81c93e73f8"}]}] Aug 04 16:58:36.055407 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-937734961 Aug 04 16:58:36.055407 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: b318eefcfdf344e1b97d6a81c93e73f8 Aug 04 16:58:36.055407 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-937734961 Aug 04 16:58:36.055407 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerMetadataNegativeTestJSON-937734961-project Aug 04 16:58:36.055407 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:58:36.055407 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:58:36.055407 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: cccc05e487794576a1a4ecd820fd6af6 Aug 04 16:58:36.055407 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-937734961-project Aug 04 16:58:36.055407 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:58:36.055407 n-d-846466-12 devstack@n-api.service[126125]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1454742944", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9f25d9f7-53f7-4396-866d-98d00c1c85fe"}]}} Aug 04 16:58:36.055407 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:58:36.057660 n-d-846466-12 devstack@n-api.service[126125]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 16:58:36.057660 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1454742944', 'imageRef': '58d80c01-1581-4a2f-bbb0-c2eaf1affa00', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '9f25d9f7-53f7-4396-866d-98d00c1c85fe'}]}}} Aug 04 16:58:36.057660 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:36.057660 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:36.057660 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:58:36.057660 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:58:36.057660 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:58:36.057660 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:58:36.057660 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 16:58:36.057660 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:36.057660 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 04 16:58:36.057660 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 04 16:58:36.057660 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 04 16:58:36.057660 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 04 16:58:36.057660 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 04 16:58:36.057660 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:36.057660 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 16:58:36.058780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 04 16:58:36.058780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:36.058780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:36.058780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:36.058780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:36.058780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:36.058780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:36.058780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:36.058780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:36.058780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:36.058780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:36.058780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:58:36.058780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:58:36.058780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 16:58:36.058780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 16:58:36.058780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:58:36.058780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:58:36.058780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:58:36.058780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:58:36.058780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 16:58:36.058780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:36.058780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:36.058780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:36.058780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:36.058780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:36.058780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:36.058780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:58:36.058780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:58:36.065585 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 16:58:36.065585 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:36.065585 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d57d97d2-8d2e-4e80-8437-060e3f24b109 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:36.065585 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d57d97d2-8d2e-4e80-8437-060e3f24b109 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.010156 Aug 04 16:58:36.065585 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2168/4261] 10.222.0.23 () {60 vars in 1148 bytes} [Thu Aug 4 16:58:36 2022] POST /compute/v2.1/servers => generated 2221 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 04 16:58:36.071601 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dea38967-1c92-4a66-b323-3ea578c5298e tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:36.072658 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dea38967-1c92-4a66-b323-3ea578c5298e tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] [instance: 987810f0-9209-4f88-9a5a-e12b2f7a9c0a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:36.082063 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-dea38967-1c92-4a66-b323-3ea578c5298e tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] HTTP exception thrown: Instance 987810f0-9209-4f88-9a5a-e12b2f7a9c0a could not be found. Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dea38967-1c92-4a66-b323-3ea578c5298e tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Request method failure captured: Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/987810f0-9209-4f88-9a5a-e12b2f7a9c0a/metadata/test2 HTTP/1.1 Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_qge7BtUV7jEMtrjlo9zs2LdrhsgNm16-3nEYJMDbpoXSBJ0R4syWewuz69h6x9Sfxudq5GAf-etC7fdaIaCkQeXLlIcOfgKKaQ222hKtDjO7DbbID_c-hs4ImKoNP3Sfr2x2Dnb_KzWeB1fqR2GsJX3QO1EKPsj5_yaQyZOPWk27I Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: b318eefcfdf344e1b97d6a81c93e73f8 Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-937734961 Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b318eefcfdf344e1b97d6a81c93e73f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b318eefcfdf344e1b97d6a81c93e73f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b318eefcfdf344e1b97d6a81c93e73f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b318eefcfdf344e1b97d6a81c93e73f8"}]}] Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-937734961 Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: b318eefcfdf344e1b97d6a81c93e73f8 Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-937734961 Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerMetadataNegativeTestJSON-937734961-project Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: cccc05e487794576a1a4ecd820fd6af6 Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-937734961-project Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 987810f0-9209-4f88-9a5a-e12b2f7a9c0a could not be found. Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'server_id': '987810f0-9209-4f88-9a5a-e12b2f7a9c0a', 'id': 'test2'} Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 987810f0-9209-4f88-9a5a-e12b2f7a9c0a could not be found. Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 987810f0-9209-4f88-9a5a-e12b2f7a9c0a could not be found. Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:36.084165 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:36.088104 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:36.088104 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:36.088104 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 987810f0-9209-4f88-9a5a-e12b2f7a9c0a could not be found. Aug 04 16:58:36.088104 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:36.091377 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dea38967-1c92-4a66-b323-3ea578c5298e tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Returning 404 to user: Instance 987810f0-9209-4f88-9a5a-e12b2f7a9c0a could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:36.092725 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dea38967-1c92-4a66-b323-3ea578c5298e tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] 10.222.0.23 "GET /compute/v2.1/servers/987810f0-9209-4f88-9a5a-e12b2f7a9c0a/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.028906 Aug 04 16:58:36.103119 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2169/4262] 10.222.0.23 () {58 vars in 1281 bytes} [Thu Aug 4 16:58:36 2022] GET /compute/v2.1/servers/987810f0-9209-4f88-9a5a-e12b2f7a9c0a/metadata/test2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:58:36.108633 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-161289f0-3acf-43b8-ac38-a03b060c7b8d tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:36.109353 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-161289f0-3acf-43b8-ac38-a03b060c7b8d tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] [instance: e6db45a6-8552-48d5-b89f-08f706f51320] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:36.116796 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-161289f0-3acf-43b8-ac38-a03b060c7b8d tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:36.117811 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-161289f0-3acf-43b8-ac38-a03b060c7b8d tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:36.118818 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-161289f0-3acf-43b8-ac38-a03b060c7b8d tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:36.119414 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-161289f0-3acf-43b8-ac38-a03b060c7b8d tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:36.177811 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-161289f0-3acf-43b8-ac38-a03b060c7b8d tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] [instance: e6db45a6-8552-48d5-b89f-08f706f51320] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:58:36.203915 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-44575d19-913f-4e92-b75f-7cd35afc5c05 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:36.217941 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-44575d19-913f-4e92-b75f-7cd35afc5c05 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:36.219766 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-44575d19-913f-4e92-b75f-7cd35afc5c05 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:36.221268 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-44575d19-913f-4e92-b75f-7cd35afc5c05 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1406 microversion: 2.20 time: 0.384113 Aug 04 16:58:36.244534 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2094/4263] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:35 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1406 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:36.269171 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3ab5d392-7ec9-4249-b899-65c226c30952 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:36.270541 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3ab5d392-7ec9-4249-b899-65c226c30952 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] [instance: e2ca7015-c972-40a6-bca5-2b1c1e56dcb1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:36.283791 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ab5d392-7ec9-4249-b899-65c226c30952 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:36.284215 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ab5d392-7ec9-4249-b899-65c226c30952 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:36.285028 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ab5d392-7ec9-4249-b899-65c226c30952 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:36.293474 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ab5d392-7ec9-4249-b899-65c226c30952 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:36.346918 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-161289f0-3acf-43b8-ac38-a03b060c7b8d tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320" status: 204 len: 0 microversion: 2.1 time: 0.239664 Aug 04 16:58:36.347804 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2170/4264] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:58:36 2022] DELETE /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:58:36.366065 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f947c6bf-c9d6-49c9-bbaa-4c2fd4a5a961 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:36.366807 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f947c6bf-c9d6-49c9-bbaa-4c2fd4a5a961 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] [instance: e6db45a6-8552-48d5-b89f-08f706f51320] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:36.380399 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f947c6bf-c9d6-49c9-bbaa-4c2fd4a5a961 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:36.380848 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f947c6bf-c9d6-49c9-bbaa-4c2fd4a5a961 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:36.381656 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f947c6bf-c9d6-49c9-bbaa-4c2fd4a5a961 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:36.382086 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f947c6bf-c9d6-49c9-bbaa-4c2fd4a5a961 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:36.559190 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3ab5d392-7ec9-4249-b899-65c226c30952 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689e7547be3c4c76beeeff391336e1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fd156c09a24dc5bdb7e8897890b157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:36.566836 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3ab5d392-7ec9-4249-b899-65c226c30952 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] 10.222.0.23 "GET /compute/v2.1/servers/e2ca7015-c972-40a6-bca5-2b1c1e56dcb1" status: 200 len: 1465 microversion: 2.1 time: 0.321109 Aug 04 16:58:36.581795 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2095/4265] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:36 2022] GET /compute/v2.1/servers/e2ca7015-c972-40a6-bca5-2b1c1e56dcb1 => generated 1465 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:36.602706 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f947c6bf-c9d6-49c9-bbaa-4c2fd4a5a961 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccc05e487794576a1a4ecd820fd6af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b318eefcfdf344e1b97d6a81c93e73f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:36.609583 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-be1dbc00-ddef-4797-9cf6-048797a5cffd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:36.610438 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-be1dbc00-ddef-4797-9cf6-048797a5cffd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:36.625014 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f947c6bf-c9d6-49c9-bbaa-4c2fd4a5a961 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] 10.222.0.23 "GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320" status: 200 len: 1526 microversion: 2.1 time: 0.272112 Aug 04 16:58:36.627088 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2171/4266] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:36 2022] GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320 => generated 1526 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:36.632060 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-84a9bae4-ec00-4caf-8710-ea13eeb28604 req-28ea6198-b841-431f-8dc9-8c5f8dcc2acc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdec5afc-3a3a-4d61-a934-5edf0c7c1397", "name": "network-vif-plugged", "status": "completed", "tag": "0762f466-ea31-44a7-9ac5-75aaf39b80a6"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:36.641096 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be1dbc00-ddef-4797-9cf6-048797a5cffd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:36.643170 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-84a9bae4-ec00-4caf-8710-ea13eeb28604 req-28ea6198-b841-431f-8dc9-8c5f8dcc2acc service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:36.643423 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be1dbc00-ddef-4797-9cf6-048797a5cffd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:36.643776 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-84a9bae4-ec00-4caf-8710-ea13eeb28604 req-28ea6198-b841-431f-8dc9-8c5f8dcc2acc service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:36.644801 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be1dbc00-ddef-4797-9cf6-048797a5cffd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:36.645470 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be1dbc00-ddef-4797-9cf6-048797a5cffd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:36.657503 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-84a9bae4-ec00-4caf-8710-ea13eeb28604 req-28ea6198-b841-431f-8dc9-8c5f8dcc2acc service nova] Creating event network-vif-plugged:0762f466-ea31-44a7-9ac5-75aaf39b80a6 for instance fdec5afc-3a3a-4d61-a934-5edf0c7c1397 on n-h2-846466-12 Aug 04 16:58:36.663930 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-84a9bae4-ec00-4caf-8710-ea13eeb28604 req-28ea6198-b841-431f-8dc9-8c5f8dcc2acc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034691 Aug 04 16:58:36.665585 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2172/4267] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:36.673209 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0125d933-fb22-4865-8b8c-5fbbf5911f44 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:36.674383 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0125d933-fb22-4865-8b8c-5fbbf5911f44 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] [instance: e2ca7015-c972-40a6-bca5-2b1c1e56dcb1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:36.684886 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0125d933-fb22-4865-8b8c-5fbbf5911f44 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:36.685817 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0125d933-fb22-4865-8b8c-5fbbf5911f44 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:36.686592 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0125d933-fb22-4865-8b8c-5fbbf5911f44 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:36.687019 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0125d933-fb22-4865-8b8c-5fbbf5911f44 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:36.728046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0125d933-fb22-4865-8b8c-5fbbf5911f44 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] [instance: e2ca7015-c972-40a6-bca5-2b1c1e56dcb1] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:58:36.828421 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0125d933-fb22-4865-8b8c-5fbbf5911f44 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e2ca7015-c972-40a6-bca5-2b1c1e56dcb1" status: 204 len: 0 microversion: 2.1 time: 0.161021 Aug 04 16:58:36.829385 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2173/4268] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:58:36 2022] DELETE /compute/v2.1/servers/e2ca7015-c972-40a6-bca5-2b1c1e56dcb1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:58:36.836586 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-be1dbc00-ddef-4797-9cf6-048797a5cffd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:36.840158 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-07bdab40-7366-4e1e-a1ab-e236104838e3 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:36.841248 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-07bdab40-7366-4e1e-a1ab-e236104838e3 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] [instance: e2ca7015-c972-40a6-bca5-2b1c1e56dcb1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:36.847361 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-be1dbc00-ddef-4797-9cf6-048797a5cffd tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1510 microversion: 2.1 time: 0.247648 Aug 04 16:58:36.847703 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-07bdab40-7366-4e1e-a1ab-e236104838e3 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:36.848139 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-07bdab40-7366-4e1e-a1ab-e236104838e3 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:36.849106 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-07bdab40-7366-4e1e-a1ab-e236104838e3 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:36.849579 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-07bdab40-7366-4e1e-a1ab-e236104838e3 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:36.861558 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2096/4269] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:36 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1510 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:37.047620 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-07bdab40-7366-4e1e-a1ab-e236104838e3 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689e7547be3c4c76beeeff391336e1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fd156c09a24dc5bdb7e8897890b157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:37.057332 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-07bdab40-7366-4e1e-a1ab-e236104838e3 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] 10.222.0.23 "GET /compute/v2.1/servers/e2ca7015-c972-40a6-bca5-2b1c1e56dcb1" status: 200 len: 1471 microversion: 2.1 time: 0.223253 Aug 04 16:58:37.058234 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2174/4270] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:36 2022] GET /compute/v2.1/servers/e2ca7015-c972-40a6-bca5-2b1c1e56dcb1 => generated 1471 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:58:37.116911 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5b1c6593-75ef-43c0-aa5a-020968968487 tempest-MultipleCreateNegativeTestJSON-654273940 tempest-MultipleCreateNegativeTestJSON-654273940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1314975049", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:37.120411 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-5b1c6593-75ef-43c0-aa5a-020968968487 tempest-MultipleCreateNegativeTestJSON-654273940 tempest-MultipleCreateNegativeTestJSON-654273940-project] HTTP exception thrown: min_count must be <= max_count Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5b1c6593-75ef-43c0-aa5a-020968968487 tempest-MultipleCreateNegativeTestJSON-654273940 tempest-MultipleCreateNegativeTestJSON-654273940-project] Request method failure captured: Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 184 Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_q8Hnf2rm54CCKvwIx1b2LRtr6iyzJU52lmY30y9z3Axx5YJcuixVeOdTA6Eq9AjhihU7Y2kDC6mtcv4p3TaHIzOAcZaH479Ym1DyxMmcxm-ngf_8BqWligDXt2upeVRW1tf0H3FG6tnvD-GYR3uvN3yio1x3WAppZ4Wpqa7Y3rltA Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 45ffaf976dec4dc29cebf9feb6b2f21d Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-654273940 Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45ffaf976dec4dc29cebf9feb6b2f21d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_45ffaf976dec4dc29cebf9feb6b2f21d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45ffaf976dec4dc29cebf9feb6b2f21d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/45ffaf976dec4dc29cebf9feb6b2f21d"}]}] Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-654273940 Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 45ffaf976dec4dc29cebf9feb6b2f21d Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-654273940 Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-MultipleCreateNegativeTestJSON-654273940-project Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: e383a74f21514703936d1d38bc501cc2 Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-654273940-project Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1314975049", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: exception: min_count must be <= max_count Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1314975049', 'imageRef': '58d80c01-1581-4a2f-bbb0-c2eaf1affa00', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 04 16:58:37.122197 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:37.127098 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5b1c6593-75ef-43c0-aa5a-020968968487 tempest-MultipleCreateNegativeTestJSON-654273940 tempest-MultipleCreateNegativeTestJSON-654273940-project] Returning 400 to user: min_count must be <= max_count {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:37.127098 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5b1c6593-75ef-43c0-aa5a-020968968487 tempest-MultipleCreateNegativeTestJSON-654273940 tempest-MultipleCreateNegativeTestJSON-654273940-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.149720 Aug 04 16:58:37.127098 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2097/4271] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:58:36 2022] POST /compute/v2.1/servers => generated 74 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 16:58:37.179424 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ee9ccc3e-5997-4911-b0cb-45a69bee15c4 tempest-MultipleCreateNegativeTestJSON-654273940 tempest-MultipleCreateNegativeTestJSON-654273940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-989061194", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "max_count": 0}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ee9ccc3e-5997-4911-b0cb-45a69bee15c4 tempest-MultipleCreateNegativeTestJSON-654273940 tempest-MultipleCreateNegativeTestJSON-654273940-project] Request method failure captured: Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 167 Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_q8Hnf2rm54CCKvwIx1b2LRtr6iyzJU52lmY30y9z3Axx5YJcuixVeOdTA6Eq9AjhihU7Y2kDC6mtcv4p3TaHIzOAcZaH479Ym1DyxMmcxm-ngf_8BqWligDXt2upeVRW1tf0H3FG6tnvD-GYR3uvN3yio1x3WAppZ4Wpqa7Y3rltA Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 45ffaf976dec4dc29cebf9feb6b2f21d Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-654273940 Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45ffaf976dec4dc29cebf9feb6b2f21d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_45ffaf976dec4dc29cebf9feb6b2f21d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45ffaf976dec4dc29cebf9feb6b2f21d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/45ffaf976dec4dc29cebf9feb6b2f21d"}]}] Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-654273940 Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 45ffaf976dec4dc29cebf9feb6b2f21d Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-654273940 Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-MultipleCreateNegativeTestJSON-654273940-project Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: e383a74f21514703936d1d38bc501cc2 Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-654273940-project Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-989061194", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "max_count": 0}} Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-989061194', 'imageRef': '58d80c01-1581-4a2f-bbb0-c2eaf1affa00', 'flavorRef': '452', 'max_count': 0}}} Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 0 Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 16:58:37.183438 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 16:58:37.189787 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:58:37.189787 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:58:37.189787 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:58:37.189787 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:58:37.189787 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 04 16:58:37.189787 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:37.189787 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:37.189787 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:37.189787 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:37.189787 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:37.189787 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:37.189787 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:58:37.189787 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:58:37.189787 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 04 16:58:37.189787 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:37.189787 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ee9ccc3e-5997-4911-b0cb-45a69bee15c4 tempest-MultipleCreateNegativeTestJSON-654273940 tempest-MultipleCreateNegativeTestJSON-654273940-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:37.189787 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ee9ccc3e-5997-4911-b0cb-45a69bee15c4 tempest-MultipleCreateNegativeTestJSON-654273940 tempest-MultipleCreateNegativeTestJSON-654273940-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.009808 Aug 04 16:58:37.193682 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2175/4272] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:58:37 2022] POST /compute/v2.1/servers => generated 130 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:58:37.250183 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2ee064e4-4f00-48be-be33-5ab10cfb996b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:37.251098 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2ee064e4-4f00-48be-be33-5ab10cfb996b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:37.260076 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ee064e4-4f00-48be-be33-5ab10cfb996b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:37.260803 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ee064e4-4f00-48be-be33-5ab10cfb996b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:37.261612 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ee064e4-4f00-48be-be33-5ab10cfb996b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:37.262449 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ee064e4-4f00-48be-be33-5ab10cfb996b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:37.310714 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b1943aca-ba1c-48b4-8bc2-ba7c018a59b1 tempest-MultipleCreateNegativeTestJSON-654273940 tempest-MultipleCreateNegativeTestJSON-654273940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1604530523", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "max_count": 2.5}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b1943aca-ba1c-48b4-8bc2-ba7c018a59b1 tempest-MultipleCreateNegativeTestJSON-654273940 tempest-MultipleCreateNegativeTestJSON-654273940-project] Request method failure captured: Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 170 Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_q8Hnf2rm54CCKvwIx1b2LRtr6iyzJU52lmY30y9z3Axx5YJcuixVeOdTA6Eq9AjhihU7Y2kDC6mtcv4p3TaHIzOAcZaH479Ym1DyxMmcxm-ngf_8BqWligDXt2upeVRW1tf0H3FG6tnvD-GYR3uvN3yio1x3WAppZ4Wpqa7Y3rltA Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 45ffaf976dec4dc29cebf9feb6b2f21d Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-654273940 Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45ffaf976dec4dc29cebf9feb6b2f21d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_45ffaf976dec4dc29cebf9feb6b2f21d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45ffaf976dec4dc29cebf9feb6b2f21d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/45ffaf976dec4dc29cebf9feb6b2f21d"}]}] Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-654273940 Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 45ffaf976dec4dc29cebf9feb6b2f21d Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-654273940 Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-MultipleCreateNegativeTestJSON-654273940-project Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: e383a74f21514703936d1d38bc501cc2 Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-654273940-project Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1604530523", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "max_count": 2.5}} Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1604530523', 'imageRef': '58d80c01-1581-4a2f-bbb0-c2eaf1affa00', 'flavorRef': '452', 'max_count': 2.5}}} Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 2.5 Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 16:58:37.314601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 16:58:37.319309 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:58:37.319309 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:58:37.319309 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:58:37.319309 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:58:37.319309 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 04 16:58:37.319309 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:37.319309 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:37.319309 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:37.319309 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:37.319309 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:37.319309 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:37.319309 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:58:37.319309 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:58:37.319309 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 04 16:58:37.319309 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:37.319309 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b1943aca-ba1c-48b4-8bc2-ba7c018a59b1 tempest-MultipleCreateNegativeTestJSON-654273940 tempest-MultipleCreateNegativeTestJSON-654273940-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:37.319309 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b1943aca-ba1c-48b4-8bc2-ba7c018a59b1 tempest-MultipleCreateNegativeTestJSON-654273940 tempest-MultipleCreateNegativeTestJSON-654273940-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.011799 Aug 04 16:58:37.329377 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2176/4273] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:58:37 2022] POST /compute/v2.1/servers => generated 139 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 16:58:37.373566 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3c578e72-a976-466b-a40d-91abf5efb68c tempest-MultipleCreateNegativeTestJSON-654273940 tempest-MultipleCreateNegativeTestJSON-654273940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1543121944", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "min_count": 0}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3c578e72-a976-466b-a40d-91abf5efb68c tempest-MultipleCreateNegativeTestJSON-654273940 tempest-MultipleCreateNegativeTestJSON-654273940-project] Request method failure captured: Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 168 Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_q8Hnf2rm54CCKvwIx1b2LRtr6iyzJU52lmY30y9z3Axx5YJcuixVeOdTA6Eq9AjhihU7Y2kDC6mtcv4p3TaHIzOAcZaH479Ym1DyxMmcxm-ngf_8BqWligDXt2upeVRW1tf0H3FG6tnvD-GYR3uvN3yio1x3WAppZ4Wpqa7Y3rltA Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 45ffaf976dec4dc29cebf9feb6b2f21d Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-654273940 Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45ffaf976dec4dc29cebf9feb6b2f21d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_45ffaf976dec4dc29cebf9feb6b2f21d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45ffaf976dec4dc29cebf9feb6b2f21d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/45ffaf976dec4dc29cebf9feb6b2f21d"}]}] Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-654273940 Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 45ffaf976dec4dc29cebf9feb6b2f21d Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-654273940 Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-MultipleCreateNegativeTestJSON-654273940-project Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: e383a74f21514703936d1d38bc501cc2 Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-654273940-project Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1543121944", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "min_count": 0}} Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1543121944', 'imageRef': '58d80c01-1581-4a2f-bbb0-c2eaf1affa00', 'flavorRef': '452', 'min_count': 0}}} Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 0 Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 16:58:37.379852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 16:58:37.395585 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:58:37.395585 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:58:37.395585 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:58:37.395585 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:58:37.395585 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 04 16:58:37.395585 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:37.395585 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:37.395585 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:37.395585 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:37.395585 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:37.395585 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:37.395585 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:58:37.395585 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:58:37.395585 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 04 16:58:37.395585 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:37.395585 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3c578e72-a976-466b-a40d-91abf5efb68c tempest-MultipleCreateNegativeTestJSON-654273940 tempest-MultipleCreateNegativeTestJSON-654273940-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:37.395585 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3c578e72-a976-466b-a40d-91abf5efb68c tempest-MultipleCreateNegativeTestJSON-654273940 tempest-MultipleCreateNegativeTestJSON-654273940-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.015266 Aug 04 16:58:37.399334 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2177/4274] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:58:37 2022] POST /compute/v2.1/servers => generated 130 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:58:37.422224 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2ee064e4-4f00-48be-be33-5ab10cfb996b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:37.431755 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2ee064e4-4f00-48be-be33-5ab10cfb996b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:37.433053 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2ee064e4-4f00-48be-be33-5ab10cfb996b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:37.449133 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2ee064e4-4f00-48be-be33-5ab10cfb996b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1406 microversion: 2.20 time: 0.203045 Aug 04 16:58:37.453967 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cba78f50-15df-4fda-8867-e389c4d102ba tempest-MultipleCreateNegativeTestJSON-654273940 tempest-MultipleCreateNegativeTestJSON-654273940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1166994479", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "min_count": 2.5}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cba78f50-15df-4fda-8867-e389c4d102ba tempest-MultipleCreateNegativeTestJSON-654273940 tempest-MultipleCreateNegativeTestJSON-654273940-project] Request method failure captured: Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 170 Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_q8Hnf2rm54CCKvwIx1b2LRtr6iyzJU52lmY30y9z3Axx5YJcuixVeOdTA6Eq9AjhihU7Y2kDC6mtcv4p3TaHIzOAcZaH479Ym1DyxMmcxm-ngf_8BqWligDXt2upeVRW1tf0H3FG6tnvD-GYR3uvN3yio1x3WAppZ4Wpqa7Y3rltA Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 45ffaf976dec4dc29cebf9feb6b2f21d Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-654273940 Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45ffaf976dec4dc29cebf9feb6b2f21d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_45ffaf976dec4dc29cebf9feb6b2f21d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45ffaf976dec4dc29cebf9feb6b2f21d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/45ffaf976dec4dc29cebf9feb6b2f21d"}]}] Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-654273940 Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 45ffaf976dec4dc29cebf9feb6b2f21d Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-654273940 Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-MultipleCreateNegativeTestJSON-654273940-project Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: e383a74f21514703936d1d38bc501cc2 Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-654273940-project Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1166994479", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "min_count": 2.5}} Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1166994479', 'imageRef': '58d80c01-1581-4a2f-bbb0-c2eaf1affa00', 'flavorRef': '452', 'min_count': 2.5}}} Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 2.5 Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 16:58:37.458130 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 16:58:37.462222 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:58:37.462222 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:58:37.462222 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:58:37.462222 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:58:37.462222 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 04 16:58:37.462222 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:37.462222 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:37.462222 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:37.462222 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:37.462222 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:37.462222 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:37.462222 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:58:37.462222 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:58:37.462222 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 04 16:58:37.462222 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:37.462222 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cba78f50-15df-4fda-8867-e389c4d102ba tempest-MultipleCreateNegativeTestJSON-654273940 tempest-MultipleCreateNegativeTestJSON-654273940-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:37.462222 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cba78f50-15df-4fda-8867-e389c4d102ba tempest-MultipleCreateNegativeTestJSON-654273940 tempest-MultipleCreateNegativeTestJSON-654273940-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.010055 Aug 04 16:58:37.462222 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2178/4275] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:58:37 2022] POST /compute/v2.1/servers => generated 139 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 16:58:37.463333 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2098/4276] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:37 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:37.651946 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c19f3fe6-bf93-4fe5-ab43-c805651c60b4 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:37.652620 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c19f3fe6-bf93-4fe5-ab43-c805651c60b4 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] [instance: e6db45a6-8552-48d5-b89f-08f706f51320] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:37.661241 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c19f3fe6-bf93-4fe5-ab43-c805651c60b4 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:37.661708 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c19f3fe6-bf93-4fe5-ab43-c805651c60b4 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:37.662670 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c19f3fe6-bf93-4fe5-ab43-c805651c60b4 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:37.663262 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c19f3fe6-bf93-4fe5-ab43-c805651c60b4 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:37.810915 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c19f3fe6-bf93-4fe5-ab43-c805651c60b4 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccc05e487794576a1a4ecd820fd6af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b318eefcfdf344e1b97d6a81c93e73f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:37.820037 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c19f3fe6-bf93-4fe5-ab43-c805651c60b4 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] 10.222.0.23 "GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320" status: 200 len: 1526 microversion: 2.1 time: 0.176063 Aug 04 16:58:37.820740 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2179/4277] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:37 2022] GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320 => generated 1526 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:37.868182 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-19116c65-69bb-4d70-9867-17682da13e6a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:37.868793 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-19116c65-69bb-4d70-9867-17682da13e6a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:37.877270 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-19116c65-69bb-4d70-9867-17682da13e6a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:37.878244 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-19116c65-69bb-4d70-9867-17682da13e6a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:37.879294 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-19116c65-69bb-4d70-9867-17682da13e6a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:37.879712 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-19116c65-69bb-4d70-9867-17682da13e6a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:38.071800 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-19116c65-69bb-4d70-9867-17682da13e6a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:38.082204 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-19116c65-69bb-4d70-9867-17682da13e6a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1510 microversion: 2.1 time: 0.217870 Aug 04 16:58:38.083291 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2099/4278] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:37 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1510 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:38.085420 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6494bd48-165d-41cb-9369-b60d5bec34c6 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:38.086054 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6494bd48-165d-41cb-9369-b60d5bec34c6 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] [instance: e2ca7015-c972-40a6-bca5-2b1c1e56dcb1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:38.094520 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6494bd48-165d-41cb-9369-b60d5bec34c6 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:38.094959 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6494bd48-165d-41cb-9369-b60d5bec34c6 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:38.096280 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6494bd48-165d-41cb-9369-b60d5bec34c6 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:38.096723 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6494bd48-165d-41cb-9369-b60d5bec34c6 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:38.102766 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:38.266517 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6494bd48-165d-41cb-9369-b60d5bec34c6 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689e7547be3c4c76beeeff391336e1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fd156c09a24dc5bdb7e8897890b157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:38.274931 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6494bd48-165d-41cb-9369-b60d5bec34c6 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] 10.222.0.23 "GET /compute/v2.1/servers/e2ca7015-c972-40a6-bca5-2b1c1e56dcb1" status: 200 len: 1471 microversion: 2.1 time: 0.198368 Aug 04 16:58:38.275511 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2180/4279] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:38 2022] GET /compute/v2.1/servers/e2ca7015-c972-40a6-bca5-2b1c1e56dcb1 => generated 1471 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:58:38.474636 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9552d267-b69e-4dc1-abc1-1ff59c228722 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:38.475723 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9552d267-b69e-4dc1-abc1-1ff59c228722 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:38.482149 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9552d267-b69e-4dc1-abc1-1ff59c228722 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:38.482836 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9552d267-b69e-4dc1-abc1-1ff59c228722 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:38.483666 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9552d267-b69e-4dc1-abc1-1ff59c228722 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:38.484095 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9552d267-b69e-4dc1-abc1-1ff59c228722 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:38.633836 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9552d267-b69e-4dc1-abc1-1ff59c228722 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:38.659661 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9552d267-b69e-4dc1-abc1-1ff59c228722 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:38.661178 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9552d267-b69e-4dc1-abc1-1ff59c228722 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:38.662342 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9552d267-b69e-4dc1-abc1-1ff59c228722 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1406 microversion: 2.20 time: 0.191762 Aug 04 16:58:38.662904 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2100/4280] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:38 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:38.841987 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0f36403d-c669-4742-a210-b19069b910a2 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:38.843680 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0f36403d-c669-4742-a210-b19069b910a2 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] [instance: e6db45a6-8552-48d5-b89f-08f706f51320] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:38.852602 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0f36403d-c669-4742-a210-b19069b910a2 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:38.853697 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0f36403d-c669-4742-a210-b19069b910a2 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:38.855056 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0f36403d-c669-4742-a210-b19069b910a2 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:38.856003 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0f36403d-c669-4742-a210-b19069b910a2 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:39.103933 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5da877d9-0249-464f-9fbc-ff85bebe70a6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:39.104637 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5da877d9-0249-464f-9fbc-ff85bebe70a6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:39.116572 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0f36403d-c669-4742-a210-b19069b910a2 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccc05e487794576a1a4ecd820fd6af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b318eefcfdf344e1b97d6a81c93e73f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:39.119493 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5da877d9-0249-464f-9fbc-ff85bebe70a6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:39.120114 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5da877d9-0249-464f-9fbc-ff85bebe70a6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:39.120954 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5da877d9-0249-464f-9fbc-ff85bebe70a6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:39.121753 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5da877d9-0249-464f-9fbc-ff85bebe70a6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:39.127754 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0f36403d-c669-4742-a210-b19069b910a2 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] 10.222.0.23 "GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320" status: 200 len: 1526 microversion: 2.1 time: 0.289683 Aug 04 16:58:39.128707 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2181/4281] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:38 2022] GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320 => generated 1526 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:39.296211 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5519a57a-2be1-4570-8500-da83340dfb37 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:39.297059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5519a57a-2be1-4570-8500-da83340dfb37 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] [instance: e2ca7015-c972-40a6-bca5-2b1c1e56dcb1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:39.305778 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5519a57a-2be1-4570-8500-da83340dfb37 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:39.306511 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5519a57a-2be1-4570-8500-da83340dfb37 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:39.308230 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5519a57a-2be1-4570-8500-da83340dfb37 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:39.309468 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5519a57a-2be1-4570-8500-da83340dfb37 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:39.443928 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5da877d9-0249-464f-9fbc-ff85bebe70a6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:39.453519 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5da877d9-0249-464f-9fbc-ff85bebe70a6 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1510 microversion: 2.1 time: 0.353230 Aug 04 16:58:39.466046 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2101/4282] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:39 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1510 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:39.617071 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5519a57a-2be1-4570-8500-da83340dfb37 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689e7547be3c4c76beeeff391336e1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fd156c09a24dc5bdb7e8897890b157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:39.631793 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5519a57a-2be1-4570-8500-da83340dfb37 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] 10.222.0.23 "GET /compute/v2.1/servers/e2ca7015-c972-40a6-bca5-2b1c1e56dcb1" status: 200 len: 1471 microversion: 2.1 time: 0.339500 Aug 04 16:58:39.636479 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2182/4283] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:39 2022] GET /compute/v2.1/servers/e2ca7015-c972-40a6-bca5-2b1c1e56dcb1 => generated 1471 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:58:39.686887 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a607ef4d-83c4-4f98-8535-9b710eaf8b66 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:39.687501 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a607ef4d-83c4-4f98-8535-9b710eaf8b66 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:39.697951 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a607ef4d-83c4-4f98-8535-9b710eaf8b66 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:39.698506 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a607ef4d-83c4-4f98-8535-9b710eaf8b66 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:39.700476 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a607ef4d-83c4-4f98-8535-9b710eaf8b66 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:39.704908 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a607ef4d-83c4-4f98-8535-9b710eaf8b66 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:39.730521 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-139a4793-6f7d-48a1-8e43-9d566a65de9f req-1c2b4d74-94a8-41a1-8903-6c06258212cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6db45a6-8552-48d5-b89f-08f706f51320", "name": "network-vif-deleted", "tag": "7819fa2c-a3cb-4c0e-a913-ca15d09393ce"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:39.756095 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-139a4793-6f7d-48a1-8e43-9d566a65de9f req-1c2b4d74-94a8-41a1-8903-6c06258212cd service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:39.756880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-139a4793-6f7d-48a1-8e43-9d566a65de9f req-1c2b4d74-94a8-41a1-8903-6c06258212cd service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:39.788133 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-139a4793-6f7d-48a1-8e43-9d566a65de9f req-1c2b4d74-94a8-41a1-8903-6c06258212cd service nova] Creating event network-vif-deleted:7819fa2c-a3cb-4c0e-a913-ca15d09393ce for instance e6db45a6-8552-48d5-b89f-08f706f51320 on n-h2-846466-12 Aug 04 16:58:39.796591 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-139a4793-6f7d-48a1-8e43-9d566a65de9f req-1c2b4d74-94a8-41a1-8903-6c06258212cd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071401 Aug 04 16:58:39.798855 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2183/4284] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:40.057797 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-11bfb0d8-7673-4451-a8db-7198bf2dcf52 req-86e865a8-88f7-4f82-b71d-8d11338f4a26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2ca7015-c972-40a6-bca5-2b1c1e56dcb1", "name": "network-vif-deleted", "tag": "598010eb-9ab0-4b4e-80ef-cda94c54294c"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:40.069223 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-11bfb0d8-7673-4451-a8db-7198bf2dcf52 req-86e865a8-88f7-4f82-b71d-8d11338f4a26 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:40.069411 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-11bfb0d8-7673-4451-a8db-7198bf2dcf52 req-86e865a8-88f7-4f82-b71d-8d11338f4a26 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:40.086911 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-11bfb0d8-7673-4451-a8db-7198bf2dcf52 req-86e865a8-88f7-4f82-b71d-8d11338f4a26 service nova] Creating event network-vif-deleted:598010eb-9ab0-4b4e-80ef-cda94c54294c for instance e2ca7015-c972-40a6-bca5-2b1c1e56dcb1 on n-h2-846466-12 Aug 04 16:58:40.093601 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-11bfb0d8-7673-4451-a8db-7198bf2dcf52 req-86e865a8-88f7-4f82-b71d-8d11338f4a26 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040521 Aug 04 16:58:40.094889 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2184/4285] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:58:40.155435 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-eec98768-8cdf-4d95-9677-e30dff57b190 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:40.156489 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-eec98768-8cdf-4d95-9677-e30dff57b190 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] [instance: e6db45a6-8552-48d5-b89f-08f706f51320] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:40.156717 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a607ef4d-83c4-4f98-8535-9b710eaf8b66 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:40.168276 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eec98768-8cdf-4d95-9677-e30dff57b190 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:40.168733 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eec98768-8cdf-4d95-9677-e30dff57b190 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:40.169547 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eec98768-8cdf-4d95-9677-e30dff57b190 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:40.169982 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eec98768-8cdf-4d95-9677-e30dff57b190 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:40.171234 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a607ef4d-83c4-4f98-8535-9b710eaf8b66 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:40.172993 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a607ef4d-83c4-4f98-8535-9b710eaf8b66 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:40.173917 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a607ef4d-83c4-4f98-8535-9b710eaf8b66 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1406 microversion: 2.20 time: 0.493107 Aug 04 16:58:40.180325 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2102/4286] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:39 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1406 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:40.201522 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:40.207822 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eec98768-8cdf-4d95-9677-e30dff57b190 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:40.208264 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eec98768-8cdf-4d95-9677-e30dff57b190 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:40.208724 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-eec98768-8cdf-4d95-9677-e30dff57b190 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lazy-loading 'fault' on Instance uuid e6db45a6-8552-48d5-b89f-08f706f51320 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:58:40.296222 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-eec98768-8cdf-4d95-9677-e30dff57b190 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccc05e487794576a1a4ecd820fd6af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b318eefcfdf344e1b97d6a81c93e73f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:40.318669 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-eec98768-8cdf-4d95-9677-e30dff57b190 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] 10.222.0.23 "GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320" status: 200 len: 1314 microversion: 2.1 time: 0.170755 Aug 04 16:58:40.319316 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2185/4287] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:40 2022] GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:40.475661 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bd213826-bae4-4d7e-ae5a-f96842da3be5 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:40.476664 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bd213826-bae4-4d7e-ae5a-f96842da3be5 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:40.489729 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bd213826-bae4-4d7e-ae5a-f96842da3be5 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:40.490429 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bd213826-bae4-4d7e-ae5a-f96842da3be5 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:40.491358 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bd213826-bae4-4d7e-ae5a-f96842da3be5 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:40.491973 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bd213826-bae4-4d7e-ae5a-f96842da3be5 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:40.658086 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8cf1392f-c7be-4d4d-b5b4-dde86ce23ae6 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:40.658986 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8cf1392f-c7be-4d4d-b5b4-dde86ce23ae6 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] [instance: e2ca7015-c972-40a6-bca5-2b1c1e56dcb1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:40.666263 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8cf1392f-c7be-4d4d-b5b4-dde86ce23ae6 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:40.666913 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8cf1392f-c7be-4d4d-b5b4-dde86ce23ae6 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:40.667692 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8cf1392f-c7be-4d4d-b5b4-dde86ce23ae6 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:40.668340 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8cf1392f-c7be-4d4d-b5b4-dde86ce23ae6 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:40.698314 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bd213826-bae4-4d7e-ae5a-f96842da3be5 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:40.711501 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8cf1392f-c7be-4d4d-b5b4-dde86ce23ae6 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:40.711981 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8cf1392f-c7be-4d4d-b5b4-dde86ce23ae6 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:40.712347 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-8cf1392f-c7be-4d4d-b5b4-dde86ce23ae6 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lazy-loading 'fault' on Instance uuid e2ca7015-c972-40a6-bca5-2b1c1e56dcb1 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:58:40.723264 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bd213826-bae4-4d7e-ae5a-f96842da3be5 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1510 microversion: 2.1 time: 0.250851 Aug 04 16:58:40.724209 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2103/4288] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:40 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1510 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:40.781992 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8cf1392f-c7be-4d4d-b5b4-dde86ce23ae6 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689e7547be3c4c76beeeff391336e1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fd156c09a24dc5bdb7e8897890b157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:40.793034 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8cf1392f-c7be-4d4d-b5b4-dde86ce23ae6 tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] 10.222.0.23 "GET /compute/v2.1/servers/e2ca7015-c972-40a6-bca5-2b1c1e56dcb1" status: 200 len: 1305 microversion: 2.1 time: 0.138248 Aug 04 16:58:40.794450 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2186/4289] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:40 2022] GET /compute/v2.1/servers/e2ca7015-c972-40a6-bca5-2b1c1e56dcb1 => generated 1305 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:41.196287 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-77db08c6-41f4-41fa-8e66-1e423627648f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:41.196991 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-77db08c6-41f4-41fa-8e66-1e423627648f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:41.206838 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-77db08c6-41f4-41fa-8e66-1e423627648f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:41.207604 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-77db08c6-41f4-41fa-8e66-1e423627648f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:41.208900 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-77db08c6-41f4-41fa-8e66-1e423627648f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:41.209552 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-77db08c6-41f4-41fa-8e66-1e423627648f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:41.348102 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ef1bf9f4-8b9d-4002-bd3c-4cbb40f667a0 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:41.348906 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ef1bf9f4-8b9d-4002-bd3c-4cbb40f667a0 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] [instance: e6db45a6-8552-48d5-b89f-08f706f51320] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:41.369149 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef1bf9f4-8b9d-4002-bd3c-4cbb40f667a0 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:41.369756 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef1bf9f4-8b9d-4002-bd3c-4cbb40f667a0 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:41.370885 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef1bf9f4-8b9d-4002-bd3c-4cbb40f667a0 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:41.373142 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef1bf9f4-8b9d-4002-bd3c-4cbb40f667a0 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:41.401930 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-ef1bf9f4-8b9d-4002-bd3c-4cbb40f667a0 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] HTTP exception thrown: Instance e6db45a6-8552-48d5-b89f-08f706f51320 could not be found. Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ef1bf9f4-8b9d-4002-bd3c-4cbb40f667a0 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Request method failure captured: Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320 HTTP/1.1 Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_qge7BtUV7jEMtrjlo9zs2LdrhsgNm16-3nEYJMDbpoXSBJ0R4syWewuz69h6x9Sfxudq5GAf-etC7fdaIaCkQeXLlIcOfgKKaQ222hKtDjO7DbbID_c-hs4ImKoNP3Sfr2x2Dnb_KzWeB1fqR2GsJX3QO1EKPsj5_yaQyZOPWk27I Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: b318eefcfdf344e1b97d6a81c93e73f8 Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-937734961 Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b318eefcfdf344e1b97d6a81c93e73f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b318eefcfdf344e1b97d6a81c93e73f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b318eefcfdf344e1b97d6a81c93e73f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b318eefcfdf344e1b97d6a81c93e73f8"}]}] Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-937734961 Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: b318eefcfdf344e1b97d6a81c93e73f8 Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-937734961 Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerMetadataNegativeTestJSON-937734961-project Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: cccc05e487794576a1a4ecd820fd6af6 Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-937734961-project Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance e6db45a6-8552-48d5-b89f-08f706f51320 could not be found. Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'e6db45a6-8552-48d5-b89f-08f706f51320'} Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6db45a6-8552-48d5-b89f-08f706f51320 could not be found. Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6db45a6-8552-48d5-b89f-08f706f51320 could not be found. Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:41.405897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:41.410077 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:41.410077 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:41.410077 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:41.410077 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:41.410077 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:41.410077 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:41.410077 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6db45a6-8552-48d5-b89f-08f706f51320 could not be found. Aug 04 16:58:41.410077 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:41.410077 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ef1bf9f4-8b9d-4002-bd3c-4cbb40f667a0 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] Returning 404 to user: Instance e6db45a6-8552-48d5-b89f-08f706f51320 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:41.410077 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ef1bf9f4-8b9d-4002-bd3c-4cbb40f667a0 tempest-ServerMetadataNegativeTestJSON-937734961 tempest-ServerMetadataNegativeTestJSON-937734961-project] 10.222.0.23 "GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320" status: 404 len: 111 microversion: 2.1 time: 0.071294 Aug 04 16:58:41.414450 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2187/4290] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:41 2022] GET /compute/v2.1/servers/e6db45a6-8552-48d5-b89f-08f706f51320 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:58:41.480185 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-77db08c6-41f4-41fa-8e66-1e423627648f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:41.493535 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-77db08c6-41f4-41fa-8e66-1e423627648f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:41.495236 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-77db08c6-41f4-41fa-8e66-1e423627648f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:41.497367 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-77db08c6-41f4-41fa-8e66-1e423627648f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1599 microversion: 2.20 time: 0.305170 Aug 04 16:58:41.500554 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2104/4291] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:41 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1599 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:41.524579 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-276942ed-799b-4c46-afbb-211e6b37fc19 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:41.525363 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-276942ed-799b-4c46-afbb-211e6b37fc19 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:41.539365 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-276942ed-799b-4c46-afbb-211e6b37fc19 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:41.544472 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-276942ed-799b-4c46-afbb-211e6b37fc19 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:41.545557 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-276942ed-799b-4c46-afbb-211e6b37fc19 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:41.546226 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-276942ed-799b-4c46-afbb-211e6b37fc19 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:41.736797 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-276942ed-799b-4c46-afbb-211e6b37fc19 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.218126 Aug 04 16:58:41.737410 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2188/4292] 10.222.0.23 () {60 vars in 1316 bytes} [Thu Aug 4 16:58:41 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397/os-interface => generated 285 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:58:41.748937 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c487e6a3-07b4-4115-9c94-be1a0ca715c1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:41.749761 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c487e6a3-07b4-4115-9c94-be1a0ca715c1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:41.760458 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c487e6a3-07b4-4115-9c94-be1a0ca715c1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:41.765693 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c487e6a3-07b4-4115-9c94-be1a0ca715c1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:41.768032 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c487e6a3-07b4-4115-9c94-be1a0ca715c1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:41.768486 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c487e6a3-07b4-4115-9c94-be1a0ca715c1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:41.827833 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1f7f53c9-5dea-49da-97b2-2eae1b6314ee tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:41.828671 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1f7f53c9-5dea-49da-97b2-2eae1b6314ee tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] [instance: e2ca7015-c972-40a6-bca5-2b1c1e56dcb1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:41.841156 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f7f53c9-5dea-49da-97b2-2eae1b6314ee tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:41.842164 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f7f53c9-5dea-49da-97b2-2eae1b6314ee tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:41.843421 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f7f53c9-5dea-49da-97b2-2eae1b6314ee tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:41.844237 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f7f53c9-5dea-49da-97b2-2eae1b6314ee tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:41.865646 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-1f7f53c9-5dea-49da-97b2-2eae1b6314ee tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] HTTP exception thrown: Instance e2ca7015-c972-40a6-bca5-2b1c1e56dcb1 could not be found. Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1f7f53c9-5dea-49da-97b2-2eae1b6314ee tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Request method failure captured: Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/e2ca7015-c972-40a6-bca5-2b1c1e56dcb1 HTTP/1.1 Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_qp4QwvsbL8HHNmmbNYljtCZjeSi5xh4Ynd2G9Dz7oCusyJeoxJvGXTvyUZ9HtVQ-cDdb_uOLzWjn_32B6AHapZ_ap-l4i6y1OaP8rjZScat8-aaEQspRnCNXeH2_uezk-bsXlkVAWX_FiDLRK-Wzcc3S8Y5yFkZKjObvKEJ1oPrXU Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 27fd156c09a24dc5bdb7e8897890b157 Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-VolumesNegativeTest-589324836 Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/27fd156c09a24dc5bdb7e8897890b157"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_27fd156c09a24dc5bdb7e8897890b157"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/27fd156c09a24dc5bdb7e8897890b157"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/27fd156c09a24dc5bdb7e8897890b157"}]}] Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-VolumesNegativeTest-589324836 Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 27fd156c09a24dc5bdb7e8897890b157 Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-VolumesNegativeTest-589324836 Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-VolumesNegativeTest-589324836-project Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 689e7547be3c4c76beeeff391336e1f1 Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-VolumesNegativeTest-589324836-project Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance e2ca7015-c972-40a6-bca5-2b1c1e56dcb1 could not be found. Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'e2ca7015-c972-40a6-bca5-2b1c1e56dcb1'} Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2ca7015-c972-40a6-bca5-2b1c1e56dcb1 could not be found. Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2ca7015-c972-40a6-bca5-2b1c1e56dcb1 could not be found. Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:41.868453 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:41.874178 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:41.874178 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:41.874178 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:41.874178 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:41.874178 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:41.874178 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2ca7015-c972-40a6-bca5-2b1c1e56dcb1 could not be found. Aug 04 16:58:41.874178 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:41.874178 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1f7f53c9-5dea-49da-97b2-2eae1b6314ee tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] Returning 404 to user: Instance e2ca7015-c972-40a6-bca5-2b1c1e56dcb1 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:41.874178 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1f7f53c9-5dea-49da-97b2-2eae1b6314ee tempest-VolumesNegativeTest-589324836 tempest-VolumesNegativeTest-589324836-project] 10.222.0.23 "GET /compute/v2.1/servers/e2ca7015-c972-40a6-bca5-2b1c1e56dcb1" status: 404 len: 111 microversion: 2.1 time: 0.055576 Aug 04 16:58:41.878987 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2189/4293] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:41 2022] GET /compute/v2.1/servers/e2ca7015-c972-40a6-bca5-2b1c1e56dcb1 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:58:42.146559 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c487e6a3-07b4-4115-9c94-be1a0ca715c1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:42.157516 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c487e6a3-07b4-4115-9c94-be1a0ca715c1 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1510 microversion: 2.1 time: 0.414483 Aug 04 16:58:42.173101 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2105/4294] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:41 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1510 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:43.180200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8c08eb35-3f45-4b75-b3ce-b08aa84bbccf tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:43.184947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8c08eb35-3f45-4b75-b3ce-b08aa84bbccf tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:43.205953 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8c08eb35-3f45-4b75-b3ce-b08aa84bbccf tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:43.207176 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8c08eb35-3f45-4b75-b3ce-b08aa84bbccf tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:43.210189 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8c08eb35-3f45-4b75-b3ce-b08aa84bbccf tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:43.212278 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8c08eb35-3f45-4b75-b3ce-b08aa84bbccf tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:43.736459 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8c08eb35-3f45-4b75-b3ce-b08aa84bbccf tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:43.751259 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8c08eb35-3f45-4b75-b3ce-b08aa84bbccf tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1510 microversion: 2.1 time: 0.569256 Aug 04 16:58:43.765825 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2190/4295] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:43 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1510 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:44.722889 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-5167be87-7987-4124-908e-a3b347b63544 req-5d7379e7-1ec4-4224-bb08-35733f5aa37d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdec5afc-3a3a-4d61-a934-5edf0c7c1397", "tag": "0762f466-ea31-44a7-9ac5-75aaf39b80a6"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:44.746207 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-5167be87-7987-4124-908e-a3b347b63544 req-5d7379e7-1ec4-4224-bb08-35733f5aa37d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:44.746600 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-5167be87-7987-4124-908e-a3b347b63544 req-5d7379e7-1ec4-4224-bb08-35733f5aa37d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:44.775974 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fe940f39-d79f-4758-80aa-dba3ab4a44ae tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:44.776999 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fe940f39-d79f-4758-80aa-dba3ab4a44ae tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:44.823998 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fe940f39-d79f-4758-80aa-dba3ab4a44ae tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:44.824499 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fe940f39-d79f-4758-80aa-dba3ab4a44ae tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:44.825485 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fe940f39-d79f-4758-80aa-dba3ab4a44ae tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:44.826068 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fe940f39-d79f-4758-80aa-dba3ab4a44ae tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:44.828464 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-5167be87-7987-4124-908e-a3b347b63544 req-5d7379e7-1ec4-4224-bb08-35733f5aa37d service nova] Creating event network-changed:0762f466-ea31-44a7-9ac5-75aaf39b80a6 for instance fdec5afc-3a3a-4d61-a934-5edf0c7c1397 on n-h2-846466-12 Aug 04 16:58:44.841901 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-5167be87-7987-4124-908e-a3b347b63544 req-5d7379e7-1ec4-4224-bb08-35733f5aa37d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122130 Aug 04 16:58:44.844460 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2106/4296] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:45.855040 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fe940f39-d79f-4758-80aa-dba3ab4a44ae tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:45.867776 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fe940f39-d79f-4758-80aa-dba3ab4a44ae tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1510 microversion: 2.1 time: 1.093441 Aug 04 16:58:45.868690 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2191/4297] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:44 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1510 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:46.893714 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dde091cf-68ab-486f-ac1c-e7d5a198486e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:46.895480 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-dde091cf-68ab-486f-ac1c-e7d5a198486e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:46.913006 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dde091cf-68ab-486f-ac1c-e7d5a198486e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:46.914083 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dde091cf-68ab-486f-ac1c-e7d5a198486e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:46.915082 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dde091cf-68ab-486f-ac1c-e7d5a198486e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:46.916838 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dde091cf-68ab-486f-ac1c-e7d5a198486e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:47.671096 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-dde091cf-68ab-486f-ac1c-e7d5a198486e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:47.680180 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dde091cf-68ab-486f-ac1c-e7d5a198486e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1510 microversion: 2.1 time: 0.791182 Aug 04 16:58:47.687757 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2107/4298] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:46 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1510 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:48.023086 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-56e68982-9b18-4f7d-a2df-c3d07255fe46 tempest-ServerGroup264TestJSON-216869311 tempest-ServerGroup264TestJSON-216869311-project] Action: 'create', calling method: .version_select at 0x7f7e840334c0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:48.077738 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-56e68982-9b18-4f7d-a2df-c3d07255fe46 tempest-ServerGroup264TestJSON-216869311 tempest-ServerGroup264TestJSON-216869311-project] Getting quotas for project eea55749e34644a4a1345924ee8f9e5c. Resources: {'server_groups'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:58:48.089158 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-56e68982-9b18-4f7d-a2df-c3d07255fe46 tempest-ServerGroup264TestJSON-216869311 tempest-ServerGroup264TestJSON-216869311-project] Getting quotas for user e09ad82dd1f14c46be48cd1108358498 and project eea55749e34644a4a1345924ee8f9e5c. Resources: {'server_groups'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:58:48.186320 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-56e68982-9b18-4f7d-a2df-c3d07255fe46 tempest-ServerGroup264TestJSON-216869311 tempest-ServerGroup264TestJSON-216869311-project] Getting quotas for project eea55749e34644a4a1345924ee8f9e5c. Resources: {'server_groups'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:58:48.193835 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-56e68982-9b18-4f7d-a2df-c3d07255fe46 tempest-ServerGroup264TestJSON-216869311 tempest-ServerGroup264TestJSON-216869311-project] Getting quotas for user e09ad82dd1f14c46be48cd1108358498 and project eea55749e34644a4a1345924ee8f9e5c. Resources: {'server_groups'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:58:48.214997 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-56e68982-9b18-4f7d-a2df-c3d07255fe46 tempest-ServerGroup264TestJSON-216869311 tempest-ServerGroup264TestJSON-216869311-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.463853 Aug 04 16:58:48.222461 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2192/4299] 10.222.0.23 () {62 vars in 1214 bytes} [Thu Aug 4 16:58:47 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:58:48.226908 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e5dd163b-2d9d-4e47-af38-8ea4feb7896e tempest-ServerGroup264TestJSON-216869311 tempest-ServerGroup264TestJSON-216869311-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:48.247796 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e5dd163b-2d9d-4e47-af38-8ea4feb7896e tempest-ServerGroup264TestJSON-216869311 tempest-ServerGroup264TestJSON-216869311-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.024652 Aug 04 16:58:48.255184 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2108/4300] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Aug 4 16:58:48 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:58:48.268010 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-38421773-43d8-429f-bc17-e96da741f247 tempest-ServerGroup264TestJSON-216869311 tempest-ServerGroup264TestJSON-216869311-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:48.294850 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-38421773-43d8-429f-bc17-e96da741f247 tempest-ServerGroup264TestJSON-216869311 tempest-ServerGroup264TestJSON-216869311-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/41732d0a-85ab-4d57-b788-78d12ee321ad" status: 200 len: 235 microversion: 2.64 time: 0.030564 Aug 04 16:58:48.303862 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2193/4301] 10.222.0.23 () {60 vars in 1304 bytes} [Thu Aug 4 16:58:48 2022] GET /compute/v2.1/os-server-groups/41732d0a-85ab-4d57-b788-78d12ee321ad => generated 235 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:58:48.308105 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-44ece549-d6f6-4934-a481-55a85eaa2cc9 tempest-ServerGroup264TestJSON-216869311 tempest-ServerGroup264TestJSON-216869311-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:48.364404 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-44ece549-d6f6-4934-a481-55a85eaa2cc9 tempest-ServerGroup264TestJSON-216869311 tempest-ServerGroup264TestJSON-216869311-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/41732d0a-85ab-4d57-b788-78d12ee321ad" status: 204 len: 0 microversion: 2.64 time: 0.058698 Aug 04 16:58:48.365870 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2109/4302] 10.222.0.23 () {60 vars in 1307 bytes} [Thu Aug 4 16:58:48 2022] DELETE /compute/v2.1/os-server-groups/41732d0a-85ab-4d57-b788-78d12ee321ad => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 04 16:58:48.379508 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-35ad9901-6516-46a0-8b06-985b42f1074c tempest-ServerGroup264TestJSON-216869311 tempest-ServerGroup264TestJSON-216869311-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:48.389572 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-35ad9901-6516-46a0-8b06-985b42f1074c tempest-ServerGroup264TestJSON-216869311 tempest-ServerGroup264TestJSON-216869311-project] HTTP exception thrown: Instance group 41732d0a-85ab-4d57-b788-78d12ee321ad could not be found. Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-35ad9901-6516-46a0-8b06-985b42f1074c tempest-ServerGroup264TestJSON-216869311 tempest-ServerGroup264TestJSON-216869311-project] Request method failure captured: Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/os-server-groups/41732d0a-85ab-4d57-b788-78d12ee321ad HTTP/1.1 Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_rHLJHucQzqLwgq7B8XfWyg3UqJ1cZU6tyslPfK2FPf7F9CPb7IXbnHi-LJy54qnHpny96nDO_R7DVm51g9vXWD3iISGelPetrm8DhQ9Bq4_hrpuwzmb1K8N-E2upuYhMuyHlyylM4iMh0yDsEjORanfo-kSjydj_aS3W01gHJr5Zc Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: X-Openstack-Nova-Api-Version: 2.64 Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: eea55749e34644a4a1345924ee8f9e5c Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerGroup264TestJSON-216869311 Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eea55749e34644a4a1345924ee8f9e5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eea55749e34644a4a1345924ee8f9e5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eea55749e34644a4a1345924ee8f9e5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eea55749e34644a4a1345924ee8f9e5c"}]}] Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerGroup264TestJSON-216869311 Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: eea55749e34644a4a1345924ee8f9e5c Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerGroup264TestJSON-216869311 Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerGroup264TestJSON-216869311-project Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: e09ad82dd1f14c46be48cd1108358498 Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerGroup264TestJSON-216869311-project Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance group 41732d0a-85ab-4d57-b788-78d12ee321ad could not be found. Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '41732d0a-85ab-4d57-b788-78d12ee321ad'} Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 41732d0a-85ab-4d57-b788-78d12ee321ad could not be found. Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 41732d0a-85ab-4d57-b788-78d12ee321ad could not be found. Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:48.392482 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:48.396937 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:48.396937 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:48.396937 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:48.396937 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:48.396937 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 41732d0a-85ab-4d57-b788-78d12ee321ad could not be found. Aug 04 16:58:48.396937 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:48.399805 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-35ad9901-6516-46a0-8b06-985b42f1074c tempest-ServerGroup264TestJSON-216869311 tempest-ServerGroup264TestJSON-216869311-project] Returning 404 to user: Instance group 41732d0a-85ab-4d57-b788-78d12ee321ad could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:48.405443 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-35ad9901-6516-46a0-8b06-985b42f1074c tempest-ServerGroup264TestJSON-216869311 tempest-ServerGroup264TestJSON-216869311-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/41732d0a-85ab-4d57-b788-78d12ee321ad" status: 404 len: 117 microversion: 2.64 time: 0.032440 Aug 04 16:58:48.418125 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2194/4303] 10.222.0.23 () {60 vars in 1307 bytes} [Thu Aug 4 16:58:48 2022] DELETE /compute/v2.1/os-server-groups/41732d0a-85ab-4d57-b788-78d12ee321ad => generated 117 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:58:48.708085 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-36b3bc09-1560-42af-bf7f-ba1d2b57cf4f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:48.708808 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-36b3bc09-1560-42af-bf7f-ba1d2b57cf4f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:48.723584 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-36b3bc09-1560-42af-bf7f-ba1d2b57cf4f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:48.724285 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-36b3bc09-1560-42af-bf7f-ba1d2b57cf4f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:48.726878 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-36b3bc09-1560-42af-bf7f-ba1d2b57cf4f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:48.727538 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-36b3bc09-1560-42af-bf7f-ba1d2b57cf4f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:49.285001 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-36b3bc09-1560-42af-bf7f-ba1d2b57cf4f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:49.310539 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-36b3bc09-1560-42af-bf7f-ba1d2b57cf4f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1510 microversion: 2.1 time: 0.598027 Aug 04 16:58:49.310539 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2110/4304] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:48 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1510 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:50.351765 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5148e09d-b894-4246-abfb-12dc71e85f1d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:50.352424 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5148e09d-b894-4246-abfb-12dc71e85f1d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:50.373626 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5148e09d-b894-4246-abfb-12dc71e85f1d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:50.374080 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5148e09d-b894-4246-abfb-12dc71e85f1d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:50.392454 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5148e09d-b894-4246-abfb-12dc71e85f1d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:50.393050 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5148e09d-b894-4246-abfb-12dc71e85f1d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:50.803680 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5148e09d-b894-4246-abfb-12dc71e85f1d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:50.816617 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5148e09d-b894-4246-abfb-12dc71e85f1d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1487 microversion: 2.1 time: 0.489245 Aug 04 16:58:50.837713 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2195/4305] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:50 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1487 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:50.842504 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3f0b8b64-c2f5-4e2b-9194-b004b837faf3 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1251903766"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:50.845868 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3f0b8b64-c2f5-4e2b-9194-b004b837faf3 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:50.866329 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3f0b8b64-c2f5-4e2b-9194-b004b837faf3 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:50.867780 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3f0b8b64-c2f5-4e2b-9194-b004b837faf3 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:50.868718 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3f0b8b64-c2f5-4e2b-9194-b004b837faf3 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:50.870922 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3f0b8b64-c2f5-4e2b-9194-b004b837faf3 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:51.005097 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3f0b8b64-c2f5-4e2b-9194-b004b837faf3 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "PUT /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1061 microversion: 2.1 time: 0.166951 Aug 04 16:58:51.008045 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2111/4306] 10.222.0.23 () {60 vars in 1256 bytes} [Thu Aug 4 16:58:50 2022] PUT /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1061 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:51.037257 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-905596c7-e970-4094-9196-14c5d0bdaf94 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:51.038698 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-905596c7-e970-4094-9196-14c5d0bdaf94 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:51.064119 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-905596c7-e970-4094-9196-14c5d0bdaf94 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:51.064998 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-905596c7-e970-4094-9196-14c5d0bdaf94 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:51.067016 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-905596c7-e970-4094-9196-14c5d0bdaf94 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:51.068208 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-905596c7-e970-4094-9196-14c5d0bdaf94 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:51.596609 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-905596c7-e970-4094-9196-14c5d0bdaf94 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:51.607888 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-905596c7-e970-4094-9196-14c5d0bdaf94 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1488 microversion: 2.1 time: 0.583875 Aug 04 16:58:51.614428 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2196/4307] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:51 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1488 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:51.631536 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-43f11c4e-4867-4c33-8f0d-26b9d5fe6251 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:51.632604 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-43f11c4e-4867-4c33-8f0d-26b9d5fe6251 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:51.647062 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-43f11c4e-4867-4c33-8f0d-26b9d5fe6251 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:51.647502 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-43f11c4e-4867-4c33-8f0d-26b9d5fe6251 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:51.648287 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-43f11c4e-4867-4c33-8f0d-26b9d5fe6251 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:51.648750 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-43f11c4e-4867-4c33-8f0d-26b9d5fe6251 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:51.937008 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-43f11c4e-4867-4c33-8f0d-26b9d5fe6251 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:51.948739 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-43f11c4e-4867-4c33-8f0d-26b9d5fe6251 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1488 microversion: 2.1 time: 0.321197 Aug 04 16:58:51.951526 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2112/4308] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:51 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1488 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:58:51.975203 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a49e8c77-72d3-4af1-93a6-484787406c30 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:51.975993 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a49e8c77-72d3-4af1-93a6-484787406c30 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:51.983133 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a49e8c77-72d3-4af1-93a6-484787406c30 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:51.993955 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a49e8c77-72d3-4af1-93a6-484787406c30 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:51.995260 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a49e8c77-72d3-4af1-93a6-484787406c30 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:52.001217 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a49e8c77-72d3-4af1-93a6-484787406c30 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:52.110443 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a49e8c77-72d3-4af1-93a6-484787406c30 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:58:52.303852 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a49e8c77-72d3-4af1-93a6-484787406c30 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "DELETE /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 204 len: 0 microversion: 2.1 time: 0.332427 Aug 04 16:58:52.306125 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2197/4309] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:58:51 2022] DELETE /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:58:52.314809 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a5618632-769f-46a0-b5df-f4b4d89af022 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:52.315425 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a5618632-769f-46a0-b5df-f4b4d89af022 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:52.329033 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a5618632-769f-46a0-b5df-f4b4d89af022 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:52.329512 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a5618632-769f-46a0-b5df-f4b4d89af022 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:52.330301 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a5618632-769f-46a0-b5df-f4b4d89af022 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:52.332322 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a5618632-769f-46a0-b5df-f4b4d89af022 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:52.362612 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:52.568509 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a5618632-769f-46a0-b5df-f4b4d89af022 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:52.582516 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a5618632-769f-46a0-b5df-f4b4d89af022 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1494 microversion: 2.1 time: 0.270750 Aug 04 16:58:52.584055 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2113/4310] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:52 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1494 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:53.610682 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1da4a32e-1145-4dbc-8c16-a8d51ffe438f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:53.612088 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1da4a32e-1145-4dbc-8c16-a8d51ffe438f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:53.625989 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1da4a32e-1145-4dbc-8c16-a8d51ffe438f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:53.627047 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1da4a32e-1145-4dbc-8c16-a8d51ffe438f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:53.629423 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1da4a32e-1145-4dbc-8c16-a8d51ffe438f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:53.630708 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1da4a32e-1145-4dbc-8c16-a8d51ffe438f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:54.006492 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1da4a32e-1145-4dbc-8c16-a8d51ffe438f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:54.016254 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1da4a32e-1145-4dbc-8c16-a8d51ffe438f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1494 microversion: 2.1 time: 0.413119 Aug 04 16:58:54.017559 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2198/4311] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:53 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1494 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:55.049795 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-23302a12-5d7c-4181-aacb-5685ccdc3bbc tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:55.051879 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-23302a12-5d7c-4181-aacb-5685ccdc3bbc tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:55.074847 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-23302a12-5d7c-4181-aacb-5685ccdc3bbc tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:55.075658 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-23302a12-5d7c-4181-aacb-5685ccdc3bbc tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:55.076816 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-23302a12-5d7c-4181-aacb-5685ccdc3bbc tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:55.077448 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-23302a12-5d7c-4181-aacb-5685ccdc3bbc tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:55.630640 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-f46e4146-8e62-4bdf-b23b-4ff4d89ece3b req-11e870f7-74b5-411b-88de-ac4f74d662ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8", "name": "network-vif-deleted", "tag": "b4e4ca9c-a9e6-4bb3-a434-6a4bf14ba564"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:55.656193 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-f46e4146-8e62-4bdf-b23b-4ff4d89ece3b req-11e870f7-74b5-411b-88de-ac4f74d662ba service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:55.656631 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-f46e4146-8e62-4bdf-b23b-4ff4d89ece3b req-11e870f7-74b5-411b-88de-ac4f74d662ba service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:55.685691 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-f46e4146-8e62-4bdf-b23b-4ff4d89ece3b req-11e870f7-74b5-411b-88de-ac4f74d662ba service nova] Creating event network-vif-deleted:b4e4ca9c-a9e6-4bb3-a434-6a4bf14ba564 for instance 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 on n-h1-846466-12 Aug 04 16:58:55.700299 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-f46e4146-8e62-4bdf-b23b-4ff4d89ece3b req-11e870f7-74b5-411b-88de-ac4f74d662ba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068462 Aug 04 16:58:55.703285 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2199/4312] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:55.831359 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-23302a12-5d7c-4181-aacb-5685ccdc3bbc tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:55.840348 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-23302a12-5d7c-4181-aacb-5685ccdc3bbc tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 200 len: 1494 microversion: 2.1 time: 0.800679 Aug 04 16:58:55.841587 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2114/4313] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:55 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 1494 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:56.864419 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-38d09a9d-9366-4119-8232-8ee61c0fe7fe tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:56.864998 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-38d09a9d-9366-4119-8232-8ee61c0fe7fe tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:56.879774 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-38d09a9d-9366-4119-8232-8ee61c0fe7fe tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:56.880224 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-38d09a9d-9366-4119-8232-8ee61c0fe7fe tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:56.881012 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-38d09a9d-9366-4119-8232-8ee61c0fe7fe tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:56.881470 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-38d09a9d-9366-4119-8232-8ee61c0fe7fe tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:56.923610 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-38d09a9d-9366-4119-8232-8ee61c0fe7fe tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] HTTP exception thrown: Instance 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 could not be found. Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-38d09a9d-9366-4119-8232-8ee61c0fe7fe tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Request method failure captured: Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 HTTP/1.1 Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_nQAsIL8Gtig2JiDfXWtIJ3WPqwL_iDK7Lzq6TGktfJLC3h9uoTgZsXj24J3msyyZQB5KWPirQK_R6x2-eYME28EQ_2bgNAh7DlNXEg7JFJsdnvAdfZMaqCmRUibanDLQxQgidHpyXwUg784UXcgxKrIZzuzT1AuaLsb_WysQnZpiA Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersTestJSON-750208524 Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa4bb1fda4ef4267829850c4c616df77"}]}] Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersTestJSON-750208524 Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersTestJSON-750208524 Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersTestJSON-750208524-project Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: db8a96da1d7943599ee6ca9df18f5148 Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersTestJSON-750208524-project Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 could not be found. Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8'} Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 could not be found. Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 could not be found. Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:56.925507 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:56.930740 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:56.930740 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:56.930740 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:56.930740 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:56.930740 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 could not be found. Aug 04 16:58:56.930740 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:56.932817 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-38d09a9d-9366-4119-8232-8ee61c0fe7fe tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Returning 404 to user: Instance 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:56.933949 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-38d09a9d-9366-4119-8232-8ee61c0fe7fe tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 404 len: 111 microversion: 2.1 time: 0.074855 Aug 04 16:58:56.935294 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2200/4314] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:56 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:58:56.952244 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dbe72a06-5538-4c97-b414-6483175cdfad tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:56.952784 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-dbe72a06-5538-4c97-b414-6483175cdfad tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:56.972752 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dbe72a06-5538-4c97-b414-6483175cdfad tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:56.973193 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dbe72a06-5538-4c97-b414-6483175cdfad tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:56.973998 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dbe72a06-5538-4c97-b414-6483175cdfad tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:56.974417 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dbe72a06-5538-4c97-b414-6483175cdfad tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:57.030977 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-dbe72a06-5538-4c97-b414-6483175cdfad tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] HTTP exception thrown: Instance 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 could not be found. Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dbe72a06-5538-4c97-b414-6483175cdfad tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Request method failure captured: Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 HTTP/1.1 Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_nQAsIL8Gtig2JiDfXWtIJ3WPqwL_iDK7Lzq6TGktfJLC3h9uoTgZsXj24J3msyyZQB5KWPirQK_R6x2-eYME28EQ_2bgNAh7DlNXEg7JFJsdnvAdfZMaqCmRUibanDLQxQgidHpyXwUg784UXcgxKrIZzuzT1AuaLsb_WysQnZpiA Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa4bb1fda4ef4267829850c4c616df77"}]}] Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersTestJSON-750208524-project Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: db8a96da1d7943599ee6ca9df18f5148 Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersTestJSON-750208524-project Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 could not be found. Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8'} Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 could not be found. Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:57.034900 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 could not be found. Aug 04 16:58:57.040047 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.040047 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:57.040047 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.040047 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.040047 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:57.040047 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:57.040047 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:57.040047 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:57.040047 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 could not be found. Aug 04 16:58:57.040047 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.045602 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dbe72a06-5538-4c97-b414-6483175cdfad tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Returning 404 to user: Instance 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:57.046720 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dbe72a06-5538-4c97-b414-6483175cdfad tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "DELETE /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 404 len: 111 microversion: 2.1 time: 0.098601 Aug 04 16:58:57.054007 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2115/4315] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:58:56 2022] DELETE /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:58:57.056425 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6f8c5461-daf8-4cbf-8380-bd044060ea4d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:57.057035 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6f8c5461-daf8-4cbf-8380-bd044060ea4d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:57.070112 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6f8c5461-daf8-4cbf-8380-bd044060ea4d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:57.070552 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6f8c5461-daf8-4cbf-8380-bd044060ea4d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:57.081570 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6f8c5461-daf8-4cbf-8380-bd044060ea4d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:57.082197 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6f8c5461-daf8-4cbf-8380-bd044060ea4d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:57.129801 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-6f8c5461-daf8-4cbf-8380-bd044060ea4d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] HTTP exception thrown: Instance 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 could not be found. Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6f8c5461-daf8-4cbf-8380-bd044060ea4d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Request method failure captured: Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 HTTP/1.1 Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_nQAsIL8Gtig2JiDfXWtIJ3WPqwL_iDK7Lzq6TGktfJLC3h9uoTgZsXj24J3msyyZQB5KWPirQK_R6x2-eYME28EQ_2bgNAh7DlNXEg7JFJsdnvAdfZMaqCmRUibanDLQxQgidHpyXwUg784UXcgxKrIZzuzT1AuaLsb_WysQnZpiA Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa4bb1fda4ef4267829850c4c616df77"}]}] Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersTestJSON-750208524-project Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: db8a96da1d7943599ee6ca9df18f5148 Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersTestJSON-750208524-project Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 could not be found. Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8'} Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 could not be found. Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 could not be found. Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.132699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.138148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:57.138148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:57.138148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:57.138148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:57.138148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 could not be found. Aug 04 16:58:57.138148 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.138148 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6f8c5461-daf8-4cbf-8380-bd044060ea4d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Returning 404 to user: Instance 69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:57.138148 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6f8c5461-daf8-4cbf-8380-bd044060ea4d tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8" status: 404 len: 111 microversion: 2.1 time: 0.082929 Aug 04 16:58:57.142002 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2201/4316] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:57 2022] GET /compute/v2.1/servers/69c542e8-a0ca-41ab-a8ee-e1cd098ca9e8 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:58:57.149129 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d5676396-6d4b-404f-bff0-f58aa18ce18f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:57.149843 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d5676396-6d4b-404f-bff0-f58aa18ce18f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: c323d329-0169-4914-96a5-1532bc922c05] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:57.163873 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d5676396-6d4b-404f-bff0-f58aa18ce18f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:57.164329 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d5676396-6d4b-404f-bff0-f58aa18ce18f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:57.171130 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d5676396-6d4b-404f-bff0-f58aa18ce18f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:57.172511 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d5676396-6d4b-404f-bff0-f58aa18ce18f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:57.224591 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-d5676396-6d4b-404f-bff0-f58aa18ce18f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] HTTP exception thrown: Instance c323d329-0169-4914-96a5-1532bc922c05 could not be found. Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d5676396-6d4b-404f-bff0-f58aa18ce18f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Request method failure captured: Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05 HTTP/1.1 Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_nQAsIL8Gtig2JiDfXWtIJ3WPqwL_iDK7Lzq6TGktfJLC3h9uoTgZsXj24J3msyyZQB5KWPirQK_R6x2-eYME28EQ_2bgNAh7DlNXEg7JFJsdnvAdfZMaqCmRUibanDLQxQgidHpyXwUg784UXcgxKrIZzuzT1AuaLsb_WysQnZpiA Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa4bb1fda4ef4267829850c4c616df77"}]}] Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersTestJSON-750208524-project Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: db8a96da1d7943599ee6ca9df18f5148 Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersTestJSON-750208524-project Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance c323d329-0169-4914-96a5-1532bc922c05 could not be found. Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'c323d329-0169-4914-96a5-1532bc922c05'} Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c323d329-0169-4914-96a5-1532bc922c05 could not be found. Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:57.226574 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c323d329-0169-4914-96a5-1532bc922c05 could not be found. Aug 04 16:58:57.233959 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.233959 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:57.233959 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.233959 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.233959 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:57.233959 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:57.233959 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:57.233959 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:57.233959 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c323d329-0169-4914-96a5-1532bc922c05 could not be found. Aug 04 16:58:57.233959 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.239373 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d5676396-6d4b-404f-bff0-f58aa18ce18f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Returning 404 to user: Instance c323d329-0169-4914-96a5-1532bc922c05 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:57.240607 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d5676396-6d4b-404f-bff0-f58aa18ce18f tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05" status: 404 len: 111 microversion: 2.1 time: 0.096273 Aug 04 16:58:57.246550 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2116/4317] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:58:57 2022] DELETE /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:58:57.250607 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-462e57e6-aa30-422e-9218-efeb9d12f085 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:57.251222 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-462e57e6-aa30-422e-9218-efeb9d12f085 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: c323d329-0169-4914-96a5-1532bc922c05] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:57.264926 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-462e57e6-aa30-422e-9218-efeb9d12f085 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:57.269812 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-462e57e6-aa30-422e-9218-efeb9d12f085 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:57.270871 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-462e57e6-aa30-422e-9218-efeb9d12f085 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:57.271499 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-462e57e6-aa30-422e-9218-efeb9d12f085 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:57.294869 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-462e57e6-aa30-422e-9218-efeb9d12f085 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] HTTP exception thrown: Instance c323d329-0169-4914-96a5-1532bc922c05 could not be found. Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-462e57e6-aa30-422e-9218-efeb9d12f085 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Request method failure captured: Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05 HTTP/1.1 Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_nQAsIL8Gtig2JiDfXWtIJ3WPqwL_iDK7Lzq6TGktfJLC3h9uoTgZsXj24J3msyyZQB5KWPirQK_R6x2-eYME28EQ_2bgNAh7DlNXEg7JFJsdnvAdfZMaqCmRUibanDLQxQgidHpyXwUg784UXcgxKrIZzuzT1AuaLsb_WysQnZpiA Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa4bb1fda4ef4267829850c4c616df77"}]}] Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersTestJSON-750208524-project Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: db8a96da1d7943599ee6ca9df18f5148 Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersTestJSON-750208524-project Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance c323d329-0169-4914-96a5-1532bc922c05 could not be found. Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'c323d329-0169-4914-96a5-1532bc922c05'} Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c323d329-0169-4914-96a5-1532bc922c05 could not be found. Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c323d329-0169-4914-96a5-1532bc922c05 could not be found. Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.296803 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.301345 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:57.301345 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:57.301345 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:57.301345 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:57.301345 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c323d329-0169-4914-96a5-1532bc922c05 could not be found. Aug 04 16:58:57.301345 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.305301 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-462e57e6-aa30-422e-9218-efeb9d12f085 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Returning 404 to user: Instance c323d329-0169-4914-96a5-1532bc922c05 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:57.306498 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-462e57e6-aa30-422e-9218-efeb9d12f085 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05" status: 404 len: 111 microversion: 2.1 time: 0.060892 Aug 04 16:58:57.307628 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2202/4318] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:57 2022] GET /compute/v2.1/servers/c323d329-0169-4914-96a5-1532bc922c05 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:58:57.316265 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-44ded5ef-404f-46b3-a173-b2c9be7b4192 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:57.317062 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-44ded5ef-404f-46b3-a173-b2c9be7b4192 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: ddc73e5e-fb45-4781-959e-c951fb5f2e6b] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:57.330397 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-44ded5ef-404f-46b3-a173-b2c9be7b4192 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:57.331175 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-44ded5ef-404f-46b3-a173-b2c9be7b4192 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:57.344212 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-44ded5ef-404f-46b3-a173-b2c9be7b4192 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:57.344212 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-44ded5ef-404f-46b3-a173-b2c9be7b4192 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:57.359510 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-44ded5ef-404f-46b3-a173-b2c9be7b4192 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] HTTP exception thrown: Instance ddc73e5e-fb45-4781-959e-c951fb5f2e6b could not be found. Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-44ded5ef-404f-46b3-a173-b2c9be7b4192 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Request method failure captured: Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b HTTP/1.1 Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_nQAsIL8Gtig2JiDfXWtIJ3WPqwL_iDK7Lzq6TGktfJLC3h9uoTgZsXj24J3msyyZQB5KWPirQK_R6x2-eYME28EQ_2bgNAh7DlNXEg7JFJsdnvAdfZMaqCmRUibanDLQxQgidHpyXwUg784UXcgxKrIZzuzT1AuaLsb_WysQnZpiA Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa4bb1fda4ef4267829850c4c616df77"}]}] Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersTestJSON-750208524-project Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: db8a96da1d7943599ee6ca9df18f5148 Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersTestJSON-750208524-project Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance ddc73e5e-fb45-4781-959e-c951fb5f2e6b could not be found. Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'ddc73e5e-fb45-4781-959e-c951fb5f2e6b'} Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddc73e5e-fb45-4781-959e-c951fb5f2e6b could not be found. Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:57.361309 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddc73e5e-fb45-4781-959e-c951fb5f2e6b could not be found. Aug 04 16:58:57.366123 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.366123 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:57.366123 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.366123 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.366123 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:57.366123 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:57.366123 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:57.366123 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:57.366123 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddc73e5e-fb45-4781-959e-c951fb5f2e6b could not be found. Aug 04 16:58:57.366123 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.366123 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-44ded5ef-404f-46b3-a173-b2c9be7b4192 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Returning 404 to user: Instance ddc73e5e-fb45-4781-959e-c951fb5f2e6b could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:57.367918 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-44ded5ef-404f-46b3-a173-b2c9be7b4192 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b" status: 404 len: 111 microversion: 2.1 time: 0.055353 Aug 04 16:58:57.368664 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2117/4319] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:58:57 2022] DELETE /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:58:57.376996 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-eb0036c2-2812-4528-98e4-5aabd658e6b2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:57.377934 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-eb0036c2-2812-4528-98e4-5aabd658e6b2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: ddc73e5e-fb45-4781-959e-c951fb5f2e6b] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:57.385652 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eb0036c2-2812-4528-98e4-5aabd658e6b2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:57.386359 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eb0036c2-2812-4528-98e4-5aabd658e6b2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:57.388461 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eb0036c2-2812-4528-98e4-5aabd658e6b2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:57.389065 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eb0036c2-2812-4528-98e4-5aabd658e6b2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:57.393968 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:57.407006 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-eb0036c2-2812-4528-98e4-5aabd658e6b2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] HTTP exception thrown: Instance ddc73e5e-fb45-4781-959e-c951fb5f2e6b could not be found. Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-eb0036c2-2812-4528-98e4-5aabd658e6b2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Request method failure captured: Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b HTTP/1.1 Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_nQAsIL8Gtig2JiDfXWtIJ3WPqwL_iDK7Lzq6TGktfJLC3h9uoTgZsXj24J3msyyZQB5KWPirQK_R6x2-eYME28EQ_2bgNAh7DlNXEg7JFJsdnvAdfZMaqCmRUibanDLQxQgidHpyXwUg784UXcgxKrIZzuzT1AuaLsb_WysQnZpiA Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa4bb1fda4ef4267829850c4c616df77"}]}] Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersTestJSON-750208524-project Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: db8a96da1d7943599ee6ca9df18f5148 Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersTestJSON-750208524-project Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance ddc73e5e-fb45-4781-959e-c951fb5f2e6b could not be found. Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'ddc73e5e-fb45-4781-959e-c951fb5f2e6b'} Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddc73e5e-fb45-4781-959e-c951fb5f2e6b could not be found. Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddc73e5e-fb45-4781-959e-c951fb5f2e6b could not be found. Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.408822 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.417092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:57.417092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:57.417092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:57.417092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:57.417092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddc73e5e-fb45-4781-959e-c951fb5f2e6b could not be found. Aug 04 16:58:57.417092 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.417092 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-eb0036c2-2812-4528-98e4-5aabd658e6b2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Returning 404 to user: Instance ddc73e5e-fb45-4781-959e-c951fb5f2e6b could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:57.417092 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-eb0036c2-2812-4528-98e4-5aabd658e6b2 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b" status: 404 len: 111 microversion: 2.1 time: 0.037748 Aug 04 16:58:57.417092 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2203/4320] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:57 2022] GET /compute/v2.1/servers/ddc73e5e-fb45-4781-959e-c951fb5f2e6b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:58:57.419004 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7fedec1b-0a74-4d9f-9cb2-6b20c1d976de tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:57.419490 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7fedec1b-0a74-4d9f-9cb2-6b20c1d976de tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 9c37f5dc-fee0-447d-bc96-db9b59933f8f] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:57.426814 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7fedec1b-0a74-4d9f-9cb2-6b20c1d976de tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:57.427253 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7fedec1b-0a74-4d9f-9cb2-6b20c1d976de tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:57.428009 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7fedec1b-0a74-4d9f-9cb2-6b20c1d976de tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:57.428436 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7fedec1b-0a74-4d9f-9cb2-6b20c1d976de tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:57.450253 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-7fedec1b-0a74-4d9f-9cb2-6b20c1d976de tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] HTTP exception thrown: Instance 9c37f5dc-fee0-447d-bc96-db9b59933f8f could not be found. Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7fedec1b-0a74-4d9f-9cb2-6b20c1d976de tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Request method failure captured: Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f HTTP/1.1 Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_nQAsIL8Gtig2JiDfXWtIJ3WPqwL_iDK7Lzq6TGktfJLC3h9uoTgZsXj24J3msyyZQB5KWPirQK_R6x2-eYME28EQ_2bgNAh7DlNXEg7JFJsdnvAdfZMaqCmRUibanDLQxQgidHpyXwUg784UXcgxKrIZzuzT1AuaLsb_WysQnZpiA Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa4bb1fda4ef4267829850c4c616df77"}]}] Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersTestJSON-750208524-project Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: db8a96da1d7943599ee6ca9df18f5148 Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersTestJSON-750208524-project Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 9c37f5dc-fee0-447d-bc96-db9b59933f8f could not be found. Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '9c37f5dc-fee0-447d-bc96-db9b59933f8f'} Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c37f5dc-fee0-447d-bc96-db9b59933f8f could not be found. Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:57.452291 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c37f5dc-fee0-447d-bc96-db9b59933f8f could not be found. Aug 04 16:58:57.460794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.460794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:57.460794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.460794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.460794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:57.460794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:57.460794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:57.460794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:57.460794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c37f5dc-fee0-447d-bc96-db9b59933f8f could not be found. Aug 04 16:58:57.460794 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.460794 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7fedec1b-0a74-4d9f-9cb2-6b20c1d976de tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Returning 404 to user: Instance 9c37f5dc-fee0-447d-bc96-db9b59933f8f could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:57.460794 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7fedec1b-0a74-4d9f-9cb2-6b20c1d976de tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f" status: 404 len: 111 microversion: 2.1 time: 0.038587 Aug 04 16:58:57.460794 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2118/4321] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:58:57 2022] DELETE /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:58:57.463633 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fdd61a4a-87e2-4f8a-88b7-e5e6b9243512 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:57.464292 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fdd61a4a-87e2-4f8a-88b7-e5e6b9243512 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 9c37f5dc-fee0-447d-bc96-db9b59933f8f] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:57.476710 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fdd61a4a-87e2-4f8a-88b7-e5e6b9243512 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:57.477654 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fdd61a4a-87e2-4f8a-88b7-e5e6b9243512 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:57.478439 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fdd61a4a-87e2-4f8a-88b7-e5e6b9243512 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:57.478928 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fdd61a4a-87e2-4f8a-88b7-e5e6b9243512 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:57.510307 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-fdd61a4a-87e2-4f8a-88b7-e5e6b9243512 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] HTTP exception thrown: Instance 9c37f5dc-fee0-447d-bc96-db9b59933f8f could not be found. Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fdd61a4a-87e2-4f8a-88b7-e5e6b9243512 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Request method failure captured: Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f HTTP/1.1 Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_nQAsIL8Gtig2JiDfXWtIJ3WPqwL_iDK7Lzq6TGktfJLC3h9uoTgZsXj24J3msyyZQB5KWPirQK_R6x2-eYME28EQ_2bgNAh7DlNXEg7JFJsdnvAdfZMaqCmRUibanDLQxQgidHpyXwUg784UXcgxKrIZzuzT1AuaLsb_WysQnZpiA Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa4bb1fda4ef4267829850c4c616df77"}]}] Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersTestJSON-750208524-project Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: db8a96da1d7943599ee6ca9df18f5148 Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersTestJSON-750208524-project Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 9c37f5dc-fee0-447d-bc96-db9b59933f8f could not be found. Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '9c37f5dc-fee0-447d-bc96-db9b59933f8f'} Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c37f5dc-fee0-447d-bc96-db9b59933f8f could not be found. Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c37f5dc-fee0-447d-bc96-db9b59933f8f could not be found. Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.515899 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.520862 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:57.520862 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:57.520862 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:57.520862 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:57.520862 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c37f5dc-fee0-447d-bc96-db9b59933f8f could not be found. Aug 04 16:58:57.520862 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.520862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fdd61a4a-87e2-4f8a-88b7-e5e6b9243512 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Returning 404 to user: Instance 9c37f5dc-fee0-447d-bc96-db9b59933f8f could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:57.521450 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fdd61a4a-87e2-4f8a-88b7-e5e6b9243512 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f" status: 404 len: 111 microversion: 2.1 time: 0.058194 Aug 04 16:58:57.525346 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2204/4322] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:57 2022] GET /compute/v2.1/servers/9c37f5dc-fee0-447d-bc96-db9b59933f8f => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:58:57.531716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a3c0aa50-2d7f-4ad4-b8ae-4d1f6e148952 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:57.532213 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a3c0aa50-2d7f-4ad4-b8ae-4d1f6e148952 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69500bda-7084-4ba9-abc9-64d6fc905b72] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:57.539335 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a3c0aa50-2d7f-4ad4-b8ae-4d1f6e148952 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:57.539772 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a3c0aa50-2d7f-4ad4-b8ae-4d1f6e148952 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:57.541310 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a3c0aa50-2d7f-4ad4-b8ae-4d1f6e148952 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:57.541783 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a3c0aa50-2d7f-4ad4-b8ae-4d1f6e148952 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:57.558376 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-a3c0aa50-2d7f-4ad4-b8ae-4d1f6e148952 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] HTTP exception thrown: Instance 69500bda-7084-4ba9-abc9-64d6fc905b72 could not be found. Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a3c0aa50-2d7f-4ad4-b8ae-4d1f6e148952 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Request method failure captured: Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72 HTTP/1.1 Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_nQAsIL8Gtig2JiDfXWtIJ3WPqwL_iDK7Lzq6TGktfJLC3h9uoTgZsXj24J3msyyZQB5KWPirQK_R6x2-eYME28EQ_2bgNAh7DlNXEg7JFJsdnvAdfZMaqCmRUibanDLQxQgidHpyXwUg784UXcgxKrIZzuzT1AuaLsb_WysQnZpiA Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa4bb1fda4ef4267829850c4c616df77"}]}] Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersTestJSON-750208524-project Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: db8a96da1d7943599ee6ca9df18f5148 Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersTestJSON-750208524-project Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 69500bda-7084-4ba9-abc9-64d6fc905b72 could not be found. Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '69500bda-7084-4ba9-abc9-64d6fc905b72'} Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69500bda-7084-4ba9-abc9-64d6fc905b72 could not be found. Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:57.560941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69500bda-7084-4ba9-abc9-64d6fc905b72 could not be found. Aug 04 16:58:57.565627 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.565627 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:57.565627 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.565627 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.565627 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:57.565627 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:57.565627 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:57.565627 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:57.565627 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69500bda-7084-4ba9-abc9-64d6fc905b72 could not be found. Aug 04 16:58:57.565627 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.565627 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a3c0aa50-2d7f-4ad4-b8ae-4d1f6e148952 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Returning 404 to user: Instance 69500bda-7084-4ba9-abc9-64d6fc905b72 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:57.565627 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a3c0aa50-2d7f-4ad4-b8ae-4d1f6e148952 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "DELETE /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72" status: 404 len: 111 microversion: 2.1 time: 0.035571 Aug 04 16:58:57.565627 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2119/4323] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:58:57 2022] DELETE /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:58:57.579604 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7051f970-dda7-46d0-96e6-9fbf0214ee4c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:57.580319 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7051f970-dda7-46d0-96e6-9fbf0214ee4c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 69500bda-7084-4ba9-abc9-64d6fc905b72] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:57.590583 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7051f970-dda7-46d0-96e6-9fbf0214ee4c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:57.591039 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7051f970-dda7-46d0-96e6-9fbf0214ee4c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:57.592293 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7051f970-dda7-46d0-96e6-9fbf0214ee4c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:57.592801 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7051f970-dda7-46d0-96e6-9fbf0214ee4c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:57.611816 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-7051f970-dda7-46d0-96e6-9fbf0214ee4c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] HTTP exception thrown: Instance 69500bda-7084-4ba9-abc9-64d6fc905b72 could not be found. Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7051f970-dda7-46d0-96e6-9fbf0214ee4c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Request method failure captured: Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72 HTTP/1.1 Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_nQAsIL8Gtig2JiDfXWtIJ3WPqwL_iDK7Lzq6TGktfJLC3h9uoTgZsXj24J3msyyZQB5KWPirQK_R6x2-eYME28EQ_2bgNAh7DlNXEg7JFJsdnvAdfZMaqCmRUibanDLQxQgidHpyXwUg784UXcgxKrIZzuzT1AuaLsb_WysQnZpiA Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa4bb1fda4ef4267829850c4c616df77"}]}] Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersTestJSON-750208524-project Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: db8a96da1d7943599ee6ca9df18f5148 Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersTestJSON-750208524-project Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 69500bda-7084-4ba9-abc9-64d6fc905b72 could not be found. Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '69500bda-7084-4ba9-abc9-64d6fc905b72'} Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69500bda-7084-4ba9-abc9-64d6fc905b72 could not be found. Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69500bda-7084-4ba9-abc9-64d6fc905b72 could not be found. Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.613544 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.618499 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:57.618499 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:57.618499 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:57.618499 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:57.618499 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69500bda-7084-4ba9-abc9-64d6fc905b72 could not be found. Aug 04 16:58:57.618499 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.618499 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7051f970-dda7-46d0-96e6-9fbf0214ee4c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Returning 404 to user: Instance 69500bda-7084-4ba9-abc9-64d6fc905b72 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:57.619567 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7051f970-dda7-46d0-96e6-9fbf0214ee4c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72" status: 404 len: 111 microversion: 2.1 time: 0.046882 Aug 04 16:58:57.621079 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2205/4324] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:57 2022] GET /compute/v2.1/servers/69500bda-7084-4ba9-abc9-64d6fc905b72 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:58:57.633078 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-140ecf3d-d93b-42b8-8e1c-1f1c3075ef5a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:57.633078 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-140ecf3d-d93b-42b8-8e1c-1f1c3075ef5a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:57.640229 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-140ecf3d-d93b-42b8-8e1c-1f1c3075ef5a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:57.640770 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-140ecf3d-d93b-42b8-8e1c-1f1c3075ef5a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:57.641876 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-140ecf3d-d93b-42b8-8e1c-1f1c3075ef5a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:57.642307 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-140ecf3d-d93b-42b8-8e1c-1f1c3075ef5a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:57.657483 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-140ecf3d-d93b-42b8-8e1c-1f1c3075ef5a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] HTTP exception thrown: Instance d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 could not be found. Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-140ecf3d-d93b-42b8-8e1c-1f1c3075ef5a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Request method failure captured: Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 HTTP/1.1 Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_nQAsIL8Gtig2JiDfXWtIJ3WPqwL_iDK7Lzq6TGktfJLC3h9uoTgZsXj24J3msyyZQB5KWPirQK_R6x2-eYME28EQ_2bgNAh7DlNXEg7JFJsdnvAdfZMaqCmRUibanDLQxQgidHpyXwUg784UXcgxKrIZzuzT1AuaLsb_WysQnZpiA Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa4bb1fda4ef4267829850c4c616df77"}]}] Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersTestJSON-750208524-project Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: db8a96da1d7943599ee6ca9df18f5148 Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersTestJSON-750208524-project Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 could not be found. Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'd752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854'} Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 could not be found. Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:57.659050 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 could not be found. Aug 04 16:58:57.663759 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.663759 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:57.663759 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.663759 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.663759 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:57.663759 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:57.663759 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:57.663759 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:57.663759 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 could not be found. Aug 04 16:58:57.663759 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.663759 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-140ecf3d-d93b-42b8-8e1c-1f1c3075ef5a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Returning 404 to user: Instance d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:57.663759 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-140ecf3d-d93b-42b8-8e1c-1f1c3075ef5a tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854" status: 404 len: 111 microversion: 2.1 time: 0.034979 Aug 04 16:58:57.670705 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d3a04c15-9140-4aef-83d0-7cb7c87c07d0 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:57.671307 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d3a04c15-9140-4aef-83d0-7cb7c87c07d0 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:57.677028 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2120/4325] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:58:57 2022] DELETE /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:58:57.679624 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d3a04c15-9140-4aef-83d0-7cb7c87c07d0 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:57.680065 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d3a04c15-9140-4aef-83d0-7cb7c87c07d0 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:57.680984 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d3a04c15-9140-4aef-83d0-7cb7c87c07d0 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:57.681440 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d3a04c15-9140-4aef-83d0-7cb7c87c07d0 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:57.706225 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-d3a04c15-9140-4aef-83d0-7cb7c87c07d0 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] HTTP exception thrown: Instance d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 could not be found. Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d3a04c15-9140-4aef-83d0-7cb7c87c07d0 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Request method failure captured: Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 HTTP/1.1 Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_nQAsIL8Gtig2JiDfXWtIJ3WPqwL_iDK7Lzq6TGktfJLC3h9uoTgZsXj24J3msyyZQB5KWPirQK_R6x2-eYME28EQ_2bgNAh7DlNXEg7JFJsdnvAdfZMaqCmRUibanDLQxQgidHpyXwUg784UXcgxKrIZzuzT1AuaLsb_WysQnZpiA Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa4bb1fda4ef4267829850c4c616df77"}]}] Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersTestJSON-750208524-project Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: db8a96da1d7943599ee6ca9df18f5148 Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersTestJSON-750208524-project Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 could not be found. Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'd752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854'} Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 could not be found. Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 could not be found. Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.708066 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.712965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:57.712965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:57.712965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:57.712965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:57.712965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 could not be found. Aug 04 16:58:57.712965 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.712965 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d3a04c15-9140-4aef-83d0-7cb7c87c07d0 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Returning 404 to user: Instance d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:57.712965 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d3a04c15-9140-4aef-83d0-7cb7c87c07d0 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854" status: 404 len: 111 microversion: 2.1 time: 0.042840 Aug 04 16:58:57.723360 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f1a2c270-030c-446e-ba11-6d2940c42b52 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:57.724615 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f1a2c270-030c-446e-ba11-6d2940c42b52 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 1db79b76-1967-4f0e-a07c-c66e82f890d4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:57.738128 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2206/4326] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:57 2022] GET /compute/v2.1/servers/d752a4a5-a3b4-4fd8-8a3b-35cf9b2a7854 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:58:57.743597 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-f1a2c270-030c-446e-ba11-6d2940c42b52 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] HTTP exception thrown: Instance 1db79b76-1967-4f0e-a07c-c66e82f890d4 could not be found. Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f1a2c270-030c-446e-ba11-6d2940c42b52 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Request method failure captured: Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/servers/1db79b76-1967-4f0e-a07c-c66e82f890d4 HTTP/1.1 Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_nQAsIL8Gtig2JiDfXWtIJ3WPqwL_iDK7Lzq6TGktfJLC3h9uoTgZsXj24J3msyyZQB5KWPirQK_R6x2-eYME28EQ_2bgNAh7DlNXEg7JFJsdnvAdfZMaqCmRUibanDLQxQgidHpyXwUg784UXcgxKrIZzuzT1AuaLsb_WysQnZpiA Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa4bb1fda4ef4267829850c4c616df77"}]}] Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersTestJSON-750208524-project Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: db8a96da1d7943599ee6ca9df18f5148 Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersTestJSON-750208524-project Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 1db79b76-1967-4f0e-a07c-c66e82f890d4 could not be found. Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '1db79b76-1967-4f0e-a07c-c66e82f890d4'} Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1db79b76-1967-4f0e-a07c-c66e82f890d4 could not be found. Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1db79b76-1967-4f0e-a07c-c66e82f890d4 could not be found. Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:57.746426 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.751688 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.751688 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:57.751688 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:57.751688 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:57.751688 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:57.751688 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1db79b76-1967-4f0e-a07c-c66e82f890d4 could not be found. Aug 04 16:58:57.751688 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.753531 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f1a2c270-030c-446e-ba11-6d2940c42b52 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Returning 404 to user: Instance 1db79b76-1967-4f0e-a07c-c66e82f890d4 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:57.754543 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f1a2c270-030c-446e-ba11-6d2940c42b52 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1db79b76-1967-4f0e-a07c-c66e82f890d4" status: 404 len: 111 microversion: 2.1 time: 0.040193 Aug 04 16:58:57.755369 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2121/4327] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:58:57 2022] DELETE /compute/v2.1/servers/1db79b76-1967-4f0e-a07c-c66e82f890d4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:58:57.764505 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-40131ace-7e41-4009-b70b-8ef260acd13e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:57.765374 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-40131ace-7e41-4009-b70b-8ef260acd13e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: 1db79b76-1967-4f0e-a07c-c66e82f890d4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:57.772495 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-40131ace-7e41-4009-b70b-8ef260acd13e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] HTTP exception thrown: Instance 1db79b76-1967-4f0e-a07c-c66e82f890d4 could not be found. Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-40131ace-7e41-4009-b70b-8ef260acd13e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Request method failure captured: Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/1db79b76-1967-4f0e-a07c-c66e82f890d4 HTTP/1.1 Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_nQAsIL8Gtig2JiDfXWtIJ3WPqwL_iDK7Lzq6TGktfJLC3h9uoTgZsXj24J3msyyZQB5KWPirQK_R6x2-eYME28EQ_2bgNAh7DlNXEg7JFJsdnvAdfZMaqCmRUibanDLQxQgidHpyXwUg784UXcgxKrIZzuzT1AuaLsb_WysQnZpiA Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa4bb1fda4ef4267829850c4c616df77"}]}] Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersTestJSON-750208524 Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersTestJSON-750208524-project Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: db8a96da1d7943599ee6ca9df18f5148 Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersTestJSON-750208524-project Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 1db79b76-1967-4f0e-a07c-c66e82f890d4 could not be found. Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '1db79b76-1967-4f0e-a07c-c66e82f890d4'} Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1db79b76-1967-4f0e-a07c-c66e82f890d4 could not be found. Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1db79b76-1967-4f0e-a07c-c66e82f890d4 could not be found. Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:57.774589 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:57.779349 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:57.779349 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:57.779349 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1db79b76-1967-4f0e-a07c-c66e82f890d4 could not be found. Aug 04 16:58:57.779349 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:58:57.780463 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-40131ace-7e41-4009-b70b-8ef260acd13e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Returning 404 to user: Instance 1db79b76-1967-4f0e-a07c-c66e82f890d4 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:57.781602 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-40131ace-7e41-4009-b70b-8ef260acd13e tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/1db79b76-1967-4f0e-a07c-c66e82f890d4" status: 404 len: 111 microversion: 2.1 time: 0.021700 Aug 04 16:58:57.786024 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2207/4328] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:57 2022] GET /compute/v2.1/servers/1db79b76-1967-4f0e-a07c-c66e82f890d4 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:58:57.791486 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-78ebe7dc-2edd-4aeb-b7dd-3e848f9c2376 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:57.791995 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-78ebe7dc-2edd-4aeb-b7dd-3e848f9c2376 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:57.810883 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-78ebe7dc-2edd-4aeb-b7dd-3e848f9c2376 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:57.813902 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-78ebe7dc-2edd-4aeb-b7dd-3e848f9c2376 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:57.814835 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-78ebe7dc-2edd-4aeb-b7dd-3e848f9c2376 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:57.815423 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-78ebe7dc-2edd-4aeb-b7dd-3e848f9c2376 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:57.862275 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-78ebe7dc-2edd-4aeb-b7dd-3e848f9c2376 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:58:58.015385 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:58.067441 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-78ebe7dc-2edd-4aeb-b7dd-3e848f9c2376 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52" status: 204 len: 0 microversion: 2.1 time: 0.275250 Aug 04 16:58:58.070053 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2122/4329] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:58:57 2022] DELETE /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:58:58.079690 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-adecf128-5a73-4387-8f25-6ebbf7523e58 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:58.080404 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-adecf128-5a73-4387-8f25-6ebbf7523e58 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:58.102950 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-adecf128-5a73-4387-8f25-6ebbf7523e58 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:58.103714 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-adecf128-5a73-4387-8f25-6ebbf7523e58 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:58.104994 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-adecf128-5a73-4387-8f25-6ebbf7523e58 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:58.105879 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-adecf128-5a73-4387-8f25-6ebbf7523e58 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:58.207268 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=8 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:58.552319 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-adecf128-5a73-4387-8f25-6ebbf7523e58 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:58.560819 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-adecf128-5a73-4387-8f25-6ebbf7523e58 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52" status: 200 len: 1479 microversion: 2.1 time: 0.485781 Aug 04 16:58:58.566042 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2208/4330] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:58 2022] GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52 => generated 1479 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:59.128946 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-34bd0678-abe9-4b0c-935f-b0ac1b37503b tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-578773583", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "596f6a02-97c2-4a77-a854-07d02bc7bbb6"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:59.233969 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-34bd0678-abe9-4b0c-935f-b0ac1b37503b tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] validate_networks() for [('596f6a02-97c2-4a77-a854-07d02bc7bbb6', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:58:59.587433 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-993405a8-ccf6-4211-80a4-cabaa2d26daa tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:59.589550 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-993405a8-ccf6-4211-80a4-cabaa2d26daa tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:59.604619 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-993405a8-ccf6-4211-80a4-cabaa2d26daa tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:59.606535 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-993405a8-ccf6-4211-80a4-cabaa2d26daa tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:59.609877 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-993405a8-ccf6-4211-80a4-cabaa2d26daa tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:59.611349 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-993405a8-ccf6-4211-80a4-cabaa2d26daa tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:59.897483 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-34bd0678-abe9-4b0c-935f-b0ac1b37503b tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:58:59.898046 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-34bd0678-abe9-4b0c-935f-b0ac1b37503b tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:58:59.898340 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-34bd0678-abe9-4b0c-935f-b0ac1b37503b tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:58:59.898748 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-34bd0678-abe9-4b0c-935f-b0ac1b37503b tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:58:59.899206 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-34bd0678-abe9-4b0c-935f-b0ac1b37503b tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:58:59.920910 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-34bd0678-abe9-4b0c-935f-b0ac1b37503b tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:59.921361 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-34bd0678-abe9-4b0c-935f-b0ac1b37503b tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:59.922425 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-34bd0678-abe9-4b0c-935f-b0ac1b37503b tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:58:59.922957 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-34bd0678-abe9-4b0c-935f-b0ac1b37503b tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:58:59.941779 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-34bd0678-abe9-4b0c-935f-b0ac1b37503b tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Getting quotas for project 1244cf4912514d41a7c5ba300e203ff6. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:58:59.956043 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-34bd0678-abe9-4b0c-935f-b0ac1b37503b tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Getting quotas for user 63ef05c9770f47bfaa3b36b3eeebbf03 and project 1244cf4912514d41a7c5ba300e203ff6. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:58:59.983856 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-34bd0678-abe9-4b0c-935f-b0ac1b37503b tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:58:59.989600 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-34bd0678-abe9-4b0c-935f-b0ac1b37503b tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] [instance: 48c8febb-db67-481b-8a56-e783d88edafa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:59:00.104094 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-34bd0678-abe9-4b0c-935f-b0ac1b37503b tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.187485 Aug 04 16:59:00.109357 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2123/4331] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:58:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1193 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:59:00.121086 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ca254374-cf71-4504-a996-68d36293f21d tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:00.122804 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ca254374-cf71-4504-a996-68d36293f21d tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] [instance: 48c8febb-db67-481b-8a56-e783d88edafa] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:00.435425 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ca254374-cf71-4504-a996-68d36293f21d tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ef05c9770f47bfaa3b36b3eeebbf03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1244cf4912514d41a7c5ba300e203ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:00.444798 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ca254374-cf71-4504-a996-68d36293f21d tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] 10.222.0.23 "GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa" status: 200 len: 1214 microversion: 2.1 time: 0.328906 Aug 04 16:59:00.445273 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2124/4332] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:00 2022] GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa => generated 1214 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:00.639960 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-993405a8-ccf6-4211-80a4-cabaa2d26daa tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:00.654693 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-993405a8-ccf6-4211-80a4-cabaa2d26daa tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52" status: 200 len: 1479 microversion: 2.1 time: 1.069061 Aug 04 16:59:00.658512 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2209/4333] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:59 2022] GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52 => generated 1479 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:01.466942 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-199bc0cd-266e-4262-82d9-8354719c60ad tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:01.467714 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-199bc0cd-266e-4262-82d9-8354719c60ad tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] [instance: 48c8febb-db67-481b-8a56-e783d88edafa] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:01.485208 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-199bc0cd-266e-4262-82d9-8354719c60ad tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:01.486039 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-199bc0cd-266e-4262-82d9-8354719c60ad tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:01.487235 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-199bc0cd-266e-4262-82d9-8354719c60ad tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:01.493719 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-199bc0cd-266e-4262-82d9-8354719c60ad tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:01.679036 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-220eee07-c305-4af2-951c-89674d83e7c5 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:01.679632 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-220eee07-c305-4af2-951c-89674d83e7c5 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:01.681689 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-199bc0cd-266e-4262-82d9-8354719c60ad tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ef05c9770f47bfaa3b36b3eeebbf03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1244cf4912514d41a7c5ba300e203ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:01.689796 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-220eee07-c305-4af2-951c-89674d83e7c5 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:01.690235 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-220eee07-c305-4af2-951c-89674d83e7c5 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:01.691039 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-220eee07-c305-4af2-951c-89674d83e7c5 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:01.691471 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-220eee07-c305-4af2-951c-89674d83e7c5 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:01.698330 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-199bc0cd-266e-4262-82d9-8354719c60ad tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] 10.222.0.23 "GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa" status: 200 len: 1266 microversion: 2.1 time: 0.233192 Aug 04 16:59:01.701697 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2125/4334] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:01 2022] GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:02.028339 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-220eee07-c305-4af2-951c-89674d83e7c5 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8a96da1d7943599ee6ca9df18f5148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4bb1fda4ef4267829850c4c616df77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:02.036508 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-220eee07-c305-4af2-951c-89674d83e7c5 tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52" status: 200 len: 1437 microversion: 2.1 time: 0.361698 Aug 04 16:59:02.037094 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2210/4335] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:01 2022] GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52 => generated 1437 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:02.506036 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-21928287-8744-4bce-8d11-e5ea1d7d4a76 req-49c393c5-967d-40dc-a2b1-c791d38bcbae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52", "name": "network-vif-deleted", "tag": "5aa14c21-5452-41b2-a399-520f9a642bad"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:02.526342 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-21928287-8744-4bce-8d11-e5ea1d7d4a76 req-49c393c5-967d-40dc-a2b1-c791d38bcbae service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:02.526887 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-21928287-8744-4bce-8d11-e5ea1d7d4a76 req-49c393c5-967d-40dc-a2b1-c791d38bcbae service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:02.575315 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-21928287-8744-4bce-8d11-e5ea1d7d4a76 req-49c393c5-967d-40dc-a2b1-c791d38bcbae service nova] Creating event network-vif-deleted:5aa14c21-5452-41b2-a399-520f9a642bad for instance e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52 on n-h2-846466-12 Aug 04 16:59:02.591956 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-21928287-8744-4bce-8d11-e5ea1d7d4a76 req-49c393c5-967d-40dc-a2b1-c791d38bcbae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089868 Aug 04 16:59:02.592926 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2126/4336] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:02.720879 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-66fee2c3-19a9-462e-ac67-ab498ce89fde tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:02.722128 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-66fee2c3-19a9-462e-ac67-ab498ce89fde tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] [instance: 48c8febb-db67-481b-8a56-e783d88edafa] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:02.730504 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-66fee2c3-19a9-462e-ac67-ab498ce89fde tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:02.731073 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-66fee2c3-19a9-462e-ac67-ab498ce89fde tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:02.731874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-66fee2c3-19a9-462e-ac67-ab498ce89fde tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:02.732313 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-66fee2c3-19a9-462e-ac67-ab498ce89fde tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:02.829379 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-66fee2c3-19a9-462e-ac67-ab498ce89fde tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ef05c9770f47bfaa3b36b3eeebbf03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1244cf4912514d41a7c5ba300e203ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:02.844801 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-66fee2c3-19a9-462e-ac67-ab498ce89fde tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] 10.222.0.23 "GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa" status: 200 len: 1272 microversion: 2.1 time: 0.127717 Aug 04 16:59:02.859530 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2127/4337] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:02 2022] GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa => generated 1272 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:59:02.960379 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-74a09367-3652-40ef-ad0a-4f3d87c75bd4 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1149380078", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "14d6f8c5-8908-4bc9-a049-d440787b4f71"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:03.071355 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-82278f02-94b6-43fd-aa72-fdf8e6aa946c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:03.072348 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-82278f02-94b6-43fd-aa72-fdf8e6aa946c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] [instance: e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:03.082962 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-74a09367-3652-40ef-ad0a-4f3d87c75bd4 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] validate_networks() for [('14d6f8c5-8908-4bc9-a049-d440787b4f71', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:59:03.088887 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-82278f02-94b6-43fd-aa72-fdf8e6aa946c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:03.090701 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-82278f02-94b6-43fd-aa72-fdf8e6aa946c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:03.091704 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-82278f02-94b6-43fd-aa72-fdf8e6aa946c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:03.093878 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-82278f02-94b6-43fd-aa72-fdf8e6aa946c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:03.124474 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-82278f02-94b6-43fd-aa72-fdf8e6aa946c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] HTTP exception thrown: Instance e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52 could not be found. Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-82278f02-94b6-43fd-aa72-fdf8e6aa946c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Request method failure captured: Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52 HTTP/1.1 Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_nQAsIL8Gtig2JiDfXWtIJ3WPqwL_iDK7Lzq6TGktfJLC3h9uoTgZsXj24J3msyyZQB5KWPirQK_R6x2-eYME28EQ_2bgNAh7DlNXEg7JFJsdnvAdfZMaqCmRUibanDLQxQgidHpyXwUg784UXcgxKrIZzuzT1AuaLsb_WysQnZpiA Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersTestJSON-750208524 Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4bb1fda4ef4267829850c4c616df77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa4bb1fda4ef4267829850c4c616df77"}]}] Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersTestJSON-750208524 Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: fa4bb1fda4ef4267829850c4c616df77 Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersTestJSON-750208524 Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersTestJSON-750208524-project Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: db8a96da1d7943599ee6ca9df18f5148 Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersTestJSON-750208524-project Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52 could not be found. Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52'} Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52 could not be found. Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52 could not be found. Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:59:03.132902 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:03.139475 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:59:03.139475 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:59:03.139475 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:59:03.139475 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:59:03.139475 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52 could not be found. Aug 04 16:59:03.139475 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:59:03.139475 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-82278f02-94b6-43fd-aa72-fdf8e6aa946c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] Returning 404 to user: Instance e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:59:03.139475 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-82278f02-94b6-43fd-aa72-fdf8e6aa946c tempest-ServersTestJSON-750208524 tempest-ServersTestJSON-750208524-project] 10.222.0.23 "GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52" status: 404 len: 111 microversion: 2.1 time: 0.078093 Aug 04 16:59:03.139475 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2128/4338] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:03 2022] GET /compute/v2.1/servers/e62e4c04-e7a0-4dd5-9177-8dc18ebe9b52 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:59:03.871002 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b4815c79-3c61-40b1-98e6-e1f19410c104 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:03.872345 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b4815c79-3c61-40b1-98e6-e1f19410c104 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] [instance: 48c8febb-db67-481b-8a56-e783d88edafa] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:03.891876 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b4815c79-3c61-40b1-98e6-e1f19410c104 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:03.892133 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b4815c79-3c61-40b1-98e6-e1f19410c104 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:03.893214 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b4815c79-3c61-40b1-98e6-e1f19410c104 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:03.893978 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b4815c79-3c61-40b1-98e6-e1f19410c104 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:04.021519 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b4815c79-3c61-40b1-98e6-e1f19410c104 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ef05c9770f47bfaa3b36b3eeebbf03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1244cf4912514d41a7c5ba300e203ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:04.038784 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b4815c79-3c61-40b1-98e6-e1f19410c104 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] 10.222.0.23 "GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa" status: 200 len: 1272 microversion: 2.1 time: 0.174577 Aug 04 16:59:04.042122 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2129/4339] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:03 2022] GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa => generated 1272 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:04.344698 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-74a09367-3652-40ef-ad0a-4f3d87c75bd4 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:59:04.345192 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-74a09367-3652-40ef-ad0a-4f3d87c75bd4 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:59:04.345833 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-74a09367-3652-40ef-ad0a-4f3d87c75bd4 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:59:04.346244 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-74a09367-3652-40ef-ad0a-4f3d87c75bd4 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:59:04.346657 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-74a09367-3652-40ef-ad0a-4f3d87c75bd4 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:59:04.369435 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-74a09367-3652-40ef-ad0a-4f3d87c75bd4 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:04.371732 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-74a09367-3652-40ef-ad0a-4f3d87c75bd4 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:04.373203 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-74a09367-3652-40ef-ad0a-4f3d87c75bd4 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:04.377305 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-74a09367-3652-40ef-ad0a-4f3d87c75bd4 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:04.434511 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-74a09367-3652-40ef-ad0a-4f3d87c75bd4 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Getting quotas for project 2f6c14a1d17b47a9877001ced2b7733d. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:59:04.441390 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-74a09367-3652-40ef-ad0a-4f3d87c75bd4 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Getting quotas for user f13e8fdfcd92428f8b43f6eb9e0d630d and project 2f6c14a1d17b47a9877001ced2b7733d. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:59:04.463885 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-74a09367-3652-40ef-ad0a-4f3d87c75bd4 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:59:04.468846 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-74a09367-3652-40ef-ad0a-4f3d87c75bd4 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] [instance: a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:59:04.525302 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:04.560182 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-74a09367-3652-40ef-ad0a-4f3d87c75bd4 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.884279 Aug 04 16:59:04.567122 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2211/4340] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:59:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:59:04.572048 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cf56ebbc-8f04-4666-9023-91e3c4d0f335 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:04.572658 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cf56ebbc-8f04-4666-9023-91e3c4d0f335 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] [instance: a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:04.742542 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cf56ebbc-8f04-4666-9023-91e3c4d0f335 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e8fdfcd92428f8b43f6eb9e0d630d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6c14a1d17b47a9877001ced2b7733d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:04.749979 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cf56ebbc-8f04-4666-9023-91e3c4d0f335 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] 10.222.0.23 "GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e" status: 200 len: 1216 microversion: 2.1 time: 0.181517 Aug 04 16:59:04.750547 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2130/4341] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:04 2022] GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e => generated 1216 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:05.067436 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7a737e69-93ee-429f-b158-da1f932d7dda tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:05.068598 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7a737e69-93ee-429f-b158-da1f932d7dda tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] [instance: 48c8febb-db67-481b-8a56-e783d88edafa] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:05.101761 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a737e69-93ee-429f-b158-da1f932d7dda tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:05.102230 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a737e69-93ee-429f-b158-da1f932d7dda tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:05.103921 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a737e69-93ee-429f-b158-da1f932d7dda tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:05.107175 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a737e69-93ee-429f-b158-da1f932d7dda tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:05.776846 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f4ad4473-3099-40b4-b3f3-be428287df1d tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:05.777765 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f4ad4473-3099-40b4-b3f3-be428287df1d tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] [instance: a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:05.793896 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f4ad4473-3099-40b4-b3f3-be428287df1d tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:05.794169 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f4ad4473-3099-40b4-b3f3-be428287df1d tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:05.797713 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7a737e69-93ee-429f-b158-da1f932d7dda tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ef05c9770f47bfaa3b36b3eeebbf03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1244cf4912514d41a7c5ba300e203ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:05.805817 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f4ad4473-3099-40b4-b3f3-be428287df1d tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:05.806321 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f4ad4473-3099-40b4-b3f3-be428287df1d tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:05.808350 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7a737e69-93ee-429f-b158-da1f932d7dda tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] 10.222.0.23 "GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa" status: 200 len: 1314 microversion: 2.1 time: 0.748098 Aug 04 16:59:05.809762 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2212/4342] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:05 2022] GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa => generated 1314 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:59:05.975441 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f4ad4473-3099-40b4-b3f3-be428287df1d tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e8fdfcd92428f8b43f6eb9e0d630d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6c14a1d17b47a9877001ced2b7733d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:05.988235 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f4ad4473-3099-40b4-b3f3-be428287df1d tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] 10.222.0.23 "GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e" status: 200 len: 1268 microversion: 2.1 time: 0.218667 Aug 04 16:59:05.989011 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2131/4343] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:05 2022] GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e => generated 1268 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:06.831023 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-97339f32-1587-4742-acb8-484ea19d7430 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:06.832726 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-97339f32-1587-4742-acb8-484ea19d7430 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] [instance: 48c8febb-db67-481b-8a56-e783d88edafa] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:06.841573 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-97339f32-1587-4742-acb8-484ea19d7430 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:06.842341 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-97339f32-1587-4742-acb8-484ea19d7430 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:06.843342 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-97339f32-1587-4742-acb8-484ea19d7430 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:06.844020 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-97339f32-1587-4742-acb8-484ea19d7430 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:07.013929 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-08cb9cbb-d4c3-4b5e-8046-e5d828147d3b tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:07.014391 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-08cb9cbb-d4c3-4b5e-8046-e5d828147d3b tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] [instance: a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:07.034141 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-08cb9cbb-d4c3-4b5e-8046-e5d828147d3b tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:07.034906 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-08cb9cbb-d4c3-4b5e-8046-e5d828147d3b tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:07.035878 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-08cb9cbb-d4c3-4b5e-8046-e5d828147d3b tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:07.036549 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-08cb9cbb-d4c3-4b5e-8046-e5d828147d3b tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:07.570400 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-08cb9cbb-d4c3-4b5e-8046-e5d828147d3b tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e8fdfcd92428f8b43f6eb9e0d630d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6c14a1d17b47a9877001ced2b7733d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:07.583052 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-08cb9cbb-d4c3-4b5e-8046-e5d828147d3b tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] 10.222.0.23 "GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e" status: 200 len: 1274 microversion: 2.1 time: 0.573260 Aug 04 16:59:07.584367 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2132/4344] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:07 2022] GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e => generated 1274 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:59:07.686698 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-20bcd1ed-026c-43c2-88b4-c52022bf2e8c req-b18cc487-7c4e-4551-9a6e-4bc542b5bdee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48c8febb-db67-481b-8a56-e783d88edafa", "tag": "7378638e-f54c-466a-9990-98a95d314366"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:07.703398 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-20bcd1ed-026c-43c2-88b4-c52022bf2e8c req-b18cc487-7c4e-4551-9a6e-4bc542b5bdee service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:07.705040 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-20bcd1ed-026c-43c2-88b4-c52022bf2e8c req-b18cc487-7c4e-4551-9a6e-4bc542b5bdee service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:07.729144 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-20bcd1ed-026c-43c2-88b4-c52022bf2e8c req-b18cc487-7c4e-4551-9a6e-4bc542b5bdee service nova] Creating event network-changed:7378638e-f54c-466a-9990-98a95d314366 for instance 48c8febb-db67-481b-8a56-e783d88edafa on n-h1-846466-12 Aug 04 16:59:07.749777 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-20bcd1ed-026c-43c2-88b4-c52022bf2e8c req-b18cc487-7c4e-4551-9a6e-4bc542b5bdee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079168 Aug 04 16:59:07.753313 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2133/4345] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:07.818294 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-97339f32-1587-4742-acb8-484ea19d7430 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ef05c9770f47bfaa3b36b3eeebbf03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1244cf4912514d41a7c5ba300e203ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:07.834903 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-97339f32-1587-4742-acb8-484ea19d7430 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] 10.222.0.23 "GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa" status: 200 len: 1314 microversion: 2.1 time: 1.006281 Aug 04 16:59:07.836096 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2213/4346] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:06 2022] GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa => generated 1314 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:08.610905 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-90a38e57-e6b7-4340-9b5b-0c564dc04fba tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:08.612618 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-90a38e57-e6b7-4340-9b5b-0c564dc04fba tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] [instance: a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:08.640775 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-90a38e57-e6b7-4340-9b5b-0c564dc04fba tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:08.641170 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-90a38e57-e6b7-4340-9b5b-0c564dc04fba tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:08.645541 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-90a38e57-e6b7-4340-9b5b-0c564dc04fba tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:08.646196 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-90a38e57-e6b7-4340-9b5b-0c564dc04fba tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:08.862906 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ef5daed8-699a-40a4-ab38-12daadb1efd8 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:08.865076 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ef5daed8-699a-40a4-ab38-12daadb1efd8 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] [instance: 48c8febb-db67-481b-8a56-e783d88edafa] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:08.889093 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef5daed8-699a-40a4-ab38-12daadb1efd8 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:08.896699 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef5daed8-699a-40a4-ab38-12daadb1efd8 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:08.897460 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef5daed8-699a-40a4-ab38-12daadb1efd8 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:08.899111 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef5daed8-699a-40a4-ab38-12daadb1efd8 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:09.053221 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-90a38e57-e6b7-4340-9b5b-0c564dc04fba tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e8fdfcd92428f8b43f6eb9e0d630d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6c14a1d17b47a9877001ced2b7733d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:09.075536 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-90a38e57-e6b7-4340-9b5b-0c564dc04fba tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] 10.222.0.23 "GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e" status: 200 len: 1274 microversion: 2.1 time: 0.475156 Aug 04 16:59:09.078591 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2134/4347] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:08 2022] GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e => generated 1274 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:09.096572 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9836c0e1-162e-4c89-aef5-aab32826009b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:09.098968 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9836c0e1-162e-4c89-aef5-aab32826009b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: e27ae6f5-5037-4714-b781-224113fa0859] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:09.151005 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9836c0e1-162e-4c89-aef5-aab32826009b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:09.153216 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9836c0e1-162e-4c89-aef5-aab32826009b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:09.154290 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9836c0e1-162e-4c89-aef5-aab32826009b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:09.160577 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9836c0e1-162e-4c89-aef5-aab32826009b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:09.308688 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9836c0e1-162e-4c89-aef5-aab32826009b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859/ips" status: 200 len: 148 microversion: 2.1 time: 0.228555 Aug 04 16:59:09.309379 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2135/4348] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Aug 4 16:59:09 2022] GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859/ips => generated 148 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:09.321608 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c7f82acd-5963-4c0b-b145-99ddca97b26a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03279f98-526c-4c50-a56a-b778a5227b21"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:09.325986 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c7f82acd-5963-4c0b-b145-99ddca97b26a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: e27ae6f5-5037-4714-b781-224113fa0859] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:09.346334 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c7f82acd-5963-4c0b-b145-99ddca97b26a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:09.349243 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c7f82acd-5963-4c0b-b145-99ddca97b26a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:09.350150 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c7f82acd-5963-4c0b-b145-99ddca97b26a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:09.350989 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c7f82acd-5963-4c0b-b145-99ddca97b26a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:09.482618 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ef5daed8-699a-40a4-ab38-12daadb1efd8 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ef05c9770f47bfaa3b36b3eeebbf03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1244cf4912514d41a7c5ba300e203ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:09.517879 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ef5daed8-699a-40a4-ab38-12daadb1efd8 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] 10.222.0.23 "GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa" status: 200 len: 1314 microversion: 2.1 time: 0.662298 Aug 04 16:59:09.520900 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2214/4349] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:08 2022] GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa => generated 1314 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:09.565078 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-c7f82acd-5963-4c0b-b145-99ddca97b26a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] HTTP exception thrown: Invalid volume: volume 03279f98-526c-4c50-a56a-b778a5227b21 is already attached to instances: 760130d2-374e-4f4c-a73b-d7a99449e324 Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c7f82acd-5963-4c0b-b145-99ddca97b26a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Request method failure captured: Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859/os-volume_attachments HTTP/1.1 Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 74 Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_owNKx0pHV40nqVD-WIcaXEsXOBwQHOEMAVVk2fno070nDFXZRZhhzMgTy8HlVP1AOBt469MYWC_AbeQLbAvgivtdjrTsmGymGu6AtGEk3CEKRMIDLRIpky1rxw9eTh6mgckU3tnNoFbB2in__O_4k2BxkTMZllLYaubH7EDDeTWL4 Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 2534921e8a2f47d394059fee872426a8 Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-AttachVolumeNegativeTest-410766221 Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2534921e8a2f47d394059fee872426a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2534921e8a2f47d394059fee872426a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2534921e8a2f47d394059fee872426a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2534921e8a2f47d394059fee872426a8"}]}] Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-AttachVolumeNegativeTest-410766221 Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 2534921e8a2f47d394059fee872426a8 Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-410766221 Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-AttachVolumeNegativeTest-410766221-project Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: d82f4a672b154291a412a282d1a88208 Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-AttachVolumeNegativeTest-410766221-project Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: {"volumeAttachment": {"volumeId": "03279f98-526c-4c50-a56a-b778a5227b21"}} Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: exception: Invalid volume: volume 03279f98-526c-4c50-a56a-b778a5227b21 is already attached to instances: 760130d2-374e-4f4c-a73b-d7a99449e324 Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'server_id': 'e27ae6f5-5037-4714-b781-224113fa0859', 'body': {'volumeAttachment': {'volumeId': '03279f98-526c-4c50-a56a-b778a5227b21'}}} Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 03279f98-526c-4c50-a56a-b778a5227b21 is already attached to instances: 760130d2-374e-4f4c-a73b-d7a99449e324 Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:59:09.566667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:59:09.571481 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:59:09.571481 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:59:09.571481 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 04 16:59:09.571481 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 16:59:09.571481 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 03279f98-526c-4c50-a56a-b778a5227b21 is already attached to instances: 760130d2-374e-4f4c-a73b-d7a99449e324 Aug 04 16:59:09.571481 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:59:09.571481 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:09.571481 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:59:09.571481 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:09.571481 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:59:09.571481 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:59:09.571481 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:59:09.571481 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:59:09.571481 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 03279f98-526c-4c50-a56a-b778a5227b21 is already attached to instances: 760130d2-374e-4f4c-a73b-d7a99449e324 Aug 04 16:59:09.571481 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 16:59:09.571481 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c7f82acd-5963-4c0b-b145-99ddca97b26a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Returning 400 to user: Invalid volume: volume 03279f98-526c-4c50-a56a-b778a5227b21 is already attached to instances: 760130d2-374e-4f4c-a73b-d7a99449e324 {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:59:09.572630 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c7f82acd-5963-4c0b-b145-99ddca97b26a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "POST /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.254469 Aug 04 16:59:09.572630 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2136/4350] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Aug 4 16:59:09 2022] POST /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859/os-volume_attachments => generated 174 bytes in 256 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 16:59:09.581966 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d57fbce6-2eac-43ce-bd5d-d5f7e132f36d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:09.582308 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d57fbce6-2eac-43ce-bd5d-d5f7e132f36d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: e27ae6f5-5037-4714-b781-224113fa0859] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:09.601575 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d57fbce6-2eac-43ce-bd5d-d5f7e132f36d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:09.602036 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d57fbce6-2eac-43ce-bd5d-d5f7e132f36d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:09.602848 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d57fbce6-2eac-43ce-bd5d-d5f7e132f36d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:09.603269 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d57fbce6-2eac-43ce-bd5d-d5f7e132f36d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:09.640854 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d57fbce6-2eac-43ce-bd5d-d5f7e132f36d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: e27ae6f5-5037-4714-b781-224113fa0859] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:59:09.782764 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d57fbce6-2eac-43ce-bd5d-d5f7e132f36d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859" status: 204 len: 0 microversion: 2.1 time: 0.198808 Aug 04 16:59:09.784155 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2215/4351] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:59:09 2022] DELETE /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:59:09.792544 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e8250cf9-9918-4251-8497-bc776218b01f tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:09.793717 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e8250cf9-9918-4251-8497-bc776218b01f tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: e27ae6f5-5037-4714-b781-224113fa0859] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:09.813510 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e8250cf9-9918-4251-8497-bc776218b01f tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:09.814239 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e8250cf9-9918-4251-8497-bc776218b01f tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:09.815274 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e8250cf9-9918-4251-8497-bc776218b01f tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:09.816033 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e8250cf9-9918-4251-8497-bc776218b01f tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:09.931407 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:10.099979 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3c2b122c-a1e7-4030-9a27-b09178e4bc5a tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:10.102239 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3c2b122c-a1e7-4030-9a27-b09178e4bc5a tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] [instance: a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:10.112359 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3c2b122c-a1e7-4030-9a27-b09178e4bc5a tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:10.113308 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3c2b122c-a1e7-4030-9a27-b09178e4bc5a tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:10.114236 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3c2b122c-a1e7-4030-9a27-b09178e4bc5a tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:10.114898 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3c2b122c-a1e7-4030-9a27-b09178e4bc5a tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:10.322740 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e8250cf9-9918-4251-8497-bc776218b01f tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:10.336329 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e8250cf9-9918-4251-8497-bc776218b01f tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859" status: 200 len: 1681 microversion: 2.1 time: 0.546648 Aug 04 16:59:10.336897 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2137/4352] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:09 2022] GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859 => generated 1681 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:10.491126 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3c2b122c-a1e7-4030-9a27-b09178e4bc5a tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e8fdfcd92428f8b43f6eb9e0d630d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6c14a1d17b47a9877001ced2b7733d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:10.499881 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3c2b122c-a1e7-4030-9a27-b09178e4bc5a tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] 10.222.0.23 "GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e" status: 200 len: 1316 microversion: 2.1 time: 0.406226 Aug 04 16:59:10.505540 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2216/4353] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:10 2022] GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e => generated 1316 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:10.547578 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-752ed6b3-e625-4831-8c14-029e16fccd62 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:10.548558 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-752ed6b3-e625-4831-8c14-029e16fccd62 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] [instance: 48c8febb-db67-481b-8a56-e783d88edafa] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:10.566550 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-752ed6b3-e625-4831-8c14-029e16fccd62 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:10.566992 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-752ed6b3-e625-4831-8c14-029e16fccd62 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:10.567768 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-752ed6b3-e625-4831-8c14-029e16fccd62 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:10.568464 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-752ed6b3-e625-4831-8c14-029e16fccd62 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:10.623171 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:10.939516 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-752ed6b3-e625-4831-8c14-029e16fccd62 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ef05c9770f47bfaa3b36b3eeebbf03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1244cf4912514d41a7c5ba300e203ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:10.950450 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-752ed6b3-e625-4831-8c14-029e16fccd62 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] 10.222.0.23 "GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa" status: 200 len: 1314 microversion: 2.1 time: 0.408969 Aug 04 16:59:10.951039 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2138/4354] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:10 2022] GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:11.124696 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-54f051b9-d0c2-4b74-9514-acac806aaa10 req-ad840c6f-daec-47d8-8fe5-c8d2faeecec2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e", "tag": "89824012-944f-4862-bf84-170177c00ac6"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:11.163653 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-54f051b9-d0c2-4b74-9514-acac806aaa10 req-ad840c6f-daec-47d8-8fe5-c8d2faeecec2 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:11.163653 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-54f051b9-d0c2-4b74-9514-acac806aaa10 req-ad840c6f-daec-47d8-8fe5-c8d2faeecec2 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:11.180132 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-54f051b9-d0c2-4b74-9514-acac806aaa10 req-ad840c6f-daec-47d8-8fe5-c8d2faeecec2 service nova] Creating event network-changed:89824012-944f-4862-bf84-170177c00ac6 for instance a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e on n-h2-846466-12 Aug 04 16:59:11.186002 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-54f051b9-d0c2-4b74-9514-acac806aaa10 req-ad840c6f-daec-47d8-8fe5-c8d2faeecec2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066748 Aug 04 16:59:11.186663 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2217/4355] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:11.394651 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b7d7e0dc-a6ae-4e29-b348-f0eb88578a54 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:11.395765 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b7d7e0dc-a6ae-4e29-b348-f0eb88578a54 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: e27ae6f5-5037-4714-b781-224113fa0859] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:11.405581 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b7d7e0dc-a6ae-4e29-b348-f0eb88578a54 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:11.407866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b7d7e0dc-a6ae-4e29-b348-f0eb88578a54 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:11.411935 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b7d7e0dc-a6ae-4e29-b348-f0eb88578a54 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:11.413391 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b7d7e0dc-a6ae-4e29-b348-f0eb88578a54 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:11.742339 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bf1fe22e-fd0f-4202-9c36-2777e4bc11d5 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-247159095", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:11.842809 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-bf1fe22e-fd0f-4202-9c36-2777e4bc11d5 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] validate_networks() for [('c50fd092-cfa9-46ac-9572-ccbca0bcf84d', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:59:12.198699 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b7d7e0dc-a6ae-4e29-b348-f0eb88578a54 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:12.214714 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b7d7e0dc-a6ae-4e29-b348-f0eb88578a54 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859" status: 200 len: 1681 microversion: 2.1 time: 0.837831 Aug 04 16:59:12.215694 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2218/4356] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:11 2022] GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859 => generated 1681 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:12.232116 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7058e481-c5f7-4963-bc12-6dd76d7d7e11 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:12.232741 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7058e481-c5f7-4963-bc12-6dd76d7d7e11 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] [instance: a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:12.245201 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7058e481-c5f7-4963-bc12-6dd76d7d7e11 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:12.246021 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7058e481-c5f7-4963-bc12-6dd76d7d7e11 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:12.247094 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7058e481-c5f7-4963-bc12-6dd76d7d7e11 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:12.254243 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7058e481-c5f7-4963-bc12-6dd76d7d7e11 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:13.589574 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7058e481-c5f7-4963-bc12-6dd76d7d7e11 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e8fdfcd92428f8b43f6eb9e0d630d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6c14a1d17b47a9877001ced2b7733d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:13.602896 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7058e481-c5f7-4963-bc12-6dd76d7d7e11 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] 10.222.0.23 "GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e" status: 200 len: 1316 microversion: 2.1 time: 1.385937 Aug 04 16:59:13.603652 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2219/4357] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:12 2022] GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e => generated 1316 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:13.610154 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3f9f7885-000b-4452-ba11-e6ba40c26361 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:13.611007 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3f9f7885-000b-4452-ba11-e6ba40c26361 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] [instance: 48c8febb-db67-481b-8a56-e783d88edafa] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:13.618567 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3f9f7885-000b-4452-ba11-e6ba40c26361 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:13.619290 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3f9f7885-000b-4452-ba11-e6ba40c26361 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:13.621350 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3f9f7885-000b-4452-ba11-e6ba40c26361 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:13.621933 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3f9f7885-000b-4452-ba11-e6ba40c26361 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:13.940338 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-bf1fe22e-fd0f-4202-9c36-2777e4bc11d5 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:59:13.942691 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-bf1fe22e-fd0f-4202-9c36-2777e4bc11d5 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:59:13.943701 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-bf1fe22e-fd0f-4202-9c36-2777e4bc11d5 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:59:13.944349 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-bf1fe22e-fd0f-4202-9c36-2777e4bc11d5 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:59:13.944972 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-bf1fe22e-fd0f-4202-9c36-2777e4bc11d5 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:59:13.956704 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf1fe22e-fd0f-4202-9c36-2777e4bc11d5 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:13.957565 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf1fe22e-fd0f-4202-9c36-2777e4bc11d5 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:13.959262 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf1fe22e-fd0f-4202-9c36-2777e4bc11d5 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:13.960666 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf1fe22e-fd0f-4202-9c36-2777e4bc11d5 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:13.991213 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-bf1fe22e-fd0f-4202-9c36-2777e4bc11d5 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Getting quotas for project fc9ddb2693734bd5a0d3c4101a165998. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:59:13.999329 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-bf1fe22e-fd0f-4202-9c36-2777e4bc11d5 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Getting quotas for user c8e7c523e9d94d2994ebe9b2d3b86b41 and project fc9ddb2693734bd5a0d3c4101a165998. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:59:14.006691 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3f9f7885-000b-4452-ba11-e6ba40c26361 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ef05c9770f47bfaa3b36b3eeebbf03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1244cf4912514d41a7c5ba300e203ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:14.026817 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3f9f7885-000b-4452-ba11-e6ba40c26361 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] 10.222.0.23 "GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa" status: 200 len: 1314 microversion: 2.1 time: 0.421197 Aug 04 16:59:14.030378 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2220/4358] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:13 2022] GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:14.046581 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2d7bf437-f8d4-4481-a0f0-e2ce2a64dddc tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:14.047939 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2d7bf437-f8d4-4481-a0f0-e2ce2a64dddc tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: e27ae6f5-5037-4714-b781-224113fa0859] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:14.056894 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d7bf437-f8d4-4481-a0f0-e2ce2a64dddc tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:14.057702 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d7bf437-f8d4-4481-a0f0-e2ce2a64dddc tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:14.059445 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bf1fe22e-fd0f-4202-9c36-2777e4bc11d5 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:59:14.060202 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d7bf437-f8d4-4481-a0f0-e2ce2a64dddc tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:14.060789 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d7bf437-f8d4-4481-a0f0-e2ce2a64dddc tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:14.068998 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bf1fe22e-fd0f-4202-9c36-2777e4bc11d5 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:59:14.199498 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bf1fe22e-fd0f-4202-9c36-2777e4bc11d5 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.891896 Aug 04 16:59:14.210169 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2139/4359] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:59:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 2903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:59:14.222997 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-96cf7c50-575e-4a4b-842a-e5122fe92a16 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:14.226564 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-96cf7c50-575e-4a4b-842a-e5122fe92a16 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:14.386041 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-96cf7c50-575e-4a4b-842a-e5122fe92a16 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e7c523e9d94d2994ebe9b2d3b86b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9ddb2693734bd5a0d3c4101a165998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:14.411744 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-96cf7c50-575e-4a4b-842a-e5122fe92a16 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba" status: 200 len: 1222 microversion: 2.1 time: 0.196982 Aug 04 16:59:14.415354 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2140/4360] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:14 2022] GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba => generated 1222 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:14.424264 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:14.455538 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:14.564195 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2d7bf437-f8d4-4481-a0f0-e2ce2a64dddc tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:14.576701 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2d7bf437-f8d4-4481-a0f0-e2ce2a64dddc tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859" status: 200 len: 1681 microversion: 2.1 time: 0.541727 Aug 04 16:59:14.579449 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2221/4361] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:14 2022] GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859 => generated 1681 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:14.629488 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5f1e29d9-f73e-42ba-ada6-02cf81fc33f1 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:14.630492 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5f1e29d9-f73e-42ba-ada6-02cf81fc33f1 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] [instance: a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:14.658371 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5f1e29d9-f73e-42ba-ada6-02cf81fc33f1 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:14.661220 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5f1e29d9-f73e-42ba-ada6-02cf81fc33f1 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:14.664216 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5f1e29d9-f73e-42ba-ada6-02cf81fc33f1 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:14.668255 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5f1e29d9-f73e-42ba-ada6-02cf81fc33f1 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:15.053045 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ac6e3c92-bba4-4162-82f8-c219af3860fb tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:15.053737 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ac6e3c92-bba4-4162-82f8-c219af3860fb tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] [instance: 48c8febb-db67-481b-8a56-e783d88edafa] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:15.063867 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ac6e3c92-bba4-4162-82f8-c219af3860fb tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:15.067544 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ac6e3c92-bba4-4162-82f8-c219af3860fb tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:15.069004 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ac6e3c92-bba4-4162-82f8-c219af3860fb tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:15.071454 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ac6e3c92-bba4-4162-82f8-c219af3860fb tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:15.543244 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5f1e29d9-f73e-42ba-ada6-02cf81fc33f1 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e8fdfcd92428f8b43f6eb9e0d630d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6c14a1d17b47a9877001ced2b7733d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:15.563270 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5f1e29d9-f73e-42ba-ada6-02cf81fc33f1 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] 10.222.0.23 "GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e" status: 200 len: 1316 microversion: 2.1 time: 0.938386 Aug 04 16:59:15.571887 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2141/4362] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:14 2022] GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e => generated 1316 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:15.587144 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-672c862a-beea-49f0-8556-2b53de2d2d50 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:15.588409 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-672c862a-beea-49f0-8556-2b53de2d2d50 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:15.606042 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-672c862a-beea-49f0-8556-2b53de2d2d50 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:15.607016 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-672c862a-beea-49f0-8556-2b53de2d2d50 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:15.608070 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-672c862a-beea-49f0-8556-2b53de2d2d50 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:15.608731 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-672c862a-beea-49f0-8556-2b53de2d2d50 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:15.628249 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ac6e3c92-bba4-4162-82f8-c219af3860fb tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ef05c9770f47bfaa3b36b3eeebbf03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1244cf4912514d41a7c5ba300e203ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:15.656642 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ac6e3c92-bba4-4162-82f8-c219af3860fb tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] 10.222.0.23 "GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa" status: 200 len: 1314 microversion: 2.1 time: 0.608851 Aug 04 16:59:15.659662 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2222/4363] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:15 2022] GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa => generated 1314 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:15.673807 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a0bcf75e-dc7e-419e-9249-d7024e2ab3eb tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:15.679645 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a0bcf75e-dc7e-419e-9249-d7024e2ab3eb tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: e27ae6f5-5037-4714-b781-224113fa0859] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:15.705859 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a0bcf75e-dc7e-419e-9249-d7024e2ab3eb tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:15.706319 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a0bcf75e-dc7e-419e-9249-d7024e2ab3eb tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:15.707131 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a0bcf75e-dc7e-419e-9249-d7024e2ab3eb tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:15.707565 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a0bcf75e-dc7e-419e-9249-d7024e2ab3eb tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:15.719168 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:15.779724 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-672c862a-beea-49f0-8556-2b53de2d2d50 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e7c523e9d94d2994ebe9b2d3b86b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9ddb2693734bd5a0d3c4101a165998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:15.791553 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-672c862a-beea-49f0-8556-2b53de2d2d50 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba" status: 200 len: 1218 microversion: 2.1 time: 0.218231 Aug 04 16:59:15.807863 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2142/4364] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:15 2022] GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba => generated 1218 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:15.823396 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-9a78fc2a-8d67-4fa2-9095-474089b5bc8e req-69491a69-54b8-4f6f-9c78-e0fa2f31c13e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e27ae6f5-5037-4714-b781-224113fa0859", "name": "network-vif-deleted", "tag": "9fc22e1a-6c76-4ae5-ac92-4c33d8d04605"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:15.860362 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-9a78fc2a-8d67-4fa2-9095-474089b5bc8e req-69491a69-54b8-4f6f-9c78-e0fa2f31c13e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:15.861216 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-9a78fc2a-8d67-4fa2-9095-474089b5bc8e req-69491a69-54b8-4f6f-9c78-e0fa2f31c13e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:15.883912 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-9a78fc2a-8d67-4fa2-9095-474089b5bc8e req-69491a69-54b8-4f6f-9c78-e0fa2f31c13e service nova] Creating event network-vif-deleted:9fc22e1a-6c76-4ae5-ac92-4c33d8d04605 for instance e27ae6f5-5037-4714-b781-224113fa0859 on n-h1-846466-12 Aug 04 16:59:15.896502 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-9a78fc2a-8d67-4fa2-9095-474089b5bc8e req-69491a69-54b8-4f6f-9c78-e0fa2f31c13e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078338 Aug 04 16:59:15.897976 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2143/4365] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:15.921612 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a0bcf75e-dc7e-419e-9249-d7024e2ab3eb tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:15.932975 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a0bcf75e-dc7e-419e-9249-d7024e2ab3eb tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859" status: 200 len: 1613 microversion: 2.1 time: 0.270119 Aug 04 16:59:15.934468 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2223/4366] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:15 2022] GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859 => generated 1613 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:16.595716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2e5b5a51-00ff-4eea-a4cb-19326b97bc44 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:16.596583 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2e5b5a51-00ff-4eea-a4cb-19326b97bc44 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] [instance: a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:16.628034 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2e5b5a51-00ff-4eea-a4cb-19326b97bc44 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:16.631889 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2e5b5a51-00ff-4eea-a4cb-19326b97bc44 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:16.635872 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2e5b5a51-00ff-4eea-a4cb-19326b97bc44 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:16.637497 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2e5b5a51-00ff-4eea-a4cb-19326b97bc44 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:16.680055 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c08f0720-2351-4e85-bfb0-04ae675f13c0 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:16.680801 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c08f0720-2351-4e85-bfb0-04ae675f13c0 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] [instance: 48c8febb-db67-481b-8a56-e783d88edafa] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:16.700056 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c08f0720-2351-4e85-bfb0-04ae675f13c0 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:16.703937 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c08f0720-2351-4e85-bfb0-04ae675f13c0 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:16.705908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c08f0720-2351-4e85-bfb0-04ae675f13c0 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:16.708074 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c08f0720-2351-4e85-bfb0-04ae675f13c0 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:17.195231 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2e5b5a51-00ff-4eea-a4cb-19326b97bc44 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e8fdfcd92428f8b43f6eb9e0d630d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6c14a1d17b47a9877001ced2b7733d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:17.207181 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2e5b5a51-00ff-4eea-a4cb-19326b97bc44 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] 10.222.0.23 "GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e" status: 200 len: 1316 microversion: 2.1 time: 0.616275 Aug 04 16:59:17.209605 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2144/4367] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:16 2022] GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e => generated 1316 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:17.215470 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2e91ab56-3498-4b1c-8fce-682289d8c8da tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:17.230637 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2e91ab56-3498-4b1c-8fce-682289d8c8da tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:17.241554 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2e91ab56-3498-4b1c-8fce-682289d8c8da tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:17.242402 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2e91ab56-3498-4b1c-8fce-682289d8c8da tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:17.243480 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2e91ab56-3498-4b1c-8fce-682289d8c8da tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:17.244140 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2e91ab56-3498-4b1c-8fce-682289d8c8da tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:17.258320 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c08f0720-2351-4e85-bfb0-04ae675f13c0 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ef05c9770f47bfaa3b36b3eeebbf03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1244cf4912514d41a7c5ba300e203ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:17.277828 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c08f0720-2351-4e85-bfb0-04ae675f13c0 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] 10.222.0.23 "GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa" status: 200 len: 1314 microversion: 2.1 time: 0.601927 Aug 04 16:59:17.294207 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2224/4368] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:16 2022] GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa => generated 1314 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:17.312836 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-136e44e0-ea32-4fcb-bc18-a65534416096 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:17.321487 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-136e44e0-ea32-4fcb-bc18-a65534416096 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: e27ae6f5-5037-4714-b781-224113fa0859] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:17.350331 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-136e44e0-ea32-4fcb-bc18-a65534416096 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:17.353761 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-136e44e0-ea32-4fcb-bc18-a65534416096 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:17.355560 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-136e44e0-ea32-4fcb-bc18-a65534416096 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:17.356146 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-136e44e0-ea32-4fcb-bc18-a65534416096 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:17.395173 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-136e44e0-ea32-4fcb-bc18-a65534416096 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] HTTP exception thrown: Instance e27ae6f5-5037-4714-b781-224113fa0859 could not be found. Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-136e44e0-ea32-4fcb-bc18-a65534416096 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Request method failure captured: Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859 HTTP/1.1 Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_owNKx0pHV40nqVD-WIcaXEsXOBwQHOEMAVVk2fno070nDFXZRZhhzMgTy8HlVP1AOBt469MYWC_AbeQLbAvgivtdjrTsmGymGu6AtGEk3CEKRMIDLRIpky1rxw9eTh6mgckU3tnNoFbB2in__O_4k2BxkTMZllLYaubH7EDDeTWL4 Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 2534921e8a2f47d394059fee872426a8 Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-AttachVolumeNegativeTest-410766221 Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2534921e8a2f47d394059fee872426a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2534921e8a2f47d394059fee872426a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2534921e8a2f47d394059fee872426a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2534921e8a2f47d394059fee872426a8"}]}] Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-AttachVolumeNegativeTest-410766221 Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 2534921e8a2f47d394059fee872426a8 Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-410766221 Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-AttachVolumeNegativeTest-410766221-project Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: d82f4a672b154291a412a282d1a88208 Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-AttachVolumeNegativeTest-410766221-project Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance e27ae6f5-5037-4714-b781-224113fa0859 could not be found. Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'e27ae6f5-5037-4714-b781-224113fa0859'} Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e27ae6f5-5037-4714-b781-224113fa0859 could not be found. Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e27ae6f5-5037-4714-b781-224113fa0859 could not be found. Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:17.405795 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:59:17.412293 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:17.412293 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:59:17.412293 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:59:17.412293 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:59:17.412293 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:59:17.412293 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e27ae6f5-5037-4714-b781-224113fa0859 could not be found. Aug 04 16:59:17.412293 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:59:17.417073 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-136e44e0-ea32-4fcb-bc18-a65534416096 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Returning 404 to user: Instance e27ae6f5-5037-4714-b781-224113fa0859 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:59:17.418885 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-136e44e0-ea32-4fcb-bc18-a65534416096 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859" status: 404 len: 111 microversion: 2.1 time: 0.123312 Aug 04 16:59:17.419761 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2225/4369] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:17 2022] GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:59:17.427837 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e5d42946-b0ee-47a8-9557-e06a74e0bff1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:17.434334 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e5d42946-b0ee-47a8-9557-e06a74e0bff1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:17.445231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e5d42946-b0ee-47a8-9557-e06a74e0bff1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:17.446115 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e5d42946-b0ee-47a8-9557-e06a74e0bff1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:17.456694 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e5d42946-b0ee-47a8-9557-e06a74e0bff1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:17.457542 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e5d42946-b0ee-47a8-9557-e06a74e0bff1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:17.485641 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2e91ab56-3498-4b1c-8fce-682289d8c8da tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e7c523e9d94d2994ebe9b2d3b86b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9ddb2693734bd5a0d3c4101a165998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:17.498745 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2e91ab56-3498-4b1c-8fce-682289d8c8da tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba" status: 200 len: 1280 microversion: 2.1 time: 0.287664 Aug 04 16:59:17.504814 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2145/4370] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:17 2022] GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba => generated 1280 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:17.512340 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c6d45cbc-c862-4299-aadf-57d6a4418865 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '.version_select at 0x7f7e77d173a0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:17.522122 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e5d42946-b0ee-47a8-9557-e06a74e0bff1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397/ips" status: 200 len: 153 microversion: 2.20 time: 0.100966 Aug 04 16:59:17.530561 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2226/4371] 10.222.0.23 () {60 vars in 1289 bytes} [Thu Aug 4 16:59:17 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397/ips => generated 153 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:59:17.591102 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c6d45cbc-c862-4299-aadf-57d6a4418865 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1573753905" status: 202 len: 0 microversion: 2.1 time: 0.083503 Aug 04 16:59:17.592188 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2146/4372] 10.222.0.23 () {58 vars in 1221 bytes} [Thu Aug 4 16:59:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1573753905 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:59:18.237589 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-93c6efb2-60e4-45f7-bf1a-18e2fddab946 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:18.238861 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-93c6efb2-60e4-45f7-bf1a-18e2fddab946 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] [instance: a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:18.269864 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-93c6efb2-60e4-45f7-bf1a-18e2fddab946 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:18.270522 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-93c6efb2-60e4-45f7-bf1a-18e2fddab946 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:18.271594 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-93c6efb2-60e4-45f7-bf1a-18e2fddab946 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:18.283805 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-93c6efb2-60e4-45f7-bf1a-18e2fddab946 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:18.313903 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-997f4346-1d03-4007-a3de-9357bce29661 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:18.317104 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-997f4346-1d03-4007-a3de-9357bce29661 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] [instance: 48c8febb-db67-481b-8a56-e783d88edafa] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:18.353168 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-997f4346-1d03-4007-a3de-9357bce29661 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:18.359014 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-997f4346-1d03-4007-a3de-9357bce29661 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:18.362595 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-997f4346-1d03-4007-a3de-9357bce29661 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:18.363037 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-997f4346-1d03-4007-a3de-9357bce29661 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:18.674405 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-997f4346-1d03-4007-a3de-9357bce29661 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ef05c9770f47bfaa3b36b3eeebbf03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1244cf4912514d41a7c5ba300e203ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:18.683359 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-997f4346-1d03-4007-a3de-9357bce29661 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] 10.222.0.23 "GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa" status: 200 len: 1314 microversion: 2.1 time: 0.375477 Aug 04 16:59:18.690687 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2147/4373] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:18 2022] GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:18.698367 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2a14a2d5-e985-46a6-a793-6b85d672d985 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:18.702087 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2a14a2d5-e985-46a6-a793-6b85d672d985 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:18.716381 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a14a2d5-e985-46a6-a793-6b85d672d985 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:18.720992 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a14a2d5-e985-46a6-a793-6b85d672d985 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:18.723438 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a14a2d5-e985-46a6-a793-6b85d672d985 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:18.723885 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a14a2d5-e985-46a6-a793-6b85d672d985 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:18.859700 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-93c6efb2-60e4-45f7-bf1a-18e2fddab946 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e8fdfcd92428f8b43f6eb9e0d630d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6c14a1d17b47a9877001ced2b7733d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:18.868392 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-93c6efb2-60e4-45f7-bf1a-18e2fddab946 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] 10.222.0.23 "GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e" status: 200 len: 1316 microversion: 2.1 time: 0.634597 Aug 04 16:59:18.871093 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2227/4374] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:18 2022] GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e => generated 1316 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:19.187856 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2a14a2d5-e985-46a6-a793-6b85d672d985 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e7c523e9d94d2994ebe9b2d3b86b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9ddb2693734bd5a0d3c4101a165998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:19.196713 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2a14a2d5-e985-46a6-a793-6b85d672d985 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba" status: 200 len: 1322 microversion: 2.1 time: 0.504529 Aug 04 16:59:19.197347 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2148/4375] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:18 2022] GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba => generated 1322 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:19.647555 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-86e63cae-506b-4543-89d0-fc1a18207534 req-e627b5cc-e94a-49de-adfe-b66ca56a3f80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48c8febb-db67-481b-8a56-e783d88edafa", "name": "network-vif-plugged", "status": "completed", "tag": "7378638e-f54c-466a-9990-98a95d314366"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:19.672525 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-86e63cae-506b-4543-89d0-fc1a18207534 req-e627b5cc-e94a-49de-adfe-b66ca56a3f80 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:19.673036 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-86e63cae-506b-4543-89d0-fc1a18207534 req-e627b5cc-e94a-49de-adfe-b66ca56a3f80 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:19.704638 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c9b6fc8d-37a7-455c-94e6-8eefcf204aa0 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:19.705354 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c9b6fc8d-37a7-455c-94e6-8eefcf204aa0 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] [instance: 48c8febb-db67-481b-8a56-e783d88edafa] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:19.720132 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-86e63cae-506b-4543-89d0-fc1a18207534 req-e627b5cc-e94a-49de-adfe-b66ca56a3f80 service nova] Creating event network-vif-plugged:7378638e-f54c-466a-9990-98a95d314366 for instance 48c8febb-db67-481b-8a56-e783d88edafa on n-h1-846466-12 Aug 04 16:59:19.722012 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9b6fc8d-37a7-455c-94e6-8eefcf204aa0 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:19.722683 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9b6fc8d-37a7-455c-94e6-8eefcf204aa0 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:19.723670 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9b6fc8d-37a7-455c-94e6-8eefcf204aa0 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:19.728242 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9b6fc8d-37a7-455c-94e6-8eefcf204aa0 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:19.743433 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-86e63cae-506b-4543-89d0-fc1a18207534 req-e627b5cc-e94a-49de-adfe-b66ca56a3f80 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.584122 Aug 04 16:59:19.746689 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2228/4376] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:19.894884 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6824f945-4913-4eff-99eb-85baa5ac86f1 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:19.895982 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6824f945-4913-4eff-99eb-85baa5ac86f1 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] [instance: a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:19.909071 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6824f945-4913-4eff-99eb-85baa5ac86f1 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:19.914064 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6824f945-4913-4eff-99eb-85baa5ac86f1 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:19.915203 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6824f945-4913-4eff-99eb-85baa5ac86f1 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:19.915853 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6824f945-4913-4eff-99eb-85baa5ac86f1 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:20.365714 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c9b6fc8d-37a7-455c-94e6-8eefcf204aa0 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ef05c9770f47bfaa3b36b3eeebbf03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1244cf4912514d41a7c5ba300e203ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:20.375715 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c9b6fc8d-37a7-455c-94e6-8eefcf204aa0 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] 10.222.0.23 "GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa" status: 200 len: 1314 microversion: 2.1 time: 0.675285 Aug 04 16:59:20.378378 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2149/4377] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:19 2022] GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa => generated 1314 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:59:20.402517 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9a78ffba-8845-4098-9476-25df293ce2d9 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:20.409338 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6824f945-4913-4eff-99eb-85baa5ac86f1 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e8fdfcd92428f8b43f6eb9e0d630d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6c14a1d17b47a9877001ced2b7733d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:20.410837 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9a78ffba-8845-4098-9476-25df293ce2d9 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:20.420123 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6824f945-4913-4eff-99eb-85baa5ac86f1 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] 10.222.0.23 "GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e" status: 200 len: 1316 microversion: 2.1 time: 0.530614 Aug 04 16:59:20.420503 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2229/4378] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:19 2022] GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e => generated 1316 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:59:20.425621 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9a78ffba-8845-4098-9476-25df293ce2d9 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:20.426719 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9a78ffba-8845-4098-9476-25df293ce2d9 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:20.428446 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9a78ffba-8845-4098-9476-25df293ce2d9 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:20.429727 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9a78ffba-8845-4098-9476-25df293ce2d9 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:20.434984 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a20c74c2-96cd-460f-ae4f-0bf8783e376a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:20.437473 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a20c74c2-96cd-460f-ae4f-0bf8783e376a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 760130d2-374e-4f4c-a73b-d7a99449e324] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:20.454643 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a20c74c2-96cd-460f-ae4f-0bf8783e376a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:20.455094 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a20c74c2-96cd-460f-ae4f-0bf8783e376a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:20.455891 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a20c74c2-96cd-460f-ae4f-0bf8783e376a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:20.456320 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a20c74c2-96cd-460f-ae4f-0bf8783e376a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:20.661413 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-a20c74c2-96cd-460f-ae4f-0bf8783e376a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lazy-loading 'services' on Instance uuid 760130d2-374e-4f4c-a73b-d7a99449e324 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:59:20.814301 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a20c74c2-96cd-460f-ae4f-0bf8783e376a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "DELETE /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324/os-volume_attachments/03279f98-526c-4c50-a56a-b778a5227b21" status: 202 len: 0 microversion: 2.1 time: 0.388974 Aug 04 16:59:20.814989 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2230/4379] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Aug 4 16:59:20 2022] DELETE /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324/os-volume_attachments/03279f98-526c-4c50-a56a-b778a5227b21 => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:59:20.836101 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-954a1c83-7a35-4ee1-82a8-1e8f0fe36e39 req-f7a4937c-6294-411e-b26a-27919a414f54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63185fca-5246-43fb-8d55-3ef5b7a5fcba", "tag": "9c23e8b8-64c3-4977-b3ff-1e91ba857153"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:20.887172 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-954a1c83-7a35-4ee1-82a8-1e8f0fe36e39 req-f7a4937c-6294-411e-b26a-27919a414f54 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:20.887701 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-954a1c83-7a35-4ee1-82a8-1e8f0fe36e39 req-f7a4937c-6294-411e-b26a-27919a414f54 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:20.923006 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-954a1c83-7a35-4ee1-82a8-1e8f0fe36e39 req-f7a4937c-6294-411e-b26a-27919a414f54 service nova] Creating event network-changed:9c23e8b8-64c3-4977-b3ff-1e91ba857153 for instance 63185fca-5246-43fb-8d55-3ef5b7a5fcba on n-h1-846466-12 Aug 04 16:59:20.929859 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-954a1c83-7a35-4ee1-82a8-1e8f0fe36e39 req-f7a4937c-6294-411e-b26a-27919a414f54 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112350 Aug 04 16:59:20.932019 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2231/4380] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:20.940314 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0816b7eb-15e4-40e8-ba53-3f549305f1c7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:20.941717 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0816b7eb-15e4-40e8-ba53-3f549305f1c7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:20.950183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0816b7eb-15e4-40e8-ba53-3f549305f1c7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:20.950923 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0816b7eb-15e4-40e8-ba53-3f549305f1c7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:20.952328 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0816b7eb-15e4-40e8-ba53-3f549305f1c7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:20.953227 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0816b7eb-15e4-40e8-ba53-3f549305f1c7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:20.963250 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9a78ffba-8845-4098-9476-25df293ce2d9 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e7c523e9d94d2994ebe9b2d3b86b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9ddb2693734bd5a0d3c4101a165998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:20.977270 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9a78ffba-8845-4098-9476-25df293ce2d9 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba" status: 200 len: 1322 microversion: 2.1 time: 0.597538 Aug 04 16:59:20.992815 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2150/4381] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:20 2022] GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba => generated 1322 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:20.993848 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-0816b7eb-15e4-40e8-ba53-3f549305f1c7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lazy-loading 'flavor' on Instance uuid fdec5afc-3a3a-4d61-a934-5edf0c7c1397 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:59:21.011303 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-687d438a-ef24-4085-9743-856dfba5bd22 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:21.026516 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-687d438a-ef24-4085-9743-856dfba5bd22 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 760130d2-374e-4f4c-a73b-d7a99449e324] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:21.043262 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-687d438a-ef24-4085-9743-856dfba5bd22 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:21.046043 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-687d438a-ef24-4085-9743-856dfba5bd22 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:21.047090 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-687d438a-ef24-4085-9743-856dfba5bd22 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:21.047797 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-687d438a-ef24-4085-9743-856dfba5bd22 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:21.094629 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-687d438a-ef24-4085-9743-856dfba5bd22 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100762 Aug 04 16:59:21.096296 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2151/4382] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 16:59:20 2022] GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:21.304085 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0816b7eb-15e4-40e8-ba53-3f549305f1c7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "POST /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397/action" status: 202 len: 0 microversion: 2.20 time: 0.369819 Aug 04 16:59:21.305927 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2232/4383] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Aug 4 16:59:20 2022] POST /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:59:21.313978 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f38bfcdf-c79b-4869-96df-6f7c0d2d7940 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:21.314627 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f38bfcdf-c79b-4869-96df-6f7c0d2d7940 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:21.316744 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:21.323821 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f38bfcdf-c79b-4869-96df-6f7c0d2d7940 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:21.324274 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f38bfcdf-c79b-4869-96df-6f7c0d2d7940 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:21.325319 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f38bfcdf-c79b-4869-96df-6f7c0d2d7940 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:21.325915 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f38bfcdf-c79b-4869-96df-6f7c0d2d7940 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:21.940559 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0683edc4-9151-4114-a504-822020ccaac1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-556469890", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "9a956378-b79d-4451-b0d0-c11ff419c38c"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:21.962324 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f38bfcdf-c79b-4869-96df-6f7c0d2d7940 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:21.978113 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f38bfcdf-c79b-4869-96df-6f7c0d2d7940 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:21.983010 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f38bfcdf-c79b-4869-96df-6f7c0d2d7940 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:21.987742 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f38bfcdf-c79b-4869-96df-6f7c0d2d7940 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1724 microversion: 2.20 time: 0.677825 Aug 04 16:59:21.991554 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2152/4384] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:59:21 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1724 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:59:21.998393 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4a4f9e05-5293-47c1-bfa0-2167acaf80da tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:21.999159 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4a4f9e05-5293-47c1-bfa0-2167acaf80da tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] [instance: 48c8febb-db67-481b-8a56-e783d88edafa] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:22.022675 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4a4f9e05-5293-47c1-bfa0-2167acaf80da tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:22.023132 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4a4f9e05-5293-47c1-bfa0-2167acaf80da tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:22.023917 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4a4f9e05-5293-47c1-bfa0-2167acaf80da tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:22.025248 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4a4f9e05-5293-47c1-bfa0-2167acaf80da tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:22.050355 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-0683edc4-9151-4114-a504-822020ccaac1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] validate_networks() for [('9a956378-b79d-4451-b0d0-c11ff419c38c', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:59:22.359977 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4a4f9e05-5293-47c1-bfa0-2167acaf80da tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ef05c9770f47bfaa3b36b3eeebbf03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1244cf4912514d41a7c5ba300e203ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:22.376296 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4a4f9e05-5293-47c1-bfa0-2167acaf80da tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] 10.222.0.23 "GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa" status: 200 len: 1501 microversion: 2.1 time: 0.382591 Aug 04 16:59:22.381335 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2153/4385] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:21 2022] GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa => generated 1501 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:22.387253 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e9f52ca1-16d6-477e-8e80-a8ebe35397ee tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:22.388209 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e9f52ca1-16d6-477e-8e80-a8ebe35397ee tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] [instance: a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:22.398387 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e9f52ca1-16d6-477e-8e80-a8ebe35397ee tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:22.399190 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e9f52ca1-16d6-477e-8e80-a8ebe35397ee tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:22.400201 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e9f52ca1-16d6-477e-8e80-a8ebe35397ee tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:22.400848 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e9f52ca1-16d6-477e-8e80-a8ebe35397ee tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:23.684742 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e9f52ca1-16d6-477e-8e80-a8ebe35397ee tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e8fdfcd92428f8b43f6eb9e0d630d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6c14a1d17b47a9877001ced2b7733d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:23.702230 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e9f52ca1-16d6-477e-8e80-a8ebe35397ee tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] 10.222.0.23 "GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e" status: 200 len: 1316 microversion: 2.1 time: 1.321957 Aug 04 16:59:23.708491 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-0683edc4-9151-4114-a504-822020ccaac1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:59:23.709659 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-0683edc4-9151-4114-a504-822020ccaac1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:59:23.710185 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-0683edc4-9151-4114-a504-822020ccaac1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:59:23.711410 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-0683edc4-9151-4114-a504-822020ccaac1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:59:23.711857 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-0683edc4-9151-4114-a504-822020ccaac1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:59:23.717556 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2154/4386] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:22 2022] GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e => generated 1316 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:23.736901 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-da6b1382-4055-4bdc-a28d-367d0bfda1c0 req-6f39e3d3-1f4e-4d04-b62e-20fabffc45b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e", "name": "network-vif-plugged", "status": "completed", "tag": "89824012-944f-4862-bf84-170177c00ac6"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:23.738310 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0683edc4-9151-4114-a504-822020ccaac1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:23.744687 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0683edc4-9151-4114-a504-822020ccaac1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:23.749145 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0683edc4-9151-4114-a504-822020ccaac1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:23.750580 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0683edc4-9151-4114-a504-822020ccaac1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:23.772783 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-da6b1382-4055-4bdc-a28d-367d0bfda1c0 req-6f39e3d3-1f4e-4d04-b62e-20fabffc45b7 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:23.777646 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-da6b1382-4055-4bdc-a28d-367d0bfda1c0 req-6f39e3d3-1f4e-4d04-b62e-20fabffc45b7 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:23.806104 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-da6b1382-4055-4bdc-a28d-367d0bfda1c0 req-6f39e3d3-1f4e-4d04-b62e-20fabffc45b7 service nova] Creating event network-vif-plugged:89824012-944f-4862-bf84-170177c00ac6 for instance a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e on n-h2-846466-12 Aug 04 16:59:23.809552 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-0683edc4-9151-4114-a504-822020ccaac1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Getting quotas for project 1a7231a2541d4bc0905b2305552429b9. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:59:23.823705 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-0683edc4-9151-4114-a504-822020ccaac1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Getting quotas for user c25fedd3842a4d7f9c5832abcbf19507 and project 1a7231a2541d4bc0905b2305552429b9. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:59:23.825359 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-da6b1382-4055-4bdc-a28d-367d0bfda1c0 req-6f39e3d3-1f4e-4d04-b62e-20fabffc45b7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101694 Aug 04 16:59:23.830343 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2155/4387] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:23.842419 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2fa801dc-4549-468c-b3d8-576a1a9fc22c tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:23.846109 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2fa801dc-4549-468c-b3d8-576a1a9fc22c tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:23.864929 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2fa801dc-4549-468c-b3d8-576a1a9fc22c tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:23.865349 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2fa801dc-4549-468c-b3d8-576a1a9fc22c tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:23.866383 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0683edc4-9151-4114-a504-822020ccaac1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:59:23.868179 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2fa801dc-4549-468c-b3d8-576a1a9fc22c tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:23.868802 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2fa801dc-4549-468c-b3d8-576a1a9fc22c tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:23.872898 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0683edc4-9151-4114-a504-822020ccaac1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:59:23.962021 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0683edc4-9151-4114-a504-822020ccaac1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.556148 Aug 04 16:59:23.963177 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2233/4388] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:59:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:59:23.968970 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c663bdd2-1da5-4dce-8620-5f850803fefa tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:23.973067 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c663bdd2-1da5-4dce-8620-5f850803fefa tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 760130d2-374e-4f4c-a73b-d7a99449e324] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:23.976696 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:23.988638 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c663bdd2-1da5-4dce-8620-5f850803fefa tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:23.989756 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c663bdd2-1da5-4dce-8620-5f850803fefa tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:23.992849 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c663bdd2-1da5-4dce-8620-5f850803fefa tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:23.992849 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c663bdd2-1da5-4dce-8620-5f850803fefa tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:24.045464 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c663bdd2-1da5-4dce-8620-5f850803fefa tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080432 Aug 04 16:59:24.051869 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2234/4389] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 16:59:23 2022] GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:24.058467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-013eaccf-0803-4f02-9380-cfebf39b9b2a tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:24.059423 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-013eaccf-0803-4f02-9380-cfebf39b9b2a tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] [instance: 48c8febb-db67-481b-8a56-e783d88edafa] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:24.067392 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-013eaccf-0803-4f02-9380-cfebf39b9b2a tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:24.068247 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-013eaccf-0803-4f02-9380-cfebf39b9b2a tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:24.069318 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-013eaccf-0803-4f02-9380-cfebf39b9b2a tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:24.070007 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-013eaccf-0803-4f02-9380-cfebf39b9b2a tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:24.399233 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=18 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:24.463459 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-013eaccf-0803-4f02-9380-cfebf39b9b2a tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ef05c9770f47bfaa3b36b3eeebbf03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1244cf4912514d41a7c5ba300e203ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:24.478674 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-013eaccf-0803-4f02-9380-cfebf39b9b2a tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] 10.222.0.23 "GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa" status: 200 len: 1501 microversion: 2.1 time: 0.425301 Aug 04 16:59:24.481474 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2235/4390] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:24 2022] GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa => generated 1501 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:24.491101 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ee704fd6-ee2a-4c78-8f2f-3165e8a86a6a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:24.500155 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ee704fd6-ee2a-4c78-8f2f-3165e8a86a6a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:24.521124 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ee704fd6-ee2a-4c78-8f2f-3165e8a86a6a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:24.521913 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ee704fd6-ee2a-4c78-8f2f-3165e8a86a6a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:24.527213 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ee704fd6-ee2a-4c78-8f2f-3165e8a86a6a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:24.527669 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ee704fd6-ee2a-4c78-8f2f-3165e8a86a6a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:24.690667 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2fa801dc-4549-468c-b3d8-576a1a9fc22c tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e7c523e9d94d2994ebe9b2d3b86b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9ddb2693734bd5a0d3c4101a165998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:24.702998 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2fa801dc-4549-468c-b3d8-576a1a9fc22c tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba" status: 200 len: 1322 microversion: 2.1 time: 0.870461 Aug 04 16:59:24.704229 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2156/4391] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:23 2022] GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba => generated 1322 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:24.709533 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f2c40638-6e2a-4c07-822b-e10cd23cd56f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:24.710348 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f2c40638-6e2a-4c07-822b-e10cd23cd56f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:24.828433 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f2c40638-6e2a-4c07-822b-e10cd23cd56f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:24.844244 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f2c40638-6e2a-4c07-822b-e10cd23cd56f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1216 microversion: 2.1 time: 0.138731 Aug 04 16:59:24.845114 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2157/4392] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:24 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1216 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:24.857594 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f0e719a6-59bb-4c9c-9648-d6f2bb8464ff tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:24.858136 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f0e719a6-59bb-4c9c-9648-d6f2bb8464ff tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] [instance: 48c8febb-db67-481b-8a56-e783d88edafa] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:24.891474 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f0e719a6-59bb-4c9c-9648-d6f2bb8464ff tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:24.891997 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f0e719a6-59bb-4c9c-9648-d6f2bb8464ff tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:24.897581 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f0e719a6-59bb-4c9c-9648-d6f2bb8464ff tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:24.898396 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f0e719a6-59bb-4c9c-9648-d6f2bb8464ff tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:24.969725 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-f0e719a6-59bb-4c9c-9648-d6f2bb8464ff tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lazy-loading 'flavor' on Instance uuid 48c8febb-db67-481b-8a56-e783d88edafa {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:59:25.035749 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ee704fd6-ee2a-4c78-8f2f-3165e8a86a6a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:25.043882 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:25.058412 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ee704fd6-ee2a-4c78-8f2f-3165e8a86a6a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:25.063601 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ee704fd6-ee2a-4c78-8f2f-3165e8a86a6a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:25.066305 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ee704fd6-ee2a-4c78-8f2f-3165e8a86a6a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1724 microversion: 2.20 time: 0.583162 Aug 04 16:59:25.069552 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2236/4393] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:59:24 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1724 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:59:25.086280 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0147cfaf-4d8d-459f-83c4-d47e25a01346 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:25.086697 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0147cfaf-4d8d-459f-83c4-d47e25a01346 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] [instance: a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:25.095637 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0147cfaf-4d8d-459f-83c4-d47e25a01346 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:25.097521 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0147cfaf-4d8d-459f-83c4-d47e25a01346 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:25.098355 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0147cfaf-4d8d-459f-83c4-d47e25a01346 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:25.098793 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0147cfaf-4d8d-459f-83c4-d47e25a01346 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:25.101809 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f0e719a6-59bb-4c9c-9648-d6f2bb8464ff tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] 10.222.0.23 "POST /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa/action" status: 202 len: 0 microversion: 2.1 time: 0.253767 Aug 04 16:59:25.103154 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2158/4394] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:59:24 2022] POST /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:59:25.125722 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-aed83351-b48c-4640-8f58-bc2729931cba tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:25.128245 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-aed83351-b48c-4640-8f58-bc2729931cba tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 760130d2-374e-4f4c-a73b-d7a99449e324] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:25.134948 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aed83351-b48c-4640-8f58-bc2729931cba tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:25.135564 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aed83351-b48c-4640-8f58-bc2729931cba tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:25.136756 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aed83351-b48c-4640-8f58-bc2729931cba tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:25.137187 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aed83351-b48c-4640-8f58-bc2729931cba tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:25.182043 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-aed83351-b48c-4640-8f58-bc2729931cba tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077451 Aug 04 16:59:25.183328 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2159/4395] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 16:59:25 2022] GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:25.198884 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-27802e6b-6c27-4787-95dc-5a3b6a4f89f0 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:25.199883 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-27802e6b-6c27-4787-95dc-5a3b6a4f89f0 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] [instance: 48c8febb-db67-481b-8a56-e783d88edafa] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:25.207131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-27802e6b-6c27-4787-95dc-5a3b6a4f89f0 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:25.207576 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-27802e6b-6c27-4787-95dc-5a3b6a4f89f0 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:25.208348 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-27802e6b-6c27-4787-95dc-5a3b6a4f89f0 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:25.208780 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-27802e6b-6c27-4787-95dc-5a3b6a4f89f0 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:25.518894 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0147cfaf-4d8d-459f-83c4-d47e25a01346 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e8fdfcd92428f8b43f6eb9e0d630d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6c14a1d17b47a9877001ced2b7733d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:25.538923 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-27802e6b-6c27-4787-95dc-5a3b6a4f89f0 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ef05c9770f47bfaa3b36b3eeebbf03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1244cf4912514d41a7c5ba300e203ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:25.548404 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-27802e6b-6c27-4787-95dc-5a3b6a4f89f0 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] 10.222.0.23 "GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa" status: 200 len: 1509 microversion: 2.1 time: 0.363827 Aug 04 16:59:25.549758 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0147cfaf-4d8d-459f-83c4-d47e25a01346 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] 10.222.0.23 "GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e" status: 200 len: 1316 microversion: 2.1 time: 0.478874 Aug 04 16:59:25.553434 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2237/4396] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:25 2022] GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e => generated 1316 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:25.563886 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2160/4397] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:25 2022] GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa => generated 1509 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:25.729858 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8a2cc7d5-0ae4-47fb-8469-0fc1b0922544 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:25.730964 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8a2cc7d5-0ae4-47fb-8469-0fc1b0922544 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:25.743188 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8a2cc7d5-0ae4-47fb-8469-0fc1b0922544 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:25.743636 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8a2cc7d5-0ae4-47fb-8469-0fc1b0922544 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:25.744443 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8a2cc7d5-0ae4-47fb-8469-0fc1b0922544 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:25.746673 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8a2cc7d5-0ae4-47fb-8469-0fc1b0922544 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:25.866666 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dd501cd2-3580-4c8d-8ef1-e9ae55b8549f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:25.867537 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-dd501cd2-3580-4c8d-8ef1-e9ae55b8549f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:25.877324 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd501cd2-3580-4c8d-8ef1-e9ae55b8549f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:25.878214 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd501cd2-3580-4c8d-8ef1-e9ae55b8549f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:25.879380 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd501cd2-3580-4c8d-8ef1-e9ae55b8549f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:25.880025 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd501cd2-3580-4c8d-8ef1-e9ae55b8549f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:26.031083 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-dd501cd2-3580-4c8d-8ef1-e9ae55b8549f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:26.039290 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dd501cd2-3580-4c8d-8ef1-e9ae55b8549f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1276 microversion: 2.1 time: 0.179118 Aug 04 16:59:26.056805 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2161/4398] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:25 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1276 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:26.096008 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b6ad3595-019c-4b6a-a2d6-60ca571e22a4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:26.096639 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b6ad3595-019c-4b6a-a2d6-60ca571e22a4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:26.108412 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b6ad3595-019c-4b6a-a2d6-60ca571e22a4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:26.108897 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b6ad3595-019c-4b6a-a2d6-60ca571e22a4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:26.112075 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b6ad3595-019c-4b6a-a2d6-60ca571e22a4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:26.112451 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b6ad3595-019c-4b6a-a2d6-60ca571e22a4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:26.122949 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8a2cc7d5-0ae4-47fb-8469-0fc1b0922544 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e7c523e9d94d2994ebe9b2d3b86b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9ddb2693734bd5a0d3c4101a165998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:26.135044 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8a2cc7d5-0ae4-47fb-8469-0fc1b0922544 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba" status: 200 len: 1322 microversion: 2.1 time: 0.411526 Aug 04 16:59:26.138319 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2238/4399] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:25 2022] GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba => generated 1322 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:26.195103 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5261c988-8871-4083-a758-d99781e59d60 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:26.197621 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5261c988-8871-4083-a758-d99781e59d60 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 760130d2-374e-4f4c-a73b-d7a99449e324] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:26.208009 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5261c988-8871-4083-a758-d99781e59d60 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:26.208599 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5261c988-8871-4083-a758-d99781e59d60 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:26.209416 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5261c988-8871-4083-a758-d99781e59d60 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:26.210005 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5261c988-8871-4083-a758-d99781e59d60 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:26.274353 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5261c988-8871-4083-a758-d99781e59d60 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083238 Aug 04 16:59:26.275070 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2239/4400] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 16:59:26 2022] GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:59:26.571545 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9cd995d0-d758-48ca-a85b-4169f5e2582a tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:26.572935 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9cd995d0-d758-48ca-a85b-4169f5e2582a tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] [instance: 48c8febb-db67-481b-8a56-e783d88edafa] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:26.582366 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9cd995d0-d758-48ca-a85b-4169f5e2582a tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:26.582881 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9cd995d0-d758-48ca-a85b-4169f5e2582a tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:26.583570 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9cd995d0-d758-48ca-a85b-4169f5e2582a tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:26.584307 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9cd995d0-d758-48ca-a85b-4169f5e2582a tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:26.590767 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:26.606404 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b6ad3595-019c-4b6a-a2d6-60ca571e22a4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:26.623700 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b6ad3595-019c-4b6a-a2d6-60ca571e22a4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:26.629965 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b6ad3595-019c-4b6a-a2d6-60ca571e22a4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:26.631556 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b6ad3595-019c-4b6a-a2d6-60ca571e22a4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1724 microversion: 2.20 time: 0.543338 Aug 04 16:59:26.632106 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2162/4401] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:59:26 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1724 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:59:26.640472 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-50fde300-3293-4ed0-b97e-cd7d50fffb13 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:26.647742 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-50fde300-3293-4ed0-b97e-cd7d50fffb13 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] [instance: a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:26.658712 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-50fde300-3293-4ed0-b97e-cd7d50fffb13 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:26.659437 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-50fde300-3293-4ed0-b97e-cd7d50fffb13 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:26.660358 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-50fde300-3293-4ed0-b97e-cd7d50fffb13 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:26.661114 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-50fde300-3293-4ed0-b97e-cd7d50fffb13 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:27.066350 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9cd995d0-d758-48ca-a85b-4169f5e2582a tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ef05c9770f47bfaa3b36b3eeebbf03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1244cf4912514d41a7c5ba300e203ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:27.075137 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9cd995d0-d758-48ca-a85b-4169f5e2582a tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] 10.222.0.23 "GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa" status: 200 len: 1492 microversion: 2.1 time: 0.508487 Aug 04 16:59:27.080217 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2240/4402] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:26 2022] GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa => generated 1492 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:59:27.089502 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-5ad888de-43cd-4197-9010-1d3e347f8adc req-71f58677-10cf-4eb8-8729-091a1ea3b82a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63185fca-5246-43fb-8d55-3ef5b7a5fcba", "name": "network-vif-plugged", "status": "completed", "tag": "9c23e8b8-64c3-4977-b3ff-1e91ba857153"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:27.113522 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-5ad888de-43cd-4197-9010-1d3e347f8adc req-71f58677-10cf-4eb8-8729-091a1ea3b82a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:27.116770 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-5ad888de-43cd-4197-9010-1d3e347f8adc req-71f58677-10cf-4eb8-8729-091a1ea3b82a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:27.130076 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-50fde300-3293-4ed0-b97e-cd7d50fffb13 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e8fdfcd92428f8b43f6eb9e0d630d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6c14a1d17b47a9877001ced2b7733d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:27.143266 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-5ad888de-43cd-4197-9010-1d3e347f8adc req-71f58677-10cf-4eb8-8729-091a1ea3b82a service nova] Creating event network-vif-plugged:9c23e8b8-64c3-4977-b3ff-1e91ba857153 for instance 63185fca-5246-43fb-8d55-3ef5b7a5fcba on n-h1-846466-12 Aug 04 16:59:27.148048 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-50fde300-3293-4ed0-b97e-cd7d50fffb13 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] 10.222.0.23 "GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e" status: 200 len: 1504 microversion: 2.1 time: 0.510111 Aug 04 16:59:27.148967 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2163/4403] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:26 2022] GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e => generated 1504 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:27.156625 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-5ad888de-43cd-4197-9010-1d3e347f8adc req-71f58677-10cf-4eb8-8729-091a1ea3b82a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074716 Aug 04 16:59:27.161748 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2241/4404] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:27.184876 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-987bcfb7-e294-459b-86bc-48f3387ccc12 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:27.185862 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-987bcfb7-e294-459b-86bc-48f3387ccc12 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:27.188400 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-703f4bf3-16b2-4c2e-952f-14fd08e9fdc9 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:27.189300 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-703f4bf3-16b2-4c2e-952f-14fd08e9fdc9 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] [instance: 48c8febb-db67-481b-8a56-e783d88edafa] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:27.204172 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-703f4bf3-16b2-4c2e-952f-14fd08e9fdc9 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:27.206480 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-703f4bf3-16b2-4c2e-952f-14fd08e9fdc9 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:27.207791 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-703f4bf3-16b2-4c2e-952f-14fd08e9fdc9 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:27.214105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-703f4bf3-16b2-4c2e-952f-14fd08e9fdc9 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:27.222629 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-987bcfb7-e294-459b-86bc-48f3387ccc12 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:27.223082 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-987bcfb7-e294-459b-86bc-48f3387ccc12 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:27.225898 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-987bcfb7-e294-459b-86bc-48f3387ccc12 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:27.227971 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-987bcfb7-e294-459b-86bc-48f3387ccc12 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:27.408537 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-703f4bf3-16b2-4c2e-952f-14fd08e9fdc9 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] 10.222.0.23 "POST /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa/action" status: 202 len: 0 microversion: 2.1 time: 0.243419 Aug 04 16:59:27.410092 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2242/4405] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:59:27 2022] POST /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:59:27.429187 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-75d9a7dc-0f1b-44a0-a531-8cb2450b6811 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:27.430059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-75d9a7dc-0f1b-44a0-a531-8cb2450b6811 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:27.442121 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-75d9a7dc-0f1b-44a0-a531-8cb2450b6811 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:27.442615 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-75d9a7dc-0f1b-44a0-a531-8cb2450b6811 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:27.443500 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-75d9a7dc-0f1b-44a0-a531-8cb2450b6811 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:27.443923 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-75d9a7dc-0f1b-44a0-a531-8cb2450b6811 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:27.966698 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-987bcfb7-e294-459b-86bc-48f3387ccc12 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:27.999360 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-987bcfb7-e294-459b-86bc-48f3387ccc12 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1316 microversion: 2.1 time: 0.849216 Aug 04 16:59:28.018521 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2164/4406] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:27 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1316 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:28.024252 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cbf61603-a19b-419c-b3b5-e3d94619a2d3 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:28.024963 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cbf61603-a19b-419c-b3b5-e3d94619a2d3 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] [instance: a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:28.033076 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cbf61603-a19b-419c-b3b5-e3d94619a2d3 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:28.033709 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cbf61603-a19b-419c-b3b5-e3d94619a2d3 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:28.034671 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cbf61603-a19b-419c-b3b5-e3d94619a2d3 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:28.035324 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cbf61603-a19b-419c-b3b5-e3d94619a2d3 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:28.092138 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-75d9a7dc-0f1b-44a0-a531-8cb2450b6811 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e7c523e9d94d2994ebe9b2d3b86b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9ddb2693734bd5a0d3c4101a165998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:28.101186 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-75d9a7dc-0f1b-44a0-a531-8cb2450b6811 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba" status: 200 len: 1322 microversion: 2.1 time: 0.689760 Aug 04 16:59:28.101967 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2243/4407] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:27 2022] GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba => generated 1322 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:28.107506 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2acd233b-c7fb-46e0-81f7-d912a55897c9 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:28.111071 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2acd233b-c7fb-46e0-81f7-d912a55897c9 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 760130d2-374e-4f4c-a73b-d7a99449e324] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:28.118255 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2acd233b-c7fb-46e0-81f7-d912a55897c9 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:28.118711 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2acd233b-c7fb-46e0-81f7-d912a55897c9 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:28.119474 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2acd233b-c7fb-46e0-81f7-d912a55897c9 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:28.120036 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2acd233b-c7fb-46e0-81f7-d912a55897c9 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:28.153378 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cbf61603-a19b-419c-b3b5-e3d94619a2d3 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.132934 Aug 04 16:59:28.158839 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2165/4408] 10.222.0.23 () {58 vars in 1296 bytes} [Thu Aug 4 16:59:28 2022] DELETE /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e/os-server-password => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:59:28.160425 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2acd233b-c7fb-46e0-81f7-d912a55897c9 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057024 Aug 04 16:59:28.161032 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2244/4409] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 16:59:28 2022] GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:59:28.166589 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f8c238a3-cdee-4f0c-9e4b-8cc7a6726ea8 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:28.166589 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f8c238a3-cdee-4f0c-9e4b-8cc7a6726ea8 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] [instance: 48c8febb-db67-481b-8a56-e783d88edafa] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:28.166798 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c9f8e607-a78c-4408-973d-eb6226c90899 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:28.166798 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c9f8e607-a78c-4408-973d-eb6226c90899 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:28.173709 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c9f8e607-a78c-4408-973d-eb6226c90899 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:28.174134 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c9f8e607-a78c-4408-973d-eb6226c90899 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:28.175291 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c9f8e607-a78c-4408-973d-eb6226c90899 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:28.175982 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c9f8e607-a78c-4408-973d-eb6226c90899 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:28.183037 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f8c238a3-cdee-4f0c-9e4b-8cc7a6726ea8 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:28.187799 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f8c238a3-cdee-4f0c-9e4b-8cc7a6726ea8 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:28.189474 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f8c238a3-cdee-4f0c-9e4b-8cc7a6726ea8 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:28.194725 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f8c238a3-cdee-4f0c-9e4b-8cc7a6726ea8 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:28.604727 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c9f8e607-a78c-4408-973d-eb6226c90899 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:28.617080 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c9f8e607-a78c-4408-973d-eb6226c90899 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:28.617816 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f8c238a3-cdee-4f0c-9e4b-8cc7a6726ea8 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ef05c9770f47bfaa3b36b3eeebbf03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1244cf4912514d41a7c5ba300e203ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:28.619539 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c9f8e607-a78c-4408-973d-eb6226c90899 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:28.621348 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c9f8e607-a78c-4408-973d-eb6226c90899 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1724 microversion: 2.20 time: 0.459276 Aug 04 16:59:28.622458 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2245/4410] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:59:28 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1724 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:59:28.628088 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e671a7fc-3b7a-481a-b3dd-5e07d903c9db tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:28.629017 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e671a7fc-3b7a-481a-b3dd-5e07d903c9db tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] [instance: a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:28.630826 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f8c238a3-cdee-4f0c-9e4b-8cc7a6726ea8 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] 10.222.0.23 "GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa" status: 200 len: 1498 microversion: 2.1 time: 0.474448 Aug 04 16:59:28.631709 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2166/4411] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:28 2022] GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa => generated 1498 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:28.642819 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2b30e9a0-f8c0-41e6-97e4-0ff27d0946f9 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:28.643620 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2b30e9a0-f8c0-41e6-97e4-0ff27d0946f9 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 760130d2-374e-4f4c-a73b-d7a99449e324] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:28.650657 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2b30e9a0-f8c0-41e6-97e4-0ff27d0946f9 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:28.651306 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2b30e9a0-f8c0-41e6-97e4-0ff27d0946f9 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:28.651828 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e671a7fc-3b7a-481a-b3dd-5e07d903c9db tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:28.652249 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2b30e9a0-f8c0-41e6-97e4-0ff27d0946f9 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:28.652366 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e671a7fc-3b7a-481a-b3dd-5e07d903c9db tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:28.652987 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2b30e9a0-f8c0-41e6-97e4-0ff27d0946f9 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:28.653220 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e671a7fc-3b7a-481a-b3dd-5e07d903c9db tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:28.653720 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e671a7fc-3b7a-481a-b3dd-5e07d903c9db tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:28.691483 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e671a7fc-3b7a-481a-b3dd-5e07d903c9db tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] 10.222.0.23 "GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.067513 Aug 04 16:59:28.692368 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2246/4412] 10.222.0.23 () {58 vars in 1293 bytes} [Thu Aug 4 16:59:28 2022] GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e/os-server-password => generated 16 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:59:28.699303 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2b30e9a0-f8c0-41e6-97e4-0ff27d0946f9 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 760130d2-374e-4f4c-a73b-d7a99449e324] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:59:28.703129 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-70475d36-4d30-47b7-8fb4-d481aa370ecb tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:28.703641 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-70475d36-4d30-47b7-8fb4-d481aa370ecb tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] [instance: a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:28.710740 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-70475d36-4d30-47b7-8fb4-d481aa370ecb tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:28.711198 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-70475d36-4d30-47b7-8fb4-d481aa370ecb tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:28.711981 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-70475d36-4d30-47b7-8fb4-d481aa370ecb tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:28.712413 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-70475d36-4d30-47b7-8fb4-d481aa370ecb tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:28.742669 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-70475d36-4d30-47b7-8fb4-d481aa370ecb tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] [instance: a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:59:28.816124 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2b30e9a0-f8c0-41e6-97e4-0ff27d0946f9 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "DELETE /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324" status: 204 len: 0 microversion: 2.1 time: 0.181544 Aug 04 16:59:28.820177 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2167/4413] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:59:28 2022] DELETE /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:59:28.827094 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8bba4fea-9036-4086-bad3-5cc896930d02 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:28.827854 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8bba4fea-9036-4086-bad3-5cc896930d02 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 760130d2-374e-4f4c-a73b-d7a99449e324] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:28.835466 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8bba4fea-9036-4086-bad3-5cc896930d02 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:28.836331 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8bba4fea-9036-4086-bad3-5cc896930d02 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:28.836671 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8bba4fea-9036-4086-bad3-5cc896930d02 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:28.837707 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8bba4fea-9036-4086-bad3-5cc896930d02 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:28.876891 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-70475d36-4d30-47b7-8fb4-d481aa370ecb tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e" status: 204 len: 0 microversion: 2.1 time: 0.177641 Aug 04 16:59:28.880443 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2247/4414] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:59:28 2022] DELETE /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 16:59:28.889587 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ec374f36-0b25-41c3-b308-93d0d7882f57 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:28.890293 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ec374f36-0b25-41c3-b308-93d0d7882f57 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] [instance: a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:28.894140 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:28.898961 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec374f36-0b25-41c3-b308-93d0d7882f57 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:28.899384 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec374f36-0b25-41c3-b308-93d0d7882f57 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:28.900180 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec374f36-0b25-41c3-b308-93d0d7882f57 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:28.901148 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec374f36-0b25-41c3-b308-93d0d7882f57 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:29.202418 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8bba4fea-9036-4086-bad3-5cc896930d02 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:29.215045 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8bba4fea-9036-4086-bad3-5cc896930d02 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324" status: 200 len: 1680 microversion: 2.1 time: 0.393037 Aug 04 16:59:29.216819 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2168/4415] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:28 2022] GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324 => generated 1680 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:29.222132 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ace5d770-f0b6-40c3-9f7b-583a25f9767f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:29.239451 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ace5d770-f0b6-40c3-9f7b-583a25f9767f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:29.260003 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ace5d770-f0b6-40c3-9f7b-583a25f9767f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:29.260547 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ace5d770-f0b6-40c3-9f7b-583a25f9767f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:29.261841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ace5d770-f0b6-40c3-9f7b-583a25f9767f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:29.262282 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ace5d770-f0b6-40c3-9f7b-583a25f9767f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:29.392042 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ec374f36-0b25-41c3-b308-93d0d7882f57 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e8fdfcd92428f8b43f6eb9e0d630d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6c14a1d17b47a9877001ced2b7733d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:29.403938 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ec374f36-0b25-41c3-b308-93d0d7882f57 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] 10.222.0.23 "GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e" status: 200 len: 1510 microversion: 2.1 time: 0.519045 Aug 04 16:59:29.410466 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2248/4416] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:28 2022] GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e => generated 1510 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:29.428203 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f3d176ed-e882-4229-9e3d-9682a9581fde tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:29.429957 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f3d176ed-e882-4229-9e3d-9682a9581fde tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:29.439123 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3d176ed-e882-4229-9e3d-9682a9581fde tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:29.439930 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3d176ed-e882-4229-9e3d-9682a9581fde tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:29.441634 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3d176ed-e882-4229-9e3d-9682a9581fde tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:29.442312 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3d176ed-e882-4229-9e3d-9682a9581fde tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:29.750496 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ace5d770-f0b6-40c3-9f7b-583a25f9767f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:29.760777 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ace5d770-f0b6-40c3-9f7b-583a25f9767f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1316 microversion: 2.1 time: 0.541691 Aug 04 16:59:29.775666 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2169/4417] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:29 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1316 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:29.790333 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-470bfab3-d3cb-4f4b-8b28-374e6d5d51f1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:29.793895 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-470bfab3-d3cb-4f4b-8b28-374e6d5d51f1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:29.802072 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-470bfab3-d3cb-4f4b-8b28-374e6d5d51f1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:29.802824 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-470bfab3-d3cb-4f4b-8b28-374e6d5d51f1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:29.803839 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-470bfab3-d3cb-4f4b-8b28-374e6d5d51f1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:29.804488 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-470bfab3-d3cb-4f4b-8b28-374e6d5d51f1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:29.851436 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f3d176ed-e882-4229-9e3d-9682a9581fde tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e7c523e9d94d2994ebe9b2d3b86b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9ddb2693734bd5a0d3c4101a165998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:29.860790 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f3d176ed-e882-4229-9e3d-9682a9581fde tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba" status: 200 len: 1518 microversion: 2.1 time: 0.448756 Aug 04 16:59:29.861423 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2249/4418] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:29 2022] GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba => generated 1518 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:29.866485 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0ab748d4-f496-42ad-b9cb-50fefa13aa4f tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:29.868023 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0ab748d4-f496-42ad-b9cb-50fefa13aa4f tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] [instance: 48c8febb-db67-481b-8a56-e783d88edafa] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:29.875624 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ab748d4-f496-42ad-b9cb-50fefa13aa4f tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:29.876431 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ab748d4-f496-42ad-b9cb-50fefa13aa4f tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:29.877471 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ab748d4-f496-42ad-b9cb-50fefa13aa4f tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:29.878130 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ab748d4-f496-42ad-b9cb-50fefa13aa4f tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:30.074599 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-470bfab3-d3cb-4f4b-8b28-374e6d5d51f1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:30.089361 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-470bfab3-d3cb-4f4b-8b28-374e6d5d51f1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:30.100906 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-470bfab3-d3cb-4f4b-8b28-374e6d5d51f1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:30.106589 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-470bfab3-d3cb-4f4b-8b28-374e6d5d51f1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1724 microversion: 2.20 time: 0.328032 Aug 04 16:59:30.107594 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2170/4419] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:59:29 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1724 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:59:30.122404 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-cf3fd6c1-ac0d-41d4-b467-1327b9e63479 req-78d578d7-4ee6-40f1-9b0d-931532a894df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7094f480-111a-4c4e-8a77-2df578c044c0", "tag": "7cc4e42a-ac69-4d95-810a-566a44e11ef2"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:30.141367 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-cf3fd6c1-ac0d-41d4-b467-1327b9e63479 req-78d578d7-4ee6-40f1-9b0d-931532a894df service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:30.141896 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-cf3fd6c1-ac0d-41d4-b467-1327b9e63479 req-78d578d7-4ee6-40f1-9b0d-931532a894df service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:30.157683 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-cf3fd6c1-ac0d-41d4-b467-1327b9e63479 req-78d578d7-4ee6-40f1-9b0d-931532a894df service nova] Creating event network-changed:7cc4e42a-ac69-4d95-810a-566a44e11ef2 for instance 7094f480-111a-4c4e-8a77-2df578c044c0 on n-h1-846466-12 Aug 04 16:59:30.161884 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0ab748d4-f496-42ad-b9cb-50fefa13aa4f tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ef05c9770f47bfaa3b36b3eeebbf03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1244cf4912514d41a7c5ba300e203ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:30.163739 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-cf3fd6c1-ac0d-41d4-b467-1327b9e63479 req-78d578d7-4ee6-40f1-9b0d-931532a894df service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053195 Aug 04 16:59:30.164350 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2171/4420] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:30.171243 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0ab748d4-f496-42ad-b9cb-50fefa13aa4f tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] 10.222.0.23 "GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa" status: 200 len: 1501 microversion: 2.1 time: 0.308528 Aug 04 16:59:30.171916 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2250/4421] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:29 2022] GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa => generated 1501 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:30.173474 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cdd96a3f-fa21-43b5-955a-549013d5d288 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:30.176120 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cdd96a3f-fa21-43b5-955a-549013d5d288 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:30.183140 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cdd96a3f-fa21-43b5-955a-549013d5d288 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:30.183811 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cdd96a3f-fa21-43b5-955a-549013d5d288 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:30.184790 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cdd96a3f-fa21-43b5-955a-549013d5d288 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:30.185414 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cdd96a3f-fa21-43b5-955a-549013d5d288 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:30.194250 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bdc6b72a-c5c6-4923-a92f-e0bcbb591d61 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:30.194900 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bdc6b72a-c5c6-4923-a92f-e0bcbb591d61 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] [instance: 48c8febb-db67-481b-8a56-e783d88edafa] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:30.202059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bdc6b72a-c5c6-4923-a92f-e0bcbb591d61 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:30.202600 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bdc6b72a-c5c6-4923-a92f-e0bcbb591d61 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:30.203648 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bdc6b72a-c5c6-4923-a92f-e0bcbb591d61 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:30.204323 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bdc6b72a-c5c6-4923-a92f-e0bcbb591d61 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:30.212896 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-cdd96a3f-fa21-43b5-955a-549013d5d288 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lazy-loading 'flavor' on Instance uuid 63185fca-5246-43fb-8d55-3ef5b7a5fcba {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:59:30.217535 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=6,nova_cell1:UPDATE=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:30.245874 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-bdc6b72a-c5c6-4923-a92f-e0bcbb591d61 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lazy-loading 'flavor' on Instance uuid 48c8febb-db67-481b-8a56-e783d88edafa {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:59:30.311532 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cdd96a3f-fa21-43b5-955a-549013d5d288 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "POST /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba/action" status: 200 len: 32 microversion: 2.1 time: 0.142273 Aug 04 16:59:30.312477 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2172/4422] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:59:30 2022] POST /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba/action => generated 32 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:59:30.318340 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-416cd89e-7722-4e7b-a8e3-f6974b0b2328 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:30.319116 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-416cd89e-7722-4e7b-a8e3-f6974b0b2328 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 760130d2-374e-4f4c-a73b-d7a99449e324] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:30.326035 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-416cd89e-7722-4e7b-a8e3-f6974b0b2328 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:30.326486 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-416cd89e-7722-4e7b-a8e3-f6974b0b2328 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:30.327256 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-416cd89e-7722-4e7b-a8e3-f6974b0b2328 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:30.327699 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-416cd89e-7722-4e7b-a8e3-f6974b0b2328 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:30.328514 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bdc6b72a-c5c6-4923-a92f-e0bcbb591d61 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] 10.222.0.23 "POST /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa/action" status: 202 len: 0 microversion: 2.1 time: 0.138389 Aug 04 16:59:30.332077 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2251/4423] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:59:30 2022] POST /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:59:30.337850 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b489a797-6413-46c5-a911-80fcbee13061 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:30.339116 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b489a797-6413-46c5-a911-80fcbee13061 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:30.347362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b489a797-6413-46c5-a911-80fcbee13061 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:30.348079 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b489a797-6413-46c5-a911-80fcbee13061 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:30.348861 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b489a797-6413-46c5-a911-80fcbee13061 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:30.349311 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b489a797-6413-46c5-a911-80fcbee13061 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:30.973981 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-416cd89e-7722-4e7b-a8e3-f6974b0b2328 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:30.987781 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-416cd89e-7722-4e7b-a8e3-f6974b0b2328 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324" status: 200 len: 1680 microversion: 2.1 time: 0.673820 Aug 04 16:59:30.988707 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2173/4424] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:30 2022] GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324 => generated 1680 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:30.993336 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b0e785c4-3663-4b73-b3e1-88e129f7123d tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:30.993932 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b0e785c4-3663-4b73-b3e1-88e129f7123d tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] [instance: 48c8febb-db67-481b-8a56-e783d88edafa] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:31.008827 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b0e785c4-3663-4b73-b3e1-88e129f7123d tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:31.014000 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b0e785c4-3663-4b73-b3e1-88e129f7123d tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:31.015081 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b0e785c4-3663-4b73-b3e1-88e129f7123d tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:31.015526 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b0e785c4-3663-4b73-b3e1-88e129f7123d tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:31.067647 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b489a797-6413-46c5-a911-80fcbee13061 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e7c523e9d94d2994ebe9b2d3b86b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9ddb2693734bd5a0d3c4101a165998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:31.080638 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b489a797-6413-46c5-a911-80fcbee13061 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba" status: 200 len: 1524 microversion: 2.1 time: 0.746645 Aug 04 16:59:31.081667 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2252/4425] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:30 2022] GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba => generated 1524 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:31.087317 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-560ec9a4-88a7-44c3-87f3-d702722dd279 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:31.089856 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-560ec9a4-88a7-44c3-87f3-d702722dd279 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] [instance: a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:31.097398 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-560ec9a4-88a7-44c3-87f3-d702722dd279 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:31.098206 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-560ec9a4-88a7-44c3-87f3-d702722dd279 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:31.099778 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-560ec9a4-88a7-44c3-87f3-d702722dd279 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:31.101024 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-560ec9a4-88a7-44c3-87f3-d702722dd279 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:31.122720 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:31.426710 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b0e785c4-3663-4b73-b3e1-88e129f7123d tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ef05c9770f47bfaa3b36b3eeebbf03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1244cf4912514d41a7c5ba300e203ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:31.430814 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-560ec9a4-88a7-44c3-87f3-d702722dd279 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e8fdfcd92428f8b43f6eb9e0d630d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6c14a1d17b47a9877001ced2b7733d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:31.441272 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-560ec9a4-88a7-44c3-87f3-d702722dd279 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] 10.222.0.23 "GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e" status: 200 len: 1510 microversion: 2.1 time: 0.358208 Aug 04 16:59:31.444297 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2253/4426] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:31 2022] GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e => generated 1510 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:31.461498 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8bb5ebb3-db08-4486-85e5-0a7b46fd4de0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:31.462449 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8bb5ebb3-db08-4486-85e5-0a7b46fd4de0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:31.468945 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b0e785c4-3663-4b73-b3e1-88e129f7123d tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] 10.222.0.23 "GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa" status: 200 len: 1509 microversion: 2.1 time: 0.477561 Aug 04 16:59:31.470480 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8bb5ebb3-db08-4486-85e5-0a7b46fd4de0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:31.470910 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8bb5ebb3-db08-4486-85e5-0a7b46fd4de0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:31.472271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8bb5ebb3-db08-4486-85e5-0a7b46fd4de0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:31.472813 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8bb5ebb3-db08-4486-85e5-0a7b46fd4de0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:31.487437 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2174/4427] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:30 2022] GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa => generated 1509 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:31.498105 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-96a6215f-53b8-41cc-91e8-7d5328d0cfcf tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:31.507585 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-96a6215f-53b8-41cc-91e8-7d5328d0cfcf tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:31.518819 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-96a6215f-53b8-41cc-91e8-7d5328d0cfcf tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:31.519625 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-96a6215f-53b8-41cc-91e8-7d5328d0cfcf tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:31.520450 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-96a6215f-53b8-41cc-91e8-7d5328d0cfcf tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:31.521077 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-96a6215f-53b8-41cc-91e8-7d5328d0cfcf tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:31.820084 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8bb5ebb3-db08-4486-85e5-0a7b46fd4de0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:31.829311 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8bb5ebb3-db08-4486-85e5-0a7b46fd4de0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1316 microversion: 2.1 time: 0.371639 Aug 04 16:59:31.841408 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2254/4428] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:31 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1316 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:31.856642 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-96a6215f-53b8-41cc-91e8-7d5328d0cfcf tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:31.871223 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-96a6215f-53b8-41cc-91e8-7d5328d0cfcf tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:31.873987 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-96a6215f-53b8-41cc-91e8-7d5328d0cfcf tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:31.875521 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-96a6215f-53b8-41cc-91e8-7d5328d0cfcf tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1724 microversion: 2.20 time: 0.382711 Aug 04 16:59:31.876255 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2175/4429] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:59:31 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1724 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:59:32.014295 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-70288956-6f6d-4bd7-8ef6-8711b1787a28 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:32.015468 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-70288956-6f6d-4bd7-8ef6-8711b1787a28 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 760130d2-374e-4f4c-a73b-d7a99449e324] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:32.024051 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-70288956-6f6d-4bd7-8ef6-8711b1787a28 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:32.025007 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-70288956-6f6d-4bd7-8ef6-8711b1787a28 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:32.026738 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-70288956-6f6d-4bd7-8ef6-8711b1787a28 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:32.028650 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-70288956-6f6d-4bd7-8ef6-8711b1787a28 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:32.110906 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6913fb40-7351-40c4-9cb1-58fa257149fc tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:32.111509 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6913fb40-7351-40c4-9cb1-58fa257149fc tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:32.120254 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6913fb40-7351-40c4-9cb1-58fa257149fc tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:32.121151 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6913fb40-7351-40c4-9cb1-58fa257149fc tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:32.122222 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6913fb40-7351-40c4-9cb1-58fa257149fc tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:32.122908 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6913fb40-7351-40c4-9cb1-58fa257149fc tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:32.367639 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-70288956-6f6d-4bd7-8ef6-8711b1787a28 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:32.383511 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-70288956-6f6d-4bd7-8ef6-8711b1787a28 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324" status: 200 len: 1680 microversion: 2.1 time: 0.375208 Aug 04 16:59:32.384858 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2255/4430] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:32 2022] GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324 => generated 1680 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:32.392637 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-1ac5ba41-5da4-4945-9e24-a0dd315625fc req-d46242d2-dde6-458b-95c4-25e3433161cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e", "name": "network-vif-deleted", "tag": "89824012-944f-4862-bf84-170177c00ac6"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:32.417924 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-1ac5ba41-5da4-4945-9e24-a0dd315625fc req-d46242d2-dde6-458b-95c4-25e3433161cb service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:32.418867 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-1ac5ba41-5da4-4945-9e24-a0dd315625fc req-d46242d2-dde6-458b-95c4-25e3433161cb service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:32.436501 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-1ac5ba41-5da4-4945-9e24-a0dd315625fc req-d46242d2-dde6-458b-95c4-25e3433161cb service nova] Creating event network-vif-deleted:89824012-944f-4862-bf84-170177c00ac6 for instance a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e on n-h2-846466-12 Aug 04 16:59:32.443361 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-1ac5ba41-5da4-4945-9e24-a0dd315625fc req-d46242d2-dde6-458b-95c4-25e3433161cb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055735 Aug 04 16:59:32.444577 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2256/4431] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:32.463381 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6913fb40-7351-40c4-9cb1-58fa257149fc tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e7c523e9d94d2994ebe9b2d3b86b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9ddb2693734bd5a0d3c4101a165998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:32.467465 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-53807ff1-af3e-4b0a-ad61-587b7f4466e1 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:32.468414 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-53807ff1-af3e-4b0a-ad61-587b7f4466e1 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] [instance: a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:32.471779 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6913fb40-7351-40c4-9cb1-58fa257149fc tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba" status: 200 len: 1524 microversion: 2.1 time: 0.364689 Aug 04 16:59:32.476377 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-53807ff1-af3e-4b0a-ad61-587b7f4466e1 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:32.477014 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-53807ff1-af3e-4b0a-ad61-587b7f4466e1 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:32.477980 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-53807ff1-af3e-4b0a-ad61-587b7f4466e1 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:32.480550 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2176/4432] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:32 2022] GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba => generated 1524 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:32.482573 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-53807ff1-af3e-4b0a-ad61-587b7f4466e1 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:32.506598 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bc3d4f37-10f9-473d-b59c-90a40a169bcb tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:32.507620 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bc3d4f37-10f9-473d-b59c-90a40a169bcb tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] [instance: 48c8febb-db67-481b-8a56-e783d88edafa] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:32.518910 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bc3d4f37-10f9-473d-b59c-90a40a169bcb tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:32.519955 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bc3d4f37-10f9-473d-b59c-90a40a169bcb tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:32.521308 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bc3d4f37-10f9-473d-b59c-90a40a169bcb tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:32.522059 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bc3d4f37-10f9-473d-b59c-90a40a169bcb tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:32.551926 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-53807ff1-af3e-4b0a-ad61-587b7f4466e1 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:32.555628 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-53807ff1-af3e-4b0a-ad61-587b7f4466e1 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:32.556087 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-53807ff1-af3e-4b0a-ad61-587b7f4466e1 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lazy-loading 'fault' on Instance uuid a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:59:32.736786 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-53807ff1-af3e-4b0a-ad61-587b7f4466e1 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13e8fdfcd92428f8b43f6eb9e0d630d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6c14a1d17b47a9877001ced2b7733d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:32.746371 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-53807ff1-af3e-4b0a-ad61-587b7f4466e1 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] 10.222.0.23 "GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e" status: 200 len: 1306 microversion: 2.1 time: 0.285337 Aug 04 16:59:32.759010 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2257/4433] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:32 2022] GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e => generated 1306 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:59:32.854316 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f9f03ea3-22d3-462b-a3a8-ee4022f6b023 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:32.855227 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f9f03ea3-22d3-462b-a3a8-ee4022f6b023 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:32.864760 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9f03ea3-22d3-462b-a3a8-ee4022f6b023 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:32.865211 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9f03ea3-22d3-462b-a3a8-ee4022f6b023 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:32.868759 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9f03ea3-22d3-462b-a3a8-ee4022f6b023 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:32.869487 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9f03ea3-22d3-462b-a3a8-ee4022f6b023 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:33.080311 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bc3d4f37-10f9-473d-b59c-90a40a169bcb tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ef05c9770f47bfaa3b36b3eeebbf03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1244cf4912514d41a7c5ba300e203ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:33.089333 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bc3d4f37-10f9-473d-b59c-90a40a169bcb tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] 10.222.0.23 "GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa" status: 200 len: 1492 microversion: 2.1 time: 0.597170 Aug 04 16:59:33.090374 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2177/4434] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:32 2022] GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa => generated 1492 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:33.095557 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-69bf69b3-d0fd-458c-9a56-1eedfb1190cf tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:33.096356 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-69bf69b3-d0fd-458c-9a56-1eedfb1190cf tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:33.106460 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-69bf69b3-d0fd-458c-9a56-1eedfb1190cf tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:33.107397 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-69bf69b3-d0fd-458c-9a56-1eedfb1190cf tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:33.108512 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-69bf69b3-d0fd-458c-9a56-1eedfb1190cf tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:33.109046 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-69bf69b3-d0fd-458c-9a56-1eedfb1190cf tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:33.258237 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f9f03ea3-22d3-462b-a3a8-ee4022f6b023 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:33.276201 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f9f03ea3-22d3-462b-a3a8-ee4022f6b023 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1316 microversion: 2.1 time: 0.427304 Aug 04 16:59:33.290617 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2258/4435] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:32 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1316 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:33.303173 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cc01c076-98dc-4970-80f0-e13d7b94b67f tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:33.305198 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cc01c076-98dc-4970-80f0-e13d7b94b67f tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] [instance: 48c8febb-db67-481b-8a56-e783d88edafa] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:33.323159 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cc01c076-98dc-4970-80f0-e13d7b94b67f tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:33.323763 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cc01c076-98dc-4970-80f0-e13d7b94b67f tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:33.324403 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cc01c076-98dc-4970-80f0-e13d7b94b67f tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:33.324835 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cc01c076-98dc-4970-80f0-e13d7b94b67f tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:33.456751 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cc01c076-98dc-4970-80f0-e13d7b94b67f tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] 10.222.0.23 "POST /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa/action" status: 202 len: 0 microversion: 2.1 time: 0.164539 Aug 04 16:59:33.460958 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2259/4436] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 16:59:33 2022] POST /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:59:33.469190 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-178b1e69-140c-48d7-a36e-fca5f6cbd0ef tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:33.469914 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-178b1e69-140c-48d7-a36e-fca5f6cbd0ef tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 760130d2-374e-4f4c-a73b-d7a99449e324] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:33.485577 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-178b1e69-140c-48d7-a36e-fca5f6cbd0ef tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:33.486365 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-178b1e69-140c-48d7-a36e-fca5f6cbd0ef tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:33.487636 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-178b1e69-140c-48d7-a36e-fca5f6cbd0ef tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:33.488072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-178b1e69-140c-48d7-a36e-fca5f6cbd0ef tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:33.632224 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-178b1e69-140c-48d7-a36e-fca5f6cbd0ef tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:33.645138 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-178b1e69-140c-48d7-a36e-fca5f6cbd0ef tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324" status: 200 len: 1612 microversion: 2.1 time: 0.182859 Aug 04 16:59:33.646188 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2260/4437] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:33 2022] GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324 => generated 1612 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:33.661039 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1961ce6b-3041-45b8-b3f0-836b8cdaa314 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:33.661815 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1961ce6b-3041-45b8-b3f0-836b8cdaa314 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] [instance: 48c8febb-db67-481b-8a56-e783d88edafa] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:33.685354 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1961ce6b-3041-45b8-b3f0-836b8cdaa314 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:33.685818 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1961ce6b-3041-45b8-b3f0-836b8cdaa314 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:33.686599 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1961ce6b-3041-45b8-b3f0-836b8cdaa314 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:33.687036 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1961ce6b-3041-45b8-b3f0-836b8cdaa314 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:33.783576 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:33.850610 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:33.932614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-69bf69b3-d0fd-458c-9a56-1eedfb1190cf tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:33.950968 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-69bf69b3-d0fd-458c-9a56-1eedfb1190cf tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:33.952706 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-69bf69b3-d0fd-458c-9a56-1eedfb1190cf tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:33.953972 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-69bf69b3-d0fd-458c-9a56-1eedfb1190cf tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1745 microversion: 2.20 time: 0.862222 Aug 04 16:59:33.954952 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2178/4438] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:59:33 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1745 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:59:33.959845 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4274f5a2-ec5c-40e2-8bf2-d1feeec474b1 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:33.966708 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4274f5a2-ec5c-40e2-8bf2-d1feeec474b1 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:33.976563 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4274f5a2-ec5c-40e2-8bf2-d1feeec474b1 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:33.980895 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4274f5a2-ec5c-40e2-8bf2-d1feeec474b1 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:33.982181 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4274f5a2-ec5c-40e2-8bf2-d1feeec474b1 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:33.982815 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4274f5a2-ec5c-40e2-8bf2-d1feeec474b1 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:34.028972 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1961ce6b-3041-45b8-b3f0-836b8cdaa314 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ef05c9770f47bfaa3b36b3eeebbf03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1244cf4912514d41a7c5ba300e203ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:34.043747 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1961ce6b-3041-45b8-b3f0-836b8cdaa314 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] 10.222.0.23 "GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa" status: 200 len: 1498 microversion: 2.1 time: 0.395179 Aug 04 16:59:34.045864 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2261/4439] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:33 2022] GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa => generated 1498 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:34.068358 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9ffaadef-16da-4175-8986-925e6e879239 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:34.068981 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9ffaadef-16da-4175-8986-925e6e879239 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] [instance: a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:34.099592 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9ffaadef-16da-4175-8986-925e6e879239 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:34.100039 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9ffaadef-16da-4175-8986-925e6e879239 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:34.100831 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9ffaadef-16da-4175-8986-925e6e879239 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:34.101423 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9ffaadef-16da-4175-8986-925e6e879239 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:34.158710 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-9ffaadef-16da-4175-8986-925e6e879239 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] HTTP exception thrown: Instance a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e could not be found. Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9ffaadef-16da-4175-8986-925e6e879239 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Request method failure captured: Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e HTTP/1.1 Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_rW3tCvCm9YpnAJ9ziHS1hs9lbIkcY37vy-A5T_Spw1pd7p8Q-mTVkH1bSGX3XOTD11O6NjfHfFeIWSV_W9she1O4Woti01pWlHG3KyqX4MLo5xqbaixMCpkYaXClToYxZFDRwOlCUN_psMl1dqsMcg0V3eIdeSB_ci3NT6qQNZYCg Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 2f6c14a1d17b47a9877001ced2b7733d Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerPasswordTestJSON-336138431 Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f6c14a1d17b47a9877001ced2b7733d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2f6c14a1d17b47a9877001ced2b7733d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f6c14a1d17b47a9877001ced2b7733d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2f6c14a1d17b47a9877001ced2b7733d"}]}] Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerPasswordTestJSON-336138431 Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 2f6c14a1d17b47a9877001ced2b7733d Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerPasswordTestJSON-336138431 Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerPasswordTestJSON-336138431-project Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: f13e8fdfcd92428f8b43f6eb9e0d630d Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerPasswordTestJSON-336138431-project Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e could not be found. Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e'} Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e could not be found. Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e could not be found. Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:34.160396 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:59:34.165187 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:34.165187 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:59:34.165187 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:59:34.165187 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:59:34.165187 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:59:34.165187 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e could not be found. Aug 04 16:59:34.165187 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:59:34.165187 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9ffaadef-16da-4175-8986-925e6e879239 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] Returning 404 to user: Instance a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:59:34.165187 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9ffaadef-16da-4175-8986-925e6e879239 tempest-ServerPasswordTestJSON-336138431 tempest-ServerPasswordTestJSON-336138431-project] 10.222.0.23 "GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e" status: 404 len: 111 microversion: 2.1 time: 0.115718 Aug 04 16:59:34.181684 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2262/4440] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:34 2022] GET /compute/v2.1/servers/a90e80f8-4f2f-4463-8d3f-31fb7ac91b3e => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:59:34.186757 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-690396f0-26e4-481f-bb65-73388ec3639b req-38257c61-c2f7-4063-ae98-3d1828e4de24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "760130d2-374e-4f4c-a73b-d7a99449e324", "name": "network-vif-deleted", "tag": "cbfa4f3b-18b3-43da-9dc1-bb3c05508ec3"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:34.204469 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-690396f0-26e4-481f-bb65-73388ec3639b req-38257c61-c2f7-4063-ae98-3d1828e4de24 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:34.209651 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-690396f0-26e4-481f-bb65-73388ec3639b req-38257c61-c2f7-4063-ae98-3d1828e4de24 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:34.221404 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4274f5a2-ec5c-40e2-8bf2-d1feeec474b1 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e7c523e9d94d2994ebe9b2d3b86b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9ddb2693734bd5a0d3c4101a165998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:34.231003 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-690396f0-26e4-481f-bb65-73388ec3639b req-38257c61-c2f7-4063-ae98-3d1828e4de24 service nova] Creating event network-vif-deleted:cbfa4f3b-18b3-43da-9dc1-bb3c05508ec3 for instance 760130d2-374e-4f4c-a73b-d7a99449e324 on n-h2-846466-12 Aug 04 16:59:34.231215 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4274f5a2-ec5c-40e2-8bf2-d1feeec474b1 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba" status: 200 len: 1524 microversion: 2.1 time: 0.274821 Aug 04 16:59:34.231719 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2179/4441] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:33 2022] GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba => generated 1524 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:34.241392 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-690396f0-26e4-481f-bb65-73388ec3639b req-38257c61-c2f7-4063-ae98-3d1828e4de24 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057869 Aug 04 16:59:34.255022 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2263/4442] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:34.298105 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-63b2d510-0e5f-4f30-97e0-b4ef2d50f31a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:34.298718 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-63b2d510-0e5f-4f30-97e0-b4ef2d50f31a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:34.310987 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63b2d510-0e5f-4f30-97e0-b4ef2d50f31a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:34.311803 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63b2d510-0e5f-4f30-97e0-b4ef2d50f31a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:34.312778 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63b2d510-0e5f-4f30-97e0-b4ef2d50f31a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:34.313781 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63b2d510-0e5f-4f30-97e0-b4ef2d50f31a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:34.648259 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-63b2d510-0e5f-4f30-97e0-b4ef2d50f31a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:34.662768 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-63b2d510-0e5f-4f30-97e0-b4ef2d50f31a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1316 microversion: 2.1 time: 0.368569 Aug 04 16:59:34.664238 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2180/4443] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:34 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1316 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:34.668272 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1d9089f0-d06e-422b-a249-5b8f314f058a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:34.668980 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1d9089f0-d06e-422b-a249-5b8f314f058a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 760130d2-374e-4f4c-a73b-d7a99449e324] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:34.692836 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1d9089f0-d06e-422b-a249-5b8f314f058a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:34.697193 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1d9089f0-d06e-422b-a249-5b8f314f058a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:34.698565 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1d9089f0-d06e-422b-a249-5b8f314f058a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:34.700705 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1d9089f0-d06e-422b-a249-5b8f314f058a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:34.719659 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-1d9089f0-d06e-422b-a249-5b8f314f058a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] HTTP exception thrown: Instance 760130d2-374e-4f4c-a73b-d7a99449e324 could not be found. Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1d9089f0-d06e-422b-a249-5b8f314f058a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Request method failure captured: Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324 HTTP/1.1 Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_owNKx0pHV40nqVD-WIcaXEsXOBwQHOEMAVVk2fno070nDFXZRZhhzMgTy8HlVP1AOBt469MYWC_AbeQLbAvgivtdjrTsmGymGu6AtGEk3CEKRMIDLRIpky1rxw9eTh6mgckU3tnNoFbB2in__O_4k2BxkTMZllLYaubH7EDDeTWL4 Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 2534921e8a2f47d394059fee872426a8 Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-AttachVolumeNegativeTest-410766221 Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2534921e8a2f47d394059fee872426a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2534921e8a2f47d394059fee872426a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2534921e8a2f47d394059fee872426a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2534921e8a2f47d394059fee872426a8"}]}] Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-AttachVolumeNegativeTest-410766221 Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 2534921e8a2f47d394059fee872426a8 Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-410766221 Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-AttachVolumeNegativeTest-410766221-project Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: d82f4a672b154291a412a282d1a88208 Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-AttachVolumeNegativeTest-410766221-project Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 760130d2-374e-4f4c-a73b-d7a99449e324 could not be found. Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '760130d2-374e-4f4c-a73b-d7a99449e324'} Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 760130d2-374e-4f4c-a73b-d7a99449e324 could not be found. Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 760130d2-374e-4f4c-a73b-d7a99449e324 could not be found. Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:34.721894 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:59:34.727667 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:34.727667 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:59:34.727667 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:59:34.727667 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:59:34.727667 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:59:34.727667 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 760130d2-374e-4f4c-a73b-d7a99449e324 could not be found. Aug 04 16:59:34.727667 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:59:34.730225 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1d9089f0-d06e-422b-a249-5b8f314f058a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Returning 404 to user: Instance 760130d2-374e-4f4c-a73b-d7a99449e324 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:59:34.731353 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1d9089f0-d06e-422b-a249-5b8f314f058a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324" status: 404 len: 111 microversion: 2.1 time: 0.068190 Aug 04 16:59:34.734119 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2264/4444] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:34 2022] GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:59:34.743762 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-718bf7a6-5b0c-4d54-b312-9043f7b59163 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '.version_select at 0x7f7e841be5e0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:34.770225 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-718bf7a6-5b0c-4d54-b312-9043f7b59163 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1364397205" status: 202 len: 0 microversion: 2.1 time: 0.029748 Aug 04 16:59:34.776201 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2181/4445] 10.222.0.23 () {58 vars in 1221 bytes} [Thu Aug 4 16:59:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1364397205 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:59:34.977857 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ac9dadeb-2fbe-4ed5-b8a6-9f3e8dc55f9a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:34.979775 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ac9dadeb-2fbe-4ed5-b8a6-9f3e8dc55f9a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:34.996574 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ac9dadeb-2fbe-4ed5-b8a6-9f3e8dc55f9a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:34.997266 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ac9dadeb-2fbe-4ed5-b8a6-9f3e8dc55f9a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:34.998639 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ac9dadeb-2fbe-4ed5-b8a6-9f3e8dc55f9a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:35.000334 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ac9dadeb-2fbe-4ed5-b8a6-9f3e8dc55f9a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:35.064974 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:35.070067 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-713c0969-e419-41cd-a7cf-ebfaa8e1c571 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:35.070835 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-713c0969-e419-41cd-a7cf-ebfaa8e1c571 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] [instance: 48c8febb-db67-481b-8a56-e783d88edafa] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:35.095378 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-713c0969-e419-41cd-a7cf-ebfaa8e1c571 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:35.099297 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-713c0969-e419-41cd-a7cf-ebfaa8e1c571 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:35.105200 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-713c0969-e419-41cd-a7cf-ebfaa8e1c571 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:35.113189 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-713c0969-e419-41cd-a7cf-ebfaa8e1c571 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:35.829218 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-713c0969-e419-41cd-a7cf-ebfaa8e1c571 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ef05c9770f47bfaa3b36b3eeebbf03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1244cf4912514d41a7c5ba300e203ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:35.847825 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-713c0969-e419-41cd-a7cf-ebfaa8e1c571 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] 10.222.0.23 "GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa" status: 200 len: 1498 microversion: 2.1 time: 0.783527 Aug 04 16:59:35.848431 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2182/4446] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:35 2022] GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa => generated 1498 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:35.874839 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-475c94e2-af13-4ff3-adaf-d44f33d4d2e8 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:35.877570 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-475c94e2-af13-4ff3-adaf-d44f33d4d2e8 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:35.918193 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-475c94e2-af13-4ff3-adaf-d44f33d4d2e8 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:35.918569 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-475c94e2-af13-4ff3-adaf-d44f33d4d2e8 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:35.919569 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-475c94e2-af13-4ff3-adaf-d44f33d4d2e8 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:35.920170 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-475c94e2-af13-4ff3-adaf-d44f33d4d2e8 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:36.453498 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ac9dadeb-2fbe-4ed5-b8a6-9f3e8dc55f9a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:36.466664 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ac9dadeb-2fbe-4ed5-b8a6-9f3e8dc55f9a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:36.473340 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ac9dadeb-2fbe-4ed5-b8a6-9f3e8dc55f9a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:36.476103 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ac9dadeb-2fbe-4ed5-b8a6-9f3e8dc55f9a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1740 microversion: 2.20 time: 1.501399 Aug 04 16:59:36.478306 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2265/4447] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:59:34 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1740 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:59:36.490196 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-58c7e058-3e7d-4a95-afaf-1abce9155954 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:36.493382 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-58c7e058-3e7d-4a95-afaf-1abce9155954 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:36.509139 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58c7e058-3e7d-4a95-afaf-1abce9155954 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:36.512838 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58c7e058-3e7d-4a95-afaf-1abce9155954 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:36.513940 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58c7e058-3e7d-4a95-afaf-1abce9155954 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:36.516145 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58c7e058-3e7d-4a95-afaf-1abce9155954 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:36.907129 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-475c94e2-af13-4ff3-adaf-d44f33d4d2e8 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e7c523e9d94d2994ebe9b2d3b86b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9ddb2693734bd5a0d3c4101a165998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:36.929616 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-475c94e2-af13-4ff3-adaf-d44f33d4d2e8 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba" status: 200 len: 1524 microversion: 2.1 time: 1.079157 Aug 04 16:59:36.934328 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2183/4448] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:35 2022] GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba => generated 1524 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:36.948993 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-f6ef3bab-b8b5-4c22-be44-c82e2ce4c7be req-4c6af910-10e6-4a08-957b-258f6b195ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdec5afc-3a3a-4d61-a934-5edf0c7c1397", "name": "network-vif-plugged", "status": "completed", "tag": "0762f466-ea31-44a7-9ac5-75aaf39b80a6"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:36.993085 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f6ef3bab-b8b5-4c22-be44-c82e2ce4c7be req-4c6af910-10e6-4a08-957b-258f6b195ef0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:36.996492 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f6ef3bab-b8b5-4c22-be44-c82e2ce4c7be req-4c6af910-10e6-4a08-957b-258f6b195ef0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:37.018214 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-f6ef3bab-b8b5-4c22-be44-c82e2ce4c7be req-4c6af910-10e6-4a08-957b-258f6b195ef0 service nova] Creating event network-vif-plugged:0762f466-ea31-44a7-9ac5-75aaf39b80a6 for instance fdec5afc-3a3a-4d61-a934-5edf0c7c1397 on n-h2-846466-12 Aug 04 16:59:37.028258 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-f6ef3bab-b8b5-4c22-be44-c82e2ce4c7be req-4c6af910-10e6-4a08-957b-258f6b195ef0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091585 Aug 04 16:59:37.029710 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2184/4449] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:37.035714 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-132f00ab-6688-4804-874e-e4b330e7d40c tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:37.037100 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-132f00ab-6688-4804-874e-e4b330e7d40c tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] [instance: 48c8febb-db67-481b-8a56-e783d88edafa] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:37.047950 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-132f00ab-6688-4804-874e-e4b330e7d40c tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:37.048715 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-132f00ab-6688-4804-874e-e4b330e7d40c tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:37.050421 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-132f00ab-6688-4804-874e-e4b330e7d40c tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:37.051082 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-132f00ab-6688-4804-874e-e4b330e7d40c tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:38.052071 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-58c7e058-3e7d-4a95-afaf-1abce9155954 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:38.067143 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-58c7e058-3e7d-4a95-afaf-1abce9155954 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1316 microversion: 2.1 time: 1.587257 Aug 04 16:59:38.083993 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2266/4450] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:36 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1316 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:38.100984 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-132f00ab-6688-4804-874e-e4b330e7d40c tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ef05c9770f47bfaa3b36b3eeebbf03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1244cf4912514d41a7c5ba300e203ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:38.103252 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a9548580-3ade-4df9-8ff2-c025e8d7b7c1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:38.104877 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a9548580-3ade-4df9-8ff2-c025e8d7b7c1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:38.111362 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-132f00ab-6688-4804-874e-e4b330e7d40c tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] 10.222.0.23 "GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa" status: 200 len: 1501 microversion: 2.1 time: 1.080011 Aug 04 16:59:38.111936 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a9548580-3ade-4df9-8ff2-c025e8d7b7c1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:38.112359 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2185/4451] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:37 2022] GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa => generated 1501 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:38.112542 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a9548580-3ade-4df9-8ff2-c025e8d7b7c1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:38.114340 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a9548580-3ade-4df9-8ff2-c025e8d7b7c1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:38.115011 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a9548580-3ade-4df9-8ff2-c025e8d7b7c1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:38.126014 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b8ea58b5-e415-45d9-88de-06e29b0bce09 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:38.126934 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b8ea58b5-e415-45d9-88de-06e29b0bce09 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:38.135821 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b8ea58b5-e415-45d9-88de-06e29b0bce09 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:38.136826 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b8ea58b5-e415-45d9-88de-06e29b0bce09 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:38.138174 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b8ea58b5-e415-45d9-88de-06e29b0bce09 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:38.138773 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b8ea58b5-e415-45d9-88de-06e29b0bce09 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:38.560285 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b8ea58b5-e415-45d9-88de-06e29b0bce09 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e7c523e9d94d2994ebe9b2d3b86b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9ddb2693734bd5a0d3c4101a165998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:38.580242 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b8ea58b5-e415-45d9-88de-06e29b0bce09 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba" status: 200 len: 1524 microversion: 2.1 time: 0.466480 Aug 04 16:59:38.581465 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2186/4452] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:38 2022] GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba => generated 1524 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:38.596742 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a9548580-3ade-4df9-8ff2-c025e8d7b7c1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:38.635095 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a9548580-3ade-4df9-8ff2-c025e8d7b7c1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:38.639082 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-19eeb508-50c2-4f1b-a2e4-527c7b3ba4c2 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Action: 'create', calling method: .version_select at 0x7f7e77e123a0>, body: {"keypair": {"name": "tempest-keypair-360744570", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXm8xTYLCZU+GUAn1IRDouiE9PsSTD7Quev3nLyfJgL2a6U5Ik0QfOS8cJVPIsf4tuGRjs494JMFtWc8vR6GOnWUqid6Bf1Fp/2/TmY31MTrZ5w7iNrMieE+gdKXfydtg=="}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:38.647511 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a9548580-3ade-4df9-8ff2-c025e8d7b7c1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:38.652073 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a9548580-3ade-4df9-8ff2-c025e8d7b7c1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1740 microversion: 2.20 time: 0.563620 Aug 04 16:59:38.653236 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2267/4453] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:59:38 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1740 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:59:38.664461 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e3353dd6-1dc9-40e6-b8ad-44a22edfd011 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:38.665180 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e3353dd6-1dc9-40e6-b8ad-44a22edfd011 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] [instance: 48c8febb-db67-481b-8a56-e783d88edafa] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:38.686275 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3353dd6-1dc9-40e6-b8ad-44a22edfd011 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:38.689786 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3353dd6-1dc9-40e6-b8ad-44a22edfd011 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:38.694079 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3353dd6-1dc9-40e6-b8ad-44a22edfd011 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:38.694649 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3353dd6-1dc9-40e6-b8ad-44a22edfd011 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:38.705105 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-19eeb508-50c2-4f1b-a2e4-527c7b3ba4c2 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Getting quotas for project 2534921e8a2f47d394059fee872426a8. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:59:38.715472 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-19eeb508-50c2-4f1b-a2e4-527c7b3ba4c2 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Getting quotas for user d82f4a672b154291a412a282d1a88208 and project 2534921e8a2f47d394059fee872426a8. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:59:38.748183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e3353dd6-1dc9-40e6-b8ad-44a22edfd011 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] [instance: 48c8febb-db67-481b-8a56-e783d88edafa] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:59:38.768007 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-19eeb508-50c2-4f1b-a2e4-527c7b3ba4c2 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.185197 Aug 04 16:59:38.777404 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2187/4454] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 16:59:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:38.979490 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e3353dd6-1dc9-40e6-b8ad-44a22edfd011 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] 10.222.0.23 "DELETE /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa" status: 204 len: 0 microversion: 2.1 time: 0.318802 Aug 04 16:59:38.983865 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2268/4455] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 16:59:38 2022] DELETE /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:59:38.995529 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-68399f9c-5424-4c07-81c2-e82911970ed6 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:38.997007 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-68399f9c-5424-4c07-81c2-e82911970ed6 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] [instance: 48c8febb-db67-481b-8a56-e783d88edafa] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:39.022383 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-68399f9c-5424-4c07-81c2-e82911970ed6 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:39.026379 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-68399f9c-5424-4c07-81c2-e82911970ed6 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:39.030032 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-68399f9c-5424-4c07-81c2-e82911970ed6 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:39.034895 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-68399f9c-5424-4c07-81c2-e82911970ed6 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:39.063429 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-4e056ea3-e318-4469-ac49-1f04f290095c req-e67e9bd4-19c6-4a59-9c35-d60fa2ee312c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7094f480-111a-4c4e-8a77-2df578c044c0", "name": "network-vif-plugged", "status": "completed", "tag": "7cc4e42a-ac69-4d95-810a-566a44e11ef2"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:39.093528 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-4e056ea3-e318-4469-ac49-1f04f290095c req-e67e9bd4-19c6-4a59-9c35-d60fa2ee312c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:39.093985 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-4e056ea3-e318-4469-ac49-1f04f290095c req-e67e9bd4-19c6-4a59-9c35-d60fa2ee312c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:39.135967 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-4e056ea3-e318-4469-ac49-1f04f290095c req-e67e9bd4-19c6-4a59-9c35-d60fa2ee312c service nova] Creating event network-vif-plugged:7cc4e42a-ac69-4d95-810a-566a44e11ef2 for instance 7094f480-111a-4c4e-8a77-2df578c044c0 on n-h1-846466-12 Aug 04 16:59:39.150312 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-4e056ea3-e318-4469-ac49-1f04f290095c req-e67e9bd4-19c6-4a59-9c35-d60fa2ee312c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090984 Aug 04 16:59:39.172809 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2269/4456] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:59:39.196392 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a118e854-b343-480d-9802-04793b8a877c tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:39.200957 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a118e854-b343-480d-9802-04793b8a877c tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:39.214842 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a118e854-b343-480d-9802-04793b8a877c tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:39.215293 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a118e854-b343-480d-9802-04793b8a877c tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:39.216081 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a118e854-b343-480d-9802-04793b8a877c tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:39.216638 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a118e854-b343-480d-9802-04793b8a877c tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:39.272524 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:39.529585 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-68399f9c-5424-4c07-81c2-e82911970ed6 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ef05c9770f47bfaa3b36b3eeebbf03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1244cf4912514d41a7c5ba300e203ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:39.545388 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-68399f9c-5424-4c07-81c2-e82911970ed6 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] 10.222.0.23 "GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa" status: 200 len: 1507 microversion: 2.1 time: 0.553330 Aug 04 16:59:39.546720 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2188/4457] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:38 2022] GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa => generated 1507 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:39.607465 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-201b53ae-34d5-4708-bb62-a2e96aaab22c tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:39.608085 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-201b53ae-34d5-4708-bb62-a2e96aaab22c tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:39.618824 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-201b53ae-34d5-4708-bb62-a2e96aaab22c tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:39.625937 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-201b53ae-34d5-4708-bb62-a2e96aaab22c tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:39.626863 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-201b53ae-34d5-4708-bb62-a2e96aaab22c tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:39.627314 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-201b53ae-34d5-4708-bb62-a2e96aaab22c tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:39.671453 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a118e854-b343-480d-9802-04793b8a877c tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:39.680581 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a118e854-b343-480d-9802-04793b8a877c tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1316 microversion: 2.1 time: 0.505587 Aug 04 16:59:39.693585 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2270/4458] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:39 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1316 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:39.694829 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c861e672-a777-4fb5-b49e-ef3388392a9c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:39.695712 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c861e672-a777-4fb5-b49e-ef3388392a9c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:39.721766 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c861e672-a777-4fb5-b49e-ef3388392a9c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:39.722516 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c861e672-a777-4fb5-b49e-ef3388392a9c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:39.723578 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c861e672-a777-4fb5-b49e-ef3388392a9c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:39.724200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c861e672-a777-4fb5-b49e-ef3388392a9c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:40.120162 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-201b53ae-34d5-4708-bb62-a2e96aaab22c tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e7c523e9d94d2994ebe9b2d3b86b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9ddb2693734bd5a0d3c4101a165998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:40.132036 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-201b53ae-34d5-4708-bb62-a2e96aaab22c tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba" status: 200 len: 1524 microversion: 2.1 time: 0.529583 Aug 04 16:59:40.139251 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c861e672-a777-4fb5-b49e-ef3388392a9c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:40.149998 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2189/4459] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:39 2022] GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba => generated 1524 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:40.153621 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c861e672-a777-4fb5-b49e-ef3388392a9c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:40.155395 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c861e672-a777-4fb5-b49e-ef3388392a9c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:40.156619 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c861e672-a777-4fb5-b49e-ef3388392a9c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1740 microversion: 2.20 time: 0.470634 Aug 04 16:59:40.157167 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2271/4460] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:59:39 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1740 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:59:40.577375 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c48178d3-414d-471f-8de0-73d519702417 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:40.578089 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c48178d3-414d-471f-8de0-73d519702417 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] [instance: 48c8febb-db67-481b-8a56-e783d88edafa] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:40.590494 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c48178d3-414d-471f-8de0-73d519702417 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:40.591246 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c48178d3-414d-471f-8de0-73d519702417 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:40.591791 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c48178d3-414d-471f-8de0-73d519702417 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:40.592229 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c48178d3-414d-471f-8de0-73d519702417 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:40.609415 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:40.710877 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-322da26d-ef2c-4405-ae0f-91d139c75472 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:40.711845 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-322da26d-ef2c-4405-ae0f-91d139c75472 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:40.722596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-322da26d-ef2c-4405-ae0f-91d139c75472 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:40.726301 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-322da26d-ef2c-4405-ae0f-91d139c75472 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:40.727298 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-322da26d-ef2c-4405-ae0f-91d139c75472 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:40.727746 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-322da26d-ef2c-4405-ae0f-91d139c75472 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:41.448403 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c48178d3-414d-471f-8de0-73d519702417 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ef05c9770f47bfaa3b36b3eeebbf03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1244cf4912514d41a7c5ba300e203ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:41.463158 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c48178d3-414d-471f-8de0-73d519702417 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] 10.222.0.23 "GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa" status: 200 len: 1507 microversion: 2.1 time: 0.887593 Aug 04 16:59:41.464364 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2190/4461] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:40 2022] GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa => generated 1507 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:41.469545 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-694d4e2b-3258-476c-970e-1c81e0556993 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:41.474063 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-694d4e2b-3258-476c-970e-1c81e0556993 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:41.485208 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-694d4e2b-3258-476c-970e-1c81e0556993 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:41.492174 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-694d4e2b-3258-476c-970e-1c81e0556993 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:41.493425 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-694d4e2b-3258-476c-970e-1c81e0556993 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:41.494059 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-694d4e2b-3258-476c-970e-1c81e0556993 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:41.575119 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-322da26d-ef2c-4405-ae0f-91d139c75472 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:41.583272 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-322da26d-ef2c-4405-ae0f-91d139c75472 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1316 microversion: 2.1 time: 0.878887 Aug 04 16:59:41.583843 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2272/4462] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:40 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1316 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:41.589422 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-14689509-b4c8-432b-8ea1-5c271448c44f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:41.597193 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-14689509-b4c8-432b-8ea1-5c271448c44f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:41.608183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14689509-b4c8-432b-8ea1-5c271448c44f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:41.609959 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14689509-b4c8-432b-8ea1-5c271448c44f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:41.618051 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14689509-b4c8-432b-8ea1-5c271448c44f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:41.618705 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14689509-b4c8-432b-8ea1-5c271448c44f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:42.040684 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-694d4e2b-3258-476c-970e-1c81e0556993 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e7c523e9d94d2994ebe9b2d3b86b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9ddb2693734bd5a0d3c4101a165998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:42.052400 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-694d4e2b-3258-476c-970e-1c81e0556993 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba" status: 200 len: 1524 microversion: 2.1 time: 0.586722 Aug 04 16:59:42.052961 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2191/4463] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:41 2022] GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba => generated 1524 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:42.062009 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-14689509-b4c8-432b-8ea1-5c271448c44f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:42.082613 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-14689509-b4c8-432b-8ea1-5c271448c44f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:42.085590 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-14689509-b4c8-432b-8ea1-5c271448c44f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:42.091365 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-14689509-b4c8-432b-8ea1-5c271448c44f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1740 microversion: 2.20 time: 0.501898 Aug 04 16:59:42.106031 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2273/4464] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:59:41 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1740 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:59:42.486074 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c9929301-4a73-4f15-a1ab-c8da3f0eb2e7 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:42.487104 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c9929301-4a73-4f15-a1ab-c8da3f0eb2e7 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] [instance: 48c8febb-db67-481b-8a56-e783d88edafa] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:42.524825 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c9929301-4a73-4f15-a1ab-c8da3f0eb2e7 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:42.525586 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c9929301-4a73-4f15-a1ab-c8da3f0eb2e7 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:42.528295 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c9929301-4a73-4f15-a1ab-c8da3f0eb2e7 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:42.533790 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c9929301-4a73-4f15-a1ab-c8da3f0eb2e7 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:42.705068 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ee0fb925-8ba0-4acf-9218-d7a472a723d4 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Action: 'create', calling method: .version_select at 0x7f7e84c96280>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-751153364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLiE9EbHFO83Kb6f43f3z+Kl56NoZe5KNMBDJHwQfnwNhK1ykxcjAvpKScQfaHcjlabzjmT7unid1IxFxs2Wp3lwXG1UTYjJHgFck3dyVEvJK5sr0QdAhig7rBPKeTLKUg=="}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:42.728900 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:42.736659 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c9929301-4a73-4f15-a1ab-c8da3f0eb2e7 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ef05c9770f47bfaa3b36b3eeebbf03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1244cf4912514d41a7c5ba300e203ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:42.753960 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c9929301-4a73-4f15-a1ab-c8da3f0eb2e7 tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] 10.222.0.23 "GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa" status: 200 len: 1465 microversion: 2.1 time: 0.266111 Aug 04 16:59:42.754680 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2274/4465] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:42 2022] GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa => generated 1465 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:42.756708 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-ee0fb925-8ba0-4acf-9218-d7a472a723d4 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Getting quotas for project 8759879e1bec45e38e9434db6bcf85e8. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:59:42.764180 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-ee0fb925-8ba0-4acf-9218-d7a472a723d4 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Getting quotas for user 113fd3653eee4f798d0860705a2b4030 and project 8759879e1bec45e38e9434db6bcf85e8. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:59:42.778678 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8da17309-1fbb-4c76-b4bd-dfa32d06155a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:42.779151 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8da17309-1fbb-4c76-b4bd-dfa32d06155a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:42.789184 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8da17309-1fbb-4c76-b4bd-dfa32d06155a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:42.790010 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8da17309-1fbb-4c76-b4bd-dfa32d06155a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:42.791130 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8da17309-1fbb-4c76-b4bd-dfa32d06155a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:42.792104 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8da17309-1fbb-4c76-b4bd-dfa32d06155a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:42.845492 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ee0fb925-8ba0-4acf-9218-d7a472a723d4 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.791398 Aug 04 16:59:42.846418 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2192/4466] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 16:59:42 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:42.851608 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-d3e71cd3-adbf-4f8b-a45b-d6d2dd94e4f8 req-28547a8c-40d3-481f-9dea-d16ea790c2a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48c8febb-db67-481b-8a56-e783d88edafa", "name": "network-vif-deleted", "tag": "7378638e-f54c-466a-9990-98a95d314366"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:42.896212 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-d3e71cd3-adbf-4f8b-a45b-d6d2dd94e4f8 req-28547a8c-40d3-481f-9dea-d16ea790c2a4 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:42.897574 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-d3e71cd3-adbf-4f8b-a45b-d6d2dd94e4f8 req-28547a8c-40d3-481f-9dea-d16ea790c2a4 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:42.933018 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-d3e71cd3-adbf-4f8b-a45b-d6d2dd94e4f8 req-28547a8c-40d3-481f-9dea-d16ea790c2a4 service nova] Creating event network-vif-deleted:7378638e-f54c-466a-9990-98a95d314366 for instance 48c8febb-db67-481b-8a56-e783d88edafa on n-h1-846466-12 Aug 04 16:59:42.960276 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-d3e71cd3-adbf-4f8b-a45b-d6d2dd94e4f8 req-28547a8c-40d3-481f-9dea-d16ea790c2a4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112199 Aug 04 16:59:42.966128 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2193/4467] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:43.074243 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7d6ac6cf-9c81-4b94-bd88-7d7b459e045e tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:43.074949 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7d6ac6cf-9c81-4b94-bd88-7d7b459e045e tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:43.086366 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7d6ac6cf-9c81-4b94-bd88-7d7b459e045e tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:43.099808 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7d6ac6cf-9c81-4b94-bd88-7d7b459e045e tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:43.104626 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7d6ac6cf-9c81-4b94-bd88-7d7b459e045e tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:43.105099 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7d6ac6cf-9c81-4b94-bd88-7d7b459e045e tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:43.561623 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8da17309-1fbb-4c76-b4bd-dfa32d06155a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:43.578105 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8da17309-1fbb-4c76-b4bd-dfa32d06155a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1316 microversion: 2.1 time: 0.809268 Aug 04 16:59:43.581276 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2275/4468] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:42 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1316 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:43.597557 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5711da25-ad14-4904-af7d-d9de9b673225 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:43.602257 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5711da25-ad14-4904-af7d-d9de9b673225 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:43.606510 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7d6ac6cf-9c81-4b94-bd88-7d7b459e045e tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e7c523e9d94d2994ebe9b2d3b86b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9ddb2693734bd5a0d3c4101a165998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:43.618399 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7d6ac6cf-9c81-4b94-bd88-7d7b459e045e tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba" status: 200 len: 1524 microversion: 2.1 time: 0.548659 Aug 04 16:59:43.631421 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2194/4469] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:43 2022] GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba => generated 1524 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:59:43.641913 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5711da25-ad14-4904-af7d-d9de9b673225 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:43.646608 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5711da25-ad14-4904-af7d-d9de9b673225 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:43.649099 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5711da25-ad14-4904-af7d-d9de9b673225 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:43.649802 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5711da25-ad14-4904-af7d-d9de9b673225 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:43.741627 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-94ffad30-02f0-482d-9cf5-0c2306b63fa4 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-851798436", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ceca6d76-bb57-49ce-899c-2985b37b1ce6"}], "security_groups": [{"name": "tempest-securitygroup--5369318"}], "key_name": "tempest-keypair-360744570", "user_data": "}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:43.953544 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-94ffad30-02f0-482d-9cf5-0c2306b63fa4 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] validate_networks() for [('ceca6d76-bb57-49ce-899c-2985b37b1ce6', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:59:44.037223 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5711da25-ad14-4904-af7d-d9de9b673225 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:44.047979 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5711da25-ad14-4904-af7d-d9de9b673225 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:44.052776 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5711da25-ad14-4904-af7d-d9de9b673225 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:44.057381 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5711da25-ad14-4904-af7d-d9de9b673225 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1740 microversion: 2.20 time: 0.474146 Aug 04 16:59:44.065574 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2276/4470] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:59:43 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1740 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:59:44.070949 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f7adeb32-621c-4ea4-9c66-2ed9cadc92de tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:44.071557 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f7adeb32-621c-4ea4-9c66-2ed9cadc92de tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] [instance: 48c8febb-db67-481b-8a56-e783d88edafa] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:44.085461 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f7adeb32-621c-4ea4-9c66-2ed9cadc92de tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:44.085896 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f7adeb32-621c-4ea4-9c66-2ed9cadc92de tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:44.086686 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f7adeb32-621c-4ea4-9c66-2ed9cadc92de tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:44.087110 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f7adeb32-621c-4ea4-9c66-2ed9cadc92de tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:44.122987 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-f7adeb32-621c-4ea4-9c66-2ed9cadc92de tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] HTTP exception thrown: Instance 48c8febb-db67-481b-8a56-e783d88edafa could not be found. Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f7adeb32-621c-4ea4-9c66-2ed9cadc92de tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Request method failure captured: Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa HTTP/1.1 Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_rQ6PCflBxH1AHkDdLY06DN6H95RF9RyAzR_Y5xdU11fGzmwsF5YPVo9AQDe1XIN2bXIOnHfjHBui6SAmeXbCZRNHY6NrNt22TAJcfbVvQmixTbRbhGQrVcXqWDiNiwQE5kAWKwH5yPg0zfu4a1zufkN6oXJM0Es8laO6cf1UPMfiA Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 1244cf4912514d41a7c5ba300e203ff6 Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-TestServerAdvancedOps-1928977249 Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1244cf4912514d41a7c5ba300e203ff6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1244cf4912514d41a7c5ba300e203ff6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1244cf4912514d41a7c5ba300e203ff6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1244cf4912514d41a7c5ba300e203ff6"}]}] Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-TestServerAdvancedOps-1928977249 Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 1244cf4912514d41a7c5ba300e203ff6 Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-TestServerAdvancedOps-1928977249 Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-TestServerAdvancedOps-1928977249-project Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 63ef05c9770f47bfaa3b36b3eeebbf03 Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-TestServerAdvancedOps-1928977249-project Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 48c8febb-db67-481b-8a56-e783d88edafa could not be found. Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '48c8febb-db67-481b-8a56-e783d88edafa'} Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48c8febb-db67-481b-8a56-e783d88edafa could not be found. Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48c8febb-db67-481b-8a56-e783d88edafa could not be found. Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:44.124618 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:59:44.129601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:44.129601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:59:44.129601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:59:44.129601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:59:44.129601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:59:44.129601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48c8febb-db67-481b-8a56-e783d88edafa could not be found. Aug 04 16:59:44.129601 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 16:59:44.129601 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f7adeb32-621c-4ea4-9c66-2ed9cadc92de tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] Returning 404 to user: Instance 48c8febb-db67-481b-8a56-e783d88edafa could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:59:44.129601 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f7adeb32-621c-4ea4-9c66-2ed9cadc92de tempest-TestServerAdvancedOps-1928977249 tempest-TestServerAdvancedOps-1928977249-project] 10.222.0.23 "GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa" status: 404 len: 111 microversion: 2.1 time: 0.059264 Aug 04 16:59:44.129601 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2277/4471] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:44 2022] GET /compute/v2.1/servers/48c8febb-db67-481b-8a56-e783d88edafa => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:59:44.603718 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-46d0585f-b819-4a76-a2a0-b03fd7b47520 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:44.604399 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-46d0585f-b819-4a76-a2a0-b03fd7b47520 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:44.612856 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46d0585f-b819-4a76-a2a0-b03fd7b47520 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:44.613918 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46d0585f-b819-4a76-a2a0-b03fd7b47520 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:44.615235 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46d0585f-b819-4a76-a2a0-b03fd7b47520 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:44.616219 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46d0585f-b819-4a76-a2a0-b03fd7b47520 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:44.753203 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-94ffad30-02f0-482d-9cf5-0c2306b63fa4 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:59:44.754008 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-94ffad30-02f0-482d-9cf5-0c2306b63fa4 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:59:44.754582 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-94ffad30-02f0-482d-9cf5-0c2306b63fa4 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:59:44.755170 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-94ffad30-02f0-482d-9cf5-0c2306b63fa4 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:59:44.755916 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-94ffad30-02f0-482d-9cf5-0c2306b63fa4 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:59:44.803011 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-94ffad30-02f0-482d-9cf5-0c2306b63fa4 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:44.805135 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-94ffad30-02f0-482d-9cf5-0c2306b63fa4 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:44.808463 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-94ffad30-02f0-482d-9cf5-0c2306b63fa4 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:44.811539 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-94ffad30-02f0-482d-9cf5-0c2306b63fa4 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:44.850513 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-94ffad30-02f0-482d-9cf5-0c2306b63fa4 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Getting quotas for project 2534921e8a2f47d394059fee872426a8. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:59:44.858781 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-94ffad30-02f0-482d-9cf5-0c2306b63fa4 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Getting quotas for user d82f4a672b154291a412a282d1a88208 and project 2534921e8a2f47d394059fee872426a8. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:59:44.884783 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-94ffad30-02f0-482d-9cf5-0c2306b63fa4 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:59:44.889368 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-94ffad30-02f0-482d-9cf5-0c2306b63fa4 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 0063f3a7-735d-438e-a375-3b2a83bef991] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:59:44.995570 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-94ffad30-02f0-482d-9cf5-0c2306b63fa4 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.260015 Aug 04 16:59:44.997057 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2195/4472] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:59:43 2022] POST /compute/v2.1/servers => generated 399 bytes in 1262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 16:59:45.005118 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ceb8d0b1-4525-4da0-84bf-ce04a84f1a59 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:45.006220 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ceb8d0b1-4525-4da0-84bf-ce04a84f1a59 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:45.016614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ceb8d0b1-4525-4da0-84bf-ce04a84f1a59 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:45.017593 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ceb8d0b1-4525-4da0-84bf-ce04a84f1a59 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:45.018601 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ceb8d0b1-4525-4da0-84bf-ce04a84f1a59 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:45.019265 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ceb8d0b1-4525-4da0-84bf-ce04a84f1a59 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:45.102748 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-46d0585f-b819-4a76-a2a0-b03fd7b47520 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:45.157049 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-46d0585f-b819-4a76-a2a0-b03fd7b47520 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.555516 Aug 04 16:59:45.174368 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2278/4473] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:44 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:59:45.212647 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-abaff821-f22a-419e-b52d-93e1f38fa100 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:45.213477 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-abaff821-f22a-419e-b52d-93e1f38fa100 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 0063f3a7-735d-438e-a375-3b2a83bef991] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:45.431842 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-abaff821-f22a-419e-b52d-93e1f38fa100 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:45.441079 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-abaff821-f22a-419e-b52d-93e1f38fa100 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991" status: 200 len: 1240 microversion: 2.1 time: 0.263832 Aug 04 16:59:45.443936 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2279/4474] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:45 2022] GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991 => generated 1240 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:45.460056 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-78627863-aa07-4d33-8778-35ba378aaae0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:45.462130 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-78627863-aa07-4d33-8778-35ba378aaae0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:45.488371 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-78627863-aa07-4d33-8778-35ba378aaae0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:45.489092 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-78627863-aa07-4d33-8778-35ba378aaae0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:45.490608 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-78627863-aa07-4d33-8778-35ba378aaae0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:45.491601 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-78627863-aa07-4d33-8778-35ba378aaae0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:45.512030 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ceb8d0b1-4525-4da0-84bf-ce04a84f1a59 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e7c523e9d94d2994ebe9b2d3b86b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9ddb2693734bd5a0d3c4101a165998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:45.530124 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ceb8d0b1-4525-4da0-84bf-ce04a84f1a59 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba" status: 200 len: 1524 microversion: 2.1 time: 0.531629 Aug 04 16:59:45.530726 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2196/4475] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:44 2022] GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba => generated 1524 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:45.535488 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fb2bb66f-3289-4638-9bed-e151941fe30a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1809619247", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "9a956378-b79d-4451-b0d0-c11ff419c38c"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:45.653166 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-fb2bb66f-3289-4638-9bed-e151941fe30a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] validate_networks() for [('9a956378-b79d-4451-b0d0-c11ff419c38c', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:59:46.027003 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-78627863-aa07-4d33-8778-35ba378aaae0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:46.054906 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-78627863-aa07-4d33-8778-35ba378aaae0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:46.066756 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-78627863-aa07-4d33-8778-35ba378aaae0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:46.069658 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-78627863-aa07-4d33-8778-35ba378aaae0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1740 microversion: 2.20 time: 0.623346 Aug 04 16:59:46.071654 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2280/4476] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:59:45 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1740 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:59:46.466400 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a2e4f838-65b6-450a-893b-a822d0378423 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:46.467862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a2e4f838-65b6-450a-893b-a822d0378423 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 0063f3a7-735d-438e-a375-3b2a83bef991] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:46.497398 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a2e4f838-65b6-450a-893b-a822d0378423 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:46.503412 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a2e4f838-65b6-450a-893b-a822d0378423 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:46.505471 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a2e4f838-65b6-450a-893b-a822d0378423 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:46.509247 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a2e4f838-65b6-450a-893b-a822d0378423 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:47.106894 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a2e4f838-65b6-450a-893b-a822d0378423 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:47.118576 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a2e4f838-65b6-450a-893b-a822d0378423 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991" status: 200 len: 1300 microversion: 2.1 time: 0.658774 Aug 04 16:59:47.119226 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2281/4477] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:46 2022] GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991 => generated 1300 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:47.158610 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c18c488b-2c04-4238-a402-1e8b335aef8e tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:47.171366 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c18c488b-2c04-4238-a402-1e8b335aef8e tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:47.201676 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c18c488b-2c04-4238-a402-1e8b335aef8e tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:47.202387 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c18c488b-2c04-4238-a402-1e8b335aef8e tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:47.203662 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c18c488b-2c04-4238-a402-1e8b335aef8e tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:47.204102 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c18c488b-2c04-4238-a402-1e8b335aef8e tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:47.405100 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-fb2bb66f-3289-4638-9bed-e151941fe30a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:59:47.406527 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-fb2bb66f-3289-4638-9bed-e151941fe30a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:59:47.407282 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-fb2bb66f-3289-4638-9bed-e151941fe30a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:59:47.408074 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-fb2bb66f-3289-4638-9bed-e151941fe30a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:59:47.408708 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-fb2bb66f-3289-4638-9bed-e151941fe30a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:59:47.428354 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fb2bb66f-3289-4638-9bed-e151941fe30a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:47.434153 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fb2bb66f-3289-4638-9bed-e151941fe30a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:47.435488 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fb2bb66f-3289-4638-9bed-e151941fe30a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:47.436185 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fb2bb66f-3289-4638-9bed-e151941fe30a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:47.489258 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-fb2bb66f-3289-4638-9bed-e151941fe30a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Getting quotas for project 1a7231a2541d4bc0905b2305552429b9. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:59:47.496768 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-fb2bb66f-3289-4638-9bed-e151941fe30a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Getting quotas for user c25fedd3842a4d7f9c5832abcbf19507 and project 1a7231a2541d4bc0905b2305552429b9. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:59:47.516758 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fb2bb66f-3289-4638-9bed-e151941fe30a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:59:47.520300 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fb2bb66f-3289-4638-9bed-e151941fe30a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 58ba4011-f974-4687-b3c0-fd8e04ce7600] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:59:47.593186 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fb2bb66f-3289-4638-9bed-e151941fe30a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.061312 Aug 04 16:59:47.594717 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2197/4478] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 16:59:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:59:47.606245 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-acc30fe2-dceb-4414-b26f-d28ab5f26058 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:47.607853 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-acc30fe2-dceb-4414-b26f-d28ab5f26058 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:47.620779 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-acc30fe2-dceb-4414-b26f-d28ab5f26058 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:47.622183 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-acc30fe2-dceb-4414-b26f-d28ab5f26058 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:47.623372 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-acc30fe2-dceb-4414-b26f-d28ab5f26058 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:47.624027 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-acc30fe2-dceb-4414-b26f-d28ab5f26058 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:48.058441 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c18c488b-2c04-4238-a402-1e8b335aef8e tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e7c523e9d94d2994ebe9b2d3b86b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9ddb2693734bd5a0d3c4101a165998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:48.082589 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c18c488b-2c04-4238-a402-1e8b335aef8e tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba" status: 200 len: 1524 microversion: 2.1 time: 0.948943 Aug 04 16:59:48.082589 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2282/4479] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:47 2022] GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba => generated 1524 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:48.112273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-24af5add-89c2-4ccd-b489-34a0757330bd tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:48.113470 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-24af5add-89c2-4ccd-b489-34a0757330bd tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 58ba4011-f974-4687-b3c0-fd8e04ce7600] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:48.225470 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-acc30fe2-dceb-4414-b26f-d28ab5f26058 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:48.242802 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-acc30fe2-dceb-4414-b26f-d28ab5f26058 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:48.249468 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-acc30fe2-dceb-4414-b26f-d28ab5f26058 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:48.252709 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-acc30fe2-dceb-4414-b26f-d28ab5f26058 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1740 microversion: 2.20 time: 0.654987 Aug 04 16:59:48.257333 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2198/4480] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:59:47 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1740 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:59:48.279887 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dc3d7042-d1f4-4a58-b05e-d6d17afa6d07 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:48.281957 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-dc3d7042-d1f4-4a58-b05e-d6d17afa6d07 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 0063f3a7-735d-438e-a375-3b2a83bef991] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:48.289220 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-24af5add-89c2-4ccd-b489-34a0757330bd tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:48.300843 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-24af5add-89c2-4ccd-b489-34a0757330bd tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600" status: 200 len: 1217 microversion: 2.1 time: 0.224849 Aug 04 16:59:48.302556 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2283/4481] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:48 2022] GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600 => generated 1217 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:48.319505 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dc3d7042-d1f4-4a58-b05e-d6d17afa6d07 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:48.320222 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dc3d7042-d1f4-4a58-b05e-d6d17afa6d07 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:48.321231 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dc3d7042-d1f4-4a58-b05e-d6d17afa6d07 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:48.321905 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dc3d7042-d1f4-4a58-b05e-d6d17afa6d07 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:48.887953 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-dc3d7042-d1f4-4a58-b05e-d6d17afa6d07 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:48.896918 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dc3d7042-d1f4-4a58-b05e-d6d17afa6d07 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991" status: 200 len: 1298 microversion: 2.1 time: 0.636999 Aug 04 16:59:48.913494 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2199/4482] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:48 2022] GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991 => generated 1298 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:49.093816 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1e2cc01c-6871-4044-b813-9ad1556fe674 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:49.095274 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1e2cc01c-6871-4044-b813-9ad1556fe674 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:49.109433 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1e2cc01c-6871-4044-b813-9ad1556fe674 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:49.110188 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1e2cc01c-6871-4044-b813-9ad1556fe674 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:49.112208 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1e2cc01c-6871-4044-b813-9ad1556fe674 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:49.115319 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1e2cc01c-6871-4044-b813-9ad1556fe674 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:49.280084 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b4702268-753c-426b-a90e-aecc9bb480a8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:49.280710 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b4702268-753c-426b-a90e-aecc9bb480a8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:49.293400 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b4702268-753c-426b-a90e-aecc9bb480a8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:49.299289 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b4702268-753c-426b-a90e-aecc9bb480a8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:49.304599 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b4702268-753c-426b-a90e-aecc9bb480a8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:49.306690 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b4702268-753c-426b-a90e-aecc9bb480a8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:50.097211 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1e2cc01c-6871-4044-b813-9ad1556fe674 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e7c523e9d94d2994ebe9b2d3b86b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9ddb2693734bd5a0d3c4101a165998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:50.106863 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1e2cc01c-6871-4044-b813-9ad1556fe674 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba" status: 200 len: 1524 microversion: 2.1 time: 1.020572 Aug 04 16:59:50.113452 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2284/4483] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:49 2022] GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba => generated 1524 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:50.125669 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b1f3c287-75a1-46d5-b454-9634b99fbd73 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:50.126507 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b1f3c287-75a1-46d5-b454-9634b99fbd73 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 58ba4011-f974-4687-b3c0-fd8e04ce7600] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:50.138430 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b1f3c287-75a1-46d5-b454-9634b99fbd73 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:50.143816 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b1f3c287-75a1-46d5-b454-9634b99fbd73 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:50.144678 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b1f3c287-75a1-46d5-b454-9634b99fbd73 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:50.145106 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b1f3c287-75a1-46d5-b454-9634b99fbd73 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:50.487430 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b1f3c287-75a1-46d5-b454-9634b99fbd73 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:50.497743 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b1f3c287-75a1-46d5-b454-9634b99fbd73 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600" status: 200 len: 1275 microversion: 2.1 time: 0.382717 Aug 04 16:59:50.498344 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2285/4484] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:50 2022] GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600 => generated 1275 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:50.507244 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f213dafd-f5fa-4398-9fa1-e3ad30d5266e tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:50.507564 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f213dafd-f5fa-4398-9fa1-e3ad30d5266e tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 0063f3a7-735d-438e-a375-3b2a83bef991] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:50.523363 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b4702268-753c-426b-a90e-aecc9bb480a8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:50.526339 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f213dafd-f5fa-4398-9fa1-e3ad30d5266e tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:50.531562 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f213dafd-f5fa-4398-9fa1-e3ad30d5266e tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:50.532654 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f213dafd-f5fa-4398-9fa1-e3ad30d5266e tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:50.535148 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b4702268-753c-426b-a90e-aecc9bb480a8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:50.536937 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b4702268-753c-426b-a90e-aecc9bb480a8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:50.538538 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b4702268-753c-426b-a90e-aecc9bb480a8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1740 microversion: 2.20 time: 1.265034 Aug 04 16:59:50.540121 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2200/4485] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:59:49 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1740 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:59:50.540943 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f213dafd-f5fa-4398-9fa1-e3ad30d5266e tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:51.134594 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-25161a76-1866-4227-b555-6d470cc88d3a tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:51.135219 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-25161a76-1866-4227-b555-6d470cc88d3a tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:51.147561 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-25161a76-1866-4227-b555-6d470cc88d3a tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:51.148015 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-25161a76-1866-4227-b555-6d470cc88d3a tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:51.148803 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-25161a76-1866-4227-b555-6d470cc88d3a tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:51.152857 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-25161a76-1866-4227-b555-6d470cc88d3a tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:51.352605 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f213dafd-f5fa-4398-9fa1-e3ad30d5266e tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:51.364640 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f213dafd-f5fa-4398-9fa1-e3ad30d5266e tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991" status: 200 len: 1363 microversion: 2.1 time: 0.865153 Aug 04 16:59:51.366452 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2286/4486] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:50 2022] GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991 => generated 1363 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:51.523026 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a8206424-1572-4e0f-b736-e711bfdbf726 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:51.523822 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a8206424-1572-4e0f-b736-e711bfdbf726 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 58ba4011-f974-4687-b3c0-fd8e04ce7600] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:51.535229 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8206424-1572-4e0f-b736-e711bfdbf726 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:51.535682 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8206424-1572-4e0f-b736-e711bfdbf726 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:51.536471 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8206424-1572-4e0f-b736-e711bfdbf726 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:51.536904 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8206424-1572-4e0f-b736-e711bfdbf726 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:51.692489 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-25161a76-1866-4227-b555-6d470cc88d3a tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e7c523e9d94d2994ebe9b2d3b86b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9ddb2693734bd5a0d3c4101a165998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:51.700679 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-25161a76-1866-4227-b555-6d470cc88d3a tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba" status: 200 len: 1524 microversion: 2.1 time: 0.570624 Aug 04 16:59:51.714635 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2201/4487] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:51 2022] GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba => generated 1524 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:59:51.771047 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2a78bdcc-6ca8-42af-a8e5-c564d8efb43f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:51.773234 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2a78bdcc-6ca8-42af-a8e5-c564d8efb43f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:51.789294 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a78bdcc-6ca8-42af-a8e5-c564d8efb43f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:51.790382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a78bdcc-6ca8-42af-a8e5-c564d8efb43f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:51.792442 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a78bdcc-6ca8-42af-a8e5-c564d8efb43f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:51.793134 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a78bdcc-6ca8-42af-a8e5-c564d8efb43f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:51.864921 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a8206424-1572-4e0f-b736-e711bfdbf726 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:51.879884 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a8206424-1572-4e0f-b736-e711bfdbf726 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600" status: 200 len: 1275 microversion: 2.1 time: 0.360373 Aug 04 16:59:51.913180 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2287/4488] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:51 2022] GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600 => generated 1275 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:52.318953 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-e132af78-92ae-4b9e-97b7-181b50895676 req-913d5cc6-7a56-45d3-b350-7f0c9d00bb1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0063f3a7-735d-438e-a375-3b2a83bef991", "tag": "5c087a04-2adb-42cd-9b46-3aec7dea7767"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:52.349115 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-e132af78-92ae-4b9e-97b7-181b50895676 req-913d5cc6-7a56-45d3-b350-7f0c9d00bb1d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:52.350390 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-e132af78-92ae-4b9e-97b7-181b50895676 req-913d5cc6-7a56-45d3-b350-7f0c9d00bb1d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:52.393709 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-e132af78-92ae-4b9e-97b7-181b50895676 req-913d5cc6-7a56-45d3-b350-7f0c9d00bb1d service nova] Creating event network-changed:5c087a04-2adb-42cd-9b46-3aec7dea7767 for instance 0063f3a7-735d-438e-a375-3b2a83bef991 on n-h2-846466-12 Aug 04 16:59:52.413675 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-e132af78-92ae-4b9e-97b7-181b50895676 req-913d5cc6-7a56-45d3-b350-7f0c9d00bb1d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100076 Aug 04 16:59:52.421432 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2288/4489] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:52.431218 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6699b236-26c5-4d4c-9b38-05b6085ac697 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:52.444603 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6699b236-26c5-4d4c-9b38-05b6085ac697 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 0063f3a7-735d-438e-a375-3b2a83bef991] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:52.469085 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2a78bdcc-6ca8-42af-a8e5-c564d8efb43f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:52.472869 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6699b236-26c5-4d4c-9b38-05b6085ac697 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:52.480969 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6699b236-26c5-4d4c-9b38-05b6085ac697 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:52.483681 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2a78bdcc-6ca8-42af-a8e5-c564d8efb43f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:52.485298 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2a78bdcc-6ca8-42af-a8e5-c564d8efb43f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:52.485732 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6699b236-26c5-4d4c-9b38-05b6085ac697 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:52.486442 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6699b236-26c5-4d4c-9b38-05b6085ac697 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:52.486587 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2a78bdcc-6ca8-42af-a8e5-c564d8efb43f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1740 microversion: 2.20 time: 0.770523 Aug 04 16:59:52.493764 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2202/4490] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:59:51 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1740 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:59:52.739005 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0848f8c7-8e56-42d4-956d-763a9166e452 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:52.739709 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0848f8c7-8e56-42d4-956d-763a9166e452 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:52.752950 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0848f8c7-8e56-42d4-956d-763a9166e452 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:52.753415 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0848f8c7-8e56-42d4-956d-763a9166e452 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:52.754199 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0848f8c7-8e56-42d4-956d-763a9166e452 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:52.754621 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0848f8c7-8e56-42d4-956d-763a9166e452 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:53.282198 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6699b236-26c5-4d4c-9b38-05b6085ac697 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:53.300491 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6699b236-26c5-4d4c-9b38-05b6085ac697 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991" status: 200 len: 1363 microversion: 2.1 time: 0.868991 Aug 04 16:59:53.301601 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2289/4491] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:52 2022] GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991 => generated 1363 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:53.313041 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2bf1f1fb-3e5d-448d-bb81-4d856a537663 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:53.322523 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2bf1f1fb-3e5d-448d-bb81-4d856a537663 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 58ba4011-f974-4687-b3c0-fd8e04ce7600] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:53.343882 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2bf1f1fb-3e5d-448d-bb81-4d856a537663 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:53.350052 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2bf1f1fb-3e5d-448d-bb81-4d856a537663 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:53.356655 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2bf1f1fb-3e5d-448d-bb81-4d856a537663 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:53.357497 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2bf1f1fb-3e5d-448d-bb81-4d856a537663 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:53.399197 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=100 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:53.563174 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2bf1f1fb-3e5d-448d-bb81-4d856a537663 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:53.571723 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2bf1f1fb-3e5d-448d-bb81-4d856a537663 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600" status: 200 len: 1275 microversion: 2.1 time: 0.268793 Aug 04 16:59:53.572470 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2290/4492] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:53 2022] GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600 => generated 1275 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:53.598230 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-30c1e2d8-e606-4b11-8386-039c619d3994 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:53.599155 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-30c1e2d8-e606-4b11-8386-039c619d3994 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:53.609882 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-30c1e2d8-e606-4b11-8386-039c619d3994 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:53.611840 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-30c1e2d8-e606-4b11-8386-039c619d3994 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:53.614713 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-30c1e2d8-e606-4b11-8386-039c619d3994 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:53.615440 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-30c1e2d8-e606-4b11-8386-039c619d3994 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:53.620805 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0848f8c7-8e56-42d4-956d-763a9166e452 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e7c523e9d94d2994ebe9b2d3b86b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9ddb2693734bd5a0d3c4101a165998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:53.640865 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0848f8c7-8e56-42d4-956d-763a9166e452 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba" status: 200 len: 1524 microversion: 2.1 time: 0.905704 Aug 04 16:59:53.643843 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2203/4493] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:52 2022] GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba => generated 1524 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:54.322746 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5c063b32-23b9-472d-b9f3-d0d792f4a85b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:54.323561 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5c063b32-23b9-472d-b9f3-d0d792f4a85b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 0063f3a7-735d-438e-a375-3b2a83bef991] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:54.344669 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5c063b32-23b9-472d-b9f3-d0d792f4a85b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:54.345968 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5c063b32-23b9-472d-b9f3-d0d792f4a85b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:54.351191 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5c063b32-23b9-472d-b9f3-d0d792f4a85b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:54.351648 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5c063b32-23b9-472d-b9f3-d0d792f4a85b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:54.543833 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-30c1e2d8-e606-4b11-8386-039c619d3994 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:54.562763 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-30c1e2d8-e606-4b11-8386-039c619d3994 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:54.564649 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-30c1e2d8-e606-4b11-8386-039c619d3994 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:54.565976 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-30c1e2d8-e606-4b11-8386-039c619d3994 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1740 microversion: 2.20 time: 0.992429 Aug 04 16:59:54.575506 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2291/4494] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:59:53 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1740 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:59:54.598852 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-052758d9-94d5-4cc6-9bbc-3bbe31afe4a9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:54.599548 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-052758d9-94d5-4cc6-9bbc-3bbe31afe4a9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 58ba4011-f974-4687-b3c0-fd8e04ce7600] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:54.623712 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:54.633756 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-052758d9-94d5-4cc6-9bbc-3bbe31afe4a9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:54.637434 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-052758d9-94d5-4cc6-9bbc-3bbe31afe4a9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:54.641354 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-052758d9-94d5-4cc6-9bbc-3bbe31afe4a9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:54.642595 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-052758d9-94d5-4cc6-9bbc-3bbe31afe4a9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:56.162286 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5c063b32-23b9-472d-b9f3-d0d792f4a85b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:56.199163 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5c063b32-23b9-472d-b9f3-d0d792f4a85b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991" status: 200 len: 1363 microversion: 2.1 time: 1.863236 Aug 04 16:59:56.202883 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2204/4495] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:54 2022] GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991 => generated 1363 bytes in 1885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:56.229147 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dacad0cc-587b-4b67-bde2-d1f844bde0d5 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:56.229147 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-dacad0cc-587b-4b67-bde2-d1f844bde0d5 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:56.247361 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dacad0cc-587b-4b67-bde2-d1f844bde0d5 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:56.248174 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dacad0cc-587b-4b67-bde2-d1f844bde0d5 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:56.249229 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dacad0cc-587b-4b67-bde2-d1f844bde0d5 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:56.249944 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dacad0cc-587b-4b67-bde2-d1f844bde0d5 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:56.406437 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-052758d9-94d5-4cc6-9bbc-3bbe31afe4a9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:56.421696 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-052758d9-94d5-4cc6-9bbc-3bbe31afe4a9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600" status: 200 len: 1317 microversion: 2.1 time: 1.824869 Aug 04 16:59:56.422383 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2292/4496] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:54 2022] GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600 => generated 1317 bytes in 1831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:56.455634 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-917d768e-3897-4882-b481-6b797109334d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:56.456349 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-917d768e-3897-4882-b481-6b797109334d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:56.474432 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-917d768e-3897-4882-b481-6b797109334d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:56.475254 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-917d768e-3897-4882-b481-6b797109334d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:56.476460 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-917d768e-3897-4882-b481-6b797109334d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:56.477358 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-917d768e-3897-4882-b481-6b797109334d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:57.044813 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-dacad0cc-587b-4b67-bde2-d1f844bde0d5 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e7c523e9d94d2994ebe9b2d3b86b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9ddb2693734bd5a0d3c4101a165998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:57.061743 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dacad0cc-587b-4b67-bde2-d1f844bde0d5 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba" status: 200 len: 1524 microversion: 2.1 time: 0.856839 Aug 04 16:59:57.077780 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2205/4497] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:56 2022] GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba => generated 1524 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:57.108369 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-917d768e-3897-4882-b481-6b797109334d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:57.118861 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-917d768e-3897-4882-b481-6b797109334d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:57.124265 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-917d768e-3897-4882-b481-6b797109334d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:57.133825 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-917d768e-3897-4882-b481-6b797109334d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1740 microversion: 2.20 time: 0.692972 Aug 04 16:59:57.150030 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2293/4498] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:59:56 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1740 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:59:57.230474 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3ba6cd00-55dc-49f7-85a5-68b30a308ceb tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:57.231145 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3ba6cd00-55dc-49f7-85a5-68b30a308ceb tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 0063f3a7-735d-438e-a375-3b2a83bef991] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:57.259645 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ba6cd00-55dc-49f7-85a5-68b30a308ceb tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:57.264163 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ba6cd00-55dc-49f7-85a5-68b30a308ceb tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:57.267881 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ba6cd00-55dc-49f7-85a5-68b30a308ceb tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:57.268339 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ba6cd00-55dc-49f7-85a5-68b30a308ceb tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:57.444825 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-43e9beae-f8a9-4053-8231-37026f472558 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:57.446399 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-43e9beae-f8a9-4053-8231-37026f472558 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 58ba4011-f974-4687-b3c0-fd8e04ce7600] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:57.459577 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-43e9beae-f8a9-4053-8231-37026f472558 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:57.462297 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-43e9beae-f8a9-4053-8231-37026f472558 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:57.463523 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-43e9beae-f8a9-4053-8231-37026f472558 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:57.466693 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-43e9beae-f8a9-4053-8231-37026f472558 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:57.472485 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=4 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:57.509131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=20 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:57.724783 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3ba6cd00-55dc-49f7-85a5-68b30a308ceb tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:57.745664 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3ba6cd00-55dc-49f7-85a5-68b30a308ceb tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991" status: 200 len: 1363 microversion: 2.1 time: 0.522320 Aug 04 16:59:57.747523 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2206/4499] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:57 2022] GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991 => generated 1363 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:57.892838 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-43e9beae-f8a9-4053-8231-37026f472558 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:57.903811 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-43e9beae-f8a9-4053-8231-37026f472558 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600" status: 200 len: 1317 microversion: 2.1 time: 0.462868 Aug 04 16:59:57.940031 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2294/4500] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:57 2022] GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600 => generated 1317 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:58.087828 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-917d762a-bd64-461c-a16e-2a40cd999b33 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:58.088448 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-917d762a-bd64-461c-a16e-2a40cd999b33 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:58.103431 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-917d762a-bd64-461c-a16e-2a40cd999b33 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:58.103983 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-917d762a-bd64-461c-a16e-2a40cd999b33 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:58.110528 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-917d762a-bd64-461c-a16e-2a40cd999b33 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:58.111096 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-917d762a-bd64-461c-a16e-2a40cd999b33 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:58.166466 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-19165c0b-cf52-4a62-be1e-5081f762b8f3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:58.167477 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-19165c0b-cf52-4a62-be1e-5081f762b8f3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:58.187011 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-19165c0b-cf52-4a62-be1e-5081f762b8f3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:58.188273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-19165c0b-cf52-4a62-be1e-5081f762b8f3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:58.194236 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-19165c0b-cf52-4a62-be1e-5081f762b8f3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:58.194686 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-19165c0b-cf52-4a62-be1e-5081f762b8f3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:58.300265 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:58.448368 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-917d762a-bd64-461c-a16e-2a40cd999b33 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e7c523e9d94d2994ebe9b2d3b86b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9ddb2693734bd5a0d3c4101a165998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:58.457555 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-917d762a-bd64-461c-a16e-2a40cd999b33 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba" status: 200 len: 1524 microversion: 2.1 time: 0.376853 Aug 04 16:59:58.464160 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2207/4501] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:58 2022] GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba => generated 1524 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:58.469127 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-64e06785-86ec-41a0-b6b6-1caaa5c97de9 req-c8dd1c3b-06f5-4677-8da0-f5788de4cd31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58ba4011-f974-4687-b3c0-fd8e04ce7600", "tag": "122d05c1-85e3-4efa-a89f-bb9d0c195075"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:58.480116 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-64e06785-86ec-41a0-b6b6-1caaa5c97de9 req-c8dd1c3b-06f5-4677-8da0-f5788de4cd31 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:58.480645 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-64e06785-86ec-41a0-b6b6-1caaa5c97de9 req-c8dd1c3b-06f5-4677-8da0-f5788de4cd31 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:58.493899 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-64e06785-86ec-41a0-b6b6-1caaa5c97de9 req-c8dd1c3b-06f5-4677-8da0-f5788de4cd31 service nova] Creating event network-changed:122d05c1-85e3-4efa-a89f-bb9d0c195075 for instance 58ba4011-f974-4687-b3c0-fd8e04ce7600 on n-h1-846466-12 Aug 04 16:59:58.505682 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-64e06785-86ec-41a0-b6b6-1caaa5c97de9 req-c8dd1c3b-06f5-4677-8da0-f5788de4cd31 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040090 Aug 04 16:59:58.508946 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2208/4502] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:58.730484 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-890f0ccd-3dda-4217-a019-a09936b92e79 req-85cea278-ca73-4c4d-8b8c-4fd0d26925d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0063f3a7-735d-438e-a375-3b2a83bef991", "name": "network-vif-plugged", "status": "completed", "tag": "5c087a04-2adb-42cd-9b46-3aec7dea7767"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:58.753482 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-890f0ccd-3dda-4217-a019-a09936b92e79 req-85cea278-ca73-4c4d-8b8c-4fd0d26925d2 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:58.754247 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-890f0ccd-3dda-4217-a019-a09936b92e79 req-85cea278-ca73-4c4d-8b8c-4fd0d26925d2 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:58.755928 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-19165c0b-cf52-4a62-be1e-5081f762b8f3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:58.771493 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-19165c0b-cf52-4a62-be1e-5081f762b8f3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:58.773731 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-890f0ccd-3dda-4217-a019-a09936b92e79 req-85cea278-ca73-4c4d-8b8c-4fd0d26925d2 service nova] Creating event network-vif-plugged:5c087a04-2adb-42cd-9b46-3aec7dea7767 for instance 0063f3a7-735d-438e-a375-3b2a83bef991 on n-h2-846466-12 Aug 04 16:59:58.781749 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-19165c0b-cf52-4a62-be1e-5081f762b8f3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:58.789873 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-19165c0b-cf52-4a62-be1e-5081f762b8f3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1740 microversion: 2.20 time: 0.625546 Aug 04 16:59:58.792830 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-890f0ccd-3dda-4217-a019-a09936b92e79 req-85cea278-ca73-4c4d-8b8c-4fd0d26925d2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081897 Aug 04 16:59:58.794199 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2209/4503] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:59:58.798273 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2295/4504] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:59:58 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1740 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:59:58.806513 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9e915d03-0771-40a9-8b85-47bef7e45d44 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:58.807605 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9e915d03-0771-40a9-8b85-47bef7e45d44 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 0063f3a7-735d-438e-a375-3b2a83bef991] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:58.816298 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e915d03-0771-40a9-8b85-47bef7e45d44 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:58.816958 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e915d03-0771-40a9-8b85-47bef7e45d44 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:58.818288 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e915d03-0771-40a9-8b85-47bef7e45d44 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:58.818884 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e915d03-0771-40a9-8b85-47bef7e45d44 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:58.941644 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2e86b2e3-609f-450b-b307-60e39a4600cc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:58.942299 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2e86b2e3-609f-450b-b307-60e39a4600cc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 58ba4011-f974-4687-b3c0-fd8e04ce7600] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:58.951883 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e86b2e3-609f-450b-b307-60e39a4600cc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:58.955765 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e86b2e3-609f-450b-b307-60e39a4600cc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:58.957153 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e86b2e3-609f-450b-b307-60e39a4600cc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:58.957778 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e86b2e3-609f-450b-b307-60e39a4600cc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:59.409167 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9e915d03-0771-40a9-8b85-47bef7e45d44 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:59.418143 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9e915d03-0771-40a9-8b85-47bef7e45d44 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991" status: 200 len: 1363 microversion: 2.1 time: 0.622183 Aug 04 16:59:59.418738 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2210/4505] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:58 2022] GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991 => generated 1363 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:59.485665 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7815c8b6-c6c6-4f0f-94be-e2f7ee5877d2 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:59.486420 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7815c8b6-c6c6-4f0f-94be-e2f7ee5877d2 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:59.495126 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7815c8b6-c6c6-4f0f-94be-e2f7ee5877d2 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:59.495571 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7815c8b6-c6c6-4f0f-94be-e2f7ee5877d2 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:59.496370 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7815c8b6-c6c6-4f0f-94be-e2f7ee5877d2 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:59.501416 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7815c8b6-c6c6-4f0f-94be-e2f7ee5877d2 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:59.507653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=100 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:59.558866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2e86b2e3-609f-450b-b307-60e39a4600cc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:59.569436 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2e86b2e3-609f-450b-b307-60e39a4600cc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600" status: 200 len: 1317 microversion: 2.1 time: 0.634503 Aug 04 16:59:59.570785 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2296/4506] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:58 2022] GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600 => generated 1317 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:59.826101 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5f8013f0-efaa-412f-84fd-4792a79385f1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:59.829901 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5f8013f0-efaa-412f-84fd-4792a79385f1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:59.846015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5f8013f0-efaa-412f-84fd-4792a79385f1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:59.850903 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7815c8b6-c6c6-4f0f-94be-e2f7ee5877d2 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e7c523e9d94d2994ebe9b2d3b86b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9ddb2693734bd5a0d3c4101a165998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:59.851562 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5f8013f0-efaa-412f-84fd-4792a79385f1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:59.852666 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5f8013f0-efaa-412f-84fd-4792a79385f1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 16:59:59.857223 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5f8013f0-efaa-412f-84fd-4792a79385f1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 16:59:59.863106 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7815c8b6-c6c6-4f0f-94be-e2f7ee5877d2 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba" status: 200 len: 1524 microversion: 2.1 time: 0.382467 Aug 04 16:59:59.864059 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2211/4507] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:59 2022] GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba => generated 1524 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:00:00.165100 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5f8013f0-efaa-412f-84fd-4792a79385f1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:00.174587 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5f8013f0-efaa-412f-84fd-4792a79385f1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:00.183160 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5f8013f0-efaa-412f-84fd-4792a79385f1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:00.185386 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5f8013f0-efaa-412f-84fd-4792a79385f1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1722 microversion: 2.20 time: 0.373167 Aug 04 17:00:00.187910 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2297/4508] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 16:59:59 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1722 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:00:00.346884 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f354ceb6-7af9-4b98-bb99-c4cb6601a5f2 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-2057291693", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:00.383340 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f042d669-7ccc-42ab-a133-2cae4a33e33c tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-937462228-access_point-904643268", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "763ebbec-345e-47c7-85d8-01e17eced3a9"}], "key_name": "tempest-TestSecurityGroupsBasicOps-751153364", "security_groups": [{"name": "tempest-secgroup_access--759994475"}, {"name": "tempest-secgroup_general--1345258286"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:00.446629 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-f354ceb6-7af9-4b98-bb99-c4cb6601a5f2 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] validate_networks() for [('040f2717-1f58-479c-8754-28f41d777747', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:00:00.876058 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-f042d669-7ccc-42ab-a133-2cae4a33e33c tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] validate_networks() for [('763ebbec-345e-47c7-85d8-01e17eced3a9', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:00:01.353539 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-f354ceb6-7af9-4b98-bb99-c4cb6601a5f2 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:00:01.354169 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-f354ceb6-7af9-4b98-bb99-c4cb6601a5f2 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:00:01.354407 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-f354ceb6-7af9-4b98-bb99-c4cb6601a5f2 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:00:01.354801 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-f354ceb6-7af9-4b98-bb99-c4cb6601a5f2 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:00:01.355427 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-f354ceb6-7af9-4b98-bb99-c4cb6601a5f2 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:00:01.376469 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f354ceb6-7af9-4b98-bb99-c4cb6601a5f2 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:01.377183 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f354ceb6-7af9-4b98-bb99-c4cb6601a5f2 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:01.378184 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f354ceb6-7af9-4b98-bb99-c4cb6601a5f2 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:01.378769 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f354ceb6-7af9-4b98-bb99-c4cb6601a5f2 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:01.422394 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-f354ceb6-7af9-4b98-bb99-c4cb6601a5f2 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Getting quotas for project 7af0c13734b34a69bbcf9201567398a2. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:00:01.435122 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-f354ceb6-7af9-4b98-bb99-c4cb6601a5f2 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Getting quotas for user 103f0906f85b4c1a8451cfc2b2384a88 and project 7af0c13734b34a69bbcf9201567398a2. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:00:01.454181 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f354ceb6-7af9-4b98-bb99-c4cb6601a5f2 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:00:01.466468 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f354ceb6-7af9-4b98-bb99-c4cb6601a5f2 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 04a3818f-fc8b-4fab-a720-46bba72436ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:00:01.561719 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f354ceb6-7af9-4b98-bb99-c4cb6601a5f2 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.554742 Aug 04 17:00:01.562619 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2212/4509] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:00:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 1557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:00:01.567322 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b70fc717-266f-407f-85a1-1014ba6aeeaf tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:01.567940 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b70fc717-266f-407f-85a1-1014ba6aeeaf tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 0063f3a7-735d-438e-a375-3b2a83bef991] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:01.575495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b70fc717-266f-407f-85a1-1014ba6aeeaf tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:01.575940 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b70fc717-266f-407f-85a1-1014ba6aeeaf tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:01.576707 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b70fc717-266f-407f-85a1-1014ba6aeeaf tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:01.577129 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b70fc717-266f-407f-85a1-1014ba6aeeaf tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:02.030923 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b70fc717-266f-407f-85a1-1014ba6aeeaf tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:02.040039 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b70fc717-266f-407f-85a1-1014ba6aeeaf tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991" status: 200 len: 1552 microversion: 2.1 time: 0.476417 Aug 04 17:00:02.040692 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2213/4510] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:01 2022] GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991 => generated 1552 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:02.098373 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d14f94ad-ffed-4783-96de-fc2c0c9621be tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:02.099013 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d14f94ad-ffed-4783-96de-fc2c0c9621be tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 58ba4011-f974-4687-b3c0-fd8e04ce7600] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:02.128673 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d14f94ad-ffed-4783-96de-fc2c0c9621be tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:02.129115 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d14f94ad-ffed-4783-96de-fc2c0c9621be tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:02.138532 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d14f94ad-ffed-4783-96de-fc2c0c9621be tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:02.138985 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d14f94ad-ffed-4783-96de-fc2c0c9621be tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:02.623940 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-f042d669-7ccc-42ab-a133-2cae4a33e33c tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:00:02.624449 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-f042d669-7ccc-42ab-a133-2cae4a33e33c tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:00:02.625915 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-f042d669-7ccc-42ab-a133-2cae4a33e33c tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:00:02.626782 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-f042d669-7ccc-42ab-a133-2cae4a33e33c tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:00:02.627438 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-f042d669-7ccc-42ab-a133-2cae4a33e33c tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:00:02.675607 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f042d669-7ccc-42ab-a133-2cae4a33e33c tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:02.676816 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f042d669-7ccc-42ab-a133-2cae4a33e33c tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:02.678710 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f042d669-7ccc-42ab-a133-2cae4a33e33c tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:02.681366 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f042d669-7ccc-42ab-a133-2cae4a33e33c tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:02.737995 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-f042d669-7ccc-42ab-a133-2cae4a33e33c tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Getting quotas for project 8759879e1bec45e38e9434db6bcf85e8. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:00:02.745054 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-f042d669-7ccc-42ab-a133-2cae4a33e33c tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Getting quotas for user 113fd3653eee4f798d0860705a2b4030 and project 8759879e1bec45e38e9434db6bcf85e8. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:00:02.763095 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f042d669-7ccc-42ab-a133-2cae4a33e33c tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:00:02.769399 n-d-846466-12 devstack@n-api.service[126125]: WARNING nova.utils [None req-f042d669-7ccc-42ab-a133-2cae4a33e33c tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-937462228-access_point-904643268 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-937462228-acc Aug 04 17:00:02.773051 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f042d669-7ccc-42ab-a133-2cae4a33e33c tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] [instance: 36778df0-79fd-4d26-b488-2e6b5e4c0edd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:00:02.918895 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f042d669-7ccc-42ab-a133-2cae4a33e33c tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 2.540191 Aug 04 17:00:02.925322 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2298/4511] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:00:00 2022] POST /compute/v2.1/servers => generated 457 bytes in 2547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 17:00:02.938285 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-54b32b51-3748-4520-b236-977ec1c8be52 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:02.946735 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-54b32b51-3748-4520-b236-977ec1c8be52 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:02.976130 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-54b32b51-3748-4520-b236-977ec1c8be52 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:02.979600 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-54b32b51-3748-4520-b236-977ec1c8be52 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:02.983322 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-54b32b51-3748-4520-b236-977ec1c8be52 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:02.985587 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-54b32b51-3748-4520-b236-977ec1c8be52 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:04.176193 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d14f94ad-ffed-4783-96de-fc2c0c9621be tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:04.192215 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d14f94ad-ffed-4783-96de-fc2c0c9621be tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600" status: 200 len: 1317 microversion: 2.1 time: 2.112911 Aug 04 17:00:04.195413 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2214/4512] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:02 2022] GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600 => generated 1317 bytes in 2154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:04.209310 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-53889700-f56d-479e-95af-42544fb535e8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:04.209912 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-53889700-f56d-479e-95af-42544fb535e8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:04.212606 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:04.246265 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-53889700-f56d-479e-95af-42544fb535e8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:04.254333 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-53889700-f56d-479e-95af-42544fb535e8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:04.255530 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-53889700-f56d-479e-95af-42544fb535e8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:04.256144 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-53889700-f56d-479e-95af-42544fb535e8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:04.371783 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-54b32b51-3748-4520-b236-977ec1c8be52 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e7c523e9d94d2994ebe9b2d3b86b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9ddb2693734bd5a0d3c4101a165998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:04.425521 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-54b32b51-3748-4520-b236-977ec1c8be52 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba" status: 200 len: 1524 microversion: 2.1 time: 1.496171 Aug 04 17:00:04.439136 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2299/4513] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:02 2022] GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba => generated 1524 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:04.469783 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-07beefe9-2b03-4402-89e0-5875eba1f301 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:04.474158 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-07beefe9-2b03-4402-89e0-5875eba1f301 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 04a3818f-fc8b-4fab-a720-46bba72436ef] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:04.502880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-07beefe9-2b03-4402-89e0-5875eba1f301 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:04.503380 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-07beefe9-2b03-4402-89e0-5875eba1f301 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:04.504176 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-07beefe9-2b03-4402-89e0-5875eba1f301 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:04.515896 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-07beefe9-2b03-4402-89e0-5875eba1f301 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:04.568152 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-53889700-f56d-479e-95af-42544fb535e8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:04.584250 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-53889700-f56d-479e-95af-42544fb535e8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:04.586324 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-53889700-f56d-479e-95af-42544fb535e8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:04.588003 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-53889700-f56d-479e-95af-42544fb535e8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1665 microversion: 2.20 time: 0.388561 Aug 04 17:00:04.589133 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2215/4514] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:04 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1665 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:04.609208 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fd63fd07-b811-4d7f-a668-6085fccbd026 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:04.610144 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fd63fd07-b811-4d7f-a668-6085fccbd026 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 0063f3a7-735d-438e-a375-3b2a83bef991] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:04.625477 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fd63fd07-b811-4d7f-a668-6085fccbd026 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:04.626236 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fd63fd07-b811-4d7f-a668-6085fccbd026 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:04.627261 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fd63fd07-b811-4d7f-a668-6085fccbd026 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:04.629707 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fd63fd07-b811-4d7f-a668-6085fccbd026 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:04.769634 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-07beefe9-2b03-4402-89e0-5875eba1f301 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:04.787185 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-07beefe9-2b03-4402-89e0-5875eba1f301 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef" status: 200 len: 1272 microversion: 2.1 time: 0.346121 Aug 04 17:00:04.788710 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2300/4515] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:04 2022] GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef => generated 1272 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:04.805685 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-5e1dfe91-4170-4e69-877e-8cbe3042d3c5 req-2562945c-ec85-4408-8f6f-0acb7ae34ccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdec5afc-3a3a-4d61-a934-5edf0c7c1397", "name": "network-vif-unplugged", "status": "completed", "tag": "0762f466-ea31-44a7-9ac5-75aaf39b80a6"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:04.858125 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-5e1dfe91-4170-4e69-877e-8cbe3042d3c5 req-2562945c-ec85-4408-8f6f-0acb7ae34ccf service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:04.862485 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-5e1dfe91-4170-4e69-877e-8cbe3042d3c5 req-2562945c-ec85-4408-8f6f-0acb7ae34ccf service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:04.903300 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.compute.server_external_events [req-5e1dfe91-4170-4e69-877e-8cbe3042d3c5 req-2562945c-ec85-4408-8f6f-0acb7ae34ccf service nova] Unable to find a host for instance fdec5afc-3a3a-4d61-a934-5edf0c7c1397. Dropping event network-vif-unplugged {{(pid=126125) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 04 17:00:04.905663 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-5e1dfe91-4170-4e69-877e-8cbe3042d3c5 req-2562945c-ec85-4408-8f6f-0acb7ae34ccf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.114660 Aug 04 17:00:04.907407 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2301/4516] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 118 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 04 17:00:04.918322 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6129feb7-78ab-4e69-871b-50a9f0c36ca1 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:04.919726 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6129feb7-78ab-4e69-871b-50a9f0c36ca1 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] [instance: 36778df0-79fd-4d26-b488-2e6b5e4c0edd] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:04.927913 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fd63fd07-b811-4d7f-a668-6085fccbd026 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.337303 Aug 04 17:00:04.936636 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2216/4517] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Aug 4 17:00:04 2022] GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991/os-interface => generated 284 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:04.942243 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-da7ba336-6c98-41ef-9d74-08aec9975df3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56b15395-3515-46c5-a206-2c204cf5e48c"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:04.949480 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6129feb7-78ab-4e69-871b-50a9f0c36ca1 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:04.950281 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-da7ba336-6c98-41ef-9d74-08aec9975df3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:04.953113 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6129feb7-78ab-4e69-871b-50a9f0c36ca1 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:04.959162 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6129feb7-78ab-4e69-871b-50a9f0c36ca1 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:04.960079 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6129feb7-78ab-4e69-871b-50a9f0c36ca1 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:04.968180 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-da7ba336-6c98-41ef-9d74-08aec9975df3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:04.968949 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-da7ba336-6c98-41ef-9d74-08aec9975df3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:04.970000 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-da7ba336-6c98-41ef-9d74-08aec9975df3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:04.970616 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-da7ba336-6c98-41ef-9d74-08aec9975df3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:05.205160 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6129feb7-78ab-4e69-871b-50a9f0c36ca1 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fd3653eee4f798d0860705a2b4030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8759879e1bec45e38e9434db6bcf85e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:05.248011 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6129feb7-78ab-4e69-871b-50a9f0c36ca1 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] 10.222.0.23 "GET /compute/v2.1/servers/36778df0-79fd-4d26-b488-2e6b5e4c0edd" status: 200 len: 1344 microversion: 2.1 time: 0.336513 Aug 04 17:00:05.251005 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2302/4518] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:04 2022] GET /compute/v2.1/servers/36778df0-79fd-4d26-b488-2e6b5e4c0edd => generated 1344 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:05.268224 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-efb4c692-ae06-4500-8ab3-29926f350511 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:05.283621 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-efb4c692-ae06-4500-8ab3-29926f350511 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 58ba4011-f974-4687-b3c0-fd8e04ce7600] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:05.307251 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-efb4c692-ae06-4500-8ab3-29926f350511 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:05.310090 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-efb4c692-ae06-4500-8ab3-29926f350511 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:05.317882 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-efb4c692-ae06-4500-8ab3-29926f350511 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:05.318468 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-efb4c692-ae06-4500-8ab3-29926f350511 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:05.680717 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-da7ba336-6c98-41ef-9d74-08aec9975df3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "POST /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.741688 Aug 04 17:00:05.688229 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2217/4519] 10.222.0.23 () {62 vars in 1364 bytes} [Thu Aug 4 17:00:04 2022] POST /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397/os-volume_attachments => generated 188 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:00:05.695270 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b4a26e09-9b62-44fd-8cdc-b569b02466a3 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:05.696210 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b4a26e09-9b62-44fd-8cdc-b569b02466a3 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:05.704854 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b4a26e09-9b62-44fd-8cdc-b569b02466a3 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:05.705878 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b4a26e09-9b62-44fd-8cdc-b569b02466a3 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:05.707337 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b4a26e09-9b62-44fd-8cdc-b569b02466a3 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:05.708117 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b4a26e09-9b62-44fd-8cdc-b569b02466a3 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:05.986425 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-efb4c692-ae06-4500-8ab3-29926f350511 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:05.995510 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-efb4c692-ae06-4500-8ab3-29926f350511 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600" status: 200 len: 1317 microversion: 2.1 time: 0.742881 Aug 04 17:00:05.996891 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2303/4520] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:05 2022] GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600 => generated 1317 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:06.003011 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-55f32164-afe6-48d7-a3ed-c3b36fc56af5 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:06.004413 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-55f32164-afe6-48d7-a3ed-c3b36fc56af5 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 04a3818f-fc8b-4fab-a720-46bba72436ef] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:06.015169 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-55f32164-afe6-48d7-a3ed-c3b36fc56af5 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:06.015895 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-55f32164-afe6-48d7-a3ed-c3b36fc56af5 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:06.016873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-55f32164-afe6-48d7-a3ed-c3b36fc56af5 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:06.017849 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-55f32164-afe6-48d7-a3ed-c3b36fc56af5 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:06.181908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-55f32164-afe6-48d7-a3ed-c3b36fc56af5 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:06.207686 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-55f32164-afe6-48d7-a3ed-c3b36fc56af5 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef" status: 200 len: 1272 microversion: 2.1 time: 0.207899 Aug 04 17:00:06.209091 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2304/4521] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:05 2022] GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef => generated 1272 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:06.222059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e381d05e-7103-4d62-a141-f38ea5da5cca tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:06.226753 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e381d05e-7103-4d62-a141-f38ea5da5cca tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:06.246371 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e381d05e-7103-4d62-a141-f38ea5da5cca tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:06.247289 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e381d05e-7103-4d62-a141-f38ea5da5cca tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:06.249895 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e381d05e-7103-4d62-a141-f38ea5da5cca tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:06.251188 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e381d05e-7103-4d62-a141-f38ea5da5cca tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:06.314343 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b4a26e09-9b62-44fd-8cdc-b569b02466a3 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e7c523e9d94d2994ebe9b2d3b86b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9ddb2693734bd5a0d3c4101a165998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:06.323983 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b4a26e09-9b62-44fd-8cdc-b569b02466a3 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba" status: 200 len: 1504 microversion: 2.1 time: 0.638180 Aug 04 17:00:06.342899 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2218/4522] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:05 2022] GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba => generated 1504 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:06.349542 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-10e58913-e24c-4ae4-920c-d23aa58c8131 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:06.350524 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-10e58913-e24c-4ae4-920c-d23aa58c8131 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] [instance: 36778df0-79fd-4d26-b488-2e6b5e4c0edd] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:06.358506 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-10e58913-e24c-4ae4-920c-d23aa58c8131 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:06.359310 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-10e58913-e24c-4ae4-920c-d23aa58c8131 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:06.360440 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-10e58913-e24c-4ae4-920c-d23aa58c8131 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:06.361094 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-10e58913-e24c-4ae4-920c-d23aa58c8131 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:06.440098 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e381d05e-7103-4d62-a141-f38ea5da5cca tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126125) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 17:00:06.486748 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-10e58913-e24c-4ae4-920c-d23aa58c8131 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fd3653eee4f798d0860705a2b4030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8759879e1bec45e38e9434db6bcf85e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:06.500679 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-10e58913-e24c-4ae4-920c-d23aa58c8131 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] 10.222.0.23 "GET /compute/v2.1/servers/36778df0-79fd-4d26-b488-2e6b5e4c0edd" status: 200 len: 1350 microversion: 2.1 time: 0.152647 Aug 04 17:00:06.501980 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2219/4523] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:06 2022] GET /compute/v2.1/servers/36778df0-79fd-4d26-b488-2e6b5e4c0edd => generated 1350 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:06.519216 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-258edc4f-0452-4efc-a82f-8d898f599c01 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Action: 'create', calling method: .version_select at 0x7f7e84bec280>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1219879260", "description": "tempest-description-439356469"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:06.570245 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e381d05e-7103-4d62-a141-f38ea5da5cca tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "POST /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397/action" status: 202 len: 0 microversion: 2.20 time: 0.359335 Aug 04 17:00:06.574402 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2305/4524] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Aug 4 17:00:06 2022] POST /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:00:06.582887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9127d67c-03a8-449d-bc94-f0a152e2f36f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:06.583427 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9127d67c-03a8-449d-bc94-f0a152e2f36f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:06.597423 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9127d67c-03a8-449d-bc94-f0a152e2f36f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:06.597876 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9127d67c-03a8-449d-bc94-f0a152e2f36f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:06.599856 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9127d67c-03a8-449d-bc94-f0a152e2f36f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:06.599856 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9127d67c-03a8-449d-bc94-f0a152e2f36f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:07.118407 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9127d67c-03a8-449d-bc94-f0a152e2f36f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:07.129925 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9127d67c-03a8-449d-bc94-f0a152e2f36f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:07.132001 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9127d67c-03a8-449d-bc94-f0a152e2f36f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:07.133784 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9127d67c-03a8-449d-bc94-f0a152e2f36f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1751 microversion: 2.20 time: 0.557506 Aug 04 17:00:07.150997 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2306/4525] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:06 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1751 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:07.156414 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2979415f-5876-4e23-98af-9dfc601d479e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:07.157460 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2979415f-5876-4e23-98af-9dfc601d479e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 58ba4011-f974-4687-b3c0-fd8e04ce7600] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:07.164776 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2979415f-5876-4e23-98af-9dfc601d479e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:07.165755 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2979415f-5876-4e23-98af-9dfc601d479e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:07.167192 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2979415f-5876-4e23-98af-9dfc601d479e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:07.167849 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2979415f-5876-4e23-98af-9dfc601d479e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:07.201534 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:07.723991 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-258edc4f-0452-4efc-a82f-8d898f599c01 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 1.218014 Aug 04 17:00:07.725074 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2220/4526] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Aug 4 17:00:06 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:07.736098 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2979415f-5876-4e23-98af-9dfc601d479e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:07.748780 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-98a3dd3e-5756-4f17-b2cf-ae80bd234b06 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:07.751792 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-98a3dd3e-5756-4f17-b2cf-ae80bd234b06 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 04a3818f-fc8b-4fab-a720-46bba72436ef] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:07.754047 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2979415f-5876-4e23-98af-9dfc601d479e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600" status: 200 len: 1317 microversion: 2.1 time: 0.601433 Aug 04 17:00:07.766609 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2307/4527] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:07 2022] GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600 => generated 1317 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:07.766609 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-3d510b90-e219-4f91-b32d-d3007cf2294f req-05d5d3a6-c1ce-483d-830b-be2dd2bd4ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ba4011-f974-4687-b3c0-fd8e04ce7600", "name": "network-vif-plugged", "status": "completed", "tag": "122d05c1-85e3-4efa-a89f-bb9d0c195075"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:07.778929 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-3d510b90-e219-4f91-b32d-d3007cf2294f req-05d5d3a6-c1ce-483d-830b-be2dd2bd4ec5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:07.781957 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-3d510b90-e219-4f91-b32d-d3007cf2294f req-05d5d3a6-c1ce-483d-830b-be2dd2bd4ec5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:07.800885 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-3d510b90-e219-4f91-b32d-d3007cf2294f req-05d5d3a6-c1ce-483d-830b-be2dd2bd4ec5 service nova] Creating event network-vif-plugged:122d05c1-85e3-4efa-a89f-bb9d0c195075 for instance 58ba4011-f974-4687-b3c0-fd8e04ce7600 on n-h1-846466-12 Aug 04 17:00:07.804857 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-98a3dd3e-5756-4f17-b2cf-ae80bd234b06 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:07.805377 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-98a3dd3e-5756-4f17-b2cf-ae80bd234b06 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:07.806267 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-98a3dd3e-5756-4f17-b2cf-ae80bd234b06 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:07.806709 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-98a3dd3e-5756-4f17-b2cf-ae80bd234b06 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:07.823362 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-3d510b90-e219-4f91-b32d-d3007cf2294f req-05d5d3a6-c1ce-483d-830b-be2dd2bd4ec5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067179 Aug 04 17:00:07.824283 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2308/4528] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:07.833832 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1e160eb0-035e-4e41-af67-d6caf790c288 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:07.834764 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1e160eb0-035e-4e41-af67-d6caf790c288 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] [instance: 36778df0-79fd-4d26-b488-2e6b5e4c0edd] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:07.855628 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1e160eb0-035e-4e41-af67-d6caf790c288 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:07.856364 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1e160eb0-035e-4e41-af67-d6caf790c288 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:07.857378 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1e160eb0-035e-4e41-af67-d6caf790c288 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:07.857986 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1e160eb0-035e-4e41-af67-d6caf790c288 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:08.054802 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1e160eb0-035e-4e41-af67-d6caf790c288 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fd3653eee4f798d0860705a2b4030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8759879e1bec45e38e9434db6bcf85e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:08.075776 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1e160eb0-035e-4e41-af67-d6caf790c288 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] 10.222.0.23 "GET /compute/v2.1/servers/36778df0-79fd-4d26-b488-2e6b5e4c0edd" status: 200 len: 1350 microversion: 2.1 time: 0.250030 Aug 04 17:00:08.076383 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2309/4529] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:07 2022] GET /compute/v2.1/servers/36778df0-79fd-4d26-b488-2e6b5e4c0edd => generated 1350 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:08.089699 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6364b719-1450-4a85-98ff-2b8a21aa080f tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1219879260"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:08.089699 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6364b719-1450-4a85-98ff-2b8a21aa080f tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:08.095820 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6364b719-1450-4a85-98ff-2b8a21aa080f tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:08.096251 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6364b719-1450-4a85-98ff-2b8a21aa080f tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:08.097219 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6364b719-1450-4a85-98ff-2b8a21aa080f tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:08.097705 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6364b719-1450-4a85-98ff-2b8a21aa080f tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:08.393375 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-98a3dd3e-5756-4f17-b2cf-ae80bd234b06 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:08.408433 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-98a3dd3e-5756-4f17-b2cf-ae80bd234b06 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef" status: 200 len: 1314 microversion: 2.1 time: 0.680747 Aug 04 17:00:08.409038 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2221/4530] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:07 2022] GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef => generated 1314 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:08.426557 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b8df3d3e-ddf1-4b05-bd41-9a815f014515 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:08.427196 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b8df3d3e-ddf1-4b05-bd41-9a815f014515 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:08.434306 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b8df3d3e-ddf1-4b05-bd41-9a815f014515 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:08.435064 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b8df3d3e-ddf1-4b05-bd41-9a815f014515 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:08.436025 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b8df3d3e-ddf1-4b05-bd41-9a815f014515 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:08.436636 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b8df3d3e-ddf1-4b05-bd41-9a815f014515 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:08.498556 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.network.security_group_api [None req-6364b719-1450-4a85-98ff-2b8a21aa080f tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Adding security group 7be38272-75f5-43c9-904e-05f37165c1b5 to port 9c23e8b8-64c3-4977-b3ff-1e91ba857153 Aug 04 17:00:08.882316 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b8df3d3e-ddf1-4b05-bd41-9a815f014515 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:08.893396 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b8df3d3e-ddf1-4b05-bd41-9a815f014515 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:08.902144 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b8df3d3e-ddf1-4b05-bd41-9a815f014515 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:08.910512 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b8df3d3e-ddf1-4b05-bd41-9a815f014515 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1753 microversion: 2.20 time: 0.481424 Aug 04 17:00:08.911970 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2222/4531] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:08 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1753 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:08.917272 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-468e47b5-abd0-4a7d-9604-2645c7134e1c req-1492df6d-0f71-4569-b929-6cc3b02c0397 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04a3818f-fc8b-4fab-a720-46bba72436ef", "tag": "c883d5f1-4bb8-4787-8687-7fe616e52760"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:08.951569 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-468e47b5-abd0-4a7d-9604-2645c7134e1c req-1492df6d-0f71-4569-b929-6cc3b02c0397 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:08.953139 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-468e47b5-abd0-4a7d-9604-2645c7134e1c req-1492df6d-0f71-4569-b929-6cc3b02c0397 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:08.979818 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-468e47b5-abd0-4a7d-9604-2645c7134e1c req-1492df6d-0f71-4569-b929-6cc3b02c0397 service nova] Creating event network-changed:c883d5f1-4bb8-4787-8687-7fe616e52760 for instance 04a3818f-fc8b-4fab-a720-46bba72436ef on n-h2-846466-12 Aug 04 17:00:09.002149 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-468e47b5-abd0-4a7d-9604-2645c7134e1c req-1492df6d-0f71-4569-b929-6cc3b02c0397 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088593 Aug 04 17:00:09.003023 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2223/4532] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:09.008485 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9ec72835-759c-4c4c-ae6f-b8105786123d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:09.009227 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9ec72835-759c-4c4c-ae6f-b8105786123d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 58ba4011-f974-4687-b3c0-fd8e04ce7600] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:09.051426 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9ec72835-759c-4c4c-ae6f-b8105786123d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:09.052671 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9ec72835-759c-4c4c-ae6f-b8105786123d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:09.053740 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9ec72835-759c-4c4c-ae6f-b8105786123d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:09.054399 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9ec72835-759c-4c4c-ae6f-b8105786123d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:10.687615 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9ec72835-759c-4c4c-ae6f-b8105786123d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:10.695883 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9ec72835-759c-4c4c-ae6f-b8105786123d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600" status: 200 len: 1317 microversion: 2.1 time: 1.691504 Aug 04 17:00:10.710310 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2224/4533] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:09 2022] GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600 => generated 1317 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:10.715555 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-a9278810-5958-42a8-809e-bd31daaafbce req-fd98bd99-b333-4c12-8294-3543ed5bb3f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0063f3a7-735d-438e-a375-3b2a83bef991", "tag": "5c087a04-2adb-42cd-9b46-3aec7dea7767"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:10.730407 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a9278810-5958-42a8-809e-bd31daaafbce req-fd98bd99-b333-4c12-8294-3543ed5bb3f8 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:10.737671 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a9278810-5958-42a8-809e-bd31daaafbce req-fd98bd99-b333-4c12-8294-3543ed5bb3f8 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:10.761762 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-a9278810-5958-42a8-809e-bd31daaafbce req-fd98bd99-b333-4c12-8294-3543ed5bb3f8 service nova] Creating event network-changed:5c087a04-2adb-42cd-9b46-3aec7dea7767 for instance 0063f3a7-735d-438e-a375-3b2a83bef991 on n-h2-846466-12 Aug 04 17:00:10.773220 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-a9278810-5958-42a8-809e-bd31daaafbce req-fd98bd99-b333-4c12-8294-3543ed5bb3f8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060842 Aug 04 17:00:10.774964 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2225/4534] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:10.786589 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-64cf7732-81c8-4b13-ae72-2e57887051db tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:10.787546 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-64cf7732-81c8-4b13-ae72-2e57887051db tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] [instance: 36778df0-79fd-4d26-b488-2e6b5e4c0edd] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:10.805344 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-64cf7732-81c8-4b13-ae72-2e57887051db tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:10.806471 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-64cf7732-81c8-4b13-ae72-2e57887051db tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:10.808080 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-64cf7732-81c8-4b13-ae72-2e57887051db tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:10.809090 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-64cf7732-81c8-4b13-ae72-2e57887051db tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:11.034006 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6364b719-1450-4a85-98ff-2b8a21aa080f tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "POST /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba/action" status: 202 len: 0 microversion: 2.1 time: 2.956506 Aug 04 17:00:11.035296 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2310/4535] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:00:08 2022] POST /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba/action => generated 0 bytes in 2958 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:00:11.045836 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-40ca20c8-31e9-4a40-8a42-30237bc31135 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:11.047990 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-40ca20c8-31e9-4a40-8a42-30237bc31135 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 04a3818f-fc8b-4fab-a720-46bba72436ef] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:11.063085 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-40ca20c8-31e9-4a40-8a42-30237bc31135 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:11.066175 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-40ca20c8-31e9-4a40-8a42-30237bc31135 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:11.067333 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-40ca20c8-31e9-4a40-8a42-30237bc31135 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:11.068975 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-40ca20c8-31e9-4a40-8a42-30237bc31135 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:11.231428 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-64cf7732-81c8-4b13-ae72-2e57887051db tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fd3653eee4f798d0860705a2b4030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8759879e1bec45e38e9434db6bcf85e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:11.251134 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-64cf7732-81c8-4b13-ae72-2e57887051db tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] 10.222.0.23 "GET /compute/v2.1/servers/36778df0-79fd-4d26-b488-2e6b5e4c0edd" status: 200 len: 1469 microversion: 2.1 time: 0.473687 Aug 04 17:00:11.252125 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2226/4536] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:10 2022] GET /compute/v2.1/servers/36778df0-79fd-4d26-b488-2e6b5e4c0edd => generated 1469 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:11.256987 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-260cb055-7116-4220-aa09-9aa289408be9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:11.257628 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-260cb055-7116-4220-aa09-9aa289408be9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:11.281749 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-260cb055-7116-4220-aa09-9aa289408be9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:11.282829 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-260cb055-7116-4220-aa09-9aa289408be9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:11.283817 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-260cb055-7116-4220-aa09-9aa289408be9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:11.284420 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-260cb055-7116-4220-aa09-9aa289408be9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:11.397607 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:11.446949 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:11.726199 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-40ca20c8-31e9-4a40-8a42-30237bc31135 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:11.743997 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-40ca20c8-31e9-4a40-8a42-30237bc31135 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef" status: 200 len: 1314 microversion: 2.1 time: 0.706266 Aug 04 17:00:11.745053 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2311/4537] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:11 2022] GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef => generated 1314 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:11.758516 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-56317980-7390-4e87-9bc3-f589178d91d8 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1219879260"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:11.759519 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-56317980-7390-4e87-9bc3-f589178d91d8 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:11.779752 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-56317980-7390-4e87-9bc3-f589178d91d8 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:11.780807 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-56317980-7390-4e87-9bc3-f589178d91d8 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:11.782221 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-56317980-7390-4e87-9bc3-f589178d91d8 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:11.782770 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-56317980-7390-4e87-9bc3-f589178d91d8 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:11.994581 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-260cb055-7116-4220-aa09-9aa289408be9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:12.017832 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-260cb055-7116-4220-aa09-9aa289408be9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:12.019947 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-260cb055-7116-4220-aa09-9aa289408be9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:12.022096 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-260cb055-7116-4220-aa09-9aa289408be9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1753 microversion: 2.20 time: 0.768586 Aug 04 17:00:12.023284 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2227/4538] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:11 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1753 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:12.034115 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5b23dc25-e6ee-44f3-bc17-d8c82d287f5d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:12.035012 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5b23dc25-e6ee-44f3-bc17-d8c82d287f5d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 58ba4011-f974-4687-b3c0-fd8e04ce7600] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:12.057308 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5b23dc25-e6ee-44f3-bc17-d8c82d287f5d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:12.058056 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5b23dc25-e6ee-44f3-bc17-d8c82d287f5d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:12.059638 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5b23dc25-e6ee-44f3-bc17-d8c82d287f5d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:12.060596 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5b23dc25-e6ee-44f3-bc17-d8c82d287f5d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:12.095895 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:12.539519 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.network.security_group_api [None req-56317980-7390-4e87-9bc3-f589178d91d8 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Removing security group 7be38272-75f5-43c9-904e-05f37165c1b5 from port 9c23e8b8-64c3-4977-b3ff-1e91ba857153 Aug 04 17:00:12.719319 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:12.756448 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:12.935728 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5b23dc25-e6ee-44f3-bc17-d8c82d287f5d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:12.954437 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5b23dc25-e6ee-44f3-bc17-d8c82d287f5d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600" status: 200 len: 1506 microversion: 2.1 time: 0.929131 Aug 04 17:00:12.972698 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2228/4539] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:12 2022] GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600 => generated 1506 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:12.990713 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-32128d0a-fbb2-46de-a694-bb09bc772d05 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:12.990713 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-32128d0a-fbb2-46de-a694-bb09bc772d05 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] [instance: 36778df0-79fd-4d26-b488-2e6b5e4c0edd] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:12.995223 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-32128d0a-fbb2-46de-a694-bb09bc772d05 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:12.996531 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-32128d0a-fbb2-46de-a694-bb09bc772d05 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:13.001930 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-32128d0a-fbb2-46de-a694-bb09bc772d05 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:13.002606 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-32128d0a-fbb2-46de-a694-bb09bc772d05 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:13.810267 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-32128d0a-fbb2-46de-a694-bb09bc772d05 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fd3653eee4f798d0860705a2b4030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8759879e1bec45e38e9434db6bcf85e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:13.840333 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-32128d0a-fbb2-46de-a694-bb09bc772d05 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] 10.222.0.23 "GET /compute/v2.1/servers/36778df0-79fd-4d26-b488-2e6b5e4c0edd" status: 200 len: 1469 microversion: 2.1 time: 0.866344 Aug 04 17:00:13.846563 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2229/4540] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:12 2022] GET /compute/v2.1/servers/36778df0-79fd-4d26-b488-2e6b5e4c0edd => generated 1469 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:13.862824 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6e2e92a2-b36b-42e5-ada8-af5d92524cd7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:13.864942 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6e2e92a2-b36b-42e5-ada8-af5d92524cd7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 04a3818f-fc8b-4fab-a720-46bba72436ef] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:13.883178 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e2e92a2-b36b-42e5-ada8-af5d92524cd7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:13.884782 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e2e92a2-b36b-42e5-ada8-af5d92524cd7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:13.887274 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e2e92a2-b36b-42e5-ada8-af5d92524cd7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:13.892424 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e2e92a2-b36b-42e5-ada8-af5d92524cd7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:14.110194 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-56317980-7390-4e87-9bc3-f589178d91d8 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "POST /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba/action" status: 202 len: 0 microversion: 2.1 time: 2.363562 Aug 04 17:00:14.111164 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2312/4541] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:00:11 2022] POST /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba/action => generated 0 bytes in 2365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:00:14.121947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-3ee2a8e6-697c-499d-ba41-f9ad9497811f req-3694336c-2092-418a-890a-614136de1a91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63185fca-5246-43fb-8d55-3ef5b7a5fcba", "tag": "9c23e8b8-64c3-4977-b3ff-1e91ba857153"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:14.155614 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-3ee2a8e6-697c-499d-ba41-f9ad9497811f req-3694336c-2092-418a-890a-614136de1a91 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:14.156234 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-3ee2a8e6-697c-499d-ba41-f9ad9497811f req-3694336c-2092-418a-890a-614136de1a91 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:14.186515 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-3ee2a8e6-697c-499d-ba41-f9ad9497811f req-3694336c-2092-418a-890a-614136de1a91 service nova] Creating event network-changed:9c23e8b8-64c3-4977-b3ff-1e91ba857153 for instance 63185fca-5246-43fb-8d55-3ef5b7a5fcba on n-h1-846466-12 Aug 04 17:00:14.195248 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-3ee2a8e6-697c-499d-ba41-f9ad9497811f req-3694336c-2092-418a-890a-614136de1a91 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082503 Aug 04 17:00:14.196058 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2313/4542] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:14.202010 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-250fe135-3c40-4167-acbd-f4090f0e772e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:14.203044 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-250fe135-3c40-4167-acbd-f4090f0e772e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 58ba4011-f974-4687-b3c0-fd8e04ce7600] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:14.210214 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-250fe135-3c40-4167-acbd-f4090f0e772e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:14.210935 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-250fe135-3c40-4167-acbd-f4090f0e772e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:14.212153 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-250fe135-3c40-4167-acbd-f4090f0e772e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:14.213054 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-250fe135-3c40-4167-acbd-f4090f0e772e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:14.253327 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-250fe135-3c40-4167-acbd-f4090f0e772e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 58ba4011-f974-4687-b3c0-fd8e04ce7600] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:00:14.474503 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-250fe135-3c40-4167-acbd-f4090f0e772e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "DELETE /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600" status: 204 len: 0 microversion: 2.1 time: 0.274871 Aug 04 17:00:14.479540 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2314/4543] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:00:14 2022] DELETE /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:00:14.502648 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2ebfb36a-ceab-4c05-ad2e-51b32c3c2163 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:14.505526 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2ebfb36a-ceab-4c05-ad2e-51b32c3c2163 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:14.533446 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2ebfb36a-ceab-4c05-ad2e-51b32c3c2163 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:14.534676 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2ebfb36a-ceab-4c05-ad2e-51b32c3c2163 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:14.537370 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2ebfb36a-ceab-4c05-ad2e-51b32c3c2163 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:14.538275 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2ebfb36a-ceab-4c05-ad2e-51b32c3c2163 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:14.626463 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6e2e92a2-b36b-42e5-ada8-af5d92524cd7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:14.641138 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6e2e92a2-b36b-42e5-ada8-af5d92524cd7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef" status: 200 len: 1314 microversion: 2.1 time: 0.792940 Aug 04 17:00:14.642125 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2230/4544] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:13 2022] GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef => generated 1314 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:14.646975 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-100e5e7d-75a6-44e6-8ba0-f52c58166415 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Action: 'create', calling method: .version_select at 0x7f7e84bec700>, body: {"pool": null} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:14.938626 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2ebfb36a-ceab-4c05-ad2e-51b32c3c2163 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:14.952406 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2ebfb36a-ceab-4c05-ad2e-51b32c3c2163 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:14.958453 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2ebfb36a-ceab-4c05-ad2e-51b32c3c2163 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:14.959758 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2ebfb36a-ceab-4c05-ad2e-51b32c3c2163 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1753 microversion: 2.20 time: 0.478564 Aug 04 17:00:14.978088 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2315/4545] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:14 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1753 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:14.978088 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e7f3b667-0fb7-449a-908f-0cd860d23eb2 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:14.978088 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e7f3b667-0fb7-449a-908f-0cd860d23eb2 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 58ba4011-f974-4687-b3c0-fd8e04ce7600] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:14.988786 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e7f3b667-0fb7-449a-908f-0cd860d23eb2 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:14.989244 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e7f3b667-0fb7-449a-908f-0cd860d23eb2 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:14.990084 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e7f3b667-0fb7-449a-908f-0cd860d23eb2 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:14.990529 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e7f3b667-0fb7-449a-908f-0cd860d23eb2 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:15.441698 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e7f3b667-0fb7-449a-908f-0cd860d23eb2 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:15.452307 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e7f3b667-0fb7-449a-908f-0cd860d23eb2 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600" status: 200 len: 1512 microversion: 2.1 time: 0.489309 Aug 04 17:00:15.456522 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2316/4546] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:14 2022] GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600 => generated 1512 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:15.466205 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c7aa2598-8414-415b-bab6-b71feeaaf98b tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:15.467669 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c7aa2598-8414-415b-bab6-b71feeaaf98b tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] [instance: 36778df0-79fd-4d26-b488-2e6b5e4c0edd] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:15.477215 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c7aa2598-8414-415b-bab6-b71feeaaf98b tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:15.477771 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c7aa2598-8414-415b-bab6-b71feeaaf98b tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:15.482064 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c7aa2598-8414-415b-bab6-b71feeaaf98b tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:15.491592 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c7aa2598-8414-415b-bab6-b71feeaaf98b tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:15.765512 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c7aa2598-8414-415b-bab6-b71feeaaf98b tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fd3653eee4f798d0860705a2b4030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8759879e1bec45e38e9434db6bcf85e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:15.777793 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c7aa2598-8414-415b-bab6-b71feeaaf98b tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] 10.222.0.23 "GET /compute/v2.1/servers/36778df0-79fd-4d26-b488-2e6b5e4c0edd" status: 200 len: 1469 microversion: 2.1 time: 0.319475 Aug 04 17:00:15.779156 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2317/4547] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:15 2022] GET /compute/v2.1/servers/36778df0-79fd-4d26-b488-2e6b5e4c0edd => generated 1469 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:15.786750 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a1e7ebd7-1dae-4a6b-9ab8-8d287e8c49ac tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:15.795532 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a1e7ebd7-1dae-4a6b-9ab8-8d287e8c49ac tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 04a3818f-fc8b-4fab-a720-46bba72436ef] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:15.823498 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a1e7ebd7-1dae-4a6b-9ab8-8d287e8c49ac tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:15.836601 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a1e7ebd7-1dae-4a6b-9ab8-8d287e8c49ac tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:15.840820 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a1e7ebd7-1dae-4a6b-9ab8-8d287e8c49ac tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:15.841732 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a1e7ebd7-1dae-4a6b-9ab8-8d287e8c49ac tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:16.170599 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a1e7ebd7-1dae-4a6b-9ab8-8d287e8c49ac tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:16.182859 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a1e7ebd7-1dae-4a6b-9ab8-8d287e8c49ac tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef" status: 200 len: 1314 microversion: 2.1 time: 0.402032 Aug 04 17:00:16.184635 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2318/4548] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:15 2022] GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:16.189991 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4f179037-1c44-4c98-aefe-9287ef7b2a59 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:16.190984 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4f179037-1c44-4c98-aefe-9287ef7b2a59 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:16.226163 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4f179037-1c44-4c98-aefe-9287ef7b2a59 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:16.227586 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4f179037-1c44-4c98-aefe-9287ef7b2a59 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:16.233804 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4f179037-1c44-4c98-aefe-9287ef7b2a59 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:16.235406 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4f179037-1c44-4c98-aefe-9287ef7b2a59 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:16.574652 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4f179037-1c44-4c98-aefe-9287ef7b2a59 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:16.594855 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4f179037-1c44-4c98-aefe-9287ef7b2a59 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:16.596977 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4f179037-1c44-4c98-aefe-9287ef7b2a59 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:16.598830 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4f179037-1c44-4c98-aefe-9287ef7b2a59 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1753 microversion: 2.20 time: 0.412886 Aug 04 17:00:16.609315 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2319/4549] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:16 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1753 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:16.614830 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-a3b27c25-a2f1-4a74-ae7d-db0afbae0a86 req-71e9d7aa-01d7-4944-97c4-e87cf6f2473b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36778df0-79fd-4d26-b488-2e6b5e4c0edd", "tag": "d728997e-bd33-4d24-93a4-db144cfb23cf"}, {"name": "network-changed", "server_uuid": "63185fca-5246-43fb-8d55-3ef5b7a5fcba", "tag": "9c23e8b8-64c3-4977-b3ff-1e91ba857153"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:16.638704 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-a3b27c25-a2f1-4a74-ae7d-db0afbae0a86 req-71e9d7aa-01d7-4944-97c4-e87cf6f2473b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:16.639689 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-a3b27c25-a2f1-4a74-ae7d-db0afbae0a86 req-71e9d7aa-01d7-4944-97c4-e87cf6f2473b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:16.665360 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-a3b27c25-a2f1-4a74-ae7d-db0afbae0a86 req-71e9d7aa-01d7-4944-97c4-e87cf6f2473b service nova] Creating event network-changed:d728997e-bd33-4d24-93a4-db144cfb23cf for instance 36778df0-79fd-4d26-b488-2e6b5e4c0edd on n-h1-846466-12 Aug 04 17:00:16.670634 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-a3b27c25-a2f1-4a74-ae7d-db0afbae0a86 req-71e9d7aa-01d7-4944-97c4-e87cf6f2473b service nova] Creating event network-changed:9c23e8b8-64c3-4977-b3ff-1e91ba857153 for instance 63185fca-5246-43fb-8d55-3ef5b7a5fcba on n-h1-846466-12 Aug 04 17:00:16.685276 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-a3b27c25-a2f1-4a74-ae7d-db0afbae0a86 req-71e9d7aa-01d7-4944-97c4-e87cf6f2473b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.074210 Aug 04 17:00:16.690402 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2320/4550] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:16.707479 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0c05d11d-3cfe-48ed-9365-ab65eff0db9e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:16.708530 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0c05d11d-3cfe-48ed-9365-ab65eff0db9e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 58ba4011-f974-4687-b3c0-fd8e04ce7600] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:16.716549 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0c05d11d-3cfe-48ed-9365-ab65eff0db9e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:16.717453 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0c05d11d-3cfe-48ed-9365-ab65eff0db9e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:16.718474 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0c05d11d-3cfe-48ed-9365-ab65eff0db9e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:16.719135 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0c05d11d-3cfe-48ed-9365-ab65eff0db9e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:18.192648 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0c05d11d-3cfe-48ed-9365-ab65eff0db9e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:18.207660 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0c05d11d-3cfe-48ed-9365-ab65eff0db9e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600" status: 200 len: 1512 microversion: 2.1 time: 1.515470 Aug 04 17:00:18.209188 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2321/4551] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:16 2022] GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600 => generated 1512 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:18.216554 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7cbc4109-4c8e-45ec-981d-b5b4c8296246 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:18.218483 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7cbc4109-4c8e-45ec-981d-b5b4c8296246 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] [instance: 36778df0-79fd-4d26-b488-2e6b5e4c0edd] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:18.228360 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7cbc4109-4c8e-45ec-981d-b5b4c8296246 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:18.229229 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7cbc4109-4c8e-45ec-981d-b5b4c8296246 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:18.230420 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7cbc4109-4c8e-45ec-981d-b5b4c8296246 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:18.231104 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7cbc4109-4c8e-45ec-981d-b5b4c8296246 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:18.898956 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7cbc4109-4c8e-45ec-981d-b5b4c8296246 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fd3653eee4f798d0860705a2b4030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8759879e1bec45e38e9434db6bcf85e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:18.907970 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7cbc4109-4c8e-45ec-981d-b5b4c8296246 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] 10.222.0.23 "GET /compute/v2.1/servers/36778df0-79fd-4d26-b488-2e6b5e4c0edd" status: 200 len: 1469 microversion: 2.1 time: 0.696669 Aug 04 17:00:18.926492 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2322/4552] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:18 2022] GET /compute/v2.1/servers/36778df0-79fd-4d26-b488-2e6b5e4c0edd => generated 1469 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:18.941396 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c59ed191-7e08-4f4a-83d0-79f49796d402 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:18.942080 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c59ed191-7e08-4f4a-83d0-79f49796d402 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 04a3818f-fc8b-4fab-a720-46bba72436ef] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:18.961903 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c59ed191-7e08-4f4a-83d0-79f49796d402 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:18.962839 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c59ed191-7e08-4f4a-83d0-79f49796d402 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:18.963824 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c59ed191-7e08-4f4a-83d0-79f49796d402 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:18.964280 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c59ed191-7e08-4f4a-83d0-79f49796d402 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:19.281056 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c59ed191-7e08-4f4a-83d0-79f49796d402 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:19.295409 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c59ed191-7e08-4f4a-83d0-79f49796d402 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef" status: 200 len: 1314 microversion: 2.1 time: 0.367569 Aug 04 17:00:19.297241 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2323/4553] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:18 2022] GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:19.302565 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8d8b29c8-790c-4031-b70f-e98aaf6d6aa8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:19.304146 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8d8b29c8-790c-4031-b70f-e98aaf6d6aa8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:19.315320 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8d8b29c8-790c-4031-b70f-e98aaf6d6aa8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:19.316157 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8d8b29c8-790c-4031-b70f-e98aaf6d6aa8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:19.317261 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8d8b29c8-790c-4031-b70f-e98aaf6d6aa8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:19.318212 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8d8b29c8-790c-4031-b70f-e98aaf6d6aa8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:19.921407 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8d8b29c8-790c-4031-b70f-e98aaf6d6aa8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:19.975635 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8d8b29c8-790c-4031-b70f-e98aaf6d6aa8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:19.977920 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8d8b29c8-790c-4031-b70f-e98aaf6d6aa8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:19.981895 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8d8b29c8-790c-4031-b70f-e98aaf6d6aa8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1809 microversion: 2.20 time: 0.681006 Aug 04 17:00:19.983041 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2324/4554] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:19 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1809 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:20.004790 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-03ea8a6d-05f5-4d84-a431-b04faa13e319 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:20.019401 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-03ea8a6d-05f5-4d84-a431-b04faa13e319 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 58ba4011-f974-4687-b3c0-fd8e04ce7600] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:20.068059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-03ea8a6d-05f5-4d84-a431-b04faa13e319 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:20.074437 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-03ea8a6d-05f5-4d84-a431-b04faa13e319 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:20.076332 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-03ea8a6d-05f5-4d84-a431-b04faa13e319 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:20.077126 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-03ea8a6d-05f5-4d84-a431-b04faa13e319 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:20.094573 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:20.378859 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-03ea8a6d-05f5-4d84-a431-b04faa13e319 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:20.406524 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-03ea8a6d-05f5-4d84-a431-b04faa13e319 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600" status: 200 len: 1470 microversion: 2.1 time: 0.415626 Aug 04 17:00:20.407832 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2325/4555] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:19 2022] GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600 => generated 1470 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:20.454434 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-dc582215-cf7d-44e6-9f1d-db5ad9664757 req-e01f2369-e73a-4f2f-8896-ca75771c9b38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04a3818f-fc8b-4fab-a720-46bba72436ef", "name": "network-vif-plugged", "status": "completed", "tag": "c883d5f1-4bb8-4787-8687-7fe616e52760"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:20.481230 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-dc582215-cf7d-44e6-9f1d-db5ad9664757 req-e01f2369-e73a-4f2f-8896-ca75771c9b38 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:20.482306 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-dc582215-cf7d-44e6-9f1d-db5ad9664757 req-e01f2369-e73a-4f2f-8896-ca75771c9b38 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:20.504053 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-dc582215-cf7d-44e6-9f1d-db5ad9664757 req-e01f2369-e73a-4f2f-8896-ca75771c9b38 service nova] Creating event network-vif-plugged:c883d5f1-4bb8-4787-8687-7fe616e52760 for instance 04a3818f-fc8b-4fab-a720-46bba72436ef on n-h2-846466-12 Aug 04 17:00:20.517810 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-dc582215-cf7d-44e6-9f1d-db5ad9664757 req-e01f2369-e73a-4f2f-8896-ca75771c9b38 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080529 Aug 04 17:00:20.518943 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2326/4556] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:20.537163 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d7b708c2-20f6-4e80-8c9d-22ce3b6067c0 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:20.541302 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d7b708c2-20f6-4e80-8c9d-22ce3b6067c0 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] [instance: 36778df0-79fd-4d26-b488-2e6b5e4c0edd] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:20.554930 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d7b708c2-20f6-4e80-8c9d-22ce3b6067c0 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:20.556578 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d7b708c2-20f6-4e80-8c9d-22ce3b6067c0 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:20.557718 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d7b708c2-20f6-4e80-8c9d-22ce3b6067c0 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:20.558571 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d7b708c2-20f6-4e80-8c9d-22ce3b6067c0 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:20.810496 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-100e5e7d-75a6-44e6-8ba0-f52c58166415 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.167208 Aug 04 17:00:20.811110 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2231/4557] 10.222.0.23 () {60 vars in 1170 bytes} [Thu Aug 4 17:00:14 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:20.817224 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5a5ed200-009a-4411-ada4-f68ba3efa8fd tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:20.818320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5a5ed200-009a-4411-ada4-f68ba3efa8fd tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 04a3818f-fc8b-4fab-a720-46bba72436ef] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:20.827353 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a5ed200-009a-4411-ada4-f68ba3efa8fd tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:20.830246 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a5ed200-009a-4411-ada4-f68ba3efa8fd tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:20.834654 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a5ed200-009a-4411-ada4-f68ba3efa8fd tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:20.837578 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a5ed200-009a-4411-ada4-f68ba3efa8fd tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:21.548457 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5a5ed200-009a-4411-ada4-f68ba3efa8fd tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:21.555255 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d7b708c2-20f6-4e80-8c9d-22ce3b6067c0 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fd3653eee4f798d0860705a2b4030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8759879e1bec45e38e9434db6bcf85e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:21.563887 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5a5ed200-009a-4411-ada4-f68ba3efa8fd tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef" status: 200 len: 1314 microversion: 2.1 time: 0.751033 Aug 04 17:00:21.564607 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2232/4558] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:20 2022] GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef => generated 1314 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:21.568840 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d7b708c2-20f6-4e80-8c9d-22ce3b6067c0 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] 10.222.0.23 "GET /compute/v2.1/servers/36778df0-79fd-4d26-b488-2e6b5e4c0edd" status: 200 len: 1469 microversion: 2.1 time: 1.048327 Aug 04 17:00:21.582121 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2327/4559] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:20 2022] GET /compute/v2.1/servers/36778df0-79fd-4d26-b488-2e6b5e4c0edd => generated 1469 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:21.590923 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-1c5d4b29-4e4a-4326-9f5b-831c8aea7ea0 req-2e2bda05-9144-4ed0-8c94-798f97a6f019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ba4011-f974-4687-b3c0-fd8e04ce7600", "name": "network-vif-deleted", "tag": "122d05c1-85e3-4efa-a89f-bb9d0c195075"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:21.596342 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4b51758f-d223-4503-8522-9f2230e2329c tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.135"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:21.605501 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4b51758f-d223-4503-8522-9f2230e2329c tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:21.625465 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4b51758f-d223-4503-8522-9f2230e2329c tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:21.626264 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4b51758f-d223-4503-8522-9f2230e2329c tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:21.627287 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4b51758f-d223-4503-8522-9f2230e2329c tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:21.627922 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4b51758f-d223-4503-8522-9f2230e2329c tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:21.639269 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-1c5d4b29-4e4a-4326-9f5b-831c8aea7ea0 req-2e2bda05-9144-4ed0-8c94-798f97a6f019 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:21.639983 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-1c5d4b29-4e4a-4326-9f5b-831c8aea7ea0 req-2e2bda05-9144-4ed0-8c94-798f97a6f019 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:21.681777 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4b51758f-d223-4503-8522-9f2230e2329c tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Acquired lock "refresh_cache-63185fca-5246-43fb-8d55-3ef5b7a5fcba" {{(pid=126125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 17:00:21.705326 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-1c5d4b29-4e4a-4326-9f5b-831c8aea7ea0 req-2e2bda05-9144-4ed0-8c94-798f97a6f019 service nova] Creating event network-vif-deleted:122d05c1-85e3-4efa-a89f-bb9d0c195075 for instance 58ba4011-f974-4687-b3c0-fd8e04ce7600 on n-h1-846466-12 Aug 04 17:00:21.712963 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-1c5d4b29-4e4a-4326-9f5b-831c8aea7ea0 req-2e2bda05-9144-4ed0-8c94-798f97a6f019 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146488 Aug 04 17:00:21.717987 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2233/4560] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:21.728534 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7a86fcf0-50a2-4d4a-a153-fc0e1efbba41 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:21.730220 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7a86fcf0-50a2-4d4a-a153-fc0e1efbba41 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:21.743163 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7a86fcf0-50a2-4d4a-a153-fc0e1efbba41 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:21.745715 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7a86fcf0-50a2-4d4a-a153-fc0e1efbba41 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:21.747655 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7a86fcf0-50a2-4d4a-a153-fc0e1efbba41 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:21.749151 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7a86fcf0-50a2-4d4a-a153-fc0e1efbba41 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:23.879385 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7a86fcf0-50a2-4d4a-a153-fc0e1efbba41 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:23.899704 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7a86fcf0-50a2-4d4a-a153-fc0e1efbba41 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:23.907830 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7a86fcf0-50a2-4d4a-a153-fc0e1efbba41 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:23.912989 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7a86fcf0-50a2-4d4a-a153-fc0e1efbba41 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1809 microversion: 2.20 time: 2.192859 Aug 04 17:00:23.920969 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2234/4561] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:21 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1809 bytes in 2202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:23.942043 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-aab5db87-86c7-4f0a-bad9-476a4ec4d54e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:23.943760 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-aab5db87-86c7-4f0a-bad9-476a4ec4d54e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 58ba4011-f974-4687-b3c0-fd8e04ce7600] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:23.981369 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aab5db87-86c7-4f0a-bad9-476a4ec4d54e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:23.988449 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aab5db87-86c7-4f0a-bad9-476a4ec4d54e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:23.991291 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aab5db87-86c7-4f0a-bad9-476a4ec4d54e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:23.992368 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aab5db87-86c7-4f0a-bad9-476a4ec4d54e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:24.017333 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-aab5db87-86c7-4f0a-bad9-476a4ec4d54e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] HTTP exception thrown: Instance 58ba4011-f974-4687-b3c0-fd8e04ce7600 could not be found. Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-aab5db87-86c7-4f0a-bad9-476a4ec4d54e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600 HTTP/1.1 Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 58ba4011-f974-4687-b3c0-fd8e04ce7600 could not be found. Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '58ba4011-f974-4687-b3c0-fd8e04ce7600'} Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58ba4011-f974-4687-b3c0-fd8e04ce7600 could not be found. Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58ba4011-f974-4687-b3c0-fd8e04ce7600 could not be found. Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:24.019217 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:24.025799 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:24.025799 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:24.025799 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:24.025799 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:00:24.025799 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:00:24.025799 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58ba4011-f974-4687-b3c0-fd8e04ce7600 could not be found. Aug 04 17:00:24.025799 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:24.027695 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-aab5db87-86c7-4f0a-bad9-476a4ec4d54e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 404 to user: Instance 58ba4011-f974-4687-b3c0-fd8e04ce7600 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:00:24.028959 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-aab5db87-86c7-4f0a-bad9-476a4ec4d54e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600" status: 404 len: 111 microversion: 2.1 time: 0.105696 Aug 04 17:00:24.030141 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2235/4562] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:23 2022] GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:00:24.036159 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c9861c50-752e-4ee9-a8a8-2ac9ca503f12 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:24.037083 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c9861c50-752e-4ee9-a8a8-2ac9ca503f12 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 04a3818f-fc8b-4fab-a720-46bba72436ef] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:24.053567 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9861c50-752e-4ee9-a8a8-2ac9ca503f12 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:24.054564 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9861c50-752e-4ee9-a8a8-2ac9ca503f12 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:24.055872 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9861c50-752e-4ee9-a8a8-2ac9ca503f12 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:24.056762 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9861c50-752e-4ee9-a8a8-2ac9ca503f12 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:24.728895 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c9861c50-752e-4ee9-a8a8-2ac9ca503f12 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:24.746839 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c9861c50-752e-4ee9-a8a8-2ac9ca503f12 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef" status: 200 len: 1499 microversion: 2.1 time: 0.715313 Aug 04 17:00:24.754001 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2236/4563] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:24 2022] GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef => generated 1499 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:24.764235 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0fabccc3-7ac0-4f83-9513-52b3219f33fe tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:24.770393 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0fabccc3-7ac0-4f83-9513-52b3219f33fe tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] [instance: 36778df0-79fd-4d26-b488-2e6b5e4c0edd] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:24.801928 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0fabccc3-7ac0-4f83-9513-52b3219f33fe tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:24.803245 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0fabccc3-7ac0-4f83-9513-52b3219f33fe tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:24.811037 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0fabccc3-7ac0-4f83-9513-52b3219f33fe tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:24.814034 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0fabccc3-7ac0-4f83-9513-52b3219f33fe tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:25.436369 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0fabccc3-7ac0-4f83-9513-52b3219f33fe tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fd3653eee4f798d0860705a2b4030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8759879e1bec45e38e9434db6bcf85e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:25.449946 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0fabccc3-7ac0-4f83-9513-52b3219f33fe tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] 10.222.0.23 "GET /compute/v2.1/servers/36778df0-79fd-4d26-b488-2e6b5e4c0edd" status: 200 len: 1469 microversion: 2.1 time: 0.694059 Aug 04 17:00:25.451105 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2237/4564] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:24 2022] GET /compute/v2.1/servers/36778df0-79fd-4d26-b488-2e6b5e4c0edd => generated 1469 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:25.465202 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-e6d8e285-a01e-4f1c-ac91-c2775fce04b1 req-ef067084-bb92-4051-9553-8f0db8ba536c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36778df0-79fd-4d26-b488-2e6b5e4c0edd", "name": "network-vif-plugged", "status": "completed", "tag": "d728997e-bd33-4d24-93a4-db144cfb23cf"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:25.490326 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-e6d8e285-a01e-4f1c-ac91-c2775fce04b1 req-ef067084-bb92-4051-9553-8f0db8ba536c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:25.491221 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-e6d8e285-a01e-4f1c-ac91-c2775fce04b1 req-ef067084-bb92-4051-9553-8f0db8ba536c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:25.508947 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-e6d8e285-a01e-4f1c-ac91-c2775fce04b1 req-ef067084-bb92-4051-9553-8f0db8ba536c service nova] Creating event network-vif-plugged:d728997e-bd33-4d24-93a4-db144cfb23cf for instance 36778df0-79fd-4d26-b488-2e6b5e4c0edd on n-h1-846466-12 Aug 04 17:00:25.515600 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-e6d8e285-a01e-4f1c-ac91-c2775fce04b1 req-ef067084-bb92-4051-9553-8f0db8ba536c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056755 Aug 04 17:00:25.517189 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2238/4565] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:25.525888 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-09345adc-dada-4a7b-a74a-8a39b3685d1d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:25.526876 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-09345adc-dada-4a7b-a74a-8a39b3685d1d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:25.537493 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-09345adc-dada-4a7b-a74a-8a39b3685d1d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:25.538357 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-09345adc-dada-4a7b-a74a-8a39b3685d1d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:25.544631 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-09345adc-dada-4a7b-a74a-8a39b3685d1d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:25.545495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-09345adc-dada-4a7b-a74a-8a39b3685d1d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:26.386197 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-09345adc-dada-4a7b-a74a-8a39b3685d1d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:26.407037 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-09345adc-dada-4a7b-a74a-8a39b3685d1d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.887985 Aug 04 17:00:26.407916 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2239/4566] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:25 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:26.425066 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-66185039-0598-449b-ade3-dfe5e02be43d tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:26.444912 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-66185039-0598-449b-ade3-dfe5e02be43d tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 04a3818f-fc8b-4fab-a720-46bba72436ef] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:26.471084 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-66185039-0598-449b-ade3-dfe5e02be43d tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:26.478398 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-66185039-0598-449b-ade3-dfe5e02be43d tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:26.486672 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-66185039-0598-449b-ade3-dfe5e02be43d tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:26.487487 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-66185039-0598-449b-ade3-dfe5e02be43d tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:26.616198 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-66185039-0598-449b-ade3-dfe5e02be43d tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lazy-loading 'flavor' on Instance uuid 04a3818f-fc8b-4fab-a720-46bba72436ef {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:00:26.872148 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-66185039-0598-449b-ade3-dfe5e02be43d tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "POST /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef/action" status: 200 len: 32 microversion: 2.1 time: 0.458704 Aug 04 17:00:26.874726 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2240/4567] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:00:26 2022] POST /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef/action => generated 32 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:00:26.888923 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-4b51758f-d223-4503-8522-9f2230e2329c tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Building network info cache for instance {{(pid=126125) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 17:00:26.896367 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0c761297-431a-486f-b041-77fbb9371c3d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:26.901725 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0c761297-431a-486f-b041-77fbb9371c3d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:26.920281 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c761297-431a-486f-b041-77fbb9371c3d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:26.920991 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c761297-431a-486f-b041-77fbb9371c3d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:26.925033 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c761297-431a-486f-b041-77fbb9371c3d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:26.925789 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c761297-431a-486f-b041-77fbb9371c3d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:27.691414 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0c761297-431a-486f-b041-77fbb9371c3d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:27.714963 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0c761297-431a-486f-b041-77fbb9371c3d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:27.724580 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0c761297-431a-486f-b041-77fbb9371c3d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:27.726012 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0c761297-431a-486f-b041-77fbb9371c3d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1809 microversion: 2.20 time: 0.848449 Aug 04 17:00:27.726629 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2241/4568] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:26 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1809 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:27.741726 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a4421879-975a-40d5-9521-0030319b1104 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-15252032", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "46edc9e4-68ed-4792-81df-afd06d836545", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8cd64b36-f8a8-48d4-b083-6164d20009da"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:27.974748 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-a4421879-975a-40d5-9521-0030319b1104 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] validate_networks() for [('8cd64b36-f8a8-48d4-b083-6164d20009da', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:00:29.869889 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-4b51758f-d223-4503-8522-9f2230e2329c tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Updating instance_info_cache with network_info: [{"id": "9c23e8b8-64c3-4977-b3ff-1e91ba857153", "address": "fa:16:3e:eb:00:d8", "network": {"id": "c50fd092-cfa9-46ac-9572-ccbca0bcf84d", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1503790848-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fc9ddb2693734bd5a0d3c4101a165998", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9c23e8b8-64", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126125) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 17:00:29.887745 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4b51758f-d223-4503-8522-9f2230e2329c tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Releasing lock "refresh_cache-63185fca-5246-43fb-8d55-3ef5b7a5fcba" {{(pid=126125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 17:00:29.888686 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4b51758f-d223-4503-8522-9f2230e2329c tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "POST /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba/action" status: 202 len: 0 microversion: 2.1 time: 8.305106 Aug 04 17:00:29.895592 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2328/4569] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:00:21 2022] POST /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba/action => generated 0 bytes in 8313 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 04 17:00:29.909642 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-09bc99c7-3c54-45fe-ab19-82733a5f018d tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:29.915542 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-09bc99c7-3c54-45fe-ab19-82733a5f018d tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] [instance: 36778df0-79fd-4d26-b488-2e6b5e4c0edd] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:29.930299 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:29.932174 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-09bc99c7-3c54-45fe-ab19-82733a5f018d tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:29.932624 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-09bc99c7-3c54-45fe-ab19-82733a5f018d tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:29.951468 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-09bc99c7-3c54-45fe-ab19-82733a5f018d tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:29.952183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-09bc99c7-3c54-45fe-ab19-82733a5f018d tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:30.347034 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-09bc99c7-3c54-45fe-ab19-82733a5f018d tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fd3653eee4f798d0860705a2b4030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8759879e1bec45e38e9434db6bcf85e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:30.364011 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-09bc99c7-3c54-45fe-ab19-82733a5f018d tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] 10.222.0.23 "GET /compute/v2.1/servers/36778df0-79fd-4d26-b488-2e6b5e4c0edd" status: 200 len: 1640 microversion: 2.1 time: 0.465314 Aug 04 17:00:30.366477 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2329/4570] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:29 2022] GET /compute/v2.1/servers/36778df0-79fd-4d26-b488-2e6b5e4c0edd => generated 1640 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:30.393058 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b22cc0a3-b887-4b5c-a5ed-6424cc039b0b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "9a956378-b79d-4451-b0d0-c11ff419c38c"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b22cc0a3-b887-4b5c-a5ed-6424cc039b0b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 163 Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: {"server": {"name": 12345, "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "9a956378-b79d-4451-b0d0-c11ff419c38c"}]}} Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '58d80c01-1581-4a2f-bbb0-c2eaf1affa00', 'flavorRef': '452', 'networks': [{'uuid': '9a956378-b79d-4451-b0d0-c11ff419c38c'}]}}} Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 12345 Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:00:30.410326 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:00:30.416152 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:00:30.416152 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 04 17:00:30.416152 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:30.416152 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:30.416152 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:30.416152 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:30.416152 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:30.416152 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:30.416152 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:00:30.416152 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:00:30.416152 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 04 17:00:30.416152 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:30.422974 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b22cc0a3-b887-4b5c-a5ed-6424cc039b0b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:00:30.424262 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b22cc0a3-b887-4b5c-a5ed-6424cc039b0b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.040094 Aug 04 17:00:30.427143 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2330/4571] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:00:30 2022] POST /compute/v2.1/servers => generated 127 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:00:30.444410 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9410e51d-1507-497f-9110-626623a857f3 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:30.446662 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9410e51d-1507-497f-9110-626623a857f3 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 04a3818f-fc8b-4fab-a720-46bba72436ef] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:30.486473 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9410e51d-1507-497f-9110-626623a857f3 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:30.487535 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9410e51d-1507-497f-9110-626623a857f3 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:30.491857 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9410e51d-1507-497f-9110-626623a857f3 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:30.493939 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9410e51d-1507-497f-9110-626623a857f3 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:30.675262 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-a4421879-975a-40d5-9521-0030319b1104 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:00:30.676335 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-a4421879-975a-40d5-9521-0030319b1104 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:00:30.677159 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-a4421879-975a-40d5-9521-0030319b1104 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:00:30.678539 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-a4421879-975a-40d5-9521-0030319b1104 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:00:30.679207 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-a4421879-975a-40d5-9521-0030319b1104 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:00:30.691496 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a4421879-975a-40d5-9521-0030319b1104 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:30.692230 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a4421879-975a-40d5-9521-0030319b1104 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:30.693346 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a4421879-975a-40d5-9521-0030319b1104 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:30.693945 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a4421879-975a-40d5-9521-0030319b1104 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:30.748312 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9410e51d-1507-497f-9110-626623a857f3 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:30.757065 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9410e51d-1507-497f-9110-626623a857f3 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef" status: 200 len: 1505 microversion: 2.1 time: 0.325655 Aug 04 17:00:30.759110 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2331/4572] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:30 2022] GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef => generated 1505 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:30.771084 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-a4421879-975a-40d5-9521-0030319b1104 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Getting quotas for project 78a0adb69ba24749817a8855effc20ad. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:00:30.772695 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-cbea26ca-e17c-48ec-a9bb-bb029b59cbe3 req-ad947bb7-f170-40eb-941c-ec6dc8fe4dbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63185fca-5246-43fb-8d55-3ef5b7a5fcba", "tag": "9c23e8b8-64c3-4977-b3ff-1e91ba857153"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:30.786409 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-cbea26ca-e17c-48ec-a9bb-bb029b59cbe3 req-ad947bb7-f170-40eb-941c-ec6dc8fe4dbc service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:30.787458 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-cbea26ca-e17c-48ec-a9bb-bb029b59cbe3 req-ad947bb7-f170-40eb-941c-ec6dc8fe4dbc service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:30.790781 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-a4421879-975a-40d5-9521-0030319b1104 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Getting quotas for user ea9cab1c1eff47ddb881a2b57bf240f3 and project 78a0adb69ba24749817a8855effc20ad. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:00:30.813987 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-cbea26ca-e17c-48ec-a9bb-bb029b59cbe3 req-ad947bb7-f170-40eb-941c-ec6dc8fe4dbc service nova] Creating event network-changed:9c23e8b8-64c3-4977-b3ff-1e91ba857153 for instance 63185fca-5246-43fb-8d55-3ef5b7a5fcba on n-h1-846466-12 Aug 04 17:00:30.820281 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-cbea26ca-e17c-48ec-a9bb-bb029b59cbe3 req-ad947bb7-f170-40eb-941c-ec6dc8fe4dbc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059479 Aug 04 17:00:30.824790 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2332/4573] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:30.833862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dd01d7c4-2201-4b0e-a015-f10026dff117 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:30.852238 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dd01d7c4-2201-4b0e-a015-f10026dff117 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:30.871251 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dd01d7c4-2201-4b0e-a015-f10026dff117 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:30.872578 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dd01d7c4-2201-4b0e-a015-f10026dff117 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:30.873944 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dd01d7c4-2201-4b0e-a015-f10026dff117 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:30.876115 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dd01d7c4-2201-4b0e-a015-f10026dff117 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:30.937466 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a4421879-975a-40d5-9521-0030319b1104 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:00:30.939816 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a4421879-975a-40d5-9521-0030319b1104 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 55db3692-c233-452b-860a-81bc8875c6be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='46edc9e4-68ed-4792-81df-afd06d836545',volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:00:31.156194 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a4421879-975a-40d5-9521-0030319b1104 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.424534 Aug 04 17:00:31.162768 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2242/4574] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:00:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3426 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:00:31.162768 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fe55d3fe-439a-4930-b94a-43205afbeb36 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.135"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:31.348031 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dd01d7c4-2201-4b0e-a015-f10026dff117 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:31.365486 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dd01d7c4-2201-4b0e-a015-f10026dff117 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:31.367074 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dd01d7c4-2201-4b0e-a015-f10026dff117 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:31.368594 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dd01d7c4-2201-4b0e-a015-f10026dff117 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1809 microversion: 2.20 time: 0.542176 Aug 04 17:00:31.369317 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2333/4575] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:30 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1809 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:31.378369 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6310caaa-dfe5-4eb0-9796-f7379e153488 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:31.383728 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6310caaa-dfe5-4eb0-9796-f7379e153488 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] [instance: 36778df0-79fd-4d26-b488-2e6b5e4c0edd] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:31.390918 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6310caaa-dfe5-4eb0-9796-f7379e153488 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:31.391492 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6310caaa-dfe5-4eb0-9796-f7379e153488 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:31.392623 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6310caaa-dfe5-4eb0-9796-f7379e153488 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:31.393228 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6310caaa-dfe5-4eb0-9796-f7379e153488 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:31.673133 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fe55d3fe-439a-4930-b94a-43205afbeb36 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:31.684011 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fe55d3fe-439a-4930-b94a-43205afbeb36 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:31.684011 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fe55d3fe-439a-4930-b94a-43205afbeb36 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:31.684011 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fe55d3fe-439a-4930-b94a-43205afbeb36 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:31.684011 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fe55d3fe-439a-4930-b94a-43205afbeb36 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:31.848299 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6310caaa-dfe5-4eb0-9796-f7379e153488 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fd3653eee4f798d0860705a2b4030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8759879e1bec45e38e9434db6bcf85e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:31.859069 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6310caaa-dfe5-4eb0-9796-f7379e153488 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] 10.222.0.23 "GET /compute/v2.1/servers/36778df0-79fd-4d26-b488-2e6b5e4c0edd" status: 200 len: 1640 microversion: 2.1 time: 0.484593 Aug 04 17:00:31.879836 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2334/4576] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:31 2022] GET /compute/v2.1/servers/36778df0-79fd-4d26-b488-2e6b5e4c0edd => generated 1640 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:31.886606 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-97b15b06-6b36-4db2-9a69-5866a7994a3c tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:31.887509 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-97b15b06-6b36-4db2-9a69-5866a7994a3c tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:31.895603 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-97b15b06-6b36-4db2-9a69-5866a7994a3c tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:31.896399 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-97b15b06-6b36-4db2-9a69-5866a7994a3c tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:31.897600 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-97b15b06-6b36-4db2-9a69-5866a7994a3c tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:31.898257 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-97b15b06-6b36-4db2-9a69-5866a7994a3c tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:32.263185 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fe55d3fe-439a-4930-b94a-43205afbeb36 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Acquired lock "refresh_cache-63185fca-5246-43fb-8d55-3ef5b7a5fcba" {{(pid=126126) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 17:00:32.363051 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-97b15b06-6b36-4db2-9a69-5866a7994a3c tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:32.371405 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-97b15b06-6b36-4db2-9a69-5866a7994a3c tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.490319 Aug 04 17:00:32.372001 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2335/4577] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:31 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:32.377637 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bd59cdbd-7ffb-4688-9bc6-9fcd8dfc78a7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:32.378213 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bd59cdbd-7ffb-4688-9bc6-9fcd8dfc78a7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 55db3692-c233-452b-860a-81bc8875c6be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:32.395609 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bd59cdbd-7ffb-4688-9bc6-9fcd8dfc78a7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:32.396165 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bd59cdbd-7ffb-4688-9bc6-9fcd8dfc78a7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:32.396840 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bd59cdbd-7ffb-4688-9bc6-9fcd8dfc78a7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:32.397271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bd59cdbd-7ffb-4688-9bc6-9fcd8dfc78a7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:32.520457 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bd59cdbd-7ffb-4688-9bc6-9fcd8dfc78a7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:32.528776 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bd59cdbd-7ffb-4688-9bc6-9fcd8dfc78a7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be" status: 200 len: 1153 microversion: 2.1 time: 0.155504 Aug 04 17:00:32.529395 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2336/4578] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:32 2022] GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be => generated 1153 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:32.538429 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f0c451bc-5b60-4bf6-9271-793da6b5f272 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:32.539568 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f0c451bc-5b60-4bf6-9271-793da6b5f272 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 04a3818f-fc8b-4fab-a720-46bba72436ef] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:32.546512 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f0c451bc-5b60-4bf6-9271-793da6b5f272 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:32.547219 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f0c451bc-5b60-4bf6-9271-793da6b5f272 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:32.548180 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f0c451bc-5b60-4bf6-9271-793da6b5f272 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:32.548784 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f0c451bc-5b60-4bf6-9271-793da6b5f272 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:33.474011 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f0c451bc-5b60-4bf6-9271-793da6b5f272 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:33.482432 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f0c451bc-5b60-4bf6-9271-793da6b5f272 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef" status: 200 len: 1505 microversion: 2.1 time: 0.947706 Aug 04 17:00:33.483330 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2337/4579] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:32 2022] GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef => generated 1505 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:33.488208 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e6337b14-0c98-4e7d-804e-156da9a94fd2 tempest-TestSecurityGroupsBasicOps-1387780031 tempest-TestSecurityGroupsBasicOps-1387780031-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:33.489020 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e6337b14-0c98-4e7d-804e-156da9a94fd2 tempest-TestSecurityGroupsBasicOps-1387780031 tempest-TestSecurityGroupsBasicOps-1387780031-project-admin] [instance: 36778df0-79fd-4d26-b488-2e6b5e4c0edd] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:33.496256 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e6337b14-0c98-4e7d-804e-156da9a94fd2 tempest-TestSecurityGroupsBasicOps-1387780031 tempest-TestSecurityGroupsBasicOps-1387780031-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:33.497015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e6337b14-0c98-4e7d-804e-156da9a94fd2 tempest-TestSecurityGroupsBasicOps-1387780031 tempest-TestSecurityGroupsBasicOps-1387780031-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:33.498067 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e6337b14-0c98-4e7d-804e-156da9a94fd2 tempest-TestSecurityGroupsBasicOps-1387780031 tempest-TestSecurityGroupsBasicOps-1387780031-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:33.498501 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e6337b14-0c98-4e7d-804e-156da9a94fd2 tempest-TestSecurityGroupsBasicOps-1387780031 tempest-TestSecurityGroupsBasicOps-1387780031-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:34.437758 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e6337b14-0c98-4e7d-804e-156da9a94fd2 tempest-TestSecurityGroupsBasicOps-1387780031 tempest-TestSecurityGroupsBasicOps-1387780031-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/36778df0-79fd-4d26-b488-2e6b5e4c0edd" status: 200 len: 1793 microversion: 2.1 time: 0.952910 Aug 04 17:00:34.438509 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2338/4580] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:33 2022] GET /compute/v2.1/servers/36778df0-79fd-4d26-b488-2e6b5e4c0edd => generated 1793 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:34.445443 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bc675acf-5e83-42ee-ad62-6e736546625f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:34.447001 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bc675acf-5e83-42ee-ad62-6e736546625f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:34.454371 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bc675acf-5e83-42ee-ad62-6e736546625f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:34.455515 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bc675acf-5e83-42ee-ad62-6e736546625f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:34.456171 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bc675acf-5e83-42ee-ad62-6e736546625f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:34.456817 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bc675acf-5e83-42ee-ad62-6e736546625f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:34.613196 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-fe55d3fe-439a-4930-b94a-43205afbeb36 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Building network info cache for instance {{(pid=126126) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 17:00:34.906866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bc675acf-5e83-42ee-ad62-6e736546625f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:34.928634 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bc675acf-5e83-42ee-ad62-6e736546625f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:34.931347 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bc675acf-5e83-42ee-ad62-6e736546625f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:34.932879 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bc675acf-5e83-42ee-ad62-6e736546625f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1809 microversion: 2.20 time: 0.491890 Aug 04 17:00:34.935757 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2339/4581] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:34 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1809 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:34.943718 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1a7e990d-f172-459c-867f-7d389f9130fe tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:34.954543 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1a7e990d-f172-459c-867f-7d389f9130fe tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:34.963152 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1a7e990d-f172-459c-867f-7d389f9130fe tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:34.964147 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1a7e990d-f172-459c-867f-7d389f9130fe tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:34.965618 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1a7e990d-f172-459c-867f-7d389f9130fe tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:34.966317 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1a7e990d-f172-459c-867f-7d389f9130fe tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:35.839324 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1a7e990d-f172-459c-867f-7d389f9130fe tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:35.853077 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1a7e990d-f172-459c-867f-7d389f9130fe tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.912509 Aug 04 17:00:35.868212 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2340/4582] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:34 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:35.868212 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0c47716f-91e1-40b2-b639-93b508d2b038 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:35.868212 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0c47716f-91e1-40b2-b639-93b508d2b038 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 55db3692-c233-452b-860a-81bc8875c6be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:35.882217 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0c47716f-91e1-40b2-b639-93b508d2b038 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:35.883044 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0c47716f-91e1-40b2-b639-93b508d2b038 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:35.890230 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0c47716f-91e1-40b2-b639-93b508d2b038 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:35.892851 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0c47716f-91e1-40b2-b639-93b508d2b038 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:36.306226 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0c47716f-91e1-40b2-b639-93b508d2b038 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:36.340177 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0c47716f-91e1-40b2-b639-93b508d2b038 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be" status: 200 len: 1213 microversion: 2.1 time: 0.484070 Aug 04 17:00:36.341530 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2341/4583] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:35 2022] GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be => generated 1213 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:36.353872 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-66745b9d-d2a7-42e5-a7bf-666a3cdeffb1 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:36.354821 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-66745b9d-d2a7-42e5-a7bf-666a3cdeffb1 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 04a3818f-fc8b-4fab-a720-46bba72436ef] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:36.371414 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-66745b9d-d2a7-42e5-a7bf-666a3cdeffb1 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:36.373713 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-66745b9d-d2a7-42e5-a7bf-666a3cdeffb1 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:36.374728 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-66745b9d-d2a7-42e5-a7bf-666a3cdeffb1 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:36.391693 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-66745b9d-d2a7-42e5-a7bf-666a3cdeffb1 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:36.823191 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-66745b9d-d2a7-42e5-a7bf-666a3cdeffb1 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:36.843645 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-66745b9d-d2a7-42e5-a7bf-666a3cdeffb1 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef" status: 200 len: 1505 microversion: 2.1 time: 0.498775 Aug 04 17:00:36.871312 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2342/4584] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:36 2022] GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef => generated 1505 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:36.877315 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-b584cc51-a063-426e-945d-665a2a51ecbd req-a6579641-b3eb-4fbd-bb28-d6be2060a5da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63185fca-5246-43fb-8d55-3ef5b7a5fcba", "tag": "9c23e8b8-64c3-4977-b3ff-1e91ba857153"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:36.883897 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-fe55d3fe-439a-4930-b94a-43205afbeb36 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Updating instance_info_cache with network_info: [{"id": "9c23e8b8-64c3-4977-b3ff-1e91ba857153", "address": "fa:16:3e:eb:00:d8", "network": {"id": "c50fd092-cfa9-46ac-9572-ccbca0bcf84d", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1503790848-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fc9ddb2693734bd5a0d3c4101a165998", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9c23e8b8-64", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126126) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 17:00:36.890363 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-b584cc51-a063-426e-945d-665a2a51ecbd req-a6579641-b3eb-4fbd-bb28-d6be2060a5da service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:36.890962 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-b584cc51-a063-426e-945d-665a2a51ecbd req-a6579641-b3eb-4fbd-bb28-d6be2060a5da service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:36.897072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:36.910505 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-b584cc51-a063-426e-945d-665a2a51ecbd req-a6579641-b3eb-4fbd-bb28-d6be2060a5da service nova] Creating event network-changed:9c23e8b8-64c3-4977-b3ff-1e91ba857153 for instance 63185fca-5246-43fb-8d55-3ef5b7a5fcba on n-h1-846466-12 Aug 04 17:00:36.921651 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-b584cc51-a063-426e-945d-665a2a51ecbd req-a6579641-b3eb-4fbd-bb28-d6be2060a5da service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048439 Aug 04 17:00:36.922278 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2343/4585] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:36.926628 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fe55d3fe-439a-4930-b94a-43205afbeb36 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Releasing lock "refresh_cache-63185fca-5246-43fb-8d55-3ef5b7a5fcba" {{(pid=126126) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 17:00:36.927946 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fe55d3fe-439a-4930-b94a-43205afbeb36 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "POST /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba/action" status: 202 len: 0 microversion: 2.1 time: 5.769547 Aug 04 17:00:36.932283 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2243/4586] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:00:31 2022] POST /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba/action => generated 0 bytes in 5774 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 04 17:00:36.940303 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-00b2791e-694a-41ea-aeda-92d1c106d4bb tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Calling method '.version_select at 0x7f7e847edd30>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:36.942899 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2d94a7ff-68b3-45df-adb3-e81297805981 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:36.943619 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2d94a7ff-68b3-45df-adb3-e81297805981 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:36.955322 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d94a7ff-68b3-45df-adb3-e81297805981 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:36.955795 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d94a7ff-68b3-45df-adb3-e81297805981 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:36.956760 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d94a7ff-68b3-45df-adb3-e81297805981 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:36.957204 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d94a7ff-68b3-45df-adb3-e81297805981 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:37.567765 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2d94a7ff-68b3-45df-adb3-e81297805981 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:37.586461 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2d94a7ff-68b3-45df-adb3-e81297805981 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:37.590622 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2d94a7ff-68b3-45df-adb3-e81297805981 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:37.605511 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2d94a7ff-68b3-45df-adb3-e81297805981 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1809 microversion: 2.20 time: 0.681549 Aug 04 17:00:37.611079 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2344/4587] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:36 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1809 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:37.628181 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bab0ca37-85c7-485c-ad98-161fce37acec tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:37.632103 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bab0ca37-85c7-485c-ad98-161fce37acec tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 55db3692-c233-452b-860a-81bc8875c6be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:37.653931 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bab0ca37-85c7-485c-ad98-161fce37acec tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:37.657055 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bab0ca37-85c7-485c-ad98-161fce37acec tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:37.658121 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bab0ca37-85c7-485c-ad98-161fce37acec tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:37.661310 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bab0ca37-85c7-485c-ad98-161fce37acec tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:38.432595 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bab0ca37-85c7-485c-ad98-161fce37acec tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:38.460931 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bab0ca37-85c7-485c-ad98-161fce37acec tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be" status: 200 len: 1213 microversion: 2.1 time: 0.848151 Aug 04 17:00:38.463150 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2345/4588] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:37 2022] GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be => generated 1213 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:38.471087 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-00df405e-d598-4f7a-b3b3-71407379d97c req-03a48814-c145-4d6d-b26f-2d4f325f34e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36778df0-79fd-4d26-b488-2e6b5e4c0edd", "tag": "d728997e-bd33-4d24-93a4-db144cfb23cf"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:38.485587 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-00df405e-d598-4f7a-b3b3-71407379d97c req-03a48814-c145-4d6d-b26f-2d4f325f34e2 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:38.486450 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-00df405e-d598-4f7a-b3b3-71407379d97c req-03a48814-c145-4d6d-b26f-2d4f325f34e2 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:38.502089 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-00df405e-d598-4f7a-b3b3-71407379d97c req-03a48814-c145-4d6d-b26f-2d4f325f34e2 service nova] Creating event network-changed:d728997e-bd33-4d24-93a4-db144cfb23cf for instance 36778df0-79fd-4d26-b488-2e6b5e4c0edd on n-h1-846466-12 Aug 04 17:00:38.508301 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-00df405e-d598-4f7a-b3b3-71407379d97c req-03a48814-c145-4d6d-b26f-2d4f325f34e2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043459 Aug 04 17:00:38.511000 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2346/4589] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:38.518000 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6893233f-2992-47a4-8f65-7c934b5e52a8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:38.520750 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6893233f-2992-47a4-8f65-7c934b5e52a8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 04a3818f-fc8b-4fab-a720-46bba72436ef] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:38.531938 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6893233f-2992-47a4-8f65-7c934b5e52a8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:38.533687 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6893233f-2992-47a4-8f65-7c934b5e52a8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:38.535361 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6893233f-2992-47a4-8f65-7c934b5e52a8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:38.535994 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6893233f-2992-47a4-8f65-7c934b5e52a8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:39.869964 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6893233f-2992-47a4-8f65-7c934b5e52a8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:39.881630 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6893233f-2992-47a4-8f65-7c934b5e52a8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef" status: 200 len: 1505 microversion: 2.1 time: 1.368735 Aug 04 17:00:39.882287 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2347/4590] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:38 2022] GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef => generated 1505 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:39.888862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5efff147-ffce-4acb-9a77-ecfb08c36068 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:39.889729 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5efff147-ffce-4acb-9a77-ecfb08c36068 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:39.897971 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5efff147-ffce-4acb-9a77-ecfb08c36068 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:39.898852 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5efff147-ffce-4acb-9a77-ecfb08c36068 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:39.899813 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5efff147-ffce-4acb-9a77-ecfb08c36068 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:39.900432 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5efff147-ffce-4acb-9a77-ecfb08c36068 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:40.248072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5efff147-ffce-4acb-9a77-ecfb08c36068 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:40.267877 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5efff147-ffce-4acb-9a77-ecfb08c36068 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:40.271440 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5efff147-ffce-4acb-9a77-ecfb08c36068 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:40.274694 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5efff147-ffce-4acb-9a77-ecfb08c36068 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1809 microversion: 2.20 time: 0.390766 Aug 04 17:00:40.275265 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2348/4591] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:39 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1809 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:40.281521 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e3f67e81-6755-46b8-8113-ac81826b62e0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-988577151", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "a1094e50-bde5-4ef2-bcac-abbdd676cd41", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "9a956378-b79d-4451-b0d0-c11ff419c38c"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:40.361442 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-e3f67e81-6755-46b8-8113-ac81826b62e0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] HTTP exception thrown: Block Device a1094e50-bde5-4ef2-bcac-abbdd676cd41 is not bootable. Aug 04 17:00:40.365969 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-00b2791e-694a-41ea-aeda-92d1c106d4bb tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/c8693d3a-ceed-488b-a1f1-de9c373eb270" status: 202 len: 0 microversion: 2.1 time: 3.429538 Aug 04 17:00:40.369782 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2244/4592] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Aug 4 17:00:36 2022] DELETE /compute/v2.1/os-floating-ips/c8693d3a-ceed-488b-a1f1-de9c373eb270 => generated 0 bytes in 3431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e3f67e81-6755-46b8-8113-ac81826b62e0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 357 Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-988577151", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "a1094e50-bde5-4ef2-bcac-abbdd676cd41", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "9a956378-b79d-4451-b0d0-c11ff419c38c"}]}} Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: exception: Block Device a1094e50-bde5-4ef2-bcac-abbdd676cd41 is not bootable. Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-988577151', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'a1094e50-bde5-4ef2-bcac-abbdd676cd41'}], 'networks': [{'uuid': '9a956378-b79d-4451-b0d0-c11ff419c38c'}]}}} Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1624, in _create_instance Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device a1094e50-bde5-4ef2-bcac-abbdd676cd41 is not bootable. Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:00:40.373723 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:00:40.378878 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:00:40.378878 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:00:40.378878 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:00:40.378878 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 17:00:40.378878 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 04 17:00:40.378878 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 04 17:00:40.378878 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device a1094e50-bde5-4ef2-bcac-abbdd676cd41 is not bootable. Aug 04 17:00:40.378878 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:40.378878 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:40.378878 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:40.378878 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:40.378878 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:40.378878 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:40.378878 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:00:40.378878 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:00:40.378878 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device a1094e50-bde5-4ef2-bcac-abbdd676cd41 is not bootable. Aug 04 17:00:40.378878 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:40.378878 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e3f67e81-6755-46b8-8113-ac81826b62e0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 400 to user: Block Device a1094e50-bde5-4ef2-bcac-abbdd676cd41 is not bootable. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:00:40.378878 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e3f67e81-6755-46b8-8113-ac81826b62e0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.098925 Aug 04 17:00:40.380611 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-0b63b986-d118-4bb6-b580-76f9e182399e req-7b6b8d54-b8f8-43ea-8f63-b4823e7ed0c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55db3692-c233-452b-860a-81bc8875c6be", "tag": "d26fb384-4a3d-4bd0-8166-5c3a407f0693"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:40.383217 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2349/4593] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:00:40 2022] POST /compute/v2.1/servers => generated 110 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:00:40.389084 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-de3cfdf3-4f87-4a70-a531-2309de6f1d7e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:40.390873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-de3cfdf3-4f87-4a70-a531-2309de6f1d7e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 55db3692-c233-452b-860a-81bc8875c6be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:40.393449 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:40.397142 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-0b63b986-d118-4bb6-b580-76f9e182399e req-7b6b8d54-b8f8-43ea-8f63-b4823e7ed0c5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:40.397706 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-0b63b986-d118-4bb6-b580-76f9e182399e req-7b6b8d54-b8f8-43ea-8f63-b4823e7ed0c5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:40.399481 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-de3cfdf3-4f87-4a70-a531-2309de6f1d7e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:40.399943 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-de3cfdf3-4f87-4a70-a531-2309de6f1d7e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:40.400961 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-de3cfdf3-4f87-4a70-a531-2309de6f1d7e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:40.401496 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-de3cfdf3-4f87-4a70-a531-2309de6f1d7e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:40.415485 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-0b63b986-d118-4bb6-b580-76f9e182399e req-7b6b8d54-b8f8-43ea-8f63-b4823e7ed0c5 service nova] Creating event network-changed:d26fb384-4a3d-4bd0-8166-5c3a407f0693 for instance 55db3692-c233-452b-860a-81bc8875c6be on n-h1-846466-12 Aug 04 17:00:40.422807 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-0b63b986-d118-4bb6-b580-76f9e182399e req-7b6b8d54-b8f8-43ea-8f63-b4823e7ed0c5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054300 Aug 04 17:00:40.423899 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2245/4594] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:40.447729 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-97368a92-15ae-4872-86cb-c91d2c129d07 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Calling method '.version_select at 0x7f7e77f385e0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:40.704749 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:40.777390 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-de3cfdf3-4f87-4a70-a531-2309de6f1d7e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:40.789807 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-de3cfdf3-4f87-4a70-a531-2309de6f1d7e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be" status: 200 len: 1213 microversion: 2.1 time: 0.404768 Aug 04 17:00:40.790988 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2350/4595] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:40 2022] GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be => generated 1213 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:40.797647 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a404d49e-eeb7-4752-a59e-57d834c00a33 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:40.798479 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a404d49e-eeb7-4752-a59e-57d834c00a33 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:40.806594 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:40.806891 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a404d49e-eeb7-4752-a59e-57d834c00a33 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:40.807282 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a404d49e-eeb7-4752-a59e-57d834c00a33 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:40.808960 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a404d49e-eeb7-4752-a59e-57d834c00a33 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:40.809778 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a404d49e-eeb7-4752-a59e-57d834c00a33 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:41.087552 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-97368a92-15ae-4872-86cb-c91d2c129d07 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/7be38272-75f5-43c9-904e-05f37165c1b5" status: 202 len: 0 microversion: 2.1 time: 0.661119 Aug 04 17:00:41.088368 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2246/4596] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 17:00:40 2022] DELETE /compute/v2.1/os-security-groups/7be38272-75f5-43c9-904e-05f37165c1b5 => generated 0 bytes in 664 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:00:41.094359 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3dfbff43-c1aa-4797-9250-0ab75b99d77c tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:41.095299 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3dfbff43-c1aa-4797-9250-0ab75b99d77c tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 04a3818f-fc8b-4fab-a720-46bba72436ef] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:41.103146 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3dfbff43-c1aa-4797-9250-0ab75b99d77c tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:41.103757 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3dfbff43-c1aa-4797-9250-0ab75b99d77c tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:41.104683 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3dfbff43-c1aa-4797-9250-0ab75b99d77c tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:41.105561 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3dfbff43-c1aa-4797-9250-0ab75b99d77c tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:41.192810 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a404d49e-eeb7-4752-a59e-57d834c00a33 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:41.203300 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a404d49e-eeb7-4752-a59e-57d834c00a33 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.410529 Aug 04 17:00:41.204009 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2351/4597] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:40 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:41.209195 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b603398e-e910-4e84-8ac8-d20f43867f2b tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:41.210105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b603398e-e910-4e84-8ac8-d20f43867f2b tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:41.217578 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b603398e-e910-4e84-8ac8-d20f43867f2b tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:41.218289 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b603398e-e910-4e84-8ac8-d20f43867f2b tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:41.219362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b603398e-e910-4e84-8ac8-d20f43867f2b tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:41.219807 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b603398e-e910-4e84-8ac8-d20f43867f2b tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:41.250453 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b603398e-e910-4e84-8ac8-d20f43867f2b tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:00:41.336139 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3dfbff43-c1aa-4797-9250-0ab75b99d77c tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:41.348199 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3dfbff43-c1aa-4797-9250-0ab75b99d77c tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef" status: 200 len: 1505 microversion: 2.1 time: 0.258474 Aug 04 17:00:41.349081 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2247/4598] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:41 2022] GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef => generated 1505 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:41.364987 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b603398e-e910-4e84-8ac8-d20f43867f2b tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "DELETE /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba" status: 204 len: 0 microversion: 2.1 time: 0.144174 Aug 04 17:00:41.364987 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2352/4599] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:00:41 2022] DELETE /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:00:41.364987 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1c87d6db-0b67-48d2-b797-ee34d1486b82 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:41.364987 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1c87d6db-0b67-48d2-b797-ee34d1486b82 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:41.364987 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1c87d6db-0b67-48d2-b797-ee34d1486b82 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:41.365899 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1c87d6db-0b67-48d2-b797-ee34d1486b82 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:41.366051 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1c87d6db-0b67-48d2-b797-ee34d1486b82 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:41.367026 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1c87d6db-0b67-48d2-b797-ee34d1486b82 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:41.372934 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2bafae12-42f5-4c56-9151-33b63e7d6c88 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:41.373773 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2bafae12-42f5-4c56-9151-33b63e7d6c88 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:41.381231 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2bafae12-42f5-4c56-9151-33b63e7d6c88 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:41.381864 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2bafae12-42f5-4c56-9151-33b63e7d6c88 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:41.382921 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2bafae12-42f5-4c56-9151-33b63e7d6c88 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:41.383430 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2bafae12-42f5-4c56-9151-33b63e7d6c88 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:41.695827 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1c87d6db-0b67-48d2-b797-ee34d1486b82 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:41.706115 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1c87d6db-0b67-48d2-b797-ee34d1486b82 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.354052 Aug 04 17:00:41.706752 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2353/4600] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:41 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:41.714662 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1cc653e7-b379-4b19-b55f-b8d236adb1be tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:41.716187 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1cc653e7-b379-4b19-b55f-b8d236adb1be tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:41.727350 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1cc653e7-b379-4b19-b55f-b8d236adb1be tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:41.728144 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1cc653e7-b379-4b19-b55f-b8d236adb1be tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:41.729793 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1cc653e7-b379-4b19-b55f-b8d236adb1be tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:41.730577 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1cc653e7-b379-4b19-b55f-b8d236adb1be tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:41.735031 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2bafae12-42f5-4c56-9151-33b63e7d6c88 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:41.747580 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:41.759430 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2bafae12-42f5-4c56-9151-33b63e7d6c88 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:41.763076 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2bafae12-42f5-4c56-9151-33b63e7d6c88 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:41.765345 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2bafae12-42f5-4c56-9151-33b63e7d6c88 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1809 microversion: 2.20 time: 0.396533 Aug 04 17:00:41.766396 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2248/4601] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:41 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1809 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:41.775785 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5879c51e-fba9-4882-a0ed-839a58f9c904 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:41.777077 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5879c51e-fba9-4882-a0ed-839a58f9c904 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 0063f3a7-735d-438e-a375-3b2a83bef991] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:41.791013 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5879c51e-fba9-4882-a0ed-839a58f9c904 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:41.791783 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5879c51e-fba9-4882-a0ed-839a58f9c904 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:41.793179 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5879c51e-fba9-4882-a0ed-839a58f9c904 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:41.793987 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5879c51e-fba9-4882-a0ed-839a58f9c904 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:41.840599 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5879c51e-fba9-4882-a0ed-839a58f9c904 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991/ips" status: 200 len: 147 microversion: 2.1 time: 0.071927 Aug 04 17:00:41.841801 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2249/4602] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Aug 4 17:00:41 2022] GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991/ips => generated 147 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:41.854926 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-908ec971-3cfc-4dc1-af6f-fbddf967526c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:41.855922 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-908ec971-3cfc-4dc1-af6f-fbddf967526c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 55db3692-c233-452b-860a-81bc8875c6be] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:41.872026 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-908ec971-3cfc-4dc1-af6f-fbddf967526c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:41.872607 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-908ec971-3cfc-4dc1-af6f-fbddf967526c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:41.873903 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-908ec971-3cfc-4dc1-af6f-fbddf967526c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:41.874414 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-908ec971-3cfc-4dc1-af6f-fbddf967526c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:41.913352 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1cc653e7-b379-4b19-b55f-b8d236adb1be tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e7c523e9d94d2994ebe9b2d3b86b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9ddb2693734bd5a0d3c4101a165998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:41.925678 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1cc653e7-b379-4b19-b55f-b8d236adb1be tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba" status: 200 len: 1510 microversion: 2.1 time: 0.217125 Aug 04 17:00:41.926449 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2354/4603] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:41 2022] GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba => generated 1510 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:42.068431 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-908ec971-3cfc-4dc1-af6f-fbddf967526c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:42.090834 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-908ec971-3cfc-4dc1-af6f-fbddf967526c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be" status: 200 len: 1201 microversion: 2.1 time: 0.246825 Aug 04 17:00:42.092239 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2250/4604] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:41 2022] GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be => generated 1201 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:42.377119 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3ef12f32-a8f9-4351-a653-e467b46e5ee1 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:42.378603 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3ef12f32-a8f9-4351-a653-e467b46e5ee1 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 04a3818f-fc8b-4fab-a720-46bba72436ef] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:42.387164 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3ef12f32-a8f9-4351-a653-e467b46e5ee1 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:42.387612 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3ef12f32-a8f9-4351-a653-e467b46e5ee1 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:42.389204 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3ef12f32-a8f9-4351-a653-e467b46e5ee1 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:42.390222 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3ef12f32-a8f9-4351-a653-e467b46e5ee1 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:42.558930 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3ef12f32-a8f9-4351-a653-e467b46e5ee1 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:42.569135 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3ef12f32-a8f9-4351-a653-e467b46e5ee1 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef" status: 200 len: 1505 microversion: 2.1 time: 0.197041 Aug 04 17:00:42.570199 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2355/4605] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:42 2022] GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef => generated 1505 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:42.790615 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f64e4876-8f33-4df0-9db5-4909761f0731 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:42.792414 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f64e4876-8f33-4df0-9db5-4909761f0731 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:42.800434 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f64e4876-8f33-4df0-9db5-4909761f0731 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:42.801174 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f64e4876-8f33-4df0-9db5-4909761f0731 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:42.802794 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f64e4876-8f33-4df0-9db5-4909761f0731 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:42.803389 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f64e4876-8f33-4df0-9db5-4909761f0731 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:42.948453 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-08028a44-ba2d-4999-a820-ba9f5a81dc06 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:42.949953 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-08028a44-ba2d-4999-a820-ba9f5a81dc06 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:42.961329 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-08028a44-ba2d-4999-a820-ba9f5a81dc06 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:42.961961 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-08028a44-ba2d-4999-a820-ba9f5a81dc06 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:42.962848 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-08028a44-ba2d-4999-a820-ba9f5a81dc06 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:42.963660 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-08028a44-ba2d-4999-a820-ba9f5a81dc06 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:42.997247 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f64e4876-8f33-4df0-9db5-4909761f0731 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:43.012086 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f64e4876-8f33-4df0-9db5-4909761f0731 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:43.013798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f64e4876-8f33-4df0-9db5-4909761f0731 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:43.016120 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f64e4876-8f33-4df0-9db5-4909761f0731 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1809 microversion: 2.20 time: 0.230340 Aug 04 17:00:43.033443 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2251/4606] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:42 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1809 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:43.116717 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-edc121b9-d45e-480d-af13-cb8b71bfb08e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:43.118045 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-edc121b9-d45e-480d-af13-cb8b71bfb08e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 55db3692-c233-452b-860a-81bc8875c6be] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:43.126758 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-edc121b9-d45e-480d-af13-cb8b71bfb08e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:43.127211 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-edc121b9-d45e-480d-af13-cb8b71bfb08e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:43.127998 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-edc121b9-d45e-480d-af13-cb8b71bfb08e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:43.128731 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-edc121b9-d45e-480d-af13-cb8b71bfb08e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:43.165953 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-08028a44-ba2d-4999-a820-ba9f5a81dc06 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e7c523e9d94d2994ebe9b2d3b86b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9ddb2693734bd5a0d3c4101a165998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:43.193849 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-08028a44-ba2d-4999-a820-ba9f5a81dc06 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba" status: 200 len: 1510 microversion: 2.1 time: 0.249420 Aug 04 17:00:43.210329 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2356/4607] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:42 2022] GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba => generated 1510 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:00:43.325060 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6810fb45-f99c-40d5-b71d-9530f39b04ce tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-271486731", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "destination_type": "local"}, {"source_type": "volume", "uuid": "f85f1f8f-8a7d-44e8-9885-1c89862afd33", "destination_type": "invalid"}], "networks": [{"uuid": "9a956378-b79d-4451-b0d0-c11ff419c38c"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6810fb45-f99c-40d5-b71d-9530f39b04ce tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 494 Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-271486731", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "destination_type": "local"}, {"source_type": "volume", "uuid": "f85f1f8f-8a7d-44e8-9885-1c89862afd33", "destination_type": "invalid"}], "networks": [{"uuid": "9a956378-b79d-4451-b0d0-c11ff419c38c"}]}} Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-271486731', 'imageRef': '58d80c01-1581-4a2f-bbb0-c2eaf1affa00', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '58d80c01-1581-4a2f-bbb0-c2eaf1affa00', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'f85f1f8f-8a7d-44e8-9885-1c89862afd33', 'destination_type': 'invalid'}], 'networks': [{'uuid': '9a956378-b79d-4451-b0d0-c11ff419c38c'}]}}} Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi 'invalid' Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:00:43.333254 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:00:43.337505 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:00:43.337505 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:00:43.337505 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:00:43.337505 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:00:43.337505 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:00:43.337505 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:00:43.337505 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:00:43.337505 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:00:43.337505 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 04 17:00:43.337505 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:43.337505 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:43.337505 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:43.337505 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:43.337505 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:43.337505 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:43.337505 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:00:43.337505 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:00:43.337505 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 04 17:00:43.337505 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:43.337505 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6810fb45-f99c-40d5-b71d-9530f39b04ce tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:00:43.337505 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6810fb45-f99c-40d5-b71d-9530f39b04ce tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.014539 Aug 04 17:00:43.337505 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2357/4608] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:00:43 2022] POST /compute/v2.1/servers => generated 155 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 17:00:43.344525 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ad0c3c4a-7b6a-4078-ac5f-b84622ee6160 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:43.345142 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ad0c3c4a-7b6a-4078-ac5f-b84622ee6160 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:43.353842 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad0c3c4a-7b6a-4078-ac5f-b84622ee6160 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:43.354479 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad0c3c4a-7b6a-4078-ac5f-b84622ee6160 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:43.355461 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad0c3c4a-7b6a-4078-ac5f-b84622ee6160 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:43.356009 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad0c3c4a-7b6a-4078-ac5f-b84622ee6160 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:43.359227 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-edc121b9-d45e-480d-af13-cb8b71bfb08e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:43.369025 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-edc121b9-d45e-480d-af13-cb8b71bfb08e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be" status: 200 len: 1201 microversion: 2.1 time: 0.258043 Aug 04 17:00:43.369846 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2252/4609] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:43 2022] GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be => generated 1201 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:43.505098 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ad0c3c4a-7b6a-4078-ac5f-b84622ee6160 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:43.513751 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ad0c3c4a-7b6a-4078-ac5f-b84622ee6160 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.172973 Aug 04 17:00:43.514352 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2358/4610] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:43 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:43.536122 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cb859f0b-f882-4046-8482-a40115ddef04 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:43.536742 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cb859f0b-f882-4046-8482-a40115ddef04 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:43.543537 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cb859f0b-f882-4046-8482-a40115ddef04 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:43.544272 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cb859f0b-f882-4046-8482-a40115ddef04 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:43.545516 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cb859f0b-f882-4046-8482-a40115ddef04 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:43.546244 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cb859f0b-f882-4046-8482-a40115ddef04 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:43.591489 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f6588628-8245-4703-87db-dd7e18e4b885 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:43.592114 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f6588628-8245-4703-87db-dd7e18e4b885 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 04a3818f-fc8b-4fab-a720-46bba72436ef] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:43.598728 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f6588628-8245-4703-87db-dd7e18e4b885 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:43.599183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f6588628-8245-4703-87db-dd7e18e4b885 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:43.599961 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f6588628-8245-4703-87db-dd7e18e4b885 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:43.600398 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f6588628-8245-4703-87db-dd7e18e4b885 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:43.813957 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cb859f0b-f882-4046-8482-a40115ddef04 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:43.822237 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cb859f0b-f882-4046-8482-a40115ddef04 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.290510 Aug 04 17:00:43.822868 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2253/4611] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:43 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:43.874681 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f6588628-8245-4703-87db-dd7e18e4b885 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:43.887748 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f6588628-8245-4703-87db-dd7e18e4b885 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef" status: 200 len: 1505 microversion: 2.1 time: 0.300143 Aug 04 17:00:43.888511 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2359/4612] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:43 2022] GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef => generated 1505 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:00:43.889462 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ecd1119f-00e7-49a0-8e9b-e1a28d54b00d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1687312820", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "9a956378-b79d-4451-b0d0-c11ff419c38c"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ecd1119f-00e7-49a0-8e9b-e1a28d54b00d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 492 Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1687312820", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "9a956378-b79d-4451-b0d0-c11ff419c38c"}]}} Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1687312820', 'imageRef': '58d80c01-1581-4a2f-bbb0-c2eaf1affa00', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '9a956378-b79d-4451-b0d0-c11ff419c38c'}]}}} Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:43.893869 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 04 17:00:43.897590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 04 17:00:43.897590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:43.897590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:43.897590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:43.897590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:43.897590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:43.897590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:43.897590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:00:43.897590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:00:43.897590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:00:43.897590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:00:43.897590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:00:43.897590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:00:43.897590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:00:43.897590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:00:43.897590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:00:43.897590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:00:43.897590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:00:43.897590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:00:43.897590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 04 17:00:43.897590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:43.897590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:43.897590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:43.897590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:43.897590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:43.897590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:43.897590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:00:43.897590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:00:43.897590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 04 17:00:43.897590 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:43.901172 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ecd1119f-00e7-49a0-8e9b-e1a28d54b00d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:00:43.902744 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ecd1119f-00e7-49a0-8e9b-e1a28d54b00d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.020506 Aug 04 17:00:43.903678 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2254/4613] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:00:43 2022] POST /compute/v2.1/servers => generated 624 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:00:43.912567 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1d992b9c-2d97-42b6-9c5b-e086d7981e76 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:43.913189 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1d992b9c-2d97-42b6-9c5b-e086d7981e76 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:43.920307 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1d992b9c-2d97-42b6-9c5b-e086d7981e76 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:43.920760 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1d992b9c-2d97-42b6-9c5b-e086d7981e76 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:43.921568 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1d992b9c-2d97-42b6-9c5b-e086d7981e76 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:43.922008 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1d992b9c-2d97-42b6-9c5b-e086d7981e76 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:44.044530 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-56bd9b80-28f1-4d2c-93a6-427edefd4616 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:44.045598 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-56bd9b80-28f1-4d2c-93a6-427edefd4616 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:44.054638 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-56bd9b80-28f1-4d2c-93a6-427edefd4616 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:44.055293 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-56bd9b80-28f1-4d2c-93a6-427edefd4616 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:44.056205 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-56bd9b80-28f1-4d2c-93a6-427edefd4616 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:44.056647 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-56bd9b80-28f1-4d2c-93a6-427edefd4616 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:44.223642 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1d992b9c-2d97-42b6-9c5b-e086d7981e76 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:44.233041 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1d992b9c-2d97-42b6-9c5b-e086d7981e76 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.324373 Aug 04 17:00:44.233689 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2360/4614] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:43 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:44.239054 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-466f1ae9-9241-43aa-a6fe-86925976f5f4 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:44.240732 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-466f1ae9-9241-43aa-a6fe-86925976f5f4 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:44.250942 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-466f1ae9-9241-43aa-a6fe-86925976f5f4 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:44.251890 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-466f1ae9-9241-43aa-a6fe-86925976f5f4 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:44.252510 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-466f1ae9-9241-43aa-a6fe-86925976f5f4 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:44.253680 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-466f1ae9-9241-43aa-a6fe-86925976f5f4 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:44.277667 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:44.623679 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-56bd9b80-28f1-4d2c-93a6-427edefd4616 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:44.644306 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-56bd9b80-28f1-4d2c-93a6-427edefd4616 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:44.646876 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-56bd9b80-28f1-4d2c-93a6-427edefd4616 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:44.648990 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-56bd9b80-28f1-4d2c-93a6-427edefd4616 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1809 microversion: 2.20 time: 0.610981 Aug 04 17:00:44.650098 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2255/4615] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:44 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1809 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:44.656063 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6aedc5c1-a22b-4d81-bee2-51d324972511 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:44.656653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6aedc5c1-a22b-4d81-bee2-51d324972511 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:44.665006 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6aedc5c1-a22b-4d81-bee2-51d324972511 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:44.666043 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6aedc5c1-a22b-4d81-bee2-51d324972511 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:44.667010 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6aedc5c1-a22b-4d81-bee2-51d324972511 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:44.667616 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6aedc5c1-a22b-4d81-bee2-51d324972511 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:44.764450 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-466f1ae9-9241-43aa-a6fe-86925976f5f4 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e7c523e9d94d2994ebe9b2d3b86b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9ddb2693734bd5a0d3c4101a165998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:44.775301 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-466f1ae9-9241-43aa-a6fe-86925976f5f4 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba" status: 200 len: 1510 microversion: 2.1 time: 0.540143 Aug 04 17:00:44.776283 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2361/4616] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:44 2022] GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba => generated 1510 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:44.783299 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-210a101a-a64d-4d6d-a05b-f57aa9c3aa34 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:44.784771 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-210a101a-a64d-4d6d-a05b-f57aa9c3aa34 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 55db3692-c233-452b-860a-81bc8875c6be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:44.793946 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-210a101a-a64d-4d6d-a05b-f57aa9c3aa34 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:44.795483 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-210a101a-a64d-4d6d-a05b-f57aa9c3aa34 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:44.796543 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-210a101a-a64d-4d6d-a05b-f57aa9c3aa34 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:44.798095 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-210a101a-a64d-4d6d-a05b-f57aa9c3aa34 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:44.947919 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6aedc5c1-a22b-4d81-bee2-51d324972511 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:44.956761 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6aedc5c1-a22b-4d81-bee2-51d324972511 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.305307 Aug 04 17:00:44.957649 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2256/4617] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:44 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:44.963305 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2cbf4b7f-2b2d-4239-a8b9-84520a9d2b69 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15e5216f-321c-4ac4-870f-a5ee1d655ddf"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:44.965998 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2cbf4b7f-2b2d-4239-a8b9-84520a9d2b69 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 0063f3a7-735d-438e-a375-3b2a83bef991] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:44.972751 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2cbf4b7f-2b2d-4239-a8b9-84520a9d2b69 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:44.973474 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2cbf4b7f-2b2d-4239-a8b9-84520a9d2b69 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:44.974343 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2cbf4b7f-2b2d-4239-a8b9-84520a9d2b69 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:44.974817 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2cbf4b7f-2b2d-4239-a8b9-84520a9d2b69 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:45.038505 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-210a101a-a64d-4d6d-a05b-f57aa9c3aa34 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:45.047653 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-210a101a-a64d-4d6d-a05b-f57aa9c3aa34 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be" status: 200 len: 1201 microversion: 2.1 time: 0.270148 Aug 04 17:00:45.048505 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2362/4618] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:44 2022] GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be => generated 1201 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:45.068755 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-62f9f741-a745-491b-bf40-c8bb12923f98 req-e25465e5-c422-419c-b92e-50650bc87689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdec5afc-3a3a-4d61-a934-5edf0c7c1397", "name": "network-vif-plugged", "status": "completed", "tag": "0762f466-ea31-44a7-9ac5-75aaf39b80a6"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:45.083789 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-62f9f741-a745-491b-bf40-c8bb12923f98 req-e25465e5-c422-419c-b92e-50650bc87689 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:45.084299 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-62f9f741-a745-491b-bf40-c8bb12923f98 req-e25465e5-c422-419c-b92e-50650bc87689 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:45.100526 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-62f9f741-a745-491b-bf40-c8bb12923f98 req-e25465e5-c422-419c-b92e-50650bc87689 service nova] Creating event network-vif-plugged:0762f466-ea31-44a7-9ac5-75aaf39b80a6 for instance fdec5afc-3a3a-4d61-a934-5edf0c7c1397 on n-h2-846466-12 Aug 04 17:00:45.106266 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-62f9f741-a745-491b-bf40-c8bb12923f98 req-e25465e5-c422-419c-b92e-50650bc87689 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043069 Aug 04 17:00:45.109725 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2363/4619] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:45.116322 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b1390e4b-b2ba-45c3-8f8b-56648a054d70 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:45.117135 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b1390e4b-b2ba-45c3-8f8b-56648a054d70 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 04a3818f-fc8b-4fab-a720-46bba72436ef] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:45.125715 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b1390e4b-b2ba-45c3-8f8b-56648a054d70 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:45.132629 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b1390e4b-b2ba-45c3-8f8b-56648a054d70 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:45.139046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b1390e4b-b2ba-45c3-8f8b-56648a054d70 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:45.139510 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b1390e4b-b2ba-45c3-8f8b-56648a054d70 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:45.332564 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2cbf4b7f-2b2d-4239-a8b9-84520a9d2b69 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "POST /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.372429 Aug 04 17:00:45.333424 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2257/4620] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Aug 4 17:00:44 2022] POST /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991/os-volume_attachments => generated 194 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:45.354077 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8273ff14-1190-4f12-ab0a-ce96deed0b2e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "9a956378-b79d-4451-b0d0-c11ff419c38c"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8273ff14-1190-4f12-ab0a-ce96deed0b2e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 416 Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "9a956378-b79d-4451-b0d0-c11ff419c38c"}]}} Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '58d80c01-1581-4a2f-bbb0-c2eaf1affa00', 'flavorRef': '452', 'networks': [{'uuid': '9a956378-b79d-4451-b0d0-c11ff419c38c'}]}}} Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:45.366462 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:45.374814 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:45.374814 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:45.374814 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:45.374814 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:45.374814 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:00:45.374814 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:00:45.374814 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:00:45.374814 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:00:45.374814 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:00:45.374814 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:00:45.374814 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:00:45.374814 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:00:45.374814 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:00:45.374814 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:00:45.374814 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:00:45.374814 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:00:45.374814 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 17:00:45.374814 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:45.374814 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:45.374814 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:45.374814 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:45.374814 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:45.374814 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:45.374814 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:00:45.374814 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:00:45.374814 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 17:00:45.374814 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:45.374814 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8273ff14-1190-4f12-ab0a-ce96deed0b2e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:00:45.374814 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8273ff14-1190-4f12-ab0a-ce96deed0b2e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.036468 Aug 04 17:00:45.383744 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2258/4621] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:00:45 2022] POST /compute/v2.1/servers => generated 619 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:00:45.395897 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b1390e4b-b2ba-45c3-8f8b-56648a054d70 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:45.400854 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-9995ce8b-073c-469c-acf3-bd3be4baded0 req-6e94e472-3e43-477e-a099-15ae23433f5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63185fca-5246-43fb-8d55-3ef5b7a5fcba", "name": "network-vif-deleted", "tag": "9c23e8b8-64c3-4977-b3ff-1e91ba857153"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:45.407425 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b1390e4b-b2ba-45c3-8f8b-56648a054d70 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef" status: 200 len: 1505 microversion: 2.1 time: 0.296300 Aug 04 17:00:45.408743 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2364/4622] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:45 2022] GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef => generated 1505 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:45.415069 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ee49c131-c121-4dd5-ae1d-b32319bcd952 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:45.416059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ee49c131-c121-4dd5-ae1d-b32319bcd952 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:45.423988 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ee49c131-c121-4dd5-ae1d-b32319bcd952 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:45.424824 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ee49c131-c121-4dd5-ae1d-b32319bcd952 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:45.426074 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ee49c131-c121-4dd5-ae1d-b32319bcd952 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:45.426974 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-9995ce8b-073c-469c-acf3-bd3be4baded0 req-6e94e472-3e43-477e-a099-15ae23433f5b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:45.427430 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-9995ce8b-073c-469c-acf3-bd3be4baded0 req-6e94e472-3e43-477e-a099-15ae23433f5b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:45.428835 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ee49c131-c121-4dd5-ae1d-b32319bcd952 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:45.453115 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-9995ce8b-073c-469c-acf3-bd3be4baded0 req-6e94e472-3e43-477e-a099-15ae23433f5b service nova] Creating event network-vif-deleted:9c23e8b8-64c3-4977-b3ff-1e91ba857153 for instance 63185fca-5246-43fb-8d55-3ef5b7a5fcba on n-h1-846466-12 Aug 04 17:00:45.462335 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-9995ce8b-073c-469c-acf3-bd3be4baded0 req-6e94e472-3e43-477e-a099-15ae23433f5b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068112 Aug 04 17:00:45.463090 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2259/4623] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:45.581599 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ee49c131-c121-4dd5-ae1d-b32319bcd952 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:45.590698 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ee49c131-c121-4dd5-ae1d-b32319bcd952 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.180508 Aug 04 17:00:45.591295 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2365/4624] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:45 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:45.613250 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2f601f71-1225-4436-8305-cc993f009d1b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:45.613963 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2f601f71-1225-4436-8305-cc993f009d1b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:45.622028 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f601f71-1225-4436-8305-cc993f009d1b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:45.622509 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f601f71-1225-4436-8305-cc993f009d1b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:45.623354 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f601f71-1225-4436-8305-cc993f009d1b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:45.623788 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f601f71-1225-4436-8305-cc993f009d1b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:45.675458 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-21bdef8c-9594-4f03-ac90-e11848792b16 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:45.676516 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-21bdef8c-9594-4f03-ac90-e11848792b16 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:45.687562 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-21bdef8c-9594-4f03-ac90-e11848792b16 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:45.688451 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-21bdef8c-9594-4f03-ac90-e11848792b16 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:45.689309 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-21bdef8c-9594-4f03-ac90-e11848792b16 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:45.689932 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-21bdef8c-9594-4f03-ac90-e11848792b16 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:45.936077 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2f601f71-1225-4436-8305-cc993f009d1b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:45.947840 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-21bdef8c-9594-4f03-ac90-e11848792b16 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:45.952013 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2f601f71-1225-4436-8305-cc993f009d1b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.336182 Aug 04 17:00:45.957514 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2260/4625] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:45 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:45.959035 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2a1b0f30-68b7-4981-a757-3ba07d473fb2 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:45.959651 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2a1b0f30-68b7-4981-a757-3ba07d473fb2 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] [instance: 63185fca-5246-43fb-8d55-3ef5b7a5fcba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:45.967461 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a1b0f30-68b7-4981-a757-3ba07d473fb2 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:45.968083 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a1b0f30-68b7-4981-a757-3ba07d473fb2 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:45.969131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a1b0f30-68b7-4981-a757-3ba07d473fb2 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:45.969726 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a1b0f30-68b7-4981-a757-3ba07d473fb2 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:45.970061 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-21bdef8c-9594-4f03-ac90-e11848792b16 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:45.974483 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-21bdef8c-9594-4f03-ac90-e11848792b16 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:45.976984 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-21bdef8c-9594-4f03-ac90-e11848792b16 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1809 microversion: 2.20 time: 0.305516 Aug 04 17:00:45.990568 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-2a1b0f30-68b7-4981-a757-3ba07d473fb2 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] HTTP exception thrown: Instance 63185fca-5246-43fb-8d55-3ef5b7a5fcba could not be found. Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2a1b0f30-68b7-4981-a757-3ba07d473fb2 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Request method failure captured: Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba HTTP/1.1 Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_reouhKh-Rkl8YGYZYqnbcPO5D2W_Iwg6oQYuI-DIKU7rUsc9wlNJJUlZ36H8YFPjoGDYAL1rLUFUoPyvS2pjzdxfJFym4W9QCnm1rjPqCvhG3n_Mvv7s1STt_4VBf-bWDRNmV8YowD18SxeLO7c5KatEJp0YfXF_E2zLo58NMGczI Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: fc9ddb2693734bd5a0d3c4101a165998 Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1294146237 Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc9ddb2693734bd5a0d3c4101a165998"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fc9ddb2693734bd5a0d3c4101a165998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc9ddb2693734bd5a0d3c4101a165998"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fc9ddb2693734bd5a0d3c4101a165998"}]}] Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1294146237 Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: fc9ddb2693734bd5a0d3c4101a165998 Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1294146237 Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServerRescueTestJSONUnderV235-1294146237-project Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: c8e7c523e9d94d2994ebe9b2d3b86b41 Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1294146237-project Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 63185fca-5246-43fb-8d55-3ef5b7a5fcba could not be found. Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '63185fca-5246-43fb-8d55-3ef5b7a5fcba'} Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63185fca-5246-43fb-8d55-3ef5b7a5fcba could not be found. Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63185fca-5246-43fb-8d55-3ef5b7a5fcba could not be found. Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:45.992907 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:45.998306 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:45.998306 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:45.998306 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:45.998306 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:45.998306 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:00:45.998306 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:00:45.998306 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63185fca-5246-43fb-8d55-3ef5b7a5fcba could not be found. Aug 04 17:00:45.998306 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:45.998306 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2a1b0f30-68b7-4981-a757-3ba07d473fb2 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] Returning 404 to user: Instance 63185fca-5246-43fb-8d55-3ef5b7a5fcba could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:00:45.999040 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2366/4626] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:45 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1809 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:00:45.999601 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2a1b0f30-68b7-4981-a757-3ba07d473fb2 tempest-ServerRescueTestJSONUnderV235-1294146237 tempest-ServerRescueTestJSONUnderV235-1294146237-project] 10.222.0.23 "GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba" status: 404 len: 111 microversion: 2.1 time: 0.044592 Aug 04 17:00:46.000277 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2261/4627] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:45 2022] GET /compute/v2.1/servers/63185fca-5246-43fb-8d55-3ef5b7a5fcba => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:00:46.025533 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4e4ae8b3-5c8d-421c-9eac-7b6cdc68197c tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-430881130", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": -1, "networks": [{"uuid": "9a956378-b79d-4451-b0d0-c11ff419c38c"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:46.041046 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-4e4ae8b3-5c8d-421c-9eac-7b6cdc68197c tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] HTTP exception thrown: Flavor -1 could not be found. Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4e4ae8b3-5c8d-421c-9eac-7b6cdc68197c tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 205 Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-430881130", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": -1, "networks": [{"uuid": "9a956378-b79d-4451-b0d0-c11ff419c38c"}]}} Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: exception: Flavor -1 could not be found. Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-430881130', 'imageRef': '58d80c01-1581-4a2f-bbb0-c2eaf1affa00', 'flavorRef': -1, 'networks': [{'uuid': '9a956378-b79d-4451-b0d0-c11ff419c38c'}]}}} Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:00:46.043841 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:00:46.048516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:00:46.048516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:00:46.048516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:00:46.048516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:00:46.048516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 17:00:46.048516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 04 17:00:46.048516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 04 17:00:46.048516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 04 17:00:46.048516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:46.048516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:46.048516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:46.048516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:46.048516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:46.048516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:46.048516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:00:46.048516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:00:46.048516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 04 17:00:46.048516 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:46.050301 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4e4ae8b3-5c8d-421c-9eac-7b6cdc68197c tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:00:46.051515 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4e4ae8b3-5c8d-421c-9eac-7b6cdc68197c tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.030656 Aug 04 17:00:46.053322 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2367/4628] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:00:46 2022] POST /compute/v2.1/servers => generated 73 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 17:00:46.062792 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-39dc959a-21c1-4adb-bcfb-5299ed55a848 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:46.062792 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-39dc959a-21c1-4adb-bcfb-5299ed55a848 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:46.068613 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0ef7139d-58d2-4246-8ce5-66d9c1e0713a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:46.069236 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0ef7139d-58d2-4246-8ce5-66d9c1e0713a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 55db3692-c233-452b-860a-81bc8875c6be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:46.069825 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39dc959a-21c1-4adb-bcfb-5299ed55a848 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:46.070615 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39dc959a-21c1-4adb-bcfb-5299ed55a848 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:46.071779 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39dc959a-21c1-4adb-bcfb-5299ed55a848 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:46.072331 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39dc959a-21c1-4adb-bcfb-5299ed55a848 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:46.082744 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ef7139d-58d2-4246-8ce5-66d9c1e0713a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:46.083558 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ef7139d-58d2-4246-8ce5-66d9c1e0713a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:46.084665 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ef7139d-58d2-4246-8ce5-66d9c1e0713a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:46.085109 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ef7139d-58d2-4246-8ce5-66d9c1e0713a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:46.406942 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-39dc959a-21c1-4adb-bcfb-5299ed55a848 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:46.416779 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0ef7139d-58d2-4246-8ce5-66d9c1e0713a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:46.417660 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-39dc959a-21c1-4adb-bcfb-5299ed55a848 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.359649 Aug 04 17:00:46.418683 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2262/4629] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:46 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:46.428134 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0ef7139d-58d2-4246-8ce5-66d9c1e0713a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be" status: 200 len: 1201 microversion: 2.1 time: 0.363652 Aug 04 17:00:46.439559 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d525fcd3-a901-4f34-9853-86152f7007b1 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:46.439559 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d525fcd3-a901-4f34-9853-86152f7007b1 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 04a3818f-fc8b-4fab-a720-46bba72436ef] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:46.442380 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2368/4630] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:46 2022] GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be => generated 1201 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:46.447751 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d525fcd3-a901-4f34-9853-86152f7007b1 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:46.448787 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d525fcd3-a901-4f34-9853-86152f7007b1 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:46.450348 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d525fcd3-a901-4f34-9853-86152f7007b1 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:46.451037 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d525fcd3-a901-4f34-9853-86152f7007b1 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:46.460175 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cd77f56b-ae29-46a5-8f42-84639a1a02ed tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:46.463022 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cd77f56b-ae29-46a5-8f42-84639a1a02ed tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:46.473050 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cd77f56b-ae29-46a5-8f42-84639a1a02ed tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:46.474338 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cd77f56b-ae29-46a5-8f42-84639a1a02ed tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:46.475395 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cd77f56b-ae29-46a5-8f42-84639a1a02ed tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:46.476020 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cd77f56b-ae29-46a5-8f42-84639a1a02ed tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:46.880857 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cd77f56b-ae29-46a5-8f42-84639a1a02ed tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:46.895094 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cd77f56b-ae29-46a5-8f42-84639a1a02ed tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.449808 Aug 04 17:00:46.896141 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2369/4631] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:46 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:46.931794 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d525fcd3-a901-4f34-9853-86152f7007b1 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:46.961715 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d525fcd3-a901-4f34-9853-86152f7007b1 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef" status: 200 len: 1505 microversion: 2.1 time: 0.531829 Aug 04 17:00:46.963706 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2263/4632] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:46 2022] GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef => generated 1505 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:47.000898 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0db2a162-e7fe-4461-9c2f-9523ce95aee3 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-180540847", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "9a956378-b79d-4451-b0d0-c11ff419c38c"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0db2a162-e7fe-4461-9c2f-9523ce95aee3 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 172 Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-180540847", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "9a956378-b79d-4451-b0d0-c11ff419c38c"}]}} Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-180540847', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '9a956378-b79d-4451-b0d0-c11ff419c38c'}]}}} Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi -1 Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:00:47.006941 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:00:47.012520 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:00:47.012520 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:00:47.012520 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 04 17:00:47.012520 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:47.012520 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:47.012520 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:47.012520 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:47.012520 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:47.012520 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:47.012520 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:00:47.012520 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:00:47.012520 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 04 17:00:47.012520 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:47.024797 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f713f97d-f852-4a9a-976b-92703313ff9f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:47.025627 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f713f97d-f852-4a9a-976b-92703313ff9f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:47.030079 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0db2a162-e7fe-4461-9c2f-9523ce95aee3 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:00:47.031368 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0db2a162-e7fe-4461-9c2f-9523ce95aee3 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.035722 Aug 04 17:00:47.034208 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2370/4633] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:00:46 2022] POST /compute/v2.1/servers => generated 145 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:00:47.041122 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f713f97d-f852-4a9a-976b-92703313ff9f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:47.041688 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f713f97d-f852-4a9a-976b-92703313ff9f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:47.042766 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f713f97d-f852-4a9a-976b-92703313ff9f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:47.043318 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f713f97d-f852-4a9a-976b-92703313ff9f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:47.043621 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d835cbde-7223-4b84-a7b8-06791eda097f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:47.044165 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d835cbde-7223-4b84-a7b8-06791eda097f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:47.066706 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d835cbde-7223-4b84-a7b8-06791eda097f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:47.067167 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d835cbde-7223-4b84-a7b8-06791eda097f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:47.069658 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d835cbde-7223-4b84-a7b8-06791eda097f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:47.070500 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d835cbde-7223-4b84-a7b8-06791eda097f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:47.636365 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d835cbde-7223-4b84-a7b8-06791eda097f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:47.642204 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f713f97d-f852-4a9a-976b-92703313ff9f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:47.646145 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d835cbde-7223-4b84-a7b8-06791eda097f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.607134 Aug 04 17:00:47.647487 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2371/4634] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:47 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:47.655464 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f713f97d-f852-4a9a-976b-92703313ff9f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:47.655697 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-16d2ddf6-bcfe-435e-b13b-268f89eb0cb9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:47.656494 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-16d2ddf6-bcfe-435e-b13b-268f89eb0cb9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 55db3692-c233-452b-860a-81bc8875c6be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:47.657669 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f713f97d-f852-4a9a-976b-92703313ff9f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:47.658961 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f713f97d-f852-4a9a-976b-92703313ff9f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1809 microversion: 2.20 time: 0.639413 Aug 04 17:00:47.660152 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2264/4635] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:47 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1809 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:47.666489 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-16d2ddf6-bcfe-435e-b13b-268f89eb0cb9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:47.667371 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-16d2ddf6-bcfe-435e-b13b-268f89eb0cb9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:47.668512 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-16d2ddf6-bcfe-435e-b13b-268f89eb0cb9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:47.670345 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-16d2ddf6-bcfe-435e-b13b-268f89eb0cb9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:47.676729 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0bcb29aa-1eb3-4701-a9a2-38fae0b4f219 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:47.677575 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0bcb29aa-1eb3-4701-a9a2-38fae0b4f219 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:47.689930 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0bcb29aa-1eb3-4701-a9a2-38fae0b4f219 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:47.691264 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0bcb29aa-1eb3-4701-a9a2-38fae0b4f219 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:47.692795 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0bcb29aa-1eb3-4701-a9a2-38fae0b4f219 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:47.693475 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0bcb29aa-1eb3-4701-a9a2-38fae0b4f219 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:47.984462 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-16d2ddf6-bcfe-435e-b13b-268f89eb0cb9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:47.993507 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-16d2ddf6-bcfe-435e-b13b-268f89eb0cb9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be" status: 200 len: 1201 microversion: 2.1 time: 0.342340 Aug 04 17:00:47.995235 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2372/4636] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:47 2022] GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be => generated 1201 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:48.005907 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a56e0879-8025-411b-87fc-392b40eab9ec tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:48.008655 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a56e0879-8025-411b-87fc-392b40eab9ec tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 04a3818f-fc8b-4fab-a720-46bba72436ef] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:48.016482 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a56e0879-8025-411b-87fc-392b40eab9ec tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:48.017151 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a56e0879-8025-411b-87fc-392b40eab9ec tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:48.017318 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0bcb29aa-1eb3-4701-a9a2-38fae0b4f219 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:48.018653 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a56e0879-8025-411b-87fc-392b40eab9ec tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:48.019257 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a56e0879-8025-411b-87fc-392b40eab9ec tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:48.028654 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0bcb29aa-1eb3-4701-a9a2-38fae0b4f219 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.357094 Aug 04 17:00:48.029476 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2265/4637] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:47 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:00:48.106246 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-82ac4ab2-dbcf-4d61-9c6b-e3e212bac376 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-620985973", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:48.111920 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-82ac4ab2-dbcf-4d61-9c6b-e3e212bac376 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-82ac4ab2-dbcf-4d61-9c6b-e3e212bac376 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 215 Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-620985973", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-620985973', 'imageRef': '58d80c01-1581-4a2f-bbb0-c2eaf1affa00', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:48.113980 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:48.120127 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:48.120127 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:48.120127 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:48.120127 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:00:48.120127 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:00:48.120127 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 04 17:00:48.120127 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:48.120127 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-82ac4ab2-dbcf-4d61-9c6b-e3e212bac376 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:00:48.120127 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-82ac4ab2-dbcf-4d61-9c6b-e3e212bac376 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.014363 Aug 04 17:00:48.124475 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2266/4638] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:00:48 2022] POST /compute/v2.1/servers => generated 123 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:00:48.129652 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7ccbbf6e-06e3-4dcb-8f55-4e514cad1093 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:48.130429 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7ccbbf6e-06e3-4dcb-8f55-4e514cad1093 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:48.140146 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7ccbbf6e-06e3-4dcb-8f55-4e514cad1093 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:48.140917 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7ccbbf6e-06e3-4dcb-8f55-4e514cad1093 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:48.141782 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7ccbbf6e-06e3-4dcb-8f55-4e514cad1093 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:48.142218 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7ccbbf6e-06e3-4dcb-8f55-4e514cad1093 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:48.347061 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a56e0879-8025-411b-87fc-392b40eab9ec tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:48.357782 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a56e0879-8025-411b-87fc-392b40eab9ec tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef" status: 200 len: 1505 microversion: 2.1 time: 0.361098 Aug 04 17:00:48.358818 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2373/4639] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:47 2022] GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef => generated 1505 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:48.424468 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7ccbbf6e-06e3-4dcb-8f55-4e514cad1093 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:48.433548 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7ccbbf6e-06e3-4dcb-8f55-4e514cad1093 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.307795 Aug 04 17:00:48.434265 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2267/4640] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:48 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:48.456699 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-09b3aa70-42f3-4beb-973f-6e522f4cc604 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:48.457511 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-09b3aa70-42f3-4beb-973f-6e522f4cc604 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:48.465169 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-09b3aa70-42f3-4beb-973f-6e522f4cc604 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:48.465756 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-09b3aa70-42f3-4beb-973f-6e522f4cc604 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:48.466630 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-09b3aa70-42f3-4beb-973f-6e522f4cc604 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:48.467142 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-09b3aa70-42f3-4beb-973f-6e522f4cc604 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:48.683270 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b9680592-9992-4907-bbf1-095a05b3a7a1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:48.684240 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b9680592-9992-4907-bbf1-095a05b3a7a1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:48.690891 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b9680592-9992-4907-bbf1-095a05b3a7a1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:48.691450 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b9680592-9992-4907-bbf1-095a05b3a7a1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:48.692473 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b9680592-9992-4907-bbf1-095a05b3a7a1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:48.692983 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b9680592-9992-4907-bbf1-095a05b3a7a1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:48.705182 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-09b3aa70-42f3-4beb-973f-6e522f4cc604 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:48.716554 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-09b3aa70-42f3-4beb-973f-6e522f4cc604 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.264494 Aug 04 17:00:48.733438 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2374/4641] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:48 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:48.796956 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0c517425-5947-46eb-8d05-0af41a586cde tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-838154662", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "key_name": "tempest-key-196417446", "networks": [{"uuid": "9a956378-b79d-4451-b0d0-c11ff419c38c"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:48.860775 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-0c517425-5947-46eb-8d05-0af41a586cde tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] validate_networks() for [('9a956378-b79d-4451-b0d0-c11ff419c38c', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:00:48.978307 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b9680592-9992-4907-bbf1-095a05b3a7a1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:48.983055 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:48.992351 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b9680592-9992-4907-bbf1-095a05b3a7a1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:48.994696 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b9680592-9992-4907-bbf1-095a05b3a7a1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:48.995948 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b9680592-9992-4907-bbf1-095a05b3a7a1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1796 microversion: 2.20 time: 0.317084 Aug 04 17:00:49.007507 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2268/4642] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:48 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1796 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:00:49.017135 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f61adf3f-e6bc-4c9e-ab67-a40800c989b5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:49.017903 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f61adf3f-e6bc-4c9e-ab67-a40800c989b5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 55db3692-c233-452b-860a-81bc8875c6be] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:49.027276 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f61adf3f-e6bc-4c9e-ab67-a40800c989b5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:49.027706 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f61adf3f-e6bc-4c9e-ab67-a40800c989b5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:49.028480 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f61adf3f-e6bc-4c9e-ab67-a40800c989b5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:49.028905 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f61adf3f-e6bc-4c9e-ab67-a40800c989b5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:49.246501 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-0c517425-5947-46eb-8d05-0af41a586cde tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] HTTP exception thrown: Invalid key_name provided. Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0c517425-5947-46eb-8d05-0af41a586cde tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 245 Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-838154662", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "key_name": "tempest-key-196417446", "networks": [{"uuid": "9a956378-b79d-4451-b0d0-c11ff419c38c"}]}} Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: exception: Invalid key_name provided. Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-838154662', 'imageRef': '58d80c01-1581-4a2f-bbb0-c2eaf1affa00', 'flavorRef': '452', 'key_name': 'tempest-key-196417446', 'networks': [{'uuid': '9a956378-b79d-4451-b0d0-c11ff419c38c'}]}}} Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1077, in _validate_and_build_base_options Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-196417446 not found for user c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:49.248593 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:49.253338 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:49.253338 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:00:49.253338 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:00:49.253338 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:00:49.253338 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:00:49.253338 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:00:49.253338 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:00:49.253338 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:00:49.253338 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:00:49.253338 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:00:49.253338 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:00:49.253338 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 17:00:49.253338 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 04 17:00:49.253338 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 04 17:00:49.253338 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 04 17:00:49.253338 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:49.253338 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:49.253338 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:49.253338 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:49.253338 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:49.253338 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:49.253338 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:00:49.253338 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:00:49.253338 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 04 17:00:49.253338 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:49.258441 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0c517425-5947-46eb-8d05-0af41a586cde tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 400 to user: Invalid key_name provided. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:00:49.261796 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0c517425-5947-46eb-8d05-0af41a586cde tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.467180 Aug 04 17:00:49.263609 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2375/4643] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:00:48 2022] POST /compute/v2.1/servers => generated 70 bytes in 473 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 17:00:49.275706 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f3f39cdd-4563-4468-a72f-d0eaa8d4ea95 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:49.282438 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f3f39cdd-4563-4468-a72f-d0eaa8d4ea95 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:49.285784 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f61adf3f-e6bc-4c9e-ab67-a40800c989b5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:49.294782 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f61adf3f-e6bc-4c9e-ab67-a40800c989b5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be" status: 200 len: 1201 microversion: 2.1 time: 0.281661 Aug 04 17:00:49.295878 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2269/4644] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:49 2022] GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be => generated 1201 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:49.311289 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3f39cdd-4563-4468-a72f-d0eaa8d4ea95 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:49.312078 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3f39cdd-4563-4468-a72f-d0eaa8d4ea95 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:49.313038 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3f39cdd-4563-4468-a72f-d0eaa8d4ea95 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:49.313733 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3f39cdd-4563-4468-a72f-d0eaa8d4ea95 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:49.381988 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ea64ea77-5087-4738-bcc7-c0b69539babc tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:49.382739 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ea64ea77-5087-4738-bcc7-c0b69539babc tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 04a3818f-fc8b-4fab-a720-46bba72436ef] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:49.396461 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea64ea77-5087-4738-bcc7-c0b69539babc tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:49.397681 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea64ea77-5087-4738-bcc7-c0b69539babc tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:49.398870 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea64ea77-5087-4738-bcc7-c0b69539babc tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:49.403160 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea64ea77-5087-4738-bcc7-c0b69539babc tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:49.608907 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f3f39cdd-4563-4468-a72f-d0eaa8d4ea95 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:49.620640 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f3f39cdd-4563-4468-a72f-d0eaa8d4ea95 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.353245 Aug 04 17:00:49.625036 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2376/4645] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:49 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:49.643575 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-548e2ccc-1968-4ea3-82ab-380225245940 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:49.644233 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-548e2ccc-1968-4ea3-82ab-380225245940 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:49.646219 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ea64ea77-5087-4738-bcc7-c0b69539babc tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:49.657600 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ea64ea77-5087-4738-bcc7-c0b69539babc tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef" status: 200 len: 1505 microversion: 2.1 time: 0.281305 Aug 04 17:00:49.661338 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2270/4646] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:49 2022] GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef => generated 1505 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:49.661539 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-548e2ccc-1968-4ea3-82ab-380225245940 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:49.661539 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-548e2ccc-1968-4ea3-82ab-380225245940 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:49.661539 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-548e2ccc-1968-4ea3-82ab-380225245940 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:49.662163 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-548e2ccc-1968-4ea3-82ab-380225245940 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:49.878168 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-548e2ccc-1968-4ea3-82ab-380225245940 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:49.886937 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-548e2ccc-1968-4ea3-82ab-380225245940 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.247373 Aug 04 17:00:49.888336 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2377/4647] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:49 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:00:49.952800 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1bc2aa75-f44e-47b7-b1ba-7d6c420b9ada tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-177647570", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "9a956378-b79d-4451-b0d0-c11ff419c38c"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:50.061269 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.security_group_api [None req-1bc2aa75-f44e-47b7-b1ba-7d6c420b9ada tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Neutron security group does_not_exist not found {{(pid=126126) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 04 17:00:50.062326 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-1bc2aa75-f44e-47b7-b1ba-7d6c420b9ada tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1bc2aa75-f44e-47b7-b1ba-7d6c420b9ada tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 257 Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-177647570", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "9a956378-b79d-4451-b0d0-c11ff419c38c"}]}} Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-177647570', 'imageRef': '58d80c01-1581-4a2f-bbb0-c2eaf1affa00', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '9a956378-b79d-4451-b0d0-c11ff419c38c'}]}}} Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 04 17:00:50.071655 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1062, in _validate_and_build_base_options Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 509, in _check_requested_secgroups Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 04 17:00:50.076741 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:50.087736 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1bc2aa75-f44e-47b7-b1ba-7d6c420b9ada tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:00:50.087736 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1bc2aa75-f44e-47b7-b1ba-7d6c420b9ada tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.130552 Aug 04 17:00:50.087736 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2271/4648] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:00:49 2022] POST /compute/v2.1/servers => generated 106 bytes in 132 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:00:50.094659 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9dea0550-233b-44bb-ad9c-bd044ce28b07 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:50.095155 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9dea0550-233b-44bb-ad9c-bd044ce28b07 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:50.103020 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:50.105107 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9dea0550-233b-44bb-ad9c-bd044ce28b07 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:50.105851 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9dea0550-233b-44bb-ad9c-bd044ce28b07 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:50.107100 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9dea0550-233b-44bb-ad9c-bd044ce28b07 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:50.107763 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9dea0550-233b-44bb-ad9c-bd044ce28b07 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:50.316828 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-31efd823-df2d-4942-b4b4-bb4c0ecfb810 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:50.338345 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-31efd823-df2d-4942-b4b4-bb4c0ecfb810 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 55db3692-c233-452b-860a-81bc8875c6be] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:50.352018 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9dea0550-233b-44bb-ad9c-bd044ce28b07 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:50.358726 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-31efd823-df2d-4942-b4b4-bb4c0ecfb810 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:50.359168 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-31efd823-df2d-4942-b4b4-bb4c0ecfb810 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:50.363829 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-31efd823-df2d-4942-b4b4-bb4c0ecfb810 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:50.367696 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9dea0550-233b-44bb-ad9c-bd044ce28b07 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.282462 Aug 04 17:00:50.369350 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2378/4649] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:50 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:00:50.369746 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-31efd823-df2d-4942-b4b4-bb4c0ecfb810 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:50.393592 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fb205fd4-971c-4f33-837e-b61cd8a23af8 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:50.394220 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fb205fd4-971c-4f33-837e-b61cd8a23af8 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:50.402124 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fb205fd4-971c-4f33-837e-b61cd8a23af8 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:50.403049 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fb205fd4-971c-4f33-837e-b61cd8a23af8 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:50.404181 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fb205fd4-971c-4f33-837e-b61cd8a23af8 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:50.405089 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fb205fd4-971c-4f33-837e-b61cd8a23af8 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:50.655850 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fb205fd4-971c-4f33-837e-b61cd8a23af8 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:50.667521 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fb205fd4-971c-4f33-837e-b61cd8a23af8 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.278670 Aug 04 17:00:50.670028 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2379/4650] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:50 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:50.683436 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c41a6c9b-1490-4958-a1d0-00734fbdf5dc tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:50.684079 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c41a6c9b-1490-4958-a1d0-00734fbdf5dc tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 04a3818f-fc8b-4fab-a720-46bba72436ef] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:50.706767 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c41a6c9b-1490-4958-a1d0-00734fbdf5dc tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:50.707270 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c41a6c9b-1490-4958-a1d0-00734fbdf5dc tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:50.708090 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c41a6c9b-1490-4958-a1d0-00734fbdf5dc tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:50.708697 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c41a6c9b-1490-4958-a1d0-00734fbdf5dc tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:50.738375 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-31efd823-df2d-4942-b4b4-bb4c0ecfb810 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:50.748486 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-31efd823-df2d-4942-b4b4-bb4c0ecfb810 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be" status: 200 len: 1201 microversion: 2.1 time: 0.436146 Aug 04 17:00:50.749300 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2272/4651] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:50 2022] GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be => generated 1201 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:50.754733 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-03bcea0b-6df9-4c96-8e09-5b268e723194 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:50.755232 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-03bcea0b-6df9-4c96-8e09-5b268e723194 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 00e37d29-85be-4769-b737-e664201671b3] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:50.775549 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-03bcea0b-6df9-4c96-8e09-5b268e723194 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] HTTP exception thrown: Instance 00e37d29-85be-4769-b737-e664201671b3 could not be found. Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-03bcea0b-6df9-4c96-8e09-5b268e723194 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/servers/00e37d29-85be-4769-b737-e664201671b3 HTTP/1.1 Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 00e37d29-85be-4769-b737-e664201671b3 could not be found. Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '00e37d29-85be-4769-b737-e664201671b3'} Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00e37d29-85be-4769-b737-e664201671b3 could not be found. Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00e37d29-85be-4769-b737-e664201671b3 could not be found. Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:50.781088 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:50.786052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:50.786052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:50.786052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:50.786052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:50.786052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:00:50.786052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:00:50.786052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00e37d29-85be-4769-b737-e664201671b3 could not be found. Aug 04 17:00:50.786052 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:50.786052 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-03bcea0b-6df9-4c96-8e09-5b268e723194 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 404 to user: Instance 00e37d29-85be-4769-b737-e664201671b3 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:00:50.786907 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-03bcea0b-6df9-4c96-8e09-5b268e723194 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "DELETE /compute/v2.1/servers/00e37d29-85be-4769-b737-e664201671b3" status: 404 len: 111 microversion: 2.1 time: 0.035998 Aug 04 17:00:50.792471 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2273/4652] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:00:50 2022] DELETE /compute/v2.1/servers/00e37d29-85be-4769-b737-e664201671b3 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:00:50.804412 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-04a37bb0-36c2-4cf4-a80c-ed54eaf47678 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:50.805661 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-04a37bb0-36c2-4cf4-a80c-ed54eaf47678 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:50.822846 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-04a37bb0-36c2-4cf4-a80c-ed54eaf47678 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:50.823302 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-04a37bb0-36c2-4cf4-a80c-ed54eaf47678 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:50.824119 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-04a37bb0-36c2-4cf4-a80c-ed54eaf47678 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:50.824824 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-04a37bb0-36c2-4cf4-a80c-ed54eaf47678 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:50.929272 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c41a6c9b-1490-4958-a1d0-00734fbdf5dc tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:50.950346 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c41a6c9b-1490-4958-a1d0-00734fbdf5dc tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef" status: 200 len: 1505 microversion: 2.1 time: 0.274249 Aug 04 17:00:50.951224 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2380/4653] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:50 2022] GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef => generated 1505 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:51.033878 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-04a37bb0-36c2-4cf4-a80c-ed54eaf47678 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:51.043307 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-04a37bb0-36c2-4cf4-a80c-ed54eaf47678 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.248611 Aug 04 17:00:51.044130 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2274/4654] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:50 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:51.065112 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-631695c3-96e3-426c-b3fa-31c21ae74f55 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:51.065854 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-631695c3-96e3-426c-b3fa-31c21ae74f55 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:51.073868 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-631695c3-96e3-426c-b3fa-31c21ae74f55 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:51.074570 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-631695c3-96e3-426c-b3fa-31c21ae74f55 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:51.075408 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-631695c3-96e3-426c-b3fa-31c21ae74f55 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:51.075874 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-631695c3-96e3-426c-b3fa-31c21ae74f55 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:51.268392 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-631695c3-96e3-426c-b3fa-31c21ae74f55 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:51.273369 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=100 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:51.281274 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-631695c3-96e3-426c-b3fa-31c21ae74f55 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.220388 Aug 04 17:00:51.282125 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2381/4655] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:51 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:51.302199 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9c55476c-51b8-436b-859b-6f2380ee1cca tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:51.303974 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9c55476c-51b8-436b-859b-6f2380ee1cca tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Failed to fetch instance by id 9223372036854775808 {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 04 17:00:51.305220 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-9c55476c-51b8-436b-859b-6f2380ee1cca tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9c55476c-51b8-436b-859b-6f2380ee1cca tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 9223372036854775808 could not be found. Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '9223372036854775808'} Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:51.307132 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:51.311708 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:51.311708 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:00:51.311708 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:00:51.311708 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 04 17:00:51.311708 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:51.313822 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9c55476c-51b8-436b-859b-6f2380ee1cca tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:00:51.315044 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9c55476c-51b8-436b-859b-6f2380ee1cca tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.016977 Aug 04 17:00:51.323195 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2275/4656] 10.222.0.23 () {58 vars in 1188 bytes} [Thu Aug 4 17:00:51 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:00:51.327761 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c0382f4c-38bb-4aeb-80f3-16462cfe3bfa tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:51.329344 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c0382f4c-38bb-4aeb-80f3-16462cfe3bfa tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:51.343500 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0382f4c-38bb-4aeb-80f3-16462cfe3bfa tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:51.344351 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0382f4c-38bb-4aeb-80f3-16462cfe3bfa tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:51.345767 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0382f4c-38bb-4aeb-80f3-16462cfe3bfa tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:51.346638 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0382f4c-38bb-4aeb-80f3-16462cfe3bfa tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:51.443817 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-7b87d3cb-3e2a-42df-9b53-58ba37c97c75 req-685f98dd-49fa-45aa-9804-e474393666f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55db3692-c233-452b-860a-81bc8875c6be", "name": "network-vif-plugged", "status": "completed", "tag": "d26fb384-4a3d-4bd0-8166-5c3a407f0693"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:51.470529 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-7b87d3cb-3e2a-42df-9b53-58ba37c97c75 req-685f98dd-49fa-45aa-9804-e474393666f7 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:51.471061 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-7b87d3cb-3e2a-42df-9b53-58ba37c97c75 req-685f98dd-49fa-45aa-9804-e474393666f7 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:51.500778 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-7b87d3cb-3e2a-42df-9b53-58ba37c97c75 req-685f98dd-49fa-45aa-9804-e474393666f7 service nova] Creating event network-vif-plugged:d26fb384-4a3d-4bd0-8166-5c3a407f0693 for instance 55db3692-c233-452b-860a-81bc8875c6be on n-h1-846466-12 Aug 04 17:00:51.507407 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-7b87d3cb-3e2a-42df-9b53-58ba37c97c75 req-685f98dd-49fa-45aa-9804-e474393666f7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068132 Aug 04 17:00:51.509417 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2276/4657] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:00:51.634797 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c0382f4c-38bb-4aeb-80f3-16462cfe3bfa tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:51.649362 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c0382f4c-38bb-4aeb-80f3-16462cfe3bfa tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.325581 Aug 04 17:00:51.657409 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2382/4658] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:51 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:00:51.674986 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-37e8d849-1980-4cd5-98c3-ed36680cc067 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:51.675803 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-37e8d849-1980-4cd5-98c3-ed36680cc067 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:51.682621 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-37e8d849-1980-4cd5-98c3-ed36680cc067 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:51.683177 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-37e8d849-1980-4cd5-98c3-ed36680cc067 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:51.684107 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-37e8d849-1980-4cd5-98c3-ed36680cc067 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:51.684723 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-37e8d849-1980-4cd5-98c3-ed36680cc067 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:51.775993 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bbdf694f-8899-4e79-ad5b-2ee154ba02a3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:51.777516 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bbdf694f-8899-4e79-ad5b-2ee154ba02a3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 55db3692-c233-452b-860a-81bc8875c6be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:51.794165 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bbdf694f-8899-4e79-ad5b-2ee154ba02a3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:51.794982 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bbdf694f-8899-4e79-ad5b-2ee154ba02a3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:51.800008 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bbdf694f-8899-4e79-ad5b-2ee154ba02a3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:51.800510 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bbdf694f-8899-4e79-ad5b-2ee154ba02a3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:52.061455 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bbdf694f-8899-4e79-ad5b-2ee154ba02a3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:52.063460 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-37e8d849-1980-4cd5-98c3-ed36680cc067 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:52.072084 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bbdf694f-8899-4e79-ad5b-2ee154ba02a3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be" status: 200 len: 1201 microversion: 2.1 time: 0.301520 Aug 04 17:00:52.072300 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-37e8d849-1980-4cd5-98c3-ed36680cc067 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.403800 Aug 04 17:00:52.072738 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2277/4659] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:51 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:52.073463 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2383/4660] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:51 2022] GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be => generated 1201 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:52.090687 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-28cc3100-30c7-4b17-821e-99ab2ca55fba tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:52.091858 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-28cc3100-30c7-4b17-821e-99ab2ca55fba tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 04a3818f-fc8b-4fab-a720-46bba72436ef] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:52.099479 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e85b2ae7-d3fe-45c0-a750-13ce8fba79bb tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:52.100064 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e85b2ae7-d3fe-45c0-a750-13ce8fba79bb tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Failed to fetch instance by id -1 {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 04 17:00:52.100662 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-e85b2ae7-d3fe-45c0-a750-13ce8fba79bb tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] HTTP exception thrown: Instance -1 could not be found. Aug 04 17:00:52.102618 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-28cc3100-30c7-4b17-821e-99ab2ca55fba tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e85b2ae7-d3fe-45c0-a750-13ce8fba79bb tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance -1 could not be found. Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '-1'} Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:52.102913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:52.107918 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:00:52.107918 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:00:52.107918 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 04 17:00:52.107918 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:52.108237 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-28cc3100-30c7-4b17-821e-99ab2ca55fba tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:52.108338 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e85b2ae7-d3fe-45c0-a750-13ce8fba79bb tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 404 to user: Instance -1 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:00:52.108338 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e85b2ae7-d3fe-45c0-a750-13ce8fba79bb tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.008991 Aug 04 17:00:52.108514 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-28cc3100-30c7-4b17-821e-99ab2ca55fba tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:52.108599 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2384/4661] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Aug 4 17:00:52 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 04 17:00:52.108699 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-28cc3100-30c7-4b17-821e-99ab2ca55fba tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:52.114046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-63a67a9c-d2b6-4db5-9150-b250a7cd1c96 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:52.114653 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-63a67a9c-d2b6-4db5-9150-b250a7cd1c96 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:52.122941 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-63a67a9c-d2b6-4db5-9150-b250a7cd1c96 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:52.123376 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-63a67a9c-d2b6-4db5-9150-b250a7cd1c96 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:52.124350 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-63a67a9c-d2b6-4db5-9150-b250a7cd1c96 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:52.124782 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-63a67a9c-d2b6-4db5-9150-b250a7cd1c96 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:52.354194 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-28cc3100-30c7-4b17-821e-99ab2ca55fba tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:52.363303 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-63a67a9c-d2b6-4db5-9150-b250a7cd1c96 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:52.372048 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-28cc3100-30c7-4b17-821e-99ab2ca55fba tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef" status: 200 len: 1505 microversion: 2.1 time: 0.285632 Aug 04 17:00:52.374529 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-63a67a9c-d2b6-4db5-9150-b250a7cd1c96 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.264993 Aug 04 17:00:52.376050 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2278/4662] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:52 2022] GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef => generated 1505 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:52.376524 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2385/4663] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:52 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:52.401500 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a28a6fa9-ffe2-4ce5-9f51-896a6e75c26a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:52.402147 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a28a6fa9-ffe2-4ce5-9f51-896a6e75c26a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:52.408342 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a28a6fa9-ffe2-4ce5-9f51-896a6e75c26a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:52.408788 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a28a6fa9-ffe2-4ce5-9f51-896a6e75c26a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:52.409584 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a28a6fa9-ffe2-4ce5-9f51-896a6e75c26a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:52.410209 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a28a6fa9-ffe2-4ce5-9f51-896a6e75c26a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:52.545471 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a28a6fa9-ffe2-4ce5-9f51-896a6e75c26a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:52.553493 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a28a6fa9-ffe2-4ce5-9f51-896a6e75c26a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.156322 Aug 04 17:00:52.553994 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2386/4664] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:52 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:52.573679 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7c2c0e7d-5c1d-47bf-86a2-628f84d24415 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:52.574345 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7c2c0e7d-5c1d-47bf-86a2-628f84d24415 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 92d157c6-d08d-4af1-b834-ec4fcb9fcf14] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:52.580620 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-7c2c0e7d-5c1d-47bf-86a2-628f84d24415 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] HTTP exception thrown: Instance 92d157c6-d08d-4af1-b834-ec4fcb9fcf14 could not be found. Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7c2c0e7d-5c1d-47bf-86a2-628f84d24415 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers/92d157c6-d08d-4af1-b834-ec4fcb9fcf14/action HTTP/1.1 Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 19 Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: {"forceDelete": {}} Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 92d157c6-d08d-4af1-b834-ec4fcb9fcf14 could not be found. Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '92d157c6-d08d-4af1-b834-ec4fcb9fcf14', 'body': {'forceDelete': {}}} Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92d157c6-d08d-4af1-b834-ec4fcb9fcf14 could not be found. Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92d157c6-d08d-4af1-b834-ec4fcb9fcf14 could not be found. Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:52.590112 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:52.595312 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:00:52.595312 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:00:52.595312 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92d157c6-d08d-4af1-b834-ec4fcb9fcf14 could not be found. Aug 04 17:00:52.595312 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:52.595312 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7c2c0e7d-5c1d-47bf-86a2-628f84d24415 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 404 to user: Instance 92d157c6-d08d-4af1-b834-ec4fcb9fcf14 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:00:52.595312 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7c2c0e7d-5c1d-47bf-86a2-628f84d24415 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers/92d157c6-d08d-4af1-b834-ec4fcb9fcf14/action" status: 404 len: 111 microversion: 2.1 time: 0.022126 Aug 04 17:00:52.595312 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2279/4665] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:00:52 2022] POST /compute/v2.1/servers/92d157c6-d08d-4af1-b834-ec4fcb9fcf14/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:00:52.600456 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a5e3045f-3d0b-4e41-b6af-26e0412e6e59 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:52.601510 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a5e3045f-3d0b-4e41-b6af-26e0412e6e59 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:52.608644 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a5e3045f-3d0b-4e41-b6af-26e0412e6e59 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:52.609072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a5e3045f-3d0b-4e41-b6af-26e0412e6e59 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:52.609876 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a5e3045f-3d0b-4e41-b6af-26e0412e6e59 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:52.610305 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a5e3045f-3d0b-4e41-b6af-26e0412e6e59 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:52.746819 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a5e3045f-3d0b-4e41-b6af-26e0412e6e59 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:52.754611 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a5e3045f-3d0b-4e41-b6af-26e0412e6e59 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.158047 Aug 04 17:00:52.755188 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2387/4666] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:52 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:52.778306 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f53e7a26-4592-4737-a077-6adee7a71e55 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:52.779218 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f53e7a26-4592-4737-a077-6adee7a71e55 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:52.786814 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f53e7a26-4592-4737-a077-6adee7a71e55 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:52.787253 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f53e7a26-4592-4737-a077-6adee7a71e55 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:52.788014 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f53e7a26-4592-4737-a077-6adee7a71e55 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:52.788439 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f53e7a26-4592-4737-a077-6adee7a71e55 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:52.933813 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f53e7a26-4592-4737-a077-6adee7a71e55 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:52.941909 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f53e7a26-4592-4737-a077-6adee7a71e55 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.167702 Aug 04 17:00:52.942423 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2280/4667] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:52 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:52.962126 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ae041ff1-65a4-46fa-8965-f6d063df23e1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:52.967492 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ae041ff1-65a4-46fa-8965-f6d063df23e1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 3e411049-fa72-431c-ac54-cc1186472892] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:52.970934 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-ae041ff1-65a4-46fa-8965-f6d063df23e1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] HTTP exception thrown: Instance 3e411049-fa72-431c-ac54-cc1186472892 could not be found. Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ae041ff1-65a4-46fa-8965-f6d063df23e1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers/3e411049-fa72-431c-ac54-cc1186472892/action HTTP/1.1 Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 39 Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: {"os-getConsoleOutput": {"length": 10}} Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 3e411049-fa72-431c-ac54-cc1186472892 could not be found. Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '3e411049-fa72-431c-ac54-cc1186472892', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e411049-fa72-431c-ac54-cc1186472892 could not be found. Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e411049-fa72-431c-ac54-cc1186472892 could not be found. Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:52.978413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:52.983305 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:52.983305 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:52.983305 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:00:52.983305 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:00:52.983305 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e411049-fa72-431c-ac54-cc1186472892 could not be found. Aug 04 17:00:52.983305 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:52.983305 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ae041ff1-65a4-46fa-8965-f6d063df23e1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 404 to user: Instance 3e411049-fa72-431c-ac54-cc1186472892 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:00:52.983305 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ae041ff1-65a4-46fa-8965-f6d063df23e1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers/3e411049-fa72-431c-ac54-cc1186472892/action" status: 404 len: 111 microversion: 2.1 time: 0.021996 Aug 04 17:00:52.983305 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2388/4668] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:00:52 2022] POST /compute/v2.1/servers/3e411049-fa72-431c-ac54-cc1186472892/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:00:52.990924 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8a8a65e2-7853-41c4-bf7b-8cd63138e202 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:52.991481 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8a8a65e2-7853-41c4-bf7b-8cd63138e202 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:53.011789 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a8a65e2-7853-41c4-bf7b-8cd63138e202 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:53.012100 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a8a65e2-7853-41c4-bf7b-8cd63138e202 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:53.013065 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a8a65e2-7853-41c4-bf7b-8cd63138e202 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:53.013704 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a8a65e2-7853-41c4-bf7b-8cd63138e202 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:53.094293 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-86ad08a0-a597-46b5-b1da-15852dbe1987 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:53.094920 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-86ad08a0-a597-46b5-b1da-15852dbe1987 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 55db3692-c233-452b-860a-81bc8875c6be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:53.104333 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-86ad08a0-a597-46b5-b1da-15852dbe1987 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:53.105167 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-86ad08a0-a597-46b5-b1da-15852dbe1987 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:53.107069 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-86ad08a0-a597-46b5-b1da-15852dbe1987 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:53.107909 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-86ad08a0-a597-46b5-b1da-15852dbe1987 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:53.222407 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8a8a65e2-7853-41c4-bf7b-8cd63138e202 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:53.232808 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8a8a65e2-7853-41c4-bf7b-8cd63138e202 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.247571 Aug 04 17:00:53.235204 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2281/4669] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:52 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:53.257319 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a478e2f2-6d62-42c6-9b15-64d264bcc6e9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:53.258289 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a478e2f2-6d62-42c6-9b15-64d264bcc6e9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:53.265074 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a478e2f2-6d62-42c6-9b15-64d264bcc6e9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:53.265812 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a478e2f2-6d62-42c6-9b15-64d264bcc6e9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:53.266588 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a478e2f2-6d62-42c6-9b15-64d264bcc6e9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:53.267367 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a478e2f2-6d62-42c6-9b15-64d264bcc6e9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:53.380890 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-86ad08a0-a597-46b5-b1da-15852dbe1987 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:53.392164 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-86ad08a0-a597-46b5-b1da-15852dbe1987 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be" status: 200 len: 1201 microversion: 2.1 time: 0.302107 Aug 04 17:00:53.393038 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2389/4670] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:53 2022] GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be => generated 1201 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:00:53.398442 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-04cdf1a8-90f6-480d-bb5b-2e35114a6bb2 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:53.399057 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-04cdf1a8-90f6-480d-bb5b-2e35114a6bb2 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 04a3818f-fc8b-4fab-a720-46bba72436ef] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:53.405764 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-04cdf1a8-90f6-480d-bb5b-2e35114a6bb2 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:53.406217 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-04cdf1a8-90f6-480d-bb5b-2e35114a6bb2 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:53.407036 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-04cdf1a8-90f6-480d-bb5b-2e35114a6bb2 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:53.407468 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-04cdf1a8-90f6-480d-bb5b-2e35114a6bb2 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:53.481263 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a478e2f2-6d62-42c6-9b15-64d264bcc6e9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:53.490101 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a478e2f2-6d62-42c6-9b15-64d264bcc6e9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.236814 Aug 04 17:00:53.506598 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2282/4671] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:53 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:00:53.512005 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bcf203d5-dd51-4a88-b2f4-d7c8ab232e4f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:53.512759 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bcf203d5-dd51-4a88-b2f4-d7c8ab232e4f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 1653421e-0c6f-41a5-aa1a-c2dbf83fb926] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:53.519123 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-bcf203d5-dd51-4a88-b2f4-d7c8ab232e4f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] HTTP exception thrown: Instance 1653421e-0c6f-41a5-aa1a-c2dbf83fb926 could not be found. Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bcf203d5-dd51-4a88-b2f4-d7c8ab232e4f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/1653421e-0c6f-41a5-aa1a-c2dbf83fb926 HTTP/1.1 Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 1653421e-0c6f-41a5-aa1a-c2dbf83fb926 could not be found. Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '1653421e-0c6f-41a5-aa1a-c2dbf83fb926'} Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1653421e-0c6f-41a5-aa1a-c2dbf83fb926 could not be found. Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1653421e-0c6f-41a5-aa1a-c2dbf83fb926 could not be found. Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:53.521081 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:53.525791 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:53.525791 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:00:53.525791 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:00:53.525791 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1653421e-0c6f-41a5-aa1a-c2dbf83fb926 could not be found. Aug 04 17:00:53.525791 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:53.527151 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bcf203d5-dd51-4a88-b2f4-d7c8ab232e4f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 404 to user: Instance 1653421e-0c6f-41a5-aa1a-c2dbf83fb926 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:00:53.528600 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bcf203d5-dd51-4a88-b2f4-d7c8ab232e4f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/1653421e-0c6f-41a5-aa1a-c2dbf83fb926" status: 404 len: 111 microversion: 2.1 time: 0.021484 Aug 04 17:00:53.529623 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2283/4672] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:53 2022] GET /compute/v2.1/servers/1653421e-0c6f-41a5-aa1a-c2dbf83fb926 => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:00:53.541885 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f62d3245-2d66-48f1-a47e-55fe57b744c2 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:53.542732 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f62d3245-2d66-48f1-a47e-55fe57b744c2 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:53.550812 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f62d3245-2d66-48f1-a47e-55fe57b744c2 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:53.551796 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f62d3245-2d66-48f1-a47e-55fe57b744c2 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:53.552986 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f62d3245-2d66-48f1-a47e-55fe57b744c2 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:53.553621 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f62d3245-2d66-48f1-a47e-55fe57b744c2 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:53.609586 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-04cdf1a8-90f6-480d-bb5b-2e35114a6bb2 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:53.618501 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-04cdf1a8-90f6-480d-bb5b-2e35114a6bb2 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef" status: 200 len: 1485 microversion: 2.1 time: 0.224048 Aug 04 17:00:53.619372 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2390/4673] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:53 2022] GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef => generated 1485 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:53.733142 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f62d3245-2d66-48f1-a47e-55fe57b744c2 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:53.743262 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f62d3245-2d66-48f1-a47e-55fe57b744c2 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.208715 Aug 04 17:00:53.744226 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2284/4674] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:53 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:53.766170 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-37316cab-a32d-4d4f-a508-3f0249fa8369 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:53.766780 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-37316cab-a32d-4d4f-a508-3f0249fa8369 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:53.777377 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3ed2d1a3-93ed-42cc-8178-bab03716f007 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1264987893", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:53.782756 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-37316cab-a32d-4d4f-a508-3f0249fa8369 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:53.783210 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-37316cab-a32d-4d4f-a508-3f0249fa8369 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:53.783972 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-37316cab-a32d-4d4f-a508-3f0249fa8369 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:53.784396 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-37316cab-a32d-4d4f-a508-3f0249fa8369 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:53.839142 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-3ed2d1a3-93ed-42cc-8178-bab03716f007 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] validate_networks() for [('040f2717-1f58-479c-8754-28f41d777747', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:00:54.138463 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-37316cab-a32d-4d4f-a508-3f0249fa8369 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:54.148007 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-37316cab-a32d-4d4f-a508-3f0249fa8369 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.386642 Aug 04 17:00:54.148943 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2391/4675] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:53 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:54.280782 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1bc3f83c-d934-45fd-b32b-282df06484b9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-304591284", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "9a956378-b79d-4451-b0d0-c11ff419c38c"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1bc3f83c-d934-45fd-b32b-282df06484b9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 237 Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-304591284", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "9a956378-b79d-4451-b0d0-c11ff419c38c"}]}} Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-304591284', 'imageRef': '58d80c01-1581-4a2f-bbb0-c2eaf1affa00', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '9a956378-b79d-4451-b0d0-c11ff419c38c'}]}}} Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:54.301938 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:54.307205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:54.307205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:54.307205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:00:54.307205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:00:54.307205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:00:54.307205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:00:54.307205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:00:54.307205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:00:54.307205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:00:54.307205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:00:54.307205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:00:54.307205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:00:54.307205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:00:54.307205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:00:54.307205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 04 17:00:54.307205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:54.307205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:54.307205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:54.307205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:54.307205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:54.307205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:54.307205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:00:54.307205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:00:54.307205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 04 17:00:54.307205 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:54.307205 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1bc3f83c-d934-45fd-b32b-282df06484b9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:00:54.307205 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1bc3f83c-d934-45fd-b32b-282df06484b9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.028483 Aug 04 17:00:54.310086 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2392/4676] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:00:54 2022] POST /compute/v2.1/servers => generated 139 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 17:00:54.315006 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5e983582-3105-4b4a-a518-68ae9dd0975a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:54.315554 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5e983582-3105-4b4a-a518-68ae9dd0975a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:54.327556 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5e983582-3105-4b4a-a518-68ae9dd0975a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:54.328271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5e983582-3105-4b4a-a518-68ae9dd0975a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:54.329742 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5e983582-3105-4b4a-a518-68ae9dd0975a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:54.330510 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5e983582-3105-4b4a-a518-68ae9dd0975a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:54.810259 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5e983582-3105-4b4a-a518-68ae9dd0975a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:54.826247 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5e983582-3105-4b4a-a518-68ae9dd0975a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.515146 Aug 04 17:00:54.827829 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-3ed2d1a3-93ed-42cc-8178-bab03716f007 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:00:54.828880 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-3ed2d1a3-93ed-42cc-8178-bab03716f007 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:00:54.830417 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-3ed2d1a3-93ed-42cc-8178-bab03716f007 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:00:54.831318 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-3ed2d1a3-93ed-42cc-8178-bab03716f007 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:00:54.832026 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-3ed2d1a3-93ed-42cc-8178-bab03716f007 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:00:54.841699 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2393/4677] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:54 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:54.845843 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ed2d1a3-93ed-42cc-8178-bab03716f007 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:54.846295 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ed2d1a3-93ed-42cc-8178-bab03716f007 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:54.847901 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ed2d1a3-93ed-42cc-8178-bab03716f007 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:54.848446 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5fe72a37-e94e-4213-84a6-d2a3b4559e93 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:54.848610 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ed2d1a3-93ed-42cc-8178-bab03716f007 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:54.849113 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5fe72a37-e94e-4213-84a6-d2a3b4559e93 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 55db3692-c233-452b-860a-81bc8875c6be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:54.855590 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5fe72a37-e94e-4213-84a6-d2a3b4559e93 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:54.856314 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5fe72a37-e94e-4213-84a6-d2a3b4559e93 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:54.857305 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5fe72a37-e94e-4213-84a6-d2a3b4559e93 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:54.857901 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5fe72a37-e94e-4213-84a6-d2a3b4559e93 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:54.872486 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-3ed2d1a3-93ed-42cc-8178-bab03716f007 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Getting quotas for project 7af0c13734b34a69bbcf9201567398a2. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:00:54.879713 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-3ed2d1a3-93ed-42cc-8178-bab03716f007 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Getting quotas for user 103f0906f85b4c1a8451cfc2b2384a88 and project 7af0c13734b34a69bbcf9201567398a2. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:00:54.894733 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3ed2d1a3-93ed-42cc-8178-bab03716f007 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:00:54.897114 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3ed2d1a3-93ed-42cc-8178-bab03716f007 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:00:54.970880 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3ed2d1a3-93ed-42cc-8178-bab03716f007 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.198132 Aug 04 17:00:54.978198 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2285/4678] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:00:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 1206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 17:00:54.984219 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4e63d409-313a-4e4a-9bae-8986deb6b456 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:54.985144 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4e63d409-313a-4e4a-9bae-8986deb6b456 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:54.994797 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4e63d409-313a-4e4a-9bae-8986deb6b456 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:54.995575 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4e63d409-313a-4e4a-9bae-8986deb6b456 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:54.996614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4e63d409-313a-4e4a-9bae-8986deb6b456 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:54.997325 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4e63d409-313a-4e4a-9bae-8986deb6b456 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:55.070363 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5fe72a37-e94e-4213-84a6-d2a3b4559e93 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:55.080487 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5fe72a37-e94e-4213-84a6-d2a3b4559e93 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be" status: 200 len: 1387 microversion: 2.1 time: 0.237019 Aug 04 17:00:55.081433 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2394/4679] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:54 2022] GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be => generated 1387 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:55.099167 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-35b1e4b7-2baa-48c7-8d57-1256e169832e tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:55.104988 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-35b1e4b7-2baa-48c7-8d57-1256e169832e tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:55.211272 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-35b1e4b7-2baa-48c7-8d57-1256e169832e tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:55.221904 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-35b1e4b7-2baa-48c7-8d57-1256e169832e tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1214 microversion: 2.1 time: 0.138779 Aug 04 17:00:55.233745 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4e63d409-313a-4e4a-9bae-8986deb6b456 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:55.234041 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2395/4680] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:55 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1214 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:55.240124 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4e63d409-313a-4e4a-9bae-8986deb6b456 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.260448 Aug 04 17:00:55.253309 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2286/4681] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:54 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:55.254467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-88a1ceed-544b-4584-aa23-ca12a2e421a6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:55.254467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-88a1ceed-544b-4584-aa23-ca12a2e421a6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 55db3692-c233-452b-860a-81bc8875c6be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:55.282171 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-88a1ceed-544b-4584-aa23-ca12a2e421a6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:55.290876 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-88a1ceed-544b-4584-aa23-ca12a2e421a6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:55.294738 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-88a1ceed-544b-4584-aa23-ca12a2e421a6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:55.295342 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-88a1ceed-544b-4584-aa23-ca12a2e421a6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:55.335181 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a2804b13-29e3-45d3-a3fb-e6cb1e3e7c6c tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2022185073", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "9a956378-b79d-4451-b0d0-c11ff419c38c"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a2804b13-29e3-45d3-a3fb-e6cb1e3e7c6c tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 235 Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2022185073", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "9a956378-b79d-4451-b0d0-c11ff419c38c"}]}} Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2022185073', 'imageRef': '58d80c01-1581-4a2f-bbb0-c2eaf1affa00', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '9a956378-b79d-4451-b0d0-c11ff419c38c'}]}}} Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:55.351713 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:55.357398 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:55.357398 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:55.357398 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:00:55.357398 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:00:55.357398 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:00:55.357398 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:00:55.357398 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:00:55.357398 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:00:55.357398 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:00:55.357398 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:00:55.357398 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:00:55.357398 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:00:55.357398 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:00:55.357398 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:00:55.357398 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 04 17:00:55.357398 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:55.357398 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:55.357398 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:55.357398 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:55.357398 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:55.357398 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:55.357398 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:00:55.357398 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:00:55.357398 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 04 17:00:55.357398 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:55.357398 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a2804b13-29e3-45d3-a3fb-e6cb1e3e7c6c tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:00:55.357398 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a2804b13-29e3-45d3-a3fb-e6cb1e3e7c6c tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.033894 Aug 04 17:00:55.357398 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2287/4682] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:00:55 2022] POST /compute/v2.1/servers => generated 133 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:00:55.370372 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-db6dfbfd-b51f-4059-b095-41dc00ffbf7b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:55.372113 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-db6dfbfd-b51f-4059-b095-41dc00ffbf7b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:55.382134 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db6dfbfd-b51f-4059-b095-41dc00ffbf7b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:55.382755 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db6dfbfd-b51f-4059-b095-41dc00ffbf7b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:55.383638 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db6dfbfd-b51f-4059-b095-41dc00ffbf7b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:55.384167 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db6dfbfd-b51f-4059-b095-41dc00ffbf7b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:55.630885 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-88a1ceed-544b-4584-aa23-ca12a2e421a6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:55.654385 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-88a1ceed-544b-4584-aa23-ca12a2e421a6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be" status: 200 len: 1387 microversion: 2.1 time: 0.421071 Aug 04 17:00:55.655249 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2396/4683] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:55 2022] GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be => generated 1387 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:55.676016 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8dd9d484-cfc2-4aac-932d-80e53808257f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:55.677012 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8dd9d484-cfc2-4aac-932d-80e53808257f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 55db3692-c233-452b-860a-81bc8875c6be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:55.686887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8dd9d484-cfc2-4aac-932d-80e53808257f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:55.687597 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8dd9d484-cfc2-4aac-932d-80e53808257f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:55.688625 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8dd9d484-cfc2-4aac-932d-80e53808257f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:55.689078 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8dd9d484-cfc2-4aac-932d-80e53808257f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:55.762190 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-db6dfbfd-b51f-4059-b095-41dc00ffbf7b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:55.778222 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-db6dfbfd-b51f-4059-b095-41dc00ffbf7b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.417270 Aug 04 17:00:55.793610 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2288/4684] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:55 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:55.802963 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e6623eab-fd63-4037-82ee-bb8075a945d7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:55.803590 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e6623eab-fd63-4037-82ee-bb8075a945d7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:55.814614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e6623eab-fd63-4037-82ee-bb8075a945d7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:55.820262 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e6623eab-fd63-4037-82ee-bb8075a945d7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:55.821619 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e6623eab-fd63-4037-82ee-bb8075a945d7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:55.827061 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e6623eab-fd63-4037-82ee-bb8075a945d7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:55.952977 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8dd9d484-cfc2-4aac-932d-80e53808257f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:55.962272 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8dd9d484-cfc2-4aac-932d-80e53808257f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be" status: 200 len: 1387 microversion: 2.1 time: 0.290130 Aug 04 17:00:55.962870 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2397/4685] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:55 2022] GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be => generated 1387 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:55.984045 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9ea24fa2-8686-415b-a2e8-a351a9c01d66 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:55.984825 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9ea24fa2-8686-415b-a2e8-a351a9c01d66 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 55db3692-c233-452b-860a-81bc8875c6be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:55.991645 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9ea24fa2-8686-415b-a2e8-a351a9c01d66 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:55.992732 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9ea24fa2-8686-415b-a2e8-a351a9c01d66 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:55.993770 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9ea24fa2-8686-415b-a2e8-a351a9c01d66 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:55.994388 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9ea24fa2-8686-415b-a2e8-a351a9c01d66 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:56.034092 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9ea24fa2-8686-415b-a2e8-a351a9c01d66 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 55db3692-c233-452b-860a-81bc8875c6be] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:00:56.102977 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e6623eab-fd63-4037-82ee-bb8075a945d7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:56.112324 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e6623eab-fd63-4037-82ee-bb8075a945d7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.313410 Aug 04 17:00:56.112927 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2289/4686] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:55 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:00:56.133775 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7ced00dd-78a0-4d82-8a3a-b8462e6d3eed tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:56.134320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7ced00dd-78a0-4d82-8a3a-b8462e6d3eed tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: a8ed5a4a-532d-442c-816b-7be121fa034b] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:56.141416 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-7ced00dd-78a0-4d82-8a3a-b8462e6d3eed tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] HTTP exception thrown: Instance a8ed5a4a-532d-442c-816b-7be121fa034b could not be found. Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7ced00dd-78a0-4d82-8a3a-b8462e6d3eed tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers/a8ed5a4a-532d-442c-816b-7be121fa034b/action HTTP/1.1 Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 13 Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: {"pause": {}} Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance a8ed5a4a-532d-442c-816b-7be121fa034b could not be found. Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'a8ed5a4a-532d-442c-816b-7be121fa034b', 'body': {'pause': {}}} Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8ed5a4a-532d-442c-816b-7be121fa034b could not be found. Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8ed5a4a-532d-442c-816b-7be121fa034b could not be found. Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:56.148503 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:56.154268 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:00:56.154268 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:00:56.154268 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8ed5a4a-532d-442c-816b-7be121fa034b could not be found. Aug 04 17:00:56.154268 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:56.154268 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7ced00dd-78a0-4d82-8a3a-b8462e6d3eed tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 404 to user: Instance a8ed5a4a-532d-442c-816b-7be121fa034b could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:00:56.154268 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7ced00dd-78a0-4d82-8a3a-b8462e6d3eed tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers/a8ed5a4a-532d-442c-816b-7be121fa034b/action" status: 404 len: 111 microversion: 2.1 time: 0.021657 Aug 04 17:00:56.155995 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2290/4687] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:00:56 2022] POST /compute/v2.1/servers/a8ed5a4a-532d-442c-816b-7be121fa034b/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:00:56.159082 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9ea24fa2-8686-415b-a2e8-a351a9c01d66 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "DELETE /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be" status: 204 len: 0 microversion: 2.1 time: 0.178797 Aug 04 17:00:56.164082 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a3d9c88e-a0bc-44f3-9964-aa53ef6333a1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:56.164082 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a3d9c88e-a0bc-44f3-9964-aa53ef6333a1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:56.164392 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2398/4688] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:00:55 2022] DELETE /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:00:56.171722 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a3d9c88e-a0bc-44f3-9964-aa53ef6333a1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:56.172173 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a3d9c88e-a0bc-44f3-9964-aa53ef6333a1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:56.172867 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-edc0bf28-7ac7-4ea6-a2d7-79738ed56007 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:56.173028 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a3d9c88e-a0bc-44f3-9964-aa53ef6333a1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:56.173711 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a3d9c88e-a0bc-44f3-9964-aa53ef6333a1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:56.173979 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-edc0bf28-7ac7-4ea6-a2d7-79738ed56007 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 55db3692-c233-452b-860a-81bc8875c6be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:56.181372 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-edc0bf28-7ac7-4ea6-a2d7-79738ed56007 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:56.181938 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-edc0bf28-7ac7-4ea6-a2d7-79738ed56007 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:56.182861 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-edc0bf28-7ac7-4ea6-a2d7-79738ed56007 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:56.183337 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-edc0bf28-7ac7-4ea6-a2d7-79738ed56007 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:56.555362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-edc0bf28-7ac7-4ea6-a2d7-79738ed56007 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:56.581811 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a3d9c88e-a0bc-44f3-9964-aa53ef6333a1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:56.590586 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-edc0bf28-7ac7-4ea6-a2d7-79738ed56007 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be" status: 200 len: 1393 microversion: 2.1 time: 0.424013 Aug 04 17:00:56.591845 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2399/4689] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:56 2022] GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be => generated 1393 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:56.628512 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a3d9c88e-a0bc-44f3-9964-aa53ef6333a1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.471174 Aug 04 17:00:56.632185 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2e7ecb63-2437-4a3e-9244-18bb930d9877 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:56.632902 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2e7ecb63-2437-4a3e-9244-18bb930d9877 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:56.643546 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2291/4690] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:56 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:56.657816 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e7ecb63-2437-4a3e-9244-18bb930d9877 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:56.658403 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e7ecb63-2437-4a3e-9244-18bb930d9877 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:56.658877 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1a236c98-d482-4684-83ad-4627ceed7044 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:56.659212 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e7ecb63-2437-4a3e-9244-18bb930d9877 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:56.659655 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e7ecb63-2437-4a3e-9244-18bb930d9877 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:56.660046 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1a236c98-d482-4684-83ad-4627ceed7044 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:56.667940 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1a236c98-d482-4684-83ad-4627ceed7044 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:56.668676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1a236c98-d482-4684-83ad-4627ceed7044 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:56.670139 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1a236c98-d482-4684-83ad-4627ceed7044 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:56.671489 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1a236c98-d482-4684-83ad-4627ceed7044 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:56.782749 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2e7ecb63-2437-4a3e-9244-18bb930d9877 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:56.787349 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:56.795277 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2e7ecb63-2437-4a3e-9244-18bb930d9877 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1274 microversion: 2.1 time: 0.174752 Aug 04 17:00:56.796150 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2400/4691] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:56 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1274 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:56.867055 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1a236c98-d482-4684-83ad-4627ceed7044 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:56.876386 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1a236c98-d482-4684-83ad-4627ceed7044 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.222080 Aug 04 17:00:56.885823 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2292/4692] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:56 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:00:56.900823 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4880a776-b354-47c7-a114-523e9f419f32 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:56.901101 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4880a776-b354-47c7-a114-523e9f419f32 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:56.913860 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4880a776-b354-47c7-a114-523e9f419f32 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:56.914791 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4880a776-b354-47c7-a114-523e9f419f32 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:56.915741 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4880a776-b354-47c7-a114-523e9f419f32 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:56.916293 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4880a776-b354-47c7-a114-523e9f419f32 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:57.001741 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4880a776-b354-47c7-a114-523e9f419f32 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0/action" status: 202 len: 0 microversion: 2.1 time: 0.105971 Aug 04 17:00:57.002846 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2401/4693] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:00:56 2022] POST /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:00:57.012406 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-aa58d5e4-8994-490a-9ac1-791e28a49b3f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:57.013033 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-aa58d5e4-8994-490a-9ac1-791e28a49b3f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:57.020830 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aa58d5e4-8994-490a-9ac1-791e28a49b3f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:57.020830 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aa58d5e4-8994-490a-9ac1-791e28a49b3f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:57.021257 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aa58d5e4-8994-490a-9ac1-791e28a49b3f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:57.021901 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aa58d5e4-8994-490a-9ac1-791e28a49b3f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:57.187110 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-aa58d5e4-8994-490a-9ac1-791e28a49b3f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:57.191785 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=100 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:57.204470 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-aa58d5e4-8994-490a-9ac1-791e28a49b3f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1511 microversion: 2.1 time: 0.197351 Aug 04 17:00:57.218533 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2293/4694] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:57 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1511 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:57.568931 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-49ba6307-bf51-4322-b469-66cce78ec10a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15e5216f-321c-4ac4-870f-a5ee1d655ddf"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:57.573276 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-49ba6307-bf51-4322-b469-66cce78ec10a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 0063f3a7-735d-438e-a375-3b2a83bef991] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:57.581687 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-49ba6307-bf51-4322-b469-66cce78ec10a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:57.582238 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-49ba6307-bf51-4322-b469-66cce78ec10a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:57.583148 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-49ba6307-bf51-4322-b469-66cce78ec10a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:57.583965 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-49ba6307-bf51-4322-b469-66cce78ec10a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:57.630776 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7a84654b-4bca-466e-aee7-b7813acb97e7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:57.633100 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7a84654b-4bca-466e-aee7-b7813acb97e7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 55db3692-c233-452b-860a-81bc8875c6be] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:57.644370 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:57.662884 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7a84654b-4bca-466e-aee7-b7813acb97e7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:57.664644 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7a84654b-4bca-466e-aee7-b7813acb97e7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:57.666844 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7a84654b-4bca-466e-aee7-b7813acb97e7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:57.669509 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7a84654b-4bca-466e-aee7-b7813acb97e7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:57.790343 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-49ba6307-bf51-4322-b469-66cce78ec10a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] HTTP exception thrown: Invalid volume: volume 15e5216f-321c-4ac4-870f-a5ee1d655ddf is already attached to instances: 0063f3a7-735d-438e-a375-3b2a83bef991 Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-49ba6307-bf51-4322-b469-66cce78ec10a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Request method failure captured: Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991/os-volume_attachments HTTP/1.1 Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 74 Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_owNKx0pHV40nqVD-WIcaXEsXOBwQHOEMAVVk2fno070nDFXZRZhhzMgTy8HlVP1AOBt469MYWC_AbeQLbAvgivtdjrTsmGymGu6AtGEk3CEKRMIDLRIpky1rxw9eTh6mgckU3tnNoFbB2in__O_4k2BxkTMZllLYaubH7EDDeTWL4 Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 2534921e8a2f47d394059fee872426a8 Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-AttachVolumeNegativeTest-410766221 Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2534921e8a2f47d394059fee872426a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2534921e8a2f47d394059fee872426a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2534921e8a2f47d394059fee872426a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2534921e8a2f47d394059fee872426a8"}]}] Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-AttachVolumeNegativeTest-410766221 Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 2534921e8a2f47d394059fee872426a8 Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-410766221 Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-AttachVolumeNegativeTest-410766221-project Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: d82f4a672b154291a412a282d1a88208 Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-AttachVolumeNegativeTest-410766221-project Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: {"volumeAttachment": {"volumeId": "15e5216f-321c-4ac4-870f-a5ee1d655ddf"}} Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: exception: Invalid volume: volume 15e5216f-321c-4ac4-870f-a5ee1d655ddf is already attached to instances: 0063f3a7-735d-438e-a375-3b2a83bef991 Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'server_id': '0063f3a7-735d-438e-a375-3b2a83bef991', 'body': {'volumeAttachment': {'volumeId': '15e5216f-321c-4ac4-870f-a5ee1d655ddf'}}} Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 15e5216f-321c-4ac4-870f-a5ee1d655ddf is already attached to instances: 0063f3a7-735d-438e-a375-3b2a83bef991 Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:00:57.794785 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:00:57.799956 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:00:57.799956 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:00:57.799956 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 04 17:00:57.799956 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 17:00:57.799956 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 15e5216f-321c-4ac4-870f-a5ee1d655ddf is already attached to instances: 0063f3a7-735d-438e-a375-3b2a83bef991 Aug 04 17:00:57.799956 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:57.799956 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:57.799956 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:57.799956 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:57.799956 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:57.799956 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:57.799956 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:00:57.799956 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:00:57.799956 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 15e5216f-321c-4ac4-870f-a5ee1d655ddf is already attached to instances: 0063f3a7-735d-438e-a375-3b2a83bef991 Aug 04 17:00:57.799956 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:00:57.803168 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-49ba6307-bf51-4322-b469-66cce78ec10a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Returning 400 to user: Invalid volume: volume 15e5216f-321c-4ac4-870f-a5ee1d655ddf is already attached to instances: 0063f3a7-735d-438e-a375-3b2a83bef991 {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:00:57.805030 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-49ba6307-bf51-4322-b469-66cce78ec10a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "POST /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.247185 Aug 04 17:00:57.806439 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2402/4695] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Aug 4 17:00:57 2022] POST /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991/os-volume_attachments => generated 174 bytes in 250 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 17:00:57.839851 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-55d0dc81-5465-4dfe-b545-85e9923ea2c9 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:57.845504 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-55d0dc81-5465-4dfe-b545-85e9923ea2c9 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:57.867744 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-55d0dc81-5465-4dfe-b545-85e9923ea2c9 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:57.868509 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-55d0dc81-5465-4dfe-b545-85e9923ea2c9 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:57.869999 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-55d0dc81-5465-4dfe-b545-85e9923ea2c9 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:57.871505 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-55d0dc81-5465-4dfe-b545-85e9923ea2c9 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:58.002515 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7a84654b-4bca-466e-aee7-b7813acb97e7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:58.044691 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7a84654b-4bca-466e-aee7-b7813acb97e7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be" status: 200 len: 1393 microversion: 2.1 time: 0.419291 Aug 04 17:00:58.045572 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2294/4696] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:57 2022] GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be => generated 1393 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:58.071694 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b7ba74ce-c881-45e7-a432-2c61c4f30527 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:58.073316 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b7ba74ce-c881-45e7-a432-2c61c4f30527 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 0063f3a7-735d-438e-a375-3b2a83bef991] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:58.088989 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7ba74ce-c881-45e7-a432-2c61c4f30527 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:58.090276 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7ba74ce-c881-45e7-a432-2c61c4f30527 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:58.092271 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7ba74ce-c881-45e7-a432-2c61c4f30527 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:58.093522 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7ba74ce-c881-45e7-a432-2c61c4f30527 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:58.160826 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-55d0dc81-5465-4dfe-b545-85e9923ea2c9 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:58.177856 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-55d0dc81-5465-4dfe-b545-85e9923ea2c9 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1272 microversion: 2.1 time: 0.351050 Aug 04 17:00:58.179655 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2403/4697] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:57 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1272 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:58.232390 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2c8f845b-9b15-4abc-a459-16f7f587c957 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:58.233927 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2c8f845b-9b15-4abc-a459-16f7f587c957 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:58.253883 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2c8f845b-9b15-4abc-a459-16f7f587c957 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:58.254330 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2c8f845b-9b15-4abc-a459-16f7f587c957 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:58.255139 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2c8f845b-9b15-4abc-a459-16f7f587c957 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:58.255572 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2c8f845b-9b15-4abc-a459-16f7f587c957 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:58.357721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-b7ba74ce-c881-45e7-a432-2c61c4f30527 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lazy-loading 'services' on Instance uuid 0063f3a7-735d-438e-a375-3b2a83bef991 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:00:58.540757 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b7ba74ce-c881-45e7-a432-2c61c4f30527 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991/os-volume_attachments/15e5216f-321c-4ac4-870f-a5ee1d655ddf" status: 202 len: 0 microversion: 2.1 time: 0.483866 Aug 04 17:00:58.543594 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2295/4698] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Aug 4 17:00:58 2022] DELETE /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991/os-volume_attachments/15e5216f-321c-4ac4-870f-a5ee1d655ddf => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:00:58.564305 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b38a44bf-6d30-4c2d-9238-f7b1b181f4bf tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:58.570798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b38a44bf-6d30-4c2d-9238-f7b1b181f4bf tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 0063f3a7-735d-438e-a375-3b2a83bef991] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:58.619320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b38a44bf-6d30-4c2d-9238-f7b1b181f4bf tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:58.619946 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b38a44bf-6d30-4c2d-9238-f7b1b181f4bf tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:58.621548 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b38a44bf-6d30-4c2d-9238-f7b1b181f4bf tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:58.622029 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b38a44bf-6d30-4c2d-9238-f7b1b181f4bf tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:58.714789 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b38a44bf-6d30-4c2d-9238-f7b1b181f4bf tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165543 Aug 04 17:00:58.721171 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2296/4699] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:00:58 2022] GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:58.917554 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2c8f845b-9b15-4abc-a459-16f7f587c957 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:58.932477 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2c8f845b-9b15-4abc-a459-16f7f587c957 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1491 microversion: 2.1 time: 0.707173 Aug 04 17:00:58.933430 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2404/4700] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:58 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1491 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:58.953343 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4b9e1263-d3a2-4f7f-a383-2fe4a9740878 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:58.953874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4b9e1263-d3a2-4f7f-a383-2fe4a9740878 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:58.961824 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b9e1263-d3a2-4f7f-a383-2fe4a9740878 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:58.962505 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b9e1263-d3a2-4f7f-a383-2fe4a9740878 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:58.963821 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b9e1263-d3a2-4f7f-a383-2fe4a9740878 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:58.964418 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b9e1263-d3a2-4f7f-a383-2fe4a9740878 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:59.025668 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-4b9e1263-d3a2-4f7f-a383-2fe4a9740878 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] HTTP exception thrown: Cannot 'pause' instance 7094f480-111a-4c4e-8a77-2df578c044c0 while it is in vm_state paused Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4b9e1263-d3a2-4f7f-a383-2fe4a9740878 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0/action HTTP/1.1 Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 13 Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: {"pause": {}} Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: exception: Cannot 'pause' instance 7094f480-111a-4c4e-8a77-2df578c044c0 while it is in vm_state paused Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '7094f480-111a-4c4e-8a77-2df578c044c0', 'body': {'pause': {}}} Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7094f480-111a-4c4e-8a77-2df578c044c0 in vm_state paused. Cannot pause while the instance is in this state. Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 7094f480-111a-4c4e-8a77-2df578c044c0 while it is in vm_state paused Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:59.028083 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:59.033815 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:59.033815 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:00:59.033815 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:00:59.033815 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 7094f480-111a-4c4e-8a77-2df578c044c0 while it is in vm_state paused Aug 04 17:00:59.033815 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:00:59.035829 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4b9e1263-d3a2-4f7f-a383-2fe4a9740878 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 409 to user: Cannot 'pause' instance 7094f480-111a-4c4e-8a77-2df578c044c0 while it is in vm_state paused {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:00:59.036935 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4b9e1263-d3a2-4f7f-a383-2fe4a9740878 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0/action" status: 409 len: 143 microversion: 2.1 time: 0.087791 Aug 04 17:00:59.042569 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2297/4701] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:00:58 2022] POST /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0/action => generated 143 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:00:59.051487 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c7fec2fa-7a50-4305-8858-738ff8bf8ee7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:59.053118 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c7fec2fa-7a50-4305-8858-738ff8bf8ee7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:59.070273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c7fec2fa-7a50-4305-8858-738ff8bf8ee7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:59.071034 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c7fec2fa-7a50-4305-8858-738ff8bf8ee7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:59.072060 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c7fec2fa-7a50-4305-8858-738ff8bf8ee7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:59.072744 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c7fec2fa-7a50-4305-8858-738ff8bf8ee7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:59.082541 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a801f482-7567-419c-b337-f74b06d3e699 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:59.083228 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a801f482-7567-419c-b337-f74b06d3e699 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 55db3692-c233-452b-860a-81bc8875c6be] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:59.097959 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a801f482-7567-419c-b337-f74b06d3e699 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:59.098409 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a801f482-7567-419c-b337-f74b06d3e699 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:59.106544 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a801f482-7567-419c-b337-f74b06d3e699 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:59.107668 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a801f482-7567-419c-b337-f74b06d3e699 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:59.259593 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c7fec2fa-7a50-4305-8858-738ff8bf8ee7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0/action" status: 202 len: 0 microversion: 2.1 time: 0.214820 Aug 04 17:00:59.260983 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2405/4702] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:00:59 2022] POST /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:00:59.281907 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bd4c5d33-d185-4ad4-a71b-a06aac048a15 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:59.282686 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bd4c5d33-d185-4ad4-a71b-a06aac048a15 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:59.293275 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bd4c5d33-d185-4ad4-a71b-a06aac048a15 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:59.293805 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bd4c5d33-d185-4ad4-a71b-a06aac048a15 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:59.297007 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bd4c5d33-d185-4ad4-a71b-a06aac048a15 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:59.298190 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bd4c5d33-d185-4ad4-a71b-a06aac048a15 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:59.489453 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bd4c5d33-d185-4ad4-a71b-a06aac048a15 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:59.499468 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bd4c5d33-d185-4ad4-a71b-a06aac048a15 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1272 microversion: 2.1 time: 0.236704 Aug 04 17:00:59.500038 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2406/4703] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:59 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1272 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:59.512865 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-df007ef3-7f69-4a63-9c57-e5eb4b14c03e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:59.515646 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-df007ef3-7f69-4a63-9c57-e5eb4b14c03e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:59.531942 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df007ef3-7f69-4a63-9c57-e5eb4b14c03e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:59.532398 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df007ef3-7f69-4a63-9c57-e5eb4b14c03e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:59.533212 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df007ef3-7f69-4a63-9c57-e5eb4b14c03e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:59.533689 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df007ef3-7f69-4a63-9c57-e5eb4b14c03e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:59.931812 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a801f482-7567-419c-b337-f74b06d3e699 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:59.943832 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a801f482-7567-419c-b337-f74b06d3e699 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be" status: 200 len: 1393 microversion: 2.1 time: 0.865788 Aug 04 17:00:59.947863 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2298/4704] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:59 2022] GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be => generated 1393 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:00:59.959741 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7201bffa-79aa-4989-a439-0e58dbc65b66 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:59.964431 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7201bffa-79aa-4989-a439-0e58dbc65b66 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 0063f3a7-735d-438e-a375-3b2a83bef991] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:59.983633 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7201bffa-79aa-4989-a439-0e58dbc65b66 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:59.984387 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7201bffa-79aa-4989-a439-0e58dbc65b66 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:00:59.986055 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7201bffa-79aa-4989-a439-0e58dbc65b66 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:00:59.988534 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7201bffa-79aa-4989-a439-0e58dbc65b66 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:00.040775 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7201bffa-79aa-4989-a439-0e58dbc65b66 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091695 Aug 04 17:01:00.041011 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-df007ef3-7f69-4a63-9c57-e5eb4b14c03e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:00.046736 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2299/4705] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:00:59 2022] GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:00.052340 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-df007ef3-7f69-4a63-9c57-e5eb4b14c03e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.549672 Aug 04 17:01:00.069007 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2407/4706] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:59 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:00.075174 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f22d7439-013d-4deb-a653-776672e28168 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:00.076322 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f22d7439-013d-4deb-a653-776672e28168 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:00.089572 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f22d7439-013d-4deb-a653-776672e28168 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:00.090628 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f22d7439-013d-4deb-a653-776672e28168 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:00.091721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f22d7439-013d-4deb-a653-776672e28168 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:00.092394 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f22d7439-013d-4deb-a653-776672e28168 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:00.522107 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-962094e0-845b-47a3-8060-6f50e57a56cc tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:00.523516 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-962094e0-845b-47a3-8060-6f50e57a56cc tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:00.536663 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-962094e0-845b-47a3-8060-6f50e57a56cc tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:00.542610 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-962094e0-845b-47a3-8060-6f50e57a56cc tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:00.543879 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-962094e0-845b-47a3-8060-6f50e57a56cc tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:00.544480 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-962094e0-845b-47a3-8060-6f50e57a56cc tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:00.888857 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f22d7439-013d-4deb-a653-776672e28168 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:00.903730 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f22d7439-013d-4deb-a653-776672e28168 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.828601 Aug 04 17:01:00.917851 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2300/4707] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:00 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:01:00.930157 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-fc64f93b-0b00-495d-bb52-e27fed3460ae req-05fe162e-0189-4b1b-ab71-43d3194eda01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55db3692-c233-452b-860a-81bc8875c6be", "name": "network-vif-deleted", "tag": "d26fb384-4a3d-4bd0-8166-5c3a407f0693"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:00.958553 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-fc64f93b-0b00-495d-bb52-e27fed3460ae req-05fe162e-0189-4b1b-ab71-43d3194eda01 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:00.959731 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-fc64f93b-0b00-495d-bb52-e27fed3460ae req-05fe162e-0189-4b1b-ab71-43d3194eda01 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:00.991011 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-fc64f93b-0b00-495d-bb52-e27fed3460ae req-05fe162e-0189-4b1b-ab71-43d3194eda01 service nova] Creating event network-vif-deleted:d26fb384-4a3d-4bd0-8166-5c3a407f0693 for instance 55db3692-c233-452b-860a-81bc8875c6be on n-h1-846466-12 Aug 04 17:01:01.002890 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-fc64f93b-0b00-495d-bb52-e27fed3460ae req-05fe162e-0189-4b1b-ab71-43d3194eda01 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083089 Aug 04 17:01:01.004018 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2301/4708] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:01.011015 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-395170ab-d8b3-4f4e-a553-aeffc21ef213 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:01.013798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-395170ab-d8b3-4f4e-a553-aeffc21ef213 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 58ba4011-f974-4687-b3c0-fd8e04ce7600] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:01.023686 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-395170ab-d8b3-4f4e-a553-aeffc21ef213 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:01.024143 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-395170ab-d8b3-4f4e-a553-aeffc21ef213 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:01.024912 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-395170ab-d8b3-4f4e-a553-aeffc21ef213 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:01.025545 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-395170ab-d8b3-4f4e-a553-aeffc21ef213 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:01.045806 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-395170ab-d8b3-4f4e-a553-aeffc21ef213 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] HTTP exception thrown: Instance 58ba4011-f974-4687-b3c0-fd8e04ce7600 could not be found. Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-395170ab-d8b3-4f4e-a553-aeffc21ef213 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600/action HTTP/1.1 Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 28 Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: {"reboot": {"type": "SOFT"}} Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 58ba4011-f974-4687-b3c0-fd8e04ce7600 could not be found. Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '58ba4011-f974-4687-b3c0-fd8e04ce7600', 'body': {'reboot': {'type': 'SOFT'}}} Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58ba4011-f974-4687-b3c0-fd8e04ce7600 could not be found. Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:01:01.049969 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:01:01.055084 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58ba4011-f974-4687-b3c0-fd8e04ce7600 could not be found. Aug 04 17:01:01.055084 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:01.055084 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:01.055084 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:01.055084 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:01.055084 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:01.055084 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:01.055084 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:01:01.055084 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:01:01.055084 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58ba4011-f974-4687-b3c0-fd8e04ce7600 could not be found. Aug 04 17:01:01.055084 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:01.056540 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-962094e0-845b-47a3-8060-6f50e57a56cc tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:01.058549 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-395170ab-d8b3-4f4e-a553-aeffc21ef213 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 404 to user: Instance 58ba4011-f974-4687-b3c0-fd8e04ce7600 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:01:01.059586 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-395170ab-d8b3-4f4e-a553-aeffc21ef213 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600/action" status: 404 len: 111 microversion: 2.1 time: 0.054286 Aug 04 17:01:01.061656 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2302/4709] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:01:01 2022] POST /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:01:01.069380 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-962094e0-845b-47a3-8060-6f50e57a56cc tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1314 microversion: 2.1 time: 0.551237 Aug 04 17:01:01.070317 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cf30de1d-8232-4e95-bc96-4aa2b6750a7d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:01.071043 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cf30de1d-8232-4e95-bc96-4aa2b6750a7d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 55db3692-c233-452b-860a-81bc8875c6be] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:01.072266 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2408/4710] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:00 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1314 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:01.080082 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf30de1d-8232-4e95-bc96-4aa2b6750a7d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:01.083567 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf30de1d-8232-4e95-bc96-4aa2b6750a7d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:01.084967 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-43cf6d38-d142-4233-a752-9df4896ed3d3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:01.085816 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf30de1d-8232-4e95-bc96-4aa2b6750a7d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:01.086649 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf30de1d-8232-4e95-bc96-4aa2b6750a7d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:01.093741 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-43cf6d38-d142-4233-a752-9df4896ed3d3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 0063f3a7-735d-438e-a375-3b2a83bef991] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:01.111095 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-43cf6d38-d142-4233-a752-9df4896ed3d3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:01.111994 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-43cf6d38-d142-4233-a752-9df4896ed3d3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:01.115745 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-43cf6d38-d142-4233-a752-9df4896ed3d3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:01.117022 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-43cf6d38-d142-4233-a752-9df4896ed3d3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:01.167488 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-43cf6d38-d142-4233-a752-9df4896ed3d3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093795 Aug 04 17:01:01.168292 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2409/4711] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:01:01 2022] GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:01.176128 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6f76270d-d486-46df-9272-bd635f12487b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:01.176810 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6f76270d-d486-46df-9272-bd635f12487b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:01.183752 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6f76270d-d486-46df-9272-bd635f12487b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:01.184287 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6f76270d-d486-46df-9272-bd635f12487b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:01.185225 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6f76270d-d486-46df-9272-bd635f12487b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:01.185747 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6f76270d-d486-46df-9272-bd635f12487b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:01.218308 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cf30de1d-8232-4e95-bc96-4aa2b6750a7d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:01.240164 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cf30de1d-8232-4e95-bc96-4aa2b6750a7d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be" status: 200 len: 1186 microversion: 2.1 time: 0.173861 Aug 04 17:01:01.241272 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2303/4712] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:01 2022] GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be => generated 1186 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:01.515866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6f76270d-d486-46df-9272-bd635f12487b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:01.527888 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6f76270d-d486-46df-9272-bd635f12487b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.358133 Aug 04 17:01:01.528565 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2410/4713] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:01 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:01.561819 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-25563724-6f59-4464-80f5-02a87ba4c52e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:01.562788 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-25563724-6f59-4464-80f5-02a87ba4c52e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:01.573588 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-25563724-6f59-4464-80f5-02a87ba4c52e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:01.576717 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-25563724-6f59-4464-80f5-02a87ba4c52e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:01.581407 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-25563724-6f59-4464-80f5-02a87ba4c52e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:01.582087 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-25563724-6f59-4464-80f5-02a87ba4c52e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:01.957915 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-25563724-6f59-4464-80f5-02a87ba4c52e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:01.966417 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-25563724-6f59-4464-80f5-02a87ba4c52e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.420050 Aug 04 17:01:01.974480 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2304/4714] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:01 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:01.988428 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a4fb3137-34d2-4df4-8828-ad29b94a5181 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:01.991223 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a4fb3137-34d2-4df4-8828-ad29b94a5181 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 28624f17-5613-4f08-bcb9-d939ed11a396] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:01.999759 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-a4fb3137-34d2-4df4-8828-ad29b94a5181 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] HTTP exception thrown: Instance 28624f17-5613-4f08-bcb9-d939ed11a396 could not be found. Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a4fb3137-34d2-4df4-8828-ad29b94a5181 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers/28624f17-5613-4f08-bcb9-d939ed11a396/action HTTP/1.1 Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 28 Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: {"reboot": {"type": "SOFT"}} Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 28624f17-5613-4f08-bcb9-d939ed11a396 could not be found. Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '28624f17-5613-4f08-bcb9-d939ed11a396', 'body': {'reboot': {'type': 'SOFT'}}} Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28624f17-5613-4f08-bcb9-d939ed11a396 could not be found. Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28624f17-5613-4f08-bcb9-d939ed11a396 could not be found. Aug 04 17:01:02.001777 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:02.007669 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:02.007669 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:02.007669 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:02.007669 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:02.007669 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:02.007669 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:01:02.007669 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:01:02.007669 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28624f17-5613-4f08-bcb9-d939ed11a396 could not be found. Aug 04 17:01:02.007669 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:02.010960 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a4fb3137-34d2-4df4-8828-ad29b94a5181 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 404 to user: Instance 28624f17-5613-4f08-bcb9-d939ed11a396 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:01:02.012003 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a4fb3137-34d2-4df4-8828-ad29b94a5181 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers/28624f17-5613-4f08-bcb9-d939ed11a396/action" status: 404 len: 111 microversion: 2.1 time: 0.027855 Aug 04 17:01:02.025473 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c5d7d240-18dd-44a1-a970-a2ac5b0f5817 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:02.026296 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c5d7d240-18dd-44a1-a970-a2ac5b0f5817 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:02.030035 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2411/4715] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:01:01 2022] POST /compute/v2.1/servers/28624f17-5613-4f08-bcb9-d939ed11a396/action => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:01:02.034038 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c5d7d240-18dd-44a1-a970-a2ac5b0f5817 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:02.034652 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c5d7d240-18dd-44a1-a970-a2ac5b0f5817 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:02.035575 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c5d7d240-18dd-44a1-a970-a2ac5b0f5817 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:02.036158 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c5d7d240-18dd-44a1-a970-a2ac5b0f5817 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:02.096282 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e0d87cd3-2ef0-4359-8d9e-3584c0c40faa tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:02.099027 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e0d87cd3-2ef0-4359-8d9e-3584c0c40faa tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:02.107762 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e0d87cd3-2ef0-4359-8d9e-3584c0c40faa tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:02.108524 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e0d87cd3-2ef0-4359-8d9e-3584c0c40faa tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:02.110246 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e0d87cd3-2ef0-4359-8d9e-3584c0c40faa tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:02.111185 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e0d87cd3-2ef0-4359-8d9e-3584c0c40faa tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:02.682974 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c5d7d240-18dd-44a1-a970-a2ac5b0f5817 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:02.696285 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c5d7d240-18dd-44a1-a970-a2ac5b0f5817 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.678163 Aug 04 17:01:02.700082 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2305/4716] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:02 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:02.707571 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2d53c2c5-3986-46ba-95aa-5122a547465a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:02.711084 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2d53c2c5-3986-46ba-95aa-5122a547465a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 0063f3a7-735d-438e-a375-3b2a83bef991] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:02.726197 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2d53c2c5-3986-46ba-95aa-5122a547465a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:02.727254 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2d53c2c5-3986-46ba-95aa-5122a547465a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:02.730044 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2d53c2c5-3986-46ba-95aa-5122a547465a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:02.731197 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2d53c2c5-3986-46ba-95aa-5122a547465a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:02.802532 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2d53c2c5-3986-46ba-95aa-5122a547465a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099977 Aug 04 17:01:02.807824 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2306/4717] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:01:02 2022] GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:02.813157 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0b2dea19-0d12-4d77-84b7-5d49584a7f97 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:02.813811 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0b2dea19-0d12-4d77-84b7-5d49584a7f97 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 55db3692-c233-452b-860a-81bc8875c6be] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:02.820476 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0b2dea19-0d12-4d77-84b7-5d49584a7f97 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:02.821023 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0b2dea19-0d12-4d77-84b7-5d49584a7f97 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:02.821832 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0b2dea19-0d12-4d77-84b7-5d49584a7f97 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:02.822259 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0b2dea19-0d12-4d77-84b7-5d49584a7f97 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:02.840625 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e0d87cd3-2ef0-4359-8d9e-3584c0c40faa tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:02.850247 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e0d87cd3-2ef0-4359-8d9e-3584c0c40faa tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1314 microversion: 2.1 time: 0.758671 Aug 04 17:01:02.864978 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2412/4718] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:02 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1314 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:02.871690 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-aed0010c-bf8c-440e-ad5f-1474b6c131d7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:02.872299 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-aed0010c-bf8c-440e-ad5f-1474b6c131d7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:02.879241 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aed0010c-bf8c-440e-ad5f-1474b6c131d7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:02.879953 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aed0010c-bf8c-440e-ad5f-1474b6c131d7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:02.881130 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aed0010c-bf8c-440e-ad5f-1474b6c131d7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:02.882036 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aed0010c-bf8c-440e-ad5f-1474b6c131d7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:02.934340 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0b2dea19-0d12-4d77-84b7-5d49584a7f97 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:02.943177 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0b2dea19-0d12-4d77-84b7-5d49584a7f97 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be" status: 200 len: 1186 microversion: 2.1 time: 0.134211 Aug 04 17:01:02.944070 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2307/4719] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:02 2022] GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be => generated 1186 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:03.050694 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-7279ad5a-e496-4d85-bbf7-a512387e3476 req-6dc70937-a601-48a8-88f4-4a79c8262696 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34fe3f64-3db2-4598-b177-745aae47d69c", "tag": "20f6c94f-9cbb-47b6-aa69-c23626a2c579"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:03.066800 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-7279ad5a-e496-4d85-bbf7-a512387e3476 req-6dc70937-a601-48a8-88f4-4a79c8262696 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:03.067353 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-7279ad5a-e496-4d85-bbf7-a512387e3476 req-6dc70937-a601-48a8-88f4-4a79c8262696 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:03.104312 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-7279ad5a-e496-4d85-bbf7-a512387e3476 req-6dc70937-a601-48a8-88f4-4a79c8262696 service nova] Creating event network-changed:20f6c94f-9cbb-47b6-aa69-c23626a2c579 for instance 34fe3f64-3db2-4598-b177-745aae47d69c on n-h1-846466-12 Aug 04 17:01:03.111160 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-7279ad5a-e496-4d85-bbf7-a512387e3476 req-6dc70937-a601-48a8-88f4-4a79c8262696 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064058 Aug 04 17:01:03.112367 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2308/4720] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:01:03.222545 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-aed0010c-bf8c-440e-ad5f-1474b6c131d7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:03.237069 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-aed0010c-bf8c-440e-ad5f-1474b6c131d7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.367624 Aug 04 17:01:03.241009 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2413/4721] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:02 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:03.273444 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-edf0cfdc-b76f-4b40-b3bf-ef1b9d376275 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:03.276943 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-edf0cfdc-b76f-4b40-b3bf-ef1b9d376275 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 58ba4011-f974-4687-b3c0-fd8e04ce7600] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:03.292079 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-edf0cfdc-b76f-4b40-b3bf-ef1b9d376275 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:03.292899 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-edf0cfdc-b76f-4b40-b3bf-ef1b9d376275 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:03.293941 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-edf0cfdc-b76f-4b40-b3bf-ef1b9d376275 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:03.294741 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-edf0cfdc-b76f-4b40-b3bf-ef1b9d376275 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:03.310032 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-edf0cfdc-b76f-4b40-b3bf-ef1b9d376275 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] HTTP exception thrown: Instance 58ba4011-f974-4687-b3c0-fd8e04ce7600 could not be found. Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-edf0cfdc-b76f-4b40-b3bf-ef1b9d376275 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600/action HTTP/1.1 Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 65 Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: {"rebuild": {"imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00"}} Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 58ba4011-f974-4687-b3c0-fd8e04ce7600 could not be found. Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '58ba4011-f974-4687-b3c0-fd8e04ce7600', 'body': {'rebuild': {'imageRef': '58d80c01-1581-4a2f-bbb0-c2eaf1affa00'}}} Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58ba4011-f974-4687-b3c0-fd8e04ce7600 could not be found. Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 04 17:01:03.312213 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 04 17:01:03.316514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 04 17:01:03.316514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:01:03.316514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:01:03.316514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:01:03.316514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:01:03.316514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58ba4011-f974-4687-b3c0-fd8e04ce7600 could not be found. Aug 04 17:01:03.316514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:03.316514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:03.316514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:03.316514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:03.316514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:03.316514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:03.316514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:01:03.316514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:01:03.316514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58ba4011-f974-4687-b3c0-fd8e04ce7600 could not be found. Aug 04 17:01:03.316514 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:03.320451 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-edf0cfdc-b76f-4b40-b3bf-ef1b9d376275 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 404 to user: Instance 58ba4011-f974-4687-b3c0-fd8e04ce7600 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:01:03.321647 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-edf0cfdc-b76f-4b40-b3bf-ef1b9d376275 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600/action" status: 404 len: 111 microversion: 2.1 time: 0.055473 Aug 04 17:01:03.323033 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2309/4722] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:01:03 2022] POST /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:01:03.331676 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b6797b90-4ea7-424e-9573-271092f26e46 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:03.332640 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b6797b90-4ea7-424e-9573-271092f26e46 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:03.341199 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b6797b90-4ea7-424e-9573-271092f26e46 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:03.341796 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b6797b90-4ea7-424e-9573-271092f26e46 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:03.342680 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b6797b90-4ea7-424e-9573-271092f26e46 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:03.343110 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b6797b90-4ea7-424e-9573-271092f26e46 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:03.579858 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b6797b90-4ea7-424e-9573-271092f26e46 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:03.588674 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b6797b90-4ea7-424e-9573-271092f26e46 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.260899 Aug 04 17:01:03.610018 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2414/4723] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:03 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:03.618109 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5e07bf1d-c4d5-40e6-9b7c-d124af3c9643 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:03.619334 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5e07bf1d-c4d5-40e6-9b7c-d124af3c9643 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:03.626662 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e07bf1d-c4d5-40e6-9b7c-d124af3c9643 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:03.627500 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e07bf1d-c4d5-40e6-9b7c-d124af3c9643 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:03.628567 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e07bf1d-c4d5-40e6-9b7c-d124af3c9643 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:03.629225 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e07bf1d-c4d5-40e6-9b7c-d124af3c9643 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:03.815700 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2d22e634-aa29-41e6-bdc2-dec5aaeb42bc tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:03.819013 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2d22e634-aa29-41e6-bdc2-dec5aaeb42bc tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 0063f3a7-735d-438e-a375-3b2a83bef991] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:03.834963 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d22e634-aa29-41e6-bdc2-dec5aaeb42bc tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:03.836150 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d22e634-aa29-41e6-bdc2-dec5aaeb42bc tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:03.838730 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d22e634-aa29-41e6-bdc2-dec5aaeb42bc tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:03.841772 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d22e634-aa29-41e6-bdc2-dec5aaeb42bc tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:03.859108 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5e07bf1d-c4d5-40e6-9b7c-d124af3c9643 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:03.869851 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5e07bf1d-c4d5-40e6-9b7c-d124af3c9643 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.256776 Aug 04 17:01:03.875227 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2310/4724] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:03 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:03.899948 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-64db3c93-944c-4b16-b32c-426340266ded tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:03.905823 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-64db3c93-944c-4b16-b32c-426340266ded tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:03.921711 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-64db3c93-944c-4b16-b32c-426340266ded tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:03.925410 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-64db3c93-944c-4b16-b32c-426340266ded tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:03.926610 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-64db3c93-944c-4b16-b32c-426340266ded tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:03.927734 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-64db3c93-944c-4b16-b32c-426340266ded tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:03.957895 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2d22e634-aa29-41e6-bdc2-dec5aaeb42bc tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146464 Aug 04 17:01:03.959743 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2415/4725] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:01:03 2022] GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:03.974486 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ba92ccb5-134e-45e7-ba5d-ac963b492bfd tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:03.981793 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ba92ccb5-134e-45e7-ba5d-ac963b492bfd tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 0381b313-fa2e-44ad-be41-75df92f65239] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:03.991850 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-ba92ccb5-134e-45e7-ba5d-ac963b492bfd tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] HTTP exception thrown: Instance 0381b313-fa2e-44ad-be41-75df92f65239 could not be found. Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ba92ccb5-134e-45e7-ba5d-ac963b492bfd tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers/0381b313-fa2e-44ad-be41-75df92f65239/action HTTP/1.1 Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 65 Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: {"rebuild": {"imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00"}} Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 0381b313-fa2e-44ad-be41-75df92f65239 could not be found. Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '0381b313-fa2e-44ad-be41-75df92f65239', 'body': {'rebuild': {'imageRef': '58d80c01-1581-4a2f-bbb0-c2eaf1affa00'}}} Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0381b313-fa2e-44ad-be41-75df92f65239 could not be found. Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 04 17:01:03.998342 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:01:04.003649 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:01:04.003649 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:01:04.003649 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:01:04.003649 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0381b313-fa2e-44ad-be41-75df92f65239 could not be found. Aug 04 17:01:04.003649 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:04.003649 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:04.003649 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:04.003649 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:04.003649 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:04.003649 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:04.003649 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:01:04.003649 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:01:04.003649 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0381b313-fa2e-44ad-be41-75df92f65239 could not be found. Aug 04 17:01:04.003649 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:04.010715 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ba92ccb5-134e-45e7-ba5d-ac963b492bfd tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 404 to user: Instance 0381b313-fa2e-44ad-be41-75df92f65239 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:01:04.011822 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ba92ccb5-134e-45e7-ba5d-ac963b492bfd tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers/0381b313-fa2e-44ad-be41-75df92f65239/action" status: 404 len: 111 microversion: 2.1 time: 0.050668 Aug 04 17:01:04.012606 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2416/4726] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:01:03 2022] POST /compute/v2.1/servers/0381b313-fa2e-44ad-be41-75df92f65239/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:01:04.021407 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b3942780-e507-4b9e-bfcd-4005e6d02553 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:04.022024 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b3942780-e507-4b9e-bfcd-4005e6d02553 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 55db3692-c233-452b-860a-81bc8875c6be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:04.031029 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b3942780-e507-4b9e-bfcd-4005e6d02553 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:04.031882 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b3942780-e507-4b9e-bfcd-4005e6d02553 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:04.032890 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b3942780-e507-4b9e-bfcd-4005e6d02553 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:04.033577 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b3942780-e507-4b9e-bfcd-4005e6d02553 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:04.058835 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:04.122389 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b3942780-e507-4b9e-bfcd-4005e6d02553 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:04.133061 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b3942780-e507-4b9e-bfcd-4005e6d02553 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be" status: 200 len: 1186 microversion: 2.1 time: 0.116047 Aug 04 17:01:04.133820 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2417/4727] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:04 2022] GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be => generated 1186 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:04.148478 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ced78af0-f772-4b5a-8269-53f479518fe6 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:04.154394 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ced78af0-f772-4b5a-8269-53f479518fe6 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:04.154625 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-64db3c93-944c-4b16-b32c-426340266ded tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:04.166411 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-64db3c93-944c-4b16-b32c-426340266ded tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1314 microversion: 2.1 time: 0.270965 Aug 04 17:01:04.168317 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2311/4728] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:03 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:04.172516 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ced78af0-f772-4b5a-8269-53f479518fe6 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:04.172965 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ced78af0-f772-4b5a-8269-53f479518fe6 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:04.173783 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ced78af0-f772-4b5a-8269-53f479518fe6 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:04.174674 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ced78af0-f772-4b5a-8269-53f479518fe6 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:04.385088 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ced78af0-f772-4b5a-8269-53f479518fe6 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:04.394454 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ced78af0-f772-4b5a-8269-53f479518fe6 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.259557 Aug 04 17:01:04.399479 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2418/4729] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:04 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:04.423078 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ea406974-bbd3-4ac9-a407-17eeee6a6afc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:04.423914 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ea406974-bbd3-4ac9-a407-17eeee6a6afc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:04.434608 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea406974-bbd3-4ac9-a407-17eeee6a6afc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:04.435428 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea406974-bbd3-4ac9-a407-17eeee6a6afc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:04.436387 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea406974-bbd3-4ac9-a407-17eeee6a6afc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:04.436984 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea406974-bbd3-4ac9-a407-17eeee6a6afc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:04.821678 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ea406974-bbd3-4ac9-a407-17eeee6a6afc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:04.829142 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:04.838446 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ea406974-bbd3-4ac9-a407-17eeee6a6afc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.418326 Aug 04 17:01:04.839549 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2312/4730] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:04 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:01:04.864734 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e96bbab6-98a9-4c97-be1d-117fe57f065e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:04.865496 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e96bbab6-98a9-4c97-be1d-117fe57f065e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: dbc59769-a435-44f5-a921-f92b140e2a24] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:04.879165 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-e96bbab6-98a9-4c97-be1d-117fe57f065e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] HTTP exception thrown: Instance dbc59769-a435-44f5-a921-f92b140e2a24 could not be found. Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e96bbab6-98a9-4c97-be1d-117fe57f065e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers/dbc59769-a435-44f5-a921-f92b140e2a24/action HTTP/1.1 Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 15 Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: {"restore": {}} Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance dbc59769-a435-44f5-a921-f92b140e2a24 could not be found. Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'dbc59769-a435-44f5-a921-f92b140e2a24', 'body': {'restore': {}}} Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbc59769-a435-44f5-a921-f92b140e2a24 could not be found. Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbc59769-a435-44f5-a921-f92b140e2a24 could not be found. Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:04.881313 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:04.891815 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:01:04.891815 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:01:04.891815 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbc59769-a435-44f5-a921-f92b140e2a24 could not be found. Aug 04 17:01:04.891815 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:04.891815 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e96bbab6-98a9-4c97-be1d-117fe57f065e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 404 to user: Instance dbc59769-a435-44f5-a921-f92b140e2a24 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:01:04.891815 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e96bbab6-98a9-4c97-be1d-117fe57f065e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers/dbc59769-a435-44f5-a921-f92b140e2a24/action" status: 404 len: 111 microversion: 2.1 time: 0.026677 Aug 04 17:01:04.891815 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2419/4731] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:01:04 2022] POST /compute/v2.1/servers/dbc59769-a435-44f5-a921-f92b140e2a24/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:01:04.900245 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6a998bb5-e268-408e-a410-68f3de3ab53b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:04.900878 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6a998bb5-e268-408e-a410-68f3de3ab53b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:04.902975 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:04.903662 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:04.926187 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a998bb5-e268-408e-a410-68f3de3ab53b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:04.933316 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a998bb5-e268-408e-a410-68f3de3ab53b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:04.934502 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a998bb5-e268-408e-a410-68f3de3ab53b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:04.935117 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a998bb5-e268-408e-a410-68f3de3ab53b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:04.973309 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9a9c9091-cba1-4ad0-b3c2-08913daed2e7 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:04.976708 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9a9c9091-cba1-4ad0-b3c2-08913daed2e7 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 0063f3a7-735d-438e-a375-3b2a83bef991] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:05.005632 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9a9c9091-cba1-4ad0-b3c2-08913daed2e7 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:05.006198 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9a9c9091-cba1-4ad0-b3c2-08913daed2e7 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:05.007102 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9a9c9091-cba1-4ad0-b3c2-08913daed2e7 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:05.007769 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9a9c9091-cba1-4ad0-b3c2-08913daed2e7 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:05.086830 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9a9c9091-cba1-4ad0-b3c2-08913daed2e7 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118407 Aug 04 17:01:05.088787 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2420/4732] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:01:04 2022] GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:05.156086 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-27eb8b48-47ee-4262-a9b9-349274062a2c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:05.159188 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-27eb8b48-47ee-4262-a9b9-349274062a2c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 55db3692-c233-452b-860a-81bc8875c6be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:05.172075 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-27eb8b48-47ee-4262-a9b9-349274062a2c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:05.174917 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-27eb8b48-47ee-4262-a9b9-349274062a2c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:05.175995 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-27eb8b48-47ee-4262-a9b9-349274062a2c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:05.176915 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-27eb8b48-47ee-4262-a9b9-349274062a2c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:05.233941 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:05.338406 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6a998bb5-e268-408e-a410-68f3de3ab53b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:05.350181 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6a998bb5-e268-408e-a410-68f3de3ab53b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.456279 Aug 04 17:01:05.351436 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2313/4733] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:04 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:05.357506 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-27eb8b48-47ee-4262-a9b9-349274062a2c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:05.361810 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-67e9d5d0-8acd-438d-b584-c510c1bcf3af tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:05.368694 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-67e9d5d0-8acd-438d-b584-c510c1bcf3af tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:05.372655 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-27eb8b48-47ee-4262-a9b9-349274062a2c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be" status: 200 len: 1186 microversion: 2.1 time: 0.221894 Aug 04 17:01:05.379809 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2421/4734] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:05 2022] GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be => generated 1186 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:01:05.386837 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e8b733d5-5590-4689-8d01-d8e33613b441 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:05.386837 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e8b733d5-5590-4689-8d01-d8e33613b441 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:05.395076 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-67e9d5d0-8acd-438d-b584-c510c1bcf3af tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:05.395517 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-67e9d5d0-8acd-438d-b584-c510c1bcf3af tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:05.396305 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-67e9d5d0-8acd-438d-b584-c510c1bcf3af tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:05.397136 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-67e9d5d0-8acd-438d-b584-c510c1bcf3af tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:05.404578 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e8b733d5-5590-4689-8d01-d8e33613b441 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:05.405034 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e8b733d5-5590-4689-8d01-d8e33613b441 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:05.405862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e8b733d5-5590-4689-8d01-d8e33613b441 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:05.406304 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e8b733d5-5590-4689-8d01-d8e33613b441 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:05.785367 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e8b733d5-5590-4689-8d01-d8e33613b441 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:05.799937 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e8b733d5-5590-4689-8d01-d8e33613b441 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.419036 Aug 04 17:01:05.802549 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2422/4735] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:05 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:05.820622 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cf928efd-1d12-4bcb-8cd3-c1e27c4e9e81 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:05.821432 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cf928efd-1d12-4bcb-8cd3-c1e27c4e9e81 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:05.828349 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cf928efd-1d12-4bcb-8cd3-c1e27c4e9e81 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:05.828941 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cf928efd-1d12-4bcb-8cd3-c1e27c4e9e81 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:05.829858 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cf928efd-1d12-4bcb-8cd3-c1e27c4e9e81 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:05.830394 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cf928efd-1d12-4bcb-8cd3-c1e27c4e9e81 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:05.876566 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-67e9d5d0-8acd-438d-b584-c510c1bcf3af tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:05.889951 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-67e9d5d0-8acd-438d-b584-c510c1bcf3af tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1314 microversion: 2.1 time: 0.537139 Aug 04 17:01:05.893855 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2314/4736] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:05 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1314 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:05.910385 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-cf928efd-1d12-4bcb-8cd3-c1e27c4e9e81 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] HTTP exception thrown: Cannot 'restore' instance 7094f480-111a-4c4e-8a77-2df578c044c0 while it is in vm_state active Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cf928efd-1d12-4bcb-8cd3-c1e27c4e9e81 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0/action HTTP/1.1 Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 15 Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: {"restore": {}} Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: exception: Cannot 'restore' instance 7094f480-111a-4c4e-8a77-2df578c044c0 while it is in vm_state active Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '7094f480-111a-4c4e-8a77-2df578c044c0', 'body': {'restore': {}}} Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7094f480-111a-4c4e-8a77-2df578c044c0 in vm_state active. Cannot restore while the instance is in this state. Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 7094f480-111a-4c4e-8a77-2df578c044c0 while it is in vm_state active Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:05.916905 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:05.922184 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:05.922184 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:01:05.922184 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:01:05.922184 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 7094f480-111a-4c4e-8a77-2df578c044c0 while it is in vm_state active Aug 04 17:01:05.922184 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:05.930519 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cf928efd-1d12-4bcb-8cd3-c1e27c4e9e81 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 409 to user: Cannot 'restore' instance 7094f480-111a-4c4e-8a77-2df578c044c0 while it is in vm_state active {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:01:05.931784 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cf928efd-1d12-4bcb-8cd3-c1e27c4e9e81 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0/action" status: 409 len: 145 microversion: 2.1 time: 0.115471 Aug 04 17:01:05.939893 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2423/4737] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:01:05 2022] POST /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0/action => generated 145 bytes in 124 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:01:05.949901 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5b89cd30-b93d-4cf8-83d5-65f68fa20d8f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:05.950783 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5b89cd30-b93d-4cf8-83d5-65f68fa20d8f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:05.967411 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5b89cd30-b93d-4cf8-83d5-65f68fa20d8f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:05.967867 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5b89cd30-b93d-4cf8-83d5-65f68fa20d8f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:05.968659 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5b89cd30-b93d-4cf8-83d5-65f68fa20d8f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:05.969096 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5b89cd30-b93d-4cf8-83d5-65f68fa20d8f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:06.101013 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-87d514a9-4be2-4fae-892b-57a0a432ef0d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:06.103407 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-87d514a9-4be2-4fae-892b-57a0a432ef0d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 0063f3a7-735d-438e-a375-3b2a83bef991] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:06.133911 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-87d514a9-4be2-4fae-892b-57a0a432ef0d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:06.134958 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-87d514a9-4be2-4fae-892b-57a0a432ef0d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:06.135326 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-87d514a9-4be2-4fae-892b-57a0a432ef0d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:06.141434 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-87d514a9-4be2-4fae-892b-57a0a432ef0d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:06.238090 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-87d514a9-4be2-4fae-892b-57a0a432ef0d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.141918 Aug 04 17:01:06.247227 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2424/4738] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:01:06 2022] GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991/os-volume_attachments => generated 25 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 17:01:06.315757 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5b89cd30-b93d-4cf8-83d5-65f68fa20d8f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:06.330022 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5b89cd30-b93d-4cf8-83d5-65f68fa20d8f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.385756 Aug 04 17:01:06.352178 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2315/4739] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:05 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:06.357241 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a7e75a71-ca64-410b-931a-1529f4a0a632 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:06.358144 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a7e75a71-ca64-410b-931a-1529f4a0a632 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:06.373553 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a7e75a71-ca64-410b-931a-1529f4a0a632 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:06.374270 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a7e75a71-ca64-410b-931a-1529f4a0a632 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:06.375293 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a7e75a71-ca64-410b-931a-1529f4a0a632 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:06.375956 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a7e75a71-ca64-410b-931a-1529f4a0a632 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:06.398977 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-699b3b43-6b06-4626-a7a3-4852860c53fb tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:06.399830 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-699b3b43-6b06-4626-a7a3-4852860c53fb tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 55db3692-c233-452b-860a-81bc8875c6be] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:06.419523 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-699b3b43-6b06-4626-a7a3-4852860c53fb tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:06.419821 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-699b3b43-6b06-4626-a7a3-4852860c53fb tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:06.420605 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-699b3b43-6b06-4626-a7a3-4852860c53fb tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:06.421214 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-699b3b43-6b06-4626-a7a3-4852860c53fb tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:06.629490 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-699b3b43-6b06-4626-a7a3-4852860c53fb tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:06.643416 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-699b3b43-6b06-4626-a7a3-4852860c53fb tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be" status: 200 len: 1186 microversion: 2.1 time: 0.248628 Aug 04 17:01:06.665061 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2316/4740] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:06 2022] GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be => generated 1186 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:06.670825 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6f9abd48-e6dc-4b44-b047-de857aa206a3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:06.671883 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6f9abd48-e6dc-4b44-b047-de857aa206a3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 0063f3a7-735d-438e-a375-3b2a83bef991] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:06.682999 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6f9abd48-e6dc-4b44-b047-de857aa206a3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:06.683437 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6f9abd48-e6dc-4b44-b047-de857aa206a3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:06.687379 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6f9abd48-e6dc-4b44-b047-de857aa206a3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:06.691673 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6f9abd48-e6dc-4b44-b047-de857aa206a3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:06.763672 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6f9abd48-e6dc-4b44-b047-de857aa206a3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 0063f3a7-735d-438e-a375-3b2a83bef991] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:01:06.773065 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a7e75a71-ca64-410b-931a-1529f4a0a632 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:06.795294 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a7e75a71-ca64-410b-931a-1529f4a0a632 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.439826 Aug 04 17:01:06.797122 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2425/4741] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:06 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:06.823040 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-52148730-8678-4cca-924c-ef7b5240b3e7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:06.824138 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-52148730-8678-4cca-924c-ef7b5240b3e7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7b49e8f5-7384-4d8a-9877-4d605a859184] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:06.830999 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:06.834833 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-52148730-8678-4cca-924c-ef7b5240b3e7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] HTTP exception thrown: Instance 7b49e8f5-7384-4d8a-9877-4d605a859184 could not be found. Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-52148730-8678-4cca-924c-ef7b5240b3e7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers/7b49e8f5-7384-4d8a-9877-4d605a859184/action HTTP/1.1 Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 14 Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: {"resume": {}} Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 7b49e8f5-7384-4d8a-9877-4d605a859184 could not be found. Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '7b49e8f5-7384-4d8a-9877-4d605a859184', 'body': {'resume': {}}} Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b49e8f5-7384-4d8a-9877-4d605a859184 could not be found. Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b49e8f5-7384-4d8a-9877-4d605a859184 could not be found. Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:06.846948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:06.852290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:01:06.852290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:01:06.852290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b49e8f5-7384-4d8a-9877-4d605a859184 could not be found. Aug 04 17:01:06.852290 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:06.855053 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-52148730-8678-4cca-924c-ef7b5240b3e7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 404 to user: Instance 7b49e8f5-7384-4d8a-9877-4d605a859184 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:01:06.864823 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-52148730-8678-4cca-924c-ef7b5240b3e7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers/7b49e8f5-7384-4d8a-9877-4d605a859184/action" status: 404 len: 111 microversion: 2.1 time: 0.047662 Aug 04 17:01:06.866124 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2426/4742] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:01:06 2022] POST /compute/v2.1/servers/7b49e8f5-7384-4d8a-9877-4d605a859184/action => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:01:06.876736 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-353fdaa3-dc49-4ae6-aa91-e463074b4906 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:06.877511 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-353fdaa3-dc49-4ae6-aa91-e463074b4906 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:06.903663 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-353fdaa3-dc49-4ae6-aa91-e463074b4906 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:06.905974 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-353fdaa3-dc49-4ae6-aa91-e463074b4906 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:06.909997 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-353fdaa3-dc49-4ae6-aa91-e463074b4906 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:06.911869 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-353fdaa3-dc49-4ae6-aa91-e463074b4906 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:07.012205 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6f9abd48-e6dc-4b44-b047-de857aa206a3 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991" status: 204 len: 0 microversion: 2.1 time: 0.343420 Aug 04 17:01:07.014737 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2317/4743] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:01:06 2022] DELETE /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:01:07.026563 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bf30a70b-abaa-451c-91e4-b71e615442ba tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:07.028506 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bf30a70b-abaa-451c-91e4-b71e615442ba tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:07.041566 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf30a70b-abaa-451c-91e4-b71e615442ba tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:07.042576 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf30a70b-abaa-451c-91e4-b71e615442ba tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:07.043621 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf30a70b-abaa-451c-91e4-b71e615442ba tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:07.044492 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf30a70b-abaa-451c-91e4-b71e615442ba tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:07.321965 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-353fdaa3-dc49-4ae6-aa91-e463074b4906 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:07.343673 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-353fdaa3-dc49-4ae6-aa91-e463074b4906 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.473132 Aug 04 17:01:07.366386 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2427/4744] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:06 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:07.373226 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4245196c-4833-4d4d-ac48-0a871bfb234e tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:07.374214 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4245196c-4833-4d4d-ac48-0a871bfb234e tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 0063f3a7-735d-438e-a375-3b2a83bef991] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:07.381165 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4245196c-4833-4d4d-ac48-0a871bfb234e tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:07.383408 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4245196c-4833-4d4d-ac48-0a871bfb234e tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:07.384766 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4245196c-4833-4d4d-ac48-0a871bfb234e tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:07.385316 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4245196c-4833-4d4d-ac48-0a871bfb234e tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:07.545216 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bf30a70b-abaa-451c-91e4-b71e615442ba tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:07.556156 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bf30a70b-abaa-451c-91e4-b71e615442ba tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1314 microversion: 2.1 time: 0.539203 Aug 04 17:01:07.561694 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2318/4745] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:07 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1314 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:07.578196 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d560bf50-3e38-437f-9fc7-7041ec7d193b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:07.579555 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d560bf50-3e38-437f-9fc7-7041ec7d193b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:07.596573 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d560bf50-3e38-437f-9fc7-7041ec7d193b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:07.597115 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d560bf50-3e38-437f-9fc7-7041ec7d193b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:07.597961 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d560bf50-3e38-437f-9fc7-7041ec7d193b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:07.598400 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d560bf50-3e38-437f-9fc7-7041ec7d193b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:07.986859 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d560bf50-3e38-437f-9fc7-7041ec7d193b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:07.995908 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d560bf50-3e38-437f-9fc7-7041ec7d193b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.432689 Aug 04 17:01:07.999071 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2319/4746] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:07 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:08.012221 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c5b10697-8e25-47b7-a000-26cbbc186f60 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:08.018130 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c5b10697-8e25-47b7-a000-26cbbc186f60 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 55db3692-c233-452b-860a-81bc8875c6be] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:08.027183 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c5b10697-8e25-47b7-a000-26cbbc186f60 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:08.032696 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c5b10697-8e25-47b7-a000-26cbbc186f60 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:08.033850 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c5b10697-8e25-47b7-a000-26cbbc186f60 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:08.034523 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c5b10697-8e25-47b7-a000-26cbbc186f60 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:08.069099 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4245196c-4833-4d4d-ac48-0a871bfb234e tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:08.078804 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4245196c-4833-4d4d-ac48-0a871bfb234e tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991" status: 200 len: 1675 microversion: 2.1 time: 0.710926 Aug 04 17:01:08.082349 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2428/4747] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:07 2022] GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991 => generated 1675 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:08.090953 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a113d664-4566-42ed-b277-c3fa13fa051f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:08.100847 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a113d664-4566-42ed-b277-c3fa13fa051f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:08.118049 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a113d664-4566-42ed-b277-c3fa13fa051f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:08.121597 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a113d664-4566-42ed-b277-c3fa13fa051f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:08.122709 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a113d664-4566-42ed-b277-c3fa13fa051f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:08.123170 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a113d664-4566-42ed-b277-c3fa13fa051f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:08.145526 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c5b10697-8e25-47b7-a000-26cbbc186f60 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:08.154213 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c5b10697-8e25-47b7-a000-26cbbc186f60 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be" status: 200 len: 1186 microversion: 2.1 time: 0.152512 Aug 04 17:01:08.154809 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2320/4748] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:07 2022] GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be => generated 1186 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:08.175910 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-a113d664-4566-42ed-b277-c3fa13fa051f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] HTTP exception thrown: Cannot 'resume' instance 7094f480-111a-4c4e-8a77-2df578c044c0 while it is in vm_state active Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a113d664-4566-42ed-b277-c3fa13fa051f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0/action HTTP/1.1 Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 14 Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: {"resume": {}} Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: exception: Cannot 'resume' instance 7094f480-111a-4c4e-8a77-2df578c044c0 while it is in vm_state active Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '7094f480-111a-4c4e-8a77-2df578c044c0', 'body': {'resume': {}}} Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7094f480-111a-4c4e-8a77-2df578c044c0 in vm_state active. Cannot resume while the instance is in this state. Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 7094f480-111a-4c4e-8a77-2df578c044c0 while it is in vm_state active Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:08.179789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:08.185207 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:08.185207 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:01:08.185207 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:01:08.185207 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 7094f480-111a-4c4e-8a77-2df578c044c0 while it is in vm_state active Aug 04 17:01:08.185207 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:08.186565 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a113d664-4566-42ed-b277-c3fa13fa051f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 409 to user: Cannot 'resume' instance 7094f480-111a-4c4e-8a77-2df578c044c0 while it is in vm_state active {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:01:08.188057 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a113d664-4566-42ed-b277-c3fa13fa051f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0/action" status: 409 len: 144 microversion: 2.1 time: 0.104241 Aug 04 17:01:08.189139 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2429/4749] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:01:08 2022] POST /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0/action => generated 144 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:01:08.197136 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-830ab81e-da50-4fef-9d24-721846c634f1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:08.197814 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-830ab81e-da50-4fef-9d24-721846c634f1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:08.206509 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-830ab81e-da50-4fef-9d24-721846c634f1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:08.211848 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-830ab81e-da50-4fef-9d24-721846c634f1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:08.212936 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-830ab81e-da50-4fef-9d24-721846c634f1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:08.213559 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-830ab81e-da50-4fef-9d24-721846c634f1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:08.480579 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-830ab81e-da50-4fef-9d24-721846c634f1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:08.496946 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-830ab81e-da50-4fef-9d24-721846c634f1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.302550 Aug 04 17:01:08.508129 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2321/4750] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:08 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:08.521725 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-67ab08c4-4884-44cb-8b40-8772dbff0174 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:08.522669 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-67ab08c4-4884-44cb-8b40-8772dbff0174 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:08.530125 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-67ab08c4-4884-44cb-8b40-8772dbff0174 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:08.531190 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-67ab08c4-4884-44cb-8b40-8772dbff0174 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:08.532155 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-67ab08c4-4884-44cb-8b40-8772dbff0174 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:08.532800 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-67ab08c4-4884-44cb-8b40-8772dbff0174 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:08.598200 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-efc23a20-ec06-4be6-9d1c-c901b62ae51c tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:08.606124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-efc23a20-ec06-4be6-9d1c-c901b62ae51c tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:08.631865 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-efc23a20-ec06-4be6-9d1c-c901b62ae51c tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:08.632368 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-efc23a20-ec06-4be6-9d1c-c901b62ae51c tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:08.633155 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-efc23a20-ec06-4be6-9d1c-c901b62ae51c tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:08.633620 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-efc23a20-ec06-4be6-9d1c-c901b62ae51c tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:08.991985 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-67ab08c4-4884-44cb-8b40-8772dbff0174 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:09.005320 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-67ab08c4-4884-44cb-8b40-8772dbff0174 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.487553 Aug 04 17:01:09.006210 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2430/4751] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:08 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:09.032600 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-efc23a20-ec06-4be6-9d1c-c901b62ae51c tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:09.064387 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-efc23a20-ec06-4be6-9d1c-c901b62ae51c tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1314 microversion: 2.1 time: 0.483123 Aug 04 17:01:09.067841 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2322/4752] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:08 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:01:09.100577 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7cabf210-137a-47f1-bb23-65b6c16f65c1 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:09.103268 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7cabf210-137a-47f1-bb23-65b6c16f65c1 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 0063f3a7-735d-438e-a375-3b2a83bef991] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:09.110888 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7cabf210-137a-47f1-bb23-65b6c16f65c1 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:09.111631 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7cabf210-137a-47f1-bb23-65b6c16f65c1 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:09.113393 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7cabf210-137a-47f1-bb23-65b6c16f65c1 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:09.114080 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7cabf210-137a-47f1-bb23-65b6c16f65c1 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:09.177235 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4eb4084a-93dc-4003-b374-cb839e2b118b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:09.179052 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4eb4084a-93dc-4003-b374-cb839e2b118b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 55db3692-c233-452b-860a-81bc8875c6be] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:09.212746 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4eb4084a-93dc-4003-b374-cb839e2b118b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:09.213679 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4eb4084a-93dc-4003-b374-cb839e2b118b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:09.214942 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4eb4084a-93dc-4003-b374-cb839e2b118b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:09.215674 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4eb4084a-93dc-4003-b374-cb839e2b118b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:09.330496 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4eb4084a-93dc-4003-b374-cb839e2b118b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:09.341135 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4eb4084a-93dc-4003-b374-cb839e2b118b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be" status: 200 len: 1186 microversion: 2.1 time: 0.169835 Aug 04 17:01:09.343182 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2323/4753] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:09 2022] GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be => generated 1186 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:01:09.348319 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-edf862de-9355-4d09-ae0d-43034a442e63 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "9a956378-b79d-4451-b0d0-c11ff419c38c"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-edf862de-9355-4d09-ae0d-43034a442e63 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 160 Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: {"server": {"name": "", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "9a956378-b79d-4451-b0d0-c11ff419c38c"}]}} Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'body': {'server': {'name': '', 'imageRef': '58d80c01-1581-4a2f-bbb0-c2eaf1affa00', 'flavorRef': '452', 'networks': [{'uuid': '9a956378-b79d-4451-b0d0-c11ff419c38c'}]}}} Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi '' Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:01:09.354056 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:01:09.358714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:01:09.358714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 04 17:01:09.358714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:09.358714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:09.358714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:09.358714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:09.358714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:09.358714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:09.358714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:01:09.358714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:01:09.358714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 04 17:01:09.358714 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:09.361024 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-edf862de-9355-4d09-ae0d-43034a442e63 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:01:09.362108 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-edf862de-9355-4d09-ae0d-43034a442e63 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.017594 Aug 04 17:01:09.367195 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2324/4754] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:01:09 2022] POST /compute/v2.1/servers => generated 108 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:01:09.373765 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f95bc2d2-dced-447f-9d63-668e097a7e35 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:09.374676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f95bc2d2-dced-447f-9d63-668e097a7e35 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:09.384183 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f95bc2d2-dced-447f-9d63-668e097a7e35 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:09.384918 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f95bc2d2-dced-447f-9d63-668e097a7e35 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:09.386296 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f95bc2d2-dced-447f-9d63-668e097a7e35 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:09.386912 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f95bc2d2-dced-447f-9d63-668e097a7e35 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:09.414081 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7cabf210-137a-47f1-bb23-65b6c16f65c1 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:09.425507 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7cabf210-137a-47f1-bb23-65b6c16f65c1 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991" status: 200 len: 1675 microversion: 2.1 time: 0.328528 Aug 04 17:01:09.426865 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2431/4755] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:09 2022] GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991 => generated 1675 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:09.606927 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f95bc2d2-dced-447f-9d63-668e097a7e35 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:09.616788 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f95bc2d2-dced-447f-9d63-668e097a7e35 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.248067 Aug 04 17:01:09.630614 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2325/4756] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:09 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:09.645815 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-363e39d8-f7eb-42f7-a762-93b0f9ef1dbc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:09.646717 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-363e39d8-f7eb-42f7-a762-93b0f9ef1dbc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:09.660696 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-363e39d8-f7eb-42f7-a762-93b0f9ef1dbc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:09.661657 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-363e39d8-f7eb-42f7-a762-93b0f9ef1dbc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:09.662893 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-363e39d8-f7eb-42f7-a762-93b0f9ef1dbc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:09.663613 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-363e39d8-f7eb-42f7-a762-93b0f9ef1dbc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:09.806806 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-e23d28f3-8ec4-44b0-890b-06f9b363770e req-45ea13bb-8ee5-403f-9238-c3892fd3f6ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34fe3f64-3db2-4598-b177-745aae47d69c", "name": "network-vif-plugged", "status": "completed", "tag": "20f6c94f-9cbb-47b6-aa69-c23626a2c579"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:09.826977 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-e23d28f3-8ec4-44b0-890b-06f9b363770e req-45ea13bb-8ee5-403f-9238-c3892fd3f6ec service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:09.827390 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-e23d28f3-8ec4-44b0-890b-06f9b363770e req-45ea13bb-8ee5-403f-9238-c3892fd3f6ec service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:09.852368 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-e23d28f3-8ec4-44b0-890b-06f9b363770e req-45ea13bb-8ee5-403f-9238-c3892fd3f6ec service nova] Creating event network-vif-plugged:20f6c94f-9cbb-47b6-aa69-c23626a2c579 for instance 34fe3f64-3db2-4598-b177-745aae47d69c on n-h1-846466-12 Aug 04 17:01:09.860212 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-e23d28f3-8ec4-44b0-890b-06f9b363770e req-45ea13bb-8ee5-403f-9238-c3892fd3f6ec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057949 Aug 04 17:01:09.863270 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2326/4757] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:01:09.903661 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-363e39d8-f7eb-42f7-a762-93b0f9ef1dbc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:09.927476 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-363e39d8-f7eb-42f7-a762-93b0f9ef1dbc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.285609 Aug 04 17:01:09.935359 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2432/4758] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:09 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:09.961703 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f24cdf1c-7fb6-4bba-aed6-25f5e228f68f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:09.962350 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f24cdf1c-7fb6-4bba-aed6-25f5e228f68f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: b0f81fed-29ad-4015-bdd7-d0a591d83b9b] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:09.977338 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-f24cdf1c-7fb6-4bba-aed6-25f5e228f68f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] HTTP exception thrown: Instance b0f81fed-29ad-4015-bdd7-d0a591d83b9b could not be found. Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f24cdf1c-7fb6-4bba-aed6-25f5e228f68f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers/b0f81fed-29ad-4015-bdd7-d0a591d83b9b/action HTTP/1.1 Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 14 Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: {"shelve": {}} Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance b0f81fed-29ad-4015-bdd7-d0a591d83b9b could not be found. Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'b0f81fed-29ad-4015-bdd7-d0a591d83b9b', 'body': {'shelve': {}}} Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0f81fed-29ad-4015-bdd7-d0a591d83b9b could not be found. Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0f81fed-29ad-4015-bdd7-d0a591d83b9b could not be found. Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:09.986903 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:09.995310 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:01:09.995310 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:01:09.995310 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0f81fed-29ad-4015-bdd7-d0a591d83b9b could not be found. Aug 04 17:01:09.995310 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:09.995310 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f24cdf1c-7fb6-4bba-aed6-25f5e228f68f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 404 to user: Instance b0f81fed-29ad-4015-bdd7-d0a591d83b9b could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:01:09.995310 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f24cdf1c-7fb6-4bba-aed6-25f5e228f68f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers/b0f81fed-29ad-4015-bdd7-d0a591d83b9b/action" status: 404 len: 111 microversion: 2.1 time: 0.033111 Aug 04 17:01:09.995310 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2327/4759] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:01:09 2022] POST /compute/v2.1/servers/b0f81fed-29ad-4015-bdd7-d0a591d83b9b/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:01:09.999050 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-580d1ab1-5bb8-4d74-937a-398339a58750 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:09.999748 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-580d1ab1-5bb8-4d74-937a-398339a58750 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:10.011663 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-580d1ab1-5bb8-4d74-937a-398339a58750 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:10.012110 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-580d1ab1-5bb8-4d74-937a-398339a58750 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:10.019886 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-580d1ab1-5bb8-4d74-937a-398339a58750 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:10.020470 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-580d1ab1-5bb8-4d74-937a-398339a58750 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:10.095485 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c1d248a9-9336-4515-ad2b-43c5306489c8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:10.096902 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c1d248a9-9336-4515-ad2b-43c5306489c8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:10.114375 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c1d248a9-9336-4515-ad2b-43c5306489c8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:10.115275 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c1d248a9-9336-4515-ad2b-43c5306489c8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:10.123509 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c1d248a9-9336-4515-ad2b-43c5306489c8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:10.129242 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c1d248a9-9336-4515-ad2b-43c5306489c8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:10.407363 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-580d1ab1-5bb8-4d74-937a-398339a58750 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:10.424714 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-580d1ab1-5bb8-4d74-937a-398339a58750 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.426959 Aug 04 17:01:10.425754 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2433/4760] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:09 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:10.436749 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ba6cfced-c97b-4dde-8f05-06d8942fde09 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:10.445875 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ba6cfced-c97b-4dde-8f05-06d8942fde09 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 55db3692-c233-452b-860a-81bc8875c6be] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:10.467535 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c1d248a9-9336-4515-ad2b-43c5306489c8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:10.472938 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba6cfced-c97b-4dde-8f05-06d8942fde09 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:10.474572 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba6cfced-c97b-4dde-8f05-06d8942fde09 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:10.478114 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba6cfced-c97b-4dde-8f05-06d8942fde09 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:10.478689 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c1d248a9-9336-4515-ad2b-43c5306489c8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1314 microversion: 2.1 time: 0.393594 Aug 04 17:01:10.489656 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2328/4761] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:10 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:10.489656 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-11f0026e-3f97-4e3e-ae38-7e7bb99eaa32 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:10.489656 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-11f0026e-3f97-4e3e-ae38-7e7bb99eaa32 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 0063f3a7-735d-438e-a375-3b2a83bef991] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:10.492413 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba6cfced-c97b-4dde-8f05-06d8942fde09 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:10.496339 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-11f0026e-3f97-4e3e-ae38-7e7bb99eaa32 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:10.496530 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-11f0026e-3f97-4e3e-ae38-7e7bb99eaa32 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:10.497420 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-11f0026e-3f97-4e3e-ae38-7e7bb99eaa32 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:10.497855 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-11f0026e-3f97-4e3e-ae38-7e7bb99eaa32 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:10.620270 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ba6cfced-c97b-4dde-8f05-06d8942fde09 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:10.631514 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ba6cfced-c97b-4dde-8f05-06d8942fde09 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be" status: 200 len: 1186 microversion: 2.1 time: 0.202820 Aug 04 17:01:10.633897 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2434/4762] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:10 2022] GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be => generated 1186 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:10.643339 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-58275896-0049-4e51-baef-635a57e752e1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:10.647180 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-58275896-0049-4e51-baef-635a57e752e1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:10.660829 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58275896-0049-4e51-baef-635a57e752e1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:10.661308 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58275896-0049-4e51-baef-635a57e752e1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:10.662099 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58275896-0049-4e51-baef-635a57e752e1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:10.665791 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58275896-0049-4e51-baef-635a57e752e1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:10.872803 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-11f0026e-3f97-4e3e-ae38-7e7bb99eaa32 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:10.889176 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-11f0026e-3f97-4e3e-ae38-7e7bb99eaa32 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991" status: 200 len: 1675 microversion: 2.1 time: 0.406326 Aug 04 17:01:10.893038 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2329/4763] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:10 2022] GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991 => generated 1675 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:10.914650 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-58275896-0049-4e51-baef-635a57e752e1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:10.925148 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-58275896-0049-4e51-baef-635a57e752e1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.289744 Aug 04 17:01:10.927800 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2435/4764] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:10 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:10.947362 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-941dd962-707a-425a-aaee-a729f338a893 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:10.947859 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-941dd962-707a-425a-aaee-a729f338a893 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:10.954604 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-941dd962-707a-425a-aaee-a729f338a893 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:10.955026 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-941dd962-707a-425a-aaee-a729f338a893 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:10.955796 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-941dd962-707a-425a-aaee-a729f338a893 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:10.956222 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-941dd962-707a-425a-aaee-a729f338a893 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:10.976233 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:10.987257 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-941dd962-707a-425a-aaee-a729f338a893 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lazy-loading 'flavor' on Instance uuid 7094f480-111a-4c4e-8a77-2df578c044c0 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:01:11.280838 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-941dd962-707a-425a-aaee-a729f338a893 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0/action" status: 202 len: 0 microversion: 2.1 time: 0.337525 Aug 04 17:01:11.286549 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2330/4765] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:01:10 2022] POST /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:01:11.289866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6a7aafd1-ea6c-4bfe-9272-51ab458c853a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:11.290481 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6a7aafd1-ea6c-4bfe-9272-51ab458c853a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:11.376983 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a7aafd1-ea6c-4bfe-9272-51ab458c853a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:11.394327 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a7aafd1-ea6c-4bfe-9272-51ab458c853a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:11.395342 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a7aafd1-ea6c-4bfe-9272-51ab458c853a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:11.395796 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a7aafd1-ea6c-4bfe-9272-51ab458c853a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:11.505689 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a2a32d44-c1d1-4761-8f89-327719ef8a21 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:11.506493 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a2a32d44-c1d1-4761-8f89-327719ef8a21 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:11.524329 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a2a32d44-c1d1-4761-8f89-327719ef8a21 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:11.524885 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a2a32d44-c1d1-4761-8f89-327719ef8a21 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:11.526143 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a2a32d44-c1d1-4761-8f89-327719ef8a21 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:11.526306 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a2a32d44-c1d1-4761-8f89-327719ef8a21 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:11.666585 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6a7aafd1-ea6c-4bfe-9272-51ab458c853a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:11.671535 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=100 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:11.678461 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6a7aafd1-ea6c-4bfe-9272-51ab458c853a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1512 microversion: 2.1 time: 0.392479 Aug 04 17:01:11.679885 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2436/4766] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:11 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1512 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:01:11.769692 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a2a32d44-c1d1-4761-8f89-327719ef8a21 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:11.780698 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a2a32d44-c1d1-4761-8f89-327719ef8a21 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1314 microversion: 2.1 time: 0.279981 Aug 04 17:01:11.782841 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2331/4767] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:11 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:01:11.799382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5c4dbea6-1bbf-4463-afec-cc49bcb4e64f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:11.802312 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5c4dbea6-1bbf-4463-afec-cc49bcb4e64f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 55db3692-c233-452b-860a-81bc8875c6be] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:11.811641 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5c4dbea6-1bbf-4463-afec-cc49bcb4e64f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:11.812463 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5c4dbea6-1bbf-4463-afec-cc49bcb4e64f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:11.814100 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5c4dbea6-1bbf-4463-afec-cc49bcb4e64f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:11.814837 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5c4dbea6-1bbf-4463-afec-cc49bcb4e64f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:11.917754 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5c4dbea6-1bbf-4463-afec-cc49bcb4e64f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:11.931026 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5c4dbea6-1bbf-4463-afec-cc49bcb4e64f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be" status: 200 len: 1186 microversion: 2.1 time: 0.146048 Aug 04 17:01:11.947509 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2332/4768] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:11 2022] GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be => generated 1186 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:11.954563 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3db152c9-cabe-485c-bf79-4871a09e9e36 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:11.962105 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3db152c9-cabe-485c-bf79-4871a09e9e36 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 0063f3a7-735d-438e-a375-3b2a83bef991] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:11.972315 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3db152c9-cabe-485c-bf79-4871a09e9e36 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:11.972766 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3db152c9-cabe-485c-bf79-4871a09e9e36 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:11.974038 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3db152c9-cabe-485c-bf79-4871a09e9e36 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:11.974733 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3db152c9-cabe-485c-bf79-4871a09e9e36 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:11.988719 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c45d2473-59f2-48a2-b7b6-de031662b57b tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1144337986", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "9f6c3d8d-d29e-4b45-a7c2-cc67014a0ed9"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:12.087127 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3db152c9-cabe-485c-bf79-4871a09e9e36 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:12.091237 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-c45d2473-59f2-48a2-b7b6-de031662b57b tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] validate_networks() for [('9f6c3d8d-d29e-4b45-a7c2-cc67014a0ed9', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:01:12.112797 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3db152c9-cabe-485c-bf79-4871a09e9e36 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991" status: 200 len: 1610 microversion: 2.1 time: 0.164066 Aug 04 17:01:12.113609 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2333/4769] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:11 2022] GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991 => generated 1610 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:12.678202 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-db27883a-cc0f-4a54-bebe-824d00cbef4f req-a6b860c0-8051-446c-aa7e-dffebccfdd65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0063f3a7-735d-438e-a375-3b2a83bef991", "name": "network-vif-deleted", "tag": "5c087a04-2adb-42cd-9b46-3aec7dea7767"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:12.698679 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-db27883a-cc0f-4a54-bebe-824d00cbef4f req-a6b860c0-8051-446c-aa7e-dffebccfdd65 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:12.699122 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-db27883a-cc0f-4a54-bebe-824d00cbef4f req-a6b860c0-8051-446c-aa7e-dffebccfdd65 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:12.739867 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-c45d2473-59f2-48a2-b7b6-de031662b57b tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:01:12.740310 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-db27883a-cc0f-4a54-bebe-824d00cbef4f req-a6b860c0-8051-446c-aa7e-dffebccfdd65 service nova] Creating event network-vif-deleted:5c087a04-2adb-42cd-9b46-3aec7dea7767 for instance 0063f3a7-735d-438e-a375-3b2a83bef991 on n-h2-846466-12 Aug 04 17:01:12.740422 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-c45d2473-59f2-48a2-b7b6-de031662b57b tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:01:12.740737 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-c45d2473-59f2-48a2-b7b6-de031662b57b tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:01:12.741200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-c45d2473-59f2-48a2-b7b6-de031662b57b tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:01:12.741841 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-c45d2473-59f2-48a2-b7b6-de031662b57b tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:01:12.752254 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-db27883a-cc0f-4a54-bebe-824d00cbef4f req-a6b860c0-8051-446c-aa7e-dffebccfdd65 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081459 Aug 04 17:01:12.752961 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2334/4770] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:12.761445 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c45d2473-59f2-48a2-b7b6-de031662b57b tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:12.762359 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c45d2473-59f2-48a2-b7b6-de031662b57b tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:12.763510 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c45d2473-59f2-48a2-b7b6-de031662b57b tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:12.765880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c45d2473-59f2-48a2-b7b6-de031662b57b tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:12.774703 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ce7a5ab3-db76-4001-99a0-abb77d385d91 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:12.775466 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ce7a5ab3-db76-4001-99a0-abb77d385d91 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:12.801390 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ce7a5ab3-db76-4001-99a0-abb77d385d91 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:12.802296 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ce7a5ab3-db76-4001-99a0-abb77d385d91 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:12.803250 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ce7a5ab3-db76-4001-99a0-abb77d385d91 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:12.804212 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ce7a5ab3-db76-4001-99a0-abb77d385d91 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:12.811016 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-c45d2473-59f2-48a2-b7b6-de031662b57b tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Getting quotas for project ff21309fd6c943b392615144aa092e4d. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:01:12.827440 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-c45d2473-59f2-48a2-b7b6-de031662b57b tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Getting quotas for user e58bee740320490097a8b7998688e679 and project ff21309fd6c943b392615144aa092e4d. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:01:12.853880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c45d2473-59f2-48a2-b7b6-de031662b57b tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:01:12.856428 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c45d2473-59f2-48a2-b7b6-de031662b57b tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] [instance: d38ee4ca-53a6-44a6-accd-8441ff314a69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:01:12.968015 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c45d2473-59f2-48a2-b7b6-de031662b57b tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.283926 Aug 04 17:01:12.968728 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2437/4771] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:01:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1288 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:01:12.985754 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ed8eaaee-9e0d-4921-aea1-04571897eeb9 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:12.986478 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ed8eaaee-9e0d-4921-aea1-04571897eeb9 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:13.008614 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ed8eaaee-9e0d-4921-aea1-04571897eeb9 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:13.009226 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ed8eaaee-9e0d-4921-aea1-04571897eeb9 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:13.013796 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ed8eaaee-9e0d-4921-aea1-04571897eeb9 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:13.014268 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ed8eaaee-9e0d-4921-aea1-04571897eeb9 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:13.209142 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ce7a5ab3-db76-4001-99a0-abb77d385d91 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:13.222698 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ce7a5ab3-db76-4001-99a0-abb77d385d91 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1512 microversion: 2.1 time: 0.468361 Aug 04 17:01:13.223757 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2335/4772] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:12 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1512 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:13.233512 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5ccfb578-e8d7-49d5-ae12-d7aa5217ec97 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:13.236110 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5ccfb578-e8d7-49d5-ae12-d7aa5217ec97 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 55db3692-c233-452b-860a-81bc8875c6be] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:13.261840 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ccfb578-e8d7-49d5-ae12-d7aa5217ec97 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:13.262547 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ccfb578-e8d7-49d5-ae12-d7aa5217ec97 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:13.263898 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ccfb578-e8d7-49d5-ae12-d7aa5217ec97 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:13.265439 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ccfb578-e8d7-49d5-ae12-d7aa5217ec97 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:13.291505 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ed8eaaee-9e0d-4921-aea1-04571897eeb9 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:13.302442 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ed8eaaee-9e0d-4921-aea1-04571897eeb9 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1500 microversion: 2.1 time: 0.332522 Aug 04 17:01:13.317125 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2438/4773] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:12 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1500 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:13.318530 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-5ccfb578-e8d7-49d5-ae12-d7aa5217ec97 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] HTTP exception thrown: Instance 55db3692-c233-452b-860a-81bc8875c6be could not be found. Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5ccfb578-e8d7-49d5-ae12-d7aa5217ec97 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Request method failure captured: Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be HTTP/1.1 Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_saEEOyGnjC2YSw5rO0XXZ0SIXFPgcyNqjoEnoWtNKNr9NN9-nC4VrXak9kuQQxq1he9punHwiXqtbTRNS_i0OM4UCS6bcDxdgTY6YMq4AHl3lv7jEdWuqMUDAU4k5OfnQSgkMml4THPPXJh4YiohQx-XVMfF21_bM4MqtZQZ4iEBI Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 78a0adb69ba24749817a8855effc20ad Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78a0adb69ba24749817a8855effc20ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_78a0adb69ba24749817a8855effc20ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78a0adb69ba24749817a8855effc20ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/78a0adb69ba24749817a8855effc20ad"}]}] Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 78a0adb69ba24749817a8855effc20ad Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-TestVolumeBootPattern-1920412406-project Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: ea9cab1c1eff47ddb881a2b57bf240f3 Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-TestVolumeBootPattern-1920412406-project Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 55db3692-c233-452b-860a-81bc8875c6be could not be found. Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '55db3692-c233-452b-860a-81bc8875c6be'} Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55db3692-c233-452b-860a-81bc8875c6be could not be found. Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55db3692-c233-452b-860a-81bc8875c6be could not be found. Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:13.320295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:13.325653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:13.325653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:13.325653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:13.325653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:01:13.325653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:01:13.325653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55db3692-c233-452b-860a-81bc8875c6be could not be found. Aug 04 17:01:13.325653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:13.325653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5ccfb578-e8d7-49d5-ae12-d7aa5217ec97 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Returning 404 to user: Instance 55db3692-c233-452b-860a-81bc8875c6be could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:01:13.325653 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5ccfb578-e8d7-49d5-ae12-d7aa5217ec97 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be" status: 404 len: 111 microversion: 2.1 time: 0.097614 Aug 04 17:01:13.325653 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2336/4774] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:13 2022] GET /compute/v2.1/servers/55db3692-c233-452b-860a-81bc8875c6be => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:01:13.328737 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f489af89-3790-4d14-a604-93f62ef199eb tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:13.329371 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f489af89-3790-4d14-a604-93f62ef199eb tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 0063f3a7-735d-438e-a375-3b2a83bef991] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:13.336902 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f489af89-3790-4d14-a604-93f62ef199eb tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:13.345541 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f489af89-3790-4d14-a604-93f62ef199eb tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:13.349098 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f489af89-3790-4d14-a604-93f62ef199eb tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:13.350271 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f489af89-3790-4d14-a604-93f62ef199eb tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:13.370928 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2bf22068-6b1c-4ad0-8d63-7f536f8c47ed tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:13.372093 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2bf22068-6b1c-4ad0-8d63-7f536f8c47ed tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] [instance: d38ee4ca-53a6-44a6-accd-8441ff314a69] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:13.442587 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f489af89-3790-4d14-a604-93f62ef199eb tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:13.443553 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f489af89-3790-4d14-a604-93f62ef199eb tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:13.444453 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-f489af89-3790-4d14-a604-93f62ef199eb tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lazy-loading 'fault' on Instance uuid 0063f3a7-735d-438e-a375-3b2a83bef991 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:01:13.751777 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f489af89-3790-4d14-a604-93f62ef199eb tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:13.771693 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f489af89-3790-4d14-a604-93f62ef199eb tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991" status: 200 len: 1330 microversion: 2.1 time: 0.446567 Aug 04 17:01:13.772498 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2337/4775] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:13 2022] GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991 => generated 1330 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:13.780714 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-760e1978-33e8-4623-a234-1a4564c82bca tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:13.786458 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2bf22068-6b1c-4ad0-8d63-7f536f8c47ed tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58bee740320490097a8b7998688e679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff21309fd6c943b392615144aa092e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:13.790554 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-760e1978-33e8-4623-a234-1a4564c82bca tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:13.800688 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2bf22068-6b1c-4ad0-8d63-7f536f8c47ed tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] 10.222.0.23 "GET /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69" status: 200 len: 1228 microversion: 2.1 time: 0.481098 Aug 04 17:01:13.803486 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2439/4776] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:13 2022] GET /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69 => generated 1228 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:13.809762 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-760e1978-33e8-4623-a234-1a4564c82bca tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:13.810358 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-760e1978-33e8-4623-a234-1a4564c82bca tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:13.811333 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-760e1978-33e8-4623-a234-1a4564c82bca tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:13.813903 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-760e1978-33e8-4623-a234-1a4564c82bca tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:13.873721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-760e1978-33e8-4623-a234-1a4564c82bca tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lazy-loading 'flavor' on Instance uuid 34fe3f64-3db2-4598-b177-745aae47d69c {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:01:14.028117 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-760e1978-33e8-4623-a234-1a4564c82bca tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "POST /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c/action" status: 200 len: 32 microversion: 2.1 time: 0.252059 Aug 04 17:01:14.042863 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2338/4777] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:01:13 2022] POST /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c/action => generated 32 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:01:14.055027 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-099e8252-1126-4b2a-8545-7b01f0da286f tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:14.058783 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-099e8252-1126-4b2a-8545-7b01f0da286f tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:14.068894 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-099e8252-1126-4b2a-8545-7b01f0da286f tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:14.069666 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-099e8252-1126-4b2a-8545-7b01f0da286f tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:14.070680 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-099e8252-1126-4b2a-8545-7b01f0da286f tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:14.071644 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-099e8252-1126-4b2a-8545-7b01f0da286f tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:14.262374 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ec3611d1-762f-46ed-b5d0-38a9e593ae29 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:14.263389 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ec3611d1-762f-46ed-b5d0-38a9e593ae29 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:14.282868 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ec3611d1-762f-46ed-b5d0-38a9e593ae29 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:14.284971 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ec3611d1-762f-46ed-b5d0-38a9e593ae29 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:14.287205 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ec3611d1-762f-46ed-b5d0-38a9e593ae29 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:14.290683 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ec3611d1-762f-46ed-b5d0-38a9e593ae29 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:15.069218 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ec3611d1-762f-46ed-b5d0-38a9e593ae29 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:15.103859 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ec3611d1-762f-46ed-b5d0-38a9e593ae29 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1512 microversion: 2.1 time: 0.847149 Aug 04 17:01:15.104494 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2339/4778] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:14 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1512 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:15.129655 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-37ae107f-6aea-4ff3-b0cc-f18bc2b9e85d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:15.129922 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-37ae107f-6aea-4ff3-b0cc-f18bc2b9e85d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 0063f3a7-735d-438e-a375-3b2a83bef991] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:15.152021 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-37ae107f-6aea-4ff3-b0cc-f18bc2b9e85d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:15.153694 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-37ae107f-6aea-4ff3-b0cc-f18bc2b9e85d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:15.154590 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-37ae107f-6aea-4ff3-b0cc-f18bc2b9e85d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:15.164008 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-37ae107f-6aea-4ff3-b0cc-f18bc2b9e85d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:15.218441 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-37ae107f-6aea-4ff3-b0cc-f18bc2b9e85d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] HTTP exception thrown: Instance 0063f3a7-735d-438e-a375-3b2a83bef991 could not be found. Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-37ae107f-6aea-4ff3-b0cc-f18bc2b9e85d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Request method failure captured: Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991 HTTP/1.1 Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_owNKx0pHV40nqVD-WIcaXEsXOBwQHOEMAVVk2fno070nDFXZRZhhzMgTy8HlVP1AOBt469MYWC_AbeQLbAvgivtdjrTsmGymGu6AtGEk3CEKRMIDLRIpky1rxw9eTh6mgckU3tnNoFbB2in__O_4k2BxkTMZllLYaubH7EDDeTWL4 Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 2534921e8a2f47d394059fee872426a8 Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-AttachVolumeNegativeTest-410766221 Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2534921e8a2f47d394059fee872426a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2534921e8a2f47d394059fee872426a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2534921e8a2f47d394059fee872426a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2534921e8a2f47d394059fee872426a8"}]}] Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-AttachVolumeNegativeTest-410766221 Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 2534921e8a2f47d394059fee872426a8 Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-410766221 Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-AttachVolumeNegativeTest-410766221-project Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: d82f4a672b154291a412a282d1a88208 Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-AttachVolumeNegativeTest-410766221-project Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 0063f3a7-735d-438e-a375-3b2a83bef991 could not be found. Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '0063f3a7-735d-438e-a375-3b2a83bef991'} Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0063f3a7-735d-438e-a375-3b2a83bef991 could not be found. Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0063f3a7-735d-438e-a375-3b2a83bef991 could not be found. Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:15.223409 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:15.229524 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:15.229524 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:15.229524 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:15.229524 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:01:15.229524 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:01:15.229524 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0063f3a7-735d-438e-a375-3b2a83bef991 could not be found. Aug 04 17:01:15.229524 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:15.229524 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-37ae107f-6aea-4ff3-b0cc-f18bc2b9e85d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Returning 404 to user: Instance 0063f3a7-735d-438e-a375-3b2a83bef991 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:01:15.229524 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-37ae107f-6aea-4ff3-b0cc-f18bc2b9e85d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991" status: 404 len: 111 microversion: 2.1 time: 0.121229 Aug 04 17:01:15.233493 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2340/4779] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:15 2022] GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:01:15.248311 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-101de81c-c40a-4caf-b338-65399a342f8a tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:15.251239 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-101de81c-c40a-4caf-b338-65399a342f8a tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] [instance: d38ee4ca-53a6-44a6-accd-8441ff314a69] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:15.255975 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-099e8252-1126-4b2a-8545-7b01f0da286f tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:15.266663 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:15.277707 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-101de81c-c40a-4caf-b338-65399a342f8a tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:15.278320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-101de81c-c40a-4caf-b338-65399a342f8a tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:15.279634 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-101de81c-c40a-4caf-b338-65399a342f8a tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:15.280272 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-101de81c-c40a-4caf-b338-65399a342f8a tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:15.281058 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-099e8252-1126-4b2a-8545-7b01f0da286f tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1506 microversion: 2.1 time: 1.228057 Aug 04 17:01:15.281769 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2440/4780] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:14 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1506 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:15.305799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0a225353-a766-405e-b8c0-f18ad5b2ef3d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '.version_select at 0x7f7e846d8e50>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:15.375287 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0a225353-a766-405e-b8c0-f18ad5b2ef3d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-360744570" status: 202 len: 0 microversion: 2.1 time: 0.086678 Aug 04 17:01:15.377749 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2441/4781] 10.222.0.23 () {58 vars in 1218 bytes} [Thu Aug 4 17:01:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-360744570 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:01:15.485156 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-101de81c-c40a-4caf-b338-65399a342f8a tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58bee740320490097a8b7998688e679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff21309fd6c943b392615144aa092e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:15.517972 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-101de81c-c40a-4caf-b338-65399a342f8a tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] 10.222.0.23 "GET /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69" status: 200 len: 1286 microversion: 2.1 time: 0.271550 Aug 04 17:01:15.521265 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2341/4782] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:15 2022] GET /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69 => generated 1286 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:16.131931 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1b624770-797d-4098-8839-3a65639017ef tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:16.132985 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1b624770-797d-4098-8839-3a65639017ef tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:16.159206 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1b624770-797d-4098-8839-3a65639017ef tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:16.166140 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1b624770-797d-4098-8839-3a65639017ef tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:16.167278 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1b624770-797d-4098-8839-3a65639017ef tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:16.182953 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1b624770-797d-4098-8839-3a65639017ef tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:16.306012 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c9c2dbde-2acb-4798-bcb9-be1e62271ae6 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:16.307235 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c9c2dbde-2acb-4798-bcb9-be1e62271ae6 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:16.321001 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9c2dbde-2acb-4798-bcb9-be1e62271ae6 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:16.321498 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9c2dbde-2acb-4798-bcb9-be1e62271ae6 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:16.322279 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9c2dbde-2acb-4798-bcb9-be1e62271ae6 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:16.324386 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9c2dbde-2acb-4798-bcb9-be1e62271ae6 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:16.975458 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1b624770-797d-4098-8839-3a65639017ef tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:16.988130 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1b624770-797d-4098-8839-3a65639017ef tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1512 microversion: 2.1 time: 0.860966 Aug 04 17:01:17.003864 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2442/4783] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:16 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1512 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:17.009304 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-30279a69-5cef-4c71-808e-b787acc6b813 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:17.010623 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-30279a69-5cef-4c71-808e-b787acc6b813 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] [instance: d38ee4ca-53a6-44a6-accd-8441ff314a69] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:17.019022 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-30279a69-5cef-4c71-808e-b787acc6b813 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:17.027385 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-30279a69-5cef-4c71-808e-b787acc6b813 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:17.028879 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-30279a69-5cef-4c71-808e-b787acc6b813 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:17.029714 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-30279a69-5cef-4c71-808e-b787acc6b813 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:17.336049 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-30279a69-5cef-4c71-808e-b787acc6b813 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58bee740320490097a8b7998688e679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff21309fd6c943b392615144aa092e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:17.348436 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-30279a69-5cef-4c71-808e-b787acc6b813 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] 10.222.0.23 "GET /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69" status: 200 len: 1286 microversion: 2.1 time: 0.342550 Aug 04 17:01:17.351828 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2443/4784] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:17 2022] GET /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69 => generated 1286 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:17.436640 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c9c2dbde-2acb-4798-bcb9-be1e62271ae6 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:17.447589 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c9c2dbde-2acb-4798-bcb9-be1e62271ae6 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1506 microversion: 2.1 time: 1.148477 Aug 04 17:01:17.448236 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2342/4785] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:16 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1506 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:01:17.719824 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f1c62c8e-9e72-4f90-af8c-96b127b89a32 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Action: 'create', calling method: .version_select at 0x7f7e848d1ee0>, body: {"keypair": {"name": "tempest-keypair-1023430209", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7XlZhEjIAKdrxCpNw47tCW7mj+BHGikJq7Eh+ikn/dskoAVRu53DPk2eeGFfEVlEPcbj+C4tp8uWXWADugMdoDj8o7v6OJB/YNozazxM7UJmPRLrEgaiF21fbAPyzN2A=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:17.762943 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-f1c62c8e-9e72-4f90-af8c-96b127b89a32 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Getting quotas for project 2534921e8a2f47d394059fee872426a8. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:01:17.777228 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-f1c62c8e-9e72-4f90-af8c-96b127b89a32 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Getting quotas for user d82f4a672b154291a412a282d1a88208 and project 2534921e8a2f47d394059fee872426a8. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:01:17.850252 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f1c62c8e-9e72-4f90-af8c-96b127b89a32 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.134373 Aug 04 17:01:17.851260 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2444/4786] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 17:01:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:18.013980 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f663ae62-ba6c-4695-8a85-9e36975f09c4 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:18.014858 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f663ae62-ba6c-4695-8a85-9e36975f09c4 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:18.035887 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f663ae62-ba6c-4695-8a85-9e36975f09c4 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:18.036555 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f663ae62-ba6c-4695-8a85-9e36975f09c4 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:18.037243 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f663ae62-ba6c-4695-8a85-9e36975f09c4 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:18.037732 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f663ae62-ba6c-4695-8a85-9e36975f09c4 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:18.370827 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e82c2415-89ec-4b45-ac96-e1d97bf78073 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:18.371462 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e82c2415-89ec-4b45-ac96-e1d97bf78073 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] [instance: d38ee4ca-53a6-44a6-accd-8441ff314a69] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:18.394828 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e82c2415-89ec-4b45-ac96-e1d97bf78073 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:18.395276 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e82c2415-89ec-4b45-ac96-e1d97bf78073 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:18.396075 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e82c2415-89ec-4b45-ac96-e1d97bf78073 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:18.396509 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e82c2415-89ec-4b45-ac96-e1d97bf78073 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:18.509525 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f663ae62-ba6c-4695-8a85-9e36975f09c4 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:18.522614 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f663ae62-ba6c-4695-8a85-9e36975f09c4 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1512 microversion: 2.1 time: 0.515396 Aug 04 17:01:18.541901 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2343/4787] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:18 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1512 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:18.555752 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a01fec5d-5885-4db4-815c-2e0ffa666bf7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:18.558874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a01fec5d-5885-4db4-815c-2e0ffa666bf7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:18.567645 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a01fec5d-5885-4db4-815c-2e0ffa666bf7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:18.568522 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a01fec5d-5885-4db4-815c-2e0ffa666bf7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:18.570162 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a01fec5d-5885-4db4-815c-2e0ffa666bf7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:18.570887 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a01fec5d-5885-4db4-815c-2e0ffa666bf7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:18.878232 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e82c2415-89ec-4b45-ac96-e1d97bf78073 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58bee740320490097a8b7998688e679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff21309fd6c943b392615144aa092e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:18.897754 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e82c2415-89ec-4b45-ac96-e1d97bf78073 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] 10.222.0.23 "GET /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69" status: 200 len: 1328 microversion: 2.1 time: 0.524559 Aug 04 17:01:18.898955 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2445/4788] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:18 2022] GET /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69 => generated 1328 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:19.019016 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a01fec5d-5885-4db4-815c-2e0ffa666bf7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:19.023742 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:19.034309 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a01fec5d-5885-4db4-815c-2e0ffa666bf7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1506 microversion: 2.1 time: 0.490858 Aug 04 17:01:19.034842 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2344/4789] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:18 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1506 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:19.566143 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2a8c336a-903e-4def-b6ad-87db67dee82f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:19.566759 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2a8c336a-903e-4def-b6ad-87db67dee82f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:19.587588 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2a8c336a-903e-4def-b6ad-87db67dee82f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:19.588026 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2a8c336a-903e-4def-b6ad-87db67dee82f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:19.588818 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2a8c336a-903e-4def-b6ad-87db67dee82f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:19.589246 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2a8c336a-903e-4def-b6ad-87db67dee82f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:19.922782 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9f5bb545-305c-44a3-a4fe-817ebf78f106 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:19.925590 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9f5bb545-305c-44a3-a4fe-817ebf78f106 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] [instance: d38ee4ca-53a6-44a6-accd-8441ff314a69] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:19.963539 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f5bb545-305c-44a3-a4fe-817ebf78f106 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:19.964356 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f5bb545-305c-44a3-a4fe-817ebf78f106 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:19.966014 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f5bb545-305c-44a3-a4fe-817ebf78f106 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:19.966723 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f5bb545-305c-44a3-a4fe-817ebf78f106 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:20.033026 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2a8c336a-903e-4def-b6ad-87db67dee82f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:20.047243 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2a8c336a-903e-4def-b6ad-87db67dee82f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1512 microversion: 2.1 time: 0.484861 Aug 04 17:01:20.077840 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2446/4790] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:19 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1512 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:20.102926 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-efc4048d-9824-4ef5-ac25-21bd1bb102f5 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:20.118965 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-efc4048d-9824-4ef5-ac25-21bd1bb102f5 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:20.145694 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-efc4048d-9824-4ef5-ac25-21bd1bb102f5 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:20.149068 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-efc4048d-9824-4ef5-ac25-21bd1bb102f5 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:20.150787 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-efc4048d-9824-4ef5-ac25-21bd1bb102f5 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:20.154461 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-efc4048d-9824-4ef5-ac25-21bd1bb102f5 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:20.325886 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9f5bb545-305c-44a3-a4fe-817ebf78f106 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58bee740320490097a8b7998688e679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff21309fd6c943b392615144aa092e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:20.339048 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9f5bb545-305c-44a3-a4fe-817ebf78f106 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] 10.222.0.23 "GET /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69" status: 200 len: 1328 microversion: 2.1 time: 0.423029 Aug 04 17:01:20.353408 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2345/4791] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:19 2022] GET /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69 => generated 1328 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:20.639536 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-efc4048d-9824-4ef5-ac25-21bd1bb102f5 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:20.657721 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-efc4048d-9824-4ef5-ac25-21bd1bb102f5 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1506 microversion: 2.1 time: 0.556725 Aug 04 17:01:20.658372 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2447/4792] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:20 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1506 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:21.081393 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ee7d4054-e8fe-4fa6-97a4-b3fbf7092556 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:21.082013 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ee7d4054-e8fe-4fa6-97a4-b3fbf7092556 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:21.110129 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ee7d4054-e8fe-4fa6-97a4-b3fbf7092556 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:21.120677 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ee7d4054-e8fe-4fa6-97a4-b3fbf7092556 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:21.121882 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ee7d4054-e8fe-4fa6-97a4-b3fbf7092556 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:21.123603 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ee7d4054-e8fe-4fa6-97a4-b3fbf7092556 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:21.269750 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-9c56969d-c6dd-499b-b4b2-eecd93414db3 req-fd57bfdd-8de6-4649-941c-70274a3eeec1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d38ee4ca-53a6-44a6-accd-8441ff314a69", "tag": "fae59d71-0ceb-4291-9527-914a3afb9bfe"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:21.292805 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-9c56969d-c6dd-499b-b4b2-eecd93414db3 req-fd57bfdd-8de6-4649-941c-70274a3eeec1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:21.293245 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-9c56969d-c6dd-499b-b4b2-eecd93414db3 req-fd57bfdd-8de6-4649-941c-70274a3eeec1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:21.337158 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-9c56969d-c6dd-499b-b4b2-eecd93414db3 req-fd57bfdd-8de6-4649-941c-70274a3eeec1 service nova] Creating event network-changed:fae59d71-0ceb-4291-9527-914a3afb9bfe for instance d38ee4ca-53a6-44a6-accd-8441ff314a69 on n-h2-846466-12 Aug 04 17:01:21.356602 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-9c56969d-c6dd-499b-b4b2-eecd93414db3 req-fd57bfdd-8de6-4649-941c-70274a3eeec1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090781 Aug 04 17:01:21.361235 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2448/4793] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:01:21.377845 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-df8a7f1f-b864-4890-b8e0-be83aa724925 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:21.382703 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-df8a7f1f-b864-4890-b8e0-be83aa724925 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] [instance: d38ee4ca-53a6-44a6-accd-8441ff314a69] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:21.400714 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df8a7f1f-b864-4890-b8e0-be83aa724925 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:21.403237 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df8a7f1f-b864-4890-b8e0-be83aa724925 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:21.405966 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df8a7f1f-b864-4890-b8e0-be83aa724925 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:21.410354 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df8a7f1f-b864-4890-b8e0-be83aa724925 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:21.426072 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ee7d4054-e8fe-4fa6-97a4-b3fbf7092556 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:21.439237 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ee7d4054-e8fe-4fa6-97a4-b3fbf7092556 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1512 microversion: 2.1 time: 0.362940 Aug 04 17:01:21.440320 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2346/4794] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:21 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1512 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:21.665612 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0ab2d942-4d68-4db4-b1bb-d11d8af9f169 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-613387803", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ceca6d76-bb57-49ce-899c-2985b37b1ce6"}], "security_groups": [{"name": "tempest-securitygroup--1511317700"}], "key_name": "tempest-keypair-1023430209", "user_data": "}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:21.725924 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-df8a7f1f-b864-4890-b8e0-be83aa724925 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58bee740320490097a8b7998688e679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff21309fd6c943b392615144aa092e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:21.734739 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-df8a7f1f-b864-4890-b8e0-be83aa724925 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] 10.222.0.23 "GET /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69" status: 200 len: 1328 microversion: 2.1 time: 0.371698 Aug 04 17:01:21.748708 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2449/4795] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:21 2022] GET /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69 => generated 1328 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:21.754827 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ce7a99c8-0cfa-4e53-9d36-702dcff64fe7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:21.755839 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ce7a99c8-0cfa-4e53-9d36-702dcff64fe7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:21.768109 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ce7a99c8-0cfa-4e53-9d36-702dcff64fe7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:21.769537 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ce7a99c8-0cfa-4e53-9d36-702dcff64fe7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:21.770386 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ce7a99c8-0cfa-4e53-9d36-702dcff64fe7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:21.770828 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ce7a99c8-0cfa-4e53-9d36-702dcff64fe7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:21.809673 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-0ab2d942-4d68-4db4-b1bb-d11d8af9f169 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] validate_networks() for [('ceca6d76-bb57-49ce-899c-2985b37b1ce6', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:01:22.031200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ce7a99c8-0cfa-4e53-9d36-702dcff64fe7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:22.043447 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ce7a99c8-0cfa-4e53-9d36-702dcff64fe7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1506 microversion: 2.1 time: 0.293399 Aug 04 17:01:22.044477 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2450/4796] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:21 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1506 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:22.049498 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e2a8f927-15aa-4625-9eac-4755fc754e63 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-95300138", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "efc52e48-7a99-46d8-9290-182cf9274866"}], "key_name": "tempest-TestSecurityGroupsBasicOps-751153364", "security_groups": []}, "os:scheduler_hints": {"different_host": ["36778df0-79fd-4d26-b488-2e6b5e4c0edd"]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:22.132043 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-e2a8f927-15aa-4625-9eac-4755fc754e63 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] validate_networks() for [('efc52e48-7a99-46d8-9290-182cf9274866', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:01:22.465032 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-0ab2d942-4d68-4db4-b1bb-d11d8af9f169 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:01:22.465562 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-0ab2d942-4d68-4db4-b1bb-d11d8af9f169 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:01:22.465938 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-0ab2d942-4d68-4db4-b1bb-d11d8af9f169 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:01:22.466335 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-0ab2d942-4d68-4db4-b1bb-d11d8af9f169 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:01:22.466732 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-0ab2d942-4d68-4db4-b1bb-d11d8af9f169 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:01:22.486616 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0ab2d942-4d68-4db4-b1bb-d11d8af9f169 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:22.487205 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0ab2d942-4d68-4db4-b1bb-d11d8af9f169 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:22.488101 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0ab2d942-4d68-4db4-b1bb-d11d8af9f169 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:22.488630 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0ab2d942-4d68-4db4-b1bb-d11d8af9f169 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:22.508743 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-0ab2d942-4d68-4db4-b1bb-d11d8af9f169 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Getting quotas for project 2534921e8a2f47d394059fee872426a8. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:01:22.514854 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-0ab2d942-4d68-4db4-b1bb-d11d8af9f169 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Getting quotas for user d82f4a672b154291a412a282d1a88208 and project 2534921e8a2f47d394059fee872426a8. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:01:22.529371 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0ab2d942-4d68-4db4-b1bb-d11d8af9f169 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:01:22.531790 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0ab2d942-4d68-4db4-b1bb-d11d8af9f169 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 179db84c-f006-46b9-85ad-ceea5c6a15ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:01:22.586816 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0ab2d942-4d68-4db4-b1bb-d11d8af9f169 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.926917 Aug 04 17:01:22.594307 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2347/4797] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:01:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 17:01:22.602952 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6d028797-d66f-48c6-b58b-ac819c3c8d1c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:22.603463 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6d028797-d66f-48c6-b58b-ac819c3c8d1c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:22.613488 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d028797-d66f-48c6-b58b-ac819c3c8d1c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:22.614881 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d028797-d66f-48c6-b58b-ac819c3c8d1c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:22.617358 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d028797-d66f-48c6-b58b-ac819c3c8d1c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:22.618019 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d028797-d66f-48c6-b58b-ac819c3c8d1c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:22.661662 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6d028797-d66f-48c6-b58b-ac819c3c8d1c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397/os-volume_attachments/56b15395-3515-46c5-a206-2c204cf5e48c" status: 200 len: 194 microversion: 2.20 time: 0.066128 Aug 04 17:01:22.662993 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2348/4798] 10.222.0.23 () {60 vars in 1454 bytes} [Thu Aug 4 17:01:22 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397/os-volume_attachments/56b15395-3515-46c5-a206-2c204cf5e48c => generated 194 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:01:22.670452 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-60047ff9-e1b7-4dbb-a068-6c7040575a0d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:22.671299 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-60047ff9-e1b7-4dbb-a068-6c7040575a0d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:22.679890 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-60047ff9-e1b7-4dbb-a068-6c7040575a0d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:22.680434 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-60047ff9-e1b7-4dbb-a068-6c7040575a0d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:22.681336 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-60047ff9-e1b7-4dbb-a068-6c7040575a0d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:22.682071 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-60047ff9-e1b7-4dbb-a068-6c7040575a0d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:22.789538 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:22.816917 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-e2a8f927-15aa-4625-9eac-4755fc754e63 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:01:22.817442 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-e2a8f927-15aa-4625-9eac-4755fc754e63 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:01:22.817918 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-e2a8f927-15aa-4625-9eac-4755fc754e63 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:01:22.818456 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-e2a8f927-15aa-4625-9eac-4755fc754e63 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:01:22.819026 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-e2a8f927-15aa-4625-9eac-4755fc754e63 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:01:22.840821 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e2a8f927-15aa-4625-9eac-4755fc754e63 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:22.841639 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e2a8f927-15aa-4625-9eac-4755fc754e63 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:22.843235 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e2a8f927-15aa-4625-9eac-4755fc754e63 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:22.844214 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e2a8f927-15aa-4625-9eac-4755fc754e63 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:22.885662 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-e2a8f927-15aa-4625-9eac-4755fc754e63 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Getting quotas for project 8759879e1bec45e38e9434db6bcf85e8. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:01:22.892458 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-60047ff9-e1b7-4dbb-a068-6c7040575a0d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:22.894187 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-e2a8f927-15aa-4625-9eac-4755fc754e63 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Getting quotas for user 113fd3653eee4f798d0860705a2b4030 and project 8759879e1bec45e38e9434db6bcf85e8. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:01:22.902055 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-60047ff9-e1b7-4dbb-a068-6c7040575a0d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1512 microversion: 2.1 time: 0.237708 Aug 04 17:01:22.902639 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2349/4799] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:22 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1512 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:22.914454 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e2a8f927-15aa-4625-9eac-4755fc754e63 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:01:22.916830 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e2a8f927-15aa-4625-9eac-4755fc754e63 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] [instance: 45167cf2-60f4-4ea0-b751-1a349694346c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:01:22.921947 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-99a9a908-2d89-4a40-be90-46d5b6589820 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:22.922562 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-99a9a908-2d89-4a40-be90-46d5b6589820 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 179db84c-f006-46b9-85ad-ceea5c6a15ad] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:22.982218 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-99a9a908-2d89-4a40-be90-46d5b6589820 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:22.989529 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-99a9a908-2d89-4a40-be90-46d5b6589820 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad" status: 200 len: 1241 microversion: 2.1 time: 0.071719 Aug 04 17:01:22.991475 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2350/4800] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:22 2022] GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:22.996132 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8205790f-eb4f-4ada-aee0-e073790a9aff tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:22.996735 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8205790f-eb4f-4ada-aee0-e073790a9aff tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] [instance: d38ee4ca-53a6-44a6-accd-8441ff314a69] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:23.003021 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8205790f-eb4f-4ada-aee0-e073790a9aff tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:23.003572 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8205790f-eb4f-4ada-aee0-e073790a9aff tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:23.004381 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8205790f-eb4f-4ada-aee0-e073790a9aff tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:23.004829 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8205790f-eb4f-4ada-aee0-e073790a9aff tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:23.006538 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e2a8f927-15aa-4625-9eac-4755fc754e63 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.960727 Aug 04 17:01:23.008036 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2451/4801] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:01:22 2022] POST /compute/v2.1/servers => generated 361 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:01:23.018869 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-554f5169-d2cf-4006-bb74-5271154a9dff tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:23.020034 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-554f5169-d2cf-4006-bb74-5271154a9dff tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:23.036745 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-554f5169-d2cf-4006-bb74-5271154a9dff tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:23.037968 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-554f5169-d2cf-4006-bb74-5271154a9dff tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:23.038917 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-554f5169-d2cf-4006-bb74-5271154a9dff tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:23.039456 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-554f5169-d2cf-4006-bb74-5271154a9dff tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:23.150870 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-554f5169-d2cf-4006-bb74-5271154a9dff tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lazy-loading 'services' on Instance uuid fdec5afc-3a3a-4d61-a934-5edf0c7c1397 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:01:23.243799 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8205790f-eb4f-4ada-aee0-e073790a9aff tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58bee740320490097a8b7998688e679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff21309fd6c943b392615144aa092e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:23.255224 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8205790f-eb4f-4ada-aee0-e073790a9aff tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] 10.222.0.23 "GET /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69" status: 200 len: 1328 microversion: 2.1 time: 0.262667 Aug 04 17:01:23.256131 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2351/4802] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:22 2022] GET /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69 => generated 1328 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:23.275320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b5d207c7-8726-4fd0-81d0-3509b7f5b413 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-525751170", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "4f1b991d-4e0e-43fb-81c9-fcb4a9f7815b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8cd64b36-f8a8-48d4-b083-6164d20009da"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:23.307245 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-554f5169-d2cf-4006-bb74-5271154a9dff tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397/os-volume_attachments/56b15395-3515-46c5-a206-2c204cf5e48c" status: 202 len: 0 microversion: 2.20 time: 0.293517 Aug 04 17:01:23.309696 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2452/4803] 10.222.0.23 () {60 vars in 1457 bytes} [Thu Aug 4 17:01:23 2022] DELETE /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397/os-volume_attachments/56b15395-3515-46c5-a206-2c204cf5e48c => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:01:23.322818 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-21ce4996-70e6-4142-a3ca-28afd12e6bf3 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:23.323579 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-21ce4996-70e6-4142-a3ca-28afd12e6bf3 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] [instance: 45167cf2-60f4-4ea0-b751-1a349694346c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:23.345805 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:23.413429 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-b5d207c7-8726-4fd0-81d0-3509b7f5b413 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] validate_networks() for [('8cd64b36-f8a8-48d4-b083-6164d20009da', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:01:23.866697 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-21ce4996-70e6-4142-a3ca-28afd12e6bf3 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fd3653eee4f798d0860705a2b4030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8759879e1bec45e38e9434db6bcf85e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:23.876102 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-21ce4996-70e6-4142-a3ca-28afd12e6bf3 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] 10.222.0.23 "GET /compute/v2.1/servers/45167cf2-60f4-4ea0-b751-1a349694346c" status: 200 len: 1239 microversion: 2.1 time: 0.562415 Aug 04 17:01:23.901634 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2453/4804] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:23 2022] GET /compute/v2.1/servers/45167cf2-60f4-4ea0-b751-1a349694346c => generated 1239 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:23.910724 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-701e452f-bd11-49da-ab42-1e97c5c9e12b tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:23.913550 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-701e452f-bd11-49da-ab42-1e97c5c9e12b tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:23.926487 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-701e452f-bd11-49da-ab42-1e97c5c9e12b tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:23.935105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-701e452f-bd11-49da-ab42-1e97c5c9e12b tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:23.936300 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-701e452f-bd11-49da-ab42-1e97c5c9e12b tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:23.937401 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-701e452f-bd11-49da-ab42-1e97c5c9e12b tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:24.355038 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-701e452f-bd11-49da-ab42-1e97c5c9e12b tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:24.373668 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-701e452f-bd11-49da-ab42-1e97c5c9e12b tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1506 microversion: 2.1 time: 0.469885 Aug 04 17:01:24.374590 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2454/4805] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:23 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1506 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:24.383488 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f95507b6-fc37-4734-a884-e333152cf9af tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:24.387027 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f95507b6-fc37-4734-a884-e333152cf9af tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:24.399014 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f95507b6-fc37-4734-a884-e333152cf9af tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:24.400043 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f95507b6-fc37-4734-a884-e333152cf9af tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:24.401223 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f95507b6-fc37-4734-a884-e333152cf9af tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:24.401962 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f95507b6-fc37-4734-a884-e333152cf9af tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:24.483750 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f95507b6-fc37-4734-a884-e333152cf9af tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.104760 Aug 04 17:01:24.491146 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2455/4806] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Aug 4 17:01:24 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:01:24.508851 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-54d714ea-ff9a-48ef-8bdb-db13c41af1b0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:24.511836 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-54d714ea-ff9a-48ef-8bdb-db13c41af1b0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:24.522550 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-54d714ea-ff9a-48ef-8bdb-db13c41af1b0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:24.523646 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-54d714ea-ff9a-48ef-8bdb-db13c41af1b0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:24.524744 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-54d714ea-ff9a-48ef-8bdb-db13c41af1b0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:24.525371 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-54d714ea-ff9a-48ef-8bdb-db13c41af1b0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:24.824967 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-54d714ea-ff9a-48ef-8bdb-db13c41af1b0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:24.855674 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-54d714ea-ff9a-48ef-8bdb-db13c41af1b0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1512 microversion: 2.1 time: 0.362998 Aug 04 17:01:24.858288 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2456/4807] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:24 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1512 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:24.875819 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5059041d-09c8-4369-ad05-dc80477bb7a7 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:24.882633 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5059041d-09c8-4369-ad05-dc80477bb7a7 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 179db84c-f006-46b9-85ad-ceea5c6a15ad] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:24.905818 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5059041d-09c8-4369-ad05-dc80477bb7a7 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:24.906275 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5059041d-09c8-4369-ad05-dc80477bb7a7 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:24.909587 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5059041d-09c8-4369-ad05-dc80477bb7a7 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:24.910025 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5059041d-09c8-4369-ad05-dc80477bb7a7 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:24.976574 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-b5d207c7-8726-4fd0-81d0-3509b7f5b413 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:01:24.977860 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-b5d207c7-8726-4fd0-81d0-3509b7f5b413 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:01:24.978527 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-b5d207c7-8726-4fd0-81d0-3509b7f5b413 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:01:24.979884 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-b5d207c7-8726-4fd0-81d0-3509b7f5b413 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:01:24.980464 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-b5d207c7-8726-4fd0-81d0-3509b7f5b413 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:01:24.998546 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b5d207c7-8726-4fd0-81d0-3509b7f5b413 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:25.001857 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b5d207c7-8726-4fd0-81d0-3509b7f5b413 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:25.005561 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b5d207c7-8726-4fd0-81d0-3509b7f5b413 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:25.006003 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b5d207c7-8726-4fd0-81d0-3509b7f5b413 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:25.062256 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-b5d207c7-8726-4fd0-81d0-3509b7f5b413 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Getting quotas for project 78a0adb69ba24749817a8855effc20ad. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:01:25.075183 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-b5d207c7-8726-4fd0-81d0-3509b7f5b413 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Getting quotas for user ea9cab1c1eff47ddb881a2b57bf240f3 and project 78a0adb69ba24749817a8855effc20ad. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:01:25.095293 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5059041d-09c8-4369-ad05-dc80477bb7a7 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:25.109659 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5059041d-09c8-4369-ad05-dc80477bb7a7 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad" status: 200 len: 1299 microversion: 2.1 time: 0.246718 Aug 04 17:01:25.116825 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2457/4808] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:24 2022] GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad => generated 1299 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:25.131963 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-824a3c7a-0832-4099-bc86-bcd465eeba27 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:25.135584 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-824a3c7a-0832-4099-bc86-bcd465eeba27 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] [instance: d38ee4ca-53a6-44a6-accd-8441ff314a69] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:25.157273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-824a3c7a-0832-4099-bc86-bcd465eeba27 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:25.158209 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-824a3c7a-0832-4099-bc86-bcd465eeba27 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:25.159257 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-824a3c7a-0832-4099-bc86-bcd465eeba27 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:25.159617 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-824a3c7a-0832-4099-bc86-bcd465eeba27 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:25.211754 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b5d207c7-8726-4fd0-81d0-3509b7f5b413 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:01:25.214130 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b5d207c7-8726-4fd0-81d0-3509b7f5b413 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: bb775932-ec80-4b14-b137-6ebd3c33670d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4f1b991d-4e0e-43fb-81c9-fcb4a9f7815b',volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:01:25.530132 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b5d207c7-8726-4fd0-81d0-3509b7f5b413 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.258305 Aug 04 17:01:25.541531 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2352/4809] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:01:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2269 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:01:25.557645 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ae85f0fe-d380-4bc6-a969-7775dbb9a2c6 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:25.558696 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ae85f0fe-d380-4bc6-a969-7775dbb9a2c6 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] [instance: 45167cf2-60f4-4ea0-b751-1a349694346c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:25.568473 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ae85f0fe-d380-4bc6-a969-7775dbb9a2c6 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:25.569236 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ae85f0fe-d380-4bc6-a969-7775dbb9a2c6 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:25.570325 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ae85f0fe-d380-4bc6-a969-7775dbb9a2c6 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:25.570950 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ae85f0fe-d380-4bc6-a969-7775dbb9a2c6 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:25.804420 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ae85f0fe-d380-4bc6-a969-7775dbb9a2c6 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fd3653eee4f798d0860705a2b4030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8759879e1bec45e38e9434db6bcf85e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:25.817834 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ae85f0fe-d380-4bc6-a969-7775dbb9a2c6 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] 10.222.0.23 "GET /compute/v2.1/servers/45167cf2-60f4-4ea0-b751-1a349694346c" status: 200 len: 1297 microversion: 2.1 time: 0.275027 Aug 04 17:01:25.818440 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2353/4810] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:25 2022] GET /compute/v2.1/servers/45167cf2-60f4-4ea0-b751-1a349694346c => generated 1297 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:25.858759 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-659d53e5-0558-4b20-a755-2b9f027fee48 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:25.859385 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-659d53e5-0558-4b20-a755-2b9f027fee48 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:25.878748 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-659d53e5-0558-4b20-a755-2b9f027fee48 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:25.879192 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-659d53e5-0558-4b20-a755-2b9f027fee48 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:25.879956 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-659d53e5-0558-4b20-a755-2b9f027fee48 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:25.880385 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-659d53e5-0558-4b20-a755-2b9f027fee48 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:25.942651 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-824a3c7a-0832-4099-bc86-bcd465eeba27 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58bee740320490097a8b7998688e679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff21309fd6c943b392615144aa092e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:25.952849 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:25.959210 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-824a3c7a-0832-4099-bc86-bcd465eeba27 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] 10.222.0.23 "GET /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69" status: 200 len: 1328 microversion: 2.1 time: 0.841035 Aug 04 17:01:25.965985 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2458/4811] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:25 2022] GET /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69 => generated 1328 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:25.995413 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-946c7f80-8f77-40eb-a34b-43006641278e tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:25.998360 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-946c7f80-8f77-40eb-a34b-43006641278e tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:26.014302 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-946c7f80-8f77-40eb-a34b-43006641278e tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:26.019669 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-946c7f80-8f77-40eb-a34b-43006641278e tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:26.021192 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-946c7f80-8f77-40eb-a34b-43006641278e tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:26.021813 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-946c7f80-8f77-40eb-a34b-43006641278e tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:26.097485 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-946c7f80-8f77-40eb-a34b-43006641278e tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.115590 Aug 04 17:01:26.105518 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2459/4812] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Aug 4 17:01:25 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:01:26.117506 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5f94475b-f0e1-46ea-b6bb-42a80f819478 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:26.118339 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5f94475b-f0e1-46ea-b6bb-42a80f819478 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: bb775932-ec80-4b14-b137-6ebd3c33670d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:26.412245 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5f94475b-f0e1-46ea-b6bb-42a80f819478 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:26.422052 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5f94475b-f0e1-46ea-b6bb-42a80f819478 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d" status: 200 len: 1056 microversion: 2.1 time: 0.314787 Aug 04 17:01:26.437315 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2460/4813] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:26 2022] GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d => generated 1056 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:26.437315 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-91ff8e73-12a0-4009-9c1b-1e8b43108c0e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:26.437315 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-91ff8e73-12a0-4009-9c1b-1e8b43108c0e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:26.455254 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-91ff8e73-12a0-4009-9c1b-1e8b43108c0e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:26.455970 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-91ff8e73-12a0-4009-9c1b-1e8b43108c0e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:26.457207 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-91ff8e73-12a0-4009-9c1b-1e8b43108c0e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:26.457866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-91ff8e73-12a0-4009-9c1b-1e8b43108c0e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:26.550044 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-659d53e5-0558-4b20-a755-2b9f027fee48 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:26.567331 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-659d53e5-0558-4b20-a755-2b9f027fee48 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1506 microversion: 2.1 time: 0.726605 Aug 04 17:01:26.567933 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2354/4814] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:25 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1506 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:26.580077 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-741299f9-1520-4366-9925-b100e661498c tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:26.580709 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-741299f9-1520-4366-9925-b100e661498c tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 179db84c-f006-46b9-85ad-ceea5c6a15ad] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:26.599220 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-741299f9-1520-4366-9925-b100e661498c tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:26.599935 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-741299f9-1520-4366-9925-b100e661498c tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:26.605895 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-741299f9-1520-4366-9925-b100e661498c tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:26.606611 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-741299f9-1520-4366-9925-b100e661498c tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:26.829643 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-741299f9-1520-4366-9925-b100e661498c tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:26.846173 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-741299f9-1520-4366-9925-b100e661498c tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad" status: 200 len: 1299 microversion: 2.1 time: 0.276904 Aug 04 17:01:26.846971 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2355/4815] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:26 2022] GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad => generated 1299 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:26.855155 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6af1eb22-e97a-4099-8eb6-6ed2a4cd5769 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:26.862165 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6af1eb22-e97a-4099-8eb6-6ed2a4cd5769 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] [instance: 45167cf2-60f4-4ea0-b751-1a349694346c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:26.875414 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6af1eb22-e97a-4099-8eb6-6ed2a4cd5769 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:26.875868 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6af1eb22-e97a-4099-8eb6-6ed2a4cd5769 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:26.876654 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6af1eb22-e97a-4099-8eb6-6ed2a4cd5769 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:26.877077 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6af1eb22-e97a-4099-8eb6-6ed2a4cd5769 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:27.117478 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-91ff8e73-12a0-4009-9c1b-1e8b43108c0e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:27.128902 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-91ff8e73-12a0-4009-9c1b-1e8b43108c0e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1512 microversion: 2.1 time: 0.701946 Aug 04 17:01:27.129778 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2461/4816] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:26 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1512 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:27.138494 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e45b4c78-5ed3-4119-b7c9-d535a737f265 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:27.143599 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e45b4c78-5ed3-4119-b7c9-d535a737f265 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] [instance: d38ee4ca-53a6-44a6-accd-8441ff314a69] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:27.149401 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6af1eb22-e97a-4099-8eb6-6ed2a4cd5769 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fd3653eee4f798d0860705a2b4030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8759879e1bec45e38e9434db6bcf85e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:27.158830 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e45b4c78-5ed3-4119-b7c9-d535a737f265 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:27.159582 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e45b4c78-5ed3-4119-b7c9-d535a737f265 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:27.160554 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e45b4c78-5ed3-4119-b7c9-d535a737f265 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:27.161333 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6af1eb22-e97a-4099-8eb6-6ed2a4cd5769 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] 10.222.0.23 "GET /compute/v2.1/servers/45167cf2-60f4-4ea0-b751-1a349694346c" status: 200 len: 1297 microversion: 2.1 time: 0.310281 Aug 04 17:01:27.161963 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2356/4817] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:26 2022] GET /compute/v2.1/servers/45167cf2-60f4-4ea0-b751-1a349694346c => generated 1297 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:27.173928 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cf9066c6-07ea-4518-9567-eb8cfc86e25a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:27.176958 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e45b4c78-5ed3-4119-b7c9-d535a737f265 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:27.178605 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cf9066c6-07ea-4518-9567-eb8cfc86e25a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:27.197025 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf9066c6-07ea-4518-9567-eb8cfc86e25a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:27.200253 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf9066c6-07ea-4518-9567-eb8cfc86e25a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:27.208142 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf9066c6-07ea-4518-9567-eb8cfc86e25a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:27.211498 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf9066c6-07ea-4518-9567-eb8cfc86e25a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:27.313943 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cf9066c6-07ea-4518-9567-eb8cfc86e25a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.149001 Aug 04 17:01:27.315002 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2357/4818] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Aug 4 17:01:27 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:01:27.425784 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-18bca854-2b8c-4388-ba24-0527b1ae2023 req-51d24893-ac82-449f-bb33-d279a5a7336c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d38ee4ca-53a6-44a6-accd-8441ff314a69", "name": "network-vif-plugged", "status": "completed", "tag": "fae59d71-0ceb-4291-9527-914a3afb9bfe"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:27.455845 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-18bca854-2b8c-4388-ba24-0527b1ae2023 req-51d24893-ac82-449f-bb33-d279a5a7336c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:27.458609 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-18bca854-2b8c-4388-ba24-0527b1ae2023 req-51d24893-ac82-449f-bb33-d279a5a7336c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:27.490416 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-18bca854-2b8c-4388-ba24-0527b1ae2023 req-51d24893-ac82-449f-bb33-d279a5a7336c service nova] Creating event network-vif-plugged:fae59d71-0ceb-4291-9527-914a3afb9bfe for instance d38ee4ca-53a6-44a6-accd-8441ff314a69 on n-h2-846466-12 Aug 04 17:01:27.504000 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-18bca854-2b8c-4388-ba24-0527b1ae2023 req-51d24893-ac82-449f-bb33-d279a5a7336c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082734 Aug 04 17:01:27.508615 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2358/4819] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:27.524891 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a412fc04-7134-4b89-820e-528df1f4f69f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:27.527722 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a412fc04-7134-4b89-820e-528df1f4f69f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: bb775932-ec80-4b14-b137-6ebd3c33670d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:27.560916 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a412fc04-7134-4b89-820e-528df1f4f69f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:27.561639 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a412fc04-7134-4b89-820e-528df1f4f69f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:27.562307 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a412fc04-7134-4b89-820e-528df1f4f69f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:27.562747 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a412fc04-7134-4b89-820e-528df1f4f69f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:27.764049 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a412fc04-7134-4b89-820e-528df1f4f69f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:27.773670 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a412fc04-7134-4b89-820e-528df1f4f69f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d" status: 200 len: 1172 microversion: 2.1 time: 0.260814 Aug 04 17:01:27.774502 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2359/4820] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:27 2022] GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d => generated 1172 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:27.784815 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ab319324-ee6d-4398-9faa-d9dbd121ef8f tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:27.786900 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ab319324-ee6d-4398-9faa-d9dbd121ef8f tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:27.796427 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ab319324-ee6d-4398-9faa-d9dbd121ef8f tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:27.797324 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ab319324-ee6d-4398-9faa-d9dbd121ef8f tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:27.798295 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ab319324-ee6d-4398-9faa-d9dbd121ef8f tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:27.798896 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ab319324-ee6d-4398-9faa-d9dbd121ef8f tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:27.886551 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e45b4c78-5ed3-4119-b7c9-d535a737f265 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58bee740320490097a8b7998688e679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff21309fd6c943b392615144aa092e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:27.902304 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e45b4c78-5ed3-4119-b7c9-d535a737f265 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] 10.222.0.23 "GET /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69" status: 200 len: 1328 microversion: 2.1 time: 0.767493 Aug 04 17:01:27.914335 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2462/4821] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:27 2022] GET /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69 => generated 1328 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:27.920235 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-169d635b-a89d-4c73-b1e4-a4af109c8700 req-25319503-e52d-44b6-ba65-8f7a1c93f61f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45167cf2-60f4-4ea0-b751-1a349694346c", "tag": "548085f3-3987-4d72-a366-a9124f3340f5"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:27.951291 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-169d635b-a89d-4c73-b1e4-a4af109c8700 req-25319503-e52d-44b6-ba65-8f7a1c93f61f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:27.951527 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-169d635b-a89d-4c73-b1e4-a4af109c8700 req-25319503-e52d-44b6-ba65-8f7a1c93f61f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:27.965012 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-169d635b-a89d-4c73-b1e4-a4af109c8700 req-25319503-e52d-44b6-ba65-8f7a1c93f61f service nova] Creating event network-changed:548085f3-3987-4d72-a366-a9124f3340f5 for instance 45167cf2-60f4-4ea0-b751-1a349694346c on n-h2-846466-12 Aug 04 17:01:27.970494 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-169d635b-a89d-4c73-b1e4-a4af109c8700 req-25319503-e52d-44b6-ba65-8f7a1c93f61f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054080 Aug 04 17:01:27.971419 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2463/4822] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:27.978817 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ad774c01-2603-4c55-a7b3-9df1a03789a8 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:27.979739 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ad774c01-2603-4c55-a7b3-9df1a03789a8 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 179db84c-f006-46b9-85ad-ceea5c6a15ad] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:27.988486 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad774c01-2603-4c55-a7b3-9df1a03789a8 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:27.989163 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad774c01-2603-4c55-a7b3-9df1a03789a8 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:27.990172 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad774c01-2603-4c55-a7b3-9df1a03789a8 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:27.991795 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad774c01-2603-4c55-a7b3-9df1a03789a8 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:28.735991 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ab319324-ee6d-4398-9faa-d9dbd121ef8f tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:28.762171 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ab319324-ee6d-4398-9faa-d9dbd121ef8f tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1506 microversion: 2.1 time: 0.983179 Aug 04 17:01:28.765244 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2360/4823] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:27 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1506 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:28.773184 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3678fe1b-c92f-445d-ae15-f605b278c53b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:28.774378 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3678fe1b-c92f-445d-ae15-f605b278c53b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:28.784959 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3678fe1b-c92f-445d-ae15-f605b278c53b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:28.785772 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3678fe1b-c92f-445d-ae15-f605b278c53b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:28.786767 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3678fe1b-c92f-445d-ae15-f605b278c53b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:28.787397 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3678fe1b-c92f-445d-ae15-f605b278c53b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:28.873482 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ad774c01-2603-4c55-a7b3-9df1a03789a8 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:28.883014 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ad774c01-2603-4c55-a7b3-9df1a03789a8 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad" status: 200 len: 1367 microversion: 2.1 time: 0.910079 Aug 04 17:01:28.883994 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2464/4824] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:27 2022] GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad => generated 1367 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:28.890691 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9b2a1e84-9541-464e-a8ce-7c5ed1f7a360 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:28.891352 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9b2a1e84-9541-464e-a8ce-7c5ed1f7a360 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] [instance: 45167cf2-60f4-4ea0-b751-1a349694346c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:28.898874 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9b2a1e84-9541-464e-a8ce-7c5ed1f7a360 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:28.899340 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9b2a1e84-9541-464e-a8ce-7c5ed1f7a360 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:28.900163 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9b2a1e84-9541-464e-a8ce-7c5ed1f7a360 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:28.900760 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9b2a1e84-9541-464e-a8ce-7c5ed1f7a360 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:29.100624 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9b2a1e84-9541-464e-a8ce-7c5ed1f7a360 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fd3653eee4f798d0860705a2b4030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8759879e1bec45e38e9434db6bcf85e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:29.108623 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9b2a1e84-9541-464e-a8ce-7c5ed1f7a360 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] 10.222.0.23 "GET /compute/v2.1/servers/45167cf2-60f4-4ea0-b751-1a349694346c" status: 200 len: 1297 microversion: 2.1 time: 0.223221 Aug 04 17:01:29.112687 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2465/4825] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:28 2022] GET /compute/v2.1/servers/45167cf2-60f4-4ea0-b751-1a349694346c => generated 1297 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:29.118409 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bbf7875c-c058-4383-9257-4e41be37dea2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:29.120736 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bbf7875c-c058-4383-9257-4e41be37dea2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:29.147420 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bbf7875c-c058-4383-9257-4e41be37dea2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:29.148025 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bbf7875c-c058-4383-9257-4e41be37dea2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:29.148920 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bbf7875c-c058-4383-9257-4e41be37dea2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:29.149398 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bbf7875c-c058-4383-9257-4e41be37dea2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:29.229993 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bbf7875c-c058-4383-9257-4e41be37dea2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.114669 Aug 04 17:01:29.234406 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2466/4826] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Aug 4 17:01:29 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:01:29.235699 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-52c7a6f6-d052-4bb9-86c1-a9af8b0ef5d8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:29.236324 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-52c7a6f6-d052-4bb9-86c1-a9af8b0ef5d8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: bb775932-ec80-4b14-b137-6ebd3c33670d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:29.243364 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-52c7a6f6-d052-4bb9-86c1-a9af8b0ef5d8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:29.243812 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-52c7a6f6-d052-4bb9-86c1-a9af8b0ef5d8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:29.244646 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-52c7a6f6-d052-4bb9-86c1-a9af8b0ef5d8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:29.245081 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-52c7a6f6-d052-4bb9-86c1-a9af8b0ef5d8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:29.333231 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3678fe1b-c92f-445d-ae15-f605b278c53b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:29.342045 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3678fe1b-c92f-445d-ae15-f605b278c53b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1512 microversion: 2.1 time: 0.574829 Aug 04 17:01:29.342851 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2361/4827] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:28 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1512 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:29.347531 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-45e859f5-532c-4aac-b38f-a00f0f2620ec tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:29.349050 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-45e859f5-532c-4aac-b38f-a00f0f2620ec tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] [instance: d38ee4ca-53a6-44a6-accd-8441ff314a69] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:29.356548 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-45e859f5-532c-4aac-b38f-a00f0f2620ec tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:29.357000 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-45e859f5-532c-4aac-b38f-a00f0f2620ec tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:29.357975 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-45e859f5-532c-4aac-b38f-a00f0f2620ec tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:29.358423 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-45e859f5-532c-4aac-b38f-a00f0f2620ec tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:29.387208 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-52c7a6f6-d052-4bb9-86c1-a9af8b0ef5d8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:29.396721 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-52c7a6f6-d052-4bb9-86c1-a9af8b0ef5d8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d" status: 200 len: 1172 microversion: 2.1 time: 0.164523 Aug 04 17:01:29.397983 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2467/4828] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:29 2022] GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d => generated 1172 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:29.705499 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-45e859f5-532c-4aac-b38f-a00f0f2620ec tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58bee740320490097a8b7998688e679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff21309fd6c943b392615144aa092e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:29.714025 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-45e859f5-532c-4aac-b38f-a00f0f2620ec tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] 10.222.0.23 "GET /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69" status: 200 len: 1528 microversion: 2.1 time: 0.370267 Aug 04 17:01:29.714648 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2362/4829] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:29 2022] GET /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69 => generated 1528 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:29.735640 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-01ddafd1-ab6c-44a1-a583-451c66d3c0c8 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:29.736259 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-01ddafd1-ab6c-44a1-a583-451c66d3c0c8 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] [instance: d38ee4ca-53a6-44a6-accd-8441ff314a69] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:29.744338 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-01ddafd1-ab6c-44a1-a583-451c66d3c0c8 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:29.744791 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-01ddafd1-ab6c-44a1-a583-451c66d3c0c8 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:29.745591 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-01ddafd1-ab6c-44a1-a583-451c66d3c0c8 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:29.746008 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-01ddafd1-ab6c-44a1-a583-451c66d3c0c8 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:29.784393 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4f7e0c5f-4fdc-452d-b986-ec074eacd78b tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:29.785460 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4f7e0c5f-4fdc-452d-b986-ec074eacd78b tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:29.795358 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4f7e0c5f-4fdc-452d-b986-ec074eacd78b tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:29.795951 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4f7e0c5f-4fdc-452d-b986-ec074eacd78b tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:29.796814 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4f7e0c5f-4fdc-452d-b986-ec074eacd78b tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:29.797329 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4f7e0c5f-4fdc-452d-b986-ec074eacd78b tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:30.178084 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-01ddafd1-ab6c-44a1-a583-451c66d3c0c8 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58bee740320490097a8b7998688e679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff21309fd6c943b392615144aa092e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:30.187078 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-01ddafd1-ab6c-44a1-a583-451c66d3c0c8 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] 10.222.0.23 "GET /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69" status: 200 len: 1528 microversion: 2.1 time: 0.455260 Aug 04 17:01:30.188316 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2468/4830] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:29 2022] GET /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69 => generated 1528 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:30.194788 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4d045487-75de-4f41-915a-9c25b1ebd84d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:30.195443 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4f7e0c5f-4fdc-452d-b986-ec074eacd78b tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:30.196042 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4d045487-75de-4f41-915a-9c25b1ebd84d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 179db84c-f006-46b9-85ad-ceea5c6a15ad] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:30.203297 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4f7e0c5f-4fdc-452d-b986-ec074eacd78b tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1506 microversion: 2.1 time: 0.423047 Aug 04 17:01:30.203850 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2363/4831] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:29 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1506 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:01:30.205474 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d045487-75de-4f41-915a-9c25b1ebd84d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:30.206479 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d045487-75de-4f41-915a-9c25b1ebd84d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:30.207529 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d045487-75de-4f41-915a-9c25b1ebd84d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:30.208185 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d045487-75de-4f41-915a-9c25b1ebd84d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:30.222640 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f47d96ed-d75c-4d47-a6ee-a6abaf281392 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:30.223250 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f47d96ed-d75c-4d47-a6ee-a6abaf281392 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] [instance: 45167cf2-60f4-4ea0-b751-1a349694346c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:30.240574 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f47d96ed-d75c-4d47-a6ee-a6abaf281392 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:30.248908 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f47d96ed-d75c-4d47-a6ee-a6abaf281392 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:30.250521 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f47d96ed-d75c-4d47-a6ee-a6abaf281392 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:30.251258 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f47d96ed-d75c-4d47-a6ee-a6abaf281392 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:30.284373 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=100 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:30.601524 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f47d96ed-d75c-4d47-a6ee-a6abaf281392 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fd3653eee4f798d0860705a2b4030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8759879e1bec45e38e9434db6bcf85e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:30.610115 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f47d96ed-d75c-4d47-a6ee-a6abaf281392 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] 10.222.0.23 "GET /compute/v2.1/servers/45167cf2-60f4-4ea0-b751-1a349694346c" status: 200 len: 1297 microversion: 2.1 time: 0.396821 Aug 04 17:01:30.633132 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2364/4832] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:30 2022] GET /compute/v2.1/servers/45167cf2-60f4-4ea0-b751-1a349694346c => generated 1297 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:30.720741 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-04d819cd-9189-4376-896d-5f03b5fc7701 tempest-ServersNegativeTestMultiTenantJSON-1507859414 tempest-ServersNegativeTestMultiTenantJSON-1507859414-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:30.721650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-04d819cd-9189-4376-896d-5f03b5fc7701 tempest-ServersNegativeTestMultiTenantJSON-1507859414 tempest-ServersNegativeTestMultiTenantJSON-1507859414-project] [instance: d38ee4ca-53a6-44a6-accd-8441ff314a69] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:30.729146 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-04d819cd-9189-4376-896d-5f03b5fc7701 tempest-ServersNegativeTestMultiTenantJSON-1507859414 tempest-ServersNegativeTestMultiTenantJSON-1507859414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:30.730148 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-04d819cd-9189-4376-896d-5f03b5fc7701 tempest-ServersNegativeTestMultiTenantJSON-1507859414 tempest-ServersNegativeTestMultiTenantJSON-1507859414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:30.731480 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-04d819cd-9189-4376-896d-5f03b5fc7701 tempest-ServersNegativeTestMultiTenantJSON-1507859414 tempest-ServersNegativeTestMultiTenantJSON-1507859414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:30.732146 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-04d819cd-9189-4376-896d-5f03b5fc7701 tempest-ServersNegativeTestMultiTenantJSON-1507859414 tempest-ServersNegativeTestMultiTenantJSON-1507859414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:30.753193 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-04d819cd-9189-4376-896d-5f03b5fc7701 tempest-ServersNegativeTestMultiTenantJSON-1507859414 tempest-ServersNegativeTestMultiTenantJSON-1507859414-project] HTTP exception thrown: Instance d38ee4ca-53a6-44a6-accd-8441ff314a69 could not be found. Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-04d819cd-9189-4376-896d-5f03b5fc7701 tempest-ServersNegativeTestMultiTenantJSON-1507859414 tempest-ServersNegativeTestMultiTenantJSON-1507859414-project] Request method failure captured: Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69 HTTP/1.1 Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_tXvbjB6zRMcegWeUpskFIQ6zCbGsrTgVwnUxXdPW8rf__QdeSNecUwLnQS5UclQNYC_sGx1SGv6UR9bsiF8oCzAt-cBFrZlsq9W-0zjc7zO7qGrwieZtZwMIXWi_dWNQM7af5ThQT_vVePbrMGuwK6IZEPfxPFXHKkEBuTpzpTwEI Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 92aa79fe63bf4d1fb03095c44e8b3e9d Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1507859414 Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/92aa79fe63bf4d1fb03095c44e8b3e9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_92aa79fe63bf4d1fb03095c44e8b3e9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/92aa79fe63bf4d1fb03095c44e8b3e9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/92aa79fe63bf4d1fb03095c44e8b3e9d"}]}] Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1507859414 Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 92aa79fe63bf4d1fb03095c44e8b3e9d Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1507859414 Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1507859414-project Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 7df8c5f8e970450299f63f38ca918910 Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1507859414-project Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance d38ee4ca-53a6-44a6-accd-8441ff314a69 could not be found. Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'd38ee4ca-53a6-44a6-accd-8441ff314a69'} Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d38ee4ca-53a6-44a6-accd-8441ff314a69 could not be found. Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:01:30.756405 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:01:30.761517 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d38ee4ca-53a6-44a6-accd-8441ff314a69 could not be found. Aug 04 17:01:30.761517 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:30.761517 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:30.761517 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:30.761517 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:30.761517 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:30.761517 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:30.761517 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:01:30.761517 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:01:30.761517 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d38ee4ca-53a6-44a6-accd-8441ff314a69 could not be found. Aug 04 17:01:30.761517 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:30.764568 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-04d819cd-9189-4376-896d-5f03b5fc7701 tempest-ServersNegativeTestMultiTenantJSON-1507859414 tempest-ServersNegativeTestMultiTenantJSON-1507859414-project] Returning 404 to user: Instance d38ee4ca-53a6-44a6-accd-8441ff314a69 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:01:30.765750 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-04d819cd-9189-4376-896d-5f03b5fc7701 tempest-ServersNegativeTestMultiTenantJSON-1507859414 tempest-ServersNegativeTestMultiTenantJSON-1507859414-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69" status: 404 len: 111 microversion: 2.1 time: 0.131240 Aug 04 17:01:30.766560 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2365/4833] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:01:30 2022] DELETE /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:01:30.772713 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-66ddd12a-5dec-4195-bbf4-11388059974f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:30.776063 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-66ddd12a-5dec-4195-bbf4-11388059974f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:30.783663 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-66ddd12a-5dec-4195-bbf4-11388059974f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:30.784235 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-66ddd12a-5dec-4195-bbf4-11388059974f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:30.786679 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-66ddd12a-5dec-4195-bbf4-11388059974f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:30.789597 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-66ddd12a-5dec-4195-bbf4-11388059974f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:30.796975 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4d045487-75de-4f41-915a-9c25b1ebd84d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:30.806756 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4d045487-75de-4f41-915a-9c25b1ebd84d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad" status: 200 len: 1367 microversion: 2.1 time: 0.616930 Aug 04 17:01:30.815802 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2469/4834] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:30 2022] GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad => generated 1367 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:30.821617 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d913c55f-7d30-4e6c-90ab-176e8ae59e5d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:30.822466 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d913c55f-7d30-4e6c-90ab-176e8ae59e5d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:30.838141 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-66ddd12a-5dec-4195-bbf4-11388059974f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.069820 Aug 04 17:01:30.839419 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2366/4835] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Aug 4 17:01:30 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:30.839630 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d913c55f-7d30-4e6c-90ab-176e8ae59e5d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:30.840242 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d913c55f-7d30-4e6c-90ab-176e8ae59e5d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:30.841026 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d913c55f-7d30-4e6c-90ab-176e8ae59e5d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:30.841493 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d913c55f-7d30-4e6c-90ab-176e8ae59e5d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:30.845474 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-daa04613-01fe-4ab2-92dd-a64a6b27b888 req-c99c57b1-df90-495c-bdad-d0623287b73c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "179db84c-f006-46b9-85ad-ceea5c6a15ad", "tag": "9a092a19-0d2c-44cd-bd13-eda962c60553"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:30.857628 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-daa04613-01fe-4ab2-92dd-a64a6b27b888 req-c99c57b1-df90-495c-bdad-d0623287b73c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:30.858405 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-daa04613-01fe-4ab2-92dd-a64a6b27b888 req-c99c57b1-df90-495c-bdad-d0623287b73c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:30.874723 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-daa04613-01fe-4ab2-92dd-a64a6b27b888 req-c99c57b1-df90-495c-bdad-d0623287b73c service nova] Creating event network-changed:9a092a19-0d2c-44cd-bd13-eda962c60553 for instance 179db84c-f006-46b9-85ad-ceea5c6a15ad on n-h1-846466-12 Aug 04 17:01:30.881080 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-daa04613-01fe-4ab2-92dd-a64a6b27b888 req-c99c57b1-df90-495c-bdad-d0623287b73c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039835 Aug 04 17:01:30.882618 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2367/4836] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:30.888842 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9dba7f4b-8493-4659-a24c-e062412d0a02 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:30.890087 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9dba7f4b-8493-4659-a24c-e062412d0a02 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: bb775932-ec80-4b14-b137-6ebd3c33670d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:30.897667 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9dba7f4b-8493-4659-a24c-e062412d0a02 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:30.898541 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9dba7f4b-8493-4659-a24c-e062412d0a02 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:30.899558 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9dba7f4b-8493-4659-a24c-e062412d0a02 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:30.900346 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9dba7f4b-8493-4659-a24c-e062412d0a02 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:31.290102 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d913c55f-7d30-4e6c-90ab-176e8ae59e5d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:31.298472 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d913c55f-7d30-4e6c-90ab-176e8ae59e5d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1512 microversion: 2.1 time: 0.481298 Aug 04 17:01:31.299295 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2470/4837] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:30 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1512 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:31.305336 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4e4c5fb1-3de5-4179-bb0c-08f5c7857536 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:31.306200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4e4c5fb1-3de5-4179-bb0c-08f5c7857536 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] [instance: d38ee4ca-53a6-44a6-accd-8441ff314a69] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:31.311464 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9dba7f4b-8493-4659-a24c-e062412d0a02 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:31.313082 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4e4c5fb1-3de5-4179-bb0c-08f5c7857536 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:31.314013 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4e4c5fb1-3de5-4179-bb0c-08f5c7857536 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:31.315712 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4e4c5fb1-3de5-4179-bb0c-08f5c7857536 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:31.316400 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4e4c5fb1-3de5-4179-bb0c-08f5c7857536 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:31.319269 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9dba7f4b-8493-4659-a24c-e062412d0a02 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d" status: 200 len: 1214 microversion: 2.1 time: 0.435200 Aug 04 17:01:31.332875 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2368/4838] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:30 2022] GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d => generated 1214 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:31.339115 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-87a1b55f-b6c4-4a64-a80d-40897a8c7636 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:31.339868 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-87a1b55f-b6c4-4a64-a80d-40897a8c7636 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:31.346921 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-87a1b55f-b6c4-4a64-a80d-40897a8c7636 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:31.347605 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-87a1b55f-b6c4-4a64-a80d-40897a8c7636 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:31.348618 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-87a1b55f-b6c4-4a64-a80d-40897a8c7636 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:31.349318 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-87a1b55f-b6c4-4a64-a80d-40897a8c7636 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:31.378780 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-87a1b55f-b6c4-4a64-a80d-40897a8c7636 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:01:31.487634 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-87a1b55f-b6c4-4a64-a80d-40897a8c7636 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 204 len: 0 microversion: 2.20 time: 0.151816 Aug 04 17:01:31.489006 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2369/4839] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Aug 4 17:01:31 2022] DELETE /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 17:01:31.495970 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7f96617f-9b80-4a48-8c5e-f9f9de562462 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:31.497908 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7f96617f-9b80-4a48-8c5e-f9f9de562462 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:31.505094 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f96617f-9b80-4a48-8c5e-f9f9de562462 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:31.505745 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f96617f-9b80-4a48-8c5e-f9f9de562462 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:31.506376 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f96617f-9b80-4a48-8c5e-f9f9de562462 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:31.506979 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f96617f-9b80-4a48-8c5e-f9f9de562462 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:31.683134 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4e4c5fb1-3de5-4179-bb0c-08f5c7857536 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58bee740320490097a8b7998688e679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff21309fd6c943b392615144aa092e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:31.693488 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4e4c5fb1-3de5-4179-bb0c-08f5c7857536 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] 10.222.0.23 "GET /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69" status: 200 len: 1528 microversion: 2.1 time: 0.392062 Aug 04 17:01:31.694722 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2471/4840] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:31 2022] GET /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69 => generated 1528 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:31.700596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-44864a61-4792-4208-b7ba-8b45f139e518 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:31.701880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-44864a61-4792-4208-b7ba-8b45f139e518 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:31.709692 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-44864a61-4792-4208-b7ba-8b45f139e518 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:31.710579 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-44864a61-4792-4208-b7ba-8b45f139e518 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:31.711876 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-44864a61-4792-4208-b7ba-8b45f139e518 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:31.712607 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-44864a61-4792-4208-b7ba-8b45f139e518 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:31.812360 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7f96617f-9b80-4a48-8c5e-f9f9de562462 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:31.822656 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7f96617f-9b80-4a48-8c5e-f9f9de562462 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1506 microversion: 2.1 time: 0.332320 Aug 04 17:01:31.823389 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2370/4841] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:31 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1506 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:31.828740 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c19a7587-6533-4c9f-8c0c-d2c2c5e10303 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:31.829705 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c19a7587-6533-4c9f-8c0c-d2c2c5e10303 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] [instance: 45167cf2-60f4-4ea0-b751-1a349694346c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:31.847856 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c19a7587-6533-4c9f-8c0c-d2c2c5e10303 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:31.849627 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c19a7587-6533-4c9f-8c0c-d2c2c5e10303 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:31.851006 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c19a7587-6533-4c9f-8c0c-d2c2c5e10303 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:31.851759 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c19a7587-6533-4c9f-8c0c-d2c2c5e10303 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:31.986878 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-44864a61-4792-4208-b7ba-8b45f139e518 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:32.000194 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-44864a61-4792-4208-b7ba-8b45f139e518 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:32.002585 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c19a7587-6533-4c9f-8c0c-d2c2c5e10303 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fd3653eee4f798d0860705a2b4030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8759879e1bec45e38e9434db6bcf85e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:32.005747 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-44864a61-4792-4208-b7ba-8b45f139e518 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:32.008131 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-44864a61-4792-4208-b7ba-8b45f139e518 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1724 microversion: 2.20 time: 0.311493 Aug 04 17:01:32.009186 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2472/4842] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:01:31 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1724 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:01:32.015800 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-336641d8-1969-4d8e-8377-b782db0cedd6 tempest-ServersNegativeTestMultiTenantJSON-1507859414 tempest-ServersNegativeTestMultiTenantJSON-1507859414-project] Action: 'update', calling method: >, body: {"server": {"name": "d38ee4ca-53a6-44a6-accd-8441ff314a69_new"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:32.018894 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-336641d8-1969-4d8e-8377-b782db0cedd6 tempest-ServersNegativeTestMultiTenantJSON-1507859414 tempest-ServersNegativeTestMultiTenantJSON-1507859414-project] [instance: d38ee4ca-53a6-44a6-accd-8441ff314a69] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:32.024151 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c19a7587-6533-4c9f-8c0c-d2c2c5e10303 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] 10.222.0.23 "GET /compute/v2.1/servers/45167cf2-60f4-4ea0-b751-1a349694346c" status: 200 len: 1297 microversion: 2.1 time: 0.199211 Aug 04 17:01:32.033359 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2371/4843] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:31 2022] GET /compute/v2.1/servers/45167cf2-60f4-4ea0-b751-1a349694346c => generated 1297 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:32.033359 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a343335c-6f57-4b51-a3b9-890381abde53 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:32.033359 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a343335c-6f57-4b51-a3b9-890381abde53 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 179db84c-f006-46b9-85ad-ceea5c6a15ad] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:32.033359 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:32.039930 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-336641d8-1969-4d8e-8377-b782db0cedd6 tempest-ServersNegativeTestMultiTenantJSON-1507859414 tempest-ServersNegativeTestMultiTenantJSON-1507859414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:32.040662 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-336641d8-1969-4d8e-8377-b782db0cedd6 tempest-ServersNegativeTestMultiTenantJSON-1507859414 tempest-ServersNegativeTestMultiTenantJSON-1507859414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:32.041825 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-336641d8-1969-4d8e-8377-b782db0cedd6 tempest-ServersNegativeTestMultiTenantJSON-1507859414 tempest-ServersNegativeTestMultiTenantJSON-1507859414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:32.042253 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-336641d8-1969-4d8e-8377-b782db0cedd6 tempest-ServersNegativeTestMultiTenantJSON-1507859414 tempest-ServersNegativeTestMultiTenantJSON-1507859414-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:32.047009 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a343335c-6f57-4b51-a3b9-890381abde53 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:32.047448 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a343335c-6f57-4b51-a3b9-890381abde53 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:32.049029 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a343335c-6f57-4b51-a3b9-890381abde53 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:32.049029 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a343335c-6f57-4b51-a3b9-890381abde53 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:32.060641 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-336641d8-1969-4d8e-8377-b782db0cedd6 tempest-ServersNegativeTestMultiTenantJSON-1507859414 tempest-ServersNegativeTestMultiTenantJSON-1507859414-project] HTTP exception thrown: Instance d38ee4ca-53a6-44a6-accd-8441ff314a69 could not be found. Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-336641d8-1969-4d8e-8377-b782db0cedd6 tempest-ServersNegativeTestMultiTenantJSON-1507859414 tempest-ServersNegativeTestMultiTenantJSON-1507859414-project] Request method failure captured: Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: request: PUT /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69 HTTP/1.1 Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 64 Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_tXvbjB6zRMcegWeUpskFIQ6zCbGsrTgVwnUxXdPW8rf__QdeSNecUwLnQS5UclQNYC_sGx1SGv6UR9bsiF8oCzAt-cBFrZlsq9W-0zjc7zO7qGrwieZtZwMIXWi_dWNQM7af5ThQT_vVePbrMGuwK6IZEPfxPFXHKkEBuTpzpTwEI Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 92aa79fe63bf4d1fb03095c44e8b3e9d Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1507859414 Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/92aa79fe63bf4d1fb03095c44e8b3e9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_92aa79fe63bf4d1fb03095c44e8b3e9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/92aa79fe63bf4d1fb03095c44e8b3e9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/92aa79fe63bf4d1fb03095c44e8b3e9d"}]}] Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1507859414 Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 92aa79fe63bf4d1fb03095c44e8b3e9d Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1507859414 Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1507859414-project Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 7df8c5f8e970450299f63f38ca918910 Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1507859414-project Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: {"server": {"name": "d38ee4ca-53a6-44a6-accd-8441ff314a69_new"}} Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance d38ee4ca-53a6-44a6-accd-8441ff314a69 could not be found. Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'd38ee4ca-53a6-44a6-accd-8441ff314a69', 'body': {'server': {'name': 'd38ee4ca-53a6-44a6-accd-8441ff314a69_new'}}} Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d38ee4ca-53a6-44a6-accd-8441ff314a69 could not be found. Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:01:32.062559 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 04 17:01:32.067452 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 04 17:01:32.067452 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 04 17:01:32.067452 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:01:32.067452 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:01:32.067452 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:01:32.067452 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:01:32.067452 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d38ee4ca-53a6-44a6-accd-8441ff314a69 could not be found. Aug 04 17:01:32.067452 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:32.067452 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:32.067452 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:32.067452 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:32.067452 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:32.067452 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:32.067452 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:01:32.067452 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:01:32.067452 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d38ee4ca-53a6-44a6-accd-8441ff314a69 could not be found. Aug 04 17:01:32.067452 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:32.067452 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-336641d8-1969-4d8e-8377-b782db0cedd6 tempest-ServersNegativeTestMultiTenantJSON-1507859414 tempest-ServersNegativeTestMultiTenantJSON-1507859414-project] Returning 404 to user: Instance d38ee4ca-53a6-44a6-accd-8441ff314a69 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:01:32.067452 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-336641d8-1969-4d8e-8377-b782db0cedd6 tempest-ServersNegativeTestMultiTenantJSON-1507859414 tempest-ServersNegativeTestMultiTenantJSON-1507859414-project] 10.222.0.23 "PUT /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69" status: 404 len: 111 microversion: 2.1 time: 0.053071 Aug 04 17:01:32.070713 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2473/4844] 10.222.0.23 () {60 vars in 1256 bytes} [Thu Aug 4 17:01:32 2022] PUT /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:01:32.075825 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5ea38de9-0aa1-4245-9768-30f53099460b tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:32.076332 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5ea38de9-0aa1-4245-9768-30f53099460b tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] [instance: d38ee4ca-53a6-44a6-accd-8441ff314a69] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:32.083166 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ea38de9-0aa1-4245-9768-30f53099460b tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:32.083975 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ea38de9-0aa1-4245-9768-30f53099460b tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:32.085899 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ea38de9-0aa1-4245-9768-30f53099460b tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:32.086518 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ea38de9-0aa1-4245-9768-30f53099460b tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:32.116933 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5ea38de9-0aa1-4245-9768-30f53099460b tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] [instance: d38ee4ca-53a6-44a6-accd-8441ff314a69] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:01:32.205166 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5ea38de9-0aa1-4245-9768-30f53099460b tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69" status: 204 len: 0 microversion: 2.1 time: 0.132989 Aug 04 17:01:32.208842 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2474/4845] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:01:32 2022] DELETE /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:01:32.216641 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-64104390-612c-4c0b-899b-7821224b669c tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:32.217500 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-64104390-612c-4c0b-899b-7821224b669c tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] [instance: d38ee4ca-53a6-44a6-accd-8441ff314a69] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:32.224403 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-64104390-612c-4c0b-899b-7821224b669c tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:32.225018 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-64104390-612c-4c0b-899b-7821224b669c tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:32.226580 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-64104390-612c-4c0b-899b-7821224b669c tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:32.227107 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-64104390-612c-4c0b-899b-7821224b669c tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:32.549507 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a343335c-6f57-4b51-a3b9-890381abde53 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:32.556145 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-64104390-612c-4c0b-899b-7821224b669c tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58bee740320490097a8b7998688e679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff21309fd6c943b392615144aa092e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:32.557885 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a343335c-6f57-4b51-a3b9-890381abde53 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad" status: 200 len: 1367 microversion: 2.1 time: 0.532088 Aug 04 17:01:32.571538 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2372/4846] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:32 2022] GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad => generated 1367 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:32.571538 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c195afe6-81e7-465b-b008-02301930737e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:32.571538 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c195afe6-81e7-465b-b008-02301930737e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:32.571997 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-64104390-612c-4c0b-899b-7821224b669c tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] 10.222.0.23 "GET /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69" status: 200 len: 1534 microversion: 2.1 time: 0.354059 Aug 04 17:01:32.571997 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2475/4847] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:32 2022] GET /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69 => generated 1534 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:01:32.572216 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c195afe6-81e7-465b-b008-02301930737e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:32.572216 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c195afe6-81e7-465b-b008-02301930737e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:32.572216 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c195afe6-81e7-465b-b008-02301930737e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:32.572216 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c195afe6-81e7-465b-b008-02301930737e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:32.573314 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8ebc0db1-7df4-4416-b44f-4b141e3c8879 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:32.577473 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8ebc0db1-7df4-4416-b44f-4b141e3c8879 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: bb775932-ec80-4b14-b137-6ebd3c33670d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:32.584499 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8ebc0db1-7df4-4416-b44f-4b141e3c8879 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:32.585236 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8ebc0db1-7df4-4416-b44f-4b141e3c8879 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:32.586379 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8ebc0db1-7df4-4416-b44f-4b141e3c8879 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:32.586983 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8ebc0db1-7df4-4416-b44f-4b141e3c8879 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:32.593608 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:32.864010 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c195afe6-81e7-465b-b008-02301930737e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:32.867334 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:32.874418 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c195afe6-81e7-465b-b008-02301930737e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1533 microversion: 2.1 time: 0.314806 Aug 04 17:01:32.876577 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8ebc0db1-7df4-4416-b44f-4b141e3c8879 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:32.890216 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2373/4848] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:32 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1533 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:32.896842 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-61fa49e1-6ab5-4a4f-9ece-90ecaf13dca3 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:32.897795 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-61fa49e1-6ab5-4a4f-9ece-90ecaf13dca3 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:32.903299 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8ebc0db1-7df4-4416-b44f-4b141e3c8879 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d" status: 200 len: 1214 microversion: 2.1 time: 0.334800 Aug 04 17:01:32.904573 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2476/4849] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:32 2022] GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d => generated 1214 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:32.910381 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-61fa49e1-6ab5-4a4f-9ece-90ecaf13dca3 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:32.910763 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-61fa49e1-6ab5-4a4f-9ece-90ecaf13dca3 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:32.911541 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-61fa49e1-6ab5-4a4f-9ece-90ecaf13dca3 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:32.911966 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-61fa49e1-6ab5-4a4f-9ece-90ecaf13dca3 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:32.959912 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-7893a002-56f6-4a61-9672-266f3d3df3d7 req-44780167-de5b-42fc-8fd5-ebf7059e40aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb775932-ec80-4b14-b137-6ebd3c33670d", "tag": "2d31dc34-8f58-4525-9bf2-5aabd514d9a1"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:32.979421 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7893a002-56f6-4a61-9672-266f3d3df3d7 req-44780167-de5b-42fc-8fd5-ebf7059e40aa service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:32.979863 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7893a002-56f6-4a61-9672-266f3d3df3d7 req-44780167-de5b-42fc-8fd5-ebf7059e40aa service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:33.009073 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-7893a002-56f6-4a61-9672-266f3d3df3d7 req-44780167-de5b-42fc-8fd5-ebf7059e40aa service nova] Creating event network-changed:2d31dc34-8f58-4525-9bf2-5aabd514d9a1 for instance bb775932-ec80-4b14-b137-6ebd3c33670d on n-h1-846466-12 Aug 04 17:01:33.021234 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-7893a002-56f6-4a61-9672-266f3d3df3d7 req-44780167-de5b-42fc-8fd5-ebf7059e40aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066165 Aug 04 17:01:33.022335 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2477/4850] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:33.044993 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-eeb492d3-04b9-45a5-811e-7f201a23c000 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:33.047840 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-eeb492d3-04b9-45a5-811e-7f201a23c000 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:33.062778 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eeb492d3-04b9-45a5-811e-7f201a23c000 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:33.063730 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eeb492d3-04b9-45a5-811e-7f201a23c000 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:33.063995 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eeb492d3-04b9-45a5-811e-7f201a23c000 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:33.064706 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eeb492d3-04b9-45a5-811e-7f201a23c000 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:33.341638 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-61fa49e1-6ab5-4a4f-9ece-90ecaf13dca3 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:33.352062 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-61fa49e1-6ab5-4a4f-9ece-90ecaf13dca3 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1506 microversion: 2.1 time: 0.460604 Aug 04 17:01:33.352664 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2374/4851] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:32 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1506 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:33.366956 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3c39d2f6-c2f5-4261-8558-2f9017fbae54 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:33.367635 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3c39d2f6-c2f5-4261-8558-2f9017fbae54 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] [instance: 45167cf2-60f4-4ea0-b751-1a349694346c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:33.380650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3c39d2f6-c2f5-4261-8558-2f9017fbae54 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:33.381335 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3c39d2f6-c2f5-4261-8558-2f9017fbae54 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:33.382698 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3c39d2f6-c2f5-4261-8558-2f9017fbae54 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:33.383133 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3c39d2f6-c2f5-4261-8558-2f9017fbae54 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:33.572621 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-eeb492d3-04b9-45a5-811e-7f201a23c000 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:33.588619 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-eeb492d3-04b9-45a5-811e-7f201a23c000 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:33.591498 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-eeb492d3-04b9-45a5-811e-7f201a23c000 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:33.593182 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-eeb492d3-04b9-45a5-811e-7f201a23c000 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1724 microversion: 2.20 time: 0.558246 Aug 04 17:01:33.593961 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2478/4852] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:01:33 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1724 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:01:33.601348 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6e610161-531a-47fb-a864-0e9671b8584c tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:33.602407 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6e610161-531a-47fb-a864-0e9671b8584c tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 179db84c-f006-46b9-85ad-ceea5c6a15ad] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:33.611059 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3c39d2f6-c2f5-4261-8558-2f9017fbae54 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fd3653eee4f798d0860705a2b4030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8759879e1bec45e38e9434db6bcf85e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:33.620112 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3c39d2f6-c2f5-4261-8558-2f9017fbae54 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] 10.222.0.23 "GET /compute/v2.1/servers/45167cf2-60f4-4ea0-b751-1a349694346c" status: 200 len: 1297 microversion: 2.1 time: 0.263480 Aug 04 17:01:33.621259 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2375/4853] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:33 2022] GET /compute/v2.1/servers/45167cf2-60f4-4ea0-b751-1a349694346c => generated 1297 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:33.621694 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6e610161-531a-47fb-a864-0e9671b8584c tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:33.622470 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6e610161-531a-47fb-a864-0e9671b8584c tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:33.623409 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6e610161-531a-47fb-a864-0e9671b8584c tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:33.624068 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6e610161-531a-47fb-a864-0e9671b8584c tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:33.626664 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-db6624b9-3eff-423e-8a92-89f6513724eb tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:33.628938 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-db6624b9-3eff-423e-8a92-89f6513724eb tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] [instance: d38ee4ca-53a6-44a6-accd-8441ff314a69] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:33.650755 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db6624b9-3eff-423e-8a92-89f6513724eb tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:33.651388 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db6624b9-3eff-423e-8a92-89f6513724eb tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:33.652271 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db6624b9-3eff-423e-8a92-89f6513724eb tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:33.652782 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-db6624b9-3eff-423e-8a92-89f6513724eb tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:34.054753 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-db6624b9-3eff-423e-8a92-89f6513724eb tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58bee740320490097a8b7998688e679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff21309fd6c943b392615144aa092e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:34.076715 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6e610161-531a-47fb-a864-0e9671b8584c tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:34.085314 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-db6624b9-3eff-423e-8a92-89f6513724eb tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] 10.222.0.23 "GET /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69" status: 200 len: 1534 microversion: 2.1 time: 0.462595 Aug 04 17:01:34.086013 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6e610161-531a-47fb-a864-0e9671b8584c tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad" status: 200 len: 1367 microversion: 2.1 time: 0.490349 Aug 04 17:01:34.087130 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2479/4854] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:33 2022] GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad => generated 1367 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:34.089996 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2376/4855] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:33 2022] GET /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69 => generated 1534 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:34.092919 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9367e18d-2be4-4a12-b35f-8bfe5920a70b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:34.093880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9367e18d-2be4-4a12-b35f-8bfe5920a70b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:34.113691 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9367e18d-2be4-4a12-b35f-8bfe5920a70b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:34.114767 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9367e18d-2be4-4a12-b35f-8bfe5920a70b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:34.116227 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9367e18d-2be4-4a12-b35f-8bfe5920a70b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:34.117024 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9367e18d-2be4-4a12-b35f-8bfe5920a70b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:34.122450 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-26a5b581-f95a-497c-b6b6-1f11c1d2b07e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:34.129439 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-26a5b581-f95a-497c-b6b6-1f11c1d2b07e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: bb775932-ec80-4b14-b137-6ebd3c33670d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:34.149321 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-26a5b581-f95a-497c-b6b6-1f11c1d2b07e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:34.150819 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-26a5b581-f95a-497c-b6b6-1f11c1d2b07e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:34.152898 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-26a5b581-f95a-497c-b6b6-1f11c1d2b07e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:34.155578 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-26a5b581-f95a-497c-b6b6-1f11c1d2b07e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:34.669786 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9367e18d-2be4-4a12-b35f-8bfe5920a70b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:34.678819 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9367e18d-2be4-4a12-b35f-8bfe5920a70b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1533 microversion: 2.1 time: 0.590410 Aug 04 17:01:34.679671 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2480/4856] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:34 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1533 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:34.684581 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5eda0dbd-8c12-409a-846a-1f0c2e6601ca tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:34.685444 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5eda0dbd-8c12-409a-846a-1f0c2e6601ca tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:34.701958 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5eda0dbd-8c12-409a-846a-1f0c2e6601ca tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:34.702410 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5eda0dbd-8c12-409a-846a-1f0c2e6601ca tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:34.703336 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5eda0dbd-8c12-409a-846a-1f0c2e6601ca tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:34.703763 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5eda0dbd-8c12-409a-846a-1f0c2e6601ca tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:34.742742 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-26a5b581-f95a-497c-b6b6-1f11c1d2b07e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:34.755524 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-26a5b581-f95a-497c-b6b6-1f11c1d2b07e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d" status: 200 len: 1214 microversion: 2.1 time: 0.664440 Aug 04 17:01:34.756831 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2377/4857] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:34 2022] GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d => generated 1214 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:34.951081 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3cbe62d8-8469-4b99-86d5-9e4aa07a2d74 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:34.951958 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3cbe62d8-8469-4b99-86d5-9e4aa07a2d74 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] [instance: cab40427-161a-4071-8c75-1a402c924402] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:34.964896 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3cbe62d8-8469-4b99-86d5-9e4aa07a2d74 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:34.965381 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3cbe62d8-8469-4b99-86d5-9e4aa07a2d74 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:34.973798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3cbe62d8-8469-4b99-86d5-9e4aa07a2d74 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:34.974253 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3cbe62d8-8469-4b99-86d5-9e4aa07a2d74 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:35.025336 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=4 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:35.040890 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3cbe62d8-8469-4b99-86d5-9e4aa07a2d74 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] [instance: cab40427-161a-4071-8c75-1a402c924402] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:01:35.094419 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=14 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:35.155365 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5eda0dbd-8c12-409a-846a-1f0c2e6601ca tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:35.167954 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3cbe62d8-8469-4b99-86d5-9e4aa07a2d74 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402" status: 204 len: 0 microversion: 2.1 time: 0.408018 Aug 04 17:01:35.174011 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2378/4858] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:01:34 2022] DELETE /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:01:35.175977 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5eda0dbd-8c12-409a-846a-1f0c2e6601ca tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1506 microversion: 2.1 time: 0.489780 Aug 04 17:01:35.178031 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2481/4859] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:34 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1506 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:35.184148 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-764e3d66-299e-4ee3-acc9-93d4bda4703a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:35.184849 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-764e3d66-299e-4ee3-acc9-93d4bda4703a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:35.189903 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4f712c0d-14d8-478a-83b8-b3e21fde3046 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:35.191400 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4f712c0d-14d8-478a-83b8-b3e21fde3046 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] [instance: 45167cf2-60f4-4ea0-b751-1a349694346c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:35.205324 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-764e3d66-299e-4ee3-acc9-93d4bda4703a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:35.206322 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4f712c0d-14d8-478a-83b8-b3e21fde3046 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:35.207367 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-764e3d66-299e-4ee3-acc9-93d4bda4703a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:35.208063 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4f712c0d-14d8-478a-83b8-b3e21fde3046 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:35.210108 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4f712c0d-14d8-478a-83b8-b3e21fde3046 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:35.211485 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-764e3d66-299e-4ee3-acc9-93d4bda4703a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:35.213587 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-764e3d66-299e-4ee3-acc9-93d4bda4703a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:35.214504 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4f712c0d-14d8-478a-83b8-b3e21fde3046 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:35.219103 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:35.393775 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-764e3d66-299e-4ee3-acc9-93d4bda4703a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:35.415312 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-764e3d66-299e-4ee3-acc9-93d4bda4703a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:35.418374 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-764e3d66-299e-4ee3-acc9-93d4bda4703a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:35.420056 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-764e3d66-299e-4ee3-acc9-93d4bda4703a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1657 microversion: 2.20 time: 0.244809 Aug 04 17:01:35.421362 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2379/4860] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:01:35 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1657 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:01:35.438414 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4f712c0d-14d8-478a-83b8-b3e21fde3046 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fd3653eee4f798d0860705a2b4030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8759879e1bec45e38e9434db6bcf85e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:35.448482 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4f712c0d-14d8-478a-83b8-b3e21fde3046 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] 10.222.0.23 "GET /compute/v2.1/servers/45167cf2-60f4-4ea0-b751-1a349694346c" status: 200 len: 1297 microversion: 2.1 time: 0.269220 Aug 04 17:01:35.451101 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a0e6135e-d101-4e68-939a-6b7fea09befc tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:35.451980 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a0e6135e-d101-4e68-939a-6b7fea09befc tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 179db84c-f006-46b9-85ad-ceea5c6a15ad] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:35.455932 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2482/4861] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:35 2022] GET /compute/v2.1/servers/45167cf2-60f4-4ea0-b751-1a349694346c => generated 1297 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:35.462131 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-180b9ef4-63b2-4117-95b5-900dc5e82ee9 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:35.466172 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-180b9ef4-63b2-4117-95b5-900dc5e82ee9 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] [instance: d38ee4ca-53a6-44a6-accd-8441ff314a69] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:35.469516 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a0e6135e-d101-4e68-939a-6b7fea09befc tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:35.470603 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a0e6135e-d101-4e68-939a-6b7fea09befc tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:35.471605 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a0e6135e-d101-4e68-939a-6b7fea09befc tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:35.472234 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a0e6135e-d101-4e68-939a-6b7fea09befc tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:35.473104 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-180b9ef4-63b2-4117-95b5-900dc5e82ee9 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:35.473646 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-180b9ef4-63b2-4117-95b5-900dc5e82ee9 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:35.474544 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-180b9ef4-63b2-4117-95b5-900dc5e82ee9 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:35.475837 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-180b9ef4-63b2-4117-95b5-900dc5e82ee9 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:35.649726 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-180b9ef4-63b2-4117-95b5-900dc5e82ee9 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58bee740320490097a8b7998688e679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff21309fd6c943b392615144aa092e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:35.661335 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-180b9ef4-63b2-4117-95b5-900dc5e82ee9 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] 10.222.0.23 "GET /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69" status: 200 len: 1492 microversion: 2.1 time: 0.203225 Aug 04 17:01:35.662245 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2483/4862] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:35 2022] GET /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69 => generated 1492 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:35.681820 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7b9b464c-b34d-4058-81e6-f09c41f9a2a3 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:35.683137 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7b9b464c-b34d-4058-81e6-f09c41f9a2a3 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] [instance: cab40427-161a-4071-8c75-1a402c924402] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:35.706553 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b9b464c-b34d-4058-81e6-f09c41f9a2a3 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:35.708567 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b9b464c-b34d-4058-81e6-f09c41f9a2a3 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:35.710128 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b9b464c-b34d-4058-81e6-f09c41f9a2a3 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:35.710733 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b9b464c-b34d-4058-81e6-f09c41f9a2a3 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:35.799731 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a0e6135e-d101-4e68-939a-6b7fea09befc tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:35.814104 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a0e6135e-d101-4e68-939a-6b7fea09befc tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad" status: 200 len: 1367 microversion: 2.1 time: 0.367534 Aug 04 17:01:35.820806 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2380/4863] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:35 2022] GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad => generated 1367 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:35.826684 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-50c363c9-aec0-495c-90e6-14289072db45 req-4dcb008f-0920-4cb5-bea8-88b244adc70d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45167cf2-60f4-4ea0-b751-1a349694346c", "name": "network-vif-plugged", "status": "completed", "tag": "548085f3-3987-4d72-a366-a9124f3340f5"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:35.840947 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-50c363c9-aec0-495c-90e6-14289072db45 req-4dcb008f-0920-4cb5-bea8-88b244adc70d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:35.841079 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-50c363c9-aec0-495c-90e6-14289072db45 req-4dcb008f-0920-4cb5-bea8-88b244adc70d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:35.853990 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-50c363c9-aec0-495c-90e6-14289072db45 req-4dcb008f-0920-4cb5-bea8-88b244adc70d service nova] Creating event network-vif-plugged:548085f3-3987-4d72-a366-a9124f3340f5 for instance 45167cf2-60f4-4ea0-b751-1a349694346c on n-h2-846466-12 Aug 04 17:01:35.859223 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-50c363c9-aec0-495c-90e6-14289072db45 req-4dcb008f-0920-4cb5-bea8-88b244adc70d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037015 Aug 04 17:01:35.860008 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2381/4864] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:35.934331 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-e58f5a1f-d82b-41ca-b7dc-30517cba661a req-e44ede08-065b-46c4-bf5e-2f9364f65605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdec5afc-3a3a-4d61-a934-5edf0c7c1397", "name": "network-vif-deleted", "tag": "0762f466-ea31-44a7-9ac5-75aaf39b80a6"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:35.945887 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-e58f5a1f-d82b-41ca-b7dc-30517cba661a req-e44ede08-065b-46c4-bf5e-2f9364f65605 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:35.946044 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7b9b464c-b34d-4058-81e6-f09c41f9a2a3 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34126dbe898545fd9d7e03b55880ab53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c93b891c0324a8cace12fb77490ad16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:35.946326 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-e58f5a1f-d82b-41ca-b7dc-30517cba661a req-e44ede08-065b-46c4-bf5e-2f9364f65605 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:35.956218 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7b9b464c-b34d-4058-81e6-f09c41f9a2a3 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] 10.222.0.23 "GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402" status: 200 len: 1733 microversion: 2.1 time: 0.278279 Aug 04 17:01:35.957608 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2484/4865] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:35 2022] GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402 => generated 1733 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:35.962999 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-290ff98a-1a54-48b0-8612-0b8fc3ec8ffc req-7f6b62f3-c605-47be-bc0f-b67aa7333783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d38ee4ca-53a6-44a6-accd-8441ff314a69", "name": "network-vif-deleted", "tag": "fae59d71-0ceb-4291-9527-914a3afb9bfe"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:35.970893 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-e58f5a1f-d82b-41ca-b7dc-30517cba661a req-e44ede08-065b-46c4-bf5e-2f9364f65605 service nova] Creating event network-vif-deleted:0762f466-ea31-44a7-9ac5-75aaf39b80a6 for instance fdec5afc-3a3a-4d61-a934-5edf0c7c1397 on n-h2-846466-12 Aug 04 17:01:35.975446 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-290ff98a-1a54-48b0-8612-0b8fc3ec8ffc req-7f6b62f3-c605-47be-bc0f-b67aa7333783 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:35.976179 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-290ff98a-1a54-48b0-8612-0b8fc3ec8ffc req-7f6b62f3-c605-47be-bc0f-b67aa7333783 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:35.978651 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-e58f5a1f-d82b-41ca-b7dc-30517cba661a req-e44ede08-065b-46c4-bf5e-2f9364f65605 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117470 Aug 04 17:01:35.979646 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2382/4866] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:35.988268 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-faa9cc6c-3890-4d24-9e0d-d8f270ffde43 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:35.989622 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-faa9cc6c-3890-4d24-9e0d-d8f270ffde43 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:35.999391 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-faa9cc6c-3890-4d24-9e0d-d8f270ffde43 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:35.999916 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-faa9cc6c-3890-4d24-9e0d-d8f270ffde43 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:36.001069 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-faa9cc6c-3890-4d24-9e0d-d8f270ffde43 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:36.001563 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-faa9cc6c-3890-4d24-9e0d-d8f270ffde43 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:36.006392 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-290ff98a-1a54-48b0-8612-0b8fc3ec8ffc req-7f6b62f3-c605-47be-bc0f-b67aa7333783 service nova] Creating event network-vif-deleted:fae59d71-0ceb-4291-9527-914a3afb9bfe for instance d38ee4ca-53a6-44a6-accd-8441ff314a69 on n-h2-846466-12 Aug 04 17:01:36.015434 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-290ff98a-1a54-48b0-8612-0b8fc3ec8ffc req-7f6b62f3-c605-47be-bc0f-b67aa7333783 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056345 Aug 04 17:01:36.018558 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2485/4867] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:36.026636 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ba0d5643-f4ff-421c-b729-2a304c04fa6e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:36.027333 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ba0d5643-f4ff-421c-b729-2a304c04fa6e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: bb775932-ec80-4b14-b137-6ebd3c33670d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:36.050411 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba0d5643-f4ff-421c-b729-2a304c04fa6e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:36.050411 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba0d5643-f4ff-421c-b729-2a304c04fa6e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:36.050935 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba0d5643-f4ff-421c-b729-2a304c04fa6e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:36.051550 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba0d5643-f4ff-421c-b729-2a304c04fa6e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:36.417036 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=22 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:36.759377 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-faa9cc6c-3890-4d24-9e0d-d8f270ffde43 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:36.771075 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-faa9cc6c-3890-4d24-9e0d-d8f270ffde43 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1533 microversion: 2.1 time: 0.790201 Aug 04 17:01:36.771724 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2383/4868] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:35 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1533 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:36.776921 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ec6e53e7-8ed1-40ed-9073-ed3ff2a2e4a6 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:36.778681 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ec6e53e7-8ed1-40ed-9073-ed3ff2a2e4a6 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:36.790680 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ec6e53e7-8ed1-40ed-9073-ed3ff2a2e4a6 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:36.791135 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ec6e53e7-8ed1-40ed-9073-ed3ff2a2e4a6 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:36.792535 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ec6e53e7-8ed1-40ed-9073-ed3ff2a2e4a6 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:36.792992 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ec6e53e7-8ed1-40ed-9073-ed3ff2a2e4a6 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:36.821107 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ba0d5643-f4ff-421c-b729-2a304c04fa6e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:36.830140 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ba0d5643-f4ff-421c-b729-2a304c04fa6e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d" status: 200 len: 1202 microversion: 2.1 time: 0.810250 Aug 04 17:01:36.830771 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2486/4869] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:36 2022] GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d => generated 1202 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:36.850361 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3d8ac823-126c-411d-b7c6-1538f0788ca0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:36.850361 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3d8ac823-126c-411d-b7c6-1538f0788ca0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:36.863734 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3d8ac823-126c-411d-b7c6-1538f0788ca0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:36.864185 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3d8ac823-126c-411d-b7c6-1538f0788ca0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:36.864968 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3d8ac823-126c-411d-b7c6-1538f0788ca0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:36.865460 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3d8ac823-126c-411d-b7c6-1538f0788ca0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:36.908162 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3d8ac823-126c-411d-b7c6-1538f0788ca0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:36.908994 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3d8ac823-126c-411d-b7c6-1538f0788ca0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:36.909743 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-3d8ac823-126c-411d-b7c6-1538f0788ca0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lazy-loading 'fault' on Instance uuid fdec5afc-3a3a-4d61-a934-5edf0c7c1397 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:01:36.963152 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3d8ac823-126c-411d-b7c6-1538f0788ca0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:36.974471 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3d8ac823-126c-411d-b7c6-1538f0788ca0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:36.977074 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3d8ac823-126c-411d-b7c6-1538f0788ca0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:36.978991 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3d8ac823-126c-411d-b7c6-1538f0788ca0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 200 len: 1371 microversion: 2.20 time: 0.147294 Aug 04 17:01:36.979914 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2487/4870] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:01:36 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 1371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:01:36.996199 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fa9587b1-7cd5-4b7a-acf3-5108c3a52a08 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:36.998166 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fa9587b1-7cd5-4b7a-acf3-5108c3a52a08 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] [instance: 45167cf2-60f4-4ea0-b751-1a349694346c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:37.008418 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fa9587b1-7cd5-4b7a-acf3-5108c3a52a08 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:37.008993 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fa9587b1-7cd5-4b7a-acf3-5108c3a52a08 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:37.009854 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fa9587b1-7cd5-4b7a-acf3-5108c3a52a08 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:37.016492 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fa9587b1-7cd5-4b7a-acf3-5108c3a52a08 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:37.069735 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ec6e53e7-8ed1-40ed-9073-ed3ff2a2e4a6 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:37.079858 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ec6e53e7-8ed1-40ed-9073-ed3ff2a2e4a6 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1506 microversion: 2.1 time: 0.307054 Aug 04 17:01:37.099687 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2384/4871] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:36 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1506 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:37.106102 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-76c89fa8-fad4-4919-b651-080ff5dad861 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:37.107019 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-76c89fa8-fad4-4919-b651-080ff5dad861 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] [instance: d38ee4ca-53a6-44a6-accd-8441ff314a69] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:37.116666 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-76c89fa8-fad4-4919-b651-080ff5dad861 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:37.117534 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-76c89fa8-fad4-4919-b651-080ff5dad861 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:37.120076 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-76c89fa8-fad4-4919-b651-080ff5dad861 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:37.120838 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-76c89fa8-fad4-4919-b651-080ff5dad861 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:37.188191 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fa9587b1-7cd5-4b7a-acf3-5108c3a52a08 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fd3653eee4f798d0860705a2b4030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8759879e1bec45e38e9434db6bcf85e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:37.190706 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-76c89fa8-fad4-4919-b651-080ff5dad861 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:37.191413 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-76c89fa8-fad4-4919-b651-080ff5dad861 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:37.192085 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-76c89fa8-fad4-4919-b651-080ff5dad861 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lazy-loading 'fault' on Instance uuid d38ee4ca-53a6-44a6-accd-8441ff314a69 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:01:37.214537 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fa9587b1-7cd5-4b7a-acf3-5108c3a52a08 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] 10.222.0.23 "GET /compute/v2.1/servers/45167cf2-60f4-4ea0-b751-1a349694346c" status: 200 len: 1297 microversion: 2.1 time: 0.232050 Aug 04 17:01:37.215159 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2488/4872] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:36 2022] GET /compute/v2.1/servers/45167cf2-60f4-4ea0-b751-1a349694346c => generated 1297 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:37.260642 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a086c41e-50c3-445e-958b-58010b619dc4 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:37.262123 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a086c41e-50c3-445e-958b-58010b619dc4 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 179db84c-f006-46b9-85ad-ceea5c6a15ad] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:37.284044 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-76c89fa8-fad4-4919-b651-080ff5dad861 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58bee740320490097a8b7998688e679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff21309fd6c943b392615144aa092e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:37.300113 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a086c41e-50c3-445e-958b-58010b619dc4 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:37.305216 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a086c41e-50c3-445e-958b-58010b619dc4 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:37.308845 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a086c41e-50c3-445e-958b-58010b619dc4 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:37.312058 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a086c41e-50c3-445e-958b-58010b619dc4 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:37.314058 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-76c89fa8-fad4-4919-b651-080ff5dad861 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] 10.222.0.23 "GET /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69" status: 200 len: 1318 microversion: 2.1 time: 0.211684 Aug 04 17:01:37.330698 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2385/4873] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:37 2022] GET /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:37.343016 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-84737ce3-0669-46d3-9376-c15ac19e6e4b tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:37.343905 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-84737ce3-0669-46d3-9376-c15ac19e6e4b tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] [instance: cab40427-161a-4071-8c75-1a402c924402] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:37.352404 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-84737ce3-0669-46d3-9376-c15ac19e6e4b tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:37.353090 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-84737ce3-0669-46d3-9376-c15ac19e6e4b tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:37.354135 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-84737ce3-0669-46d3-9376-c15ac19e6e4b tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:37.354662 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-84737ce3-0669-46d3-9376-c15ac19e6e4b tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:37.639240 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-84737ce3-0669-46d3-9376-c15ac19e6e4b tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34126dbe898545fd9d7e03b55880ab53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c93b891c0324a8cace12fb77490ad16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:37.647873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a086c41e-50c3-445e-958b-58010b619dc4 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:37.651005 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-84737ce3-0669-46d3-9376-c15ac19e6e4b tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] 10.222.0.23 "GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402" status: 200 len: 1733 microversion: 2.1 time: 0.318461 Aug 04 17:01:37.652421 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2386/4874] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:37 2022] GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402 => generated 1733 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:37.670521 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a086c41e-50c3-445e-958b-58010b619dc4 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad" status: 200 len: 1367 microversion: 2.1 time: 0.437720 Aug 04 17:01:37.671961 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2489/4875] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:37 2022] GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad => generated 1367 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:37.795307 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d12e524e-f1c0-4787-b070-259e7c3931ff tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:37.795944 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d12e524e-f1c0-4787-b070-259e7c3931ff tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:37.803877 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d12e524e-f1c0-4787-b070-259e7c3931ff tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:37.804660 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d12e524e-f1c0-4787-b070-259e7c3931ff tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:37.805637 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d12e524e-f1c0-4787-b070-259e7c3931ff tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:37.806241 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d12e524e-f1c0-4787-b070-259e7c3931ff tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:37.863998 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7212f320-b12c-48e3-8a92-de9183ff40eb tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:37.875393 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7212f320-b12c-48e3-8a92-de9183ff40eb tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: bb775932-ec80-4b14-b137-6ebd3c33670d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:37.899695 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7212f320-b12c-48e3-8a92-de9183ff40eb tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:37.900274 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7212f320-b12c-48e3-8a92-de9183ff40eb tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:37.901159 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7212f320-b12c-48e3-8a92-de9183ff40eb tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:37.901627 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7212f320-b12c-48e3-8a92-de9183ff40eb tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:38.147059 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d12e524e-f1c0-4787-b070-259e7c3931ff tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:38.155372 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d12e524e-f1c0-4787-b070-259e7c3931ff tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1528 microversion: 2.1 time: 0.366744 Aug 04 17:01:38.175335 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2387/4876] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:37 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1528 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:38.185524 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-a16a9d06-e58a-499c-83b6-ddfecad049f9 req-09fd03a5-c54b-43ef-b618-96755288a62c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7094f480-111a-4c4e-8a77-2df578c044c0", "name": "network-vif-plugged", "status": "completed", "tag": "7cc4e42a-ac69-4d95-810a-566a44e11ef2"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:38.198850 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a16a9d06-e58a-499c-83b6-ddfecad049f9 req-09fd03a5-c54b-43ef-b618-96755288a62c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:38.199280 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a16a9d06-e58a-499c-83b6-ddfecad049f9 req-09fd03a5-c54b-43ef-b618-96755288a62c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:38.227978 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-a16a9d06-e58a-499c-83b6-ddfecad049f9 req-09fd03a5-c54b-43ef-b618-96755288a62c service nova] Creating event network-vif-plugged:7cc4e42a-ac69-4d95-810a-566a44e11ef2 for instance 7094f480-111a-4c4e-8a77-2df578c044c0 on n-h1-846466-12 Aug 04 17:01:38.233580 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-a16a9d06-e58a-499c-83b6-ddfecad049f9 req-09fd03a5-c54b-43ef-b618-96755288a62c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056442 Aug 04 17:01:38.234594 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2388/4877] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:38.239835 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ea61d832-5531-4f7c-ba62-1523d3fd3be3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:38.240632 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ea61d832-5531-4f7c-ba62-1523d3fd3be3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:38.252214 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea61d832-5531-4f7c-ba62-1523d3fd3be3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:38.252662 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea61d832-5531-4f7c-ba62-1523d3fd3be3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:38.253493 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea61d832-5531-4f7c-ba62-1523d3fd3be3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:38.253901 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea61d832-5531-4f7c-ba62-1523d3fd3be3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:38.271924 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7212f320-b12c-48e3-8a92-de9183ff40eb tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:38.280187 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-ea61d832-5531-4f7c-ba62-1523d3fd3be3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] HTTP exception thrown: Instance fdec5afc-3a3a-4d61-a934-5edf0c7c1397 could not be found. Aug 04 17:01:38.282672 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7212f320-b12c-48e3-8a92-de9183ff40eb tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d" status: 200 len: 1202 microversion: 2.1 time: 0.428561 Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ea61d832-5531-4f7c-ba62-1523d3fd3be3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Request method failure captured: Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 HTTP/1.1 Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_qndxwtkVSpt9eVNk6ZKpFWJUcFmuQLaaSx6ocgZ7gmg2r9GxpWFc241UYsUoIBHVxqlAzz16eog81fL_ft_rOSwNbZQ8QVGT5NAUYt1npmuLnbZSe16PgStKvW5mqTXgejMujgHsJd9y2d2cMsw6qbBYV95uiNxB_Det_6BWr4NE8 Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 470aa7b0a4464f9789d315176c4b7bc6 Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1028345116 Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/470aa7b0a4464f9789d315176c4b7bc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_470aa7b0a4464f9789d315176c4b7bc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/470aa7b0a4464f9789d315176c4b7bc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/470aa7b0a4464f9789d315176c4b7bc6"}]}] Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1028345116 Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 470aa7b0a4464f9789d315176c4b7bc6 Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1028345116 Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-AttachVolumeShelveTestJSON-1028345116-project Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 6700990d94334afcac9adff62009d099 Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1028345116-project Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance fdec5afc-3a3a-4d61-a934-5edf0c7c1397 could not be found. Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'fdec5afc-3a3a-4d61-a934-5edf0c7c1397'} Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdec5afc-3a3a-4d61-a934-5edf0c7c1397 could not be found. Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdec5afc-3a3a-4d61-a934-5edf0c7c1397 could not be found. Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:38.284987 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:38.291865 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:38.291865 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:38.291865 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:38.291865 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:38.291865 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:01:38.291865 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:01:38.291865 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdec5afc-3a3a-4d61-a934-5edf0c7c1397 could not be found. Aug 04 17:01:38.291865 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:38.292911 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ea61d832-5531-4f7c-ba62-1523d3fd3be3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Returning 404 to user: Instance fdec5afc-3a3a-4d61-a934-5edf0c7c1397 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:01:38.294727 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ea61d832-5531-4f7c-ba62-1523d3fd3be3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 404 len: 111 microversion: 2.20 time: 0.059004 Aug 04 17:01:38.295539 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2389/4878] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:01:38 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:01:38.313450 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2490/4879] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:37 2022] GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d => generated 1202 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:38.318900 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-50fd92cc-6bd8-4aff-b1bb-d9cd2e1bd2f8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:38.319772 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-50fd92cc-6bd8-4aff-b1bb-d9cd2e1bd2f8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:38.326918 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-50fd92cc-6bd8-4aff-b1bb-d9cd2e1bd2f8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:38.327803 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-50fd92cc-6bd8-4aff-b1bb-d9cd2e1bd2f8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:38.328810 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-50fd92cc-6bd8-4aff-b1bb-d9cd2e1bd2f8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:38.329468 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-50fd92cc-6bd8-4aff-b1bb-d9cd2e1bd2f8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:38.329601 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2d7bb698-d7f8-4b87-9b99-d1522265894a tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:38.331231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2d7bb698-d7f8-4b87-9b99-d1522265894a tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] [instance: 45167cf2-60f4-4ea0-b751-1a349694346c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:38.345717 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d7bb698-d7f8-4b87-9b99-d1522265894a tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:38.362608 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d7bb698-d7f8-4b87-9b99-d1522265894a tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:38.363484 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d7bb698-d7f8-4b87-9b99-d1522265894a tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:38.363944 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d7bb698-d7f8-4b87-9b99-d1522265894a tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:38.641143 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2d7bb698-d7f8-4b87-9b99-d1522265894a tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fd3653eee4f798d0860705a2b4030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8759879e1bec45e38e9434db6bcf85e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:38.651135 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2d7bb698-d7f8-4b87-9b99-d1522265894a tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] 10.222.0.23 "GET /compute/v2.1/servers/45167cf2-60f4-4ea0-b751-1a349694346c" status: 200 len: 1469 microversion: 2.1 time: 0.330546 Aug 04 17:01:38.656086 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2491/4880] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:38 2022] GET /compute/v2.1/servers/45167cf2-60f4-4ea0-b751-1a349694346c => generated 1469 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:38.664721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-50fd92cc-6bd8-4aff-b1bb-d9cd2e1bd2f8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:38.669229 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-25aa07ec-cc83-4927-88f2-d1c65061293b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '.version_select at 0x7f7e84522a60>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:38.685527 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-50fd92cc-6bd8-4aff-b1bb-d9cd2e1bd2f8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1506 microversion: 2.1 time: 0.388987 Aug 04 17:01:38.690853 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2390/4881] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:38 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1506 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:38.696150 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e0ce21d4-ea85-4372-95aa-6bdc27b63e78 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:38.713620 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e0ce21d4-ea85-4372-95aa-6bdc27b63e78 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] [instance: d38ee4ca-53a6-44a6-accd-8441ff314a69] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:38.725775 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e0ce21d4-ea85-4372-95aa-6bdc27b63e78 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:38.726533 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e0ce21d4-ea85-4372-95aa-6bdc27b63e78 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:38.727491 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e0ce21d4-ea85-4372-95aa-6bdc27b63e78 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:38.728082 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e0ce21d4-ea85-4372-95aa-6bdc27b63e78 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:38.754087 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-e0ce21d4-ea85-4372-95aa-6bdc27b63e78 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] HTTP exception thrown: Instance d38ee4ca-53a6-44a6-accd-8441ff314a69 could not be found. Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e0ce21d4-ea85-4372-95aa-6bdc27b63e78 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Request method failure captured: Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69 HTTP/1.1 Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_tMrsBgCT32A04azoVU9mIJSuiqmVwNs586NgzTBkoBzL6ZFT2La6XgtqUEEsOmDIu79Gt2zVawJ5puSnl7WrnoyylWTfhblhYyV9iGwMW5Vy36sazu60KLmzqY_YawT5hrpNUCDkQsz5r5FlXK8emf2sH28bMihRPiDl9g0cKJ8wM Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: ff21309fd6c943b392615144aa092e4d Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-705689793 Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ff21309fd6c943b392615144aa092e4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ff21309fd6c943b392615144aa092e4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ff21309fd6c943b392615144aa092e4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ff21309fd6c943b392615144aa092e4d"}]}] Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-705689793 Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: ff21309fd6c943b392615144aa092e4d Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-705689793 Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersNegativeTestMultiTenantJSON-705689793-project Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: e58bee740320490097a8b7998688e679 Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-705689793-project Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance d38ee4ca-53a6-44a6-accd-8441ff314a69 could not be found. Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'd38ee4ca-53a6-44a6-accd-8441ff314a69'} Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d38ee4ca-53a6-44a6-accd-8441ff314a69 could not be found. Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d38ee4ca-53a6-44a6-accd-8441ff314a69 could not be found. Aug 04 17:01:38.756073 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:38.761756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:38.761756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:38.761756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:38.761756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:38.761756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:38.761756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:01:38.761756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:01:38.761756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d38ee4ca-53a6-44a6-accd-8441ff314a69 could not be found. Aug 04 17:01:38.761756 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:38.763606 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-25aa07ec-cc83-4927-88f2-d1c65061293b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2017448656" status: 204 len: 0 microversion: 2.20 time: 0.104871 Aug 04 17:01:38.764702 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2492/4882] 10.222.0.23 () {60 vars in 1262 bytes} [Thu Aug 4 17:01:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2017448656 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 17:01:38.765222 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e0ce21d4-ea85-4372-95aa-6bdc27b63e78 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] Returning 404 to user: Instance d38ee4ca-53a6-44a6-accd-8441ff314a69 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:01:38.766302 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e0ce21d4-ea85-4372-95aa-6bdc27b63e78 tempest-ServersNegativeTestMultiTenantJSON-705689793 tempest-ServersNegativeTestMultiTenantJSON-705689793-project] 10.222.0.23 "GET /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69" status: 404 len: 111 microversion: 2.1 time: 0.074167 Aug 04 17:01:38.767338 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2391/4883] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:38 2022] GET /compute/v2.1/servers/d38ee4ca-53a6-44a6-accd-8441ff314a69 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:01:38.775262 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-44e6158f-ef2a-4448-a3ec-d77aee7f6794 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:38.776446 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-44e6158f-ef2a-4448-a3ec-d77aee7f6794 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] [instance: cab40427-161a-4071-8c75-1a402c924402] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:38.783148 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-a62f6c84-bcef-43eb-9feb-459f047f9631 req-4428c2c0-eea0-43c0-abc7-70f0e447164c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab40427-161a-4071-8c75-1a402c924402", "name": "network-vif-deleted", "tag": "48c095fd-d4cb-401f-b1ff-0380e65dd15f"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:38.785457 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-44e6158f-ef2a-4448-a3ec-d77aee7f6794 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:38.786468 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-44e6158f-ef2a-4448-a3ec-d77aee7f6794 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:38.787692 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-44e6158f-ef2a-4448-a3ec-d77aee7f6794 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:38.788653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-44e6158f-ef2a-4448-a3ec-d77aee7f6794 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:38.810378 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-a62f6c84-bcef-43eb-9feb-459f047f9631 req-4428c2c0-eea0-43c0-abc7-70f0e447164c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:38.815435 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-a62f6c84-bcef-43eb-9feb-459f047f9631 req-4428c2c0-eea0-43c0-abc7-70f0e447164c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:38.845751 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-44e6158f-ef2a-4448-a3ec-d77aee7f6794 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:38.846813 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-44e6158f-ef2a-4448-a3ec-d77aee7f6794 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:38.847423 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-44e6158f-ef2a-4448-a3ec-d77aee7f6794 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lazy-loading 'fault' on Instance uuid cab40427-161a-4071-8c75-1a402c924402 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:01:38.848218 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-a62f6c84-bcef-43eb-9feb-459f047f9631 req-4428c2c0-eea0-43c0-abc7-70f0e447164c service nova] Creating event network-vif-deleted:48c095fd-d4cb-401f-b1ff-0380e65dd15f for instance cab40427-161a-4071-8c75-1a402c924402 on n-h2-846466-12 Aug 04 17:01:38.860738 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-a62f6c84-bcef-43eb-9feb-459f047f9631 req-4428c2c0-eea0-43c0-abc7-70f0e447164c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094431 Aug 04 17:01:38.861848 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2493/4884] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:38.869179 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ec6017e3-758e-46b1-aaec-ac94216cd50b tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:38.870935 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ec6017e3-758e-46b1-aaec-ac94216cd50b tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] [instance: 45167cf2-60f4-4ea0-b751-1a349694346c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:38.880256 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec6017e3-758e-46b1-aaec-ac94216cd50b tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:38.880858 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec6017e3-758e-46b1-aaec-ac94216cd50b tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:38.882703 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec6017e3-758e-46b1-aaec-ac94216cd50b tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:38.883676 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec6017e3-758e-46b1-aaec-ac94216cd50b tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:39.026333 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-44e6158f-ef2a-4448-a3ec-d77aee7f6794 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34126dbe898545fd9d7e03b55880ab53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c93b891c0324a8cace12fb77490ad16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:39.052169 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-44e6158f-ef2a-4448-a3ec-d77aee7f6794 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] 10.222.0.23 "GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402" status: 200 len: 1389 microversion: 2.1 time: 0.282045 Aug 04 17:01:39.057818 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2392/4885] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:38 2022] GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402 => generated 1389 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:39.072613 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-29175614-4d16-4886-a3ed-6622ca6c50f8 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:39.073225 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-29175614-4d16-4886-a3ed-6622ca6c50f8 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 179db84c-f006-46b9-85ad-ceea5c6a15ad] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:39.112165 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-29175614-4d16-4886-a3ed-6622ca6c50f8 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:39.112779 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-29175614-4d16-4886-a3ed-6622ca6c50f8 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:39.113744 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-29175614-4d16-4886-a3ed-6622ca6c50f8 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:39.121496 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-29175614-4d16-4886-a3ed-6622ca6c50f8 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:39.133619 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ec6017e3-758e-46b1-aaec-ac94216cd50b tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fd3653eee4f798d0860705a2b4030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8759879e1bec45e38e9434db6bcf85e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:39.144148 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ec6017e3-758e-46b1-aaec-ac94216cd50b tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] 10.222.0.23 "GET /compute/v2.1/servers/45167cf2-60f4-4ea0-b751-1a349694346c" status: 200 len: 1469 microversion: 2.1 time: 0.280684 Aug 04 17:01:39.145195 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2494/4886] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:38 2022] GET /compute/v2.1/servers/45167cf2-60f4-4ea0-b751-1a349694346c => generated 1469 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:39.171716 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-67e4d2df-c951-4c21-bce3-d6ad797887ba tempest-TestSecurityGroupsBasicOps-1387780031 tempest-TestSecurityGroupsBasicOps-1387780031-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:39.172772 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-67e4d2df-c951-4c21-bce3-d6ad797887ba tempest-TestSecurityGroupsBasicOps-1387780031 tempest-TestSecurityGroupsBasicOps-1387780031-project-admin] [instance: 45167cf2-60f4-4ea0-b751-1a349694346c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:39.180199 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-67e4d2df-c951-4c21-bce3-d6ad797887ba tempest-TestSecurityGroupsBasicOps-1387780031 tempest-TestSecurityGroupsBasicOps-1387780031-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:39.181074 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-67e4d2df-c951-4c21-bce3-d6ad797887ba tempest-TestSecurityGroupsBasicOps-1387780031 tempest-TestSecurityGroupsBasicOps-1387780031-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:39.182526 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-67e4d2df-c951-4c21-bce3-d6ad797887ba tempest-TestSecurityGroupsBasicOps-1387780031 tempest-TestSecurityGroupsBasicOps-1387780031-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:39.183450 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-67e4d2df-c951-4c21-bce3-d6ad797887ba tempest-TestSecurityGroupsBasicOps-1387780031 tempest-TestSecurityGroupsBasicOps-1387780031-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:39.207335 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=100 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:39.384214 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-67e4d2df-c951-4c21-bce3-d6ad797887ba tempest-TestSecurityGroupsBasicOps-1387780031 tempest-TestSecurityGroupsBasicOps-1387780031-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/45167cf2-60f4-4ea0-b751-1a349694346c" status: 200 len: 1622 microversion: 2.1 time: 0.217105 Aug 04 17:01:39.388361 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2495/4887] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:39 2022] GET /compute/v2.1/servers/45167cf2-60f4-4ea0-b751-1a349694346c => generated 1622 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:39.393552 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f7552558-ad8d-468a-bf74-aa1972cc7688 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:39.398195 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f7552558-ad8d-468a-bf74-aa1972cc7688 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:39.420950 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f7552558-ad8d-468a-bf74-aa1972cc7688 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:39.424306 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f7552558-ad8d-468a-bf74-aa1972cc7688 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:39.425694 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f7552558-ad8d-468a-bf74-aa1972cc7688 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:39.429571 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f7552558-ad8d-468a-bf74-aa1972cc7688 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:39.445172 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-29175614-4d16-4886-a3ed-6622ca6c50f8 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:39.460696 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-29175614-4d16-4886-a3ed-6622ca6c50f8 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad" status: 200 len: 1367 microversion: 2.1 time: 0.400585 Aug 04 17:01:39.462293 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2393/4888] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:39 2022] GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad => generated 1367 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:39.470237 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6a7dd646-6404-4606-8cb2-16bc42f109ad tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:39.474415 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6a7dd646-6404-4606-8cb2-16bc42f109ad tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: bb775932-ec80-4b14-b137-6ebd3c33670d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:39.485198 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a7dd646-6404-4606-8cb2-16bc42f109ad tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:39.488892 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a7dd646-6404-4606-8cb2-16bc42f109ad tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:39.491007 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a7dd646-6404-4606-8cb2-16bc42f109ad tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:39.492981 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a7dd646-6404-4606-8cb2-16bc42f109ad tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:39.731150 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f7552558-ad8d-468a-bf74-aa1972cc7688 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:39.748720 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f7552558-ad8d-468a-bf74-aa1972cc7688 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1528 microversion: 2.1 time: 0.358900 Aug 04 17:01:39.753151 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2496/4889] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:39 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1528 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:39.769088 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7b89348b-7508-4497-aab3-d6a590aabb51 tempest-TestSecurityGroupsBasicOps-1387780031 tempest-TestSecurityGroupsBasicOps-1387780031-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:39.773360 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7b89348b-7508-4497-aab3-d6a590aabb51 tempest-TestSecurityGroupsBasicOps-1387780031 tempest-TestSecurityGroupsBasicOps-1387780031-project-admin] [instance: 36778df0-79fd-4d26-b488-2e6b5e4c0edd] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:39.776366 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:39.782693 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6a7dd646-6404-4606-8cb2-16bc42f109ad tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:39.791372 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6a7dd646-6404-4606-8cb2-16bc42f109ad tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d" status: 200 len: 1202 microversion: 2.1 time: 0.327602 Aug 04 17:01:39.792417 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b89348b-7508-4497-aab3-d6a590aabb51 tempest-TestSecurityGroupsBasicOps-1387780031 tempest-TestSecurityGroupsBasicOps-1387780031-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:39.792883 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b89348b-7508-4497-aab3-d6a590aabb51 tempest-TestSecurityGroupsBasicOps-1387780031 tempest-TestSecurityGroupsBasicOps-1387780031-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:39.793831 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2394/4890] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:39 2022] GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d => generated 1202 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:39.798883 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bf21b5b5-2b2f-44a7-9f4d-bcf3aeb761f8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:39.799791 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bf21b5b5-2b2f-44a7-9f4d-bcf3aeb761f8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:39.806780 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf21b5b5-2b2f-44a7-9f4d-bcf3aeb761f8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:39.807725 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf21b5b5-2b2f-44a7-9f4d-bcf3aeb761f8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:39.808745 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf21b5b5-2b2f-44a7-9f4d-bcf3aeb761f8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:39.809459 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf21b5b5-2b2f-44a7-9f4d-bcf3aeb761f8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:39.812876 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b89348b-7508-4497-aab3-d6a590aabb51 tempest-TestSecurityGroupsBasicOps-1387780031 tempest-TestSecurityGroupsBasicOps-1387780031-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:39.813368 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b89348b-7508-4497-aab3-d6a590aabb51 tempest-TestSecurityGroupsBasicOps-1387780031 tempest-TestSecurityGroupsBasicOps-1387780031-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:40.102472 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bf21b5b5-2b2f-44a7-9f4d-bcf3aeb761f8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:40.114643 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bf21b5b5-2b2f-44a7-9f4d-bcf3aeb761f8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1506 microversion: 2.1 time: 0.319492 Aug 04 17:01:40.117990 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2395/4891] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:39 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1506 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:40.126479 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7d134f32-2c3b-403c-99c4-cfee6b939ce5 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:40.134175 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7d134f32-2c3b-403c-99c4-cfee6b939ce5 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] [instance: cab40427-161a-4071-8c75-1a402c924402] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:40.141491 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7b89348b-7508-4497-aab3-d6a590aabb51 tempest-TestSecurityGroupsBasicOps-1387780031 tempest-TestSecurityGroupsBasicOps-1387780031-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/36778df0-79fd-4d26-b488-2e6b5e4c0edd" status: 200 len: 1912 microversion: 2.1 time: 0.386023 Aug 04 17:01:40.143917 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7d134f32-2c3b-403c-99c4-cfee6b939ce5 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:40.147800 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7d134f32-2c3b-403c-99c4-cfee6b939ce5 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:40.148605 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7d134f32-2c3b-403c-99c4-cfee6b939ce5 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:40.149176 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7d134f32-2c3b-403c-99c4-cfee6b939ce5 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:40.153513 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2497/4892] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:39 2022] GET /compute/v2.1/servers/36778df0-79fd-4d26-b488-2e6b5e4c0edd => generated 1912 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:40.179455 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-7d134f32-2c3b-403c-99c4-cfee6b939ce5 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] HTTP exception thrown: Instance cab40427-161a-4071-8c75-1a402c924402 could not be found. Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7d134f32-2c3b-403c-99c4-cfee6b939ce5 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Request method failure captured: Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402 HTTP/1.1 Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_oXW5UTFzBJ2MR-SiSXl-WDlzlmJ3j-j_3DmBDdMJH02AFBYlG5gwojN65MCJZfzS7pMk8b_xY74eLIokYJ1Ynyd-8TurMFBokA0cLpOCNtlnS_plEqL9G_7xqsYehWJ1fdE6fUs_g-fgvExH1o6xUZ90g7WIituWiBasHSd9TRpN8 Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 7c93b891c0324a8cace12fb77490ad16 Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-TestServerBasicOps-1217943363 Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c93b891c0324a8cace12fb77490ad16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7c93b891c0324a8cace12fb77490ad16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c93b891c0324a8cace12fb77490ad16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7c93b891c0324a8cace12fb77490ad16"}]}] Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-TestServerBasicOps-1217943363 Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 7c93b891c0324a8cace12fb77490ad16 Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-TestServerBasicOps-1217943363 Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-TestServerBasicOps-1217943363-project Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 34126dbe898545fd9d7e03b55880ab53 Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-TestServerBasicOps-1217943363-project Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance cab40427-161a-4071-8c75-1a402c924402 could not be found. Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'cab40427-161a-4071-8c75-1a402c924402'} Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cab40427-161a-4071-8c75-1a402c924402 could not be found. Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cab40427-161a-4071-8c75-1a402c924402 could not be found. Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:40.181184 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:40.187059 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:40.187059 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:40.187059 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:40.187059 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:01:40.187059 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:01:40.187059 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cab40427-161a-4071-8c75-1a402c924402 could not be found. Aug 04 17:01:40.187059 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:01:40.192286 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7d134f32-2c3b-403c-99c4-cfee6b939ce5 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Returning 404 to user: Instance cab40427-161a-4071-8c75-1a402c924402 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:01:40.193584 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7d134f32-2c3b-403c-99c4-cfee6b939ce5 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] 10.222.0.23 "GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402" status: 404 len: 111 microversion: 2.1 time: 0.074644 Aug 04 17:01:40.194418 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2396/4893] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:40 2022] GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:01:40.256509 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-ce119122-7ac0-4fa2-ac1d-4f28a31c8768 req-15494152-3eed-47a6-b2a1-19140347d0db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179db84c-f006-46b9-85ad-ceea5c6a15ad", "name": "network-vif-plugged", "status": "completed", "tag": "9a092a19-0d2c-44cd-bd13-eda962c60553"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:40.285542 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-ce119122-7ac0-4fa2-ac1d-4f28a31c8768 req-15494152-3eed-47a6-b2a1-19140347d0db service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:40.285982 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-ce119122-7ac0-4fa2-ac1d-4f28a31c8768 req-15494152-3eed-47a6-b2a1-19140347d0db service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:40.309228 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-ce119122-7ac0-4fa2-ac1d-4f28a31c8768 req-15494152-3eed-47a6-b2a1-19140347d0db service nova] Creating event network-vif-plugged:9a092a19-0d2c-44cd-bd13-eda962c60553 for instance 179db84c-f006-46b9-85ad-ceea5c6a15ad on n-h1-846466-12 Aug 04 17:01:40.319149 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-ce119122-7ac0-4fa2-ac1d-4f28a31c8768 req-15494152-3eed-47a6-b2a1-19140347d0db service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064937 Aug 04 17:01:40.320021 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2498/4894] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:40.390726 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c103ae05-c388-4346-9fc2-8c05b29d98f0 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:40.391529 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c103ae05-c388-4346-9fc2-8c05b29d98f0 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] [instance: 45167cf2-60f4-4ea0-b751-1a349694346c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:40.407018 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c103ae05-c388-4346-9fc2-8c05b29d98f0 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:40.408413 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c103ae05-c388-4346-9fc2-8c05b29d98f0 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:40.410226 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c103ae05-c388-4346-9fc2-8c05b29d98f0 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:40.410887 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c103ae05-c388-4346-9fc2-8c05b29d98f0 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:40.461604 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c103ae05-c388-4346-9fc2-8c05b29d98f0 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] [instance: 45167cf2-60f4-4ea0-b751-1a349694346c] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:01:40.486382 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-18faf4ad-cb94-46dd-bf00-6320c30a3a53 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:40.487663 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-18faf4ad-cb94-46dd-bf00-6320c30a3a53 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 179db84c-f006-46b9-85ad-ceea5c6a15ad] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:40.534155 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-18faf4ad-cb94-46dd-bf00-6320c30a3a53 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:40.540437 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-18faf4ad-cb94-46dd-bf00-6320c30a3a53 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:40.541917 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-18faf4ad-cb94-46dd-bf00-6320c30a3a53 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:40.542921 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-18faf4ad-cb94-46dd-bf00-6320c30a3a53 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:40.578324 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:40.640769 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c103ae05-c388-4346-9fc2-8c05b29d98f0 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] 10.222.0.23 "DELETE /compute/v2.1/servers/45167cf2-60f4-4ea0-b751-1a349694346c" status: 204 len: 0 microversion: 2.1 time: 0.253983 Aug 04 17:01:40.644101 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2397/4895] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:01:40 2022] DELETE /compute/v2.1/servers/45167cf2-60f4-4ea0-b751-1a349694346c => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:01:40.660481 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a7ba5be8-80d5-4d8e-81ec-b9ff83de63f4 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:40.664148 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a7ba5be8-80d5-4d8e-81ec-b9ff83de63f4 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] [instance: 45167cf2-60f4-4ea0-b751-1a349694346c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:40.671917 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a7ba5be8-80d5-4d8e-81ec-b9ff83de63f4 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:40.672679 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a7ba5be8-80d5-4d8e-81ec-b9ff83de63f4 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:40.673725 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a7ba5be8-80d5-4d8e-81ec-b9ff83de63f4 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:40.674319 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a7ba5be8-80d5-4d8e-81ec-b9ff83de63f4 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:41.024977 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a7ba5be8-80d5-4d8e-81ec-b9ff83de63f4 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fd3653eee4f798d0860705a2b4030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8759879e1bec45e38e9434db6bcf85e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:41.034218 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a7ba5be8-80d5-4d8e-81ec-b9ff83de63f4 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] 10.222.0.23 "GET /compute/v2.1/servers/45167cf2-60f4-4ea0-b751-1a349694346c" status: 200 len: 1475 microversion: 2.1 time: 0.386601 Aug 04 17:01:41.037862 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2398/4896] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:40 2022] GET /compute/v2.1/servers/45167cf2-60f4-4ea0-b751-1a349694346c => generated 1475 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:41.045598 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bf8c8653-ab86-4f8a-8d9d-a3d4ceb20cb9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:41.048187 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bf8c8653-ab86-4f8a-8d9d-a3d4ceb20cb9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:41.060627 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf8c8653-ab86-4f8a-8d9d-a3d4ceb20cb9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:41.062752 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf8c8653-ab86-4f8a-8d9d-a3d4ceb20cb9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:41.063644 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf8c8653-ab86-4f8a-8d9d-a3d4ceb20cb9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:41.066962 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf8c8653-ab86-4f8a-8d9d-a3d4ceb20cb9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:41.137783 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-18faf4ad-cb94-46dd-bf00-6320c30a3a53 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:41.146827 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-18faf4ad-cb94-46dd-bf00-6320c30a3a53 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad" status: 200 len: 1367 microversion: 2.1 time: 0.668292 Aug 04 17:01:41.156727 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2499/4897] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:40 2022] GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad => generated 1367 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:41.163664 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-283ae11b-dd1d-4570-873a-35059640279a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:41.171004 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-283ae11b-dd1d-4570-873a-35059640279a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: bb775932-ec80-4b14-b137-6ebd3c33670d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:41.186603 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-283ae11b-dd1d-4570-873a-35059640279a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:41.193355 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-283ae11b-dd1d-4570-873a-35059640279a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:41.195410 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-283ae11b-dd1d-4570-873a-35059640279a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:41.199686 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-283ae11b-dd1d-4570-873a-35059640279a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:41.353904 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bf8c8653-ab86-4f8a-8d9d-a3d4ceb20cb9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:41.368037 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bf8c8653-ab86-4f8a-8d9d-a3d4ceb20cb9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1528 microversion: 2.1 time: 0.327924 Aug 04 17:01:41.370193 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2399/4898] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:41 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1528 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:41.379513 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5bebdeff-d161-44a8-aa0f-82aec2245ead tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Action: 'create', calling method: .version_select at 0x7f7e8483e1f0>, body: {"keypair": {"name": "tempest-keypair-605289474", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBBQmfX3H/laXrznQ3qnRjaJYpoG/uhp8Cp2OKqUhq6Az0xHIk7BePNtxn9YI9SbYcXe+WTcoMN+XQh49ljHI5G58qBahS64ftrxlFKk2Yz8t0Gwzivl+WWx8sxUHQlwRA=="}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:41.404821 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-5bebdeff-d161-44a8-aa0f-82aec2245ead tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Getting quotas for project 470aa7b0a4464f9789d315176c4b7bc6. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:01:41.416317 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-5bebdeff-d161-44a8-aa0f-82aec2245ead tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Getting quotas for user 6700990d94334afcac9adff62009d099 and project 470aa7b0a4464f9789d315176c4b7bc6. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:01:41.456511 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5bebdeff-d161-44a8-aa0f-82aec2245ead tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.084265 Aug 04 17:01:41.460022 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2400/4899] 10.222.0.23 () {62 vars in 1200 bytes} [Thu Aug 4 17:01:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 88 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 17:01:41.468159 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-221ad7c8-e05a-4c1e-92d9-8654d1cab110 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:41.469172 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-221ad7c8-e05a-4c1e-92d9-8654d1cab110 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:41.477851 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-221ad7c8-e05a-4c1e-92d9-8654d1cab110 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:41.478914 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-221ad7c8-e05a-4c1e-92d9-8654d1cab110 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:41.479905 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-221ad7c8-e05a-4c1e-92d9-8654d1cab110 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:41.480703 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-221ad7c8-e05a-4c1e-92d9-8654d1cab110 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:41.630784 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-283ae11b-dd1d-4570-873a-35059640279a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:41.642538 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-283ae11b-dd1d-4570-873a-35059640279a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d" status: 200 len: 1202 microversion: 2.1 time: 0.484183 Aug 04 17:01:41.659495 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2500/4900] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:41 2022] GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d => generated 1202 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:41.669866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bef6a60b-6813-4493-8674-3147eacd04b3 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:41.671371 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bef6a60b-6813-4493-8674-3147eacd04b3 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] [instance: cab40427-161a-4071-8c75-1a402c924402] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:41.680530 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bef6a60b-6813-4493-8674-3147eacd04b3 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:41.681880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bef6a60b-6813-4493-8674-3147eacd04b3 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:41.683438 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bef6a60b-6813-4493-8674-3147eacd04b3 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:41.684131 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bef6a60b-6813-4493-8674-3147eacd04b3 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:41.702163 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-bef6a60b-6813-4493-8674-3147eacd04b3 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] HTTP exception thrown: Instance cab40427-161a-4071-8c75-1a402c924402 could not be found. Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bef6a60b-6813-4493-8674-3147eacd04b3 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Request method failure captured: Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402 HTTP/1.1 Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_oXW5UTFzBJ2MR-SiSXl-WDlzlmJ3j-j_3DmBDdMJH02AFBYlG5gwojN65MCJZfzS7pMk8b_xY74eLIokYJ1Ynyd-8TurMFBokA0cLpOCNtlnS_plEqL9G_7xqsYehWJ1fdE6fUs_g-fgvExH1o6xUZ90g7WIituWiBasHSd9TRpN8 Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 7c93b891c0324a8cace12fb77490ad16 Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-TestServerBasicOps-1217943363 Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c93b891c0324a8cace12fb77490ad16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7c93b891c0324a8cace12fb77490ad16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c93b891c0324a8cace12fb77490ad16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7c93b891c0324a8cace12fb77490ad16"}]}] Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-TestServerBasicOps-1217943363 Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 7c93b891c0324a8cace12fb77490ad16 Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-TestServerBasicOps-1217943363 Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-TestServerBasicOps-1217943363-project Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 34126dbe898545fd9d7e03b55880ab53 Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-TestServerBasicOps-1217943363-project Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance cab40427-161a-4071-8c75-1a402c924402 could not be found. Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'cab40427-161a-4071-8c75-1a402c924402'} Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cab40427-161a-4071-8c75-1a402c924402 could not be found. Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:01:41.705003 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:01:41.714574 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cab40427-161a-4071-8c75-1a402c924402 could not be found. Aug 04 17:01:41.714574 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:41.714574 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:41.714574 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:41.714574 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:41.714574 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:41.714574 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:41.714574 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:01:41.714574 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:01:41.714574 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cab40427-161a-4071-8c75-1a402c924402 could not be found. Aug 04 17:01:41.714574 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:41.718506 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-221ad7c8-e05a-4c1e-92d9-8654d1cab110 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:41.720054 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bef6a60b-6813-4493-8674-3147eacd04b3 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Returning 404 to user: Instance cab40427-161a-4071-8c75-1a402c924402 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:01:41.721428 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bef6a60b-6813-4493-8674-3147eacd04b3 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402" status: 404 len: 111 microversion: 2.1 time: 0.059805 Aug 04 17:01:41.723477 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2501/4901] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:01:41 2022] DELETE /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:01:41.735486 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-221ad7c8-e05a-4c1e-92d9-8654d1cab110 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1506 microversion: 2.1 time: 0.273914 Aug 04 17:01:41.736072 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2401/4902] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:41 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1506 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:41.736231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-707f79aa-63ef-423f-a300-16bc68141be5 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:41.737262 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-707f79aa-63ef-423f-a300-16bc68141be5 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] [instance: cab40427-161a-4071-8c75-1a402c924402] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:41.748233 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-707f79aa-63ef-423f-a300-16bc68141be5 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:41.749173 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-707f79aa-63ef-423f-a300-16bc68141be5 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:41.750940 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-707f79aa-63ef-423f-a300-16bc68141be5 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:41.751555 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-707f79aa-63ef-423f-a300-16bc68141be5 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:41.780935 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-707f79aa-63ef-423f-a300-16bc68141be5 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] HTTP exception thrown: Instance cab40427-161a-4071-8c75-1a402c924402 could not be found. Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-707f79aa-63ef-423f-a300-16bc68141be5 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Request method failure captured: Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402 HTTP/1.1 Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_oXW5UTFzBJ2MR-SiSXl-WDlzlmJ3j-j_3DmBDdMJH02AFBYlG5gwojN65MCJZfzS7pMk8b_xY74eLIokYJ1Ynyd-8TurMFBokA0cLpOCNtlnS_plEqL9G_7xqsYehWJ1fdE6fUs_g-fgvExH1o6xUZ90g7WIituWiBasHSd9TRpN8 Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 7c93b891c0324a8cace12fb77490ad16 Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-TestServerBasicOps-1217943363 Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c93b891c0324a8cace12fb77490ad16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7c93b891c0324a8cace12fb77490ad16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c93b891c0324a8cace12fb77490ad16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7c93b891c0324a8cace12fb77490ad16"}]}] Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-TestServerBasicOps-1217943363 Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 7c93b891c0324a8cace12fb77490ad16 Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-TestServerBasicOps-1217943363 Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-TestServerBasicOps-1217943363-project Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 34126dbe898545fd9d7e03b55880ab53 Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-TestServerBasicOps-1217943363-project Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance cab40427-161a-4071-8c75-1a402c924402 could not be found. Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'cab40427-161a-4071-8c75-1a402c924402'} Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cab40427-161a-4071-8c75-1a402c924402 could not be found. Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cab40427-161a-4071-8c75-1a402c924402 could not be found. Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:41.785789 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:41.793200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:41.793200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:41.793200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:41.793200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:01:41.793200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:01:41.793200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cab40427-161a-4071-8c75-1a402c924402 could not be found. Aug 04 17:01:41.793200 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:41.793200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-707f79aa-63ef-423f-a300-16bc68141be5 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Returning 404 to user: Instance cab40427-161a-4071-8c75-1a402c924402 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:01:41.793200 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-707f79aa-63ef-423f-a300-16bc68141be5 tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] 10.222.0.23 "GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402" status: 404 len: 111 microversion: 2.1 time: 0.061633 Aug 04 17:01:41.796137 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2502/4903] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:41 2022] GET /compute/v2.1/servers/cab40427-161a-4071-8c75-1a402c924402 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:01:42.059825 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f882b556-54bf-4689-841e-ab5a440c7280 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:42.060528 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f882b556-54bf-4689-841e-ab5a440c7280 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] [instance: 45167cf2-60f4-4ea0-b751-1a349694346c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:42.076207 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-54ae6300-5040-49d4-9989-d204925265bd tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] Calling method '.version_select at 0x7f7e77b86160>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:42.093414 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f882b556-54bf-4689-841e-ab5a440c7280 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:42.093925 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f882b556-54bf-4689-841e-ab5a440c7280 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:42.098616 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f882b556-54bf-4689-841e-ab5a440c7280 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:42.099190 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f882b556-54bf-4689-841e-ab5a440c7280 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:42.135973 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-54ae6300-5040-49d4-9989-d204925265bd tempest-TestServerBasicOps-1217943363 tempest-TestServerBasicOps-1217943363-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1780717108" status: 202 len: 0 microversion: 2.1 time: 0.064583 Aug 04 17:01:42.137467 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2503/4904] 10.222.0.23 () {58 vars in 1254 bytes} [Thu Aug 4 17:01:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1780717108 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 17:01:42.171814 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-32de0137-7b38-42f1-91ce-8bc9376a2117 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:42.174422 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-32de0137-7b38-42f1-91ce-8bc9376a2117 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 179db84c-f006-46b9-85ad-ceea5c6a15ad] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:42.191488 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-32de0137-7b38-42f1-91ce-8bc9376a2117 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:42.196183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-32de0137-7b38-42f1-91ce-8bc9376a2117 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:42.196921 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-32de0137-7b38-42f1-91ce-8bc9376a2117 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:42.208916 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-32de0137-7b38-42f1-91ce-8bc9376a2117 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:42.444987 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f882b556-54bf-4689-841e-ab5a440c7280 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fd3653eee4f798d0860705a2b4030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8759879e1bec45e38e9434db6bcf85e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:42.454982 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f882b556-54bf-4689-841e-ab5a440c7280 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] 10.222.0.23 "GET /compute/v2.1/servers/45167cf2-60f4-4ea0-b751-1a349694346c" status: 200 len: 1475 microversion: 2.1 time: 0.399046 Aug 04 17:01:42.455740 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2402/4905] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:42 2022] GET /compute/v2.1/servers/45167cf2-60f4-4ea0-b751-1a349694346c => generated 1475 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:42.470517 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-14bcc4ac-bb5d-4e67-812b-eac3e49f9018 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:42.471812 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-14bcc4ac-bb5d-4e67-812b-eac3e49f9018 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:42.492185 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-14bcc4ac-bb5d-4e67-812b-eac3e49f9018 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:42.492831 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-14bcc4ac-bb5d-4e67-812b-eac3e49f9018 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:42.493748 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-14bcc4ac-bb5d-4e67-812b-eac3e49f9018 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:42.494497 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-14bcc4ac-bb5d-4e67-812b-eac3e49f9018 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:42.682366 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-32de0137-7b38-42f1-91ce-8bc9376a2117 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:42.696338 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-32de0137-7b38-42f1-91ce-8bc9376a2117 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad" status: 200 len: 1367 microversion: 2.1 time: 0.528809 Aug 04 17:01:42.699898 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2504/4906] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:42 2022] GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad => generated 1367 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:42.729055 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9dd40fb6-1f9f-47ea-81b8-61501709d0a7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:42.729873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9dd40fb6-1f9f-47ea-81b8-61501709d0a7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: bb775932-ec80-4b14-b137-6ebd3c33670d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:42.740762 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9dd40fb6-1f9f-47ea-81b8-61501709d0a7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:42.744599 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9dd40fb6-1f9f-47ea-81b8-61501709d0a7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:42.745589 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9dd40fb6-1f9f-47ea-81b8-61501709d0a7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:42.746276 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9dd40fb6-1f9f-47ea-81b8-61501709d0a7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:42.784919 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-14bcc4ac-bb5d-4e67-812b-eac3e49f9018 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:42.797446 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-14bcc4ac-bb5d-4e67-812b-eac3e49f9018 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1528 microversion: 2.1 time: 0.340337 Aug 04 17:01:42.798060 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2403/4907] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:42 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1528 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:42.810316 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-beae29e4-96ac-482d-91db-f4c9b1d7c676 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:42.821996 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-beae29e4-96ac-482d-91db-f4c9b1d7c676 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:42.848650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-beae29e4-96ac-482d-91db-f4c9b1d7c676 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:42.848650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-beae29e4-96ac-482d-91db-f4c9b1d7c676 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:42.848650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-beae29e4-96ac-482d-91db-f4c9b1d7c676 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:42.848650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-beae29e4-96ac-482d-91db-f4c9b1d7c676 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:43.159050 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9dd40fb6-1f9f-47ea-81b8-61501709d0a7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:43.172298 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9dd40fb6-1f9f-47ea-81b8-61501709d0a7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d" status: 200 len: 1202 microversion: 2.1 time: 0.469979 Aug 04 17:01:43.175151 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2505/4908] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:42 2022] GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d => generated 1202 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:43.384813 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-beae29e4-96ac-482d-91db-f4c9b1d7c676 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:43.393657 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-beae29e4-96ac-482d-91db-f4c9b1d7c676 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1506 microversion: 2.1 time: 0.587245 Aug 04 17:01:43.394249 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2404/4909] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:42 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1506 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:43.483342 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bf59b6f7-bfc8-459e-98f9-489e86e112ce tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:43.484633 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bf59b6f7-bfc8-459e-98f9-489e86e112ce tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] [instance: 45167cf2-60f4-4ea0-b751-1a349694346c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:43.495475 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf59b6f7-bfc8-459e-98f9-489e86e112ce tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:43.496704 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf59b6f7-bfc8-459e-98f9-489e86e112ce tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:43.497927 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf59b6f7-bfc8-459e-98f9-489e86e112ce tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:43.498638 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bf59b6f7-bfc8-459e-98f9-489e86e112ce tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:43.608419 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bf59b6f7-bfc8-459e-98f9-489e86e112ce tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fd3653eee4f798d0860705a2b4030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8759879e1bec45e38e9434db6bcf85e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:43.620794 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bf59b6f7-bfc8-459e-98f9-489e86e112ce tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] 10.222.0.23 "GET /compute/v2.1/servers/45167cf2-60f4-4ea0-b751-1a349694346c" status: 200 len: 1475 microversion: 2.1 time: 0.144274 Aug 04 17:01:43.624194 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2506/4910] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:43 2022] GET /compute/v2.1/servers/45167cf2-60f4-4ea0-b751-1a349694346c => generated 1475 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:43.718395 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-64739ec9-33e2-447e-a435-80369eeaad5a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:43.719651 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-64739ec9-33e2-447e-a435-80369eeaad5a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 179db84c-f006-46b9-85ad-ceea5c6a15ad] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:43.738737 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-64739ec9-33e2-447e-a435-80369eeaad5a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:43.753138 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-64739ec9-33e2-447e-a435-80369eeaad5a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:43.754752 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-64739ec9-33e2-447e-a435-80369eeaad5a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:43.755367 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-64739ec9-33e2-447e-a435-80369eeaad5a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:43.822922 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4648ef85-95e4-4878-9cb9-57f5898f7fda tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:43.824084 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4648ef85-95e4-4878-9cb9-57f5898f7fda tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:43.831825 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4648ef85-95e4-4878-9cb9-57f5898f7fda tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:43.847265 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4648ef85-95e4-4878-9cb9-57f5898f7fda tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:43.853006 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4648ef85-95e4-4878-9cb9-57f5898f7fda tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:43.861402 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4648ef85-95e4-4878-9cb9-57f5898f7fda tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:44.741823 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-64739ec9-33e2-447e-a435-80369eeaad5a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:44.760742 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-64739ec9-33e2-447e-a435-80369eeaad5a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad" status: 200 len: 1556 microversion: 2.1 time: 1.043067 Aug 04 17:01:44.762021 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2405/4911] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:43 2022] GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad => generated 1556 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:01:44.780471 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-578ba688-c822-4bcd-bbd4-b105b6292fb1 req-c05d037f-b9b2-4cd6-8d20-55a237f29bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45167cf2-60f4-4ea0-b751-1a349694346c", "name": "network-vif-deleted", "tag": "548085f3-3987-4d72-a366-a9124f3340f5"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:44.802757 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-578ba688-c822-4bcd-bbd4-b105b6292fb1 req-c05d037f-b9b2-4cd6-8d20-55a237f29bf5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:44.805131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-578ba688-c822-4bcd-bbd4-b105b6292fb1 req-c05d037f-b9b2-4cd6-8d20-55a237f29bf5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:44.833229 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-578ba688-c822-4bcd-bbd4-b105b6292fb1 req-c05d037f-b9b2-4cd6-8d20-55a237f29bf5 service nova] Creating event network-vif-deleted:548085f3-3987-4d72-a366-a9124f3340f5 for instance 45167cf2-60f4-4ea0-b751-1a349694346c on n-h2-846466-12 Aug 04 17:01:44.849148 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-578ba688-c822-4bcd-bbd4-b105b6292fb1 req-c05d037f-b9b2-4cd6-8d20-55a237f29bf5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084369 Aug 04 17:01:44.854297 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2406/4912] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:44.866128 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3768677e-31bc-4d24-8e62-1c51ffaeef5c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:44.868538 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3768677e-31bc-4d24-8e62-1c51ffaeef5c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: bb775932-ec80-4b14-b137-6ebd3c33670d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:44.887200 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3768677e-31bc-4d24-8e62-1c51ffaeef5c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:44.888086 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3768677e-31bc-4d24-8e62-1c51ffaeef5c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:44.891035 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3768677e-31bc-4d24-8e62-1c51ffaeef5c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:44.891811 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3768677e-31bc-4d24-8e62-1c51ffaeef5c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:44.900034 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4648ef85-95e4-4878-9cb9-57f5898f7fda tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:44.910665 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4648ef85-95e4-4878-9cb9-57f5898f7fda tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1528 microversion: 2.1 time: 1.091896 Aug 04 17:01:44.918492 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2507/4913] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:43 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1528 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:01:44.933467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a4b827db-beff-4096-a54c-30e8cf00f3d6 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:44.935102 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a4b827db-beff-4096-a54c-30e8cf00f3d6 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:44.951021 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a4b827db-beff-4096-a54c-30e8cf00f3d6 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:44.951911 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a4b827db-beff-4096-a54c-30e8cf00f3d6 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:44.954570 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a4b827db-beff-4096-a54c-30e8cf00f3d6 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:44.955265 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a4b827db-beff-4096-a54c-30e8cf00f3d6 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:45.410436 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a4b827db-beff-4096-a54c-30e8cf00f3d6 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:45.419453 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a4b827db-beff-4096-a54c-30e8cf00f3d6 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1486 microversion: 2.1 time: 0.499324 Aug 04 17:01:45.447087 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2508/4914] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:44 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1486 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:45.457213 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3768677e-31bc-4d24-8e62-1c51ffaeef5c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:45.463068 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-06fed80a-dc73-4f5c-93e4-11e208a99c78 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:45.465849 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-06fed80a-dc73-4f5c-93e4-11e208a99c78 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] [instance: 45167cf2-60f4-4ea0-b751-1a349694346c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:45.476372 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3768677e-31bc-4d24-8e62-1c51ffaeef5c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d" status: 200 len: 1202 microversion: 2.1 time: 0.620487 Aug 04 17:01:45.479545 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-06fed80a-dc73-4f5c-93e4-11e208a99c78 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:45.480124 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-06fed80a-dc73-4f5c-93e4-11e208a99c78 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:45.482338 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-06fed80a-dc73-4f5c-93e4-11e208a99c78 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:45.482581 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-06fed80a-dc73-4f5c-93e4-11e208a99c78 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:45.499247 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2407/4915] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:44 2022] GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d => generated 1202 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:45.514180 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-22fd0c48-a1e1-416e-a43d-ddfb5ac44c0d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:45.516392 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-22fd0c48-a1e1-416e-a43d-ddfb5ac44c0d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 179db84c-f006-46b9-85ad-ceea5c6a15ad] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:45.519475 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-06fed80a-dc73-4f5c-93e4-11e208a99c78 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] HTTP exception thrown: Instance 45167cf2-60f4-4ea0-b751-1a349694346c could not be found. Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-06fed80a-dc73-4f5c-93e4-11e208a99c78 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Request method failure captured: Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/45167cf2-60f4-4ea0-b751-1a349694346c HTTP/1.1 Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_r6I1cGCMwV-pEUrVc4JBd4Z6ar0VF4AphE4IpgF9lYfq9hwmDHuJCd1J8VTc982f0hK-XFAS3Cbm1Y3G3b_WprRYGDqIrEZWAJJKVrgeHcVjAIZcFGFkAMKrGxiZL0P2Fy1s-L7RaVt07Cxm5pZ-UtpCvxP7corxjyYmRr_IK2uB4 Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 8759879e1bec45e38e9434db6bcf85e8 Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-937462228 Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8759879e1bec45e38e9434db6bcf85e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8759879e1bec45e38e9434db6bcf85e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8759879e1bec45e38e9434db6bcf85e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8759879e1bec45e38e9434db6bcf85e8"}]}] Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-TestSecurityGroupsBasicOps-937462228 Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 8759879e1bec45e38e9434db6bcf85e8 Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-937462228 Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-TestSecurityGroupsBasicOps-937462228-project Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 113fd3653eee4f798d0860705a2b4030 Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-TestSecurityGroupsBasicOps-937462228-project Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 45167cf2-60f4-4ea0-b751-1a349694346c could not be found. Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '45167cf2-60f4-4ea0-b751-1a349694346c'} Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45167cf2-60f4-4ea0-b751-1a349694346c could not be found. Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45167cf2-60f4-4ea0-b751-1a349694346c could not be found. Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:45.524020 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:45.528684 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:45.528684 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:45.528684 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:45.528684 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:01:45.528684 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:01:45.528684 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45167cf2-60f4-4ea0-b751-1a349694346c could not be found. Aug 04 17:01:45.528684 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:01:45.528684 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-06fed80a-dc73-4f5c-93e4-11e208a99c78 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Returning 404 to user: Instance 45167cf2-60f4-4ea0-b751-1a349694346c could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:01:45.528684 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-06fed80a-dc73-4f5c-93e4-11e208a99c78 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] 10.222.0.23 "GET /compute/v2.1/servers/45167cf2-60f4-4ea0-b751-1a349694346c" status: 404 len: 111 microversion: 2.1 time: 0.074684 Aug 04 17:01:45.528684 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2509/4916] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:45 2022] GET /compute/v2.1/servers/45167cf2-60f4-4ea0-b751-1a349694346c => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:01:45.538170 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-25be982e-1952-404a-96ac-4ccf2c48b5e2 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:45.538781 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-25be982e-1952-404a-96ac-4ccf2c48b5e2 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:45.541526 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-22fd0c48-a1e1-416e-a43d-ddfb5ac44c0d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:45.542301 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-22fd0c48-a1e1-416e-a43d-ddfb5ac44c0d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:45.543439 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-22fd0c48-a1e1-416e-a43d-ddfb5ac44c0d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:45.545932 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-22fd0c48-a1e1-416e-a43d-ddfb5ac44c0d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:45.558662 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-25be982e-1952-404a-96ac-4ccf2c48b5e2 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:45.559103 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-25be982e-1952-404a-96ac-4ccf2c48b5e2 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:45.565475 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-25be982e-1952-404a-96ac-4ccf2c48b5e2 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:45.565930 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-25be982e-1952-404a-96ac-4ccf2c48b5e2 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:45.721241 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-25be982e-1952-404a-96ac-4ccf2c48b5e2 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "POST /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c/action" status: 202 len: 0 microversion: 2.1 time: 0.191686 Aug 04 17:01:45.727642 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2510/4917] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:01:45 2022] POST /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:01:45.747289 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8d8ec690-7bee-4aec-9cea-1030dd611b8f tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:45.748338 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8d8ec690-7bee-4aec-9cea-1030dd611b8f tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:45.761057 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8d8ec690-7bee-4aec-9cea-1030dd611b8f tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:45.763712 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8d8ec690-7bee-4aec-9cea-1030dd611b8f tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:45.764705 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8d8ec690-7bee-4aec-9cea-1030dd611b8f tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:45.765208 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8d8ec690-7bee-4aec-9cea-1030dd611b8f tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:46.067493 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-22fd0c48-a1e1-416e-a43d-ddfb5ac44c0d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.566454 Aug 04 17:01:46.069541 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2408/4918] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Aug 4 17:01:45 2022] GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad/os-interface => generated 284 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:46.076781 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ea78df5f-9616-4deb-9ec6-0073e369ea38 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:46.077657 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ea78df5f-9616-4deb-9ec6-0073e369ea38 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:46.088113 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:46.107759 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea78df5f-9616-4deb-9ec6-0073e369ea38 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:46.110910 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea78df5f-9616-4deb-9ec6-0073e369ea38 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:46.111960 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea78df5f-9616-4deb-9ec6-0073e369ea38 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:46.116817 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea78df5f-9616-4deb-9ec6-0073e369ea38 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:46.586692 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8d8ec690-7bee-4aec-9cea-1030dd611b8f tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:46.602261 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8d8ec690-7bee-4aec-9cea-1030dd611b8f tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1494 microversion: 2.1 time: 0.869748 Aug 04 17:01:46.603634 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2511/4919] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:45 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1494 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:01:46.621204 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-7787a57b-d370-445c-a1f2-f49e8addb679 req-6bdddb1b-3943-46a3-ab5c-713de96b9687 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb775932-ec80-4b14-b137-6ebd3c33670d", "name": "network-vif-plugged", "status": "completed", "tag": "2d31dc34-8f58-4525-9bf2-5aabd514d9a1"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:46.641586 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7787a57b-d370-445c-a1f2-f49e8addb679 req-6bdddb1b-3943-46a3-ab5c-713de96b9687 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:46.642036 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7787a57b-d370-445c-a1f2-f49e8addb679 req-6bdddb1b-3943-46a3-ab5c-713de96b9687 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:46.668216 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-7787a57b-d370-445c-a1f2-f49e8addb679 req-6bdddb1b-3943-46a3-ab5c-713de96b9687 service nova] Creating event network-vif-plugged:2d31dc34-8f58-4525-9bf2-5aabd514d9a1 for instance bb775932-ec80-4b14-b137-6ebd3c33670d on n-h1-846466-12 Aug 04 17:01:46.679753 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-7787a57b-d370-445c-a1f2-f49e8addb679 req-6bdddb1b-3943-46a3-ab5c-713de96b9687 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074293 Aug 04 17:01:46.688204 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2512/4920] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:46.704815 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-be57c8bc-7bd7-4091-a97a-51e58e98e53a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-535407552", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b5e40019-250e-43d9-8f31-7dbc366e4c24"}], "security_groups": [{"name": "tempest-securitygroup--1003398060"}], "key_name": "tempest-keypair-605289474", "user_data": "}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:46.904219 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ea78df5f-9616-4deb-9ec6-0073e369ea38 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:46.917243 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ea78df5f-9616-4deb-9ec6-0073e369ea38 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1528 microversion: 2.1 time: 0.846380 Aug 04 17:01:46.919832 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2409/4921] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:46 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1528 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:46.926674 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5911b287-a374-45dc-9d89-eedb2b2750f5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:46.929474 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5911b287-a374-45dc-9d89-eedb2b2750f5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: bb775932-ec80-4b14-b137-6ebd3c33670d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:46.940091 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5911b287-a374-45dc-9d89-eedb2b2750f5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:46.941345 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5911b287-a374-45dc-9d89-eedb2b2750f5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:46.944280 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5911b287-a374-45dc-9d89-eedb2b2750f5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:46.945633 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5911b287-a374-45dc-9d89-eedb2b2750f5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:47.058042 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-be57c8bc-7bd7-4091-a97a-51e58e98e53a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] validate_networks() for [('b5e40019-250e-43d9-8f31-7dbc366e4c24', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:01:47.879711 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5911b287-a374-45dc-9d89-eedb2b2750f5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:47.889856 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5911b287-a374-45dc-9d89-eedb2b2750f5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d" status: 200 len: 1202 microversion: 2.1 time: 0.968699 Aug 04 17:01:47.907573 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2410/4922] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:46 2022] GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d => generated 1202 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:47.915541 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-81677262-721f-48f0-8141-355dcf0e5ee7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:47.918802 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-81677262-721f-48f0-8141-355dcf0e5ee7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:47.928955 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-81677262-721f-48f0-8141-355dcf0e5ee7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:47.929732 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-81677262-721f-48f0-8141-355dcf0e5ee7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:47.930888 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-81677262-721f-48f0-8141-355dcf0e5ee7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:47.931487 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-81677262-721f-48f0-8141-355dcf0e5ee7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:48.692191 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-81677262-721f-48f0-8141-355dcf0e5ee7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:48.710580 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-81677262-721f-48f0-8141-355dcf0e5ee7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1494 microversion: 2.1 time: 0.798419 Aug 04 17:01:48.711982 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2411/4923] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:47 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1494 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:48.726665 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a309049d-e4fe-42e2-abb5-09c6d908ff84 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:48.727761 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a309049d-e4fe-42e2-abb5-09c6d908ff84 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:48.744201 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a309049d-e4fe-42e2-abb5-09c6d908ff84 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:48.745038 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a309049d-e4fe-42e2-abb5-09c6d908ff84 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:48.745972 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a309049d-e4fe-42e2-abb5-09c6d908ff84 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:48.746415 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a309049d-e4fe-42e2-abb5-09c6d908ff84 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:49.247648 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-be57c8bc-7bd7-4091-a97a-51e58e98e53a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:01:49.248214 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-be57c8bc-7bd7-4091-a97a-51e58e98e53a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:01:49.249375 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-be57c8bc-7bd7-4091-a97a-51e58e98e53a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:01:49.249950 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-be57c8bc-7bd7-4091-a97a-51e58e98e53a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:01:49.250289 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-be57c8bc-7bd7-4091-a97a-51e58e98e53a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:01:49.267799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be57c8bc-7bd7-4091-a97a-51e58e98e53a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:49.268246 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be57c8bc-7bd7-4091-a97a-51e58e98e53a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:49.269040 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be57c8bc-7bd7-4091-a97a-51e58e98e53a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:49.269506 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be57c8bc-7bd7-4091-a97a-51e58e98e53a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:49.320737 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-be57c8bc-7bd7-4091-a97a-51e58e98e53a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Getting quotas for project 470aa7b0a4464f9789d315176c4b7bc6. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:01:49.337096 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-be57c8bc-7bd7-4091-a97a-51e58e98e53a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Getting quotas for user 6700990d94334afcac9adff62009d099 and project 470aa7b0a4464f9789d315176c4b7bc6. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:01:49.365037 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-be57c8bc-7bd7-4091-a97a-51e58e98e53a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:01:49.371312 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-be57c8bc-7bd7-4091-a97a-51e58e98e53a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:01:49.485545 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-be57c8bc-7bd7-4091-a97a-51e58e98e53a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.795479 Aug 04 17:01:49.493249 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2513/4924] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Aug 4 17:01:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 2804 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 17:01:49.508965 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a309049d-e4fe-42e2-abb5-09c6d908ff84 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:49.515931 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e5819e04-921e-4d28-9010-d2a7e865e8e4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:49.518957 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e5819e04-921e-4d28-9010-d2a7e865e8e4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: bb775932-ec80-4b14-b137-6ebd3c33670d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:49.521920 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a309049d-e4fe-42e2-abb5-09c6d908ff84 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1528 microversion: 2.1 time: 0.806406 Aug 04 17:01:49.524931 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2412/4925] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:48 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1528 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:49.529927 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-959fb2b5-870f-4420-ac74-49a16dc1719c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:49.537385 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e5819e04-921e-4d28-9010-d2a7e865e8e4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:49.541236 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-959fb2b5-870f-4420-ac74-49a16dc1719c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:49.546285 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e5819e04-921e-4d28-9010-d2a7e865e8e4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:49.547486 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e5819e04-921e-4d28-9010-d2a7e865e8e4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:49.549641 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e5819e04-921e-4d28-9010-d2a7e865e8e4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:49.972538 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-959fb2b5-870f-4420-ac74-49a16dc1719c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:49.984895 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-959fb2b5-870f-4420-ac74-49a16dc1719c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:49.991125 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-959fb2b5-870f-4420-ac74-49a16dc1719c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:49.997991 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-959fb2b5-870f-4420-ac74-49a16dc1719c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1280 microversion: 2.20 time: 0.471729 Aug 04 17:01:50.018470 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2413/4926] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:01:49 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1280 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:01:50.031138 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f998bfbd-372e-4dda-bc61-80945c8ea5a5 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:50.034558 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f998bfbd-372e-4dda-bc61-80945c8ea5a5 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:50.062046 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f998bfbd-372e-4dda-bc61-80945c8ea5a5 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:50.062544 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f998bfbd-372e-4dda-bc61-80945c8ea5a5 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:50.063418 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f998bfbd-372e-4dda-bc61-80945c8ea5a5 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:50.063854 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f998bfbd-372e-4dda-bc61-80945c8ea5a5 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:50.596331 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e5819e04-921e-4d28-9010-d2a7e865e8e4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:50.610227 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e5819e04-921e-4d28-9010-d2a7e865e8e4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d" status: 200 len: 1389 microversion: 2.1 time: 1.115437 Aug 04 17:01:50.633976 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2514/4927] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:49 2022] GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d => generated 1389 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:50.640178 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-208e347e-a08c-486b-81d0-4c59e771ef48 req-2c38ca6f-a14e-4c94-b22b-d03651043fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "179db84c-f006-46b9-85ad-ceea5c6a15ad", "tag": "9a092a19-0d2c-44cd-bd13-eda962c60553"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:50.685314 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-208e347e-a08c-486b-81d0-4c59e771ef48 req-2c38ca6f-a14e-4c94-b22b-d03651043fa1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:50.686095 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-208e347e-a08c-486b-81d0-4c59e771ef48 req-2c38ca6f-a14e-4c94-b22b-d03651043fa1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:50.716772 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-208e347e-a08c-486b-81d0-4c59e771ef48 req-2c38ca6f-a14e-4c94-b22b-d03651043fa1 service nova] Creating event network-changed:9a092a19-0d2c-44cd-bd13-eda962c60553 for instance 179db84c-f006-46b9-85ad-ceea5c6a15ad on n-h1-846466-12 Aug 04 17:01:50.731181 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-208e347e-a08c-486b-81d0-4c59e771ef48 req-2c38ca6f-a14e-4c94-b22b-d03651043fa1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095613 Aug 04 17:01:50.732506 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2515/4928] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:50.751290 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-326c55f6-faed-49f0-a4fe-3a55ed9a75cc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:50.752473 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-326c55f6-faed-49f0-a4fe-3a55ed9a75cc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:50.766321 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-326c55f6-faed-49f0-a4fe-3a55ed9a75cc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:50.770799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-326c55f6-faed-49f0-a4fe-3a55ed9a75cc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:50.772698 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-326c55f6-faed-49f0-a4fe-3a55ed9a75cc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:50.777204 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-326c55f6-faed-49f0-a4fe-3a55ed9a75cc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:51.137991 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f998bfbd-372e-4dda-bc61-80945c8ea5a5 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:51.163794 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f998bfbd-372e-4dda-bc61-80945c8ea5a5 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1494 microversion: 2.1 time: 1.141821 Aug 04 17:01:51.165543 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2414/4929] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:50 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1494 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:51.179278 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4c8ecd79-c9ab-4d22-ac11-6bbf964960d5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:51.180483 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4c8ecd79-c9ab-4d22-ac11-6bbf964960d5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: bb775932-ec80-4b14-b137-6ebd3c33670d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:51.197121 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4c8ecd79-c9ab-4d22-ac11-6bbf964960d5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:51.197795 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4c8ecd79-c9ab-4d22-ac11-6bbf964960d5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:51.199124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4c8ecd79-c9ab-4d22-ac11-6bbf964960d5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:51.199790 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4c8ecd79-c9ab-4d22-ac11-6bbf964960d5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:51.255946 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-326c55f6-faed-49f0-a4fe-3a55ed9a75cc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:51.265887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:51.282115 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-326c55f6-faed-49f0-a4fe-3a55ed9a75cc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1528 microversion: 2.1 time: 0.547397 Aug 04 17:01:51.286202 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2516/4930] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:50 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1528 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:51.303583 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9fa323c1-84e2-410c-9031-452a6dc3e5a6 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:51.304894 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9fa323c1-84e2-410c-9031-452a6dc3e5a6 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:51.325761 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9fa323c1-84e2-410c-9031-452a6dc3e5a6 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:51.326565 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9fa323c1-84e2-410c-9031-452a6dc3e5a6 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:51.327847 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9fa323c1-84e2-410c-9031-452a6dc3e5a6 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:51.328460 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9fa323c1-84e2-410c-9031-452a6dc3e5a6 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:51.493216 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9fa323c1-84e2-410c-9031-452a6dc3e5a6 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:51.516780 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9fa323c1-84e2-410c-9031-452a6dc3e5a6 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:51.523989 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9fa323c1-84e2-410c-9031-452a6dc3e5a6 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:51.525190 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9fa323c1-84e2-410c-9031-452a6dc3e5a6 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1332 microversion: 2.20 time: 0.233585 Aug 04 17:01:51.537947 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2517/4931] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:01:51 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1332 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:01:52.190786 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d6ce807c-3113-40a2-89ea-4f15a41c5095 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:52.192249 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d6ce807c-3113-40a2-89ea-4f15a41c5095 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:52.209896 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d6ce807c-3113-40a2-89ea-4f15a41c5095 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:52.212217 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d6ce807c-3113-40a2-89ea-4f15a41c5095 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:52.230524 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d6ce807c-3113-40a2-89ea-4f15a41c5095 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:52.236546 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d6ce807c-3113-40a2-89ea-4f15a41c5095 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:52.305089 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4c8ecd79-c9ab-4d22-ac11-6bbf964960d5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:52.317564 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4c8ecd79-c9ab-4d22-ac11-6bbf964960d5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d" status: 200 len: 1389 microversion: 2.1 time: 1.150529 Aug 04 17:01:52.322104 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2415/4932] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:51 2022] GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d => generated 1389 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:52.331076 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f6b1a557-6418-4385-93e3-a73fc936430b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:52.333130 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f6b1a557-6418-4385-93e3-a73fc936430b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:52.354702 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6b1a557-6418-4385-93e3-a73fc936430b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:52.355217 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6b1a557-6418-4385-93e3-a73fc936430b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:52.356001 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6b1a557-6418-4385-93e3-a73fc936430b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:52.356425 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6b1a557-6418-4385-93e3-a73fc936430b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:52.907800 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f6b1a557-6418-4385-93e3-a73fc936430b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:52.918121 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f6b1a557-6418-4385-93e3-a73fc936430b tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1528 microversion: 2.1 time: 0.594443 Aug 04 17:01:52.922649 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2416/4933] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:52 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1528 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:52.939398 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1d6932b7-31e3-442a-807d-6374009151bd tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:52.942214 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1d6932b7-31e3-442a-807d-6374009151bd tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: bb775932-ec80-4b14-b137-6ebd3c33670d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:52.958332 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d6932b7-31e3-442a-807d-6374009151bd tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:52.959077 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d6932b7-31e3-442a-807d-6374009151bd tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:52.964222 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d6932b7-31e3-442a-807d-6374009151bd tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:52.965229 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d6932b7-31e3-442a-807d-6374009151bd tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:53.031431 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:53.232172 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1d6932b7-31e3-442a-807d-6374009151bd tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:53.251597 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1d6932b7-31e3-442a-807d-6374009151bd tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d" status: 200 len: 1389 microversion: 2.1 time: 0.327284 Aug 04 17:01:53.254133 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2417/4934] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:52 2022] GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d => generated 1389 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:53.278555 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7a8de674-38fb-49f1-aab8-3c97fa121a2f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:53.279539 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7a8de674-38fb-49f1-aab8-3c97fa121a2f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:53.301735 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7a8de674-38fb-49f1-aab8-3c97fa121a2f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:53.303052 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7a8de674-38fb-49f1-aab8-3c97fa121a2f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:53.306084 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7a8de674-38fb-49f1-aab8-3c97fa121a2f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:53.307197 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7a8de674-38fb-49f1-aab8-3c97fa121a2f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:53.442320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7a8de674-38fb-49f1-aab8-3c97fa121a2f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:53.455697 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7a8de674-38fb-49f1-aab8-3c97fa121a2f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:53.459742 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7a8de674-38fb-49f1-aab8-3c97fa121a2f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:53.461591 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7a8de674-38fb-49f1-aab8-3c97fa121a2f tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1338 microversion: 2.20 time: 0.191955 Aug 04 17:01:53.465873 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2418/4935] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:01:53 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1338 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:01:53.471932 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7f50822b-1908-46e1-95a3-4c06de20254e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:53.478658 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7f50822b-1908-46e1-95a3-4c06de20254e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: bb775932-ec80-4b14-b137-6ebd3c33670d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:53.497987 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f50822b-1908-46e1-95a3-4c06de20254e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:53.498547 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f50822b-1908-46e1-95a3-4c06de20254e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:53.499439 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f50822b-1908-46e1-95a3-4c06de20254e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:53.499879 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f50822b-1908-46e1-95a3-4c06de20254e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:53.537892 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7f50822b-1908-46e1-95a3-4c06de20254e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: bb775932-ec80-4b14-b137-6ebd3c33670d] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:01:53.674068 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7f50822b-1908-46e1-95a3-4c06de20254e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d" status: 204 len: 0 microversion: 2.1 time: 0.205726 Aug 04 17:01:53.675446 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2419/4936] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:01:53 2022] DELETE /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:01:53.703199 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-645791b0-f49a-4db5-b09c-ea3d77c4aa98 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:53.704166 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-645791b0-f49a-4db5-b09c-ea3d77c4aa98 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: bb775932-ec80-4b14-b137-6ebd3c33670d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:53.718891 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-645791b0-f49a-4db5-b09c-ea3d77c4aa98 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:53.719534 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-645791b0-f49a-4db5-b09c-ea3d77c4aa98 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:53.721298 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-645791b0-f49a-4db5-b09c-ea3d77c4aa98 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:53.721874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-645791b0-f49a-4db5-b09c-ea3d77c4aa98 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:53.722293 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d6ce807c-3113-40a2-89ea-4f15a41c5095 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:53.736451 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d6ce807c-3113-40a2-89ea-4f15a41c5095 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1500 microversion: 2.1 time: 1.550377 Aug 04 17:01:53.739499 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2518/4937] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:52 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1500 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:01:53.766713 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e678296a-59c8-4f90-b04c-c0019a070210 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:53.767484 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e678296a-59c8-4f90-b04c-c0019a070210 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:53.786055 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e678296a-59c8-4f90-b04c-c0019a070210 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:53.789464 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e678296a-59c8-4f90-b04c-c0019a070210 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:53.793752 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e678296a-59c8-4f90-b04c-c0019a070210 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:53.794345 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e678296a-59c8-4f90-b04c-c0019a070210 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:53.837989 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e678296a-59c8-4f90-b04c-c0019a070210 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:01:54.021210 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e678296a-59c8-4f90-b04c-c0019a070210 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "DELETE /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 204 len: 0 microversion: 2.1 time: 0.256783 Aug 04 17:01:54.025506 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2519/4938] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:01:53 2022] DELETE /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:01:54.048398 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e201a377-9ee8-4f58-8632-be02223acd61 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:54.055597 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e201a377-9ee8-4f58-8632-be02223acd61 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:54.065058 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e201a377-9ee8-4f58-8632-be02223acd61 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:54.066238 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e201a377-9ee8-4f58-8632-be02223acd61 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:54.071621 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e201a377-9ee8-4f58-8632-be02223acd61 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:54.072331 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e201a377-9ee8-4f58-8632-be02223acd61 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:54.339332 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-645791b0-f49a-4db5-b09c-ea3d77c4aa98 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:54.350925 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-645791b0-f49a-4db5-b09c-ea3d77c4aa98 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d" status: 200 len: 1395 microversion: 2.1 time: 0.667635 Aug 04 17:01:54.352391 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2420/4939] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:53 2022] GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d => generated 1395 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:54.358424 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b2d6e717-02d3-4517-9359-08696c60afd9 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:54.361391 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b2d6e717-02d3-4517-9359-08696c60afd9 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:54.371170 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b2d6e717-02d3-4517-9359-08696c60afd9 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:54.372279 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b2d6e717-02d3-4517-9359-08696c60afd9 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:54.397607 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b2d6e717-02d3-4517-9359-08696c60afd9 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:54.400700 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b2d6e717-02d3-4517-9359-08696c60afd9 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:54.571842 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e201a377-9ee8-4f58-8632-be02223acd61 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:54.582422 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e201a377-9ee8-4f58-8632-be02223acd61 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1528 microversion: 2.1 time: 0.553596 Aug 04 17:01:54.594479 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2520/4940] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:54 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1528 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:54.599873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9f040202-7710-4f71-9081-5cbf0292d273 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:54.601202 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9f040202-7710-4f71-9081-5cbf0292d273 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:54.617601 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9f040202-7710-4f71-9081-5cbf0292d273 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:54.618264 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9f040202-7710-4f71-9081-5cbf0292d273 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:54.622885 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9f040202-7710-4f71-9081-5cbf0292d273 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:54.623527 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9f040202-7710-4f71-9081-5cbf0292d273 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:55.045570 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b2d6e717-02d3-4517-9359-08696c60afd9 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:55.062339 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b2d6e717-02d3-4517-9359-08696c60afd9 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1506 microversion: 2.1 time: 0.707855 Aug 04 17:01:55.062982 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2421/4941] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:54 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1506 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:55.377396 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3b246a69-4344-4baa-9e89-520102e38b3c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:55.378116 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3b246a69-4344-4baa-9e89-520102e38b3c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: bb775932-ec80-4b14-b137-6ebd3c33670d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:55.392135 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b246a69-4344-4baa-9e89-520102e38b3c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:55.393038 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b246a69-4344-4baa-9e89-520102e38b3c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:55.399120 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b246a69-4344-4baa-9e89-520102e38b3c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:55.400133 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b246a69-4344-4baa-9e89-520102e38b3c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:55.432254 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9f040202-7710-4f71-9081-5cbf0292d273 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:55.441348 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9f040202-7710-4f71-9081-5cbf0292d273 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:55.443176 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9f040202-7710-4f71-9081-5cbf0292d273 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:55.444443 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9f040202-7710-4f71-9081-5cbf0292d273 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1406 microversion: 2.20 time: 0.848646 Aug 04 17:01:55.461580 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2521/4942] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:01:54 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1406 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:01:55.615271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8f366c91-98e2-4fd5-8a54-65a8a3c8892a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:55.616321 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8f366c91-98e2-4fd5-8a54-65a8a3c8892a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:55.633740 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8f366c91-98e2-4fd5-8a54-65a8a3c8892a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:55.634520 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8f366c91-98e2-4fd5-8a54-65a8a3c8892a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:55.635935 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8f366c91-98e2-4fd5-8a54-65a8a3c8892a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:55.636605 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8f366c91-98e2-4fd5-8a54-65a8a3c8892a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:56.063004 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3b246a69-4344-4baa-9e89-520102e38b3c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:56.076413 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3b246a69-4344-4baa-9e89-520102e38b3c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d" status: 200 len: 1395 microversion: 2.1 time: 0.704273 Aug 04 17:01:56.078596 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2422/4943] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:55 2022] GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d => generated 1395 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:56.100632 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d83604b3-f246-40ea-8a3d-a6c235cb1383 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:56.101773 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d83604b3-f246-40ea-8a3d-a6c235cb1383 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:56.123647 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d83604b3-f246-40ea-8a3d-a6c235cb1383 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:56.124087 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d83604b3-f246-40ea-8a3d-a6c235cb1383 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:56.124871 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d83604b3-f246-40ea-8a3d-a6c235cb1383 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:56.125322 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d83604b3-f246-40ea-8a3d-a6c235cb1383 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:56.496798 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8f366c91-98e2-4fd5-8a54-65a8a3c8892a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:56.512985 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8f366c91-98e2-4fd5-8a54-65a8a3c8892a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1528 microversion: 2.1 time: 0.901838 Aug 04 17:01:56.513612 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2522/4944] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:55 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1528 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:56.525182 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-dd7b6760-aa29-42be-8ee0-c56498ce88e1 req-42a3f063-4b3f-43d7-a43c-25124a34fb7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e192310d-3cab-471d-8d3e-d161ef4de6c8", "tag": "a6e1b245-35b9-4d61-8ca7-43f55954fbc5"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:56.541615 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-dd7b6760-aa29-42be-8ee0-c56498ce88e1 req-42a3f063-4b3f-43d7-a43c-25124a34fb7f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:56.548706 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-dd7b6760-aa29-42be-8ee0-c56498ce88e1 req-42a3f063-4b3f-43d7-a43c-25124a34fb7f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:56.574603 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-dd7b6760-aa29-42be-8ee0-c56498ce88e1 req-42a3f063-4b3f-43d7-a43c-25124a34fb7f service nova] Creating event network-changed:a6e1b245-35b9-4d61-8ca7-43f55954fbc5 for instance e192310d-3cab-471d-8d3e-d161ef4de6c8 on n-h2-846466-12 Aug 04 17:01:56.579941 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-dd7b6760-aa29-42be-8ee0-c56498ce88e1 req-42a3f063-4b3f-43d7-a43c-25124a34fb7f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064965 Aug 04 17:01:56.584464 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2523/4945] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:56.591987 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-10da2e64-8350-4554-afaa-aff2ae90c89b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:56.592960 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-10da2e64-8350-4554-afaa-aff2ae90c89b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:56.608555 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-10da2e64-8350-4554-afaa-aff2ae90c89b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:56.611187 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-10da2e64-8350-4554-afaa-aff2ae90c89b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:56.612302 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-10da2e64-8350-4554-afaa-aff2ae90c89b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:56.613256 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-10da2e64-8350-4554-afaa-aff2ae90c89b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:56.686214 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d83604b3-f246-40ea-8a3d-a6c235cb1383 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:56.698976 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d83604b3-f246-40ea-8a3d-a6c235cb1383 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1506 microversion: 2.1 time: 0.611132 Aug 04 17:01:56.702465 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2423/4946] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:56 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1506 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:57.045585 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-10da2e64-8350-4554-afaa-aff2ae90c89b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:57.080506 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-10da2e64-8350-4554-afaa-aff2ae90c89b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:57.084969 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-10da2e64-8350-4554-afaa-aff2ae90c89b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:57.087132 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-10da2e64-8350-4554-afaa-aff2ae90c89b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1406 microversion: 2.20 time: 0.500986 Aug 04 17:01:57.091713 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2524/4947] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:01:56 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1406 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:01:57.106892 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c1f0e3e5-1a1f-479f-b5c2-5234cbf9d7c3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:57.108410 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c1f0e3e5-1a1f-479f-b5c2-5234cbf9d7c3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: bb775932-ec80-4b14-b137-6ebd3c33670d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:57.119381 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c1f0e3e5-1a1f-479f-b5c2-5234cbf9d7c3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:57.120143 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c1f0e3e5-1a1f-479f-b5c2-5234cbf9d7c3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:57.121114 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c1f0e3e5-1a1f-479f-b5c2-5234cbf9d7c3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:57.121755 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c1f0e3e5-1a1f-479f-b5c2-5234cbf9d7c3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:57.551780 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b6e6cf7d-cded-4776-945b-823c1824f5d9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:57.552448 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b6e6cf7d-cded-4776-945b-823c1824f5d9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:57.559820 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b6e6cf7d-cded-4776-945b-823c1824f5d9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:57.560295 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b6e6cf7d-cded-4776-945b-823c1824f5d9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:57.561219 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b6e6cf7d-cded-4776-945b-823c1824f5d9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:57.561511 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b6e6cf7d-cded-4776-945b-823c1824f5d9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:57.584951 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c1f0e3e5-1a1f-479f-b5c2-5234cbf9d7c3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:57.598503 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c1f0e3e5-1a1f-479f-b5c2-5234cbf9d7c3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d" status: 200 len: 1395 microversion: 2.1 time: 0.494913 Aug 04 17:01:57.599157 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2424/4948] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:57 2022] GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d => generated 1395 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:57.727359 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f138a923-4db0-4ce5-90a4-6b4cd26db3f7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:57.728768 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f138a923-4db0-4ce5-90a4-6b4cd26db3f7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:57.745834 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f138a923-4db0-4ce5-90a4-6b4cd26db3f7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:57.748288 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f138a923-4db0-4ce5-90a4-6b4cd26db3f7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:57.753845 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f138a923-4db0-4ce5-90a4-6b4cd26db3f7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:57.755817 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f138a923-4db0-4ce5-90a4-6b4cd26db3f7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:58.039780 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b6e6cf7d-cded-4776-945b-823c1824f5d9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:58.048346 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b6e6cf7d-cded-4776-945b-823c1824f5d9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1528 microversion: 2.1 time: 0.511892 Aug 04 17:01:58.063306 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2525/4949] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:57 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1528 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:58.120086 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-838cbf29-30bc-47d2-8ce5-97be00fb8691 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:58.121120 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-838cbf29-30bc-47d2-8ce5-97be00fb8691 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:58.127726 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-838cbf29-30bc-47d2-8ce5-97be00fb8691 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:58.128580 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-838cbf29-30bc-47d2-8ce5-97be00fb8691 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:58.133017 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f138a923-4db0-4ce5-90a4-6b4cd26db3f7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:58.141561 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-838cbf29-30bc-47d2-8ce5-97be00fb8691 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:58.143240 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-838cbf29-30bc-47d2-8ce5-97be00fb8691 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:58.146601 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f138a923-4db0-4ce5-90a4-6b4cd26db3f7 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1506 microversion: 2.1 time: 0.420855 Aug 04 17:01:58.147736 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2425/4950] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:57 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1506 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:01:58.625589 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-251f3a31-b43d-4e86-b824-f563d1886bef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:58.626211 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-251f3a31-b43d-4e86-b824-f563d1886bef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: bb775932-ec80-4b14-b137-6ebd3c33670d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:58.647458 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-251f3a31-b43d-4e86-b824-f563d1886bef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:58.649215 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-251f3a31-b43d-4e86-b824-f563d1886bef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:58.654537 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-251f3a31-b43d-4e86-b824-f563d1886bef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:58.655128 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-251f3a31-b43d-4e86-b824-f563d1886bef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:58.680259 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-838cbf29-30bc-47d2-8ce5-97be00fb8691 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:58.690505 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-838cbf29-30bc-47d2-8ce5-97be00fb8691 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:58.708209 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-838cbf29-30bc-47d2-8ce5-97be00fb8691 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:58.710756 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-838cbf29-30bc-47d2-8ce5-97be00fb8691 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1406 microversion: 2.20 time: 0.597098 Aug 04 17:01:58.717409 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2526/4951] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:01:58 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1406 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:01:59.074386 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4057253b-70dd-4944-b15b-cc8a42af92df tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:59.075767 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4057253b-70dd-4944-b15b-cc8a42af92df tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:59.087651 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4057253b-70dd-4944-b15b-cc8a42af92df tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:59.088532 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4057253b-70dd-4944-b15b-cc8a42af92df tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:59.089988 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4057253b-70dd-4944-b15b-cc8a42af92df tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:59.091392 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4057253b-70dd-4944-b15b-cc8a42af92df tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:59.293618 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:59.353052 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:59.729227 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-251f3a31-b43d-4e86-b824-f563d1886bef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:59.744957 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-251f3a31-b43d-4e86-b824-f563d1886bef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d" status: 200 len: 1395 microversion: 2.1 time: 1.123255 Aug 04 17:01:59.758821 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2426/4952] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:58 2022] GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d => generated 1395 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:59.764402 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-56d85020-9e3a-4eb3-a45f-5d25ec3867fe tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:59.765033 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-56d85020-9e3a-4eb3-a45f-5d25ec3867fe tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:59.779450 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-56d85020-9e3a-4eb3-a45f-5d25ec3867fe tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:59.779831 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-56d85020-9e3a-4eb3-a45f-5d25ec3867fe tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:59.781628 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-56d85020-9e3a-4eb3-a45f-5d25ec3867fe tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:01:59.783912 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-56d85020-9e3a-4eb3-a45f-5d25ec3867fe tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:01:59.981223 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:59.987572 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4057253b-70dd-4944-b15b-cc8a42af92df tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:59.997698 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4057253b-70dd-4944-b15b-cc8a42af92df tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1510 microversion: 2.1 time: 0.930633 Aug 04 17:02:00.013014 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2527/4953] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:59 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1510 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:00.019241 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f1fcd0d9-25ce-48be-8fda-93fb7d43eb72 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:00.019959 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f1fcd0d9-25ce-48be-8fda-93fb7d43eb72 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:00.027438 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f1fcd0d9-25ce-48be-8fda-93fb7d43eb72 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:00.027977 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f1fcd0d9-25ce-48be-8fda-93fb7d43eb72 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:00.028820 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f1fcd0d9-25ce-48be-8fda-93fb7d43eb72 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:00.029327 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f1fcd0d9-25ce-48be-8fda-93fb7d43eb72 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:00.334506 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-56d85020-9e3a-4eb3-a45f-5d25ec3867fe tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:00.353984 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-56d85020-9e3a-4eb3-a45f-5d25ec3867fe tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1506 microversion: 2.1 time: 0.593362 Aug 04 17:02:00.369642 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2427/4954] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:59 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1506 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:00.602504 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f1fcd0d9-25ce-48be-8fda-93fb7d43eb72 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:00.618879 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f1fcd0d9-25ce-48be-8fda-93fb7d43eb72 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:00.620396 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f1fcd0d9-25ce-48be-8fda-93fb7d43eb72 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:00.621583 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f1fcd0d9-25ce-48be-8fda-93fb7d43eb72 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1406 microversion: 2.20 time: 0.607069 Aug 04 17:02:00.622158 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2528/4955] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:00 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1406 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:00.776807 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d839e18d-26ac-4e8e-97aa-46aaa67aa95e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:00.776807 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d839e18d-26ac-4e8e-97aa-46aaa67aa95e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: bb775932-ec80-4b14-b137-6ebd3c33670d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:00.786470 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d839e18d-26ac-4e8e-97aa-46aaa67aa95e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:00.787263 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d839e18d-26ac-4e8e-97aa-46aaa67aa95e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:00.790231 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d839e18d-26ac-4e8e-97aa-46aaa67aa95e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:00.793427 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d839e18d-26ac-4e8e-97aa-46aaa67aa95e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:00.954637 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d839e18d-26ac-4e8e-97aa-46aaa67aa95e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:00.972007 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d839e18d-26ac-4e8e-97aa-46aaa67aa95e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d" status: 200 len: 1353 microversion: 2.1 time: 0.206269 Aug 04 17:02:00.972685 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2428/4956] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:00 2022] GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d => generated 1353 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:00.989662 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-5a407d93-0b98-4a65-b336-091961b841d2 req-17d1b430-883a-4f82-a2b5-5a2a9873e421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb775932-ec80-4b14-b137-6ebd3c33670d", "name": "network-vif-deleted", "tag": "2d31dc34-8f58-4525-9bf2-5aabd514d9a1"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:01.004013 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-5a407d93-0b98-4a65-b336-091961b841d2 req-17d1b430-883a-4f82-a2b5-5a2a9873e421 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:01.004866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-5a407d93-0b98-4a65-b336-091961b841d2 req-17d1b430-883a-4f82-a2b5-5a2a9873e421 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:01.020830 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5ec7c2d4-5ef4-4701-bf82-8e7e924f3adc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:01.022117 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5ec7c2d4-5ef4-4701-bf82-8e7e924f3adc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:01.024773 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-5a407d93-0b98-4a65-b336-091961b841d2 req-17d1b430-883a-4f82-a2b5-5a2a9873e421 service nova] Creating event network-vif-deleted:2d31dc34-8f58-4525-9bf2-5aabd514d9a1 for instance bb775932-ec80-4b14-b137-6ebd3c33670d on n-h1-846466-12 Aug 04 17:02:01.029880 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ec7c2d4-5ef4-4701-bf82-8e7e924f3adc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:01.030684 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ec7c2d4-5ef4-4701-bf82-8e7e924f3adc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:01.031803 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ec7c2d4-5ef4-4701-bf82-8e7e924f3adc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:01.032538 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ec7c2d4-5ef4-4701-bf82-8e7e924f3adc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:01.039445 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-5a407d93-0b98-4a65-b336-091961b841d2 req-17d1b430-883a-4f82-a2b5-5a2a9873e421 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053744 Aug 04 17:02:01.040710 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2529/4957] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:01.377183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-149779a3-6fc1-4129-9d06-20eac0e31801 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:01.378042 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-149779a3-6fc1-4129-9d06-20eac0e31801 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:01.390717 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-149779a3-6fc1-4129-9d06-20eac0e31801 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:01.391155 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-149779a3-6fc1-4129-9d06-20eac0e31801 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:01.392804 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-149779a3-6fc1-4129-9d06-20eac0e31801 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:01.393251 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-149779a3-6fc1-4129-9d06-20eac0e31801 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:01.729632 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-149779a3-6fc1-4129-9d06-20eac0e31801 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:01.747148 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-149779a3-6fc1-4129-9d06-20eac0e31801 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1464 microversion: 2.1 time: 0.374949 Aug 04 17:02:01.747782 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2530/4958] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:01 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1464 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:01.752876 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f68fdee9-fec9-4a6d-8e86-28eb4ce3186c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:01.753793 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f68fdee9-fec9-4a6d-8e86-28eb4ce3186c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:01.767231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f68fdee9-fec9-4a6d-8e86-28eb4ce3186c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:01.771090 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f68fdee9-fec9-4a6d-8e86-28eb4ce3186c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:01.772431 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f68fdee9-fec9-4a6d-8e86-28eb4ce3186c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:01.776526 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f68fdee9-fec9-4a6d-8e86-28eb4ce3186c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:01.872348 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5ec7c2d4-5ef4-4701-bf82-8e7e924f3adc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:01.885452 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5ec7c2d4-5ef4-4701-bf82-8e7e924f3adc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1510 microversion: 2.1 time: 0.865484 Aug 04 17:02:01.886411 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2429/4959] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:01 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1510 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:01.994231 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-641d6e61-291a-4043-8eed-28563ed999aa tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:01.995128 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-641d6e61-291a-4043-8eed-28563ed999aa tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: bb775932-ec80-4b14-b137-6ebd3c33670d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:02.003275 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-641d6e61-291a-4043-8eed-28563ed999aa tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:02.010730 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-641d6e61-291a-4043-8eed-28563ed999aa tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:02.014625 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-641d6e61-291a-4043-8eed-28563ed999aa tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:02.015264 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-641d6e61-291a-4043-8eed-28563ed999aa tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:02.485086 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-641d6e61-291a-4043-8eed-28563ed999aa tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:02.493769 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-641d6e61-291a-4043-8eed-28563ed999aa tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d" status: 200 len: 1187 microversion: 2.1 time: 0.503473 Aug 04 17:02:02.494386 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2430/4960] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:01 2022] GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d => generated 1187 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:02:02.512949 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-0e11815c-eb51-4e2c-b2c9-75619b18156d req-e119982c-323e-455b-9f85-e4c78fc4093e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7094f480-111a-4c4e-8a77-2df578c044c0", "name": "network-vif-unplugged", "status": "completed", "tag": "7cc4e42a-ac69-4d95-810a-566a44e11ef2"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:02.535877 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-0e11815c-eb51-4e2c-b2c9-75619b18156d req-e119982c-323e-455b-9f85-e4c78fc4093e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:02.536357 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-0e11815c-eb51-4e2c-b2c9-75619b18156d req-e119982c-323e-455b-9f85-e4c78fc4093e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:02.564646 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-0e11815c-eb51-4e2c-b2c9-75619b18156d req-e119982c-323e-455b-9f85-e4c78fc4093e service nova] Creating event network-vif-unplugged:7cc4e42a-ac69-4d95-810a-566a44e11ef2 for instance 7094f480-111a-4c4e-8a77-2df578c044c0 on n-h1-846466-12 Aug 04 17:02:02.571781 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-0e11815c-eb51-4e2c-b2c9-75619b18156d req-e119982c-323e-455b-9f85-e4c78fc4093e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076158 Aug 04 17:02:02.574519 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2431/4961] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:02.612343 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f68fdee9-fec9-4a6d-8e86-28eb4ce3186c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:02.624657 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f68fdee9-fec9-4a6d-8e86-28eb4ce3186c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:02.627788 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f68fdee9-fec9-4a6d-8e86-28eb4ce3186c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:02.639327 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f68fdee9-fec9-4a6d-8e86-28eb4ce3186c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1406 microversion: 2.20 time: 0.890189 Aug 04 17:02:02.643354 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2531/4962] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:01 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1406 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:02.773960 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4285963f-61e5-4c3c-96ef-c8e5b462c1b8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:02.774662 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4285963f-61e5-4c3c-96ef-c8e5b462c1b8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:02.799314 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4285963f-61e5-4c3c-96ef-c8e5b462c1b8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:02.799762 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4285963f-61e5-4c3c-96ef-c8e5b462c1b8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:02.800545 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4285963f-61e5-4c3c-96ef-c8e5b462c1b8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:02.800992 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4285963f-61e5-4c3c-96ef-c8e5b462c1b8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:02.914059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-67b05be7-b862-4069-825e-5716f629d307 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:02.914965 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-67b05be7-b862-4069-825e-5716f629d307 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:02.916596 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4285963f-61e5-4c3c-96ef-c8e5b462c1b8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:02.917101 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4285963f-61e5-4c3c-96ef-c8e5b462c1b8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:02.917552 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-4285963f-61e5-4c3c-96ef-c8e5b462c1b8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lazy-loading 'fault' on Instance uuid 34fe3f64-3db2-4598-b177-745aae47d69c {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:02:02.927469 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:02.928751 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-67b05be7-b862-4069-825e-5716f629d307 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:02.929488 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-67b05be7-b862-4069-825e-5716f629d307 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:02.932076 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-67b05be7-b862-4069-825e-5716f629d307 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:02.933671 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-67b05be7-b862-4069-825e-5716f629d307 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:03.035030 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4285963f-61e5-4c3c-96ef-c8e5b462c1b8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:03.047573 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4285963f-61e5-4c3c-96ef-c8e5b462c1b8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 200 len: 1304 microversion: 2.1 time: 0.278686 Aug 04 17:02:03.048574 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2432/4963] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:02 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 1304 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:03.064323 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-178e03ca-fe10-4e38-bf0f-5bd8859e3cd5 req-c7431921-21d1-44ea-8e5f-81088d9ef11e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34fe3f64-3db2-4598-b177-745aae47d69c", "name": "network-vif-deleted", "tag": "20f6c94f-9cbb-47b6-aa69-c23626a2c579"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:03.082302 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-178e03ca-fe10-4e38-bf0f-5bd8859e3cd5 req-c7431921-21d1-44ea-8e5f-81088d9ef11e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:03.082825 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-178e03ca-fe10-4e38-bf0f-5bd8859e3cd5 req-c7431921-21d1-44ea-8e5f-81088d9ef11e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:03.104095 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-178e03ca-fe10-4e38-bf0f-5bd8859e3cd5 req-c7431921-21d1-44ea-8e5f-81088d9ef11e service nova] Creating event network-vif-deleted:20f6c94f-9cbb-47b6-aa69-c23626a2c579 for instance 34fe3f64-3db2-4598-b177-745aae47d69c on n-h1-846466-12 Aug 04 17:02:03.111730 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-178e03ca-fe10-4e38-bf0f-5bd8859e3cd5 req-c7431921-21d1-44ea-8e5f-81088d9ef11e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052913 Aug 04 17:02:03.115894 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2433/4964] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:03.204743 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-67b05be7-b862-4069-825e-5716f629d307 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:03.216580 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-67b05be7-b862-4069-825e-5716f629d307 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1453 microversion: 2.1 time: 0.305181 Aug 04 17:02:03.217820 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2532/4965] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:02 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1453 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:03.241636 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4f1fbf7b-78c4-4606-a7ec-3a16465765d5 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:03.243095 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4f1fbf7b-78c4-4606-a7ec-3a16465765d5 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:03.258674 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4f1fbf7b-78c4-4606-a7ec-3a16465765d5 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:03.260198 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4f1fbf7b-78c4-4606-a7ec-3a16465765d5 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:03.265810 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4f1fbf7b-78c4-4606-a7ec-3a16465765d5 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:03.266909 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4f1fbf7b-78c4-4606-a7ec-3a16465765d5 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:03.516120 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ad702524-565d-4bb9-80c3-8832262937af tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:03.516750 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ad702524-565d-4bb9-80c3-8832262937af tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: bb775932-ec80-4b14-b137-6ebd3c33670d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:03.534252 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad702524-565d-4bb9-80c3-8832262937af tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:03.537021 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad702524-565d-4bb9-80c3-8832262937af tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:03.538115 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad702524-565d-4bb9-80c3-8832262937af tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:03.538739 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad702524-565d-4bb9-80c3-8832262937af tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:03.590064 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4f1fbf7b-78c4-4606-a7ec-3a16465765d5 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:03.595319 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:03.604935 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4f1fbf7b-78c4-4606-a7ec-3a16465765d5 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1453 microversion: 2.1 time: 0.370644 Aug 04 17:02:03.605612 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2434/4966] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:03 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1453 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:03.666130 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a0f88270-2308-4c50-bca7-635b4da0c55d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:03.666744 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a0f88270-2308-4c50-bca7-635b4da0c55d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:03.678217 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ad702524-565d-4bb9-80c3-8832262937af tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:03.690343 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ad702524-565d-4bb9-80c3-8832262937af tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d" status: 200 len: 1187 microversion: 2.1 time: 0.178454 Aug 04 17:02:03.701676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a0f88270-2308-4c50-bca7-635b4da0c55d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:03.701676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a0f88270-2308-4c50-bca7-635b4da0c55d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:03.701676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a0f88270-2308-4c50-bca7-635b4da0c55d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:03.701676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a0f88270-2308-4c50-bca7-635b4da0c55d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:03.702986 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2533/4967] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:03 2022] GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d => generated 1187 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:03.754976 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-70ea5162-24f5-4a67-9bec-a4a7c3e551cc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:03.755693 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-70ea5162-24f5-4a67-9bec-a4a7c3e551cc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:03.782981 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-70ea5162-24f5-4a67-9bec-a4a7c3e551cc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:03.783708 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-70ea5162-24f5-4a67-9bec-a4a7c3e551cc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:03.784794 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-70ea5162-24f5-4a67-9bec-a4a7c3e551cc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:03.785356 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-70ea5162-24f5-4a67-9bec-a4a7c3e551cc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:03.849167 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-70ea5162-24f5-4a67-9bec-a4a7c3e551cc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lazy-loading 'flavor' on Instance uuid 7094f480-111a-4c4e-8a77-2df578c044c0 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:02:03.882052 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-70ea5162-24f5-4a67-9bec-a4a7c3e551cc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] HTTP exception thrown: Cannot 'shelve' instance 7094f480-111a-4c4e-8a77-2df578c044c0 while it is in vm_state shelved_offloaded Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-70ea5162-24f5-4a67-9bec-a4a7c3e551cc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0/action HTTP/1.1 Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 14 Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: {"shelve": {}} Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: exception: Cannot 'shelve' instance 7094f480-111a-4c4e-8a77-2df578c044c0 while it is in vm_state shelved_offloaded Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '7094f480-111a-4c4e-8a77-2df578c044c0', 'body': {'shelve': {}}} Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7094f480-111a-4c4e-8a77-2df578c044c0 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 04 17:02:03.887732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 17:02:03.892678 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 17:02:03.892678 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 17:02:03.892678 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 7094f480-111a-4c4e-8a77-2df578c044c0 while it is in vm_state shelved_offloaded Aug 04 17:02:03.892678 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:03.892678 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:03.892678 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:03.892678 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:03.892678 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:03.892678 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:03.892678 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:02:03.892678 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:02:03.892678 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 7094f480-111a-4c4e-8a77-2df578c044c0 while it is in vm_state shelved_offloaded Aug 04 17:02:03.892678 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:03.895474 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-70ea5162-24f5-4a67-9bec-a4a7c3e551cc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 409 to user: Cannot 'shelve' instance 7094f480-111a-4c4e-8a77-2df578c044c0 while it is in vm_state shelved_offloaded {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:02:03.897728 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-70ea5162-24f5-4a67-9bec-a4a7c3e551cc tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0/action" status: 409 len: 155 microversion: 2.1 time: 0.149110 Aug 04 17:02:03.899419 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2534/4968] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:02:03 2022] POST /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0/action => generated 155 bytes in 151 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 04 17:02:03.909942 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-65f5704b-51ee-4623-a9dd-71ec8de04078 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:03.911361 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-65f5704b-51ee-4623-a9dd-71ec8de04078 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:03.923554 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:03.927022 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-65f5704b-51ee-4623-a9dd-71ec8de04078 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:03.928721 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-65f5704b-51ee-4623-a9dd-71ec8de04078 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:03.929873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-65f5704b-51ee-4623-a9dd-71ec8de04078 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:03.930666 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-65f5704b-51ee-4623-a9dd-71ec8de04078 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:03.994076 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-65f5704b-51ee-4623-a9dd-71ec8de04078 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126125) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 17:02:04.018678 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a0f88270-2308-4c50-bca7-635b4da0c55d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:04.027702 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a0f88270-2308-4c50-bca7-635b4da0c55d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:04.029211 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a0f88270-2308-4c50-bca7-635b4da0c55d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:04.039757 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a0f88270-2308-4c50-bca7-635b4da0c55d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1406 microversion: 2.20 time: 0.377725 Aug 04 17:02:04.040691 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2435/4969] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:03 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1406 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:04.070310 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8e2347f3-2d3f-46b4-aa5a-ce85ab1f7d97 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:04.070936 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8e2347f3-2d3f-46b4-aa5a-ce85ab1f7d97 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 34fe3f64-3db2-4598-b177-745aae47d69c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:04.080744 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8e2347f3-2d3f-46b4-aa5a-ce85ab1f7d97 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:04.083075 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8e2347f3-2d3f-46b4-aa5a-ce85ab1f7d97 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:04.084261 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8e2347f3-2d3f-46b4-aa5a-ce85ab1f7d97 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:04.089941 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8e2347f3-2d3f-46b4-aa5a-ce85ab1f7d97 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:04.106186 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-65f5704b-51ee-4623-a9dd-71ec8de04078 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0/action" status: 202 len: 0 microversion: 2.1 time: 0.201193 Aug 04 17:02:04.109276 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2535/4970] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:02:03 2022] POST /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:02:04.125109 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-8e2347f3-2d3f-46b4-aa5a-ce85ab1f7d97 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] HTTP exception thrown: Instance 34fe3f64-3db2-4598-b177-745aae47d69c could not be found. Aug 04 17:02:04.126682 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ad1c44b1-6af7-4c57-af4b-68cc179d8e12 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8e2347f3-2d3f-46b4-aa5a-ce85ab1f7d97 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Request method failure captured: Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c HTTP/1.1 Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_sPF5RZaZQ1laXuHLfLApbJQO2NV6UrjH3ab_TEAHOAekRR7SOb_CaeidRgV_juWF_EmOtOx__223mJd2as3Qu3hQ5zdwDSf9mGP2tz0rhiLLQt34M5n3y13LDd4l0e78wxGbK-WmDEsY7dHkbNZCKiabioXlDe_kPaI9XdorHN2pI Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 7af0c13734b34a69bbcf9201567398a2 Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServerRescueTestJSON-977924644 Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7af0c13734b34a69bbcf9201567398a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7af0c13734b34a69bbcf9201567398a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7af0c13734b34a69bbcf9201567398a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7af0c13734b34a69bbcf9201567398a2"}]}] Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServerRescueTestJSON-977924644 Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 7af0c13734b34a69bbcf9201567398a2 Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServerRescueTestJSON-977924644 Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServerRescueTestJSON-977924644-project Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 103f0906f85b4c1a8451cfc2b2384a88 Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServerRescueTestJSON-977924644-project Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 34fe3f64-3db2-4598-b177-745aae47d69c could not be found. Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '34fe3f64-3db2-4598-b177-745aae47d69c'} Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34fe3f64-3db2-4598-b177-745aae47d69c could not be found. Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34fe3f64-3db2-4598-b177-745aae47d69c could not be found. Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:04.127736 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:02:04.133408 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:04.133408 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:04.133408 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:04.133408 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:02:04.133408 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:02:04.133408 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34fe3f64-3db2-4598-b177-745aae47d69c could not be found. Aug 04 17:02:04.133408 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:02:04.135505 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ad1c44b1-6af7-4c57-af4b-68cc179d8e12 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:04.135849 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8e2347f3-2d3f-46b4-aa5a-ce85ab1f7d97 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Returning 404 to user: Instance 34fe3f64-3db2-4598-b177-745aae47d69c could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:02:04.137181 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8e2347f3-2d3f-46b4-aa5a-ce85ab1f7d97 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c" status: 404 len: 111 microversion: 2.1 time: 0.071507 Aug 04 17:02:04.146904 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2436/4971] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:04 2022] GET /compute/v2.1/servers/34fe3f64-3db2-4598-b177-745aae47d69c => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:02:04.154119 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad1c44b1-6af7-4c57-af4b-68cc179d8e12 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:04.155720 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4234bab2-cc8b-44f6-abd1-dc647b159579 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:04.158390 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4234bab2-cc8b-44f6-abd1-dc647b159579 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 04a3818f-fc8b-4fab-a720-46bba72436ef] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:04.172764 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad1c44b1-6af7-4c57-af4b-68cc179d8e12 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:04.174626 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad1c44b1-6af7-4c57-af4b-68cc179d8e12 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:04.178148 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad1c44b1-6af7-4c57-af4b-68cc179d8e12 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:04.187003 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4234bab2-cc8b-44f6-abd1-dc647b159579 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:04.188239 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4234bab2-cc8b-44f6-abd1-dc647b159579 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:04.190086 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4234bab2-cc8b-44f6-abd1-dc647b159579 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:04.191210 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4234bab2-cc8b-44f6-abd1-dc647b159579 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:04.247992 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4234bab2-cc8b-44f6-abd1-dc647b159579 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 04a3818f-fc8b-4fab-a720-46bba72436ef] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:02:04.421591 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4234bab2-cc8b-44f6-abd1-dc647b159579 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "DELETE /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef" status: 204 len: 0 microversion: 2.1 time: 0.272513 Aug 04 17:02:04.424601 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2437/4972] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:02:04 2022] DELETE /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:02:04.435146 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bb3127bf-d096-4bc0-9eeb-25db53d26dbe tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:04.436071 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bb3127bf-d096-4bc0-9eeb-25db53d26dbe tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 04a3818f-fc8b-4fab-a720-46bba72436ef] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:04.442343 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ad1c44b1-6af7-4c57-af4b-68cc179d8e12 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:04.447248 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bb3127bf-d096-4bc0-9eeb-25db53d26dbe tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:04.447823 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bb3127bf-d096-4bc0-9eeb-25db53d26dbe tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:04.448879 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bb3127bf-d096-4bc0-9eeb-25db53d26dbe tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:04.450868 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bb3127bf-d096-4bc0-9eeb-25db53d26dbe tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:04.452024 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ad1c44b1-6af7-4c57-af4b-68cc179d8e12 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1461 microversion: 2.1 time: 0.337203 Aug 04 17:02:04.453353 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2536/4973] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:04 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1461 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:04.590368 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-9dd31cf4-4667-4f32-b963-903edf46b361 req-05caf623-f1e2-4593-92f4-e249259f3a22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e192310d-3cab-471d-8d3e-d161ef4de6c8", "name": "network-vif-plugged", "status": "completed", "tag": "a6e1b245-35b9-4d61-8ca7-43f55954fbc5"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:04.606138 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-9dd31cf4-4667-4f32-b963-903edf46b361 req-05caf623-f1e2-4593-92f4-e249259f3a22 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:04.609770 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-9dd31cf4-4667-4f32-b963-903edf46b361 req-05caf623-f1e2-4593-92f4-e249259f3a22 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:04.623779 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-9dd31cf4-4667-4f32-b963-903edf46b361 req-05caf623-f1e2-4593-92f4-e249259f3a22 service nova] Creating event network-vif-plugged:a6e1b245-35b9-4d61-8ca7-43f55954fbc5 for instance e192310d-3cab-471d-8d3e-d161ef4de6c8 on n-h2-846466-12 Aug 04 17:02:04.629456 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-9dd31cf4-4667-4f32-b963-903edf46b361 req-05caf623-f1e2-4593-92f4-e249259f3a22 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043481 Aug 04 17:02:04.633318 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2537/4974] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:04.690894 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bb3127bf-d096-4bc0-9eeb-25db53d26dbe tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:04.699323 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bb3127bf-d096-4bc0-9eeb-25db53d26dbe tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef" status: 200 len: 1491 microversion: 2.1 time: 0.271083 Aug 04 17:02:04.712981 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2438/4975] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:04 2022] GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef => generated 1491 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:04.719111 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-38c594af-e766-4d06-8f78-e51f1924fdc8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:04.719765 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-38c594af-e766-4d06-8f78-e51f1924fdc8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: bb775932-ec80-4b14-b137-6ebd3c33670d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:04.727721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-38c594af-e766-4d06-8f78-e51f1924fdc8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:04.728157 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-38c594af-e766-4d06-8f78-e51f1924fdc8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:04.729169 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-38c594af-e766-4d06-8f78-e51f1924fdc8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:04.729652 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-38c594af-e766-4d06-8f78-e51f1924fdc8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:04.785997 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7e74ceef-8e39-4b47-a206-5bedb85120a6 tempest-QuotasTestJSON-1287737118 tempest-QuotasTestJSON-1287737118-project] Calling method '.version_select at 0x7f7e775e09d0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:04.804627 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-38c594af-e766-4d06-8f78-e51f1924fdc8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:04.822286 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-38c594af-e766-4d06-8f78-e51f1924fdc8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d" status: 200 len: 1187 microversion: 2.1 time: 0.107585 Aug 04 17:02:04.823923 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2439/4976] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:04 2022] GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d => generated 1187 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:04.874059 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7e74ceef-8e39-4b47-a206-5bedb85120a6 tempest-QuotasTestJSON-1287737118 tempest-QuotasTestJSON-1287737118-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/ccabd8f172ea4905a2a3e42a56235b1d/defaults" status: 200 len: 371 microversion: 2.1 time: 0.239365 Aug 04 17:02:04.875228 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2538/4977] 10.222.0.23 () {58 vars in 1269 bytes} [Thu Aug 4 17:02:04 2022] GET /compute/v2.1/os-quota-sets/ccabd8f172ea4905a2a3e42a56235b1d/defaults => generated 371 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:04.887878 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4409ddc2-d9ce-4dac-b806-28726e9bef14 tempest-QuotasTestJSON-1287737118 tempest-QuotasTestJSON-1287737118-project] Calling method '.version_select at 0x7f7e84ac8160>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:04.980584 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4409ddc2-d9ce-4dac-b806-28726e9bef14 tempest-QuotasTestJSON-1287737118 tempest-QuotasTestJSON-1287737118-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/ccabd8f172ea4905a2a3e42a56235b1d" status: 200 len: 371 microversion: 2.1 time: 0.097202 Aug 04 17:02:04.981553 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2440/4978] 10.222.0.23 () {58 vars in 1242 bytes} [Thu Aug 4 17:02:04 2022] GET /compute/v2.1/os-quota-sets/ccabd8f172ea4905a2a3e42a56235b1d => generated 371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:04.995722 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e858ba94-9f34-4b4d-ab95-d0f4362318ca tempest-QuotasTestJSON-1287737118 tempest-QuotasTestJSON-1287737118-project] Calling method '.version_select at 0x7f7e77cab040>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:05.060749 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e858ba94-9f34-4b4d-ab95-d0f4362318ca tempest-QuotasTestJSON-1287737118 tempest-QuotasTestJSON-1287737118-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/ccabd8f172ea4905a2a3e42a56235b1d/defaults" status: 200 len: 371 microversion: 2.1 time: 0.069008 Aug 04 17:02:05.061811 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2539/4979] 10.222.0.23 () {58 vars in 1269 bytes} [Thu Aug 4 17:02:04 2022] GET /compute/v2.1/os-quota-sets/ccabd8f172ea4905a2a3e42a56235b1d/defaults => generated 371 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:02:05.064176 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e0ed6d37-ecaf-44d0-962e-92189c12a4c7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:05.064793 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e0ed6d37-ecaf-44d0-962e-92189c12a4c7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:05.072976 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e0ed6d37-ecaf-44d0-962e-92189c12a4c7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:05.073913 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e0ed6d37-ecaf-44d0-962e-92189c12a4c7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:05.075198 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e0ed6d37-ecaf-44d0-962e-92189c12a4c7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:05.075895 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e0ed6d37-ecaf-44d0-962e-92189c12a4c7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:05.079861 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7333f7f9-f24b-490c-a0b8-8e5fb724bb6c tempest-QuotasTestJSON-1287737118 tempest-QuotasTestJSON-1287737118-project] Calling method '.version_select at 0x7f7e848e53a0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:05.229589 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7333f7f9-f24b-490c-a0b8-8e5fb724bb6c tempest-QuotasTestJSON-1287737118 tempest-QuotasTestJSON-1287737118-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/ccabd8f172ea4905a2a3e42a56235b1d" status: 200 len: 371 microversion: 2.1 time: 0.154075 Aug 04 17:02:05.277005 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2540/4980] 10.222.0.23 () {58 vars in 1242 bytes} [Thu Aug 4 17:02:05 2022] GET /compute/v2.1/os-quota-sets/ccabd8f172ea4905a2a3e42a56235b1d => generated 371 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:05.283838 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-828a855d-cfff-4a3b-95b2-562473c6c689 tempest-QuotasTestJSON-1287737118 tempest-QuotasTestJSON-1287737118-project] Calling method '.version_select at 0x7f7e89ba7dc0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:05.362368 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e0ed6d37-ecaf-44d0-962e-92189c12a4c7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:05.373323 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e0ed6d37-ecaf-44d0-962e-92189c12a4c7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:05.377240 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e0ed6d37-ecaf-44d0-962e-92189c12a4c7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:05.378438 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e0ed6d37-ecaf-44d0-962e-92189c12a4c7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1406 microversion: 2.20 time: 0.319551 Aug 04 17:02:05.381186 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2441/4981] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:05 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1406 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:05.463663 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-828a855d-cfff-4a3b-95b2-562473c6c689 tempest-QuotasTestJSON-1287737118 tempest-QuotasTestJSON-1287737118-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/ccabd8f172ea4905a2a3e42a56235b1d?user_id=b2cb06a23ed14e7e91ccee6cb3f4f1b2" status: 200 len: 371 microversion: 2.1 time: 0.184329 Aug 04 17:02:05.464622 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2541/4982] 10.222.0.23 () {58 vars in 1323 bytes} [Thu Aug 4 17:02:05 2022] GET /compute/v2.1/os-quota-sets/ccabd8f172ea4905a2a3e42a56235b1d?user_id=b2cb06a23ed14e7e91ccee6cb3f4f1b2 => generated 371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:05.474819 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-be2c17c2-d107-467b-bb45-b5fbd84e6431 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:05.475542 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-be2c17c2-d107-467b-bb45-b5fbd84e6431 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:05.489411 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be2c17c2-d107-467b-bb45-b5fbd84e6431 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:05.490078 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be2c17c2-d107-467b-bb45-b5fbd84e6431 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:05.491081 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be2c17c2-d107-467b-bb45-b5fbd84e6431 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:05.491514 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be2c17c2-d107-467b-bb45-b5fbd84e6431 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:05.655245 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-be2c17c2-d107-467b-bb45-b5fbd84e6431 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:05.669420 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-be2c17c2-d107-467b-bb45-b5fbd84e6431 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1461 microversion: 2.1 time: 0.198714 Aug 04 17:02:05.672510 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2442/4983] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:05 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1461 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:05.720271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9428cae0-5cbd-4a27-8247-930590f50ad0 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:05.721328 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9428cae0-5cbd-4a27-8247-930590f50ad0 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 04a3818f-fc8b-4fab-a720-46bba72436ef] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:05.729273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9428cae0-5cbd-4a27-8247-930590f50ad0 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:05.730000 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9428cae0-5cbd-4a27-8247-930590f50ad0 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:05.730930 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9428cae0-5cbd-4a27-8247-930590f50ad0 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:05.732169 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9428cae0-5cbd-4a27-8247-930590f50ad0 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:05.841727 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-612f4eea-354f-449f-a068-a8c353a49a12 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:05.842376 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-612f4eea-354f-449f-a068-a8c353a49a12 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: bb775932-ec80-4b14-b137-6ebd3c33670d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:05.850068 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-612f4eea-354f-449f-a068-a8c353a49a12 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:05.855519 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-612f4eea-354f-449f-a068-a8c353a49a12 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:05.856418 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-612f4eea-354f-449f-a068-a8c353a49a12 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:05.856849 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-612f4eea-354f-449f-a068-a8c353a49a12 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:05.997171 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-612f4eea-354f-449f-a068-a8c353a49a12 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:06.008734 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-612f4eea-354f-449f-a068-a8c353a49a12 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d" status: 200 len: 1187 microversion: 2.1 time: 0.170942 Aug 04 17:02:06.012773 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2443/4984] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:05 2022] GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d => generated 1187 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:06.021330 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8bf6e8c8-749a-4cf5-b724-5b19ef3aab43 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:06.025932 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8bf6e8c8-749a-4cf5-b724-5b19ef3aab43 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] [instance: 36778df0-79fd-4d26-b488-2e6b5e4c0edd] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:06.035119 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8bf6e8c8-749a-4cf5-b724-5b19ef3aab43 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:06.035567 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8bf6e8c8-749a-4cf5-b724-5b19ef3aab43 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:06.036962 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8bf6e8c8-749a-4cf5-b724-5b19ef3aab43 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:06.037696 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8bf6e8c8-749a-4cf5-b724-5b19ef3aab43 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:06.069747 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8bf6e8c8-749a-4cf5-b724-5b19ef3aab43 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] [instance: 36778df0-79fd-4d26-b488-2e6b5e4c0edd] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:02:06.081073 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9428cae0-5cbd-4a27-8247-930590f50ad0 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:06.094578 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9428cae0-5cbd-4a27-8247-930590f50ad0 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef" status: 200 len: 1491 microversion: 2.1 time: 0.377978 Aug 04 17:02:06.095914 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2542/4985] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:05 2022] GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef => generated 1491 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:06.102330 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-7602948d-a38d-436f-832c-597e32cfe043 req-5386492d-0f8a-4f5b-8c25-60b171e1dd28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36778df0-79fd-4d26-b488-2e6b5e4c0edd", "tag": "d728997e-bd33-4d24-93a4-db144cfb23cf"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:06.124144 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7602948d-a38d-436f-832c-597e32cfe043 req-5386492d-0f8a-4f5b-8c25-60b171e1dd28 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:06.125353 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7602948d-a38d-436f-832c-597e32cfe043 req-5386492d-0f8a-4f5b-8c25-60b171e1dd28 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:06.166610 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-7602948d-a38d-436f-832c-597e32cfe043 req-5386492d-0f8a-4f5b-8c25-60b171e1dd28 service nova] Creating event network-changed:d728997e-bd33-4d24-93a4-db144cfb23cf for instance 36778df0-79fd-4d26-b488-2e6b5e4c0edd on n-h1-846466-12 Aug 04 17:02:06.180608 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-7602948d-a38d-436f-832c-597e32cfe043 req-5386492d-0f8a-4f5b-8c25-60b171e1dd28 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080219 Aug 04 17:02:06.181594 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2543/4986] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:06.287918 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8bf6e8c8-749a-4cf5-b724-5b19ef3aab43 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] 10.222.0.23 "DELETE /compute/v2.1/servers/36778df0-79fd-4d26-b488-2e6b5e4c0edd" status: 204 len: 0 microversion: 2.1 time: 0.273304 Aug 04 17:02:06.298829 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-72f5062a-1395-438d-a22a-74ee35e9fa55 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:06.299890 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-72f5062a-1395-438d-a22a-74ee35e9fa55 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] [instance: 36778df0-79fd-4d26-b488-2e6b5e4c0edd] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:06.301379 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2444/4987] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:02:06 2022] DELETE /compute/v2.1/servers/36778df0-79fd-4d26-b488-2e6b5e4c0edd => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:02:06.313904 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-72f5062a-1395-438d-a22a-74ee35e9fa55 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:06.314712 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-72f5062a-1395-438d-a22a-74ee35e9fa55 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:06.318042 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-72f5062a-1395-438d-a22a-74ee35e9fa55 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:06.318729 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-72f5062a-1395-438d-a22a-74ee35e9fa55 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:06.404842 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3b271ebd-4991-4d63-b2e8-da95a6d02c4a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:06.405880 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3b271ebd-4991-4d63-b2e8-da95a6d02c4a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:06.420015 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b271ebd-4991-4d63-b2e8-da95a6d02c4a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:06.423116 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b271ebd-4991-4d63-b2e8-da95a6d02c4a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:06.427463 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b271ebd-4991-4d63-b2e8-da95a6d02c4a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:06.428239 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b271ebd-4991-4d63-b2e8-da95a6d02c4a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:07.003312 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-72f5062a-1395-438d-a22a-74ee35e9fa55 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fd3653eee4f798d0860705a2b4030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8759879e1bec45e38e9434db6bcf85e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:07.046963 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-72f5062a-1395-438d-a22a-74ee35e9fa55 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] 10.222.0.23 "GET /compute/v2.1/servers/36778df0-79fd-4d26-b488-2e6b5e4c0edd" status: 200 len: 1765 microversion: 2.1 time: 0.733186 Aug 04 17:02:07.048121 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2544/4988] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:06 2022] GET /compute/v2.1/servers/36778df0-79fd-4d26-b488-2e6b5e4c0edd => generated 1765 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:07.076428 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3b271ebd-4991-4d63-b2e8-da95a6d02c4a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:07.077491 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bab4c40b-0dd9-465a-a19f-32bd314e9a69 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:07.078680 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bab4c40b-0dd9-465a-a19f-32bd314e9a69 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:07.085717 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3b271ebd-4991-4d63-b2e8-da95a6d02c4a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:07.096547 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3b271ebd-4991-4d63-b2e8-da95a6d02c4a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:07.098143 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3b271ebd-4991-4d63-b2e8-da95a6d02c4a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1406 microversion: 2.20 time: 0.697930 Aug 04 17:02:07.103614 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bab4c40b-0dd9-465a-a19f-32bd314e9a69 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:07.105368 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bab4c40b-0dd9-465a-a19f-32bd314e9a69 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:07.111045 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bab4c40b-0dd9-465a-a19f-32bd314e9a69 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:07.112387 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bab4c40b-0dd9-465a-a19f-32bd314e9a69 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:07.114614 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2445/4989] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:06 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1406 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:02:07.121600 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-57cd58e2-6d1b-42fc-9aec-b3ac56a8b6ec tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:07.122493 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-57cd58e2-6d1b-42fc-9aec-b3ac56a8b6ec tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: bb775932-ec80-4b14-b137-6ebd3c33670d] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:07.139845 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-57cd58e2-6d1b-42fc-9aec-b3ac56a8b6ec tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:07.140636 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-57cd58e2-6d1b-42fc-9aec-b3ac56a8b6ec tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:07.141679 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-57cd58e2-6d1b-42fc-9aec-b3ac56a8b6ec tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:07.142266 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-57cd58e2-6d1b-42fc-9aec-b3ac56a8b6ec tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:07.459124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-57cd58e2-6d1b-42fc-9aec-b3ac56a8b6ec tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:07.467529 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-57cd58e2-6d1b-42fc-9aec-b3ac56a8b6ec tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d" status: 200 len: 1187 microversion: 2.1 time: 0.351226 Aug 04 17:02:07.472335 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2446/4990] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:07 2022] GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d => generated 1187 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:07.482490 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a49c9b32-51a8-4cee-ae9d-b7101d47198b tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:07.484660 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a49c9b32-51a8-4cee-ae9d-b7101d47198b tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 04a3818f-fc8b-4fab-a720-46bba72436ef] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:07.492371 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:07.499662 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a49c9b32-51a8-4cee-ae9d-b7101d47198b tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:07.508698 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a49c9b32-51a8-4cee-ae9d-b7101d47198b tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:07.510200 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a49c9b32-51a8-4cee-ae9d-b7101d47198b tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:07.511347 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a49c9b32-51a8-4cee-ae9d-b7101d47198b tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:08.222965 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a49c9b32-51a8-4cee-ae9d-b7101d47198b tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:08.233025 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a49c9b32-51a8-4cee-ae9d-b7101d47198b tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef" status: 200 len: 1491 microversion: 2.1 time: 0.759207 Aug 04 17:02:08.237167 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2447/4991] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:07 2022] GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef => generated 1491 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:08.254296 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-15684b97-6cce-4c27-8565-3bc9825936e1 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:08.262276 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-15684b97-6cce-4c27-8565-3bc9825936e1 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] [instance: 36778df0-79fd-4d26-b488-2e6b5e4c0edd] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:08.277757 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-15684b97-6cce-4c27-8565-3bc9825936e1 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:08.278412 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-15684b97-6cce-4c27-8565-3bc9825936e1 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:08.279586 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-15684b97-6cce-4c27-8565-3bc9825936e1 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:08.281078 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-15684b97-6cce-4c27-8565-3bc9825936e1 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:08.286158 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:08.445980 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bab4c40b-0dd9-465a-a19f-32bd314e9a69 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:08.455931 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bab4c40b-0dd9-465a-a19f-32bd314e9a69 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1519 microversion: 2.1 time: 1.400495 Aug 04 17:02:08.456831 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2545/4992] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:07 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1519 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:08.462358 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-828df595-b3a1-43f3-acee-b829f26c01b9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:08.463331 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-828df595-b3a1-43f3-acee-b829f26c01b9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:08.470844 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-828df595-b3a1-43f3-acee-b829f26c01b9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:08.471688 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-828df595-b3a1-43f3-acee-b829f26c01b9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:08.472669 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-828df595-b3a1-43f3-acee-b829f26c01b9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:08.473259 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-828df595-b3a1-43f3-acee-b829f26c01b9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:09.365899 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-15684b97-6cce-4c27-8565-3bc9825936e1 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113fd3653eee4f798d0860705a2b4030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8759879e1bec45e38e9434db6bcf85e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:09.377388 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-15684b97-6cce-4c27-8565-3bc9825936e1 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] 10.222.0.23 "GET /compute/v2.1/servers/36778df0-79fd-4d26-b488-2e6b5e4c0edd" status: 200 len: 1765 microversion: 2.1 time: 1.138256 Aug 04 17:02:09.378083 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2448/4993] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:08 2022] GET /compute/v2.1/servers/36778df0-79fd-4d26-b488-2e6b5e4c0edd => generated 1765 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:09.485742 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-828df595-b3a1-43f3-acee-b829f26c01b9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:09.501675 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-828df595-b3a1-43f3-acee-b829f26c01b9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:09.503296 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-828df595-b3a1-43f3-acee-b829f26c01b9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:09.507904 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-828df595-b3a1-43f3-acee-b829f26c01b9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1599 microversion: 2.20 time: 1.049504 Aug 04 17:02:09.511545 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2546/4994] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:08 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1599 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:09.518619 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a4450c45-6439-4b10-99e6-0791267b6f4d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:09.521027 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a4450c45-6439-4b10-99e6-0791267b6f4d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: bb775932-ec80-4b14-b137-6ebd3c33670d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:09.535849 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a4450c45-6439-4b10-99e6-0791267b6f4d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:09.536636 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a4450c45-6439-4b10-99e6-0791267b6f4d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:09.539273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a4450c45-6439-4b10-99e6-0791267b6f4d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:09.540761 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a4450c45-6439-4b10-99e6-0791267b6f4d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:09.586490 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a4450c45-6439-4b10-99e6-0791267b6f4d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:09.587044 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a4450c45-6439-4b10-99e6-0791267b6f4d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:09.587491 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-a4450c45-6439-4b10-99e6-0791267b6f4d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lazy-loading 'fault' on Instance uuid bb775932-ec80-4b14-b137-6ebd3c33670d {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:02:09.682745 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a4450c45-6439-4b10-99e6-0791267b6f4d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:09.698782 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a4450c45-6439-4b10-99e6-0791267b6f4d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d" status: 200 len: 1192 microversion: 2.1 time: 0.183765 Aug 04 17:02:09.701330 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2547/4995] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:09 2022] GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d => generated 1192 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:09.717771 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-81c19fda-6d72-4eaf-940d-4c7da5750209 req-20133274-7475-4095-9c16-4dc8cf108061 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7094f480-111a-4c4e-8a77-2df578c044c0", "tag": "7cc4e42a-ac69-4d95-810a-566a44e11ef2"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:09.753847 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-81c19fda-6d72-4eaf-940d-4c7da5750209 req-20133274-7475-4095-9c16-4dc8cf108061 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:09.755689 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-81c19fda-6d72-4eaf-940d-4c7da5750209 req-20133274-7475-4095-9c16-4dc8cf108061 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:09.776330 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-81c19fda-6d72-4eaf-940d-4c7da5750209 req-20133274-7475-4095-9c16-4dc8cf108061 service nova] Creating event network-changed:7cc4e42a-ac69-4d95-810a-566a44e11ef2 for instance 7094f480-111a-4c4e-8a77-2df578c044c0 on n-h2-846466-12 Aug 04 17:02:09.797034 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-81c19fda-6d72-4eaf-940d-4c7da5750209 req-20133274-7475-4095-9c16-4dc8cf108061 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094429 Aug 04 17:02:09.799529 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2548/4996] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:09.807532 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-6759a80b-2217-4317-aa45-f31116ee91d7 req-6d9977f1-8c03-4486-a83f-f8f52a260268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04a3818f-fc8b-4fab-a720-46bba72436ef", "name": "network-vif-deleted", "tag": "c883d5f1-4bb8-4787-8687-7fe616e52760"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:09.838300 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6759a80b-2217-4317-aa45-f31116ee91d7 req-6d9977f1-8c03-4486-a83f-f8f52a260268 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:09.839571 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6759a80b-2217-4317-aa45-f31116ee91d7 req-6d9977f1-8c03-4486-a83f-f8f52a260268 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:09.868576 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-6759a80b-2217-4317-aa45-f31116ee91d7 req-6d9977f1-8c03-4486-a83f-f8f52a260268 service nova] Creating event network-vif-deleted:c883d5f1-4bb8-4787-8687-7fe616e52760 for instance 04a3818f-fc8b-4fab-a720-46bba72436ef on n-h2-846466-12 Aug 04 17:02:09.881924 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-6759a80b-2217-4317-aa45-f31116ee91d7 req-6d9977f1-8c03-4486-a83f-f8f52a260268 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080450 Aug 04 17:02:09.882518 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2549/4997] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:09.908030 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a305ad0b-9f41-45e4-aef9-0cf6c289fad4 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:09.908741 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a305ad0b-9f41-45e4-aef9-0cf6c289fad4 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 04a3818f-fc8b-4fab-a720-46bba72436ef] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:09.927556 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a305ad0b-9f41-45e4-aef9-0cf6c289fad4 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:09.928073 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a305ad0b-9f41-45e4-aef9-0cf6c289fad4 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:09.929309 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a305ad0b-9f41-45e4-aef9-0cf6c289fad4 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:09.929941 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a305ad0b-9f41-45e4-aef9-0cf6c289fad4 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:09.932033 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d671acf9-9fff-4419-b671-5aca2f25f72e tempest-VolumesGetTestJSON-1333143073 tempest-VolumesGetTestJSON-1333143073-project] Action: 'create', calling method: .version_select at 0x7f7e77d64550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-232230325", "metadata": {"Type": "work"}}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:09.975923 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a305ad0b-9f41-45e4-aef9-0cf6c289fad4 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:09.976714 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a305ad0b-9f41-45e4-aef9-0cf6c289fad4 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:09.977433 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-a305ad0b-9f41-45e4-aef9-0cf6c289fad4 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lazy-loading 'fault' on Instance uuid 04a3818f-fc8b-4fab-a720-46bba72436ef {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:02:10.043518 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a305ad0b-9f41-45e4-aef9-0cf6c289fad4 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '103f0906f85b4c1a8451cfc2b2384a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0c13734b34a69bbcf9201567398a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:10.053134 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a305ad0b-9f41-45e4-aef9-0cf6c289fad4 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef" status: 200 len: 1304 microversion: 2.1 time: 0.167884 Aug 04 17:02:10.065335 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2550/4998] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:09 2022] GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef => generated 1304 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:10.071569 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1a8196a7-0402-4200-94f7-305c516d6f9c tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:10.072394 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1a8196a7-0402-4200-94f7-305c516d6f9c tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:10.089006 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1a8196a7-0402-4200-94f7-305c516d6f9c tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:10.093986 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1a8196a7-0402-4200-94f7-305c516d6f9c tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:10.095203 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1a8196a7-0402-4200-94f7-305c516d6f9c tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:10.095875 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1a8196a7-0402-4200-94f7-305c516d6f9c tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:10.466520 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1a8196a7-0402-4200-94f7-305c516d6f9c tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:10.485404 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1a8196a7-0402-4200-94f7-305c516d6f9c tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1519 microversion: 2.1 time: 0.422056 Aug 04 17:02:10.517321 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2551/4999] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:10 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1519 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:10.546563 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5c312fd0-55f4-4146-a7ff-3d8fa0dca597 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:10.553502 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5c312fd0-55f4-4146-a7ff-3d8fa0dca597 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:10.592243 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5c312fd0-55f4-4146-a7ff-3d8fa0dca597 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:10.593091 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5c312fd0-55f4-4146-a7ff-3d8fa0dca597 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:10.596908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5c312fd0-55f4-4146-a7ff-3d8fa0dca597 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:10.597998 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5c312fd0-55f4-4146-a7ff-3d8fa0dca597 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:10.704238 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d671acf9-9fff-4419-b671-5aca2f25f72e tempest-VolumesGetTestJSON-1333143073 tempest-VolumesGetTestJSON-1333143073-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.323892 Aug 04 17:02:10.705085 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2449/5000] 10.222.0.23 () {60 vars in 1156 bytes} [Thu Aug 4 17:02:09 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1326 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 04 17:02:10.717874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6ad5cac3-e808-4ee2-be49-972bfadecf96 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:10.727219 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6ad5cac3-e808-4ee2-be49-972bfadecf96 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] [instance: 36778df0-79fd-4d26-b488-2e6b5e4c0edd] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:10.769410 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6ad5cac3-e808-4ee2-be49-972bfadecf96 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:10.770937 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6ad5cac3-e808-4ee2-be49-972bfadecf96 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:10.772745 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6ad5cac3-e808-4ee2-be49-972bfadecf96 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:10.775515 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6ad5cac3-e808-4ee2-be49-972bfadecf96 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:10.833063 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-6ad5cac3-e808-4ee2-be49-972bfadecf96 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] HTTP exception thrown: Instance 36778df0-79fd-4d26-b488-2e6b5e4c0edd could not be found. Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6ad5cac3-e808-4ee2-be49-972bfadecf96 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Request method failure captured: Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/36778df0-79fd-4d26-b488-2e6b5e4c0edd HTTP/1.1 Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_r6I1cGCMwV-pEUrVc4JBd4Z6ar0VF4AphE4IpgF9lYfq9hwmDHuJCd1J8VTc982f0hK-XFAS3Cbm1Y3G3b_WprRYGDqIrEZWAJJKVrgeHcVjAIZcFGFkAMKrGxiZL0P2Fy1s-L7RaVt07Cxm5pZ-UtpCvxP7corxjyYmRr_IK2uB4 Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 8759879e1bec45e38e9434db6bcf85e8 Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-937462228 Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8759879e1bec45e38e9434db6bcf85e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8759879e1bec45e38e9434db6bcf85e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8759879e1bec45e38e9434db6bcf85e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8759879e1bec45e38e9434db6bcf85e8"}]}] Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-TestSecurityGroupsBasicOps-937462228 Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 8759879e1bec45e38e9434db6bcf85e8 Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-937462228 Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-TestSecurityGroupsBasicOps-937462228-project Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 113fd3653eee4f798d0860705a2b4030 Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-TestSecurityGroupsBasicOps-937462228-project Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 36778df0-79fd-4d26-b488-2e6b5e4c0edd could not be found. Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '36778df0-79fd-4d26-b488-2e6b5e4c0edd'} Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36778df0-79fd-4d26-b488-2e6b5e4c0edd could not be found. Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36778df0-79fd-4d26-b488-2e6b5e4c0edd could not be found. Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:10.838542 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:02:10.844487 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:10.844487 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:10.844487 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:10.844487 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:02:10.844487 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:02:10.844487 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36778df0-79fd-4d26-b488-2e6b5e4c0edd could not be found. Aug 04 17:02:10.844487 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:02:10.852303 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6ad5cac3-e808-4ee2-be49-972bfadecf96 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Returning 404 to user: Instance 36778df0-79fd-4d26-b488-2e6b5e4c0edd could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:02:10.858661 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6ad5cac3-e808-4ee2-be49-972bfadecf96 tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] 10.222.0.23 "GET /compute/v2.1/servers/36778df0-79fd-4d26-b488-2e6b5e4c0edd" status: 404 len: 111 microversion: 2.1 time: 0.152180 Aug 04 17:02:10.862084 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2450/5001] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:10 2022] GET /compute/v2.1/servers/36778df0-79fd-4d26-b488-2e6b5e4c0edd => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:02:10.882209 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5c312fd0-55f4-4146-a7ff-3d8fa0dca597 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.349528 Aug 04 17:02:10.883578 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cc2f1547-6725-46fd-810a-4455aa4eef4b tempest-VolumesGetTestJSON-1333143073 tempest-VolumesGetTestJSON-1333143073-project] Calling method '.version_select at 0x7f7e84e96c10>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:10.893688 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2552/5002] 10.222.0.23 () {60 vars in 1316 bytes} [Thu Aug 4 17:02:10 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8/os-interface => generated 285 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:02:10.912878 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d26b0c6b-1197-4e23-8768-e26df60816df tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:10.916887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d26b0c6b-1197-4e23-8768-e26df60816df tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: bb775932-ec80-4b14-b137-6ebd3c33670d] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:10.940117 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d26b0c6b-1197-4e23-8768-e26df60816df tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:10.948596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d26b0c6b-1197-4e23-8768-e26df60816df tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:10.950025 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d26b0c6b-1197-4e23-8768-e26df60816df tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:10.951439 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d26b0c6b-1197-4e23-8768-e26df60816df tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:11.002046 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-d26b0c6b-1197-4e23-8768-e26df60816df tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] HTTP exception thrown: Instance bb775932-ec80-4b14-b137-6ebd3c33670d could not be found. Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d26b0c6b-1197-4e23-8768-e26df60816df tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Request method failure captured: Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d HTTP/1.1 Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_saEEOyGnjC2YSw5rO0XXZ0SIXFPgcyNqjoEnoWtNKNr9NN9-nC4VrXak9kuQQxq1he9punHwiXqtbTRNS_i0OM4UCS6bcDxdgTY6YMq4AHl3lv7jEdWuqMUDAU4k5OfnQSgkMml4THPPXJh4YiohQx-XVMfF21_bM4MqtZQZ4iEBI Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 78a0adb69ba24749817a8855effc20ad Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78a0adb69ba24749817a8855effc20ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_78a0adb69ba24749817a8855effc20ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78a0adb69ba24749817a8855effc20ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/78a0adb69ba24749817a8855effc20ad"}]}] Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 78a0adb69ba24749817a8855effc20ad Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-TestVolumeBootPattern-1920412406-project Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: ea9cab1c1eff47ddb881a2b57bf240f3 Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-TestVolumeBootPattern-1920412406-project Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance bb775932-ec80-4b14-b137-6ebd3c33670d could not be found. Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'bb775932-ec80-4b14-b137-6ebd3c33670d'} Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb775932-ec80-4b14-b137-6ebd3c33670d could not be found. Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb775932-ec80-4b14-b137-6ebd3c33670d could not be found. Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:11.006134 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:11.011441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:11.011441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:11.011441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:11.011441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:02:11.011441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:02:11.011441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb775932-ec80-4b14-b137-6ebd3c33670d could not be found. Aug 04 17:02:11.011441 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:11.015341 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d26b0c6b-1197-4e23-8768-e26df60816df tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Returning 404 to user: Instance bb775932-ec80-4b14-b137-6ebd3c33670d could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:02:11.018100 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d26b0c6b-1197-4e23-8768-e26df60816df tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d" status: 404 len: 111 microversion: 2.1 time: 0.120978 Aug 04 17:02:11.021224 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2553/5003] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:10 2022] GET /compute/v2.1/servers/bb775932-ec80-4b14-b137-6ebd3c33670d => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:02:11.051553 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cc2f1547-6725-46fd-810a-4455aa4eef4b tempest-VolumesGetTestJSON-1333143073 tempest-VolumesGetTestJSON-1333143073-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/ca3215be-49de-4c9f-a915-8bca6b180770" status: 200 len: 352 microversion: 2.1 time: 0.187361 Aug 04 17:02:11.052389 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2451/5004] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Aug 4 17:02:10 2022] GET /compute/v2.1/os-volumes/ca3215be-49de-4c9f-a915-8bca6b180770 => generated 352 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:11.076531 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-74910802-58a9-4119-815e-182b305aa4c8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:11.077787 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-74910802-58a9-4119-815e-182b305aa4c8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] [instance: 04a3818f-fc8b-4fab-a720-46bba72436ef] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:11.095940 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-74910802-58a9-4119-815e-182b305aa4c8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:11.102799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-74910802-58a9-4119-815e-182b305aa4c8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:11.105645 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-74910802-58a9-4119-815e-182b305aa4c8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:11.107126 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-74910802-58a9-4119-815e-182b305aa4c8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:11.157983 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-74910802-58a9-4119-815e-182b305aa4c8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] HTTP exception thrown: Instance 04a3818f-fc8b-4fab-a720-46bba72436ef could not be found. Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-74910802-58a9-4119-815e-182b305aa4c8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Request method failure captured: Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef HTTP/1.1 Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_sPF5RZaZQ1laXuHLfLApbJQO2NV6UrjH3ab_TEAHOAekRR7SOb_CaeidRgV_juWF_EmOtOx__223mJd2as3Qu3hQ5zdwDSf9mGP2tz0rhiLLQt34M5n3y13LDd4l0e78wxGbK-WmDEsY7dHkbNZCKiabioXlDe_kPaI9XdorHN2pI Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 7af0c13734b34a69bbcf9201567398a2 Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerRescueTestJSON-977924644 Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7af0c13734b34a69bbcf9201567398a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7af0c13734b34a69bbcf9201567398a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7af0c13734b34a69bbcf9201567398a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7af0c13734b34a69bbcf9201567398a2"}]}] Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerRescueTestJSON-977924644 Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 7af0c13734b34a69bbcf9201567398a2 Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerRescueTestJSON-977924644 Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerRescueTestJSON-977924644-project Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 103f0906f85b4c1a8451cfc2b2384a88 Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerRescueTestJSON-977924644-project Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 04a3818f-fc8b-4fab-a720-46bba72436ef could not be found. Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '04a3818f-fc8b-4fab-a720-46bba72436ef'} Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04a3818f-fc8b-4fab-a720-46bba72436ef could not be found. Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04a3818f-fc8b-4fab-a720-46bba72436ef could not be found. Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:11.161891 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:11.168673 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:11.168673 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:11.168673 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:11.168673 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:02:11.168673 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:02:11.168673 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04a3818f-fc8b-4fab-a720-46bba72436ef could not be found. Aug 04 17:02:11.168673 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:11.174292 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-74910802-58a9-4119-815e-182b305aa4c8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] Returning 404 to user: Instance 04a3818f-fc8b-4fab-a720-46bba72436ef could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:02:11.177760 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-74910802-58a9-4119-815e-182b305aa4c8 tempest-ServerRescueTestJSON-977924644 tempest-ServerRescueTestJSON-977924644-project] 10.222.0.23 "GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef" status: 404 len: 111 microversion: 2.1 time: 0.105455 Aug 04 17:02:11.180597 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2554/5005] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:11 2022] GET /compute/v2.1/servers/04a3818f-fc8b-4fab-a720-46bba72436ef => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:02:11.516576 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a4c34158-dd10-4164-9686-94424071901d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:11.517992 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a4c34158-dd10-4164-9686-94424071901d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:11.576611 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a4c34158-dd10-4164-9686-94424071901d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:11.585852 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a4c34158-dd10-4164-9686-94424071901d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:11.587664 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a4c34158-dd10-4164-9686-94424071901d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:11.596074 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a4c34158-dd10-4164-9686-94424071901d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:12.067673 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e1ff96b3-9147-4012-90e0-f89e94d6ae23 tempest-VolumesGetTestJSON-1333143073 tempest-VolumesGetTestJSON-1333143073-project] Calling method '.version_select at 0x7f7e89cd19d0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:12.187933 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e1ff96b3-9147-4012-90e0-f89e94d6ae23 tempest-VolumesGetTestJSON-1333143073 tempest-VolumesGetTestJSON-1333143073-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/ca3215be-49de-4c9f-a915-8bca6b180770" status: 200 len: 352 microversion: 2.1 time: 0.124601 Aug 04 17:02:12.200012 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2555/5006] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Aug 4 17:02:12 2022] GET /compute/v2.1/os-volumes/ca3215be-49de-4c9f-a915-8bca6b180770 => generated 352 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:12.220583 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-5d0e38db-227a-40be-b3b4-73cda17e26e3 req-d09ef116-6d1e-4818-baf0-ee09ebdcf72e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36778df0-79fd-4d26-b488-2e6b5e4c0edd", "name": "network-vif-deleted", "tag": "d728997e-bd33-4d24-93a4-db144cfb23cf"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:12.260876 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-5d0e38db-227a-40be-b3b4-73cda17e26e3 req-d09ef116-6d1e-4818-baf0-ee09ebdcf72e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:12.266267 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-5d0e38db-227a-40be-b3b4-73cda17e26e3 req-d09ef116-6d1e-4818-baf0-ee09ebdcf72e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:12.299606 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-5d0e38db-227a-40be-b3b4-73cda17e26e3 req-d09ef116-6d1e-4818-baf0-ee09ebdcf72e service nova] Creating event network-vif-deleted:d728997e-bd33-4d24-93a4-db144cfb23cf for instance 36778df0-79fd-4d26-b488-2e6b5e4c0edd on n-h1-846466-12 Aug 04 17:02:12.319273 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-5d0e38db-227a-40be-b3b4-73cda17e26e3 req-d09ef116-6d1e-4818-baf0-ee09ebdcf72e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116320 Aug 04 17:02:12.322315 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2556/5007] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:12.827627 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a4c34158-dd10-4164-9686-94424071901d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:12.858099 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a4c34158-dd10-4164-9686-94424071901d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1519 microversion: 2.1 time: 1.353027 Aug 04 17:02:12.874266 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2452/5008] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:11 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1519 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:13.206994 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5ad8de68-3f26-4707-b444-0be620edfd90 tempest-VolumesGetTestJSON-1333143073 tempest-VolumesGetTestJSON-1333143073-project] Calling method '.version_select at 0x7f7e89cd19d0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:13.290469 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5ad8de68-3f26-4707-b444-0be620edfd90 tempest-VolumesGetTestJSON-1333143073 tempest-VolumesGetTestJSON-1333143073-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/ca3215be-49de-4c9f-a915-8bca6b180770" status: 200 len: 353 microversion: 2.1 time: 0.089448 Aug 04 17:02:13.292526 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2557/5009] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Aug 4 17:02:13 2022] GET /compute/v2.1/os-volumes/ca3215be-49de-4c9f-a915-8bca6b180770 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:13.309926 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b16698c1-833f-497d-b671-c753e197ef0e tempest-VolumesGetTestJSON-1333143073 tempest-VolumesGetTestJSON-1333143073-project] Calling method '.version_select at 0x7f7e89c62ca0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:13.434937 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b16698c1-833f-497d-b671-c753e197ef0e tempest-VolumesGetTestJSON-1333143073 tempest-VolumesGetTestJSON-1333143073-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/ca3215be-49de-4c9f-a915-8bca6b180770" status: 200 len: 353 microversion: 2.1 time: 0.131305 Aug 04 17:02:13.450789 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2453/5010] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Aug 4 17:02:13 2022] GET /compute/v2.1/os-volumes/ca3215be-49de-4c9f-a915-8bca6b180770 => generated 353 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:13.453790 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-374c412f-e9fc-4a0a-b05c-87bbf718cf7e tempest-VolumesGetTestJSON-1333143073 tempest-VolumesGetTestJSON-1333143073-project] Calling method '.version_select at 0x7f7e77bff280>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:13.611533 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-374c412f-e9fc-4a0a-b05c-87bbf718cf7e tempest-VolumesGetTestJSON-1333143073 tempest-VolumesGetTestJSON-1333143073-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/ca3215be-49de-4c9f-a915-8bca6b180770" status: 202 len: 0 microversion: 2.1 time: 0.163527 Aug 04 17:02:13.619430 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2558/5011] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Aug 4 17:02:13 2022] DELETE /compute/v2.1/os-volumes/ca3215be-49de-4c9f-a915-8bca6b180770 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:02:13.622111 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7804ed9c-aa65-4ef5-92c9-bde6efb97fe5 tempest-VolumesGetTestJSON-1333143073 tempest-VolumesGetTestJSON-1333143073-project] Calling method '.version_select at 0x7f7e841354c0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:13.748260 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7804ed9c-aa65-4ef5-92c9-bde6efb97fe5 tempest-VolumesGetTestJSON-1333143073 tempest-VolumesGetTestJSON-1333143073-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/ca3215be-49de-4c9f-a915-8bca6b180770" status: 200 len: 352 microversion: 2.1 time: 0.130981 Aug 04 17:02:13.756314 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2454/5012] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Aug 4 17:02:13 2022] GET /compute/v2.1/os-volumes/ca3215be-49de-4c9f-a915-8bca6b180770 => generated 352 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:13.886795 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4bec48a6-0842-4521-ab3a-72b4025dd6a1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:13.888203 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4bec48a6-0842-4521-ab3a-72b4025dd6a1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:13.909352 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4bec48a6-0842-4521-ab3a-72b4025dd6a1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:13.910743 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4bec48a6-0842-4521-ab3a-72b4025dd6a1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:13.913714 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4bec48a6-0842-4521-ab3a-72b4025dd6a1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:13.915710 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4bec48a6-0842-4521-ab3a-72b4025dd6a1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:14.453734 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4bec48a6-0842-4521-ab3a-72b4025dd6a1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:14.480382 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4bec48a6-0842-4521-ab3a-72b4025dd6a1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1519 microversion: 2.1 time: 0.598298 Aug 04 17:02:14.530924 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2559/5013] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:13 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1519 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:14.768853 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7b21c546-328e-46bc-a9f0-37a24d61b4f6 tempest-VolumesGetTestJSON-1333143073 tempest-VolumesGetTestJSON-1333143073-project] Calling method '.version_select at 0x7f7e77d261f0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:14.974347 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:14.987481 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7b21c546-328e-46bc-a9f0-37a24d61b4f6 tempest-VolumesGetTestJSON-1333143073 tempest-VolumesGetTestJSON-1333143073-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/ca3215be-49de-4c9f-a915-8bca6b180770" status: 200 len: 352 microversion: 2.1 time: 0.227285 Aug 04 17:02:14.988331 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2455/5014] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Aug 4 17:02:14 2022] GET /compute/v2.1/os-volumes/ca3215be-49de-4c9f-a915-8bca6b180770 => generated 352 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:15.552861 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ba94b23e-e6b9-40b4-b5d8-a9400d07b511 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:15.566591 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ba94b23e-e6b9-40b4-b5d8-a9400d07b511 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:15.597920 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:15.618433 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba94b23e-e6b9-40b4-b5d8-a9400d07b511 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:15.620519 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba94b23e-e6b9-40b4-b5d8-a9400d07b511 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:15.629736 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba94b23e-e6b9-40b4-b5d8-a9400d07b511 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:15.640481 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba94b23e-e6b9-40b4-b5d8-a9400d07b511 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:15.682902 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:16.003501 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f03adba1-ca24-417a-89b2-4fda568f3185 tempest-VolumesGetTestJSON-1333143073 tempest-VolumesGetTestJSON-1333143073-project] Calling method '.version_select at 0x7f7e77d64550>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:16.282353 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f03adba1-ca24-417a-89b2-4fda568f3185 tempest-VolumesGetTestJSON-1333143073 tempest-VolumesGetTestJSON-1333143073-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/ca3215be-49de-4c9f-a915-8bca6b180770" status: 200 len: 352 microversion: 2.1 time: 0.282906 Aug 04 17:02:16.283377 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2456/5015] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Aug 4 17:02:15 2022] GET /compute/v2.1/os-volumes/ca3215be-49de-4c9f-a915-8bca6b180770 => generated 352 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:02:16.430913 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-db3694c8-42bf-4aef-b74f-29e0e4ac9e1c req-f6b85d04-e6df-4655-8eeb-3e5feef90da4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e192310d-3cab-471d-8d3e-d161ef4de6c8", "tag": "a6e1b245-35b9-4d61-8ca7-43f55954fbc5"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:16.482493 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-db3694c8-42bf-4aef-b74f-29e0e4ac9e1c req-f6b85d04-e6df-4655-8eeb-3e5feef90da4 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:16.482935 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-db3694c8-42bf-4aef-b74f-29e0e4ac9e1c req-f6b85d04-e6df-4655-8eeb-3e5feef90da4 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:16.487374 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ba94b23e-e6b9-40b4-b5d8-a9400d07b511 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:16.496579 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ba94b23e-e6b9-40b4-b5d8-a9400d07b511 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1519 microversion: 2.1 time: 0.953196 Aug 04 17:02:16.502473 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2560/5016] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:15 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1519 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:16.524437 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-db3694c8-42bf-4aef-b74f-29e0e4ac9e1c req-f6b85d04-e6df-4655-8eeb-3e5feef90da4 service nova] Creating event network-changed:a6e1b245-35b9-4d61-8ca7-43f55954fbc5 for instance e192310d-3cab-471d-8d3e-d161ef4de6c8 on n-h2-846466-12 Aug 04 17:02:16.541264 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-db3694c8-42bf-4aef-b74f-29e0e4ac9e1c req-f6b85d04-e6df-4655-8eeb-3e5feef90da4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115143 Aug 04 17:02:16.553248 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2457/5017] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:02:17.299942 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6c84e034-8e30-41c1-89e3-fd226abbccb8 tempest-VolumesGetTestJSON-1333143073 tempest-VolumesGetTestJSON-1333143073-project] Calling method '.version_select at 0x7f7e77cb7e50>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:17.454476 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6c84e034-8e30-41c1-89e3-fd226abbccb8 tempest-VolumesGetTestJSON-1333143073 tempest-VolumesGetTestJSON-1333143073-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/ca3215be-49de-4c9f-a915-8bca6b180770" status: 200 len: 352 microversion: 2.1 time: 0.160977 Aug 04 17:02:17.455328 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2561/5018] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Aug 4 17:02:17 2022] GET /compute/v2.1/os-volumes/ca3215be-49de-4c9f-a915-8bca6b180770 => generated 352 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:17.527442 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6f6324da-3490-459f-b2c6-9dd177b27eb6 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:17.529105 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6f6324da-3490-459f-b2c6-9dd177b27eb6 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:17.551345 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6f6324da-3490-459f-b2c6-9dd177b27eb6 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:17.557549 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6f6324da-3490-459f-b2c6-9dd177b27eb6 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:17.558842 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6f6324da-3490-459f-b2c6-9dd177b27eb6 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:17.560490 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6f6324da-3490-459f-b2c6-9dd177b27eb6 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:18.468929 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4f8c76d9-ad55-4b91-a1b2-befa61f47efd tempest-VolumesGetTestJSON-1333143073 tempest-VolumesGetTestJSON-1333143073-project] Calling method '.version_select at 0x7f7e77b86ca0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:18.643751 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4f8c76d9-ad55-4b91-a1b2-befa61f47efd tempest-VolumesGetTestJSON-1333143073 tempest-VolumesGetTestJSON-1333143073-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/ca3215be-49de-4c9f-a915-8bca6b180770" status: 200 len: 352 microversion: 2.1 time: 0.178846 Aug 04 17:02:18.644363 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2562/5019] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Aug 4 17:02:18 2022] GET /compute/v2.1/os-volumes/ca3215be-49de-4c9f-a915-8bca6b180770 => generated 352 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:02:18.878722 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6f6324da-3490-459f-b2c6-9dd177b27eb6 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:18.920899 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6f6324da-3490-459f-b2c6-9dd177b27eb6 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1519 microversion: 2.1 time: 1.393595 Aug 04 17:02:18.925833 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2458/5020] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:17 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1519 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:19.661912 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-84ecb0c0-1f49-4477-a4de-524dfc28ca9e tempest-VolumesGetTestJSON-1333143073 tempest-VolumesGetTestJSON-1333143073-project] Calling method '.version_select at 0x7f7e84712670>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:19.741182 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-84ecb0c0-1f49-4477-a4de-524dfc28ca9e tempest-VolumesGetTestJSON-1333143073 tempest-VolumesGetTestJSON-1333143073-project] HTTP exception thrown: Volume ca3215be-49de-4c9f-a915-8bca6b180770 could not be found. Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-84ecb0c0-1f49-4477-a4de-524dfc28ca9e tempest-VolumesGetTestJSON-1333143073 tempest-VolumesGetTestJSON-1333143073-project] Request method failure captured: Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/os-volumes/ca3215be-49de-4c9f-a915-8bca6b180770 HTTP/1.1 Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_uQo1A6JWRaW9Elh5kNFZtF5XA2CYFEtVmLXR7Nrx4G4Hr6YZ9ZUT4mayREJji6Jx7W0SwizqlKCbICatzAM6xnplyPTBpTJLB1l1ZjccGJALB_PDsHRalOhReBcye8kSXiaLey73zELzGBNbmxjEZtEJpmxhJ6h7tZ8nyagOfFMjE Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 4247953a3e0b481481ea5dcae2dacb60 Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-VolumesGetTestJSON-1333143073 Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4247953a3e0b481481ea5dcae2dacb60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4247953a3e0b481481ea5dcae2dacb60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4247953a3e0b481481ea5dcae2dacb60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4247953a3e0b481481ea5dcae2dacb60"}]}] Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-VolumesGetTestJSON-1333143073 Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 4247953a3e0b481481ea5dcae2dacb60 Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-VolumesGetTestJSON-1333143073 Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-VolumesGetTestJSON-1333143073-project Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: af5293d4f2f44ab3b8574701e666c34d Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-VolumesGetTestJSON-1333143073-project Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: exception: Volume ca3215be-49de-4c9f-a915-8bca6b180770 could not be found. Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'ca3215be-49de-4c9f-a915-8bca6b180770'} Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ca3215be-49de-4c9f-a915-8bca6b180770 could not be found. (HTTP 404) (Request-ID: req-31f45fb0-d88a-4d25-80ef-b61a68b3a85d) Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 17:02:19.750964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ca3215be-49de-4c9f-a915-8bca6b180770 could not be found. Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ca3215be-49de-4c9f-a915-8bca6b180770 could not be found. Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ca3215be-49de-4c9f-a915-8bca6b180770 could not be found. Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-84ecb0c0-1f49-4477-a4de-524dfc28ca9e tempest-VolumesGetTestJSON-1333143073 tempest-VolumesGetTestJSON-1333143073-project] Returning 404 to user: Volume ca3215be-49de-4c9f-a915-8bca6b180770 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-84ecb0c0-1f49-4477-a4de-524dfc28ca9e tempest-VolumesGetTestJSON-1333143073 tempest-VolumesGetTestJSON-1333143073-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/ca3215be-49de-4c9f-a915-8bca6b180770" status: 404 len: 109 microversion: 2.1 time: 0.087442 Aug 04 17:02:19.759196 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2563/5021] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Aug 4 17:02:19 2022] GET /compute/v2.1/os-volumes/ca3215be-49de-4c9f-a915-8bca6b180770 => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:02:19.955202 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-de8b0558-146f-4a49-a1da-1bbbd65d703f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:19.955934 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-de8b0558-146f-4a49-a1da-1bbbd65d703f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:19.987567 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-de8b0558-146f-4a49-a1da-1bbbd65d703f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:19.988021 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-de8b0558-146f-4a49-a1da-1bbbd65d703f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:19.988817 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-de8b0558-146f-4a49-a1da-1bbbd65d703f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:19.989391 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-de8b0558-146f-4a49-a1da-1bbbd65d703f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:21.250304 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-de8b0558-146f-4a49-a1da-1bbbd65d703f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:21.274509 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-de8b0558-146f-4a49-a1da-1bbbd65d703f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1519 microversion: 2.1 time: 1.323701 Aug 04 17:02:21.282225 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2459/5022] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:19 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1519 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:22.315048 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e7b5c871-fb1d-4da3-b1a1-8dbe671f46fa tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:22.315637 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e7b5c871-fb1d-4da3-b1a1-8dbe671f46fa tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:22.343528 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e7b5c871-fb1d-4da3-b1a1-8dbe671f46fa tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:22.343988 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e7b5c871-fb1d-4da3-b1a1-8dbe671f46fa tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:22.344792 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e7b5c871-fb1d-4da3-b1a1-8dbe671f46fa tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:22.345238 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e7b5c871-fb1d-4da3-b1a1-8dbe671f46fa tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:22.884427 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-45b823ed-6590-4a86-810e-8465d550fc8b tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] Calling method '.version_select at 0x7f7e77d26310>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:22.965982 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-45b823ed-6590-4a86-810e-8465d550fc8b tempest-TestSecurityGroupsBasicOps-937462228 tempest-TestSecurityGroupsBasicOps-937462228-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-751153364" status: 202 len: 0 microversion: 2.1 time: 0.084176 Aug 04 17:02:22.969541 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2460/5023] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Aug 4 17:02:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-751153364 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:02:23.780800 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e7b5c871-fb1d-4da3-b1a1-8dbe671f46fa tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:23.789847 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e7b5c871-fb1d-4da3-b1a1-8dbe671f46fa tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1519 microversion: 2.1 time: 1.479239 Aug 04 17:02:23.802163 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2564/5024] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:22 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1519 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:24.844720 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7d029e1f-e087-4788-b697-ff65bf599a81 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:24.846151 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7d029e1f-e087-4788-b697-ff65bf599a81 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:24.886235 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7d029e1f-e087-4788-b697-ff65bf599a81 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:24.903364 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7d029e1f-e087-4788-b697-ff65bf599a81 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:24.911103 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7d029e1f-e087-4788-b697-ff65bf599a81 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:24.924339 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7d029e1f-e087-4788-b697-ff65bf599a81 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:25.307400 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-eaff3a33-5684-4952-a823-284b62d431a2 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:25.309105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-eaff3a33-5684-4952-a823-284b62d431a2 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 179db84c-f006-46b9-85ad-ceea5c6a15ad] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:25.357063 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eaff3a33-5684-4952-a823-284b62d431a2 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:25.357501 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eaff3a33-5684-4952-a823-284b62d431a2 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:25.358566 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eaff3a33-5684-4952-a823-284b62d431a2 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:25.366944 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eaff3a33-5684-4952-a823-284b62d431a2 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:25.441972 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-eaff3a33-5684-4952-a823-284b62d431a2 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad/ips" status: 200 len: 149 microversion: 2.1 time: 0.140278 Aug 04 17:02:25.447613 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2565/5025] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Aug 4 17:02:25 2022] GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad/ips => generated 149 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:26.807321 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7d029e1f-e087-4788-b697-ff65bf599a81 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:26.824612 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7d029e1f-e087-4788-b697-ff65bf599a81 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1519 microversion: 2.1 time: 1.999130 Aug 04 17:02:26.843088 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2461/5026] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:24 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1519 bytes in 2016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:27.854615 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-57025ace-7e19-4040-8828-fceb4214b451 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:27.856136 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-57025ace-7e19-4040-8828-fceb4214b451 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:27.885821 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-57025ace-7e19-4040-8828-fceb4214b451 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:27.888983 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-57025ace-7e19-4040-8828-fceb4214b451 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:27.893075 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-57025ace-7e19-4040-8828-fceb4214b451 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:27.904545 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-57025ace-7e19-4040-8828-fceb4214b451 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:28.415807 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-50f49daa-89f1-4233-b1f0-6edffeb48c81 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17c74bdc-6cfe-402a-820d-6e21ac66f12c"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:28.419197 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-50f49daa-89f1-4233-b1f0-6edffeb48c81 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 179db84c-f006-46b9-85ad-ceea5c6a15ad] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:28.428624 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-50f49daa-89f1-4233-b1f0-6edffeb48c81 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:28.429625 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-50f49daa-89f1-4233-b1f0-6edffeb48c81 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:28.430646 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-50f49daa-89f1-4233-b1f0-6edffeb48c81 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:28.431285 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-50f49daa-89f1-4233-b1f0-6edffeb48c81 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:28.579068 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-57025ace-7e19-4040-8828-fceb4214b451 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:28.594319 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-57025ace-7e19-4040-8828-fceb4214b451 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1519 microversion: 2.1 time: 0.746633 Aug 04 17:02:28.616344 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2566/5027] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:27 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1519 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:02:28.911189 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-50f49daa-89f1-4233-b1f0-6edffeb48c81 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "POST /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.497468 Aug 04 17:02:28.913856 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2462/5028] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Aug 4 17:02:28 2022] POST /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad/os-volume_attachments => generated 194 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:02:29.624366 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e5c34b7d-0f4e-4a40-93a1-d1850abc3cb9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:29.625789 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e5c34b7d-0f4e-4a40-93a1-d1850abc3cb9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:29.640789 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e5c34b7d-0f4e-4a40-93a1-d1850abc3cb9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:29.641262 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e5c34b7d-0f4e-4a40-93a1-d1850abc3cb9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:29.642124 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e5c34b7d-0f4e-4a40-93a1-d1850abc3cb9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:29.642562 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e5c34b7d-0f4e-4a40-93a1-d1850abc3cb9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:30.354024 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e5c34b7d-0f4e-4a40-93a1-d1850abc3cb9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:30.368114 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e5c34b7d-0f4e-4a40-93a1-d1850abc3cb9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1519 microversion: 2.1 time: 0.748691 Aug 04 17:02:30.370501 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2567/5029] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:29 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1519 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:31.395973 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-caf7713d-7a3a-414b-b878-52dc25f9c15f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:31.396859 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-caf7713d-7a3a-414b-b878-52dc25f9c15f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:31.408922 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-caf7713d-7a3a-414b-b878-52dc25f9c15f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:31.409847 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-caf7713d-7a3a-414b-b878-52dc25f9c15f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:31.410947 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-caf7713d-7a3a-414b-b878-52dc25f9c15f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:31.411566 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-caf7713d-7a3a-414b-b878-52dc25f9c15f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:31.739322 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-a88766a4-ecaa-4da5-bbc5-51d20cd8e561 req-49312b1f-be19-4371-bf3f-049023c8f909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7094f480-111a-4c4e-8a77-2df578c044c0", "name": "network-vif-plugged", "status": "completed", "tag": "7cc4e42a-ac69-4d95-810a-566a44e11ef2"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:31.742063 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-caf7713d-7a3a-414b-b878-52dc25f9c15f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:31.756465 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-caf7713d-7a3a-414b-b878-52dc25f9c15f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1519 microversion: 2.1 time: 0.366532 Aug 04 17:02:31.778698 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2463/5030] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:31 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1519 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:31.784244 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-a88766a4-ecaa-4da5-bbc5-51d20cd8e561 req-49312b1f-be19-4371-bf3f-049023c8f909 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:31.785404 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-a88766a4-ecaa-4da5-bbc5-51d20cd8e561 req-49312b1f-be19-4371-bf3f-049023c8f909 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:31.825599 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-a88766a4-ecaa-4da5-bbc5-51d20cd8e561 req-49312b1f-be19-4371-bf3f-049023c8f909 service nova] Creating event network-vif-plugged:7cc4e42a-ac69-4d95-810a-566a44e11ef2 for instance 7094f480-111a-4c4e-8a77-2df578c044c0 on n-h2-846466-12 Aug 04 17:02:31.843315 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-a88766a4-ecaa-4da5-bbc5-51d20cd8e561 req-49312b1f-be19-4371-bf3f-049023c8f909 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112581 Aug 04 17:02:31.846763 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2568/5031] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:32.787976 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-26f84323-74b6-48ca-9d3a-0216806cf69e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:32.789531 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-26f84323-74b6-48ca-9d3a-0216806cf69e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:32.814603 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-26f84323-74b6-48ca-9d3a-0216806cf69e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:32.815063 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-26f84323-74b6-48ca-9d3a-0216806cf69e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:32.823388 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-26f84323-74b6-48ca-9d3a-0216806cf69e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:32.823846 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-26f84323-74b6-48ca-9d3a-0216806cf69e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:33.147768 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-26f84323-74b6-48ca-9d3a-0216806cf69e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:33.171730 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-26f84323-74b6-48ca-9d3a-0216806cf69e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1519 microversion: 2.1 time: 0.384327 Aug 04 17:02:33.199740 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2464/5032] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:32 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1519 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:34.217307 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e88cada7-d56e-4237-958e-5e04af508c34 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:34.218284 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e88cada7-d56e-4237-958e-5e04af508c34 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:34.227029 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:34.281233 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e88cada7-d56e-4237-958e-5e04af508c34 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:34.281717 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e88cada7-d56e-4237-958e-5e04af508c34 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:34.282510 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e88cada7-d56e-4237-958e-5e04af508c34 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:34.282956 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e88cada7-d56e-4237-958e-5e04af508c34 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:35.201506 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e88cada7-d56e-4237-958e-5e04af508c34 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:35.236794 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e88cada7-d56e-4237-958e-5e04af508c34 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1519 microversion: 2.1 time: 1.024828 Aug 04 17:02:35.286012 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2569/5033] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:34 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1519 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:36.298043 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fb357354-504c-4ec3-b9f3-fcf115d5f88d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:36.305026 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fb357354-504c-4ec3-b9f3-fcf115d5f88d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:36.345801 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fb357354-504c-4ec3-b9f3-fcf115d5f88d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:36.347313 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fb357354-504c-4ec3-b9f3-fcf115d5f88d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:36.352039 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fb357354-504c-4ec3-b9f3-fcf115d5f88d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:36.353810 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fb357354-504c-4ec3-b9f3-fcf115d5f88d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:37.085853 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fb357354-504c-4ec3-b9f3-fcf115d5f88d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:37.106869 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fb357354-504c-4ec3-b9f3-fcf115d5f88d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.824400 Aug 04 17:02:37.123123 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2465/5034] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:36 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:37.143885 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f3c32b5c-60d9-4dbd-8721-5954fca57f73 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:37.149169 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f3c32b5c-60d9-4dbd-8721-5954fca57f73 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:37.175703 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3c32b5c-60d9-4dbd-8721-5954fca57f73 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:37.180803 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3c32b5c-60d9-4dbd-8721-5954fca57f73 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:37.196805 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3c32b5c-60d9-4dbd-8721-5954fca57f73 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:37.198279 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3c32b5c-60d9-4dbd-8721-5954fca57f73 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:37.838097 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f3c32b5c-60d9-4dbd-8721-5954fca57f73 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:37.856496 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f3c32b5c-60d9-4dbd-8721-5954fca57f73 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.720132 Aug 04 17:02:37.859283 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2570/5035] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:37 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:37.909130 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fbb19e87-a280-4a5c-8522-60ee40bf9b0e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:37.912589 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fbb19e87-a280-4a5c-8522-60ee40bf9b0e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:37.930415 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:37.934500 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fbb19e87-a280-4a5c-8522-60ee40bf9b0e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:37.936277 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fbb19e87-a280-4a5c-8522-60ee40bf9b0e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:37.938820 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fbb19e87-a280-4a5c-8522-60ee40bf9b0e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:37.940485 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fbb19e87-a280-4a5c-8522-60ee40bf9b0e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:38.939237 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fbb19e87-a280-4a5c-8522-60ee40bf9b0e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:38.943712 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:38.966119 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fbb19e87-a280-4a5c-8522-60ee40bf9b0e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 1.064310 Aug 04 17:02:38.989950 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2466/5036] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:37 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:39.010714 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0baf0f2d-d32f-4962-98a8-4a4cc52a3464 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:39.058098 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-0baf0f2d-d32f-4962-98a8-4a4cc52a3464 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] HTTP exception thrown: Instance 8f0b1cb4-9050-4854-95db-cae6d459ef40 has no mapping to a cell. Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0baf0f2d-d32f-4962-98a8-4a4cc52a3464 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers/8f0b1cb4-9050-4854-95db-cae6d459ef40/action HTTP/1.1 Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 15 Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: {"os-stop": {}} Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 8f0b1cb4-9050-4854-95db-cae6d459ef40 has no mapping to a cell. Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '8f0b1cb4-9050-4854-95db-cae6d459ef40', 'body': {'os-stop': {}}} Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 8f0b1cb4-9050-4854-95db-cae6d459ef40 has no mapping to a cell. Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:02:39.079501 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f0b1cb4-9050-4854-95db-cae6d459ef40 has no mapping to a cell. Aug 04 17:02:39.095797 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:39.095797 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:39.095797 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:39.095797 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:39.095797 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:39.095797 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:39.095797 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:02:39.095797 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:02:39.095797 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f0b1cb4-9050-4854-95db-cae6d459ef40 has no mapping to a cell. Aug 04 17:02:39.095797 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:39.095797 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0baf0f2d-d32f-4962-98a8-4a4cc52a3464 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 404 to user: Instance 8f0b1cb4-9050-4854-95db-cae6d459ef40 has no mapping to a cell. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:02:39.107227 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0baf0f2d-d32f-4962-98a8-4a4cc52a3464 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers/8f0b1cb4-9050-4854-95db-cae6d459ef40/action" status: 404 len: 117 microversion: 2.1 time: 0.114561 Aug 04 17:02:39.116231 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2571/5037] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:02:38 2022] POST /compute/v2.1/servers/8f0b1cb4-9050-4854-95db-cae6d459ef40/action => generated 117 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:02:39.126887 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-268c323d-44b1-4059-9f8a-a61e7151c017 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:39.127505 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-268c323d-44b1-4059-9f8a-a61e7151c017 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:39.139873 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-268c323d-44b1-4059-9f8a-a61e7151c017 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:39.140313 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-268c323d-44b1-4059-9f8a-a61e7151c017 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:39.147279 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-268c323d-44b1-4059-9f8a-a61e7151c017 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:39.150026 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-268c323d-44b1-4059-9f8a-a61e7151c017 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:39.931601 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-268c323d-44b1-4059-9f8a-a61e7151c017 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:39.944887 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-268c323d-44b1-4059-9f8a-a61e7151c017 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.822345 Aug 04 17:02:39.965160 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2467/5038] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:39 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:39.974650 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b6c43517-571e-46de-9094-b6dff8fedfd0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:39.979348 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b6c43517-571e-46de-9094-b6dff8fedfd0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:40.018180 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b6c43517-571e-46de-9094-b6dff8fedfd0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:40.029797 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b6c43517-571e-46de-9094-b6dff8fedfd0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:40.031670 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b6c43517-571e-46de-9094-b6dff8fedfd0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:40.039816 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b6c43517-571e-46de-9094-b6dff8fedfd0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:41.187106 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b6c43517-571e-46de-9094-b6dff8fedfd0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:41.195819 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b6c43517-571e-46de-9094-b6dff8fedfd0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 1.228924 Aug 04 17:02:41.204894 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2572/5039] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:39 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:41.221607 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0af9484a-aed2-45c5-8083-0e8de35fcb76 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:41.222166 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0af9484a-aed2-45c5-8083-0e8de35fcb76 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 96331ce0-1560-401b-bb42-a5732104ec73] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:41.234668 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-0af9484a-aed2-45c5-8083-0e8de35fcb76 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] HTTP exception thrown: Instance 96331ce0-1560-401b-bb42-a5732104ec73 could not be found. Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0af9484a-aed2-45c5-8083-0e8de35fcb76 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers/96331ce0-1560-401b-bb42-a5732104ec73/action HTTP/1.1 Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 15 Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: {"suspend": {}} Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 96331ce0-1560-401b-bb42-a5732104ec73 could not be found. Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '96331ce0-1560-401b-bb42-a5732104ec73', 'body': {'suspend': {}}} Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96331ce0-1560-401b-bb42-a5732104ec73 could not be found. Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96331ce0-1560-401b-bb42-a5732104ec73 could not be found. Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:41.237140 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:41.243212 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:02:41.243212 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:02:41.243212 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96331ce0-1560-401b-bb42-a5732104ec73 could not be found. Aug 04 17:02:41.243212 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:02:41.250229 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0af9484a-aed2-45c5-8083-0e8de35fcb76 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 404 to user: Instance 96331ce0-1560-401b-bb42-a5732104ec73 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:02:41.251435 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0af9484a-aed2-45c5-8083-0e8de35fcb76 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers/96331ce0-1560-401b-bb42-a5732104ec73/action" status: 404 len: 111 microversion: 2.1 time: 0.034168 Aug 04 17:02:41.252619 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2468/5040] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:02:41 2022] POST /compute/v2.1/servers/96331ce0-1560-401b-bb42-a5732104ec73/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:02:41.271186 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8c78c924-c1bc-485b-8fee-a2b76cb6e0e0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:41.272003 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8c78c924-c1bc-485b-8fee-a2b76cb6e0e0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:41.287438 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8c78c924-c1bc-485b-8fee-a2b76cb6e0e0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:41.288146 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8c78c924-c1bc-485b-8fee-a2b76cb6e0e0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:41.289152 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8c78c924-c1bc-485b-8fee-a2b76cb6e0e0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:41.292719 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8c78c924-c1bc-485b-8fee-a2b76cb6e0e0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:41.957538 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8c78c924-c1bc-485b-8fee-a2b76cb6e0e0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:41.977691 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8c78c924-c1bc-485b-8fee-a2b76cb6e0e0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.718040 Aug 04 17:02:41.978361 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2573/5041] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:41 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:42.002442 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-65e92966-0a0d-4d1e-b731-cfdf2a4f5ee0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:42.003409 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-65e92966-0a0d-4d1e-b731-cfdf2a4f5ee0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:42.016328 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65e92966-0a0d-4d1e-b731-cfdf2a4f5ee0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:42.024077 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65e92966-0a0d-4d1e-b731-cfdf2a4f5ee0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:42.025382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65e92966-0a0d-4d1e-b731-cfdf2a4f5ee0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:42.026048 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65e92966-0a0d-4d1e-b731-cfdf2a4f5ee0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:42.928050 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-65e92966-0a0d-4d1e-b731-cfdf2a4f5ee0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:42.952067 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-65e92966-0a0d-4d1e-b731-cfdf2a4f5ee0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.952800 Aug 04 17:02:42.954042 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2469/5042] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:41 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:42.964820 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9e5504f3-febe-4eca-8839-80ecba13fdc2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:42.965955 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9e5504f3-febe-4eca-8839-80ecba13fdc2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:42.985666 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e5504f3-febe-4eca-8839-80ecba13fdc2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:42.987093 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e5504f3-febe-4eca-8839-80ecba13fdc2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:42.990283 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e5504f3-febe-4eca-8839-80ecba13fdc2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:42.992209 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e5504f3-febe-4eca-8839-80ecba13fdc2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:43.051950 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9e5504f3-febe-4eca-8839-80ecba13fdc2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8/ips" status: 200 len: 153 microversion: 2.20 time: 0.094708 Aug 04 17:02:43.056986 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2470/5043] 10.222.0.23 () {60 vars in 1289 bytes} [Thu Aug 4 17:02:42 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8/ips => generated 153 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:02:43.069225 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-053a303e-92c5-43f3-a3b4-6625e6e2aac1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:43.070649 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-053a303e-92c5-43f3-a3b4-6625e6e2aac1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:43.084296 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-053a303e-92c5-43f3-a3b4-6625e6e2aac1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:43.085036 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-053a303e-92c5-43f3-a3b4-6625e6e2aac1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:43.088247 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-053a303e-92c5-43f3-a3b4-6625e6e2aac1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:43.089078 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-053a303e-92c5-43f3-a3b4-6625e6e2aac1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:43.208348 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-053a303e-92c5-43f3-a3b4-6625e6e2aac1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lazy-loading 'flavor' on Instance uuid 7094f480-111a-4c4e-8a77-2df578c044c0 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:02:43.411457 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b0ea122c-aa65-40ef-a73a-cda21b5dd746 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1759669364", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "8cb02a54-d7a1-4ae8-b295-530e70a5b5b4"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:43.467423 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-053a303e-92c5-43f3-a3b4-6625e6e2aac1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0/action" status: 202 len: 0 microversion: 2.1 time: 0.407590 Aug 04 17:02:43.470985 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2471/5044] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:02:43 2022] POST /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0/action => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:02:43.555312 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-46bacd2c-ca75-4a78-bc30-8af60816d8d5 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:43.560825 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-46bacd2c-ca75-4a78-bc30-8af60816d8d5 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:43.590738 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-46bacd2c-ca75-4a78-bc30-8af60816d8d5 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:43.591421 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-46bacd2c-ca75-4a78-bc30-8af60816d8d5 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:43.592481 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-46bacd2c-ca75-4a78-bc30-8af60816d8d5 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:43.593089 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-46bacd2c-ca75-4a78-bc30-8af60816d8d5 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:43.669193 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-b0ea122c-aa65-40ef-a73a-cda21b5dd746 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] validate_networks() for [('8cb02a54-d7a1-4ae8-b295-530e70a5b5b4', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:02:44.234896 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-46bacd2c-ca75-4a78-bc30-8af60816d8d5 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:44.256248 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-46bacd2c-ca75-4a78-bc30-8af60816d8d5 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1514 microversion: 2.1 time: 0.714772 Aug 04 17:02:44.257029 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2472/5045] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:43 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1514 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:45.221609 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b0ea122c-aa65-40ef-a73a-cda21b5dd746 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:02:45.222092 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b0ea122c-aa65-40ef-a73a-cda21b5dd746 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:02:45.222530 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b0ea122c-aa65-40ef-a73a-cda21b5dd746 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:02:45.222975 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b0ea122c-aa65-40ef-a73a-cda21b5dd746 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:02:45.223528 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b0ea122c-aa65-40ef-a73a-cda21b5dd746 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:02:45.242166 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0ea122c-aa65-40ef-a73a-cda21b5dd746 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:45.242879 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0ea122c-aa65-40ef-a73a-cda21b5dd746 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:45.243961 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0ea122c-aa65-40ef-a73a-cda21b5dd746 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:45.244613 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0ea122c-aa65-40ef-a73a-cda21b5dd746 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:45.272013 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-b0ea122c-aa65-40ef-a73a-cda21b5dd746 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Getting quotas for project 1cdb1c1c0cf540afa1a51049f0340022. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:02:45.287535 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-b0ea122c-aa65-40ef-a73a-cda21b5dd746 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Getting quotas for user 037190e78d894fa09b8178c01da2568e and project 1cdb1c1c0cf540afa1a51049f0340022. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:02:45.291098 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-68eef870-f486-425c-913b-b6e6e337dfc1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:45.291714 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-68eef870-f486-425c-913b-b6e6e337dfc1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:45.317291 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-68eef870-f486-425c-913b-b6e6e337dfc1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:45.319661 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-68eef870-f486-425c-913b-b6e6e337dfc1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:45.320569 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-68eef870-f486-425c-913b-b6e6e337dfc1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:45.324594 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b0ea122c-aa65-40ef-a73a-cda21b5dd746 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:02:45.324812 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-68eef870-f486-425c-913b-b6e6e337dfc1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:45.331137 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b0ea122c-aa65-40ef-a73a-cda21b5dd746 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] [instance: 0b68766c-714e-4e29-b5ff-5db6d4d1c459] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:02:45.513008 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b0ea122c-aa65-40ef-a73a-cda21b5dd746 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 3.093029 Aug 04 17:02:45.523104 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2574/5046] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Aug 4 17:02:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 3104 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 17:02:45.543987 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fce5a011-71ef-4b24-bf09-f3b2bcea7213 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:45.551754 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fce5a011-71ef-4b24-bf09-f3b2bcea7213 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] [instance: 0b68766c-714e-4e29-b5ff-5db6d4d1c459] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:45.867115 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fce5a011-71ef-4b24-bf09-f3b2bcea7213 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:45.879917 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fce5a011-71ef-4b24-bf09-f3b2bcea7213 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:45.883253 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fce5a011-71ef-4b24-bf09-f3b2bcea7213 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:45.884832 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fce5a011-71ef-4b24-bf09-f3b2bcea7213 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459" status: 200 len: 1262 microversion: 2.26 time: 0.360332 Aug 04 17:02:45.889044 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2575/5047] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:45 2022] GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459 => generated 1262 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:45.986124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-68eef870-f486-425c-913b-b6e6e337dfc1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:46.019776 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-68eef870-f486-425c-913b-b6e6e337dfc1 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1497 microversion: 2.1 time: 0.736344 Aug 04 17:02:46.024263 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2473/5048] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:45 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1497 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:46.047783 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-51f39d9a-4cff-4e6b-b937-e423b23b9093 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:46.048953 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-51f39d9a-4cff-4e6b-b937-e423b23b9093 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:46.065867 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-51f39d9a-4cff-4e6b-b937-e423b23b9093 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:46.068143 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-51f39d9a-4cff-4e6b-b937-e423b23b9093 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:46.070139 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-51f39d9a-4cff-4e6b-b937-e423b23b9093 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:46.073604 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-51f39d9a-4cff-4e6b-b937-e423b23b9093 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:46.086742 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=55 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:46.165253 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-51f39d9a-4cff-4e6b-b937-e423b23b9093 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lazy-loading 'flavor' on Instance uuid 7094f480-111a-4c4e-8a77-2df578c044c0 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:02:46.261738 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-51f39d9a-4cff-4e6b-b937-e423b23b9093 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] HTTP exception thrown: Cannot 'suspend' instance 7094f480-111a-4c4e-8a77-2df578c044c0 while it is in vm_state suspended Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-51f39d9a-4cff-4e6b-b937-e423b23b9093 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0/action HTTP/1.1 Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 15 Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: {"suspend": {}} Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: exception: Cannot 'suspend' instance 7094f480-111a-4c4e-8a77-2df578c044c0 while it is in vm_state suspended Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '7094f480-111a-4c4e-8a77-2df578c044c0', 'body': {'suspend': {}}} Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7094f480-111a-4c4e-8a77-2df578c044c0 in vm_state suspended. Cannot suspend while the instance is in this state. Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 04 17:02:46.265736 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 17:02:46.281557 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 17:02:46.281557 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 17:02:46.281557 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 7094f480-111a-4c4e-8a77-2df578c044c0 while it is in vm_state suspended Aug 04 17:02:46.281557 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:46.281557 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:46.281557 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:46.281557 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:46.281557 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:46.281557 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:46.281557 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:02:46.281557 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:02:46.281557 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 7094f480-111a-4c4e-8a77-2df578c044c0 while it is in vm_state suspended Aug 04 17:02:46.281557 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:46.281557 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-51f39d9a-4cff-4e6b-b937-e423b23b9093 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 409 to user: Cannot 'suspend' instance 7094f480-111a-4c4e-8a77-2df578c044c0 while it is in vm_state suspended {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:02:46.281557 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-51f39d9a-4cff-4e6b-b937-e423b23b9093 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0/action" status: 409 len: 148 microversion: 2.1 time: 0.237363 Aug 04 17:02:46.303837 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2576/5049] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:02:46 2022] POST /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0/action => generated 148 bytes in 262 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:02:46.312408 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f2f31f9c-3346-45aa-873b-59881b472ac9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:46.314997 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f2f31f9c-3346-45aa-873b-59881b472ac9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:46.371084 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f2f31f9c-3346-45aa-873b-59881b472ac9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:46.372702 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f2f31f9c-3346-45aa-873b-59881b472ac9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:46.376056 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f2f31f9c-3346-45aa-873b-59881b472ac9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:46.380346 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f2f31f9c-3346-45aa-873b-59881b472ac9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:46.625105 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f2f31f9c-3346-45aa-873b-59881b472ac9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0/action" status: 202 len: 0 microversion: 2.1 time: 0.318058 Aug 04 17:02:46.630694 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2474/5050] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:02:46 2022] POST /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 17:02:46.644599 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-57234c50-18f8-4569-bcf1-be8849de11e0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:46.650103 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-57234c50-18f8-4569-bcf1-be8849de11e0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:46.684707 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-57234c50-18f8-4569-bcf1-be8849de11e0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:46.686590 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-57234c50-18f8-4569-bcf1-be8849de11e0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:46.689137 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-57234c50-18f8-4569-bcf1-be8849de11e0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:46.690375 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-57234c50-18f8-4569-bcf1-be8849de11e0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:46.718082 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bc89b85d-22d9-4ee2-adaf-0e634979c195 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:46.718706 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bc89b85d-22d9-4ee2-adaf-0e634979c195 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:46.744099 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bc89b85d-22d9-4ee2-adaf-0e634979c195 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:46.744653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bc89b85d-22d9-4ee2-adaf-0e634979c195 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:46.745378 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bc89b85d-22d9-4ee2-adaf-0e634979c195 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:46.752765 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bc89b85d-22d9-4ee2-adaf-0e634979c195 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:46.840872 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-bc89b85d-22d9-4ee2-adaf-0e634979c195 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lazy-loading 'flavor' on Instance uuid e192310d-3cab-471d-8d3e-d161ef4de6c8 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:02:47.222316 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-57234c50-18f8-4569-bcf1-be8849de11e0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:47.255738 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-57234c50-18f8-4569-bcf1-be8849de11e0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1503 microversion: 2.1 time: 0.622293 Aug 04 17:02:47.260633 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2577/5051] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:46 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1503 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:47.276384 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1d6a99f0-dc66-4bfb-9bcc-e0915b8b8303 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:47.277174 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1d6a99f0-dc66-4bfb-9bcc-e0915b8b8303 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] [instance: 0b68766c-714e-4e29-b5ff-5db6d4d1c459] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:47.291536 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1d6a99f0-dc66-4bfb-9bcc-e0915b8b8303 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:47.292863 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1d6a99f0-dc66-4bfb-9bcc-e0915b8b8303 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:47.296471 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1d6a99f0-dc66-4bfb-9bcc-e0915b8b8303 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:47.298579 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1d6a99f0-dc66-4bfb-9bcc-e0915b8b8303 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:47.361159 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bc89b85d-22d9-4ee2-adaf-0e634979c195 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "POST /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8/action" status: 202 len: 0 microversion: 2.20 time: 0.652800 Aug 04 17:02:47.367794 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2475/5052] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Aug 4 17:02:46 2022] POST /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8/action => generated 0 bytes in 660 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 04 17:02:47.388990 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1a5526ec-4484-4b78-93b1-7ae8d85effa4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:47.390407 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1a5526ec-4484-4b78-93b1-7ae8d85effa4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:47.428588 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1a5526ec-4484-4b78-93b1-7ae8d85effa4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:47.430533 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1a5526ec-4484-4b78-93b1-7ae8d85effa4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:47.436881 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1a5526ec-4484-4b78-93b1-7ae8d85effa4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:47.439880 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1a5526ec-4484-4b78-93b1-7ae8d85effa4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:47.471020 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1d6a99f0-dc66-4bfb-9bcc-e0915b8b8303 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:47.487085 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1d6a99f0-dc66-4bfb-9bcc-e0915b8b8303 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:47.493966 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1d6a99f0-dc66-4bfb-9bcc-e0915b8b8303 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:47.501560 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1d6a99f0-dc66-4bfb-9bcc-e0915b8b8303 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459" status: 200 len: 1314 microversion: 2.26 time: 0.239006 Aug 04 17:02:47.505367 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2578/5053] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:47 2022] GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:47.909144 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1a5526ec-4484-4b78-93b1-7ae8d85effa4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:47.936713 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1a5526ec-4484-4b78-93b1-7ae8d85effa4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:47.963072 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1a5526ec-4484-4b78-93b1-7ae8d85effa4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:47.964838 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1a5526ec-4484-4b78-93b1-7ae8d85effa4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1724 microversion: 2.20 time: 0.593487 Aug 04 17:02:47.975624 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2476/5054] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:47 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1724 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:48.084211 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-440f2371-7326-41c7-9b5a-ee800df1248d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:48.090438 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-440f2371-7326-41c7-9b5a-ee800df1248d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 179db84c-f006-46b9-85ad-ceea5c6a15ad] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:48.131039 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-440f2371-7326-41c7-9b5a-ee800df1248d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:48.138140 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-440f2371-7326-41c7-9b5a-ee800df1248d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:48.140265 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-440f2371-7326-41c7-9b5a-ee800df1248d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:48.140708 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-440f2371-7326-41c7-9b5a-ee800df1248d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:48.282765 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8044fbc1-5955-4a0f-a68e-05185422fe92 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:48.284009 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8044fbc1-5955-4a0f-a68e-05185422fe92 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:48.296465 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8044fbc1-5955-4a0f-a68e-05185422fe92 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:48.306047 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8044fbc1-5955-4a0f-a68e-05185422fe92 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:48.309018 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8044fbc1-5955-4a0f-a68e-05185422fe92 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:48.311459 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8044fbc1-5955-4a0f-a68e-05185422fe92 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:48.508167 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-440f2371-7326-41c7-9b5a-ee800df1248d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lazy-loading 'services' on Instance uuid 179db84c-f006-46b9-85ad-ceea5c6a15ad {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:02:48.685532 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-440f2371-7326-41c7-9b5a-ee800df1248d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "DELETE /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad/os-volume_attachments/17c74bdc-6cfe-402a-820d-6e21ac66f12c" status: 202 len: 0 microversion: 2.1 time: 0.611621 Aug 04 17:02:48.686179 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2579/5055] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Aug 4 17:02:48 2022] DELETE /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad/os-volume_attachments/17c74bdc-6cfe-402a-820d-6e21ac66f12c => generated 0 bytes in 614 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:02:48.716654 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bed77216-d986-4a72-953a-9ff542f2e5c3 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:48.721024 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bed77216-d986-4a72-953a-9ff542f2e5c3 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] [instance: 0b68766c-714e-4e29-b5ff-5db6d4d1c459] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:48.735098 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bed77216-d986-4a72-953a-9ff542f2e5c3 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:48.736267 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bed77216-d986-4a72-953a-9ff542f2e5c3 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:48.737644 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bed77216-d986-4a72-953a-9ff542f2e5c3 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:48.738627 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bed77216-d986-4a72-953a-9ff542f2e5c3 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:48.781750 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8044fbc1-5955-4a0f-a68e-05185422fe92 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:48.810135 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8044fbc1-5955-4a0f-a68e-05185422fe92 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1503 microversion: 2.1 time: 0.529379 Aug 04 17:02:48.810768 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2477/5056] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:48 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1503 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:02:48.831840 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e5d0b5bc-3f46-4e43-88bf-bf170b1e5322 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:48.845601 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e5d0b5bc-3f46-4e43-88bf-bf170b1e5322 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 179db84c-f006-46b9-85ad-ceea5c6a15ad] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:48.867475 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5d0b5bc-3f46-4e43-88bf-bf170b1e5322 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:48.868208 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5d0b5bc-3f46-4e43-88bf-bf170b1e5322 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:48.870342 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5d0b5bc-3f46-4e43-88bf-bf170b1e5322 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:48.871585 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5d0b5bc-3f46-4e43-88bf-bf170b1e5322 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:48.930362 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e5d0b5bc-3f46-4e43-88bf-bf170b1e5322 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112575 Aug 04 17:02:48.931238 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2478/5057] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:02:48 2022] GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:49.000519 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-49b28179-1879-45f4-b988-35c814c1a8fd tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:49.001541 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-49b28179-1879-45f4-b988-35c814c1a8fd tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:49.016012 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-49b28179-1879-45f4-b988-35c814c1a8fd tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:49.019067 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-49b28179-1879-45f4-b988-35c814c1a8fd tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:49.022768 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-49b28179-1879-45f4-b988-35c814c1a8fd tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:49.024572 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-49b28179-1879-45f4-b988-35c814c1a8fd tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:49.237441 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bed77216-d986-4a72-953a-9ff542f2e5c3 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:49.261996 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bed77216-d986-4a72-953a-9ff542f2e5c3 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:49.268973 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bed77216-d986-4a72-953a-9ff542f2e5c3 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:49.274152 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bed77216-d986-4a72-953a-9ff542f2e5c3 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459" status: 200 len: 1320 microversion: 2.26 time: 0.586686 Aug 04 17:02:49.277936 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2580/5058] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:48 2022] GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459 => generated 1320 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:49.630584 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-49b28179-1879-45f4-b988-35c814c1a8fd tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:49.658969 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-49b28179-1879-45f4-b988-35c814c1a8fd tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:49.673367 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-49b28179-1879-45f4-b988-35c814c1a8fd tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:49.674617 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-49b28179-1879-45f4-b988-35c814c1a8fd tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1724 microversion: 2.20 time: 0.680482 Aug 04 17:02:49.681692 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2479/5059] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:48 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1724 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:02:49.835365 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9c23eb18-f70b-4e0b-b401-8786262c117e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:49.835975 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9c23eb18-f70b-4e0b-b401-8786262c117e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:49.857244 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c23eb18-f70b-4e0b-b401-8786262c117e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:49.858903 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c23eb18-f70b-4e0b-b401-8786262c117e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:49.864863 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c23eb18-f70b-4e0b-b401-8786262c117e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:49.866230 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c23eb18-f70b-4e0b-b401-8786262c117e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:49.945112 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5360b5d9-8323-4842-b3b7-360b49c9096b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:49.951966 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5360b5d9-8323-4842-b3b7-360b49c9096b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 179db84c-f006-46b9-85ad-ceea5c6a15ad] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:49.977048 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5360b5d9-8323-4842-b3b7-360b49c9096b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:49.978923 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5360b5d9-8323-4842-b3b7-360b49c9096b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:49.982251 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5360b5d9-8323-4842-b3b7-360b49c9096b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:49.986220 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5360b5d9-8323-4842-b3b7-360b49c9096b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:50.008435 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:50.123131 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5360b5d9-8323-4842-b3b7-360b49c9096b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.183955 Aug 04 17:02:50.130968 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2480/5060] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:02:49 2022] GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:50.305730 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-49da721b-1205-4ae1-8abf-267075806a15 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:50.307010 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-49da721b-1205-4ae1-8abf-267075806a15 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] [instance: 0b68766c-714e-4e29-b5ff-5db6d4d1c459] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:50.323800 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-49da721b-1205-4ae1-8abf-267075806a15 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:50.325102 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-49da721b-1205-4ae1-8abf-267075806a15 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:50.330219 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-49da721b-1205-4ae1-8abf-267075806a15 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:50.332606 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-49da721b-1205-4ae1-8abf-267075806a15 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:50.790794 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9c23eb18-f70b-4e0b-b401-8786262c117e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:50.822810 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9c23eb18-f70b-4e0b-b401-8786262c117e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.989140 Aug 04 17:02:50.826650 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2581/5061] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:49 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:50.843856 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-46043899-0823-4c45-bcca-0bdeb1cac7c2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:50.848091 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-46043899-0823-4c45-bcca-0bdeb1cac7c2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:50.868845 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46043899-0823-4c45-bcca-0bdeb1cac7c2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:50.869910 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46043899-0823-4c45-bcca-0bdeb1cac7c2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:50.873203 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46043899-0823-4c45-bcca-0bdeb1cac7c2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:50.875765 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46043899-0823-4c45-bcca-0bdeb1cac7c2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:50.943797 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-49da721b-1205-4ae1-8abf-267075806a15 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:50.956220 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-49da721b-1205-4ae1-8abf-267075806a15 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:50.959528 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-49da721b-1205-4ae1-8abf-267075806a15 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:50.960976 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-49da721b-1205-4ae1-8abf-267075806a15 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459" status: 200 len: 1362 microversion: 2.26 time: 0.661148 Aug 04 17:02:50.962144 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2481/5062] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:50 2022] GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459 => generated 1362 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:02:50.981346 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-441a3375-d04a-4d1c-a7dd-404c37fb6caf tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:50.982733 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-441a3375-d04a-4d1c-a7dd-404c37fb6caf tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:50.991929 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-441a3375-d04a-4d1c-a7dd-404c37fb6caf tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:50.993872 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-441a3375-d04a-4d1c-a7dd-404c37fb6caf tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:50.997205 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-441a3375-d04a-4d1c-a7dd-404c37fb6caf tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:50.999179 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-441a3375-d04a-4d1c-a7dd-404c37fb6caf tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:51.541319 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-46043899-0823-4c45-bcca-0bdeb1cac7c2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:51.555104 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-46043899-0823-4c45-bcca-0bdeb1cac7c2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:51.560619 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-441a3375-d04a-4d1c-a7dd-404c37fb6caf tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:51.562350 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-46043899-0823-4c45-bcca-0bdeb1cac7c2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:51.566327 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-46043899-0823-4c45-bcca-0bdeb1cac7c2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1724 microversion: 2.20 time: 0.737779 Aug 04 17:02:51.568115 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2582/5063] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:50 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1724 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:51.578735 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e8ff7086-86ab-40fb-8b59-62c6de43bcba tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:51.584903 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-441a3375-d04a-4d1c-a7dd-404c37fb6caf tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.621363 Aug 04 17:02:51.587231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e8ff7086-86ab-40fb-8b59-62c6de43bcba tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 179db84c-f006-46b9-85ad-ceea5c6a15ad] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:51.602094 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2482/5064] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:50 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:51.611623 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e8ff7086-86ab-40fb-8b59-62c6de43bcba tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:51.614703 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-098e4690-0557-4ca7-8457-bdaf69c1e5a0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:51.614927 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e8ff7086-86ab-40fb-8b59-62c6de43bcba tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:51.615859 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e8ff7086-86ab-40fb-8b59-62c6de43bcba tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:51.616254 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-098e4690-0557-4ca7-8457-bdaf69c1e5a0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: e4398ca9-8e76-4eb1-9474-0b1d26aaf256] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:51.618362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e8ff7086-86ab-40fb-8b59-62c6de43bcba tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:51.633188 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-098e4690-0557-4ca7-8457-bdaf69c1e5a0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] HTTP exception thrown: Instance e4398ca9-8e76-4eb1-9474-0b1d26aaf256 could not be found. Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-098e4690-0557-4ca7-8457-bdaf69c1e5a0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers/e4398ca9-8e76-4eb1-9474-0b1d26aaf256/action HTTP/1.1 Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 15 Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: {"unpause": {}} Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance e4398ca9-8e76-4eb1-9474-0b1d26aaf256 could not be found. Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'e4398ca9-8e76-4eb1-9474-0b1d26aaf256', 'body': {'unpause': {}}} Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4398ca9-8e76-4eb1-9474-0b1d26aaf256 could not be found. Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4398ca9-8e76-4eb1-9474-0b1d26aaf256 could not be found. Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:51.636508 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:51.643644 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:02:51.643644 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:02:51.643644 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4398ca9-8e76-4eb1-9474-0b1d26aaf256 could not be found. Aug 04 17:02:51.643644 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:02:51.643644 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-098e4690-0557-4ca7-8457-bdaf69c1e5a0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 404 to user: Instance e4398ca9-8e76-4eb1-9474-0b1d26aaf256 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:02:51.643644 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-098e4690-0557-4ca7-8457-bdaf69c1e5a0 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers/e4398ca9-8e76-4eb1-9474-0b1d26aaf256/action" status: 404 len: 111 microversion: 2.1 time: 0.036126 Aug 04 17:02:51.647138 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2483/5065] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:02:51 2022] POST /compute/v2.1/servers/e4398ca9-8e76-4eb1-9474-0b1d26aaf256/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:02:51.653416 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0adca599-5f0f-4e9d-b8cb-264f18866d1d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:51.654032 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0adca599-5f0f-4e9d-b8cb-264f18866d1d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:51.665567 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0adca599-5f0f-4e9d-b8cb-264f18866d1d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:51.665937 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0adca599-5f0f-4e9d-b8cb-264f18866d1d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:51.666672 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0adca599-5f0f-4e9d-b8cb-264f18866d1d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:51.667101 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0adca599-5f0f-4e9d-b8cb-264f18866d1d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:51.724750 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e8ff7086-86ab-40fb-8b59-62c6de43bcba tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153620 Aug 04 17:02:51.733471 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2583/5066] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:02:51 2022] GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:51.986798 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4c327e33-db4b-4411-b128-6eca8f32bb21 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:51.989131 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4c327e33-db4b-4411-b128-6eca8f32bb21 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] [instance: 0b68766c-714e-4e29-b5ff-5db6d4d1c459] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:52.017811 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4c327e33-db4b-4411-b128-6eca8f32bb21 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:52.020968 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4c327e33-db4b-4411-b128-6eca8f32bb21 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:52.025167 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4c327e33-db4b-4411-b128-6eca8f32bb21 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:52.029244 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4c327e33-db4b-4411-b128-6eca8f32bb21 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:52.335425 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0adca599-5f0f-4e9d-b8cb-264f18866d1d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:52.347399 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0adca599-5f0f-4e9d-b8cb-264f18866d1d tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.695672 Aug 04 17:02:52.348850 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2484/5067] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:51 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:52.381173 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e9dadf74-5d69-4292-bcc9-bcaac3c7ee12 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:52.382429 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e9dadf74-5d69-4292-bcc9-bcaac3c7ee12 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:52.403380 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e9dadf74-5d69-4292-bcc9-bcaac3c7ee12 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:52.404058 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e9dadf74-5d69-4292-bcc9-bcaac3c7ee12 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:52.405114 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e9dadf74-5d69-4292-bcc9-bcaac3c7ee12 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:52.405745 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e9dadf74-5d69-4292-bcc9-bcaac3c7ee12 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:52.974607 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4c327e33-db4b-4411-b128-6eca8f32bb21 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:52.985941 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4c327e33-db4b-4411-b128-6eca8f32bb21 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:52.989598 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4c327e33-db4b-4411-b128-6eca8f32bb21 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:52.993846 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4c327e33-db4b-4411-b128-6eca8f32bb21 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459" status: 200 len: 1362 microversion: 2.26 time: 1.011763 Aug 04 17:02:52.995110 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2584/5068] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:51 2022] GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459 => generated 1362 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:53.001633 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-940a7c7d-fb2a-4e7b-a107-ca1936e39fd4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:53.002566 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-940a7c7d-fb2a-4e7b-a107-ca1936e39fd4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:53.015361 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-940a7c7d-fb2a-4e7b-a107-ca1936e39fd4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:53.016149 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-940a7c7d-fb2a-4e7b-a107-ca1936e39fd4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:53.017407 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-940a7c7d-fb2a-4e7b-a107-ca1936e39fd4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:53.018532 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-940a7c7d-fb2a-4e7b-a107-ca1936e39fd4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:53.818923 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e9dadf74-5d69-4292-bcc9-bcaac3c7ee12 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:53.828349 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e9dadf74-5d69-4292-bcc9-bcaac3c7ee12 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 1.457856 Aug 04 17:02:53.859453 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2485/5069] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:52 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:53.870289 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c60213ff-cd22-4352-89b8-8ccd4d32f975 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:53.883109 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c60213ff-cd22-4352-89b8-8ccd4d32f975 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 179db84c-f006-46b9-85ad-ceea5c6a15ad] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:53.890564 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c60213ff-cd22-4352-89b8-8ccd4d32f975 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:53.896994 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c60213ff-cd22-4352-89b8-8ccd4d32f975 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:53.898082 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c60213ff-cd22-4352-89b8-8ccd4d32f975 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:53.899345 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c60213ff-cd22-4352-89b8-8ccd4d32f975 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:53.967765 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c60213ff-cd22-4352-89b8-8ccd4d32f975 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106627 Aug 04 17:02:53.968753 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2486/5070] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:02:53 2022] GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:53.994257 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-baf70198-8f30-424f-82b9-a216d7a04d86 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:54.004266 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-baf70198-8f30-424f-82b9-a216d7a04d86 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:54.044429 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-baf70198-8f30-424f-82b9-a216d7a04d86 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:54.046994 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-baf70198-8f30-424f-82b9-a216d7a04d86 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:54.048440 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-baf70198-8f30-424f-82b9-a216d7a04d86 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:54.051399 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-baf70198-8f30-424f-82b9-a216d7a04d86 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:54.062206 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-940a7c7d-fb2a-4e7b-a107-ca1936e39fd4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:54.073320 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-940a7c7d-fb2a-4e7b-a107-ca1936e39fd4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:54.094024 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-940a7c7d-fb2a-4e7b-a107-ca1936e39fd4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:54.096253 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-940a7c7d-fb2a-4e7b-a107-ca1936e39fd4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1724 microversion: 2.20 time: 1.099651 Aug 04 17:02:54.097405 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2585/5071] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:52 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1724 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:54.116621 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-04d9d784-0d67-4d52-9776-a0d1419007a6 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:54.117452 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-04d9d784-0d67-4d52-9776-a0d1419007a6 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] [instance: 0b68766c-714e-4e29-b5ff-5db6d4d1c459] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:54.150121 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-04d9d784-0d67-4d52-9776-a0d1419007a6 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:54.152190 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-04d9d784-0d67-4d52-9776-a0d1419007a6 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:54.153138 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-04d9d784-0d67-4d52-9776-a0d1419007a6 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:54.159942 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-04d9d784-0d67-4d52-9776-a0d1419007a6 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:54.162560 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-baf70198-8f30-424f-82b9-a216d7a04d86 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] HTTP exception thrown: Cannot 'unpause' instance 7094f480-111a-4c4e-8a77-2df578c044c0 while it is in vm_state active Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-baf70198-8f30-424f-82b9-a216d7a04d86 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0/action HTTP/1.1 Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 15 Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: {"unpause": {}} Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: exception: Cannot 'unpause' instance 7094f480-111a-4c4e-8a77-2df578c044c0 while it is in vm_state active Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '7094f480-111a-4c4e-8a77-2df578c044c0', 'body': {'unpause': {}}} Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7094f480-111a-4c4e-8a77-2df578c044c0 in vm_state active. Cannot unpause while the instance is in this state. Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 7094f480-111a-4c4e-8a77-2df578c044c0 while it is in vm_state active Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:54.167015 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:54.172780 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:54.172780 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:02:54.172780 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:02:54.172780 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 7094f480-111a-4c4e-8a77-2df578c044c0 while it is in vm_state active Aug 04 17:02:54.172780 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:02:54.178999 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-baf70198-8f30-424f-82b9-a216d7a04d86 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 409 to user: Cannot 'unpause' instance 7094f480-111a-4c4e-8a77-2df578c044c0 while it is in vm_state active {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:02:54.180403 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-baf70198-8f30-424f-82b9-a216d7a04d86 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0/action" status: 409 len: 145 microversion: 2.1 time: 0.190268 Aug 04 17:02:54.180998 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2487/5072] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:02:53 2022] POST /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0/action => generated 145 bytes in 192 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:02:54.195794 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-edabf321-2988-45f2-8edd-5877b1443539 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:54.202059 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-edabf321-2988-45f2-8edd-5877b1443539 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:54.214885 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-edabf321-2988-45f2-8edd-5877b1443539 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:54.215335 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-edabf321-2988-45f2-8edd-5877b1443539 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:54.216121 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-edabf321-2988-45f2-8edd-5877b1443539 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:54.216554 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-edabf321-2988-45f2-8edd-5877b1443539 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:55.257545 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:55.293734 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-edabf321-2988-45f2-8edd-5877b1443539 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:55.299696 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-edabf321-2988-45f2-8edd-5877b1443539 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 1.114228 Aug 04 17:02:55.310048 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2488/5073] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:54 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:02:55.331108 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-74caab73-f147-491e-bb8c-fd350d0cb90b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:55.331108 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-74caab73-f147-491e-bb8c-fd350d0cb90b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 179db84c-f006-46b9-85ad-ceea5c6a15ad] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:55.354411 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-04d9d784-0d67-4d52-9776-a0d1419007a6 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:55.369502 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-04d9d784-0d67-4d52-9776-a0d1419007a6 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:55.371132 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-04d9d784-0d67-4d52-9776-a0d1419007a6 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:55.373439 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-04d9d784-0d67-4d52-9776-a0d1419007a6 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459" status: 200 len: 1362 microversion: 2.26 time: 1.274805 Aug 04 17:02:55.377124 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2586/5074] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:54 2022] GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459 => generated 1362 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:55.391747 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ad118572-a93f-4de0-b8f8-2b095d976bc3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:55.392365 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ad118572-a93f-4de0-b8f8-2b095d976bc3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:55.398161 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-74caab73-f147-491e-bb8c-fd350d0cb90b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:55.398732 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-74caab73-f147-491e-bb8c-fd350d0cb90b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:55.399574 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-74caab73-f147-491e-bb8c-fd350d0cb90b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:55.400005 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-74caab73-f147-491e-bb8c-fd350d0cb90b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:55.403101 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad118572-a93f-4de0-b8f8-2b095d976bc3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:55.403552 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad118572-a93f-4de0-b8f8-2b095d976bc3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:55.404421 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad118572-a93f-4de0-b8f8-2b095d976bc3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:55.406071 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad118572-a93f-4de0-b8f8-2b095d976bc3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:55.496880 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-74caab73-f147-491e-bb8c-fd350d0cb90b tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.185413 Aug 04 17:02:55.503938 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2489/5075] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:02:55 2022] GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:55.513900 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-f5ff530f-8585-4341-92ab-76cb86e9b145 req-85abcf17-c7c0-41bf-9942-6bc641f312a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b68766c-714e-4e29-b5ff-5db6d4d1c459", "tag": "4217d3e4-70c7-4ce9-9180-5e391b9ff59f"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:55.532700 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f5ff530f-8585-4341-92ab-76cb86e9b145 req-85abcf17-c7c0-41bf-9942-6bc641f312a0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:55.536507 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f5ff530f-8585-4341-92ab-76cb86e9b145 req-85abcf17-c7c0-41bf-9942-6bc641f312a0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:55.578832 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-f5ff530f-8585-4341-92ab-76cb86e9b145 req-85abcf17-c7c0-41bf-9942-6bc641f312a0 service nova] Creating event network-changed:4217d3e4-70c7-4ce9-9180-5e391b9ff59f for instance 0b68766c-714e-4e29-b5ff-5db6d4d1c459 on n-h1-846466-12 Aug 04 17:02:55.591167 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-f5ff530f-8585-4341-92ab-76cb86e9b145 req-85abcf17-c7c0-41bf-9942-6bc641f312a0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085401 Aug 04 17:02:55.594707 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2490/5076] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:55.607624 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d271605e-fa60-4fab-9c15-644e831ba238 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:55.608385 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d271605e-fa60-4fab-9c15-644e831ba238 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:55.635846 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d271605e-fa60-4fab-9c15-644e831ba238 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:55.636449 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d271605e-fa60-4fab-9c15-644e831ba238 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:55.637387 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d271605e-fa60-4fab-9c15-644e831ba238 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:55.639477 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d271605e-fa60-4fab-9c15-644e831ba238 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:55.875904 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=8 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:56.831830 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d271605e-fa60-4fab-9c15-644e831ba238 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:56.846472 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d271605e-fa60-4fab-9c15-644e831ba238 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 1.250447 Aug 04 17:02:56.853136 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2491/5077] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:55 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:56.882688 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-00870ac5-07de-4805-b85d-8fbe3adabcaf tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:56.882901 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-00870ac5-07de-4805-b85d-8fbe3adabcaf tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] [instance: 0b68766c-714e-4e29-b5ff-5db6d4d1c459] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:56.896623 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-00870ac5-07de-4805-b85d-8fbe3adabcaf tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:56.897074 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-00870ac5-07de-4805-b85d-8fbe3adabcaf tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:56.898522 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-00870ac5-07de-4805-b85d-8fbe3adabcaf tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:56.898970 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-00870ac5-07de-4805-b85d-8fbe3adabcaf tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:56.919645 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ad118572-a93f-4de0-b8f8-2b095d976bc3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:56.935177 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ad118572-a93f-4de0-b8f8-2b095d976bc3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:56.939322 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ad118572-a93f-4de0-b8f8-2b095d976bc3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:56.943498 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ad118572-a93f-4de0-b8f8-2b095d976bc3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1724 microversion: 2.20 time: 1.564597 Aug 04 17:02:56.946278 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2587/5078] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:55 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1724 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:56.957947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-686d3b8d-53b2-450b-8326-e1edc58e5705 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:56.967928 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-686d3b8d-53b2-450b-8326-e1edc58e5705 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 179db84c-f006-46b9-85ad-ceea5c6a15ad] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:56.983476 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-686d3b8d-53b2-450b-8326-e1edc58e5705 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:56.983931 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-686d3b8d-53b2-450b-8326-e1edc58e5705 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:56.985231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-686d3b8d-53b2-450b-8326-e1edc58e5705 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:56.990944 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-686d3b8d-53b2-450b-8326-e1edc58e5705 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:57.035197 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-686d3b8d-53b2-450b-8326-e1edc58e5705 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087718 Aug 04 17:02:57.040370 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2588/5079] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:02:56 2022] GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:57.048469 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3c314054-6b23-4dc1-aab8-1a441a06d05f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:57.050362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3c314054-6b23-4dc1-aab8-1a441a06d05f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: a56bfff8-20bf-4bc5-bf55-9349643c0906] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:57.060541 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-3c314054-6b23-4dc1-aab8-1a441a06d05f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] HTTP exception thrown: Instance a56bfff8-20bf-4bc5-bf55-9349643c0906 could not be found. Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3c314054-6b23-4dc1-aab8-1a441a06d05f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers/a56bfff8-20bf-4bc5-bf55-9349643c0906/action HTTP/1.1 Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 18 Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: {"unshelve": null} Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance a56bfff8-20bf-4bc5-bf55-9349643c0906 could not be found. Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'a56bfff8-20bf-4bc5-bf55-9349643c0906', 'body': {'unshelve': None}} Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a56bfff8-20bf-4bc5-bf55-9349643c0906 could not be found. Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a56bfff8-20bf-4bc5-bf55-9349643c0906 could not be found. Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:57.062754 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:57.069806 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:57.069806 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:57.069806 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:57.069806 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:57.069806 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:02:57.069806 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:02:57.069806 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a56bfff8-20bf-4bc5-bf55-9349643c0906 could not be found. Aug 04 17:02:57.069806 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:57.075651 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3c314054-6b23-4dc1-aab8-1a441a06d05f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 404 to user: Instance a56bfff8-20bf-4bc5-bf55-9349643c0906 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:02:57.079259 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3c314054-6b23-4dc1-aab8-1a441a06d05f tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers/a56bfff8-20bf-4bc5-bf55-9349643c0906/action" status: 404 len: 111 microversion: 2.1 time: 0.035553 Aug 04 17:02:57.083446 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2589/5080] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:02:57 2022] POST /compute/v2.1/servers/a56bfff8-20bf-4bc5-bf55-9349643c0906/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:02:57.099062 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5e6e5532-8302-440a-8f36-01c1b6f23cd7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:57.099999 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5e6e5532-8302-440a-8f36-01c1b6f23cd7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:57.126307 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5e6e5532-8302-440a-8f36-01c1b6f23cd7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:57.127329 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5e6e5532-8302-440a-8f36-01c1b6f23cd7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:57.130842 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5e6e5532-8302-440a-8f36-01c1b6f23cd7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:57.131516 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5e6e5532-8302-440a-8f36-01c1b6f23cd7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:57.557587 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-00870ac5-07de-4805-b85d-8fbe3adabcaf tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:57.570356 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-00870ac5-07de-4805-b85d-8fbe3adabcaf tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:57.571970 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-00870ac5-07de-4805-b85d-8fbe3adabcaf tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:57.573158 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-00870ac5-07de-4805-b85d-8fbe3adabcaf tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459" status: 200 len: 1362 microversion: 2.26 time: 0.718842 Aug 04 17:02:57.585023 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2492/5081] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:56 2022] GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459 => generated 1362 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:57.678963 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5e6e5532-8302-440a-8f36-01c1b6f23cd7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:57.718221 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5e6e5532-8302-440a-8f36-01c1b6f23cd7 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.625313 Aug 04 17:02:57.719318 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2590/5082] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:57 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:57.747580 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6db7ffbb-e7b8-4e2d-b7db-74095497efed tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:57.748944 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6db7ffbb-e7b8-4e2d-b7db-74095497efed tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:57.764428 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6db7ffbb-e7b8-4e2d-b7db-74095497efed tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:57.765559 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6db7ffbb-e7b8-4e2d-b7db-74095497efed tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:57.766966 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6db7ffbb-e7b8-4e2d-b7db-74095497efed tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:57.769781 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6db7ffbb-e7b8-4e2d-b7db-74095497efed tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:57.970969 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-62717220-3e4f-4f7e-9a8d-b25bbb7c1484 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:57.972515 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-62717220-3e4f-4f7e-9a8d-b25bbb7c1484 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:57.980406 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-62717220-3e4f-4f7e-9a8d-b25bbb7c1484 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:57.981316 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-62717220-3e4f-4f7e-9a8d-b25bbb7c1484 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:57.982151 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-62717220-3e4f-4f7e-9a8d-b25bbb7c1484 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:57.982766 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-62717220-3e4f-4f7e-9a8d-b25bbb7c1484 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:58.139199 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6db7ffbb-e7b8-4e2d-b7db-74095497efed tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:58.155318 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6db7ffbb-e7b8-4e2d-b7db-74095497efed tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.411907 Aug 04 17:02:58.159821 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2493/5083] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:57 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:58.174089 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e7ec36fb-3081-42de-8579-4e5702cf4e23 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:58.176767 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e7ec36fb-3081-42de-8579-4e5702cf4e23 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 179db84c-f006-46b9-85ad-ceea5c6a15ad] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:58.193110 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e7ec36fb-3081-42de-8579-4e5702cf4e23 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:58.196788 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e7ec36fb-3081-42de-8579-4e5702cf4e23 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:58.197884 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e7ec36fb-3081-42de-8579-4e5702cf4e23 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:58.201660 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e7ec36fb-3081-42de-8579-4e5702cf4e23 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:58.290488 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e7ec36fb-3081-42de-8579-4e5702cf4e23 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128729 Aug 04 17:02:58.300846 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2494/5084] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:02:58 2022] GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:58.312394 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9f798c9f-f272-4224-8bf1-fb3197720ec9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:58.316258 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9f798c9f-f272-4224-8bf1-fb3197720ec9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:58.319062 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-62717220-3e4f-4f7e-9a8d-b25bbb7c1484 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:58.328432 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-62717220-3e4f-4f7e-9a8d-b25bbb7c1484 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:58.330207 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-62717220-3e4f-4f7e-9a8d-b25bbb7c1484 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:58.330424 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f798c9f-f272-4224-8bf1-fb3197720ec9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:58.331090 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f798c9f-f272-4224-8bf1-fb3197720ec9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:58.332287 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f798c9f-f272-4224-8bf1-fb3197720ec9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:58.333110 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-62717220-3e4f-4f7e-9a8d-b25bbb7c1484 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1724 microversion: 2.20 time: 0.366381 Aug 04 17:02:58.334044 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2591/5085] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:57 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1724 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:02:58.334221 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f798c9f-f272-4224-8bf1-fb3197720ec9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:58.387446 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-9f798c9f-f272-4224-8bf1-fb3197720ec9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] HTTP exception thrown: Cannot 'unshelve' instance 7094f480-111a-4c4e-8a77-2df578c044c0 while it is in vm_state active Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9f798c9f-f272-4224-8bf1-fb3197720ec9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0/action HTTP/1.1 Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 18 Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: {"unshelve": null} Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: exception: Cannot 'unshelve' instance 7094f480-111a-4c4e-8a77-2df578c044c0 while it is in vm_state active Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '7094f480-111a-4c4e-8a77-2df578c044c0', 'body': {'unshelve': None}} Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7094f480-111a-4c4e-8a77-2df578c044c0 in vm_state active. Cannot unshelve while the instance is in this state. Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 17:02:58.389552 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 17:02:58.395723 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 7094f480-111a-4c4e-8a77-2df578c044c0 while it is in vm_state active Aug 04 17:02:58.395723 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:02:58.395723 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:58.395723 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:02:58.395723 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:58.395723 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:58.395723 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:58.395723 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:02:58.395723 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:02:58.395723 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 7094f480-111a-4c4e-8a77-2df578c044c0 while it is in vm_state active Aug 04 17:02:58.395723 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:02:58.395723 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9f798c9f-f272-4224-8bf1-fb3197720ec9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 409 to user: Cannot 'unshelve' instance 7094f480-111a-4c4e-8a77-2df578c044c0 while it is in vm_state active {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:02:58.395723 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9f798c9f-f272-4224-8bf1-fb3197720ec9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "POST /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0/action" status: 409 len: 146 microversion: 2.1 time: 0.090491 Aug 04 17:02:58.401414 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2495/5086] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:02:58 2022] POST /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0/action => generated 146 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:02:58.405743 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-581ecffa-f61b-4312-9578-c87400d0e5f2 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:58.406424 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-581ecffa-f61b-4312-9578-c87400d0e5f2 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:58.415126 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-581ecffa-f61b-4312-9578-c87400d0e5f2 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:58.415482 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-581ecffa-f61b-4312-9578-c87400d0e5f2 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:58.416215 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-581ecffa-f61b-4312-9578-c87400d0e5f2 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:58.416672 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-581ecffa-f61b-4312-9578-c87400d0e5f2 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:58.601733 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-928494d6-e5f5-484d-a8b8-6932dc96ea8e tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:58.602373 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-928494d6-e5f5-484d-a8b8-6932dc96ea8e tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] [instance: 0b68766c-714e-4e29-b5ff-5db6d4d1c459] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:58.616839 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-928494d6-e5f5-484d-a8b8-6932dc96ea8e tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:58.622704 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-928494d6-e5f5-484d-a8b8-6932dc96ea8e tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:58.623609 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-928494d6-e5f5-484d-a8b8-6932dc96ea8e tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:58.624058 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-928494d6-e5f5-484d-a8b8-6932dc96ea8e tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:58.724843 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-581ecffa-f61b-4312-9578-c87400d0e5f2 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:58.742776 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-581ecffa-f61b-4312-9578-c87400d0e5f2 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.341855 Aug 04 17:02:58.760563 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2592/5087] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:58 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:58.770554 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-397cfd0f-d2de-4cc2-9749-a666404d5316 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:58.771173 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-397cfd0f-d2de-4cc2-9749-a666404d5316 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:58.784029 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-397cfd0f-d2de-4cc2-9749-a666404d5316 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:58.786054 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-397cfd0f-d2de-4cc2-9749-a666404d5316 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:58.789631 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-397cfd0f-d2de-4cc2-9749-a666404d5316 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:58.790488 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-397cfd0f-d2de-4cc2-9749-a666404d5316 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:58.803893 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:59.469880 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-928494d6-e5f5-484d-a8b8-6932dc96ea8e tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:59.479027 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-928494d6-e5f5-484d-a8b8-6932dc96ea8e tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:59.480943 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-928494d6-e5f5-484d-a8b8-6932dc96ea8e tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:59.482393 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-928494d6-e5f5-484d-a8b8-6932dc96ea8e tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459" status: 200 len: 1362 microversion: 2.26 time: 0.886228 Aug 04 17:02:59.483191 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2496/5088] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:58 2022] GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459 => generated 1362 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:59.503170 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-553c755c-e54e-4b57-a6fc-4aab6f46a9de tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:59.506848 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-553c755c-e54e-4b57-a6fc-4aab6f46a9de tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 179db84c-f006-46b9-85ad-ceea5c6a15ad] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:59.514212 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-553c755c-e54e-4b57-a6fc-4aab6f46a9de tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:59.514643 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-553c755c-e54e-4b57-a6fc-4aab6f46a9de tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:59.515663 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-553c755c-e54e-4b57-a6fc-4aab6f46a9de tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:59.516366 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-553c755c-e54e-4b57-a6fc-4aab6f46a9de tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:59.553796 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-553c755c-e54e-4b57-a6fc-4aab6f46a9de tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054389 Aug 04 17:02:59.554951 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2497/5089] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:02:59 2022] GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:02:59.564401 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-577c6d05-66d4-403b-b6a3-c9758bbb257c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:59.565017 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-577c6d05-66d4-403b-b6a3-c9758bbb257c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:59.570003 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-397cfd0f-d2de-4cc2-9749-a666404d5316 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:59.584447 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-577c6d05-66d4-403b-b6a3-c9758bbb257c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:59.585164 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-577c6d05-66d4-403b-b6a3-c9758bbb257c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:59.587064 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-577c6d05-66d4-403b-b6a3-c9758bbb257c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:59.588591 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-577c6d05-66d4-403b-b6a3-c9758bbb257c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:59.591726 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-397cfd0f-d2de-4cc2-9749-a666404d5316 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.826130 Aug 04 17:02:59.622305 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2593/5090] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:58 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:02:59.642072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e1668c33-55b7-42bf-9210-53feb56892c8 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-156235511_updated"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:59.645065 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e1668c33-55b7-42bf-9210-53feb56892c8 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 3f43b553-62dc-4edd-9334-520e2cdac2d4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:59.661654 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-e1668c33-55b7-42bf-9210-53feb56892c8 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] HTTP exception thrown: Instance 3f43b553-62dc-4edd-9334-520e2cdac2d4 could not be found. Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e1668c33-55b7-42bf-9210-53feb56892c8 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: request: PUT /compute/v2.1/servers/3f43b553-62dc-4edd-9334-520e2cdac2d4 HTTP/1.1 Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 80 Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-156235511_updated"}} Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 3f43b553-62dc-4edd-9334-520e2cdac2d4 could not be found. Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '3f43b553-62dc-4edd-9334-520e2cdac2d4', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-156235511_updated'}}} Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f43b553-62dc-4edd-9334-520e2cdac2d4 could not be found. Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 04 17:02:59.671811 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:02:59.680347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:02:59.680347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:02:59.680347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:02:59.680347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f43b553-62dc-4edd-9334-520e2cdac2d4 could not be found. Aug 04 17:02:59.680347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:59.680347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:59.680347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:59.680347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:59.680347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:59.680347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:59.680347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:02:59.680347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:02:59.680347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f43b553-62dc-4edd-9334-520e2cdac2d4 could not be found. Aug 04 17:02:59.680347 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:02:59.680347 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e1668c33-55b7-42bf-9210-53feb56892c8 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 404 to user: Instance 3f43b553-62dc-4edd-9334-520e2cdac2d4 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:02:59.680347 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e1668c33-55b7-42bf-9210-53feb56892c8 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "PUT /compute/v2.1/servers/3f43b553-62dc-4edd-9334-520e2cdac2d4" status: 404 len: 111 microversion: 2.1 time: 0.041896 Aug 04 17:02:59.680347 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2594/5091] 10.222.0.23 () {60 vars in 1256 bytes} [Thu Aug 4 17:02:59 2022] PUT /compute/v2.1/servers/3f43b553-62dc-4edd-9334-520e2cdac2d4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:02:59.691015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b0ae7ede-fa54-472d-8bc7-7822f6859b54 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:59.692342 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b0ae7ede-fa54-472d-8bc7-7822f6859b54 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:59.709614 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0ae7ede-fa54-472d-8bc7-7822f6859b54 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:59.710179 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0ae7ede-fa54-472d-8bc7-7822f6859b54 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:02:59.710963 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0ae7ede-fa54-472d-8bc7-7822f6859b54 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:02:59.711453 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0ae7ede-fa54-472d-8bc7-7822f6859b54 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:00.105951 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-577c6d05-66d4-403b-b6a3-c9758bbb257c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:00.139634 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-577c6d05-66d4-403b-b6a3-c9758bbb257c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:00.140874 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b0ae7ede-fa54-472d-8bc7-7822f6859b54 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:00.142027 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-577c6d05-66d4-403b-b6a3-c9758bbb257c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:00.146841 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-577c6d05-66d4-403b-b6a3-c9758bbb257c tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1724 microversion: 2.20 time: 0.584551 Aug 04 17:03:00.160478 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2498/5092] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:59 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1724 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:00.163977 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b0ae7ede-fa54-472d-8bc7-7822f6859b54 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.479665 Aug 04 17:03:00.165749 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2595/5093] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:59 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:00.198757 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c8c767f0-87b3-4e35-84d6-a32a98139a98 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:00.198921 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7725294b-bede-4995-afd9-7273c50a87d6 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:00.199038 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c8c767f0-87b3-4e35-84d6-a32a98139a98 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:00.199161 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7725294b-bede-4995-afd9-7273c50a87d6 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 179db84c-f006-46b9-85ad-ceea5c6a15ad] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:00.199284 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c8c767f0-87b3-4e35-84d6-a32a98139a98 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:00.199284 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c8c767f0-87b3-4e35-84d6-a32a98139a98 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:00.199284 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c8c767f0-87b3-4e35-84d6-a32a98139a98 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:00.199284 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c8c767f0-87b3-4e35-84d6-a32a98139a98 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:00.203719 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7725294b-bede-4995-afd9-7273c50a87d6 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:00.206125 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7725294b-bede-4995-afd9-7273c50a87d6 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:00.207891 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7725294b-bede-4995-afd9-7273c50a87d6 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:00.211456 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7725294b-bede-4995-afd9-7273c50a87d6 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:00.259841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=100 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:03:00.272645 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7725294b-bede-4995-afd9-7273c50a87d6 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 179db84c-f006-46b9-85ad-ceea5c6a15ad] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:03:00.486913 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7725294b-bede-4995-afd9-7273c50a87d6 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "DELETE /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad" status: 204 len: 0 microversion: 2.1 time: 0.322769 Aug 04 17:03:00.487953 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2499/5094] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:03:00 2022] DELETE /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:03:00.511659 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dbc9db56-7b17-4b63-abab-b2eb6bec7ea9 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:00.512740 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-dbc9db56-7b17-4b63-abab-b2eb6bec7ea9 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 179db84c-f006-46b9-85ad-ceea5c6a15ad] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:00.544119 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dbc9db56-7b17-4b63-abab-b2eb6bec7ea9 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:00.544969 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dbc9db56-7b17-4b63-abab-b2eb6bec7ea9 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:00.545971 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dbc9db56-7b17-4b63-abab-b2eb6bec7ea9 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:00.546597 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dbc9db56-7b17-4b63-abab-b2eb6bec7ea9 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:00.649602 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c8c767f0-87b3-4e35-84d6-a32a98139a98 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:00.660767 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c8c767f0-87b3-4e35-84d6-a32a98139a98 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.478068 Aug 04 17:03:00.661573 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2596/5095] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:00 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:03:00.679133 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7517c075-f0d3-48ff-a435-d2a6adc9934f tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:00.680129 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7517c075-f0d3-48ff-a435-d2a6adc9934f tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] [instance: 0b68766c-714e-4e29-b5ff-5db6d4d1c459] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:00.692015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7517c075-f0d3-48ff-a435-d2a6adc9934f tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:00.692842 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7517c075-f0d3-48ff-a435-d2a6adc9934f tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:00.693889 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7517c075-f0d3-48ff-a435-d2a6adc9934f tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:00.702211 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7517c075-f0d3-48ff-a435-d2a6adc9934f tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:01.025962 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-dbc9db56-7b17-4b63-abab-b2eb6bec7ea9 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:01.039943 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dbc9db56-7b17-4b63-abab-b2eb6bec7ea9 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad" status: 200 len: 1681 microversion: 2.1 time: 0.542753 Aug 04 17:03:01.042392 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2500/5096] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:00 2022] GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad => generated 1681 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:01.057834 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f5ae1d4b-2852-48bd-a9b6-b2f044f834e3 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f5ae1d4b-2852-48bd-a9b6-b2f044f834e3 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: request: PUT /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 HTTP/1.1 Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 280 Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '7094f480-111a-4c4e-8a77-2df578c044c0', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:01.064137 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:01.070053 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:01.070053 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:01.070053 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:01.070053 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:01.070053 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:01.070053 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:01.070053 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:03:01.070053 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:03:01.070053 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:03:01.070053 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:03:01.070053 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:03:01.070053 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:03:01.070053 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:03:01.070053 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:03:01.070053 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 17:03:01.070053 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:01.070053 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:01.070053 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:01.070053 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:01.070053 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:01.070053 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:01.070053 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:03:01.070053 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:03:01.070053 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 17:03:01.070053 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:01.070053 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f5ae1d4b-2852-48bd-a9b6-b2f044f834e3 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:01.070053 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f5ae1d4b-2852-48bd-a9b6-b2f044f834e3 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "PUT /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 400 len: 619 microversion: 2.1 time: 0.023450 Aug 04 17:03:01.073329 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2501/5097] 10.222.0.23 () {60 vars in 1257 bytes} [Thu Aug 4 17:03:01 2022] PUT /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 619 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:03:01.075653 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7517c075-f0d3-48ff-a435-d2a6adc9934f tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:01.089713 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7517c075-f0d3-48ff-a435-d2a6adc9934f tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:01.092647 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7517c075-f0d3-48ff-a435-d2a6adc9934f tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:01.096853 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7517c075-f0d3-48ff-a435-d2a6adc9934f tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459" status: 200 len: 1362 microversion: 2.26 time: 0.433484 Aug 04 17:03:01.100143 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2597/5098] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:00 2022] GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459 => generated 1362 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:01.128401 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-56c7ecb9-f7a6-44e5-bacf-2f4ab703d2f9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:01.129252 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-56c7ecb9-f7a6-44e5-bacf-2f4ab703d2f9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:01.152625 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-56c7ecb9-f7a6-44e5-bacf-2f4ab703d2f9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:01.153323 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-56c7ecb9-f7a6-44e5-bacf-2f4ab703d2f9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:01.154366 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-56c7ecb9-f7a6-44e5-bacf-2f4ab703d2f9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:01.155010 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-56c7ecb9-f7a6-44e5-bacf-2f4ab703d2f9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:01.187631 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c2558972-a6b2-4295-bfd1-78ee2c721c79 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:01.188647 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c2558972-a6b2-4295-bfd1-78ee2c721c79 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:01.200583 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2558972-a6b2-4295-bfd1-78ee2c721c79 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:01.201462 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2558972-a6b2-4295-bfd1-78ee2c721c79 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:01.202535 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2558972-a6b2-4295-bfd1-78ee2c721c79 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:01.203211 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2558972-a6b2-4295-bfd1-78ee2c721c79 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:01.496541 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c2558972-a6b2-4295-bfd1-78ee2c721c79 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:01.510525 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c2558972-a6b2-4295-bfd1-78ee2c721c79 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:01.512526 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c2558972-a6b2-4295-bfd1-78ee2c721c79 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:01.515192 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c2558972-a6b2-4295-bfd1-78ee2c721c79 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1724 microversion: 2.20 time: 0.334975 Aug 04 17:03:01.515787 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2598/5099] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:01 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1724 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:01.590364 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-56c7ecb9-f7a6-44e5-bacf-2f4ab703d2f9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:01.623966 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-56c7ecb9-f7a6-44e5-bacf-2f4ab703d2f9 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.546643 Aug 04 17:03:01.631125 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2502/5100] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:01 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:01.662803 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ee6c9664-0249-4550-bc6f-ed945f4c5add tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:01.664318 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ee6c9664-0249-4550-bc6f-ed945f4c5add tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:01.672619 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ee6c9664-0249-4550-bc6f-ed945f4c5add tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:01.673584 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ee6c9664-0249-4550-bc6f-ed945f4c5add tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:01.674608 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ee6c9664-0249-4550-bc6f-ed945f4c5add tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:01.675549 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ee6c9664-0249-4550-bc6f-ed945f4c5add tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:01.921051 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ee6c9664-0249-4550-bc6f-ed945f4c5add tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:01.930942 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ee6c9664-0249-4550-bc6f-ed945f4c5add tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 0.281557 Aug 04 17:03:01.931695 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2599/5101] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:01 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:01.952218 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f7b7e283-f65b-41a0-b55c-a94a6bea7343 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f7b7e283-f65b-41a0-b55c-a94a6bea7343 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: request: PUT /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 HTTP/1.1 Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 24 Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: {"server": {"name": ""}} Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '7094f480-111a-4c4e-8a77-2df578c044c0', 'body': {'server': {'name': ''}}} Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi '' Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:03:01.956712 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 04 17:03:01.962443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:01.962443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:01.962443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:01.962443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:01.962443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:01.962443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:01.962443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:03:01.962443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:03:01.962443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 04 17:03:01.962443 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:01.964249 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f7b7e283-f65b-41a0-b55c-a94a6bea7343 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:01.965272 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f7b7e283-f65b-41a0-b55c-a94a6bea7343 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "PUT /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 400 len: 108 microversion: 2.1 time: 0.017518 Aug 04 17:03:01.972163 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2503/5102] 10.222.0.23 () {60 vars in 1256 bytes} [Thu Aug 4 17:03:01 2022] PUT /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 108 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:03:01.977803 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-69687cb6-e7fc-4d51-9c6a-e2f22edcbd8e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:01.978766 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-69687cb6-e7fc-4d51-9c6a-e2f22edcbd8e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:01.987896 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-69687cb6-e7fc-4d51-9c6a-e2f22edcbd8e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:01.991157 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-69687cb6-e7fc-4d51-9c6a-e2f22edcbd8e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:01.992339 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-69687cb6-e7fc-4d51-9c6a-e2f22edcbd8e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:01.993562 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-69687cb6-e7fc-4d51-9c6a-e2f22edcbd8e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:02.067264 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3180ad56-feff-4914-910a-679541667c17 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:02.067885 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3180ad56-feff-4914-910a-679541667c17 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 179db84c-f006-46b9-85ad-ceea5c6a15ad] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:02.082037 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3180ad56-feff-4914-910a-679541667c17 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:02.082488 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3180ad56-feff-4914-910a-679541667c17 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:02.088180 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3180ad56-feff-4914-910a-679541667c17 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:02.091349 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3180ad56-feff-4914-910a-679541667c17 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:03.011245 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3180ad56-feff-4914-910a-679541667c17 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:03.023147 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3180ad56-feff-4914-910a-679541667c17 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad" status: 200 len: 1681 microversion: 2.1 time: 0.961154 Aug 04 17:03:03.024095 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2504/5103] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:02 2022] GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad => generated 1681 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:03.030653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ae0bbd8b-eb0a-435d-bc35-cebe2763e20c tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:03.031720 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ae0bbd8b-eb0a-435d-bc35-cebe2763e20c tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] [instance: 0b68766c-714e-4e29-b5ff-5db6d4d1c459] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:03.048445 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ae0bbd8b-eb0a-435d-bc35-cebe2763e20c tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:03.048954 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ae0bbd8b-eb0a-435d-bc35-cebe2763e20c tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:03.050857 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ae0bbd8b-eb0a-435d-bc35-cebe2763e20c tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:03.051479 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ae0bbd8b-eb0a-435d-bc35-cebe2763e20c tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:03.112184 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-69687cb6-e7fc-4d51-9c6a-e2f22edcbd8e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:03.124682 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-69687cb6-e7fc-4d51-9c6a-e2f22edcbd8e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1506 microversion: 2.1 time: 1.151437 Aug 04 17:03:03.126503 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2600/5104] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:01 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1506 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:03:03.135196 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e6d94957-5f8a-4d3b-9af1-48b10030d34d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:03.136862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e6d94957-5f8a-4d3b-9af1-48b10030d34d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:03.145489 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e6d94957-5f8a-4d3b-9af1-48b10030d34d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:03.146256 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e6d94957-5f8a-4d3b-9af1-48b10030d34d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:03.147260 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e6d94957-5f8a-4d3b-9af1-48b10030d34d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:03.148529 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e6d94957-5f8a-4d3b-9af1-48b10030d34d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:03.474206 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ae0bbd8b-eb0a-435d-bc35-cebe2763e20c tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:03.485571 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ae0bbd8b-eb0a-435d-bc35-cebe2763e20c tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:03.490155 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ae0bbd8b-eb0a-435d-bc35-cebe2763e20c tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:03.493625 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ae0bbd8b-eb0a-435d-bc35-cebe2763e20c tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459" status: 200 len: 1362 microversion: 2.26 time: 0.468441 Aug 04 17:03:03.497969 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2505/5105] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:03 2022] GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459 => generated 1362 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:03.510738 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-bcf99026-9c4d-4dbd-9585-07cf79448ea2 req-f471b9e5-a001-43c9-9b96-1b87aadbd8ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b68766c-714e-4e29-b5ff-5db6d4d1c459", "name": "network-vif-plugged", "status": "completed", "tag": "4217d3e4-70c7-4ce9-9180-5e391b9ff59f"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:03.525934 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-bcf99026-9c4d-4dbd-9585-07cf79448ea2 req-f471b9e5-a001-43c9-9b96-1b87aadbd8ff service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:03.526766 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-bcf99026-9c4d-4dbd-9585-07cf79448ea2 req-f471b9e5-a001-43c9-9b96-1b87aadbd8ff service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:03.545251 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-bcf99026-9c4d-4dbd-9585-07cf79448ea2 req-f471b9e5-a001-43c9-9b96-1b87aadbd8ff service nova] Creating event network-vif-plugged:4217d3e4-70c7-4ce9-9180-5e391b9ff59f for instance 0b68766c-714e-4e29-b5ff-5db6d4d1c459 on n-h1-846466-12 Aug 04 17:03:03.558442 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-bcf99026-9c4d-4dbd-9585-07cf79448ea2 req-f471b9e5-a001-43c9-9b96-1b87aadbd8ff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055138 Aug 04 17:03:03.559945 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2506/5106] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:03.571119 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-720cf6e1-e795-445b-a23d-a583c294acbc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1499286130", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "e7aca9d1-8bf4-46c2-a464-6f56e4c71706", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "8cd64b36-f8a8-48d4-b083-6164d20009da"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:03.778281 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-720cf6e1-e795-445b-a23d-a583c294acbc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] validate_networks() for [('8cd64b36-f8a8-48d4-b083-6164d20009da', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:03:04.176053 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e6d94957-5f8a-4d3b-9af1-48b10030d34d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:04.191382 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e6d94957-5f8a-4d3b-9af1-48b10030d34d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:04.213479 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e6d94957-5f8a-4d3b-9af1-48b10030d34d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:04.218304 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e6d94957-5f8a-4d3b-9af1-48b10030d34d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1745 microversion: 2.20 time: 1.090547 Aug 04 17:03:04.218963 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2601/5107] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:03 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1745 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:04.224843 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-652fab8c-2749-4d6a-8d11-09456b565139 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:04.226308 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-652fab8c-2749-4d6a-8d11-09456b565139 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 179db84c-f006-46b9-85ad-ceea5c6a15ad] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:04.235560 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-652fab8c-2749-4d6a-8d11-09456b565139 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:04.236323 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-652fab8c-2749-4d6a-8d11-09456b565139 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:04.237126 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-652fab8c-2749-4d6a-8d11-09456b565139 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:04.237742 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-652fab8c-2749-4d6a-8d11-09456b565139 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:04.881003 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-652fab8c-2749-4d6a-8d11-09456b565139 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:04.907378 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-652fab8c-2749-4d6a-8d11-09456b565139 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad" status: 200 len: 1681 microversion: 2.1 time: 0.687011 Aug 04 17:03:04.921611 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2602/5108] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:04 2022] GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad => generated 1681 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:04.927649 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d267dbed-4756-4a4e-ab29-1bf2f1400ef2 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:04.928574 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d267dbed-4756-4a4e-ab29-1bf2f1400ef2 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] [instance: 0b68766c-714e-4e29-b5ff-5db6d4d1c459] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:04.934486 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:03:04.936823 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d267dbed-4756-4a4e-ab29-1bf2f1400ef2 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:04.937215 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d267dbed-4756-4a4e-ab29-1bf2f1400ef2 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:04.938255 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d267dbed-4756-4a4e-ab29-1bf2f1400ef2 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:04.938915 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d267dbed-4756-4a4e-ab29-1bf2f1400ef2 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:05.556790 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-720cf6e1-e795-445b-a23d-a583c294acbc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:03:05.557530 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-720cf6e1-e795-445b-a23d-a583c294acbc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:03:05.558332 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-720cf6e1-e795-445b-a23d-a583c294acbc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:03:05.558756 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-720cf6e1-e795-445b-a23d-a583c294acbc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:03:05.559219 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-720cf6e1-e795-445b-a23d-a583c294acbc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:03:05.617368 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-720cf6e1-e795-445b-a23d-a583c294acbc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:05.617819 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-720cf6e1-e795-445b-a23d-a583c294acbc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:05.644020 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-720cf6e1-e795-445b-a23d-a583c294acbc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:05.644583 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-720cf6e1-e795-445b-a23d-a583c294acbc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:05.649959 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d267dbed-4756-4a4e-ab29-1bf2f1400ef2 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:05.659235 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d267dbed-4756-4a4e-ab29-1bf2f1400ef2 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:05.661243 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d267dbed-4756-4a4e-ab29-1bf2f1400ef2 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:05.662466 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d267dbed-4756-4a4e-ab29-1bf2f1400ef2 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459" status: 200 len: 1362 microversion: 2.26 time: 0.739781 Aug 04 17:03:05.663044 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2603/5109] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:04 2022] GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459 => generated 1362 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:05.681205 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b9ef45c5-e243-423c-a9f2-c96b3e78c1f0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:05.682164 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b9ef45c5-e243-423c-a9f2-c96b3e78c1f0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:05.697783 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b9ef45c5-e243-423c-a9f2-c96b3e78c1f0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:05.698494 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b9ef45c5-e243-423c-a9f2-c96b3e78c1f0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:05.699471 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b9ef45c5-e243-423c-a9f2-c96b3e78c1f0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:05.700085 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b9ef45c5-e243-423c-a9f2-c96b3e78c1f0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:05.788847 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-720cf6e1-e795-445b-a23d-a583c294acbc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Getting quotas for project 78a0adb69ba24749817a8855effc20ad. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:03:05.815693 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-720cf6e1-e795-445b-a23d-a583c294acbc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Getting quotas for user ea9cab1c1eff47ddb881a2b57bf240f3 and project 78a0adb69ba24749817a8855effc20ad. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:03:05.894926 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-720cf6e1-e795-445b-a23d-a583c294acbc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:03:05.912131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-720cf6e1-e795-445b-a23d-a583c294acbc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='e7aca9d1-8bf4-46c2-a464-6f56e4c71706',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:03:06.133448 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-720cf6e1-e795-445b-a23d-a583c294acbc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.570621 Aug 04 17:03:06.136706 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2507/5110] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:03:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:03:06.153577 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0cea556b-f0ab-4ca1-96c1-fe64b48ae9ca tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:06.155929 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0cea556b-f0ab-4ca1-96c1-fe64b48ae9ca tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 179db84c-f006-46b9-85ad-ceea5c6a15ad] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:06.183488 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:03:06.211166 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0cea556b-f0ab-4ca1-96c1-fe64b48ae9ca tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:06.223320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0cea556b-f0ab-4ca1-96c1-fe64b48ae9ca tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:06.229010 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0cea556b-f0ab-4ca1-96c1-fe64b48ae9ca tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:06.229656 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0cea556b-f0ab-4ca1-96c1-fe64b48ae9ca tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:06.296736 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b9ef45c5-e243-423c-a9f2-c96b3e78c1f0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:06.316960 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b9ef45c5-e243-423c-a9f2-c96b3e78c1f0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:06.326073 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b9ef45c5-e243-423c-a9f2-c96b3e78c1f0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:06.332785 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b9ef45c5-e243-423c-a9f2-c96b3e78c1f0 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1740 microversion: 2.20 time: 0.655015 Aug 04 17:03:06.338154 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2604/5111] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:05 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1740 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:06.360813 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0cd1ad62-7b2c-479f-a13b-13bdc1302a8f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:06.363867 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0cd1ad62-7b2c-479f-a13b-13bdc1302a8f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:06.466990 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0cea556b-f0ab-4ca1-96c1-fe64b48ae9ca tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f4a672b154291a412a282d1a88208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2534921e8a2f47d394059fee872426a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:06.474986 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0cea556b-f0ab-4ca1-96c1-fe64b48ae9ca tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad" status: 200 len: 1613 microversion: 2.1 time: 0.334523 Aug 04 17:03:06.475593 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2508/5112] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:06 2022] GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad => generated 1613 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:06.502470 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0cd1ad62-7b2c-479f-a13b-13bdc1302a8f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:06.517863 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0cd1ad62-7b2c-479f-a13b-13bdc1302a8f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1057 microversion: 2.1 time: 0.178522 Aug 04 17:03:06.521230 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2605/5113] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:06 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1057 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:06.692490 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7a72ac2f-7939-435e-b881-2a3e2d5cd012 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:06.693157 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7a72ac2f-7939-435e-b881-2a3e2d5cd012 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] [instance: 0b68766c-714e-4e29-b5ff-5db6d4d1c459] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:06.704677 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7a72ac2f-7939-435e-b881-2a3e2d5cd012 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:06.717368 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7a72ac2f-7939-435e-b881-2a3e2d5cd012 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:06.718385 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7a72ac2f-7939-435e-b881-2a3e2d5cd012 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:06.718839 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7a72ac2f-7939-435e-b881-2a3e2d5cd012 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:06.779183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-579e4d9b-63cb-4a7f-ba1c-5f515b6301fa req-90934864-6f67-4928-bfc9-bab4390f4e36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179db84c-f006-46b9-85ad-ceea5c6a15ad", "name": "network-vif-deleted", "tag": "9a092a19-0d2c-44cd-bd13-eda962c60553"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:06.840416 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-579e4d9b-63cb-4a7f-ba1c-5f515b6301fa req-90934864-6f67-4928-bfc9-bab4390f4e36 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:06.841378 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-579e4d9b-63cb-4a7f-ba1c-5f515b6301fa req-90934864-6f67-4928-bfc9-bab4390f4e36 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:06.928162 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-579e4d9b-63cb-4a7f-ba1c-5f515b6301fa req-90934864-6f67-4928-bfc9-bab4390f4e36 service nova] Creating event network-vif-deleted:9a092a19-0d2c-44cd-bd13-eda962c60553 for instance 179db84c-f006-46b9-85ad-ceea5c6a15ad on n-h1-846466-12 Aug 04 17:03:06.953027 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-579e4d9b-63cb-4a7f-ba1c-5f515b6301fa req-90934864-6f67-4928-bfc9-bab4390f4e36 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178922 Aug 04 17:03:06.960458 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2606/5114] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:03:07.291466 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7a72ac2f-7939-435e-b881-2a3e2d5cd012 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:07.307867 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7a72ac2f-7939-435e-b881-2a3e2d5cd012 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:07.311945 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7a72ac2f-7939-435e-b881-2a3e2d5cd012 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:07.317208 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7a72ac2f-7939-435e-b881-2a3e2d5cd012 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459" status: 200 len: 1545 microversion: 2.26 time: 0.630069 Aug 04 17:03:07.324033 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2509/5115] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:06 2022] GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459 => generated 1545 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:07.356228 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d401f560-8b7a-41dc-880e-8271eac62893 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Calling method '.version_select at 0x7f7e77d395e0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:07.371911 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9efc4d4b-f597-423e-a9be-c993c4cc272b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:07.373081 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9efc4d4b-f597-423e-a9be-c993c4cc272b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:07.387537 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9efc4d4b-f597-423e-a9be-c993c4cc272b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:07.422799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d401f560-8b7a-41dc-880e-8271eac62893 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:07.423247 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d401f560-8b7a-41dc-880e-8271eac62893 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:07.423715 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9efc4d4b-f597-423e-a9be-c993c4cc272b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:07.423891 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d401f560-8b7a-41dc-880e-8271eac62893 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] [instance: 0b68766c-714e-4e29-b5ff-5db6d4d1c459] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:07.427216 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9efc4d4b-f597-423e-a9be-c993c4cc272b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:07.428144 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9efc4d4b-f597-423e-a9be-c993c4cc272b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:07.476631 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d401f560-8b7a-41dc-880e-8271eac62893 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:07.477104 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d401f560-8b7a-41dc-880e-8271eac62893 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:07.489603 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d401f560-8b7a-41dc-880e-8271eac62893 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:07.494639 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d401f560-8b7a-41dc-880e-8271eac62893 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:07.628049 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d401f560-8b7a-41dc-880e-8271eac62893 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:07.639461 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d401f560-8b7a-41dc-880e-8271eac62893 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:07.706905 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d401f560-8b7a-41dc-880e-8271eac62893 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:07.707265 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d401f560-8b7a-41dc-880e-8271eac62893 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:07.819731 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-d401f560-8b7a-41dc-880e-8271eac62893 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lazy-loading 'flavor' on Instance uuid 0b68766c-714e-4e29-b5ff-5db6d4d1c459 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:03:07.889720 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d401f560-8b7a-41dc-880e-8271eac62893 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "PUT /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags/tempest-tag-1657139014" status: 201 len: 0 microversion: 2.26 time: 0.534788 Aug 04 17:03:07.895394 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2607/5116] 10.222.0.23 () {62 vars in 1380 bytes} [Thu Aug 4 17:03:07 2022] PUT /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags/tempest-tag-1657139014 => generated 0 bytes in 546 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 04 17:03:07.902515 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6a84b973-3913-4ab2-9daa-5b6b8856f275 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:07.903143 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6a84b973-3913-4ab2-9daa-5b6b8856f275 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 179db84c-f006-46b9-85ad-ceea5c6a15ad] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:07.931150 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a84b973-3913-4ab2-9daa-5b6b8856f275 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:07.931621 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a84b973-3913-4ab2-9daa-5b6b8856f275 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:07.932441 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a84b973-3913-4ab2-9daa-5b6b8856f275 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:07.932866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a84b973-3913-4ab2-9daa-5b6b8856f275 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:07.955744 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9efc4d4b-f597-423e-a9be-c993c4cc272b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:07.972017 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9efc4d4b-f597-423e-a9be-c993c4cc272b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:07.977627 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9efc4d4b-f597-423e-a9be-c993c4cc272b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:07.988354 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-6a84b973-3913-4ab2-9daa-5b6b8856f275 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] HTTP exception thrown: Instance 179db84c-f006-46b9-85ad-ceea5c6a15ad could not be found. Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6a84b973-3913-4ab2-9daa-5b6b8856f275 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Request method failure captured: Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad HTTP/1.1 Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_owNKx0pHV40nqVD-WIcaXEsXOBwQHOEMAVVk2fno070nDFXZRZhhzMgTy8HlVP1AOBt469MYWC_AbeQLbAvgivtdjrTsmGymGu6AtGEk3CEKRMIDLRIpky1rxw9eTh6mgckU3tnNoFbB2in__O_4k2BxkTMZllLYaubH7EDDeTWL4 Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 2534921e8a2f47d394059fee872426a8 Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-AttachVolumeNegativeTest-410766221 Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2534921e8a2f47d394059fee872426a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2534921e8a2f47d394059fee872426a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2534921e8a2f47d394059fee872426a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2534921e8a2f47d394059fee872426a8"}]}] Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-AttachVolumeNegativeTest-410766221 Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 2534921e8a2f47d394059fee872426a8 Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-410766221 Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-AttachVolumeNegativeTest-410766221-project Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: d82f4a672b154291a412a282d1a88208 Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-AttachVolumeNegativeTest-410766221-project Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 179db84c-f006-46b9-85ad-ceea5c6a15ad could not be found. Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '179db84c-f006-46b9-85ad-ceea5c6a15ad'} Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 179db84c-f006-46b9-85ad-ceea5c6a15ad could not be found. Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 179db84c-f006-46b9-85ad-ceea5c6a15ad could not be found. Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:07.990166 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:07.996125 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:07.996125 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:07.996125 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:07.996125 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:03:07.996125 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:03:07.996125 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 179db84c-f006-46b9-85ad-ceea5c6a15ad could not be found. Aug 04 17:03:07.996125 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:07.996774 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9efc4d4b-f597-423e-a9be-c993c4cc272b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1740 microversion: 2.20 time: 0.621217 Aug 04 17:03:07.997758 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6a84b973-3913-4ab2-9daa-5b6b8856f275 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Returning 404 to user: Instance 179db84c-f006-46b9-85ad-ceea5c6a15ad could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:07.998965 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6a84b973-3913-4ab2-9daa-5b6b8856f275 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad" status: 404 len: 111 microversion: 2.1 time: 0.102545 Aug 04 17:03:07.999726 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2608/5117] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:07 2022] GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:03:08.024270 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7e3eb8fb-75ff-40cc-9e3b-fc7c9a9765ad tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:08.026478 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7e3eb8fb-75ff-40cc-9e3b-fc7c9a9765ad tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:08.037378 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2510/5118] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:07 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1740 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:08.071242 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f1e879fb-f118-4f5c-9ee7-ab592bd5d7ac tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Calling method '.version_select at 0x7f7e84135820>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:08.142081 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f1e879fb-f118-4f5c-9ee7-ab592bd5d7ac tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:08.142719 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f1e879fb-f118-4f5c-9ee7-ab592bd5d7ac tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:08.266836 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7e3eb8fb-75ff-40cc-9e3b-fc7c9a9765ad tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:08.270186 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f1e879fb-f118-4f5c-9ee7-ab592bd5d7ac tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags/tempest-tag-1657139014" status: 204 len: 0 microversion: 2.26 time: 0.226591 Aug 04 17:03:08.274618 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7e3eb8fb-75ff-40cc-9e3b-fc7c9a9765ad tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1057 microversion: 2.1 time: 0.264079 Aug 04 17:03:08.275145 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2511/5119] 10.222.0.23 () {60 vars in 1361 bytes} [Thu Aug 4 17:03:08 2022] GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags/tempest-tag-1657139014 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 17:03:08.295875 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2609/5120] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:08 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1057 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:08.308367 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cc63fa9b-24d9-412d-8da5-d54d9ee3dad8 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '.version_select at 0x7f7e84135160>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:08.310354 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e99e1a48-888d-43ab-a900-327aff84a60c tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Calling method '.version_select at 0x7f7e89cc9550>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:08.323646 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e99e1a48-888d-43ab-a900-327aff84a60c tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:08.324321 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e99e1a48-888d-43ab-a900-327aff84a60c tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:08.326566 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e99e1a48-888d-43ab-a900-327aff84a60c tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] [instance: 0b68766c-714e-4e29-b5ff-5db6d4d1c459] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:08.335465 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e99e1a48-888d-43ab-a900-327aff84a60c tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:08.344757 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e99e1a48-888d-43ab-a900-327aff84a60c tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:08.349975 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e99e1a48-888d-43ab-a900-327aff84a60c tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:08.350686 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e99e1a48-888d-43ab-a900-327aff84a60c tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:08.426502 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cc63fa9b-24d9-412d-8da5-d54d9ee3dad8 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1023430209" status: 202 len: 0 microversion: 2.1 time: 0.146300 Aug 04 17:03:08.435838 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2512/5121] 10.222.0.23 () {58 vars in 1221 bytes} [Thu Aug 4 17:03:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1023430209 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:03:08.445269 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e99e1a48-888d-43ab-a900-327aff84a60c tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:08.446207 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e99e1a48-888d-43ab-a900-327aff84a60c tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:08.471552 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-e99e1a48-888d-43ab-a900-327aff84a60c tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lazy-loading 'flavor' on Instance uuid 0b68766c-714e-4e29-b5ff-5db6d4d1c459 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:03:08.506640 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e99e1a48-888d-43ab-a900-327aff84a60c tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags" status: 204 len: 0 microversion: 2.26 time: 0.209019 Aug 04 17:03:08.513123 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2610/5122] 10.222.0.23 () {60 vars in 1295 bytes} [Thu Aug 4 17:03:08 2022] DELETE /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 17:03:08.523584 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-76321fcf-90e4-4292-9722-663145c306f9 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Calling method '.version_select at 0x7f7e776abd30>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:08.542525 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-76321fcf-90e4-4292-9722-663145c306f9 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:08.543932 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-76321fcf-90e4-4292-9722-663145c306f9 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:08.586044 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-76321fcf-90e4-4292-9722-663145c306f9 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags" status: 200 len: 12 microversion: 2.26 time: 0.066524 Aug 04 17:03:08.586666 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2513/5123] 10.222.0.23 () {60 vars in 1292 bytes} [Thu Aug 4 17:03:08 2022] GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags => generated 12 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:03:08.600152 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2dbf2f11-824f-46c9-883b-63d7f87b8da6 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Calling method '.version_select at 0x7f7e77ff7d30>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:08.621360 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2dbf2f11-824f-46c9-883b-63d7f87b8da6 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:08.626195 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2dbf2f11-824f-46c9-883b-63d7f87b8da6 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:08.630891 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2dbf2f11-824f-46c9-883b-63d7f87b8da6 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] [instance: 0b68766c-714e-4e29-b5ff-5db6d4d1c459] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:08.648093 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2dbf2f11-824f-46c9-883b-63d7f87b8da6 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:08.650949 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2dbf2f11-824f-46c9-883b-63d7f87b8da6 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:08.655074 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2dbf2f11-824f-46c9-883b-63d7f87b8da6 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:08.657208 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2dbf2f11-824f-46c9-883b-63d7f87b8da6 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:08.698892 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2dbf2f11-824f-46c9-883b-63d7f87b8da6 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:08.699543 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2dbf2f11-824f-46c9-883b-63d7f87b8da6 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:08.711464 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:03:08.714365 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2dbf2f11-824f-46c9-883b-63d7f87b8da6 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:08.715255 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2dbf2f11-824f-46c9-883b-63d7f87b8da6 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:08.787783 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-2dbf2f11-824f-46c9-883b-63d7f87b8da6 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lazy-loading 'flavor' on Instance uuid 0b68766c-714e-4e29-b5ff-5db6d4d1c459 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:03:08.834535 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2dbf2f11-824f-46c9-883b-63d7f87b8da6 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "PUT /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags/tempest-tag-191615744" status: 201 len: 0 microversion: 2.26 time: 0.240183 Aug 04 17:03:08.843151 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2611/5124] 10.222.0.23 () {62 vars in 1377 bytes} [Thu Aug 4 17:03:08 2022] PUT /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags/tempest-tag-191615744 => generated 0 bytes in 250 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 04 17:03:08.852339 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d9ea23bd-2217-465d-8632-703c4f3286e3 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Calling method '.version_select at 0x7f7e776a48b0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:08.908958 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d9ea23bd-2217-465d-8632-703c4f3286e3 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:08.909638 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d9ea23bd-2217-465d-8632-703c4f3286e3 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:08.960480 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d9ea23bd-2217-465d-8632-703c4f3286e3 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags" status: 200 len: 35 microversion: 2.26 time: 0.114686 Aug 04 17:03:08.963751 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2514/5125] 10.222.0.23 () {60 vars in 1292 bytes} [Thu Aug 4 17:03:08 2022] GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags => generated 35 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:03:08.973057 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6bf3cecd-cb3c-426d-9689-b6b34c72f704 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Calling method '.version_select at 0x7f7e77ff7af0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:08.985096 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6bf3cecd-cb3c-426d-9689-b6b34c72f704 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:08.998524 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6bf3cecd-cb3c-426d-9689-b6b34c72f704 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:09.003785 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6bf3cecd-cb3c-426d-9689-b6b34c72f704 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] [instance: 0b68766c-714e-4e29-b5ff-5db6d4d1c459] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:09.018874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5ef98735-401b-4749-b5ee-2276c31564b1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:09.019864 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5ef98735-401b-4749-b5ee-2276c31564b1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:09.034466 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ef98735-401b-4749-b5ee-2276c31564b1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:09.038334 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6bf3cecd-cb3c-426d-9689-b6b34c72f704 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:09.040733 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ef98735-401b-4749-b5ee-2276c31564b1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:09.043806 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ef98735-401b-4749-b5ee-2276c31564b1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:09.051291 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ef98735-401b-4749-b5ee-2276c31564b1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:09.061497 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6bf3cecd-cb3c-426d-9689-b6b34c72f704 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:09.062721 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6bf3cecd-cb3c-426d-9689-b6b34c72f704 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:09.065216 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6bf3cecd-cb3c-426d-9689-b6b34c72f704 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:09.187301 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6bf3cecd-cb3c-426d-9689-b6b34c72f704 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:09.197543 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6bf3cecd-cb3c-426d-9689-b6b34c72f704 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:09.332085 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-6bf3cecd-cb3c-426d-9689-b6b34c72f704 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lazy-loading 'flavor' on Instance uuid 0b68766c-714e-4e29-b5ff-5db6d4d1c459 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:03:09.400714 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6bf3cecd-cb3c-426d-9689-b6b34c72f704 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags/tempest-tag-191615744" status: 204 len: 0 microversion: 2.26 time: 0.432021 Aug 04 17:03:09.404003 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2612/5126] 10.222.0.23 () {60 vars in 1361 bytes} [Thu Aug 4 17:03:08 2022] DELETE /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags/tempest-tag-191615744 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 17:03:09.427566 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-63dc4af7-88d6-47e3-ba2b-53a72883fed3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:09.428493 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-63dc4af7-88d6-47e3-ba2b-53a72883fed3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:09.454525 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-63dc4af7-88d6-47e3-ba2b-53a72883fed3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:09.455411 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-63dc4af7-88d6-47e3-ba2b-53a72883fed3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:09.456510 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-63dc4af7-88d6-47e3-ba2b-53a72883fed3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:09.457125 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-63dc4af7-88d6-47e3-ba2b-53a72883fed3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:09.583596 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5ef98735-401b-4749-b5ee-2276c31564b1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:09.728841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5ef98735-401b-4749-b5ee-2276c31564b1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:09.747922 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5ef98735-401b-4749-b5ee-2276c31564b1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:09.753684 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5ef98735-401b-4749-b5ee-2276c31564b1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1740 microversion: 2.20 time: 0.735681 Aug 04 17:03:09.757970 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2515/5127] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:09 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1740 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:03:09.782896 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7775d26b-d1af-4497-bca3-334a575408ac tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Calling method '.version_select at 0x7f7e776a4550>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:09.810907 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-63dc4af7-88d6-47e3-ba2b-53a72883fed3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:09.822627 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7775d26b-d1af-4497-bca3-334a575408ac tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:09.824954 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-63dc4af7-88d6-47e3-ba2b-53a72883fed3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1109 microversion: 2.1 time: 0.417608 Aug 04 17:03:09.825308 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7775d26b-d1af-4497-bca3-334a575408ac tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:09.842511 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2613/5128] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:09 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1109 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:09.870689 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7775d26b-d1af-4497-bca3-334a575408ac tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags" status: 200 len: 12 microversion: 2.26 time: 0.101902 Aug 04 17:03:09.872963 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2516/5129] 10.222.0.23 () {60 vars in 1292 bytes} [Thu Aug 4 17:03:09 2022] GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags => generated 12 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:09.883824 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ad66ce91-ea82-476e-8a8c-9a9ba602e4da tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Calling method '.version_select at 0x7f7e89cf21f0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:09.902666 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad66ce91-ea82-476e-8a8c-9a9ba602e4da tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:09.903310 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad66ce91-ea82-476e-8a8c-9a9ba602e4da tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:09.904036 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ad66ce91-ea82-476e-8a8c-9a9ba602e4da tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] [instance: 0b68766c-714e-4e29-b5ff-5db6d4d1c459] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:09.919816 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad66ce91-ea82-476e-8a8c-9a9ba602e4da tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:09.921861 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad66ce91-ea82-476e-8a8c-9a9ba602e4da tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:09.922899 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad66ce91-ea82-476e-8a8c-9a9ba602e4da tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:09.925030 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad66ce91-ea82-476e-8a8c-9a9ba602e4da tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:09.975413 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad66ce91-ea82-476e-8a8c-9a9ba602e4da tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:09.978675 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad66ce91-ea82-476e-8a8c-9a9ba602e4da tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:10.019307 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-ad66ce91-ea82-476e-8a8c-9a9ba602e4da tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lazy-loading 'flavor' on Instance uuid 0b68766c-714e-4e29-b5ff-5db6d4d1c459 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:03:10.082864 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ad66ce91-ea82-476e-8a8c-9a9ba602e4da tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags" status: 204 len: 0 microversion: 2.26 time: 0.203891 Aug 04 17:03:10.083853 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2614/5130] 10.222.0.23 () {60 vars in 1295 bytes} [Thu Aug 4 17:03:09 2022] DELETE /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 17:03:10.095596 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2f84fb46-427e-4510-8b49-647a258fccaf tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Calling method '.version_select at 0x7f7e776a4e50>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:10.132724 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f84fb46-427e-4510-8b49-647a258fccaf tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:10.133209 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f84fb46-427e-4510-8b49-647a258fccaf tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:10.135918 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2f84fb46-427e-4510-8b49-647a258fccaf tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] [instance: 0b68766c-714e-4e29-b5ff-5db6d4d1c459] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:10.166528 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f84fb46-427e-4510-8b49-647a258fccaf tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:10.166987 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f84fb46-427e-4510-8b49-647a258fccaf tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:10.167789 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f84fb46-427e-4510-8b49-647a258fccaf tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:10.168224 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f84fb46-427e-4510-8b49-647a258fccaf tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:10.266230 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f84fb46-427e-4510-8b49-647a258fccaf tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:10.266684 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f84fb46-427e-4510-8b49-647a258fccaf tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:10.309240 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f84fb46-427e-4510-8b49-647a258fccaf tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:10.309743 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f84fb46-427e-4510-8b49-647a258fccaf tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:10.388208 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-6954b7dd-86c6-405a-b780-532947be3718 req-fbff0a3b-b9a5-4c86-9f80-75914e9d895f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e192310d-3cab-471d-8d3e-d161ef4de6c8", "name": "network-vif-plugged", "status": "completed", "tag": "a6e1b245-35b9-4d61-8ca7-43f55954fbc5"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:10.425424 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-2f84fb46-427e-4510-8b49-647a258fccaf tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lazy-loading 'flavor' on Instance uuid 0b68766c-714e-4e29-b5ff-5db6d4d1c459 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:03:10.432782 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6954b7dd-86c6-405a-b780-532947be3718 req-fbff0a3b-b9a5-4c86-9f80-75914e9d895f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:10.433742 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6954b7dd-86c6-405a-b780-532947be3718 req-fbff0a3b-b9a5-4c86-9f80-75914e9d895f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:10.493777 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-6954b7dd-86c6-405a-b780-532947be3718 req-fbff0a3b-b9a5-4c86-9f80-75914e9d895f service nova] Creating event network-vif-plugged:a6e1b245-35b9-4d61-8ca7-43f55954fbc5 for instance e192310d-3cab-471d-8d3e-d161ef4de6c8 on n-h2-846466-12 Aug 04 17:03:10.499793 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2f84fb46-427e-4510-8b49-647a258fccaf tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "PUT /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags/tempest-tag-1294858725" status: 201 len: 0 microversion: 2.26 time: 0.408142 Aug 04 17:03:10.503299 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2517/5131] 10.222.0.23 () {62 vars in 1380 bytes} [Thu Aug 4 17:03:10 2022] PUT /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags/tempest-tag-1294858725 => generated 0 bytes in 412 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Aug 04 17:03:10.516151 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-6954b7dd-86c6-405a-b780-532947be3718 req-fbff0a3b-b9a5-4c86-9f80-75914e9d895f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132296 Aug 04 17:03:10.520118 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2615/5132] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:03:10.522081 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9f063427-cbd7-4340-a709-6a0b1687da18 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Calling method '.version_select at 0x7f7e776abdc0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:10.549370 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f063427-cbd7-4340-a709-6a0b1687da18 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:10.552182 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f063427-cbd7-4340-a709-6a0b1687da18 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:10.552973 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9f063427-cbd7-4340-a709-6a0b1687da18 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] [instance: 0b68766c-714e-4e29-b5ff-5db6d4d1c459] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:10.564675 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f063427-cbd7-4340-a709-6a0b1687da18 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:10.570592 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f063427-cbd7-4340-a709-6a0b1687da18 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:10.573627 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f063427-cbd7-4340-a709-6a0b1687da18 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:10.575397 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f063427-cbd7-4340-a709-6a0b1687da18 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:10.639552 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:03:10.678268 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f063427-cbd7-4340-a709-6a0b1687da18 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:10.693699 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f063427-cbd7-4340-a709-6a0b1687da18 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:10.766433 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f063427-cbd7-4340-a709-6a0b1687da18 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:10.767197 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f063427-cbd7-4340-a709-6a0b1687da18 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:10.786568 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-72814a87-8d0d-4483-b410-15b32038c1f2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:10.787300 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-72814a87-8d0d-4483-b410-15b32038c1f2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:10.822872 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-72814a87-8d0d-4483-b410-15b32038c1f2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:10.828619 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-72814a87-8d0d-4483-b410-15b32038c1f2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:10.839114 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-72814a87-8d0d-4483-b410-15b32038c1f2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:10.839459 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-72814a87-8d0d-4483-b410-15b32038c1f2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:10.923148 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-9f063427-cbd7-4340-a709-6a0b1687da18 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lazy-loading 'flavor' on Instance uuid 0b68766c-714e-4e29-b5ff-5db6d4d1c459 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:03:11.054447 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9f063427-cbd7-4340-a709-6a0b1687da18 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "PUT /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags/tempest-tag-1731531551" status: 201 len: 0 microversion: 2.26 time: 0.543849 Aug 04 17:03:11.071268 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2518/5133] 10.222.0.23 () {62 vars in 1380 bytes} [Thu Aug 4 17:03:10 2022] PUT /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags/tempest-tag-1731531551 => generated 0 bytes in 560 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 04 17:03:11.101234 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-765e1e13-2f48-4f38-8298-5239957f51ce tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:11.103793 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-765e1e13-2f48-4f38-8298-5239957f51ce tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:11.172386 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-765e1e13-2f48-4f38-8298-5239957f51ce tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:11.174549 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-765e1e13-2f48-4f38-8298-5239957f51ce tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:11.176823 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-765e1e13-2f48-4f38-8298-5239957f51ce tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:11.182355 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-765e1e13-2f48-4f38-8298-5239957f51ce tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:11.469853 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-765e1e13-2f48-4f38-8298-5239957f51ce tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:11.483611 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-765e1e13-2f48-4f38-8298-5239957f51ce tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1127 microversion: 2.1 time: 0.407098 Aug 04 17:03:11.484269 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2519/5134] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:11 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1127 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:11.501236 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3c161ca9-6e6b-4380-a7ef-e33c580ad831 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Calling method '.version_select at 0x7f7e776a4790>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:11.584901 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3c161ca9-6e6b-4380-a7ef-e33c580ad831 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:11.591815 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3c161ca9-6e6b-4380-a7ef-e33c580ad831 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:11.600806 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3c161ca9-6e6b-4380-a7ef-e33c580ad831 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] [instance: 0b68766c-714e-4e29-b5ff-5db6d4d1c459] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:11.640467 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3c161ca9-6e6b-4380-a7ef-e33c580ad831 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:11.649122 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3c161ca9-6e6b-4380-a7ef-e33c580ad831 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:11.653719 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3c161ca9-6e6b-4380-a7ef-e33c580ad831 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:11.658834 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3c161ca9-6e6b-4380-a7ef-e33c580ad831 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:11.690939 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-72814a87-8d0d-4483-b410-15b32038c1f2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:11.712425 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-72814a87-8d0d-4483-b410-15b32038c1f2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:11.728487 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-72814a87-8d0d-4483-b410-15b32038c1f2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:11.742123 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-72814a87-8d0d-4483-b410-15b32038c1f2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1740 microversion: 2.20 time: 0.961093 Aug 04 17:03:11.748787 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2616/5135] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:10 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1740 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:03:11.817624 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3c161ca9-6e6b-4380-a7ef-e33c580ad831 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:11.818083 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3c161ca9-6e6b-4380-a7ef-e33c580ad831 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:11.925980 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-3c161ca9-6e6b-4380-a7ef-e33c580ad831 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lazy-loading 'flavor' on Instance uuid 0b68766c-714e-4e29-b5ff-5db6d4d1c459 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:03:12.038824 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3c161ca9-6e6b-4380-a7ef-e33c580ad831 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags" status: 204 len: 0 microversion: 2.26 time: 0.549309 Aug 04 17:03:12.052304 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2520/5136] 10.222.0.23 () {60 vars in 1295 bytes} [Thu Aug 4 17:03:11 2022] DELETE /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags => generated 0 bytes in 567 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 17:03:12.061707 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-43294c90-7335-44f1-8e58-f09af795070e tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Calling method '.version_select at 0x7f7e84632ca0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:12.091338 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-43294c90-7335-44f1-8e58-f09af795070e tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:12.101313 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-43294c90-7335-44f1-8e58-f09af795070e tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:12.140752 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-43294c90-7335-44f1-8e58-f09af795070e tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags" status: 200 len: 12 microversion: 2.26 time: 0.078469 Aug 04 17:03:12.146614 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2617/5137] 10.222.0.23 () {60 vars in 1292 bytes} [Thu Aug 4 17:03:12 2022] GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags => generated 12 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:12.152811 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-188b9056-8165-4a2f-a644-630b32ae4ede tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Calling method '.version_select at 0x7f7e776b3e50>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:12.177059 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-188b9056-8165-4a2f-a644-630b32ae4ede tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:12.186461 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-188b9056-8165-4a2f-a644-630b32ae4ede tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:12.187507 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-188b9056-8165-4a2f-a644-630b32ae4ede tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] [instance: 0b68766c-714e-4e29-b5ff-5db6d4d1c459] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:12.214542 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-188b9056-8165-4a2f-a644-630b32ae4ede tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:12.215353 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-188b9056-8165-4a2f-a644-630b32ae4ede tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:12.218328 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-188b9056-8165-4a2f-a644-630b32ae4ede tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:12.220587 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-188b9056-8165-4a2f-a644-630b32ae4ede tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:12.335662 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-188b9056-8165-4a2f-a644-630b32ae4ede tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:12.340014 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-188b9056-8165-4a2f-a644-630b32ae4ede tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:12.385651 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-188b9056-8165-4a2f-a644-630b32ae4ede tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lazy-loading 'flavor' on Instance uuid 0b68766c-714e-4e29-b5ff-5db6d4d1c459 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:03:12.449269 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-188b9056-8165-4a2f-a644-630b32ae4ede tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags" status: 204 len: 0 microversion: 2.26 time: 0.300617 Aug 04 17:03:12.459290 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2521/5138] 10.222.0.23 () {60 vars in 1295 bytes} [Thu Aug 4 17:03:12 2022] DELETE /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 17:03:12.468774 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2e23bd6e-9d0b-47c0-9a43-a4d844f30b72 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Calling method '.version_select at 0x7f7e8413b040>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:12.504398 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c4a286da-507a-4d17-a762-d3c32051d86c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:12.505133 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c4a286da-507a-4d17-a762-d3c32051d86c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:12.512665 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e23bd6e-9d0b-47c0-9a43-a4d844f30b72 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:12.513859 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e23bd6e-9d0b-47c0-9a43-a4d844f30b72 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:12.515835 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2e23bd6e-9d0b-47c0-9a43-a4d844f30b72 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] [instance: 0b68766c-714e-4e29-b5ff-5db6d4d1c459] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:12.532333 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4a286da-507a-4d17-a762-d3c32051d86c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:12.546695 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4a286da-507a-4d17-a762-d3c32051d86c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:12.547769 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4a286da-507a-4d17-a762-d3c32051d86c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:12.549437 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4a286da-507a-4d17-a762-d3c32051d86c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:12.550553 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e23bd6e-9d0b-47c0-9a43-a4d844f30b72 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:12.554055 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e23bd6e-9d0b-47c0-9a43-a4d844f30b72 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:12.566520 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e23bd6e-9d0b-47c0-9a43-a4d844f30b72 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:12.568285 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e23bd6e-9d0b-47c0-9a43-a4d844f30b72 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:12.720848 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e23bd6e-9d0b-47c0-9a43-a4d844f30b72 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:12.735450 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e23bd6e-9d0b-47c0-9a43-a4d844f30b72 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:12.779741 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e23bd6e-9d0b-47c0-9a43-a4d844f30b72 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:12.791808 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e23bd6e-9d0b-47c0-9a43-a4d844f30b72 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:12.819665 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c4a286da-507a-4d17-a762-d3c32051d86c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:12.832633 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c4a286da-507a-4d17-a762-d3c32051d86c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1127 microversion: 2.1 time: 0.329285 Aug 04 17:03:12.834340 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2522/5139] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:12 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1127 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:03:12.885085 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e5cc2172-02dc-415a-897c-ccbd02f0f775 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:12.886523 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e5cc2172-02dc-415a-897c-ccbd02f0f775 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:12.890152 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-2e23bd6e-9d0b-47c0-9a43-a4d844f30b72 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lazy-loading 'flavor' on Instance uuid 0b68766c-714e-4e29-b5ff-5db6d4d1c459 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:03:12.916365 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5cc2172-02dc-415a-897c-ccbd02f0f775 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:12.921044 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5cc2172-02dc-415a-897c-ccbd02f0f775 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:12.923614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5cc2172-02dc-415a-897c-ccbd02f0f775 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:12.933854 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5cc2172-02dc-415a-897c-ccbd02f0f775 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:12.949938 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2e23bd6e-9d0b-47c0-9a43-a4d844f30b72 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "PUT /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags/tempest-tag-877989099" status: 201 len: 0 microversion: 2.26 time: 0.485146 Aug 04 17:03:12.957694 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2618/5140] 10.222.0.23 () {62 vars in 1377 bytes} [Thu Aug 4 17:03:12 2022] PUT /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags/tempest-tag-877989099 => generated 0 bytes in 494 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 04 17:03:12.979791 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f5e7ad19-8d57-4442-951e-d274c4defdb5 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Calling method '.version_select at 0x7f7e84194c10>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:13.008111 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f5e7ad19-8d57-4442-951e-d274c4defdb5 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:13.010032 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f5e7ad19-8d57-4442-951e-d274c4defdb5 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:13.011201 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f5e7ad19-8d57-4442-951e-d274c4defdb5 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] [instance: 0b68766c-714e-4e29-b5ff-5db6d4d1c459] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:13.051668 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f5e7ad19-8d57-4442-951e-d274c4defdb5 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:13.055038 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f5e7ad19-8d57-4442-951e-d274c4defdb5 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:13.085701 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f5e7ad19-8d57-4442-951e-d274c4defdb5 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:13.086369 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f5e7ad19-8d57-4442-951e-d274c4defdb5 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:13.344991 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f5e7ad19-8d57-4442-951e-d274c4defdb5 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:13.349334 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f5e7ad19-8d57-4442-951e-d274c4defdb5 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:13.392071 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f5e7ad19-8d57-4442-951e-d274c4defdb5 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:13.412382 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f5e7ad19-8d57-4442-951e-d274c4defdb5 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:13.578700 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-f5e7ad19-8d57-4442-951e-d274c4defdb5 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lazy-loading 'flavor' on Instance uuid 0b68766c-714e-4e29-b5ff-5db6d4d1c459 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:03:13.619545 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e5cc2172-02dc-415a-897c-ccbd02f0f775 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:13.687060 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f5e7ad19-8d57-4442-951e-d274c4defdb5 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "PUT /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags/tempest-tag-1220844034" status: 201 len: 0 microversion: 2.26 time: 0.722432 Aug 04 17:03:13.697920 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2619/5141] 10.222.0.23 () {62 vars in 1380 bytes} [Thu Aug 4 17:03:12 2022] PUT /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags/tempest-tag-1220844034 => generated 0 bytes in 734 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 04 17:03:13.712041 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-37aa1709-11d3-4dc6-a4ee-9e5b9a42a9c5 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Action: 'update_all', calling method: .version_select at 0x7f7e84194160>, body: {"tags": ["tempest-tag-465483693", "tempest-tag-1671750128"]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:13.715029 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e5cc2172-02dc-415a-897c-ccbd02f0f775 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:13.732290 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e5cc2172-02dc-415a-897c-ccbd02f0f775 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:13.740038 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-37aa1709-11d3-4dc6-a4ee-9e5b9a42a9c5 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:13.741822 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-37aa1709-11d3-4dc6-a4ee-9e5b9a42a9c5 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:13.744085 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-37aa1709-11d3-4dc6-a4ee-9e5b9a42a9c5 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] [instance: 0b68766c-714e-4e29-b5ff-5db6d4d1c459] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:13.751924 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e5cc2172-02dc-415a-897c-ccbd02f0f775 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1740 microversion: 2.20 time: 0.886739 Aug 04 17:03:13.757878 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2523/5142] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:12 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1740 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:13.788305 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-37aa1709-11d3-4dc6-a4ee-9e5b9a42a9c5 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:13.789350 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-37aa1709-11d3-4dc6-a4ee-9e5b9a42a9c5 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:13.791346 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-37aa1709-11d3-4dc6-a4ee-9e5b9a42a9c5 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:13.792298 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-37aa1709-11d3-4dc6-a4ee-9e5b9a42a9c5 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:13.882516 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e299c364-80e4-4913-8654-a6856680539c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:13.886097 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e299c364-80e4-4913-8654-a6856680539c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:13.953534 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e299c364-80e4-4913-8654-a6856680539c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:13.953915 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e299c364-80e4-4913-8654-a6856680539c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:13.955061 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e299c364-80e4-4913-8654-a6856680539c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:13.955244 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e299c364-80e4-4913-8654-a6856680539c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:13.986077 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-37aa1709-11d3-4dc6-a4ee-9e5b9a42a9c5 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:13.986960 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-37aa1709-11d3-4dc6-a4ee-9e5b9a42a9c5 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:14.037606 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-37aa1709-11d3-4dc6-a4ee-9e5b9a42a9c5 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lazy-loading 'flavor' on Instance uuid 0b68766c-714e-4e29-b5ff-5db6d4d1c459 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:03:14.085663 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-37aa1709-11d3-4dc6-a4ee-9e5b9a42a9c5 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "PUT /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags" status: 200 len: 61 microversion: 2.26 time: 0.385593 Aug 04 17:03:14.087055 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2620/5143] 10.222.0.23 () {62 vars in 1312 bytes} [Thu Aug 4 17:03:13 2022] PUT /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags => generated 61 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:14.104780 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-55bfe7b6-e42a-4393-a519-81f552b16aa0 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Calling method '.version_select at 0x7f7e89b36e50>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:14.144707 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-55bfe7b6-e42a-4393-a519-81f552b16aa0 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:14.145261 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-55bfe7b6-e42a-4393-a519-81f552b16aa0 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:14.171396 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-55bfe7b6-e42a-4393-a519-81f552b16aa0 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags" status: 200 len: 61 microversion: 2.26 time: 0.077971 Aug 04 17:03:14.173022 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2621/5144] 10.222.0.23 () {60 vars in 1292 bytes} [Thu Aug 4 17:03:14 2022] GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags => generated 61 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:14.193642 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9370ed0a-d1c2-45cc-92a7-62ca260c6157 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Calling method '.version_select at 0x7f7e8413baf0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:14.226402 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9370ed0a-d1c2-45cc-92a7-62ca260c6157 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:14.227059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9370ed0a-d1c2-45cc-92a7-62ca260c6157 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:14.230181 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9370ed0a-d1c2-45cc-92a7-62ca260c6157 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] [instance: 0b68766c-714e-4e29-b5ff-5db6d4d1c459] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:14.274350 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9370ed0a-d1c2-45cc-92a7-62ca260c6157 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:14.274795 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9370ed0a-d1c2-45cc-92a7-62ca260c6157 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:14.275597 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9370ed0a-d1c2-45cc-92a7-62ca260c6157 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:14.276022 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9370ed0a-d1c2-45cc-92a7-62ca260c6157 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:14.294387 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=87,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=4,nova_cell1:RELEASE=3,nova_cell1:DELETE=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:03:14.432118 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9370ed0a-d1c2-45cc-92a7-62ca260c6157 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:14.432691 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9370ed0a-d1c2-45cc-92a7-62ca260c6157 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:14.553001 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-9370ed0a-d1c2-45cc-92a7-62ca260c6157 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lazy-loading 'flavor' on Instance uuid 0b68766c-714e-4e29-b5ff-5db6d4d1c459 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:03:14.626897 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9370ed0a-d1c2-45cc-92a7-62ca260c6157 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags" status: 204 len: 0 microversion: 2.26 time: 0.445754 Aug 04 17:03:14.628241 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2622/5145] 10.222.0.23 () {60 vars in 1295 bytes} [Thu Aug 4 17:03:14 2022] DELETE /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459/tags => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 17:03:14.640919 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-05cb0547-7408-4ccf-a3b6-3d4bb44b06e9 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:14.642175 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-05cb0547-7408-4ccf-a3b6-3d4bb44b06e9 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] [instance: 0b68766c-714e-4e29-b5ff-5db6d4d1c459] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:14.650136 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-05cb0547-7408-4ccf-a3b6-3d4bb44b06e9 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:14.650873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-05cb0547-7408-4ccf-a3b6-3d4bb44b06e9 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:14.651839 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-05cb0547-7408-4ccf-a3b6-3d4bb44b06e9 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:14.652439 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-05cb0547-7408-4ccf-a3b6-3d4bb44b06e9 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:14.696576 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-05cb0547-7408-4ccf-a3b6-3d4bb44b06e9 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] [instance: 0b68766c-714e-4e29-b5ff-5db6d4d1c459] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:03:14.778529 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e299c364-80e4-4913-8654-a6856680539c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:14.819547 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e299c364-80e4-4913-8654-a6856680539c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1169 microversion: 2.1 time: 0.953301 Aug 04 17:03:14.833432 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2524/5146] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:13 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1169 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:14.860586 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8dfe864c-4bea-4e17-bfaa-f78e151bee70 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:14.867736 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8dfe864c-4bea-4e17-bfaa-f78e151bee70 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:14.876007 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-05cb0547-7408-4ccf-a3b6-3d4bb44b06e9 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459" status: 204 len: 0 microversion: 2.26 time: 0.239575 Aug 04 17:03:14.877024 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2623/5147] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Aug 4 17:03:14 2022] DELETE /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 17:03:14.888983 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c615e3ac-10cb-411f-9735-265a96acdfd1 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:14.889888 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c615e3ac-10cb-411f-9735-265a96acdfd1 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] [instance: 0b68766c-714e-4e29-b5ff-5db6d4d1c459] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:14.905847 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c615e3ac-10cb-411f-9735-265a96acdfd1 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:14.906369 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c615e3ac-10cb-411f-9735-265a96acdfd1 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:14.907218 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c615e3ac-10cb-411f-9735-265a96acdfd1 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:14.907729 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c615e3ac-10cb-411f-9735-265a96acdfd1 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:14.911928 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8dfe864c-4bea-4e17-bfaa-f78e151bee70 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:14.919760 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8dfe864c-4bea-4e17-bfaa-f78e151bee70 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:14.926185 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8dfe864c-4bea-4e17-bfaa-f78e151bee70 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:14.939600 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8dfe864c-4bea-4e17-bfaa-f78e151bee70 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:15.376799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c615e3ac-10cb-411f-9735-265a96acdfd1 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:15.396183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c615e3ac-10cb-411f-9735-265a96acdfd1 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:15.398366 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c615e3ac-10cb-411f-9735-265a96acdfd1 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:15.399856 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c615e3ac-10cb-411f-9735-265a96acdfd1 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459" status: 200 len: 1551 microversion: 2.26 time: 0.518200 Aug 04 17:03:15.407867 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2624/5148] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:14 2022] GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459 => generated 1551 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:03:15.514314 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8dfe864c-4bea-4e17-bfaa-f78e151bee70 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:15.527093 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8dfe864c-4bea-4e17-bfaa-f78e151bee70 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:15.529586 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8dfe864c-4bea-4e17-bfaa-f78e151bee70 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:15.532868 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8dfe864c-4bea-4e17-bfaa-f78e151bee70 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1740 microversion: 2.20 time: 0.696574 Aug 04 17:03:15.536275 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2525/5149] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:14 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1740 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:15.848337 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dd5a67a1-401e-4519-bbb7-fbd6a8e2ce6c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:15.849163 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dd5a67a1-401e-4519-bbb7-fbd6a8e2ce6c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:15.887140 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dd5a67a1-401e-4519-bbb7-fbd6a8e2ce6c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:15.887818 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dd5a67a1-401e-4519-bbb7-fbd6a8e2ce6c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:15.888288 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dd5a67a1-401e-4519-bbb7-fbd6a8e2ce6c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:15.888719 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dd5a67a1-401e-4519-bbb7-fbd6a8e2ce6c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:16.320201 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dd5a67a1-401e-4519-bbb7-fbd6a8e2ce6c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:16.340666 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dd5a67a1-401e-4519-bbb7-fbd6a8e2ce6c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1169 microversion: 2.1 time: 0.496335 Aug 04 17:03:16.342169 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2625/5150] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:15 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1169 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:16.432193 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:03:16.433866 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:03:16.442546 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c963f113-7c0e-4a4d-b7bc-cd7d6fd2bd81 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:16.445075 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c963f113-7c0e-4a4d-b7bc-cd7d6fd2bd81 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] [instance: 0b68766c-714e-4e29-b5ff-5db6d4d1c459] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:16.470507 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c963f113-7c0e-4a4d-b7bc-cd7d6fd2bd81 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:16.473897 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c963f113-7c0e-4a4d-b7bc-cd7d6fd2bd81 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:16.477214 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c963f113-7c0e-4a4d-b7bc-cd7d6fd2bd81 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:16.477967 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c963f113-7c0e-4a4d-b7bc-cd7d6fd2bd81 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:17.492139 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dac2841c-3acd-45c0-8ccf-263af1d05269 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:17.493428 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dac2841c-3acd-45c0-8ccf-263af1d05269 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:17.505802 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dac2841c-3acd-45c0-8ccf-263af1d05269 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:17.506567 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dac2841c-3acd-45c0-8ccf-263af1d05269 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:17.507553 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dac2841c-3acd-45c0-8ccf-263af1d05269 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:17.513393 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dac2841c-3acd-45c0-8ccf-263af1d05269 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:18.186196 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c963f113-7c0e-4a4d-b7bc-cd7d6fd2bd81 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:18.199487 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c963f113-7c0e-4a4d-b7bc-cd7d6fd2bd81 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:18.211221 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c963f113-7c0e-4a4d-b7bc-cd7d6fd2bd81 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:18.216280 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c963f113-7c0e-4a4d-b7bc-cd7d6fd2bd81 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459" status: 200 len: 1551 microversion: 2.26 time: 1.783777 Aug 04 17:03:18.221120 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2526/5151] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:16 2022] GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459 => generated 1551 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:18.238860 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-be501271-6d4f-44d0-8e4b-f3d3a7fa7e89 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:18.240983 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-be501271-6d4f-44d0-8e4b-f3d3a7fa7e89 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 58ba4011-f974-4687-b3c0-fd8e04ce7600] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:18.266334 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be501271-6d4f-44d0-8e4b-f3d3a7fa7e89 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:18.271408 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:03:18.273040 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be501271-6d4f-44d0-8e4b-f3d3a7fa7e89 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:18.280417 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be501271-6d4f-44d0-8e4b-f3d3a7fa7e89 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:18.282902 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be501271-6d4f-44d0-8e4b-f3d3a7fa7e89 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:18.322996 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-be501271-6d4f-44d0-8e4b-f3d3a7fa7e89 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] HTTP exception thrown: Instance 58ba4011-f974-4687-b3c0-fd8e04ce7600 could not be found. Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-be501271-6d4f-44d0-8e4b-f3d3a7fa7e89 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600 HTTP/1.1 Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 58ba4011-f974-4687-b3c0-fd8e04ce7600 could not be found. Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '58ba4011-f974-4687-b3c0-fd8e04ce7600'} Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58ba4011-f974-4687-b3c0-fd8e04ce7600 could not be found. Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:03:18.330947 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:03:18.336174 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58ba4011-f974-4687-b3c0-fd8e04ce7600 could not be found. Aug 04 17:03:18.336174 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:18.336174 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:18.336174 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:18.336174 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:18.336174 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:18.336174 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:18.336174 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:03:18.336174 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:03:18.336174 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58ba4011-f974-4687-b3c0-fd8e04ce7600 could not be found. Aug 04 17:03:18.336174 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:18.341356 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-be501271-6d4f-44d0-8e4b-f3d3a7fa7e89 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 404 to user: Instance 58ba4011-f974-4687-b3c0-fd8e04ce7600 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:18.342600 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-be501271-6d4f-44d0-8e4b-f3d3a7fa7e89 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "DELETE /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600" status: 404 len: 111 microversion: 2.1 time: 0.120078 Aug 04 17:03:18.346719 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2527/5152] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:03:18 2022] DELETE /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:03:18.358509 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-22f24586-75a8-42fc-88a5-4e64735a5cbb req-207f5e6f-4913-489f-becc-00b8890383c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19a8136d-f89b-449a-9cf9-3e2b246fc5e1", "tag": "18789b88-4ed9-49d6-89bd-13c13c26115b"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:18.386359 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-22f24586-75a8-42fc-88a5-4e64735a5cbb req-207f5e6f-4913-489f-becc-00b8890383c6 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:18.390954 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-22f24586-75a8-42fc-88a5-4e64735a5cbb req-207f5e6f-4913-489f-becc-00b8890383c6 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:18.439516 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dac2841c-3acd-45c0-8ccf-263af1d05269 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:18.456119 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dac2841c-3acd-45c0-8ccf-263af1d05269 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:18.466790 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-22f24586-75a8-42fc-88a5-4e64735a5cbb req-207f5e6f-4913-489f-becc-00b8890383c6 service nova] Creating event network-changed:18789b88-4ed9-49d6-89bd-13c13c26115b for instance 19a8136d-f89b-449a-9cf9-3e2b246fc5e1 on n-h2-846466-12 Aug 04 17:03:18.469089 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dac2841c-3acd-45c0-8ccf-263af1d05269 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:18.474272 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dac2841c-3acd-45c0-8ccf-263af1d05269 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1740 microversion: 2.20 time: 1.919961 Aug 04 17:03:18.483428 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2626/5153] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:16 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1740 bytes in 1930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:18.491238 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-22f24586-75a8-42fc-88a5-4e64735a5cbb req-207f5e6f-4913-489f-becc-00b8890383c6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141042 Aug 04 17:03:18.492885 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-446c02fe-f880-4caf-aa1d-c4a2e877341c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:18.496101 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2528/5154] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:18.500082 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-446c02fe-f880-4caf-aa1d-c4a2e877341c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:18.525592 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-446c02fe-f880-4caf-aa1d-c4a2e877341c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:18.527616 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-446c02fe-f880-4caf-aa1d-c4a2e877341c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:18.528667 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-446c02fe-f880-4caf-aa1d-c4a2e877341c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:18.531183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-446c02fe-f880-4caf-aa1d-c4a2e877341c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:18.743357 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-446c02fe-f880-4caf-aa1d-c4a2e877341c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:18.757885 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-446c02fe-f880-4caf-aa1d-c4a2e877341c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1169 microversion: 2.1 time: 0.270642 Aug 04 17:03:18.761729 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2627/5155] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:18 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1169 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:18.772456 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a6ba85b2-643c-4ee0-aa1d-81622c589367 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:18.773687 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a6ba85b2-643c-4ee0-aa1d-81622c589367 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 58ba4011-f974-4687-b3c0-fd8e04ce7600] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:18.795723 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6ba85b2-643c-4ee0-aa1d-81622c589367 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:18.796612 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6ba85b2-643c-4ee0-aa1d-81622c589367 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:18.797863 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6ba85b2-643c-4ee0-aa1d-81622c589367 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:18.798543 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6ba85b2-643c-4ee0-aa1d-81622c589367 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:18.830331 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-a6ba85b2-643c-4ee0-aa1d-81622c589367 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] HTTP exception thrown: Instance 58ba4011-f974-4687-b3c0-fd8e04ce7600 could not be found. Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a6ba85b2-643c-4ee0-aa1d-81622c589367 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600 HTTP/1.1 Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 58ba4011-f974-4687-b3c0-fd8e04ce7600 could not be found. Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '58ba4011-f974-4687-b3c0-fd8e04ce7600'} Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58ba4011-f974-4687-b3c0-fd8e04ce7600 could not be found. Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58ba4011-f974-4687-b3c0-fd8e04ce7600 could not be found. Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:18.839771 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:18.844590 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:18.844590 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:18.844590 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:18.844590 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:03:18.844590 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:03:18.844590 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58ba4011-f974-4687-b3c0-fd8e04ce7600 could not be found. Aug 04 17:03:18.844590 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:18.848820 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a6ba85b2-643c-4ee0-aa1d-81622c589367 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 404 to user: Instance 58ba4011-f974-4687-b3c0-fd8e04ce7600 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:18.850027 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a6ba85b2-643c-4ee0-aa1d-81622c589367 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600" status: 404 len: 111 microversion: 2.1 time: 0.086723 Aug 04 17:03:18.854818 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2628/5156] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:18 2022] GET /compute/v2.1/servers/58ba4011-f974-4687-b3c0-fd8e04ce7600 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:03:18.870900 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9c462f66-1c8c-411c-b342-bda01341e85e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:18.874305 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9c462f66-1c8c-411c-b342-bda01341e85e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:18.910105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c462f66-1c8c-411c-b342-bda01341e85e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:18.910105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c462f66-1c8c-411c-b342-bda01341e85e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:18.910105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c462f66-1c8c-411c-b342-bda01341e85e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:18.910105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c462f66-1c8c-411c-b342-bda01341e85e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:19.010547 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9c462f66-1c8c-411c-b342-bda01341e85e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:03:19.072270 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-595562c9-6f6c-4c68-8e26-a0790fb00d45 req-d1ed2c59-9952-4871-b31d-59554808aa3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b68766c-714e-4e29-b5ff-5db6d4d1c459", "name": "network-vif-deleted", "tag": "4217d3e4-70c7-4ce9-9180-5e391b9ff59f"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:19.099914 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-595562c9-6f6c-4c68-8e26-a0790fb00d45 req-d1ed2c59-9952-4871-b31d-59554808aa3b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:19.103738 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-595562c9-6f6c-4c68-8e26-a0790fb00d45 req-d1ed2c59-9952-4871-b31d-59554808aa3b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:19.145334 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-595562c9-6f6c-4c68-8e26-a0790fb00d45 req-d1ed2c59-9952-4871-b31d-59554808aa3b service nova] Creating event network-vif-deleted:4217d3e4-70c7-4ce9-9180-5e391b9ff59f for instance 0b68766c-714e-4e29-b5ff-5db6d4d1c459 on n-h1-846466-12 Aug 04 17:03:19.155191 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-595562c9-6f6c-4c68-8e26-a0790fb00d45 req-d1ed2c59-9952-4871-b31d-59554808aa3b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.657415 Aug 04 17:03:19.169640 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2529/5157] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:19.243620 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6c530785-8c5d-40c3-93ca-a714a0262ffa tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:19.245651 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6c530785-8c5d-40c3-93ca-a714a0262ffa tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] [instance: 0b68766c-714e-4e29-b5ff-5db6d4d1c459] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:19.271108 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c530785-8c5d-40c3-93ca-a714a0262ffa tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:19.273806 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c530785-8c5d-40c3-93ca-a714a0262ffa tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:19.276847 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c530785-8c5d-40c3-93ca-a714a0262ffa tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:19.280521 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c530785-8c5d-40c3-93ca-a714a0262ffa tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:19.338522 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9c462f66-1c8c-411c-b342-bda01341e85e tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 204 len: 0 microversion: 2.1 time: 0.480320 Aug 04 17:03:19.347223 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2629/5158] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:03:18 2022] DELETE /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:03:19.377613 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-779b1a40-b413-42fd-af9b-161dab329d1a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:19.381972 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-779b1a40-b413-42fd-af9b-161dab329d1a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:19.426644 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-779b1a40-b413-42fd-af9b-161dab329d1a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:19.427402 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-779b1a40-b413-42fd-af9b-161dab329d1a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:19.432322 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-779b1a40-b413-42fd-af9b-161dab329d1a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:19.436428 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c530785-8c5d-40c3-93ca-a714a0262ffa tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:19.437031 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-779b1a40-b413-42fd-af9b-161dab329d1a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:19.444572 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c530785-8c5d-40c3-93ca-a714a0262ffa tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:19.456763 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-6c530785-8c5d-40c3-93ca-a714a0262ffa tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lazy-loading 'fault' on Instance uuid 0b68766c-714e-4e29-b5ff-5db6d4d1c459 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:03:19.615577 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6c530785-8c5d-40c3-93ca-a714a0262ffa tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:19.628920 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6c530785-8c5d-40c3-93ca-a714a0262ffa tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:19.635051 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6c530785-8c5d-40c3-93ca-a714a0262ffa tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037190e78d894fa09b8178c01da2568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdb1c1c0cf540afa1a51049f0340022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:19.637400 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6c530785-8c5d-40c3-93ca-a714a0262ffa tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459" status: 200 len: 1352 microversion: 2.26 time: 0.399284 Aug 04 17:03:19.641836 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2530/5159] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:19 2022] GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459 => generated 1352 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:03:19.656460 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-412630be-440c-4611-b9ad-a919e0dadb82 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:19.660792 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-412630be-440c-4611-b9ad-a919e0dadb82 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:19.682372 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-412630be-440c-4611-b9ad-a919e0dadb82 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:19.683116 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-412630be-440c-4611-b9ad-a919e0dadb82 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:19.684091 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-412630be-440c-4611-b9ad-a919e0dadb82 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:19.684693 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-412630be-440c-4611-b9ad-a919e0dadb82 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:19.946355 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-779b1a40-b413-42fd-af9b-161dab329d1a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:19.962756 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-779b1a40-b413-42fd-af9b-161dab329d1a tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1512 microversion: 2.1 time: 0.607509 Aug 04 17:03:19.963360 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2630/5160] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:19 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1512 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:20.010716 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4894b677-5d58-42fa-9e40-a602b7e57b4c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:20.013106 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4894b677-5d58-42fa-9e40-a602b7e57b4c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:20.041144 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4894b677-5d58-42fa-9e40-a602b7e57b4c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:20.042410 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4894b677-5d58-42fa-9e40-a602b7e57b4c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:20.043548 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4894b677-5d58-42fa-9e40-a602b7e57b4c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:20.046300 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4894b677-5d58-42fa-9e40-a602b7e57b4c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:20.312248 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-412630be-440c-4611-b9ad-a919e0dadb82 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:20.328869 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-412630be-440c-4611-b9ad-a919e0dadb82 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:20.333466 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-412630be-440c-4611-b9ad-a919e0dadb82 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:20.337722 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-412630be-440c-4611-b9ad-a919e0dadb82 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1740 microversion: 2.20 time: 0.691660 Aug 04 17:03:20.338805 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2531/5161] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:19 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1740 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:20.463346 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4894b677-5d58-42fa-9e40-a602b7e57b4c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:20.488076 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4894b677-5d58-42fa-9e40-a602b7e57b4c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1169 microversion: 2.1 time: 0.492248 Aug 04 17:03:20.498109 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2631/5162] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:19 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1169 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:20.664474 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e86377ba-e0bc-414f-ae27-5f50607d1f49 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:20.669718 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e86377ba-e0bc-414f-ae27-5f50607d1f49 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] [instance: 0b68766c-714e-4e29-b5ff-5db6d4d1c459] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:20.714827 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e86377ba-e0bc-414f-ae27-5f50607d1f49 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:20.716593 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e86377ba-e0bc-414f-ae27-5f50607d1f49 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:20.718896 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e86377ba-e0bc-414f-ae27-5f50607d1f49 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:20.724503 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e86377ba-e0bc-414f-ae27-5f50607d1f49 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:20.770904 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-e86377ba-e0bc-414f-ae27-5f50607d1f49 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] HTTP exception thrown: Instance 0b68766c-714e-4e29-b5ff-5db6d4d1c459 could not be found. Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e86377ba-e0bc-414f-ae27-5f50607d1f49 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Request method failure captured: Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459 HTTP/1.1 Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_uxhtcKxl1KaItdndsKLO5BGAI5c4vOfpV_FmXIvNbGutLA_uCK_vgo_wUUmLGmXvJ597JhvGWX1UlN57kJ2Rr9oaYK1csi1jKIVn_CV6a4hzRmGqJXdbvc3mcjAN3HyERQ8u3M8bFzMGIHuL26Qk5ggesxcWqKXumpRPGh7NTlxm8 Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: X-Openstack-Nova-Api-Version: 2.26 Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 1cdb1c1c0cf540afa1a51049f0340022 Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServerTagsTestJSON-1047269924 Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1cdb1c1c0cf540afa1a51049f0340022"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1cdb1c1c0cf540afa1a51049f0340022"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1cdb1c1c0cf540afa1a51049f0340022"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1cdb1c1c0cf540afa1a51049f0340022"}]}] Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServerTagsTestJSON-1047269924 Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 1cdb1c1c0cf540afa1a51049f0340022 Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServerTagsTestJSON-1047269924 Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServerTagsTestJSON-1047269924-project Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 037190e78d894fa09b8178c01da2568e Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServerTagsTestJSON-1047269924-project Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 0b68766c-714e-4e29-b5ff-5db6d4d1c459 could not be found. Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '0b68766c-714e-4e29-b5ff-5db6d4d1c459'} Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b68766c-714e-4e29-b5ff-5db6d4d1c459 could not be found. Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b68766c-714e-4e29-b5ff-5db6d4d1c459 could not be found. Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:20.774438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:20.780581 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:20.780581 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:20.780581 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:20.780581 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:03:20.780581 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:03:20.780581 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b68766c-714e-4e29-b5ff-5db6d4d1c459 could not be found. Aug 04 17:03:20.780581 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:20.780581 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e86377ba-e0bc-414f-ae27-5f50607d1f49 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] Returning 404 to user: Instance 0b68766c-714e-4e29-b5ff-5db6d4d1c459 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:20.784798 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e86377ba-e0bc-414f-ae27-5f50607d1f49 tempest-ServerTagsTestJSON-1047269924 tempest-ServerTagsTestJSON-1047269924-project] 10.222.0.23 "GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459" status: 404 len: 111 microversion: 2.26 time: 0.124330 Aug 04 17:03:20.789060 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2532/5163] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:20 2022] GET /compute/v2.1/servers/0b68766c-714e-4e29-b5ff-5db6d4d1c459 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:03:20.990897 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f34ce828-d054-4d2b-b24a-add46369c262 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:20.992170 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f34ce828-d054-4d2b-b24a-add46369c262 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:21.000921 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f34ce828-d054-4d2b-b24a-add46369c262 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:21.001699 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f34ce828-d054-4d2b-b24a-add46369c262 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:21.014562 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f34ce828-d054-4d2b-b24a-add46369c262 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:21.015943 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f34ce828-d054-4d2b-b24a-add46369c262 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:21.361663 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d18ef5d6-726e-4ccc-8be0-de070e121180 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:21.362513 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d18ef5d6-726e-4ccc-8be0-de070e121180 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:21.374833 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d18ef5d6-726e-4ccc-8be0-de070e121180 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:21.378470 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d18ef5d6-726e-4ccc-8be0-de070e121180 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:21.379616 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d18ef5d6-726e-4ccc-8be0-de070e121180 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:21.394091 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d18ef5d6-726e-4ccc-8be0-de070e121180 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:22.625657 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d18ef5d6-726e-4ccc-8be0-de070e121180 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:22.673481 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d18ef5d6-726e-4ccc-8be0-de070e121180 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:22.677956 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d18ef5d6-726e-4ccc-8be0-de070e121180 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:22.682781 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d18ef5d6-726e-4ccc-8be0-de070e121180 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1740 microversion: 2.20 time: 1.325123 Aug 04 17:03:22.689736 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2533/5164] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:21 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1740 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:03:22.736910 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f34ce828-d054-4d2b-b24a-add46369c262 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:22.748228 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d1071b27-6ed3-4969-a5ce-a2c9a273f018 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:22.754405 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d1071b27-6ed3-4969-a5ce-a2c9a273f018 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:22.757333 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f34ce828-d054-4d2b-b24a-add46369c262 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1512 microversion: 2.1 time: 1.774377 Aug 04 17:03:22.764345 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2632/5165] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:20 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1512 bytes in 1781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:22.780743 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-836b0f4f-3e81-47c7-9021-7900d68081ae tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:22.782265 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-836b0f4f-3e81-47c7-9021-7900d68081ae tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 179db84c-f006-46b9-85ad-ceea5c6a15ad] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:22.793329 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d1071b27-6ed3-4969-a5ce-a2c9a273f018 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:22.798940 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d1071b27-6ed3-4969-a5ce-a2c9a273f018 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:22.804905 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d1071b27-6ed3-4969-a5ce-a2c9a273f018 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:22.806412 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d1071b27-6ed3-4969-a5ce-a2c9a273f018 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:22.824473 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-836b0f4f-3e81-47c7-9021-7900d68081ae tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:22.836264 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-836b0f4f-3e81-47c7-9021-7900d68081ae tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:22.839475 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-836b0f4f-3e81-47c7-9021-7900d68081ae tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:22.840825 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-836b0f4f-3e81-47c7-9021-7900d68081ae tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:22.905276 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-836b0f4f-3e81-47c7-9021-7900d68081ae tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] HTTP exception thrown: Instance 179db84c-f006-46b9-85ad-ceea5c6a15ad could not be found. Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-836b0f4f-3e81-47c7-9021-7900d68081ae tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Request method failure captured: Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad HTTP/1.1 Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_owNKx0pHV40nqVD-WIcaXEsXOBwQHOEMAVVk2fno070nDFXZRZhhzMgTy8HlVP1AOBt469MYWC_AbeQLbAvgivtdjrTsmGymGu6AtGEk3CEKRMIDLRIpky1rxw9eTh6mgckU3tnNoFbB2in__O_4k2BxkTMZllLYaubH7EDDeTWL4 Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 2534921e8a2f47d394059fee872426a8 Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-AttachVolumeNegativeTest-410766221 Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2534921e8a2f47d394059fee872426a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2534921e8a2f47d394059fee872426a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2534921e8a2f47d394059fee872426a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2534921e8a2f47d394059fee872426a8"}]}] Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-AttachVolumeNegativeTest-410766221 Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 2534921e8a2f47d394059fee872426a8 Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-410766221 Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-AttachVolumeNegativeTest-410766221-project Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: d82f4a672b154291a412a282d1a88208 Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-AttachVolumeNegativeTest-410766221-project Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 179db84c-f006-46b9-85ad-ceea5c6a15ad could not be found. Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '179db84c-f006-46b9-85ad-ceea5c6a15ad'} Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 179db84c-f006-46b9-85ad-ceea5c6a15ad could not be found. Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:03:22.909187 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:03:22.914569 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 179db84c-f006-46b9-85ad-ceea5c6a15ad could not be found. Aug 04 17:03:22.914569 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.914569 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:22.914569 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.914569 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:22.914569 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:22.914569 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:22.914569 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:03:22.914569 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:03:22.914569 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 179db84c-f006-46b9-85ad-ceea5c6a15ad could not be found. Aug 04 17:03:22.914569 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.921453 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-836b0f4f-3e81-47c7-9021-7900d68081ae tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Returning 404 to user: Instance 179db84c-f006-46b9-85ad-ceea5c6a15ad could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:22.922638 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-836b0f4f-3e81-47c7-9021-7900d68081ae tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "DELETE /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad" status: 404 len: 111 microversion: 2.1 time: 0.157164 Aug 04 17:03:22.925247 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2633/5166] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:03:22 2022] DELETE /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:03:22.934906 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c3b949f2-2afb-4a64-b7a1-389dc3aee461 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:22.938958 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c3b949f2-2afb-4a64-b7a1-389dc3aee461 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 179db84c-f006-46b9-85ad-ceea5c6a15ad] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:22.960807 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3b949f2-2afb-4a64-b7a1-389dc3aee461 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:22.961256 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3b949f2-2afb-4a64-b7a1-389dc3aee461 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:22.962082 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3b949f2-2afb-4a64-b7a1-389dc3aee461 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:22.962508 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3b949f2-2afb-4a64-b7a1-389dc3aee461 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:23.008215 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-c3b949f2-2afb-4a64-b7a1-389dc3aee461 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] HTTP exception thrown: Instance 179db84c-f006-46b9-85ad-ceea5c6a15ad could not be found. Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c3b949f2-2afb-4a64-b7a1-389dc3aee461 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Request method failure captured: Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad HTTP/1.1 Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_owNKx0pHV40nqVD-WIcaXEsXOBwQHOEMAVVk2fno070nDFXZRZhhzMgTy8HlVP1AOBt469MYWC_AbeQLbAvgivtdjrTsmGymGu6AtGEk3CEKRMIDLRIpky1rxw9eTh6mgckU3tnNoFbB2in__O_4k2BxkTMZllLYaubH7EDDeTWL4 Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 2534921e8a2f47d394059fee872426a8 Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-AttachVolumeNegativeTest-410766221 Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2534921e8a2f47d394059fee872426a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2534921e8a2f47d394059fee872426a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2534921e8a2f47d394059fee872426a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2534921e8a2f47d394059fee872426a8"}]}] Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-AttachVolumeNegativeTest-410766221 Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 2534921e8a2f47d394059fee872426a8 Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-410766221 Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-AttachVolumeNegativeTest-410766221-project Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: d82f4a672b154291a412a282d1a88208 Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-AttachVolumeNegativeTest-410766221-project Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 179db84c-f006-46b9-85ad-ceea5c6a15ad could not be found. Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '179db84c-f006-46b9-85ad-ceea5c6a15ad'} Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 179db84c-f006-46b9-85ad-ceea5c6a15ad could not be found. Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 179db84c-f006-46b9-85ad-ceea5c6a15ad could not be found. Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:23.010461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:23.015531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:23.015531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:23.015531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:23.015531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:03:23.015531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:03:23.015531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 179db84c-f006-46b9-85ad-ceea5c6a15ad could not be found. Aug 04 17:03:23.015531 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:23.015531 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c3b949f2-2afb-4a64-b7a1-389dc3aee461 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Returning 404 to user: Instance 179db84c-f006-46b9-85ad-ceea5c6a15ad could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:23.015531 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c3b949f2-2afb-4a64-b7a1-389dc3aee461 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad" status: 404 len: 111 microversion: 2.1 time: 0.081718 Aug 04 17:03:23.015531 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2634/5167] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:22 2022] GET /compute/v2.1/servers/179db84c-f006-46b9-85ad-ceea5c6a15ad => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:03:23.719816 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-52c6df43-4459-4de1-82c9-db9f77260bb4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:23.720891 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-52c6df43-4459-4de1-82c9-db9f77260bb4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:23.763439 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-52c6df43-4459-4de1-82c9-db9f77260bb4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:23.770188 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-52c6df43-4459-4de1-82c9-db9f77260bb4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:23.774714 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-52c6df43-4459-4de1-82c9-db9f77260bb4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:23.777909 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-52c6df43-4459-4de1-82c9-db9f77260bb4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:24.730923 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d1071b27-6ed3-4969-a5ce-a2c9a273f018 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:24.734476 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:03:24.771803 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d1071b27-6ed3-4969-a5ce-a2c9a273f018 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1169 microversion: 2.1 time: 2.076049 Aug 04 17:03:24.776608 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2534/5168] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:22 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1169 bytes in 2086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:24.806613 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-aa531fdc-6587-4f5f-96b8-925dde60a846 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:24.811546 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-aa531fdc-6587-4f5f-96b8-925dde60a846 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:24.844502 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aa531fdc-6587-4f5f-96b8-925dde60a846 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:24.845203 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aa531fdc-6587-4f5f-96b8-925dde60a846 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:24.852398 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aa531fdc-6587-4f5f-96b8-925dde60a846 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:24.853034 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aa531fdc-6587-4f5f-96b8-925dde60a846 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:25.348058 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-aa531fdc-6587-4f5f-96b8-925dde60a846 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25fedd3842a4d7f9c5832abcbf19507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7231a2541d4bc0905b2305552429b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:25.373235 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-aa531fdc-6587-4f5f-96b8-925dde60a846 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 200 len: 1470 microversion: 2.1 time: 0.589308 Aug 04 17:03:25.403885 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2535/5169] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:24 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 1470 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:25.553997 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-c1fadf7b-52f9-439f-8532-6cc7bf7a4a3b req-6a1ef522-e850-4fb6-9674-705b63ae1578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7094f480-111a-4c4e-8a77-2df578c044c0", "name": "network-vif-deleted", "tag": "7cc4e42a-ac69-4d95-810a-566a44e11ef2"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:25.641639 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-c1fadf7b-52f9-439f-8532-6cc7bf7a4a3b req-6a1ef522-e850-4fb6-9674-705b63ae1578 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:25.654974 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-c1fadf7b-52f9-439f-8532-6cc7bf7a4a3b req-6a1ef522-e850-4fb6-9674-705b63ae1578 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:25.704723 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-c1fadf7b-52f9-439f-8532-6cc7bf7a4a3b req-6a1ef522-e850-4fb6-9674-705b63ae1578 service nova] Creating event network-vif-deleted:7cc4e42a-ac69-4d95-810a-566a44e11ef2 for instance 7094f480-111a-4c4e-8a77-2df578c044c0 on n-h2-846466-12 Aug 04 17:03:25.705654 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-52c6df43-4459-4de1-82c9-db9f77260bb4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:25.723692 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-52c6df43-4459-4de1-82c9-db9f77260bb4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:25.728822 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-52c6df43-4459-4de1-82c9-db9f77260bb4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:25.730343 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-52c6df43-4459-4de1-82c9-db9f77260bb4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1740 microversion: 2.20 time: 2.016516 Aug 04 17:03:25.735916 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2635/5170] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:23 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1740 bytes in 2023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:25.760665 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-c1fadf7b-52f9-439f-8532-6cc7bf7a4a3b req-6a1ef522-e850-4fb6-9674-705b63ae1578 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208023 Aug 04 17:03:25.762239 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2536/5171] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:03:25.802495 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-af18f2d6-4b81-4be6-ae3d-10639a027596 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:25.803979 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-af18f2d6-4b81-4be6-ae3d-10639a027596 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:25.837586 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:03:25.844708 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-af18f2d6-4b81-4be6-ae3d-10639a027596 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:25.847668 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-af18f2d6-4b81-4be6-ae3d-10639a027596 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:25.848802 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-af18f2d6-4b81-4be6-ae3d-10639a027596 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:25.849504 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-af18f2d6-4b81-4be6-ae3d-10639a027596 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:26.420237 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a4334bd0-04fc-42d6-97af-4486f4148302 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:26.422162 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a4334bd0-04fc-42d6-97af-4486f4148302 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] [instance: 7094f480-111a-4c4e-8a77-2df578c044c0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:26.443809 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a4334bd0-04fc-42d6-97af-4486f4148302 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:26.447195 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a4334bd0-04fc-42d6-97af-4486f4148302 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:26.456174 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a4334bd0-04fc-42d6-97af-4486f4148302 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:26.460392 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a4334bd0-04fc-42d6-97af-4486f4148302 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:26.510541 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-a4334bd0-04fc-42d6-97af-4486f4148302 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] HTTP exception thrown: Instance 7094f480-111a-4c4e-8a77-2df578c044c0 could not be found. Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a4334bd0-04fc-42d6-97af-4486f4148302 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Request method failure captured: Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 HTTP/1.1 Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_rpDiPcYQPPnOfpXpWT7oAyeZ-8VhXg-d4NXOmdxHSuivizbQVd2nP1szlC1tDMyebH0lkU9ZKoGVGStxUpzD7s51TTJxMNucpTuHuK0ufm9ZmtZU86lSLkG-DhYIlu3Ty-ZZaLU9AguVrpELLlXKH6eFSj8-vdfGvnnTlzhAZV5sM Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a7231a2541d4bc0905b2305552429b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a7231a2541d4bc0905b2305552429b9"}]}] Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 1a7231a2541d4bc0905b2305552429b9 Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersNegativeTestJSON-946891663 Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: c25fedd3842a4d7f9c5832abcbf19507 Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersNegativeTestJSON-946891663-project Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 7094f480-111a-4c4e-8a77-2df578c044c0 could not be found. Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '7094f480-111a-4c4e-8a77-2df578c044c0'} Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7094f480-111a-4c4e-8a77-2df578c044c0 could not be found. Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7094f480-111a-4c4e-8a77-2df578c044c0 could not be found. Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:26.517402 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:26.525581 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:26.525581 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:26.525581 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:26.525581 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:03:26.525581 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:03:26.525581 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7094f480-111a-4c4e-8a77-2df578c044c0 could not be found. Aug 04 17:03:26.525581 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:26.527869 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a4334bd0-04fc-42d6-97af-4486f4148302 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] Returning 404 to user: Instance 7094f480-111a-4c4e-8a77-2df578c044c0 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:26.530289 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a4334bd0-04fc-42d6-97af-4486f4148302 tempest-ServersNegativeTestJSON-946891663 tempest-ServersNegativeTestJSON-946891663-project] 10.222.0.23 "GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0" status: 404 len: 111 microversion: 2.1 time: 0.117533 Aug 04 17:03:26.533351 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2537/5172] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:26 2022] GET /compute/v2.1/servers/7094f480-111a-4c4e-8a77-2df578c044c0 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:03:26.589605 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-af18f2d6-4b81-4be6-ae3d-10639a027596 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:26.593449 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=95,nova_cell1:DELETE=1,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:03:26.604163 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-af18f2d6-4b81-4be6-ae3d-10639a027596 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1169 microversion: 2.1 time: 0.810422 Aug 04 17:03:26.607050 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2636/5173] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:25 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1169 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:26.768484 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7c23bfea-ddf4-40dc-86a9-3d82e634a924 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:26.770022 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7c23bfea-ddf4-40dc-86a9-3d82e634a924 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:26.802362 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7c23bfea-ddf4-40dc-86a9-3d82e634a924 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:26.806473 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7c23bfea-ddf4-40dc-86a9-3d82e634a924 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:26.814678 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7c23bfea-ddf4-40dc-86a9-3d82e634a924 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:26.816773 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7c23bfea-ddf4-40dc-86a9-3d82e634a924 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:27.431446 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7c23bfea-ddf4-40dc-86a9-3d82e634a924 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:27.496556 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7c23bfea-ddf4-40dc-86a9-3d82e634a924 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:27.509418 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7c23bfea-ddf4-40dc-86a9-3d82e634a924 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:27.525085 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7c23bfea-ddf4-40dc-86a9-3d82e634a924 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1740 microversion: 2.20 time: 0.759082 Aug 04 17:03:27.557128 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2538/5174] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:26 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1740 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:27.640367 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b2375a6c-8e9f-4dda-9972-5277bb196675 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:27.641145 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b2375a6c-8e9f-4dda-9972-5277bb196675 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:27.668598 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2375a6c-8e9f-4dda-9972-5277bb196675 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:27.669125 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2375a6c-8e9f-4dda-9972-5277bb196675 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:27.670083 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2375a6c-8e9f-4dda-9972-5277bb196675 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:27.670725 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2375a6c-8e9f-4dda-9972-5277bb196675 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:28.224647 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b2375a6c-8e9f-4dda-9972-5277bb196675 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:28.243439 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b2375a6c-8e9f-4dda-9972-5277bb196675 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1169 microversion: 2.1 time: 0.609354 Aug 04 17:03:28.271388 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2637/5175] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:27 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1169 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:28.647444 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-30748d2a-5c11-443e-be18-5c91d3b12ab3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:28.648347 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-30748d2a-5c11-443e-be18-5c91d3b12ab3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:28.707734 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-30748d2a-5c11-443e-be18-5c91d3b12ab3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:28.708770 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-30748d2a-5c11-443e-be18-5c91d3b12ab3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:28.717497 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-30748d2a-5c11-443e-be18-5c91d3b12ab3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:28.718533 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-30748d2a-5c11-443e-be18-5c91d3b12ab3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:29.157674 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-30748d2a-5c11-443e-be18-5c91d3b12ab3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:29.172850 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-30748d2a-5c11-443e-be18-5c91d3b12ab3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:29.177739 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-30748d2a-5c11-443e-be18-5c91d3b12ab3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:29.180420 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-30748d2a-5c11-443e-be18-5c91d3b12ab3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1740 microversion: 2.20 time: 0.543439 Aug 04 17:03:29.194315 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2539/5176] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:28 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1740 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:29.278569 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bd011e1a-cd1b-4747-9cde-957084e2be6f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:29.280211 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bd011e1a-cd1b-4747-9cde-957084e2be6f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:29.311731 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bd011e1a-cd1b-4747-9cde-957084e2be6f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:29.319491 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bd011e1a-cd1b-4747-9cde-957084e2be6f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:29.321568 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bd011e1a-cd1b-4747-9cde-957084e2be6f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:29.326206 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bd011e1a-cd1b-4747-9cde-957084e2be6f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:30.210654 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f36d0dea-c2e0-4282-a055-bfe64671c98d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:30.211273 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f36d0dea-c2e0-4282-a055-bfe64671c98d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:30.236835 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f36d0dea-c2e0-4282-a055-bfe64671c98d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:30.237635 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f36d0dea-c2e0-4282-a055-bfe64671c98d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:30.242117 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f36d0dea-c2e0-4282-a055-bfe64671c98d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:30.243565 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f36d0dea-c2e0-4282-a055-bfe64671c98d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:31.456195 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bd011e1a-cd1b-4747-9cde-957084e2be6f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:31.495277 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bd011e1a-cd1b-4747-9cde-957084e2be6f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1169 microversion: 2.1 time: 2.218161 Aug 04 17:03:31.505488 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2638/5177] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:29 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1169 bytes in 2233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:31.533812 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a66477ae-b72b-4b1c-a2eb-ca04078ba0c1 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:31.534716 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a66477ae-b72b-4b1c-a2eb-ca04078ba0c1 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 0063f3a7-735d-438e-a375-3b2a83bef991] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:31.553234 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a66477ae-b72b-4b1c-a2eb-ca04078ba0c1 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:31.553716 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a66477ae-b72b-4b1c-a2eb-ca04078ba0c1 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:31.554510 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a66477ae-b72b-4b1c-a2eb-ca04078ba0c1 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:31.554946 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a66477ae-b72b-4b1c-a2eb-ca04078ba0c1 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:31.617425 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-a66477ae-b72b-4b1c-a2eb-ca04078ba0c1 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] HTTP exception thrown: Instance 0063f3a7-735d-438e-a375-3b2a83bef991 could not be found. Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a66477ae-b72b-4b1c-a2eb-ca04078ba0c1 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Request method failure captured: Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991 HTTP/1.1 Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_owNKx0pHV40nqVD-WIcaXEsXOBwQHOEMAVVk2fno070nDFXZRZhhzMgTy8HlVP1AOBt469MYWC_AbeQLbAvgivtdjrTsmGymGu6AtGEk3CEKRMIDLRIpky1rxw9eTh6mgckU3tnNoFbB2in__O_4k2BxkTMZllLYaubH7EDDeTWL4 Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 2534921e8a2f47d394059fee872426a8 Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-AttachVolumeNegativeTest-410766221 Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2534921e8a2f47d394059fee872426a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2534921e8a2f47d394059fee872426a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2534921e8a2f47d394059fee872426a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2534921e8a2f47d394059fee872426a8"}]}] Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-AttachVolumeNegativeTest-410766221 Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 2534921e8a2f47d394059fee872426a8 Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-410766221 Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-AttachVolumeNegativeTest-410766221-project Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: d82f4a672b154291a412a282d1a88208 Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-AttachVolumeNegativeTest-410766221-project Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 0063f3a7-735d-438e-a375-3b2a83bef991 could not be found. Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '0063f3a7-735d-438e-a375-3b2a83bef991'} Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0063f3a7-735d-438e-a375-3b2a83bef991 could not be found. Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:03:31.619072 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:03:31.624344 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0063f3a7-735d-438e-a375-3b2a83bef991 could not be found. Aug 04 17:03:31.624344 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:31.624344 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:31.624344 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:31.624344 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:31.624344 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:31.624344 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:31.624344 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:03:31.624344 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:03:31.624344 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0063f3a7-735d-438e-a375-3b2a83bef991 could not be found. Aug 04 17:03:31.624344 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:31.624344 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a66477ae-b72b-4b1c-a2eb-ca04078ba0c1 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Returning 404 to user: Instance 0063f3a7-735d-438e-a375-3b2a83bef991 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:31.625249 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a66477ae-b72b-4b1c-a2eb-ca04078ba0c1 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991" status: 404 len: 111 microversion: 2.1 time: 0.091456 Aug 04 17:03:31.625249 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2639/5178] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:03:31 2022] DELETE /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:03:31.635183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ab40af11-cfd2-4fa4-b4ae-a8edfbf68d45 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:31.635798 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ab40af11-cfd2-4fa4-b4ae-a8edfbf68d45 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 0063f3a7-735d-438e-a375-3b2a83bef991] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:31.655259 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab40af11-cfd2-4fa4-b4ae-a8edfbf68d45 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:31.655706 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab40af11-cfd2-4fa4-b4ae-a8edfbf68d45 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:31.656487 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab40af11-cfd2-4fa4-b4ae-a8edfbf68d45 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:31.656920 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ab40af11-cfd2-4fa4-b4ae-a8edfbf68d45 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:31.706427 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-ab40af11-cfd2-4fa4-b4ae-a8edfbf68d45 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] HTTP exception thrown: Instance 0063f3a7-735d-438e-a375-3b2a83bef991 could not be found. Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ab40af11-cfd2-4fa4-b4ae-a8edfbf68d45 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Request method failure captured: Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991 HTTP/1.1 Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_owNKx0pHV40nqVD-WIcaXEsXOBwQHOEMAVVk2fno070nDFXZRZhhzMgTy8HlVP1AOBt469MYWC_AbeQLbAvgivtdjrTsmGymGu6AtGEk3CEKRMIDLRIpky1rxw9eTh6mgckU3tnNoFbB2in__O_4k2BxkTMZllLYaubH7EDDeTWL4 Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 2534921e8a2f47d394059fee872426a8 Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-AttachVolumeNegativeTest-410766221 Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2534921e8a2f47d394059fee872426a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2534921e8a2f47d394059fee872426a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2534921e8a2f47d394059fee872426a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2534921e8a2f47d394059fee872426a8"}]}] Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-AttachVolumeNegativeTest-410766221 Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 2534921e8a2f47d394059fee872426a8 Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-410766221 Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-AttachVolumeNegativeTest-410766221-project Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: d82f4a672b154291a412a282d1a88208 Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-AttachVolumeNegativeTest-410766221-project Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 0063f3a7-735d-438e-a375-3b2a83bef991 could not be found. Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '0063f3a7-735d-438e-a375-3b2a83bef991'} Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0063f3a7-735d-438e-a375-3b2a83bef991 could not be found. Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0063f3a7-735d-438e-a375-3b2a83bef991 could not be found. Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:31.712288 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:31.719886 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:31.719886 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:31.719886 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:31.719886 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:03:31.719886 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:03:31.719886 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0063f3a7-735d-438e-a375-3b2a83bef991 could not be found. Aug 04 17:03:31.719886 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:31.719886 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ab40af11-cfd2-4fa4-b4ae-a8edfbf68d45 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Returning 404 to user: Instance 0063f3a7-735d-438e-a375-3b2a83bef991 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:31.719886 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ab40af11-cfd2-4fa4-b4ae-a8edfbf68d45 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991" status: 404 len: 111 microversion: 2.1 time: 0.087652 Aug 04 17:03:31.719886 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2640/5179] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:31 2022] GET /compute/v2.1/servers/0063f3a7-735d-438e-a375-3b2a83bef991 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:03:31.732842 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f323cb11-35de-4f46-98dd-4952d12dd030 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:31.735779 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f323cb11-35de-4f46-98dd-4952d12dd030 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: e27ae6f5-5037-4714-b781-224113fa0859] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:31.764710 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f323cb11-35de-4f46-98dd-4952d12dd030 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:31.766462 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f323cb11-35de-4f46-98dd-4952d12dd030 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:31.767364 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f323cb11-35de-4f46-98dd-4952d12dd030 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:31.773320 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f323cb11-35de-4f46-98dd-4952d12dd030 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:31.822784 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-f323cb11-35de-4f46-98dd-4952d12dd030 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] HTTP exception thrown: Instance e27ae6f5-5037-4714-b781-224113fa0859 could not be found. Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f323cb11-35de-4f46-98dd-4952d12dd030 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Request method failure captured: Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859 HTTP/1.1 Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_owNKx0pHV40nqVD-WIcaXEsXOBwQHOEMAVVk2fno070nDFXZRZhhzMgTy8HlVP1AOBt469MYWC_AbeQLbAvgivtdjrTsmGymGu6AtGEk3CEKRMIDLRIpky1rxw9eTh6mgckU3tnNoFbB2in__O_4k2BxkTMZllLYaubH7EDDeTWL4 Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 2534921e8a2f47d394059fee872426a8 Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-AttachVolumeNegativeTest-410766221 Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2534921e8a2f47d394059fee872426a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2534921e8a2f47d394059fee872426a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2534921e8a2f47d394059fee872426a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2534921e8a2f47d394059fee872426a8"}]}] Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-AttachVolumeNegativeTest-410766221 Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 2534921e8a2f47d394059fee872426a8 Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-410766221 Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-AttachVolumeNegativeTest-410766221-project Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: d82f4a672b154291a412a282d1a88208 Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-AttachVolumeNegativeTest-410766221-project Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance e27ae6f5-5037-4714-b781-224113fa0859 could not be found. Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'e27ae6f5-5037-4714-b781-224113fa0859'} Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e27ae6f5-5037-4714-b781-224113fa0859 could not be found. Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:03:31.827699 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:03:31.833834 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e27ae6f5-5037-4714-b781-224113fa0859 could not be found. Aug 04 17:03:31.833834 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:31.833834 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:31.833834 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:31.833834 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:31.833834 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:31.833834 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:31.833834 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:03:31.833834 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:03:31.833834 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e27ae6f5-5037-4714-b781-224113fa0859 could not be found. Aug 04 17:03:31.833834 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:31.837262 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f323cb11-35de-4f46-98dd-4952d12dd030 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Returning 404 to user: Instance e27ae6f5-5037-4714-b781-224113fa0859 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:31.841134 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f323cb11-35de-4f46-98dd-4952d12dd030 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859" status: 404 len: 111 microversion: 2.1 time: 0.116629 Aug 04 17:03:31.841951 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2641/5180] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:03:31 2022] DELETE /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:03:31.858719 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-009355fe-f08b-4018-9e2d-f846ab79bb93 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:31.859774 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-009355fe-f08b-4018-9e2d-f846ab79bb93 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: e27ae6f5-5037-4714-b781-224113fa0859] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:31.878030 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-009355fe-f08b-4018-9e2d-f846ab79bb93 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:31.878690 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-009355fe-f08b-4018-9e2d-f846ab79bb93 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:31.881573 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-009355fe-f08b-4018-9e2d-f846ab79bb93 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:31.882583 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-009355fe-f08b-4018-9e2d-f846ab79bb93 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:31.891490 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f36d0dea-c2e0-4282-a055-bfe64671c98d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:31.904021 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f36d0dea-c2e0-4282-a055-bfe64671c98d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:31.914868 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f36d0dea-c2e0-4282-a055-bfe64671c98d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:31.921317 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f36d0dea-c2e0-4282-a055-bfe64671c98d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1740 microversion: 2.20 time: 1.714518 Aug 04 17:03:31.922332 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-009355fe-f08b-4018-9e2d-f846ab79bb93 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] HTTP exception thrown: Instance e27ae6f5-5037-4714-b781-224113fa0859 could not be found. Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-009355fe-f08b-4018-9e2d-f846ab79bb93 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Request method failure captured: Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859 HTTP/1.1 Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_owNKx0pHV40nqVD-WIcaXEsXOBwQHOEMAVVk2fno070nDFXZRZhhzMgTy8HlVP1AOBt469MYWC_AbeQLbAvgivtdjrTsmGymGu6AtGEk3CEKRMIDLRIpky1rxw9eTh6mgckU3tnNoFbB2in__O_4k2BxkTMZllLYaubH7EDDeTWL4 Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 2534921e8a2f47d394059fee872426a8 Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-AttachVolumeNegativeTest-410766221 Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2534921e8a2f47d394059fee872426a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2534921e8a2f47d394059fee872426a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2534921e8a2f47d394059fee872426a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2534921e8a2f47d394059fee872426a8"}]}] Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-AttachVolumeNegativeTest-410766221 Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 2534921e8a2f47d394059fee872426a8 Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-410766221 Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-AttachVolumeNegativeTest-410766221-project Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: d82f4a672b154291a412a282d1a88208 Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-AttachVolumeNegativeTest-410766221-project Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance e27ae6f5-5037-4714-b781-224113fa0859 could not be found. Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'e27ae6f5-5037-4714-b781-224113fa0859'} Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e27ae6f5-5037-4714-b781-224113fa0859 could not be found. Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e27ae6f5-5037-4714-b781-224113fa0859 could not be found. Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:31.926005 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:31.932042 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:31.932042 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:31.932042 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:31.932042 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:03:31.932042 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:03:31.932042 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e27ae6f5-5037-4714-b781-224113fa0859 could not be found. Aug 04 17:03:31.932042 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:31.932731 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2540/5181] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:30 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1740 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:31.935162 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-009355fe-f08b-4018-9e2d-f846ab79bb93 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Returning 404 to user: Instance e27ae6f5-5037-4714-b781-224113fa0859 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:31.937550 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-009355fe-f08b-4018-9e2d-f846ab79bb93 tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859" status: 404 len: 111 microversion: 2.1 time: 0.089854 Aug 04 17:03:31.938638 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2642/5182] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:31 2022] GET /compute/v2.1/servers/e27ae6f5-5037-4714-b781-224113fa0859 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:03:32.535235 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d3d10d9d-f94d-4f28-a459-123f81d2a837 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:32.536233 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d3d10d9d-f94d-4f28-a459-123f81d2a837 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:32.556258 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d3d10d9d-f94d-4f28-a459-123f81d2a837 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:32.556714 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d3d10d9d-f94d-4f28-a459-123f81d2a837 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:32.557537 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d3d10d9d-f94d-4f28-a459-123f81d2a837 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:32.572350 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d3d10d9d-f94d-4f28-a459-123f81d2a837 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:32.957812 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-56125c16-d4d5-43c7-b4c9-7cdeba881b2e tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:32.958386 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-56125c16-d4d5-43c7-b4c9-7cdeba881b2e tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:32.974448 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-56125c16-d4d5-43c7-b4c9-7cdeba881b2e tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:32.974891 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-56125c16-d4d5-43c7-b4c9-7cdeba881b2e tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:32.983540 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-56125c16-d4d5-43c7-b4c9-7cdeba881b2e tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:32.984263 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-56125c16-d4d5-43c7-b4c9-7cdeba881b2e tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:33.019952 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d3d10d9d-f94d-4f28-a459-123f81d2a837 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:33.031687 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d3d10d9d-f94d-4f28-a459-123f81d2a837 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1169 microversion: 2.1 time: 0.501834 Aug 04 17:03:33.032309 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2541/5183] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:32 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1169 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:33.333808 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-56125c16-d4d5-43c7-b4c9-7cdeba881b2e tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:33.346126 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-56125c16-d4d5-43c7-b4c9-7cdeba881b2e tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:33.349822 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-56125c16-d4d5-43c7-b4c9-7cdeba881b2e tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:33.351963 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-56125c16-d4d5-43c7-b4c9-7cdeba881b2e tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1740 microversion: 2.20 time: 0.399525 Aug 04 17:03:33.366238 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2643/5184] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:32 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1740 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:03:34.068566 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2c5a093c-9c4b-4056-959a-c79d8a5680a4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:34.069430 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2c5a093c-9c4b-4056-959a-c79d8a5680a4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:34.211944 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2c5a093c-9c4b-4056-959a-c79d8a5680a4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:34.212395 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2c5a093c-9c4b-4056-959a-c79d8a5680a4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:34.213193 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2c5a093c-9c4b-4056-959a-c79d8a5680a4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:34.227958 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2c5a093c-9c4b-4056-959a-c79d8a5680a4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:34.399409 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8be99205-7eac-4f48-8b19-3e0d4aa56c74 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:34.400452 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8be99205-7eac-4f48-8b19-3e0d4aa56c74 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:34.431887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8be99205-7eac-4f48-8b19-3e0d4aa56c74 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:34.432665 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8be99205-7eac-4f48-8b19-3e0d4aa56c74 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:34.433402 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8be99205-7eac-4f48-8b19-3e0d4aa56c74 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:34.433775 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8be99205-7eac-4f48-8b19-3e0d4aa56c74 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:34.924786 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2c5a093c-9c4b-4056-959a-c79d8a5680a4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:34.935487 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2c5a093c-9c4b-4056-959a-c79d8a5680a4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1169 microversion: 2.1 time: 0.882994 Aug 04 17:03:34.938340 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2542/5185] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:34 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1169 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:35.087196 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8be99205-7eac-4f48-8b19-3e0d4aa56c74 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:35.102382 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8be99205-7eac-4f48-8b19-3e0d4aa56c74 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:35.107685 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8be99205-7eac-4f48-8b19-3e0d4aa56c74 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:35.123154 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8be99205-7eac-4f48-8b19-3e0d4aa56c74 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1740 microversion: 2.20 time: 0.733723 Aug 04 17:03:35.124097 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2644/5186] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:34 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1740 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:35.959580 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d5b70298-ab28-4eff-b0c6-eb8ba2c88153 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:35.960228 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d5b70298-ab28-4eff-b0c6-eb8ba2c88153 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:35.981384 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d5b70298-ab28-4eff-b0c6-eb8ba2c88153 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:35.981910 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d5b70298-ab28-4eff-b0c6-eb8ba2c88153 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:35.995130 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d5b70298-ab28-4eff-b0c6-eb8ba2c88153 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:35.995130 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d5b70298-ab28-4eff-b0c6-eb8ba2c88153 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:36.159051 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-611645ec-36b8-4ed7-939a-f30cd14234b2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:36.159829 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-611645ec-36b8-4ed7-939a-f30cd14234b2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:36.175824 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-611645ec-36b8-4ed7-939a-f30cd14234b2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:36.178555 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-611645ec-36b8-4ed7-939a-f30cd14234b2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:36.179469 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-611645ec-36b8-4ed7-939a-f30cd14234b2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:36.186335 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-611645ec-36b8-4ed7-939a-f30cd14234b2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:36.489529 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d5b70298-ab28-4eff-b0c6-eb8ba2c88153 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:36.503869 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d5b70298-ab28-4eff-b0c6-eb8ba2c88153 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1169 microversion: 2.1 time: 0.549388 Aug 04 17:03:36.504483 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2543/5187] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:35 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1169 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:36.630756 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-611645ec-36b8-4ed7-939a-f30cd14234b2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:36.640024 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-611645ec-36b8-4ed7-939a-f30cd14234b2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:36.642132 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-611645ec-36b8-4ed7-939a-f30cd14234b2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:36.643730 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-611645ec-36b8-4ed7-939a-f30cd14234b2 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1740 microversion: 2.20 time: 0.492728 Aug 04 17:03:36.644513 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2645/5188] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:36 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1740 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:37.528617 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7c443943-0865-4bd3-817c-5c671d334ee6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:37.529699 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7c443943-0865-4bd3-817c-5c671d334ee6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:37.533004 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:03:37.552315 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7c443943-0865-4bd3-817c-5c671d334ee6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:37.554963 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7c443943-0865-4bd3-817c-5c671d334ee6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:37.559712 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7c443943-0865-4bd3-817c-5c671d334ee6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:37.560368 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7c443943-0865-4bd3-817c-5c671d334ee6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:37.685359 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dd8918b6-5a4a-4473-8fd8-31ca3d11cf50 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:37.686664 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dd8918b6-5a4a-4473-8fd8-31ca3d11cf50 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:37.747905 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dd8918b6-5a4a-4473-8fd8-31ca3d11cf50 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:37.747905 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dd8918b6-5a4a-4473-8fd8-31ca3d11cf50 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:37.750416 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dd8918b6-5a4a-4473-8fd8-31ca3d11cf50 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:37.750893 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dd8918b6-5a4a-4473-8fd8-31ca3d11cf50 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:38.336542 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dd8918b6-5a4a-4473-8fd8-31ca3d11cf50 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:38.353222 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dd8918b6-5a4a-4473-8fd8-31ca3d11cf50 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:38.371161 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dd8918b6-5a4a-4473-8fd8-31ca3d11cf50 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:38.375269 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dd8918b6-5a4a-4473-8fd8-31ca3d11cf50 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1740 microversion: 2.20 time: 0.696605 Aug 04 17:03:38.387407 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2646/5189] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:37 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1740 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:38.435713 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7c443943-0865-4bd3-817c-5c671d334ee6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:38.444541 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7c443943-0865-4bd3-817c-5c671d334ee6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1169 microversion: 2.1 time: 0.923604 Aug 04 17:03:38.451429 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2544/5190] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:37 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1169 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:03:39.412032 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-247dc894-4bd1-4c3b-8bf4-ec54e7863042 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:39.413960 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-247dc894-4bd1-4c3b-8bf4-ec54e7863042 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:39.443557 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-247dc894-4bd1-4c3b-8bf4-ec54e7863042 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:39.449827 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-247dc894-4bd1-4c3b-8bf4-ec54e7863042 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:39.456060 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-247dc894-4bd1-4c3b-8bf4-ec54e7863042 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:39.459211 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-247dc894-4bd1-4c3b-8bf4-ec54e7863042 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:39.468569 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7c2a2d0d-c48e-4b3f-a661-323009771fa0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:39.470500 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7c2a2d0d-c48e-4b3f-a661-323009771fa0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:39.512780 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7c2a2d0d-c48e-4b3f-a661-323009771fa0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:39.517471 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7c2a2d0d-c48e-4b3f-a661-323009771fa0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:39.530996 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7c2a2d0d-c48e-4b3f-a661-323009771fa0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:39.532227 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7c2a2d0d-c48e-4b3f-a661-323009771fa0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:40.139963 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7c2a2d0d-c48e-4b3f-a661-323009771fa0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:40.157778 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7c2a2d0d-c48e-4b3f-a661-323009771fa0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1169 microversion: 2.1 time: 0.692633 Aug 04 17:03:40.159372 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2545/5191] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:39 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1169 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:03:40.199625 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-247dc894-4bd1-4c3b-8bf4-ec54e7863042 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:40.216479 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-247dc894-4bd1-4c3b-8bf4-ec54e7863042 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:40.219370 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-247dc894-4bd1-4c3b-8bf4-ec54e7863042 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:40.225687 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-247dc894-4bd1-4c3b-8bf4-ec54e7863042 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1740 microversion: 2.20 time: 0.816328 Aug 04 17:03:40.229640 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2647/5192] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:39 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1740 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:41.179788 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f7c91e15-9690-44d6-9b8e-489ed26e220a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:41.180391 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f7c91e15-9690-44d6-9b8e-489ed26e220a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:41.201207 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f7c91e15-9690-44d6-9b8e-489ed26e220a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:41.201839 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f7c91e15-9690-44d6-9b8e-489ed26e220a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:41.202750 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f7c91e15-9690-44d6-9b8e-489ed26e220a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:41.203366 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f7c91e15-9690-44d6-9b8e-489ed26e220a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:41.259217 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-305905e1-67db-4635-83f7-19b8226cd981 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:41.260478 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-305905e1-67db-4635-83f7-19b8226cd981 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:41.274171 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-305905e1-67db-4635-83f7-19b8226cd981 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:41.276030 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-305905e1-67db-4635-83f7-19b8226cd981 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:41.276880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-305905e1-67db-4635-83f7-19b8226cd981 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:41.277341 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-305905e1-67db-4635-83f7-19b8226cd981 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:41.803019 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-305905e1-67db-4635-83f7-19b8226cd981 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:41.811362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-305905e1-67db-4635-83f7-19b8226cd981 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:41.812894 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-305905e1-67db-4635-83f7-19b8226cd981 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:41.814126 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-305905e1-67db-4635-83f7-19b8226cd981 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1722 microversion: 2.20 time: 0.560076 Aug 04 17:03:41.814803 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2648/5193] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:41 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1722 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:03:41.837581 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-707bd54c-bc20-4117-a143-f750aa855a2d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:41.838085 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-707bd54c-bc20-4117-a143-f750aa855a2d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 760130d2-374e-4f4c-a73b-d7a99449e324] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:41.865999 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-707bd54c-bc20-4117-a143-f750aa855a2d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:41.866688 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-707bd54c-bc20-4117-a143-f750aa855a2d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:41.867686 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-707bd54c-bc20-4117-a143-f750aa855a2d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:41.868416 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-707bd54c-bc20-4117-a143-f750aa855a2d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:41.879628 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f7c91e15-9690-44d6-9b8e-489ed26e220a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:41.891097 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f7c91e15-9690-44d6-9b8e-489ed26e220a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1169 microversion: 2.1 time: 0.715063 Aug 04 17:03:41.891694 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2546/5194] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:41 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1169 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:41.922685 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-707bd54c-bc20-4117-a143-f750aa855a2d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] HTTP exception thrown: Instance 760130d2-374e-4f4c-a73b-d7a99449e324 could not be found. Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-707bd54c-bc20-4117-a143-f750aa855a2d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Request method failure captured: Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324 HTTP/1.1 Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_owNKx0pHV40nqVD-WIcaXEsXOBwQHOEMAVVk2fno070nDFXZRZhhzMgTy8HlVP1AOBt469MYWC_AbeQLbAvgivtdjrTsmGymGu6AtGEk3CEKRMIDLRIpky1rxw9eTh6mgckU3tnNoFbB2in__O_4k2BxkTMZllLYaubH7EDDeTWL4 Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 2534921e8a2f47d394059fee872426a8 Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-AttachVolumeNegativeTest-410766221 Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2534921e8a2f47d394059fee872426a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2534921e8a2f47d394059fee872426a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2534921e8a2f47d394059fee872426a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2534921e8a2f47d394059fee872426a8"}]}] Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-AttachVolumeNegativeTest-410766221 Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 2534921e8a2f47d394059fee872426a8 Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-410766221 Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-AttachVolumeNegativeTest-410766221-project Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: d82f4a672b154291a412a282d1a88208 Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-AttachVolumeNegativeTest-410766221-project Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 760130d2-374e-4f4c-a73b-d7a99449e324 could not be found. Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '760130d2-374e-4f4c-a73b-d7a99449e324'} Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 760130d2-374e-4f4c-a73b-d7a99449e324 could not be found. Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:03:41.925648 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:03:41.932359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 760130d2-374e-4f4c-a73b-d7a99449e324 could not be found. Aug 04 17:03:41.932359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:41.932359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:41.932359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:41.932359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:41.932359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:41.932359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:41.932359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:03:41.932359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:03:41.932359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 760130d2-374e-4f4c-a73b-d7a99449e324 could not be found. Aug 04 17:03:41.932359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:41.934734 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-707bd54c-bc20-4117-a143-f750aa855a2d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Returning 404 to user: Instance 760130d2-374e-4f4c-a73b-d7a99449e324 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:41.935912 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-707bd54c-bc20-4117-a143-f750aa855a2d tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "DELETE /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324" status: 404 len: 111 microversion: 2.1 time: 0.120192 Aug 04 17:03:41.946122 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2649/5195] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:03:41 2022] DELETE /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:03:41.956295 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2beff42c-2dbe-41d0-801f-16dc1d55d49a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:41.956904 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2beff42c-2dbe-41d0-801f-16dc1d55d49a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] [instance: 760130d2-374e-4f4c-a73b-d7a99449e324] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:41.973700 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2beff42c-2dbe-41d0-801f-16dc1d55d49a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:41.974404 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2beff42c-2dbe-41d0-801f-16dc1d55d49a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:41.975187 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2beff42c-2dbe-41d0-801f-16dc1d55d49a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:41.975611 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2beff42c-2dbe-41d0-801f-16dc1d55d49a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:42.011065 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-2beff42c-2dbe-41d0-801f-16dc1d55d49a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] HTTP exception thrown: Instance 760130d2-374e-4f4c-a73b-d7a99449e324 could not be found. Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2beff42c-2dbe-41d0-801f-16dc1d55d49a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Request method failure captured: Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324 HTTP/1.1 Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_owNKx0pHV40nqVD-WIcaXEsXOBwQHOEMAVVk2fno070nDFXZRZhhzMgTy8HlVP1AOBt469MYWC_AbeQLbAvgivtdjrTsmGymGu6AtGEk3CEKRMIDLRIpky1rxw9eTh6mgckU3tnNoFbB2in__O_4k2BxkTMZllLYaubH7EDDeTWL4 Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 2534921e8a2f47d394059fee872426a8 Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-AttachVolumeNegativeTest-410766221 Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2534921e8a2f47d394059fee872426a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2534921e8a2f47d394059fee872426a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2534921e8a2f47d394059fee872426a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2534921e8a2f47d394059fee872426a8"}]}] Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-AttachVolumeNegativeTest-410766221 Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 2534921e8a2f47d394059fee872426a8 Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-410766221 Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-AttachVolumeNegativeTest-410766221-project Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: d82f4a672b154291a412a282d1a88208 Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-AttachVolumeNegativeTest-410766221-project Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 760130d2-374e-4f4c-a73b-d7a99449e324 could not be found. Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '760130d2-374e-4f4c-a73b-d7a99449e324'} Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 760130d2-374e-4f4c-a73b-d7a99449e324 could not be found. Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 760130d2-374e-4f4c-a73b-d7a99449e324 could not be found. Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:42.027876 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:42.035334 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:42.035334 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:42.035334 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:42.035334 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:03:42.035334 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:03:42.035334 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 760130d2-374e-4f4c-a73b-d7a99449e324 could not be found. Aug 04 17:03:42.035334 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:42.035334 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2beff42c-2dbe-41d0-801f-16dc1d55d49a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] Returning 404 to user: Instance 760130d2-374e-4f4c-a73b-d7a99449e324 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:42.035334 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2beff42c-2dbe-41d0-801f-16dc1d55d49a tempest-AttachVolumeNegativeTest-410766221 tempest-AttachVolumeNegativeTest-410766221-project] 10.222.0.23 "GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324" status: 404 len: 111 microversion: 2.1 time: 0.079317 Aug 04 17:03:42.035334 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2547/5196] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:41 2022] GET /compute/v2.1/servers/760130d2-374e-4f4c-a73b-d7a99449e324 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:03:42.844153 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b3ca8f0a-5085-45f1-857f-ee24a9d328bd tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:42.845732 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b3ca8f0a-5085-45f1-857f-ee24a9d328bd tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:42.868451 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b3ca8f0a-5085-45f1-857f-ee24a9d328bd tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:42.872008 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b3ca8f0a-5085-45f1-857f-ee24a9d328bd tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:42.872953 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b3ca8f0a-5085-45f1-857f-ee24a9d328bd tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:42.873268 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b3ca8f0a-5085-45f1-857f-ee24a9d328bd tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:42.924540 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-65bb91d6-99ac-4190-a320-1d70b1e9a18f tempest-VolumesNegativeTest-261559860 tempest-VolumesNegativeTest-261559860-project] Action: 'create', calling method: .version_select at 0x7f7e89cd1ee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-564314253", "metadata": {"Type": "work"}}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-65bb91d6-99ac-4190-a320-1d70b1e9a18f tempest-VolumesNegativeTest-261559860 tempest-VolumesNegativeTest-261559860-project] Request method failure captured: Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 121 Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_vu7lYW661ALfApiZ0Vog3S47OGStrxRW8h7lHGjhXBbP5Gt9X3E0jnrF0wPpBvqVNWg4VDQ6UIqzUJC_Jjj8VB_REdYRIMiqN1yESCnuPKnS8vdzQHsq3iO4k4EeBobRwQn3H0NBYCh8iFMAeU9yr9NeP-HUkYLUu-Wy3ARuONJaE Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 6c4433df998c4e7f8e9f71318f6c518f Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-VolumesNegativeTest-261559860 Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6c4433df998c4e7f8e9f71318f6c518f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6c4433df998c4e7f8e9f71318f6c518f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6c4433df998c4e7f8e9f71318f6c518f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6c4433df998c4e7f8e9f71318f6c518f"}]}] Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-VolumesNegativeTest-261559860 Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 6c4433df998c4e7f8e9f71318f6c518f Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-VolumesNegativeTest-261559860 Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-VolumesNegativeTest-261559860-project Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 047d2849623e4cfb8f5d42cda0fcb18c Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-VolumesNegativeTest-261559860-project Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-564314253", "metadata": {"Type": "work"}}} Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-564314253', 'metadata': {'Type': 'work'}}}} Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi '#$%' Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:03:42.928746 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:03:42.936780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 17:03:42.936780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:42.936780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:42.936780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:42.936780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:42.936780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:42.936780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:42.936780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:03:42.936780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:03:42.936780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 17:03:42.936780 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:42.936780 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-65bb91d6-99ac-4190-a320-1d70b1e9a18f tempest-VolumesNegativeTest-261559860 tempest-VolumesNegativeTest-261559860-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:42.936780 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-65bb91d6-99ac-4190-a320-1d70b1e9a18f tempest-VolumesNegativeTest-261559860 tempest-VolumesNegativeTest-261559860-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.220979 Aug 04 17:03:42.936780 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2650/5197] 10.222.0.23 () {60 vars in 1156 bytes} [Thu Aug 4 17:03:42 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 223 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:03:42.940187 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fcdd4ef2-7126-4130-8a68-4fa550d7f5c2 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:42.941542 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fcdd4ef2-7126-4130-8a68-4fa550d7f5c2 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:42.948747 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fcdd4ef2-7126-4130-8a68-4fa550d7f5c2 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:42.949255 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fcdd4ef2-7126-4130-8a68-4fa550d7f5c2 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:42.950124 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fcdd4ef2-7126-4130-8a68-4fa550d7f5c2 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:42.950613 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fcdd4ef2-7126-4130-8a68-4fa550d7f5c2 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:43.200699 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fcdd4ef2-7126-4130-8a68-4fa550d7f5c2 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:43.212473 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fcdd4ef2-7126-4130-8a68-4fa550d7f5c2 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1169 microversion: 2.1 time: 0.278661 Aug 04 17:03:43.219813 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2651/5198] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:42 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1169 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:43.227175 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-11f25dba-1074-473c-a7b5-4994d5cce930 tempest-VolumesNegativeTest-261559860 tempest-VolumesNegativeTest-261559860-project] Action: 'create', calling method: .version_select at 0x7f7e770f2280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1918866499", "metadata": {"Type": "work"}}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-11f25dba-1074-473c-a7b5-4994d5cce930 tempest-VolumesNegativeTest-261559860 tempest-VolumesNegativeTest-261559860-project] Request method failure captured: Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 120 Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_vu7lYW661ALfApiZ0Vog3S47OGStrxRW8h7lHGjhXBbP5Gt9X3E0jnrF0wPpBvqVNWg4VDQ6UIqzUJC_Jjj8VB_REdYRIMiqN1yESCnuPKnS8vdzQHsq3iO4k4EeBobRwQn3H0NBYCh8iFMAeU9yr9NeP-HUkYLUu-Wy3ARuONJaE Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 6c4433df998c4e7f8e9f71318f6c518f Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-VolumesNegativeTest-261559860 Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6c4433df998c4e7f8e9f71318f6c518f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6c4433df998c4e7f8e9f71318f6c518f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6c4433df998c4e7f8e9f71318f6c518f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6c4433df998c4e7f8e9f71318f6c518f"}]}] Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-VolumesNegativeTest-261559860 Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 6c4433df998c4e7f8e9f71318f6c518f Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-VolumesNegativeTest-261559860 Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-VolumesNegativeTest-261559860-project Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 047d2849623e4cfb8f5d42cda0fcb18c Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-VolumesNegativeTest-261559860-project Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1918866499", "metadata": {"Type": "work"}}} Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1918866499', 'metadata': {'Type': 'work'}}}} Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi '0' Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:03:43.235552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:03:43.240898 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 17:03:43.240898 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:43.240898 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:43.240898 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:43.240898 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:43.240898 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:43.240898 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:43.240898 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:03:43.240898 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:03:43.240898 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 17:03:43.240898 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:43.240898 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-11f25dba-1074-473c-a7b5-4994d5cce930 tempest-VolumesNegativeTest-261559860 tempest-VolumesNegativeTest-261559860-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:43.253927 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-11f25dba-1074-473c-a7b5-4994d5cce930 tempest-VolumesNegativeTest-261559860 tempest-VolumesNegativeTest-261559860-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.020236 Aug 04 17:03:43.254629 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2652/5199] 10.222.0.23 () {60 vars in 1156 bytes} [Thu Aug 4 17:03:43 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:03:43.270845 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b3ca8f0a-5085-45f1-857f-ee24a9d328bd tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:43.271213 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-85c6e9e1-68f0-4a7a-bac4-45a5b70155d3 tempest-VolumesNegativeTest-261559860 tempest-VolumesNegativeTest-261559860-project] Action: 'create', calling method: .version_select at 0x7f7e84632c10>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1889861604", "metadata": {"Type": "work"}}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-85c6e9e1-68f0-4a7a-bac4-45a5b70155d3 tempest-VolumesNegativeTest-261559860 tempest-VolumesNegativeTest-261559860-project] Request method failure captured: Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 119 Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_vu7lYW661ALfApiZ0Vog3S47OGStrxRW8h7lHGjhXBbP5Gt9X3E0jnrF0wPpBvqVNWg4VDQ6UIqzUJC_Jjj8VB_REdYRIMiqN1yESCnuPKnS8vdzQHsq3iO4k4EeBobRwQn3H0NBYCh8iFMAeU9yr9NeP-HUkYLUu-Wy3ARuONJaE Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 6c4433df998c4e7f8e9f71318f6c518f Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-VolumesNegativeTest-261559860 Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6c4433df998c4e7f8e9f71318f6c518f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6c4433df998c4e7f8e9f71318f6c518f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6c4433df998c4e7f8e9f71318f6c518f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6c4433df998c4e7f8e9f71318f6c518f"}]}] Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-VolumesNegativeTest-261559860 Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 6c4433df998c4e7f8e9f71318f6c518f Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-VolumesNegativeTest-261559860 Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-VolumesNegativeTest-261559860-project Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 047d2849623e4cfb8f5d42cda0fcb18c Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-VolumesNegativeTest-261559860-project Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1889861604", "metadata": {"Type": "work"}}} Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1889861604', 'metadata': {'Type': 'work'}}}} Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi '' Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:03:43.279873 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:03:43.286890 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 17:03:43.286890 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:43.286890 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:43.286890 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:43.286890 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:43.286890 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:43.286890 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:43.286890 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:03:43.286890 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:03:43.286890 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 17:03:43.286890 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:43.287845 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b3ca8f0a-5085-45f1-857f-ee24a9d328bd tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:43.293022 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-85c6e9e1-68f0-4a7a-bac4-45a5b70155d3 tempest-VolumesNegativeTest-261559860 tempest-VolumesNegativeTest-261559860-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:43.294894 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b3ca8f0a-5085-45f1-857f-ee24a9d328bd tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:43.296548 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b3ca8f0a-5085-45f1-857f-ee24a9d328bd tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1722 microversion: 2.20 time: 0.456650 Aug 04 17:03:43.296940 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-85c6e9e1-68f0-4a7a-bac4-45a5b70155d3 tempest-VolumesNegativeTest-261559860 tempest-VolumesNegativeTest-261559860-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.032892 Aug 04 17:03:43.297558 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2548/5200] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:42 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1722 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:03:43.328884 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2653/5201] 10.222.0.23 () {60 vars in 1156 bytes} [Thu Aug 4 17:03:43 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 68 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:03:43.337520 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fe06df5f-e274-4523-ab78-bb71ba709b11 tempest-VolumesNegativeTest-261559860 tempest-VolumesNegativeTest-261559860-project] Calling method '.version_select at 0x7f7e777665e0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:43.388239 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-fe06df5f-e274-4523-ab78-bb71ba709b11 tempest-VolumesNegativeTest-261559860 tempest-VolumesNegativeTest-261559860-project] HTTP exception thrown: Volume tempest-invalid-1579962054 could not be found. Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fe06df5f-e274-4523-ab78-bb71ba709b11 tempest-VolumesNegativeTest-261559860 tempest-VolumesNegativeTest-261559860-project] Request method failure captured: Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1579962054 HTTP/1.1 Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_vu7lYW661ALfApiZ0Vog3S47OGStrxRW8h7lHGjhXBbP5Gt9X3E0jnrF0wPpBvqVNWg4VDQ6UIqzUJC_Jjj8VB_REdYRIMiqN1yESCnuPKnS8vdzQHsq3iO4k4EeBobRwQn3H0NBYCh8iFMAeU9yr9NeP-HUkYLUu-Wy3ARuONJaE Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 6c4433df998c4e7f8e9f71318f6c518f Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-VolumesNegativeTest-261559860 Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6c4433df998c4e7f8e9f71318f6c518f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6c4433df998c4e7f8e9f71318f6c518f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6c4433df998c4e7f8e9f71318f6c518f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6c4433df998c4e7f8e9f71318f6c518f"}]}] Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-VolumesNegativeTest-261559860 Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 6c4433df998c4e7f8e9f71318f6c518f Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-VolumesNegativeTest-261559860 Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-VolumesNegativeTest-261559860-project Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 047d2849623e4cfb8f5d42cda0fcb18c Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-VolumesNegativeTest-261559860-project Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: exception: Volume tempest-invalid-1579962054 could not be found. Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'tempest-invalid-1579962054'} Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1579962054 could not be found. (HTTP 404) (Request-ID: req-26fd78ce-982d-46ca-a9a5-dc9a3c38eb45) Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 17:03:43.390936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1579962054 could not be found. Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1579962054 could not be found. Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1579962054 could not be found. Aug 04 17:03:43.396593 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:43.402103 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fe06df5f-e274-4523-ab78-bb71ba709b11 tempest-VolumesNegativeTest-261559860 tempest-VolumesNegativeTest-261559860-project] Returning 404 to user: Volume tempest-invalid-1579962054 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:43.403397 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fe06df5f-e274-4523-ab78-bb71ba709b11 tempest-VolumesNegativeTest-261559860 tempest-VolumesNegativeTest-261559860-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1579962054" status: 404 len: 99 microversion: 2.1 time: 0.067416 Aug 04 17:03:43.403397 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2549/5202] 10.222.0.23 () {58 vars in 1218 bytes} [Thu Aug 4 17:03:43 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1579962054 => generated 99 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:03:43.416459 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a4234f92-6e5e-4eda-830e-cc4540fe2f4d tempest-VolumesNegativeTest-261559860 tempest-VolumesNegativeTest-261559860-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005749 Aug 04 17:03:43.417700 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2654/5203] 10.222.0.23 () {58 vars in 1140 bytes} [Thu Aug 4 17:03:43 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 17:03:43.430521 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9341e32e-1014-4692-bb78-148ef56b38d5 tempest-VolumesNegativeTest-261559860 tempest-VolumesNegativeTest-261559860-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006644 Aug 04 17:03:43.432200 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2550/5204] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Aug 4 17:03:43 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 17:03:43.443809 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7e60806b-aaef-41dc-adaf-9175aa3df276 tempest-VolumesNegativeTest-261559860 tempest-VolumesNegativeTest-261559860-project] Calling method '.version_select at 0x7f7e843e80d0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:43.514337 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-7e60806b-aaef-41dc-adaf-9175aa3df276 tempest-VolumesNegativeTest-261559860 tempest-VolumesNegativeTest-261559860-project] HTTP exception thrown: Volume a3a6ef89-ff1c-48a7-ad9e-c2cf67a9e189 could not be found. Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7e60806b-aaef-41dc-adaf-9175aa3df276 tempest-VolumesNegativeTest-261559860 tempest-VolumesNegativeTest-261559860-project] Request method failure captured: Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/os-volumes/a3a6ef89-ff1c-48a7-ad9e-c2cf67a9e189 HTTP/1.1 Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_vu7lYW661ALfApiZ0Vog3S47OGStrxRW8h7lHGjhXBbP5Gt9X3E0jnrF0wPpBvqVNWg4VDQ6UIqzUJC_Jjj8VB_REdYRIMiqN1yESCnuPKnS8vdzQHsq3iO4k4EeBobRwQn3H0NBYCh8iFMAeU9yr9NeP-HUkYLUu-Wy3ARuONJaE Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 6c4433df998c4e7f8e9f71318f6c518f Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-VolumesNegativeTest-261559860 Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6c4433df998c4e7f8e9f71318f6c518f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6c4433df998c4e7f8e9f71318f6c518f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6c4433df998c4e7f8e9f71318f6c518f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6c4433df998c4e7f8e9f71318f6c518f"}]}] Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-VolumesNegativeTest-261559860 Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 6c4433df998c4e7f8e9f71318f6c518f Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-VolumesNegativeTest-261559860 Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-VolumesNegativeTest-261559860-project Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 047d2849623e4cfb8f5d42cda0fcb18c Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-VolumesNegativeTest-261559860-project Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: method: Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: exception: Volume a3a6ef89-ff1c-48a7-ad9e-c2cf67a9e189 could not be found. Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'a3a6ef89-ff1c-48a7-ad9e-c2cf67a9e189'} Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a3a6ef89-ff1c-48a7-ad9e-c2cf67a9e189 could not be found. (HTTP 404) (Request-ID: req-a234efac-7e7a-4e13-bd46-2b503166e904) Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 17:03:43.516359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a3a6ef89-ff1c-48a7-ad9e-c2cf67a9e189 could not be found. Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a3a6ef89-ff1c-48a7-ad9e-c2cf67a9e189 could not be found. Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a3a6ef89-ff1c-48a7-ad9e-c2cf67a9e189 could not be found. Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7e60806b-aaef-41dc-adaf-9175aa3df276 tempest-VolumesNegativeTest-261559860 tempest-VolumesNegativeTest-261559860-project] Returning 404 to user: Volume a3a6ef89-ff1c-48a7-ad9e-c2cf67a9e189 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7e60806b-aaef-41dc-adaf-9175aa3df276 tempest-VolumesNegativeTest-261559860 tempest-VolumesNegativeTest-261559860-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/a3a6ef89-ff1c-48a7-ad9e-c2cf67a9e189" status: 404 len: 109 microversion: 2.1 time: 0.081568 Aug 04 17:03:43.521120 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2655/5205] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Aug 4 17:03:43 2022] DELETE /compute/v2.1/os-volumes/a3a6ef89-ff1c-48a7-ad9e-c2cf67a9e189 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:03:43.535312 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1d8fd0c8-3ee3-47ea-bf4d-1c68f5bdc41b tempest-VolumesNegativeTest-261559860 tempest-VolumesNegativeTest-261559860-project] Calling method '.version_select at 0x7f7e776be280>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:43.586379 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-1d8fd0c8-3ee3-47ea-bf4d-1c68f5bdc41b tempest-VolumesNegativeTest-261559860 tempest-VolumesNegativeTest-261559860-project] HTTP exception thrown: Volume 0b2b1664-69e6-4568-a7f5-25deb557c7e3 could not be found. Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1d8fd0c8-3ee3-47ea-bf4d-1c68f5bdc41b tempest-VolumesNegativeTest-261559860 tempest-VolumesNegativeTest-261559860-project] Request method failure captured: Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/os-volumes/0b2b1664-69e6-4568-a7f5-25deb557c7e3 HTTP/1.1 Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_vu7lYW661ALfApiZ0Vog3S47OGStrxRW8h7lHGjhXBbP5Gt9X3E0jnrF0wPpBvqVNWg4VDQ6UIqzUJC_Jjj8VB_REdYRIMiqN1yESCnuPKnS8vdzQHsq3iO4k4EeBobRwQn3H0NBYCh8iFMAeU9yr9NeP-HUkYLUu-Wy3ARuONJaE Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 6c4433df998c4e7f8e9f71318f6c518f Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-VolumesNegativeTest-261559860 Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6c4433df998c4e7f8e9f71318f6c518f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6c4433df998c4e7f8e9f71318f6c518f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6c4433df998c4e7f8e9f71318f6c518f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6c4433df998c4e7f8e9f71318f6c518f"}]}] Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-VolumesNegativeTest-261559860 Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 6c4433df998c4e7f8e9f71318f6c518f Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-VolumesNegativeTest-261559860 Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-VolumesNegativeTest-261559860-project Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 047d2849623e4cfb8f5d42cda0fcb18c Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-VolumesNegativeTest-261559860-project Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: method: Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: exception: Volume 0b2b1664-69e6-4568-a7f5-25deb557c7e3 could not be found. Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '0b2b1664-69e6-4568-a7f5-25deb557c7e3'} Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0b2b1664-69e6-4568-a7f5-25deb557c7e3 could not be found. (HTTP 404) (Request-ID: req-9003869b-f97c-46b9-b8f9-dbcd4844d18b) Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 17:03:43.589254 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0b2b1664-69e6-4568-a7f5-25deb557c7e3 could not be found. Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0b2b1664-69e6-4568-a7f5-25deb557c7e3 could not be found. Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0b2b1664-69e6-4568-a7f5-25deb557c7e3 could not be found. Aug 04 17:03:43.594783 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:03:43.599647 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1d8fd0c8-3ee3-47ea-bf4d-1c68f5bdc41b tempest-VolumesNegativeTest-261559860 tempest-VolumesNegativeTest-261559860-project] Returning 404 to user: Volume 0b2b1664-69e6-4568-a7f5-25deb557c7e3 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:43.600694 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1d8fd0c8-3ee3-47ea-bf4d-1c68f5bdc41b tempest-VolumesNegativeTest-261559860 tempest-VolumesNegativeTest-261559860-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/0b2b1664-69e6-4568-a7f5-25deb557c7e3" status: 404 len: 109 microversion: 2.1 time: 0.075353 Aug 04 17:03:43.601815 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2551/5206] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Aug 4 17:03:43 2022] GET /compute/v2.1/os-volumes/0b2b1664-69e6-4568-a7f5-25deb557c7e3 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:03:44.240245 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cd5a9a99-731c-41e6-a942-80b58570c270 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:44.240956 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cd5a9a99-731c-41e6-a942-80b58570c270 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:44.256466 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cd5a9a99-731c-41e6-a942-80b58570c270 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:44.257781 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cd5a9a99-731c-41e6-a942-80b58570c270 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:44.260614 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cd5a9a99-731c-41e6-a942-80b58570c270 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:44.261149 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cd5a9a99-731c-41e6-a942-80b58570c270 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:44.320446 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9f280b12-8be4-4c82-904e-ffd6269fe8d9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:44.323124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9f280b12-8be4-4c82-904e-ffd6269fe8d9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:44.336549 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f280b12-8be4-4c82-904e-ffd6269fe8d9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:44.339734 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f280b12-8be4-4c82-904e-ffd6269fe8d9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:44.344145 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f280b12-8be4-4c82-904e-ffd6269fe8d9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:44.345113 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f280b12-8be4-4c82-904e-ffd6269fe8d9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:44.846937 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cd5a9a99-731c-41e6-a942-80b58570c270 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:44.861260 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cd5a9a99-731c-41e6-a942-80b58570c270 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1169 microversion: 2.1 time: 0.625505 Aug 04 17:03:44.862676 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2656/5207] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:44 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1169 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:45.027335 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9f280b12-8be4-4c82-904e-ffd6269fe8d9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:45.036161 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9f280b12-8be4-4c82-904e-ffd6269fe8d9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:45.045557 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9f280b12-8be4-4c82-904e-ffd6269fe8d9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:45.047474 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9f280b12-8be4-4c82-904e-ffd6269fe8d9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1725 microversion: 2.20 time: 0.731023 Aug 04 17:03:45.048387 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2552/5208] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:44 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1725 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:03:45.078592 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bfdd9237-659b-4036-9d2d-f7654b8c63c8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a92ad8d-246b-4e63-87e5-e5922f00140d"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:45.081520 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bfdd9237-659b-4036-9d2d-f7654b8c63c8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:45.101224 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bfdd9237-659b-4036-9d2d-f7654b8c63c8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:45.101864 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bfdd9237-659b-4036-9d2d-f7654b8c63c8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:45.103201 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bfdd9237-659b-4036-9d2d-f7654b8c63c8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:45.103738 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bfdd9237-659b-4036-9d2d-f7654b8c63c8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:45.186623 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b566e126-708f-49a6-92ad-d4dd11238358 tempest-ComputeTenantNetworksTest-1286323681 tempest-ComputeTenantNetworksTest-1286323681-project] Calling method '.version_select at 0x7f7e8413bc10>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:45.708467 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b566e126-708f-49a6-92ad-d4dd11238358 tempest-ComputeTenantNetworksTest-1286323681 tempest-ComputeTenantNetworksTest-1286323681-project] 10.222.0.23 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.844234 Aug 04 17:03:45.709116 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:03:45.709570 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2657/5209] 10.222.0.23 () {58 vars in 1158 bytes} [Thu Aug 4 17:03:44 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:45.719439 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-865f9e56-c8b9-481a-8372-dd666539a312 tempest-ComputeTenantNetworksTest-1286323681 tempest-ComputeTenantNetworksTest-1286323681-project] Calling method '.version_select at 0x7f7e770fc160>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:45.735120 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bfdd9237-659b-4036-9d2d-f7654b8c63c8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "POST /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.660263 Aug 04 17:03:45.737441 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2553/5210] 10.222.0.23 () {62 vars in 1364 bytes} [Thu Aug 4 17:03:45 2022] POST /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8/os-volume_attachments => generated 188 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 17:03:45.885692 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-be03af73-6cba-42ba-bb20-a53aba94398e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:45.886535 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-be03af73-6cba-42ba-bb20-a53aba94398e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:45.896441 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-865f9e56-c8b9-481a-8372-dd666539a312 tempest-ComputeTenantNetworksTest-1286323681 tempest-ComputeTenantNetworksTest-1286323681-project] 10.222.0.23 "GET /compute/v2.1/os-tenant-networks/751bfd30-bb3d-4a93-bf54-a605831b646f" status: 200 len: 139 microversion: 2.1 time: 0.180699 Aug 04 17:03:45.897635 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2658/5211] 10.222.0.23 () {58 vars in 1269 bytes} [Thu Aug 4 17:03:45 2022] GET /compute/v2.1/os-tenant-networks/751bfd30-bb3d-4a93-bf54-a605831b646f => generated 139 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:45.914353 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be03af73-6cba-42ba-bb20-a53aba94398e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:45.915418 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be03af73-6cba-42ba-bb20-a53aba94398e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:45.919290 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be03af73-6cba-42ba-bb20-a53aba94398e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:45.920856 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be03af73-6cba-42ba-bb20-a53aba94398e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:45.935875 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-29292ead-37ff-4367-860a-541c58c82f87 req-23237ca2-c1c6-4dea-a3aa-57a1c4e82248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e192310d-3cab-471d-8d3e-d161ef4de6c8", "name": "network-vif-unplugged", "status": "completed", "tag": "a6e1b245-35b9-4d61-8ca7-43f55954fbc5"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:45.975736 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-29292ead-37ff-4367-860a-541c58c82f87 req-23237ca2-c1c6-4dea-a3aa-57a1c4e82248 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:45.976179 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-29292ead-37ff-4367-860a-541c58c82f87 req-23237ca2-c1c6-4dea-a3aa-57a1c4e82248 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:46.039730 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.compute.server_external_events [req-29292ead-37ff-4367-860a-541c58c82f87 req-23237ca2-c1c6-4dea-a3aa-57a1c4e82248 service nova] Unable to find a host for instance e192310d-3cab-471d-8d3e-d161ef4de6c8. Dropping event network-vif-unplugged {{(pid=126125) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 04 17:03:46.040650 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-29292ead-37ff-4367-860a-541c58c82f87 req-23237ca2-c1c6-4dea-a3aa-57a1c4e82248 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.108532 Aug 04 17:03:46.050499 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2659/5212] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 119 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 04 17:03:46.164134 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a6045bba-9462-4644-9ed2-926c75f1a5e4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:46.165490 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a6045bba-9462-4644-9ed2-926c75f1a5e4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:46.191261 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6045bba-9462-4644-9ed2-926c75f1a5e4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:46.197160 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6045bba-9462-4644-9ed2-926c75f1a5e4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:46.199710 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6045bba-9462-4644-9ed2-926c75f1a5e4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:46.201877 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6045bba-9462-4644-9ed2-926c75f1a5e4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:46.638752 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-be03af73-6cba-42ba-bb20-a53aba94398e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:46.649860 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-be03af73-6cba-42ba-bb20-a53aba94398e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1169 microversion: 2.1 time: 0.769189 Aug 04 17:03:46.654101 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2554/5213] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:45 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1169 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:46.720519 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a6045bba-9462-4644-9ed2-926c75f1a5e4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8/os-volume_attachments/9a92ad8d-246b-4e63-87e5-e5922f00140d" status: 202 len: 0 microversion: 2.20 time: 0.560801 Aug 04 17:03:46.723281 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2660/5214] 10.222.0.23 () {60 vars in 1457 bytes} [Thu Aug 4 17:03:46 2022] DELETE /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8/os-volume_attachments/9a92ad8d-246b-4e63-87e5-e5922f00140d => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 04 17:03:46.839656 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c5afb2f2-2dc9-426d-8f4c-2dce42986cef tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:46.840930 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c5afb2f2-2dc9-426d-8f4c-2dce42986cef tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:46.851558 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c5afb2f2-2dc9-426d-8f4c-2dce42986cef tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:46.852280 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c5afb2f2-2dc9-426d-8f4c-2dce42986cef tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:46.853940 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c5afb2f2-2dc9-426d-8f4c-2dce42986cef tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:46.854647 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c5afb2f2-2dc9-426d-8f4c-2dce42986cef tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:46.962840 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c5afb2f2-2dc9-426d-8f4c-2dce42986cef tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126126) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 17:03:47.172509 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c5afb2f2-2dc9-426d-8f4c-2dce42986cef tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "POST /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8/action" status: 202 len: 0 microversion: 2.20 time: 0.338159 Aug 04 17:03:47.174280 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2555/5215] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Aug 4 17:03:46 2022] POST /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:03:47.183061 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-113108bf-4c2a-438a-8d9e-c86e0aafa4eb tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:47.184045 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-113108bf-4c2a-438a-8d9e-c86e0aafa4eb tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:47.194022 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-113108bf-4c2a-438a-8d9e-c86e0aafa4eb tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:47.196849 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-113108bf-4c2a-438a-8d9e-c86e0aafa4eb tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:47.199691 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-113108bf-4c2a-438a-8d9e-c86e0aafa4eb tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:47.200462 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-113108bf-4c2a-438a-8d9e-c86e0aafa4eb tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:47.679964 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0a361ae5-b1ff-4f9d-b0a0-0435dc00e4a3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:47.680849 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0a361ae5-b1ff-4f9d-b0a0-0435dc00e4a3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:47.693035 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0a361ae5-b1ff-4f9d-b0a0-0435dc00e4a3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:47.698771 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0a361ae5-b1ff-4f9d-b0a0-0435dc00e4a3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:47.701681 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0a361ae5-b1ff-4f9d-b0a0-0435dc00e4a3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:47.703300 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0a361ae5-b1ff-4f9d-b0a0-0435dc00e4a3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:48.127884 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-113108bf-4c2a-438a-8d9e-c86e0aafa4eb tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:48.136882 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-113108bf-4c2a-438a-8d9e-c86e0aafa4eb tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:48.138414 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-113108bf-4c2a-438a-8d9e-c86e0aafa4eb tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:48.139586 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-113108bf-4c2a-438a-8d9e-c86e0aafa4eb tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1673 microversion: 2.20 time: 0.961226 Aug 04 17:03:48.144327 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2661/5216] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:47 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1673 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:48.311105 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0a361ae5-b1ff-4f9d-b0a0-0435dc00e4a3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:48.334517 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0a361ae5-b1ff-4f9d-b0a0-0435dc00e4a3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1203 microversion: 2.1 time: 0.658012 Aug 04 17:03:48.337134 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2556/5217] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:47 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1203 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:49.165376 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4be67213-af5d-4827-ad73-5bf42dca7070 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:49.168357 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4be67213-af5d-4827-ad73-5bf42dca7070 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:49.186710 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4be67213-af5d-4827-ad73-5bf42dca7070 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:49.188138 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4be67213-af5d-4827-ad73-5bf42dca7070 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:49.189558 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4be67213-af5d-4827-ad73-5bf42dca7070 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:49.190991 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4be67213-af5d-4827-ad73-5bf42dca7070 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:49.211682 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:03:49.373824 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a33cca09-9854-4a56-98a6-398f5fda7495 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:49.374951 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a33cca09-9854-4a56-98a6-398f5fda7495 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:49.411850 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a33cca09-9854-4a56-98a6-398f5fda7495 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:49.413162 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a33cca09-9854-4a56-98a6-398f5fda7495 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:49.416381 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a33cca09-9854-4a56-98a6-398f5fda7495 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:49.418275 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a33cca09-9854-4a56-98a6-398f5fda7495 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:49.899814 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4be67213-af5d-4827-ad73-5bf42dca7070 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:49.916388 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a33cca09-9854-4a56-98a6-398f5fda7495 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:49.926135 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a33cca09-9854-4a56-98a6-398f5fda7495 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1203 microversion: 2.1 time: 0.565118 Aug 04 17:03:49.940329 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4be67213-af5d-4827-ad73-5bf42dca7070 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:49.940329 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4be67213-af5d-4827-ad73-5bf42dca7070 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:49.940329 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4be67213-af5d-4827-ad73-5bf42dca7070 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1673 microversion: 2.20 time: 0.771993 Aug 04 17:03:49.940682 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2557/5218] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:49 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1203 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:03:49.940789 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2662/5219] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:49 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1673 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:50.763141 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a33cca09-9854-4a56-98a6-398f5fda7495 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:50.764098 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a33cca09-9854-4a56-98a6-398f5fda7495 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001291 Aug 04 17:03:50.771092 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2558/5220] 10.222.0.23 () {56 vars in 886 bytes} [Thu Aug 4 17:03:50 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 04 17:03:50.772571 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4be67213-af5d-4827-ad73-5bf42dca7070 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:50.773701 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4be67213-af5d-4827-ad73-5bf42dca7070 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001636 Aug 04 17:03:50.774097 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2663/5221] 10.222.0.23 () {54 vars in 1035 bytes} [Thu Aug 4 17:03:50 2022] GET /compute/v2/ => generated 379 bytes in 2 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Aug 04 17:03:50.781708 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a33cca09-9854-4a56-98a6-398f5fda7495 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:50.783160 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a33cca09-9854-4a56-98a6-398f5fda7495 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001871 Aug 04 17:03:50.783982 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2559/5222] 10.222.0.23 () {54 vars in 1041 bytes} [Thu Aug 4 17:03:50 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:50.792946 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4be67213-af5d-4827-ad73-5bf42dca7070 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:50.794270 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4be67213-af5d-4827-ad73-5bf42dca7070 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001672 Aug 04 17:03:50.794748 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2664/5223] 10.222.0.23 () {56 vars in 886 bytes} [Thu Aug 4 17:03:50 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 04 17:03:50.949099 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-325fe3eb-cbbf-4d3a-bd32-ebee29962b40 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:50.950981 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-325fe3eb-cbbf-4d3a-bd32-ebee29962b40 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:50.958300 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9c28a3f0-0b69-4506-b370-752d463513da tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:50.958927 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9c28a3f0-0b69-4506-b370-752d463513da tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:50.976412 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c28a3f0-0b69-4506-b370-752d463513da tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:50.976866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c28a3f0-0b69-4506-b370-752d463513da tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:50.984085 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-325fe3eb-cbbf-4d3a-bd32-ebee29962b40 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:50.984538 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-325fe3eb-cbbf-4d3a-bd32-ebee29962b40 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:50.986469 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c28a3f0-0b69-4506-b370-752d463513da tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:50.987198 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-325fe3eb-cbbf-4d3a-bd32-ebee29962b40 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:50.988421 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-325fe3eb-cbbf-4d3a-bd32-ebee29962b40 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:50.990123 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c28a3f0-0b69-4506-b370-752d463513da tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:51.525908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9c28a3f0-0b69-4506-b370-752d463513da tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:51.536796 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9c28a3f0-0b69-4506-b370-752d463513da tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:51.543125 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9c28a3f0-0b69-4506-b370-752d463513da tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:51.544364 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9c28a3f0-0b69-4506-b370-752d463513da tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1731 microversion: 2.20 time: 0.592150 Aug 04 17:03:51.544950 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2665/5224] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:50 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1731 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:51.566226 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-325fe3eb-cbbf-4d3a-bd32-ebee29962b40 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:51.580515 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-325fe3eb-cbbf-4d3a-bd32-ebee29962b40 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1203 microversion: 2.1 time: 0.636387 Aug 04 17:03:51.582596 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2560/5225] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:50 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1203 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:52.209359 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-b91ba36d-7642-42fc-8f0e-3c8dc7780ea7 req-48f7538a-0297-4cad-8ce4-ea71905e022a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e192310d-3cab-471d-8d3e-d161ef4de6c8", "tag": "a6e1b245-35b9-4d61-8ca7-43f55954fbc5"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:52.228957 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-b91ba36d-7642-42fc-8f0e-3c8dc7780ea7 req-48f7538a-0297-4cad-8ce4-ea71905e022a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:52.230325 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-b91ba36d-7642-42fc-8f0e-3c8dc7780ea7 req-48f7538a-0297-4cad-8ce4-ea71905e022a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:52.273787 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-b91ba36d-7642-42fc-8f0e-3c8dc7780ea7 req-48f7538a-0297-4cad-8ce4-ea71905e022a service nova] Creating event network-changed:a6e1b245-35b9-4d61-8ca7-43f55954fbc5 for instance e192310d-3cab-471d-8d3e-d161ef4de6c8 on n-h1-846466-12 Aug 04 17:03:52.289006 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-b91ba36d-7642-42fc-8f0e-3c8dc7780ea7 req-48f7538a-0297-4cad-8ce4-ea71905e022a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083286 Aug 04 17:03:52.289666 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2666/5226] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:52.570902 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ce9806ae-ac26-4f56-807c-7ad14f28e845 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:52.571859 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ce9806ae-ac26-4f56-807c-7ad14f28e845 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:52.592094 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ce9806ae-ac26-4f56-807c-7ad14f28e845 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:52.592094 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ce9806ae-ac26-4f56-807c-7ad14f28e845 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:52.592094 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ce9806ae-ac26-4f56-807c-7ad14f28e845 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:52.592094 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ce9806ae-ac26-4f56-807c-7ad14f28e845 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:52.609728 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-aed44785-1da0-49a5-8f70-7120de32ced9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:52.611321 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-aed44785-1da0-49a5-8f70-7120de32ced9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:52.628201 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aed44785-1da0-49a5-8f70-7120de32ced9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:52.629807 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aed44785-1da0-49a5-8f70-7120de32ced9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:52.630821 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aed44785-1da0-49a5-8f70-7120de32ced9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:52.632660 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aed44785-1da0-49a5-8f70-7120de32ced9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:52.883170 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ce9806ae-ac26-4f56-807c-7ad14f28e845 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:52.898996 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ce9806ae-ac26-4f56-807c-7ad14f28e845 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:52.902131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ce9806ae-ac26-4f56-807c-7ad14f28e845 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:52.905702 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ce9806ae-ac26-4f56-807c-7ad14f28e845 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1731 microversion: 2.20 time: 0.338281 Aug 04 17:03:52.918917 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2561/5227] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:52 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1731 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:52.966319 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-aed44785-1da0-49a5-8f70-7120de32ced9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:52.978560 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-aed44785-1da0-49a5-8f70-7120de32ced9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1203 microversion: 2.1 time: 0.376610 Aug 04 17:03:52.982074 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2667/5228] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:52 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1203 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:53.932351 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0f3347d9-c959-4aa9-b2a5-4c3e4f15ef55 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:53.934387 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0f3347d9-c959-4aa9-b2a5-4c3e4f15ef55 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:53.957197 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0f3347d9-c959-4aa9-b2a5-4c3e4f15ef55 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:53.960575 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0f3347d9-c959-4aa9-b2a5-4c3e4f15ef55 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:53.962409 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0f3347d9-c959-4aa9-b2a5-4c3e4f15ef55 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:53.965514 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0f3347d9-c959-4aa9-b2a5-4c3e4f15ef55 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:54.008996 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dfeac535-09b9-4583-af01-4951743374e2 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:54.009802 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dfeac535-09b9-4583-af01-4951743374e2 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:54.039541 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dfeac535-09b9-4583-af01-4951743374e2 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:54.040621 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dfeac535-09b9-4583-af01-4951743374e2 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:54.042819 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dfeac535-09b9-4583-af01-4951743374e2 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:54.045685 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dfeac535-09b9-4583-af01-4951743374e2 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:54.468547 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0f3347d9-c959-4aa9-b2a5-4c3e4f15ef55 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:54.484464 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0f3347d9-c959-4aa9-b2a5-4c3e4f15ef55 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:54.492874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0f3347d9-c959-4aa9-b2a5-4c3e4f15ef55 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:54.502190 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0f3347d9-c959-4aa9-b2a5-4c3e4f15ef55 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1731 microversion: 2.20 time: 0.573795 Aug 04 17:03:54.503472 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2562/5229] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:53 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1731 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:54.589959 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dfeac535-09b9-4583-af01-4951743374e2 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:54.604127 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dfeac535-09b9-4583-af01-4951743374e2 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1203 microversion: 2.1 time: 0.600859 Aug 04 17:03:54.607566 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2668/5230] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:54 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1203 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:55.533362 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1d410566-fa2d-4c8a-a3a4-fcc369b9c7c8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:55.534597 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1d410566-fa2d-4c8a-a3a4-fcc369b9c7c8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:55.549742 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d410566-fa2d-4c8a-a3a4-fcc369b9c7c8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:55.550185 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d410566-fa2d-4c8a-a3a4-fcc369b9c7c8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:55.551120 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d410566-fa2d-4c8a-a3a4-fcc369b9c7c8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:55.553532 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d410566-fa2d-4c8a-a3a4-fcc369b9c7c8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:55.636454 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1225b4b7-4ef3-47e3-8536-1e4f3fdfbc2b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:55.637145 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1225b4b7-4ef3-47e3-8536-1e4f3fdfbc2b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:55.654067 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1225b4b7-4ef3-47e3-8536-1e4f3fdfbc2b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:55.654510 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1225b4b7-4ef3-47e3-8536-1e4f3fdfbc2b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:55.692717 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1225b4b7-4ef3-47e3-8536-1e4f3fdfbc2b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:55.698559 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1225b4b7-4ef3-47e3-8536-1e4f3fdfbc2b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:55.957083 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1d410566-fa2d-4c8a-a3a4-fcc369b9c7c8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:55.993341 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1d410566-fa2d-4c8a-a3a4-fcc369b9c7c8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:55.998243 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1d410566-fa2d-4c8a-a3a4-fcc369b9c7c8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:56.006943 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1d410566-fa2d-4c8a-a3a4-fcc369b9c7c8 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1731 microversion: 2.20 time: 0.478835 Aug 04 17:03:56.013195 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2563/5231] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:55 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1731 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:56.179888 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1225b4b7-4ef3-47e3-8536-1e4f3fdfbc2b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:56.191231 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1225b4b7-4ef3-47e3-8536-1e4f3fdfbc2b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1203 microversion: 2.1 time: 0.563228 Aug 04 17:03:56.220093 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2669/5232] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:55 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1203 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:57.034995 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5e9ea838-8c2d-4b06-ba96-c3c253eebea6 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:57.036011 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5e9ea838-8c2d-4b06-ba96-c3c253eebea6 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:57.050651 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e9ea838-8c2d-4b06-ba96-c3c253eebea6 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:57.053019 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e9ea838-8c2d-4b06-ba96-c3c253eebea6 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:57.055309 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e9ea838-8c2d-4b06-ba96-c3c253eebea6 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:57.056684 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e9ea838-8c2d-4b06-ba96-c3c253eebea6 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:57.216799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bc52f248-113a-492a-8d8a-6808726b7c01 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:57.217885 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bc52f248-113a-492a-8d8a-6808726b7c01 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:57.224651 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=50 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:03:57.248993 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bc52f248-113a-492a-8d8a-6808726b7c01 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:57.249892 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bc52f248-113a-492a-8d8a-6808726b7c01 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:57.251059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bc52f248-113a-492a-8d8a-6808726b7c01 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:57.251795 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bc52f248-113a-492a-8d8a-6808726b7c01 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:57.379106 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5e9ea838-8c2d-4b06-ba96-c3c253eebea6 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:57.394565 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5e9ea838-8c2d-4b06-ba96-c3c253eebea6 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:57.398067 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5e9ea838-8c2d-4b06-ba96-c3c253eebea6 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:57.407442 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5e9ea838-8c2d-4b06-ba96-c3c253eebea6 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1731 microversion: 2.20 time: 0.378016 Aug 04 17:03:57.410178 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2564/5233] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:57 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1731 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:57.541514 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bc52f248-113a-492a-8d8a-6808726b7c01 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:57.553924 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bc52f248-113a-492a-8d8a-6808726b7c01 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1203 microversion: 2.1 time: 0.341561 Aug 04 17:03:57.554758 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2670/5234] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:57 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1203 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:57.878461 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-3e847fb2-81e7-4bf4-ba55-81987c4b00a6 req-87111c07-0514-4474-b917-28c8791be6db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19a8136d-f89b-449a-9cf9-3e2b246fc5e1", "name": "network-vif-plugged", "status": "completed", "tag": "18789b88-4ed9-49d6-89bd-13c13c26115b"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:57.897602 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-3e847fb2-81e7-4bf4-ba55-81987c4b00a6 req-87111c07-0514-4474-b917-28c8791be6db service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:57.900808 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-3e847fb2-81e7-4bf4-ba55-81987c4b00a6 req-87111c07-0514-4474-b917-28c8791be6db service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:57.917479 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-3e847fb2-81e7-4bf4-ba55-81987c4b00a6 req-87111c07-0514-4474-b917-28c8791be6db service nova] Creating event network-vif-plugged:18789b88-4ed9-49d6-89bd-13c13c26115b for instance 19a8136d-f89b-449a-9cf9-3e2b246fc5e1 on n-h2-846466-12 Aug 04 17:03:57.925461 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-3e847fb2-81e7-4bf4-ba55-81987c4b00a6 req-87111c07-0514-4474-b917-28c8791be6db service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050638 Aug 04 17:03:57.926912 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2565/5235] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:03:58.441123 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f2134968-f0a4-4330-9f34-41f17ba41c02 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:58.443848 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f2134968-f0a4-4330-9f34-41f17ba41c02 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:58.475321 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f2134968-f0a4-4330-9f34-41f17ba41c02 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:58.478363 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f2134968-f0a4-4330-9f34-41f17ba41c02 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:58.484214 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f2134968-f0a4-4330-9f34-41f17ba41c02 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:58.486669 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f2134968-f0a4-4330-9f34-41f17ba41c02 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:58.578009 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-35ce101b-0af7-4f30-ae6f-dad7d73b47dc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:58.578779 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-35ce101b-0af7-4f30-ae6f-dad7d73b47dc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:58.598228 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-35ce101b-0af7-4f30-ae6f-dad7d73b47dc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:58.599894 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-35ce101b-0af7-4f30-ae6f-dad7d73b47dc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:58.606667 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-35ce101b-0af7-4f30-ae6f-dad7d73b47dc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:58.611911 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-35ce101b-0af7-4f30-ae6f-dad7d73b47dc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:58.886949 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f2134968-f0a4-4330-9f34-41f17ba41c02 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:58.898239 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f2134968-f0a4-4330-9f34-41f17ba41c02 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:58.904264 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f2134968-f0a4-4330-9f34-41f17ba41c02 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:58.913108 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f2134968-f0a4-4330-9f34-41f17ba41c02 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1731 microversion: 2.20 time: 0.482297 Aug 04 17:03:58.914470 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2671/5236] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:58 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1731 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:59.023441 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-35ce101b-0af7-4f30-ae6f-dad7d73b47dc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:59.036317 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-35ce101b-0af7-4f30-ae6f-dad7d73b47dc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1203 microversion: 2.1 time: 0.464063 Aug 04 17:03:59.039153 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2566/5237] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:58 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1203 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:59.947966 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-91082e5d-5688-4665-8c45-51ce5d2ab60d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:59.954026 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-91082e5d-5688-4665-8c45-51ce5d2ab60d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:59.971782 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-91082e5d-5688-4665-8c45-51ce5d2ab60d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:59.972588 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-91082e5d-5688-4665-8c45-51ce5d2ab60d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:03:59.973617 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-91082e5d-5688-4665-8c45-51ce5d2ab60d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:03:59.974228 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-91082e5d-5688-4665-8c45-51ce5d2ab60d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:00.064160 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d3a6fa00-2b37-4c55-9220-1745cf5ce65e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:00.065699 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d3a6fa00-2b37-4c55-9220-1745cf5ce65e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:00.083172 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d3a6fa00-2b37-4c55-9220-1745cf5ce65e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:00.084747 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d3a6fa00-2b37-4c55-9220-1745cf5ce65e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:00.089702 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d3a6fa00-2b37-4c55-9220-1745cf5ce65e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:00.090892 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d3a6fa00-2b37-4c55-9220-1745cf5ce65e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:00.514315 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-91082e5d-5688-4665-8c45-51ce5d2ab60d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:00.536670 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-91082e5d-5688-4665-8c45-51ce5d2ab60d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:00.538283 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-91082e5d-5688-4665-8c45-51ce5d2ab60d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:00.539507 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-91082e5d-5688-4665-8c45-51ce5d2ab60d tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1731 microversion: 2.20 time: 0.595435 Aug 04 17:04:00.540093 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2672/5238] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:59 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1731 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:04:00.616560 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d3a6fa00-2b37-4c55-9220-1745cf5ce65e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:00.625732 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d3a6fa00-2b37-4c55-9220-1745cf5ce65e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1390 microversion: 2.1 time: 0.570398 Aug 04 17:04:00.626375 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2567/5239] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:00 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1390 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:00.651051 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ce8b040a-9ac6-43d2-aa17-cf26f5d02690 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:00.652005 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ce8b040a-9ac6-43d2-aa17-cf26f5d02690 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:00.675061 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ce8b040a-9ac6-43d2-aa17-cf26f5d02690 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:00.675608 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ce8b040a-9ac6-43d2-aa17-cf26f5d02690 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:00.676651 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ce8b040a-9ac6-43d2-aa17-cf26f5d02690 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:00.677161 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ce8b040a-9ac6-43d2-aa17-cf26f5d02690 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:01.078213 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ce8b040a-9ac6-43d2-aa17-cf26f5d02690 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:01.090391 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ce8b040a-9ac6-43d2-aa17-cf26f5d02690 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1390 microversion: 2.1 time: 0.442386 Aug 04 17:04:01.103016 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2673/5240] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:00 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1390 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:01.114988 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5db3b784-c569-4b3c-9fa7-3c4132cd96af tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:01.115866 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5db3b784-c569-4b3c-9fa7-3c4132cd96af tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:01.125540 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5db3b784-c569-4b3c-9fa7-3c4132cd96af tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:01.126786 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5db3b784-c569-4b3c-9fa7-3c4132cd96af tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:01.127967 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5db3b784-c569-4b3c-9fa7-3c4132cd96af tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:01.128769 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5db3b784-c569-4b3c-9fa7-3c4132cd96af tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:01.564292 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-eaadbc4d-f275-413d-ae63-dc280b4b95d7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:01.565414 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-eaadbc4d-f275-413d-ae63-dc280b4b95d7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:01.589005 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eaadbc4d-f275-413d-ae63-dc280b4b95d7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:01.589846 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eaadbc4d-f275-413d-ae63-dc280b4b95d7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:01.590889 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eaadbc4d-f275-413d-ae63-dc280b4b95d7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:01.593168 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eaadbc4d-f275-413d-ae63-dc280b4b95d7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:02.265368 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5db3b784-c569-4b3c-9fa7-3c4132cd96af tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:02.275512 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5db3b784-c569-4b3c-9fa7-3c4132cd96af tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1390 microversion: 2.1 time: 1.166320 Aug 04 17:04:02.281780 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2568/5241] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:01 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1390 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:02.336872 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-eaadbc4d-f275-413d-ae63-dc280b4b95d7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:02.351345 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-eaadbc4d-f275-413d-ae63-dc280b4b95d7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:02.359728 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-eaadbc4d-f275-413d-ae63-dc280b4b95d7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:02.363289 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-eaadbc4d-f275-413d-ae63-dc280b4b95d7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1731 microversion: 2.20 time: 0.802951 Aug 04 17:04:02.366541 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2674/5242] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:04:01 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1731 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:04:02.445351 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-82fabd5c-6bf2-4ece-946d-5dc425d4c17b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:02.446378 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-82fabd5c-6bf2-4ece-946d-5dc425d4c17b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:02.464426 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-82fabd5c-6bf2-4ece-946d-5dc425d4c17b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:02.465208 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-82fabd5c-6bf2-4ece-946d-5dc425d4c17b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:02.468684 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-82fabd5c-6bf2-4ece-946d-5dc425d4c17b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:02.469123 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-82fabd5c-6bf2-4ece-946d-5dc425d4c17b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:02.554193 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-82fabd5c-6bf2-4ece-946d-5dc425d4c17b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:04:02.880069 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-82fabd5c-6bf2-4ece-946d-5dc425d4c17b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "DELETE /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 204 len: 0 microversion: 2.1 time: 0.438358 Aug 04 17:04:02.886698 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2569/5243] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:04:02 2022] DELETE /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:04:02.896055 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-41958632-e26b-4292-ae94-a3505607dc5a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:02.896663 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-41958632-e26b-4292-ae94-a3505607dc5a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:02.911221 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-41958632-e26b-4292-ae94-a3505607dc5a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:02.911667 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-41958632-e26b-4292-ae94-a3505607dc5a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:02.912451 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-41958632-e26b-4292-ae94-a3505607dc5a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:02.912879 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-41958632-e26b-4292-ae94-a3505607dc5a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:03.356940 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-41958632-e26b-4292-ae94-a3505607dc5a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:03.376672 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-41958632-e26b-4292-ae94-a3505607dc5a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1396 microversion: 2.1 time: 0.484449 Aug 04 17:04:03.390582 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2675/5244] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:02 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1396 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:03.392771 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d342d6a5-c7ef-42e5-8514-fa77ce6e88d4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:03.394212 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d342d6a5-c7ef-42e5-8514-fa77ce6e88d4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:03.432542 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d342d6a5-c7ef-42e5-8514-fa77ce6e88d4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:03.433384 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d342d6a5-c7ef-42e5-8514-fa77ce6e88d4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:03.434430 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d342d6a5-c7ef-42e5-8514-fa77ce6e88d4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:03.435161 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d342d6a5-c7ef-42e5-8514-fa77ce6e88d4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:03.476034 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:04:03.952207 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d342d6a5-c7ef-42e5-8514-fa77ce6e88d4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:03.981321 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d342d6a5-c7ef-42e5-8514-fa77ce6e88d4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:03.982960 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d342d6a5-c7ef-42e5-8514-fa77ce6e88d4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:03.984139 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d342d6a5-c7ef-42e5-8514-fa77ce6e88d4 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1731 microversion: 2.20 time: 0.598080 Aug 04 17:04:03.985114 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2570/5245] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:04:03 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1731 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:04:04.406263 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b3ce9e8e-95d7-413d-85b3-c6cdc724b4b4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:04.408213 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b3ce9e8e-95d7-413d-85b3-c6cdc724b4b4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:04.447424 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b3ce9e8e-95d7-413d-85b3-c6cdc724b4b4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:04.450706 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b3ce9e8e-95d7-413d-85b3-c6cdc724b4b4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:04.456606 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b3ce9e8e-95d7-413d-85b3-c6cdc724b4b4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:04.459738 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b3ce9e8e-95d7-413d-85b3-c6cdc724b4b4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:05.013578 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-165ee404-590c-4435-8034-30bc3d8508b7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:05.015109 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-165ee404-590c-4435-8034-30bc3d8508b7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:05.034887 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-165ee404-590c-4435-8034-30bc3d8508b7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:05.036170 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-165ee404-590c-4435-8034-30bc3d8508b7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:05.038133 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-165ee404-590c-4435-8034-30bc3d8508b7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:05.041747 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-165ee404-590c-4435-8034-30bc3d8508b7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:05.769682 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b3ce9e8e-95d7-413d-85b3-c6cdc724b4b4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:05.769682 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b3ce9e8e-95d7-413d-85b3-c6cdc724b4b4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1396 microversion: 2.1 time: 1.341859 Aug 04 17:04:05.769682 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2676/5246] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:04 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1396 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:06.418581 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-99fb55e2-43a5-4e19-9e7a-09532c5f8566 req-f59b8589-0c3f-4c93-a8ac-7d5b2f55411b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19a8136d-f89b-449a-9cf9-3e2b246fc5e1", "name": "network-vif-deleted", "tag": "18789b88-4ed9-49d6-89bd-13c13c26115b"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:06.426689 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-165ee404-590c-4435-8034-30bc3d8508b7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:06.445716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-165ee404-590c-4435-8034-30bc3d8508b7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:06.466492 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-99fb55e2-43a5-4e19-9e7a-09532c5f8566 req-f59b8589-0c3f-4c93-a8ac-7d5b2f55411b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:06.467252 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-99fb55e2-43a5-4e19-9e7a-09532c5f8566 req-f59b8589-0c3f-4c93-a8ac-7d5b2f55411b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:06.491081 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-99fb55e2-43a5-4e19-9e7a-09532c5f8566 req-f59b8589-0c3f-4c93-a8ac-7d5b2f55411b service nova] Creating event network-vif-deleted:18789b88-4ed9-49d6-89bd-13c13c26115b for instance 19a8136d-f89b-449a-9cf9-3e2b246fc5e1 on n-h2-846466-12 Aug 04 17:04:06.498142 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-165ee404-590c-4435-8034-30bc3d8508b7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:06.498659 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-99fb55e2-43a5-4e19-9e7a-09532c5f8566 req-f59b8589-0c3f-4c93-a8ac-7d5b2f55411b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083640 Aug 04 17:04:06.500152 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2677/5247] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:06.510115 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-165ee404-590c-4435-8034-30bc3d8508b7 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1731 microversion: 2.20 time: 1.491664 Aug 04 17:04:06.516230 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2571/5248] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:04:05 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1731 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:04:06.777765 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c24819d8-d6f8-4adc-8616-b9029e9e2cf0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:06.778488 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c24819d8-d6f8-4adc-8616-b9029e9e2cf0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:06.802234 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c24819d8-d6f8-4adc-8616-b9029e9e2cf0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:06.802919 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c24819d8-d6f8-4adc-8616-b9029e9e2cf0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:06.803885 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c24819d8-d6f8-4adc-8616-b9029e9e2cf0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:06.806367 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c24819d8-d6f8-4adc-8616-b9029e9e2cf0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:06.987050 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c24819d8-d6f8-4adc-8616-b9029e9e2cf0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:07.003880 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c24819d8-d6f8-4adc-8616-b9029e9e2cf0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1188 microversion: 2.1 time: 0.231045 Aug 04 17:04:07.022800 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2678/5249] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:06 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1188 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:07.545506 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9960f1e6-8530-4efc-be44-25b1c1e3470b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:07.546274 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9960f1e6-8530-4efc-be44-25b1c1e3470b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:07.567446 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9960f1e6-8530-4efc-be44-25b1c1e3470b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:07.569740 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9960f1e6-8530-4efc-be44-25b1c1e3470b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:07.570792 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9960f1e6-8530-4efc-be44-25b1c1e3470b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:07.572275 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9960f1e6-8530-4efc-be44-25b1c1e3470b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:07.980342 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9960f1e6-8530-4efc-be44-25b1c1e3470b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:08.005208 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9960f1e6-8530-4efc-be44-25b1c1e3470b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:08.014495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9960f1e6-8530-4efc-be44-25b1c1e3470b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:08.017336 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9960f1e6-8530-4efc-be44-25b1c1e3470b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1731 microversion: 2.20 time: 0.478958 Aug 04 17:04:08.030654 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5305f45d-2fcc-43e5-b6dc-3171400833d4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:08.032033 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5305f45d-2fcc-43e5-b6dc-3171400833d4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:08.036061 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2572/5250] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:04:07 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1731 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:04:08.046612 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5305f45d-2fcc-43e5-b6dc-3171400833d4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:08.049851 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5305f45d-2fcc-43e5-b6dc-3171400833d4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:08.051444 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5305f45d-2fcc-43e5-b6dc-3171400833d4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:08.051955 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5305f45d-2fcc-43e5-b6dc-3171400833d4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:08.224527 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5305f45d-2fcc-43e5-b6dc-3171400833d4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:08.240559 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5305f45d-2fcc-43e5-b6dc-3171400833d4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1188 microversion: 2.1 time: 0.213712 Aug 04 17:04:08.245730 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2679/5251] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:08 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1188 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:09.061943 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-91f4ba2e-0770-4c82-91f9-5733e2b01705 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:09.063328 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-91f4ba2e-0770-4c82-91f9-5733e2b01705 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:09.067908 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:04:09.080540 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-91f4ba2e-0770-4c82-91f9-5733e2b01705 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:09.080980 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-91f4ba2e-0770-4c82-91f9-5733e2b01705 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:09.082510 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-91f4ba2e-0770-4c82-91f9-5733e2b01705 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:09.083283 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-91f4ba2e-0770-4c82-91f9-5733e2b01705 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:09.275268 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2709abfa-7332-4ebf-b934-bc74f91b0e56 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:09.280396 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2709abfa-7332-4ebf-b934-bc74f91b0e56 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:09.304443 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2709abfa-7332-4ebf-b934-bc74f91b0e56 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:09.310362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2709abfa-7332-4ebf-b934-bc74f91b0e56 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:09.311222 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2709abfa-7332-4ebf-b934-bc74f91b0e56 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:09.318483 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2709abfa-7332-4ebf-b934-bc74f91b0e56 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:09.436110 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-91f4ba2e-0770-4c82-91f9-5733e2b01705 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:09.453325 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-91f4ba2e-0770-4c82-91f9-5733e2b01705 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:09.455177 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-91f4ba2e-0770-4c82-91f9-5733e2b01705 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:09.459686 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-91f4ba2e-0770-4c82-91f9-5733e2b01705 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1731 microversion: 2.20 time: 0.400633 Aug 04 17:04:09.478363 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2573/5252] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:04:09 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1731 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:04:09.491655 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2709abfa-7332-4ebf-b934-bc74f91b0e56 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:09.503045 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2709abfa-7332-4ebf-b934-bc74f91b0e56 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1188 microversion: 2.1 time: 0.241338 Aug 04 17:04:09.506303 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2680/5253] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:09 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1188 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:10.492735 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6392cab9-e853-43b1-b891-6b5c5964df83 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:10.493574 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6392cab9-e853-43b1-b891-6b5c5964df83 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:10.507264 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6392cab9-e853-43b1-b891-6b5c5964df83 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:10.507715 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6392cab9-e853-43b1-b891-6b5c5964df83 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:10.512145 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6392cab9-e853-43b1-b891-6b5c5964df83 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:10.512594 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6392cab9-e853-43b1-b891-6b5c5964df83 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:10.542495 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f2688710-5d7f-4b45-8f95-0fd5f760cb9e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:10.543793 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f2688710-5d7f-4b45-8f95-0fd5f760cb9e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:10.553660 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f2688710-5d7f-4b45-8f95-0fd5f760cb9e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:10.554489 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f2688710-5d7f-4b45-8f95-0fd5f760cb9e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:10.555597 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f2688710-5d7f-4b45-8f95-0fd5f760cb9e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:10.556453 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f2688710-5d7f-4b45-8f95-0fd5f760cb9e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:10.664678 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f2688710-5d7f-4b45-8f95-0fd5f760cb9e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:10.685337 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f2688710-5d7f-4b45-8f95-0fd5f760cb9e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1188 microversion: 2.1 time: 0.146909 Aug 04 17:04:10.710381 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2681/5254] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:10 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1188 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:04:10.838679 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6392cab9-e853-43b1-b891-6b5c5964df83 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:10.857124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6392cab9-e853-43b1-b891-6b5c5964df83 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:10.865333 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6392cab9-e853-43b1-b891-6b5c5964df83 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:10.870021 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6392cab9-e853-43b1-b891-6b5c5964df83 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1731 microversion: 2.20 time: 0.381977 Aug 04 17:04:10.873189 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2574/5255] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:04:10 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1731 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:04:11.721508 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a20c04cf-b2ae-4f70-be75-fe68cc34d1c9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:11.721508 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a20c04cf-b2ae-4f70-be75-fe68cc34d1c9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:11.763685 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a20c04cf-b2ae-4f70-be75-fe68cc34d1c9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:11.766006 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a20c04cf-b2ae-4f70-be75-fe68cc34d1c9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:11.767758 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a20c04cf-b2ae-4f70-be75-fe68cc34d1c9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:11.769329 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a20c04cf-b2ae-4f70-be75-fe68cc34d1c9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:11.778380 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=100 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:04:11.897509 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5b1c6b07-76d9-4896-a09b-35904598ba7b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:11.898721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5b1c6b07-76d9-4896-a09b-35904598ba7b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:11.910762 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5b1c6b07-76d9-4896-a09b-35904598ba7b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:11.911966 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5b1c6b07-76d9-4896-a09b-35904598ba7b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:11.913189 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5b1c6b07-76d9-4896-a09b-35904598ba7b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:11.913951 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5b1c6b07-76d9-4896-a09b-35904598ba7b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:11.957242 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a20c04cf-b2ae-4f70-be75-fe68cc34d1c9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:11.967411 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a20c04cf-b2ae-4f70-be75-fe68cc34d1c9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1188 microversion: 2.1 time: 0.258675 Aug 04 17:04:11.971369 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2682/5256] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:11 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1188 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:12.223882 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5b1c6b07-76d9-4896-a09b-35904598ba7b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:12.233968 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5b1c6b07-76d9-4896-a09b-35904598ba7b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:12.235567 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5b1c6b07-76d9-4896-a09b-35904598ba7b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:12.237418 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5b1c6b07-76d9-4896-a09b-35904598ba7b tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1731 microversion: 2.20 time: 0.343929 Aug 04 17:04:12.238398 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2575/5257] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:04:11 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1731 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:04:12.728201 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-06a0068f-a7e3-49bd-a3de-f2ba7a805cc3 req-7d14f617-d15d-44b3-9857-df0104b2db53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e192310d-3cab-471d-8d3e-d161ef4de6c8", "name": "network-vif-plugged", "status": "completed", "tag": "a6e1b245-35b9-4d61-8ca7-43f55954fbc5"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:12.754159 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-06a0068f-a7e3-49bd-a3de-f2ba7a805cc3 req-7d14f617-d15d-44b3-9857-df0104b2db53 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:12.758742 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-06a0068f-a7e3-49bd-a3de-f2ba7a805cc3 req-7d14f617-d15d-44b3-9857-df0104b2db53 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:12.792426 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-06a0068f-a7e3-49bd-a3de-f2ba7a805cc3 req-7d14f617-d15d-44b3-9857-df0104b2db53 service nova] Creating event network-vif-plugged:a6e1b245-35b9-4d61-8ca7-43f55954fbc5 for instance e192310d-3cab-471d-8d3e-d161ef4de6c8 on n-h1-846466-12 Aug 04 17:04:12.807141 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-06a0068f-a7e3-49bd-a3de-f2ba7a805cc3 req-7d14f617-d15d-44b3-9857-df0104b2db53 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081267 Aug 04 17:04:12.807833 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2683/5258] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:12.992667 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-410a29bd-23d2-4863-8b13-a005a10f6fd8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:12.993076 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-410a29bd-23d2-4863-8b13-a005a10f6fd8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:13.019680 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-410a29bd-23d2-4863-8b13-a005a10f6fd8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:13.019680 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-410a29bd-23d2-4863-8b13-a005a10f6fd8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:13.019680 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-410a29bd-23d2-4863-8b13-a005a10f6fd8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:13.020111 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-410a29bd-23d2-4863-8b13-a005a10f6fd8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:13.268662 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5b90d671-3ee6-47c4-bdbb-5c3088bee7ca tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:13.269874 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5b90d671-3ee6-47c4-bdbb-5c3088bee7ca tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:13.287347 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5b90d671-3ee6-47c4-bdbb-5c3088bee7ca tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:13.289564 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5b90d671-3ee6-47c4-bdbb-5c3088bee7ca tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:13.292606 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5b90d671-3ee6-47c4-bdbb-5c3088bee7ca tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:13.293662 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5b90d671-3ee6-47c4-bdbb-5c3088bee7ca tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:13.298185 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-410a29bd-23d2-4863-8b13-a005a10f6fd8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:13.315340 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-410a29bd-23d2-4863-8b13-a005a10f6fd8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1188 microversion: 2.1 time: 0.327130 Aug 04 17:04:13.317422 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2576/5259] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:12 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1188 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:13.557659 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5b90d671-3ee6-47c4-bdbb-5c3088bee7ca tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:13.572830 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5b90d671-3ee6-47c4-bdbb-5c3088bee7ca tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:13.576545 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5b90d671-3ee6-47c4-bdbb-5c3088bee7ca tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:13.579827 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5b90d671-3ee6-47c4-bdbb-5c3088bee7ca tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1731 microversion: 2.20 time: 0.316220 Aug 04 17:04:13.597881 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2684/5260] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:04:13 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1731 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:04:14.338825 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-36e2e2f5-a6f4-40c1-b557-0649a2adb085 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:14.340828 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-36e2e2f5-a6f4-40c1-b557-0649a2adb085 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:14.352133 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-36e2e2f5-a6f4-40c1-b557-0649a2adb085 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:14.352950 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-36e2e2f5-a6f4-40c1-b557-0649a2adb085 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:14.354420 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-36e2e2f5-a6f4-40c1-b557-0649a2adb085 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:14.355086 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-36e2e2f5-a6f4-40c1-b557-0649a2adb085 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:14.535822 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-36e2e2f5-a6f4-40c1-b557-0649a2adb085 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:14.553113 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-36e2e2f5-a6f4-40c1-b557-0649a2adb085 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 200 len: 1188 microversion: 2.1 time: 0.217389 Aug 04 17:04:14.555787 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2577/5261] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:14 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 1188 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:14.610074 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7075bc10-608e-44a8-acf0-c80df0cbe75a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:14.612832 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7075bc10-608e-44a8-acf0-c80df0cbe75a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:14.635681 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7075bc10-608e-44a8-acf0-c80df0cbe75a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:14.638083 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7075bc10-608e-44a8-acf0-c80df0cbe75a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:14.640272 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7075bc10-608e-44a8-acf0-c80df0cbe75a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:14.642011 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7075bc10-608e-44a8-acf0-c80df0cbe75a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:14.905036 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7075bc10-608e-44a8-acf0-c80df0cbe75a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:14.931343 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7075bc10-608e-44a8-acf0-c80df0cbe75a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:14.935059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7075bc10-608e-44a8-acf0-c80df0cbe75a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:14.944847 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7075bc10-608e-44a8-acf0-c80df0cbe75a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1731 microversion: 2.20 time: 0.340987 Aug 04 17:04:14.949245 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2685/5262] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:04:14 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1731 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:04:15.576013 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4464474c-bead-4f0a-8668-5747fd8041ae tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:15.577024 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4464474c-bead-4f0a-8668-5747fd8041ae tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:15.596124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4464474c-bead-4f0a-8668-5747fd8041ae tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:15.596873 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4464474c-bead-4f0a-8668-5747fd8041ae tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:15.599265 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4464474c-bead-4f0a-8668-5747fd8041ae tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:15.600064 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4464474c-bead-4f0a-8668-5747fd8041ae tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:15.649963 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-4464474c-bead-4f0a-8668-5747fd8041ae tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] HTTP exception thrown: Instance 19a8136d-f89b-449a-9cf9-3e2b246fc5e1 could not be found. Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4464474c-bead-4f0a-8668-5747fd8041ae tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Request method failure captured: Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 HTTP/1.1 Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_saEEOyGnjC2YSw5rO0XXZ0SIXFPgcyNqjoEnoWtNKNr9NN9-nC4VrXak9kuQQxq1he9punHwiXqtbTRNS_i0OM4UCS6bcDxdgTY6YMq4AHl3lv7jEdWuqMUDAU4k5OfnQSgkMml4THPPXJh4YiohQx-XVMfF21_bM4MqtZQZ4iEBI Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 78a0adb69ba24749817a8855effc20ad Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78a0adb69ba24749817a8855effc20ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_78a0adb69ba24749817a8855effc20ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78a0adb69ba24749817a8855effc20ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/78a0adb69ba24749817a8855effc20ad"}]}] Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 78a0adb69ba24749817a8855effc20ad Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-TestVolumeBootPattern-1920412406-project Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: ea9cab1c1eff47ddb881a2b57bf240f3 Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-TestVolumeBootPattern-1920412406-project Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 19a8136d-f89b-449a-9cf9-3e2b246fc5e1 could not be found. Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '19a8136d-f89b-449a-9cf9-3e2b246fc5e1'} Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19a8136d-f89b-449a-9cf9-3e2b246fc5e1 could not be found. Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19a8136d-f89b-449a-9cf9-3e2b246fc5e1 could not be found. Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:15.654244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:04:15.660141 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:15.660141 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:15.660141 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:15.660141 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:04:15.660141 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:04:15.660141 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19a8136d-f89b-449a-9cf9-3e2b246fc5e1 could not be found. Aug 04 17:04:15.660141 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:04:15.660141 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4464474c-bead-4f0a-8668-5747fd8041ae tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Returning 404 to user: Instance 19a8136d-f89b-449a-9cf9-3e2b246fc5e1 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:04:15.660141 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4464474c-bead-4f0a-8668-5747fd8041ae tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 404 len: 111 microversion: 2.1 time: 0.086379 Aug 04 17:04:15.660141 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2578/5263] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:15 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:04:15.976222 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-763850e7-bec9-485d-8a31-9b6338226a8a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:15.977028 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-763850e7-bec9-485d-8a31-9b6338226a8a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:16.008236 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-763850e7-bec9-485d-8a31-9b6338226a8a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:16.010170 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-763850e7-bec9-485d-8a31-9b6338226a8a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:16.011370 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-763850e7-bec9-485d-8a31-9b6338226a8a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:16.011835 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-763850e7-bec9-485d-8a31-9b6338226a8a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:16.317243 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-763850e7-bec9-485d-8a31-9b6338226a8a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:16.327667 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-763850e7-bec9-485d-8a31-9b6338226a8a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:16.330675 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-763850e7-bec9-485d-8a31-9b6338226a8a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:16.332161 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-763850e7-bec9-485d-8a31-9b6338226a8a tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1731 microversion: 2.20 time: 0.360806 Aug 04 17:04:16.346165 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2686/5264] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:04:15 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1731 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:04:17.361754 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4f7632e5-5c79-46eb-b315-c5b4cfabd268 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:17.361754 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4f7632e5-5c79-46eb-b315-c5b4cfabd268 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:17.372718 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4f7632e5-5c79-46eb-b315-c5b4cfabd268 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:17.373844 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4f7632e5-5c79-46eb-b315-c5b4cfabd268 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:17.374867 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4f7632e5-5c79-46eb-b315-c5b4cfabd268 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:17.375772 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4f7632e5-5c79-46eb-b315-c5b4cfabd268 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:17.620716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4f7632e5-5c79-46eb-b315-c5b4cfabd268 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:17.630530 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4f7632e5-5c79-46eb-b315-c5b4cfabd268 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:17.632106 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4f7632e5-5c79-46eb-b315-c5b4cfabd268 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:17.633758 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4f7632e5-5c79-46eb-b315-c5b4cfabd268 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1718 microversion: 2.20 time: 0.279968 Aug 04 17:04:17.634331 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2579/5265] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:04:17 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1718 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:04:19.100830 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-857a5fee-a8df-43dc-969d-583c01150850 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:19.102282 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-857a5fee-a8df-43dc-969d-583c01150850 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:19.112929 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-857a5fee-a8df-43dc-969d-583c01150850 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:19.114214 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-857a5fee-a8df-43dc-969d-583c01150850 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:19.115250 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-857a5fee-a8df-43dc-969d-583c01150850 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:19.115990 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-857a5fee-a8df-43dc-969d-583c01150850 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:19.137832 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-857a5fee-a8df-43dc-969d-583c01150850 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] HTTP exception thrown: Instance 19a8136d-f89b-449a-9cf9-3e2b246fc5e1 could not be found. Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-857a5fee-a8df-43dc-969d-583c01150850 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Request method failure captured: Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 HTTP/1.1 Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_saEEOyGnjC2YSw5rO0XXZ0SIXFPgcyNqjoEnoWtNKNr9NN9-nC4VrXak9kuQQxq1he9punHwiXqtbTRNS_i0OM4UCS6bcDxdgTY6YMq4AHl3lv7jEdWuqMUDAU4k5OfnQSgkMml4THPPXJh4YiohQx-XVMfF21_bM4MqtZQZ4iEBI Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 78a0adb69ba24749817a8855effc20ad Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78a0adb69ba24749817a8855effc20ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_78a0adb69ba24749817a8855effc20ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78a0adb69ba24749817a8855effc20ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/78a0adb69ba24749817a8855effc20ad"}]}] Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 78a0adb69ba24749817a8855effc20ad Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-TestVolumeBootPattern-1920412406-project Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: ea9cab1c1eff47ddb881a2b57bf240f3 Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-TestVolumeBootPattern-1920412406-project Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 19a8136d-f89b-449a-9cf9-3e2b246fc5e1 could not be found. Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '19a8136d-f89b-449a-9cf9-3e2b246fc5e1'} Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19a8136d-f89b-449a-9cf9-3e2b246fc5e1 could not be found. Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:04:19.140643 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:04:19.144353 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19a8136d-f89b-449a-9cf9-3e2b246fc5e1 could not be found. Aug 04 17:04:19.144353 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:04:19.144353 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:19.144353 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:04:19.144353 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:19.144353 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:19.144353 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:19.144353 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:04:19.144353 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:04:19.144353 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19a8136d-f89b-449a-9cf9-3e2b246fc5e1 could not be found. Aug 04 17:04:19.144353 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:04:19.146715 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-857a5fee-a8df-43dc-969d-583c01150850 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Returning 404 to user: Instance 19a8136d-f89b-449a-9cf9-3e2b246fc5e1 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:04:19.148470 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-857a5fee-a8df-43dc-969d-583c01150850 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "DELETE /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 404 len: 111 microversion: 2.1 time: 0.052690 Aug 04 17:04:19.149496 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2687/5266] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:04:19 2022] DELETE /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:04:19.164633 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-73ff0f7c-4887-421a-80f3-c9e2dc5fddb8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:19.165968 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-73ff0f7c-4887-421a-80f3-c9e2dc5fddb8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 19a8136d-f89b-449a-9cf9-3e2b246fc5e1] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:19.182161 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-73ff0f7c-4887-421a-80f3-c9e2dc5fddb8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:19.183208 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-73ff0f7c-4887-421a-80f3-c9e2dc5fddb8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:19.184675 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-73ff0f7c-4887-421a-80f3-c9e2dc5fddb8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:19.185817 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-73ff0f7c-4887-421a-80f3-c9e2dc5fddb8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:19.219937 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-73ff0f7c-4887-421a-80f3-c9e2dc5fddb8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] HTTP exception thrown: Instance 19a8136d-f89b-449a-9cf9-3e2b246fc5e1 could not be found. Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-73ff0f7c-4887-421a-80f3-c9e2dc5fddb8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Request method failure captured: Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 HTTP/1.1 Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_saEEOyGnjC2YSw5rO0XXZ0SIXFPgcyNqjoEnoWtNKNr9NN9-nC4VrXak9kuQQxq1he9punHwiXqtbTRNS_i0OM4UCS6bcDxdgTY6YMq4AHl3lv7jEdWuqMUDAU4k5OfnQSgkMml4THPPXJh4YiohQx-XVMfF21_bM4MqtZQZ4iEBI Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 78a0adb69ba24749817a8855effc20ad Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78a0adb69ba24749817a8855effc20ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_78a0adb69ba24749817a8855effc20ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78a0adb69ba24749817a8855effc20ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/78a0adb69ba24749817a8855effc20ad"}]}] Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 78a0adb69ba24749817a8855effc20ad Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-TestVolumeBootPattern-1920412406-project Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: ea9cab1c1eff47ddb881a2b57bf240f3 Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-TestVolumeBootPattern-1920412406-project Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 19a8136d-f89b-449a-9cf9-3e2b246fc5e1 could not be found. Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '19a8136d-f89b-449a-9cf9-3e2b246fc5e1'} Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19a8136d-f89b-449a-9cf9-3e2b246fc5e1 could not be found. Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19a8136d-f89b-449a-9cf9-3e2b246fc5e1 could not be found. Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:19.223430 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:04:19.227159 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:19.227159 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:19.227159 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:19.227159 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:04:19.227159 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:04:19.227159 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19a8136d-f89b-449a-9cf9-3e2b246fc5e1 could not be found. Aug 04 17:04:19.227159 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:04:19.229651 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-73ff0f7c-4887-421a-80f3-c9e2dc5fddb8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Returning 404 to user: Instance 19a8136d-f89b-449a-9cf9-3e2b246fc5e1 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:04:19.231793 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-73ff0f7c-4887-421a-80f3-c9e2dc5fddb8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1" status: 404 len: 111 microversion: 2.1 time: 0.075377 Aug 04 17:04:19.242847 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2580/5267] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:19 2022] GET /compute/v2.1/servers/19a8136d-f89b-449a-9cf9-3e2b246fc5e1 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:04:50.554753 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3b6c1ab9-47f6-431a-81da-e712a0b0ac27 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:50.557599 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3b6c1ab9-47f6-431a-81da-e712a0b0ac27 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:50.562796 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=35 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:04:50.565730 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=27 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:04:50.585786 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b6c1ab9-47f6-431a-81da-e712a0b0ac27 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:50.590151 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b6c1ab9-47f6-431a-81da-e712a0b0ac27 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:50.591271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b6c1ab9-47f6-431a-81da-e712a0b0ac27 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:50.592426 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b6c1ab9-47f6-431a-81da-e712a0b0ac27 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:50.712479 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3b6c1ab9-47f6-431a-81da-e712a0b0ac27 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.162111 Aug 04 17:04:50.716008 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2688/5268] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Aug 4 17:04:50 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8/os-volume_attachments => generated 25 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:50.898946 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dfecb1bb-fc65-473e-8a4e-0629691ca8be tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:50.899726 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-dfecb1bb-fc65-473e-8a4e-0629691ca8be tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:50.916927 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=15 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:04:50.923799 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=55 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:04:50.927311 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dfecb1bb-fc65-473e-8a4e-0629691ca8be tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:50.932496 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dfecb1bb-fc65-473e-8a4e-0629691ca8be tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:50.936577 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dfecb1bb-fc65-473e-8a4e-0629691ca8be tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:50.939023 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dfecb1bb-fc65-473e-8a4e-0629691ca8be tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:51.050677 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-dfecb1bb-fc65-473e-8a4e-0629691ca8be tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:04:51.292288 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dfecb1bb-fc65-473e-8a4e-0629691ca8be tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 204 len: 0 microversion: 2.20 time: 0.397597 Aug 04 17:04:51.295095 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2581/5269] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Aug 4 17:04:50 2022] DELETE /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 04 17:04:51.306120 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fe73b897-0eb7-4386-998d-30f1faac7d23 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:51.306955 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fe73b897-0eb7-4386-998d-30f1faac7d23 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:51.318732 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fe73b897-0eb7-4386-998d-30f1faac7d23 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:51.321915 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fe73b897-0eb7-4386-998d-30f1faac7d23 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:51.323124 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fe73b897-0eb7-4386-998d-30f1faac7d23 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:51.325330 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fe73b897-0eb7-4386-998d-30f1faac7d23 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:51.933271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fe73b897-0eb7-4386-998d-30f1faac7d23 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:51.951527 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fe73b897-0eb7-4386-998d-30f1faac7d23 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:51.959323 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fe73b897-0eb7-4386-998d-30f1faac7d23 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:51.962994 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fe73b897-0eb7-4386-998d-30f1faac7d23 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1724 microversion: 2.20 time: 0.661396 Aug 04 17:04:51.964708 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2689/5270] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:04:51 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1724 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:04:52.996882 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-be417383-ffce-4a18-ba00-57114498ec18 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:53.001121 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-be417383-ffce-4a18-ba00-57114498ec18 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:53.036847 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be417383-ffce-4a18-ba00-57114498ec18 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:53.048043 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be417383-ffce-4a18-ba00-57114498ec18 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:53.049953 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be417383-ffce-4a18-ba00-57114498ec18 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:53.058862 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-be417383-ffce-4a18-ba00-57114498ec18 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:53.954936 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-be417383-ffce-4a18-ba00-57114498ec18 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:53.967256 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-be417383-ffce-4a18-ba00-57114498ec18 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:53.978214 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-be417383-ffce-4a18-ba00-57114498ec18 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:53.979907 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-be417383-ffce-4a18-ba00-57114498ec18 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1724 microversion: 2.20 time: 0.994262 Aug 04 17:04:53.985570 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2582/5271] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:04:52 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1724 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:04:55.008926 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5fef8815-e7a7-44f9-8f1c-763a8cdf6626 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:55.010184 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5fef8815-e7a7-44f9-8f1c-763a8cdf6626 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:55.020638 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5fef8815-e7a7-44f9-8f1c-763a8cdf6626 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:55.027618 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5fef8815-e7a7-44f9-8f1c-763a8cdf6626 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:55.028612 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5fef8815-e7a7-44f9-8f1c-763a8cdf6626 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:55.029190 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5fef8815-e7a7-44f9-8f1c-763a8cdf6626 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:55.802663 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5fef8815-e7a7-44f9-8f1c-763a8cdf6626 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:55.812230 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5fef8815-e7a7-44f9-8f1c-763a8cdf6626 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:55.831533 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5fef8815-e7a7-44f9-8f1c-763a8cdf6626 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:55.832898 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5fef8815-e7a7-44f9-8f1c-763a8cdf6626 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1724 microversion: 2.20 time: 0.828822 Aug 04 17:04:55.842559 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2690/5272] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:04:55 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1724 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:04:56.528409 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-92f97618-ed2d-48d1-b529-018a17d4bc71 req-f1a3e329-415d-4b6e-b481-6884a1701914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e192310d-3cab-471d-8d3e-d161ef4de6c8", "name": "network-vif-deleted", "tag": "a6e1b245-35b9-4d61-8ca7-43f55954fbc5"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:56.577132 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-92f97618-ed2d-48d1-b529-018a17d4bc71 req-f1a3e329-415d-4b6e-b481-6884a1701914 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:56.579372 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-92f97618-ed2d-48d1-b529-018a17d4bc71 req-f1a3e329-415d-4b6e-b481-6884a1701914 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:56.647286 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-92f97618-ed2d-48d1-b529-018a17d4bc71 req-f1a3e329-415d-4b6e-b481-6884a1701914 service nova] Creating event network-vif-deleted:a6e1b245-35b9-4d61-8ca7-43f55954fbc5 for instance e192310d-3cab-471d-8d3e-d161ef4de6c8 on n-h1-846466-12 Aug 04 17:04:56.665972 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-92f97618-ed2d-48d1-b529-018a17d4bc71 req-f1a3e329-415d-4b6e-b481-6884a1701914 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146335 Aug 04 17:04:56.677201 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2583/5273] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:56.858876 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d43f9422-864a-4630-b6ac-ed690066f133 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:56.859585 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d43f9422-864a-4630-b6ac-ed690066f133 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:56.879886 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d43f9422-864a-4630-b6ac-ed690066f133 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:56.880614 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d43f9422-864a-4630-b6ac-ed690066f133 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:56.882783 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d43f9422-864a-4630-b6ac-ed690066f133 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:56.884784 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d43f9422-864a-4630-b6ac-ed690066f133 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:57.001748 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d43f9422-864a-4630-b6ac-ed690066f133 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:57.004961 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d43f9422-864a-4630-b6ac-ed690066f133 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:57.007383 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-d43f9422-864a-4630-b6ac-ed690066f133 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lazy-loading 'fault' on Instance uuid e192310d-3cab-471d-8d3e-d161ef4de6c8 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:04:57.156346 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d43f9422-864a-4630-b6ac-ed690066f133 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:57.181002 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d43f9422-864a-4630-b6ac-ed690066f133 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:57.199087 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d43f9422-864a-4630-b6ac-ed690066f133 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6700990d94334afcac9adff62009d099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470aa7b0a4464f9789d315176c4b7bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:57.200833 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d43f9422-864a-4630-b6ac-ed690066f133 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 200 len: 1370 microversion: 2.20 time: 0.346255 Aug 04 17:04:57.205422 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2691/5274] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:04:56 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 1370 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:04:58.231575 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1b2e8f75-690c-4794-8acf-734947d9aec3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:58.232451 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1b2e8f75-690c-4794-8acf-734947d9aec3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:58.250396 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1b2e8f75-690c-4794-8acf-734947d9aec3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:58.250396 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1b2e8f75-690c-4794-8acf-734947d9aec3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:58.251224 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1b2e8f75-690c-4794-8acf-734947d9aec3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:04:58.251657 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1b2e8f75-690c-4794-8acf-734947d9aec3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:04:58.342858 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-1b2e8f75-690c-4794-8acf-734947d9aec3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] HTTP exception thrown: Instance e192310d-3cab-471d-8d3e-d161ef4de6c8 could not be found. Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1b2e8f75-690c-4794-8acf-734947d9aec3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Request method failure captured: Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 HTTP/1.1 Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_qndxwtkVSpt9eVNk6ZKpFWJUcFmuQLaaSx6ocgZ7gmg2r9GxpWFc241UYsUoIBHVxqlAzz16eog81fL_ft_rOSwNbZQ8QVGT5NAUYt1npmuLnbZSe16PgStKvW5mqTXgejMujgHsJd9y2d2cMsw6qbBYV95uiNxB_Det_6BWr4NE8 Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 470aa7b0a4464f9789d315176c4b7bc6 Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1028345116 Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/470aa7b0a4464f9789d315176c4b7bc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_470aa7b0a4464f9789d315176c4b7bc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/470aa7b0a4464f9789d315176c4b7bc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/470aa7b0a4464f9789d315176c4b7bc6"}]}] Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1028345116 Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 470aa7b0a4464f9789d315176c4b7bc6 Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1028345116 Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-AttachVolumeShelveTestJSON-1028345116-project Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 6700990d94334afcac9adff62009d099 Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1028345116-project Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance e192310d-3cab-471d-8d3e-d161ef4de6c8 could not be found. Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'e192310d-3cab-471d-8d3e-d161ef4de6c8'} Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e192310d-3cab-471d-8d3e-d161ef4de6c8 could not be found. Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e192310d-3cab-471d-8d3e-d161ef4de6c8 could not be found. Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.351667 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:58.355255 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.355255 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.355255 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:58.355255 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:58.355255 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:04:58.355255 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:04:58.355255 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e192310d-3cab-471d-8d3e-d161ef4de6c8 could not be found. Aug 04 17:04:58.355255 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.355255 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1b2e8f75-690c-4794-8acf-734947d9aec3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Returning 404 to user: Instance e192310d-3cab-471d-8d3e-d161ef4de6c8 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:04:58.357334 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1b2e8f75-690c-4794-8acf-734947d9aec3 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 404 len: 111 microversion: 2.20 time: 0.130421 Aug 04 17:04:58.364085 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2584/5275] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:04:58 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:04:58.368776 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-85aff390-429c-4c82-b9cb-82aaa3093b91 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '.version_select at 0x7f7e89cc93a0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:58.426192 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-85aff390-429c-4c82-b9cb-82aaa3093b91 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-605289474" status: 204 len: 0 microversion: 2.20 time: 0.061518 Aug 04 17:04:58.436238 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2692/5276] 10.222.0.23 () {60 vars in 1259 bytes} [Thu Aug 4 17:04:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-605289474 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 17:05:02.671781 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cdfc2115-3cb4-4dd7-9100-c452949f3ee3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-610718536", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "039386e2-ad5f-4b14-9ee4-cc5f3c42a8fb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "8cd64b36-f8a8-48d4-b083-6164d20009da"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:02.917672 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-cdfc2115-3cb4-4dd7-9100-c452949f3ee3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] validate_networks() for [('8cd64b36-f8a8-48d4-b083-6164d20009da', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:05:04.059475 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-cdfc2115-3cb4-4dd7-9100-c452949f3ee3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:05:04.060075 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-cdfc2115-3cb4-4dd7-9100-c452949f3ee3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:05:04.060443 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-cdfc2115-3cb4-4dd7-9100-c452949f3ee3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:05:04.061035 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-cdfc2115-3cb4-4dd7-9100-c452949f3ee3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:05:04.062225 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-cdfc2115-3cb4-4dd7-9100-c452949f3ee3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:05:04.089424 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cdfc2115-3cb4-4dd7-9100-c452949f3ee3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:04.093591 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cdfc2115-3cb4-4dd7-9100-c452949f3ee3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:04.095976 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cdfc2115-3cb4-4dd7-9100-c452949f3ee3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:04.096423 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cdfc2115-3cb4-4dd7-9100-c452949f3ee3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:04.187579 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-cdfc2115-3cb4-4dd7-9100-c452949f3ee3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Getting quotas for project 78a0adb69ba24749817a8855effc20ad. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:05:04.250380 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-cdfc2115-3cb4-4dd7-9100-c452949f3ee3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Getting quotas for user ea9cab1c1eff47ddb881a2b57bf240f3 and project 78a0adb69ba24749817a8855effc20ad. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:05:04.442658 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cdfc2115-3cb4-4dd7-9100-c452949f3ee3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:05:04.445295 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cdfc2115-3cb4-4dd7-9100-c452949f3ee3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='039386e2-ad5f-4b14-9ee4-cc5f3c42a8fb',volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:05:04.819868 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cdfc2115-3cb4-4dd7-9100-c452949f3ee3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.152202 Aug 04 17:05:04.820838 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2585/5277] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:05:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:05:04.850677 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b5920c3d-2b93-4cf7-a638-8f12a1385d3e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:04.866650 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b5920c3d-2b93-4cf7-a638-8f12a1385d3e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:05.082116 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b5920c3d-2b93-4cf7-a638-8f12a1385d3e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:05.096548 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b5920c3d-2b93-4cf7-a638-8f12a1385d3e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 200 len: 1070 microversion: 2.1 time: 0.262088 Aug 04 17:05:05.097154 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2693/5278] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:04 2022] GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 1070 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:06.120755 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ce0c16f0-f526-46fe-a486-0361a183609c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:06.122024 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ce0c16f0-f526-46fe-a486-0361a183609c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:06.141549 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ce0c16f0-f526-46fe-a486-0361a183609c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:06.141913 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ce0c16f0-f526-46fe-a486-0361a183609c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:06.143692 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ce0c16f0-f526-46fe-a486-0361a183609c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:06.146060 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ce0c16f0-f526-46fe-a486-0361a183609c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:06.346867 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ce0c16f0-f526-46fe-a486-0361a183609c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:06.373801 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ce0c16f0-f526-46fe-a486-0361a183609c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 200 len: 1112 microversion: 2.1 time: 0.255747 Aug 04 17:05:06.392199 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2586/5279] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:06 2022] GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 1112 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:06.419207 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-81988cac-c781-4f27-83b9-29e57c7ecfb1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:06.419734 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-81988cac-c781-4f27-83b9-29e57c7ecfb1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:06.449871 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-81988cac-c781-4f27-83b9-29e57c7ecfb1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:06.450406 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-81988cac-c781-4f27-83b9-29e57c7ecfb1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:06.451280 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-81988cac-c781-4f27-83b9-29e57c7ecfb1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:06.451787 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-81988cac-c781-4f27-83b9-29e57c7ecfb1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:06.491502 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-81988cac-c781-4f27-83b9-29e57c7ecfb1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] HTTP exception thrown: Instance e192310d-3cab-471d-8d3e-d161ef4de6c8 could not be found. Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-81988cac-c781-4f27-83b9-29e57c7ecfb1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Request method failure captured: Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 HTTP/1.1 Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_qndxwtkVSpt9eVNk6ZKpFWJUcFmuQLaaSx6ocgZ7gmg2r9GxpWFc241UYsUoIBHVxqlAzz16eog81fL_ft_rOSwNbZQ8QVGT5NAUYt1npmuLnbZSe16PgStKvW5mqTXgejMujgHsJd9y2d2cMsw6qbBYV95uiNxB_Det_6BWr4NE8 Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 470aa7b0a4464f9789d315176c4b7bc6 Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1028345116 Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/470aa7b0a4464f9789d315176c4b7bc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_470aa7b0a4464f9789d315176c4b7bc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/470aa7b0a4464f9789d315176c4b7bc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/470aa7b0a4464f9789d315176c4b7bc6"}]}] Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1028345116 Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 470aa7b0a4464f9789d315176c4b7bc6 Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1028345116 Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-AttachVolumeShelveTestJSON-1028345116-project Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 6700990d94334afcac9adff62009d099 Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1028345116-project Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance e192310d-3cab-471d-8d3e-d161ef4de6c8 could not be found. Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'e192310d-3cab-471d-8d3e-d161ef4de6c8'} Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e192310d-3cab-471d-8d3e-d161ef4de6c8 could not be found. Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:05:06.495758 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:05:06.499325 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e192310d-3cab-471d-8d3e-d161ef4de6c8 could not be found. Aug 04 17:05:06.499325 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:05:06.499325 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:06.499325 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:05:06.499325 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:06.499325 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:06.499325 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:06.499325 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:05:06.499325 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:05:06.499325 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e192310d-3cab-471d-8d3e-d161ef4de6c8 could not be found. Aug 04 17:05:06.499325 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:05:06.499920 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-81988cac-c781-4f27-83b9-29e57c7ecfb1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Returning 404 to user: Instance e192310d-3cab-471d-8d3e-d161ef4de6c8 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:05:06.500351 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-81988cac-c781-4f27-83b9-29e57c7ecfb1 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 404 len: 111 microversion: 2.20 time: 0.089123 Aug 04 17:05:06.501115 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2694/5280] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Aug 4 17:05:06 2022] DELETE /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:05:06.510594 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6aed65c1-2e18-43c6-858b-ec5c72af0fa9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:06.511251 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6aed65c1-2e18-43c6-858b-ec5c72af0fa9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: e192310d-3cab-471d-8d3e-d161ef4de6c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:06.520885 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6aed65c1-2e18-43c6-858b-ec5c72af0fa9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:06.525248 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6aed65c1-2e18-43c6-858b-ec5c72af0fa9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:06.526335 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6aed65c1-2e18-43c6-858b-ec5c72af0fa9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:06.527692 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6aed65c1-2e18-43c6-858b-ec5c72af0fa9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:06.562920 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-6aed65c1-2e18-43c6-858b-ec5c72af0fa9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] HTTP exception thrown: Instance e192310d-3cab-471d-8d3e-d161ef4de6c8 could not be found. Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6aed65c1-2e18-43c6-858b-ec5c72af0fa9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Request method failure captured: Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 HTTP/1.1 Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_qndxwtkVSpt9eVNk6ZKpFWJUcFmuQLaaSx6ocgZ7gmg2r9GxpWFc241UYsUoIBHVxqlAzz16eog81fL_ft_rOSwNbZQ8QVGT5NAUYt1npmuLnbZSe16PgStKvW5mqTXgejMujgHsJd9y2d2cMsw6qbBYV95uiNxB_Det_6BWr4NE8 Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 470aa7b0a4464f9789d315176c4b7bc6 Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1028345116 Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/470aa7b0a4464f9789d315176c4b7bc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_470aa7b0a4464f9789d315176c4b7bc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/470aa7b0a4464f9789d315176c4b7bc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/470aa7b0a4464f9789d315176c4b7bc6"}]}] Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1028345116 Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 470aa7b0a4464f9789d315176c4b7bc6 Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1028345116 Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-AttachVolumeShelveTestJSON-1028345116-project Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 6700990d94334afcac9adff62009d099 Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1028345116-project Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance e192310d-3cab-471d-8d3e-d161ef4de6c8 could not be found. Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'e192310d-3cab-471d-8d3e-d161ef4de6c8'} Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e192310d-3cab-471d-8d3e-d161ef4de6c8 could not be found. Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e192310d-3cab-471d-8d3e-d161ef4de6c8 could not be found. Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:05:06.569656 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:06.575033 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:05:06.575033 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:06.575033 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:06.575033 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:06.575033 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:05:06.575033 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:05:06.575033 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e192310d-3cab-471d-8d3e-d161ef4de6c8 could not be found. Aug 04 17:05:06.575033 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:05:06.576782 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6aed65c1-2e18-43c6-858b-ec5c72af0fa9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Returning 404 to user: Instance e192310d-3cab-471d-8d3e-d161ef4de6c8 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:05:06.577942 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6aed65c1-2e18-43c6-858b-ec5c72af0fa9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8" status: 404 len: 111 microversion: 2.20 time: 0.072046 Aug 04 17:05:06.583254 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2587/5281] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:05:06 2022] GET /compute/v2.1/servers/e192310d-3cab-471d-8d3e-d161ef4de6c8 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:05:07.395519 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8b020973-beeb-415e-bcdb-f67a09de6611 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:07.396633 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8b020973-beeb-415e-bcdb-f67a09de6611 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:07.413857 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8b020973-beeb-415e-bcdb-f67a09de6611 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:07.416959 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8b020973-beeb-415e-bcdb-f67a09de6611 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:07.421246 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8b020973-beeb-415e-bcdb-f67a09de6611 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:07.423203 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8b020973-beeb-415e-bcdb-f67a09de6611 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:07.616453 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8b020973-beeb-415e-bcdb-f67a09de6611 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:07.627502 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8b020973-beeb-415e-bcdb-f67a09de6611 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 200 len: 1186 microversion: 2.1 time: 0.236774 Aug 04 17:05:07.636569 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2695/5282] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:07 2022] GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 1186 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:08.670149 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8d008924-600e-43cd-b580-5519f8b795d3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:08.675473 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8d008924-600e-43cd-b580-5519f8b795d3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:08.697835 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8d008924-600e-43cd-b580-5519f8b795d3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:08.698308 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8d008924-600e-43cd-b580-5519f8b795d3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:08.704337 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8d008924-600e-43cd-b580-5519f8b795d3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:08.704814 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8d008924-600e-43cd-b580-5519f8b795d3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:09.401618 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8d008924-600e-43cd-b580-5519f8b795d3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:09.413098 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8d008924-600e-43cd-b580-5519f8b795d3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 200 len: 1228 microversion: 2.1 time: 0.754329 Aug 04 17:05:09.420741 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2588/5283] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:08 2022] GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 1228 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:10.434966 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-022184e5-6977-4346-8ab2-d06225cd4a18 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:10.435571 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-022184e5-6977-4346-8ab2-d06225cd4a18 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:10.472820 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-022184e5-6977-4346-8ab2-d06225cd4a18 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:10.488069 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-022184e5-6977-4346-8ab2-d06225cd4a18 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:10.489976 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-022184e5-6977-4346-8ab2-d06225cd4a18 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:10.493077 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-022184e5-6977-4346-8ab2-d06225cd4a18 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:11.799357 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-022184e5-6977-4346-8ab2-d06225cd4a18 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:11.815517 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-022184e5-6977-4346-8ab2-d06225cd4a18 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 200 len: 1228 microversion: 2.1 time: 1.382256 Aug 04 17:05:11.816722 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2696/5284] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:10 2022] GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 1228 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:12.836791 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-72b18d27-3934-4b62-85e6-53dee5a59775 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:12.837454 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-72b18d27-3934-4b62-85e6-53dee5a59775 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:12.854848 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-72b18d27-3934-4b62-85e6-53dee5a59775 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:12.855640 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-72b18d27-3934-4b62-85e6-53dee5a59775 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:12.859963 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-72b18d27-3934-4b62-85e6-53dee5a59775 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:12.861710 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-72b18d27-3934-4b62-85e6-53dee5a59775 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:13.140174 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-1965fded-cb48-4d4d-a9d7-06965988af7e req-1171acb5-6ab6-4bd6-a543-6e479118a183 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0337a477-e21a-4d1c-886f-c9caa02906b7", "tag": "f8fd5042-ecfc-4bd6-aed4-37deaa6ee2a9"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:13.165749 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-1965fded-cb48-4d4d-a9d7-06965988af7e req-1171acb5-6ab6-4bd6-a543-6e479118a183 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:13.166200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-1965fded-cb48-4d4d-a9d7-06965988af7e req-1171acb5-6ab6-4bd6-a543-6e479118a183 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:13.189635 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-1965fded-cb48-4d4d-a9d7-06965988af7e req-1171acb5-6ab6-4bd6-a543-6e479118a183 service nova] Creating event network-changed:f8fd5042-ecfc-4bd6-aed4-37deaa6ee2a9 for instance 0337a477-e21a-4d1c-886f-c9caa02906b7 on n-h2-846466-12 Aug 04 17:05:13.199719 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-1965fded-cb48-4d4d-a9d7-06965988af7e req-1171acb5-6ab6-4bd6-a543-6e479118a183 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063721 Aug 04 17:05:13.202833 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2697/5285] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:13.526099 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-72b18d27-3934-4b62-85e6-53dee5a59775 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:13.538249 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-72b18d27-3934-4b62-85e6-53dee5a59775 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 200 len: 1228 microversion: 2.1 time: 0.705546 Aug 04 17:05:13.546235 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2589/5286] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:12 2022] GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 1228 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:14.569498 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-99c3de5c-0d7f-4c1a-819e-6cfc3ddbc494 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:14.570995 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-99c3de5c-0d7f-4c1a-819e-6cfc3ddbc494 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:14.601968 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-99c3de5c-0d7f-4c1a-819e-6cfc3ddbc494 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:14.602713 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-99c3de5c-0d7f-4c1a-819e-6cfc3ddbc494 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:14.604908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-99c3de5c-0d7f-4c1a-819e-6cfc3ddbc494 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:14.609714 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-99c3de5c-0d7f-4c1a-819e-6cfc3ddbc494 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:14.689584 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b5d54ec9-d555-4cc9-be7c-7ce86d209460 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:14.690948 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b5d54ec9-d555-4cc9-be7c-7ce86d209460 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:14.707420 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:14.710219 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:14.718544 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b5d54ec9-d555-4cc9-be7c-7ce86d209460 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:14.722691 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b5d54ec9-d555-4cc9-be7c-7ce86d209460 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:14.723743 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b5d54ec9-d555-4cc9-be7c-7ce86d209460 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:14.726705 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b5d54ec9-d555-4cc9-be7c-7ce86d209460 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:14.773186 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-b5d54ec9-d555-4cc9-be7c-7ce86d209460 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] HTTP exception thrown: Instance fdec5afc-3a3a-4d61-a934-5edf0c7c1397 could not be found. Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b5d54ec9-d555-4cc9-be7c-7ce86d209460 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Request method failure captured: Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 HTTP/1.1 Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_qndxwtkVSpt9eVNk6ZKpFWJUcFmuQLaaSx6ocgZ7gmg2r9GxpWFc241UYsUoIBHVxqlAzz16eog81fL_ft_rOSwNbZQ8QVGT5NAUYt1npmuLnbZSe16PgStKvW5mqTXgejMujgHsJd9y2d2cMsw6qbBYV95uiNxB_Det_6BWr4NE8 Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 470aa7b0a4464f9789d315176c4b7bc6 Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1028345116 Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/470aa7b0a4464f9789d315176c4b7bc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_470aa7b0a4464f9789d315176c4b7bc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/470aa7b0a4464f9789d315176c4b7bc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/470aa7b0a4464f9789d315176c4b7bc6"}]}] Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1028345116 Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 470aa7b0a4464f9789d315176c4b7bc6 Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1028345116 Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-AttachVolumeShelveTestJSON-1028345116-project Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 6700990d94334afcac9adff62009d099 Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1028345116-project Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance fdec5afc-3a3a-4d61-a934-5edf0c7c1397 could not be found. Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'fdec5afc-3a3a-4d61-a934-5edf0c7c1397'} Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdec5afc-3a3a-4d61-a934-5edf0c7c1397 could not be found. Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:05:14.775244 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:05:14.780236 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdec5afc-3a3a-4d61-a934-5edf0c7c1397 could not be found. Aug 04 17:05:14.780236 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:05:14.780236 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:14.780236 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:05:14.780236 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:14.780236 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:14.780236 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:14.780236 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:05:14.780236 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:05:14.780236 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdec5afc-3a3a-4d61-a934-5edf0c7c1397 could not be found. Aug 04 17:05:14.780236 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:05:14.782417 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b5d54ec9-d555-4cc9-be7c-7ce86d209460 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Returning 404 to user: Instance fdec5afc-3a3a-4d61-a934-5edf0c7c1397 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:05:14.783769 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b5d54ec9-d555-4cc9-be7c-7ce86d209460 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 404 len: 111 microversion: 2.20 time: 0.100851 Aug 04 17:05:14.790518 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2590/5287] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Aug 4 17:05:14 2022] DELETE /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:05:14.800234 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cd175340-4ba7-4785-8733-e4a58009c8b9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:14.805032 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cd175340-4ba7-4785-8733-e4a58009c8b9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] [instance: fdec5afc-3a3a-4d61-a934-5edf0c7c1397] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:14.817923 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cd175340-4ba7-4785-8733-e4a58009c8b9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:14.818378 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cd175340-4ba7-4785-8733-e4a58009c8b9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:14.819172 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cd175340-4ba7-4785-8733-e4a58009c8b9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:14.819842 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cd175340-4ba7-4785-8733-e4a58009c8b9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:14.848423 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-cd175340-4ba7-4785-8733-e4a58009c8b9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] HTTP exception thrown: Instance fdec5afc-3a3a-4d61-a934-5edf0c7c1397 could not be found. Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cd175340-4ba7-4785-8733-e4a58009c8b9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Request method failure captured: Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 HTTP/1.1 Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_qndxwtkVSpt9eVNk6ZKpFWJUcFmuQLaaSx6ocgZ7gmg2r9GxpWFc241UYsUoIBHVxqlAzz16eog81fL_ft_rOSwNbZQ8QVGT5NAUYt1npmuLnbZSe16PgStKvW5mqTXgejMujgHsJd9y2d2cMsw6qbBYV95uiNxB_Det_6BWr4NE8 Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 470aa7b0a4464f9789d315176c4b7bc6 Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1028345116 Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/470aa7b0a4464f9789d315176c4b7bc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_470aa7b0a4464f9789d315176c4b7bc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/470aa7b0a4464f9789d315176c4b7bc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/470aa7b0a4464f9789d315176c4b7bc6"}]}] Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1028345116 Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 470aa7b0a4464f9789d315176c4b7bc6 Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1028345116 Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-AttachVolumeShelveTestJSON-1028345116-project Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 6700990d94334afcac9adff62009d099 Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1028345116-project Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance fdec5afc-3a3a-4d61-a934-5edf0c7c1397 could not be found. Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'fdec5afc-3a3a-4d61-a934-5edf0c7c1397'} Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdec5afc-3a3a-4d61-a934-5edf0c7c1397 could not be found. Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdec5afc-3a3a-4d61-a934-5edf0c7c1397 could not be found. Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:05:14.850098 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:14.854586 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:05:14.854586 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:14.854586 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:14.854586 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:14.854586 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:05:14.854586 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:05:14.854586 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdec5afc-3a3a-4d61-a934-5edf0c7c1397 could not be found. Aug 04 17:05:14.854586 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:05:14.854586 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cd175340-4ba7-4785-8733-e4a58009c8b9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] Returning 404 to user: Instance fdec5afc-3a3a-4d61-a934-5edf0c7c1397 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:05:14.854586 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cd175340-4ba7-4785-8733-e4a58009c8b9 tempest-AttachVolumeShelveTestJSON-1028345116 tempest-AttachVolumeShelveTestJSON-1028345116-project] 10.222.0.23 "GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397" status: 404 len: 111 microversion: 2.20 time: 0.059561 Aug 04 17:05:14.854586 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2591/5288] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Aug 4 17:05:14 2022] GET /compute/v2.1/servers/fdec5afc-3a3a-4d61-a934-5edf0c7c1397 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:05:15.089811 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:15.646358 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-99c3de5c-0d7f-4c1a-819e-6cfc3ddbc494 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:15.665172 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-99c3de5c-0d7f-4c1a-819e-6cfc3ddbc494 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 200 len: 1228 microversion: 2.1 time: 1.098193 Aug 04 17:05:15.668287 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2698/5289] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:14 2022] GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 1228 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:16.688645 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-865547d8-fa9b-4ba8-8a9a-1e97f251ee9f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:16.689449 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-865547d8-fa9b-4ba8-8a9a-1e97f251ee9f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:16.702641 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-865547d8-fa9b-4ba8-8a9a-1e97f251ee9f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:16.703431 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-865547d8-fa9b-4ba8-8a9a-1e97f251ee9f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:16.705407 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-865547d8-fa9b-4ba8-8a9a-1e97f251ee9f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:16.706661 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-865547d8-fa9b-4ba8-8a9a-1e97f251ee9f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:17.072417 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-865547d8-fa9b-4ba8-8a9a-1e97f251ee9f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:17.085902 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-865547d8-fa9b-4ba8-8a9a-1e97f251ee9f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 200 len: 1228 microversion: 2.1 time: 0.401389 Aug 04 17:05:17.087070 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2592/5290] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:16 2022] GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 1228 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:18.110062 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-13b8bc42-e714-4eb9-8108-05dced82b730 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:18.111626 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-13b8bc42-e714-4eb9-8108-05dced82b730 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:18.144275 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-13b8bc42-e714-4eb9-8108-05dced82b730 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:18.150046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-13b8bc42-e714-4eb9-8108-05dced82b730 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:18.151381 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-13b8bc42-e714-4eb9-8108-05dced82b730 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:18.152154 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-13b8bc42-e714-4eb9-8108-05dced82b730 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:19.376059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-13b8bc42-e714-4eb9-8108-05dced82b730 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:19.398490 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-13b8bc42-e714-4eb9-8108-05dced82b730 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 200 len: 1228 microversion: 2.1 time: 1.292107 Aug 04 17:05:19.399570 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2699/5291] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:18 2022] GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 1228 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:20.421974 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d4ae7670-dc5b-4a64-9e75-dee6fe6cfa23 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:20.423200 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d4ae7670-dc5b-4a64-9e75-dee6fe6cfa23 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:20.439355 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d4ae7670-dc5b-4a64-9e75-dee6fe6cfa23 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:20.444976 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d4ae7670-dc5b-4a64-9e75-dee6fe6cfa23 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:20.446909 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d4ae7670-dc5b-4a64-9e75-dee6fe6cfa23 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:20.448481 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d4ae7670-dc5b-4a64-9e75-dee6fe6cfa23 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:20.959825 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d4ae7670-dc5b-4a64-9e75-dee6fe6cfa23 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:20.969334 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d4ae7670-dc5b-4a64-9e75-dee6fe6cfa23 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 200 len: 1228 microversion: 2.1 time: 0.552603 Aug 04 17:05:20.974948 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2593/5292] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:20 2022] GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 1228 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:21.996328 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-330abac0-4266-4a5e-8e95-01a1b087e677 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:21.997738 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-330abac0-4266-4a5e-8e95-01a1b087e677 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:22.007616 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:22.013972 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-330abac0-4266-4a5e-8e95-01a1b087e677 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:22.017033 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-330abac0-4266-4a5e-8e95-01a1b087e677 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:22.020636 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-330abac0-4266-4a5e-8e95-01a1b087e677 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:22.022772 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-330abac0-4266-4a5e-8e95-01a1b087e677 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:22.088120 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=55 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:22.549509 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-330abac0-4266-4a5e-8e95-01a1b087e677 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:22.564017 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-330abac0-4266-4a5e-8e95-01a1b087e677 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 200 len: 1216 microversion: 2.1 time: 0.572351 Aug 04 17:05:22.581799 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2700/5293] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:21 2022] GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 1216 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:24.195695 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-604503b1-921c-4a33-bbbe-702c55ef86d4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:24.196349 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-604503b1-921c-4a33-bbbe-702c55ef86d4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:24.198381 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:24.215823 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-604503b1-921c-4a33-bbbe-702c55ef86d4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:24.215823 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-604503b1-921c-4a33-bbbe-702c55ef86d4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:24.215823 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-604503b1-921c-4a33-bbbe-702c55ef86d4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:24.215823 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-604503b1-921c-4a33-bbbe-702c55ef86d4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:24.232314 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:24.588706 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-604503b1-921c-4a33-bbbe-702c55ef86d4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:24.602385 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-604503b1-921c-4a33-bbbe-702c55ef86d4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 200 len: 1216 microversion: 2.1 time: 1.019133 Aug 04 17:05:24.604500 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2594/5294] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:23 2022] GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 1216 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:25.627417 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d840d682-37f4-4f9c-b8a0-e74c1e72e234 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:25.628262 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d840d682-37f4-4f9c-b8a0-e74c1e72e234 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:25.635651 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d840d682-37f4-4f9c-b8a0-e74c1e72e234 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:25.636101 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d840d682-37f4-4f9c-b8a0-e74c1e72e234 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:25.636880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d840d682-37f4-4f9c-b8a0-e74c1e72e234 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:25.637324 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d840d682-37f4-4f9c-b8a0-e74c1e72e234 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:25.854529 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d840d682-37f4-4f9c-b8a0-e74c1e72e234 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:25.864002 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d840d682-37f4-4f9c-b8a0-e74c1e72e234 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 200 len: 1216 microversion: 2.1 time: 0.240891 Aug 04 17:05:25.865304 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2701/5295] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:25 2022] GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 1216 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:26.890668 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1cc79097-cb83-4456-941c-83df88751ee6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:26.890668 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1cc79097-cb83-4456-941c-83df88751ee6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:26.910659 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1cc79097-cb83-4456-941c-83df88751ee6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:26.911199 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1cc79097-cb83-4456-941c-83df88751ee6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:26.913161 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1cc79097-cb83-4456-941c-83df88751ee6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:26.913650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1cc79097-cb83-4456-941c-83df88751ee6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:27.284867 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1cc79097-cb83-4456-941c-83df88751ee6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:27.296412 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1cc79097-cb83-4456-941c-83df88751ee6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 200 len: 1216 microversion: 2.1 time: 0.412270 Aug 04 17:05:27.297392 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2595/5296] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:26 2022] GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 1216 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:28.324922 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c8db9319-c3d7-449b-96a1-eada4ac6b612 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:28.331809 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c8db9319-c3d7-449b-96a1-eada4ac6b612 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:28.376315 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c8db9319-c3d7-449b-96a1-eada4ac6b612 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:28.380324 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c8db9319-c3d7-449b-96a1-eada4ac6b612 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:28.386024 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c8db9319-c3d7-449b-96a1-eada4ac6b612 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:28.387283 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c8db9319-c3d7-449b-96a1-eada4ac6b612 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:28.854123 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c8db9319-c3d7-449b-96a1-eada4ac6b612 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:28.867943 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c8db9319-c3d7-449b-96a1-eada4ac6b612 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 200 len: 1216 microversion: 2.1 time: 0.549562 Aug 04 17:05:28.874317 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2702/5297] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:28 2022] GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 1216 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:29.902860 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4745e92d-2efb-4056-a893-d59a39b040a4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:29.904081 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4745e92d-2efb-4056-a893-d59a39b040a4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:29.918936 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4745e92d-2efb-4056-a893-d59a39b040a4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:29.922461 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4745e92d-2efb-4056-a893-d59a39b040a4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:29.924148 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4745e92d-2efb-4056-a893-d59a39b040a4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:29.924824 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4745e92d-2efb-4056-a893-d59a39b040a4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:30.861716 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-cdaa84f0-7b80-4cb6-a378-a28f33396226 req-f7e441c1-7016-4944-bbd2-c793cfc57db5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0337a477-e21a-4d1c-886f-c9caa02906b7", "name": "network-vif-plugged", "status": "completed", "tag": "f8fd5042-ecfc-4bd6-aed4-37deaa6ee2a9"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:30.884602 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-cdaa84f0-7b80-4cb6-a378-a28f33396226 req-f7e441c1-7016-4944-bbd2-c793cfc57db5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:30.895048 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-cdaa84f0-7b80-4cb6-a378-a28f33396226 req-f7e441c1-7016-4944-bbd2-c793cfc57db5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:30.935247 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-cdaa84f0-7b80-4cb6-a378-a28f33396226 req-f7e441c1-7016-4944-bbd2-c793cfc57db5 service nova] Creating event network-vif-plugged:f8fd5042-ecfc-4bd6-aed4-37deaa6ee2a9 for instance 0337a477-e21a-4d1c-886f-c9caa02906b7 on n-h2-846466-12 Aug 04 17:05:30.948589 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-cdaa84f0-7b80-4cb6-a378-a28f33396226 req-f7e441c1-7016-4944-bbd2-c793cfc57db5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.571070 Aug 04 17:05:30.950600 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2703/5298] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:05:31.088234 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4745e92d-2efb-4056-a893-d59a39b040a4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:31.103072 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4745e92d-2efb-4056-a893-d59a39b040a4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 200 len: 1216 microversion: 2.1 time: 1.208327 Aug 04 17:05:31.105610 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2596/5299] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:29 2022] GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 1216 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:32.134712 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4c7d97b1-3f03-4907-9a49-a9746b8cc7e1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:32.140377 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4c7d97b1-3f03-4907-9a49-a9746b8cc7e1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:32.166384 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4c7d97b1-3f03-4907-9a49-a9746b8cc7e1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:32.167657 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4c7d97b1-3f03-4907-9a49-a9746b8cc7e1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:32.168764 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4c7d97b1-3f03-4907-9a49-a9746b8cc7e1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:32.169221 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4c7d97b1-3f03-4907-9a49-a9746b8cc7e1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:32.605460 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4c7d97b1-3f03-4907-9a49-a9746b8cc7e1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:32.619840 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4c7d97b1-3f03-4907-9a49-a9746b8cc7e1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 200 len: 1216 microversion: 2.1 time: 0.497282 Aug 04 17:05:32.636385 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2704/5300] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:32 2022] GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 1216 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:33.652713 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d261daab-d17b-4f2f-87b8-391d76032645 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:33.657341 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d261daab-d17b-4f2f-87b8-391d76032645 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:33.700224 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d261daab-d17b-4f2f-87b8-391d76032645 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:33.700691 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d261daab-d17b-4f2f-87b8-391d76032645 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:33.701686 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d261daab-d17b-4f2f-87b8-391d76032645 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:33.702123 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d261daab-d17b-4f2f-87b8-391d76032645 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:34.224017 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d261daab-d17b-4f2f-87b8-391d76032645 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:34.236192 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d261daab-d17b-4f2f-87b8-391d76032645 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 200 len: 1402 microversion: 2.1 time: 0.595265 Aug 04 17:05:34.236807 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2597/5301] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:33 2022] GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 1402 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:34.268146 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-751db8d6-283d-4aad-bf38-375a416ec4aa tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:34.269643 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-751db8d6-283d-4aad-bf38-375a416ec4aa tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:34.288951 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-751db8d6-283d-4aad-bf38-375a416ec4aa tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:34.289588 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-751db8d6-283d-4aad-bf38-375a416ec4aa tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:34.292606 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-751db8d6-283d-4aad-bf38-375a416ec4aa tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:34.293176 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-751db8d6-283d-4aad-bf38-375a416ec4aa tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:35.077744 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-751db8d6-283d-4aad-bf38-375a416ec4aa tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:35.088392 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-751db8d6-283d-4aad-bf38-375a416ec4aa tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 200 len: 1402 microversion: 2.1 time: 0.832594 Aug 04 17:05:35.102222 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2705/5302] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:34 2022] GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 1402 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:35.127880 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-345db080-1795-431e-a400-53c43a48a4ef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1561439051"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:35.131650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-345db080-1795-431e-a400-53c43a48a4ef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:35.147862 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-345db080-1795-431e-a400-53c43a48a4ef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:35.149631 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-345db080-1795-431e-a400-53c43a48a4ef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:35.151786 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-345db080-1795-431e-a400-53c43a48a4ef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:35.156721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-345db080-1795-431e-a400-53c43a48a4ef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:35.409479 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.compute.api [None req-345db080-1795-431e-a400-53c43a48a4ef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Attempting to quiesce instance before volume snapshot. Aug 04 17:05:35.484585 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.compute.api [None req-345db080-1795-431e-a400-53c43a48a4ef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 04 17:05:35.681483 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-345db080-1795-431e-a400-53c43a48a4ef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Creating snapshot from volume 039386e2-ad5f-4b14-9ee4-cc5f3c42a8fb. {{(pid=126126) snapshot_instance /opt/stack/nova/nova/compute/api.py:3456}} Aug 04 17:05:35.955053 n-d-846466-12 devstack@n-api.service[126125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:05:35.955562 n-d-846466-12 devstack@n-api.service[126125]: Thu Aug 4 17:05:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 17:05:36.446801 n-d-846466-12 devstack@n-api.service[126126]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:05:36.447983 n-d-846466-12 devstack@n-api.service[126126]: Thu Aug 4 17:05:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7/action (ip 10.222.0.23) !!! Aug 04 17:05:38.206720 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-345db080-1795-431e-a400-53c43a48a4ef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "POST /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7/action" status: 202 len: 0 microversion: 2.1 time: 3.083439 Aug 04 17:05:38.209756 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2598/5303] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:05:35 2022] POST /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7/action => generated 0 bytes in 3087 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 17:05:40.851465 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-df7f4bf5-2de7-49fd-a82e-f493f7d38e9d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1800034455", "imageRef": "7183f2d4-d439-48d9-ab88-bbf3ad909ffb", "flavorRef": "452", "networks": [{"uuid": "8cd64b36-f8a8-48d4-b083-6164d20009da"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:40.993925 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-df7f4bf5-2de7-49fd-a82e-f493f7d38e9d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] validate_networks() for [('8cd64b36-f8a8-48d4-b083-6164d20009da', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:05:41.399940 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-95758584-f037-4297-8ed4-f537938d6e7f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Action: 'create', calling method: .version_select at 0x7f7e770b98b0>, body: {"keypair": {"name": "tempest-keypair-2102455995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwpne1Ue16q1HsN/K4zG5N+diGD0ZryOmJdv75+P10+AUpUY8MrmPbMyzgOUR6PLer1BMtJHwx9k9IHPuzceUAN7fexTx/a2FOs4ptk2aZBYHp4JY7BGhBgr7DDPGiwqQ=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:41.470908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-95758584-f037-4297-8ed4-f537938d6e7f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Getting quotas for project a0ad199f31d04aa4ac7c6ba5925eb06b. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:05:41.487427 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-95758584-f037-4297-8ed4-f537938d6e7f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Getting quotas for user d8430522c580414d9798349ededbd6d2 and project a0ad199f31d04aa4ac7c6ba5925eb06b. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:05:41.579041 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-95758584-f037-4297-8ed4-f537938d6e7f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.839229 Aug 04 17:05:41.584001 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2706/5304] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 17:05:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:43.511778 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-df7f4bf5-2de7-49fd-a82e-f493f7d38e9d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:05:43.512298 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-df7f4bf5-2de7-49fd-a82e-f493f7d38e9d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:05:43.512666 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-df7f4bf5-2de7-49fd-a82e-f493f7d38e9d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:05:43.513912 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-df7f4bf5-2de7-49fd-a82e-f493f7d38e9d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:05:43.516133 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-df7f4bf5-2de7-49fd-a82e-f493f7d38e9d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:05:43.542856 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-df7f4bf5-2de7-49fd-a82e-f493f7d38e9d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:43.549507 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-df7f4bf5-2de7-49fd-a82e-f493f7d38e9d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:43.550936 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-df7f4bf5-2de7-49fd-a82e-f493f7d38e9d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:43.553730 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-df7f4bf5-2de7-49fd-a82e-f493f7d38e9d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:43.630192 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-df7f4bf5-2de7-49fd-a82e-f493f7d38e9d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Getting quotas for project 78a0adb69ba24749817a8855effc20ad. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:05:43.644478 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-df7f4bf5-2de7-49fd-a82e-f493f7d38e9d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Getting quotas for user ea9cab1c1eff47ddb881a2b57bf240f3 and project 78a0adb69ba24749817a8855effc20ad. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:05:43.678724 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-df7f4bf5-2de7-49fd-a82e-f493f7d38e9d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:05:43.687242 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-df7f4bf5-2de7-49fd-a82e-f493f7d38e9d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='1cc4f0bb-794f-47ce-947d-6bad8b6420e2',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:05:43.909808 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-df7f4bf5-2de7-49fd-a82e-f493f7d38e9d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.060626 Aug 04 17:05:43.928500 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2599/5305] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:05:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 3083 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 17:05:43.964729 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d187a7f5-8e16-4cb2-ad8b-bacafa5eda18 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:43.969075 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d187a7f5-8e16-4cb2-ad8b-bacafa5eda18 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:44.318608 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d187a7f5-8e16-4cb2-ad8b-bacafa5eda18 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:44.346036 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d187a7f5-8e16-4cb2-ad8b-bacafa5eda18 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1230 microversion: 2.1 time: 0.416992 Aug 04 17:05:44.350636 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2707/5306] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:43 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1230 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:45.389403 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0217982e-a9b9-455d-a8ea-5783e6c634bb tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:45.390761 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0217982e-a9b9-455d-a8ea-5783e6c634bb tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:45.407014 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0217982e-a9b9-455d-a8ea-5783e6c634bb tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:45.410600 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0217982e-a9b9-455d-a8ea-5783e6c634bb tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:45.412370 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0217982e-a9b9-455d-a8ea-5783e6c634bb tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:45.413890 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0217982e-a9b9-455d-a8ea-5783e6c634bb tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:45.657838 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0217982e-a9b9-455d-a8ea-5783e6c634bb tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:45.667259 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0217982e-a9b9-455d-a8ea-5783e6c634bb tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1226 microversion: 2.1 time: 0.282551 Aug 04 17:05:45.686997 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2600/5307] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:45 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1226 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:46.693181 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e418ef22-4ad5-4f78-82db-84bb8a3d424a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:46.694371 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e418ef22-4ad5-4f78-82db-84bb8a3d424a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:46.698864 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=31 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:46.728459 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e418ef22-4ad5-4f78-82db-84bb8a3d424a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:46.728909 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e418ef22-4ad5-4f78-82db-84bb8a3d424a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:46.729886 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e418ef22-4ad5-4f78-82db-84bb8a3d424a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:46.730494 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e418ef22-4ad5-4f78-82db-84bb8a3d424a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:47.128709 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e418ef22-4ad5-4f78-82db-84bb8a3d424a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:47.172260 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e418ef22-4ad5-4f78-82db-84bb8a3d424a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1300 microversion: 2.1 time: 0.487087 Aug 04 17:05:47.181421 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2708/5308] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:46 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1300 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:47.233004 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9e02b766-936f-41f8-94e4-a6d32931bab8 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1825819729", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a5519241-a4a3-48ef-999e-1c5c2d6965d5"}], "security_groups": [{"name": "tempest-securitygroup--1454869107"}], "key_name": "tempest-keypair-2102455995", "user_data": "}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:47.760930 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-9e02b766-936f-41f8-94e4-a6d32931bab8 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] validate_networks() for [('a5519241-a4a3-48ef-999e-1c5c2d6965d5', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:05:48.204438 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9a0b1b52-914e-4e78-9f14-b0a38ce87563 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:48.213919 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9a0b1b52-914e-4e78-9f14-b0a38ce87563 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:48.236502 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9a0b1b52-914e-4e78-9f14-b0a38ce87563 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:48.270145 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9a0b1b52-914e-4e78-9f14-b0a38ce87563 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:48.271746 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9a0b1b52-914e-4e78-9f14-b0a38ce87563 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:48.272548 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9a0b1b52-914e-4e78-9f14-b0a38ce87563 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:48.701412 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9a0b1b52-914e-4e78-9f14-b0a38ce87563 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:48.712504 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9a0b1b52-914e-4e78-9f14-b0a38ce87563 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1300 microversion: 2.1 time: 0.512283 Aug 04 17:05:48.715696 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2709/5309] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:48 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1300 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:49.736907 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-44d156a7-8d8c-486d-bb36-c0fc18636cbe tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:49.738598 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-44d156a7-8d8c-486d-bb36-c0fc18636cbe tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:49.762074 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-44d156a7-8d8c-486d-bb36-c0fc18636cbe tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:49.762477 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-44d156a7-8d8c-486d-bb36-c0fc18636cbe tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:49.763398 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-44d156a7-8d8c-486d-bb36-c0fc18636cbe tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:49.769900 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-44d156a7-8d8c-486d-bb36-c0fc18636cbe tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:50.633409 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-44d156a7-8d8c-486d-bb36-c0fc18636cbe tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:50.660375 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-44d156a7-8d8c-486d-bb36-c0fc18636cbe tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1300 microversion: 2.1 time: 0.928416 Aug 04 17:05:50.668236 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2710/5310] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:49 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1300 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:51.512970 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9e02b766-936f-41f8-94e4-a6d32931bab8 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:05:51.517333 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9e02b766-936f-41f8-94e4-a6d32931bab8 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:05:51.521991 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9e02b766-936f-41f8-94e4-a6d32931bab8 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:05:51.526343 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9e02b766-936f-41f8-94e4-a6d32931bab8 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:05:51.528581 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9e02b766-936f-41f8-94e4-a6d32931bab8 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:05:51.612329 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e02b766-936f-41f8-94e4-a6d32931bab8 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:51.613127 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e02b766-936f-41f8-94e4-a6d32931bab8 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:51.629957 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e02b766-936f-41f8-94e4-a6d32931bab8 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:51.636401 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e02b766-936f-41f8-94e4-a6d32931bab8 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:51.694958 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1c306be5-125d-463a-a574-ea774cd01ee8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:51.696336 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1c306be5-125d-463a-a574-ea774cd01ee8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:51.713164 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1c306be5-125d-463a-a574-ea774cd01ee8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:51.714314 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1c306be5-125d-463a-a574-ea774cd01ee8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:51.717243 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1c306be5-125d-463a-a574-ea774cd01ee8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:51.718547 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1c306be5-125d-463a-a574-ea774cd01ee8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:51.727218 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-9e02b766-936f-41f8-94e4-a6d32931bab8 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Getting quotas for project a0ad199f31d04aa4ac7c6ba5925eb06b. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:05:51.748632 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-9e02b766-936f-41f8-94e4-a6d32931bab8 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Getting quotas for user d8430522c580414d9798349ededbd6d2 and project a0ad199f31d04aa4ac7c6ba5925eb06b. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:05:51.843847 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9e02b766-936f-41f8-94e4-a6d32931bab8 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:05:51.849136 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9e02b766-936f-41f8-94e4-a6d32931bab8 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:05:52.043960 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9e02b766-936f-41f8-94e4-a6d32931bab8 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.814969 Aug 04 17:05:52.053852 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2601/5311] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:05:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 4826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:05:52.099066 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3eb2d792-36c5-4945-ba56-6a0e7d4de14e tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:52.118360 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3eb2d792-36c5-4945-ba56-6a0e7d4de14e tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:52.593581 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3eb2d792-36c5-4945-ba56-6a0e7d4de14e tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:52.607033 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3eb2d792-36c5-4945-ba56-6a0e7d4de14e tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1238 microversion: 2.1 time: 0.543246 Aug 04 17:05:52.608646 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2602/5312] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:52 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1238 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:52.640895 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1c306be5-125d-463a-a574-ea774cd01ee8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:52.692124 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1c306be5-125d-463a-a574-ea774cd01ee8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1342 microversion: 2.1 time: 0.999655 Aug 04 17:05:52.695093 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2711/5313] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:51 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1342 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:05:53.630144 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-196e9f73-53e9-4575-b8f6-15b93e289a01 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:53.630993 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-196e9f73-53e9-4575-b8f6-15b93e289a01 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:53.650390 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-196e9f73-53e9-4575-b8f6-15b93e289a01 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:53.654556 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-196e9f73-53e9-4575-b8f6-15b93e289a01 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:53.657447 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-196e9f73-53e9-4575-b8f6-15b93e289a01 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:53.659573 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-196e9f73-53e9-4575-b8f6-15b93e289a01 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:53.719568 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9f86e0b0-b65b-41ea-9984-d850439397f1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:53.721659 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9f86e0b0-b65b-41ea-9984-d850439397f1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:53.752018 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:53.762457 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9f86e0b0-b65b-41ea-9984-d850439397f1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:53.764502 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9f86e0b0-b65b-41ea-9984-d850439397f1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:53.769778 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9f86e0b0-b65b-41ea-9984-d850439397f1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:53.770301 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9f86e0b0-b65b-41ea-9984-d850439397f1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:54.346196 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:55.422828 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-196e9f73-53e9-4575-b8f6-15b93e289a01 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:55.446369 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=52,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:55.454591 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-196e9f73-53e9-4575-b8f6-15b93e289a01 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1242 microversion: 2.1 time: 1.828386 Aug 04 17:05:55.457058 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2603/5314] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:53 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1242 bytes in 1833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:55.935349 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9f86e0b0-b65b-41ea-9984-d850439397f1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:55.960566 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9f86e0b0-b65b-41ea-9984-d850439397f1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1342 microversion: 2.1 time: 2.249811 Aug 04 17:05:55.970046 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2712/5315] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:53 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1342 bytes in 2260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:56.498774 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bc0e0d44-e7c3-4894-b836-d95a8dd4addb tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:56.501620 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bc0e0d44-e7c3-4894-b836-d95a8dd4addb tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:56.519436 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:56.527402 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bc0e0d44-e7c3-4894-b836-d95a8dd4addb tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:56.529353 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bc0e0d44-e7c3-4894-b836-d95a8dd4addb tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:56.531798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bc0e0d44-e7c3-4894-b836-d95a8dd4addb tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:56.534122 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bc0e0d44-e7c3-4894-b836-d95a8dd4addb tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:56.984176 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e7a6caed-6ed8-4c99-9195-ac330f75ea3a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:56.985196 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e7a6caed-6ed8-4c99-9195-ac330f75ea3a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:57.018293 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e7a6caed-6ed8-4c99-9195-ac330f75ea3a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:57.021486 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e7a6caed-6ed8-4c99-9195-ac330f75ea3a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:57.024889 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e7a6caed-6ed8-4c99-9195-ac330f75ea3a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:57.027293 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e7a6caed-6ed8-4c99-9195-ac330f75ea3a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:57.101662 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bc0e0d44-e7c3-4894-b836-d95a8dd4addb tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:57.123751 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bc0e0d44-e7c3-4894-b836-d95a8dd4addb tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1296 microversion: 2.1 time: 0.633179 Aug 04 17:05:57.147758 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2604/5316] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:56 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1296 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:57.770821 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e7a6caed-6ed8-4c99-9195-ac330f75ea3a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:57.801690 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e7a6caed-6ed8-4c99-9195-ac330f75ea3a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1342 microversion: 2.1 time: 0.821935 Aug 04 17:05:57.817086 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2713/5317] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:56 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1342 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:57.900513 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-09965fae-028e-4506-9e3a-519bd6c90f10 req-f0263a32-e30a-4720-af0d-5f5ca8eae883 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a21b339b-7fc4-47e7-9e25-d24d3aae4535", "tag": "1ba5e936-38c0-409a-b546-b21f5d5edc20"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:57.922229 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-09965fae-028e-4506-9e3a-519bd6c90f10 req-f0263a32-e30a-4720-af0d-5f5ca8eae883 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:57.922864 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-09965fae-028e-4506-9e3a-519bd6c90f10 req-f0263a32-e30a-4720-af0d-5f5ca8eae883 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:57.955779 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-09965fae-028e-4506-9e3a-519bd6c90f10 req-f0263a32-e30a-4720-af0d-5f5ca8eae883 service nova] Creating event network-changed:1ba5e936-38c0-409a-b546-b21f5d5edc20 for instance a21b339b-7fc4-47e7-9e25-d24d3aae4535 on n-h1-846466-12 Aug 04 17:05:57.963596 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-09965fae-028e-4506-9e3a-519bd6c90f10 req-f0263a32-e30a-4720-af0d-5f5ca8eae883 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070060 Aug 04 17:05:57.964589 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2605/5318] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:05:58.155617 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-62d3b697-038a-4583-8703-8f1b9a160262 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:58.156370 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-62d3b697-038a-4583-8703-8f1b9a160262 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:58.181037 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-62d3b697-038a-4583-8703-8f1b9a160262 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:58.181300 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-62d3b697-038a-4583-8703-8f1b9a160262 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:58.184003 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-62d3b697-038a-4583-8703-8f1b9a160262 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:58.186221 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-62d3b697-038a-4583-8703-8f1b9a160262 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:58.620879 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-62d3b697-038a-4583-8703-8f1b9a160262 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:58.647576 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-62d3b697-038a-4583-8703-8f1b9a160262 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1296 microversion: 2.1 time: 0.497494 Aug 04 17:05:58.648275 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2714/5319] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:58 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1296 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:58.833231 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d9191f49-66e4-42be-97a0-d9133327bf3a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:58.837354 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d9191f49-66e4-42be-97a0-d9133327bf3a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:58.871742 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d9191f49-66e4-42be-97a0-d9133327bf3a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:58.873614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d9191f49-66e4-42be-97a0-d9133327bf3a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:58.884061 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d9191f49-66e4-42be-97a0-d9133327bf3a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:58.887028 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d9191f49-66e4-42be-97a0-d9133327bf3a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:59.678946 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-68adce48-5599-4350-9502-a73a84f5e846 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:59.681005 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-68adce48-5599-4350-9502-a73a84f5e846 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:59.734574 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-68adce48-5599-4350-9502-a73a84f5e846 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:59.735433 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-68adce48-5599-4350-9502-a73a84f5e846 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:05:59.736364 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-68adce48-5599-4350-9502-a73a84f5e846 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:05:59.736915 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-68adce48-5599-4350-9502-a73a84f5e846 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:00.230942 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-68adce48-5599-4350-9502-a73a84f5e846 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:00.285332 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-68adce48-5599-4350-9502-a73a84f5e846 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1296 microversion: 2.1 time: 0.608760 Aug 04 17:06:00.308411 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2715/5320] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:59 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1296 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:06:00.656068 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d9191f49-66e4-42be-97a0-d9133327bf3a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:00.687171 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d9191f49-66e4-42be-97a0-d9133327bf3a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1342 microversion: 2.1 time: 1.864096 Aug 04 17:06:00.695430 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2606/5321] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:58 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1342 bytes in 1875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:01.360482 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a6753510-0ede-4747-aaa2-1844b0d15046 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:01.361991 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a6753510-0ede-4747-aaa2-1844b0d15046 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:01.401758 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6753510-0ede-4747-aaa2-1844b0d15046 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:01.403452 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6753510-0ede-4747-aaa2-1844b0d15046 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:01.415170 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6753510-0ede-4747-aaa2-1844b0d15046 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:01.416373 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6753510-0ede-4747-aaa2-1844b0d15046 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:01.741559 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-78fd496f-0fac-4ba5-8659-9016270ca356 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:01.743085 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-78fd496f-0fac-4ba5-8659-9016270ca356 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:01.747728 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=4 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:06:01.773509 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-78fd496f-0fac-4ba5-8659-9016270ca356 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:01.774360 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-78fd496f-0fac-4ba5-8659-9016270ca356 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:01.776203 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-78fd496f-0fac-4ba5-8659-9016270ca356 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:01.776932 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-78fd496f-0fac-4ba5-8659-9016270ca356 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:02.603596 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=14 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:06:02.818078 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-78fd496f-0fac-4ba5-8659-9016270ca356 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:02.846382 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-78fd496f-0fac-4ba5-8659-9016270ca356 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1342 microversion: 2.1 time: 1.110267 Aug 04 17:06:02.855293 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2607/5322] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:01 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1342 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:06:03.023710 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a6753510-0ede-4747-aaa2-1844b0d15046 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:03.039629 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a6753510-0ede-4747-aaa2-1844b0d15046 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1364 microversion: 2.1 time: 1.688013 Aug 04 17:06:03.042931 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2716/5323] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:01 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1364 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:03.881762 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c697707f-933d-475b-85e1-78f662c42666 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:03.882908 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c697707f-933d-475b-85e1-78f662c42666 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:03.911412 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c697707f-933d-475b-85e1-78f662c42666 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:03.913537 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c697707f-933d-475b-85e1-78f662c42666 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:03.924075 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c697707f-933d-475b-85e1-78f662c42666 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:03.925372 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c697707f-933d-475b-85e1-78f662c42666 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:04.070432 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e45d79b6-cdf6-4902-9483-69a935ee4ff5 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:04.071957 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e45d79b6-cdf6-4902-9483-69a935ee4ff5 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:04.095468 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e45d79b6-cdf6-4902-9483-69a935ee4ff5 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:04.096379 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e45d79b6-cdf6-4902-9483-69a935ee4ff5 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:04.098656 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e45d79b6-cdf6-4902-9483-69a935ee4ff5 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:04.103491 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e45d79b6-cdf6-4902-9483-69a935ee4ff5 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:06.059652 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e45d79b6-cdf6-4902-9483-69a935ee4ff5 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:06.089759 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e45d79b6-cdf6-4902-9483-69a935ee4ff5 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1364 microversion: 2.1 time: 2.021935 Aug 04 17:06:06.111173 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2717/5324] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:04 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1364 bytes in 2046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:06.311584 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c697707f-933d-475b-85e1-78f662c42666 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:06.341352 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c697707f-933d-475b-85e1-78f662c42666 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1342 microversion: 2.1 time: 2.464382 Aug 04 17:06:06.362277 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2608/5325] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:03 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1342 bytes in 2486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:06:06.769194 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-e9b9afd9-ba2c-44a8-a9cf-213082b377af req-08adb858-1473-4497-aeb7-b76dab41ade4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffb04e5e-6da9-40bd-87f2-1d914893b296", "tag": "df60c13d-990a-4651-b538-bba81604b9ef"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:06.789777 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-e9b9afd9-ba2c-44a8-a9cf-213082b377af req-08adb858-1473-4497-aeb7-b76dab41ade4 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:06.790483 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-e9b9afd9-ba2c-44a8-a9cf-213082b377af req-08adb858-1473-4497-aeb7-b76dab41ade4 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:06.824695 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-e9b9afd9-ba2c-44a8-a9cf-213082b377af req-08adb858-1473-4497-aeb7-b76dab41ade4 service nova] Creating event network-changed:df60c13d-990a-4651-b538-bba81604b9ef for instance ffb04e5e-6da9-40bd-87f2-1d914893b296 on n-h2-846466-12 Aug 04 17:06:06.838949 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-e9b9afd9-ba2c-44a8-a9cf-213082b377af req-08adb858-1473-4497-aeb7-b76dab41ade4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072905 Aug 04 17:06:06.866305 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2718/5326] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:06:07.113473 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-04e3b416-8472-495f-a872-fa4587f88dcd tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:07.114266 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-04e3b416-8472-495f-a872-fa4587f88dcd tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:07.133682 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-04e3b416-8472-495f-a872-fa4587f88dcd tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:07.135191 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-04e3b416-8472-495f-a872-fa4587f88dcd tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:07.139541 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-04e3b416-8472-495f-a872-fa4587f88dcd tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:07.140009 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-04e3b416-8472-495f-a872-fa4587f88dcd tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:07.379145 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0117379d-1dcd-4e7f-b511-ec522912bc8c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:07.380005 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0117379d-1dcd-4e7f-b511-ec522912bc8c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:07.403125 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0117379d-1dcd-4e7f-b511-ec522912bc8c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:07.403814 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0117379d-1dcd-4e7f-b511-ec522912bc8c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:07.405303 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0117379d-1dcd-4e7f-b511-ec522912bc8c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:07.406761 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0117379d-1dcd-4e7f-b511-ec522912bc8c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:07.623332 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-04e3b416-8472-495f-a872-fa4587f88dcd tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:07.642413 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-04e3b416-8472-495f-a872-fa4587f88dcd tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1364 microversion: 2.1 time: 0.533355 Aug 04 17:06:07.648292 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2609/5327] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:07 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1364 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:07.917364 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0117379d-1dcd-4e7f-b511-ec522912bc8c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:07.927678 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0117379d-1dcd-4e7f-b511-ec522912bc8c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1342 microversion: 2.1 time: 0.553563 Aug 04 17:06:07.928295 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2719/5328] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:07 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1342 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:08.672314 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1713e0da-9550-4670-a7b5-13769e810ccd tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:08.672944 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1713e0da-9550-4670-a7b5-13769e810ccd tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:08.681171 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1713e0da-9550-4670-a7b5-13769e810ccd tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:08.681669 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1713e0da-9550-4670-a7b5-13769e810ccd tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:08.682825 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1713e0da-9550-4670-a7b5-13769e810ccd tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:08.683402 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1713e0da-9550-4670-a7b5-13769e810ccd tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:08.848497 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1713e0da-9550-4670-a7b5-13769e810ccd tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:08.856634 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1713e0da-9550-4670-a7b5-13769e810ccd tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1364 microversion: 2.1 time: 0.188209 Aug 04 17:06:08.857481 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2610/5329] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:08 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:08.960574 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a2a41a29-d315-41b3-b820-23fc356e56e5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:08.961202 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a2a41a29-d315-41b3-b820-23fc356e56e5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:08.980231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a2a41a29-d315-41b3-b820-23fc356e56e5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:08.980676 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a2a41a29-d315-41b3-b820-23fc356e56e5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:08.981692 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a2a41a29-d315-41b3-b820-23fc356e56e5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:08.982285 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a2a41a29-d315-41b3-b820-23fc356e56e5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:09.450944 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a2a41a29-d315-41b3-b820-23fc356e56e5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:09.472327 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a2a41a29-d315-41b3-b820-23fc356e56e5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1342 microversion: 2.1 time: 0.513026 Aug 04 17:06:09.487295 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2720/5330] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:08 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1342 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:09.883418 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c4c52cf4-5495-487b-9027-a7c943f257a9 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:09.884280 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c4c52cf4-5495-487b-9027-a7c943f257a9 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:09.901122 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4c52cf4-5495-487b-9027-a7c943f257a9 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:09.901617 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4c52cf4-5495-487b-9027-a7c943f257a9 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:09.902417 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4c52cf4-5495-487b-9027-a7c943f257a9 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:09.902899 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4c52cf4-5495-487b-9027-a7c943f257a9 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:10.301213 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c4c52cf4-5495-487b-9027-a7c943f257a9 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:10.313119 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c4c52cf4-5495-487b-9027-a7c943f257a9 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1364 microversion: 2.1 time: 0.439178 Aug 04 17:06:10.326932 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2611/5331] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:09 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1364 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:10.504799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7e6691b3-823c-4e2e-86a1-0b75e1a95e98 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:10.506808 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7e6691b3-823c-4e2e-86a1-0b75e1a95e98 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:10.537092 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7e6691b3-823c-4e2e-86a1-0b75e1a95e98 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:10.538398 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7e6691b3-823c-4e2e-86a1-0b75e1a95e98 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:10.540016 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7e6691b3-823c-4e2e-86a1-0b75e1a95e98 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:10.541018 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7e6691b3-823c-4e2e-86a1-0b75e1a95e98 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:11.233567 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7e6691b3-823c-4e2e-86a1-0b75e1a95e98 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:11.247490 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7e6691b3-823c-4e2e-86a1-0b75e1a95e98 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1342 microversion: 2.1 time: 0.749617 Aug 04 17:06:11.252090 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2721/5332] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:10 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1342 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:11.339025 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-65f01888-a39c-47bd-895f-0b82844dcc8d tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:11.340299 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-65f01888-a39c-47bd-895f-0b82844dcc8d tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:11.376008 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65f01888-a39c-47bd-895f-0b82844dcc8d tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:11.378267 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65f01888-a39c-47bd-895f-0b82844dcc8d tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:11.379342 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65f01888-a39c-47bd-895f-0b82844dcc8d tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:11.383342 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65f01888-a39c-47bd-895f-0b82844dcc8d tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:11.856749 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-65f01888-a39c-47bd-895f-0b82844dcc8d tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:11.870874 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-65f01888-a39c-47bd-895f-0b82844dcc8d tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1364 microversion: 2.1 time: 0.538533 Aug 04 17:06:11.875332 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2612/5333] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:11 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1364 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:12.276322 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-86cfe857-2da9-485c-a0c5-8d4cab78db6f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:12.277822 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-86cfe857-2da9-485c-a0c5-8d4cab78db6f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:12.303556 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-86cfe857-2da9-485c-a0c5-8d4cab78db6f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:12.304935 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-86cfe857-2da9-485c-a0c5-8d4cab78db6f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:12.306921 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-86cfe857-2da9-485c-a0c5-8d4cab78db6f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:12.309487 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-86cfe857-2da9-485c-a0c5-8d4cab78db6f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:12.719850 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-86cfe857-2da9-485c-a0c5-8d4cab78db6f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:12.732235 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-86cfe857-2da9-485c-a0c5-8d4cab78db6f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1342 microversion: 2.1 time: 0.461453 Aug 04 17:06:12.734828 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2722/5334] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:12 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1342 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:12.818437 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-1e8747e9-2aaf-420a-b935-d1bde5a4d95b req-f260e524-d153-4ed8-a313-c1509619ceef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffb04e5e-6da9-40bd-87f2-1d914893b296", "name": "network-vif-plugged", "status": "completed", "tag": "df60c13d-990a-4651-b538-bba81604b9ef"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:12.843445 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-1e8747e9-2aaf-420a-b935-d1bde5a4d95b req-f260e524-d153-4ed8-a313-c1509619ceef service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:12.844285 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-1e8747e9-2aaf-420a-b935-d1bde5a4d95b req-f260e524-d153-4ed8-a313-c1509619ceef service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:12.859291 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-1e8747e9-2aaf-420a-b935-d1bde5a4d95b req-f260e524-d153-4ed8-a313-c1509619ceef service nova] Creating event network-vif-plugged:df60c13d-990a-4651-b538-bba81604b9ef for instance ffb04e5e-6da9-40bd-87f2-1d914893b296 on n-h2-846466-12 Aug 04 17:06:12.873418 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-1e8747e9-2aaf-420a-b935-d1bde5a4d95b req-f260e524-d153-4ed8-a313-c1509619ceef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056098 Aug 04 17:06:12.874403 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2613/5335] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:06:12.899663 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-837207af-2dae-4730-ad07-50206f1e2d22 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:12.900540 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-837207af-2dae-4730-ad07-50206f1e2d22 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:12.912158 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-837207af-2dae-4730-ad07-50206f1e2d22 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:12.912612 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-837207af-2dae-4730-ad07-50206f1e2d22 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:12.913428 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-837207af-2dae-4730-ad07-50206f1e2d22 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:12.913858 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-837207af-2dae-4730-ad07-50206f1e2d22 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:13.428416 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-837207af-2dae-4730-ad07-50206f1e2d22 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:13.442603 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-837207af-2dae-4730-ad07-50206f1e2d22 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1364 microversion: 2.1 time: 0.546333 Aug 04 17:06:13.456955 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2723/5336] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:12 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1364 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:13.763956 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a48dc282-58a8-43bc-9c2f-1faa2c3acb86 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:13.764833 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a48dc282-58a8-43bc-9c2f-1faa2c3acb86 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:13.783706 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a48dc282-58a8-43bc-9c2f-1faa2c3acb86 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:13.785474 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a48dc282-58a8-43bc-9c2f-1faa2c3acb86 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:13.788839 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a48dc282-58a8-43bc-9c2f-1faa2c3acb86 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:13.790356 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a48dc282-58a8-43bc-9c2f-1faa2c3acb86 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:14.410936 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a48dc282-58a8-43bc-9c2f-1faa2c3acb86 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:14.425105 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a48dc282-58a8-43bc-9c2f-1faa2c3acb86 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1342 microversion: 2.1 time: 0.666342 Aug 04 17:06:14.438095 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2614/5337] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:13 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1342 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:14.470219 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-53f3886e-8483-4f96-a840-5eb4d0058164 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:14.470605 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-53f3886e-8483-4f96-a840-5eb4d0058164 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:14.491272 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-53f3886e-8483-4f96-a840-5eb4d0058164 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:14.492188 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-53f3886e-8483-4f96-a840-5eb4d0058164 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:14.492992 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-53f3886e-8483-4f96-a840-5eb4d0058164 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:14.495560 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-53f3886e-8483-4f96-a840-5eb4d0058164 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:14.932978 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-53f3886e-8483-4f96-a840-5eb4d0058164 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:14.951599 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-53f3886e-8483-4f96-a840-5eb4d0058164 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1550 microversion: 2.1 time: 0.489614 Aug 04 17:06:14.955694 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2724/5338] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:14 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1550 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:14.977405 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0508e79e-3775-4938-8098-90a4aa6e3d21 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:14.977937 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0508e79e-3775-4938-8098-90a4aa6e3d21 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:15.000301 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0508e79e-3775-4938-8098-90a4aa6e3d21 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:15.003132 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0508e79e-3775-4938-8098-90a4aa6e3d21 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:15.004062 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0508e79e-3775-4938-8098-90a4aa6e3d21 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:15.006398 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0508e79e-3775-4938-8098-90a4aa6e3d21 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:15.191796 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0508e79e-3775-4938-8098-90a4aa6e3d21 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.219910 Aug 04 17:06:15.199249 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2615/5339] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Aug 4 17:06:14 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296/os-interface => generated 285 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:06:15.452678 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f860f39d-4c13-4144-ad11-81a9674376a3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:15.453599 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f860f39d-4c13-4144-ad11-81a9674376a3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:15.471055 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f860f39d-4c13-4144-ad11-81a9674376a3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:15.474474 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f860f39d-4c13-4144-ad11-81a9674376a3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:15.480218 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f860f39d-4c13-4144-ad11-81a9674376a3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:15.481474 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f860f39d-4c13-4144-ad11-81a9674376a3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:15.486581 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=100 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:06:15.839135 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f860f39d-4c13-4144-ad11-81a9674376a3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:15.850435 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f860f39d-4c13-4144-ad11-81a9674376a3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1342 microversion: 2.1 time: 0.402030 Aug 04 17:06:15.853725 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2725/5340] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:15 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1342 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:16.892058 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c61468b6-029c-4580-8d71-872701b78bec tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:16.893518 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c61468b6-029c-4580-8d71-872701b78bec tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:16.908452 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c61468b6-029c-4580-8d71-872701b78bec tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:16.909978 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c61468b6-029c-4580-8d71-872701b78bec tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:16.911320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c61468b6-029c-4580-8d71-872701b78bec tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:16.911872 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c61468b6-029c-4580-8d71-872701b78bec tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:17.167799 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c61468b6-029c-4580-8d71-872701b78bec tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:17.179648 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c61468b6-029c-4580-8d71-872701b78bec tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1342 microversion: 2.1 time: 0.295969 Aug 04 17:06:17.182645 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2616/5341] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:16 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1342 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:17.835333 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-da7f8c75-34ec-4e30-b35d-88a9cdd33404 req-ac7cc921-8089-4ca5-aa36-24cf5ec00b0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffb04e5e-6da9-40bd-87f2-1d914893b296", "tag": "df60c13d-990a-4651-b538-bba81604b9ef"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:17.861310 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-da7f8c75-34ec-4e30-b35d-88a9cdd33404 req-ac7cc921-8089-4ca5-aa36-24cf5ec00b0d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:17.864411 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-da7f8c75-34ec-4e30-b35d-88a9cdd33404 req-ac7cc921-8089-4ca5-aa36-24cf5ec00b0d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:17.901778 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-da7f8c75-34ec-4e30-b35d-88a9cdd33404 req-ac7cc921-8089-4ca5-aa36-24cf5ec00b0d service nova] Creating event network-changed:df60c13d-990a-4651-b538-bba81604b9ef for instance ffb04e5e-6da9-40bd-87f2-1d914893b296 on n-h2-846466-12 Aug 04 17:06:17.913030 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-da7f8c75-34ec-4e30-b35d-88a9cdd33404 req-ac7cc921-8089-4ca5-aa36-24cf5ec00b0d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082245 Aug 04 17:06:17.914558 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2726/5342] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:06:18.208064 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7de74dd2-05e0-4de4-9072-46f723999dea tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:18.208881 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7de74dd2-05e0-4de4-9072-46f723999dea tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:18.256594 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7de74dd2-05e0-4de4-9072-46f723999dea tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:18.258579 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7de74dd2-05e0-4de4-9072-46f723999dea tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:18.268271 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7de74dd2-05e0-4de4-9072-46f723999dea tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:18.269134 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7de74dd2-05e0-4de4-9072-46f723999dea tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:18.903105 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7de74dd2-05e0-4de4-9072-46f723999dea tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:18.916181 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7de74dd2-05e0-4de4-9072-46f723999dea tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1342 microversion: 2.1 time: 0.715210 Aug 04 17:06:18.933905 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2617/5343] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:18 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1342 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:19.951737 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-486c922a-faf9-44a5-89e2-02a530a6b84e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:19.953772 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-486c922a-faf9-44a5-89e2-02a530a6b84e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:19.993264 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-486c922a-faf9-44a5-89e2-02a530a6b84e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:19.993688 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-486c922a-faf9-44a5-89e2-02a530a6b84e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:20.009066 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-486c922a-faf9-44a5-89e2-02a530a6b84e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:20.009818 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-486c922a-faf9-44a5-89e2-02a530a6b84e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:20.857393 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-486c922a-faf9-44a5-89e2-02a530a6b84e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:20.872323 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-486c922a-faf9-44a5-89e2-02a530a6b84e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1342 microversion: 2.1 time: 0.925900 Aug 04 17:06:20.882362 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2727/5344] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:19 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1342 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:21.895491 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a887b1df-ad0d-4367-b879-15d8cf3dc7c6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:21.896835 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a887b1df-ad0d-4367-b879-15d8cf3dc7c6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:21.914017 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a887b1df-ad0d-4367-b879-15d8cf3dc7c6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:21.914976 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a887b1df-ad0d-4367-b879-15d8cf3dc7c6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:21.919450 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a887b1df-ad0d-4367-b879-15d8cf3dc7c6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:21.923693 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a887b1df-ad0d-4367-b879-15d8cf3dc7c6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:22.395068 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a887b1df-ad0d-4367-b879-15d8cf3dc7c6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:22.417599 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a887b1df-ad0d-4367-b879-15d8cf3dc7c6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1342 microversion: 2.1 time: 0.525525 Aug 04 17:06:22.418553 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2618/5345] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:21 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1342 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:06:23.438534 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a5dee141-672e-45fd-972f-c836748bf16c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:23.439287 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a5dee141-672e-45fd-972f-c836748bf16c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:23.453006 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a5dee141-672e-45fd-972f-c836748bf16c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:23.453862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a5dee141-672e-45fd-972f-c836748bf16c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:23.456566 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a5dee141-672e-45fd-972f-c836748bf16c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:23.464687 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a5dee141-672e-45fd-972f-c836748bf16c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:23.828721 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a5dee141-672e-45fd-972f-c836748bf16c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:23.844856 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a5dee141-672e-45fd-972f-c836748bf16c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1342 microversion: 2.1 time: 0.407698 Aug 04 17:06:23.845944 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2728/5346] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:23 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1342 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:24.872694 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-25d481d5-1a6c-4c4b-9d18-82a0cb689cc0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:24.874401 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-25d481d5-1a6c-4c4b-9d18-82a0cb689cc0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:24.888144 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-25d481d5-1a6c-4c4b-9d18-82a0cb689cc0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:24.888827 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-25d481d5-1a6c-4c4b-9d18-82a0cb689cc0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:24.889843 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-25d481d5-1a6c-4c4b-9d18-82a0cb689cc0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:24.890591 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-25d481d5-1a6c-4c4b-9d18-82a0cb689cc0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:25.180797 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-25d481d5-1a6c-4c4b-9d18-82a0cb689cc0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:25.189757 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-25d481d5-1a6c-4c4b-9d18-82a0cb689cc0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1342 microversion: 2.1 time: 0.324615 Aug 04 17:06:25.190348 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2619/5347] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:24 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1342 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:26.214225 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c98f4c8c-adca-4ab2-8e1e-43cf2c8372f6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:26.215732 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c98f4c8c-adca-4ab2-8e1e-43cf2c8372f6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:26.225634 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=34 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:06:26.227844 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c98f4c8c-adca-4ab2-8e1e-43cf2c8372f6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:26.229154 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c98f4c8c-adca-4ab2-8e1e-43cf2c8372f6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:26.230592 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c98f4c8c-adca-4ab2-8e1e-43cf2c8372f6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:26.231291 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c98f4c8c-adca-4ab2-8e1e-43cf2c8372f6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:26.539595 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c98f4c8c-adca-4ab2-8e1e-43cf2c8372f6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:26.550731 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c98f4c8c-adca-4ab2-8e1e-43cf2c8372f6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1376 microversion: 2.1 time: 0.343175 Aug 04 17:06:26.572500 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2729/5348] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:26 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1376 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:27.575571 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-13c500b4-a13a-4588-9dd5-8aa57fb7e81e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:27.576863 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-13c500b4-a13a-4588-9dd5-8aa57fb7e81e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:27.593087 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=32 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:06:27.602004 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-13c500b4-a13a-4588-9dd5-8aa57fb7e81e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:27.602876 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-13c500b4-a13a-4588-9dd5-8aa57fb7e81e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:27.605801 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-13c500b4-a13a-4588-9dd5-8aa57fb7e81e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:27.607676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-13c500b4-a13a-4588-9dd5-8aa57fb7e81e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:27.623069 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=88 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:06:27.997170 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-13c500b4-a13a-4588-9dd5-8aa57fb7e81e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:28.016782 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-13c500b4-a13a-4588-9dd5-8aa57fb7e81e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1376 microversion: 2.1 time: 0.448064 Aug 04 17:06:28.017688 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2620/5349] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:27 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1376 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:29.038897 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-20dc423c-1b05-4f37-a2a3-207245be3e68 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:29.039694 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-20dc423c-1b05-4f37-a2a3-207245be3e68 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:29.053868 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-20dc423c-1b05-4f37-a2a3-207245be3e68 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:29.054584 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-20dc423c-1b05-4f37-a2a3-207245be3e68 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:29.055581 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-20dc423c-1b05-4f37-a2a3-207245be3e68 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:29.057430 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-20dc423c-1b05-4f37-a2a3-207245be3e68 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:29.380954 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-20dc423c-1b05-4f37-a2a3-207245be3e68 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:29.391729 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-20dc423c-1b05-4f37-a2a3-207245be3e68 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1376 microversion: 2.1 time: 0.356807 Aug 04 17:06:29.397958 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2730/5350] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:29 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1376 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:30.540115 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8726a87f-2e25-4f86-aed6-4c28d0894c90 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:30.540115 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8726a87f-2e25-4f86-aed6-4c28d0894c90 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:30.540115 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8726a87f-2e25-4f86-aed6-4c28d0894c90 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:30.540115 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8726a87f-2e25-4f86-aed6-4c28d0894c90 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:30.540115 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8726a87f-2e25-4f86-aed6-4c28d0894c90 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:30.540115 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8726a87f-2e25-4f86-aed6-4c28d0894c90 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:30.745689 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8726a87f-2e25-4f86-aed6-4c28d0894c90 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:30.770367 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8726a87f-2e25-4f86-aed6-4c28d0894c90 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1376 microversion: 2.1 time: 0.353816 Aug 04 17:06:30.779121 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2621/5351] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:30 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1376 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:31.799323 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2328695c-01ae-4c07-96c5-e76082ae351f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:31.800881 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2328695c-01ae-4c07-96c5-e76082ae351f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:31.809848 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2328695c-01ae-4c07-96c5-e76082ae351f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:31.810615 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2328695c-01ae-4c07-96c5-e76082ae351f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:31.811747 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2328695c-01ae-4c07-96c5-e76082ae351f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:31.812331 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2328695c-01ae-4c07-96c5-e76082ae351f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:32.109978 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2328695c-01ae-4c07-96c5-e76082ae351f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:32.118613 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2328695c-01ae-4c07-96c5-e76082ae351f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1376 microversion: 2.1 time: 0.325062 Aug 04 17:06:32.130363 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2731/5352] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:31 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1376 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:33.151559 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-13e2faf4-b607-43ca-9542-654afde00775 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:33.152377 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-13e2faf4-b607-43ca-9542-654afde00775 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:33.186478 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-13e2faf4-b607-43ca-9542-654afde00775 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:33.187152 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-13e2faf4-b607-43ca-9542-654afde00775 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:33.192688 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-13e2faf4-b607-43ca-9542-654afde00775 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:33.193154 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-13e2faf4-b607-43ca-9542-654afde00775 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:33.655592 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-13e2faf4-b607-43ca-9542-654afde00775 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:33.668182 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-13e2faf4-b607-43ca-9542-654afde00775 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1376 microversion: 2.1 time: 0.519718 Aug 04 17:06:33.669158 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2622/5353] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:33 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1376 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:34.691082 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2b9bb50f-89a8-4caa-98ef-88001fdc0cb0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:34.691703 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2b9bb50f-89a8-4caa-98ef-88001fdc0cb0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:34.706315 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2b9bb50f-89a8-4caa-98ef-88001fdc0cb0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:34.706773 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2b9bb50f-89a8-4caa-98ef-88001fdc0cb0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:34.707564 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2b9bb50f-89a8-4caa-98ef-88001fdc0cb0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:34.708001 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2b9bb50f-89a8-4caa-98ef-88001fdc0cb0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:34.953793 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2b9bb50f-89a8-4caa-98ef-88001fdc0cb0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:34.965576 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2b9bb50f-89a8-4caa-98ef-88001fdc0cb0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1376 microversion: 2.1 time: 0.278210 Aug 04 17:06:34.977016 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2732/5354] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:34 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1376 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:35.592632 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-7a28776c-4b07-47cf-92a5-f16340070d34 req-735071bd-966b-442a-b862-49b6518bf9f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a21b339b-7fc4-47e7-9e25-d24d3aae4535", "name": "network-vif-plugged", "status": "completed", "tag": "1ba5e936-38c0-409a-b546-b21f5d5edc20"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:35.628211 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-7a28776c-4b07-47cf-92a5-f16340070d34 req-735071bd-966b-442a-b862-49b6518bf9f9 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:35.629850 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-7a28776c-4b07-47cf-92a5-f16340070d34 req-735071bd-966b-442a-b862-49b6518bf9f9 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:35.702974 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-7a28776c-4b07-47cf-92a5-f16340070d34 req-735071bd-966b-442a-b862-49b6518bf9f9 service nova] Creating event network-vif-plugged:1ba5e936-38c0-409a-b546-b21f5d5edc20 for instance a21b339b-7fc4-47e7-9e25-d24d3aae4535 on n-h1-846466-12 Aug 04 17:06:35.717089 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-7a28776c-4b07-47cf-92a5-f16340070d34 req-735071bd-966b-442a-b862-49b6518bf9f9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128918 Aug 04 17:06:35.724056 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2623/5355] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:06:36.003083 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2f8e2840-6a31-4237-8217-36ca32fa4c73 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:36.004501 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2f8e2840-6a31-4237-8217-36ca32fa4c73 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:36.032115 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2f8e2840-6a31-4237-8217-36ca32fa4c73 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:36.036928 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2f8e2840-6a31-4237-8217-36ca32fa4c73 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:36.047242 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2f8e2840-6a31-4237-8217-36ca32fa4c73 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:36.047790 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2f8e2840-6a31-4237-8217-36ca32fa4c73 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:36.476806 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2f8e2840-6a31-4237-8217-36ca32fa4c73 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:36.490179 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2f8e2840-6a31-4237-8217-36ca32fa4c73 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1376 microversion: 2.1 time: 0.493265 Aug 04 17:06:36.492635 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2733/5356] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:35 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1376 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:37.512965 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-060eba79-9764-4886-8a09-d6d2493b65d7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:37.519929 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-060eba79-9764-4886-8a09-d6d2493b65d7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:37.538284 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-060eba79-9764-4886-8a09-d6d2493b65d7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:37.539768 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-060eba79-9764-4886-8a09-d6d2493b65d7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:37.540358 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-060eba79-9764-4886-8a09-d6d2493b65d7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:37.540811 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-060eba79-9764-4886-8a09-d6d2493b65d7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:37.832639 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-060eba79-9764-4886-8a09-d6d2493b65d7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:37.844521 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-060eba79-9764-4886-8a09-d6d2493b65d7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1562 microversion: 2.1 time: 0.334530 Aug 04 17:06:37.848680 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2624/5357] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:37 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1562 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:37.870189 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-30ec4460-c8fd-4ceb-95bb-c400c435643e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:37.870879 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-30ec4460-c8fd-4ceb-95bb-c400c435643e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:37.899572 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-30ec4460-c8fd-4ceb-95bb-c400c435643e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:37.901925 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-30ec4460-c8fd-4ceb-95bb-c400c435643e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:37.902900 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-30ec4460-c8fd-4ceb-95bb-c400c435643e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:37.905006 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-30ec4460-c8fd-4ceb-95bb-c400c435643e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:38.412563 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-30ec4460-c8fd-4ceb-95bb-c400c435643e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:38.428728 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-30ec4460-c8fd-4ceb-95bb-c400c435643e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1562 microversion: 2.1 time: 0.562910 Aug 04 17:06:38.435195 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2734/5358] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:37 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1562 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:38.661499 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1182a11a-82a8-45b4-9bab-1fc4e04aa5de tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:38.662018 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1182a11a-82a8-45b4-9bab-1fc4e04aa5de tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:38.679225 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1182a11a-82a8-45b4-9bab-1fc4e04aa5de tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:38.679679 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1182a11a-82a8-45b4-9bab-1fc4e04aa5de tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:38.680465 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1182a11a-82a8-45b4-9bab-1fc4e04aa5de tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:38.683380 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1182a11a-82a8-45b4-9bab-1fc4e04aa5de tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:38.768721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1182a11a-82a8-45b4-9bab-1fc4e04aa5de tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:06:39.070825 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1182a11a-82a8-45b4-9bab-1fc4e04aa5de tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 204 len: 0 microversion: 2.1 time: 0.409583 Aug 04 17:06:39.077194 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2625/5359] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:06:38 2022] DELETE /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:06:39.083889 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3023e87a-b8cd-4ae9-b6ad-99223a6b66e9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:39.085209 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3023e87a-b8cd-4ae9-b6ad-99223a6b66e9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:39.103324 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3023e87a-b8cd-4ae9-b6ad-99223a6b66e9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:39.108683 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3023e87a-b8cd-4ae9-b6ad-99223a6b66e9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:39.112696 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3023e87a-b8cd-4ae9-b6ad-99223a6b66e9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:39.112862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3023e87a-b8cd-4ae9-b6ad-99223a6b66e9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:39.751868 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3023e87a-b8cd-4ae9-b6ad-99223a6b66e9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:39.766245 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3023e87a-b8cd-4ae9-b6ad-99223a6b66e9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1568 microversion: 2.1 time: 0.686552 Aug 04 17:06:39.771130 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2735/5360] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:39 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1568 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:40.817420 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d6c9e918-c974-47fd-addc-d0d720ee5278 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:40.818901 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d6c9e918-c974-47fd-addc-d0d720ee5278 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:40.837437 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d6c9e918-c974-47fd-addc-d0d720ee5278 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:40.840069 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d6c9e918-c974-47fd-addc-d0d720ee5278 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:40.843552 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d6c9e918-c974-47fd-addc-d0d720ee5278 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:40.848505 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d6c9e918-c974-47fd-addc-d0d720ee5278 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:41.646890 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d6c9e918-c974-47fd-addc-d0d720ee5278 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:41.661672 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d6c9e918-c974-47fd-addc-d0d720ee5278 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1568 microversion: 2.1 time: 0.845949 Aug 04 17:06:41.663194 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2626/5361] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:40 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1568 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:42.629485 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-11e4b020-dab2-491b-aa91-59623277d121 req-3090f339-391d-4533-8e12-ae68814feb9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a21b339b-7fc4-47e7-9e25-d24d3aae4535", "name": "network-vif-deleted", "tag": "1ba5e936-38c0-409a-b546-b21f5d5edc20"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:42.671887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-11e4b020-dab2-491b-aa91-59623277d121 req-3090f339-391d-4533-8e12-ae68814feb9a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:42.672918 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-11e4b020-dab2-491b-aa91-59623277d121 req-3090f339-391d-4533-8e12-ae68814feb9a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:42.703057 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fa3d9fcf-4830-45d3-9a8a-3dafec11791d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:42.704741 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fa3d9fcf-4830-45d3-9a8a-3dafec11791d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:42.721127 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fa3d9fcf-4830-45d3-9a8a-3dafec11791d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:42.728477 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fa3d9fcf-4830-45d3-9a8a-3dafec11791d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:42.731597 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fa3d9fcf-4830-45d3-9a8a-3dafec11791d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:42.732317 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fa3d9fcf-4830-45d3-9a8a-3dafec11791d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:42.742844 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-11e4b020-dab2-491b-aa91-59623277d121 req-3090f339-391d-4533-8e12-ae68814feb9a service nova] Creating event network-vif-deleted:1ba5e936-38c0-409a-b546-b21f5d5edc20 for instance a21b339b-7fc4-47e7-9e25-d24d3aae4535 on n-h1-846466-12 Aug 04 17:06:42.764763 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-11e4b020-dab2-491b-aa91-59623277d121 req-3090f339-391d-4533-8e12-ae68814feb9a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145028 Aug 04 17:06:42.776421 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2736/5362] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:06:43.025425 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fa3d9fcf-4830-45d3-9a8a-3dafec11791d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:43.049195 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fa3d9fcf-4830-45d3-9a8a-3dafec11791d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1361 microversion: 2.1 time: 0.341570 Aug 04 17:06:43.057109 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2627/5363] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:42 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1361 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:44.088284 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-182e7cfe-613a-457c-8274-e59812c86df3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:44.091095 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-182e7cfe-613a-457c-8274-e59812c86df3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:44.102318 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-182e7cfe-613a-457c-8274-e59812c86df3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:44.103406 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-182e7cfe-613a-457c-8274-e59812c86df3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:44.104694 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-182e7cfe-613a-457c-8274-e59812c86df3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:44.105525 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-182e7cfe-613a-457c-8274-e59812c86df3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:44.280478 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-182e7cfe-613a-457c-8274-e59812c86df3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:44.293638 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-182e7cfe-613a-457c-8274-e59812c86df3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1361 microversion: 2.1 time: 0.215328 Aug 04 17:06:44.300837 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2737/5364] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:44 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1361 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:45.322977 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4277586d-8b5f-4a1e-b8b9-8e36fd48291f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:45.324153 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4277586d-8b5f-4a1e-b8b9-8e36fd48291f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:45.363954 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4277586d-8b5f-4a1e-b8b9-8e36fd48291f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:45.372362 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4277586d-8b5f-4a1e-b8b9-8e36fd48291f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:45.388567 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4277586d-8b5f-4a1e-b8b9-8e36fd48291f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:45.403289 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4277586d-8b5f-4a1e-b8b9-8e36fd48291f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:45.746307 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4277586d-8b5f-4a1e-b8b9-8e36fd48291f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:45.778213 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4277586d-8b5f-4a1e-b8b9-8e36fd48291f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1361 microversion: 2.1 time: 0.454004 Aug 04 17:06:45.781049 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2628/5365] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:45 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1361 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:46.806953 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c0d3529e-0576-481a-bc80-7720eabd718d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:46.808282 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c0d3529e-0576-481a-bc80-7720eabd718d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:46.822010 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0d3529e-0576-481a-bc80-7720eabd718d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:46.830094 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0d3529e-0576-481a-bc80-7720eabd718d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:46.831382 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0d3529e-0576-481a-bc80-7720eabd718d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:46.853682 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0d3529e-0576-481a-bc80-7720eabd718d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:46.867266 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=69 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:06:47.201372 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c0d3529e-0576-481a-bc80-7720eabd718d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:47.211219 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c0d3529e-0576-481a-bc80-7720eabd718d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1361 microversion: 2.1 time: 0.408884 Aug 04 17:06:47.229526 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2738/5366] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:46 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1361 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:48.233206 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-930f5b29-0f9d-418b-a94f-03fd43f5b155 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:48.233866 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-930f5b29-0f9d-418b-a94f-03fd43f5b155 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:48.255389 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-930f5b29-0f9d-418b-a94f-03fd43f5b155 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:48.255955 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-930f5b29-0f9d-418b-a94f-03fd43f5b155 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:48.259518 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-930f5b29-0f9d-418b-a94f-03fd43f5b155 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:48.262336 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-930f5b29-0f9d-418b-a94f-03fd43f5b155 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:48.440799 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-930f5b29-0f9d-418b-a94f-03fd43f5b155 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:48.486604 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-930f5b29-0f9d-418b-a94f-03fd43f5b155 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1361 microversion: 2.1 time: 0.257563 Aug 04 17:06:48.491500 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2629/5367] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:48 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1361 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:49.510304 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f833b4fd-af74-4aaf-98bf-46ab2d78d355 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:49.510990 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f833b4fd-af74-4aaf-98bf-46ab2d78d355 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:49.530222 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f833b4fd-af74-4aaf-98bf-46ab2d78d355 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:49.537685 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f833b4fd-af74-4aaf-98bf-46ab2d78d355 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:49.538871 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f833b4fd-af74-4aaf-98bf-46ab2d78d355 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:49.539340 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f833b4fd-af74-4aaf-98bf-46ab2d78d355 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:49.676231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f833b4fd-af74-4aaf-98bf-46ab2d78d355 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:49.692489 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f833b4fd-af74-4aaf-98bf-46ab2d78d355 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1361 microversion: 2.1 time: 0.188068 Aug 04 17:06:49.693847 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2739/5368] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:49 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:50.730948 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ed1355fe-4fbf-46e0-b3ea-c86045bf2d91 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:50.731838 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ed1355fe-4fbf-46e0-b3ea-c86045bf2d91 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:50.780560 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ed1355fe-4fbf-46e0-b3ea-c86045bf2d91 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:50.783050 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ed1355fe-4fbf-46e0-b3ea-c86045bf2d91 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:50.785096 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ed1355fe-4fbf-46e0-b3ea-c86045bf2d91 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:50.786453 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ed1355fe-4fbf-46e0-b3ea-c86045bf2d91 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:50.805690 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-df714d1a-371d-49b3-a880-0baf1ed03847 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:50.806507 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-df714d1a-371d-49b3-a880-0baf1ed03847 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:50.826254 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df714d1a-371d-49b3-a880-0baf1ed03847 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:50.834305 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df714d1a-371d-49b3-a880-0baf1ed03847 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:50.835482 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df714d1a-371d-49b3-a880-0baf1ed03847 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:50.836149 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df714d1a-371d-49b3-a880-0baf1ed03847 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:50.900055 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-df714d1a-371d-49b3-a880-0baf1ed03847 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296/ips" status: 200 len: 146 microversion: 2.1 time: 0.099909 Aug 04 17:06:50.905009 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2740/5369] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Aug 4 17:06:50 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296/ips => generated 146 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:06:51.046406 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ed1355fe-4fbf-46e0-b3ea-c86045bf2d91 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:51.068167 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ed1355fe-4fbf-46e0-b3ea-c86045bf2d91 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1361 microversion: 2.1 time: 0.348612 Aug 04 17:06:51.085894 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2630/5370] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:50 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1361 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:52.108979 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7e19838f-0687-4456-9525-237501ca8c36 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:52.112238 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7e19838f-0687-4456-9525-237501ca8c36 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:52.139901 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7e19838f-0687-4456-9525-237501ca8c36 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:52.140719 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7e19838f-0687-4456-9525-237501ca8c36 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:52.148976 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7e19838f-0687-4456-9525-237501ca8c36 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:52.152222 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7e19838f-0687-4456-9525-237501ca8c36 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:52.311254 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7e19838f-0687-4456-9525-237501ca8c36 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:52.311783 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7e19838f-0687-4456-9525-237501ca8c36 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:52.318491 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-7e19838f-0687-4456-9525-237501ca8c36 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lazy-loading 'fault' on Instance uuid a21b339b-7fc4-47e7-9e25-d24d3aae4535 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:06:52.451992 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7e19838f-0687-4456-9525-237501ca8c36 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:52.493745 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7e19838f-0687-4456-9525-237501ca8c36 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 200 len: 1320 microversion: 2.1 time: 0.361319 Aug 04 17:06:52.498732 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2741/5371] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:52 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 1320 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:53.529223 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d549b8e3-4a86-45a8-b806-08ab62642554 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:53.529931 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d549b8e3-4a86-45a8-b806-08ab62642554 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:53.576173 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d549b8e3-4a86-45a8-b806-08ab62642554 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:53.576637 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d549b8e3-4a86-45a8-b806-08ab62642554 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:53.577526 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d549b8e3-4a86-45a8-b806-08ab62642554 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:53.577987 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d549b8e3-4a86-45a8-b806-08ab62642554 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:53.631414 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-d549b8e3-4a86-45a8-b806-08ab62642554 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] HTTP exception thrown: Instance a21b339b-7fc4-47e7-9e25-d24d3aae4535 could not be found. Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d549b8e3-4a86-45a8-b806-08ab62642554 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Request method failure captured: Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 HTTP/1.1 Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_saEEOyGnjC2YSw5rO0XXZ0SIXFPgcyNqjoEnoWtNKNr9NN9-nC4VrXak9kuQQxq1he9punHwiXqtbTRNS_i0OM4UCS6bcDxdgTY6YMq4AHl3lv7jEdWuqMUDAU4k5OfnQSgkMml4THPPXJh4YiohQx-XVMfF21_bM4MqtZQZ4iEBI Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 78a0adb69ba24749817a8855effc20ad Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78a0adb69ba24749817a8855effc20ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_78a0adb69ba24749817a8855effc20ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78a0adb69ba24749817a8855effc20ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/78a0adb69ba24749817a8855effc20ad"}]}] Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 78a0adb69ba24749817a8855effc20ad Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-TestVolumeBootPattern-1920412406-project Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: ea9cab1c1eff47ddb881a2b57bf240f3 Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-TestVolumeBootPattern-1920412406-project Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance a21b339b-7fc4-47e7-9e25-d24d3aae4535 could not be found. Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'a21b339b-7fc4-47e7-9e25-d24d3aae4535'} Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a21b339b-7fc4-47e7-9e25-d24d3aae4535 could not be found. Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a21b339b-7fc4-47e7-9e25-d24d3aae4535 could not be found. Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:53.641647 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:06:53.647551 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:53.647551 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:53.647551 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:53.647551 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:06:53.647551 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:06:53.647551 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a21b339b-7fc4-47e7-9e25-d24d3aae4535 could not be found. Aug 04 17:06:53.647551 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:06:53.647551 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d549b8e3-4a86-45a8-b806-08ab62642554 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Returning 404 to user: Instance a21b339b-7fc4-47e7-9e25-d24d3aae4535 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:06:53.647551 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d549b8e3-4a86-45a8-b806-08ab62642554 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 404 len: 111 microversion: 2.1 time: 0.119331 Aug 04 17:06:53.658845 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2631/5372] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:53 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:06:56.318120 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-afe782ca-2140-48ab-bb8d-d3448af12671 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5089a64-c9dd-4747-85a9-f8546d257f4b"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:56.331873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-afe782ca-2140-48ab-bb8d-d3448af12671 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:56.347097 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=28 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:06:56.354638 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-afe782ca-2140-48ab-bb8d-d3448af12671 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:56.357791 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-afe782ca-2140-48ab-bb8d-d3448af12671 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:56.359960 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-afe782ca-2140-48ab-bb8d-d3448af12671 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:06:56.360714 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-afe782ca-2140-48ab-bb8d-d3448af12671 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:06:56.864530 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-afe782ca-2140-48ab-bb8d-d3448af12671 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "POST /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.559798 Aug 04 17:06:56.876081 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2742/5373] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Aug 4 17:06:56 2022] POST /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296/os-volume_attachments => generated 194 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:01.811908 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5ecb1f65-6281-4ac1-a4d1-912a83037c1b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:01.812490 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5ecb1f65-6281-4ac1-a4d1-912a83037c1b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:01.824911 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:01.831330 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ecb1f65-6281-4ac1-a4d1-912a83037c1b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:01.831746 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ecb1f65-6281-4ac1-a4d1-912a83037c1b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:01.832789 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ecb1f65-6281-4ac1-a4d1-912a83037c1b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:01.833514 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ecb1f65-6281-4ac1-a4d1-912a83037c1b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:01.847691 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:01.907437 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5ecb1f65-6281-4ac1-a4d1-912a83037c1b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:07:02.093817 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5ecb1f65-6281-4ac1-a4d1-912a83037c1b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 204 len: 0 microversion: 2.1 time: 0.284492 Aug 04 17:07:02.098733 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2632/5374] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:07:01 2022] DELETE /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:07:02.106319 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-20e9039c-c90a-4a10-8446-19ef5ef0cb4e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:02.107030 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-20e9039c-c90a-4a10-8446-19ef5ef0cb4e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:02.137876 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-20e9039c-c90a-4a10-8446-19ef5ef0cb4e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:02.138500 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-20e9039c-c90a-4a10-8446-19ef5ef0cb4e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:02.139456 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-20e9039c-c90a-4a10-8446-19ef5ef0cb4e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:02.139984 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-20e9039c-c90a-4a10-8446-19ef5ef0cb4e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:02.649021 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-20e9039c-c90a-4a10-8446-19ef5ef0cb4e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:02.690226 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-20e9039c-c90a-4a10-8446-19ef5ef0cb4e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 200 len: 1408 microversion: 2.1 time: 0.589848 Aug 04 17:07:02.694323 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2743/5375] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:02 2022] GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 1408 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:03.719656 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ac98cc17-b0db-4d67-807d-66ea9dbd2ab0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:03.721018 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ac98cc17-b0db-4d67-807d-66ea9dbd2ab0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:03.732252 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ac98cc17-b0db-4d67-807d-66ea9dbd2ab0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:03.735626 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ac98cc17-b0db-4d67-807d-66ea9dbd2ab0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:03.736685 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ac98cc17-b0db-4d67-807d-66ea9dbd2ab0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:03.743041 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ac98cc17-b0db-4d67-807d-66ea9dbd2ab0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:04.329900 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ac98cc17-b0db-4d67-807d-66ea9dbd2ab0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:04.344103 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ac98cc17-b0db-4d67-807d-66ea9dbd2ab0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 200 len: 1408 microversion: 2.1 time: 0.629435 Aug 04 17:07:04.345857 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2633/5376] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:03 2022] GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 1408 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:05.372669 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e8ccbc56-09f0-4cbe-8978-48be977775be tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:05.373674 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e8ccbc56-09f0-4cbe-8978-48be977775be tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:05.392099 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e8ccbc56-09f0-4cbe-8978-48be977775be tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:05.392695 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e8ccbc56-09f0-4cbe-8978-48be977775be tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:05.395405 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e8ccbc56-09f0-4cbe-8978-48be977775be tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:05.396186 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e8ccbc56-09f0-4cbe-8978-48be977775be tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:05.461687 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-031bb60c-078b-4cfb-9d9b-02573338d4e4 req-89d5d61f-3c1c-4abc-85f2-0b4e1531634d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0337a477-e21a-4d1c-886f-c9caa02906b7", "name": "network-vif-deleted", "tag": "f8fd5042-ecfc-4bd6-aed4-37deaa6ee2a9"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:05.483990 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-031bb60c-078b-4cfb-9d9b-02573338d4e4 req-89d5d61f-3c1c-4abc-85f2-0b4e1531634d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:05.484432 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-031bb60c-078b-4cfb-9d9b-02573338d4e4 req-89d5d61f-3c1c-4abc-85f2-0b4e1531634d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:05.515770 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-031bb60c-078b-4cfb-9d9b-02573338d4e4 req-89d5d61f-3c1c-4abc-85f2-0b4e1531634d service nova] Creating event network-vif-deleted:f8fd5042-ecfc-4bd6-aed4-37deaa6ee2a9 for instance 0337a477-e21a-4d1c-886f-c9caa02906b7 on n-h2-846466-12 Aug 04 17:07:05.537102 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-031bb60c-078b-4cfb-9d9b-02573338d4e4 req-89d5d61f-3c1c-4abc-85f2-0b4e1531634d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079848 Aug 04 17:07:05.538245 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2634/5377] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:07:05.575828 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e8ccbc56-09f0-4cbe-8978-48be977775be tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:05.583748 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e8ccbc56-09f0-4cbe-8978-48be977775be tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 200 len: 1201 microversion: 2.1 time: 0.216065 Aug 04 17:07:05.586965 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2744/5378] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:05 2022] GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 1201 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:06.612578 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7a5eba1a-5636-4251-a4e0-4fdbbc8fc5a7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:06.641233 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7a5eba1a-5636-4251-a4e0-4fdbbc8fc5a7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:06.669790 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7a5eba1a-5636-4251-a4e0-4fdbbc8fc5a7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:06.670342 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7a5eba1a-5636-4251-a4e0-4fdbbc8fc5a7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:06.672802 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7a5eba1a-5636-4251-a4e0-4fdbbc8fc5a7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:06.673419 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7a5eba1a-5636-4251-a4e0-4fdbbc8fc5a7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:06.865593 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7a5eba1a-5636-4251-a4e0-4fdbbc8fc5a7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:06.877956 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7a5eba1a-5636-4251-a4e0-4fdbbc8fc5a7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 200 len: 1201 microversion: 2.1 time: 0.270995 Aug 04 17:07:06.891591 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2635/5379] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:06 2022] GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 1201 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:07.908811 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cb1db5e1-5ade-4c87-ada5-7b78ac6c3e59 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:07.911206 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cb1db5e1-5ade-4c87-ada5-7b78ac6c3e59 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:07.922250 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cb1db5e1-5ade-4c87-ada5-7b78ac6c3e59 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:07.923084 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cb1db5e1-5ade-4c87-ada5-7b78ac6c3e59 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:07.924390 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cb1db5e1-5ade-4c87-ada5-7b78ac6c3e59 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:07.925254 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cb1db5e1-5ade-4c87-ada5-7b78ac6c3e59 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:08.072528 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cb1db5e1-5ade-4c87-ada5-7b78ac6c3e59 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:08.100759 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cb1db5e1-5ade-4c87-ada5-7b78ac6c3e59 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 200 len: 1201 microversion: 2.1 time: 0.205314 Aug 04 17:07:08.101411 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2745/5380] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:07 2022] GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 1201 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:09.123277 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1ad87105-5b1e-4e32-9544-755008323d22 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:09.124710 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1ad87105-5b1e-4e32-9544-755008323d22 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:09.148221 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1ad87105-5b1e-4e32-9544-755008323d22 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:09.154345 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1ad87105-5b1e-4e32-9544-755008323d22 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:09.155477 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1ad87105-5b1e-4e32-9544-755008323d22 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:09.165802 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1ad87105-5b1e-4e32-9544-755008323d22 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:09.348951 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1ad87105-5b1e-4e32-9544-755008323d22 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:09.373311 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1ad87105-5b1e-4e32-9544-755008323d22 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 200 len: 1201 microversion: 2.1 time: 0.255551 Aug 04 17:07:09.376638 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2636/5381] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:09 2022] GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 1201 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:10.396567 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8f81f969-7d8c-403f-8bfc-1b5a45b45522 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:10.397862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8f81f969-7d8c-403f-8bfc-1b5a45b45522 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:10.405924 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8f81f969-7d8c-403f-8bfc-1b5a45b45522 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:10.406780 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8f81f969-7d8c-403f-8bfc-1b5a45b45522 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:10.407747 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8f81f969-7d8c-403f-8bfc-1b5a45b45522 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:10.408402 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8f81f969-7d8c-403f-8bfc-1b5a45b45522 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:10.483210 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8f81f969-7d8c-403f-8bfc-1b5a45b45522 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:10.492061 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8f81f969-7d8c-403f-8bfc-1b5a45b45522 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 200 len: 1201 microversion: 2.1 time: 0.099507 Aug 04 17:07:10.493246 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2746/5382] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:10 2022] GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 1201 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:11.514505 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1cff0608-6165-4a3b-a42b-7aa0df275ce2 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:11.515203 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1cff0608-6165-4a3b-a42b-7aa0df275ce2 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:11.529730 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1cff0608-6165-4a3b-a42b-7aa0df275ce2 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:11.529730 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1cff0608-6165-4a3b-a42b-7aa0df275ce2 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:11.529730 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1cff0608-6165-4a3b-a42b-7aa0df275ce2 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:11.529730 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1cff0608-6165-4a3b-a42b-7aa0df275ce2 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:11.678416 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1cff0608-6165-4a3b-a42b-7aa0df275ce2 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:11.699742 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1cff0608-6165-4a3b-a42b-7aa0df275ce2 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 200 len: 1201 microversion: 2.1 time: 0.189876 Aug 04 17:07:11.713380 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2637/5383] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:11 2022] GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 1201 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:11.788217 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a35c112d-f9f1-4c1e-9d23-c76d043ac32d tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Action: 'create', calling method: .version_select at 0x7f7e77096e50>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1773976084", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFq+Pve/KbaJZr5T/JVYkiLEPtRQywzccR+n6Z//6LlPNIDlrQjq3QeCi1pMnGIUDSrL826tMRDVvUDyjYjevJmp9zsdkjn06kQINNIVdXlM+pEsxixBT+KcpXYxHFslw=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:11.820299 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-a35c112d-f9f1-4c1e-9d23-c76d043ac32d tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Getting quotas for project de2827b551964bf296b13728f77c5f88. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:07:11.828900 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-a35c112d-f9f1-4c1e-9d23-c76d043ac32d tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Getting quotas for user a27c708a0dfa40bd85a95aa5f48d3bb9 and project de2827b551964bf296b13728f77c5f88. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:07:11.868003 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a35c112d-f9f1-4c1e-9d23-c76d043ac32d tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.085113 Aug 04 17:07:11.868646 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2747/5384] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 17:07:11 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:12.727149 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7f412c64-fb33-45d4-8438-e252391ab774 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:12.728634 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7f412c64-fb33-45d4-8438-e252391ab774 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:12.747209 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f412c64-fb33-45d4-8438-e252391ab774 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:12.748631 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f412c64-fb33-45d4-8438-e252391ab774 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:12.749607 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f412c64-fb33-45d4-8438-e252391ab774 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:12.751240 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f412c64-fb33-45d4-8438-e252391ab774 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:12.987392 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7f412c64-fb33-45d4-8438-e252391ab774 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:13.000873 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7f412c64-fb33-45d4-8438-e252391ab774 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 200 len: 1201 microversion: 2.1 time: 0.275932 Aug 04 17:07:13.005948 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2638/5385] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:12 2022] GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 1201 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:14.029888 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1c6539c5-1ed5-4515-9996-229918663f54 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:14.031027 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1c6539c5-1ed5-4515-9996-229918663f54 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:14.042675 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1c6539c5-1ed5-4515-9996-229918663f54 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:14.045539 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1c6539c5-1ed5-4515-9996-229918663f54 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:14.046863 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1c6539c5-1ed5-4515-9996-229918663f54 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:14.049519 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1c6539c5-1ed5-4515-9996-229918663f54 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:14.170087 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1c6539c5-1ed5-4515-9996-229918663f54 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:14.184525 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1c6539c5-1ed5-4515-9996-229918663f54 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 200 len: 1201 microversion: 2.1 time: 0.155403 Aug 04 17:07:14.185531 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2748/5386] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:14 2022] GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 1201 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:14.594780 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3b8ca59d-7267-4bc8-adf8-14557b764eed tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1144251774", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "97181041-756d-478e-97e7-5ec2b0b5e976", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1773976084", "security_groups": [{"name": "tempest-secgroup-smoke-2058668089"}], "networks": [{"uuid": "0a5b7f8c-6801-4cd0-8eee-cacd8d607f63"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:14.909407 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-3b8ca59d-7267-4bc8-adf8-14557b764eed tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] validate_networks() for [('0a5b7f8c-6801-4cd0-8eee-cacd8d607f63', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:07:15.211210 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2b0f599d-b19f-4c09-9ea9-99e4202167d3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:15.213609 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2b0f599d-b19f-4c09-9ea9-99e4202167d3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:15.232161 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2b0f599d-b19f-4c09-9ea9-99e4202167d3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:15.232983 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2b0f599d-b19f-4c09-9ea9-99e4202167d3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:15.234707 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2b0f599d-b19f-4c09-9ea9-99e4202167d3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:15.235388 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2b0f599d-b19f-4c09-9ea9-99e4202167d3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:15.411906 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2b0f599d-b19f-4c09-9ea9-99e4202167d3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:15.424077 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2b0f599d-b19f-4c09-9ea9-99e4202167d3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 200 len: 1201 microversion: 2.1 time: 0.217551 Aug 04 17:07:15.424842 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2749/5387] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:15 2022] GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 1201 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:16.157505 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-3b8ca59d-7267-4bc8-adf8-14557b764eed tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:07:16.158081 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-3b8ca59d-7267-4bc8-adf8-14557b764eed tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:07:16.158416 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-3b8ca59d-7267-4bc8-adf8-14557b764eed tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:07:16.158835 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-3b8ca59d-7267-4bc8-adf8-14557b764eed tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:07:16.159257 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-3b8ca59d-7267-4bc8-adf8-14557b764eed tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:07:16.175866 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b8ca59d-7267-4bc8-adf8-14557b764eed tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:16.176345 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b8ca59d-7267-4bc8-adf8-14557b764eed tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:16.177169 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b8ca59d-7267-4bc8-adf8-14557b764eed tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:16.177655 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3b8ca59d-7267-4bc8-adf8-14557b764eed tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:16.226463 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-3b8ca59d-7267-4bc8-adf8-14557b764eed tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Getting quotas for project de2827b551964bf296b13728f77c5f88. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:07:16.238176 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-3b8ca59d-7267-4bc8-adf8-14557b764eed tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Getting quotas for user a27c708a0dfa40bd85a95aa5f48d3bb9 and project de2827b551964bf296b13728f77c5f88. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:07:16.361069 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3b8ca59d-7267-4bc8-adf8-14557b764eed tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:07:16.363670 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3b8ca59d-7267-4bc8-adf8-14557b764eed tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] [instance: f273a7e1-9a1b-443a-8b5f-40cbb05136ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='97181041-756d-478e-97e7-5ec2b0b5e976',volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:07:16.450174 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-27f762c0-c3ea-4d68-8f62-558063c6c467 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:16.451349 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-27f762c0-c3ea-4d68-8f62-558063c6c467 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:16.471109 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-27f762c0-c3ea-4d68-8f62-558063c6c467 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:16.480699 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-27f762c0-c3ea-4d68-8f62-558063c6c467 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:16.484469 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-27f762c0-c3ea-4d68-8f62-558063c6c467 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:16.484949 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-27f762c0-c3ea-4d68-8f62-558063c6c467 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:16.663507 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3b8ca59d-7267-4bc8-adf8-14557b764eed tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.073068 Aug 04 17:07:16.670907 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2639/5388] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:07:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 2081 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:07:16.678145 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-127960be-371e-4803-afb7-c7431ab93a4d tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:16.685802 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-127960be-371e-4803-afb7-c7431ab93a4d tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] [instance: f273a7e1-9a1b-443a-8b5f-40cbb05136ba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:16.686173 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-27f762c0-c3ea-4d68-8f62-558063c6c467 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:16.712518 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-27f762c0-c3ea-4d68-8f62-558063c6c467 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 200 len: 1201 microversion: 2.1 time: 0.263772 Aug 04 17:07:16.715814 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2750/5389] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:16 2022] GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 1201 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:16.802655 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-127960be-371e-4803-afb7-c7431ab93a4d tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27c708a0dfa40bd85a95aa5f48d3bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2827b551964bf296b13728f77c5f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:16.811309 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-127960be-371e-4803-afb7-c7431ab93a4d tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] 10.222.0.23 "GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba" status: 200 len: 1099 microversion: 2.1 time: 0.138752 Aug 04 17:07:16.828214 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2640/5390] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:16 2022] GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba => generated 1099 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:17.498802 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-12a78af1-fd3c-41ba-bce0-e39bc63a348f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:17.522295 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-12a78af1-fd3c-41ba-bce0-e39bc63a348f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:17.531201 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-12a78af1-fd3c-41ba-bce0-e39bc63a348f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:17.570921 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:17.588105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-12a78af1-fd3c-41ba-bce0-e39bc63a348f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Going to try to stop instance {{(pid=126125) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 17:07:17.667240 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-12a78af1-fd3c-41ba-bce0-e39bc63a348f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "POST /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296/action" status: 202 len: 0 microversion: 2.1 time: 0.171833 Aug 04 17:07:17.672346 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2751/5391] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:07:17 2022] POST /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:07:17.678075 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-98ad268c-f420-464b-859d-540877d0dbed tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:17.679294 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-98ad268c-f420-464b-859d-540877d0dbed tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:17.698962 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-98ad268c-f420-464b-859d-540877d0dbed tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:17.699725 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-98ad268c-f420-464b-859d-540877d0dbed tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:17.700532 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-98ad268c-f420-464b-859d-540877d0dbed tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:17.700976 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-98ad268c-f420-464b-859d-540877d0dbed tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:17.750938 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5665ea72-9005-48b5-ba8d-0accd603663b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:17.751728 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5665ea72-9005-48b5-ba8d-0accd603663b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:17.766974 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5665ea72-9005-48b5-ba8d-0accd603663b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:17.768747 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5665ea72-9005-48b5-ba8d-0accd603663b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:17.771397 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5665ea72-9005-48b5-ba8d-0accd603663b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:17.772070 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5665ea72-9005-48b5-ba8d-0accd603663b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:17.984238 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5665ea72-9005-48b5-ba8d-0accd603663b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:17.997762 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5665ea72-9005-48b5-ba8d-0accd603663b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 200 len: 1201 microversion: 2.1 time: 0.256446 Aug 04 17:07:17.998647 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2752/5392] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:17 2022] GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 1201 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:18.007818 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0e835266-1de2-4fa5-9253-c36ad7100943 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:18.008812 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0e835266-1de2-4fa5-9253-c36ad7100943 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] [instance: f273a7e1-9a1b-443a-8b5f-40cbb05136ba] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:18.020826 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0e835266-1de2-4fa5-9253-c36ad7100943 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:18.023922 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0e835266-1de2-4fa5-9253-c36ad7100943 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:18.025833 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0e835266-1de2-4fa5-9253-c36ad7100943 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:18.028200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0e835266-1de2-4fa5-9253-c36ad7100943 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:18.265128 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0e835266-1de2-4fa5-9253-c36ad7100943 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27c708a0dfa40bd85a95aa5f48d3bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2827b551964bf296b13728f77c5f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:18.275066 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0e835266-1de2-4fa5-9253-c36ad7100943 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] 10.222.0.23 "GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba" status: 200 len: 1141 microversion: 2.1 time: 0.275135 Aug 04 17:07:18.277896 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2753/5393] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:17 2022] GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba => generated 1141 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:18.301113 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-98ad268c-f420-464b-859d-540877d0dbed tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:18.321713 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-98ad268c-f420-464b-859d-540877d0dbed tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1725 microversion: 2.1 time: 0.648314 Aug 04 17:07:18.336802 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2641/5394] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:17 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1725 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:19.023283 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2932f1e8-b3fc-45fb-8198-b5819cd1aa8e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:19.023895 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2932f1e8-b3fc-45fb-8198-b5819cd1aa8e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:19.066794 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2932f1e8-b3fc-45fb-8198-b5819cd1aa8e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:19.067042 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2932f1e8-b3fc-45fb-8198-b5819cd1aa8e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:19.073704 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2932f1e8-b3fc-45fb-8198-b5819cd1aa8e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:19.077171 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2932f1e8-b3fc-45fb-8198-b5819cd1aa8e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:19.278888 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2932f1e8-b3fc-45fb-8198-b5819cd1aa8e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:19.279339 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2932f1e8-b3fc-45fb-8198-b5819cd1aa8e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:19.279797 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-2932f1e8-b3fc-45fb-8198-b5819cd1aa8e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lazy-loading 'fault' on Instance uuid 0337a477-e21a-4d1c-886f-c9caa02906b7 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:07:19.298444 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-97bc9b01-df74-40f1-aa69-07cc8e756677 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:19.299120 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-97bc9b01-df74-40f1-aa69-07cc8e756677 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] [instance: f273a7e1-9a1b-443a-8b5f-40cbb05136ba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:19.311398 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-97bc9b01-df74-40f1-aa69-07cc8e756677 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:19.328766 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-97bc9b01-df74-40f1-aa69-07cc8e756677 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:19.334586 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-97bc9b01-df74-40f1-aa69-07cc8e756677 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:19.336094 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-97bc9b01-df74-40f1-aa69-07cc8e756677 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:19.374785 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2932f1e8-b3fc-45fb-8198-b5819cd1aa8e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:19.392954 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2932f1e8-b3fc-45fb-8198-b5819cd1aa8e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 200 len: 1206 microversion: 2.1 time: 0.369534 Aug 04 17:07:19.396668 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2754/5395] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:19 2022] GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 1206 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:19.413195 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b978c73b-96ee-4bbe-a9c9-b1ff36e49c0f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:19.416400 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b978c73b-96ee-4bbe-a9c9-b1ff36e49c0f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:19.432178 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b978c73b-96ee-4bbe-a9c9-b1ff36e49c0f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:19.432535 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b978c73b-96ee-4bbe-a9c9-b1ff36e49c0f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:19.436447 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b978c73b-96ee-4bbe-a9c9-b1ff36e49c0f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:19.437021 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b978c73b-96ee-4bbe-a9c9-b1ff36e49c0f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:19.523091 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-97bc9b01-df74-40f1-aa69-07cc8e756677 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27c708a0dfa40bd85a95aa5f48d3bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2827b551964bf296b13728f77c5f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:19.535592 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-97bc9b01-df74-40f1-aa69-07cc8e756677 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] 10.222.0.23 "GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba" status: 200 len: 1215 microversion: 2.1 time: 0.238780 Aug 04 17:07:19.549243 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2642/5396] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:19 2022] GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba => generated 1215 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:20.293185 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b978c73b-96ee-4bbe-a9c9-b1ff36e49c0f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:20.308712 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b978c73b-96ee-4bbe-a9c9-b1ff36e49c0f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1725 microversion: 2.1 time: 0.910301 Aug 04 17:07:20.315225 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2755/5397] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:19 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1725 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:20.418237 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ad9572fc-2241-4421-9a1c-539d9d6858ac tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:20.418858 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ad9572fc-2241-4421-9a1c-539d9d6858ac tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:20.431307 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad9572fc-2241-4421-9a1c-539d9d6858ac tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:20.434547 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad9572fc-2241-4421-9a1c-539d9d6858ac tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:20.435602 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad9572fc-2241-4421-9a1c-539d9d6858ac tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:20.436206 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad9572fc-2241-4421-9a1c-539d9d6858ac tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:20.470428 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-ad9572fc-2241-4421-9a1c-539d9d6858ac tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] HTTP exception thrown: Instance 0337a477-e21a-4d1c-886f-c9caa02906b7 could not be found. Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ad9572fc-2241-4421-9a1c-539d9d6858ac tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Request method failure captured: Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 HTTP/1.1 Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_saEEOyGnjC2YSw5rO0XXZ0SIXFPgcyNqjoEnoWtNKNr9NN9-nC4VrXak9kuQQxq1he9punHwiXqtbTRNS_i0OM4UCS6bcDxdgTY6YMq4AHl3lv7jEdWuqMUDAU4k5OfnQSgkMml4THPPXJh4YiohQx-XVMfF21_bM4MqtZQZ4iEBI Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 78a0adb69ba24749817a8855effc20ad Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78a0adb69ba24749817a8855effc20ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_78a0adb69ba24749817a8855effc20ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78a0adb69ba24749817a8855effc20ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/78a0adb69ba24749817a8855effc20ad"}]}] Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 78a0adb69ba24749817a8855effc20ad Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-TestVolumeBootPattern-1920412406-project Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: ea9cab1c1eff47ddb881a2b57bf240f3 Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-TestVolumeBootPattern-1920412406-project Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 0337a477-e21a-4d1c-886f-c9caa02906b7 could not be found. Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '0337a477-e21a-4d1c-886f-c9caa02906b7'} Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0337a477-e21a-4d1c-886f-c9caa02906b7 could not be found. Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0337a477-e21a-4d1c-886f-c9caa02906b7 could not be found. Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:07:20.498295 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:07:20.502923 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:20.502923 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:07:20.502923 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:07:20.502923 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:07:20.502923 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:07:20.502923 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0337a477-e21a-4d1c-886f-c9caa02906b7 could not be found. Aug 04 17:07:20.502923 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:07:20.504304 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ad9572fc-2241-4421-9a1c-539d9d6858ac tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Returning 404 to user: Instance 0337a477-e21a-4d1c-886f-c9caa02906b7 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:07:20.505466 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ad9572fc-2241-4421-9a1c-539d9d6858ac tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 404 len: 111 microversion: 2.1 time: 0.091261 Aug 04 17:07:20.507641 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2643/5398] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:20 2022] GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:07:20.557480 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-730c74fa-5eb7-4d7d-8806-823c787d96ad tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:20.558332 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-730c74fa-5eb7-4d7d-8806-823c787d96ad tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] [instance: f273a7e1-9a1b-443a-8b5f-40cbb05136ba] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:20.572279 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-730c74fa-5eb7-4d7d-8806-823c787d96ad tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:20.573053 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-730c74fa-5eb7-4d7d-8806-823c787d96ad tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:20.576125 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-730c74fa-5eb7-4d7d-8806-823c787d96ad tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:20.577927 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-730c74fa-5eb7-4d7d-8806-823c787d96ad tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:20.803161 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-730c74fa-5eb7-4d7d-8806-823c787d96ad tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27c708a0dfa40bd85a95aa5f48d3bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2827b551964bf296b13728f77c5f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:20.819142 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-730c74fa-5eb7-4d7d-8806-823c787d96ad tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] 10.222.0.23 "GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba" status: 200 len: 1215 microversion: 2.1 time: 0.266903 Aug 04 17:07:20.836755 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2756/5399] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:20 2022] GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba => generated 1215 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:21.338285 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dd4f6a07-a530-49c2-af20-535033e526c3 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:21.339337 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-dd4f6a07-a530-49c2-af20-535033e526c3 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:21.375874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd4f6a07-a530-49c2-af20-535033e526c3 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:21.376635 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd4f6a07-a530-49c2-af20-535033e526c3 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:21.377882 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd4f6a07-a530-49c2-af20-535033e526c3 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:21.378343 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd4f6a07-a530-49c2-af20-535033e526c3 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:21.840617 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a889e973-f46f-462e-863e-23275ed50116 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:21.841352 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a889e973-f46f-462e-863e-23275ed50116 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] [instance: f273a7e1-9a1b-443a-8b5f-40cbb05136ba] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:21.845076 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:21.892068 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a889e973-f46f-462e-863e-23275ed50116 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:21.892749 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a889e973-f46f-462e-863e-23275ed50116 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:21.893672 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a889e973-f46f-462e-863e-23275ed50116 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:21.894118 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a889e973-f46f-462e-863e-23275ed50116 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:22.987129 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-dd4f6a07-a530-49c2-af20-535033e526c3 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:23.002073 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dd4f6a07-a530-49c2-af20-535033e526c3 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1725 microversion: 2.1 time: 1.668788 Aug 04 17:07:23.009781 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2644/5400] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:21 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1725 bytes in 1677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:23.256814 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a889e973-f46f-462e-863e-23275ed50116 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27c708a0dfa40bd85a95aa5f48d3bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2827b551964bf296b13728f77c5f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:23.279452 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a889e973-f46f-462e-863e-23275ed50116 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] 10.222.0.23 "GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba" status: 200 len: 1283 microversion: 2.1 time: 1.442106 Aug 04 17:07:23.280985 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2757/5401] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:21 2022] GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba => generated 1283 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:24.028330 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f9c25ba9-7c2e-430b-8165-73f0b6616d16 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:24.037402 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f9c25ba9-7c2e-430b-8165-73f0b6616d16 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:24.058532 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f9c25ba9-7c2e-430b-8165-73f0b6616d16 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:24.060035 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f9c25ba9-7c2e-430b-8165-73f0b6616d16 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:24.061237 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f9c25ba9-7c2e-430b-8165-73f0b6616d16 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:24.062457 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f9c25ba9-7c2e-430b-8165-73f0b6616d16 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:24.312344 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-577360e0-0872-4e7b-9da2-9bf44dbba791 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:24.316368 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-577360e0-0872-4e7b-9da2-9bf44dbba791 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] [instance: f273a7e1-9a1b-443a-8b5f-40cbb05136ba] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:24.327583 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-577360e0-0872-4e7b-9da2-9bf44dbba791 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:24.328941 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-577360e0-0872-4e7b-9da2-9bf44dbba791 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:24.330036 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-577360e0-0872-4e7b-9da2-9bf44dbba791 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:24.330587 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-577360e0-0872-4e7b-9da2-9bf44dbba791 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:25.354168 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-577360e0-0872-4e7b-9da2-9bf44dbba791 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27c708a0dfa40bd85a95aa5f48d3bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2827b551964bf296b13728f77c5f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:25.364135 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-577360e0-0872-4e7b-9da2-9bf44dbba791 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] 10.222.0.23 "GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba" status: 200 len: 1283 microversion: 2.1 time: 1.063020 Aug 04 17:07:25.371342 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2758/5402] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:24 2022] GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba => generated 1283 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:25.373029 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f9c25ba9-7c2e-430b-8165-73f0b6616d16 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:25.384230 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-de5257a6-6815-47d1-b233-cc48678ad7b3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:25.392407 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f9c25ba9-7c2e-430b-8165-73f0b6616d16 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1725 microversion: 2.1 time: 1.369472 Aug 04 17:07:25.396173 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-de5257a6-6815-47d1-b233-cc48678ad7b3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:25.417050 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2645/5403] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:24 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1725 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:25.428033 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-de5257a6-6815-47d1-b233-cc48678ad7b3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:25.432466 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-de5257a6-6815-47d1-b233-cc48678ad7b3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:25.435180 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-de5257a6-6815-47d1-b233-cc48678ad7b3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:25.436054 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-de5257a6-6815-47d1-b233-cc48678ad7b3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:25.494932 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-de5257a6-6815-47d1-b233-cc48678ad7b3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] HTTP exception thrown: Instance a21b339b-7fc4-47e7-9e25-d24d3aae4535 could not be found. Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-de5257a6-6815-47d1-b233-cc48678ad7b3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Request method failure captured: Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 HTTP/1.1 Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_saEEOyGnjC2YSw5rO0XXZ0SIXFPgcyNqjoEnoWtNKNr9NN9-nC4VrXak9kuQQxq1he9punHwiXqtbTRNS_i0OM4UCS6bcDxdgTY6YMq4AHl3lv7jEdWuqMUDAU4k5OfnQSgkMml4THPPXJh4YiohQx-XVMfF21_bM4MqtZQZ4iEBI Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 78a0adb69ba24749817a8855effc20ad Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78a0adb69ba24749817a8855effc20ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_78a0adb69ba24749817a8855effc20ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78a0adb69ba24749817a8855effc20ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/78a0adb69ba24749817a8855effc20ad"}]}] Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 78a0adb69ba24749817a8855effc20ad Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-TestVolumeBootPattern-1920412406-project Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: ea9cab1c1eff47ddb881a2b57bf240f3 Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-TestVolumeBootPattern-1920412406-project Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance a21b339b-7fc4-47e7-9e25-d24d3aae4535 could not be found. Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'a21b339b-7fc4-47e7-9e25-d24d3aae4535'} Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a21b339b-7fc4-47e7-9e25-d24d3aae4535 could not be found. Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:07:25.497167 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:07:25.501172 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a21b339b-7fc4-47e7-9e25-d24d3aae4535 could not be found. Aug 04 17:07:25.501172 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:07:25.501172 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:07:25.501172 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:07:25.501172 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:25.501172 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:07:25.501172 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:07:25.501172 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:07:25.501172 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:07:25.501172 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a21b339b-7fc4-47e7-9e25-d24d3aae4535 could not be found. Aug 04 17:07:25.501172 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:07:25.503079 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-de5257a6-6815-47d1-b233-cc48678ad7b3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Returning 404 to user: Instance a21b339b-7fc4-47e7-9e25-d24d3aae4535 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:07:25.504842 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-de5257a6-6815-47d1-b233-cc48678ad7b3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 404 len: 111 microversion: 2.1 time: 0.130692 Aug 04 17:07:25.508702 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2759/5404] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:07:25 2022] DELETE /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:07:25.518795 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-13726963-c71f-470b-a9f9-c1c3503468a9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:25.519570 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-13726963-c71f-470b-a9f9-c1c3503468a9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: a21b339b-7fc4-47e7-9e25-d24d3aae4535] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:25.544051 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-13726963-c71f-470b-a9f9-c1c3503468a9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:25.544740 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-13726963-c71f-470b-a9f9-c1c3503468a9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:25.545768 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-13726963-c71f-470b-a9f9-c1c3503468a9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:25.555762 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-13726963-c71f-470b-a9f9-c1c3503468a9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:25.579340 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-13726963-c71f-470b-a9f9-c1c3503468a9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] HTTP exception thrown: Instance a21b339b-7fc4-47e7-9e25-d24d3aae4535 could not be found. Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-13726963-c71f-470b-a9f9-c1c3503468a9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Request method failure captured: Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 HTTP/1.1 Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_saEEOyGnjC2YSw5rO0XXZ0SIXFPgcyNqjoEnoWtNKNr9NN9-nC4VrXak9kuQQxq1he9punHwiXqtbTRNS_i0OM4UCS6bcDxdgTY6YMq4AHl3lv7jEdWuqMUDAU4k5OfnQSgkMml4THPPXJh4YiohQx-XVMfF21_bM4MqtZQZ4iEBI Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 78a0adb69ba24749817a8855effc20ad Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78a0adb69ba24749817a8855effc20ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_78a0adb69ba24749817a8855effc20ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78a0adb69ba24749817a8855effc20ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/78a0adb69ba24749817a8855effc20ad"}]}] Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 78a0adb69ba24749817a8855effc20ad Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-TestVolumeBootPattern-1920412406-project Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: ea9cab1c1eff47ddb881a2b57bf240f3 Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-TestVolumeBootPattern-1920412406-project Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance a21b339b-7fc4-47e7-9e25-d24d3aae4535 could not be found. Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'a21b339b-7fc4-47e7-9e25-d24d3aae4535'} Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a21b339b-7fc4-47e7-9e25-d24d3aae4535 could not be found. Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a21b339b-7fc4-47e7-9e25-d24d3aae4535 could not be found. Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:07:25.582785 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:07:25.586493 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:25.586493 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:07:25.586493 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:07:25.586493 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:07:25.586493 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:07:25.586493 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a21b339b-7fc4-47e7-9e25-d24d3aae4535 could not be found. Aug 04 17:07:25.586493 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:07:25.592184 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-13726963-c71f-470b-a9f9-c1c3503468a9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Returning 404 to user: Instance a21b339b-7fc4-47e7-9e25-d24d3aae4535 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:07:25.596998 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-13726963-c71f-470b-a9f9-c1c3503468a9 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535" status: 404 len: 111 microversion: 2.1 time: 0.082480 Aug 04 17:07:25.598206 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2646/5405] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:25 2022] GET /compute/v2.1/servers/a21b339b-7fc4-47e7-9e25-d24d3aae4535 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:07:26.402804 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b703d7f9-d0be-4d63-b666-012a6d3dfd46 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:26.404610 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b703d7f9-d0be-4d63-b666-012a6d3dfd46 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] [instance: f273a7e1-9a1b-443a-8b5f-40cbb05136ba] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:26.419140 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-08e6fdd6-1d5d-4c93-9c93-d82c101c3959 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:26.421578 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-08e6fdd6-1d5d-4c93-9c93-d82c101c3959 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:26.435306 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:26.436460 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:26.443977 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-08e6fdd6-1d5d-4c93-9c93-d82c101c3959 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:26.445043 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b703d7f9-d0be-4d63-b666-012a6d3dfd46 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:26.450924 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b703d7f9-d0be-4d63-b666-012a6d3dfd46 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:26.451959 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-08e6fdd6-1d5d-4c93-9c93-d82c101c3959 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:26.453594 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b703d7f9-d0be-4d63-b666-012a6d3dfd46 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:26.460149 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b703d7f9-d0be-4d63-b666-012a6d3dfd46 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:26.461130 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-08e6fdd6-1d5d-4c93-9c93-d82c101c3959 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:26.462728 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-08e6fdd6-1d5d-4c93-9c93-d82c101c3959 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:26.807016 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=8 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:27.209261 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b703d7f9-d0be-4d63-b666-012a6d3dfd46 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27c708a0dfa40bd85a95aa5f48d3bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2827b551964bf296b13728f77c5f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:27.224329 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b703d7f9-d0be-4d63-b666-012a6d3dfd46 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] 10.222.0.23 "GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba" status: 200 len: 1283 microversion: 2.1 time: 0.825831 Aug 04 17:07:27.230561 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2760/5406] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:26 2022] GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba => generated 1283 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:27.248583 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5f14cc2f-0e37-4d9e-af84-4fe219e10ef5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:27.252027 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5f14cc2f-0e37-4d9e-af84-4fe219e10ef5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:27.274467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5f14cc2f-0e37-4d9e-af84-4fe219e10ef5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:27.275416 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5f14cc2f-0e37-4d9e-af84-4fe219e10ef5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:27.277104 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5f14cc2f-0e37-4d9e-af84-4fe219e10ef5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:27.280168 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5f14cc2f-0e37-4d9e-af84-4fe219e10ef5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:27.317689 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-5f14cc2f-0e37-4d9e-af84-4fe219e10ef5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] HTTP exception thrown: Instance 0337a477-e21a-4d1c-886f-c9caa02906b7 could not be found. Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5f14cc2f-0e37-4d9e-af84-4fe219e10ef5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Request method failure captured: Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 HTTP/1.1 Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_saEEOyGnjC2YSw5rO0XXZ0SIXFPgcyNqjoEnoWtNKNr9NN9-nC4VrXak9kuQQxq1he9punHwiXqtbTRNS_i0OM4UCS6bcDxdgTY6YMq4AHl3lv7jEdWuqMUDAU4k5OfnQSgkMml4THPPXJh4YiohQx-XVMfF21_bM4MqtZQZ4iEBI Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 78a0adb69ba24749817a8855effc20ad Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78a0adb69ba24749817a8855effc20ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_78a0adb69ba24749817a8855effc20ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78a0adb69ba24749817a8855effc20ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/78a0adb69ba24749817a8855effc20ad"}]}] Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 78a0adb69ba24749817a8855effc20ad Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-TestVolumeBootPattern-1920412406-project Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: ea9cab1c1eff47ddb881a2b57bf240f3 Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-TestVolumeBootPattern-1920412406-project Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 0337a477-e21a-4d1c-886f-c9caa02906b7 could not be found. Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '0337a477-e21a-4d1c-886f-c9caa02906b7'} Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0337a477-e21a-4d1c-886f-c9caa02906b7 could not be found. Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:07:27.319587 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:07:27.324788 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0337a477-e21a-4d1c-886f-c9caa02906b7 could not be found. Aug 04 17:07:27.324788 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:07:27.324788 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:07:27.324788 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:07:27.324788 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:27.324788 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:07:27.324788 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:07:27.324788 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:07:27.324788 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:07:27.324788 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0337a477-e21a-4d1c-886f-c9caa02906b7 could not be found. Aug 04 17:07:27.324788 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:07:27.334013 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5f14cc2f-0e37-4d9e-af84-4fe219e10ef5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Returning 404 to user: Instance 0337a477-e21a-4d1c-886f-c9caa02906b7 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:07:27.335076 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5f14cc2f-0e37-4d9e-af84-4fe219e10ef5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 404 len: 111 microversion: 2.1 time: 0.103208 Aug 04 17:07:27.340756 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2761/5407] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:07:27 2022] DELETE /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:07:27.354711 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6bb2c4ef-494c-4778-9ecf-d54714e2b97a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:27.355691 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6bb2c4ef-494c-4778-9ecf-d54714e2b97a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0337a477-e21a-4d1c-886f-c9caa02906b7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:27.363432 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6bb2c4ef-494c-4778-9ecf-d54714e2b97a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:27.366871 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6bb2c4ef-494c-4778-9ecf-d54714e2b97a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:27.367962 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6bb2c4ef-494c-4778-9ecf-d54714e2b97a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:27.374951 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6bb2c4ef-494c-4778-9ecf-d54714e2b97a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:27.399454 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-6bb2c4ef-494c-4778-9ecf-d54714e2b97a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] HTTP exception thrown: Instance 0337a477-e21a-4d1c-886f-c9caa02906b7 could not be found. Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6bb2c4ef-494c-4778-9ecf-d54714e2b97a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Request method failure captured: Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 HTTP/1.1 Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_saEEOyGnjC2YSw5rO0XXZ0SIXFPgcyNqjoEnoWtNKNr9NN9-nC4VrXak9kuQQxq1he9punHwiXqtbTRNS_i0OM4UCS6bcDxdgTY6YMq4AHl3lv7jEdWuqMUDAU4k5OfnQSgkMml4THPPXJh4YiohQx-XVMfF21_bM4MqtZQZ4iEBI Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 78a0adb69ba24749817a8855effc20ad Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78a0adb69ba24749817a8855effc20ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_78a0adb69ba24749817a8855effc20ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78a0adb69ba24749817a8855effc20ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/78a0adb69ba24749817a8855effc20ad"}]}] Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 78a0adb69ba24749817a8855effc20ad Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-TestVolumeBootPattern-1920412406-project Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: ea9cab1c1eff47ddb881a2b57bf240f3 Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-TestVolumeBootPattern-1920412406-project Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 0337a477-e21a-4d1c-886f-c9caa02906b7 could not be found. Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '0337a477-e21a-4d1c-886f-c9caa02906b7'} Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0337a477-e21a-4d1c-886f-c9caa02906b7 could not be found. Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0337a477-e21a-4d1c-886f-c9caa02906b7 could not be found. Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:07:27.406500 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:07:27.412295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:27.412295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:07:27.412295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:07:27.412295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:07:27.412295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:07:27.412295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0337a477-e21a-4d1c-886f-c9caa02906b7 could not be found. Aug 04 17:07:27.412295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:07:27.414283 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6bb2c4ef-494c-4778-9ecf-d54714e2b97a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Returning 404 to user: Instance 0337a477-e21a-4d1c-886f-c9caa02906b7 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:07:27.417759 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6bb2c4ef-494c-4778-9ecf-d54714e2b97a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7" status: 404 len: 111 microversion: 2.1 time: 0.075689 Aug 04 17:07:27.418622 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2762/5408] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:27 2022] GET /compute/v2.1/servers/0337a477-e21a-4d1c-886f-c9caa02906b7 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:07:27.448983 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-6058785a-41bb-42c1-a48d-289ce61aa406 req-7840fd30-5dd6-4698-9d17-a9dedc7256f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f273a7e1-9a1b-443a-8b5f-40cbb05136ba", "tag": "1bfefa9e-5520-4546-b945-a099a6e07a63"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:27.473080 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6058785a-41bb-42c1-a48d-289ce61aa406 req-7840fd30-5dd6-4698-9d17-a9dedc7256f6 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:27.474051 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6058785a-41bb-42c1-a48d-289ce61aa406 req-7840fd30-5dd6-4698-9d17-a9dedc7256f6 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:27.505642 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-6058785a-41bb-42c1-a48d-289ce61aa406 req-7840fd30-5dd6-4698-9d17-a9dedc7256f6 service nova] Creating event network-changed:1bfefa9e-5520-4546-b945-a099a6e07a63 for instance f273a7e1-9a1b-443a-8b5f-40cbb05136ba on n-h1-846466-12 Aug 04 17:07:27.523663 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-6058785a-41bb-42c1-a48d-289ce61aa406 req-7840fd30-5dd6-4698-9d17-a9dedc7256f6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073258 Aug 04 17:07:27.525186 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2763/5409] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:07:27.585536 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3de7d39b-abce-4814-a4d7-26fc3340ed41 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Action: 'create', calling method: .version_select at 0x7f7e7706cd30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1843310632", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOtIephS8UsnCqSVTK7pcwhwcEzxXHHOqqDZ2G1nQ5SSb389WoAKKTce8Y3JcbIXq15v7ZUKLYzGiQporcrCABemITMa8M8hldKTKHxTa4VIHl7J9wJtq5wXhyy56sxjg=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:27.597408 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-08e6fdd6-1d5d-4c93-9c93-d82c101c3959 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:27.613946 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-08e6fdd6-1d5d-4c93-9c93-d82c101c3959 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1725 microversion: 2.1 time: 1.199462 Aug 04 17:07:27.614515 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2647/5410] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:26 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1725 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:27.659774 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-3de7d39b-abce-4814-a4d7-26fc3340ed41 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Getting quotas for project 78a0adb69ba24749817a8855effc20ad. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:07:27.670944 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-3de7d39b-abce-4814-a4d7-26fc3340ed41 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Getting quotas for user ea9cab1c1eff47ddb881a2b57bf240f3 and project 78a0adb69ba24749817a8855effc20ad. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:07:27.769559 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3de7d39b-abce-4814-a4d7-26fc3340ed41 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.186660 Aug 04 17:07:27.770984 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2764/5411] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 17:07:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:28.253098 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-38d92ac7-0276-4b9a-a2eb-4986a4c63c28 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:28.254136 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-38d92ac7-0276-4b9a-a2eb-4986a4c63c28 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] [instance: f273a7e1-9a1b-443a-8b5f-40cbb05136ba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:28.268000 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-38d92ac7-0276-4b9a-a2eb-4986a4c63c28 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:28.269409 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-38d92ac7-0276-4b9a-a2eb-4986a4c63c28 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:28.270450 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-38d92ac7-0276-4b9a-a2eb-4986a4c63c28 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:28.276124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-38d92ac7-0276-4b9a-a2eb-4986a4c63c28 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:28.651326 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ba6110f1-23ad-4c7a-b60a-a5340e09b121 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:28.660163 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ba6110f1-23ad-4c7a-b60a-a5340e09b121 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:28.686783 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba6110f1-23ad-4c7a-b60a-a5340e09b121 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:28.687574 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba6110f1-23ad-4c7a-b60a-a5340e09b121 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:28.699460 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba6110f1-23ad-4c7a-b60a-a5340e09b121 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:28.700511 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba6110f1-23ad-4c7a-b60a-a5340e09b121 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:29.052105 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-38d92ac7-0276-4b9a-a2eb-4986a4c63c28 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27c708a0dfa40bd85a95aa5f48d3bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2827b551964bf296b13728f77c5f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:29.096389 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-38d92ac7-0276-4b9a-a2eb-4986a4c63c28 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] 10.222.0.23 "GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba" status: 200 len: 1283 microversion: 2.1 time: 0.849161 Aug 04 17:07:29.113910 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2648/5412] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:28 2022] GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba => generated 1283 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:29.370318 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ba6110f1-23ad-4c7a-b60a-a5340e09b121 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:29.379684 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ba6110f1-23ad-4c7a-b60a-a5340e09b121 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1725 microversion: 2.1 time: 0.736699 Aug 04 17:07:29.397717 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2765/5413] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:28 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1725 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:30.120769 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-62c04995-6770-4ed4-85f8-7f225abf25ca tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:30.122302 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-62c04995-6770-4ed4-85f8-7f225abf25ca tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] [instance: f273a7e1-9a1b-443a-8b5f-40cbb05136ba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:30.140095 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-62c04995-6770-4ed4-85f8-7f225abf25ca tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:30.140810 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-62c04995-6770-4ed4-85f8-7f225abf25ca tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:30.143064 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-62c04995-6770-4ed4-85f8-7f225abf25ca tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:30.144472 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-62c04995-6770-4ed4-85f8-7f225abf25ca tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:30.409693 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-23719fff-25a4-4d2f-8fd4-05129929f1be tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:30.411125 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-23719fff-25a4-4d2f-8fd4-05129929f1be tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:30.426174 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-23719fff-25a4-4d2f-8fd4-05129929f1be tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:30.426818 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-23719fff-25a4-4d2f-8fd4-05129929f1be tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:30.427779 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-23719fff-25a4-4d2f-8fd4-05129929f1be tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:30.428896 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-23719fff-25a4-4d2f-8fd4-05129929f1be tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:30.590479 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-62c04995-6770-4ed4-85f8-7f225abf25ca tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27c708a0dfa40bd85a95aa5f48d3bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2827b551964bf296b13728f77c5f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:30.603437 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-62c04995-6770-4ed4-85f8-7f225abf25ca tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] 10.222.0.23 "GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba" status: 200 len: 1283 microversion: 2.1 time: 0.487447 Aug 04 17:07:30.607017 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2649/5414] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:30 2022] GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba => generated 1283 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:30.748321 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-23719fff-25a4-4d2f-8fd4-05129929f1be tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:30.764769 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-23719fff-25a4-4d2f-8fd4-05129929f1be tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1725 microversion: 2.1 time: 0.358886 Aug 04 17:07:30.778565 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2766/5415] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:30 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1725 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:31.626330 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-08447393-873d-4516-bf78-4a995850505a tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:31.627673 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-08447393-873d-4516-bf78-4a995850505a tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] [instance: f273a7e1-9a1b-443a-8b5f-40cbb05136ba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:31.639770 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-08447393-873d-4516-bf78-4a995850505a tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:31.654149 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-08447393-873d-4516-bf78-4a995850505a tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:31.655282 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-08447393-873d-4516-bf78-4a995850505a tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:31.655924 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-08447393-873d-4516-bf78-4a995850505a tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:31.788585 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f3e0f60c-d7be-4469-979f-198c0d35ead7 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:31.789217 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f3e0f60c-d7be-4469-979f-198c0d35ead7 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:31.807914 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3e0f60c-d7be-4469-979f-198c0d35ead7 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:31.809226 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3e0f60c-d7be-4469-979f-198c0d35ead7 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:31.810425 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3e0f60c-d7be-4469-979f-198c0d35ead7 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:31.822650 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3e0f60c-d7be-4469-979f-198c0d35ead7 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:32.394143 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-08447393-873d-4516-bf78-4a995850505a tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27c708a0dfa40bd85a95aa5f48d3bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2827b551964bf296b13728f77c5f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:32.411285 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:32.414648 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-08447393-873d-4516-bf78-4a995850505a tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] 10.222.0.23 "GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba" status: 200 len: 1271 microversion: 2.1 time: 0.792111 Aug 04 17:07:32.415541 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2650/5416] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:31 2022] GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba => generated 1271 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:32.435236 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f3e0f60c-d7be-4469-979f-198c0d35ead7 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:32.444445 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f3e0f60c-d7be-4469-979f-198c0d35ead7 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1725 microversion: 2.1 time: 0.660059 Aug 04 17:07:32.445043 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2767/5417] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:31 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1725 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:33.439924 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d9bc65ce-b265-4595-9d38-344584b5e96c tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:33.440694 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d9bc65ce-b265-4595-9d38-344584b5e96c tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] [instance: f273a7e1-9a1b-443a-8b5f-40cbb05136ba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:33.447382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:33.468348 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7d91a5b3-f69a-43fb-9126-cb4c302087f8 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:33.469219 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7d91a5b3-f69a-43fb-9126-cb4c302087f8 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:33.472656 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d9bc65ce-b265-4595-9d38-344584b5e96c tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:33.473427 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d9bc65ce-b265-4595-9d38-344584b5e96c tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:33.474133 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d9bc65ce-b265-4595-9d38-344584b5e96c tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:33.474573 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d9bc65ce-b265-4595-9d38-344584b5e96c tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:33.489765 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d91a5b3-f69a-43fb-9126-cb4c302087f8 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:33.490422 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d91a5b3-f69a-43fb-9126-cb4c302087f8 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:33.491565 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d91a5b3-f69a-43fb-9126-cb4c302087f8 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:33.492219 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d91a5b3-f69a-43fb-9126-cb4c302087f8 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:34.267543 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7d91a5b3-f69a-43fb-9126-cb4c302087f8 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:34.286663 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d9bc65ce-b265-4595-9d38-344584b5e96c tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27c708a0dfa40bd85a95aa5f48d3bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2827b551964bf296b13728f77c5f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:34.287138 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7d91a5b3-f69a-43fb-9126-cb4c302087f8 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1725 microversion: 2.1 time: 0.823000 Aug 04 17:07:34.287905 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2768/5418] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:33 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1725 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:34.323621 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d9bc65ce-b265-4595-9d38-344584b5e96c tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] 10.222.0.23 "GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba" status: 200 len: 1271 microversion: 2.1 time: 0.887900 Aug 04 17:07:34.327815 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2651/5419] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:33 2022] GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba => generated 1271 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:35.310060 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-aafbfd01-7e46-4521-b290-5ed16e4f4842 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:35.310587 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-aafbfd01-7e46-4521-b290-5ed16e4f4842 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:35.327422 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aafbfd01-7e46-4521-b290-5ed16e4f4842 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:35.327757 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aafbfd01-7e46-4521-b290-5ed16e4f4842 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:35.338020 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aafbfd01-7e46-4521-b290-5ed16e4f4842 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:35.340124 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aafbfd01-7e46-4521-b290-5ed16e4f4842 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:35.350361 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d53be025-d41d-46c3-aef2-08890fb93bee tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:35.351656 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d53be025-d41d-46c3-aef2-08890fb93bee tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] [instance: f273a7e1-9a1b-443a-8b5f-40cbb05136ba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:35.372407 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d53be025-d41d-46c3-aef2-08890fb93bee tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:35.373103 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d53be025-d41d-46c3-aef2-08890fb93bee tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:35.374158 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d53be025-d41d-46c3-aef2-08890fb93bee tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:35.374938 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d53be025-d41d-46c3-aef2-08890fb93bee tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:36.133242 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d53be025-d41d-46c3-aef2-08890fb93bee tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27c708a0dfa40bd85a95aa5f48d3bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2827b551964bf296b13728f77c5f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:36.157361 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-aafbfd01-7e46-4521-b290-5ed16e4f4842 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:36.199124 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-aafbfd01-7e46-4521-b290-5ed16e4f4842 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1725 microversion: 2.1 time: 0.893929 Aug 04 17:07:36.206109 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d53be025-d41d-46c3-aef2-08890fb93bee tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] 10.222.0.23 "GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba" status: 200 len: 1271 microversion: 2.1 time: 0.856324 Aug 04 17:07:36.206958 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2769/5420] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:35 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1725 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:36.211250 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2652/5421] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:35 2022] GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba => generated 1271 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:37.243942 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-370cca48-6324-4f7e-9248-1f66457fb159 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:37.245515 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-370cca48-6324-4f7e-9248-1f66457fb159 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] [instance: f273a7e1-9a1b-443a-8b5f-40cbb05136ba] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:37.245823 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9f5e89b2-8707-4f9b-81ff-426e8d7e5c8f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:37.247223 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9f5e89b2-8707-4f9b-81ff-426e8d7e5c8f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:37.287331 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-370cca48-6324-4f7e-9248-1f66457fb159 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:37.289166 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f5e89b2-8707-4f9b-81ff-426e8d7e5c8f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:37.290569 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-370cca48-6324-4f7e-9248-1f66457fb159 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:37.294283 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f5e89b2-8707-4f9b-81ff-426e8d7e5c8f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:37.298968 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f5e89b2-8707-4f9b-81ff-426e8d7e5c8f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:37.299424 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-370cca48-6324-4f7e-9248-1f66457fb159 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:37.300053 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-370cca48-6324-4f7e-9248-1f66457fb159 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:37.301175 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9f5e89b2-8707-4f9b-81ff-426e8d7e5c8f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:37.330523 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:37.708821 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:37.855391 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9f5e89b2-8707-4f9b-81ff-426e8d7e5c8f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:37.866353 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9f5e89b2-8707-4f9b-81ff-426e8d7e5c8f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1725 microversion: 2.1 time: 0.638581 Aug 04 17:07:37.870082 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2653/5422] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:37 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1725 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:37.886258 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-370cca48-6324-4f7e-9248-1f66457fb159 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27c708a0dfa40bd85a95aa5f48d3bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2827b551964bf296b13728f77c5f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:37.910271 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-370cca48-6324-4f7e-9248-1f66457fb159 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] 10.222.0.23 "GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba" status: 200 len: 1271 microversion: 2.1 time: 0.679677 Aug 04 17:07:37.918411 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2770/5423] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:37 2022] GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba => generated 1271 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:38.902632 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6e6ba6e9-b9d1-495c-a3c7-14198df0d4d9 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:38.905893 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6e6ba6e9-b9d1-495c-a3c7-14198df0d4d9 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:38.938926 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e6ba6e9-b9d1-495c-a3c7-14198df0d4d9 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:38.943234 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e6ba6e9-b9d1-495c-a3c7-14198df0d4d9 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:38.944386 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e0e85df3-ecd0-4045-a774-79b2e22c026a tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:38.946369 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e0e85df3-ecd0-4045-a774-79b2e22c026a tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] [instance: f273a7e1-9a1b-443a-8b5f-40cbb05136ba] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:38.946798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e6ba6e9-b9d1-495c-a3c7-14198df0d4d9 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:38.947580 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e6ba6e9-b9d1-495c-a3c7-14198df0d4d9 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:38.975136 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e0e85df3-ecd0-4045-a774-79b2e22c026a tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:38.978264 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e0e85df3-ecd0-4045-a774-79b2e22c026a tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:38.979772 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e0e85df3-ecd0-4045-a774-79b2e22c026a tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:38.982543 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e0e85df3-ecd0-4045-a774-79b2e22c026a tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:39.410553 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6e6ba6e9-b9d1-495c-a3c7-14198df0d4d9 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:39.434576 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6e6ba6e9-b9d1-495c-a3c7-14198df0d4d9 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1702 microversion: 2.1 time: 0.537385 Aug 04 17:07:39.446042 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2654/5424] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:38 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1702 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:39.468587 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a9da5796-806a-4546-9343-ec777fa8c492 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:39.486568 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a9da5796-806a-4546-9343-ec777fa8c492 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:39.487437 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a9da5796-806a-4546-9343-ec777fa8c492 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:39.525576 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e0e85df3-ecd0-4045-a774-79b2e22c026a tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27c708a0dfa40bd85a95aa5f48d3bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2827b551964bf296b13728f77c5f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:39.534877 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e0e85df3-ecd0-4045-a774-79b2e22c026a tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] 10.222.0.23 "GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba" status: 200 len: 1271 microversion: 2.1 time: 0.599647 Aug 04 17:07:39.544848 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2771/5425] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:38 2022] GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba => generated 1271 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:39.612135 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a9da5796-806a-4546-9343-ec777fa8c492 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Going to try to start instance {{(pid=126126) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 17:07:39.778156 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a9da5796-806a-4546-9343-ec777fa8c492 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "POST /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296/action" status: 202 len: 0 microversion: 2.1 time: 0.312189 Aug 04 17:07:39.786102 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2655/5426] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:07:39 2022] POST /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:07:39.791976 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-28f3fc35-150c-457c-b581-2407c2c8e9bb tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:39.792986 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-28f3fc35-150c-457c-b581-2407c2c8e9bb tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:39.827933 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-28f3fc35-150c-457c-b581-2407c2c8e9bb tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:39.831273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-28f3fc35-150c-457c-b581-2407c2c8e9bb tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:39.836380 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-28f3fc35-150c-457c-b581-2407c2c8e9bb tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:39.841458 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-28f3fc35-150c-457c-b581-2407c2c8e9bb tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:40.596388 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1acdd00c-e08d-4dad-81ef-9acd3af1ce8c tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:40.598659 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1acdd00c-e08d-4dad-81ef-9acd3af1ce8c tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] [instance: f273a7e1-9a1b-443a-8b5f-40cbb05136ba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:40.620505 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1acdd00c-e08d-4dad-81ef-9acd3af1ce8c tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:40.629254 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1acdd00c-e08d-4dad-81ef-9acd3af1ce8c tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:40.632141 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1acdd00c-e08d-4dad-81ef-9acd3af1ce8c tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:40.632867 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1acdd00c-e08d-4dad-81ef-9acd3af1ce8c tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:40.686304 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-28f3fc35-150c-457c-b581-2407c2c8e9bb tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:40.706329 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-28f3fc35-150c-457c-b581-2407c2c8e9bb tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1711 microversion: 2.1 time: 0.920637 Aug 04 17:07:40.719712 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2772/5427] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:39 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1711 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:41.512602 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1acdd00c-e08d-4dad-81ef-9acd3af1ce8c tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27c708a0dfa40bd85a95aa5f48d3bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2827b551964bf296b13728f77c5f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:41.528703 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1acdd00c-e08d-4dad-81ef-9acd3af1ce8c tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] 10.222.0.23 "GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba" status: 200 len: 1271 microversion: 2.1 time: 0.944414 Aug 04 17:07:41.539546 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2656/5428] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:40 2022] GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba => generated 1271 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:41.745624 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6bcf5d3b-68c3-4145-b1f5-9c3fa6ae410f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:41.746552 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6bcf5d3b-68c3-4145-b1f5-9c3fa6ae410f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:41.788199 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6bcf5d3b-68c3-4145-b1f5-9c3fa6ae410f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:41.792700 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6bcf5d3b-68c3-4145-b1f5-9c3fa6ae410f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:41.801437 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6bcf5d3b-68c3-4145-b1f5-9c3fa6ae410f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:41.801437 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6bcf5d3b-68c3-4145-b1f5-9c3fa6ae410f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:42.319411 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6bcf5d3b-68c3-4145-b1f5-9c3fa6ae410f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:42.333096 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6bcf5d3b-68c3-4145-b1f5-9c3fa6ae410f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1711 microversion: 2.1 time: 0.594250 Aug 04 17:07:42.334399 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2773/5429] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:41 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1711 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:42.559063 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ce2d189e-0708-4b09-90dc-3a02808a3ee1 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:42.560377 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ce2d189e-0708-4b09-90dc-3a02808a3ee1 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] [instance: f273a7e1-9a1b-443a-8b5f-40cbb05136ba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:42.574150 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ce2d189e-0708-4b09-90dc-3a02808a3ee1 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:42.576314 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ce2d189e-0708-4b09-90dc-3a02808a3ee1 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:42.578569 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ce2d189e-0708-4b09-90dc-3a02808a3ee1 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:42.580877 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ce2d189e-0708-4b09-90dc-3a02808a3ee1 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:43.356789 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-97a3f80f-f1ad-460a-8d88-2a6b3021731b tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:43.358271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-97a3f80f-f1ad-460a-8d88-2a6b3021731b tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:43.367156 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-97a3f80f-f1ad-460a-8d88-2a6b3021731b tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:43.367988 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-97a3f80f-f1ad-460a-8d88-2a6b3021731b tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:43.369759 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-97a3f80f-f1ad-460a-8d88-2a6b3021731b tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:43.370495 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-97a3f80f-f1ad-460a-8d88-2a6b3021731b tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:43.588959 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ce2d189e-0708-4b09-90dc-3a02808a3ee1 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27c708a0dfa40bd85a95aa5f48d3bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2827b551964bf296b13728f77c5f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:43.598175 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ce2d189e-0708-4b09-90dc-3a02808a3ee1 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] 10.222.0.23 "GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba" status: 200 len: 1271 microversion: 2.1 time: 1.045115 Aug 04 17:07:43.602185 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2657/5430] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:42 2022] GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba => generated 1271 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:43.812900 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-894a75b8-7f91-43f8-9e7c-66c5505b8640 req-c1238c96-fec7-4443-8e40-f6a1f156deea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f273a7e1-9a1b-443a-8b5f-40cbb05136ba", "name": "network-vif-plugged", "status": "completed", "tag": "1bfefa9e-5520-4546-b945-a099a6e07a63"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:43.835078 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-894a75b8-7f91-43f8-9e7c-66c5505b8640 req-c1238c96-fec7-4443-8e40-f6a1f156deea service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:43.835896 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-894a75b8-7f91-43f8-9e7c-66c5505b8640 req-c1238c96-fec7-4443-8e40-f6a1f156deea service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:43.860393 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-894a75b8-7f91-43f8-9e7c-66c5505b8640 req-c1238c96-fec7-4443-8e40-f6a1f156deea service nova] Creating event network-vif-plugged:1bfefa9e-5520-4546-b945-a099a6e07a63 for instance f273a7e1-9a1b-443a-8b5f-40cbb05136ba on n-h1-846466-12 Aug 04 17:07:43.875405 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-894a75b8-7f91-43f8-9e7c-66c5505b8640 req-c1238c96-fec7-4443-8e40-f6a1f156deea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066809 Aug 04 17:07:43.878014 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2658/5431] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:07:44.127141 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-97a3f80f-f1ad-460a-8d88-2a6b3021731b tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:44.152040 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-97a3f80f-f1ad-460a-8d88-2a6b3021731b tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1715 microversion: 2.1 time: 0.796552 Aug 04 17:07:44.153045 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2774/5432] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:43 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1715 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:44.625747 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e998378d-589d-4437-a447-4a356ac0fc99 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:44.626480 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e998378d-589d-4437-a447-4a356ac0fc99 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] [instance: f273a7e1-9a1b-443a-8b5f-40cbb05136ba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:44.646035 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e998378d-589d-4437-a447-4a356ac0fc99 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:44.646503 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e998378d-589d-4437-a447-4a356ac0fc99 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:44.647351 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e998378d-589d-4437-a447-4a356ac0fc99 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:44.647998 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e998378d-589d-4437-a447-4a356ac0fc99 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:45.110317 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e998378d-589d-4437-a447-4a356ac0fc99 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27c708a0dfa40bd85a95aa5f48d3bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2827b551964bf296b13728f77c5f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:45.118472 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e998378d-589d-4437-a447-4a356ac0fc99 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] 10.222.0.23 "GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba" status: 200 len: 1271 microversion: 2.1 time: 0.497954 Aug 04 17:07:45.122913 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2659/5433] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:44 2022] GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba => generated 1271 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:46.156110 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-efd1dc75-2270-48ed-91e3-ab6860bfd524 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:46.158283 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-efd1dc75-2270-48ed-91e3-ab6860bfd524 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] [instance: f273a7e1-9a1b-443a-8b5f-40cbb05136ba] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:46.182892 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-efd1dc75-2270-48ed-91e3-ab6860bfd524 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:46.183357 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-efd1dc75-2270-48ed-91e3-ab6860bfd524 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:46.184194 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-efd1dc75-2270-48ed-91e3-ab6860bfd524 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:46.184646 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-efd1dc75-2270-48ed-91e3-ab6860bfd524 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:46.567039 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-efd1dc75-2270-48ed-91e3-ab6860bfd524 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27c708a0dfa40bd85a95aa5f48d3bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2827b551964bf296b13728f77c5f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:46.579286 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-efd1dc75-2270-48ed-91e3-ab6860bfd524 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] 10.222.0.23 "GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba" status: 200 len: 1460 microversion: 2.1 time: 0.440560 Aug 04 17:07:46.581175 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2775/5434] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:46 2022] GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba => generated 1460 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:46.610822 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3cb308f0-c649-495f-8fda-567f590dd4ef tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:46.612258 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3cb308f0-c649-495f-8fda-567f590dd4ef tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] [instance: f273a7e1-9a1b-443a-8b5f-40cbb05136ba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:46.624812 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3cb308f0-c649-495f-8fda-567f590dd4ef tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:46.625267 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3cb308f0-c649-495f-8fda-567f590dd4ef tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:46.626112 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3cb308f0-c649-495f-8fda-567f590dd4ef tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:46.626552 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3cb308f0-c649-495f-8fda-567f590dd4ef tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:47.052603 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3cb308f0-c649-495f-8fda-567f590dd4ef tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27c708a0dfa40bd85a95aa5f48d3bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2827b551964bf296b13728f77c5f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:47.064967 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3cb308f0-c649-495f-8fda-567f590dd4ef tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] 10.222.0.23 "GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba" status: 200 len: 1460 microversion: 2.1 time: 0.458480 Aug 04 17:07:47.065484 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2660/5435] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:46 2022] GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba => generated 1460 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:52.972449 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-0539a631-94cd-4f4a-8169-7af81cd53b57 req-64c587a0-0ca9-4bf7-a529-2a305d321944 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f273a7e1-9a1b-443a-8b5f-40cbb05136ba", "tag": "1bfefa9e-5520-4546-b945-a099a6e07a63"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:52.996177 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-0539a631-94cd-4f4a-8169-7af81cd53b57 req-64c587a0-0ca9-4bf7-a529-2a305d321944 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:52.996712 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-0539a631-94cd-4f4a-8169-7af81cd53b57 req-64c587a0-0ca9-4bf7-a529-2a305d321944 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:53.021090 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-0539a631-94cd-4f4a-8169-7af81cd53b57 req-64c587a0-0ca9-4bf7-a529-2a305d321944 service nova] Creating event network-changed:1bfefa9e-5520-4546-b945-a099a6e07a63 for instance f273a7e1-9a1b-443a-8b5f-40cbb05136ba on n-h1-846466-12 Aug 04 17:07:53.031438 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-0539a631-94cd-4f4a-8169-7af81cd53b57 req-64c587a0-0ca9-4bf7-a529-2a305d321944 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064657 Aug 04 17:07:53.034702 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2776/5436] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:07:56.625173 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=19 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:56.685346 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-6cf84e0d-03e8-49df-a949-56022d8d4d5a req-e4f3eb3e-dde5-4f85-8dba-eeea888c47cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f273a7e1-9a1b-443a-8b5f-40cbb05136ba", "tag": "1bfefa9e-5520-4546-b945-a099a6e07a63"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:56.704046 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-6cf84e0d-03e8-49df-a949-56022d8d4d5a req-e4f3eb3e-dde5-4f85-8dba-eeea888c47cb service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:56.709928 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-6cf84e0d-03e8-49df-a949-56022d8d4d5a req-e4f3eb3e-dde5-4f85-8dba-eeea888c47cb service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:56.740795 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-6cf84e0d-03e8-49df-a949-56022d8d4d5a req-e4f3eb3e-dde5-4f85-8dba-eeea888c47cb service nova] Creating event network-changed:1bfefa9e-5520-4546-b945-a099a6e07a63 for instance f273a7e1-9a1b-443a-8b5f-40cbb05136ba on n-h1-846466-12 Aug 04 17:07:56.758186 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-6cf84e0d-03e8-49df-a949-56022d8d4d5a req-e4f3eb3e-dde5-4f85-8dba-eeea888c47cb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.555745 Aug 04 17:07:56.760025 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2661/5437] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:58.843007 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-970dfe1d-1a10-4a51-95d6-297ce9b240ae req-0731e8fb-9326-4d87-ae1e-813666a9e441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f273a7e1-9a1b-443a-8b5f-40cbb05136ba", "tag": "1bfefa9e-5520-4546-b945-a099a6e07a63"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:58.854215 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:58.866755 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-970dfe1d-1a10-4a51-95d6-297ce9b240ae req-0731e8fb-9326-4d87-ae1e-813666a9e441 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:07:58.867305 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-970dfe1d-1a10-4a51-95d6-297ce9b240ae req-0731e8fb-9326-4d87-ae1e-813666a9e441 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:07:58.888860 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-970dfe1d-1a10-4a51-95d6-297ce9b240ae req-0731e8fb-9326-4d87-ae1e-813666a9e441 service nova] Creating event network-changed:1bfefa9e-5520-4546-b945-a099a6e07a63 for instance f273a7e1-9a1b-443a-8b5f-40cbb05136ba on n-h1-846466-12 Aug 04 17:07:58.905034 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-970dfe1d-1a10-4a51-95d6-297ce9b240ae req-0731e8fb-9326-4d87-ae1e-813666a9e441 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066759 Aug 04 17:07:58.905909 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2777/5438] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:11.713405 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:11.714814 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:11.723539 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3a47d823-5a1c-4fb5-a465-4e2f58fbf23f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2026949879", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1843310632", "security_groups": [{"name": "tempest-secgroup-smoke-1275595346"}], "block_device_mapping_v2": [{"uuid": "e00165ec-8fe4-4173-a576-8d54d74cf173", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8cd64b36-f8a8-48d4-b083-6164d20009da"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:12.053539 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-3a47d823-5a1c-4fb5-a465-4e2f58fbf23f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] validate_networks() for [('8cd64b36-f8a8-48d4-b083-6164d20009da', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:08:13.142404 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-3a47d823-5a1c-4fb5-a465-4e2f58fbf23f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:08:13.143061 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-3a47d823-5a1c-4fb5-a465-4e2f58fbf23f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:08:13.143597 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-3a47d823-5a1c-4fb5-a465-4e2f58fbf23f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:08:13.144029 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-3a47d823-5a1c-4fb5-a465-4e2f58fbf23f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:08:13.144610 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-3a47d823-5a1c-4fb5-a465-4e2f58fbf23f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:08:13.162868 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a47d823-5a1c-4fb5-a465-4e2f58fbf23f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:13.166744 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a47d823-5a1c-4fb5-a465-4e2f58fbf23f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:13.170379 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a47d823-5a1c-4fb5-a465-4e2f58fbf23f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:13.172649 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a47d823-5a1c-4fb5-a465-4e2f58fbf23f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:13.226631 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-3a47d823-5a1c-4fb5-a465-4e2f58fbf23f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Getting quotas for project 78a0adb69ba24749817a8855effc20ad. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:08:13.241070 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-3a47d823-5a1c-4fb5-a465-4e2f58fbf23f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Getting quotas for user ea9cab1c1eff47ddb881a2b57bf240f3 and project 78a0adb69ba24749817a8855effc20ad. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:08:13.359765 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3a47d823-5a1c-4fb5-a465-4e2f58fbf23f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:08:13.363023 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3a47d823-5a1c-4fb5-a465-4e2f58fbf23f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e00165ec-8fe4-4173-a576-8d54d74cf173',volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:08:13.702702 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3a47d823-5a1c-4fb5-a465-4e2f58fbf23f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.989990 Aug 04 17:08:13.714382 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2662/5439] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:08:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 2005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:08:13.720521 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3c82ec6b-1d0a-4f72-a2c1-d35c1e3f75d0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:13.722789 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3c82ec6b-1d0a-4f72-a2c1-d35c1e3f75d0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:13.732299 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:13.733893 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=39 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:13.940660 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3c82ec6b-1d0a-4f72-a2c1-d35c1e3f75d0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:13.950544 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3c82ec6b-1d0a-4f72-a2c1-d35c1e3f75d0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a" status: 200 len: 1095 microversion: 2.1 time: 0.235504 Aug 04 17:08:13.953472 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2778/5440] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:13 2022] GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a => generated 1095 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:14.974344 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ace1d539-3909-47cd-8dde-c67f11e3e30a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:14.978678 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ace1d539-3909-47cd-8dde-c67f11e3e30a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:15.019163 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ace1d539-3909-47cd-8dde-c67f11e3e30a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:15.019660 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ace1d539-3909-47cd-8dde-c67f11e3e30a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:15.020856 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ace1d539-3909-47cd-8dde-c67f11e3e30a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:15.022084 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ace1d539-3909-47cd-8dde-c67f11e3e30a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:15.222411 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ace1d539-3909-47cd-8dde-c67f11e3e30a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:15.230764 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ace1d539-3909-47cd-8dde-c67f11e3e30a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a" status: 200 len: 1145 microversion: 2.1 time: 0.262960 Aug 04 17:08:15.231380 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2663/5441] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:14 2022] GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a => generated 1145 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:16.259571 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f7fe5b58-838e-4e89-9ac4-f8bf29664c65 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:16.260924 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f7fe5b58-838e-4e89-9ac4-f8bf29664c65 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:16.293404 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f7fe5b58-838e-4e89-9ac4-f8bf29664c65 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:16.293880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f7fe5b58-838e-4e89-9ac4-f8bf29664c65 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:16.294710 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f7fe5b58-838e-4e89-9ac4-f8bf29664c65 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:16.295147 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f7fe5b58-838e-4e89-9ac4-f8bf29664c65 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:16.541034 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f7fe5b58-838e-4e89-9ac4-f8bf29664c65 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:16.554154 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f7fe5b58-838e-4e89-9ac4-f8bf29664c65 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a" status: 200 len: 1211 microversion: 2.1 time: 0.301017 Aug 04 17:08:16.572973 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2779/5442] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:16 2022] GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a => generated 1211 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:16.649608 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9179a8c3-add7-4cbc-8839-737a78dce915 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:16.651155 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9179a8c3-add7-4cbc-8839-737a78dce915 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:16.681947 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9179a8c3-add7-4cbc-8839-737a78dce915 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:16.685518 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9179a8c3-add7-4cbc-8839-737a78dce915 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:16.693455 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9179a8c3-add7-4cbc-8839-737a78dce915 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:16.697033 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9179a8c3-add7-4cbc-8839-737a78dce915 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:17.094490 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-9179a8c3-add7-4cbc-8839-737a78dce915 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lazy-loading 'services' on Instance uuid ffb04e5e-6da9-40bd-87f2-1d914893b296 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:08:17.242296 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9179a8c3-add7-4cbc-8839-737a78dce915 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296/os-volume_attachments/b5089a64-c9dd-4747-85a9-f8546d257f4b" status: 202 len: 0 microversion: 2.1 time: 0.600869 Aug 04 17:08:17.245669 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2664/5443] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Aug 4 17:08:16 2022] DELETE /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296/os-volume_attachments/b5089a64-c9dd-4747-85a9-f8546d257f4b => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:08:17.580400 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-aaa5870c-0b43-44be-8a01-952a7954da1c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:17.580943 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-aaa5870c-0b43-44be-8a01-952a7954da1c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:17.596883 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aaa5870c-0b43-44be-8a01-952a7954da1c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:17.597354 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aaa5870c-0b43-44be-8a01-952a7954da1c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:17.598256 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aaa5870c-0b43-44be-8a01-952a7954da1c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:17.598693 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aaa5870c-0b43-44be-8a01-952a7954da1c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:18.126641 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-aaa5870c-0b43-44be-8a01-952a7954da1c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:18.138521 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-aaa5870c-0b43-44be-8a01-952a7954da1c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a" status: 200 len: 1211 microversion: 2.1 time: 0.562092 Aug 04 17:08:18.163795 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2780/5444] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:17 2022] GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a => generated 1211 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:19.162016 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-814d5776-dddb-4db9-b131-67f4c46e634c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:19.162994 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-814d5776-dddb-4db9-b131-67f4c46e634c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:19.176465 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-814d5776-dddb-4db9-b131-67f4c46e634c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:19.181182 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-814d5776-dddb-4db9-b131-67f4c46e634c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:19.182399 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-814d5776-dddb-4db9-b131-67f4c46e634c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:19.182975 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-814d5776-dddb-4db9-b131-67f4c46e634c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:19.666708 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-814d5776-dddb-4db9-b131-67f4c46e634c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:19.684344 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-814d5776-dddb-4db9-b131-67f4c46e634c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a" status: 200 len: 1279 microversion: 2.1 time: 0.525392 Aug 04 17:08:19.690345 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2665/5445] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:19 2022] GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a => generated 1279 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:20.715420 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0c8dd3e2-dbc4-4099-9783-ceb4f927efe5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:20.716923 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0c8dd3e2-dbc4-4099-9783-ceb4f927efe5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:20.750968 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0c8dd3e2-dbc4-4099-9783-ceb4f927efe5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:20.752212 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0c8dd3e2-dbc4-4099-9783-ceb4f927efe5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:20.755030 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0c8dd3e2-dbc4-4099-9783-ceb4f927efe5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:20.756974 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0c8dd3e2-dbc4-4099-9783-ceb4f927efe5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:21.196583 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0c8dd3e2-dbc4-4099-9783-ceb4f927efe5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:21.214745 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0c8dd3e2-dbc4-4099-9783-ceb4f927efe5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a" status: 200 len: 1279 microversion: 2.1 time: 0.505861 Aug 04 17:08:21.216669 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2781/5446] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:20 2022] GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a => generated 1279 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:08:21.718479 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-ef7f1017-0829-4e9d-8465-ef4ce9986f69 req-3399a4c8-9cf0-4020-bb06-6bd71f6045aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc8307a2-4a12-4301-a04f-6ed3bccb7d1a", "tag": "9ea99fa2-f541-4856-a304-28a402350443"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:21.730176 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-ef7f1017-0829-4e9d-8465-ef4ce9986f69 req-3399a4c8-9cf0-4020-bb06-6bd71f6045aa service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:21.730929 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-ef7f1017-0829-4e9d-8465-ef4ce9986f69 req-3399a4c8-9cf0-4020-bb06-6bd71f6045aa service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:21.743584 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-ef7f1017-0829-4e9d-8465-ef4ce9986f69 req-3399a4c8-9cf0-4020-bb06-6bd71f6045aa service nova] Creating event network-changed:9ea99fa2-f541-4856-a304-28a402350443 for instance dc8307a2-4a12-4301-a04f-6ed3bccb7d1a on n-h2-846466-12 Aug 04 17:08:21.749096 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-ef7f1017-0829-4e9d-8465-ef4ce9986f69 req-3399a4c8-9cf0-4020-bb06-6bd71f6045aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.238624 Aug 04 17:08:21.750678 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2666/5447] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:22.242304 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5a521985-2a91-44e7-a963-b60e3d664543 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:22.242840 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5a521985-2a91-44e7-a963-b60e3d664543 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:22.258644 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5a521985-2a91-44e7-a963-b60e3d664543 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:22.259172 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5a521985-2a91-44e7-a963-b60e3d664543 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:22.262975 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5a521985-2a91-44e7-a963-b60e3d664543 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:22.269114 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5a521985-2a91-44e7-a963-b60e3d664543 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:22.625802 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5a521985-2a91-44e7-a963-b60e3d664543 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:22.639442 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5a521985-2a91-44e7-a963-b60e3d664543 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a" status: 200 len: 1279 microversion: 2.1 time: 0.402045 Aug 04 17:08:22.641472 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2782/5448] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:22 2022] GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a => generated 1279 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:23.662567 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:23.665409 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:23.671756 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d07ea8c6-29de-4ae9-b04d-0d80cc220c2b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:23.672751 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d07ea8c6-29de-4ae9-b04d-0d80cc220c2b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:23.683368 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d07ea8c6-29de-4ae9-b04d-0d80cc220c2b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:23.684076 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d07ea8c6-29de-4ae9-b04d-0d80cc220c2b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:23.685090 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d07ea8c6-29de-4ae9-b04d-0d80cc220c2b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:23.685804 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d07ea8c6-29de-4ae9-b04d-0d80cc220c2b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:23.991655 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d07ea8c6-29de-4ae9-b04d-0d80cc220c2b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:24.009706 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d07ea8c6-29de-4ae9-b04d-0d80cc220c2b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a" status: 200 len: 1279 microversion: 2.1 time: 0.346193 Aug 04 17:08:24.013188 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2667/5449] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:23 2022] GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a => generated 1279 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:24.503389 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2d4b389a-5a04-4265-a879-155578ef5797 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:24.508546 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:24.522827 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d4b389a-5a04-4265-a879-155578ef5797 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:24.523683 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d4b389a-5a04-4265-a879-155578ef5797 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:24.563671 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2d4b389a-5a04-4265-a879-155578ef5797 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Going to try to stop instance {{(pid=126125) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 17:08:24.628996 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2d4b389a-5a04-4265-a879-155578ef5797 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "POST /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296/action" status: 202 len: 0 microversion: 2.1 time: 0.127907 Aug 04 17:08:24.633509 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2783/5450] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:08:24 2022] POST /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:08:24.643073 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9542ada3-aa4a-4e4f-ae83-322fe7b41456 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:24.643073 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9542ada3-aa4a-4e4f-ae83-322fe7b41456 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:24.667600 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9542ada3-aa4a-4e4f-ae83-322fe7b41456 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:24.668434 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9542ada3-aa4a-4e4f-ae83-322fe7b41456 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:24.668930 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9542ada3-aa4a-4e4f-ae83-322fe7b41456 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:24.669392 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9542ada3-aa4a-4e4f-ae83-322fe7b41456 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:24.951350 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9542ada3-aa4a-4e4f-ae83-322fe7b41456 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:24.966880 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9542ada3-aa4a-4e4f-ae83-322fe7b41456 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1679 microversion: 2.1 time: 0.331049 Aug 04 17:08:24.968590 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2668/5451] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:24 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1679 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:25.036448 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-95bbc154-2f62-414c-bf0e-ff43aa774fa1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:25.037331 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-95bbc154-2f62-414c-bf0e-ff43aa774fa1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:25.045808 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-95bbc154-2f62-414c-bf0e-ff43aa774fa1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:25.046498 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-95bbc154-2f62-414c-bf0e-ff43aa774fa1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:25.048958 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-95bbc154-2f62-414c-bf0e-ff43aa774fa1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:25.049437 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-95bbc154-2f62-414c-bf0e-ff43aa774fa1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:25.259109 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-95bbc154-2f62-414c-bf0e-ff43aa774fa1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:25.271114 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-95bbc154-2f62-414c-bf0e-ff43aa774fa1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a" status: 200 len: 1279 microversion: 2.1 time: 0.241728 Aug 04 17:08:25.272030 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2784/5452] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:25 2022] GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a => generated 1279 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:25.992732 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5e833d4c-3c8b-45fc-b6f8-397e2e86abfe tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:25.993732 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5e833d4c-3c8b-45fc-b6f8-397e2e86abfe tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:26.010534 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e833d4c-3c8b-45fc-b6f8-397e2e86abfe tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:26.011004 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e833d4c-3c8b-45fc-b6f8-397e2e86abfe tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:26.013030 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e833d4c-3c8b-45fc-b6f8-397e2e86abfe tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:26.015683 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e833d4c-3c8b-45fc-b6f8-397e2e86abfe tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:26.296620 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2728a843-abcd-429e-93f7-3217751471fa tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:26.298105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2728a843-abcd-429e-93f7-3217751471fa tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:26.308979 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2728a843-abcd-429e-93f7-3217751471fa tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:26.309518 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2728a843-abcd-429e-93f7-3217751471fa tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:26.315065 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2728a843-abcd-429e-93f7-3217751471fa tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:26.315557 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2728a843-abcd-429e-93f7-3217751471fa tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:26.759590 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5e833d4c-3c8b-45fc-b6f8-397e2e86abfe tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:26.783986 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5e833d4c-3c8b-45fc-b6f8-397e2e86abfe tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1679 microversion: 2.1 time: 0.793597 Aug 04 17:08:26.785106 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2669/5453] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:25 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1679 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:26.930578 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2728a843-abcd-429e-93f7-3217751471fa tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:26.950102 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2728a843-abcd-429e-93f7-3217751471fa tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a" status: 200 len: 1279 microversion: 2.1 time: 0.655900 Aug 04 17:08:26.951093 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2785/5454] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:26 2022] GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a => generated 1279 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:27.809532 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-da1dc658-76e6-45ab-9a5b-bd905e08e9c4 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:27.810366 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-da1dc658-76e6-45ab-9a5b-bd905e08e9c4 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:27.828851 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-da1dc658-76e6-45ab-9a5b-bd905e08e9c4 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:27.829326 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-da1dc658-76e6-45ab-9a5b-bd905e08e9c4 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:27.842726 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-da1dc658-76e6-45ab-9a5b-bd905e08e9c4 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:27.843472 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-da1dc658-76e6-45ab-9a5b-bd905e08e9c4 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:27.975434 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a0f1da7c-b4d2-498a-826b-ac0b4887d439 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:27.976004 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a0f1da7c-b4d2-498a-826b-ac0b4887d439 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:27.995310 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a0f1da7c-b4d2-498a-826b-ac0b4887d439 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:27.995619 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a0f1da7c-b4d2-498a-826b-ac0b4887d439 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:27.998745 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a0f1da7c-b4d2-498a-826b-ac0b4887d439 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:28.000489 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a0f1da7c-b4d2-498a-826b-ac0b4887d439 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:28.391794 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-da1dc658-76e6-45ab-9a5b-bd905e08e9c4 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:28.411029 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-da1dc658-76e6-45ab-9a5b-bd905e08e9c4 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1679 microversion: 2.1 time: 0.605407 Aug 04 17:08:28.412998 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2670/5455] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:27 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1679 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:08:28.604892 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a0f1da7c-b4d2-498a-826b-ac0b4887d439 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:28.622710 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a0f1da7c-b4d2-498a-826b-ac0b4887d439 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a" status: 200 len: 1279 microversion: 2.1 time: 0.651633 Aug 04 17:08:28.624239 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2786/5456] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:27 2022] GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a => generated 1279 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:29.434914 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e6abddbf-bd75-4bb2-bb64-aff2dcf61e0a tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:29.436230 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e6abddbf-bd75-4bb2-bb64-aff2dcf61e0a tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:29.452051 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e6abddbf-bd75-4bb2-bb64-aff2dcf61e0a tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:29.453015 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e6abddbf-bd75-4bb2-bb64-aff2dcf61e0a tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:29.454996 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e6abddbf-bd75-4bb2-bb64-aff2dcf61e0a tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:29.455604 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e6abddbf-bd75-4bb2-bb64-aff2dcf61e0a tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:29.666881 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5c969932-816b-4501-8fb3-8f743e44e291 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:29.668120 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5c969932-816b-4501-8fb3-8f743e44e291 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:29.676393 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5c969932-816b-4501-8fb3-8f743e44e291 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:29.677072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5c969932-816b-4501-8fb3-8f743e44e291 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:29.678254 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5c969932-816b-4501-8fb3-8f743e44e291 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:29.678855 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5c969932-816b-4501-8fb3-8f743e44e291 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:30.078541 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e6abddbf-bd75-4bb2-bb64-aff2dcf61e0a tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:30.099829 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e6abddbf-bd75-4bb2-bb64-aff2dcf61e0a tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1679 microversion: 2.1 time: 0.667578 Aug 04 17:08:30.103282 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2671/5457] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:29 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1679 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:30.122628 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-87a9a83f-bf77-4436-9545-3278c6e9a1f2 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:30.124522 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-87a9a83f-bf77-4436-9545-3278c6e9a1f2 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] [instance: f273a7e1-9a1b-443a-8b5f-40cbb05136ba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:30.155112 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-87a9a83f-bf77-4436-9545-3278c6e9a1f2 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:30.156465 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-87a9a83f-bf77-4436-9545-3278c6e9a1f2 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:30.158863 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-87a9a83f-bf77-4436-9545-3278c6e9a1f2 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:30.159315 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-87a9a83f-bf77-4436-9545-3278c6e9a1f2 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:30.209159 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-87a9a83f-bf77-4436-9545-3278c6e9a1f2 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] [instance: f273a7e1-9a1b-443a-8b5f-40cbb05136ba] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:08:30.323455 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5c969932-816b-4501-8fb3-8f743e44e291 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:30.343328 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5c969932-816b-4501-8fb3-8f743e44e291 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a" status: 200 len: 1279 microversion: 2.1 time: 0.677525 Aug 04 17:08:30.346633 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2787/5458] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:29 2022] GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a => generated 1279 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:30.366403 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-6d5f2a39-3bc3-4f87-b4c5-41e875d86797 req-e6782e85-dbac-4cb1-9e31-418c341c1a66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f273a7e1-9a1b-443a-8b5f-40cbb05136ba", "tag": "1bfefa9e-5520-4546-b945-a099a6e07a63"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:30.408898 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6d5f2a39-3bc3-4f87-b4c5-41e875d86797 req-e6782e85-dbac-4cb1-9e31-418c341c1a66 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:30.409442 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6d5f2a39-3bc3-4f87-b4c5-41e875d86797 req-e6782e85-dbac-4cb1-9e31-418c341c1a66 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:30.456974 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-6d5f2a39-3bc3-4f87-b4c5-41e875d86797 req-e6782e85-dbac-4cb1-9e31-418c341c1a66 service nova] Creating event network-changed:1bfefa9e-5520-4546-b945-a099a6e07a63 for instance f273a7e1-9a1b-443a-8b5f-40cbb05136ba on n-h1-846466-12 Aug 04 17:08:30.469069 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-6d5f2a39-3bc3-4f87-b4c5-41e875d86797 req-e6782e85-dbac-4cb1-9e31-418c341c1a66 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120297 Aug 04 17:08:30.470610 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2788/5459] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:30.481170 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-87a9a83f-bf77-4436-9545-3278c6e9a1f2 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba" status: 204 len: 0 microversion: 2.1 time: 0.370672 Aug 04 17:08:30.484130 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2672/5460] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:08:30 2022] DELETE /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:08:30.497950 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-986c5891-1f36-459f-b55f-9c859261b49f tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:30.500451 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-986c5891-1f36-459f-b55f-9c859261b49f tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] [instance: f273a7e1-9a1b-443a-8b5f-40cbb05136ba] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:30.523405 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-986c5891-1f36-459f-b55f-9c859261b49f tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:30.524105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-986c5891-1f36-459f-b55f-9c859261b49f tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:30.525900 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-986c5891-1f36-459f-b55f-9c859261b49f tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:30.526732 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-986c5891-1f36-459f-b55f-9c859261b49f tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:31.005197 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-986c5891-1f36-459f-b55f-9c859261b49f tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27c708a0dfa40bd85a95aa5f48d3bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2827b551964bf296b13728f77c5f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:31.023597 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-986c5891-1f36-459f-b55f-9c859261b49f tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] 10.222.0.23 "GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba" status: 200 len: 1585 microversion: 2.1 time: 0.532365 Aug 04 17:08:31.025642 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2789/5461] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:30 2022] GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba => generated 1585 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:31.129803 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-efb1d5c6-709c-4f7b-ade7-769b3beafea7 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:31.131412 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-efb1d5c6-709c-4f7b-ade7-769b3beafea7 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:31.153310 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-efb1d5c6-709c-4f7b-ade7-769b3beafea7 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:31.153970 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-efb1d5c6-709c-4f7b-ade7-769b3beafea7 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:31.154956 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-efb1d5c6-709c-4f7b-ade7-769b3beafea7 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:31.162952 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-efb1d5c6-709c-4f7b-ade7-769b3beafea7 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:31.369503 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-50b733bc-64f9-437a-a275-75da58932bf4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:31.370595 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-50b733bc-64f9-437a-a275-75da58932bf4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:31.380240 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50b733bc-64f9-437a-a275-75da58932bf4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:31.383652 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50b733bc-64f9-437a-a275-75da58932bf4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:31.386431 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50b733bc-64f9-437a-a275-75da58932bf4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:31.387096 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50b733bc-64f9-437a-a275-75da58932bf4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:32.489473 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-efb1d5c6-709c-4f7b-ade7-769b3beafea7 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:32.499343 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-efb1d5c6-709c-4f7b-ade7-769b3beafea7 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1679 microversion: 2.1 time: 1.373756 Aug 04 17:08:32.507811 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2673/5462] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:31 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1679 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:32.533680 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-95efbb65-0427-4416-a914-fc8e3b17becf tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:32.534429 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-95efbb65-0427-4416-a914-fc8e3b17becf tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] [instance: f273a7e1-9a1b-443a-8b5f-40cbb05136ba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:32.549225 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-95efbb65-0427-4416-a914-fc8e3b17becf tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:32.549708 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-95efbb65-0427-4416-a914-fc8e3b17becf tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:32.558582 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-95efbb65-0427-4416-a914-fc8e3b17becf tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:32.559045 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-95efbb65-0427-4416-a914-fc8e3b17becf tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:32.938677 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-50b733bc-64f9-437a-a275-75da58932bf4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:32.952053 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-50b733bc-64f9-437a-a275-75da58932bf4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a" status: 200 len: 1279 microversion: 2.1 time: 1.586940 Aug 04 17:08:32.952672 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2790/5463] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:31 2022] GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a => generated 1279 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:08:32.987975 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-95efbb65-0427-4416-a914-fc8e3b17becf tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27c708a0dfa40bd85a95aa5f48d3bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2827b551964bf296b13728f77c5f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:33.008746 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-95efbb65-0427-4416-a914-fc8e3b17becf tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] 10.222.0.23 "GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba" status: 200 len: 1585 microversion: 2.1 time: 0.490317 Aug 04 17:08:33.026060 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2674/5464] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:32 2022] GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba => generated 1585 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:33.528161 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d154b826-df92-4229-ac45-5d27cebf4531 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:33.529350 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d154b826-df92-4229-ac45-5d27cebf4531 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:33.548973 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d154b826-df92-4229-ac45-5d27cebf4531 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:33.551871 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d154b826-df92-4229-ac45-5d27cebf4531 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:33.559311 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d154b826-df92-4229-ac45-5d27cebf4531 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:33.560817 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d154b826-df92-4229-ac45-5d27cebf4531 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:33.977199 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4e8db946-cd6d-4d82-8019-c0289908d609 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:33.977875 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4e8db946-cd6d-4d82-8019-c0289908d609 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:33.995790 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4e8db946-cd6d-4d82-8019-c0289908d609 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:33.998370 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4e8db946-cd6d-4d82-8019-c0289908d609 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:34.001953 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4e8db946-cd6d-4d82-8019-c0289908d609 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:34.002770 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4e8db946-cd6d-4d82-8019-c0289908d609 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:35.439115 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4e8db946-cd6d-4d82-8019-c0289908d609 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:35.451558 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4e8db946-cd6d-4d82-8019-c0289908d609 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a" status: 200 len: 1267 microversion: 2.1 time: 1.481818 Aug 04 17:08:35.454942 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2675/5465] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:33 2022] GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a => generated 1267 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:08:35.469767 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e5fe78e2-af45-4d3f-9c69-5696f836f8eb tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:35.470752 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e5fe78e2-af45-4d3f-9c69-5696f836f8eb tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] [instance: f273a7e1-9a1b-443a-8b5f-40cbb05136ba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:35.488077 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5fe78e2-af45-4d3f-9c69-5696f836f8eb tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:35.488884 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5fe78e2-af45-4d3f-9c69-5696f836f8eb tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:35.490070 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5fe78e2-af45-4d3f-9c69-5696f836f8eb tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:35.490676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5fe78e2-af45-4d3f-9c69-5696f836f8eb tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:35.523637 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d154b826-df92-4229-ac45-5d27cebf4531 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:35.534980 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d154b826-df92-4229-ac45-5d27cebf4531 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1679 microversion: 2.1 time: 2.012329 Aug 04 17:08:35.536404 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2791/5466] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:33 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1679 bytes in 2014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:36.479253 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a66de7fa-f15d-44ae-9375-7c695cdbd405 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:36.481476 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a66de7fa-f15d-44ae-9375-7c695cdbd405 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:36.507466 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a66de7fa-f15d-44ae-9375-7c695cdbd405 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:36.508282 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a66de7fa-f15d-44ae-9375-7c695cdbd405 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:36.509108 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a66de7fa-f15d-44ae-9375-7c695cdbd405 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:36.509693 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a66de7fa-f15d-44ae-9375-7c695cdbd405 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:37.261555 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e5fe78e2-af45-4d3f-9c69-5696f836f8eb tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27c708a0dfa40bd85a95aa5f48d3bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2827b551964bf296b13728f77c5f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:37.276333 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e5fe78e2-af45-4d3f-9c69-5696f836f8eb tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] 10.222.0.23 "GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba" status: 200 len: 1585 microversion: 2.1 time: 1.817638 Aug 04 17:08:37.280507 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2676/5467] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:35 2022] GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba => generated 1585 bytes in 1822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:37.293357 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cc7a6a51-c351-4975-85de-85cd373779d9 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:37.294485 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cc7a6a51-c351-4975-85de-85cd373779d9 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:37.308742 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cc7a6a51-c351-4975-85de-85cd373779d9 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:37.309202 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cc7a6a51-c351-4975-85de-85cd373779d9 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:37.310020 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cc7a6a51-c351-4975-85de-85cd373779d9 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:37.310467 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cc7a6a51-c351-4975-85de-85cd373779d9 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:37.402776 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:37.679698 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a66de7fa-f15d-44ae-9375-7c695cdbd405 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:37.689757 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a66de7fa-f15d-44ae-9375-7c695cdbd405 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a" status: 200 len: 1267 microversion: 2.1 time: 1.216397 Aug 04 17:08:37.704906 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2792/5468] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:36 2022] GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a => generated 1267 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:37.712943 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-bff99aaf-0e99-4a9c-b3dc-77fa522f2051 req-de1a37f7-fb31-460a-85c8-fe814ac8329f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f273a7e1-9a1b-443a-8b5f-40cbb05136ba", "name": "network-vif-deleted", "tag": "1bfefa9e-5520-4546-b945-a099a6e07a63"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:37.730059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-bff99aaf-0e99-4a9c-b3dc-77fa522f2051 req-de1a37f7-fb31-460a-85c8-fe814ac8329f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:37.730857 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-bff99aaf-0e99-4a9c-b3dc-77fa522f2051 req-de1a37f7-fb31-460a-85c8-fe814ac8329f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:37.772864 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-bff99aaf-0e99-4a9c-b3dc-77fa522f2051 req-de1a37f7-fb31-460a-85c8-fe814ac8329f service nova] Creating event network-vif-deleted:1bfefa9e-5520-4546-b945-a099a6e07a63 for instance f273a7e1-9a1b-443a-8b5f-40cbb05136ba on n-h1-846466-12 Aug 04 17:08:37.789677 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-bff99aaf-0e99-4a9c-b3dc-77fa522f2051 req-de1a37f7-fb31-460a-85c8-fe814ac8329f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081645 Aug 04 17:08:37.790310 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2793/5469] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:37.969045 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cc7a6a51-c351-4975-85de-85cd373779d9 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:37.989680 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cc7a6a51-c351-4975-85de-85cd373779d9 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1656 microversion: 2.1 time: 0.707798 Aug 04 17:08:38.003650 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2677/5470] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:37 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1656 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:38.022444 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2d77aa8f-b103-485a-91c7-cc7188be818a tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:38.037273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d77aa8f-b103-485a-91c7-cc7188be818a tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:38.037739 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d77aa8f-b103-485a-91c7-cc7188be818a tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:38.102248 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2d77aa8f-b103-485a-91c7-cc7188be818a tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Going to try to start instance {{(pid=126125) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 17:08:38.198464 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:38.217545 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2d77aa8f-b103-485a-91c7-cc7188be818a tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "POST /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296/action" status: 202 len: 0 microversion: 2.1 time: 0.202205 Aug 04 17:08:38.218519 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2794/5471] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:08:38 2022] POST /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:08:38.227060 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cde02769-4813-4114-9904-e61849d5d387 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:38.227695 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cde02769-4813-4114-9904-e61849d5d387 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:38.272251 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cde02769-4813-4114-9904-e61849d5d387 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:38.276519 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cde02769-4813-4114-9904-e61849d5d387 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:38.278005 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cde02769-4813-4114-9904-e61849d5d387 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:38.285332 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cde02769-4813-4114-9904-e61849d5d387 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:38.318663 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-25f1ef20-92a5-4130-b872-8c810bced9cf tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:38.319287 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-25f1ef20-92a5-4130-b872-8c810bced9cf tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] [instance: f273a7e1-9a1b-443a-8b5f-40cbb05136ba] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:38.334472 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-25f1ef20-92a5-4130-b872-8c810bced9cf tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:38.334926 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-25f1ef20-92a5-4130-b872-8c810bced9cf tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:38.335760 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-25f1ef20-92a5-4130-b872-8c810bced9cf tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:38.336197 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-25f1ef20-92a5-4130-b872-8c810bced9cf tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:38.828020 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cde02769-4813-4114-9904-e61849d5d387 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:38.844054 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cde02769-4813-4114-9904-e61849d5d387 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1665 microversion: 2.1 time: 0.616262 Aug 04 17:08:38.844904 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2678/5472] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:38 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1665 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:38.868944 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fe3faf0d-2f7b-44fb-99f4-8d0403fc5a35 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:38.874528 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fe3faf0d-2f7b-44fb-99f4-8d0403fc5a35 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:38.911505 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fe3faf0d-2f7b-44fb-99f4-8d0403fc5a35 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:38.912005 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fe3faf0d-2f7b-44fb-99f4-8d0403fc5a35 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:38.912847 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fe3faf0d-2f7b-44fb-99f4-8d0403fc5a35 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:38.913379 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fe3faf0d-2f7b-44fb-99f4-8d0403fc5a35 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:39.206817 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-25f1ef20-92a5-4130-b872-8c810bced9cf tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27c708a0dfa40bd85a95aa5f48d3bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2827b551964bf296b13728f77c5f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:39.230907 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-25f1ef20-92a5-4130-b872-8c810bced9cf tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] 10.222.0.23 "GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba" status: 200 len: 1230 microversion: 2.1 time: 0.918458 Aug 04 17:08:39.232147 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2795/5473] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:38 2022] GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba => generated 1230 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:08:39.377095 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fe3faf0d-2f7b-44fb-99f4-8d0403fc5a35 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:39.387247 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fe3faf0d-2f7b-44fb-99f4-8d0403fc5a35 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a" status: 200 len: 1267 microversion: 2.1 time: 0.525976 Aug 04 17:08:39.394835 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2679/5474] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:38 2022] GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a => generated 1267 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:39.764403 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b8b4d9de-edbf-48b9-8cbf-98045ee8d1e7 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1816078467", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:39.852689 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-b8b4d9de-edbf-48b9-8cbf-98045ee8d1e7 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] validate_networks() for None {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:08:39.867356 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c679958a-1e0c-4336-af71-f642acc89d30 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:39.868029 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c679958a-1e0c-4336-af71-f642acc89d30 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:39.888596 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c679958a-1e0c-4336-af71-f642acc89d30 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:39.889127 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c679958a-1e0c-4336-af71-f642acc89d30 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:39.890572 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c679958a-1e0c-4336-af71-f642acc89d30 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:39.891454 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c679958a-1e0c-4336-af71-f642acc89d30 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:41.278468 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c679958a-1e0c-4336-af71-f642acc89d30 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:41.291710 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c679958a-1e0c-4336-af71-f642acc89d30 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1665 microversion: 2.1 time: 1.428734 Aug 04 17:08:41.292636 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2680/5475] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:39 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1665 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:08:41.312540 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-63804948-bf8e-4d47-854b-151f6c49cf57 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:41.313559 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-63804948-bf8e-4d47-854b-151f6c49cf57 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] [instance: f273a7e1-9a1b-443a-8b5f-40cbb05136ba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:41.322342 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63804948-bf8e-4d47-854b-151f6c49cf57 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:41.322992 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63804948-bf8e-4d47-854b-151f6c49cf57 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:41.323903 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63804948-bf8e-4d47-854b-151f6c49cf57 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:41.324558 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-63804948-bf8e-4d47-854b-151f6c49cf57 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:41.526693 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-63804948-bf8e-4d47-854b-151f6c49cf57 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27c708a0dfa40bd85a95aa5f48d3bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2827b551964bf296b13728f77c5f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:41.545243 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-63804948-bf8e-4d47-854b-151f6c49cf57 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] 10.222.0.23 "GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba" status: 200 len: 1230 microversion: 2.1 time: 0.251397 Aug 04 17:08:41.564666 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2681/5476] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:41 2022] GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba => generated 1230 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:41.569822 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1c7b2472-de9d-4f8a-a9b2-3d13878bb0a3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:41.571527 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1c7b2472-de9d-4f8a-a9b2-3d13878bb0a3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:41.579344 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c7b2472-de9d-4f8a-a9b2-3d13878bb0a3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:41.579985 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c7b2472-de9d-4f8a-a9b2-3d13878bb0a3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:41.580922 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c7b2472-de9d-4f8a-a9b2-3d13878bb0a3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:41.581548 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c7b2472-de9d-4f8a-a9b2-3d13878bb0a3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:41.655897 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b8b4d9de-edbf-48b9-8cbf-98045ee8d1e7 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:08:41.657026 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b8b4d9de-edbf-48b9-8cbf-98045ee8d1e7 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:08:41.658029 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b8b4d9de-edbf-48b9-8cbf-98045ee8d1e7 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:08:41.658744 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b8b4d9de-edbf-48b9-8cbf-98045ee8d1e7 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:08:41.660108 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b8b4d9de-edbf-48b9-8cbf-98045ee8d1e7 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:08:41.675243 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8b4d9de-edbf-48b9-8cbf-98045ee8d1e7 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:41.676085 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8b4d9de-edbf-48b9-8cbf-98045ee8d1e7 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:41.677196 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8b4d9de-edbf-48b9-8cbf-98045ee8d1e7 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:41.678177 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8b4d9de-edbf-48b9-8cbf-98045ee8d1e7 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:41.709664 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-b8b4d9de-edbf-48b9-8cbf-98045ee8d1e7 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Getting quotas for project 907d9430adfe43b1a29a92b24d1d9f15. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:08:41.716706 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-b8b4d9de-edbf-48b9-8cbf-98045ee8d1e7 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Getting quotas for user 1837a483e4624787801bfc3411566003 and project 907d9430adfe43b1a29a92b24d1d9f15. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:08:41.733354 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b8b4d9de-edbf-48b9-8cbf-98045ee8d1e7 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:08:41.736927 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b8b4d9de-edbf-48b9-8cbf-98045ee8d1e7 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] [instance: 35918880-3ff3-4163-97af-b7e794421b4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:08:41.789401 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1c7b2472-de9d-4f8a-a9b2-3d13878bb0a3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:41.797191 n-d-846466-12 devstack@n-api.service[126125]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b8b4d9de-edbf-48b9-8cbf-98045ee8d1e7 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] [b042ee28-61dd-48b8-9569-21b30cd0d61a] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 17:08:41.799531 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1c7b2472-de9d-4f8a-a9b2-3d13878bb0a3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a" status: 200 len: 1267 microversion: 2.1 time: 0.233400 Aug 04 17:08:41.800433 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2682/5477] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:41 2022] GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a => generated 1267 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:41.806624 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-f995d25f-ba4c-43d3-baaf-6e3f4a0d9726 req-bdf8b79e-c4e6-4110-a619-0e91a7997e4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc8307a2-4a12-4301-a04f-6ed3bccb7d1a", "name": "network-vif-plugged", "status": "completed", "tag": "9ea99fa2-f541-4856-a304-28a402350443"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:41.819859 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:41.822995 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f995d25f-ba4c-43d3-baaf-6e3f4a0d9726 req-bdf8b79e-c4e6-4110-a619-0e91a7997e4e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:41.823765 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f995d25f-ba4c-43d3-baaf-6e3f4a0d9726 req-bdf8b79e-c4e6-4110-a619-0e91a7997e4e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:41.847075 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-f995d25f-ba4c-43d3-baaf-6e3f4a0d9726 req-bdf8b79e-c4e6-4110-a619-0e91a7997e4e service nova] Creating event network-vif-plugged:9ea99fa2-f541-4856-a304-28a402350443 for instance dc8307a2-4a12-4301-a04f-6ed3bccb7d1a on n-h2-846466-12 Aug 04 17:08:41.854497 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-f995d25f-ba4c-43d3-baaf-6e3f4a0d9726 req-bdf8b79e-c4e6-4110-a619-0e91a7997e4e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052312 Aug 04 17:08:41.855847 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2683/5478] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:42.316001 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6d5a885e-17f0-4474-a7db-54c0df8b3436 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:42.317816 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6d5a885e-17f0-4474-a7db-54c0df8b3436 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:42.329554 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d5a885e-17f0-4474-a7db-54c0df8b3436 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:42.330321 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d5a885e-17f0-4474-a7db-54c0df8b3436 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:42.331369 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d5a885e-17f0-4474-a7db-54c0df8b3436 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:42.331996 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d5a885e-17f0-4474-a7db-54c0df8b3436 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:42.540700 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6d5a885e-17f0-4474-a7db-54c0df8b3436 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:42.552257 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6d5a885e-17f0-4474-a7db-54c0df8b3436 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1669 microversion: 2.1 time: 0.243033 Aug 04 17:08:42.553677 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2684/5479] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:42 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1669 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:08:42.591899 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-336892c1-07ed-460b-a5dd-bbb7d11ef8e2 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:42.592858 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-336892c1-07ed-460b-a5dd-bbb7d11ef8e2 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] [instance: f273a7e1-9a1b-443a-8b5f-40cbb05136ba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:42.602324 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-336892c1-07ed-460b-a5dd-bbb7d11ef8e2 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:42.603049 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-336892c1-07ed-460b-a5dd-bbb7d11ef8e2 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:42.604214 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-336892c1-07ed-460b-a5dd-bbb7d11ef8e2 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:42.605019 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-336892c1-07ed-460b-a5dd-bbb7d11ef8e2 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:42.697911 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-336892c1-07ed-460b-a5dd-bbb7d11ef8e2 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27c708a0dfa40bd85a95aa5f48d3bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2827b551964bf296b13728f77c5f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:42.707616 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-336892c1-07ed-460b-a5dd-bbb7d11ef8e2 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] 10.222.0.23 "GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba" status: 200 len: 1230 microversion: 2.1 time: 0.122093 Aug 04 17:08:42.709100 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2685/5480] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:42 2022] GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba => generated 1230 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:42.808995 n-d-846466-12 devstack@n-api.service[126125]: INFO oslo.messaging._drivers.impl_rabbit [None req-b8b4d9de-edbf-48b9-8cbf-98045ee8d1e7 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] [b042ee28-61dd-48b8-9569-21b30cd0d61a] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 43958. Aug 04 17:08:42.814211 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b8b4d9de-edbf-48b9-8cbf-98045ee8d1e7 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.060396 Aug 04 17:08:42.814849 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2796/5481] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:08:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 3062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:08:42.820972 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7b75f719-e4c0-43dd-9665-64a791423d1b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:42.821872 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7b75f719-e4c0-43dd-9665-64a791423d1b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:42.831028 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-54b1a09a-03e5-4646-9c99-f7352d6821d6 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:42.841202 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-54b1a09a-03e5-4646-9c99-f7352d6821d6 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] [instance: 35918880-3ff3-4163-97af-b7e794421b4c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:42.842525 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b75f719-e4c0-43dd-9665-64a791423d1b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:42.844609 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b75f719-e4c0-43dd-9665-64a791423d1b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:42.848148 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b75f719-e4c0-43dd-9665-64a791423d1b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:42.850227 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b75f719-e4c0-43dd-9665-64a791423d1b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:43.279094 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-54b1a09a-03e5-4646-9c99-f7352d6821d6 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1837a483e4624787801bfc3411566003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907d9430adfe43b1a29a92b24d1d9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:43.291964 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-54b1a09a-03e5-4646-9c99-f7352d6821d6 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] 10.222.0.23 "GET /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c" status: 200 len: 1214 microversion: 2.1 time: 0.468411 Aug 04 17:08:43.308290 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2797/5482] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:42 2022] GET /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c => generated 1214 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:43.435173 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7b75f719-e4c0-43dd-9665-64a791423d1b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:43.447672 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7b75f719-e4c0-43dd-9665-64a791423d1b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a" status: 200 len: 1267 microversion: 2.1 time: 0.631298 Aug 04 17:08:43.462011 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2686/5483] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:42 2022] GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a => generated 1267 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:43.752654 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-74c86459-20f4-4788-a64f-0c4fe08a2e6e tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:43.760786 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-74c86459-20f4-4788-a64f-0c4fe08a2e6e tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] [instance: f273a7e1-9a1b-443a-8b5f-40cbb05136ba] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:43.776445 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:43.785187 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-74c86459-20f4-4788-a64f-0c4fe08a2e6e tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:43.789669 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-74c86459-20f4-4788-a64f-0c4fe08a2e6e tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:43.791180 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-74c86459-20f4-4788-a64f-0c4fe08a2e6e tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:43.792087 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-74c86459-20f4-4788-a64f-0c4fe08a2e6e tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:43.969473 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-74c86459-20f4-4788-a64f-0c4fe08a2e6e tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27c708a0dfa40bd85a95aa5f48d3bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2827b551964bf296b13728f77c5f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:43.987738 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-74c86459-20f4-4788-a64f-0c4fe08a2e6e tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] 10.222.0.23 "GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba" status: 200 len: 1230 microversion: 2.1 time: 0.261064 Aug 04 17:08:43.988545 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2798/5484] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:43 2022] GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba => generated 1230 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:44.336328 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9e1f2cf0-1c27-4a42-ba6d-aed9dec56bd1 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:44.337006 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9e1f2cf0-1c27-4a42-ba6d-aed9dec56bd1 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] [instance: 35918880-3ff3-4163-97af-b7e794421b4c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:44.358708 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e1f2cf0-1c27-4a42-ba6d-aed9dec56bd1 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:44.363486 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e1f2cf0-1c27-4a42-ba6d-aed9dec56bd1 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:44.369838 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e1f2cf0-1c27-4a42-ba6d-aed9dec56bd1 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:44.371166 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e1f2cf0-1c27-4a42-ba6d-aed9dec56bd1 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:44.468392 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fbd5de0c-acd6-4d1e-84ac-970666c3882c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:44.469018 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fbd5de0c-acd6-4d1e-84ac-970666c3882c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:44.486805 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fbd5de0c-acd6-4d1e-84ac-970666c3882c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:44.491084 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fbd5de0c-acd6-4d1e-84ac-970666c3882c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:44.494079 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fbd5de0c-acd6-4d1e-84ac-970666c3882c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:44.494557 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fbd5de0c-acd6-4d1e-84ac-970666c3882c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:44.626622 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9e1f2cf0-1c27-4a42-ba6d-aed9dec56bd1 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1837a483e4624787801bfc3411566003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907d9430adfe43b1a29a92b24d1d9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:44.649041 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9e1f2cf0-1c27-4a42-ba6d-aed9dec56bd1 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] 10.222.0.23 "GET /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c" status: 200 len: 1274 microversion: 2.1 time: 0.316086 Aug 04 17:08:44.651314 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2687/5485] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:44 2022] GET /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c => generated 1274 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:45.020005 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-39b2411c-96fb-4136-92a0-013ac7397325 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:45.020778 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-39b2411c-96fb-4136-92a0-013ac7397325 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] [instance: f273a7e1-9a1b-443a-8b5f-40cbb05136ba] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:45.034330 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39b2411c-96fb-4136-92a0-013ac7397325 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:45.035070 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39b2411c-96fb-4136-92a0-013ac7397325 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:45.036174 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39b2411c-96fb-4136-92a0-013ac7397325 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:45.037519 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39b2411c-96fb-4136-92a0-013ac7397325 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:45.062648 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fbd5de0c-acd6-4d1e-84ac-970666c3882c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:45.084407 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fbd5de0c-acd6-4d1e-84ac-970666c3882c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a" status: 200 len: 1454 microversion: 2.1 time: 0.619243 Aug 04 17:08:45.098950 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2799/5486] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:44 2022] GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a => generated 1454 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:08:45.107765 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5a9305ac-2495-4d8c-8154-d42aa228b5bf tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:45.108475 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5a9305ac-2495-4d8c-8154-d42aa228b5bf tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:45.117967 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5a9305ac-2495-4d8c-8154-d42aa228b5bf tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:45.118707 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5a9305ac-2495-4d8c-8154-d42aa228b5bf tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:45.119910 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5a9305ac-2495-4d8c-8154-d42aa228b5bf tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:45.120510 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5a9305ac-2495-4d8c-8154-d42aa228b5bf tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:45.156882 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-39b2411c-96fb-4136-92a0-013ac7397325 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27c708a0dfa40bd85a95aa5f48d3bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2827b551964bf296b13728f77c5f88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:45.170936 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-39b2411c-96fb-4136-92a0-013ac7397325 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] 10.222.0.23 "GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba" status: 200 len: 1230 microversion: 2.1 time: 0.163176 Aug 04 17:08:45.173697 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2688/5487] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:45 2022] GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba => generated 1230 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:45.590024 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5a9305ac-2495-4d8c-8154-d42aa228b5bf tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:45.612862 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5a9305ac-2495-4d8c-8154-d42aa228b5bf tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a" status: 200 len: 1454 microversion: 2.1 time: 0.509698 Aug 04 17:08:45.614131 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2800/5488] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:45 2022] GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a => generated 1454 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:45.670886 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4de77f0f-8018-43f6-afa3-455fb8402ac9 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:45.671597 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4de77f0f-8018-43f6-afa3-455fb8402ac9 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] [instance: 35918880-3ff3-4163-97af-b7e794421b4c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:45.680979 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4de77f0f-8018-43f6-afa3-455fb8402ac9 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:45.681840 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4de77f0f-8018-43f6-afa3-455fb8402ac9 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:45.684914 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4de77f0f-8018-43f6-afa3-455fb8402ac9 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:45.685623 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4de77f0f-8018-43f6-afa3-455fb8402ac9 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:45.837207 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4de77f0f-8018-43f6-afa3-455fb8402ac9 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1837a483e4624787801bfc3411566003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907d9430adfe43b1a29a92b24d1d9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:45.854110 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4de77f0f-8018-43f6-afa3-455fb8402ac9 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] 10.222.0.23 "GET /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c" status: 200 len: 1272 microversion: 2.1 time: 0.186537 Aug 04 17:08:45.855483 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2689/5489] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:45 2022] GET /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c => generated 1272 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:46.199047 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f2d8dd27-d84c-48fe-b206-cfc158a6cf85 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:46.199652 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f2d8dd27-d84c-48fe-b206-cfc158a6cf85 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] [instance: f273a7e1-9a1b-443a-8b5f-40cbb05136ba] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:46.207407 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f2d8dd27-d84c-48fe-b206-cfc158a6cf85 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:46.207844 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f2d8dd27-d84c-48fe-b206-cfc158a6cf85 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:46.208840 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f2d8dd27-d84c-48fe-b206-cfc158a6cf85 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:46.209334 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f2d8dd27-d84c-48fe-b206-cfc158a6cf85 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:46.226787 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-f2d8dd27-d84c-48fe-b206-cfc158a6cf85 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] HTTP exception thrown: Instance f273a7e1-9a1b-443a-8b5f-40cbb05136ba could not be found. Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f2d8dd27-d84c-48fe-b206-cfc158a6cf85 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Request method failure captured: Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba HTTP/1.1 Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_u3Px7GpzVEtNBgu5YgIAfeCQpHea4IXCIntma-WNyZDrtVyE6PDSh7xonLXGfVRaUKuRYwyQgVaqQvvCBSuiAUFSn_9RL5MAvi9xwq8L5Z-EJ83uuys79Rgvw4PzLWB1o9dyAwqmlo2ZXdIcTWHeNfbhdyBvrxleYLnoB62ihcOKk Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: de2827b551964bf296b13728f77c5f88 Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-TestVolumeBackupRestore-224666159 Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de2827b551964bf296b13728f77c5f88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_de2827b551964bf296b13728f77c5f88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de2827b551964bf296b13728f77c5f88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/de2827b551964bf296b13728f77c5f88"}]}] Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-TestVolumeBackupRestore-224666159 Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: de2827b551964bf296b13728f77c5f88 Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-TestVolumeBackupRestore-224666159 Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-TestVolumeBackupRestore-224666159-project Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: a27c708a0dfa40bd85a95aa5f48d3bb9 Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-TestVolumeBackupRestore-224666159-project Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance f273a7e1-9a1b-443a-8b5f-40cbb05136ba could not be found. Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'f273a7e1-9a1b-443a-8b5f-40cbb05136ba'} Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f273a7e1-9a1b-443a-8b5f-40cbb05136ba could not be found. Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f273a7e1-9a1b-443a-8b5f-40cbb05136ba could not be found. Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:08:46.228558 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:08:46.232818 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:46.232818 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:08:46.232818 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:08:46.232818 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:08:46.232818 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:08:46.232818 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f273a7e1-9a1b-443a-8b5f-40cbb05136ba could not be found. Aug 04 17:08:46.232818 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:08:46.234980 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f2d8dd27-d84c-48fe-b206-cfc158a6cf85 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Returning 404 to user: Instance f273a7e1-9a1b-443a-8b5f-40cbb05136ba could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:08:46.236189 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f2d8dd27-d84c-48fe-b206-cfc158a6cf85 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] 10.222.0.23 "GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba" status: 404 len: 111 microversion: 2.1 time: 0.044683 Aug 04 17:08:46.236982 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2801/5490] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:46 2022] GET /compute/v2.1/servers/f273a7e1-9a1b-443a-8b5f-40cbb05136ba => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:08:46.879502 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b76367fc-8bb1-4194-8557-8c03d76d3ed1 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:46.885646 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b76367fc-8bb1-4194-8557-8c03d76d3ed1 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] [instance: 35918880-3ff3-4163-97af-b7e794421b4c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:46.895700 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b76367fc-8bb1-4194-8557-8c03d76d3ed1 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:46.896449 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b76367fc-8bb1-4194-8557-8c03d76d3ed1 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:46.897264 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b76367fc-8bb1-4194-8557-8c03d76d3ed1 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:46.897985 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b76367fc-8bb1-4194-8557-8c03d76d3ed1 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:47.008312 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-292ccd9b-ab51-4c7d-a442-c2049368d800 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] Calling method '.version_select at 0x7f7e77081700>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:47.031887 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-292ccd9b-ab51-4c7d-a442-c2049368d800 tempest-TestVolumeBackupRestore-224666159 tempest-TestVolumeBackupRestore-224666159-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1773976084" status: 202 len: 0 microversion: 2.1 time: 0.029296 Aug 04 17:08:47.033365 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2802/5491] 10.222.0.23 () {58 vars in 1269 bytes} [Thu Aug 4 17:08:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1773976084 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:08:48.288273 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b76367fc-8bb1-4194-8557-8c03d76d3ed1 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1837a483e4624787801bfc3411566003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907d9430adfe43b1a29a92b24d1d9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:48.308390 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b76367fc-8bb1-4194-8557-8c03d76d3ed1 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] 10.222.0.23 "GET /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c" status: 200 len: 1314 microversion: 2.1 time: 1.429541 Aug 04 17:08:48.309863 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2690/5492] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:46 2022] GET /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c => generated 1314 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:08:49.337594 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bd0e3191-6019-41a8-8cc4-3c704194b9b7 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:49.339155 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bd0e3191-6019-41a8-8cc4-3c704194b9b7 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] [instance: 35918880-3ff3-4163-97af-b7e794421b4c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:49.434116 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bd0e3191-6019-41a8-8cc4-3c704194b9b7 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:49.436012 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bd0e3191-6019-41a8-8cc4-3c704194b9b7 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:49.439573 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bd0e3191-6019-41a8-8cc4-3c704194b9b7 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:49.440226 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bd0e3191-6019-41a8-8cc4-3c704194b9b7 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:50.844189 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bd0e3191-6019-41a8-8cc4-3c704194b9b7 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1837a483e4624787801bfc3411566003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907d9430adfe43b1a29a92b24d1d9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:50.864615 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bd0e3191-6019-41a8-8cc4-3c704194b9b7 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] 10.222.0.23 "GET /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c" status: 200 len: 1314 microversion: 2.1 time: 1.532229 Aug 04 17:08:50.866326 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2803/5493] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:49 2022] GET /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c => generated 1314 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:51.142374 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-768836c7-cee0-4e71-a365-3d80487b436b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-740172353", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "43b69fc9-32f7-47a3-bb2a-2e6553e0c94a"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:51.254666 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-768836c7-cee0-4e71-a365-3d80487b436b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] validate_networks() for [('43b69fc9-32f7-47a3-bb2a-2e6553e0c94a', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:08:51.442748 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-38582d6e-50fd-4bc4-a4ef-9544fab87399 req-ad328cac-08c4-4b81-802c-3ce5b088d78a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35918880-3ff3-4163-97af-b7e794421b4c", "tag": "f902e0b1-7012-4c81-ba91-22e451d7485f"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:51.468231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-38582d6e-50fd-4bc4-a4ef-9544fab87399 req-ad328cac-08c4-4b81-802c-3ce5b088d78a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:51.469005 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-38582d6e-50fd-4bc4-a4ef-9544fab87399 req-ad328cac-08c4-4b81-802c-3ce5b088d78a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:51.501170 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-38582d6e-50fd-4bc4-a4ef-9544fab87399 req-ad328cac-08c4-4b81-802c-3ce5b088d78a service nova] Creating event network-changed:f902e0b1-7012-4c81-ba91-22e451d7485f for instance 35918880-3ff3-4163-97af-b7e794421b4c on n-h1-846466-12 Aug 04 17:08:51.517722 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-38582d6e-50fd-4bc4-a4ef-9544fab87399 req-ad328cac-08c4-4b81-802c-3ce5b088d78a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079527 Aug 04 17:08:51.520287 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2804/5494] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:51.887910 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-628409b3-4c0a-4c19-b40e-42b02460b497 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:51.888625 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-628409b3-4c0a-4c19-b40e-42b02460b497 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] [instance: 35918880-3ff3-4163-97af-b7e794421b4c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:51.890856 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:51.910209 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-628409b3-4c0a-4c19-b40e-42b02460b497 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:51.910771 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-628409b3-4c0a-4c19-b40e-42b02460b497 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:51.911596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-628409b3-4c0a-4c19-b40e-42b02460b497 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:51.912039 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-628409b3-4c0a-4c19-b40e-42b02460b497 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:52.995641 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-628409b3-4c0a-4c19-b40e-42b02460b497 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1837a483e4624787801bfc3411566003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907d9430adfe43b1a29a92b24d1d9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:53.008535 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-628409b3-4c0a-4c19-b40e-42b02460b497 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] 10.222.0.23 "GET /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c" status: 200 len: 1314 microversion: 2.1 time: 1.123081 Aug 04 17:08:53.009444 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2805/5495] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:51 2022] GET /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c => generated 1314 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:08:54.033956 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d4649d20-0b3e-4931-a33e-d24ecf316dad tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:54.034916 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d4649d20-0b3e-4931-a33e-d24ecf316dad tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] [instance: 35918880-3ff3-4163-97af-b7e794421b4c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:54.036537 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=8 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:54.054110 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d4649d20-0b3e-4931-a33e-d24ecf316dad tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:54.054899 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d4649d20-0b3e-4931-a33e-d24ecf316dad tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:54.055929 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d4649d20-0b3e-4931-a33e-d24ecf316dad tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:54.060846 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d4649d20-0b3e-4931-a33e-d24ecf316dad tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:54.142513 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-768836c7-cee0-4e71-a365-3d80487b436b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:08:54.143946 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-768836c7-cee0-4e71-a365-3d80487b436b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:08:54.144896 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-768836c7-cee0-4e71-a365-3d80487b436b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:08:54.147383 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-768836c7-cee0-4e71-a365-3d80487b436b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:08:54.150592 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-768836c7-cee0-4e71-a365-3d80487b436b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:08:54.188302 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-768836c7-cee0-4e71-a365-3d80487b436b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:54.189099 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-768836c7-cee0-4e71-a365-3d80487b436b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:54.192874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-768836c7-cee0-4e71-a365-3d80487b436b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:54.195772 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-768836c7-cee0-4e71-a365-3d80487b436b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:54.291186 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-768836c7-cee0-4e71-a365-3d80487b436b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Getting quotas for project af166c943aa6480b92dd1762ac5e4176. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:08:54.310360 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-768836c7-cee0-4e71-a365-3d80487b436b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Getting quotas for user f9ce8bf1816648ac97dcceea91556ad8 and project af166c943aa6480b92dd1762ac5e4176. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:08:54.384383 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-768836c7-cee0-4e71-a365-3d80487b436b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:08:54.388982 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-768836c7-cee0-4e71-a365-3d80487b436b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: d4d7425d-33f4-4a0a-bb03-4c02f23bd843] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:08:54.561180 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-768836c7-cee0-4e71-a365-3d80487b436b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.416850 Aug 04 17:08:54.562904 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2691/5496] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:08:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 3426 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:08:54.583204 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-19433f7d-5297-499f-beed-985ebaf24885 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:54.584798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-19433f7d-5297-499f-beed-985ebaf24885 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: d4d7425d-33f4-4a0a-bb03-4c02f23bd843] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:54.780146 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-19433f7d-5297-499f-beed-985ebaf24885 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce8bf1816648ac97dcceea91556ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af166c943aa6480b92dd1762ac5e4176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:54.795819 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d4649d20-0b3e-4931-a33e-d24ecf316dad tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1837a483e4624787801bfc3411566003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907d9430adfe43b1a29a92b24d1d9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:54.811134 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d4649d20-0b3e-4931-a33e-d24ecf316dad tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] 10.222.0.23 "GET /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c" status: 200 len: 1314 microversion: 2.1 time: 0.781235 Aug 04 17:08:54.811752 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2806/5497] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:54 2022] GET /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c => generated 1314 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:08:54.820783 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-19433f7d-5297-499f-beed-985ebaf24885 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "GET /compute/v2.1/servers/d4d7425d-33f4-4a0a-bb03-4c02f23bd843" status: 200 len: 1213 microversion: 2.1 time: 0.244625 Aug 04 17:08:54.823901 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2692/5498] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:54 2022] GET /compute/v2.1/servers/d4d7425d-33f4-4a0a-bb03-4c02f23bd843 => generated 1213 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:55.776428 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-bc0ff979-837b-4c43-a610-e8fc9faf8da1 req-ab365dfa-eae7-4ed3-b0e0-6e29ab1cf6f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc8307a2-4a12-4301-a04f-6ed3bccb7d1a", "tag": "9ea99fa2-f541-4856-a304-28a402350443"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:55.827059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-bc0ff979-837b-4c43-a610-e8fc9faf8da1 req-ab365dfa-eae7-4ed3-b0e0-6e29ab1cf6f1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:55.827503 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-bc0ff979-837b-4c43-a610-e8fc9faf8da1 req-ab365dfa-eae7-4ed3-b0e0-6e29ab1cf6f1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:55.835264 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b3e80d16-7a04-4dea-9998-8889243e8bae tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:55.837067 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b3e80d16-7a04-4dea-9998-8889243e8bae tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] [instance: 35918880-3ff3-4163-97af-b7e794421b4c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:55.859362 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b3e80d16-7a04-4dea-9998-8889243e8bae tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:55.861693 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b3e80d16-7a04-4dea-9998-8889243e8bae tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:55.864390 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b3e80d16-7a04-4dea-9998-8889243e8bae tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:55.864887 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b3e80d16-7a04-4dea-9998-8889243e8bae tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:55.902775 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-bc0ff979-837b-4c43-a610-e8fc9faf8da1 req-ab365dfa-eae7-4ed3-b0e0-6e29ab1cf6f1 service nova] Creating event network-changed:9ea99fa2-f541-4856-a304-28a402350443 for instance dc8307a2-4a12-4301-a04f-6ed3bccb7d1a on n-h2-846466-12 Aug 04 17:08:55.916198 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-bc0ff979-837b-4c43-a610-e8fc9faf8da1 req-ab365dfa-eae7-4ed3-b0e0-6e29ab1cf6f1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142487 Aug 04 17:08:55.921807 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2807/5499] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:55.934102 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5a56c85e-eb9c-47ea-a9e3-d734d9890a10 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:55.935282 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5a56c85e-eb9c-47ea-a9e3-d734d9890a10 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: d4d7425d-33f4-4a0a-bb03-4c02f23bd843] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:55.950163 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5a56c85e-eb9c-47ea-a9e3-d734d9890a10 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:55.955015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5a56c85e-eb9c-47ea-a9e3-d734d9890a10 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:55.956122 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5a56c85e-eb9c-47ea-a9e3-d734d9890a10 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:55.957216 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5a56c85e-eb9c-47ea-a9e3-d734d9890a10 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:56.240379 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5a56c85e-eb9c-47ea-a9e3-d734d9890a10 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce8bf1816648ac97dcceea91556ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af166c943aa6480b92dd1762ac5e4176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:56.254963 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5a56c85e-eb9c-47ea-a9e3-d734d9890a10 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "GET /compute/v2.1/servers/d4d7425d-33f4-4a0a-bb03-4c02f23bd843" status: 200 len: 1265 microversion: 2.1 time: 0.331517 Aug 04 17:08:56.256118 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2808/5500] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:55 2022] GET /compute/v2.1/servers/d4d7425d-33f4-4a0a-bb03-4c02f23bd843 => generated 1265 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:56.470567 n-d-846466-12 devstack@n-api.service[126126]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:08:56.470816 n-d-846466-12 devstack@n-api.service[126126]: Thu Aug 4 17:08:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c (ip 10.222.0.23) !!! Aug 04 17:08:56.667029 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b3e80d16-7a04-4dea-9998-8889243e8bae tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1837a483e4624787801bfc3411566003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907d9430adfe43b1a29a92b24d1d9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:56.675927 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b3e80d16-7a04-4dea-9998-8889243e8bae tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] 10.222.0.23 "GET /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c" status: 200 len: 1314 microversion: 2.1 time: 0.845599 Aug 04 17:08:56.681129 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2693/5501] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:55 2022] GET /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c => generated 1314 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:08:57.279225 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2627ddbc-ad07-4582-bd23-44ce859f7bff tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:57.279829 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2627ddbc-ad07-4582-bd23-44ce859f7bff tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: d4d7425d-33f4-4a0a-bb03-4c02f23bd843] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:57.296982 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2627ddbc-ad07-4582-bd23-44ce859f7bff tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:57.297675 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2627ddbc-ad07-4582-bd23-44ce859f7bff tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:57.298731 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2627ddbc-ad07-4582-bd23-44ce859f7bff tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:57.299236 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2627ddbc-ad07-4582-bd23-44ce859f7bff tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:57.524874 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2627ddbc-ad07-4582-bd23-44ce859f7bff tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce8bf1816648ac97dcceea91556ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af166c943aa6480b92dd1762ac5e4176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:57.534654 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2627ddbc-ad07-4582-bd23-44ce859f7bff tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "GET /compute/v2.1/servers/d4d7425d-33f4-4a0a-bb03-4c02f23bd843" status: 200 len: 1271 microversion: 2.1 time: 0.259269 Aug 04 17:08:57.535684 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2809/5502] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:57 2022] GET /compute/v2.1/servers/d4d7425d-33f4-4a0a-bb03-4c02f23bd843 => generated 1271 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:57.704156 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ab553db7-2233-4d92-8511-36f585c2befa tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:57.704766 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ab553db7-2233-4d92-8511-36f585c2befa tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] [instance: 35918880-3ff3-4163-97af-b7e794421b4c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:57.716899 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ab553db7-2233-4d92-8511-36f585c2befa tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:57.717382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ab553db7-2233-4d92-8511-36f585c2befa tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:57.718172 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ab553db7-2233-4d92-8511-36f585c2befa tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:57.718617 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ab553db7-2233-4d92-8511-36f585c2befa tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:58.033702 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ab553db7-2233-4d92-8511-36f585c2befa tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1837a483e4624787801bfc3411566003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907d9430adfe43b1a29a92b24d1d9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:58.045999 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ab553db7-2233-4d92-8511-36f585c2befa tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] 10.222.0.23 "GET /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c" status: 200 len: 1314 microversion: 2.1 time: 0.345701 Aug 04 17:08:58.047324 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2694/5503] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:57 2022] GET /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:58.559387 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-75d7fd9a-20f2-4315-9042-d0fa209237a3 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:58.559997 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-75d7fd9a-20f2-4315-9042-d0fa209237a3 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: d4d7425d-33f4-4a0a-bb03-4c02f23bd843] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:58.568104 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-75d7fd9a-20f2-4315-9042-d0fa209237a3 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:58.568916 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-75d7fd9a-20f2-4315-9042-d0fa209237a3 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:58.569983 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-75d7fd9a-20f2-4315-9042-d0fa209237a3 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:58.570611 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-75d7fd9a-20f2-4315-9042-d0fa209237a3 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:58.847575 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-75d7fd9a-20f2-4315-9042-d0fa209237a3 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce8bf1816648ac97dcceea91556ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af166c943aa6480b92dd1762ac5e4176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:58.860252 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-75d7fd9a-20f2-4315-9042-d0fa209237a3 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "GET /compute/v2.1/servers/d4d7425d-33f4-4a0a-bb03-4c02f23bd843" status: 200 len: 1313 microversion: 2.1 time: 0.304577 Aug 04 17:08:58.861905 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2810/5504] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:58 2022] GET /compute/v2.1/servers/d4d7425d-33f4-4a0a-bb03-4c02f23bd843 => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:59.067856 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-80f2778a-ff18-41f9-a861-0b08a17a16e3 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:59.069698 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-80f2778a-ff18-41f9-a861-0b08a17a16e3 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] [instance: 35918880-3ff3-4163-97af-b7e794421b4c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:59.077770 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-80f2778a-ff18-41f9-a861-0b08a17a16e3 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:59.078605 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-80f2778a-ff18-41f9-a861-0b08a17a16e3 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:59.079673 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-80f2778a-ff18-41f9-a861-0b08a17a16e3 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:59.080333 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-80f2778a-ff18-41f9-a861-0b08a17a16e3 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:59.680650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-80f2778a-ff18-41f9-a861-0b08a17a16e3 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1837a483e4624787801bfc3411566003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907d9430adfe43b1a29a92b24d1d9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:59.691482 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-80f2778a-ff18-41f9-a861-0b08a17a16e3 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] 10.222.0.23 "GET /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c" status: 200 len: 1314 microversion: 2.1 time: 0.627594 Aug 04 17:08:59.692060 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2695/5505] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:59 2022] GET /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c => generated 1314 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:59.831317 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-8301465b-79a4-4d9e-89db-25ac509e17b5 req-3b7175c9-c635-4f64-96cf-79b71a2d2474 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4d7425d-33f4-4a0a-bb03-4c02f23bd843", "tag": "2d9d601e-a99c-4681-a1cd-80e601a42acf"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:59.858062 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-8301465b-79a4-4d9e-89db-25ac509e17b5 req-3b7175c9-c635-4f64-96cf-79b71a2d2474 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:59.858753 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-8301465b-79a4-4d9e-89db-25ac509e17b5 req-3b7175c9-c635-4f64-96cf-79b71a2d2474 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:59.873949 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-8301465b-79a4-4d9e-89db-25ac509e17b5 req-3b7175c9-c635-4f64-96cf-79b71a2d2474 service nova] Creating event network-changed:2d9d601e-a99c-4681-a1cd-80e601a42acf for instance d4d7425d-33f4-4a0a-bb03-4c02f23bd843 on n-h1-846466-12 Aug 04 17:08:59.883228 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cfaa42c1-070a-4a5f-8d10-f2a4d08ba4cd tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:59.884197 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cfaa42c1-070a-4a5f-8d10-f2a4d08ba4cd tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: d4d7425d-33f4-4a0a-bb03-4c02f23bd843] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:59.895419 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cfaa42c1-070a-4a5f-8d10-f2a4d08ba4cd tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:59.900218 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-8301465b-79a4-4d9e-89db-25ac509e17b5 req-3b7175c9-c635-4f64-96cf-79b71a2d2474 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079630 Aug 04 17:08:59.902627 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2811/5506] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:59.905414 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cfaa42c1-070a-4a5f-8d10-f2a4d08ba4cd tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:59.906538 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cfaa42c1-070a-4a5f-8d10-f2a4d08ba4cd tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:59.907072 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cfaa42c1-070a-4a5f-8d10-f2a4d08ba4cd tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:59.923371 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-3c76b0e2-ff80-4038-8ed1-d842496fe94e req-0c98e035-8df6-4c3b-9d42-8f1618433f8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35918880-3ff3-4163-97af-b7e794421b4c", "name": "network-vif-plugged", "status": "completed", "tag": "f902e0b1-7012-4c81-ba91-22e451d7485f"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:59.936230 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-3c76b0e2-ff80-4038-8ed1-d842496fe94e req-0c98e035-8df6-4c3b-9d42-8f1618433f8c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:08:59.936879 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-3c76b0e2-ff80-4038-8ed1-d842496fe94e req-0c98e035-8df6-4c3b-9d42-8f1618433f8c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:08:59.955193 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=100 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:59.963693 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-3c76b0e2-ff80-4038-8ed1-d842496fe94e req-0c98e035-8df6-4c3b-9d42-8f1618433f8c service nova] Creating event network-vif-plugged:f902e0b1-7012-4c81-ba91-22e451d7485f for instance 35918880-3ff3-4163-97af-b7e794421b4c on n-h1-846466-12 Aug 04 17:08:59.974926 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-3c76b0e2-ff80-4038-8ed1-d842496fe94e req-0c98e035-8df6-4c3b-9d42-8f1618433f8c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056150 Aug 04 17:08:59.977114 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2812/5507] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:09:00.495239 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cfaa42c1-070a-4a5f-8d10-f2a4d08ba4cd tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce8bf1816648ac97dcceea91556ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af166c943aa6480b92dd1762ac5e4176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:00.508085 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cfaa42c1-070a-4a5f-8d10-f2a4d08ba4cd tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "GET /compute/v2.1/servers/d4d7425d-33f4-4a0a-bb03-4c02f23bd843" status: 200 len: 1313 microversion: 2.1 time: 0.630399 Aug 04 17:09:00.524989 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2696/5508] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:59 2022] GET /compute/v2.1/servers/d4d7425d-33f4-4a0a-bb03-4c02f23bd843 => generated 1313 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:00.713587 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ecb0b990-d524-4a08-814f-e3b5b916da55 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:00.714709 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ecb0b990-d524-4a08-814f-e3b5b916da55 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] [instance: 35918880-3ff3-4163-97af-b7e794421b4c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:00.721774 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ecb0b990-d524-4a08-814f-e3b5b916da55 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:00.722566 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ecb0b990-d524-4a08-814f-e3b5b916da55 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:00.723570 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ecb0b990-d524-4a08-814f-e3b5b916da55 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:00.724214 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ecb0b990-d524-4a08-814f-e3b5b916da55 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:01.050382 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ecb0b990-d524-4a08-814f-e3b5b916da55 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1837a483e4624787801bfc3411566003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907d9430adfe43b1a29a92b24d1d9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:01.058705 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ecb0b990-d524-4a08-814f-e3b5b916da55 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] 10.222.0.23 "GET /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c" status: 200 len: 1314 microversion: 2.1 time: 0.350287 Aug 04 17:09:01.060133 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2813/5509] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:00 2022] GET /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:01.534356 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2a05c789-6b39-4912-8fc2-84ff40b6e98b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:01.536684 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2a05c789-6b39-4912-8fc2-84ff40b6e98b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: d4d7425d-33f4-4a0a-bb03-4c02f23bd843] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:01.558411 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a05c789-6b39-4912-8fc2-84ff40b6e98b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:01.559242 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a05c789-6b39-4912-8fc2-84ff40b6e98b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:01.560293 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a05c789-6b39-4912-8fc2-84ff40b6e98b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:01.562245 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2a05c789-6b39-4912-8fc2-84ff40b6e98b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:01.871433 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2a05c789-6b39-4912-8fc2-84ff40b6e98b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce8bf1816648ac97dcceea91556ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af166c943aa6480b92dd1762ac5e4176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:01.883097 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2a05c789-6b39-4912-8fc2-84ff40b6e98b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "GET /compute/v2.1/servers/d4d7425d-33f4-4a0a-bb03-4c02f23bd843" status: 200 len: 1313 microversion: 2.1 time: 0.352965 Aug 04 17:09:01.883642 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2697/5510] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:01 2022] GET /compute/v2.1/servers/d4d7425d-33f4-4a0a-bb03-4c02f23bd843 => generated 1313 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:02.081049 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b1f1d3c5-2055-4eeb-8167-9fcec481617a tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:02.081684 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b1f1d3c5-2055-4eeb-8167-9fcec481617a tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] [instance: 35918880-3ff3-4163-97af-b7e794421b4c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:02.092234 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b1f1d3c5-2055-4eeb-8167-9fcec481617a tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:02.096673 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b1f1d3c5-2055-4eeb-8167-9fcec481617a tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:02.097693 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b1f1d3c5-2055-4eeb-8167-9fcec481617a tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:02.098225 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b1f1d3c5-2055-4eeb-8167-9fcec481617a tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:02.620423 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b1f1d3c5-2055-4eeb-8167-9fcec481617a tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1837a483e4624787801bfc3411566003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907d9430adfe43b1a29a92b24d1d9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:02.628709 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b1f1d3c5-2055-4eeb-8167-9fcec481617a tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] 10.222.0.23 "GET /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c" status: 200 len: 1314 microversion: 2.1 time: 0.551455 Aug 04 17:09:02.634461 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2814/5511] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:02 2022] GET /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:02.906274 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f8a8fddb-4436-4350-a756-31bf8252287d tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:02.907060 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f8a8fddb-4436-4350-a756-31bf8252287d tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: d4d7425d-33f4-4a0a-bb03-4c02f23bd843] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:02.932942 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f8a8fddb-4436-4350-a756-31bf8252287d tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:02.933844 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f8a8fddb-4436-4350-a756-31bf8252287d tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:02.935013 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f8a8fddb-4436-4350-a756-31bf8252287d tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:02.935815 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f8a8fddb-4436-4350-a756-31bf8252287d tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:03.278267 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f8a8fddb-4436-4350-a756-31bf8252287d tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce8bf1816648ac97dcceea91556ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af166c943aa6480b92dd1762ac5e4176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:03.292832 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f8a8fddb-4436-4350-a756-31bf8252287d tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "GET /compute/v2.1/servers/d4d7425d-33f4-4a0a-bb03-4c02f23bd843" status: 200 len: 1313 microversion: 2.1 time: 0.392368 Aug 04 17:09:03.294965 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2698/5512] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:02 2022] GET /compute/v2.1/servers/d4d7425d-33f4-4a0a-bb03-4c02f23bd843 => generated 1313 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:03.653833 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-595c32ea-c8db-4f28-ad99-62950e38dac9 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:03.655012 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-595c32ea-c8db-4f28-ad99-62950e38dac9 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] [instance: 35918880-3ff3-4163-97af-b7e794421b4c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:03.665614 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-595c32ea-c8db-4f28-ad99-62950e38dac9 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:03.666269 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-595c32ea-c8db-4f28-ad99-62950e38dac9 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:03.667547 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-595c32ea-c8db-4f28-ad99-62950e38dac9 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:03.668142 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-595c32ea-c8db-4f28-ad99-62950e38dac9 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:03.872700 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-595c32ea-c8db-4f28-ad99-62950e38dac9 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1837a483e4624787801bfc3411566003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907d9430adfe43b1a29a92b24d1d9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:03.881950 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-595c32ea-c8db-4f28-ad99-62950e38dac9 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] 10.222.0.23 "GET /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c" status: 200 len: 1464 microversion: 2.1 time: 0.233175 Aug 04 17:09:03.893864 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2815/5513] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:03 2022] GET /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c => generated 1464 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:03.919249 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3723742f-a53a-4f8b-a58e-008acd36d9c1 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6b21979-f74a-4c26-a3ef-55d7185843d0", "device": "/dev/sdb"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:03.924099 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3723742f-a53a-4f8b-a58e-008acd36d9c1 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] [instance: 35918880-3ff3-4163-97af-b7e794421b4c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:03.937519 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3723742f-a53a-4f8b-a58e-008acd36d9c1 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:03.938494 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3723742f-a53a-4f8b-a58e-008acd36d9c1 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:03.940070 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3723742f-a53a-4f8b-a58e-008acd36d9c1 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:03.941495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3723742f-a53a-4f8b-a58e-008acd36d9c1 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:04.239437 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:04.322110 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-865e2c7d-63b9-4da2-a685-aa2d1773b5c5 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:04.339000 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-865e2c7d-63b9-4da2-a685-aa2d1773b5c5 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: d4d7425d-33f4-4a0a-bb03-4c02f23bd843] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:04.352222 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-865e2c7d-63b9-4da2-a685-aa2d1773b5c5 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:04.352686 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-865e2c7d-63b9-4da2-a685-aa2d1773b5c5 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:04.353550 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-865e2c7d-63b9-4da2-a685-aa2d1773b5c5 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:04.354180 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-865e2c7d-63b9-4da2-a685-aa2d1773b5c5 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:04.407386 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3723742f-a53a-4f8b-a58e-008acd36d9c1 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] 10.222.0.23 "POST /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.504460 Aug 04 17:09:04.432221 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2699/5514] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Aug 4 17:09:03 2022] POST /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c/os-volume_attachments => generated 194 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:09:04.639947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-865e2c7d-63b9-4da2-a685-aa2d1773b5c5 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce8bf1816648ac97dcceea91556ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af166c943aa6480b92dd1762ac5e4176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:04.652437 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-865e2c7d-63b9-4da2-a685-aa2d1773b5c5 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "GET /compute/v2.1/servers/d4d7425d-33f4-4a0a-bb03-4c02f23bd843" status: 200 len: 1313 microversion: 2.1 time: 0.335505 Aug 04 17:09:04.654011 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2816/5515] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:04 2022] GET /compute/v2.1/servers/d4d7425d-33f4-4a0a-bb03-4c02f23bd843 => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:05.696420 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-478cb7e6-e416-4c8f-b18a-c45a12b8780e tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:05.701476 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-478cb7e6-e416-4c8f-b18a-c45a12b8780e tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: d4d7425d-33f4-4a0a-bb03-4c02f23bd843] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:05.713247 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=8 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:05.754392 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-478cb7e6-e416-4c8f-b18a-c45a12b8780e tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:05.755039 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-478cb7e6-e416-4c8f-b18a-c45a12b8780e tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:05.756413 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-478cb7e6-e416-4c8f-b18a-c45a12b8780e tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:05.758627 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-478cb7e6-e416-4c8f-b18a-c45a12b8780e tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:06.179409 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-478cb7e6-e416-4c8f-b18a-c45a12b8780e tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce8bf1816648ac97dcceea91556ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af166c943aa6480b92dd1762ac5e4176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:06.189959 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-478cb7e6-e416-4c8f-b18a-c45a12b8780e tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "GET /compute/v2.1/servers/d4d7425d-33f4-4a0a-bb03-4c02f23bd843" status: 200 len: 1313 microversion: 2.1 time: 0.515286 Aug 04 17:09:06.190641 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2700/5516] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:05 2022] GET /compute/v2.1/servers/d4d7425d-33f4-4a0a-bb03-4c02f23bd843 => generated 1313 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:07.211010 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b0f8ef5f-a7ac-46ae-8826-8c44613be1c7 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:07.212318 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b0f8ef5f-a7ac-46ae-8826-8c44613be1c7 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: d4d7425d-33f4-4a0a-bb03-4c02f23bd843] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:07.229838 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0f8ef5f-a7ac-46ae-8826-8c44613be1c7 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:07.230493 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0f8ef5f-a7ac-46ae-8826-8c44613be1c7 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:07.231501 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0f8ef5f-a7ac-46ae-8826-8c44613be1c7 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:07.232119 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0f8ef5f-a7ac-46ae-8826-8c44613be1c7 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:07.314350 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=100 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:08.195702 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b0f8ef5f-a7ac-46ae-8826-8c44613be1c7 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce8bf1816648ac97dcceea91556ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af166c943aa6480b92dd1762ac5e4176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:08.208244 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b0f8ef5f-a7ac-46ae-8826-8c44613be1c7 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "GET /compute/v2.1/servers/d4d7425d-33f4-4a0a-bb03-4c02f23bd843" status: 200 len: 1313 microversion: 2.1 time: 1.001362 Aug 04 17:09:08.210271 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2817/5517] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:07 2022] GET /compute/v2.1/servers/d4d7425d-33f4-4a0a-bb03-4c02f23bd843 => generated 1313 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:08.830782 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-4a68fc89-3003-4697-ab02-04e23daf208c req-de648b0a-bd3a-4187-8efd-a5fd55ae37cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4d7425d-33f4-4a0a-bb03-4c02f23bd843", "name": "network-vif-plugged", "status": "completed", "tag": "2d9d601e-a99c-4681-a1cd-80e601a42acf"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:08.862230 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-4a68fc89-3003-4697-ab02-04e23daf208c req-de648b0a-bd3a-4187-8efd-a5fd55ae37cb service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:08.862783 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-4a68fc89-3003-4697-ab02-04e23daf208c req-de648b0a-bd3a-4187-8efd-a5fd55ae37cb service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:08.893418 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-4a68fc89-3003-4697-ab02-04e23daf208c req-de648b0a-bd3a-4187-8efd-a5fd55ae37cb service nova] Creating event network-vif-plugged:2d9d601e-a99c-4681-a1cd-80e601a42acf for instance d4d7425d-33f4-4a0a-bb03-4c02f23bd843 on n-h1-846466-12 Aug 04 17:09:08.906391 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-4a68fc89-3003-4697-ab02-04e23daf208c req-de648b0a-bd3a-4187-8efd-a5fd55ae37cb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080556 Aug 04 17:09:08.910027 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2701/5518] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:09:09.230908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-336f1088-706d-43c4-b441-33c8178dec0f tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:09.232255 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-336f1088-706d-43c4-b441-33c8178dec0f tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: d4d7425d-33f4-4a0a-bb03-4c02f23bd843] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:09.256149 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-336f1088-706d-43c4-b441-33c8178dec0f tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:09.256991 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-336f1088-706d-43c4-b441-33c8178dec0f tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:09.258148 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-336f1088-706d-43c4-b441-33c8178dec0f tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:09.264022 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-336f1088-706d-43c4-b441-33c8178dec0f tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:09.623159 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-336f1088-706d-43c4-b441-33c8178dec0f tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce8bf1816648ac97dcceea91556ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af166c943aa6480b92dd1762ac5e4176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:09.631645 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-336f1088-706d-43c4-b441-33c8178dec0f tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "GET /compute/v2.1/servers/d4d7425d-33f4-4a0a-bb03-4c02f23bd843" status: 200 len: 1313 microversion: 2.1 time: 0.404464 Aug 04 17:09:09.655670 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2818/5519] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:09 2022] GET /compute/v2.1/servers/d4d7425d-33f4-4a0a-bb03-4c02f23bd843 => generated 1313 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:10.668357 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-07f40bb9-e3b5-4a86-a525-3ec0d83e913a tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:10.669208 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-07f40bb9-e3b5-4a86-a525-3ec0d83e913a tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: d4d7425d-33f4-4a0a-bb03-4c02f23bd843] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:10.696981 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-07f40bb9-e3b5-4a86-a525-3ec0d83e913a tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:10.701246 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-07f40bb9-e3b5-4a86-a525-3ec0d83e913a tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:10.702306 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-07f40bb9-e3b5-4a86-a525-3ec0d83e913a tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:10.702948 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-07f40bb9-e3b5-4a86-a525-3ec0d83e913a tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:11.283709 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-07f40bb9-e3b5-4a86-a525-3ec0d83e913a tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce8bf1816648ac97dcceea91556ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af166c943aa6480b92dd1762ac5e4176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:11.298378 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-07f40bb9-e3b5-4a86-a525-3ec0d83e913a tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "GET /compute/v2.1/servers/d4d7425d-33f4-4a0a-bb03-4c02f23bd843" status: 200 len: 1497 microversion: 2.1 time: 0.638996 Aug 04 17:09:11.301515 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2702/5520] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:10 2022] GET /compute/v2.1/servers/d4d7425d-33f4-4a0a-bb03-4c02f23bd843 => generated 1497 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:12.133258 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-512bed23-fa1d-4b01-9e18-ec2ed81369ed tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:12.134377 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-512bed23-fa1d-4b01-9e18-ec2ed81369ed tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: d4d7425d-33f4-4a0a-bb03-4c02f23bd843] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:12.142520 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-512bed23-fa1d-4b01-9e18-ec2ed81369ed tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:12.142883 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-512bed23-fa1d-4b01-9e18-ec2ed81369ed tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:12.143711 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-512bed23-fa1d-4b01-9e18-ec2ed81369ed tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:12.144132 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-512bed23-fa1d-4b01-9e18-ec2ed81369ed tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:12.182747 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-512bed23-fa1d-4b01-9e18-ec2ed81369ed tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: d4d7425d-33f4-4a0a-bb03-4c02f23bd843] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:09:12.319628 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-512bed23-fa1d-4b01-9e18-ec2ed81369ed tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d4d7425d-33f4-4a0a-bb03-4c02f23bd843" status: 204 len: 0 microversion: 2.1 time: 0.189453 Aug 04 17:09:12.321434 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2819/5521] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:09:12 2022] DELETE /compute/v2.1/servers/d4d7425d-33f4-4a0a-bb03-4c02f23bd843 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:09:12.334840 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-49f48ac5-5449-4375-a32f-12d069ec9fa7 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:12.336280 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-49f48ac5-5449-4375-a32f-12d069ec9fa7 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: d4d7425d-33f4-4a0a-bb03-4c02f23bd843] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:12.346987 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:12.349914 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-49f48ac5-5449-4375-a32f-12d069ec9fa7 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:12.350613 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-49f48ac5-5449-4375-a32f-12d069ec9fa7 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:12.351576 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-49f48ac5-5449-4375-a32f-12d069ec9fa7 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:12.352181 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-49f48ac5-5449-4375-a32f-12d069ec9fa7 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:12.855755 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-49f48ac5-5449-4375-a32f-12d069ec9fa7 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce8bf1816648ac97dcceea91556ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af166c943aa6480b92dd1762ac5e4176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:12.885457 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-49f48ac5-5449-4375-a32f-12d069ec9fa7 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "GET /compute/v2.1/servers/d4d7425d-33f4-4a0a-bb03-4c02f23bd843" status: 200 len: 1503 microversion: 2.1 time: 0.558254 Aug 04 17:09:12.886105 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2703/5522] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:12 2022] GET /compute/v2.1/servers/d4d7425d-33f4-4a0a-bb03-4c02f23bd843 => generated 1503 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:09:13.911781 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-961a70b8-c173-4266-bf71-8f61eae9b4e4 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:13.913132 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-961a70b8-c173-4266-bf71-8f61eae9b4e4 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: d4d7425d-33f4-4a0a-bb03-4c02f23bd843] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:13.923006 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:13.926070 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-961a70b8-c173-4266-bf71-8f61eae9b4e4 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:13.926854 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-961a70b8-c173-4266-bf71-8f61eae9b4e4 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:13.927829 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-961a70b8-c173-4266-bf71-8f61eae9b4e4 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:13.928376 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-961a70b8-c173-4266-bf71-8f61eae9b4e4 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:14.422071 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-961a70b8-c173-4266-bf71-8f61eae9b4e4 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce8bf1816648ac97dcceea91556ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af166c943aa6480b92dd1762ac5e4176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:14.430247 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-961a70b8-c173-4266-bf71-8f61eae9b4e4 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "GET /compute/v2.1/servers/d4d7425d-33f4-4a0a-bb03-4c02f23bd843" status: 200 len: 1503 microversion: 2.1 time: 0.524134 Aug 04 17:09:14.431441 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2820/5523] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:13 2022] GET /compute/v2.1/servers/d4d7425d-33f4-4a0a-bb03-4c02f23bd843 => generated 1503 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:09:15.045732 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3a574819-ea8c-4136-83b7-62efda591242 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:15.049614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3a574819-ea8c-4136-83b7-62efda591242 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:15.062647 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a574819-ea8c-4136-83b7-62efda591242 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:15.063511 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a574819-ea8c-4136-83b7-62efda591242 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:15.064585 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a574819-ea8c-4136-83b7-62efda591242 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:15.066389 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a574819-ea8c-4136-83b7-62efda591242 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:15.410409 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-9c4a8048-e09b-49d8-a178-96fa7906b8ec req-764f4239-aa71-4165-b911-f0a32ce5dec3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4d7425d-33f4-4a0a-bb03-4c02f23bd843", "name": "network-vif-deleted", "tag": "2d9d601e-a99c-4681-a1cd-80e601a42acf"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:15.434148 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-9c4a8048-e09b-49d8-a178-96fa7906b8ec req-764f4239-aa71-4165-b911-f0a32ce5dec3 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:15.434912 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-9c4a8048-e09b-49d8-a178-96fa7906b8ec req-764f4239-aa71-4165-b911-f0a32ce5dec3 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:15.460729 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-9c4a8048-e09b-49d8-a178-96fa7906b8ec req-764f4239-aa71-4165-b911-f0a32ce5dec3 service nova] Creating event network-vif-deleted:2d9d601e-a99c-4681-a1cd-80e601a42acf for instance d4d7425d-33f4-4a0a-bb03-4c02f23bd843 on n-h1-846466-12 Aug 04 17:09:15.479027 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-9c4a8048-e09b-49d8-a178-96fa7906b8ec req-764f4239-aa71-4165-b911-f0a32ce5dec3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065782 Aug 04 17:09:15.479735 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2821/5524] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:09:15.488659 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-761235a7-e4a4-45f3-b44f-375d539d616c tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:15.489445 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-761235a7-e4a4-45f3-b44f-375d539d616c tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: d4d7425d-33f4-4a0a-bb03-4c02f23bd843] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:15.507572 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-761235a7-e4a4-45f3-b44f-375d539d616c tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:15.509363 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-761235a7-e4a4-45f3-b44f-375d539d616c tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:15.510199 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-761235a7-e4a4-45f3-b44f-375d539d616c tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:15.510636 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-761235a7-e4a4-45f3-b44f-375d539d616c tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:15.592475 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3a574819-ea8c-4136-83b7-62efda591242 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.552366 Aug 04 17:09:15.593304 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2704/5525] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:09:15 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296/os-volume_attachments => generated 25 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 17:09:15.684001 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b844594a-e289-4f53-b121-2ab0f51aa8f4 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:15.684878 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b844594a-e289-4f53-b121-2ab0f51aa8f4 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:15.692251 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b844594a-e289-4f53-b121-2ab0f51aa8f4 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:15.693088 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b844594a-e289-4f53-b121-2ab0f51aa8f4 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:15.694691 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b844594a-e289-4f53-b121-2ab0f51aa8f4 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:15.695241 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b844594a-e289-4f53-b121-2ab0f51aa8f4 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:15.708028 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-761235a7-e4a4-45f3-b44f-375d539d616c tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce8bf1816648ac97dcceea91556ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af166c943aa6480b92dd1762ac5e4176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:15.718089 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-761235a7-e4a4-45f3-b44f-375d539d616c tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "GET /compute/v2.1/servers/d4d7425d-33f4-4a0a-bb03-4c02f23bd843" status: 200 len: 1298 microversion: 2.1 time: 0.235125 Aug 04 17:09:15.719057 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2822/5526] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:15 2022] GET /compute/v2.1/servers/d4d7425d-33f4-4a0a-bb03-4c02f23bd843 => generated 1298 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:15.747709 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b844594a-e289-4f53-b121-2ab0f51aa8f4 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:09:15.873756 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b844594a-e289-4f53-b121-2ab0f51aa8f4 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 204 len: 0 microversion: 2.1 time: 0.192217 Aug 04 17:09:15.877765 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2705/5527] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:09:15 2022] DELETE /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 17:09:15.883607 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6edc2abb-d98b-42f4-8c91-5a4796f798ef tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:15.884233 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6edc2abb-d98b-42f4-8c91-5a4796f798ef tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:15.890871 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6edc2abb-d98b-42f4-8c91-5a4796f798ef tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:15.891538 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6edc2abb-d98b-42f4-8c91-5a4796f798ef tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:15.897243 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6edc2abb-d98b-42f4-8c91-5a4796f798ef tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:15.898091 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6edc2abb-d98b-42f4-8c91-5a4796f798ef tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:16.383195 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6edc2abb-d98b-42f4-8c91-5a4796f798ef tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:16.394969 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6edc2abb-d98b-42f4-8c91-5a4796f798ef tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1675 microversion: 2.1 time: 0.515787 Aug 04 17:09:16.395879 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2823/5528] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:15 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1675 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:16.756164 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-edb63b32-4fc4-474c-aa36-021f4444eb09 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:16.758493 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-edb63b32-4fc4-474c-aa36-021f4444eb09 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: d4d7425d-33f4-4a0a-bb03-4c02f23bd843] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:16.771509 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-edb63b32-4fc4-474c-aa36-021f4444eb09 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:16.772346 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-edb63b32-4fc4-474c-aa36-021f4444eb09 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:16.773461 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-edb63b32-4fc4-474c-aa36-021f4444eb09 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:16.774131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-edb63b32-4fc4-474c-aa36-021f4444eb09 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:16.794335 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-edb63b32-4fc4-474c-aa36-021f4444eb09 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] HTTP exception thrown: Instance d4d7425d-33f4-4a0a-bb03-4c02f23bd843 could not be found. Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-edb63b32-4fc4-474c-aa36-021f4444eb09 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Request method failure captured: Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/d4d7425d-33f4-4a0a-bb03-4c02f23bd843 HTTP/1.1 Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_0ftk_qbSMNU2OZMimBrt2waIqfVjyA65yZbprenX3QxWQ7AL3rABhu6TLq0rFZSy8coFvi0u4PaYkMM2C8BWEdLJD-g8yaE3bpERWrArawMw9e12zsVFBhhlBdOz--6VjPChu0LvDl_C38GO1rKieER__CniOdx2XZrSxMfIqVrPc Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: af166c943aa6480b92dd1762ac5e4176 Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-VolumesActionsTest-425500951 Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/af166c943aa6480b92dd1762ac5e4176"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_af166c943aa6480b92dd1762ac5e4176"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/af166c943aa6480b92dd1762ac5e4176"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/af166c943aa6480b92dd1762ac5e4176"}]}] Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-VolumesActionsTest-425500951 Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: af166c943aa6480b92dd1762ac5e4176 Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-VolumesActionsTest-425500951 Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-VolumesActionsTest-425500951-project Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: f9ce8bf1816648ac97dcceea91556ad8 Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-VolumesActionsTest-425500951-project Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance d4d7425d-33f4-4a0a-bb03-4c02f23bd843 could not be found. Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'd4d7425d-33f4-4a0a-bb03-4c02f23bd843'} Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4d7425d-33f4-4a0a-bb03-4c02f23bd843 could not be found. Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4d7425d-33f4-4a0a-bb03-4c02f23bd843 could not be found. Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:09:16.796479 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:09:16.801518 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:09:16.801518 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:09:16.801518 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:09:16.801518 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:09:16.801518 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:09:16.801518 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4d7425d-33f4-4a0a-bb03-4c02f23bd843 could not be found. Aug 04 17:09:16.801518 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:09:16.803362 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-edb63b32-4fc4-474c-aa36-021f4444eb09 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Returning 404 to user: Instance d4d7425d-33f4-4a0a-bb03-4c02f23bd843 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:09:16.805337 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-edb63b32-4fc4-474c-aa36-021f4444eb09 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "GET /compute/v2.1/servers/d4d7425d-33f4-4a0a-bb03-4c02f23bd843" status: 404 len: 111 microversion: 2.1 time: 0.065389 Aug 04 17:09:16.806509 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2706/5529] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:16 2022] GET /compute/v2.1/servers/d4d7425d-33f4-4a0a-bb03-4c02f23bd843 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:09:17.003397 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cfe8c0a8-b02a-4b01-8453-aca2effac766 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-608454996", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "43b69fc9-32f7-47a3-bb2a-2e6553e0c94a"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:17.073504 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-cfe8c0a8-b02a-4b01-8453-aca2effac766 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] validate_networks() for [('43b69fc9-32f7-47a3-bb2a-2e6553e0c94a', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:09:17.420251 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-93725b49-6a8b-4713-a12f-a331747aeb99 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:17.421154 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-93725b49-6a8b-4713-a12f-a331747aeb99 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:17.430011 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-93725b49-6a8b-4713-a12f-a331747aeb99 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:17.430748 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-93725b49-6a8b-4713-a12f-a331747aeb99 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:17.432162 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-93725b49-6a8b-4713-a12f-a331747aeb99 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:17.433212 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-93725b49-6a8b-4713-a12f-a331747aeb99 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:17.895077 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-93725b49-6a8b-4713-a12f-a331747aeb99 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:17.914357 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-93725b49-6a8b-4713-a12f-a331747aeb99 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1675 microversion: 2.1 time: 0.499024 Aug 04 17:09:17.918811 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2707/5530] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:17 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1675 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:09:18.936914 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-440519d5-a159-4ff6-8d9c-35ac5ffd9147 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:18.937621 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-440519d5-a159-4ff6-8d9c-35ac5ffd9147 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:18.945058 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-440519d5-a159-4ff6-8d9c-35ac5ffd9147 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:18.945640 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-440519d5-a159-4ff6-8d9c-35ac5ffd9147 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:18.946622 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-440519d5-a159-4ff6-8d9c-35ac5ffd9147 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:18.947079 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-440519d5-a159-4ff6-8d9c-35ac5ffd9147 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:18.955343 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-cfe8c0a8-b02a-4b01-8453-aca2effac766 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:09:18.956776 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-cfe8c0a8-b02a-4b01-8453-aca2effac766 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:09:18.957734 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-cfe8c0a8-b02a-4b01-8453-aca2effac766 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:09:18.958451 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-cfe8c0a8-b02a-4b01-8453-aca2effac766 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:09:18.959559 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-cfe8c0a8-b02a-4b01-8453-aca2effac766 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:09:18.973948 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cfe8c0a8-b02a-4b01-8453-aca2effac766 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:18.975264 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cfe8c0a8-b02a-4b01-8453-aca2effac766 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:18.977242 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cfe8c0a8-b02a-4b01-8453-aca2effac766 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:18.978140 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cfe8c0a8-b02a-4b01-8453-aca2effac766 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:19.004300 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-cfe8c0a8-b02a-4b01-8453-aca2effac766 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Getting quotas for project af166c943aa6480b92dd1762ac5e4176. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:09:19.011240 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-cfe8c0a8-b02a-4b01-8453-aca2effac766 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Getting quotas for user f9ce8bf1816648ac97dcceea91556ad8 and project af166c943aa6480b92dd1762ac5e4176. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:09:19.028368 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cfe8c0a8-b02a-4b01-8453-aca2effac766 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:09:19.031007 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cfe8c0a8-b02a-4b01-8453-aca2effac766 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: c6c3399a-cbe5-44ff-a72d-24af568cdab0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:09:19.134047 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cfe8c0a8-b02a-4b01-8453-aca2effac766 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.135403 Aug 04 17:09:19.139666 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2824/5531] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:09:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:09:19.153446 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-66dfbbe7-72c8-4bdb-8717-946ce640405b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:19.154677 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-66dfbbe7-72c8-4bdb-8717-946ce640405b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: c6c3399a-cbe5-44ff-a72d-24af568cdab0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:19.343287 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-66dfbbe7-72c8-4bdb-8717-946ce640405b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce8bf1816648ac97dcceea91556ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af166c943aa6480b92dd1762ac5e4176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:19.354295 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-66dfbbe7-72c8-4bdb-8717-946ce640405b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "GET /compute/v2.1/servers/c6c3399a-cbe5-44ff-a72d-24af568cdab0" status: 200 len: 1213 microversion: 2.1 time: 0.209531 Aug 04 17:09:19.362122 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2825/5532] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:19 2022] GET /compute/v2.1/servers/c6c3399a-cbe5-44ff-a72d-24af568cdab0 => generated 1213 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:19.526070 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-440519d5-a159-4ff6-8d9c-35ac5ffd9147 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:19.536616 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-440519d5-a159-4ff6-8d9c-35ac5ffd9147 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1675 microversion: 2.1 time: 0.604365 Aug 04 17:09:19.548912 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2708/5533] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:18 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1675 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:09:20.397794 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f82c1757-2559-45f6-8352-857f5e17c71f tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:20.399085 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f82c1757-2559-45f6-8352-857f5e17c71f tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: c6c3399a-cbe5-44ff-a72d-24af568cdab0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:20.419798 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f82c1757-2559-45f6-8352-857f5e17c71f tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:20.421974 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f82c1757-2559-45f6-8352-857f5e17c71f tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:20.423511 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f82c1757-2559-45f6-8352-857f5e17c71f tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:20.425553 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f82c1757-2559-45f6-8352-857f5e17c71f tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:20.564880 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dd43586e-580b-4ce0-b30c-a26548e528ee tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:20.565814 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-dd43586e-580b-4ce0-b30c-a26548e528ee tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:20.597686 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd43586e-580b-4ce0-b30c-a26548e528ee tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:20.598128 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd43586e-580b-4ce0-b30c-a26548e528ee tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:20.598942 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd43586e-580b-4ce0-b30c-a26548e528ee tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:20.599553 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd43586e-580b-4ce0-b30c-a26548e528ee tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:20.777486 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f82c1757-2559-45f6-8352-857f5e17c71f tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce8bf1816648ac97dcceea91556ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af166c943aa6480b92dd1762ac5e4176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:20.794699 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f82c1757-2559-45f6-8352-857f5e17c71f tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "GET /compute/v2.1/servers/c6c3399a-cbe5-44ff-a72d-24af568cdab0" status: 200 len: 1273 microversion: 2.1 time: 0.400445 Aug 04 17:09:20.795760 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2826/5534] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:20 2022] GET /compute/v2.1/servers/c6c3399a-cbe5-44ff-a72d-24af568cdab0 => generated 1273 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:20.993038 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-dd43586e-580b-4ce0-b30c-a26548e528ee tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:21.009402 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dd43586e-580b-4ce0-b30c-a26548e528ee tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1607 microversion: 2.1 time: 0.451553 Aug 04 17:09:21.009998 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2709/5535] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:20 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1607 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:21.511826 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-8f640c78-61d6-4f7d-b3bf-64d55d8c4b9c req-b01fe463-cd4a-4afe-8d26-5699fe223d85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffb04e5e-6da9-40bd-87f2-1d914893b296", "name": "network-vif-deleted", "tag": "df60c13d-990a-4651-b538-bba81604b9ef"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:21.534536 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-8f640c78-61d6-4f7d-b3bf-64d55d8c4b9c req-b01fe463-cd4a-4afe-8d26-5699fe223d85 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:21.535249 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-8f640c78-61d6-4f7d-b3bf-64d55d8c4b9c req-b01fe463-cd4a-4afe-8d26-5699fe223d85 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:21.563624 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-8f640c78-61d6-4f7d-b3bf-64d55d8c4b9c req-b01fe463-cd4a-4afe-8d26-5699fe223d85 service nova] Creating event network-vif-deleted:df60c13d-990a-4651-b538-bba81604b9ef for instance ffb04e5e-6da9-40bd-87f2-1d914893b296 on n-h2-846466-12 Aug 04 17:09:21.575845 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-8f640c78-61d6-4f7d-b3bf-64d55d8c4b9c req-b01fe463-cd4a-4afe-8d26-5699fe223d85 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067778 Aug 04 17:09:21.581178 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2827/5536] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:09:21.818154 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-49a98ea6-437e-48bd-b257-32e3f1c68452 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:21.819269 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-49a98ea6-437e-48bd-b257-32e3f1c68452 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: c6c3399a-cbe5-44ff-a72d-24af568cdab0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:21.833788 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-49a98ea6-437e-48bd-b257-32e3f1c68452 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:21.834296 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-49a98ea6-437e-48bd-b257-32e3f1c68452 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:21.835192 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-49a98ea6-437e-48bd-b257-32e3f1c68452 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:21.835647 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-49a98ea6-437e-48bd-b257-32e3f1c68452 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:22.001411 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-49a98ea6-437e-48bd-b257-32e3f1c68452 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce8bf1816648ac97dcceea91556ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af166c943aa6480b92dd1762ac5e4176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:22.016780 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-49a98ea6-437e-48bd-b257-32e3f1c68452 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "GET /compute/v2.1/servers/c6c3399a-cbe5-44ff-a72d-24af568cdab0" status: 200 len: 1271 microversion: 2.1 time: 0.203057 Aug 04 17:09:22.019974 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2710/5537] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:21 2022] GET /compute/v2.1/servers/c6c3399a-cbe5-44ff-a72d-24af568cdab0 => generated 1271 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:22.034208 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-812ef94f-4497-41b9-b84c-4d8032570572 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:22.035371 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-812ef94f-4497-41b9-b84c-4d8032570572 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:22.047851 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-812ef94f-4497-41b9-b84c-4d8032570572 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:22.051248 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-812ef94f-4497-41b9-b84c-4d8032570572 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:22.054060 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-812ef94f-4497-41b9-b84c-4d8032570572 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:22.055389 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-812ef94f-4497-41b9-b84c-4d8032570572 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:22.141247 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-812ef94f-4497-41b9-b84c-4d8032570572 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:22.144760 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-812ef94f-4497-41b9-b84c-4d8032570572 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:22.146475 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-812ef94f-4497-41b9-b84c-4d8032570572 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lazy-loading 'fault' on Instance uuid ffb04e5e-6da9-40bd-87f2-1d914893b296 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:09:22.283703 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-812ef94f-4497-41b9-b84c-4d8032570572 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:22.300951 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-812ef94f-4497-41b9-b84c-4d8032570572 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 200 len: 1328 microversion: 2.1 time: 0.270972 Aug 04 17:09:22.302246 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2828/5538] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:22 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 1328 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:23.050201 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-570c9c7c-8c1c-4e20-8b6a-97d5157ad4ff tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:23.050838 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-570c9c7c-8c1c-4e20-8b6a-97d5157ad4ff tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: c6c3399a-cbe5-44ff-a72d-24af568cdab0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:23.063390 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-570c9c7c-8c1c-4e20-8b6a-97d5157ad4ff tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:23.063845 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-570c9c7c-8c1c-4e20-8b6a-97d5157ad4ff tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:23.064664 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-570c9c7c-8c1c-4e20-8b6a-97d5157ad4ff tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:23.065140 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-570c9c7c-8c1c-4e20-8b6a-97d5157ad4ff tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:23.121402 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:23.324368 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-72bfb2a4-6884-49fc-b825-75296615af90 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:23.325966 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-72bfb2a4-6884-49fc-b825-75296615af90 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:23.344554 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-72bfb2a4-6884-49fc-b825-75296615af90 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:23.345547 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-72bfb2a4-6884-49fc-b825-75296615af90 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:23.346576 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-72bfb2a4-6884-49fc-b825-75296615af90 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:23.347181 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-72bfb2a4-6884-49fc-b825-75296615af90 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:23.371611 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-72bfb2a4-6884-49fc-b825-75296615af90 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] HTTP exception thrown: Instance ffb04e5e-6da9-40bd-87f2-1d914893b296 could not be found. Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-72bfb2a4-6884-49fc-b825-75296615af90 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Request method failure captured: Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 HTTP/1.1 Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_xkMobk0ocfazMP7hYnvVvbLVAvEwEb5REErGjzI9UZVqVc5FIWvv-QR9zFeWUsqPXILGrf-HGsaOZUgXdPhYGGxPWcnFslxIOM4z6icNcb_C59yr-YzD5BrDqo7SRDF0RJTLkguGfLyqsKN3GRHG1y9GVwuNwMdilQQw4Sdcx6c5s Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: a0ad199f31d04aa4ac7c6ba5925eb06b Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-AttachVolumeTestJSON-1542553691 Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a0ad199f31d04aa4ac7c6ba5925eb06b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a0ad199f31d04aa4ac7c6ba5925eb06b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a0ad199f31d04aa4ac7c6ba5925eb06b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a0ad199f31d04aa4ac7c6ba5925eb06b"}]}] Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-AttachVolumeTestJSON-1542553691 Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: a0ad199f31d04aa4ac7c6ba5925eb06b Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1542553691 Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-AttachVolumeTestJSON-1542553691-project Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: d8430522c580414d9798349ededbd6d2 Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-AttachVolumeTestJSON-1542553691-project Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance ffb04e5e-6da9-40bd-87f2-1d914893b296 could not be found. Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'ffb04e5e-6da9-40bd-87f2-1d914893b296'} Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffb04e5e-6da9-40bd-87f2-1d914893b296 could not be found. Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffb04e5e-6da9-40bd-87f2-1d914893b296 could not be found. Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:09:23.376837 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:09:23.381603 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:09:23.381603 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:09:23.381603 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:09:23.381603 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:09:23.381603 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:09:23.381603 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffb04e5e-6da9-40bd-87f2-1d914893b296 could not be found. Aug 04 17:09:23.381603 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:09:23.383575 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-72bfb2a4-6884-49fc-b825-75296615af90 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Returning 404 to user: Instance ffb04e5e-6da9-40bd-87f2-1d914893b296 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:09:23.384647 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-72bfb2a4-6884-49fc-b825-75296615af90 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 404 len: 111 microversion: 2.1 time: 0.064487 Aug 04 17:09:23.385827 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2829/5539] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:23 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:09:23.405538 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-24010080-588a-4ed5-9105-b3ff8c125bdf tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '.version_select at 0x7f7e76fc8670>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:23.442397 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-24010080-588a-4ed5-9105-b3ff8c125bdf tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2102455995" status: 202 len: 0 microversion: 2.1 time: 0.051471 Aug 04 17:09:23.443352 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2830/5540] 10.222.0.23 () {58 vars in 1221 bytes} [Thu Aug 4 17:09:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2102455995 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:09:23.518891 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-570c9c7c-8c1c-4e20-8b6a-97d5157ad4ff tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce8bf1816648ac97dcceea91556ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af166c943aa6480b92dd1762ac5e4176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:23.531438 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-570c9c7c-8c1c-4e20-8b6a-97d5157ad4ff tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "GET /compute/v2.1/servers/c6c3399a-cbe5-44ff-a72d-24af568cdab0" status: 200 len: 1313 microversion: 2.1 time: 0.486139 Aug 04 17:09:23.533484 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2711/5541] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:23 2022] GET /compute/v2.1/servers/c6c3399a-cbe5-44ff-a72d-24af568cdab0 => generated 1313 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:24.559465 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6a4d604b-cb33-41f7-8dcd-2fd7be534f27 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:24.560089 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6a4d604b-cb33-41f7-8dcd-2fd7be534f27 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: c6c3399a-cbe5-44ff-a72d-24af568cdab0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:24.569801 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a4d604b-cb33-41f7-8dcd-2fd7be534f27 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:24.570855 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a4d604b-cb33-41f7-8dcd-2fd7be534f27 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:24.577530 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a4d604b-cb33-41f7-8dcd-2fd7be534f27 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:24.578089 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a4d604b-cb33-41f7-8dcd-2fd7be534f27 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:25.078837 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6a4d604b-cb33-41f7-8dcd-2fd7be534f27 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce8bf1816648ac97dcceea91556ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af166c943aa6480b92dd1762ac5e4176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:25.088421 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6a4d604b-cb33-41f7-8dcd-2fd7be534f27 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "GET /compute/v2.1/servers/c6c3399a-cbe5-44ff-a72d-24af568cdab0" status: 200 len: 1313 microversion: 2.1 time: 0.534239 Aug 04 17:09:25.088916 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2831/5542] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:24 2022] GET /compute/v2.1/servers/c6c3399a-cbe5-44ff-a72d-24af568cdab0 => generated 1313 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:25.652100 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-abd1f7c3-d3f1-4041-ad5d-a804985606d0 req-9ee4d036-0d66-459a-ad28-cc3e188749ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6c3399a-cbe5-44ff-a72d-24af568cdab0", "tag": "7682f549-1fdf-4ab1-9b67-60d18149c571"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:25.692624 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-abd1f7c3-d3f1-4041-ad5d-a804985606d0 req-9ee4d036-0d66-459a-ad28-cc3e188749ee service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:25.693081 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-abd1f7c3-d3f1-4041-ad5d-a804985606d0 req-9ee4d036-0d66-459a-ad28-cc3e188749ee service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:25.720083 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-abd1f7c3-d3f1-4041-ad5d-a804985606d0 req-9ee4d036-0d66-459a-ad28-cc3e188749ee service nova] Creating event network-changed:7682f549-1fdf-4ab1-9b67-60d18149c571 for instance c6c3399a-cbe5-44ff-a72d-24af568cdab0 on n-h1-846466-12 Aug 04 17:09:25.728623 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-abd1f7c3-d3f1-4041-ad5d-a804985606d0 req-9ee4d036-0d66-459a-ad28-cc3e188749ee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081733 Aug 04 17:09:25.733255 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2712/5543] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:09:26.125191 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-137b015c-3b76-4a78-8fbd-871cdcbde1d1 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:26.126555 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-137b015c-3b76-4a78-8fbd-871cdcbde1d1 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: c6c3399a-cbe5-44ff-a72d-24af568cdab0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:26.137127 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-137b015c-3b76-4a78-8fbd-871cdcbde1d1 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:26.138276 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-137b015c-3b76-4a78-8fbd-871cdcbde1d1 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:26.139547 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-137b015c-3b76-4a78-8fbd-871cdcbde1d1 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:26.140146 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-137b015c-3b76-4a78-8fbd-871cdcbde1d1 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:26.320353 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-58c142d9-157c-45a6-a073-7980c2b952b6 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Action: 'create', calling method: .version_select at 0x7f7e745aec10>, body: {"keypair": {"name": "tempest-keypair-285522879", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApSHvkNKXZXP4ryg3xpzPJEoU9cHo0q4vMGxr+tr7zX+N6MVQ4Zz8p9qhC/Kuq3cqOt0VEbKh50XYoGPOpuqaEtIaS9L2pzuYRIySbol5ihEJ2Qy7FG83A1h6xE8V9fCw=="}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:26.342579 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-58c142d9-157c-45a6-a073-7980c2b952b6 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Getting quotas for project a0ad199f31d04aa4ac7c6ba5925eb06b. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:09:26.349523 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-58c142d9-157c-45a6-a073-7980c2b952b6 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Getting quotas for user d8430522c580414d9798349ededbd6d2 and project a0ad199f31d04aa4ac7c6ba5925eb06b. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:09:26.394320 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-58c142d9-157c-45a6-a073-7980c2b952b6 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.077129 Aug 04 17:09:26.402490 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2713/5544] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 17:09:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:09:26.533203 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-137b015c-3b76-4a78-8fbd-871cdcbde1d1 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce8bf1816648ac97dcceea91556ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af166c943aa6480b92dd1762ac5e4176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:26.543790 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-137b015c-3b76-4a78-8fbd-871cdcbde1d1 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "GET /compute/v2.1/servers/c6c3399a-cbe5-44ff-a72d-24af568cdab0" status: 200 len: 1313 microversion: 2.1 time: 0.426406 Aug 04 17:09:26.544646 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2832/5545] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:26 2022] GET /compute/v2.1/servers/c6c3399a-cbe5-44ff-a72d-24af568cdab0 => generated 1313 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:27.572923 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bd1c5862-e463-4ce6-8e51-310ce06d13a8 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:27.574171 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bd1c5862-e463-4ce6-8e51-310ce06d13a8 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: c6c3399a-cbe5-44ff-a72d-24af568cdab0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:27.612376 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bd1c5862-e463-4ce6-8e51-310ce06d13a8 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:27.613067 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bd1c5862-e463-4ce6-8e51-310ce06d13a8 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:27.618718 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bd1c5862-e463-4ce6-8e51-310ce06d13a8 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:27.620576 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bd1c5862-e463-4ce6-8e51-310ce06d13a8 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:28.548381 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bd1c5862-e463-4ce6-8e51-310ce06d13a8 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce8bf1816648ac97dcceea91556ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af166c943aa6480b92dd1762ac5e4176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:28.575809 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bd1c5862-e463-4ce6-8e51-310ce06d13a8 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "GET /compute/v2.1/servers/c6c3399a-cbe5-44ff-a72d-24af568cdab0" status: 200 len: 1313 microversion: 2.1 time: 1.012867 Aug 04 17:09:28.577109 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2714/5546] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:27 2022] GET /compute/v2.1/servers/c6c3399a-cbe5-44ff-a72d-24af568cdab0 => generated 1313 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:09:29.621183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a532d555-d956-4c15-b839-d3fbe1219dbb tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:29.622626 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a532d555-d956-4c15-b839-d3fbe1219dbb tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: c6c3399a-cbe5-44ff-a72d-24af568cdab0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:29.636065 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:29.640651 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=8 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:29.645195 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a532d555-d956-4c15-b839-d3fbe1219dbb tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:29.649669 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a532d555-d956-4c15-b839-d3fbe1219dbb tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:29.650692 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a532d555-d956-4c15-b839-d3fbe1219dbb tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:29.651248 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a532d555-d956-4c15-b839-d3fbe1219dbb tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:29.922743 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a532d555-d956-4c15-b839-d3fbe1219dbb tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce8bf1816648ac97dcceea91556ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af166c943aa6480b92dd1762ac5e4176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:29.945027 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a532d555-d956-4c15-b839-d3fbe1219dbb tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "GET /compute/v2.1/servers/c6c3399a-cbe5-44ff-a72d-24af568cdab0" status: 200 len: 1313 microversion: 2.1 time: 0.349174 Aug 04 17:09:29.964114 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2833/5547] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:29 2022] GET /compute/v2.1/servers/c6c3399a-cbe5-44ff-a72d-24af568cdab0 => generated 1313 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:09:30.970596 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a6af53fb-3ae3-499b-9e2b-5aa3dbca7cef tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:30.971976 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a6af53fb-3ae3-499b-9e2b-5aa3dbca7cef tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: c6c3399a-cbe5-44ff-a72d-24af568cdab0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:30.982613 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6af53fb-3ae3-499b-9e2b-5aa3dbca7cef tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:30.986282 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6af53fb-3ae3-499b-9e2b-5aa3dbca7cef tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:30.990435 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6af53fb-3ae3-499b-9e2b-5aa3dbca7cef tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:30.991214 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6af53fb-3ae3-499b-9e2b-5aa3dbca7cef tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:31.406600 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a6af53fb-3ae3-499b-9e2b-5aa3dbca7cef tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce8bf1816648ac97dcceea91556ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af166c943aa6480b92dd1762ac5e4176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:31.416224 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a6af53fb-3ae3-499b-9e2b-5aa3dbca7cef tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "GET /compute/v2.1/servers/c6c3399a-cbe5-44ff-a72d-24af568cdab0" status: 200 len: 1313 microversion: 2.1 time: 0.449432 Aug 04 17:09:31.421533 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2715/5548] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:30 2022] GET /compute/v2.1/servers/c6c3399a-cbe5-44ff-a72d-24af568cdab0 => generated 1313 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:31.906797 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dbb2eda5-d6dd-4559-8cfa-0e4b8e384f5b tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-519317170", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a5519241-a4a3-48ef-999e-1c5c2d6965d5"}], "security_groups": [{"name": "tempest-securitygroup--38941352"}], "key_name": "tempest-keypair-285522879", "user_data": "}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:32.300389 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-73aa80ee-2c78-4cd0-892c-7a642c64364f req-8a936d3c-298d-4a01-8cdc-9a1b01bb8f2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6c3399a-cbe5-44ff-a72d-24af568cdab0", "name": "network-vif-plugged", "status": "completed", "tag": "7682f549-1fdf-4ab1-9b67-60d18149c571"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:32.338978 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-73aa80ee-2c78-4cd0-892c-7a642c64364f req-8a936d3c-298d-4a01-8cdc-9a1b01bb8f2c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:32.339146 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-73aa80ee-2c78-4cd0-892c-7a642c64364f req-8a936d3c-298d-4a01-8cdc-9a1b01bb8f2c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:32.402080 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-73aa80ee-2c78-4cd0-892c-7a642c64364f req-8a936d3c-298d-4a01-8cdc-9a1b01bb8f2c service nova] Creating event network-vif-plugged:7682f549-1fdf-4ab1-9b67-60d18149c571 for instance c6c3399a-cbe5-44ff-a72d-24af568cdab0 on n-h1-846466-12 Aug 04 17:09:32.405068 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-dbb2eda5-d6dd-4559-8cfa-0e4b8e384f5b tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] validate_networks() for [('a5519241-a4a3-48ef-999e-1c5c2d6965d5', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:09:32.416495 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-73aa80ee-2c78-4cd0-892c-7a642c64364f req-8a936d3c-298d-4a01-8cdc-9a1b01bb8f2c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122406 Aug 04 17:09:32.417559 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2716/5549] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:09:32.510611 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7e457478-be42-4769-9781-baeea944acd2 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:32.511822 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7e457478-be42-4769-9781-baeea944acd2 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: c6c3399a-cbe5-44ff-a72d-24af568cdab0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:32.539945 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7e457478-be42-4769-9781-baeea944acd2 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:32.540478 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7e457478-be42-4769-9781-baeea944acd2 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:32.543938 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7e457478-be42-4769-9781-baeea944acd2 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:32.544644 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7e457478-be42-4769-9781-baeea944acd2 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:32.943266 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7e457478-be42-4769-9781-baeea944acd2 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce8bf1816648ac97dcceea91556ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af166c943aa6480b92dd1762ac5e4176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:32.973724 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7e457478-be42-4769-9781-baeea944acd2 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "GET /compute/v2.1/servers/c6c3399a-cbe5-44ff-a72d-24af568cdab0" status: 200 len: 1313 microversion: 2.1 time: 0.513923 Aug 04 17:09:32.991406 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2717/5550] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:32 2022] GET /compute/v2.1/servers/c6c3399a-cbe5-44ff-a72d-24af568cdab0 => generated 1313 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:33.552769 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-dbb2eda5-d6dd-4559-8cfa-0e4b8e384f5b tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:09:33.553783 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-dbb2eda5-d6dd-4559-8cfa-0e4b8e384f5b tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:09:33.553783 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-dbb2eda5-d6dd-4559-8cfa-0e4b8e384f5b tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:09:33.554205 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-dbb2eda5-d6dd-4559-8cfa-0e4b8e384f5b tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:09:33.554620 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-dbb2eda5-d6dd-4559-8cfa-0e4b8e384f5b tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:09:33.576642 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dbb2eda5-d6dd-4559-8cfa-0e4b8e384f5b tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:33.577193 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dbb2eda5-d6dd-4559-8cfa-0e4b8e384f5b tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:33.579976 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dbb2eda5-d6dd-4559-8cfa-0e4b8e384f5b tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:33.580712 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dbb2eda5-d6dd-4559-8cfa-0e4b8e384f5b tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:33.618609 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-dbb2eda5-d6dd-4559-8cfa-0e4b8e384f5b tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Getting quotas for project a0ad199f31d04aa4ac7c6ba5925eb06b. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:09:33.641988 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-dbb2eda5-d6dd-4559-8cfa-0e4b8e384f5b tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Getting quotas for user d8430522c580414d9798349ededbd6d2 and project a0ad199f31d04aa4ac7c6ba5925eb06b. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:09:33.664418 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dbb2eda5-d6dd-4559-8cfa-0e4b8e384f5b tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:09:33.667213 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dbb2eda5-d6dd-4559-8cfa-0e4b8e384f5b tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: 9856bd39-78da-4852-a1ce-d93c747f00c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:09:33.787537 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dbb2eda5-d6dd-4559-8cfa-0e4b8e384f5b tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.881846 Aug 04 17:09:33.788938 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2834/5551] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:09:31 2022] POST /compute/v2.1/servers => generated 400 bytes in 1890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:09:33.810548 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-994134e7-c5b2-4b2d-abbb-a09570268937 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:33.812315 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-994134e7-c5b2-4b2d-abbb-a09570268937 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: 9856bd39-78da-4852-a1ce-d93c747f00c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:33.933875 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-994134e7-c5b2-4b2d-abbb-a09570268937 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:33.943801 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-994134e7-c5b2-4b2d-abbb-a09570268937 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8" status: 200 len: 1236 microversion: 2.1 time: 0.147309 Aug 04 17:09:33.956490 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2718/5552] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:33 2022] GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8 => generated 1236 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:33.998586 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0a1c5e52-7b25-4612-82b3-bca23757d8c7 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:33.999378 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0a1c5e52-7b25-4612-82b3-bca23757d8c7 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: c6c3399a-cbe5-44ff-a72d-24af568cdab0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:34.016308 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0a1c5e52-7b25-4612-82b3-bca23757d8c7 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:34.016816 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0a1c5e52-7b25-4612-82b3-bca23757d8c7 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:34.018840 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0a1c5e52-7b25-4612-82b3-bca23757d8c7 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:34.019457 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0a1c5e52-7b25-4612-82b3-bca23757d8c7 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:34.675307 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0a1c5e52-7b25-4612-82b3-bca23757d8c7 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce8bf1816648ac97dcceea91556ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af166c943aa6480b92dd1762ac5e4176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:34.688807 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0a1c5e52-7b25-4612-82b3-bca23757d8c7 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "GET /compute/v2.1/servers/c6c3399a-cbe5-44ff-a72d-24af568cdab0" status: 200 len: 1313 microversion: 2.1 time: 0.696337 Aug 04 17:09:34.690354 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2835/5553] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:33 2022] GET /compute/v2.1/servers/c6c3399a-cbe5-44ff-a72d-24af568cdab0 => generated 1313 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:34.965694 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8f9d7c18-f5e1-47b8-a41f-edb9936a84fc tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:34.966334 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8f9d7c18-f5e1-47b8-a41f-edb9936a84fc tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: 9856bd39-78da-4852-a1ce-d93c747f00c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:35.006760 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8f9d7c18-f5e1-47b8-a41f-edb9936a84fc tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:35.007228 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8f9d7c18-f5e1-47b8-a41f-edb9936a84fc tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:35.008133 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8f9d7c18-f5e1-47b8-a41f-edb9936a84fc tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:35.009358 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8f9d7c18-f5e1-47b8-a41f-edb9936a84fc tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:35.124417 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8f9d7c18-f5e1-47b8-a41f-edb9936a84fc tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:35.134803 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8f9d7c18-f5e1-47b8-a41f-edb9936a84fc tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8" status: 200 len: 1288 microversion: 2.1 time: 0.173777 Aug 04 17:09:35.148471 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2719/5554] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:34 2022] GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8 => generated 1288 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:35.720863 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a200e204-c332-484a-94c0-fa579eb0b5d6 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:35.723908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a200e204-c332-484a-94c0-fa579eb0b5d6 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: c6c3399a-cbe5-44ff-a72d-24af568cdab0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:35.746765 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a200e204-c332-484a-94c0-fa579eb0b5d6 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:35.747215 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a200e204-c332-484a-94c0-fa579eb0b5d6 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:35.748079 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a200e204-c332-484a-94c0-fa579eb0b5d6 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:35.748565 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a200e204-c332-484a-94c0-fa579eb0b5d6 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:36.165035 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a24acc3c-f877-42f4-95e3-5e7ea3e84c1f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:36.165785 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a24acc3c-f877-42f4-95e3-5e7ea3e84c1f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: 9856bd39-78da-4852-a1ce-d93c747f00c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:36.193326 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a24acc3c-f877-42f4-95e3-5e7ea3e84c1f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:36.232147 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a24acc3c-f877-42f4-95e3-5e7ea3e84c1f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:36.236472 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a24acc3c-f877-42f4-95e3-5e7ea3e84c1f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:36.238944 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a24acc3c-f877-42f4-95e3-5e7ea3e84c1f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:36.527727 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a24acc3c-f877-42f4-95e3-5e7ea3e84c1f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:36.538513 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a24acc3c-f877-42f4-95e3-5e7ea3e84c1f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8" status: 200 len: 1294 microversion: 2.1 time: 0.386083 Aug 04 17:09:36.545787 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2720/5555] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:36 2022] GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8 => generated 1294 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:36.795923 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a200e204-c332-484a-94c0-fa579eb0b5d6 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce8bf1816648ac97dcceea91556ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af166c943aa6480b92dd1762ac5e4176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:36.823939 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a200e204-c332-484a-94c0-fa579eb0b5d6 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "GET /compute/v2.1/servers/c6c3399a-cbe5-44ff-a72d-24af568cdab0" status: 200 len: 1498 microversion: 2.1 time: 1.113365 Aug 04 17:09:36.837314 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2836/5556] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:35 2022] GET /compute/v2.1/servers/c6c3399a-cbe5-44ff-a72d-24af568cdab0 => generated 1498 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:37.578894 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3bd1fb7a-a4df-4826-9a3c-ac3beddc4e95 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:37.580712 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3bd1fb7a-a4df-4826-9a3c-ac3beddc4e95 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: 9856bd39-78da-4852-a1ce-d93c747f00c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:37.607904 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3bd1fb7a-a4df-4826-9a3c-ac3beddc4e95 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:37.612591 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3bd1fb7a-a4df-4826-9a3c-ac3beddc4e95 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:37.613612 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3bd1fb7a-a4df-4826-9a3c-ac3beddc4e95 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:37.614084 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3bd1fb7a-a4df-4826-9a3c-ac3beddc4e95 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:37.972987 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7ff1c048-9bf2-4e90-9a18-1ee17e67a609 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:37.973647 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7ff1c048-9bf2-4e90-9a18-1ee17e67a609 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: c6c3399a-cbe5-44ff-a72d-24af568cdab0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:38.004001 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ff1c048-9bf2-4e90-9a18-1ee17e67a609 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:38.004655 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ff1c048-9bf2-4e90-9a18-1ee17e67a609 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:38.005943 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ff1c048-9bf2-4e90-9a18-1ee17e67a609 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:38.006381 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ff1c048-9bf2-4e90-9a18-1ee17e67a609 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:38.099256 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:38.117214 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7ff1c048-9bf2-4e90-9a18-1ee17e67a609 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: c6c3399a-cbe5-44ff-a72d-24af568cdab0] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:09:38.368999 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7ff1c048-9bf2-4e90-9a18-1ee17e67a609 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c6c3399a-cbe5-44ff-a72d-24af568cdab0" status: 204 len: 0 microversion: 2.1 time: 0.397523 Aug 04 17:09:38.372547 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2837/5557] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:09:37 2022] DELETE /compute/v2.1/servers/c6c3399a-cbe5-44ff-a72d-24af568cdab0 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:09:38.394961 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b318bed1-a72f-4bb2-82d5-aed1d474b9af tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:38.396033 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b318bed1-a72f-4bb2-82d5-aed1d474b9af tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: c6c3399a-cbe5-44ff-a72d-24af568cdab0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:38.404075 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b318bed1-a72f-4bb2-82d5-aed1d474b9af tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:38.404692 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b318bed1-a72f-4bb2-82d5-aed1d474b9af tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:38.405803 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b318bed1-a72f-4bb2-82d5-aed1d474b9af tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:38.406346 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b318bed1-a72f-4bb2-82d5-aed1d474b9af tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:38.407745 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3bd1fb7a-a4df-4826-9a3c-ac3beddc4e95 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:38.425443 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3bd1fb7a-a4df-4826-9a3c-ac3beddc4e95 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8" status: 200 len: 1360 microversion: 2.1 time: 0.858737 Aug 04 17:09:38.426101 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2721/5558] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:37 2022] GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8 => generated 1360 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:38.806518 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b318bed1-a72f-4bb2-82d5-aed1d474b9af tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce8bf1816648ac97dcceea91556ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af166c943aa6480b92dd1762ac5e4176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:38.814808 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b318bed1-a72f-4bb2-82d5-aed1d474b9af tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "GET /compute/v2.1/servers/c6c3399a-cbe5-44ff-a72d-24af568cdab0" status: 200 len: 1504 microversion: 2.1 time: 0.437268 Aug 04 17:09:38.815420 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2838/5559] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:38 2022] GET /compute/v2.1/servers/c6c3399a-cbe5-44ff-a72d-24af568cdab0 => generated 1504 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:39.458271 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dd5605d0-a769-450f-bd99-f562b894ff95 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:39.461102 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-dd5605d0-a769-450f-bd99-f562b894ff95 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: 9856bd39-78da-4852-a1ce-d93c747f00c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:39.473020 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd5605d0-a769-450f-bd99-f562b894ff95 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:39.474083 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd5605d0-a769-450f-bd99-f562b894ff95 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:39.475227 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd5605d0-a769-450f-bd99-f562b894ff95 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:39.476283 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd5605d0-a769-450f-bd99-f562b894ff95 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:39.658935 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-d5bc2b01-6508-4363-863e-ec9e29e797eb req-41c82dec-064a-48e2-9545-c57f36c4e5f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9856bd39-78da-4852-a1ce-d93c747f00c8", "tag": "75a5658e-50cb-45aa-ae6d-3470c5cf9877"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:39.684908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-d5bc2b01-6508-4363-863e-ec9e29e797eb req-41c82dec-064a-48e2-9545-c57f36c4e5f8 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:39.685656 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-d5bc2b01-6508-4363-863e-ec9e29e797eb req-41c82dec-064a-48e2-9545-c57f36c4e5f8 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:39.715309 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-d5bc2b01-6508-4363-863e-ec9e29e797eb req-41c82dec-064a-48e2-9545-c57f36c4e5f8 service nova] Creating event network-changed:75a5658e-50cb-45aa-ae6d-3470c5cf9877 for instance 9856bd39-78da-4852-a1ce-d93c747f00c8 on n-h2-846466-12 Aug 04 17:09:39.721367 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-d5bc2b01-6508-4363-863e-ec9e29e797eb req-41c82dec-064a-48e2-9545-c57f36c4e5f8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069622 Aug 04 17:09:39.722825 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2839/5560] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:09:39.837171 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-306cd7bd-e7cc-47ff-86e7-eddd8d019b6b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:39.838206 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-306cd7bd-e7cc-47ff-86e7-eddd8d019b6b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: c6c3399a-cbe5-44ff-a72d-24af568cdab0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:39.846265 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-306cd7bd-e7cc-47ff-86e7-eddd8d019b6b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:39.846752 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-306cd7bd-e7cc-47ff-86e7-eddd8d019b6b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:39.847776 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-306cd7bd-e7cc-47ff-86e7-eddd8d019b6b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:39.848197 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-306cd7bd-e7cc-47ff-86e7-eddd8d019b6b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:40.279119 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-dd5605d0-a769-450f-bd99-f562b894ff95 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:40.289340 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dd5605d0-a769-450f-bd99-f562b894ff95 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8" status: 200 len: 1360 microversion: 2.1 time: 0.844250 Aug 04 17:09:40.290611 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2722/5561] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:39 2022] GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8 => generated 1360 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:09:40.459103 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-306cd7bd-e7cc-47ff-86e7-eddd8d019b6b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce8bf1816648ac97dcceea91556ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af166c943aa6480b92dd1762ac5e4176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:40.471200 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-306cd7bd-e7cc-47ff-86e7-eddd8d019b6b tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "GET /compute/v2.1/servers/c6c3399a-cbe5-44ff-a72d-24af568cdab0" status: 200 len: 1504 microversion: 2.1 time: 0.638200 Aug 04 17:09:40.472200 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2840/5562] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:39 2022] GET /compute/v2.1/servers/c6c3399a-cbe5-44ff-a72d-24af568cdab0 => generated 1504 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:09:41.311119 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-51953f33-bc66-4655-a18e-4c83161a1d33 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:41.312428 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-51953f33-bc66-4655-a18e-4c83161a1d33 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: 9856bd39-78da-4852-a1ce-d93c747f00c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:41.325834 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-51953f33-bc66-4655-a18e-4c83161a1d33 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:41.328701 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-51953f33-bc66-4655-a18e-4c83161a1d33 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:41.331840 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-51953f33-bc66-4655-a18e-4c83161a1d33 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:41.332836 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-51953f33-bc66-4655-a18e-4c83161a1d33 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:41.522347 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1333dc64-a1aa-418e-a0b9-c42b4254f29c tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:41.523251 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1333dc64-a1aa-418e-a0b9-c42b4254f29c tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: c6c3399a-cbe5-44ff-a72d-24af568cdab0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:41.549520 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1333dc64-a1aa-418e-a0b9-c42b4254f29c tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:41.549986 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1333dc64-a1aa-418e-a0b9-c42b4254f29c tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:41.550840 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1333dc64-a1aa-418e-a0b9-c42b4254f29c tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:41.551290 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1333dc64-a1aa-418e-a0b9-c42b4254f29c tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:42.572179 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1333dc64-a1aa-418e-a0b9-c42b4254f29c tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce8bf1816648ac97dcceea91556ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af166c943aa6480b92dd1762ac5e4176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:42.617774 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1333dc64-a1aa-418e-a0b9-c42b4254f29c tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "GET /compute/v2.1/servers/c6c3399a-cbe5-44ff-a72d-24af568cdab0" status: 200 len: 1462 microversion: 2.1 time: 1.110280 Aug 04 17:09:42.622940 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2841/5563] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:41 2022] GET /compute/v2.1/servers/c6c3399a-cbe5-44ff-a72d-24af568cdab0 => generated 1462 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:42.920059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-5c24d9b9-795c-4a3b-820a-b47e866cd02d req-88fdeedb-330c-4946-9926-326d73007df4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6c3399a-cbe5-44ff-a72d-24af568cdab0", "name": "network-vif-deleted", "tag": "7682f549-1fdf-4ab1-9b67-60d18149c571"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:42.933401 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-5c24d9b9-795c-4a3b-820a-b47e866cd02d req-88fdeedb-330c-4946-9926-326d73007df4 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:42.934380 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-5c24d9b9-795c-4a3b-820a-b47e866cd02d req-88fdeedb-330c-4946-9926-326d73007df4 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:42.942719 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-51953f33-bc66-4655-a18e-4c83161a1d33 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:42.968646 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-51953f33-bc66-4655-a18e-4c83161a1d33 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8" status: 200 len: 1360 microversion: 2.1 time: 1.660741 Aug 04 17:09:42.973758 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2723/5564] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:41 2022] GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8 => generated 1360 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:42.985176 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-5c24d9b9-795c-4a3b-820a-b47e866cd02d req-88fdeedb-330c-4946-9926-326d73007df4 service nova] Creating event network-vif-deleted:7682f549-1fdf-4ab1-9b67-60d18149c571 for instance c6c3399a-cbe5-44ff-a72d-24af568cdab0 on n-h1-846466-12 Aug 04 17:09:42.994508 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-5c24d9b9-795c-4a3b-820a-b47e866cd02d req-88fdeedb-330c-4946-9926-326d73007df4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082371 Aug 04 17:09:42.995825 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2842/5565] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:09:43.705423 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-48600f9d-b8fe-4f27-b4e6-53158d637b92 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:43.706903 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-48600f9d-b8fe-4f27-b4e6-53158d637b92 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] [instance: c6c3399a-cbe5-44ff-a72d-24af568cdab0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:43.760228 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:43.796165 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-48600f9d-b8fe-4f27-b4e6-53158d637b92 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:43.796923 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-48600f9d-b8fe-4f27-b4e6-53158d637b92 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:43.798048 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-48600f9d-b8fe-4f27-b4e6-53158d637b92 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:43.798759 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-48600f9d-b8fe-4f27-b4e6-53158d637b92 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:43.855198 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-48600f9d-b8fe-4f27-b4e6-53158d637b92 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] HTTP exception thrown: Instance c6c3399a-cbe5-44ff-a72d-24af568cdab0 could not be found. Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-48600f9d-b8fe-4f27-b4e6-53158d637b92 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Request method failure captured: Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/c6c3399a-cbe5-44ff-a72d-24af568cdab0 HTTP/1.1 Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_0ftk_qbSMNU2OZMimBrt2waIqfVjyA65yZbprenX3QxWQ7AL3rABhu6TLq0rFZSy8coFvi0u4PaYkMM2C8BWEdLJD-g8yaE3bpERWrArawMw9e12zsVFBhhlBdOz--6VjPChu0LvDl_C38GO1rKieER__CniOdx2XZrSxMfIqVrPc Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: af166c943aa6480b92dd1762ac5e4176 Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-VolumesActionsTest-425500951 Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/af166c943aa6480b92dd1762ac5e4176"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_af166c943aa6480b92dd1762ac5e4176"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/af166c943aa6480b92dd1762ac5e4176"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/af166c943aa6480b92dd1762ac5e4176"}]}] Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-VolumesActionsTest-425500951 Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: af166c943aa6480b92dd1762ac5e4176 Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-VolumesActionsTest-425500951 Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-VolumesActionsTest-425500951-project Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: f9ce8bf1816648ac97dcceea91556ad8 Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-VolumesActionsTest-425500951-project Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance c6c3399a-cbe5-44ff-a72d-24af568cdab0 could not be found. Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'c6c3399a-cbe5-44ff-a72d-24af568cdab0'} Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6c3399a-cbe5-44ff-a72d-24af568cdab0 could not be found. Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6c3399a-cbe5-44ff-a72d-24af568cdab0 could not be found. Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:09:43.859806 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:09:43.866739 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:09:43.866739 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:09:43.866739 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:09:43.866739 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:09:43.866739 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:09:43.866739 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6c3399a-cbe5-44ff-a72d-24af568cdab0 could not be found. Aug 04 17:09:43.866739 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:09:43.866739 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-48600f9d-b8fe-4f27-b4e6-53158d637b92 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] Returning 404 to user: Instance c6c3399a-cbe5-44ff-a72d-24af568cdab0 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:09:43.866739 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-48600f9d-b8fe-4f27-b4e6-53158d637b92 tempest-VolumesActionsTest-425500951 tempest-VolumesActionsTest-425500951-project] 10.222.0.23 "GET /compute/v2.1/servers/c6c3399a-cbe5-44ff-a72d-24af568cdab0" status: 404 len: 111 microversion: 2.1 time: 0.218513 Aug 04 17:09:43.866739 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2724/5566] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:43 2022] GET /compute/v2.1/servers/c6c3399a-cbe5-44ff-a72d-24af568cdab0 => generated 111 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:09:43.998738 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c1c54700-9865-4720-a32a-c9eb10461032 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:43.999647 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c1c54700-9865-4720-a32a-c9eb10461032 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: 9856bd39-78da-4852-a1ce-d93c747f00c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:44.033200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:44.045427 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:44.049101 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:44.051845 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c1c54700-9865-4720-a32a-c9eb10461032 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:44.052618 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c1c54700-9865-4720-a32a-c9eb10461032 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:44.055271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c1c54700-9865-4720-a32a-c9eb10461032 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:44.056133 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c1c54700-9865-4720-a32a-c9eb10461032 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:44.363606 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c1c54700-9865-4720-a32a-c9eb10461032 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:44.384291 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c1c54700-9865-4720-a32a-c9eb10461032 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8" status: 200 len: 1360 microversion: 2.1 time: 0.387940 Aug 04 17:09:44.402983 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2843/5567] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:43 2022] GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8 => generated 1360 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:09:45.408290 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5b5aea2d-8309-4878-b3db-04be052ec145 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:45.408925 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5b5aea2d-8309-4878-b3db-04be052ec145 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: 9856bd39-78da-4852-a1ce-d93c747f00c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:45.412719 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:45.426492 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5b5aea2d-8309-4878-b3db-04be052ec145 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:45.427126 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5b5aea2d-8309-4878-b3db-04be052ec145 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:45.427959 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5b5aea2d-8309-4878-b3db-04be052ec145 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:45.428422 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5b5aea2d-8309-4878-b3db-04be052ec145 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:45.796445 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5b5aea2d-8309-4878-b3db-04be052ec145 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:45.811739 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5b5aea2d-8309-4878-b3db-04be052ec145 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8" status: 200 len: 1360 microversion: 2.1 time: 0.407634 Aug 04 17:09:45.812384 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2725/5568] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:45 2022] GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8 => generated 1360 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:09:46.833637 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-41b777f0-421b-48cc-8df9-7f15e34f158e tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:46.834497 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-41b777f0-421b-48cc-8df9-7f15e34f158e tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: 9856bd39-78da-4852-a1ce-d93c747f00c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:46.858157 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-41b777f0-421b-48cc-8df9-7f15e34f158e tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:46.858870 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-41b777f0-421b-48cc-8df9-7f15e34f158e tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:46.859807 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-41b777f0-421b-48cc-8df9-7f15e34f158e tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:46.860390 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-41b777f0-421b-48cc-8df9-7f15e34f158e tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:47.154408 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-41b777f0-421b-48cc-8df9-7f15e34f158e tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:47.175294 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-41b777f0-421b-48cc-8df9-7f15e34f158e tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8" status: 200 len: 1360 microversion: 2.1 time: 0.344934 Aug 04 17:09:47.175952 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2844/5569] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:46 2022] GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8 => generated 1360 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:47.823703 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-e2d8fbe1-f91d-49a6-ac6f-d333a6a278dd req-7720e550-7d45-4423-8c0d-f7120552eac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9856bd39-78da-4852-a1ce-d93c747f00c8", "name": "network-vif-plugged", "status": "completed", "tag": "75a5658e-50cb-45aa-ae6d-3470c5cf9877"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:47.887943 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-e2d8fbe1-f91d-49a6-ac6f-d333a6a278dd req-7720e550-7d45-4423-8c0d-f7120552eac9 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:47.888303 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-e2d8fbe1-f91d-49a6-ac6f-d333a6a278dd req-7720e550-7d45-4423-8c0d-f7120552eac9 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:47.926089 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-e2d8fbe1-f91d-49a6-ac6f-d333a6a278dd req-7720e550-7d45-4423-8c0d-f7120552eac9 service nova] Creating event network-vif-plugged:75a5658e-50cb-45aa-ae6d-3470c5cf9877 for instance 9856bd39-78da-4852-a1ce-d93c747f00c8 on n-h2-846466-12 Aug 04 17:09:47.947469 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-e2d8fbe1-f91d-49a6-ac6f-d333a6a278dd req-7720e550-7d45-4423-8c0d-f7120552eac9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129742 Aug 04 17:09:47.951743 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2726/5570] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:09:48.196496 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4fd4e5bf-dd17-426d-91cc-929ff1b71f48 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:48.197123 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4fd4e5bf-dd17-426d-91cc-929ff1b71f48 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: 9856bd39-78da-4852-a1ce-d93c747f00c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:48.209209 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4fd4e5bf-dd17-426d-91cc-929ff1b71f48 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:48.215340 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4fd4e5bf-dd17-426d-91cc-929ff1b71f48 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:48.216633 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4fd4e5bf-dd17-426d-91cc-929ff1b71f48 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:48.217310 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4fd4e5bf-dd17-426d-91cc-929ff1b71f48 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:48.638178 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4fd4e5bf-dd17-426d-91cc-929ff1b71f48 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:48.656607 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4fd4e5bf-dd17-426d-91cc-929ff1b71f48 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8" status: 200 len: 1360 microversion: 2.1 time: 0.461280 Aug 04 17:09:48.660206 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2845/5571] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:48 2022] GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8 => generated 1360 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:49.685820 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e4be7654-dfdd-4ece-aa3c-ba9e91baf6b9 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:49.687388 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e4be7654-dfdd-4ece-aa3c-ba9e91baf6b9 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: 9856bd39-78da-4852-a1ce-d93c747f00c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:49.760250 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e4be7654-dfdd-4ece-aa3c-ba9e91baf6b9 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:49.761950 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e4be7654-dfdd-4ece-aa3c-ba9e91baf6b9 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:49.763759 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e4be7654-dfdd-4ece-aa3c-ba9e91baf6b9 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:49.766225 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e4be7654-dfdd-4ece-aa3c-ba9e91baf6b9 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:50.290448 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e4be7654-dfdd-4ece-aa3c-ba9e91baf6b9 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:50.343885 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e4be7654-dfdd-4ece-aa3c-ba9e91baf6b9 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8" status: 200 len: 1545 microversion: 2.1 time: 0.665993 Aug 04 17:09:50.344489 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2727/5572] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:49 2022] GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8 => generated 1545 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:50.367944 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3ce97d19-8579-4f05-93e1-abe99b169247 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:50.368603 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3ce97d19-8579-4f05-93e1-abe99b169247 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: 9856bd39-78da-4852-a1ce-d93c747f00c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:50.393985 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3ce97d19-8579-4f05-93e1-abe99b169247 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:50.396441 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3ce97d19-8579-4f05-93e1-abe99b169247 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:50.401592 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3ce97d19-8579-4f05-93e1-abe99b169247 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:50.402546 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3ce97d19-8579-4f05-93e1-abe99b169247 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:50.815642 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3ce97d19-8579-4f05-93e1-abe99b169247 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.452827 Aug 04 17:09:50.816241 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2846/5573] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Aug 4 17:09:50 2022] GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8/os-interface => generated 284 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:09:54.799555 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-e3bd1976-5582-4d52-8d56-3cb81aa6a93c req-d63bce29-cd00-47b6-92c9-5c95e221dd66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9856bd39-78da-4852-a1ce-d93c747f00c8", "tag": "75a5658e-50cb-45aa-ae6d-3470c5cf9877"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:54.854795 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-e3bd1976-5582-4d52-8d56-3cb81aa6a93c req-d63bce29-cd00-47b6-92c9-5c95e221dd66 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:09:54.855251 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-e3bd1976-5582-4d52-8d56-3cb81aa6a93c req-d63bce29-cd00-47b6-92c9-5c95e221dd66 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:09:54.864892 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=71 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:54.892565 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-e3bd1976-5582-4d52-8d56-3cb81aa6a93c req-d63bce29-cd00-47b6-92c9-5c95e221dd66 service nova] Creating event network-changed:75a5658e-50cb-45aa-ae6d-3470c5cf9877 for instance 9856bd39-78da-4852-a1ce-d93c747f00c8 on n-h2-846466-12 Aug 04 17:09:54.912872 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-e3bd1976-5582-4d52-8d56-3cb81aa6a93c req-d63bce29-cd00-47b6-92c9-5c95e221dd66 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122584 Aug 04 17:09:54.920930 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2728/5574] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:10:27.523380 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=7 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:27.524562 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:27.529400 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-793fcadc-83a4-4d4d-8230-97b6f6f290df tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:27.530231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-793fcadc-83a4-4d4d-8230-97b6f6f290df tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: 9856bd39-78da-4852-a1ce-d93c747f00c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:27.548996 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-793fcadc-83a4-4d4d-8230-97b6f6f290df tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:27.549601 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-793fcadc-83a4-4d4d-8230-97b6f6f290df tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:27.553988 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-793fcadc-83a4-4d4d-8230-97b6f6f290df tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:27.555102 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-793fcadc-83a4-4d4d-8230-97b6f6f290df tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:27.611432 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-793fcadc-83a4-4d4d-8230-97b6f6f290df tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8/ips" status: 200 len: 145 microversion: 2.1 time: 0.090224 Aug 04 17:10:27.618286 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2847/5575] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Aug 4 17:10:27 2022] GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8/ips => generated 145 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:10:30.489900 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2c09ec93-2a47-46b0-852b-07bd89b30ad1 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77c10baa-83d4-4a48-9fb6-31ae7c3c6e7d"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:30.492943 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2c09ec93-2a47-46b0-852b-07bd89b30ad1 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: 9856bd39-78da-4852-a1ce-d93c747f00c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:30.506070 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=9 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:30.507490 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:30.521962 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2c09ec93-2a47-46b0-852b-07bd89b30ad1 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:30.523329 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2c09ec93-2a47-46b0-852b-07bd89b30ad1 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:30.524991 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2c09ec93-2a47-46b0-852b-07bd89b30ad1 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:30.525688 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2c09ec93-2a47-46b0-852b-07bd89b30ad1 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:31.119361 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2c09ec93-2a47-46b0-852b-07bd89b30ad1 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "POST /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.634566 Aug 04 17:10:31.142254 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2729/5576] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Aug 4 17:10:30 2022] POST /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8/os-volume_attachments => generated 194 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:10:42.182161 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:42.188727 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:42.874168 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f73e9c6b-4d99-4ff9-ae96-cec88eecc92a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:42.874954 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f73e9c6b-4d99-4ff9-ae96-cec88eecc92a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:42.890676 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f73e9c6b-4d99-4ff9-ae96-cec88eecc92a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:42.893079 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f73e9c6b-4d99-4ff9-ae96-cec88eecc92a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:42.894214 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f73e9c6b-4d99-4ff9-ae96-cec88eecc92a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:42.901225 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f73e9c6b-4d99-4ff9-ae96-cec88eecc92a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:42.957345 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f73e9c6b-4d99-4ff9-ae96-cec88eecc92a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:10:43.083426 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f73e9c6b-4d99-4ff9-ae96-cec88eecc92a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a" status: 204 len: 0 microversion: 2.1 time: 0.901522 Aug 04 17:10:43.084445 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2848/5577] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:10:42 2022] DELETE /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a => generated 0 bytes in 904 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:10:43.091770 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:43.093174 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:43.101340 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a158d6c4-0c69-4b70-8191-85c3a232f80e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:43.102526 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a158d6c4-0c69-4b70-8191-85c3a232f80e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:43.112825 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a158d6c4-0c69-4b70-8191-85c3a232f80e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:43.113453 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a158d6c4-0c69-4b70-8191-85c3a232f80e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:43.114405 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a158d6c4-0c69-4b70-8191-85c3a232f80e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:43.115018 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a158d6c4-0c69-4b70-8191-85c3a232f80e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:43.532462 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a158d6c4-0c69-4b70-8191-85c3a232f80e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:43.547546 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a158d6c4-0c69-4b70-8191-85c3a232f80e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a" status: 200 len: 1579 microversion: 2.1 time: 0.458229 Aug 04 17:10:43.563043 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2730/5578] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:43 2022] GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a => generated 1579 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:10:44.571187 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-707b063f-0fac-46ab-b008-8417543b5847 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:44.571910 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-707b063f-0fac-46ab-b008-8417543b5847 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:44.587227 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-707b063f-0fac-46ab-b008-8417543b5847 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:44.587586 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-707b063f-0fac-46ab-b008-8417543b5847 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:44.590995 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-707b063f-0fac-46ab-b008-8417543b5847 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:44.591605 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-707b063f-0fac-46ab-b008-8417543b5847 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:44.888641 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-707b063f-0fac-46ab-b008-8417543b5847 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:44.902706 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-707b063f-0fac-46ab-b008-8417543b5847 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a" status: 200 len: 1579 microversion: 2.1 time: 0.334443 Aug 04 17:10:44.902706 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2849/5579] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:44 2022] GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a => generated 1579 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:45.924498 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f74f0f65-9aef-4887-94c8-78f1ccedb335 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:45.925779 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f74f0f65-9aef-4887-94c8-78f1ccedb335 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:45.939979 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f74f0f65-9aef-4887-94c8-78f1ccedb335 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:45.941787 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f74f0f65-9aef-4887-94c8-78f1ccedb335 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:45.943883 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f74f0f65-9aef-4887-94c8-78f1ccedb335 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:45.945586 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f74f0f65-9aef-4887-94c8-78f1ccedb335 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:46.102979 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f74f0f65-9aef-4887-94c8-78f1ccedb335 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:46.113021 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f74f0f65-9aef-4887-94c8-78f1ccedb335 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a" status: 200 len: 1511 microversion: 2.1 time: 0.192073 Aug 04 17:10:46.136476 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2731/5580] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:45 2022] GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a => generated 1511 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:46.742395 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-89ed6f53-9184-49e5-9923-26227f671bf5 req-f7e301c8-879e-4a25-ac55-c04605962c89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc8307a2-4a12-4301-a04f-6ed3bccb7d1a", "name": "network-vif-deleted", "tag": "9ea99fa2-f541-4856-a304-28a402350443"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:46.757516 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-89ed6f53-9184-49e5-9923-26227f671bf5 req-f7e301c8-879e-4a25-ac55-c04605962c89 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:46.758465 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-89ed6f53-9184-49e5-9923-26227f671bf5 req-f7e301c8-879e-4a25-ac55-c04605962c89 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:46.772483 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-89ed6f53-9184-49e5-9923-26227f671bf5 req-f7e301c8-879e-4a25-ac55-c04605962c89 service nova] Creating event network-vif-deleted:9ea99fa2-f541-4856-a304-28a402350443 for instance dc8307a2-4a12-4301-a04f-6ed3bccb7d1a on n-h2-846466-12 Aug 04 17:10:46.778963 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-89ed6f53-9184-49e5-9923-26227f671bf5 req-f7e301c8-879e-4a25-ac55-c04605962c89 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040454 Aug 04 17:10:46.784403 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2850/5581] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:10:47.140977 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ecdbd62c-794f-4feb-adb4-a2f4eed891df tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:47.141755 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ecdbd62c-794f-4feb-adb4-a2f4eed891df tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:47.158076 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ecdbd62c-794f-4feb-adb4-a2f4eed891df tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:47.158653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ecdbd62c-794f-4feb-adb4-a2f4eed891df tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:47.159628 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ecdbd62c-794f-4feb-adb4-a2f4eed891df tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:47.160196 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ecdbd62c-794f-4feb-adb4-a2f4eed891df tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:47.414274 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ecdbd62c-794f-4feb-adb4-a2f4eed891df tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:47.437127 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ecdbd62c-794f-4feb-adb4-a2f4eed891df tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a" status: 200 len: 1226 microversion: 2.1 time: 0.300288 Aug 04 17:10:47.441923 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0a195e1b-598f-46e2-8fe5-e3534ef11386 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:47.442718 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2732/5582] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:47 2022] GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a => generated 1226 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:47.444471 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0a195e1b-598f-46e2-8fe5-e3534ef11386 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: 9856bd39-78da-4852-a1ce-d93c747f00c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:47.500865 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0a195e1b-598f-46e2-8fe5-e3534ef11386 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:47.502447 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0a195e1b-598f-46e2-8fe5-e3534ef11386 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:47.503774 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0a195e1b-598f-46e2-8fe5-e3534ef11386 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:47.509371 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0a195e1b-598f-46e2-8fe5-e3534ef11386 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:47.587618 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0a195e1b-598f-46e2-8fe5-e3534ef11386 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149479 Aug 04 17:10:47.590485 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2851/5583] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:10:47 2022] GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:10:47.601162 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-62541614-efd4-4cb3-bbdf-341788668c89 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:47.602286 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-62541614-efd4-4cb3-bbdf-341788668c89 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: 9856bd39-78da-4852-a1ce-d93c747f00c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:47.609610 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-62541614-efd4-4cb3-bbdf-341788668c89 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:47.613091 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-62541614-efd4-4cb3-bbdf-341788668c89 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:47.623327 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-62541614-efd4-4cb3-bbdf-341788668c89 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:47.624291 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-62541614-efd4-4cb3-bbdf-341788668c89 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:47.693889 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-62541614-efd4-4cb3-bbdf-341788668c89 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8/os-volume_attachments/77c10baa-83d4-4a48-9fb6-31ae7c3c6e7d" status: 200 len: 194 microversion: 2.1 time: 0.092849 Aug 04 17:10:47.698631 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2733/5584] 10.222.0.23 () {58 vars in 1413 bytes} [Thu Aug 4 17:10:47 2022] GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8/os-volume_attachments/77c10baa-83d4-4a48-9fb6-31ae7c3c6e7d => generated 194 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:10:48.464581 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f3601d8f-d992-4765-b8b4-8fae35f506fc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:48.465983 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f3601d8f-d992-4765-b8b4-8fae35f506fc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:48.507516 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3601d8f-d992-4765-b8b4-8fae35f506fc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:48.509466 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3601d8f-d992-4765-b8b4-8fae35f506fc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:48.514401 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3601d8f-d992-4765-b8b4-8fae35f506fc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:48.515188 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3601d8f-d992-4765-b8b4-8fae35f506fc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:48.888589 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f3601d8f-d992-4765-b8b4-8fae35f506fc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:48.905118 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f3601d8f-d992-4765-b8b4-8fae35f506fc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a" status: 200 len: 1226 microversion: 2.1 time: 0.444918 Aug 04 17:10:48.907012 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2852/5585] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:48 2022] GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a => generated 1226 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:49.215188 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ad5de963-9f64-4273-9338-496c40e47f10 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1578831667", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "c0f301d6-7802-408f-97b8-b6a0e53c9c6a"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:49.388473 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-ad5de963-9f64-4273-9338-496c40e47f10 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] validate_networks() for [('c0f301d6-7802-408f-97b8-b6a0e53c9c6a', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:10:49.938531 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0b4328e9-646b-47f0-b50c-4ab9cecd6c07 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:49.939860 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0b4328e9-646b-47f0-b50c-4ab9cecd6c07 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:49.951855 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0b4328e9-646b-47f0-b50c-4ab9cecd6c07 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:49.952690 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0b4328e9-646b-47f0-b50c-4ab9cecd6c07 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:49.959184 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0b4328e9-646b-47f0-b50c-4ab9cecd6c07 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:49.960029 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0b4328e9-646b-47f0-b50c-4ab9cecd6c07 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:50.163082 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0b4328e9-646b-47f0-b50c-4ab9cecd6c07 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:50.180536 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0b4328e9-646b-47f0-b50c-4ab9cecd6c07 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a" status: 200 len: 1226 microversion: 2.1 time: 0.253672 Aug 04 17:10:50.181321 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2853/5586] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:49 2022] GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a => generated 1226 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:50.651335 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-ad5de963-9f64-4273-9338-496c40e47f10 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:10:50.655249 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-ad5de963-9f64-4273-9338-496c40e47f10 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:10:50.655249 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-ad5de963-9f64-4273-9338-496c40e47f10 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:10:50.655249 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-ad5de963-9f64-4273-9338-496c40e47f10 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:10:50.655249 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-ad5de963-9f64-4273-9338-496c40e47f10 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:10:50.667655 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad5de963-9f64-4273-9338-496c40e47f10 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:50.668379 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad5de963-9f64-4273-9338-496c40e47f10 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:50.669517 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad5de963-9f64-4273-9338-496c40e47f10 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:50.670729 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad5de963-9f64-4273-9338-496c40e47f10 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:50.694307 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-ad5de963-9f64-4273-9338-496c40e47f10 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Getting quotas for project 57bacd72b52f4f0cb34d4de277d5dfda. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:10:50.703766 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-ad5de963-9f64-4273-9338-496c40e47f10 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Getting quotas for user 0c3fd9093913428194a6be01f5224789 and project 57bacd72b52f4f0cb34d4de277d5dfda. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:10:50.739913 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ad5de963-9f64-4273-9338-496c40e47f10 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:10:50.743410 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ad5de963-9f64-4273-9338-496c40e47f10 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] [instance: 89d498e7-9ad6-452b-b90d-b90929e1fab6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:10:50.854580 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ad5de963-9f64-4273-9338-496c40e47f10 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.910674 Aug 04 17:10:50.855826 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2734/5587] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:10:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:10:50.873006 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-afa1fbf5-8e4a-4703-a2d7-c512cb460ab8 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:50.873994 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-afa1fbf5-8e4a-4703-a2d7-c512cb460ab8 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] [instance: 89d498e7-9ad6-452b-b90d-b90929e1fab6] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:50.949665 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-afa1fbf5-8e4a-4703-a2d7-c512cb460ab8 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c3fd9093913428194a6be01f5224789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bacd72b52f4f0cb34d4de277d5dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:50.962421 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-afa1fbf5-8e4a-4703-a2d7-c512cb460ab8 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] 10.222.0.23 "GET /compute/v2.1/servers/89d498e7-9ad6-452b-b90d-b90929e1fab6" status: 200 len: 1214 microversion: 2.1 time: 0.099279 Aug 04 17:10:50.975886 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2854/5588] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:50 2022] GET /compute/v2.1/servers/89d498e7-9ad6-452b-b90d-b90929e1fab6 => generated 1214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:51.206167 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7d33ddf0-d3a1-4e5a-b386-579115865fef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:51.206808 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7d33ddf0-d3a1-4e5a-b386-579115865fef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:51.216978 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7d33ddf0-d3a1-4e5a-b386-579115865fef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:51.218001 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7d33ddf0-d3a1-4e5a-b386-579115865fef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:51.219079 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7d33ddf0-d3a1-4e5a-b386-579115865fef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:51.219759 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7d33ddf0-d3a1-4e5a-b386-579115865fef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:51.232253 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e70c226b-83c3-4f37-8131-e116b5493e73 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e00ba81-c766-4d92-a73a-0b2d359cd30b"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:51.251535 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e70c226b-83c3-4f37-8131-e116b5493e73 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: 9856bd39-78da-4852-a1ce-d93c747f00c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:51.315236 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e70c226b-83c3-4f37-8131-e116b5493e73 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:51.316009 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e70c226b-83c3-4f37-8131-e116b5493e73 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:51.317026 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e70c226b-83c3-4f37-8131-e116b5493e73 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:51.317855 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e70c226b-83c3-4f37-8131-e116b5493e73 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:51.329568 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7d33ddf0-d3a1-4e5a-b386-579115865fef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:51.338875 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7d33ddf0-d3a1-4e5a-b386-579115865fef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a" status: 200 len: 1226 microversion: 2.1 time: 0.137001 Aug 04 17:10:51.354151 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2735/5589] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:51 2022] GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a => generated 1226 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:51.988418 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a6f634d6-1e60-42d1-9883-27a2616b1bae tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:51.992198 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a6f634d6-1e60-42d1-9883-27a2616b1bae tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] [instance: 89d498e7-9ad6-452b-b90d-b90929e1fab6] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:52.039656 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6f634d6-1e60-42d1-9883-27a2616b1bae tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:52.044907 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6f634d6-1e60-42d1-9883-27a2616b1bae tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:52.049862 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6f634d6-1e60-42d1-9883-27a2616b1bae tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:52.057479 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6f634d6-1e60-42d1-9883-27a2616b1bae tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:52.100681 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e70c226b-83c3-4f37-8131-e116b5493e73 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "POST /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.873238 Aug 04 17:10:52.109508 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2855/5590] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Aug 4 17:10:51 2022] POST /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8/os-volume_attachments => generated 194 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:10:52.235193 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a6f634d6-1e60-42d1-9883-27a2616b1bae tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c3fd9093913428194a6be01f5224789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bacd72b52f4f0cb34d4de277d5dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:52.247447 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a6f634d6-1e60-42d1-9883-27a2616b1bae tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] 10.222.0.23 "GET /compute/v2.1/servers/89d498e7-9ad6-452b-b90d-b90929e1fab6" status: 200 len: 1210 microversion: 2.1 time: 0.268174 Aug 04 17:10:52.254544 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2736/5591] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:51 2022] GET /compute/v2.1/servers/89d498e7-9ad6-452b-b90d-b90929e1fab6 => generated 1210 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:10:52.367472 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-378d464c-7d45-4ec7-9c8e-cd79a11ae8c3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:52.368494 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-378d464c-7d45-4ec7-9c8e-cd79a11ae8c3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:52.386473 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-378d464c-7d45-4ec7-9c8e-cd79a11ae8c3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:52.391410 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-378d464c-7d45-4ec7-9c8e-cd79a11ae8c3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:52.393219 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-378d464c-7d45-4ec7-9c8e-cd79a11ae8c3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:52.398649 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-378d464c-7d45-4ec7-9c8e-cd79a11ae8c3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:52.604658 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-378d464c-7d45-4ec7-9c8e-cd79a11ae8c3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:52.618918 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-378d464c-7d45-4ec7-9c8e-cd79a11ae8c3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a" status: 200 len: 1226 microversion: 2.1 time: 0.254508 Aug 04 17:10:52.637579 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2856/5592] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:52 2022] GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a => generated 1226 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:53.276719 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9793ca51-3c6d-467b-a9e1-a5635a8be857 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:53.278029 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9793ca51-3c6d-467b-a9e1-a5635a8be857 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] [instance: 89d498e7-9ad6-452b-b90d-b90929e1fab6] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:53.294593 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9793ca51-3c6d-467b-a9e1-a5635a8be857 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:53.295069 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9793ca51-3c6d-467b-a9e1-a5635a8be857 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:53.295866 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9793ca51-3c6d-467b-a9e1-a5635a8be857 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:53.308603 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9793ca51-3c6d-467b-a9e1-a5635a8be857 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:53.645597 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-10995017-31e3-4363-875c-d3982f9146f5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:53.646216 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-10995017-31e3-4363-875c-d3982f9146f5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:53.655247 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9793ca51-3c6d-467b-a9e1-a5635a8be857 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c3fd9093913428194a6be01f5224789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bacd72b52f4f0cb34d4de277d5dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:53.663992 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9793ca51-3c6d-467b-a9e1-a5635a8be857 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] 10.222.0.23 "GET /compute/v2.1/servers/89d498e7-9ad6-452b-b90d-b90929e1fab6" status: 200 len: 1274 microversion: 2.1 time: 0.392426 Aug 04 17:10:53.666189 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-10995017-31e3-4363-875c-d3982f9146f5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:53.666641 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-10995017-31e3-4363-875c-d3982f9146f5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:53.667430 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-10995017-31e3-4363-875c-d3982f9146f5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:53.667862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-10995017-31e3-4363-875c-d3982f9146f5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:53.669553 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2737/5593] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:53 2022] GET /compute/v2.1/servers/89d498e7-9ad6-452b-b90d-b90929e1fab6 => generated 1274 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:53.848290 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-10995017-31e3-4363-875c-d3982f9146f5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:53.876285 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-10995017-31e3-4363-875c-d3982f9146f5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a" status: 200 len: 1226 microversion: 2.1 time: 0.235514 Aug 04 17:10:53.886575 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2857/5594] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:53 2022] GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a => generated 1226 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:54.690210 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d46795d2-d1b5-4f1c-aaa8-f7393378e189 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:54.691038 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d46795d2-d1b5-4f1c-aaa8-f7393378e189 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] [instance: 89d498e7-9ad6-452b-b90d-b90929e1fab6] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:54.699983 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d46795d2-d1b5-4f1c-aaa8-f7393378e189 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:54.700538 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d46795d2-d1b5-4f1c-aaa8-f7393378e189 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:54.701811 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d46795d2-d1b5-4f1c-aaa8-f7393378e189 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:54.702154 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d46795d2-d1b5-4f1c-aaa8-f7393378e189 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:54.818469 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d46795d2-d1b5-4f1c-aaa8-f7393378e189 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c3fd9093913428194a6be01f5224789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bacd72b52f4f0cb34d4de277d5dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:54.829236 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d46795d2-d1b5-4f1c-aaa8-f7393378e189 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] 10.222.0.23 "GET /compute/v2.1/servers/89d498e7-9ad6-452b-b90d-b90929e1fab6" status: 200 len: 1272 microversion: 2.1 time: 0.143062 Aug 04 17:10:54.830513 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2738/5595] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:54 2022] GET /compute/v2.1/servers/89d498e7-9ad6-452b-b90d-b90929e1fab6 => generated 1272 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:54.924218 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-03869573-fc7d-48c5-b3a6-df057db89eb5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:54.925865 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-03869573-fc7d-48c5-b3a6-df057db89eb5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:54.933798 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-03869573-fc7d-48c5-b3a6-df057db89eb5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:54.934642 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-03869573-fc7d-48c5-b3a6-df057db89eb5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:54.935644 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-03869573-fc7d-48c5-b3a6-df057db89eb5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:54.936301 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-03869573-fc7d-48c5-b3a6-df057db89eb5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:55.176498 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-03869573-fc7d-48c5-b3a6-df057db89eb5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:55.191485 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-03869573-fc7d-48c5-b3a6-df057db89eb5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a" status: 200 len: 1226 microversion: 2.1 time: 0.270623 Aug 04 17:10:55.192887 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2858/5596] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:54 2022] GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a => generated 1226 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:55.851555 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0d39a209-d33f-43e6-96fc-9ae6051d5754 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:55.852167 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0d39a209-d33f-43e6-96fc-9ae6051d5754 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] [instance: 89d498e7-9ad6-452b-b90d-b90929e1fab6] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:55.862047 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0d39a209-d33f-43e6-96fc-9ae6051d5754 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:55.877593 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0d39a209-d33f-43e6-96fc-9ae6051d5754 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:55.879690 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0d39a209-d33f-43e6-96fc-9ae6051d5754 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:55.882680 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0d39a209-d33f-43e6-96fc-9ae6051d5754 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:56.213986 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-de787a5d-4e45-4e53-95fc-38bcfddce1b6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:56.214668 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-de787a5d-4e45-4e53-95fc-38bcfddce1b6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:56.224435 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-de787a5d-4e45-4e53-95fc-38bcfddce1b6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:56.224991 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-de787a5d-4e45-4e53-95fc-38bcfddce1b6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:56.225880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-de787a5d-4e45-4e53-95fc-38bcfddce1b6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:56.226508 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-de787a5d-4e45-4e53-95fc-38bcfddce1b6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:56.275625 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-de787a5d-4e45-4e53-95fc-38bcfddce1b6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:56.276051 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-de787a5d-4e45-4e53-95fc-38bcfddce1b6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:56.276671 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-de787a5d-4e45-4e53-95fc-38bcfddce1b6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lazy-loading 'fault' on Instance uuid dc8307a2-4a12-4301-a04f-6ed3bccb7d1a {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:10:56.321456 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0d39a209-d33f-43e6-96fc-9ae6051d5754 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c3fd9093913428194a6be01f5224789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bacd72b52f4f0cb34d4de277d5dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:56.331292 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0d39a209-d33f-43e6-96fc-9ae6051d5754 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] 10.222.0.23 "GET /compute/v2.1/servers/89d498e7-9ad6-452b-b90d-b90929e1fab6" status: 200 len: 1314 microversion: 2.1 time: 0.484425 Aug 04 17:10:56.331910 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2739/5597] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:55 2022] GET /compute/v2.1/servers/89d498e7-9ad6-452b-b90d-b90929e1fab6 => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:56.371762 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-de787a5d-4e45-4e53-95fc-38bcfddce1b6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:56.384642 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-de787a5d-4e45-4e53-95fc-38bcfddce1b6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a" status: 200 len: 1231 microversion: 2.1 time: 0.175006 Aug 04 17:10:56.400281 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2859/5598] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:56 2022] GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a => generated 1231 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:56.856628 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-f440a961-e97a-4071-9430-ba4bb3a848fc req-6b1efd1f-a15e-4679-a705-d032cbca966d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89d498e7-9ad6-452b-b90d-b90929e1fab6", "tag": "ef1c81c9-fe12-4f9c-816d-3668e0ded5ee"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:56.878672 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f440a961-e97a-4071-9430-ba4bb3a848fc req-6b1efd1f-a15e-4679-a705-d032cbca966d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:56.879461 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f440a961-e97a-4071-9430-ba4bb3a848fc req-6b1efd1f-a15e-4679-a705-d032cbca966d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:56.902424 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-f440a961-e97a-4071-9430-ba4bb3a848fc req-6b1efd1f-a15e-4679-a705-d032cbca966d service nova] Creating event network-changed:ef1c81c9-fe12-4f9c-816d-3668e0ded5ee for instance 89d498e7-9ad6-452b-b90d-b90929e1fab6 on n-h1-846466-12 Aug 04 17:10:56.915917 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-f440a961-e97a-4071-9430-ba4bb3a848fc req-6b1efd1f-a15e-4679-a705-d032cbca966d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062815 Aug 04 17:10:56.916969 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2740/5599] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:10:57.355875 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-df5b530e-33d6-43ee-b6bb-c6cb08284a20 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:57.357494 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-df5b530e-33d6-43ee-b6bb-c6cb08284a20 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] [instance: 89d498e7-9ad6-452b-b90d-b90929e1fab6] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:57.365940 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df5b530e-33d6-43ee-b6bb-c6cb08284a20 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:57.366698 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df5b530e-33d6-43ee-b6bb-c6cb08284a20 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:57.367874 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df5b530e-33d6-43ee-b6bb-c6cb08284a20 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:57.368635 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-df5b530e-33d6-43ee-b6bb-c6cb08284a20 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:57.412674 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e2ec93be-bd78-4bed-9982-fddcfcfa8f21 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:57.413599 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e2ec93be-bd78-4bed-9982-fddcfcfa8f21 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:57.425234 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e2ec93be-bd78-4bed-9982-fddcfcfa8f21 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:57.425976 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e2ec93be-bd78-4bed-9982-fddcfcfa8f21 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:57.427073 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e2ec93be-bd78-4bed-9982-fddcfcfa8f21 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:57.427772 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e2ec93be-bd78-4bed-9982-fddcfcfa8f21 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:57.445442 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-e2ec93be-bd78-4bed-9982-fddcfcfa8f21 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] HTTP exception thrown: Instance dc8307a2-4a12-4301-a04f-6ed3bccb7d1a could not be found. Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e2ec93be-bd78-4bed-9982-fddcfcfa8f21 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Request method failure captured: Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a HTTP/1.1 Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_saEEOyGnjC2YSw5rO0XXZ0SIXFPgcyNqjoEnoWtNKNr9NN9-nC4VrXak9kuQQxq1he9punHwiXqtbTRNS_i0OM4UCS6bcDxdgTY6YMq4AHl3lv7jEdWuqMUDAU4k5OfnQSgkMml4THPPXJh4YiohQx-XVMfF21_bM4MqtZQZ4iEBI Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 78a0adb69ba24749817a8855effc20ad Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78a0adb69ba24749817a8855effc20ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_78a0adb69ba24749817a8855effc20ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78a0adb69ba24749817a8855effc20ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/78a0adb69ba24749817a8855effc20ad"}]}] Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 78a0adb69ba24749817a8855effc20ad Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-TestVolumeBootPattern-1920412406-project Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: ea9cab1c1eff47ddb881a2b57bf240f3 Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-TestVolumeBootPattern-1920412406-project Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance dc8307a2-4a12-4301-a04f-6ed3bccb7d1a could not be found. Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'dc8307a2-4a12-4301-a04f-6ed3bccb7d1a'} Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc8307a2-4a12-4301-a04f-6ed3bccb7d1a could not be found. Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc8307a2-4a12-4301-a04f-6ed3bccb7d1a could not be found. Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:10:57.447678 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:10:57.451936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:57.451936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:10:57.451936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:10:57.451936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:10:57.451936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:10:57.451936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc8307a2-4a12-4301-a04f-6ed3bccb7d1a could not be found. Aug 04 17:10:57.451936 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:10:57.454655 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e2ec93be-bd78-4bed-9982-fddcfcfa8f21 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Returning 404 to user: Instance dc8307a2-4a12-4301-a04f-6ed3bccb7d1a could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:10:57.456324 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e2ec93be-bd78-4bed-9982-fddcfcfa8f21 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a" status: 404 len: 111 microversion: 2.1 time: 0.049028 Aug 04 17:10:57.457267 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2741/5600] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:57 2022] GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:10:57.633165 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-df5b530e-33d6-43ee-b6bb-c6cb08284a20 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c3fd9093913428194a6be01f5224789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bacd72b52f4f0cb34d4de277d5dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:57.642982 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-df5b530e-33d6-43ee-b6bb-c6cb08284a20 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] 10.222.0.23 "GET /compute/v2.1/servers/89d498e7-9ad6-452b-b90d-b90929e1fab6" status: 200 len: 1314 microversion: 2.1 time: 0.291516 Aug 04 17:10:57.648610 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2860/5601] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:57 2022] GET /compute/v2.1/servers/89d498e7-9ad6-452b-b90d-b90929e1fab6 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:57.691237 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-92c897c1-28a8-4723-9adc-670f6f193788 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2027537096", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1843310632", "security_groups": [{"name": "tempest-secgroup-smoke-1275595346"}], "block_device_mapping_v2": [{"uuid": "e00165ec-8fe4-4173-a576-8d54d74cf173", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8cd64b36-f8a8-48d4-b083-6164d20009da"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:57.872742 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-92c897c1-28a8-4723-9adc-670f6f193788 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] validate_networks() for [('8cd64b36-f8a8-48d4-b083-6164d20009da', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:10:58.669075 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-61a8ba80-5caa-471f-91e2-a4b8a26c21d7 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:58.670044 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-61a8ba80-5caa-471f-91e2-a4b8a26c21d7 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] [instance: 89d498e7-9ad6-452b-b90d-b90929e1fab6] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:58.678830 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-61a8ba80-5caa-471f-91e2-a4b8a26c21d7 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:58.679668 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-61a8ba80-5caa-471f-91e2-a4b8a26c21d7 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:58.680740 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-61a8ba80-5caa-471f-91e2-a4b8a26c21d7 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:58.681558 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-61a8ba80-5caa-471f-91e2-a4b8a26c21d7 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:58.983384 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-92c897c1-28a8-4723-9adc-670f6f193788 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:10:58.984356 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-92c897c1-28a8-4723-9adc-670f6f193788 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:10:58.985125 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-92c897c1-28a8-4723-9adc-670f6f193788 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:10:58.985628 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-92c897c1-28a8-4723-9adc-670f6f193788 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:10:58.986145 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-92c897c1-28a8-4723-9adc-670f6f193788 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:10:58.997560 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-92c897c1-28a8-4723-9adc-670f6f193788 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:58.999835 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-92c897c1-28a8-4723-9adc-670f6f193788 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:59.000917 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-92c897c1-28a8-4723-9adc-670f6f193788 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:10:59.001629 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-92c897c1-28a8-4723-9adc-670f6f193788 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:10:59.024861 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-92c897c1-28a8-4723-9adc-670f6f193788 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Getting quotas for project 78a0adb69ba24749817a8855effc20ad. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:10:59.032479 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-92c897c1-28a8-4723-9adc-670f6f193788 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Getting quotas for user ea9cab1c1eff47ddb881a2b57bf240f3 and project 78a0adb69ba24749817a8855effc20ad. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:10:59.087881 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-61a8ba80-5caa-471f-91e2-a4b8a26c21d7 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c3fd9093913428194a6be01f5224789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bacd72b52f4f0cb34d4de277d5dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:59.099652 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-61a8ba80-5caa-471f-91e2-a4b8a26c21d7 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] 10.222.0.23 "GET /compute/v2.1/servers/89d498e7-9ad6-452b-b90d-b90929e1fab6" status: 200 len: 1314 microversion: 2.1 time: 0.434922 Aug 04 17:10:59.100973 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2861/5602] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:58 2022] GET /compute/v2.1/servers/89d498e7-9ad6-452b-b90d-b90929e1fab6 => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:59.106510 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-92c897c1-28a8-4723-9adc-670f6f193788 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:10:59.108854 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-92c897c1-28a8-4723-9adc-670f6f193788 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e00165ec-8fe4-4173-a576-8d54d74cf173',volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:10:59.266099 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-92c897c1-28a8-4723-9adc-670f6f193788 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.579108 Aug 04 17:10:59.267180 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2742/5603] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:10:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 1581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:10:59.278451 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9dce3a4b-dc11-4c2e-b725-fe12468e1d89 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:59.279458 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9dce3a4b-dc11-4c2e-b725-fe12468e1d89 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:59.409183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9dce3a4b-dc11-4c2e-b725-fe12468e1d89 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:59.420868 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9dce3a4b-dc11-4c2e-b725-fe12468e1d89 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1095 microversion: 2.1 time: 0.146325 Aug 04 17:10:59.422335 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2862/5604] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:59 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1095 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:00.126651 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d8064834-2f6b-47d9-8d2e-c535db615502 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:00.127535 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d8064834-2f6b-47d9-8d2e-c535db615502 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] [instance: 89d498e7-9ad6-452b-b90d-b90929e1fab6] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:00.145437 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d8064834-2f6b-47d9-8d2e-c535db615502 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:00.148031 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d8064834-2f6b-47d9-8d2e-c535db615502 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:00.149255 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d8064834-2f6b-47d9-8d2e-c535db615502 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:00.150664 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d8064834-2f6b-47d9-8d2e-c535db615502 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:00.443908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-52394ff9-6d06-45ce-8982-7b9ef9b5356d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:00.445372 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-52394ff9-6d06-45ce-8982-7b9ef9b5356d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:00.456003 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-52394ff9-6d06-45ce-8982-7b9ef9b5356d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:00.456914 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-52394ff9-6d06-45ce-8982-7b9ef9b5356d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:00.458167 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-52394ff9-6d06-45ce-8982-7b9ef9b5356d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:00.458808 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-52394ff9-6d06-45ce-8982-7b9ef9b5356d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:00.527465 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d8064834-2f6b-47d9-8d2e-c535db615502 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c3fd9093913428194a6be01f5224789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bacd72b52f4f0cb34d4de277d5dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:00.536797 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d8064834-2f6b-47d9-8d2e-c535db615502 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] 10.222.0.23 "GET /compute/v2.1/servers/89d498e7-9ad6-452b-b90d-b90929e1fab6" status: 200 len: 1314 microversion: 2.1 time: 0.418940 Aug 04 17:11:00.537915 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2743/5605] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:00 2022] GET /compute/v2.1/servers/89d498e7-9ad6-452b-b90d-b90929e1fab6 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:00.586055 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-52394ff9-6d06-45ce-8982-7b9ef9b5356d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:00.595965 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:00.599058 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-52394ff9-6d06-45ce-8982-7b9ef9b5356d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1201 microversion: 2.1 time: 0.160896 Aug 04 17:11:00.601155 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2863/5606] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:00 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1201 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:01.559721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-775c3317-af40-4d74-b499-92c3e62706dd tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:01.561206 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-775c3317-af40-4d74-b499-92c3e62706dd tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] [instance: 89d498e7-9ad6-452b-b90d-b90929e1fab6] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:01.570614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-775c3317-af40-4d74-b499-92c3e62706dd tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:01.571352 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-775c3317-af40-4d74-b499-92c3e62706dd tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:01.572418 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-775c3317-af40-4d74-b499-92c3e62706dd tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:01.573023 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-775c3317-af40-4d74-b499-92c3e62706dd tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:01.621915 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e2391125-5395-4055-90ad-31424692551c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:01.622556 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e2391125-5395-4055-90ad-31424692551c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:01.634638 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e2391125-5395-4055-90ad-31424692551c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:01.635578 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e2391125-5395-4055-90ad-31424692551c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:01.636555 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e2391125-5395-4055-90ad-31424692551c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:01.637195 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e2391125-5395-4055-90ad-31424692551c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:01.793089 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e2391125-5395-4055-90ad-31424692551c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:01.814656 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e2391125-5395-4055-90ad-31424692551c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1211 microversion: 2.1 time: 0.195937 Aug 04 17:11:01.837725 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2864/5607] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:01 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1211 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:02.331807 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-775c3317-af40-4d74-b499-92c3e62706dd tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c3fd9093913428194a6be01f5224789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bacd72b52f4f0cb34d4de277d5dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:02.341978 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-775c3317-af40-4d74-b499-92c3e62706dd tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] 10.222.0.23 "GET /compute/v2.1/servers/89d498e7-9ad6-452b-b90d-b90929e1fab6" status: 200 len: 1314 microversion: 2.1 time: 0.787322 Aug 04 17:11:02.351572 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2744/5608] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:01 2022] GET /compute/v2.1/servers/89d498e7-9ad6-452b-b90d-b90929e1fab6 => generated 1314 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:02.609057 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-091c3ff4-a373-4ca2-9d97-87a5690b3832 req-5116e368-0267-4e47-9cd0-62085917372a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89d498e7-9ad6-452b-b90d-b90929e1fab6", "name": "network-vif-plugged", "status": "completed", "tag": "ef1c81c9-fe12-4f9c-816d-3668e0ded5ee"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:02.626936 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-091c3ff4-a373-4ca2-9d97-87a5690b3832 req-5116e368-0267-4e47-9cd0-62085917372a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:02.628220 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-091c3ff4-a373-4ca2-9d97-87a5690b3832 req-5116e368-0267-4e47-9cd0-62085917372a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:02.642187 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-091c3ff4-a373-4ca2-9d97-87a5690b3832 req-5116e368-0267-4e47-9cd0-62085917372a service nova] Creating event network-vif-plugged:ef1c81c9-fe12-4f9c-816d-3668e0ded5ee for instance 89d498e7-9ad6-452b-b90d-b90929e1fab6 on n-h1-846466-12 Aug 04 17:11:02.648134 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-091c3ff4-a373-4ca2-9d97-87a5690b3832 req-5116e368-0267-4e47-9cd0-62085917372a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166966 Aug 04 17:11:02.649415 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2865/5609] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:11:02.837171 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-061dc5ff-4912-40b2-b8a2-59ada6c276a7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:02.838483 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-061dc5ff-4912-40b2-b8a2-59ada6c276a7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:02.848897 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-061dc5ff-4912-40b2-b8a2-59ada6c276a7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:02.849651 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-061dc5ff-4912-40b2-b8a2-59ada6c276a7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:02.851257 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-061dc5ff-4912-40b2-b8a2-59ada6c276a7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:02.851878 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-061dc5ff-4912-40b2-b8a2-59ada6c276a7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:03.209959 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-061dc5ff-4912-40b2-b8a2-59ada6c276a7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:03.220133 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-061dc5ff-4912-40b2-b8a2-59ada6c276a7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1279 microversion: 2.1 time: 0.387782 Aug 04 17:11:03.223747 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2745/5610] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:02 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1279 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:03.368909 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6cc7af8b-e00d-4e44-8c7b-a060caaa0108 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:03.369680 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6cc7af8b-e00d-4e44-8c7b-a060caaa0108 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] [instance: 89d498e7-9ad6-452b-b90d-b90929e1fab6] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:03.381579 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6cc7af8b-e00d-4e44-8c7b-a060caaa0108 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:03.382032 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6cc7af8b-e00d-4e44-8c7b-a060caaa0108 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:03.388341 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6cc7af8b-e00d-4e44-8c7b-a060caaa0108 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:03.388922 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6cc7af8b-e00d-4e44-8c7b-a060caaa0108 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:03.739961 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6cc7af8b-e00d-4e44-8c7b-a060caaa0108 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c3fd9093913428194a6be01f5224789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bacd72b52f4f0cb34d4de277d5dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:03.752787 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6cc7af8b-e00d-4e44-8c7b-a060caaa0108 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] 10.222.0.23 "GET /compute/v2.1/servers/89d498e7-9ad6-452b-b90d-b90929e1fab6" status: 200 len: 1314 microversion: 2.1 time: 0.388054 Aug 04 17:11:03.779121 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2866/5611] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:03 2022] GET /compute/v2.1/servers/89d498e7-9ad6-452b-b90d-b90929e1fab6 => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:04.076102 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-21d3e98f-95a4-4063-8827-9458c778aefa req-26d41370-a2f3-4d2e-9890-d1284acdc2bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25704445-abe8-44bb-89d7-870d193deec0", "tag": "6f2c9abd-c5f4-435c-a94c-84a048ee2e9c"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:04.089530 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-21d3e98f-95a4-4063-8827-9458c778aefa req-26d41370-a2f3-4d2e-9890-d1284acdc2bd service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:04.090322 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-21d3e98f-95a4-4063-8827-9458c778aefa req-26d41370-a2f3-4d2e-9890-d1284acdc2bd service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:04.104453 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-21d3e98f-95a4-4063-8827-9458c778aefa req-26d41370-a2f3-4d2e-9890-d1284acdc2bd service nova] Creating event network-changed:6f2c9abd-c5f4-435c-a94c-84a048ee2e9c for instance 25704445-abe8-44bb-89d7-870d193deec0 on n-h2-846466-12 Aug 04 17:11:04.110521 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-21d3e98f-95a4-4063-8827-9458c778aefa req-26d41370-a2f3-4d2e-9890-d1284acdc2bd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039692 Aug 04 17:11:04.111133 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2746/5612] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:11:04.247775 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-db61314a-81da-4717-98aa-9f934dc4fc94 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:04.248957 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-db61314a-81da-4717-98aa-9f934dc4fc94 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:04.256858 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-db61314a-81da-4717-98aa-9f934dc4fc94 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:04.257851 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-db61314a-81da-4717-98aa-9f934dc4fc94 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:04.259081 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-db61314a-81da-4717-98aa-9f934dc4fc94 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:04.259768 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-db61314a-81da-4717-98aa-9f934dc4fc94 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:04.598033 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-db61314a-81da-4717-98aa-9f934dc4fc94 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:04.608343 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-db61314a-81da-4717-98aa-9f934dc4fc94 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1279 microversion: 2.1 time: 0.363670 Aug 04 17:11:04.608927 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2867/5613] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:04 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1279 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:04.802029 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1c4f62e0-67fd-4782-b1da-400f67eea2c2 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:04.803590 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1c4f62e0-67fd-4782-b1da-400f67eea2c2 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] [instance: 89d498e7-9ad6-452b-b90d-b90929e1fab6] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:04.812713 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c4f62e0-67fd-4782-b1da-400f67eea2c2 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:04.813474 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c4f62e0-67fd-4782-b1da-400f67eea2c2 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:04.815476 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c4f62e0-67fd-4782-b1da-400f67eea2c2 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:04.816131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c4f62e0-67fd-4782-b1da-400f67eea2c2 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:05.210158 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1c4f62e0-67fd-4782-b1da-400f67eea2c2 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c3fd9093913428194a6be01f5224789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bacd72b52f4f0cb34d4de277d5dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:05.226059 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1c4f62e0-67fd-4782-b1da-400f67eea2c2 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] 10.222.0.23 "GET /compute/v2.1/servers/89d498e7-9ad6-452b-b90d-b90929e1fab6" status: 200 len: 1497 microversion: 2.1 time: 0.430004 Aug 04 17:11:05.227274 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2747/5614] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:04 2022] GET /compute/v2.1/servers/89d498e7-9ad6-452b-b90d-b90929e1fab6 => generated 1497 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:05.639592 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8c1f46cb-1399-4e2f-a1ed-5acd77bf6b44 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:05.641406 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8c1f46cb-1399-4e2f-a1ed-5acd77bf6b44 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:05.649269 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8c1f46cb-1399-4e2f-a1ed-5acd77bf6b44 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:05.650272 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8c1f46cb-1399-4e2f-a1ed-5acd77bf6b44 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:05.651825 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8c1f46cb-1399-4e2f-a1ed-5acd77bf6b44 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:05.652497 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8c1f46cb-1399-4e2f-a1ed-5acd77bf6b44 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:05.908347 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8c1f46cb-1399-4e2f-a1ed-5acd77bf6b44 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:05.926355 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8c1f46cb-1399-4e2f-a1ed-5acd77bf6b44 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1279 microversion: 2.1 time: 0.300556 Aug 04 17:11:05.926937 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2868/5615] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:05 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1279 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:06.950140 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b7785c9e-497f-42d8-b516-af989a2bc00a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:06.951644 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b7785c9e-497f-42d8-b516-af989a2bc00a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:06.968889 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7785c9e-497f-42d8-b516-af989a2bc00a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:06.970311 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7785c9e-497f-42d8-b516-af989a2bc00a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:06.971435 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7785c9e-497f-42d8-b516-af989a2bc00a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:06.972113 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7785c9e-497f-42d8-b516-af989a2bc00a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:07.137572 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b7785c9e-497f-42d8-b516-af989a2bc00a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:07.147160 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b7785c9e-497f-42d8-b516-af989a2bc00a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1279 microversion: 2.1 time: 0.202957 Aug 04 17:11:07.161061 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2748/5616] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:06 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1279 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:08.168474 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-daae982d-ed4d-4f62-a42a-772561737b2f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:08.169085 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-daae982d-ed4d-4f62-a42a-772561737b2f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:08.177715 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-daae982d-ed4d-4f62-a42a-772561737b2f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:08.178164 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-daae982d-ed4d-4f62-a42a-772561737b2f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:08.179137 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-daae982d-ed4d-4f62-a42a-772561737b2f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:08.179801 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-daae982d-ed4d-4f62-a42a-772561737b2f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:08.350146 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-daae982d-ed4d-4f62-a42a-772561737b2f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:08.350146 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-daae982d-ed4d-4f62-a42a-772561737b2f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1279 microversion: 2.1 time: 0.185234 Aug 04 17:11:08.350146 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2869/5617] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:08 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1279 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:09.370470 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-aac9fe21-42b7-408e-b190-c0275e50fce6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:09.371139 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-aac9fe21-42b7-408e-b190-c0275e50fce6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:09.375232 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=4 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:09.379000 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=12 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:09.405875 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aac9fe21-42b7-408e-b190-c0275e50fce6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:09.406944 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aac9fe21-42b7-408e-b190-c0275e50fce6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:09.412101 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aac9fe21-42b7-408e-b190-c0275e50fce6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:09.412933 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aac9fe21-42b7-408e-b190-c0275e50fce6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:09.724931 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-aac9fe21-42b7-408e-b190-c0275e50fce6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:09.729775 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=100 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:09.736622 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-aac9fe21-42b7-408e-b190-c0275e50fce6 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1279 microversion: 2.1 time: 0.370818 Aug 04 17:11:09.750184 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2749/5618] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:09 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1279 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:10.768472 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dfcd8809-6f28-4966-a8a7-a2f96d31c111 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:10.770718 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dfcd8809-6f28-4966-a8a7-a2f96d31c111 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:10.782697 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:10.786100 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dfcd8809-6f28-4966-a8a7-a2f96d31c111 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:10.786946 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dfcd8809-6f28-4966-a8a7-a2f96d31c111 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:10.787500 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dfcd8809-6f28-4966-a8a7-a2f96d31c111 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:10.788094 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dfcd8809-6f28-4966-a8a7-a2f96d31c111 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:11.057971 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dfcd8809-6f28-4966-a8a7-a2f96d31c111 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:11.070215 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dfcd8809-6f28-4966-a8a7-a2f96d31c111 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1279 microversion: 2.1 time: 0.313389 Aug 04 17:11:11.071403 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2870/5619] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:10 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1279 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:12.093652 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e7c106af-e020-4431-b556-61127f20296e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:12.094377 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e7c106af-e020-4431-b556-61127f20296e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:12.117040 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e7c106af-e020-4431-b556-61127f20296e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:12.123415 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e7c106af-e020-4431-b556-61127f20296e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:12.124886 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e7c106af-e020-4431-b556-61127f20296e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:12.125555 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e7c106af-e020-4431-b556-61127f20296e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:12.472247 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e7c106af-e020-4431-b556-61127f20296e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:12.482365 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e7c106af-e020-4431-b556-61127f20296e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1279 microversion: 2.1 time: 0.395237 Aug 04 17:11:12.486017 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2750/5620] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:12 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1279 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:13.037932 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-983b126a-3d5e-4447-af33-1597d7b43ffb tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:13.038454 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-983b126a-3d5e-4447-af33-1597d7b43ffb tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] [instance: 89d498e7-9ad6-452b-b90d-b90929e1fab6] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:13.054192 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:13.069602 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-983b126a-3d5e-4447-af33-1597d7b43ffb tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:13.070292 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-983b126a-3d5e-4447-af33-1597d7b43ffb tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:13.071242 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-983b126a-3d5e-4447-af33-1597d7b43ffb tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:13.071823 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-983b126a-3d5e-4447-af33-1597d7b43ffb tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:13.141618 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-983b126a-3d5e-4447-af33-1597d7b43ffb tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] [instance: 89d498e7-9ad6-452b-b90d-b90929e1fab6] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:11:13.309224 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-983b126a-3d5e-4447-af33-1597d7b43ffb tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] 10.222.0.23 "DELETE /compute/v2.1/servers/89d498e7-9ad6-452b-b90d-b90929e1fab6" status: 204 len: 0 microversion: 2.1 time: 0.282690 Aug 04 17:11:13.309973 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2871/5621] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:11:13 2022] DELETE /compute/v2.1/servers/89d498e7-9ad6-452b-b90d-b90929e1fab6 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:11:13.324442 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4b3dc618-ee4b-4812-9852-335cfa5cec1d tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:13.325378 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4b3dc618-ee4b-4812-9852-335cfa5cec1d tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] [instance: 89d498e7-9ad6-452b-b90d-b90929e1fab6] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:13.351305 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:13.353116 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b3dc618-ee4b-4812-9852-335cfa5cec1d tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:13.362117 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b3dc618-ee4b-4812-9852-335cfa5cec1d tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:13.363124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b3dc618-ee4b-4812-9852-335cfa5cec1d tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:13.364301 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b3dc618-ee4b-4812-9852-335cfa5cec1d tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:13.504824 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-97a1263d-1edc-4015-8ebd-40c2a5b1fd54 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:13.545254 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-97a1263d-1edc-4015-8ebd-40c2a5b1fd54 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:13.564891 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-97a1263d-1edc-4015-8ebd-40c2a5b1fd54 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:13.568911 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-97a1263d-1edc-4015-8ebd-40c2a5b1fd54 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:13.573930 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-97a1263d-1edc-4015-8ebd-40c2a5b1fd54 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:13.574635 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-97a1263d-1edc-4015-8ebd-40c2a5b1fd54 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:13.633546 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4b3dc618-ee4b-4812-9852-335cfa5cec1d tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c3fd9093913428194a6be01f5224789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bacd72b52f4f0cb34d4de277d5dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:13.645402 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4b3dc618-ee4b-4812-9852-335cfa5cec1d tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] 10.222.0.23 "GET /compute/v2.1/servers/89d498e7-9ad6-452b-b90d-b90929e1fab6" status: 200 len: 1503 microversion: 2.1 time: 0.327531 Aug 04 17:11:13.646303 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2751/5622] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:13 2022] GET /compute/v2.1/servers/89d498e7-9ad6-452b-b90d-b90929e1fab6 => generated 1503 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:13.770825 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9b65bd3a-fc2b-4c02-a2c1-f445d9d6ce84 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:13.776945 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9b65bd3a-fc2b-4c02-a2c1-f445d9d6ce84 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: 9856bd39-78da-4852-a1ce-d93c747f00c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:13.787554 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9b65bd3a-fc2b-4c02-a2c1-f445d9d6ce84 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:13.788037 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9b65bd3a-fc2b-4c02-a2c1-f445d9d6ce84 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:13.788893 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9b65bd3a-fc2b-4c02-a2c1-f445d9d6ce84 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:13.789401 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9b65bd3a-fc2b-4c02-a2c1-f445d9d6ce84 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:13.833247 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9b65bd3a-fc2b-4c02-a2c1-f445d9d6ce84 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.072761 Aug 04 17:11:13.834493 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2752/5623] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:11:13 2022] GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8/os-volume_attachments => generated 371 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:11:13.864330 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-97a1263d-1edc-4015-8ebd-40c2a5b1fd54 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:13.877596 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-97a1263d-1edc-4015-8ebd-40c2a5b1fd54 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1279 microversion: 2.1 time: 0.376442 Aug 04 17:11:13.885327 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2872/5624] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:13 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1279 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:11:13.990853 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-db9baa76-d9e7-4831-87d2-b7c25854b471 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:13.991255 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-db9baa76-d9e7-4831-87d2-b7c25854b471 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: 9856bd39-78da-4852-a1ce-d93c747f00c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:13.998251 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-db9baa76-d9e7-4831-87d2-b7c25854b471 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:13.998876 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-db9baa76-d9e7-4831-87d2-b7c25854b471 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:13.999627 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-502c4898-3e3d-4de3-9feb-16a18e23b2e3 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:13.999787 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-db9baa76-d9e7-4831-87d2-b7c25854b471 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:14.000190 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-db9baa76-d9e7-4831-87d2-b7c25854b471 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:14.000733 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-502c4898-3e3d-4de3-9feb-16a18e23b2e3 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] [instance: 35918880-3ff3-4163-97af-b7e794421b4c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:14.010166 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-502c4898-3e3d-4de3-9feb-16a18e23b2e3 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:14.010639 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-502c4898-3e3d-4de3-9feb-16a18e23b2e3 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:14.011438 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-502c4898-3e3d-4de3-9feb-16a18e23b2e3 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:14.011888 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-502c4898-3e3d-4de3-9feb-16a18e23b2e3 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:14.058096 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-db9baa76-d9e7-4831-87d2-b7c25854b471 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8/os-volume_attachments/77c10baa-83d4-4a48-9fb6-31ae7c3c6e7d" status: 200 len: 194 microversion: 2.1 time: 0.071339 Aug 04 17:11:14.058815 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2873/5625] 10.222.0.23 () {58 vars in 1413 bytes} [Thu Aug 4 17:11:13 2022] GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8/os-volume_attachments/77c10baa-83d4-4a48-9fb6-31ae7c3c6e7d => generated 194 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:11:14.073264 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ccad36af-25e1-4088-ac21-f669378dcc6e tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:14.074409 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ccad36af-25e1-4088-ac21-f669378dcc6e tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: 9856bd39-78da-4852-a1ce-d93c747f00c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:14.090137 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ccad36af-25e1-4088-ac21-f669378dcc6e tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:14.090852 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ccad36af-25e1-4088-ac21-f669378dcc6e tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:14.091823 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ccad36af-25e1-4088-ac21-f669378dcc6e tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:14.092672 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ccad36af-25e1-4088-ac21-f669378dcc6e tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:14.149571 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-502c4898-3e3d-4de3-9feb-16a18e23b2e3 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lazy-loading 'services' on Instance uuid 35918880-3ff3-4163-97af-b7e794421b4c {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:11:14.221631 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-ccad36af-25e1-4088-ac21-f669378dcc6e tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lazy-loading 'services' on Instance uuid 9856bd39-78da-4852-a1ce-d93c747f00c8 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:11:14.295163 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-502c4898-3e3d-4de3-9feb-16a18e23b2e3 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] 10.222.0.23 "DELETE /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c/os-volume_attachments/c6b21979-f74a-4c26-a3ef-55d7185843d0" status: 202 len: 0 microversion: 2.1 time: 0.306450 Aug 04 17:11:14.297461 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2753/5626] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Aug 4 17:11:13 2022] DELETE /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c/os-volume_attachments/c6b21979-f74a-4c26-a3ef-55d7185843d0 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:11:14.350113 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ccad36af-25e1-4088-ac21-f669378dcc6e tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8/os-volume_attachments/77c10baa-83d4-4a48-9fb6-31ae7c3c6e7d" status: 202 len: 0 microversion: 2.1 time: 0.283498 Aug 04 17:11:14.351326 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2874/5627] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Aug 4 17:11:14 2022] DELETE /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8/os-volume_attachments/77c10baa-83d4-4a48-9fb6-31ae7c3c6e7d => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:11:14.678674 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b38d79b5-d20b-46f8-a408-b5163eb0a1cd tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:14.679466 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b38d79b5-d20b-46f8-a408-b5163eb0a1cd tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] [instance: 89d498e7-9ad6-452b-b90d-b90929e1fab6] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:14.723149 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b38d79b5-d20b-46f8-a408-b5163eb0a1cd tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:14.723925 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b38d79b5-d20b-46f8-a408-b5163eb0a1cd tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:14.725045 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b38d79b5-d20b-46f8-a408-b5163eb0a1cd tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:14.725718 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b38d79b5-d20b-46f8-a408-b5163eb0a1cd tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:14.925385 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-57a71a97-a73d-4e79-84f7-a020b2212d66 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:14.926812 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-57a71a97-a73d-4e79-84f7-a020b2212d66 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:14.937982 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-57a71a97-a73d-4e79-84f7-a020b2212d66 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:14.938603 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-57a71a97-a73d-4e79-84f7-a020b2212d66 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:14.940313 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-57a71a97-a73d-4e79-84f7-a020b2212d66 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:14.940577 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-57a71a97-a73d-4e79-84f7-a020b2212d66 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:14.996420 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b38d79b5-d20b-46f8-a408-b5163eb0a1cd tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c3fd9093913428194a6be01f5224789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bacd72b52f4f0cb34d4de277d5dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:15.033297 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b38d79b5-d20b-46f8-a408-b5163eb0a1cd tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] 10.222.0.23 "GET /compute/v2.1/servers/89d498e7-9ad6-452b-b90d-b90929e1fab6" status: 200 len: 1503 microversion: 2.1 time: 0.358166 Aug 04 17:11:15.037672 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2754/5628] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:14 2022] GET /compute/v2.1/servers/89d498e7-9ad6-452b-b90d-b90929e1fab6 => generated 1503 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:11:15.216168 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-57a71a97-a73d-4e79-84f7-a020b2212d66 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:15.229653 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-57a71a97-a73d-4e79-84f7-a020b2212d66 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1279 microversion: 2.1 time: 0.308405 Aug 04 17:11:15.244541 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2875/5629] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:14 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1279 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:15.770841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-9033ea1e-d0eb-4157-945f-f91bdee3847a req-9925a992-e0a6-4826-93ff-626dbb68b11b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89d498e7-9ad6-452b-b90d-b90929e1fab6", "name": "network-vif-deleted", "tag": "ef1c81c9-fe12-4f9c-816d-3668e0ded5ee"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:15.804097 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-9033ea1e-d0eb-4157-945f-f91bdee3847a req-9925a992-e0a6-4826-93ff-626dbb68b11b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:15.804953 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-9033ea1e-d0eb-4157-945f-f91bdee3847a req-9925a992-e0a6-4826-93ff-626dbb68b11b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:15.824899 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-9033ea1e-d0eb-4157-945f-f91bdee3847a req-9925a992-e0a6-4826-93ff-626dbb68b11b service nova] Creating event network-vif-deleted:ef1c81c9-fe12-4f9c-816d-3668e0ded5ee for instance 89d498e7-9ad6-452b-b90d-b90929e1fab6 on n-h1-846466-12 Aug 04 17:11:15.845579 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-9033ea1e-d0eb-4157-945f-f91bdee3847a req-9925a992-e0a6-4826-93ff-626dbb68b11b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079515 Aug 04 17:11:15.846498 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2755/5630] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:11:16.065813 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2e040875-cbe1-4d0e-96c5-74bfe221add9 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:16.065926 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2e040875-cbe1-4d0e-96c5-74bfe221add9 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] [instance: 89d498e7-9ad6-452b-b90d-b90929e1fab6] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:16.074773 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e040875-cbe1-4d0e-96c5-74bfe221add9 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:16.075279 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e040875-cbe1-4d0e-96c5-74bfe221add9 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:16.076268 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e040875-cbe1-4d0e-96c5-74bfe221add9 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:16.076768 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e040875-cbe1-4d0e-96c5-74bfe221add9 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:16.118812 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e040875-cbe1-4d0e-96c5-74bfe221add9 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:16.119572 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e040875-cbe1-4d0e-96c5-74bfe221add9 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:16.120189 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-2e040875-cbe1-4d0e-96c5-74bfe221add9 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lazy-loading 'fault' on Instance uuid 89d498e7-9ad6-452b-b90d-b90929e1fab6 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:11:16.171508 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2e040875-cbe1-4d0e-96c5-74bfe221add9 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c3fd9093913428194a6be01f5224789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bacd72b52f4f0cb34d4de277d5dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:16.181964 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2e040875-cbe1-4d0e-96c5-74bfe221add9 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] 10.222.0.23 "GET /compute/v2.1/servers/89d498e7-9ad6-452b-b90d-b90929e1fab6" status: 200 len: 1304 microversion: 2.1 time: 0.121994 Aug 04 17:11:16.194402 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2876/5631] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:16 2022] GET /compute/v2.1/servers/89d498e7-9ad6-452b-b90d-b90929e1fab6 => generated 1304 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:16.254068 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6a61cf7e-6370-4664-8ae4-a63b7db15fb5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:16.254801 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6a61cf7e-6370-4664-8ae4-a63b7db15fb5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:16.262645 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a61cf7e-6370-4664-8ae4-a63b7db15fb5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:16.263354 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a61cf7e-6370-4664-8ae4-a63b7db15fb5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:16.264599 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a61cf7e-6370-4664-8ae4-a63b7db15fb5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:16.265205 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6a61cf7e-6370-4664-8ae4-a63b7db15fb5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:16.500462 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6a61cf7e-6370-4664-8ae4-a63b7db15fb5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:16.512335 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6a61cf7e-6370-4664-8ae4-a63b7db15fb5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1279 microversion: 2.1 time: 0.264188 Aug 04 17:11:16.526912 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2756/5632] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:16 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1279 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:17.217334 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-85c5a55e-b3c4-4c35-9e4c-1d0735254d02 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:17.218502 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-85c5a55e-b3c4-4c35-9e4c-1d0735254d02 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] [instance: 89d498e7-9ad6-452b-b90d-b90929e1fab6] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:17.227514 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-85c5a55e-b3c4-4c35-9e4c-1d0735254d02 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:17.227961 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-85c5a55e-b3c4-4c35-9e4c-1d0735254d02 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:17.228762 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-85c5a55e-b3c4-4c35-9e4c-1d0735254d02 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:17.229198 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-85c5a55e-b3c4-4c35-9e4c-1d0735254d02 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:17.244273 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-85c5a55e-b3c4-4c35-9e4c-1d0735254d02 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] HTTP exception thrown: Instance 89d498e7-9ad6-452b-b90d-b90929e1fab6 could not be found. Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-85c5a55e-b3c4-4c35-9e4c-1d0735254d02 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Request method failure captured: Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/89d498e7-9ad6-452b-b90d-b90929e1fab6 HTTP/1.1 Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_2Vc7wbsgSvqDWiYnnGBfdBtpJoPqJ9PDYwKr70iV4pBJjZST5Rzoi-i-U61-iShMUuRzt4eHSzOAPFKn0V7wRvx_BlcLwKotj5an7i6DxGPtQwYaBkO0qdH-D-z8E9yWOWZDDuDer8pVrLdrC7gslO1sg-LaxN_RMbgxczJ5je-uo Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 57bacd72b52f4f0cb34d4de277d5dfda Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-VolumesActionsTest-555852470 Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/57bacd72b52f4f0cb34d4de277d5dfda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_57bacd72b52f4f0cb34d4de277d5dfda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/57bacd72b52f4f0cb34d4de277d5dfda"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/57bacd72b52f4f0cb34d4de277d5dfda"}]}] Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-VolumesActionsTest-555852470 Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 57bacd72b52f4f0cb34d4de277d5dfda Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-VolumesActionsTest-555852470 Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-VolumesActionsTest-555852470-project Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 0c3fd9093913428194a6be01f5224789 Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-VolumesActionsTest-555852470-project Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 89d498e7-9ad6-452b-b90d-b90929e1fab6 could not be found. Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '89d498e7-9ad6-452b-b90d-b90929e1fab6'} Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89d498e7-9ad6-452b-b90d-b90929e1fab6 could not be found. Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89d498e7-9ad6-452b-b90d-b90929e1fab6 could not be found. Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:11:17.246281 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:11:17.250852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:17.250852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:11:17.250852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:11:17.250852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:11:17.250852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:11:17.250852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89d498e7-9ad6-452b-b90d-b90929e1fab6 could not be found. Aug 04 17:11:17.250852 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:11:17.252733 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-85c5a55e-b3c4-4c35-9e4c-1d0735254d02 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] Returning 404 to user: Instance 89d498e7-9ad6-452b-b90d-b90929e1fab6 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:11:17.254511 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-85c5a55e-b3c4-4c35-9e4c-1d0735254d02 tempest-VolumesActionsTest-555852470 tempest-VolumesActionsTest-555852470-project] 10.222.0.23 "GET /compute/v2.1/servers/89d498e7-9ad6-452b-b90d-b90929e1fab6" status: 404 len: 111 microversion: 2.1 time: 0.042805 Aug 04 17:11:17.255640 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2877/5633] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:17 2022] GET /compute/v2.1/servers/89d498e7-9ad6-452b-b90d-b90929e1fab6 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:11:17.535013 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2d9e48e4-a2c1-44af-8d27-bec84b2212e2 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:17.535658 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2d9e48e4-a2c1-44af-8d27-bec84b2212e2 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:17.542973 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2d9e48e4-a2c1-44af-8d27-bec84b2212e2 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:17.543432 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2d9e48e4-a2c1-44af-8d27-bec84b2212e2 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:17.544221 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2d9e48e4-a2c1-44af-8d27-bec84b2212e2 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:17.544656 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2d9e48e4-a2c1-44af-8d27-bec84b2212e2 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:17.712342 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2d9e48e4-a2c1-44af-8d27-bec84b2212e2 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:17.721898 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2d9e48e4-a2c1-44af-8d27-bec84b2212e2 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1279 microversion: 2.1 time: 0.191129 Aug 04 17:11:17.722565 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2757/5634] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:17 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1279 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:18.743298 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1a332dc1-c4f2-4c32-b614-b34961b11b62 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:18.743899 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1a332dc1-c4f2-4c32-b614-b34961b11b62 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:18.753903 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1a332dc1-c4f2-4c32-b614-b34961b11b62 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:18.754774 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1a332dc1-c4f2-4c32-b614-b34961b11b62 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:18.755891 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1a332dc1-c4f2-4c32-b614-b34961b11b62 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:18.756505 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1a332dc1-c4f2-4c32-b614-b34961b11b62 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:18.900555 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1a332dc1-c4f2-4c32-b614-b34961b11b62 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:18.910345 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1a332dc1-c4f2-4c32-b614-b34961b11b62 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1279 microversion: 2.1 time: 0.170970 Aug 04 17:11:18.910953 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2878/5635] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:18 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1279 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:19.932953 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5822ded1-9c82-477d-985c-c41d3360c672 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:19.933803 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5822ded1-9c82-477d-985c-c41d3360c672 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:19.941539 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5822ded1-9c82-477d-985c-c41d3360c672 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:19.942374 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5822ded1-9c82-477d-985c-c41d3360c672 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:19.943226 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5822ded1-9c82-477d-985c-c41d3360c672 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:19.943804 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5822ded1-9c82-477d-985c-c41d3360c672 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:20.092663 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5822ded1-9c82-477d-985c-c41d3360c672 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:20.101006 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5822ded1-9c82-477d-985c-c41d3360c672 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1279 microversion: 2.1 time: 0.172339 Aug 04 17:11:20.101625 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2758/5636] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:19 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1279 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:20.679178 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c12aaa51-7bc4-4f86-929b-3b796ba940ef tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:20.679703 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c12aaa51-7bc4-4f86-929b-3b796ba940ef tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: 9856bd39-78da-4852-a1ce-d93c747f00c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:20.686923 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c12aaa51-7bc4-4f86-929b-3b796ba940ef tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:20.687441 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c12aaa51-7bc4-4f86-929b-3b796ba940ef tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:20.696220 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c12aaa51-7bc4-4f86-929b-3b796ba940ef tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:20.696954 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c12aaa51-7bc4-4f86-929b-3b796ba940ef tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:20.701681 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:20.740188 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c12aaa51-7bc4-4f86-929b-3b796ba940ef tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8/os-volume_attachments/6e00ba81-c766-4d92-a73a-0b2d359cd30b" status: 200 len: 194 microversion: 2.1 time: 0.064948 Aug 04 17:11:20.741059 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2879/5637] 10.222.0.23 () {58 vars in 1413 bytes} [Thu Aug 4 17:11:20 2022] GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8/os-volume_attachments/6e00ba81-c766-4d92-a73a-0b2d359cd30b => generated 194 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:11:20.753011 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-913d2eab-ae43-4bee-b48c-cead4441f99f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:20.754260 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-913d2eab-ae43-4bee-b48c-cead4441f99f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: 9856bd39-78da-4852-a1ce-d93c747f00c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:20.761351 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-913d2eab-ae43-4bee-b48c-cead4441f99f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:20.761780 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-913d2eab-ae43-4bee-b48c-cead4441f99f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:20.762579 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-913d2eab-ae43-4bee-b48c-cead4441f99f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:20.763021 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-913d2eab-ae43-4bee-b48c-cead4441f99f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:21.123187 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3f737b5e-2ea8-4908-bc20-f2bf20f276c1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:21.124123 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3f737b5e-2ea8-4908-bc20-f2bf20f276c1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:21.132181 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3f737b5e-2ea8-4908-bc20-f2bf20f276c1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:21.132935 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3f737b5e-2ea8-4908-bc20-f2bf20f276c1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:21.133773 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3f737b5e-2ea8-4908-bc20-f2bf20f276c1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:21.134330 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3f737b5e-2ea8-4908-bc20-f2bf20f276c1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:21.335244 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3f737b5e-2ea8-4908-bc20-f2bf20f276c1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:21.346565 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3f737b5e-2ea8-4908-bc20-f2bf20f276c1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1267 microversion: 2.1 time: 0.228029 Aug 04 17:11:21.369137 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2880/5638] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:21 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1267 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:11:21.814154 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-913d2eab-ae43-4bee-b48c-cead4441f99f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lazy-loading 'services' on Instance uuid 9856bd39-78da-4852-a1ce-d93c747f00c8 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:11:22.192769 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-913d2eab-ae43-4bee-b48c-cead4441f99f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8/os-volume_attachments/6e00ba81-c766-4d92-a73a-0b2d359cd30b" status: 202 len: 0 microversion: 2.1 time: 1.444602 Aug 04 17:11:22.195418 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2759/5639] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Aug 4 17:11:20 2022] DELETE /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8/os-volume_attachments/6e00ba81-c766-4d92-a73a-0b2d359cd30b => generated 0 bytes in 1448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:11:22.369081 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-835b2dad-dc7b-4cd2-80a6-c203d5ef2937 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:22.371107 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-835b2dad-dc7b-4cd2-80a6-c203d5ef2937 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:22.382389 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-835b2dad-dc7b-4cd2-80a6-c203d5ef2937 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:22.382873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-835b2dad-dc7b-4cd2-80a6-c203d5ef2937 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:22.383817 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-835b2dad-dc7b-4cd2-80a6-c203d5ef2937 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:22.384260 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-835b2dad-dc7b-4cd2-80a6-c203d5ef2937 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:22.642955 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-835b2dad-dc7b-4cd2-80a6-c203d5ef2937 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:22.663114 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-835b2dad-dc7b-4cd2-80a6-c203d5ef2937 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1267 microversion: 2.1 time: 0.298742 Aug 04 17:11:22.663710 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2881/5640] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:22 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1267 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:23.695629 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e53c88ab-7424-4e85-b38e-be56047ffcc0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:23.696321 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e53c88ab-7424-4e85-b38e-be56047ffcc0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:23.706418 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e53c88ab-7424-4e85-b38e-be56047ffcc0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:23.707078 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e53c88ab-7424-4e85-b38e-be56047ffcc0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:23.708023 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e53c88ab-7424-4e85-b38e-be56047ffcc0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:23.708472 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e53c88ab-7424-4e85-b38e-be56047ffcc0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:23.868941 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e53c88ab-7424-4e85-b38e-be56047ffcc0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:23.878386 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e53c88ab-7424-4e85-b38e-be56047ffcc0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1267 microversion: 2.1 time: 0.187131 Aug 04 17:11:23.879841 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2760/5641] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:23 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:24.900998 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4d3f8561-ab9e-4809-9615-21793a9501da tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:24.901599 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4d3f8561-ab9e-4809-9615-21793a9501da tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:24.911163 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d3f8561-ab9e-4809-9615-21793a9501da tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:24.911719 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d3f8561-ab9e-4809-9615-21793a9501da tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:24.912601 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d3f8561-ab9e-4809-9615-21793a9501da tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:24.913080 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d3f8561-ab9e-4809-9615-21793a9501da tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:25.070746 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4d3f8561-ab9e-4809-9615-21793a9501da tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:25.079210 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4d3f8561-ab9e-4809-9615-21793a9501da tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1267 microversion: 2.1 time: 0.182527 Aug 04 17:11:25.089564 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2882/5642] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:24 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:25.572667 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-187bd401-cd59-4ce2-a7fb-cd462b24ed98 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:25.573241 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-187bd401-cd59-4ce2-a7fb-cd462b24ed98 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] [instance: 35918880-3ff3-4163-97af-b7e794421b4c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:25.582250 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-187bd401-cd59-4ce2-a7fb-cd462b24ed98 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:25.582707 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-187bd401-cd59-4ce2-a7fb-cd462b24ed98 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:25.583750 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-187bd401-cd59-4ce2-a7fb-cd462b24ed98 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:25.584184 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-187bd401-cd59-4ce2-a7fb-cd462b24ed98 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:25.612579 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-187bd401-cd59-4ce2-a7fb-cd462b24ed98 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] [instance: 35918880-3ff3-4163-97af-b7e794421b4c] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:11:25.728114 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-187bd401-cd59-4ce2-a7fb-cd462b24ed98 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] 10.222.0.23 "DELETE /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c" status: 204 len: 0 microversion: 2.1 time: 0.149854 Aug 04 17:11:25.728114 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2761/5643] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:11:25 2022] DELETE /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:11:25.729901 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c37ccc49-aecc-4701-a43a-f710e1310f41 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:25.730533 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c37ccc49-aecc-4701-a43a-f710e1310f41 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] [instance: 35918880-3ff3-4163-97af-b7e794421b4c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:25.739416 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c37ccc49-aecc-4701-a43a-f710e1310f41 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:25.739785 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c37ccc49-aecc-4701-a43a-f710e1310f41 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:25.740619 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c37ccc49-aecc-4701-a43a-f710e1310f41 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:25.741036 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c37ccc49-aecc-4701-a43a-f710e1310f41 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:25.970761 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c37ccc49-aecc-4701-a43a-f710e1310f41 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1837a483e4624787801bfc3411566003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907d9430adfe43b1a29a92b24d1d9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:25.989164 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c37ccc49-aecc-4701-a43a-f710e1310f41 tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] 10.222.0.23 "GET /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c" status: 200 len: 1470 microversion: 2.1 time: 0.262735 Aug 04 17:11:25.991593 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2883/5644] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:25 2022] GET /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c => generated 1470 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:26.110820 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-41ff009f-f564-40b7-b4f5-64ae945709db tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:26.114542 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-41ff009f-f564-40b7-b4f5-64ae945709db tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:26.124397 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-41ff009f-f564-40b7-b4f5-64ae945709db tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:26.125133 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-41ff009f-f564-40b7-b4f5-64ae945709db tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:26.127343 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-41ff009f-f564-40b7-b4f5-64ae945709db tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:26.128059 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-41ff009f-f564-40b7-b4f5-64ae945709db tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:26.382915 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-41ff009f-f564-40b7-b4f5-64ae945709db tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:26.394917 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-41ff009f-f564-40b7-b4f5-64ae945709db tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1267 microversion: 2.1 time: 0.296742 Aug 04 17:11:26.396194 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2762/5645] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:26 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1267 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:27.012488 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4b099ffd-6356-437c-9c9e-785a95a731da tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:27.013345 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4b099ffd-6356-437c-9c9e-785a95a731da tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] [instance: 35918880-3ff3-4163-97af-b7e794421b4c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:27.033803 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4b099ffd-6356-437c-9c9e-785a95a731da tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:27.034298 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4b099ffd-6356-437c-9c9e-785a95a731da tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:27.035281 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4b099ffd-6356-437c-9c9e-785a95a731da tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:27.035757 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4b099ffd-6356-437c-9c9e-785a95a731da tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:27.254649 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4b099ffd-6356-437c-9c9e-785a95a731da tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1837a483e4624787801bfc3411566003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907d9430adfe43b1a29a92b24d1d9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:27.269390 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4b099ffd-6356-437c-9c9e-785a95a731da tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] 10.222.0.23 "GET /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c" status: 200 len: 1470 microversion: 2.1 time: 0.260827 Aug 04 17:11:27.270707 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2884/5646] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:27 2022] GET /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c => generated 1470 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:27.418335 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8a378f5d-1d09-4bdf-8458-c253aeb54548 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:27.419741 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8a378f5d-1d09-4bdf-8458-c253aeb54548 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:27.442877 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a378f5d-1d09-4bdf-8458-c253aeb54548 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:27.449176 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a378f5d-1d09-4bdf-8458-c253aeb54548 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:27.450472 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a378f5d-1d09-4bdf-8458-c253aeb54548 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:27.451073 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a378f5d-1d09-4bdf-8458-c253aeb54548 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:28.112356 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8a378f5d-1d09-4bdf-8458-c253aeb54548 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:28.160655 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8a378f5d-1d09-4bdf-8458-c253aeb54548 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1267 microversion: 2.1 time: 0.747603 Aug 04 17:11:28.179227 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2763/5647] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:27 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1267 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:28.314234 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f179c0bd-8e7f-4efa-8876-1aeba56b025c tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:28.315089 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f179c0bd-8e7f-4efa-8876-1aeba56b025c tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] [instance: 35918880-3ff3-4163-97af-b7e794421b4c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:28.339250 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f179c0bd-8e7f-4efa-8876-1aeba56b025c tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:28.342378 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f179c0bd-8e7f-4efa-8876-1aeba56b025c tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:28.347517 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f179c0bd-8e7f-4efa-8876-1aeba56b025c tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:28.347980 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f179c0bd-8e7f-4efa-8876-1aeba56b025c tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:29.123271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f179c0bd-8e7f-4efa-8876-1aeba56b025c tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1837a483e4624787801bfc3411566003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907d9430adfe43b1a29a92b24d1d9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:29.132667 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f179c0bd-8e7f-4efa-8876-1aeba56b025c tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] 10.222.0.23 "GET /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c" status: 200 len: 1470 microversion: 2.1 time: 0.830725 Aug 04 17:11:29.133266 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2885/5648] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:28 2022] GET /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c => generated 1470 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:29.192552 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2291f8e7-b0c3-41cc-9f8c-5404af7af597 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:29.194791 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2291f8e7-b0c3-41cc-9f8c-5404af7af597 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:29.259755 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2291f8e7-b0c3-41cc-9f8c-5404af7af597 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:29.261242 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2291f8e7-b0c3-41cc-9f8c-5404af7af597 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:29.263179 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2291f8e7-b0c3-41cc-9f8c-5404af7af597 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:29.264527 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2291f8e7-b0c3-41cc-9f8c-5404af7af597 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:29.331699 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-dee23bee-89d7-4f5b-926e-cda4ef0c8ddd req-5764dd10-a8db-4b9d-8fb8-0b23893a2dbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35918880-3ff3-4163-97af-b7e794421b4c", "name": "network-vif-deleted", "tag": "f902e0b1-7012-4c81-ba91-22e451d7485f"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:29.360504 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:29.363270 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-dee23bee-89d7-4f5b-926e-cda4ef0c8ddd req-5764dd10-a8db-4b9d-8fb8-0b23893a2dbe service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:29.364561 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-dee23bee-89d7-4f5b-926e-cda4ef0c8ddd req-5764dd10-a8db-4b9d-8fb8-0b23893a2dbe service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:29.413765 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-dee23bee-89d7-4f5b-926e-cda4ef0c8ddd req-5764dd10-a8db-4b9d-8fb8-0b23893a2dbe service nova] Creating event network-vif-deleted:f902e0b1-7012-4c81-ba91-22e451d7485f for instance 35918880-3ff3-4163-97af-b7e794421b4c on n-h1-846466-12 Aug 04 17:11:29.436562 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-dee23bee-89d7-4f5b-926e-cda4ef0c8ddd req-5764dd10-a8db-4b9d-8fb8-0b23893a2dbe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109329 Aug 04 17:11:29.452198 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2886/5649] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:11:29.614021 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2291f8e7-b0c3-41cc-9f8c-5404af7af597 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:29.628088 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2291f8e7-b0c3-41cc-9f8c-5404af7af597 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1267 microversion: 2.1 time: 0.444208 Aug 04 17:11:29.638151 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2764/5650] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:29 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1267 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:29.701983 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-dc1b9c69-d5b3-42e0-b50a-72c701866c18 req-ed028e01-ef1a-4027-b9d2-188cfe4cef0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25704445-abe8-44bb-89d7-870d193deec0", "name": "network-vif-plugged", "status": "completed", "tag": "6f2c9abd-c5f4-435c-a94c-84a048ee2e9c"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:29.734936 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-dc1b9c69-d5b3-42e0-b50a-72c701866c18 req-ed028e01-ef1a-4027-b9d2-188cfe4cef0b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:29.736126 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-dc1b9c69-d5b3-42e0-b50a-72c701866c18 req-ed028e01-ef1a-4027-b9d2-188cfe4cef0b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:29.784414 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-dc1b9c69-d5b3-42e0-b50a-72c701866c18 req-ed028e01-ef1a-4027-b9d2-188cfe4cef0b service nova] Creating event network-vif-plugged:6f2c9abd-c5f4-435c-a94c-84a048ee2e9c for instance 25704445-abe8-44bb-89d7-870d193deec0 on n-h2-846466-12 Aug 04 17:11:29.801269 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-dc1b9c69-d5b3-42e0-b50a-72c701866c18 req-ed028e01-ef1a-4027-b9d2-188cfe4cef0b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111873 Aug 04 17:11:29.801595 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2887/5651] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:11:30.156981 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f2c3ae4a-bbe9-47e3-ad14-f66dfbdcb50e tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:30.158055 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f2c3ae4a-bbe9-47e3-ad14-f66dfbdcb50e tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] [instance: 35918880-3ff3-4163-97af-b7e794421b4c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:30.178206 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f2c3ae4a-bbe9-47e3-ad14-f66dfbdcb50e tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:30.179447 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f2c3ae4a-bbe9-47e3-ad14-f66dfbdcb50e tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:30.183237 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f2c3ae4a-bbe9-47e3-ad14-f66dfbdcb50e tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:30.183237 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f2c3ae4a-bbe9-47e3-ad14-f66dfbdcb50e tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:30.198679 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-f2c3ae4a-bbe9-47e3-ad14-f66dfbdcb50e tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] HTTP exception thrown: Instance 35918880-3ff3-4163-97af-b7e794421b4c could not be found. Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f2c3ae4a-bbe9-47e3-ad14-f66dfbdcb50e tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Request method failure captured: Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c HTTP/1.1 Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_0U4Z5AhQAi4m6jFqyQrORMQzXlF3ly9Ou1BTY7N6jiAJ7GNXH1NgbFMDQ4kBXHPYGRfdRCc4brGY7Y8V5hjH6r1P1YWuoJ7iTgXqR63JawW-uV8EVml6HXHzYA72KQSg_wvLXjZHNKDU_55a2sl-zEInLEuxqqsm0DFl2U9XZj2Js Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 907d9430adfe43b1a29a92b24d1d9f15 Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-VolumesBackupsTest-999173982 Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/907d9430adfe43b1a29a92b24d1d9f15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_907d9430adfe43b1a29a92b24d1d9f15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/907d9430adfe43b1a29a92b24d1d9f15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/907d9430adfe43b1a29a92b24d1d9f15"}]}] Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-VolumesBackupsTest-999173982 Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 907d9430adfe43b1a29a92b24d1d9f15 Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-VolumesBackupsTest-999173982 Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-VolumesBackupsTest-999173982-project Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 1837a483e4624787801bfc3411566003 Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-VolumesBackupsTest-999173982-project Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 35918880-3ff3-4163-97af-b7e794421b4c could not be found. Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '35918880-3ff3-4163-97af-b7e794421b4c'} Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35918880-3ff3-4163-97af-b7e794421b4c could not be found. Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35918880-3ff3-4163-97af-b7e794421b4c could not be found. Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:11:30.200482 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:11:30.205827 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:30.205827 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:11:30.205827 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:11:30.205827 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:11:30.205827 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:11:30.205827 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35918880-3ff3-4163-97af-b7e794421b4c could not be found. Aug 04 17:11:30.205827 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:11:30.207605 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f2c3ae4a-bbe9-47e3-ad14-f66dfbdcb50e tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] Returning 404 to user: Instance 35918880-3ff3-4163-97af-b7e794421b4c could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:11:30.208491 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f2c3ae4a-bbe9-47e3-ad14-f66dfbdcb50e tempest-VolumesBackupsTest-999173982 tempest-VolumesBackupsTest-999173982-project] 10.222.0.23 "GET /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c" status: 404 len: 111 microversion: 2.1 time: 0.057942 Aug 04 17:11:30.209174 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2765/5652] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:30 2022] GET /compute/v2.1/servers/35918880-3ff3-4163-97af-b7e794421b4c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:11:30.658545 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9fa41922-bbe8-44e1-bfd5-e5027e29d32b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:30.660244 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9fa41922-bbe8-44e1-bfd5-e5027e29d32b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:30.671049 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9fa41922-bbe8-44e1-bfd5-e5027e29d32b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:30.682120 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9fa41922-bbe8-44e1-bfd5-e5027e29d32b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:30.683027 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9fa41922-bbe8-44e1-bfd5-e5027e29d32b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:30.683448 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9fa41922-bbe8-44e1-bfd5-e5027e29d32b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:30.897055 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9fa41922-bbe8-44e1-bfd5-e5027e29d32b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:30.907001 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9fa41922-bbe8-44e1-bfd5-e5027e29d32b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1267 microversion: 2.1 time: 0.252175 Aug 04 17:11:30.908404 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2888/5653] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:30 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1267 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:31.932987 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f6b34007-4e4e-463b-9da9-4d4c26f4d55a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:31.934026 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f6b34007-4e4e-463b-9da9-4d4c26f4d55a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:31.969799 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6b34007-4e4e-463b-9da9-4d4c26f4d55a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:31.970576 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6b34007-4e4e-463b-9da9-4d4c26f4d55a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:31.971781 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6b34007-4e4e-463b-9da9-4d4c26f4d55a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:31.972452 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6b34007-4e4e-463b-9da9-4d4c26f4d55a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:32.356100 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f6b34007-4e4e-463b-9da9-4d4c26f4d55a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:32.395616 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f6b34007-4e4e-463b-9da9-4d4c26f4d55a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1454 microversion: 2.1 time: 0.463667 Aug 04 17:11:32.396584 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2766/5654] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:31 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1454 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:32.439822 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-14faa2a0-f92e-4f88-b146-ee2cfd0ea6ea tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:32.440696 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-14faa2a0-f92e-4f88-b146-ee2cfd0ea6ea tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:32.470004 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14faa2a0-f92e-4f88-b146-ee2cfd0ea6ea tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:32.470551 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14faa2a0-f92e-4f88-b146-ee2cfd0ea6ea tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:32.471604 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14faa2a0-f92e-4f88-b146-ee2cfd0ea6ea tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:32.479779 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-14faa2a0-f92e-4f88-b146-ee2cfd0ea6ea tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:32.833984 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-14faa2a0-f92e-4f88-b146-ee2cfd0ea6ea tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:32.846481 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-14faa2a0-f92e-4f88-b146-ee2cfd0ea6ea tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1454 microversion: 2.1 time: 0.414346 Aug 04 17:11:32.847861 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2889/5655] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:32 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1454 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:33.899285 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4361b72c-0c83-41e9-93cb-ef4bdb74f467 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:33.902502 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4361b72c-0c83-41e9-93cb-ef4bdb74f467 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: 9856bd39-78da-4852-a1ce-d93c747f00c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:33.917577 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4361b72c-0c83-41e9-93cb-ef4bdb74f467 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:33.918291 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4361b72c-0c83-41e9-93cb-ef4bdb74f467 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:33.920995 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4361b72c-0c83-41e9-93cb-ef4bdb74f467 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:33.922237 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4361b72c-0c83-41e9-93cb-ef4bdb74f467 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:34.030890 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4361b72c-0c83-41e9-93cb-ef4bdb74f467 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.141173 Aug 04 17:11:34.031847 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2767/5656] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:11:33 2022] GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8/os-volume_attachments => generated 25 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:11:34.345153 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-96894d41-654c-4cf7-8834-e169a6ffa942 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:34.348180 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-96894d41-654c-4cf7-8834-e169a6ffa942 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: 9856bd39-78da-4852-a1ce-d93c747f00c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:34.368425 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-96894d41-654c-4cf7-8834-e169a6ffa942 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:34.368656 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-96894d41-654c-4cf7-8834-e169a6ffa942 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:34.369468 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-96894d41-654c-4cf7-8834-e169a6ffa942 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:34.369904 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-96894d41-654c-4cf7-8834-e169a6ffa942 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:34.448270 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-96894d41-654c-4cf7-8834-e169a6ffa942 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.110183 Aug 04 17:11:34.448882 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2890/5657] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:11:34 2022] GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8/os-volume_attachments => generated 25 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:11:34.589455 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bdd278d7-5db5-42fa-bd07-935cb3979e24 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:34.590417 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bdd278d7-5db5-42fa-bd07-935cb3979e24 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: 9856bd39-78da-4852-a1ce-d93c747f00c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:34.599696 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bdd278d7-5db5-42fa-bd07-935cb3979e24 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:34.600560 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bdd278d7-5db5-42fa-bd07-935cb3979e24 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:34.602520 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bdd278d7-5db5-42fa-bd07-935cb3979e24 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:34.603270 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bdd278d7-5db5-42fa-bd07-935cb3979e24 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:34.658060 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bdd278d7-5db5-42fa-bd07-935cb3979e24 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: 9856bd39-78da-4852-a1ce-d93c747f00c8] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:11:34.915474 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bdd278d7-5db5-42fa-bd07-935cb3979e24 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8" status: 204 len: 0 microversion: 2.1 time: 0.330799 Aug 04 17:11:34.919362 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2768/5658] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:11:34 2022] DELETE /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:11:34.927057 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f9444211-c2c2-40e7-ba93-85b9c0da2895 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:34.927732 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f9444211-c2c2-40e7-ba93-85b9c0da2895 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: 9856bd39-78da-4852-a1ce-d93c747f00c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:34.942266 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9444211-c2c2-40e7-ba93-85b9c0da2895 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:34.946005 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9444211-c2c2-40e7-ba93-85b9c0da2895 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:34.949532 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9444211-c2c2-40e7-ba93-85b9c0da2895 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:34.950313 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9444211-c2c2-40e7-ba93-85b9c0da2895 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:35.321245 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f9444211-c2c2-40e7-ba93-85b9c0da2895 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:35.331385 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f9444211-c2c2-40e7-ba93-85b9c0da2895 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8" status: 200 len: 1670 microversion: 2.1 time: 0.410470 Aug 04 17:11:35.344291 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2891/5659] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:34 2022] GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8 => generated 1670 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:35.772446 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-315fbfcb-4562-43d9-9ae7-16b5869471e2 req-894dcce9-72b8-460c-93a2-daf9a3e7b92e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25704445-abe8-44bb-89d7-870d193deec0", "tag": "6f2c9abd-c5f4-435c-a94c-84a048ee2e9c"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:35.791708 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-315fbfcb-4562-43d9-9ae7-16b5869471e2 req-894dcce9-72b8-460c-93a2-daf9a3e7b92e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:35.792170 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-315fbfcb-4562-43d9-9ae7-16b5869471e2 req-894dcce9-72b8-460c-93a2-daf9a3e7b92e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:35.818340 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-315fbfcb-4562-43d9-9ae7-16b5869471e2 req-894dcce9-72b8-460c-93a2-daf9a3e7b92e service nova] Creating event network-changed:6f2c9abd-c5f4-435c-a94c-84a048ee2e9c for instance 25704445-abe8-44bb-89d7-870d193deec0 on n-h2-846466-12 Aug 04 17:11:35.828047 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-315fbfcb-4562-43d9-9ae7-16b5869471e2 req-894dcce9-72b8-460c-93a2-daf9a3e7b92e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060143 Aug 04 17:11:35.832115 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2769/5660] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:11:36.356182 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a8415e44-d90f-47c2-9273-ecb07dff9bbd tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:36.356947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a8415e44-d90f-47c2-9273-ecb07dff9bbd tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: 9856bd39-78da-4852-a1ce-d93c747f00c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:36.412258 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8415e44-d90f-47c2-9273-ecb07dff9bbd tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:36.427118 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8415e44-d90f-47c2-9273-ecb07dff9bbd tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:36.428617 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8415e44-d90f-47c2-9273-ecb07dff9bbd tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:36.437885 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8415e44-d90f-47c2-9273-ecb07dff9bbd tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:36.949125 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a8415e44-d90f-47c2-9273-ecb07dff9bbd tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:36.963567 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a8415e44-d90f-47c2-9273-ecb07dff9bbd tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8" status: 200 len: 1670 microversion: 2.1 time: 0.612942 Aug 04 17:11:36.965031 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2892/5661] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:36 2022] GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8 => generated 1670 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:37.990796 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b71352d9-72ea-455c-96e2-aa9b1f350542 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:37.996930 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b71352d9-72ea-455c-96e2-aa9b1f350542 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: 9856bd39-78da-4852-a1ce-d93c747f00c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:38.025647 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b71352d9-72ea-455c-96e2-aa9b1f350542 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:38.025886 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b71352d9-72ea-455c-96e2-aa9b1f350542 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:38.026694 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b71352d9-72ea-455c-96e2-aa9b1f350542 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:38.027268 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b71352d9-72ea-455c-96e2-aa9b1f350542 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:38.175055 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b71352d9-72ea-455c-96e2-aa9b1f350542 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:38.184185 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b71352d9-72ea-455c-96e2-aa9b1f350542 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8" status: 200 len: 1604 microversion: 2.1 time: 0.198040 Aug 04 17:11:38.187717 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2770/5662] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:37 2022] GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8 => generated 1604 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:11:39.066599 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-a3045ec8-4842-4a99-b5e4-c01f2de5e414 req-06c7f8b7-3298-4e72-9fc9-8c8037075c9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9856bd39-78da-4852-a1ce-d93c747f00c8", "name": "network-vif-deleted", "tag": "75a5658e-50cb-45aa-ae6d-3470c5cf9877"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:39.099749 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-a3045ec8-4842-4a99-b5e4-c01f2de5e414 req-06c7f8b7-3298-4e72-9fc9-8c8037075c9f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:39.100270 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-a3045ec8-4842-4a99-b5e4-c01f2de5e414 req-06c7f8b7-3298-4e72-9fc9-8c8037075c9f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:39.156015 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-a3045ec8-4842-4a99-b5e4-c01f2de5e414 req-06c7f8b7-3298-4e72-9fc9-8c8037075c9f service nova] Creating event network-vif-deleted:75a5658e-50cb-45aa-ae6d-3470c5cf9877 for instance 9856bd39-78da-4852-a1ce-d93c747f00c8 on n-h2-846466-12 Aug 04 17:11:39.186050 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-a3045ec8-4842-4a99-b5e4-c01f2de5e414 req-06c7f8b7-3298-4e72-9fc9-8c8037075c9f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127310 Aug 04 17:11:39.186671 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2893/5663] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:11:39.231487 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8a691828-0cbb-4a5a-84d1-dc9459d6034f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:39.232106 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8a691828-0cbb-4a5a-84d1-dc9459d6034f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: 9856bd39-78da-4852-a1ce-d93c747f00c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:39.241599 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a691828-0cbb-4a5a-84d1-dc9459d6034f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:39.244931 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a691828-0cbb-4a5a-84d1-dc9459d6034f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:39.247989 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a691828-0cbb-4a5a-84d1-dc9459d6034f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:39.248695 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a691828-0cbb-4a5a-84d1-dc9459d6034f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:39.475041 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8a691828-0cbb-4a5a-84d1-dc9459d6034f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8430522c580414d9798349ededbd6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ad199f31d04aa4ac7c6ba5925eb06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:39.489967 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8a691828-0cbb-4a5a-84d1-dc9459d6034f tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8" status: 200 len: 1321 microversion: 2.1 time: 0.260279 Aug 04 17:11:39.492452 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2771/5664] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:39 2022] GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8 => generated 1321 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:40.517376 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6d1bb921-54b9-4796-a466-0b14ebcee9d1 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:40.517911 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6d1bb921-54b9-4796-a466-0b14ebcee9d1 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: 9856bd39-78da-4852-a1ce-d93c747f00c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:40.538133 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d1bb921-54b9-4796-a466-0b14ebcee9d1 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:40.556458 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d1bb921-54b9-4796-a466-0b14ebcee9d1 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:40.557869 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d1bb921-54b9-4796-a466-0b14ebcee9d1 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:40.559816 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d1bb921-54b9-4796-a466-0b14ebcee9d1 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:40.624048 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-6d1bb921-54b9-4796-a466-0b14ebcee9d1 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] HTTP exception thrown: Instance 9856bd39-78da-4852-a1ce-d93c747f00c8 could not be found. Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6d1bb921-54b9-4796-a466-0b14ebcee9d1 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Request method failure captured: Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8 HTTP/1.1 Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_xkMobk0ocfazMP7hYnvVvbLVAvEwEb5REErGjzI9UZVqVc5FIWvv-QR9zFeWUsqPXILGrf-HGsaOZUgXdPhYGGxPWcnFslxIOM4z6icNcb_C59yr-YzD5BrDqo7SRDF0RJTLkguGfLyqsKN3GRHG1y9GVwuNwMdilQQw4Sdcx6c5s Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: a0ad199f31d04aa4ac7c6ba5925eb06b Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-AttachVolumeTestJSON-1542553691 Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a0ad199f31d04aa4ac7c6ba5925eb06b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a0ad199f31d04aa4ac7c6ba5925eb06b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a0ad199f31d04aa4ac7c6ba5925eb06b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a0ad199f31d04aa4ac7c6ba5925eb06b"}]}] Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-AttachVolumeTestJSON-1542553691 Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: a0ad199f31d04aa4ac7c6ba5925eb06b Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1542553691 Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-AttachVolumeTestJSON-1542553691-project Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: d8430522c580414d9798349ededbd6d2 Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-AttachVolumeTestJSON-1542553691-project Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 9856bd39-78da-4852-a1ce-d93c747f00c8 could not be found. Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '9856bd39-78da-4852-a1ce-d93c747f00c8'} Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9856bd39-78da-4852-a1ce-d93c747f00c8 could not be found. Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9856bd39-78da-4852-a1ce-d93c747f00c8 could not be found. Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:11:40.626104 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:11:40.633756 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:40.633756 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:11:40.633756 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:11:40.633756 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:11:40.633756 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:11:40.633756 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9856bd39-78da-4852-a1ce-d93c747f00c8 could not be found. Aug 04 17:11:40.633756 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:11:40.660907 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6d1bb921-54b9-4796-a466-0b14ebcee9d1 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Returning 404 to user: Instance 9856bd39-78da-4852-a1ce-d93c747f00c8 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:11:40.668263 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6d1bb921-54b9-4796-a466-0b14ebcee9d1 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8" status: 404 len: 111 microversion: 2.1 time: 0.157368 Aug 04 17:11:40.682738 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9317f491-b300-406f-ba9e-4765fc8156c8 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '.version_select at 0x7f7e850aa1f0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:40.687630 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2894/5665] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:40 2022] GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:11:40.745001 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9317f491-b300-406f-ba9e-4765fc8156c8 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-285522879" status: 202 len: 0 microversion: 2.1 time: 0.066176 Aug 04 17:11:40.745626 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2772/5666] 10.222.0.23 () {58 vars in 1218 bytes} [Thu Aug 4 17:11:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-285522879 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:11:52.686848 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-81fbb36b-862b-4973-853a-13ec60d17d7a tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:52.688274 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-81fbb36b-862b-4973-853a-13ec60d17d7a tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: 9856bd39-78da-4852-a1ce-d93c747f00c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:52.701555 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:52.702938 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=78 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:52.711281 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-81fbb36b-862b-4973-853a-13ec60d17d7a tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:52.715382 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-81fbb36b-862b-4973-853a-13ec60d17d7a tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:52.717315 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-81fbb36b-862b-4973-853a-13ec60d17d7a tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:52.719486 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-81fbb36b-862b-4973-853a-13ec60d17d7a tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:52.765433 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-81fbb36b-862b-4973-853a-13ec60d17d7a tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] HTTP exception thrown: Instance 9856bd39-78da-4852-a1ce-d93c747f00c8 could not be found. Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-81fbb36b-862b-4973-853a-13ec60d17d7a tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Request method failure captured: Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8 HTTP/1.1 Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_xkMobk0ocfazMP7hYnvVvbLVAvEwEb5REErGjzI9UZVqVc5FIWvv-QR9zFeWUsqPXILGrf-HGsaOZUgXdPhYGGxPWcnFslxIOM4z6icNcb_C59yr-YzD5BrDqo7SRDF0RJTLkguGfLyqsKN3GRHG1y9GVwuNwMdilQQw4Sdcx6c5s Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: a0ad199f31d04aa4ac7c6ba5925eb06b Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-AttachVolumeTestJSON-1542553691 Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a0ad199f31d04aa4ac7c6ba5925eb06b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a0ad199f31d04aa4ac7c6ba5925eb06b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a0ad199f31d04aa4ac7c6ba5925eb06b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a0ad199f31d04aa4ac7c6ba5925eb06b"}]}] Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-AttachVolumeTestJSON-1542553691 Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: a0ad199f31d04aa4ac7c6ba5925eb06b Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1542553691 Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-AttachVolumeTestJSON-1542553691-project Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: d8430522c580414d9798349ededbd6d2 Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-AttachVolumeTestJSON-1542553691-project Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 9856bd39-78da-4852-a1ce-d93c747f00c8 could not be found. Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '9856bd39-78da-4852-a1ce-d93c747f00c8'} Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9856bd39-78da-4852-a1ce-d93c747f00c8 could not be found. Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:11:52.771193 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:11:52.775708 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9856bd39-78da-4852-a1ce-d93c747f00c8 could not be found. Aug 04 17:11:52.775708 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:11:52.775708 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:11:52.775708 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:11:52.775708 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:52.775708 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:11:52.775708 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:11:52.775708 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:11:52.775708 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:11:52.775708 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9856bd39-78da-4852-a1ce-d93c747f00c8 could not be found. Aug 04 17:11:52.775708 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:11:52.778130 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-81fbb36b-862b-4973-853a-13ec60d17d7a tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Returning 404 to user: Instance 9856bd39-78da-4852-a1ce-d93c747f00c8 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:11:52.780279 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-81fbb36b-862b-4973-853a-13ec60d17d7a tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8" status: 404 len: 111 microversion: 2.1 time: 0.102634 Aug 04 17:11:52.782175 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2895/5667] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:11:52 2022] DELETE /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:11:52.791136 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4fe56995-7f90-4b0e-9b43-fb0175077836 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:52.792564 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4fe56995-7f90-4b0e-9b43-fb0175077836 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: 9856bd39-78da-4852-a1ce-d93c747f00c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:52.806765 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:52.810286 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:52.814152 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4fe56995-7f90-4b0e-9b43-fb0175077836 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:52.817573 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4fe56995-7f90-4b0e-9b43-fb0175077836 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:52.819642 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4fe56995-7f90-4b0e-9b43-fb0175077836 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:52.823380 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4fe56995-7f90-4b0e-9b43-fb0175077836 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:52.858387 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-4fe56995-7f90-4b0e-9b43-fb0175077836 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] HTTP exception thrown: Instance 9856bd39-78da-4852-a1ce-d93c747f00c8 could not be found. Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4fe56995-7f90-4b0e-9b43-fb0175077836 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Request method failure captured: Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8 HTTP/1.1 Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_xkMobk0ocfazMP7hYnvVvbLVAvEwEb5REErGjzI9UZVqVc5FIWvv-QR9zFeWUsqPXILGrf-HGsaOZUgXdPhYGGxPWcnFslxIOM4z6icNcb_C59yr-YzD5BrDqo7SRDF0RJTLkguGfLyqsKN3GRHG1y9GVwuNwMdilQQw4Sdcx6c5s Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: a0ad199f31d04aa4ac7c6ba5925eb06b Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-AttachVolumeTestJSON-1542553691 Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a0ad199f31d04aa4ac7c6ba5925eb06b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a0ad199f31d04aa4ac7c6ba5925eb06b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a0ad199f31d04aa4ac7c6ba5925eb06b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a0ad199f31d04aa4ac7c6ba5925eb06b"}]}] Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-AttachVolumeTestJSON-1542553691 Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: a0ad199f31d04aa4ac7c6ba5925eb06b Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1542553691 Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-AttachVolumeTestJSON-1542553691-project Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: d8430522c580414d9798349ededbd6d2 Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-AttachVolumeTestJSON-1542553691-project Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 9856bd39-78da-4852-a1ce-d93c747f00c8 could not be found. Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '9856bd39-78da-4852-a1ce-d93c747f00c8'} Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9856bd39-78da-4852-a1ce-d93c747f00c8 could not be found. Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9856bd39-78da-4852-a1ce-d93c747f00c8 could not be found. Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:11:52.861801 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:11:52.867329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:52.867329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:11:52.867329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:11:52.867329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:11:52.867329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:11:52.867329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9856bd39-78da-4852-a1ce-d93c747f00c8 could not be found. Aug 04 17:11:52.867329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:11:52.869332 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4fe56995-7f90-4b0e-9b43-fb0175077836 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Returning 404 to user: Instance 9856bd39-78da-4852-a1ce-d93c747f00c8 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:11:52.870908 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4fe56995-7f90-4b0e-9b43-fb0175077836 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8" status: 404 len: 111 microversion: 2.1 time: 0.084317 Aug 04 17:11:52.871746 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2773/5668] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:52 2022] GET /compute/v2.1/servers/9856bd39-78da-4852-a1ce-d93c747f00c8 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:11:58.613694 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-285c4640-cf14-401d-ac36-fa5b3eeaec2a tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:58.614329 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-285c4640-cf14-401d-ac36-fa5b3eeaec2a tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:58.627184 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-285c4640-cf14-401d-ac36-fa5b3eeaec2a tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:58.627636 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-285c4640-cf14-401d-ac36-fa5b3eeaec2a tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:58.628793 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-285c4640-cf14-401d-ac36-fa5b3eeaec2a tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:58.629225 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-285c4640-cf14-401d-ac36-fa5b3eeaec2a tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:58.702688 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-285c4640-cf14-401d-ac36-fa5b3eeaec2a tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] HTTP exception thrown: Instance ffb04e5e-6da9-40bd-87f2-1d914893b296 could not be found. Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-285c4640-cf14-401d-ac36-fa5b3eeaec2a tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Request method failure captured: Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 HTTP/1.1 Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_xkMobk0ocfazMP7hYnvVvbLVAvEwEb5REErGjzI9UZVqVc5FIWvv-QR9zFeWUsqPXILGrf-HGsaOZUgXdPhYGGxPWcnFslxIOM4z6icNcb_C59yr-YzD5BrDqo7SRDF0RJTLkguGfLyqsKN3GRHG1y9GVwuNwMdilQQw4Sdcx6c5s Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: a0ad199f31d04aa4ac7c6ba5925eb06b Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-AttachVolumeTestJSON-1542553691 Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a0ad199f31d04aa4ac7c6ba5925eb06b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a0ad199f31d04aa4ac7c6ba5925eb06b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a0ad199f31d04aa4ac7c6ba5925eb06b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a0ad199f31d04aa4ac7c6ba5925eb06b"}]}] Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-AttachVolumeTestJSON-1542553691 Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: a0ad199f31d04aa4ac7c6ba5925eb06b Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1542553691 Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-AttachVolumeTestJSON-1542553691-project Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: d8430522c580414d9798349ededbd6d2 Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-AttachVolumeTestJSON-1542553691-project Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance ffb04e5e-6da9-40bd-87f2-1d914893b296 could not be found. Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'ffb04e5e-6da9-40bd-87f2-1d914893b296'} Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffb04e5e-6da9-40bd-87f2-1d914893b296 could not be found. Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:11:58.704638 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:11:58.711224 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffb04e5e-6da9-40bd-87f2-1d914893b296 could not be found. Aug 04 17:11:58.711224 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:11:58.711224 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:11:58.711224 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:11:58.711224 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:58.711224 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:11:58.711224 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:11:58.711224 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:11:58.711224 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:11:58.711224 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffb04e5e-6da9-40bd-87f2-1d914893b296 could not be found. Aug 04 17:11:58.711224 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:11:58.714923 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-285c4640-cf14-401d-ac36-fa5b3eeaec2a tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Returning 404 to user: Instance ffb04e5e-6da9-40bd-87f2-1d914893b296 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:11:58.716921 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-285c4640-cf14-401d-ac36-fa5b3eeaec2a tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 404 len: 111 microversion: 2.1 time: 0.108407 Aug 04 17:11:58.721410 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2896/5669] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:11:58 2022] DELETE /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:11:58.729723 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4cc63299-92ec-4f2b-80ca-62ee313046f4 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:58.731321 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4cc63299-92ec-4f2b-80ca-62ee313046f4 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] [instance: ffb04e5e-6da9-40bd-87f2-1d914893b296] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:58.747849 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4cc63299-92ec-4f2b-80ca-62ee313046f4 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:58.750039 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4cc63299-92ec-4f2b-80ca-62ee313046f4 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:58.752209 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4cc63299-92ec-4f2b-80ca-62ee313046f4 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:11:58.754693 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4cc63299-92ec-4f2b-80ca-62ee313046f4 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:11:58.780382 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-4cc63299-92ec-4f2b-80ca-62ee313046f4 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] HTTP exception thrown: Instance ffb04e5e-6da9-40bd-87f2-1d914893b296 could not be found. Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4cc63299-92ec-4f2b-80ca-62ee313046f4 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Request method failure captured: Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 HTTP/1.1 Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_xkMobk0ocfazMP7hYnvVvbLVAvEwEb5REErGjzI9UZVqVc5FIWvv-QR9zFeWUsqPXILGrf-HGsaOZUgXdPhYGGxPWcnFslxIOM4z6icNcb_C59yr-YzD5BrDqo7SRDF0RJTLkguGfLyqsKN3GRHG1y9GVwuNwMdilQQw4Sdcx6c5s Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: a0ad199f31d04aa4ac7c6ba5925eb06b Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-AttachVolumeTestJSON-1542553691 Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a0ad199f31d04aa4ac7c6ba5925eb06b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a0ad199f31d04aa4ac7c6ba5925eb06b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a0ad199f31d04aa4ac7c6ba5925eb06b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a0ad199f31d04aa4ac7c6ba5925eb06b"}]}] Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-AttachVolumeTestJSON-1542553691 Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: a0ad199f31d04aa4ac7c6ba5925eb06b Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1542553691 Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-AttachVolumeTestJSON-1542553691-project Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: d8430522c580414d9798349ededbd6d2 Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-AttachVolumeTestJSON-1542553691-project Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance ffb04e5e-6da9-40bd-87f2-1d914893b296 could not be found. Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'ffb04e5e-6da9-40bd-87f2-1d914893b296'} Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffb04e5e-6da9-40bd-87f2-1d914893b296 could not be found. Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffb04e5e-6da9-40bd-87f2-1d914893b296 could not be found. Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:11:58.782293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:11:58.787941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:58.787941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:11:58.787941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:11:58.787941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:11:58.787941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:11:58.787941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffb04e5e-6da9-40bd-87f2-1d914893b296 could not be found. Aug 04 17:11:58.787941 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:11:58.790701 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4cc63299-92ec-4f2b-80ca-62ee313046f4 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] Returning 404 to user: Instance ffb04e5e-6da9-40bd-87f2-1d914893b296 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:11:58.791814 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4cc63299-92ec-4f2b-80ca-62ee313046f4 tempest-AttachVolumeTestJSON-1542553691 tempest-AttachVolumeTestJSON-1542553691-project] 10.222.0.23 "GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296" status: 404 len: 111 microversion: 2.1 time: 0.066562 Aug 04 17:11:58.792931 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2774/5670] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:58 2022] GET /compute/v2.1/servers/ffb04e5e-6da9-40bd-87f2-1d914893b296 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:12:08.940147 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-58ac5555-0264-4d99-857c-5bcda628c230 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1463615120", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "c94cc0a9-05f4-4bef-9c9c-721c00dd3892"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:12:08.986088 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:12:08.989875 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:12:09.079560 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-58ac5555-0264-4d99-857c-5bcda628c230 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] validate_networks() for [('c94cc0a9-05f4-4bef-9c9c-721c00dd3892', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:12:09.874464 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-58ac5555-0264-4d99-857c-5bcda628c230 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:12:09.875165 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-58ac5555-0264-4d99-857c-5bcda628c230 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:12:09.875640 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-58ac5555-0264-4d99-857c-5bcda628c230 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:12:09.876050 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-58ac5555-0264-4d99-857c-5bcda628c230 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:12:09.876459 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-58ac5555-0264-4d99-857c-5bcda628c230 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:12:09.896296 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58ac5555-0264-4d99-857c-5bcda628c230 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:12:09.896748 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58ac5555-0264-4d99-857c-5bcda628c230 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:12:09.897581 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58ac5555-0264-4d99-857c-5bcda628c230 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:12:09.898016 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58ac5555-0264-4d99-857c-5bcda628c230 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:12:09.951199 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-58ac5555-0264-4d99-857c-5bcda628c230 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Getting quotas for project e16f62c8d73843a3b2380304f9af7ce5. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:12:09.965008 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-58ac5555-0264-4d99-857c-5bcda628c230 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Getting quotas for user 24ff743726c34c02a99feaa8abd09e41 and project e16f62c8d73843a3b2380304f9af7ce5. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:12:10.011842 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-58ac5555-0264-4d99-857c-5bcda628c230 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:12:10.015025 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-58ac5555-0264-4d99-857c-5bcda628c230 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: cf2cba90-3c51-40f7-a160-8d68a39250c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:12:10.152490 n-d-846466-12 devstack@n-api.service[126125]: ERROR oslo.messaging._drivers.impl_rabbit [None req-58ac5555-0264-4d99-857c-5bcda628c230 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [b042ee28-61dd-48b8-9569-21b30cd0d61a] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 17:12:11.161201 n-d-846466-12 devstack@n-api.service[126125]: INFO oslo.messaging._drivers.impl_rabbit [None req-58ac5555-0264-4d99-857c-5bcda628c230 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [b042ee28-61dd-48b8-9569-21b30cd0d61a] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 49462. Aug 04 17:12:11.165657 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-58ac5555-0264-4d99-857c-5bcda628c230 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.229774 Aug 04 17:12:11.166368 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2897/5671] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:12:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2231 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:12:11.180339 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-27dc053a-09df-4cc5-997a-a26fd27d442f tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:11.180982 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-27dc053a-09df-4cc5-997a-a26fd27d442f tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: cf2cba90-3c51-40f7-a160-8d68a39250c5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:11.204167 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=4 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:12:11.213225 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=4 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:12:11.285211 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-27dc053a-09df-4cc5-997a-a26fd27d442f tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff743726c34c02a99feaa8abd09e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16f62c8d73843a3b2380304f9af7ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:11.295613 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-27dc053a-09df-4cc5-997a-a26fd27d442f tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "GET /compute/v2.1/servers/cf2cba90-3c51-40f7-a160-8d68a39250c5" status: 200 len: 1219 microversion: 2.1 time: 0.121598 Aug 04 17:12:11.297251 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2775/5672] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:11 2022] GET /compute/v2.1/servers/cf2cba90-3c51-40f7-a160-8d68a39250c5 => generated 1219 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:12.319864 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9cf94af7-a9ce-4792-a73b-1bb52f91052a tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:12.320478 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9cf94af7-a9ce-4792-a73b-1bb52f91052a tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: cf2cba90-3c51-40f7-a160-8d68a39250c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:12.349368 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9cf94af7-a9ce-4792-a73b-1bb52f91052a tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:12:12.349825 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9cf94af7-a9ce-4792-a73b-1bb52f91052a tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:12:12.350613 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9cf94af7-a9ce-4792-a73b-1bb52f91052a tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:12:12.351046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9cf94af7-a9ce-4792-a73b-1bb52f91052a tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:12:12.510759 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9cf94af7-a9ce-4792-a73b-1bb52f91052a tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff743726c34c02a99feaa8abd09e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16f62c8d73843a3b2380304f9af7ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:12.527187 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9cf94af7-a9ce-4792-a73b-1bb52f91052a tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "GET /compute/v2.1/servers/cf2cba90-3c51-40f7-a160-8d68a39250c5" status: 200 len: 1271 microversion: 2.1 time: 0.212480 Aug 04 17:12:12.530156 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2898/5673] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:12 2022] GET /compute/v2.1/servers/cf2cba90-3c51-40f7-a160-8d68a39250c5 => generated 1271 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:13.554164 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-46bdf9d0-52fa-46a4-85e3-d56af9219ebb tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:13.554869 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-46bdf9d0-52fa-46a4-85e3-d56af9219ebb tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: cf2cba90-3c51-40f7-a160-8d68a39250c5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:13.579687 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-46bdf9d0-52fa-46a4-85e3-d56af9219ebb tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:12:13.580395 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-46bdf9d0-52fa-46a4-85e3-d56af9219ebb tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:12:13.581603 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-46bdf9d0-52fa-46a4-85e3-d56af9219ebb tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:12:13.582743 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-46bdf9d0-52fa-46a4-85e3-d56af9219ebb tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:12:13.782366 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-46bdf9d0-52fa-46a4-85e3-d56af9219ebb tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff743726c34c02a99feaa8abd09e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16f62c8d73843a3b2380304f9af7ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:13.806182 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-46bdf9d0-52fa-46a4-85e3-d56af9219ebb tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "GET /compute/v2.1/servers/cf2cba90-3c51-40f7-a160-8d68a39250c5" status: 200 len: 1277 microversion: 2.1 time: 0.258919 Aug 04 17:12:13.806721 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2776/5674] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:13 2022] GET /compute/v2.1/servers/cf2cba90-3c51-40f7-a160-8d68a39250c5 => generated 1277 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:14.831204 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-eae0b425-28ed-4325-bd30-31ec7c379b16 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:14.831800 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-eae0b425-28ed-4325-bd30-31ec7c379b16 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: cf2cba90-3c51-40f7-a160-8d68a39250c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:14.845637 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eae0b425-28ed-4325-bd30-31ec7c379b16 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:12:14.853076 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eae0b425-28ed-4325-bd30-31ec7c379b16 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:12:14.855290 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eae0b425-28ed-4325-bd30-31ec7c379b16 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:12:14.856321 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eae0b425-28ed-4325-bd30-31ec7c379b16 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:12:15.191756 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-eae0b425-28ed-4325-bd30-31ec7c379b16 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff743726c34c02a99feaa8abd09e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16f62c8d73843a3b2380304f9af7ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:15.232414 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-eae0b425-28ed-4325-bd30-31ec7c379b16 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "GET /compute/v2.1/servers/cf2cba90-3c51-40f7-a160-8d68a39250c5" status: 200 len: 1319 microversion: 2.1 time: 0.406018 Aug 04 17:12:15.233773 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2899/5675] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:14 2022] GET /compute/v2.1/servers/cf2cba90-3c51-40f7-a160-8d68a39250c5 => generated 1319 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:15.434956 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-c3680a37-2f63-4cfa-8e34-d3e44dcec5d1 req-05c0ff90-96ba-4533-bafc-05435b1d2a00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf2cba90-3c51-40f7-a160-8d68a39250c5", "tag": "c1249799-ed07-4822-ac01-8d35b9026962"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:12:15.455235 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-c3680a37-2f63-4cfa-8e34-d3e44dcec5d1 req-05c0ff90-96ba-4533-bafc-05435b1d2a00 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:12:15.456459 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-c3680a37-2f63-4cfa-8e34-d3e44dcec5d1 req-05c0ff90-96ba-4533-bafc-05435b1d2a00 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:12:15.473568 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-c3680a37-2f63-4cfa-8e34-d3e44dcec5d1 req-05c0ff90-96ba-4533-bafc-05435b1d2a00 service nova] Creating event network-changed:c1249799-ed07-4822-ac01-8d35b9026962 for instance cf2cba90-3c51-40f7-a160-8d68a39250c5 on n-h1-846466-12 Aug 04 17:12:15.480683 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-c3680a37-2f63-4cfa-8e34-d3e44dcec5d1 req-05c0ff90-96ba-4533-bafc-05435b1d2a00 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050056 Aug 04 17:12:15.482110 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2777/5676] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:12:16.255694 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-acad4ead-8353-4ac6-939e-445b47696342 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:16.256466 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-acad4ead-8353-4ac6-939e-445b47696342 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: cf2cba90-3c51-40f7-a160-8d68a39250c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:16.264869 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-acad4ead-8353-4ac6-939e-445b47696342 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:12:16.265473 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-acad4ead-8353-4ac6-939e-445b47696342 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:12:16.266336 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-acad4ead-8353-4ac6-939e-445b47696342 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:12:16.267834 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-acad4ead-8353-4ac6-939e-445b47696342 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:12:16.431323 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-acad4ead-8353-4ac6-939e-445b47696342 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff743726c34c02a99feaa8abd09e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16f62c8d73843a3b2380304f9af7ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:16.440767 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-acad4ead-8353-4ac6-939e-445b47696342 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "GET /compute/v2.1/servers/cf2cba90-3c51-40f7-a160-8d68a39250c5" status: 200 len: 1319 microversion: 2.1 time: 0.189540 Aug 04 17:12:16.454422 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2900/5677] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:16 2022] GET /compute/v2.1/servers/cf2cba90-3c51-40f7-a160-8d68a39250c5 => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:17.477658 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7f216d29-1365-4bbb-a8f7-c8dcb6d68c0b tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:17.478888 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7f216d29-1365-4bbb-a8f7-c8dcb6d68c0b tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: cf2cba90-3c51-40f7-a160-8d68a39250c5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:17.506569 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f216d29-1365-4bbb-a8f7-c8dcb6d68c0b tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:12:17.508006 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f216d29-1365-4bbb-a8f7-c8dcb6d68c0b tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:12:17.514847 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f216d29-1365-4bbb-a8f7-c8dcb6d68c0b tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:12:17.516483 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f216d29-1365-4bbb-a8f7-c8dcb6d68c0b tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:12:17.882696 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7f216d29-1365-4bbb-a8f7-c8dcb6d68c0b tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff743726c34c02a99feaa8abd09e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16f62c8d73843a3b2380304f9af7ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:17.891214 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7f216d29-1365-4bbb-a8f7-c8dcb6d68c0b tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "GET /compute/v2.1/servers/cf2cba90-3c51-40f7-a160-8d68a39250c5" status: 200 len: 1319 microversion: 2.1 time: 0.429550 Aug 04 17:12:17.892481 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2778/5678] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:17 2022] GET /compute/v2.1/servers/cf2cba90-3c51-40f7-a160-8d68a39250c5 => generated 1319 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:18.912894 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d4920b5a-e792-4f9c-bce7-32dc5157f794 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:18.913607 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d4920b5a-e792-4f9c-bce7-32dc5157f794 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: cf2cba90-3c51-40f7-a160-8d68a39250c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:18.921620 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d4920b5a-e792-4f9c-bce7-32dc5157f794 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:12:18.922202 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d4920b5a-e792-4f9c-bce7-32dc5157f794 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:12:18.923000 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d4920b5a-e792-4f9c-bce7-32dc5157f794 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:12:18.923697 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d4920b5a-e792-4f9c-bce7-32dc5157f794 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:12:19.196278 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d4920b5a-e792-4f9c-bce7-32dc5157f794 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff743726c34c02a99feaa8abd09e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16f62c8d73843a3b2380304f9af7ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:19.206412 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d4920b5a-e792-4f9c-bce7-32dc5157f794 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "GET /compute/v2.1/servers/cf2cba90-3c51-40f7-a160-8d68a39250c5" status: 200 len: 1319 microversion: 2.1 time: 0.297797 Aug 04 17:12:19.222492 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2901/5679] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:18 2022] GET /compute/v2.1/servers/cf2cba90-3c51-40f7-a160-8d68a39250c5 => generated 1319 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:20.235086 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9a507267-8b36-4807-bb29-88a58a5820da tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:20.235086 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9a507267-8b36-4807-bb29-88a58a5820da tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: cf2cba90-3c51-40f7-a160-8d68a39250c5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:20.245382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9a507267-8b36-4807-bb29-88a58a5820da tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:12:20.246360 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9a507267-8b36-4807-bb29-88a58a5820da tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:12:20.247532 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9a507267-8b36-4807-bb29-88a58a5820da tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:12:20.248431 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9a507267-8b36-4807-bb29-88a58a5820da tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:12:20.426332 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9a507267-8b36-4807-bb29-88a58a5820da tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff743726c34c02a99feaa8abd09e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16f62c8d73843a3b2380304f9af7ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:20.437351 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9a507267-8b36-4807-bb29-88a58a5820da tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "GET /compute/v2.1/servers/cf2cba90-3c51-40f7-a160-8d68a39250c5" status: 200 len: 1319 microversion: 2.1 time: 0.210001 Aug 04 17:12:20.438246 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2779/5680] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:20 2022] GET /compute/v2.1/servers/cf2cba90-3c51-40f7-a160-8d68a39250c5 => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:20.697988 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-02ab6ab7-b2fc-4727-8ffb-35bcc94d2f15 req-4caa0e93-ab90-4d44-a5dd-b69b4263af43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf2cba90-3c51-40f7-a160-8d68a39250c5", "name": "network-vif-plugged", "status": "completed", "tag": "c1249799-ed07-4822-ac01-8d35b9026962"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:12:20.713228 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:12:20.714997 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:12:20.720172 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-02ab6ab7-b2fc-4727-8ffb-35bcc94d2f15 req-4caa0e93-ab90-4d44-a5dd-b69b4263af43 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:12:20.721029 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-02ab6ab7-b2fc-4727-8ffb-35bcc94d2f15 req-4caa0e93-ab90-4d44-a5dd-b69b4263af43 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:12:20.746025 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-02ab6ab7-b2fc-4727-8ffb-35bcc94d2f15 req-4caa0e93-ab90-4d44-a5dd-b69b4263af43 service nova] Creating event network-vif-plugged:c1249799-ed07-4822-ac01-8d35b9026962 for instance cf2cba90-3c51-40f7-a160-8d68a39250c5 on n-h1-846466-12 Aug 04 17:12:20.752252 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-02ab6ab7-b2fc-4727-8ffb-35bcc94d2f15 req-4caa0e93-ab90-4d44-a5dd-b69b4263af43 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058136 Aug 04 17:12:20.753913 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2902/5681] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:12:21.459238 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ede2528b-8ab4-40a7-83b0-409bab9fb40e tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:21.460525 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ede2528b-8ab4-40a7-83b0-409bab9fb40e tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: cf2cba90-3c51-40f7-a160-8d68a39250c5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:21.470934 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:12:21.474682 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ede2528b-8ab4-40a7-83b0-409bab9fb40e tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:12:21.477839 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ede2528b-8ab4-40a7-83b0-409bab9fb40e tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:12:21.478988 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ede2528b-8ab4-40a7-83b0-409bab9fb40e tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:12:21.482711 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ede2528b-8ab4-40a7-83b0-409bab9fb40e tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:12:21.651616 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ede2528b-8ab4-40a7-83b0-409bab9fb40e tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff743726c34c02a99feaa8abd09e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16f62c8d73843a3b2380304f9af7ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:21.660388 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ede2528b-8ab4-40a7-83b0-409bab9fb40e tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "GET /compute/v2.1/servers/cf2cba90-3c51-40f7-a160-8d68a39250c5" status: 200 len: 1319 microversion: 2.1 time: 0.205592 Aug 04 17:12:21.673631 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2780/5682] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:21 2022] GET /compute/v2.1/servers/cf2cba90-3c51-40f7-a160-8d68a39250c5 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:12:22.689085 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5e129dce-d816-4337-be14-4e1cfebc1362 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:22.689850 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5e129dce-d816-4337-be14-4e1cfebc1362 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: cf2cba90-3c51-40f7-a160-8d68a39250c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:22.699181 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5e129dce-d816-4337-be14-4e1cfebc1362 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:12:22.699630 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5e129dce-d816-4337-be14-4e1cfebc1362 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:12:22.700399 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5e129dce-d816-4337-be14-4e1cfebc1362 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:12:22.701023 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5e129dce-d816-4337-be14-4e1cfebc1362 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:12:22.928380 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5e129dce-d816-4337-be14-4e1cfebc1362 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff743726c34c02a99feaa8abd09e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16f62c8d73843a3b2380304f9af7ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:22.939229 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5e129dce-d816-4337-be14-4e1cfebc1362 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "GET /compute/v2.1/servers/cf2cba90-3c51-40f7-a160-8d68a39250c5" status: 200 len: 1508 microversion: 2.1 time: 0.258312 Aug 04 17:12:22.941483 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2903/5683] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:22 2022] GET /compute/v2.1/servers/cf2cba90-3c51-40f7-a160-8d68a39250c5 => generated 1508 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:53.709964 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c56becc3-aa65-4248-a7ac-fb29322a2aba tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acb639a0-1391-4ac0-bc5c-b2b17be93210", "device": "/dev/sdb"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:12:53.714188 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c56becc3-aa65-4248-a7ac-fb29322a2aba tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: cf2cba90-3c51-40f7-a160-8d68a39250c5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:53.724275 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=14 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:12:53.725434 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=26 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:12:53.734943 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c56becc3-aa65-4248-a7ac-fb29322a2aba tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:12:53.738743 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c56becc3-aa65-4248-a7ac-fb29322a2aba tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:12:53.742508 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c56becc3-aa65-4248-a7ac-fb29322a2aba tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:12:53.742713 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c56becc3-aa65-4248-a7ac-fb29322a2aba tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:12:54.567820 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c56becc3-aa65-4248-a7ac-fb29322a2aba tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "POST /compute/v2.1/servers/cf2cba90-3c51-40f7-a160-8d68a39250c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.862323 Aug 04 17:12:54.568937 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2781/5684] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Aug 4 17:12:53 2022] POST /compute/v2.1/servers/cf2cba90-3c51-40f7-a160-8d68a39250c5/os-volume_attachments => generated 194 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:12:57.810189 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:12:57.811556 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=34 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:12:58.360104 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6164d28f-6180-49a4-8aed-5fbafebd6790 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Action: 'create', calling method: .version_select at 0x7f7e89bd6940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-64000245", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNorvQ/pxmadMVYzbEdhgp4nX6A6wcyu6Rd4Kb4205e3XdFe2JH1cr2OrqefBLA5QgQQ+sY3i+SVWZS0Q8FiJu7gu6WM4s7Ha2IyI8aIC0Y4O8CcfGGa1sNztueLlOccyg=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:12:58.395151 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-6164d28f-6180-49a4-8aed-5fbafebd6790 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Getting quotas for project a080cbeb5c3a435a880e48ea64dbea70. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:12:58.405695 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-6164d28f-6180-49a4-8aed-5fbafebd6790 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Getting quotas for user e4c6be7b0d164da98f08be0c35f843a2 and project a080cbeb5c3a435a880e48ea64dbea70. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:12:58.460880 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6164d28f-6180-49a4-8aed-5fbafebd6790 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.655267 Aug 04 17:12:58.462502 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2904/5685] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 17:12:57 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:13:10.752011 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-717be941-e406-42fe-8ad9-66ba98223710 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2142737445", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "38e10f6f-e8ae-482a-8aad-798efb75f1c8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-64000245", "security_groups": [{"name": "tempest-secgroup-smoke-529574960"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:10.795254 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:10.797369 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:10.996374 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-717be941-e406-42fe-8ad9-66ba98223710 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] validate_networks() for [('38e10f6f-e8ae-482a-8aad-798efb75f1c8', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:13:12.098570 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-717be941-e406-42fe-8ad9-66ba98223710 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:13:12.099907 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-717be941-e406-42fe-8ad9-66ba98223710 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:13:12.099907 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-717be941-e406-42fe-8ad9-66ba98223710 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:13:12.099907 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-717be941-e406-42fe-8ad9-66ba98223710 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:13:12.100265 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-717be941-e406-42fe-8ad9-66ba98223710 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:13:12.114056 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-717be941-e406-42fe-8ad9-66ba98223710 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:12.114783 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-717be941-e406-42fe-8ad9-66ba98223710 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:12.115970 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-717be941-e406-42fe-8ad9-66ba98223710 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:12.116582 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-717be941-e406-42fe-8ad9-66ba98223710 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:12.163713 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-717be941-e406-42fe-8ad9-66ba98223710 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Getting quotas for project a080cbeb5c3a435a880e48ea64dbea70. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:13:12.173807 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-717be941-e406-42fe-8ad9-66ba98223710 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Getting quotas for user e4c6be7b0d164da98f08be0c35f843a2 and project a080cbeb5c3a435a880e48ea64dbea70. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:13:12.192517 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-717be941-e406-42fe-8ad9-66ba98223710 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:13:12.195907 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-717be941-e406-42fe-8ad9-66ba98223710 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:13:12.312213 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-717be941-e406-42fe-8ad9-66ba98223710 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.566190 Aug 04 17:13:12.313109 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2782/5686] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:13:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 1568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:13:12.326819 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:12.328959 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:12.340526 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5c9df6f3-b054-41de-a303-7e6bf99dfbb2 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:12.344061 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5c9df6f3-b054-41de-a303-7e6bf99dfbb2 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:13.097508 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5c9df6f3-b054-41de-a303-7e6bf99dfbb2 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:13.114218 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5c9df6f3-b054-41de-a303-7e6bf99dfbb2 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1265 microversion: 2.1 time: 0.785662 Aug 04 17:13:13.114766 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2905/5687] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:12 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1265 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:14.136947 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f211a0b9-b09c-47b1-9d06-cbfe7cd1af88 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:14.146883 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f211a0b9-b09c-47b1-9d06-cbfe7cd1af88 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:14.162177 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f211a0b9-b09c-47b1-9d06-cbfe7cd1af88 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:14.162635 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f211a0b9-b09c-47b1-9d06-cbfe7cd1af88 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:14.167432 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f211a0b9-b09c-47b1-9d06-cbfe7cd1af88 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:14.167900 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f211a0b9-b09c-47b1-9d06-cbfe7cd1af88 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:14.289688 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f211a0b9-b09c-47b1-9d06-cbfe7cd1af88 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:14.302633 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f211a0b9-b09c-47b1-9d06-cbfe7cd1af88 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1317 microversion: 2.1 time: 0.170868 Aug 04 17:13:14.317333 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2783/5688] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:14 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:15.324737 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-979f1a96-6e51-41bf-9bf7-e22155fee3f5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:15.325577 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-979f1a96-6e51-41bf-9bf7-e22155fee3f5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:15.341118 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-979f1a96-6e51-41bf-9bf7-e22155fee3f5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:15.341663 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-979f1a96-6e51-41bf-9bf7-e22155fee3f5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:15.342622 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-979f1a96-6e51-41bf-9bf7-e22155fee3f5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:15.350584 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-979f1a96-6e51-41bf-9bf7-e22155fee3f5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:15.552151 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-979f1a96-6e51-41bf-9bf7-e22155fee3f5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:15.567411 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-979f1a96-6e51-41bf-9bf7-e22155fee3f5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1323 microversion: 2.1 time: 0.246917 Aug 04 17:13:15.585398 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2906/5689] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:15 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1323 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:16.598292 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cc9f3fee-f7a8-4da1-a291-87731544e388 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:16.598909 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cc9f3fee-f7a8-4da1-a291-87731544e388 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:16.615774 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cc9f3fee-f7a8-4da1-a291-87731544e388 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:16.616246 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cc9f3fee-f7a8-4da1-a291-87731544e388 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:16.628131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cc9f3fee-f7a8-4da1-a291-87731544e388 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:16.636541 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cc9f3fee-f7a8-4da1-a291-87731544e388 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:17.335050 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cc9f3fee-f7a8-4da1-a291-87731544e388 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:17.346160 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cc9f3fee-f7a8-4da1-a291-87731544e388 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1390 microversion: 2.1 time: 0.752073 Aug 04 17:13:17.346749 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2784/5690] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:16 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1390 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:18.367611 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-828f2dbe-c76d-4d2a-b88c-cee325aa0239 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:18.368262 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-828f2dbe-c76d-4d2a-b88c-cee325aa0239 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:18.386750 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-828f2dbe-c76d-4d2a-b88c-cee325aa0239 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:18.387238 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-828f2dbe-c76d-4d2a-b88c-cee325aa0239 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:18.399415 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-828f2dbe-c76d-4d2a-b88c-cee325aa0239 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:18.400291 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-828f2dbe-c76d-4d2a-b88c-cee325aa0239 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:18.971478 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-828f2dbe-c76d-4d2a-b88c-cee325aa0239 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:18.981267 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-828f2dbe-c76d-4d2a-b88c-cee325aa0239 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1390 microversion: 2.1 time: 0.617837 Aug 04 17:13:18.997062 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2907/5691] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:18 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1390 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:19.283034 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-ffbc19fe-9b16-47ce-8a8d-bb40c511b802 req-74ca6681-2be0-4507-8663-da47a1672904 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55605b02-eb78-41d9-a397-c58a3997fc46", "tag": "8b156186-1d42-470c-9334-6468b498cd22"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:19.318552 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-ffbc19fe-9b16-47ce-8a8d-bb40c511b802 req-74ca6681-2be0-4507-8663-da47a1672904 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:19.319254 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-ffbc19fe-9b16-47ce-8a8d-bb40c511b802 req-74ca6681-2be0-4507-8663-da47a1672904 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:19.341860 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-ffbc19fe-9b16-47ce-8a8d-bb40c511b802 req-74ca6681-2be0-4507-8663-da47a1672904 service nova] Creating event network-changed:8b156186-1d42-470c-9334-6468b498cd22 for instance 55605b02-eb78-41d9-a397-c58a3997fc46 on n-h1-846466-12 Aug 04 17:13:19.361073 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-ffbc19fe-9b16-47ce-8a8d-bb40c511b802 req-74ca6681-2be0-4507-8663-da47a1672904 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078737 Aug 04 17:13:19.363458 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2785/5692] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:13:20.005149 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0cc9a497-946c-4155-b166-8e172937d8d6 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:20.007236 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0cc9a497-946c-4155-b166-8e172937d8d6 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:20.016805 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0cc9a497-946c-4155-b166-8e172937d8d6 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:20.017598 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0cc9a497-946c-4155-b166-8e172937d8d6 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:20.018578 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0cc9a497-946c-4155-b166-8e172937d8d6 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:20.019192 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0cc9a497-946c-4155-b166-8e172937d8d6 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:20.270161 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0cc9a497-946c-4155-b166-8e172937d8d6 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:20.280163 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0cc9a497-946c-4155-b166-8e172937d8d6 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1390 microversion: 2.1 time: 0.279666 Aug 04 17:13:20.293899 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2908/5693] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:19 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1390 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:21.324010 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7e701a86-b28a-42ef-bb47-26f5a5c041ac tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:21.326297 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7e701a86-b28a-42ef-bb47-26f5a5c041ac tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:21.359322 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7e701a86-b28a-42ef-bb47-26f5a5c041ac tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:21.366200 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7e701a86-b28a-42ef-bb47-26f5a5c041ac tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:21.369092 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7e701a86-b28a-42ef-bb47-26f5a5c041ac tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:21.370096 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7e701a86-b28a-42ef-bb47-26f5a5c041ac tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:21.980292 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7e701a86-b28a-42ef-bb47-26f5a5c041ac tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:21.990624 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7e701a86-b28a-42ef-bb47-26f5a5c041ac tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1390 microversion: 2.1 time: 0.687007 Aug 04 17:13:22.007300 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2786/5694] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:21 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1390 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:23.015421 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7c6b3f4e-7f9e-4f12-afb6-49a2b29a915d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:23.017363 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7c6b3f4e-7f9e-4f12-afb6-49a2b29a915d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:23.035442 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7c6b3f4e-7f9e-4f12-afb6-49a2b29a915d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:23.036297 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7c6b3f4e-7f9e-4f12-afb6-49a2b29a915d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:23.037376 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7c6b3f4e-7f9e-4f12-afb6-49a2b29a915d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:23.038345 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7c6b3f4e-7f9e-4f12-afb6-49a2b29a915d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:23.104745 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:23.352881 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7c6b3f4e-7f9e-4f12-afb6-49a2b29a915d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:23.387751 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7c6b3f4e-7f9e-4f12-afb6-49a2b29a915d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1390 microversion: 2.1 time: 0.377304 Aug 04 17:13:23.401747 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2909/5695] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:23 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1390 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:24.433127 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5771ca72-8528-4af2-9738-41382822b2ec tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:24.434813 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5771ca72-8528-4af2-9738-41382822b2ec tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:24.441262 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:24.450489 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:24.454537 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5771ca72-8528-4af2-9738-41382822b2ec tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:24.455727 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5771ca72-8528-4af2-9738-41382822b2ec tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:24.456781 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5771ca72-8528-4af2-9738-41382822b2ec tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:24.457461 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5771ca72-8528-4af2-9738-41382822b2ec tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:24.699918 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5771ca72-8528-4af2-9738-41382822b2ec tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:24.732476 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5771ca72-8528-4af2-9738-41382822b2ec tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1390 microversion: 2.1 time: 0.327501 Aug 04 17:13:24.733621 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2787/5696] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:24 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1390 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:25.373929 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-437d34a4-9809-4967-bb65-f69294faeb15 req-4c9caa9c-c84f-4c84-b1b4-deabbd52fdfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55605b02-eb78-41d9-a397-c58a3997fc46", "name": "network-vif-plugged", "status": "completed", "tag": "8b156186-1d42-470c-9334-6468b498cd22"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:25.429466 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-437d34a4-9809-4967-bb65-f69294faeb15 req-4c9caa9c-c84f-4c84-b1b4-deabbd52fdfd service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:25.431881 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-437d34a4-9809-4967-bb65-f69294faeb15 req-4c9caa9c-c84f-4c84-b1b4-deabbd52fdfd service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:25.466999 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-437d34a4-9809-4967-bb65-f69294faeb15 req-4c9caa9c-c84f-4c84-b1b4-deabbd52fdfd service nova] Creating event network-vif-plugged:8b156186-1d42-470c-9334-6468b498cd22 for instance 55605b02-eb78-41d9-a397-c58a3997fc46 on n-h1-846466-12 Aug 04 17:13:25.485039 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-437d34a4-9809-4967-bb65-f69294faeb15 req-4c9caa9c-c84f-4c84-b1b4-deabbd52fdfd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114898 Aug 04 17:13:25.487585 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2910/5697] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:13:25.762477 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-418215e0-c7b4-4937-b38b-dcf98d8cd666 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:25.763377 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-418215e0-c7b4-4937-b38b-dcf98d8cd666 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:25.781110 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-418215e0-c7b4-4937-b38b-dcf98d8cd666 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:25.781717 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-418215e0-c7b4-4937-b38b-dcf98d8cd666 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:25.782716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-418215e0-c7b4-4937-b38b-dcf98d8cd666 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:25.783261 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-418215e0-c7b4-4937-b38b-dcf98d8cd666 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:26.308823 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-418215e0-c7b4-4937-b38b-dcf98d8cd666 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:26.320427 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-418215e0-c7b4-4937-b38b-dcf98d8cd666 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1390 microversion: 2.1 time: 0.562014 Aug 04 17:13:26.321472 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2788/5698] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:25 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1390 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:27.343944 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-17042add-0f73-4d75-ac6a-0367f1d1a123 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:27.344727 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-17042add-0f73-4d75-ac6a-0367f1d1a123 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:27.361917 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-17042add-0f73-4d75-ac6a-0367f1d1a123 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:27.362375 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-17042add-0f73-4d75-ac6a-0367f1d1a123 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:27.368286 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-17042add-0f73-4d75-ac6a-0367f1d1a123 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:27.373753 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-17042add-0f73-4d75-ac6a-0367f1d1a123 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:28.439591 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-17042add-0f73-4d75-ac6a-0367f1d1a123 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:28.448545 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-17042add-0f73-4d75-ac6a-0367f1d1a123 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1390 microversion: 2.1 time: 1.110630 Aug 04 17:13:28.451585 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2911/5699] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:27 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1390 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:29.474516 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ead5a286-2eb4-4d9c-8e9e-157ab376c766 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:29.476374 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ead5a286-2eb4-4d9c-8e9e-157ab376c766 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:29.526419 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ead5a286-2eb4-4d9c-8e9e-157ab376c766 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:29.528188 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ead5a286-2eb4-4d9c-8e9e-157ab376c766 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:29.537962 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ead5a286-2eb4-4d9c-8e9e-157ab376c766 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:29.537962 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ead5a286-2eb4-4d9c-8e9e-157ab376c766 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:29.912448 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ead5a286-2eb4-4d9c-8e9e-157ab376c766 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:29.923660 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ead5a286-2eb4-4d9c-8e9e-157ab376c766 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1561 microversion: 2.1 time: 0.453023 Aug 04 17:13:29.929090 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2789/5700] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:29 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1561 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:29.951553 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-573a768c-f9e0-40bb-9681-f6513c96c8f3 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:29.952727 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-573a768c-f9e0-40bb-9681-f6513c96c8f3 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:29.969302 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-573a768c-f9e0-40bb-9681-f6513c96c8f3 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:29.969799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-573a768c-f9e0-40bb-9681-f6513c96c8f3 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:29.976743 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-573a768c-f9e0-40bb-9681-f6513c96c8f3 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:29.977493 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-573a768c-f9e0-40bb-9681-f6513c96c8f3 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:30.172686 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-573a768c-f9e0-40bb-9681-f6513c96c8f3 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:30.182147 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-573a768c-f9e0-40bb-9681-f6513c96c8f3 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1561 microversion: 2.1 time: 0.234624 Aug 04 17:13:30.183000 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2912/5701] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:29 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1561 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:13:31.063212 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9335166e-f781-469d-ab12-9b6f5aae8513 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1746117441", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1843310632", "security_groups": [{"name": "tempest-secgroup-smoke-1275595346"}], "block_device_mapping_v2": [{"uuid": "7a2bd353-68be-4142-ae3a-ac9814480265", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8cd64b36-f8a8-48d4-b083-6164d20009da"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:31.237828 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-9335166e-f781-469d-ab12-9b6f5aae8513 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] validate_networks() for [('8cd64b36-f8a8-48d4-b083-6164d20009da', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:13:31.958273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6f130c48-ab2a-436e-b5ee-4eec1f75d1fd tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:31.958803 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6f130c48-ab2a-436e-b5ee-4eec1f75d1fd tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: cf2cba90-3c51-40f7-a160-8d68a39250c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:31.976253 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6f130c48-ab2a-436e-b5ee-4eec1f75d1fd tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:31.976911 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6f130c48-ab2a-436e-b5ee-4eec1f75d1fd tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:31.977906 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6f130c48-ab2a-436e-b5ee-4eec1f75d1fd tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:31.978361 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6f130c48-ab2a-436e-b5ee-4eec1f75d1fd tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:32.187829 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-6f130c48-ab2a-436e-b5ee-4eec1f75d1fd tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lazy-loading 'services' on Instance uuid cf2cba90-3c51-40f7-a160-8d68a39250c5 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:13:32.352587 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6f130c48-ab2a-436e-b5ee-4eec1f75d1fd tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cf2cba90-3c51-40f7-a160-8d68a39250c5/os-volume_attachments/acb639a0-1391-4ac0-bc5c-b2b17be93210" status: 202 len: 0 microversion: 2.1 time: 0.394847 Aug 04 17:13:32.360911 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2913/5702] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Aug 4 17:13:31 2022] DELETE /compute/v2.1/servers/cf2cba90-3c51-40f7-a160-8d68a39250c5/os-volume_attachments/acb639a0-1391-4ac0-bc5c-b2b17be93210 => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 17:13:32.627624 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9335166e-f781-469d-ab12-9b6f5aae8513 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:13:32.628812 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9335166e-f781-469d-ab12-9b6f5aae8513 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:13:32.629509 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9335166e-f781-469d-ab12-9b6f5aae8513 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:13:32.630286 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9335166e-f781-469d-ab12-9b6f5aae8513 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:13:32.631409 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9335166e-f781-469d-ab12-9b6f5aae8513 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:13:32.645868 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9335166e-f781-469d-ab12-9b6f5aae8513 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:32.646326 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9335166e-f781-469d-ab12-9b6f5aae8513 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:32.647159 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9335166e-f781-469d-ab12-9b6f5aae8513 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:32.647601 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9335166e-f781-469d-ab12-9b6f5aae8513 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:32.673625 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-9335166e-f781-469d-ab12-9b6f5aae8513 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Getting quotas for project 78a0adb69ba24749817a8855effc20ad. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:13:32.681885 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-9335166e-f781-469d-ab12-9b6f5aae8513 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Getting quotas for user ea9cab1c1eff47ddb881a2b57bf240f3 and project 78a0adb69ba24749817a8855effc20ad. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:13:32.866894 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9335166e-f781-469d-ab12-9b6f5aae8513 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:13:32.869904 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9335166e-f781-469d-ab12-9b6f5aae8513 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7a2bd353-68be-4142-ae3a-ac9814480265',volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:13:33.288274 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9335166e-f781-469d-ab12-9b6f5aae8513 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.229739 Aug 04 17:13:33.290062 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2790/5703] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:13:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 2240 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:13:33.313560 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-24e4b46c-abce-45ad-87af-2760fa4a2b3d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:33.321238 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-24e4b46c-abce-45ad-87af-2760fa4a2b3d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:33.554303 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-24e4b46c-abce-45ad-87af-2760fa4a2b3d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:33.585127 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-24e4b46c-abce-45ad-87af-2760fa4a2b3d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 200 len: 1095 microversion: 2.1 time: 0.286030 Aug 04 17:13:33.589943 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2914/5704] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:33 2022] GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 1095 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:34.619355 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-560d4de3-542e-4227-b6b0-c740d7ed6046 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:34.625158 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-560d4de3-542e-4227-b6b0-c740d7ed6046 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:34.756261 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-560d4de3-542e-4227-b6b0-c740d7ed6046 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:34.826434 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-560d4de3-542e-4227-b6b0-c740d7ed6046 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 200 len: 1095 microversion: 2.1 time: 0.218807 Aug 04 17:13:34.831374 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2791/5705] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:34 2022] GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 1095 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:35.331032 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6de7e710-4b44-4fe6-b734-4694158345ae tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:35.332351 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6de7e710-4b44-4fe6-b734-4694158345ae tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:35.354753 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6de7e710-4b44-4fe6-b734-4694158345ae tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:35.359825 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6de7e710-4b44-4fe6-b734-4694158345ae tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:35.362887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6de7e710-4b44-4fe6-b734-4694158345ae tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:35.370748 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6de7e710-4b44-4fe6-b734-4694158345ae tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:35.712076 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-d4d33cd7-b4fa-4b66-9363-980109bc961d req-697f975b-ef9a-4298-a44e-d7ef708ce8a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55605b02-eb78-41d9-a397-c58a3997fc46", "tag": "8b156186-1d42-470c-9334-6468b498cd22"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:35.734548 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-d4d33cd7-b4fa-4b66-9363-980109bc961d req-697f975b-ef9a-4298-a44e-d7ef708ce8a0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:35.737083 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-d4d33cd7-b4fa-4b66-9363-980109bc961d req-697f975b-ef9a-4298-a44e-d7ef708ce8a0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:35.770541 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-d4d33cd7-b4fa-4b66-9363-980109bc961d req-697f975b-ef9a-4298-a44e-d7ef708ce8a0 service nova] Creating event network-changed:8b156186-1d42-470c-9334-6468b498cd22 for instance 55605b02-eb78-41d9-a397-c58a3997fc46 on n-h1-846466-12 Aug 04 17:13:35.786159 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-d4d33cd7-b4fa-4b66-9363-980109bc961d req-697f975b-ef9a-4298-a44e-d7ef708ce8a0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.429543 Aug 04 17:13:35.789033 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2792/5706] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:13:35.869180 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6c9f1e41-7bbc-4998-babf-70610f905453 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:35.870056 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6c9f1e41-7bbc-4998-babf-70610f905453 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:35.928650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c9f1e41-7bbc-4998-babf-70610f905453 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:35.929541 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c9f1e41-7bbc-4998-babf-70610f905453 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:35.954421 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c9f1e41-7bbc-4998-babf-70610f905453 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:35.954999 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c9f1e41-7bbc-4998-babf-70610f905453 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:36.520120 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6c9f1e41-7bbc-4998-babf-70610f905453 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:36.553258 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6c9f1e41-7bbc-4998-babf-70610f905453 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 200 len: 1193 microversion: 2.1 time: 0.687934 Aug 04 17:13:36.554570 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2793/5707] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:35 2022] GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 1193 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:13:36.558732 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6de7e710-4b44-4fe6-b734-4694158345ae tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:36.584342 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6de7e710-4b44-4fe6-b734-4694158345ae tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1561 microversion: 2.1 time: 1.258912 Aug 04 17:13:36.586865 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2915/5708] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:35 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1561 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:37.588979 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d74dfb9f-4582-4e6a-b2ce-cdb9e025d250 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:37.589653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d74dfb9f-4582-4e6a-b2ce-cdb9e025d250 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:37.606108 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d74dfb9f-4582-4e6a-b2ce-cdb9e025d250 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:37.613532 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d74dfb9f-4582-4e6a-b2ce-cdb9e025d250 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:37.614643 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d74dfb9f-4582-4e6a-b2ce-cdb9e025d250 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:37.615107 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d74dfb9f-4582-4e6a-b2ce-cdb9e025d250 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:37.839797 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d74dfb9f-4582-4e6a-b2ce-cdb9e025d250 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:37.853907 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d74dfb9f-4582-4e6a-b2ce-cdb9e025d250 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 200 len: 1211 microversion: 2.1 time: 0.269625 Aug 04 17:13:37.861615 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2794/5709] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:37 2022] GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 1211 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:38.878346 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ad49655a-6ee3-48fa-a85c-6acdfcf728cc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:38.878968 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ad49655a-6ee3-48fa-a85c-6acdfcf728cc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:38.911483 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad49655a-6ee3-48fa-a85c-6acdfcf728cc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:38.913630 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad49655a-6ee3-48fa-a85c-6acdfcf728cc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:38.939079 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad49655a-6ee3-48fa-a85c-6acdfcf728cc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:38.940041 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad49655a-6ee3-48fa-a85c-6acdfcf728cc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:39.118993 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ad49655a-6ee3-48fa-a85c-6acdfcf728cc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:39.128168 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ad49655a-6ee3-48fa-a85c-6acdfcf728cc tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 200 len: 1211 microversion: 2.1 time: 0.256549 Aug 04 17:13:39.142359 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2916/5710] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:38 2022] GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 1211 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:40.150265 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-73be7db9-5b65-49d4-984d-97b396f01fd8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:40.150989 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-73be7db9-5b65-49d4-984d-97b396f01fd8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:40.159309 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-73be7db9-5b65-49d4-984d-97b396f01fd8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:40.160085 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-73be7db9-5b65-49d4-984d-97b396f01fd8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:40.161107 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-73be7db9-5b65-49d4-984d-97b396f01fd8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:40.161834 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-73be7db9-5b65-49d4-984d-97b396f01fd8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:40.460626 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-73be7db9-5b65-49d4-984d-97b396f01fd8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:40.477675 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-73be7db9-5b65-49d4-984d-97b396f01fd8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 200 len: 1279 microversion: 2.1 time: 0.328237 Aug 04 17:13:40.479218 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2795/5711] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:40 2022] GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 1279 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:41.055998 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-13ba9a88-efaf-4cbb-b9bf-a3745bcfbfe8 req-5d672bf4-dae2-40b1-bca5-fadb3bb984e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ad652c1-0763-405a-8cf9-2560bab1df4c", "tag": "c22976c8-ed27-4b47-8acb-123754158502"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:41.076555 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-13ba9a88-efaf-4cbb-b9bf-a3745bcfbfe8 req-5d672bf4-dae2-40b1-bca5-fadb3bb984e3 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:41.077503 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-13ba9a88-efaf-4cbb-b9bf-a3745bcfbfe8 req-5d672bf4-dae2-40b1-bca5-fadb3bb984e3 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:41.120629 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-13ba9a88-efaf-4cbb-b9bf-a3745bcfbfe8 req-5d672bf4-dae2-40b1-bca5-fadb3bb984e3 service nova] Creating event network-changed:c22976c8-ed27-4b47-8acb-123754158502 for instance 0ad652c1-0763-405a-8cf9-2560bab1df4c on n-h2-846466-12 Aug 04 17:13:41.140349 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-13ba9a88-efaf-4cbb-b9bf-a3745bcfbfe8 req-5d672bf4-dae2-40b1-bca5-fadb3bb984e3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.426180 Aug 04 17:13:41.141330 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2917/5712] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:13:41.502369 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8c7eace1-0f96-40b4-af2c-22b30f2ff735 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:41.503883 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8c7eace1-0f96-40b4-af2c-22b30f2ff735 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:41.513327 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:41.520126 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8c7eace1-0f96-40b4-af2c-22b30f2ff735 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:41.525414 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8c7eace1-0f96-40b4-af2c-22b30f2ff735 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:41.530916 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8c7eace1-0f96-40b4-af2c-22b30f2ff735 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:41.534182 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8c7eace1-0f96-40b4-af2c-22b30f2ff735 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:41.624851 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=63 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:42.091323 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8c7eace1-0f96-40b4-af2c-22b30f2ff735 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:42.104233 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8c7eace1-0f96-40b4-af2c-22b30f2ff735 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 200 len: 1279 microversion: 2.1 time: 0.608003 Aug 04 17:13:42.106497 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2796/5713] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:41 2022] GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 1279 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:42.470189 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-229d4c13-3867-464c-a9db-fde41ee606b2 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:42.470876 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-229d4c13-3867-464c-a9db-fde41ee606b2 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: cf2cba90-3c51-40f7-a160-8d68a39250c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:42.498909 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=31 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:42.501093 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-229d4c13-3867-464c-a9db-fde41ee606b2 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:42.501592 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-229d4c13-3867-464c-a9db-fde41ee606b2 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:42.502858 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-229d4c13-3867-464c-a9db-fde41ee606b2 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:42.503298 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-229d4c13-3867-464c-a9db-fde41ee606b2 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:42.554577 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=62,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:42.561446 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-229d4c13-3867-464c-a9db-fde41ee606b2 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: cf2cba90-3c51-40f7-a160-8d68a39250c5] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:13:42.759062 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-229d4c13-3867-464c-a9db-fde41ee606b2 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cf2cba90-3c51-40f7-a160-8d68a39250c5" status: 204 len: 0 microversion: 2.1 time: 0.295095 Aug 04 17:13:42.762762 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2918/5714] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:13:42 2022] DELETE /compute/v2.1/servers/cf2cba90-3c51-40f7-a160-8d68a39250c5 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:13:42.776445 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-46c6002a-fbf2-42ef-9fee-c181c8776e66 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:42.779776 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-46c6002a-fbf2-42ef-9fee-c181c8776e66 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: cf2cba90-3c51-40f7-a160-8d68a39250c5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:42.812297 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:42.820684 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-46c6002a-fbf2-42ef-9fee-c181c8776e66 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:42.824760 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-46c6002a-fbf2-42ef-9fee-c181c8776e66 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:42.829393 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-46c6002a-fbf2-42ef-9fee-c181c8776e66 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:42.832904 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-46c6002a-fbf2-42ef-9fee-c181c8776e66 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:43.129132 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-be1ff7f2-7eea-48b8-895f-66c12aa6fc1e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:43.129983 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-be1ff7f2-7eea-48b8-895f-66c12aa6fc1e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:43.140710 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be1ff7f2-7eea-48b8-895f-66c12aa6fc1e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:43.146120 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be1ff7f2-7eea-48b8-895f-66c12aa6fc1e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:43.147413 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be1ff7f2-7eea-48b8-895f-66c12aa6fc1e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:43.148035 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be1ff7f2-7eea-48b8-895f-66c12aa6fc1e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:43.573273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:43.795122 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-46c6002a-fbf2-42ef-9fee-c181c8776e66 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff743726c34c02a99feaa8abd09e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16f62c8d73843a3b2380304f9af7ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:43.817660 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-46c6002a-fbf2-42ef-9fee-c181c8776e66 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "GET /compute/v2.1/servers/cf2cba90-3c51-40f7-a160-8d68a39250c5" status: 200 len: 1514 microversion: 2.1 time: 1.045944 Aug 04 17:13:43.818316 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2797/5715] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:42 2022] GET /compute/v2.1/servers/cf2cba90-3c51-40f7-a160-8d68a39250c5 => generated 1514 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:43.906002 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-be1ff7f2-7eea-48b8-895f-66c12aa6fc1e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:43.914564 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-be1ff7f2-7eea-48b8-895f-66c12aa6fc1e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 200 len: 1279 microversion: 2.1 time: 0.790146 Aug 04 17:13:43.934141 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2919/5716] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:43 2022] GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 1279 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:13:44.854236 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9497cedc-5917-4ca5-8f16-df1add4ab7fb tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:44.855944 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9497cedc-5917-4ca5-8f16-df1add4ab7fb tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: cf2cba90-3c51-40f7-a160-8d68a39250c5] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:44.873258 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=8 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:44.878982 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9497cedc-5917-4ca5-8f16-df1add4ab7fb tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:44.881727 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9497cedc-5917-4ca5-8f16-df1add4ab7fb tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:44.883159 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9497cedc-5917-4ca5-8f16-df1add4ab7fb tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:44.884125 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9497cedc-5917-4ca5-8f16-df1add4ab7fb tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:44.964298 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6130f665-dea6-4fe1-ae30-4339fef997aa tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:44.966270 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6130f665-dea6-4fe1-ae30-4339fef997aa tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:44.986170 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6130f665-dea6-4fe1-ae30-4339fef997aa tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:44.989837 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6130f665-dea6-4fe1-ae30-4339fef997aa tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:44.991359 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6130f665-dea6-4fe1-ae30-4339fef997aa tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:44.996138 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6130f665-dea6-4fe1-ae30-4339fef997aa tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:45.418961 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9497cedc-5917-4ca5-8f16-df1add4ab7fb tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff743726c34c02a99feaa8abd09e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16f62c8d73843a3b2380304f9af7ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:45.438462 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9497cedc-5917-4ca5-8f16-df1add4ab7fb tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "GET /compute/v2.1/servers/cf2cba90-3c51-40f7-a160-8d68a39250c5" status: 200 len: 1514 microversion: 2.1 time: 0.595247 Aug 04 17:13:45.449402 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2798/5717] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:44 2022] GET /compute/v2.1/servers/cf2cba90-3c51-40f7-a160-8d68a39250c5 => generated 1514 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:13:45.449675 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6130f665-dea6-4fe1-ae30-4339fef997aa tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:45.457629 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6130f665-dea6-4fe1-ae30-4339fef997aa tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 200 len: 1279 microversion: 2.1 time: 0.512379 Aug 04 17:13:45.458231 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2920/5718] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:44 2022] GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 1279 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:45.840884 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-3211c546-58b7-47c1-a960-de30cc3ba045 req-5bf16e86-e9c0-4ed6-9c5b-d982cc7def74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf2cba90-3c51-40f7-a160-8d68a39250c5", "name": "network-vif-deleted", "tag": "c1249799-ed07-4822-ac01-8d35b9026962"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:45.891777 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-3211c546-58b7-47c1-a960-de30cc3ba045 req-5bf16e86-e9c0-4ed6-9c5b-d982cc7def74 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:45.892591 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-3211c546-58b7-47c1-a960-de30cc3ba045 req-5bf16e86-e9c0-4ed6-9c5b-d982cc7def74 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:45.924236 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-3211c546-58b7-47c1-a960-de30cc3ba045 req-5bf16e86-e9c0-4ed6-9c5b-d982cc7def74 service nova] Creating event network-vif-deleted:c1249799-ed07-4822-ac01-8d35b9026962 for instance cf2cba90-3c51-40f7-a160-8d68a39250c5 on n-h1-846466-12 Aug 04 17:13:45.938154 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-3211c546-58b7-47c1-a960-de30cc3ba045 req-5bf16e86-e9c0-4ed6-9c5b-d982cc7def74 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101332 Aug 04 17:13:45.942980 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2799/5719] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:13:46.461180 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c3f610f7-ce22-49b2-8203-21bfadf10e07 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:46.462748 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c3f610f7-ce22-49b2-8203-21bfadf10e07 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: cf2cba90-3c51-40f7-a160-8d68a39250c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:46.498615 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6324cf8c-feac-4af5-82ff-83f16cb61321 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:46.499806 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6324cf8c-feac-4af5-82ff-83f16cb61321 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:46.503805 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3f610f7-ce22-49b2-8203-21bfadf10e07 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:46.509686 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3f610f7-ce22-49b2-8203-21bfadf10e07 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:46.512948 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3f610f7-ce22-49b2-8203-21bfadf10e07 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:46.516087 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3f610f7-ce22-49b2-8203-21bfadf10e07 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:46.554318 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6324cf8c-feac-4af5-82ff-83f16cb61321 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:46.555204 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6324cf8c-feac-4af5-82ff-83f16cb61321 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:46.566624 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6324cf8c-feac-4af5-82ff-83f16cb61321 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:46.567709 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6324cf8c-feac-4af5-82ff-83f16cb61321 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:46.673380 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3f610f7-ce22-49b2-8203-21bfadf10e07 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:46.674431 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3f610f7-ce22-49b2-8203-21bfadf10e07 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:46.675776 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-c3f610f7-ce22-49b2-8203-21bfadf10e07 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lazy-loading 'fault' on Instance uuid cf2cba90-3c51-40f7-a160-8d68a39250c5 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:13:46.857910 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c3f610f7-ce22-49b2-8203-21bfadf10e07 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff743726c34c02a99feaa8abd09e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16f62c8d73843a3b2380304f9af7ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:46.891155 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c3f610f7-ce22-49b2-8203-21bfadf10e07 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "GET /compute/v2.1/servers/cf2cba90-3c51-40f7-a160-8d68a39250c5" status: 200 len: 1309 microversion: 2.1 time: 0.429919 Aug 04 17:13:46.892926 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2921/5720] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:46 2022] GET /compute/v2.1/servers/cf2cba90-3c51-40f7-a160-8d68a39250c5 => generated 1309 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:47.053135 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6324cf8c-feac-4af5-82ff-83f16cb61321 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:47.063284 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6324cf8c-feac-4af5-82ff-83f16cb61321 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 200 len: 1279 microversion: 2.1 time: 0.573631 Aug 04 17:13:47.065010 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2800/5721] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:46 2022] GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 1279 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:47.926997 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-eb0a8319-3be6-49bc-90fe-f8a357a39d2d tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:47.933916 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-eb0a8319-3be6-49bc-90fe-f8a357a39d2d tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: cf2cba90-3c51-40f7-a160-8d68a39250c5] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:47.951952 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eb0a8319-3be6-49bc-90fe-f8a357a39d2d tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:47.957117 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eb0a8319-3be6-49bc-90fe-f8a357a39d2d tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:47.961404 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eb0a8319-3be6-49bc-90fe-f8a357a39d2d tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:47.962097 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eb0a8319-3be6-49bc-90fe-f8a357a39d2d tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:47.999234 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-eb0a8319-3be6-49bc-90fe-f8a357a39d2d tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] HTTP exception thrown: Instance cf2cba90-3c51-40f7-a160-8d68a39250c5 could not be found. Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-eb0a8319-3be6-49bc-90fe-f8a357a39d2d tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Request method failure captured: Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/cf2cba90-3c51-40f7-a160-8d68a39250c5 HTTP/1.1 Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_2JbUoIKfbiZRaYTIaWVEPfmbHCRsHYWDzYCqO5aN0pdwRFMgKuBDQo66AeM6aLBa0vGGW0YjCqaVZj7Q2Eu0ik-Sxw5TrfKvTfGM8sVEbTZe9MR006lIyLNCME4pB0kaf5j-tBdyXHhQVNlwrxeN3bwa6ROhPkNAw8S5vQ-VkF914 Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: e16f62c8d73843a3b2380304f9af7ce5 Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-VolumesSnapshotTestJSON-392001947 Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e16f62c8d73843a3b2380304f9af7ce5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e16f62c8d73843a3b2380304f9af7ce5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e16f62c8d73843a3b2380304f9af7ce5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e16f62c8d73843a3b2380304f9af7ce5"}]}] Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-VolumesSnapshotTestJSON-392001947 Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: e16f62c8d73843a3b2380304f9af7ce5 Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-392001947 Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-VolumesSnapshotTestJSON-392001947-project Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 24ff743726c34c02a99feaa8abd09e41 Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-VolumesSnapshotTestJSON-392001947-project Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance cf2cba90-3c51-40f7-a160-8d68a39250c5 could not be found. Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'cf2cba90-3c51-40f7-a160-8d68a39250c5'} Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf2cba90-3c51-40f7-a160-8d68a39250c5 could not be found. Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf2cba90-3c51-40f7-a160-8d68a39250c5 could not be found. Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:13:48.001480 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:13:48.007948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:13:48.007948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:13:48.007948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:13:48.007948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:13:48.007948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:13:48.007948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf2cba90-3c51-40f7-a160-8d68a39250c5 could not be found. Aug 04 17:13:48.007948 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:13:48.011806 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-eb0a8319-3be6-49bc-90fe-f8a357a39d2d tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Returning 404 to user: Instance cf2cba90-3c51-40f7-a160-8d68a39250c5 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:13:48.013272 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-eb0a8319-3be6-49bc-90fe-f8a357a39d2d tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "GET /compute/v2.1/servers/cf2cba90-3c51-40f7-a160-8d68a39250c5" status: 404 len: 111 microversion: 2.1 time: 0.094696 Aug 04 17:13:48.035153 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2922/5722] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:47 2022] GET /compute/v2.1/servers/cf2cba90-3c51-40f7-a160-8d68a39250c5 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:13:48.096600 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6b031544-0511-4edb-8955-1783f8d6ec5b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:48.097175 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6b031544-0511-4edb-8955-1783f8d6ec5b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:48.121338 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6b031544-0511-4edb-8955-1783f8d6ec5b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:48.121338 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6b031544-0511-4edb-8955-1783f8d6ec5b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:48.121338 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6b031544-0511-4edb-8955-1783f8d6ec5b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:48.121338 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6b031544-0511-4edb-8955-1783f8d6ec5b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:48.353206 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6b031544-0511-4edb-8955-1783f8d6ec5b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:48.372234 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6b031544-0511-4edb-8955-1783f8d6ec5b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 200 len: 1279 microversion: 2.1 time: 0.279627 Aug 04 17:13:48.377308 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2801/5723] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:48 2022] GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 1279 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:49.404962 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ad388d51-602e-4f8a-94b0-d54b29da502c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:49.406651 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ad388d51-602e-4f8a-94b0-d54b29da502c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:49.449764 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad388d51-602e-4f8a-94b0-d54b29da502c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:49.458715 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad388d51-602e-4f8a-94b0-d54b29da502c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:49.459843 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad388d51-602e-4f8a-94b0-d54b29da502c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:49.462454 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad388d51-602e-4f8a-94b0-d54b29da502c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:49.761701 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ad388d51-602e-4f8a-94b0-d54b29da502c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:49.771386 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ad388d51-602e-4f8a-94b0-d54b29da502c tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 200 len: 1279 microversion: 2.1 time: 0.373085 Aug 04 17:13:49.789391 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2923/5724] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:49 2022] GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 1279 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:50.798092 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cbe4445c-8004-4c5f-9af0-1f453d18fce0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:50.799173 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cbe4445c-8004-4c5f-9af0-1f453d18fce0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:50.826526 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cbe4445c-8004-4c5f-9af0-1f453d18fce0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:50.827418 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cbe4445c-8004-4c5f-9af0-1f453d18fce0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:50.828761 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cbe4445c-8004-4c5f-9af0-1f453d18fce0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:50.834391 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cbe4445c-8004-4c5f-9af0-1f453d18fce0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:51.366994 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cbe4445c-8004-4c5f-9af0-1f453d18fce0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:51.388024 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cbe4445c-8004-4c5f-9af0-1f453d18fce0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 200 len: 1267 microversion: 2.1 time: 0.597583 Aug 04 17:13:51.393567 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2802/5725] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:50 2022] GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 1267 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:52.412291 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5f9df592-f974-473e-aae6-f7a0e39acf90 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:52.413575 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5f9df592-f974-473e-aae6-f7a0e39acf90 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:52.431952 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5f9df592-f974-473e-aae6-f7a0e39acf90 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:52.432853 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5f9df592-f974-473e-aae6-f7a0e39acf90 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:52.434031 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5f9df592-f974-473e-aae6-f7a0e39acf90 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:52.434634 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5f9df592-f974-473e-aae6-f7a0e39acf90 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:52.828094 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5f9df592-f974-473e-aae6-f7a0e39acf90 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:52.839921 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5f9df592-f974-473e-aae6-f7a0e39acf90 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 200 len: 1267 microversion: 2.1 time: 0.431342 Aug 04 17:13:52.841877 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2924/5726] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:52 2022] GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 1267 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:53.873208 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bbd1b5bb-cb43-49d1-98b1-5f162e428f11 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:53.877236 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bbd1b5bb-cb43-49d1-98b1-5f162e428f11 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:53.893397 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bbd1b5bb-cb43-49d1-98b1-5f162e428f11 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:53.894239 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bbd1b5bb-cb43-49d1-98b1-5f162e428f11 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:53.895418 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bbd1b5bb-cb43-49d1-98b1-5f162e428f11 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:53.896454 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bbd1b5bb-cb43-49d1-98b1-5f162e428f11 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:54.264167 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bbd1b5bb-cb43-49d1-98b1-5f162e428f11 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:54.275946 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bbd1b5bb-cb43-49d1-98b1-5f162e428f11 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 200 len: 1267 microversion: 2.1 time: 0.410861 Aug 04 17:13:54.276771 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2803/5727] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:53 2022] GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 1267 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:55.283618 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-619be220-0daf-4ad7-b17a-df828a12c8ae tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:55.286050 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-619be220-0daf-4ad7-b17a-df828a12c8ae tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:55.298688 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4b454f57-7b2f-4652-9958-aeea508f41b4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:55.301076 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4b454f57-7b2f-4652-9958-aeea508f41b4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:55.312918 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b454f57-7b2f-4652-9958-aeea508f41b4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:55.316464 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-619be220-0daf-4ad7-b17a-df828a12c8ae tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:55.317377 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b454f57-7b2f-4652-9958-aeea508f41b4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:55.318595 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b454f57-7b2f-4652-9958-aeea508f41b4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:55.319671 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4b454f57-7b2f-4652-9958-aeea508f41b4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:55.320329 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-619be220-0daf-4ad7-b17a-df828a12c8ae tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:55.322825 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-619be220-0daf-4ad7-b17a-df828a12c8ae tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:55.323707 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-619be220-0daf-4ad7-b17a-df828a12c8ae tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:55.427658 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-619be220-0daf-4ad7-b17a-df828a12c8ae tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "POST /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46/action" status: 200 len: 24582 microversion: 2.1 time: 0.146236 Aug 04 17:13:55.430024 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2925/5728] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:13:55 2022] POST /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46/action => generated 24582 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:13:55.929713 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4b454f57-7b2f-4652-9958-aeea508f41b4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:55.950054 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4b454f57-7b2f-4652-9958-aeea508f41b4 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 200 len: 1267 microversion: 2.1 time: 0.654851 Aug 04 17:13:55.967954 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2804/5729] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:55 2022] GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 1267 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:56.484129 n-d-846466-12 devstack@n-api.service[126126]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:13:56.484761 n-d-846466-12 devstack@n-api.service[126126]: Thu Aug 4 17:13:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 17:13:57.001077 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3dcee283-8c41-4cc3-a0a7-87fdb41505b0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:57.003581 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3dcee283-8c41-4cc3-a0a7-87fdb41505b0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:57.016005 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3dcee283-8c41-4cc3-a0a7-87fdb41505b0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:57.016746 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3dcee283-8c41-4cc3-a0a7-87fdb41505b0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:57.017762 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3dcee283-8c41-4cc3-a0a7-87fdb41505b0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:57.020648 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3dcee283-8c41-4cc3-a0a7-87fdb41505b0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:57.400097 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3dcee283-8c41-4cc3-a0a7-87fdb41505b0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:57.412486 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3dcee283-8c41-4cc3-a0a7-87fdb41505b0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 200 len: 1267 microversion: 2.1 time: 0.433806 Aug 04 17:13:57.413838 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2926/5730] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:56 2022] GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 1267 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:58.440960 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1e093c6d-02e1-4bf5-8211-7c464a9a308a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:58.442843 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1e093c6d-02e1-4bf5-8211-7c464a9a308a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:58.458100 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1e093c6d-02e1-4bf5-8211-7c464a9a308a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:58.462646 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1e093c6d-02e1-4bf5-8211-7c464a9a308a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:58.464355 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1e093c6d-02e1-4bf5-8211-7c464a9a308a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:13:58.469140 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1e093c6d-02e1-4bf5-8211-7c464a9a308a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:13:58.982434 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1e093c6d-02e1-4bf5-8211-7c464a9a308a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:59.005320 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1e093c6d-02e1-4bf5-8211-7c464a9a308a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 200 len: 1267 microversion: 2.1 time: 0.570230 Aug 04 17:13:59.022041 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2805/5731] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:58 2022] GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 1267 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:59.085728 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a549691d-7c3f-4932-a264-a95f61730d11 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-587968482", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "c94cc0a9-05f4-4bef-9c9c-721c00dd3892"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:59.184504 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-a549691d-7c3f-4932-a264-a95f61730d11 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] validate_networks() for [('c94cc0a9-05f4-4bef-9c9c-721c00dd3892', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:14:00.040804 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6c5d8ae1-f7cf-404c-a1cc-c2ebaccbadff tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:00.041500 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6c5d8ae1-f7cf-404c-a1cc-c2ebaccbadff tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:00.055734 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c5d8ae1-f7cf-404c-a1cc-c2ebaccbadff tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:00.062226 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c5d8ae1-f7cf-404c-a1cc-c2ebaccbadff tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:00.071290 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c5d8ae1-f7cf-404c-a1cc-c2ebaccbadff tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:00.071675 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c5d8ae1-f7cf-404c-a1cc-c2ebaccbadff tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:00.606960 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6c5d8ae1-f7cf-404c-a1cc-c2ebaccbadff tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:00.623389 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6c5d8ae1-f7cf-404c-a1cc-c2ebaccbadff tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 200 len: 1267 microversion: 2.1 time: 0.585435 Aug 04 17:14:00.627016 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2806/5732] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:00 2022] GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 1267 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:00.647457 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-24cdc556-c279-4cb1-88ff-6369f8ffce8e req-79080161-6ded-49ed-86b2-8b86df4acb88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ad652c1-0763-405a-8cf9-2560bab1df4c", "name": "network-vif-plugged", "status": "completed", "tag": "c22976c8-ed27-4b47-8acb-123754158502"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:00.664871 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-a549691d-7c3f-4932-a264-a95f61730d11 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:14:00.666704 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-a549691d-7c3f-4932-a264-a95f61730d11 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:14:00.667438 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-a549691d-7c3f-4932-a264-a95f61730d11 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:14:00.668534 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-a549691d-7c3f-4932-a264-a95f61730d11 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:14:00.669226 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-a549691d-7c3f-4932-a264-a95f61730d11 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:14:00.673846 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-24cdc556-c279-4cb1-88ff-6369f8ffce8e req-79080161-6ded-49ed-86b2-8b86df4acb88 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:00.674306 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-24cdc556-c279-4cb1-88ff-6369f8ffce8e req-79080161-6ded-49ed-86b2-8b86df4acb88 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:00.713691 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-24cdc556-c279-4cb1-88ff-6369f8ffce8e req-79080161-6ded-49ed-86b2-8b86df4acb88 service nova] Creating event network-vif-plugged:c22976c8-ed27-4b47-8acb-123754158502 for instance 0ad652c1-0763-405a-8cf9-2560bab1df4c on n-h2-846466-12 Aug 04 17:14:00.724955 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a549691d-7c3f-4932-a264-a95f61730d11 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:00.729710 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-24cdc556-c279-4cb1-88ff-6369f8ffce8e req-79080161-6ded-49ed-86b2-8b86df4acb88 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099969 Aug 04 17:14:00.730896 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2807/5733] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:14:00.750217 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a549691d-7c3f-4932-a264-a95f61730d11 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:00.752377 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a549691d-7c3f-4932-a264-a95f61730d11 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:00.752377 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a549691d-7c3f-4932-a264-a95f61730d11 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:00.867941 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-a549691d-7c3f-4932-a264-a95f61730d11 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Getting quotas for project e16f62c8d73843a3b2380304f9af7ce5. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:14:00.890931 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-a549691d-7c3f-4932-a264-a95f61730d11 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Getting quotas for user 24ff743726c34c02a99feaa8abd09e41 and project e16f62c8d73843a3b2380304f9af7ce5. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:14:00.917395 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a549691d-7c3f-4932-a264-a95f61730d11 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:14:00.922138 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a549691d-7c3f-4932-a264-a95f61730d11 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: ad92a901-e6d8-45d5-9c79-7705b3b9d44a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:14:00.988602 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a549691d-7c3f-4932-a264-a95f61730d11 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.907116 Aug 04 17:14:00.989624 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2927/5734] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:13:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 17:14:01.013553 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a7a1277d-7d9f-4a84-82b6-fd4493e0d6bc tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:01.014476 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a7a1277d-7d9f-4a84-82b6-fd4493e0d6bc tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: ad92a901-e6d8-45d5-9c79-7705b3b9d44a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:01.276177 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a7a1277d-7d9f-4a84-82b6-fd4493e0d6bc tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff743726c34c02a99feaa8abd09e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16f62c8d73843a3b2380304f9af7ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:01.284828 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a7a1277d-7d9f-4a84-82b6-fd4493e0d6bc tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "GET /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a" status: 200 len: 1218 microversion: 2.1 time: 0.287264 Aug 04 17:14:01.285340 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2808/5735] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:00 2022] GET /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a => generated 1218 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:01.648403 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-250dad38-b05f-43b7-9c7c-05cf84677e21 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:01.649391 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-250dad38-b05f-43b7-9c7c-05cf84677e21 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:01.672645 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-250dad38-b05f-43b7-9c7c-05cf84677e21 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:01.679366 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-250dad38-b05f-43b7-9c7c-05cf84677e21 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:01.680342 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-250dad38-b05f-43b7-9c7c-05cf84677e21 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:01.680800 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-250dad38-b05f-43b7-9c7c-05cf84677e21 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:02.034288 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-250dad38-b05f-43b7-9c7c-05cf84677e21 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:02.047516 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-250dad38-b05f-43b7-9c7c-05cf84677e21 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 200 len: 1267 microversion: 2.1 time: 0.403286 Aug 04 17:14:02.054346 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2928/5736] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:01 2022] GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 1267 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:02.318016 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5ce4a857-b29b-4e05-8c8c-3e0bf733ba94 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:02.319755 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5ce4a857-b29b-4e05-8c8c-3e0bf733ba94 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: ad92a901-e6d8-45d5-9c79-7705b3b9d44a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:02.343060 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ce4a857-b29b-4e05-8c8c-3e0bf733ba94 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:02.346250 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ce4a857-b29b-4e05-8c8c-3e0bf733ba94 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:02.350534 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ce4a857-b29b-4e05-8c8c-3e0bf733ba94 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:02.352301 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ce4a857-b29b-4e05-8c8c-3e0bf733ba94 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:02.479540 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5ce4a857-b29b-4e05-8c8c-3e0bf733ba94 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff743726c34c02a99feaa8abd09e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16f62c8d73843a3b2380304f9af7ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:02.490295 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5ce4a857-b29b-4e05-8c8c-3e0bf733ba94 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "GET /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a" status: 200 len: 1270 microversion: 2.1 time: 0.177821 Aug 04 17:14:02.490893 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2809/5737] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:02 2022] GET /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a => generated 1270 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:03.083618 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f9b1ae84-7338-4e16-a907-1b806bc0cb97 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:03.084247 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f9b1ae84-7338-4e16-a907-1b806bc0cb97 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:03.102633 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9b1ae84-7338-4e16-a907-1b806bc0cb97 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:03.110793 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9b1ae84-7338-4e16-a907-1b806bc0cb97 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:03.111932 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9b1ae84-7338-4e16-a907-1b806bc0cb97 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:03.112398 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9b1ae84-7338-4e16-a907-1b806bc0cb97 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:03.514913 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dc2f8e31-e4aa-4c50-b0ea-c63f2b1f37d2 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:03.516438 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-dc2f8e31-e4aa-4c50-b0ea-c63f2b1f37d2 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: ad92a901-e6d8-45d5-9c79-7705b3b9d44a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:03.528624 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dc2f8e31-e4aa-4c50-b0ea-c63f2b1f37d2 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:03.529612 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dc2f8e31-e4aa-4c50-b0ea-c63f2b1f37d2 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:03.530967 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dc2f8e31-e4aa-4c50-b0ea-c63f2b1f37d2 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:03.532753 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dc2f8e31-e4aa-4c50-b0ea-c63f2b1f37d2 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:03.693083 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-dc2f8e31-e4aa-4c50-b0ea-c63f2b1f37d2 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff743726c34c02a99feaa8abd09e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16f62c8d73843a3b2380304f9af7ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:03.716414 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dc2f8e31-e4aa-4c50-b0ea-c63f2b1f37d2 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "GET /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a" status: 200 len: 1276 microversion: 2.1 time: 0.208183 Aug 04 17:14:03.724250 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2810/5738] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:03 2022] GET /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a => generated 1276 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:03.753339 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f9b1ae84-7338-4e16-a907-1b806bc0cb97 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:03.767919 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f9b1ae84-7338-4e16-a907-1b806bc0cb97 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 200 len: 1453 microversion: 2.1 time: 0.688681 Aug 04 17:14:03.786156 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2929/5739] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:03 2022] GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 1453 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:03.803153 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-27ef5211-9c1d-48d9-beb2-f25cbe82c35b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:03.804082 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-27ef5211-9c1d-48d9-beb2-f25cbe82c35b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:03.817187 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-27ef5211-9c1d-48d9-beb2-f25cbe82c35b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:03.817560 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-27ef5211-9c1d-48d9-beb2-f25cbe82c35b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:03.818559 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-27ef5211-9c1d-48d9-beb2-f25cbe82c35b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:03.818731 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-27ef5211-9c1d-48d9-beb2-f25cbe82c35b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:04.230787 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-27ef5211-9c1d-48d9-beb2-f25cbe82c35b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:04.252579 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-27ef5211-9c1d-48d9-beb2-f25cbe82c35b tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 200 len: 1453 microversion: 2.1 time: 0.455459 Aug 04 17:14:04.254031 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2811/5740] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:03 2022] GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 1453 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:04.749307 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2f19ea90-7e89-494e-9ef6-d422d5c34d32 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:04.749307 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2f19ea90-7e89-494e-9ef6-d422d5c34d32 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: ad92a901-e6d8-45d5-9c79-7705b3b9d44a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:04.778389 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2f19ea90-7e89-494e-9ef6-d422d5c34d32 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:04.785351 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2f19ea90-7e89-494e-9ef6-d422d5c34d32 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:04.788289 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2f19ea90-7e89-494e-9ef6-d422d5c34d32 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:04.788871 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2f19ea90-7e89-494e-9ef6-d422d5c34d32 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:04.936409 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2f19ea90-7e89-494e-9ef6-d422d5c34d32 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff743726c34c02a99feaa8abd09e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16f62c8d73843a3b2380304f9af7ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:04.945049 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2f19ea90-7e89-494e-9ef6-d422d5c34d32 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "GET /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a" status: 200 len: 1276 microversion: 2.1 time: 0.203283 Aug 04 17:14:04.947244 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2930/5741] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:04 2022] GET /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a => generated 1276 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:05.977706 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-60c1b1aa-1031-46d1-ba27-334aff928ecb tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:05.978334 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-60c1b1aa-1031-46d1-ba27-334aff928ecb tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: ad92a901-e6d8-45d5-9c79-7705b3b9d44a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:06.001843 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-60c1b1aa-1031-46d1-ba27-334aff928ecb tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:06.004510 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-60c1b1aa-1031-46d1-ba27-334aff928ecb tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:06.006985 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-60c1b1aa-1031-46d1-ba27-334aff928ecb tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:06.007724 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-60c1b1aa-1031-46d1-ba27-334aff928ecb tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:06.446397 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-60c1b1aa-1031-46d1-ba27-334aff928ecb tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff743726c34c02a99feaa8abd09e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16f62c8d73843a3b2380304f9af7ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:06.455455 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-60c1b1aa-1031-46d1-ba27-334aff928ecb tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "GET /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a" status: 200 len: 1318 microversion: 2.1 time: 0.491904 Aug 04 17:14:06.459891 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2812/5742] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:05 2022] GET /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a => generated 1318 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:06.515058 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bc1434f9-7193-4fe3-8ddd-28318aa0665d tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:06.515669 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bc1434f9-7193-4fe3-8ddd-28318aa0665d tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:06.533113 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bc1434f9-7193-4fe3-8ddd-28318aa0665d tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:06.539429 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bc1434f9-7193-4fe3-8ddd-28318aa0665d tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:06.540559 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bc1434f9-7193-4fe3-8ddd-28318aa0665d tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:06.541165 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bc1434f9-7193-4fe3-8ddd-28318aa0665d tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:07.271063 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-714e1781-9cae-4468-8987-64ef99ab16fc req-1f2fb2d7-d71d-450e-994b-8e3681c860f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ad652c1-0763-405a-8cf9-2560bab1df4c", "tag": "c22976c8-ed27-4b47-8acb-123754158502"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:07.287451 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-714e1781-9cae-4468-8987-64ef99ab16fc req-1f2fb2d7-d71d-450e-994b-8e3681c860f5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:07.288341 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-714e1781-9cae-4468-8987-64ef99ab16fc req-1f2fb2d7-d71d-450e-994b-8e3681c860f5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:07.304745 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-714e1781-9cae-4468-8987-64ef99ab16fc req-1f2fb2d7-d71d-450e-994b-8e3681c860f5 service nova] Creating event network-changed:c22976c8-ed27-4b47-8acb-123754158502 for instance 0ad652c1-0763-405a-8cf9-2560bab1df4c on n-h2-846466-12 Aug 04 17:14:07.312300 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-714e1781-9cae-4468-8987-64ef99ab16fc req-1f2fb2d7-d71d-450e-994b-8e3681c860f5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046030 Aug 04 17:14:07.314405 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2813/5743] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:14:07.507014 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6ac733ec-dfba-4346-a04d-0daa1a1a4a27 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:07.507786 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6ac733ec-dfba-4346-a04d-0daa1a1a4a27 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: ad92a901-e6d8-45d5-9c79-7705b3b9d44a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:07.566859 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bc1434f9-7193-4fe3-8ddd-28318aa0665d tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1833 microversion: 2.1 time: 1.034503 Aug 04 17:14:07.578180 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2931/5744] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:06 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1833 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:07.583800 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6ac733ec-dfba-4346-a04d-0daa1a1a4a27 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:07.583800 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6ac733ec-dfba-4346-a04d-0daa1a1a4a27 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:07.583800 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6ac733ec-dfba-4346-a04d-0daa1a1a4a27 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:07.583800 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6ac733ec-dfba-4346-a04d-0daa1a1a4a27 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:07.590037 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5117068a-02c3-43b3-9406-780c0962c6ad tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:07.590858 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5117068a-02c3-43b3-9406-780c0962c6ad tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:07.613767 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5117068a-02c3-43b3-9406-780c0962c6ad tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:07.614295 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5117068a-02c3-43b3-9406-780c0962c6ad tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:07.615120 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5117068a-02c3-43b3-9406-780c0962c6ad tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:07.615559 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5117068a-02c3-43b3-9406-780c0962c6ad tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:08.076338 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5117068a-02c3-43b3-9406-780c0962c6ad tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:08.087049 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5117068a-02c3-43b3-9406-780c0962c6ad tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1680 microversion: 2.1 time: 0.501675 Aug 04 17:14:08.099171 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2932/5745] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:07 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1680 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:14:08.131829 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6ac733ec-dfba-4346-a04d-0daa1a1a4a27 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff743726c34c02a99feaa8abd09e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16f62c8d73843a3b2380304f9af7ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:08.139787 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6ac733ec-dfba-4346-a04d-0daa1a1a4a27 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "GET /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a" status: 200 len: 1318 microversion: 2.1 time: 0.654068 Aug 04 17:14:08.141274 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2814/5746] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:07 2022] GET /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a => generated 1318 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:08.341944 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-211591a5-2e14-42b3-9405-623ba2c35f88 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:08.344900 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-211591a5-2e14-42b3-9405-623ba2c35f88 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:08.372848 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-211591a5-2e14-42b3-9405-623ba2c35f88 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:08.373377 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-211591a5-2e14-42b3-9405-623ba2c35f88 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:08.378116 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-211591a5-2e14-42b3-9405-623ba2c35f88 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:08.379002 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-211591a5-2e14-42b3-9405-623ba2c35f88 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:08.505527 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-e601ef1f-56d3-4488-adac-fca8e11adddd req-ee4e8eb3-d0ec-42e8-a01f-eae17ed8f260 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad92a901-e6d8-45d5-9c79-7705b3b9d44a", "tag": "a04d3f5a-56dd-409c-ba1d-2fbc107e00aa"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:08.519922 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-211591a5-2e14-42b3-9405-623ba2c35f88 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "POST /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46/action" status: 200 len: 32645 microversion: 2.1 time: 0.185096 Aug 04 17:14:08.521354 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2933/5747] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:14:08 2022] POST /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46/action => generated 32645 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:14:08.544439 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-e601ef1f-56d3-4488-adac-fca8e11adddd req-ee4e8eb3-d0ec-42e8-a01f-eae17ed8f260 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:08.546476 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-e601ef1f-56d3-4488-adac-fca8e11adddd req-ee4e8eb3-d0ec-42e8-a01f-eae17ed8f260 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:08.594884 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-e601ef1f-56d3-4488-adac-fca8e11adddd req-ee4e8eb3-d0ec-42e8-a01f-eae17ed8f260 service nova] Creating event network-changed:a04d3f5a-56dd-409c-ba1d-2fbc107e00aa for instance ad92a901-e6d8-45d5-9c79-7705b3b9d44a on n-h1-846466-12 Aug 04 17:14:08.615520 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-e601ef1f-56d3-4488-adac-fca8e11adddd req-ee4e8eb3-d0ec-42e8-a01f-eae17ed8f260 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115629 Aug 04 17:14:08.619125 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2815/5748] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:14:08.728788 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-658c54bf-e50e-4caa-8ef1-f9da7097fd4b tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:08.729465 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-658c54bf-e50e-4caa-8ef1-f9da7097fd4b tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:08.758074 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-658c54bf-e50e-4caa-8ef1-f9da7097fd4b tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:08.758555 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-658c54bf-e50e-4caa-8ef1-f9da7097fd4b tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:08.759357 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-658c54bf-e50e-4caa-8ef1-f9da7097fd4b tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:08.759795 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-658c54bf-e50e-4caa-8ef1-f9da7097fd4b tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:09.002522 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-658c54bf-e50e-4caa-8ef1-f9da7097fd4b tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'fdebc383c01f485cb4bfa2a58b2271ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d1171d8d014eb68ece66e1906b7d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:09.003348 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-658c54bf-e50e-4caa-8ef1-f9da7097fd4b tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] flavor_id is None. Assuming migration. {{(pid=126125) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 04 17:14:09.004313 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-658c54bf-e50e-4caa-8ef1-f9da7097fd4b tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=126125) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 17:14:09.011237 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:09.172396 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a744c9b3-2592-4771-b03c-8e8270afeeb6 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:09.173389 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a744c9b3-2592-4771-b03c-8e8270afeeb6 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: ad92a901-e6d8-45d5-9c79-7705b3b9d44a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:09.187356 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a744c9b3-2592-4771-b03c-8e8270afeeb6 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:09.194660 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a744c9b3-2592-4771-b03c-8e8270afeeb6 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:09.195851 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a744c9b3-2592-4771-b03c-8e8270afeeb6 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:09.196952 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a744c9b3-2592-4771-b03c-8e8270afeeb6 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:09.281092 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=100 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:09.601020 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a744c9b3-2592-4771-b03c-8e8270afeeb6 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff743726c34c02a99feaa8abd09e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16f62c8d73843a3b2380304f9af7ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:09.617969 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a744c9b3-2592-4771-b03c-8e8270afeeb6 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "GET /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a" status: 200 len: 1318 microversion: 2.1 time: 0.457472 Aug 04 17:14:09.632375 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2816/5749] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:09 2022] GET /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a => generated 1318 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:14:09.817719 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-658c54bf-e50e-4caa-8ef1-f9da7097fd4b tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46/action" status: 202 len: 0 microversion: 2.1 time: 1.094715 Aug 04 17:14:09.824150 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2934/5750] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:14:08 2022] POST /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46/action => generated 0 bytes in 1102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:14:09.833174 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-83fec996-ea8f-4883-bd69-ed5ef4180cb7 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:09.833542 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-83fec996-ea8f-4883-bd69-ed5ef4180cb7 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:09.845596 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-83fec996-ea8f-4883-bd69-ed5ef4180cb7 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:09.846595 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-83fec996-ea8f-4883-bd69-ed5ef4180cb7 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:09.847838 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-83fec996-ea8f-4883-bd69-ed5ef4180cb7 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:09.848726 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-83fec996-ea8f-4883-bd69-ed5ef4180cb7 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:10.152096 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-83fec996-ea8f-4883-bd69-ed5ef4180cb7 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:10.168068 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-83fec996-ea8f-4883-bd69-ed5ef4180cb7 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1689 microversion: 2.1 time: 0.339125 Aug 04 17:14:10.169052 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2817/5751] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:09 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1689 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:10.649823 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-13a06c69-b19c-4245-ac2e-860622b4a350 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:10.650743 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-13a06c69-b19c-4245-ac2e-860622b4a350 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: ad92a901-e6d8-45d5-9c79-7705b3b9d44a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:10.666915 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-13a06c69-b19c-4245-ac2e-860622b4a350 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:10.667833 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-13a06c69-b19c-4245-ac2e-860622b4a350 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:10.668873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-13a06c69-b19c-4245-ac2e-860622b4a350 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:10.672832 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-13a06c69-b19c-4245-ac2e-860622b4a350 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:10.840596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:10.909130 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:11.132170 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-13a06c69-b19c-4245-ac2e-860622b4a350 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff743726c34c02a99feaa8abd09e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16f62c8d73843a3b2380304f9af7ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:11.146818 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-13a06c69-b19c-4245-ac2e-860622b4a350 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "GET /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a" status: 200 len: 1318 microversion: 2.1 time: 0.500023 Aug 04 17:14:11.149757 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2935/5752] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:10 2022] GET /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a => generated 1318 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:11.195374 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a8d9efde-bdf1-484e-942e-7f5c05d4133d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:11.197068 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a8d9efde-bdf1-484e-942e-7f5c05d4133d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:11.206913 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a8d9efde-bdf1-484e-942e-7f5c05d4133d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:11.207627 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a8d9efde-bdf1-484e-942e-7f5c05d4133d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:11.208680 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a8d9efde-bdf1-484e-942e-7f5c05d4133d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:11.209324 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a8d9efde-bdf1-484e-942e-7f5c05d4133d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:11.281192 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:11.550698 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a8d9efde-bdf1-484e-942e-7f5c05d4133d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:11.617540 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a8d9efde-bdf1-484e-942e-7f5c05d4133d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1689 microversion: 2.1 time: 0.421724 Aug 04 17:14:11.618879 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2818/5753] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:11 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1689 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:12.174016 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dda5c9c3-f566-439e-bb50-9e8e580b903a tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:12.174765 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dda5c9c3-f566-439e-bb50-9e8e580b903a tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: ad92a901-e6d8-45d5-9c79-7705b3b9d44a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:12.201387 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dda5c9c3-f566-439e-bb50-9e8e580b903a tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:12.201840 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dda5c9c3-f566-439e-bb50-9e8e580b903a tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:12.202636 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dda5c9c3-f566-439e-bb50-9e8e580b903a tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:12.206942 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dda5c9c3-f566-439e-bb50-9e8e580b903a tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:12.553152 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dda5c9c3-f566-439e-bb50-9e8e580b903a tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff743726c34c02a99feaa8abd09e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16f62c8d73843a3b2380304f9af7ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:12.574330 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dda5c9c3-f566-439e-bb50-9e8e580b903a tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "GET /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a" status: 200 len: 1318 microversion: 2.1 time: 0.403199 Aug 04 17:14:12.595425 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2936/5754] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:12 2022] GET /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a => generated 1318 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:14:12.640298 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-019a82ba-171e-42f9-a076-b65dd1bb7c85 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:12.643260 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-019a82ba-171e-42f9-a076-b65dd1bb7c85 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:12.658275 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=48 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:12.660641 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-019a82ba-171e-42f9-a076-b65dd1bb7c85 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:12.661208 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-019a82ba-171e-42f9-a076-b65dd1bb7c85 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:12.662390 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-019a82ba-171e-42f9-a076-b65dd1bb7c85 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:12.663075 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-019a82ba-171e-42f9-a076-b65dd1bb7c85 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:13.203175 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-019a82ba-171e-42f9-a076-b65dd1bb7c85 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:13.226673 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-019a82ba-171e-42f9-a076-b65dd1bb7c85 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1689 microversion: 2.1 time: 0.591057 Aug 04 17:14:13.228500 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2819/5755] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:12 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1689 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:13.610112 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-901e5457-938b-4501-ad98-4af922c4e0e5 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:13.613328 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-901e5457-938b-4501-ad98-4af922c4e0e5 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: ad92a901-e6d8-45d5-9c79-7705b3b9d44a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:13.628399 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:13.637719 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-901e5457-938b-4501-ad98-4af922c4e0e5 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:13.638710 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-901e5457-938b-4501-ad98-4af922c4e0e5 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:13.640617 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-901e5457-938b-4501-ad98-4af922c4e0e5 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:13.643643 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-901e5457-938b-4501-ad98-4af922c4e0e5 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:14.072402 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-901e5457-938b-4501-ad98-4af922c4e0e5 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff743726c34c02a99feaa8abd09e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16f62c8d73843a3b2380304f9af7ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:14.091205 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-901e5457-938b-4501-ad98-4af922c4e0e5 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "GET /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a" status: 200 len: 1318 microversion: 2.1 time: 0.486560 Aug 04 17:14:14.107121 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2937/5756] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:13 2022] GET /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a => generated 1318 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:14.130419 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-07299f8a-fb2b-4ca1-a896-7ccf3e9ea0f6 req-2e2eefa1-27be-44c2-af56-02faee9f72f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad92a901-e6d8-45d5-9c79-7705b3b9d44a", "name": "network-vif-plugged", "status": "completed", "tag": "a04d3f5a-56dd-409c-ba1d-2fbc107e00aa"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:14.154671 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-07299f8a-fb2b-4ca1-a896-7ccf3e9ea0f6 req-2e2eefa1-27be-44c2-af56-02faee9f72f4 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:14.155128 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-07299f8a-fb2b-4ca1-a896-7ccf3e9ea0f6 req-2e2eefa1-27be-44c2-af56-02faee9f72f4 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:14.181977 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-07299f8a-fb2b-4ca1-a896-7ccf3e9ea0f6 req-2e2eefa1-27be-44c2-af56-02faee9f72f4 service nova] Creating event network-vif-plugged:a04d3f5a-56dd-409c-ba1d-2fbc107e00aa for instance ad92a901-e6d8-45d5-9c79-7705b3b9d44a on n-h1-846466-12 Aug 04 17:14:14.188256 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-07299f8a-fb2b-4ca1-a896-7ccf3e9ea0f6 req-2e2eefa1-27be-44c2-af56-02faee9f72f4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062376 Aug 04 17:14:14.190513 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2820/5757] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:14:14.271980 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e3939261-37ad-4ec1-8430-704439edc842 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:14.272652 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e3939261-37ad-4ec1-8430-704439edc842 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:14.290861 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3939261-37ad-4ec1-8430-704439edc842 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:14.291347 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3939261-37ad-4ec1-8430-704439edc842 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:14.292221 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3939261-37ad-4ec1-8430-704439edc842 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:14.292667 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3939261-37ad-4ec1-8430-704439edc842 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:14.678931 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e3939261-37ad-4ec1-8430-704439edc842 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:14.688346 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e3939261-37ad-4ec1-8430-704439edc842 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1689 microversion: 2.1 time: 0.436464 Aug 04 17:14:14.702545 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2938/5758] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:14 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1689 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:15.116440 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5c7884cb-4f53-40ea-8fe5-c1829005e888 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:15.117435 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5c7884cb-4f53-40ea-8fe5-c1829005e888 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: ad92a901-e6d8-45d5-9c79-7705b3b9d44a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:15.130274 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5c7884cb-4f53-40ea-8fe5-c1829005e888 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:15.130987 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5c7884cb-4f53-40ea-8fe5-c1829005e888 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:15.133458 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5c7884cb-4f53-40ea-8fe5-c1829005e888 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:15.137375 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5c7884cb-4f53-40ea-8fe5-c1829005e888 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:15.457784 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5c7884cb-4f53-40ea-8fe5-c1829005e888 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff743726c34c02a99feaa8abd09e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16f62c8d73843a3b2380304f9af7ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:15.471204 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5c7884cb-4f53-40ea-8fe5-c1829005e888 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "GET /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a" status: 200 len: 1318 microversion: 2.1 time: 0.358896 Aug 04 17:14:15.472478 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2821/5759] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:15 2022] GET /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:14:15.711626 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bd489e0d-8c9c-449d-9a26-7b7beb21b9f1 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:15.713106 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bd489e0d-8c9c-449d-9a26-7b7beb21b9f1 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:15.731260 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bd489e0d-8c9c-449d-9a26-7b7beb21b9f1 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:15.731955 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bd489e0d-8c9c-449d-9a26-7b7beb21b9f1 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:15.735272 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bd489e0d-8c9c-449d-9a26-7b7beb21b9f1 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:15.736805 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bd489e0d-8c9c-449d-9a26-7b7beb21b9f1 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:15.931550 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bd489e0d-8c9c-449d-9a26-7b7beb21b9f1 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:15.946022 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bd489e0d-8c9c-449d-9a26-7b7beb21b9f1 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1694 microversion: 2.1 time: 0.238329 Aug 04 17:14:15.948113 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2939/5760] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:15 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1694 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:16.492266 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-81790cc1-cb02-42bc-a5ed-430b7af89e74 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:16.493772 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-81790cc1-cb02-42bc-a5ed-430b7af89e74 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: ad92a901-e6d8-45d5-9c79-7705b3b9d44a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:16.508492 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-81790cc1-cb02-42bc-a5ed-430b7af89e74 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:16.509185 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-81790cc1-cb02-42bc-a5ed-430b7af89e74 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:16.510490 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-81790cc1-cb02-42bc-a5ed-430b7af89e74 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:16.513008 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-81790cc1-cb02-42bc-a5ed-430b7af89e74 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:16.859775 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-81790cc1-cb02-42bc-a5ed-430b7af89e74 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff743726c34c02a99feaa8abd09e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16f62c8d73843a3b2380304f9af7ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:16.870493 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-81790cc1-cb02-42bc-a5ed-430b7af89e74 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "GET /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a" status: 200 len: 1506 microversion: 2.1 time: 0.382146 Aug 04 17:14:16.873348 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2822/5761] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:16 2022] GET /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a => generated 1506 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:16.894831 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a98162c4-ba88-43b8-91d3-e595e6a16d17 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84aa70f9-c663-4392-8812-e956a3893deb", "device": "/dev/sdb"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:16.898096 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a98162c4-ba88-43b8-91d3-e595e6a16d17 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: ad92a901-e6d8-45d5-9c79-7705b3b9d44a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:16.908073 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a98162c4-ba88-43b8-91d3-e595e6a16d17 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:16.908808 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a98162c4-ba88-43b8-91d3-e595e6a16d17 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:16.909886 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a98162c4-ba88-43b8-91d3-e595e6a16d17 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:16.910545 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a98162c4-ba88-43b8-91d3-e595e6a16d17 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:16.970152 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1fa65b25-f356-4621-93c4-0e0aa3aca5a6 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:16.970993 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1fa65b25-f356-4621-93c4-0e0aa3aca5a6 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:16.984940 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1fa65b25-f356-4621-93c4-0e0aa3aca5a6 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:16.985652 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1fa65b25-f356-4621-93c4-0e0aa3aca5a6 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:16.989036 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1fa65b25-f356-4621-93c4-0e0aa3aca5a6 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:16.990004 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1fa65b25-f356-4621-93c4-0e0aa3aca5a6 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:17.347682 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a98162c4-ba88-43b8-91d3-e595e6a16d17 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "POST /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.456495 Aug 04 17:14:17.359161 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2940/5762] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Aug 4 17:14:16 2022] POST /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a/os-volume_attachments => generated 194 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:14:17.423948 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1fa65b25-f356-4621-93c4-0e0aa3aca5a6 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:17.434905 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1fa65b25-f356-4621-93c4-0e0aa3aca5a6 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1694 microversion: 2.1 time: 0.468378 Aug 04 17:14:17.436655 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2823/5763] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:16 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1694 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:14:18.456723 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ffdb9e56-c1a7-4916-92ba-8d67541c812e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:18.458119 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ffdb9e56-c1a7-4916-92ba-8d67541c812e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:18.475022 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ffdb9e56-c1a7-4916-92ba-8d67541c812e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:18.482043 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ffdb9e56-c1a7-4916-92ba-8d67541c812e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:18.483193 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ffdb9e56-c1a7-4916-92ba-8d67541c812e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:18.483813 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ffdb9e56-c1a7-4916-92ba-8d67541c812e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:18.965963 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ffdb9e56-c1a7-4916-92ba-8d67541c812e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:18.981639 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ffdb9e56-c1a7-4916-92ba-8d67541c812e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1694 microversion: 2.1 time: 0.528960 Aug 04 17:14:18.982791 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2941/5764] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:18 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1694 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:20.005830 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e597788a-90a5-4a19-9b0b-e25d10264246 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:20.006935 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e597788a-90a5-4a19-9b0b-e25d10264246 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:20.030374 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e597788a-90a5-4a19-9b0b-e25d10264246 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:20.031417 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e597788a-90a5-4a19-9b0b-e25d10264246 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:20.032725 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e597788a-90a5-4a19-9b0b-e25d10264246 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:20.033474 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e597788a-90a5-4a19-9b0b-e25d10264246 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:20.254521 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e597788a-90a5-4a19-9b0b-e25d10264246 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:20.273491 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e597788a-90a5-4a19-9b0b-e25d10264246 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1694 microversion: 2.1 time: 0.274282 Aug 04 17:14:20.276145 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2824/5765] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:19 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1694 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:21.297630 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-565993d4-d2fe-41c2-9256-21b1c5d30099 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:21.298252 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-565993d4-d2fe-41c2-9256-21b1c5d30099 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:21.309226 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-565993d4-d2fe-41c2-9256-21b1c5d30099 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:21.309709 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-565993d4-d2fe-41c2-9256-21b1c5d30099 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:21.310503 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-565993d4-d2fe-41c2-9256-21b1c5d30099 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:21.310942 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-565993d4-d2fe-41c2-9256-21b1c5d30099 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:21.872752 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-565993d4-d2fe-41c2-9256-21b1c5d30099 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:21.882479 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-565993d4-d2fe-41c2-9256-21b1c5d30099 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1694 microversion: 2.1 time: 0.588846 Aug 04 17:14:21.886582 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2942/5766] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:21 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1694 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:22.931731 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b4049aeb-1fdd-4da3-ac3e-224802590986 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:22.931731 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b4049aeb-1fdd-4da3-ac3e-224802590986 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:23.042074 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b4049aeb-1fdd-4da3-ac3e-224802590986 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:23.042074 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b4049aeb-1fdd-4da3-ac3e-224802590986 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:23.042074 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b4049aeb-1fdd-4da3-ac3e-224802590986 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:23.042074 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b4049aeb-1fdd-4da3-ac3e-224802590986 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:23.557482 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b4049aeb-1fdd-4da3-ac3e-224802590986 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:23.570190 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b4049aeb-1fdd-4da3-ac3e-224802590986 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1694 microversion: 2.1 time: 0.662841 Aug 04 17:14:23.570823 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2825/5767] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:22 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1694 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:24.597373 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b92f42c9-66e2-446b-9257-9ab1d61c593d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:24.601439 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b92f42c9-66e2-446b-9257-9ab1d61c593d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:24.616154 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b92f42c9-66e2-446b-9257-9ab1d61c593d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:24.616592 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b92f42c9-66e2-446b-9257-9ab1d61c593d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:24.622177 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b92f42c9-66e2-446b-9257-9ab1d61c593d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:24.622687 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b92f42c9-66e2-446b-9257-9ab1d61c593d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:24.865653 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b92f42c9-66e2-446b-9257-9ab1d61c593d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:24.892486 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b92f42c9-66e2-446b-9257-9ab1d61c593d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1694 microversion: 2.1 time: 0.300610 Aug 04 17:14:24.894330 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2943/5768] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:24 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1694 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:25.917553 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7098c248-a447-4bf0-957d-a4d1916a2c25 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:25.918109 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7098c248-a447-4bf0-957d-a4d1916a2c25 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:25.934888 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7098c248-a447-4bf0-957d-a4d1916a2c25 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:25.935347 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7098c248-a447-4bf0-957d-a4d1916a2c25 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:25.936145 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7098c248-a447-4bf0-957d-a4d1916a2c25 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:25.936604 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7098c248-a447-4bf0-957d-a4d1916a2c25 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:26.641561 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7098c248-a447-4bf0-957d-a4d1916a2c25 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:26.651394 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7098c248-a447-4bf0-957d-a4d1916a2c25 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1694 microversion: 2.1 time: 0.739661 Aug 04 17:14:26.653206 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2826/5769] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:25 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1694 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:27.677910 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-002f2d86-43de-4655-a5e7-c474699b221d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:27.678966 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-002f2d86-43de-4655-a5e7-c474699b221d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:27.688017 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-002f2d86-43de-4655-a5e7-c474699b221d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:27.688933 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-002f2d86-43de-4655-a5e7-c474699b221d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:27.690725 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-002f2d86-43de-4655-a5e7-c474699b221d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:27.691343 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-002f2d86-43de-4655-a5e7-c474699b221d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:28.060965 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-002f2d86-43de-4655-a5e7-c474699b221d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:28.093327 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-002f2d86-43de-4655-a5e7-c474699b221d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1694 microversion: 2.1 time: 0.420884 Aug 04 17:14:28.105217 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2944/5770] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:27 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1694 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:29.122959 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b1144d2c-5d7b-4eb4-b87b-d5620b8fe216 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:29.123630 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b1144d2c-5d7b-4eb4-b87b-d5620b8fe216 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:29.142244 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b1144d2c-5d7b-4eb4-b87b-d5620b8fe216 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:29.143013 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b1144d2c-5d7b-4eb4-b87b-d5620b8fe216 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:29.144270 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b1144d2c-5d7b-4eb4-b87b-d5620b8fe216 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:29.144731 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b1144d2c-5d7b-4eb4-b87b-d5620b8fe216 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:29.313948 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-0a3920e9-74b2-43e3-b3c7-f3096290904e req-17bb1c64-b616-4a9b-8acf-ad072c125634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55605b02-eb78-41d9-a397-c58a3997fc46", "name": "network-vif-unplugged", "status": "completed", "tag": "8b156186-1d42-470c-9334-6468b498cd22"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:29.336367 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-0a3920e9-74b2-43e3-b3c7-f3096290904e req-17bb1c64-b616-4a9b-8acf-ad072c125634 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:29.341907 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-0a3920e9-74b2-43e3-b3c7-f3096290904e req-17bb1c64-b616-4a9b-8acf-ad072c125634 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:29.376106 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-0a3920e9-74b2-43e3-b3c7-f3096290904e req-17bb1c64-b616-4a9b-8acf-ad072c125634 service nova] Creating event network-vif-unplugged:8b156186-1d42-470c-9334-6468b498cd22 for instance 55605b02-eb78-41d9-a397-c58a3997fc46 on n-h2-846466-12 Aug 04 17:14:29.405593 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [req-0a3920e9-74b2-43e3-b3c7-f3096290904e req-17bb1c64-b616-4a9b-8acf-ad072c125634 service nova] Instance 55605b02-eb78-41d9-a397-c58a3997fc46 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:14:29.427617 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-0a3920e9-74b2-43e3-b3c7-f3096290904e req-17bb1c64-b616-4a9b-8acf-ad072c125634 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117910 Aug 04 17:14:29.429338 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2945/5771] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:14:29.917500 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b1144d2c-5d7b-4eb4-b87b-d5620b8fe216 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:29.926068 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b1144d2c-5d7b-4eb4-b87b-d5620b8fe216 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1693 microversion: 2.1 time: 0.810495 Aug 04 17:14:29.927665 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2827/5772] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:29 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1693 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:30.954878 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0a9ad25d-b54b-41a4-97a1-26e19e153c17 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:30.955591 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0a9ad25d-b54b-41a4-97a1-26e19e153c17 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:30.980196 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0a9ad25d-b54b-41a4-97a1-26e19e153c17 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:30.980730 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0a9ad25d-b54b-41a4-97a1-26e19e153c17 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:30.987941 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0a9ad25d-b54b-41a4-97a1-26e19e153c17 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:30.988421 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0a9ad25d-b54b-41a4-97a1-26e19e153c17 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:31.474313 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-57c91940-9568-4199-86ad-e4cc346a3899 req-f7e94144-8603-4c9c-a751-eeb3d364e495 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55605b02-eb78-41d9-a397-c58a3997fc46", "tag": "8b156186-1d42-470c-9334-6468b498cd22"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:31.492172 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-57c91940-9568-4199-86ad-e4cc346a3899 req-f7e94144-8603-4c9c-a751-eeb3d364e495 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:31.492957 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-57c91940-9568-4199-86ad-e4cc346a3899 req-f7e94144-8603-4c9c-a751-eeb3d364e495 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:31.538754 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-57c91940-9568-4199-86ad-e4cc346a3899 req-f7e94144-8603-4c9c-a751-eeb3d364e495 service nova] Creating event network-changed:8b156186-1d42-470c-9334-6468b498cd22 for instance 55605b02-eb78-41d9-a397-c58a3997fc46 on n-h2-846466-12 Aug 04 17:14:31.551564 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [req-57c91940-9568-4199-86ad-e4cc346a3899 req-f7e94144-8603-4c9c-a751-eeb3d364e495 service nova] Instance 55605b02-eb78-41d9-a397-c58a3997fc46 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126126) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:14:31.564242 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-57c91940-9568-4199-86ad-e4cc346a3899 req-f7e94144-8603-4c9c-a751-eeb3d364e495 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094260 Aug 04 17:14:31.565530 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2828/5773] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:14:32.070920 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0a9ad25d-b54b-41a4-97a1-26e19e153c17 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:32.082832 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0a9ad25d-b54b-41a4-97a1-26e19e153c17 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1693 microversion: 2.1 time: 1.137421 Aug 04 17:14:32.084111 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2946/5774] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:30 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1693 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:33.106501 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cc41583f-ebbc-4984-a4d5-4786f0a775ef tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:33.107995 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cc41583f-ebbc-4984-a4d5-4786f0a775ef tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:33.131319 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cc41583f-ebbc-4984-a4d5-4786f0a775ef tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:33.140754 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cc41583f-ebbc-4984-a4d5-4786f0a775ef tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:33.141841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cc41583f-ebbc-4984-a4d5-4786f0a775ef tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:33.142428 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cc41583f-ebbc-4984-a4d5-4786f0a775ef tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:34.596299 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cc41583f-ebbc-4984-a4d5-4786f0a775ef tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:34.621885 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cc41583f-ebbc-4984-a4d5-4786f0a775ef tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1691 microversion: 2.1 time: 1.521113 Aug 04 17:14:34.636213 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2829/5775] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:33 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1691 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:35.647354 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6481ed74-0da8-42d1-b5e4-64179b731a63 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:35.648575 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6481ed74-0da8-42d1-b5e4-64179b731a63 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:35.662152 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6481ed74-0da8-42d1-b5e4-64179b731a63 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:35.666393 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6481ed74-0da8-42d1-b5e4-64179b731a63 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:35.667786 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6481ed74-0da8-42d1-b5e4-64179b731a63 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:35.673743 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6481ed74-0da8-42d1-b5e4-64179b731a63 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:36.123608 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6481ed74-0da8-42d1-b5e4-64179b731a63 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:36.131961 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6481ed74-0da8-42d1-b5e4-64179b731a63 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1688 microversion: 2.1 time: 0.488486 Aug 04 17:14:36.135547 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2947/5776] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:35 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1688 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:36.156934 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-39ca22a6-5c7f-457d-a9e3-a8162f9cb4c1 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:36.158129 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-39ca22a6-5c7f-457d-a9e3-a8162f9cb4c1 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:36.169325 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39ca22a6-5c7f-457d-a9e3-a8162f9cb4c1 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:36.170127 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39ca22a6-5c7f-457d-a9e3-a8162f9cb4c1 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:36.171217 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39ca22a6-5c7f-457d-a9e3-a8162f9cb4c1 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:36.171873 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39ca22a6-5c7f-457d-a9e3-a8162f9cb4c1 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:36.290569 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-39ca22a6-5c7f-457d-a9e3-a8162f9cb4c1 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "POST /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46/action" status: 204 len: 0 microversion: 2.1 time: 0.137590 Aug 04 17:14:36.291651 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2830/5777] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:14:36 2022] POST /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46/action => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:14:36.302020 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c7d9fd8a-c1ab-4044-9b74-c23b55118e00 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:36.302796 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c7d9fd8a-c1ab-4044-9b74-c23b55118e00 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:36.318272 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c7d9fd8a-c1ab-4044-9b74-c23b55118e00 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:36.321229 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c7d9fd8a-c1ab-4044-9b74-c23b55118e00 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:36.322432 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c7d9fd8a-c1ab-4044-9b74-c23b55118e00 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:36.326689 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c7d9fd8a-c1ab-4044-9b74-c23b55118e00 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:37.255853 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c7d9fd8a-c1ab-4044-9b74-c23b55118e00 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:37.260758 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:37.294670 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c7d9fd8a-c1ab-4044-9b74-c23b55118e00 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1688 microversion: 2.1 time: 0.994013 Aug 04 17:14:37.295370 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2948/5778] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:36 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1688 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:38.322160 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9d8117e4-f9ba-4361-af50-0771acce370f tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:38.322930 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9d8117e4-f9ba-4361-af50-0771acce370f tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:38.356210 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d8117e4-f9ba-4361-af50-0771acce370f tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:38.359387 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d8117e4-f9ba-4361-af50-0771acce370f tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:38.362868 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d8117e4-f9ba-4361-af50-0771acce370f tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:38.363532 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d8117e4-f9ba-4361-af50-0771acce370f tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:38.836096 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-949f5ed6-f351-4122-af1a-3886efd5685b req-8e6e94c6-2645-4f4a-85f8-3812b1ddf9a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55605b02-eb78-41d9-a397-c58a3997fc46", "name": "network-vif-plugged", "status": "completed", "tag": "8b156186-1d42-470c-9334-6468b498cd22"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:38.878166 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-949f5ed6-f351-4122-af1a-3886efd5685b req-8e6e94c6-2645-4f4a-85f8-3812b1ddf9a0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:38.880898 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-949f5ed6-f351-4122-af1a-3886efd5685b req-8e6e94c6-2645-4f4a-85f8-3812b1ddf9a0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:38.922101 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-949f5ed6-f351-4122-af1a-3886efd5685b req-8e6e94c6-2645-4f4a-85f8-3812b1ddf9a0 service nova] Creating event network-vif-plugged:8b156186-1d42-470c-9334-6468b498cd22 for instance 55605b02-eb78-41d9-a397-c58a3997fc46 on n-h2-846466-12 Aug 04 17:14:38.932179 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [req-949f5ed6-f351-4122-af1a-3886efd5685b req-8e6e94c6-2645-4f4a-85f8-3812b1ddf9a0 service nova] Instance 55605b02-eb78-41d9-a397-c58a3997fc46 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:14:38.965682 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-949f5ed6-f351-4122-af1a-3886efd5685b req-8e6e94c6-2645-4f4a-85f8-3812b1ddf9a0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124507 Aug 04 17:14:38.967491 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2949/5779] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:14:39.356149 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9d8117e4-f9ba-4361-af50-0771acce370f tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:39.360104 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:39.385190 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9d8117e4-f9ba-4361-af50-0771acce370f tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1688 microversion: 2.1 time: 1.068057 Aug 04 17:14:39.386258 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2831/5780] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:38 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1688 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:40.418844 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-16d8ec9f-9f5c-4b9e-94d3-8c86839ab9ac tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:40.419524 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-16d8ec9f-9f5c-4b9e-94d3-8c86839ab9ac tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:40.444868 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-16d8ec9f-9f5c-4b9e-94d3-8c86839ab9ac tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:40.445357 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-16d8ec9f-9f5c-4b9e-94d3-8c86839ab9ac tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:40.451196 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-16d8ec9f-9f5c-4b9e-94d3-8c86839ab9ac tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:40.451638 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-16d8ec9f-9f5c-4b9e-94d3-8c86839ab9ac tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:41.632964 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-16d8ec9f-9f5c-4b9e-94d3-8c86839ab9ac tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:41.650907 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-16d8ec9f-9f5c-4b9e-94d3-8c86839ab9ac tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1680 microversion: 2.1 time: 1.239132 Aug 04 17:14:41.654967 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2950/5781] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:40 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1680 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:42.185079 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6a0031a2-45f4-4ead-83a9-a71c8467846e tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Action: 'create', calling method: .version_select at 0x7f7e84214ee0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-114939124", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5bX9O2ajW6XTenj7VIIMRxfoGulxPiAD0PrunBa22OL2VgatGqp3b9vQ8b4hcTe3eFQAnl11SUHf5FqERvmFR5AN/++ErK+IIvZdkl39VwD7TcQ/9iK2M2xQT+Pu8s3A=="}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:42.213617 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-6a0031a2-45f4-4ead-83a9-a71c8467846e tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Getting quotas for project f2dc5d0512d34a47b06925edfebfce57. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:14:42.220894 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-6a0031a2-45f4-4ead-83a9-a71c8467846e tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Getting quotas for user 208d51c5701647a39b2ee6a3b999fe27 and project f2dc5d0512d34a47b06925edfebfce57. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:14:42.289019 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6a0031a2-45f4-4ead-83a9-a71c8467846e tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.109559 Aug 04 17:14:42.295504 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2832/5782] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 17:14:42 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:14:45.823986 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2d91ead9-67c6-40f9-9690-3a854e3158a8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-507702808", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "23d8496a-eae0-4fae-9274-86d8d54d549a"}], "key_name": "tempest-TestNetworkBasicOps-114939124", "security_groups": [{"name": "tempest-secgroup-smoke-1399971491"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:45.855007 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=28 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:46.114835 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-2d91ead9-67c6-40f9-9690-3a854e3158a8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] validate_networks() for [('23d8496a-eae0-4fae-9274-86d8d54d549a', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:14:47.075639 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-2d91ead9-67c6-40f9-9690-3a854e3158a8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:14:47.076230 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-2d91ead9-67c6-40f9-9690-3a854e3158a8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:14:47.076545 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-2d91ead9-67c6-40f9-9690-3a854e3158a8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:14:47.076918 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-2d91ead9-67c6-40f9-9690-3a854e3158a8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:14:47.077365 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-2d91ead9-67c6-40f9-9690-3a854e3158a8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:14:47.087733 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d91ead9-67c6-40f9-9690-3a854e3158a8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:47.088163 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d91ead9-67c6-40f9-9690-3a854e3158a8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:47.089008 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d91ead9-67c6-40f9-9690-3a854e3158a8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:47.089905 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d91ead9-67c6-40f9-9690-3a854e3158a8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:47.111999 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-2d91ead9-67c6-40f9-9690-3a854e3158a8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Getting quotas for project f2dc5d0512d34a47b06925edfebfce57. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:14:47.117769 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-2d91ead9-67c6-40f9-9690-3a854e3158a8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Getting quotas for user 208d51c5701647a39b2ee6a3b999fe27 and project f2dc5d0512d34a47b06925edfebfce57. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:14:47.132504 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2d91ead9-67c6-40f9-9690-3a854e3158a8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:14:47.135105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2d91ead9-67c6-40f9-9690-3a854e3158a8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: 2ee82d9d-5776-43cc-8688-530e478c23cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:14:47.186093 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2d91ead9-67c6-40f9-9690-3a854e3158a8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.366432 Aug 04 17:14:47.186774 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2951/5783] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:14:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 1368 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:14:47.199790 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-04e6f29a-9138-44b5-9db4-83c9625ef423 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:47.200612 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-04e6f29a-9138-44b5-9db4-83c9625ef423 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: 2ee82d9d-5776-43cc-8688-530e478c23cb] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:47.202778 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:47.358241 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-04e6f29a-9138-44b5-9db4-83c9625ef423 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:47.367774 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-04e6f29a-9138-44b5-9db4-83c9625ef423 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee82d9d-5776-43cc-8688-530e478c23cb" status: 200 len: 1247 microversion: 2.1 time: 0.173189 Aug 04 17:14:47.368902 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2833/5784] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:47 2022] GET /compute/v2.1/servers/2ee82d9d-5776-43cc-8688-530e478c23cb => generated 1247 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:48.394317 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c0c62479-ed9b-4752-82a2-aebfd768fd3e tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:48.394927 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c0c62479-ed9b-4752-82a2-aebfd768fd3e tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: 2ee82d9d-5776-43cc-8688-530e478c23cb] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:48.407516 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0c62479-ed9b-4752-82a2-aebfd768fd3e tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:48.407966 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0c62479-ed9b-4752-82a2-aebfd768fd3e tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:48.408730 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0c62479-ed9b-4752-82a2-aebfd768fd3e tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:48.414512 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0c62479-ed9b-4752-82a2-aebfd768fd3e tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:48.674766 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c0c62479-ed9b-4752-82a2-aebfd768fd3e tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:48.704540 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c0c62479-ed9b-4752-82a2-aebfd768fd3e tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee82d9d-5776-43cc-8688-530e478c23cb" status: 200 len: 1299 microversion: 2.1 time: 0.307688 Aug 04 17:14:48.709497 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2952/5785] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:48 2022] GET /compute/v2.1/servers/2ee82d9d-5776-43cc-8688-530e478c23cb => generated 1299 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:49.731432 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-957e02a4-2122-48f0-98fb-6149c058f22d tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:49.732063 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-957e02a4-2122-48f0-98fb-6149c058f22d tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: 2ee82d9d-5776-43cc-8688-530e478c23cb] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:49.750391 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-957e02a4-2122-48f0-98fb-6149c058f22d tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:49.751109 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-957e02a4-2122-48f0-98fb-6149c058f22d tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:49.752097 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-957e02a4-2122-48f0-98fb-6149c058f22d tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:49.753147 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-957e02a4-2122-48f0-98fb-6149c058f22d tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:50.203494 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-957e02a4-2122-48f0-98fb-6149c058f22d tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:50.241112 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-957e02a4-2122-48f0-98fb-6149c058f22d tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee82d9d-5776-43cc-8688-530e478c23cb" status: 200 len: 1305 microversion: 2.1 time: 0.512622 Aug 04 17:14:50.242327 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2834/5786] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:49 2022] GET /compute/v2.1/servers/2ee82d9d-5776-43cc-8688-530e478c23cb => generated 1305 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:51.267326 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ec3cf844-1430-45a2-ba05-267ff6f6db25 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:51.268522 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ec3cf844-1430-45a2-ba05-267ff6f6db25 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: 2ee82d9d-5776-43cc-8688-530e478c23cb] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:51.288195 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec3cf844-1430-45a2-ba05-267ff6f6db25 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:51.289011 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec3cf844-1430-45a2-ba05-267ff6f6db25 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:51.290961 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec3cf844-1430-45a2-ba05-267ff6f6db25 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:51.293700 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ec3cf844-1430-45a2-ba05-267ff6f6db25 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:51.740028 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2ff3ef5f-ee01-432b-90c4-8c7c17e2dd3e tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:51.741110 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2ff3ef5f-ee01-432b-90c4-8c7c17e2dd3e tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: ad92a901-e6d8-45d5-9c79-7705b3b9d44a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:51.753944 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ff3ef5f-ee01-432b-90c4-8c7c17e2dd3e tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:51.754607 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ff3ef5f-ee01-432b-90c4-8c7c17e2dd3e tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:51.755986 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ff3ef5f-ee01-432b-90c4-8c7c17e2dd3e tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:51.762646 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ff3ef5f-ee01-432b-90c4-8c7c17e2dd3e tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:51.787529 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ec3cf844-1430-45a2-ba05-267ff6f6db25 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:51.804844 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ec3cf844-1430-45a2-ba05-267ff6f6db25 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee82d9d-5776-43cc-8688-530e478c23cb" status: 200 len: 1373 microversion: 2.1 time: 0.540612 Aug 04 17:14:51.812478 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2953/5787] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:51 2022] GET /compute/v2.1/servers/2ee82d9d-5776-43cc-8688-530e478c23cb => generated 1373 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:51.925584 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-2ff3ef5f-ee01-432b-90c4-8c7c17e2dd3e tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lazy-loading 'services' on Instance uuid ad92a901-e6d8-45d5-9c79-7705b3b9d44a {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:14:52.048529 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2ff3ef5f-ee01-432b-90c4-8c7c17e2dd3e tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a/os-volume_attachments/84aa70f9-c663-4392-8812-e956a3893deb" status: 202 len: 0 microversion: 2.1 time: 0.312762 Aug 04 17:14:52.049607 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2835/5788] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Aug 4 17:14:51 2022] DELETE /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a/os-volume_attachments/84aa70f9-c663-4392-8812-e956a3893deb => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:14:52.209037 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-7fca73bb-bf8e-4454-b47e-03219c340596 req-56376ed0-7f11-4a91-94f8-dcbba1db8372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ee82d9d-5776-43cc-8688-530e478c23cb", "tag": "db4e0464-1873-4edc-bf3c-11009c2e1cc9"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:52.223155 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7fca73bb-bf8e-4454-b47e-03219c340596 req-56376ed0-7f11-4a91-94f8-dcbba1db8372 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:52.223845 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7fca73bb-bf8e-4454-b47e-03219c340596 req-56376ed0-7f11-4a91-94f8-dcbba1db8372 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:52.268714 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-7fca73bb-bf8e-4454-b47e-03219c340596 req-56376ed0-7f11-4a91-94f8-dcbba1db8372 service nova] Creating event network-changed:db4e0464-1873-4edc-bf3c-11009c2e1cc9 for instance 2ee82d9d-5776-43cc-8688-530e478c23cb on n-h1-846466-12 Aug 04 17:14:52.277559 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-7fca73bb-bf8e-4454-b47e-03219c340596 req-56376ed0-7f11-4a91-94f8-dcbba1db8372 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072896 Aug 04 17:14:52.281111 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2954/5789] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:14:52.830939 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9a767a3d-8302-488c-9f3d-d1c031ac2c65 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:52.833506 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9a767a3d-8302-488c-9f3d-d1c031ac2c65 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: 2ee82d9d-5776-43cc-8688-530e478c23cb] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:52.854461 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9a767a3d-8302-488c-9f3d-d1c031ac2c65 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:52.855655 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9a767a3d-8302-488c-9f3d-d1c031ac2c65 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:52.858554 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9a767a3d-8302-488c-9f3d-d1c031ac2c65 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:52.859675 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9a767a3d-8302-488c-9f3d-d1c031ac2c65 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:53.170036 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9a767a3d-8302-488c-9f3d-d1c031ac2c65 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:53.179298 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9a767a3d-8302-488c-9f3d-d1c031ac2c65 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee82d9d-5776-43cc-8688-530e478c23cb" status: 200 len: 1373 microversion: 2.1 time: 0.355103 Aug 04 17:14:53.179906 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2836/5790] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:52 2022] GET /compute/v2.1/servers/2ee82d9d-5776-43cc-8688-530e478c23cb => generated 1373 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:54.209085 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d24d1d4c-1532-4c3d-b099-53f12e1a112d tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:54.210119 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d24d1d4c-1532-4c3d-b099-53f12e1a112d tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: 2ee82d9d-5776-43cc-8688-530e478c23cb] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:54.233669 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d24d1d4c-1532-4c3d-b099-53f12e1a112d tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:54.234211 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d24d1d4c-1532-4c3d-b099-53f12e1a112d tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:54.235061 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d24d1d4c-1532-4c3d-b099-53f12e1a112d tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:54.235565 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d24d1d4c-1532-4c3d-b099-53f12e1a112d tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:54.568458 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d24d1d4c-1532-4c3d-b099-53f12e1a112d tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:54.590701 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d24d1d4c-1532-4c3d-b099-53f12e1a112d tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee82d9d-5776-43cc-8688-530e478c23cb" status: 200 len: 1373 microversion: 2.1 time: 0.385797 Aug 04 17:14:54.592176 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2955/5791] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:54 2022] GET /compute/v2.1/servers/2ee82d9d-5776-43cc-8688-530e478c23cb => generated 1373 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:55.622269 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e91eaeb8-147b-42e1-b7ff-4092cdcad63c tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:55.624439 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e91eaeb8-147b-42e1-b7ff-4092cdcad63c tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: 2ee82d9d-5776-43cc-8688-530e478c23cb] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:55.638893 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e91eaeb8-147b-42e1-b7ff-4092cdcad63c tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:55.639838 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e91eaeb8-147b-42e1-b7ff-4092cdcad63c tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:55.642688 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e91eaeb8-147b-42e1-b7ff-4092cdcad63c tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:55.645124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e91eaeb8-147b-42e1-b7ff-4092cdcad63c tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:55.936778 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e91eaeb8-147b-42e1-b7ff-4092cdcad63c tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:55.948892 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e91eaeb8-147b-42e1-b7ff-4092cdcad63c tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee82d9d-5776-43cc-8688-530e478c23cb" status: 200 len: 1373 microversion: 2.1 time: 0.337325 Aug 04 17:14:55.965347 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2837/5792] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:55 2022] GET /compute/v2.1/servers/2ee82d9d-5776-43cc-8688-530e478c23cb => generated 1373 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:56.982116 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e7fa8795-1e41-44d5-8a57-f05d3990bba1 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:56.982731 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e7fa8795-1e41-44d5-8a57-f05d3990bba1 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: 2ee82d9d-5776-43cc-8688-530e478c23cb] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:57.000546 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e7fa8795-1e41-44d5-8a57-f05d3990bba1 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:57.003817 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e7fa8795-1e41-44d5-8a57-f05d3990bba1 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:57.006205 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e7fa8795-1e41-44d5-8a57-f05d3990bba1 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:57.007670 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e7fa8795-1e41-44d5-8a57-f05d3990bba1 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:57.102157 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:57.125063 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:57.242152 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e7fa8795-1e41-44d5-8a57-f05d3990bba1 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:57.254382 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e7fa8795-1e41-44d5-8a57-f05d3990bba1 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee82d9d-5776-43cc-8688-530e478c23cb" status: 200 len: 1373 microversion: 2.1 time: 0.275417 Aug 04 17:14:57.255417 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2956/5793] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:56 2022] GET /compute/v2.1/servers/2ee82d9d-5776-43cc-8688-530e478c23cb => generated 1373 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:57.443102 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-8fe9bb12-c2f4-478b-a892-9496357e44f7 req-0ae0c53f-ddd7-452b-b1ce-62cb30ceb4b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee82d9d-5776-43cc-8688-530e478c23cb", "name": "network-vif-plugged", "status": "completed", "tag": "db4e0464-1873-4edc-bf3c-11009c2e1cc9"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:57.455785 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:57.461252 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-8fe9bb12-c2f4-478b-a892-9496357e44f7 req-0ae0c53f-ddd7-452b-b1ce-62cb30ceb4b5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:57.462042 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-8fe9bb12-c2f4-478b-a892-9496357e44f7 req-0ae0c53f-ddd7-452b-b1ce-62cb30ceb4b5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:57.479863 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-8fe9bb12-c2f4-478b-a892-9496357e44f7 req-0ae0c53f-ddd7-452b-b1ce-62cb30ceb4b5 service nova] Creating event network-vif-plugged:db4e0464-1873-4edc-bf3c-11009c2e1cc9 for instance 2ee82d9d-5776-43cc-8688-530e478c23cb on n-h1-846466-12 Aug 04 17:14:57.486399 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-8fe9bb12-c2f4-478b-a892-9496357e44f7 req-0ae0c53f-ddd7-452b-b1ce-62cb30ceb4b5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048250 Aug 04 17:14:57.487729 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2838/5794] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:14:58.279940 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7b34549d-d61d-4a89-9cd3-ab9ae693c1eb tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:58.280849 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7b34549d-d61d-4a89-9cd3-ab9ae693c1eb tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: 2ee82d9d-5776-43cc-8688-530e478c23cb] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:58.288571 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b34549d-d61d-4a89-9cd3-ab9ae693c1eb tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:58.289013 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b34549d-d61d-4a89-9cd3-ab9ae693c1eb tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:58.290004 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b34549d-d61d-4a89-9cd3-ab9ae693c1eb tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:58.290588 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b34549d-d61d-4a89-9cd3-ab9ae693c1eb tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:58.482127 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7b34549d-d61d-4a89-9cd3-ab9ae693c1eb tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:58.496722 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7b34549d-d61d-4a89-9cd3-ab9ae693c1eb tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee82d9d-5776-43cc-8688-530e478c23cb" status: 200 len: 1373 microversion: 2.1 time: 0.218935 Aug 04 17:14:58.497788 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2957/5795] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:58 2022] GET /compute/v2.1/servers/2ee82d9d-5776-43cc-8688-530e478c23cb => generated 1373 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:58.842310 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-058a64bd-ce63-4be3-a71d-e5ef6c89d57f tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:58.843526 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-058a64bd-ce63-4be3-a71d-e5ef6c89d57f tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: ad92a901-e6d8-45d5-9c79-7705b3b9d44a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:58.850433 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-058a64bd-ce63-4be3-a71d-e5ef6c89d57f tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:58.851175 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-058a64bd-ce63-4be3-a71d-e5ef6c89d57f tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:58.852634 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-058a64bd-ce63-4be3-a71d-e5ef6c89d57f tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:58.853244 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-058a64bd-ce63-4be3-a71d-e5ef6c89d57f tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:58.881468 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-058a64bd-ce63-4be3-a71d-e5ef6c89d57f tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: ad92a901-e6d8-45d5-9c79-7705b3b9d44a] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:14:59.007772 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-058a64bd-ce63-4be3-a71d-e5ef6c89d57f tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a" status: 204 len: 0 microversion: 2.1 time: 0.171465 Aug 04 17:14:59.011111 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2839/5796] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:14:58 2022] DELETE /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:14:59.018982 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-790fe261-7102-4d05-8c92-5f54ed2998a2 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:59.019865 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-790fe261-7102-4d05-8c92-5f54ed2998a2 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: ad92a901-e6d8-45d5-9c79-7705b3b9d44a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:59.032505 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-790fe261-7102-4d05-8c92-5f54ed2998a2 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:59.033443 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-790fe261-7102-4d05-8c92-5f54ed2998a2 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:59.034405 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-790fe261-7102-4d05-8c92-5f54ed2998a2 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:59.037090 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-790fe261-7102-4d05-8c92-5f54ed2998a2 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:59.230609 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-790fe261-7102-4d05-8c92-5f54ed2998a2 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff743726c34c02a99feaa8abd09e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16f62c8d73843a3b2380304f9af7ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:59.240449 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-790fe261-7102-4d05-8c92-5f54ed2998a2 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "GET /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a" status: 200 len: 1512 microversion: 2.1 time: 0.225622 Aug 04 17:14:59.251727 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2958/5797] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:59 2022] GET /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a => generated 1512 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:59.519993 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0642b5db-ab2e-46fd-ba43-46c3dd2843f1 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:59.521165 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0642b5db-ab2e-46fd-ba43-46c3dd2843f1 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: 2ee82d9d-5776-43cc-8688-530e478c23cb] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:59.529118 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0642b5db-ab2e-46fd-ba43-46c3dd2843f1 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:59.529636 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0642b5db-ab2e-46fd-ba43-46c3dd2843f1 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:59.530476 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0642b5db-ab2e-46fd-ba43-46c3dd2843f1 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:59.530919 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0642b5db-ab2e-46fd-ba43-46c3dd2843f1 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:59.703223 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0642b5db-ab2e-46fd-ba43-46c3dd2843f1 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:59.711920 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0642b5db-ab2e-46fd-ba43-46c3dd2843f1 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee82d9d-5776-43cc-8688-530e478c23cb" status: 200 len: 1544 microversion: 2.1 time: 0.196528 Aug 04 17:14:59.712745 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2840/5798] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:59 2022] GET /compute/v2.1/servers/2ee82d9d-5776-43cc-8688-530e478c23cb => generated 1544 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:59.733370 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-278c0c27-9095-4856-b6cd-4c050b21a959 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:59.733867 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-278c0c27-9095-4856-b6cd-4c050b21a959 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: 2ee82d9d-5776-43cc-8688-530e478c23cb] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:59.741384 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-278c0c27-9095-4856-b6cd-4c050b21a959 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:59.741846 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-278c0c27-9095-4856-b6cd-4c050b21a959 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:59.742912 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-278c0c27-9095-4856-b6cd-4c050b21a959 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:14:59.743355 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-278c0c27-9095-4856-b6cd-4c050b21a959 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:14:59.978821 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-278c0c27-9095-4856-b6cd-4c050b21a959 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:59.987323 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-278c0c27-9095-4856-b6cd-4c050b21a959 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee82d9d-5776-43cc-8688-530e478c23cb" status: 200 len: 1544 microversion: 2.1 time: 0.258235 Aug 04 17:14:59.988525 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2959/5799] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:59 2022] GET /compute/v2.1/servers/2ee82d9d-5776-43cc-8688-530e478c23cb => generated 1544 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:00.030239 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1bacc11e-996c-4d27-83d8-f1091c01b38e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:00.034365 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1bacc11e-996c-4d27-83d8-f1091c01b38e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:00.043969 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1bacc11e-996c-4d27-83d8-f1091c01b38e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:00.045172 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1bacc11e-996c-4d27-83d8-f1091c01b38e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:00.046340 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1bacc11e-996c-4d27-83d8-f1091c01b38e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:00.047012 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1bacc11e-996c-4d27-83d8-f1091c01b38e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:00.126918 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1bacc11e-996c-4d27-83d8-f1091c01b38e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "POST /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46/action" status: 200 len: 24572 microversion: 2.1 time: 0.100687 Aug 04 17:15:00.139243 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2841/5800] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:15:00 2022] POST /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46/action => generated 24572 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:15:00.272235 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0426e740-4e79-42cc-8ddc-298a3bf5801b tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:00.272845 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0426e740-4e79-42cc-8ddc-298a3bf5801b tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: ad92a901-e6d8-45d5-9c79-7705b3b9d44a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:00.286268 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0426e740-4e79-42cc-8ddc-298a3bf5801b tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:00.286950 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0426e740-4e79-42cc-8ddc-298a3bf5801b tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:00.294959 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0426e740-4e79-42cc-8ddc-298a3bf5801b tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:00.295716 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0426e740-4e79-42cc-8ddc-298a3bf5801b tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:00.664221 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0426e740-4e79-42cc-8ddc-298a3bf5801b tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff743726c34c02a99feaa8abd09e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16f62c8d73843a3b2380304f9af7ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:00.675119 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0426e740-4e79-42cc-8ddc-298a3bf5801b tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "GET /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a" status: 200 len: 1512 microversion: 2.1 time: 0.406529 Aug 04 17:15:00.677089 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2960/5801] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:00 2022] GET /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a => generated 1512 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:01.686848 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-04602138-1a3b-4caa-9726-b67a2c761c0d req-10d39ef7-1cbe-4af6-9d24-44ab8f3428ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad92a901-e6d8-45d5-9c79-7705b3b9d44a", "name": "network-vif-deleted", "tag": "a04d3f5a-56dd-409c-ba1d-2fbc107e00aa"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:01.698143 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d92c7764-46ce-49d5-8609-2df2456c5155 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:01.699771 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d92c7764-46ce-49d5-8609-2df2456c5155 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: ad92a901-e6d8-45d5-9c79-7705b3b9d44a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:01.718711 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d92c7764-46ce-49d5-8609-2df2456c5155 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:01.724306 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d92c7764-46ce-49d5-8609-2df2456c5155 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:01.727271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d92c7764-46ce-49d5-8609-2df2456c5155 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:01.727893 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d92c7764-46ce-49d5-8609-2df2456c5155 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:01.735188 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-04602138-1a3b-4caa-9726-b67a2c761c0d req-10d39ef7-1cbe-4af6-9d24-44ab8f3428ab service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:01.746514 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-04602138-1a3b-4caa-9726-b67a2c761c0d req-10d39ef7-1cbe-4af6-9d24-44ab8f3428ab service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:01.775279 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-04602138-1a3b-4caa-9726-b67a2c761c0d req-10d39ef7-1cbe-4af6-9d24-44ab8f3428ab service nova] Creating event network-vif-deleted:a04d3f5a-56dd-409c-ba1d-2fbc107e00aa for instance ad92a901-e6d8-45d5-9c79-7705b3b9d44a on n-h1-846466-12 Aug 04 17:15:01.787310 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-04602138-1a3b-4caa-9726-b67a2c761c0d req-10d39ef7-1cbe-4af6-9d24-44ab8f3428ab service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105011 Aug 04 17:15:01.788784 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2842/5802] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:02.079906 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d92c7764-46ce-49d5-8609-2df2456c5155 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff743726c34c02a99feaa8abd09e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16f62c8d73843a3b2380304f9af7ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:02.089065 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d92c7764-46ce-49d5-8609-2df2456c5155 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "GET /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a" status: 200 len: 1303 microversion: 2.1 time: 0.394943 Aug 04 17:15:02.092458 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2961/5803] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:01 2022] GET /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a => generated 1303 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:15:02.855345 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-68a1e0b8-9256-49d0-8e59-ed25008c880a req-1f87d46c-8abb-4e15-98f6-90cd0a4d3b89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ee82d9d-5776-43cc-8688-530e478c23cb", "tag": "db4e0464-1873-4edc-bf3c-11009c2e1cc9"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:02.879533 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-68a1e0b8-9256-49d0-8e59-ed25008c880a req-1f87d46c-8abb-4e15-98f6-90cd0a4d3b89 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:02.879838 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-68a1e0b8-9256-49d0-8e59-ed25008c880a req-1f87d46c-8abb-4e15-98f6-90cd0a4d3b89 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:02.897572 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-68a1e0b8-9256-49d0-8e59-ed25008c880a req-1f87d46c-8abb-4e15-98f6-90cd0a4d3b89 service nova] Creating event network-changed:db4e0464-1873-4edc-bf3c-11009c2e1cc9 for instance 2ee82d9d-5776-43cc-8688-530e478c23cb on n-h1-846466-12 Aug 04 17:15:02.903885 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-68a1e0b8-9256-49d0-8e59-ed25008c880a req-1f87d46c-8abb-4e15-98f6-90cd0a4d3b89 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056104 Aug 04 17:15:02.905032 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2843/5804] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:15:03.113891 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-798272cd-cf60-4375-87a7-6afc7e5ff6f3 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:03.114500 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-798272cd-cf60-4375-87a7-6afc7e5ff6f3 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] [instance: ad92a901-e6d8-45d5-9c79-7705b3b9d44a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:03.130404 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-798272cd-cf60-4375-87a7-6afc7e5ff6f3 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:03.130910 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-798272cd-cf60-4375-87a7-6afc7e5ff6f3 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:03.131694 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-798272cd-cf60-4375-87a7-6afc7e5ff6f3 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:03.132281 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-798272cd-cf60-4375-87a7-6afc7e5ff6f3 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:03.160614 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-798272cd-cf60-4375-87a7-6afc7e5ff6f3 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] HTTP exception thrown: Instance ad92a901-e6d8-45d5-9c79-7705b3b9d44a could not be found. Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-798272cd-cf60-4375-87a7-6afc7e5ff6f3 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Request method failure captured: Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a HTTP/1.1 Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_2JbUoIKfbiZRaYTIaWVEPfmbHCRsHYWDzYCqO5aN0pdwRFMgKuBDQo66AeM6aLBa0vGGW0YjCqaVZj7Q2Eu0ik-Sxw5TrfKvTfGM8sVEbTZe9MR006lIyLNCME4pB0kaf5j-tBdyXHhQVNlwrxeN3bwa6ROhPkNAw8S5vQ-VkF914 Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: e16f62c8d73843a3b2380304f9af7ce5 Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-VolumesSnapshotTestJSON-392001947 Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e16f62c8d73843a3b2380304f9af7ce5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e16f62c8d73843a3b2380304f9af7ce5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e16f62c8d73843a3b2380304f9af7ce5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e16f62c8d73843a3b2380304f9af7ce5"}]}] Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-VolumesSnapshotTestJSON-392001947 Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: e16f62c8d73843a3b2380304f9af7ce5 Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-392001947 Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-VolumesSnapshotTestJSON-392001947-project Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 24ff743726c34c02a99feaa8abd09e41 Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-VolumesSnapshotTestJSON-392001947-project Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance ad92a901-e6d8-45d5-9c79-7705b3b9d44a could not be found. Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'ad92a901-e6d8-45d5-9c79-7705b3b9d44a'} Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad92a901-e6d8-45d5-9c79-7705b3b9d44a could not be found. Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad92a901-e6d8-45d5-9c79-7705b3b9d44a could not be found. Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:03.162359 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:15:03.165897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:03.165897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:03.165897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:03.165897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:15:03.165897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:15:03.165897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad92a901-e6d8-45d5-9c79-7705b3b9d44a could not be found. Aug 04 17:15:03.165897 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:15:03.169871 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-798272cd-cf60-4375-87a7-6afc7e5ff6f3 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] Returning 404 to user: Instance ad92a901-e6d8-45d5-9c79-7705b3b9d44a could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:15:03.171104 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-798272cd-cf60-4375-87a7-6afc7e5ff6f3 tempest-VolumesSnapshotTestJSON-392001947 tempest-VolumesSnapshotTestJSON-392001947-project] 10.222.0.23 "GET /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a" status: 404 len: 111 microversion: 2.1 time: 0.061183 Aug 04 17:15:03.172250 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2962/5805] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:03 2022] GET /compute/v2.1/servers/ad92a901-e6d8-45d5-9c79-7705b3b9d44a => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:15:06.338420 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ae938052-2f49-4667-9118-b8e02674f555 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:06.340002 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ae938052-2f49-4667-9118-b8e02674f555 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:06.357160 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ae938052-2f49-4667-9118-b8e02674f555 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:06.363857 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ae938052-2f49-4667-9118-b8e02674f555 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:06.363857 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ae938052-2f49-4667-9118-b8e02674f555 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:06.363857 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ae938052-2f49-4667-9118-b8e02674f555 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:06.574965 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ae938052-2f49-4667-9118-b8e02674f555 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1833 microversion: 2.1 time: 0.243129 Aug 04 17:15:06.576140 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2844/5806] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:06 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1833 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:15:08.022089 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a58cbb31-3ceb-4caa-9015-55a49b6b26c3 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:08.023359 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a58cbb31-3ceb-4caa-9015-55a49b6b26c3 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:08.092204 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a58cbb31-3ceb-4caa-9015-55a49b6b26c3 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:08.094078 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a58cbb31-3ceb-4caa-9015-55a49b6b26c3 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:08.096627 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a58cbb31-3ceb-4caa-9015-55a49b6b26c3 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:08.103562 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-a76862eb-68f0-4048-bb35-b4c74b78d90d req-dfa0301e-9353-46ad-8494-4c0169110a7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55605b02-eb78-41d9-a397-c58a3997fc46", "tag": "8b156186-1d42-470c-9334-6468b498cd22"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:08.104153 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a58cbb31-3ceb-4caa-9015-55a49b6b26c3 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:08.130975 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a76862eb-68f0-4048-bb35-b4c74b78d90d req-dfa0301e-9353-46ad-8494-4c0169110a7e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:08.131780 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a76862eb-68f0-4048-bb35-b4c74b78d90d req-dfa0301e-9353-46ad-8494-4c0169110a7e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:08.182949 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-a76862eb-68f0-4048-bb35-b4c74b78d90d req-dfa0301e-9353-46ad-8494-4c0169110a7e service nova] Creating event network-changed:8b156186-1d42-470c-9334-6468b498cd22 for instance 55605b02-eb78-41d9-a397-c58a3997fc46 on n-h2-846466-12 Aug 04 17:15:08.205100 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-a76862eb-68f0-4048-bb35-b4c74b78d90d req-dfa0301e-9353-46ad-8494-4c0169110a7e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108835 Aug 04 17:15:08.206424 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2845/5807] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:15:08.215253 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a58cbb31-3ceb-4caa-9015-55a49b6b26c3 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:15:08.368904 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a58cbb31-3ceb-4caa-9015-55a49b6b26c3 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "DELETE /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 204 len: 0 microversion: 2.1 time: 0.353000 Aug 04 17:15:08.372662 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2963/5808] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:15:08 2022] DELETE /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:15:08.384767 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-43f1abce-96fd-499a-bbe5-c9f584f12134 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:08.386975 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-43f1abce-96fd-499a-bbe5-c9f584f12134 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:08.395551 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-43f1abce-96fd-499a-bbe5-c9f584f12134 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:08.396116 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-43f1abce-96fd-499a-bbe5-c9f584f12134 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:08.397073 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-43f1abce-96fd-499a-bbe5-c9f584f12134 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:08.397598 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-43f1abce-96fd-499a-bbe5-c9f584f12134 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:08.661070 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-43f1abce-96fd-499a-bbe5-c9f584f12134 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:08.674964 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-43f1abce-96fd-499a-bbe5-c9f584f12134 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1686 microversion: 2.1 time: 0.299831 Aug 04 17:15:08.675713 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2846/5809] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:08 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1686 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:09.698931 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3b5292bb-e62d-410c-a042-bd32000bc0db tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:09.699735 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3b5292bb-e62d-410c-a042-bd32000bc0db tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:09.712151 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b5292bb-e62d-410c-a042-bd32000bc0db tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:09.713037 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b5292bb-e62d-410c-a042-bd32000bc0db tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:09.716279 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b5292bb-e62d-410c-a042-bd32000bc0db tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:09.718291 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b5292bb-e62d-410c-a042-bd32000bc0db tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:09.786303 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:10.296363 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3b5292bb-e62d-410c-a042-bd32000bc0db tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:10.331685 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3b5292bb-e62d-410c-a042-bd32000bc0db tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1686 microversion: 2.1 time: 0.637010 Aug 04 17:15:10.336128 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2964/5810] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:09 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1686 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:10.964636 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-7b4ebe96-1138-424c-8012-afdc66558329 req-b0e6d534-3842-462e-a80c-e2ff3ad15046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55605b02-eb78-41d9-a397-c58a3997fc46", "name": "network-vif-deleted", "tag": "8b156186-1d42-470c-9334-6468b498cd22"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:11.008882 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-7b4ebe96-1138-424c-8012-afdc66558329 req-b0e6d534-3842-462e-a80c-e2ff3ad15046 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:11.012131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-7b4ebe96-1138-424c-8012-afdc66558329 req-b0e6d534-3842-462e-a80c-e2ff3ad15046 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:11.023979 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-7b4ebe96-1138-424c-8012-afdc66558329 req-b0e6d534-3842-462e-a80c-e2ff3ad15046 service nova] Creating event network-vif-deleted:8b156186-1d42-470c-9334-6468b498cd22 for instance 55605b02-eb78-41d9-a397-c58a3997fc46 on n-h2-846466-12 Aug 04 17:15:11.030840 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-7b4ebe96-1138-424c-8012-afdc66558329 req-b0e6d534-3842-462e-a80c-e2ff3ad15046 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069978 Aug 04 17:15:11.036552 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2847/5811] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:11.357269 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d2f5a7f6-1ef5-48dd-9e0d-64932927a3e7 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:11.357922 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d2f5a7f6-1ef5-48dd-9e0d-64932927a3e7 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:11.370977 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d2f5a7f6-1ef5-48dd-9e0d-64932927a3e7 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:11.372183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d2f5a7f6-1ef5-48dd-9e0d-64932927a3e7 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:11.373033 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d2f5a7f6-1ef5-48dd-9e0d-64932927a3e7 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:11.373509 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d2f5a7f6-1ef5-48dd-9e0d-64932927a3e7 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:11.462117 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d2f5a7f6-1ef5-48dd-9e0d-64932927a3e7 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:11.463019 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d2f5a7f6-1ef5-48dd-9e0d-64932927a3e7 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:11.463793 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-d2f5a7f6-1ef5-48dd-9e0d-64932927a3e7 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lazy-loading 'fault' on Instance uuid 55605b02-eb78-41d9-a397-c58a3997fc46 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:15:11.613932 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d2f5a7f6-1ef5-48dd-9e0d-64932927a3e7 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:11.625759 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d2f5a7f6-1ef5-48dd-9e0d-64932927a3e7 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 200 len: 1355 microversion: 2.1 time: 0.273020 Aug 04 17:15:11.626270 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2965/5812] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:11 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 1355 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:12.649899 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b37b512e-283f-4915-bc18-1c09bf069fee tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:12.654422 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b37b512e-283f-4915-bc18-1c09bf069fee tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 55605b02-eb78-41d9-a397-c58a3997fc46] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:12.678298 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b37b512e-283f-4915-bc18-1c09bf069fee tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:12.680111 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b37b512e-283f-4915-bc18-1c09bf069fee tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:12.682335 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b37b512e-283f-4915-bc18-1c09bf069fee tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:12.682982 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b37b512e-283f-4915-bc18-1c09bf069fee tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:12.687526 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:12.704708 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-b37b512e-283f-4915-bc18-1c09bf069fee tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] HTTP exception thrown: Instance 55605b02-eb78-41d9-a397-c58a3997fc46 could not be found. Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b37b512e-283f-4915-bc18-1c09bf069fee tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Request method failure captured: Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 HTTP/1.1 Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_4YOThE04EgY2ZC-6Z4P4BLZorNPrwNYsXnudJ3q-g4O8Bpo6oQ4TtL_No6KcEehCahXC1c1rl575Jd3mS3Ei78aQ8uVNhdiDOypdyIumzQRzdLDSRFfSIpFDGraNFEgTS8aTaqqN8uid7ehZJahj9lTM6cYwjw3-kHQng3DwqKDNs Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: a080cbeb5c3a435a880e48ea64dbea70 Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1931304919 Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a080cbeb5c3a435a880e48ea64dbea70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a080cbeb5c3a435a880e48ea64dbea70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a080cbeb5c3a435a880e48ea64dbea70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a080cbeb5c3a435a880e48ea64dbea70"}]}] Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1931304919 Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: a080cbeb5c3a435a880e48ea64dbea70 Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1931304919 Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-TestNetworkAdvancedServerOps-1931304919-project Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: e4c6be7b0d164da98f08be0c35f843a2 Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1931304919-project Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 55605b02-eb78-41d9-a397-c58a3997fc46 could not be found. Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '55605b02-eb78-41d9-a397-c58a3997fc46'} Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55605b02-eb78-41d9-a397-c58a3997fc46 could not be found. Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55605b02-eb78-41d9-a397-c58a3997fc46 could not be found. Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:15:12.706909 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:12.711017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:15:12.711017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:12.711017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:12.711017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:12.711017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:15:12.711017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:15:12.711017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55605b02-eb78-41d9-a397-c58a3997fc46 could not be found. Aug 04 17:15:12.711017 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:15:12.712757 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b37b512e-283f-4915-bc18-1c09bf069fee tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Returning 404 to user: Instance 55605b02-eb78-41d9-a397-c58a3997fc46 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:15:12.713857 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b37b512e-283f-4915-bc18-1c09bf069fee tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46" status: 404 len: 111 microversion: 2.1 time: 0.069351 Aug 04 17:15:12.719365 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2848/5813] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:12 2022] GET /compute/v2.1/servers/55605b02-eb78-41d9-a397-c58a3997fc46 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:15:19.925370 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c51f06ef-7858-4990-bf1d-774a6c92c9d1 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '.version_select at 0x7f7e84c1d1f0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:19.987397 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:20.010652 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c51f06ef-7858-4990-bf1d-774a6c92c9d1 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-64000245" status: 202 len: 0 microversion: 2.1 time: 0.089364 Aug 04 17:15:20.011651 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2966/5814] 10.222.0.23 () {58 vars in 1278 bytes} [Thu Aug 4 17:15:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-64000245 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:15:20.061806 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-23351914-0f2d-426b-b5f2-3620ad0d8573 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Action: 'create', calling method: .version_select at 0x7f7e89b8f4c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1557178140", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMRiZOq31SZsquc0RRChlOyFMGUh0w1VkJZ3ZeyhaZaN3lXFedeRncr/R+pDWReUYu095AlQHtY2dHcpGfMT37PbPZnhLhCwSczRra6bJ+7mE4PLl8diOBrqrD+O3vxldw=="}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:20.082737 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:20.106187 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-23351914-0f2d-426b-b5f2-3620ad0d8573 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Getting quotas for project a080cbeb5c3a435a880e48ea64dbea70. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:15:20.119342 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-23351914-0f2d-426b-b5f2-3620ad0d8573 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Getting quotas for user e4c6be7b0d164da98f08be0c35f843a2 and project a080cbeb5c3a435a880e48ea64dbea70. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:15:20.155645 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-23351914-0f2d-426b-b5f2-3620ad0d8573 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.112307 Aug 04 17:15:20.156940 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2849/5815] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 17:15:20 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:26.109115 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0111670a-9ee5-4414-9eb9-528a5627d6a6 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:26.112101 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0111670a-9ee5-4414-9eb9-528a5627d6a6 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: 2ee82d9d-5776-43cc-8688-530e478c23cb] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:26.127912 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=13 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:26.129896 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0111670a-9ee5-4414-9eb9-528a5627d6a6 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:26.130334 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0111670a-9ee5-4414-9eb9-528a5627d6a6 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:26.131112 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0111670a-9ee5-4414-9eb9-528a5627d6a6 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:26.131537 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0111670a-9ee5-4414-9eb9-528a5627d6a6 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:26.242268 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0111670a-9ee5-4414-9eb9-528a5627d6a6 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "POST /compute/v2.1/servers/2ee82d9d-5776-43cc-8688-530e478c23cb/action" status: 200 len: 24567 microversion: 2.1 time: 0.137223 Aug 04 17:15:26.244296 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2967/5816] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:15:26 2022] POST /compute/v2.1/servers/2ee82d9d-5776-43cc-8688-530e478c23cb/action => generated 24567 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:15:32.737401 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fbbae943-9bc6-4471-ab71-121520806ab0 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1452717154", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "04e14b37-5f2b-445c-ae9a-2ecb1b0e17f0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1557178140", "security_groups": [{"name": "tempest-secgroup-smoke-589932931"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:32.758073 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:32.759520 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=4 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:32.760855 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:32.942794 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-fbbae943-9bc6-4471-ab71-121520806ab0 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] validate_networks() for [('04e14b37-5f2b-445c-ae9a-2ecb1b0e17f0', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:15:34.329363 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-fbbae943-9bc6-4471-ab71-121520806ab0 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:15:34.330939 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-fbbae943-9bc6-4471-ab71-121520806ab0 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:15:34.331573 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-fbbae943-9bc6-4471-ab71-121520806ab0 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:15:34.332206 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-fbbae943-9bc6-4471-ab71-121520806ab0 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:15:34.332565 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-fbbae943-9bc6-4471-ab71-121520806ab0 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:15:34.369947 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fbbae943-9bc6-4471-ab71-121520806ab0 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:34.370514 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fbbae943-9bc6-4471-ab71-121520806ab0 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:34.372849 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fbbae943-9bc6-4471-ab71-121520806ab0 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:34.373487 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fbbae943-9bc6-4471-ab71-121520806ab0 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:34.426350 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-fbbae943-9bc6-4471-ab71-121520806ab0 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Getting quotas for project a080cbeb5c3a435a880e48ea64dbea70. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:15:34.449403 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-fbbae943-9bc6-4471-ab71-121520806ab0 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Getting quotas for user e4c6be7b0d164da98f08be0c35f843a2 and project a080cbeb5c3a435a880e48ea64dbea70. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:15:34.481455 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fbbae943-9bc6-4471-ab71-121520806ab0 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:15:34.484124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fbbae943-9bc6-4471-ab71-121520806ab0 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:15:34.580579 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fbbae943-9bc6-4471-ab71-121520806ab0 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.847636 Aug 04 17:15:34.581559 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2850/5817] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:15:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 1850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:15:34.596781 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-502f4b52-5181-4128-9a14-435cbfba80c2 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:34.598635 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-502f4b52-5181-4128-9a14-435cbfba80c2 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:35.094723 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-502f4b52-5181-4128-9a14-435cbfba80c2 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:35.105001 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-502f4b52-5181-4128-9a14-435cbfba80c2 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1267 microversion: 2.1 time: 0.516206 Aug 04 17:15:35.105731 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2968/5818] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:34 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1267 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:36.145817 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f705246a-bc78-40de-ae03-53d3245148ae tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:36.147164 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f705246a-bc78-40de-ae03-53d3245148ae tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:36.180945 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f705246a-bc78-40de-ae03-53d3245148ae tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:36.182097 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f705246a-bc78-40de-ae03-53d3245148ae tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:36.184488 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f705246a-bc78-40de-ae03-53d3245148ae tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:36.185457 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f705246a-bc78-40de-ae03-53d3245148ae tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:36.357859 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f705246a-bc78-40de-ae03-53d3245148ae tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:36.370191 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f705246a-bc78-40de-ae03-53d3245148ae tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1263 microversion: 2.1 time: 0.244315 Aug 04 17:15:36.373234 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2851/5819] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:36 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1263 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:37.120267 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8031f2e5-5e33-42d0-825c-a903d736bea1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:37.121372 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8031f2e5-5e33-42d0-825c-a903d736bea1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:37.132047 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:37.141003 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8031f2e5-5e33-42d0-825c-a903d736bea1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:37.141811 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8031f2e5-5e33-42d0-825c-a903d736bea1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:37.142870 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-d9069e48-c20c-40d2-b36d-c8f727189ea6 req-2b16ae78-c6aa-4e0f-a301-d12331529993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ad652c1-0763-405a-8cf9-2560bab1df4c", "tag": "c22976c8-ed27-4b47-8acb-123754158502"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:37.143596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8031f2e5-5e33-42d0-825c-a903d736bea1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:37.145947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8031f2e5-5e33-42d0-825c-a903d736bea1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:37.170815 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-d9069e48-c20c-40d2-b36d-c8f727189ea6 req-2b16ae78-c6aa-4e0f-a301-d12331529993 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:37.175437 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-d9069e48-c20c-40d2-b36d-c8f727189ea6 req-2b16ae78-c6aa-4e0f-a301-d12331529993 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:37.225098 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-d9069e48-c20c-40d2-b36d-c8f727189ea6 req-2b16ae78-c6aa-4e0f-a301-d12331529993 service nova] Creating event network-changed:c22976c8-ed27-4b47-8acb-123754158502 for instance 0ad652c1-0763-405a-8cf9-2560bab1df4c on n-h2-846466-12 Aug 04 17:15:37.237666 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8031f2e5-5e33-42d0-825c-a903d736bea1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:15:37.243729 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-d9069e48-c20c-40d2-b36d-c8f727189ea6 req-2b16ae78-c6aa-4e0f-a301-d12331529993 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105112 Aug 04 17:15:37.246722 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2852/5820] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:15:37.406065 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-32d5cdc2-c4ef-40cc-85b1-526bcd827732 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:37.407020 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-32d5cdc2-c4ef-40cc-85b1-526bcd827732 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:37.425436 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-32d5cdc2-c4ef-40cc-85b1-526bcd827732 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:37.426367 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-32d5cdc2-c4ef-40cc-85b1-526bcd827732 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:37.429469 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-32d5cdc2-c4ef-40cc-85b1-526bcd827732 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:37.430706 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-32d5cdc2-c4ef-40cc-85b1-526bcd827732 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:37.480177 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8031f2e5-5e33-42d0-825c-a903d736bea1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 204 len: 0 microversion: 2.1 time: 0.358112 Aug 04 17:15:37.484670 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2969/5821] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:15:37 2022] DELETE /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:15:37.514798 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3dde35fa-311a-4f31-a544-0fa0c1fe88da tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:37.522710 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3dde35fa-311a-4f31-a544-0fa0c1fe88da tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:37.561570 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3dde35fa-311a-4f31-a544-0fa0c1fe88da tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:37.562196 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3dde35fa-311a-4f31-a544-0fa0c1fe88da tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:37.563038 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3dde35fa-311a-4f31-a544-0fa0c1fe88da tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:37.565036 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3dde35fa-311a-4f31-a544-0fa0c1fe88da tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:37.824790 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-32d5cdc2-c4ef-40cc-85b1-526bcd827732 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:37.837400 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-32d5cdc2-c4ef-40cc-85b1-526bcd827732 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1325 microversion: 2.1 time: 0.446641 Aug 04 17:15:37.841204 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2853/5822] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:37 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1325 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:15:37.888664 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3dde35fa-311a-4f31-a544-0fa0c1fe88da tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:37.899575 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3dde35fa-311a-4f31-a544-0fa0c1fe88da tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 200 len: 1578 microversion: 2.1 time: 0.410589 Aug 04 17:15:37.900864 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2970/5823] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:37 2022] GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 1578 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:38.865969 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5e286cd5-2d3c-48b4-93f5-de1dded42280 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:38.866971 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5e286cd5-2d3c-48b4-93f5-de1dded42280 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:38.880630 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e286cd5-2d3c-48b4-93f5-de1dded42280 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:38.880630 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e286cd5-2d3c-48b4-93f5-de1dded42280 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:38.880630 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e286cd5-2d3c-48b4-93f5-de1dded42280 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:38.880630 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e286cd5-2d3c-48b4-93f5-de1dded42280 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:38.927972 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9dfa92af-b641-4a4c-92bb-314808b29b72 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:38.929053 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9dfa92af-b641-4a4c-92bb-314808b29b72 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:38.952341 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9dfa92af-b641-4a4c-92bb-314808b29b72 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:38.956058 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9dfa92af-b641-4a4c-92bb-314808b29b72 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:38.958409 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9dfa92af-b641-4a4c-92bb-314808b29b72 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:38.960405 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9dfa92af-b641-4a4c-92bb-314808b29b72 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:39.247463 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5e286cd5-2d3c-48b4-93f5-de1dded42280 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:39.275700 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5e286cd5-2d3c-48b4-93f5-de1dded42280 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1325 microversion: 2.1 time: 0.414187 Aug 04 17:15:39.276849 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2854/5824] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:38 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1325 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:39.566349 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9dfa92af-b641-4a4c-92bb-314808b29b72 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:39.579375 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9dfa92af-b641-4a4c-92bb-314808b29b72 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 200 len: 1578 microversion: 2.1 time: 0.654729 Aug 04 17:15:39.581857 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2971/5825] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:38 2022] GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 1578 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:40.310122 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2c59974f-da15-4162-84d7-945d82ca20f5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:40.310927 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2c59974f-da15-4162-84d7-945d82ca20f5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:40.328927 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2c59974f-da15-4162-84d7-945d82ca20f5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:40.330892 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2c59974f-da15-4162-84d7-945d82ca20f5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:40.334006 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2c59974f-da15-4162-84d7-945d82ca20f5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:40.334839 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2c59974f-da15-4162-84d7-945d82ca20f5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:40.616813 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5ba9ec4a-93f0-4f21-9aae-bdb444dbc3ea tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:40.618257 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5ba9ec4a-93f0-4f21-9aae-bdb444dbc3ea tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:40.644111 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ba9ec4a-93f0-4f21-9aae-bdb444dbc3ea tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:40.644868 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ba9ec4a-93f0-4f21-9aae-bdb444dbc3ea tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:40.645875 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ba9ec4a-93f0-4f21-9aae-bdb444dbc3ea tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:40.650703 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ba9ec4a-93f0-4f21-9aae-bdb444dbc3ea tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:41.366268 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5ba9ec4a-93f0-4f21-9aae-bdb444dbc3ea tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:41.379012 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5ba9ec4a-93f0-4f21-9aae-bdb444dbc3ea tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 200 len: 1578 microversion: 2.1 time: 0.776868 Aug 04 17:15:41.380867 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2972/5826] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:40 2022] GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 1578 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:15:41.455216 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2c59974f-da15-4162-84d7-945d82ca20f5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:41.464465 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2c59974f-da15-4162-84d7-945d82ca20f5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1392 microversion: 2.1 time: 1.158308 Aug 04 17:15:41.469035 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2855/5827] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:40 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1392 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:42.330240 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-6b340a22-c0b7-4fcf-b8ba-5f4785f86807 req-057bbd43-795c-4272-b87f-dd584c2f5b8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ad652c1-0763-405a-8cf9-2560bab1df4c", "name": "network-vif-deleted", "tag": "c22976c8-ed27-4b47-8acb-123754158502"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:42.381671 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6b340a22-c0b7-4fcf-b8ba-5f4785f86807 req-057bbd43-795c-4272-b87f-dd584c2f5b8d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:42.387192 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6b340a22-c0b7-4fcf-b8ba-5f4785f86807 req-057bbd43-795c-4272-b87f-dd584c2f5b8d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:42.411115 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-6b340a22-c0b7-4fcf-b8ba-5f4785f86807 req-057bbd43-795c-4272-b87f-dd584c2f5b8d service nova] Creating event network-vif-deleted:c22976c8-ed27-4b47-8acb-123754158502 for instance 0ad652c1-0763-405a-8cf9-2560bab1df4c on n-h2-846466-12 Aug 04 17:15:42.427866 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-6b340a22-c0b7-4fcf-b8ba-5f4785f86807 req-057bbd43-795c-4272-b87f-dd584c2f5b8d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193191 Aug 04 17:15:42.430664 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2973/5828] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:42.494560 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-765ec156-c527-4b10-a6b8-b999f3c6d46b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:42.495646 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-765ec156-c527-4b10-a6b8-b999f3c6d46b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:42.518149 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-765ec156-c527-4b10-a6b8-b999f3c6d46b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:42.524945 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-765ec156-c527-4b10-a6b8-b999f3c6d46b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:42.527596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-765ec156-c527-4b10-a6b8-b999f3c6d46b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:42.528367 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-765ec156-c527-4b10-a6b8-b999f3c6d46b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:42.896412 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6c7caad0-5911-43f4-a658-232afc33fc7e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:42.897112 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6c7caad0-5911-43f4-a658-232afc33fc7e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:42.924468 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c7caad0-5911-43f4-a658-232afc33fc7e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:42.926490 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c7caad0-5911-43f4-a658-232afc33fc7e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:42.931463 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c7caad0-5911-43f4-a658-232afc33fc7e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:42.932126 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6c7caad0-5911-43f4-a658-232afc33fc7e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:43.514551 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6c7caad0-5911-43f4-a658-232afc33fc7e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:43.531994 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6c7caad0-5911-43f4-a658-232afc33fc7e tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 200 len: 1226 microversion: 2.1 time: 1.134066 Aug 04 17:15:43.535702 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2856/5829] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:42 2022] GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 1226 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:44.165194 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-b6377a73-1df1-4b84-89c1-3b7b29e9263f req-57762c6f-39f8-4f2b-be57-4aca891818e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "274b5c58-9bd5-4fd0-8e51-8e52623be12c", "tag": "2cb3c423-6a6f-4b14-9715-f2909f91e90d"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:44.219488 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-b6377a73-1df1-4b84-89c1-3b7b29e9263f req-57762c6f-39f8-4f2b-be57-4aca891818e9 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:44.219961 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-b6377a73-1df1-4b84-89c1-3b7b29e9263f req-57762c6f-39f8-4f2b-be57-4aca891818e9 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:44.256255 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-765ec156-c527-4b10-a6b8-b999f3c6d46b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:44.270766 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-765ec156-c527-4b10-a6b8-b999f3c6d46b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1392 microversion: 2.1 time: 1.784838 Aug 04 17:15:44.284747 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2974/5830] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:42 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1392 bytes in 1800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:15:44.304388 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-b6377a73-1df1-4b84-89c1-3b7b29e9263f req-57762c6f-39f8-4f2b-be57-4aca891818e9 service nova] Creating event network-changed:2cb3c423-6a6f-4b14-9715-f2909f91e90d for instance 274b5c58-9bd5-4fd0-8e51-8e52623be12c on n-h2-846466-12 Aug 04 17:15:44.342215 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-b6377a73-1df1-4b84-89c1-3b7b29e9263f req-57762c6f-39f8-4f2b-be57-4aca891818e9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182662 Aug 04 17:15:44.347474 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2857/5831] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:44.556746 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4f4a047c-75ea-4c87-bdc5-62b71f6e68d7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:44.557570 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4f4a047c-75ea-4c87-bdc5-62b71f6e68d7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:44.569418 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4f4a047c-75ea-4c87-bdc5-62b71f6e68d7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:44.575232 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4f4a047c-75ea-4c87-bdc5-62b71f6e68d7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:44.576565 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4f4a047c-75ea-4c87-bdc5-62b71f6e68d7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:44.577475 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4f4a047c-75ea-4c87-bdc5-62b71f6e68d7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:44.827924 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4f4a047c-75ea-4c87-bdc5-62b71f6e68d7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:44.870603 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4f4a047c-75ea-4c87-bdc5-62b71f6e68d7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 200 len: 1226 microversion: 2.1 time: 0.317140 Aug 04 17:15:44.876470 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2975/5832] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:44 2022] GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 1226 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:45.307075 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c62c5e3a-9781-47d0-8b92-8198ee80123f tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:45.308454 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c62c5e3a-9781-47d0-8b92-8198ee80123f tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:45.312146 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:45.320083 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:45.345178 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c62c5e3a-9781-47d0-8b92-8198ee80123f tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:45.346159 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c62c5e3a-9781-47d0-8b92-8198ee80123f tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:45.347612 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c62c5e3a-9781-47d0-8b92-8198ee80123f tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:45.348337 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c62c5e3a-9781-47d0-8b92-8198ee80123f tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:45.906584 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a6203855-2311-4cef-bcef-67d6e11dfbba tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:45.909725 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a6203855-2311-4cef-bcef-67d6e11dfbba tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:45.918117 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:45.928590 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6203855-2311-4cef-bcef-67d6e11dfbba tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:45.929873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6203855-2311-4cef-bcef-67d6e11dfbba tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:45.932003 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6203855-2311-4cef-bcef-67d6e11dfbba tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:45.933254 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a6203855-2311-4cef-bcef-67d6e11dfbba tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:46.175544 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c62c5e3a-9781-47d0-8b92-8198ee80123f tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:46.187065 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c62c5e3a-9781-47d0-8b92-8198ee80123f tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1392 microversion: 2.1 time: 0.885496 Aug 04 17:15:46.208655 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a6203855-2311-4cef-bcef-67d6e11dfbba tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:46.221426 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2858/5833] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:45 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1392 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:46.222957 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a6203855-2311-4cef-bcef-67d6e11dfbba tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 200 len: 1226 microversion: 2.1 time: 0.321080 Aug 04 17:15:46.233481 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2976/5834] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:45 2022] GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 1226 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:15:46.524970 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0c030a0e-652f-4023-b90f-f75f4da5ddb5 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Action: 'create', calling method: .version_select at 0x7f7e89c795e0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-645596772", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJg3bUJk0xhgOFt7pzL43/O7UQBQuFZMGhx6wuPPTyOx7c+vJr3y3eutV19RuFnQ82vVn5DBFNdLFlXGXGfcTv+haOn7EMcsGKQitBxm7RYUfAXr3j2EeUFltMDAo1Wcg=="}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:46.562880 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-0c030a0e-652f-4023-b90f-f75f4da5ddb5 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Getting quotas for project f2dc5d0512d34a47b06925edfebfce57. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:15:46.577826 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-0c030a0e-652f-4023-b90f-f75f4da5ddb5 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Getting quotas for user 208d51c5701647a39b2ee6a3b999fe27 and project f2dc5d0512d34a47b06925edfebfce57. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:15:46.708800 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0c030a0e-652f-4023-b90f-f75f4da5ddb5 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.188946 Aug 04 17:15:46.713274 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2859/5835] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 17:15:46 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:47.228350 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-73d040b5-878f-4f23-8fdb-3e3f3a2cb67d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:47.229608 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-73d040b5-878f-4f23-8fdb-3e3f3a2cb67d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:47.244513 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7691e10e-3c2b-44ac-92ef-fc7ed2afde4a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:47.245215 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7691e10e-3c2b-44ac-92ef-fc7ed2afde4a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:47.263540 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7691e10e-3c2b-44ac-92ef-fc7ed2afde4a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:47.267855 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7691e10e-3c2b-44ac-92ef-fc7ed2afde4a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:47.273873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-73d040b5-878f-4f23-8fdb-3e3f3a2cb67d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:47.275969 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7691e10e-3c2b-44ac-92ef-fc7ed2afde4a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:47.279536 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-73d040b5-878f-4f23-8fdb-3e3f3a2cb67d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:47.280257 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7691e10e-3c2b-44ac-92ef-fc7ed2afde4a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:47.286616 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-73d040b5-878f-4f23-8fdb-3e3f3a2cb67d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:47.288064 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-73d040b5-878f-4f23-8fdb-3e3f3a2cb67d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:47.647003 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7691e10e-3c2b-44ac-92ef-fc7ed2afde4a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:47.673759 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7691e10e-3c2b-44ac-92ef-fc7ed2afde4a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 200 len: 1226 microversion: 2.1 time: 0.432650 Aug 04 17:15:47.683475 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2860/5836] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:47 2022] GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 1226 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:48.277246 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-73d040b5-878f-4f23-8fdb-3e3f3a2cb67d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:48.286817 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-73d040b5-878f-4f23-8fdb-3e3f3a2cb67d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1392 microversion: 2.1 time: 1.065129 Aug 04 17:15:48.290040 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2977/5837] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:47 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1392 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:48.708423 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d586a591-e0c1-4fb0-8451-960ac435056a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:48.709035 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d586a591-e0c1-4fb0-8451-960ac435056a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:48.741417 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d586a591-e0c1-4fb0-8451-960ac435056a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:48.741890 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d586a591-e0c1-4fb0-8451-960ac435056a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:48.742692 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d586a591-e0c1-4fb0-8451-960ac435056a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:48.743136 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d586a591-e0c1-4fb0-8451-960ac435056a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:49.094989 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d586a591-e0c1-4fb0-8451-960ac435056a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:49.110843 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d586a591-e0c1-4fb0-8451-960ac435056a tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 200 len: 1226 microversion: 2.1 time: 0.406401 Aug 04 17:15:49.112264 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2861/5838] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:48 2022] GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 1226 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:49.310575 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cdc2449e-af5c-4878-9a05-f78039e1ebe1 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:49.311101 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cdc2449e-af5c-4878-9a05-f78039e1ebe1 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:49.335684 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cdc2449e-af5c-4878-9a05-f78039e1ebe1 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:49.335958 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cdc2449e-af5c-4878-9a05-f78039e1ebe1 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:49.336758 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cdc2449e-af5c-4878-9a05-f78039e1ebe1 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:49.337195 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cdc2449e-af5c-4878-9a05-f78039e1ebe1 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:50.133545 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0fe01bcc-65b2-4095-8fca-78c9604c7f31 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:50.134112 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0fe01bcc-65b2-4095-8fca-78c9604c7f31 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:50.162942 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0fe01bcc-65b2-4095-8fca-78c9604c7f31 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:50.163497 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0fe01bcc-65b2-4095-8fca-78c9604c7f31 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:50.165936 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0fe01bcc-65b2-4095-8fca-78c9604c7f31 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:50.166396 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0fe01bcc-65b2-4095-8fca-78c9604c7f31 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:50.379465 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0fe01bcc-65b2-4095-8fca-78c9604c7f31 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:50.390011 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0fe01bcc-65b2-4095-8fca-78c9604c7f31 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 200 len: 1226 microversion: 2.1 time: 0.261645 Aug 04 17:15:50.395851 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2862/5839] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:50 2022] GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 1226 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:50.407385 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cdc2449e-af5c-4878-9a05-f78039e1ebe1 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:50.417627 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cdc2449e-af5c-4878-9a05-f78039e1ebe1 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1392 microversion: 2.1 time: 1.111112 Aug 04 17:15:50.418669 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2978/5840] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:49 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1392 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:50.757765 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6d1c5f20-5cc9-4f86-b2f5-627525a2ddd8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1032232113", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "3c5b1995-5535-4513-ac64-3a122e4aec28"}], "key_name": "tempest-TestNetworkBasicOps-645596772", "security_groups": [{"name": "tempest-secgroup-smoke-605569213"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:51.046011 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-6d1c5f20-5cc9-4f86-b2f5-627525a2ddd8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] validate_networks() for [('3c5b1995-5535-4513-ac64-3a122e4aec28', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:15:51.418117 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4a622a0a-dce4-4787-ba65-9b9a9d25dca7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:51.419985 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4a622a0a-dce4-4787-ba65-9b9a9d25dca7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:51.481311 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4a622a0a-dce4-4787-ba65-9b9a9d25dca7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:51.488420 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4a622a0a-dce4-4787-ba65-9b9a9d25dca7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:51.489836 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4a622a0a-dce4-4787-ba65-9b9a9d25dca7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:51.492030 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4a622a0a-dce4-4787-ba65-9b9a9d25dca7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:51.639742 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4a622a0a-dce4-4787-ba65-9b9a9d25dca7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:51.664970 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4a622a0a-dce4-4787-ba65-9b9a9d25dca7 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 200 len: 1226 microversion: 2.1 time: 0.248723 Aug 04 17:15:51.665670 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2979/5841] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:51 2022] GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 1226 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:51.703318 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d28332cd-ed07-4afb-82a1-b4d562d7e833 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:51.713989 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d28332cd-ed07-4afb-82a1-b4d562d7e833 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:51.732262 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d28332cd-ed07-4afb-82a1-b4d562d7e833 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:51.732868 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d28332cd-ed07-4afb-82a1-b4d562d7e833 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:51.742834 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d28332cd-ed07-4afb-82a1-b4d562d7e833 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:51.743327 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d28332cd-ed07-4afb-82a1-b4d562d7e833 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:52.323612 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d28332cd-ed07-4afb-82a1-b4d562d7e833 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:52.340974 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-6d1c5f20-5cc9-4f86-b2f5-627525a2ddd8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:15:52.341517 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-6d1c5f20-5cc9-4f86-b2f5-627525a2ddd8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:15:52.341958 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-6d1c5f20-5cc9-4f86-b2f5-627525a2ddd8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:15:52.342382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-6d1c5f20-5cc9-4f86-b2f5-627525a2ddd8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:15:52.342847 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-6d1c5f20-5cc9-4f86-b2f5-627525a2ddd8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:15:52.342954 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d28332cd-ed07-4afb-82a1-b4d562d7e833 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1392 microversion: 2.1 time: 0.654567 Aug 04 17:15:52.343812 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2980/5842] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:51 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1392 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:52.372476 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d1c5f20-5cc9-4f86-b2f5-627525a2ddd8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:52.372855 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d1c5f20-5cc9-4f86-b2f5-627525a2ddd8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:52.373806 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d1c5f20-5cc9-4f86-b2f5-627525a2ddd8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:52.374264 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d1c5f20-5cc9-4f86-b2f5-627525a2ddd8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:52.408623 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-6d1c5f20-5cc9-4f86-b2f5-627525a2ddd8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Getting quotas for project f2dc5d0512d34a47b06925edfebfce57. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:15:52.421767 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-6d1c5f20-5cc9-4f86-b2f5-627525a2ddd8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Getting quotas for user 208d51c5701647a39b2ee6a3b999fe27 and project f2dc5d0512d34a47b06925edfebfce57. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:15:52.468615 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6d1c5f20-5cc9-4f86-b2f5-627525a2ddd8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:15:52.480245 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6d1c5f20-5cc9-4f86-b2f5-627525a2ddd8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e01342e9-793f-4810-adfe-4d2803167d04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:15:52.607519 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6d1c5f20-5cc9-4f86-b2f5-627525a2ddd8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.854043 Aug 04 17:15:52.610516 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2863/5843] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:15:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 1858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:15:52.619870 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-07c63220-5463-42b5-a034-e882d92b7d00 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:52.622116 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-07c63220-5463-42b5-a034-e882d92b7d00 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e01342e9-793f-4810-adfe-4d2803167d04] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:52.689370 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b7b52715-00c4-4304-8995-d6a9f0e0f9e1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:52.690374 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b7b52715-00c4-4304-8995-d6a9f0e0f9e1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:52.707405 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7b52715-00c4-4304-8995-d6a9f0e0f9e1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:52.708212 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7b52715-00c4-4304-8995-d6a9f0e0f9e1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:52.709300 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7b52715-00c4-4304-8995-d6a9f0e0f9e1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:52.709952 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7b52715-00c4-4304-8995-d6a9f0e0f9e1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:52.731802 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-07c63220-5463-42b5-a034-e882d92b7d00 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:52.742791 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-07c63220-5463-42b5-a034-e882d92b7d00 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/e01342e9-793f-4810-adfe-4d2803167d04" status: 200 len: 1248 microversion: 2.1 time: 0.127179 Aug 04 17:15:52.750003 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2981/5844] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:52 2022] GET /compute/v2.1/servers/e01342e9-793f-4810-adfe-4d2803167d04 => generated 1248 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:52.888805 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b7b52715-00c4-4304-8995-d6a9f0e0f9e1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:52.920970 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b7b52715-00c4-4304-8995-d6a9f0e0f9e1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 200 len: 1226 microversion: 2.1 time: 0.237123 Aug 04 17:15:52.929776 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2864/5845] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:52 2022] GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 1226 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:15:53.364888 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bdefca71-62bf-4fb7-82a2-67f5f5d45ecd tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:53.365895 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bdefca71-62bf-4fb7-82a2-67f5f5d45ecd tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:53.382597 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bdefca71-62bf-4fb7-82a2-67f5f5d45ecd tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:53.383507 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bdefca71-62bf-4fb7-82a2-67f5f5d45ecd tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:53.384508 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bdefca71-62bf-4fb7-82a2-67f5f5d45ecd tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:53.387428 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bdefca71-62bf-4fb7-82a2-67f5f5d45ecd tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:53.600979 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-56adfb92-1a87-4c8a-ad80-39013a3fb0a6 req-c8a1816c-34a6-44d3-b13b-4adf687435ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "274b5c58-9bd5-4fd0-8e51-8e52623be12c", "name": "network-vif-plugged", "status": "completed", "tag": "2cb3c423-6a6f-4b14-9715-f2909f91e90d"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:53.651642 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-56adfb92-1a87-4c8a-ad80-39013a3fb0a6 req-c8a1816c-34a6-44d3-b13b-4adf687435ae service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:53.659433 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-56adfb92-1a87-4c8a-ad80-39013a3fb0a6 req-c8a1816c-34a6-44d3-b13b-4adf687435ae service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:53.704283 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bdefca71-62bf-4fb7-82a2-67f5f5d45ecd tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:53.719299 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-56adfb92-1a87-4c8a-ad80-39013a3fb0a6 req-c8a1816c-34a6-44d3-b13b-4adf687435ae service nova] Creating event network-vif-plugged:2cb3c423-6a6f-4b14-9715-f2909f91e90d for instance 274b5c58-9bd5-4fd0-8e51-8e52623be12c on n-h2-846466-12 Aug 04 17:15:53.738965 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bdefca71-62bf-4fb7-82a2-67f5f5d45ecd tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1392 microversion: 2.1 time: 0.366958 Aug 04 17:15:53.742529 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2982/5846] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:53 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1392 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:53.755260 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-56adfb92-1a87-4c8a-ad80-39013a3fb0a6 req-c8a1816c-34a6-44d3-b13b-4adf687435ae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170667 Aug 04 17:15:53.763834 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2865/5847] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:15:53.772427 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c494b87f-281d-4b55-a023-a997150e7461 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:53.773055 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c494b87f-281d-4b55-a023-a997150e7461 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e01342e9-793f-4810-adfe-4d2803167d04] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:53.832598 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c494b87f-281d-4b55-a023-a997150e7461 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:53.833902 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c494b87f-281d-4b55-a023-a997150e7461 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:53.835098 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c494b87f-281d-4b55-a023-a997150e7461 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:53.835686 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c494b87f-281d-4b55-a023-a997150e7461 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:53.952071 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-39f27a82-2665-4892-ad65-5f9e9b9242ef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:53.952949 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-39f27a82-2665-4892-ad65-5f9e9b9242ef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:53.983773 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39f27a82-2665-4892-ad65-5f9e9b9242ef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:53.985236 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39f27a82-2665-4892-ad65-5f9e9b9242ef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:53.986503 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39f27a82-2665-4892-ad65-5f9e9b9242ef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:53.987187 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39f27a82-2665-4892-ad65-5f9e9b9242ef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:54.061878 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c494b87f-281d-4b55-a023-a997150e7461 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:54.065632 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39f27a82-2665-4892-ad65-5f9e9b9242ef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:54.066366 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39f27a82-2665-4892-ad65-5f9e9b9242ef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:54.067034 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-39f27a82-2665-4892-ad65-5f9e9b9242ef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lazy-loading 'fault' on Instance uuid 0ad652c1-0763-405a-8cf9-2560bab1df4c {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:15:54.081141 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c494b87f-281d-4b55-a023-a997150e7461 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/e01342e9-793f-4810-adfe-4d2803167d04" status: 200 len: 1244 microversion: 2.1 time: 0.312529 Aug 04 17:15:54.083306 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2983/5848] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:53 2022] GET /compute/v2.1/servers/e01342e9-793f-4810-adfe-4d2803167d04 => generated 1244 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:54.116720 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-39f27a82-2665-4892-ad65-5f9e9b9242ef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:54.124669 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-39f27a82-2665-4892-ad65-5f9e9b9242ef tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 200 len: 1185 microversion: 2.1 time: 0.176972 Aug 04 17:15:54.141099 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2866/5849] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:53 2022] GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 1185 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:15:54.766842 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-47462fce-c472-46cd-b528-c23fa700bb2a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:54.767540 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-47462fce-c472-46cd-b528-c23fa700bb2a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:54.788135 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-47462fce-c472-46cd-b528-c23fa700bb2a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:54.795235 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-47462fce-c472-46cd-b528-c23fa700bb2a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:54.799236 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-47462fce-c472-46cd-b528-c23fa700bb2a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:54.804802 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-47462fce-c472-46cd-b528-c23fa700bb2a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:55.107596 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e1698946-f5b2-43b8-acb1-bf9f4c8a6626 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:55.107964 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e1698946-f5b2-43b8-acb1-bf9f4c8a6626 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e01342e9-793f-4810-adfe-4d2803167d04] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:55.123373 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e1698946-f5b2-43b8-acb1-bf9f4c8a6626 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:55.125779 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e1698946-f5b2-43b8-acb1-bf9f4c8a6626 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:55.127778 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e1698946-f5b2-43b8-acb1-bf9f4c8a6626 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:55.128554 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e1698946-f5b2-43b8-acb1-bf9f4c8a6626 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:55.341470 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-47462fce-c472-46cd-b528-c23fa700bb2a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:55.362817 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-47462fce-c472-46cd-b528-c23fa700bb2a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1392 microversion: 2.1 time: 0.600551 Aug 04 17:15:55.364109 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2984/5850] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:54 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1392 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:55.370324 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5ffa1fb2-1f7c-4dc1-8dab-4739eff0dfac tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:55.373217 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5ffa1fb2-1f7c-4dc1-8dab-4739eff0dfac tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 0ad652c1-0763-405a-8cf9-2560bab1df4c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:55.391566 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e1698946-f5b2-43b8-acb1-bf9f4c8a6626 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:55.402265 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ffa1fb2-1f7c-4dc1-8dab-4739eff0dfac tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:55.406120 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e1698946-f5b2-43b8-acb1-bf9f4c8a6626 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/e01342e9-793f-4810-adfe-4d2803167d04" status: 200 len: 1306 microversion: 2.1 time: 0.305426 Aug 04 17:15:55.408163 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ffa1fb2-1f7c-4dc1-8dab-4739eff0dfac tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:55.417655 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2867/5851] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:55 2022] GET /compute/v2.1/servers/e01342e9-793f-4810-adfe-4d2803167d04 => generated 1306 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:55.419692 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ffa1fb2-1f7c-4dc1-8dab-4739eff0dfac tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:55.420335 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ffa1fb2-1f7c-4dc1-8dab-4739eff0dfac tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:55.442938 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-5ffa1fb2-1f7c-4dc1-8dab-4739eff0dfac tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] HTTP exception thrown: Instance 0ad652c1-0763-405a-8cf9-2560bab1df4c could not be found. Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5ffa1fb2-1f7c-4dc1-8dab-4739eff0dfac tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Request method failure captured: Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c HTTP/1.1 Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_saEEOyGnjC2YSw5rO0XXZ0SIXFPgcyNqjoEnoWtNKNr9NN9-nC4VrXak9kuQQxq1he9punHwiXqtbTRNS_i0OM4UCS6bcDxdgTY6YMq4AHl3lv7jEdWuqMUDAU4k5OfnQSgkMml4THPPXJh4YiohQx-XVMfF21_bM4MqtZQZ4iEBI Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 78a0adb69ba24749817a8855effc20ad Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78a0adb69ba24749817a8855effc20ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_78a0adb69ba24749817a8855effc20ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78a0adb69ba24749817a8855effc20ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/78a0adb69ba24749817a8855effc20ad"}]}] Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 78a0adb69ba24749817a8855effc20ad Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-TestVolumeBootPattern-1920412406-project Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: ea9cab1c1eff47ddb881a2b57bf240f3 Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-TestVolumeBootPattern-1920412406-project Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 0ad652c1-0763-405a-8cf9-2560bab1df4c could not be found. Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '0ad652c1-0763-405a-8cf9-2560bab1df4c'} Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ad652c1-0763-405a-8cf9-2560bab1df4c could not be found. Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ad652c1-0763-405a-8cf9-2560bab1df4c could not be found. Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:55.452975 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:15:55.457639 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:55.457639 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:55.457639 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:55.457639 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:15:55.457639 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:15:55.457639 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ad652c1-0763-405a-8cf9-2560bab1df4c could not be found. Aug 04 17:15:55.457639 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:15:55.467461 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5ffa1fb2-1f7c-4dc1-8dab-4739eff0dfac tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Returning 404 to user: Instance 0ad652c1-0763-405a-8cf9-2560bab1df4c could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:15:55.478525 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5ffa1fb2-1f7c-4dc1-8dab-4739eff0dfac tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c" status: 404 len: 111 microversion: 2.1 time: 0.113051 Aug 04 17:15:55.479407 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2985/5852] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:55 2022] GET /compute/v2.1/servers/0ad652c1-0763-405a-8cf9-2560bab1df4c => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:15:56.388868 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f6f8bc57-2d3f-42a9-81e7-535488d07fc5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:56.389586 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f6f8bc57-2d3f-42a9-81e7-535488d07fc5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:56.405172 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6f8bc57-2d3f-42a9-81e7-535488d07fc5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:56.405811 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6f8bc57-2d3f-42a9-81e7-535488d07fc5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:56.407354 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6f8bc57-2d3f-42a9-81e7-535488d07fc5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:56.407915 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6f8bc57-2d3f-42a9-81e7-535488d07fc5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:56.441685 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-db43cfa7-9f28-4328-b351-eac272b5ea20 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:56.442305 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-db43cfa7-9f28-4328-b351-eac272b5ea20 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e01342e9-793f-4810-adfe-4d2803167d04] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:56.445648 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:56.465053 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-db43cfa7-9f28-4328-b351-eac272b5ea20 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:56.465535 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-db43cfa7-9f28-4328-b351-eac272b5ea20 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:56.482040 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-db43cfa7-9f28-4328-b351-eac272b5ea20 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:56.492462 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-db43cfa7-9f28-4328-b351-eac272b5ea20 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:56.516274 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:57.213496 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f6f8bc57-2d3f-42a9-81e7-535488d07fc5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:57.238665 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f6f8bc57-2d3f-42a9-81e7-535488d07fc5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1564 microversion: 2.1 time: 0.854737 Aug 04 17:15:57.257029 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-db43cfa7-9f28-4328-b351-eac272b5ea20 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:57.278058 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2868/5853] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:56 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1564 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:57.284600 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-db43cfa7-9f28-4328-b351-eac272b5ea20 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/e01342e9-793f-4810-adfe-4d2803167d04" status: 200 len: 1373 microversion: 2.1 time: 0.845605 Aug 04 17:15:57.294693 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2986/5854] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:56 2022] GET /compute/v2.1/servers/e01342e9-793f-4810-adfe-4d2803167d04 => generated 1373 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:57.308074 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-58e8bba9-1529-4cd1-8349-db9def657e6a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:57.309259 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-58e8bba9-1529-4cd1-8349-db9def657e6a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:57.322970 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58e8bba9-1529-4cd1-8349-db9def657e6a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:57.323532 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58e8bba9-1529-4cd1-8349-db9def657e6a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:57.324515 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58e8bba9-1529-4cd1-8349-db9def657e6a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:57.326475 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58e8bba9-1529-4cd1-8349-db9def657e6a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:57.659474 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-58e8bba9-1529-4cd1-8349-db9def657e6a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:57.668112 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-58e8bba9-1529-4cd1-8349-db9def657e6a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1564 microversion: 2.1 time: 0.383286 Aug 04 17:15:57.674513 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2869/5855] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:57 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1564 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:58.315661 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c81c703d-0981-4dbc-8387-d8836c5e6566 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:58.316401 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c81c703d-0981-4dbc-8387-d8836c5e6566 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e01342e9-793f-4810-adfe-4d2803167d04] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:58.333111 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c81c703d-0981-4dbc-8387-d8836c5e6566 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:58.339564 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c81c703d-0981-4dbc-8387-d8836c5e6566 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:58.340920 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c81c703d-0981-4dbc-8387-d8836c5e6566 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:58.342633 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c81c703d-0981-4dbc-8387-d8836c5e6566 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:58.895804 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c81c703d-0981-4dbc-8387-d8836c5e6566 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:58.907122 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c81c703d-0981-4dbc-8387-d8836c5e6566 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/e01342e9-793f-4810-adfe-4d2803167d04" status: 200 len: 1373 microversion: 2.1 time: 0.595976 Aug 04 17:15:58.909681 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2987/5856] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:58 2022] GET /compute/v2.1/servers/e01342e9-793f-4810-adfe-4d2803167d04 => generated 1373 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:59.683923 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-a944d9e4-0067-46e1-b1a8-951653ed1d98 req-cbd16010-6ce4-4d1b-b88e-de935e446ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e01342e9-793f-4810-adfe-4d2803167d04", "tag": "9666cdc6-5dd8-4e03-8516-12e069551413"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:59.726921 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a944d9e4-0067-46e1-b1a8-951653ed1d98 req-cbd16010-6ce4-4d1b-b88e-de935e446ce6 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:59.729396 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a944d9e4-0067-46e1-b1a8-951653ed1d98 req-cbd16010-6ce4-4d1b-b88e-de935e446ce6 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:59.777115 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-a944d9e4-0067-46e1-b1a8-951653ed1d98 req-cbd16010-6ce4-4d1b-b88e-de935e446ce6 service nova] Creating event network-changed:9666cdc6-5dd8-4e03-8516-12e069551413 for instance e01342e9-793f-4810-adfe-4d2803167d04 on n-h1-846466-12 Aug 04 17:15:59.815437 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-a944d9e4-0067-46e1-b1a8-951653ed1d98 req-cbd16010-6ce4-4d1b-b88e-de935e446ce6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138096 Aug 04 17:15:59.822547 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2870/5857] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:59.941438 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8cd40852-84cb-4467-8e56-df20d4d1b672 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:59.942726 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8cd40852-84cb-4467-8e56-df20d4d1b672 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e01342e9-793f-4810-adfe-4d2803167d04] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:59.967476 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8cd40852-84cb-4467-8e56-df20d4d1b672 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:59.968122 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8cd40852-84cb-4467-8e56-df20d4d1b672 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:15:59.970103 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8cd40852-84cb-4467-8e56-df20d4d1b672 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:15:59.979469 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8cd40852-84cb-4467-8e56-df20d4d1b672 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:01.502231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8cd40852-84cb-4467-8e56-df20d4d1b672 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:01.540956 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8cd40852-84cb-4467-8e56-df20d4d1b672 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/e01342e9-793f-4810-adfe-4d2803167d04" status: 200 len: 1373 microversion: 2.1 time: 1.590596 Aug 04 17:16:01.549783 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2988/5858] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:59 2022] GET /compute/v2.1/servers/e01342e9-793f-4810-adfe-4d2803167d04 => generated 1373 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:02.598594 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0268cc5a-5bd2-4e0e-b6e8-bc6d0a50469b tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:02.600086 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0268cc5a-5bd2-4e0e-b6e8-bc6d0a50469b tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e01342e9-793f-4810-adfe-4d2803167d04] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:02.615591 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:16:02.617127 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=10 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:16:02.623025 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0268cc5a-5bd2-4e0e-b6e8-bc6d0a50469b tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:02.623850 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0268cc5a-5bd2-4e0e-b6e8-bc6d0a50469b tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:02.630006 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0268cc5a-5bd2-4e0e-b6e8-bc6d0a50469b tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:02.630774 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0268cc5a-5bd2-4e0e-b6e8-bc6d0a50469b tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:02.644704 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=100 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:16:04.484485 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0268cc5a-5bd2-4e0e-b6e8-bc6d0a50469b tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:04.502656 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0268cc5a-5bd2-4e0e-b6e8-bc6d0a50469b tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/e01342e9-793f-4810-adfe-4d2803167d04" status: 200 len: 1373 microversion: 2.1 time: 1.908729 Aug 04 17:16:04.519073 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2871/5859] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:02 2022] GET /compute/v2.1/servers/e01342e9-793f-4810-adfe-4d2803167d04 => generated 1373 bytes in 1926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:05.528949 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-23a3ab2d-79a5-4490-962a-e09edb5b0db3 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:05.530396 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-23a3ab2d-79a5-4490-962a-e09edb5b0db3 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e01342e9-793f-4810-adfe-4d2803167d04] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:05.541972 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:16:05.551541 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-23a3ab2d-79a5-4490-962a-e09edb5b0db3 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:05.551993 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-23a3ab2d-79a5-4490-962a-e09edb5b0db3 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:05.552798 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-23a3ab2d-79a5-4490-962a-e09edb5b0db3 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:05.553229 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-23a3ab2d-79a5-4490-962a-e09edb5b0db3 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:06.211860 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-913a999e-50e0-40f9-a3fd-ffedc72ce7d8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:06.213191 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-913a999e-50e0-40f9-a3fd-ffedc72ce7d8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:06.223905 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:16:06.231985 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-913a999e-50e0-40f9-a3fd-ffedc72ce7d8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:06.232795 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-913a999e-50e0-40f9-a3fd-ffedc72ce7d8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:06.234610 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-913a999e-50e0-40f9-a3fd-ffedc72ce7d8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:06.237899 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-913a999e-50e0-40f9-a3fd-ffedc72ce7d8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:06.336165 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-23a3ab2d-79a5-4490-962a-e09edb5b0db3 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:06.377146 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-23a3ab2d-79a5-4490-962a-e09edb5b0db3 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/e01342e9-793f-4810-adfe-4d2803167d04" status: 200 len: 1373 microversion: 2.1 time: 0.837080 Aug 04 17:16:06.386346 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2989/5860] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:05 2022] GET /compute/v2.1/servers/e01342e9-793f-4810-adfe-4d2803167d04 => generated 1373 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:16:06.396208 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-0c7d4da9-6ba0-4c26-b76a-11e82fb73820 req-75a6a8f9-eaf1-4767-8a70-66e37cbf4187 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "274b5c58-9bd5-4fd0-8e51-8e52623be12c", "tag": "2cb3c423-6a6f-4b14-9715-f2909f91e90d"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:06.435395 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-0c7d4da9-6ba0-4c26-b76a-11e82fb73820 req-75a6a8f9-eaf1-4767-8a70-66e37cbf4187 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:06.436050 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-0c7d4da9-6ba0-4c26-b76a-11e82fb73820 req-75a6a8f9-eaf1-4767-8a70-66e37cbf4187 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:06.453496 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-0c7d4da9-6ba0-4c26-b76a-11e82fb73820 req-75a6a8f9-eaf1-4767-8a70-66e37cbf4187 service nova] Creating event network-changed:2cb3c423-6a6f-4b14-9715-f2909f91e90d for instance 274b5c58-9bd5-4fd0-8e51-8e52623be12c on n-h2-846466-12 Aug 04 17:16:06.461388 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-0c7d4da9-6ba0-4c26-b76a-11e82fb73820 req-75a6a8f9-eaf1-4767-8a70-66e37cbf4187 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073335 Aug 04 17:16:06.462273 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2990/5861] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:16:06.840643 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-913a999e-50e0-40f9-a3fd-ffedc72ce7d8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:06.851841 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-913a999e-50e0-40f9-a3fd-ffedc72ce7d8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1564 microversion: 2.1 time: 0.644701 Aug 04 17:16:06.866004 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2872/5862] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:06 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1564 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:07.411891 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3fec44cf-4394-4236-86bc-9fc7fb519bbb tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:07.414041 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3fec44cf-4394-4236-86bc-9fc7fb519bbb tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e01342e9-793f-4810-adfe-4d2803167d04] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:07.441804 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3fec44cf-4394-4236-86bc-9fc7fb519bbb tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:07.445401 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3fec44cf-4394-4236-86bc-9fc7fb519bbb tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:07.447273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3fec44cf-4394-4236-86bc-9fc7fb519bbb tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:07.450168 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3fec44cf-4394-4236-86bc-9fc7fb519bbb tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:08.016083 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3fec44cf-4394-4236-86bc-9fc7fb519bbb tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:08.025259 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3fec44cf-4394-4236-86bc-9fc7fb519bbb tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/e01342e9-793f-4810-adfe-4d2803167d04" status: 200 len: 1373 microversion: 2.1 time: 0.621590 Aug 04 17:16:08.044437 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2991/5863] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:07 2022] GET /compute/v2.1/servers/e01342e9-793f-4810-adfe-4d2803167d04 => generated 1373 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:08.444740 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-00f59ab6-556a-4d08-84d3-8fc73d028c44 req-45799429-1b9d-45ff-a796-7fba4afb1239 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e01342e9-793f-4810-adfe-4d2803167d04", "name": "network-vif-plugged", "status": "completed", "tag": "9666cdc6-5dd8-4e03-8516-12e069551413"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:08.459930 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-00f59ab6-556a-4d08-84d3-8fc73d028c44 req-45799429-1b9d-45ff-a796-7fba4afb1239 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:08.460689 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-00f59ab6-556a-4d08-84d3-8fc73d028c44 req-45799429-1b9d-45ff-a796-7fba4afb1239 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:08.483823 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-00f59ab6-556a-4d08-84d3-8fc73d028c44 req-45799429-1b9d-45ff-a796-7fba4afb1239 service nova] Creating event network-vif-plugged:9666cdc6-5dd8-4e03-8516-12e069551413 for instance e01342e9-793f-4810-adfe-4d2803167d04 on n-h1-846466-12 Aug 04 17:16:08.496707 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-00f59ab6-556a-4d08-84d3-8fc73d028c44 req-45799429-1b9d-45ff-a796-7fba4afb1239 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190140 Aug 04 17:16:08.500362 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2873/5864] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:16:08.726545 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5fdac6c1-d03d-41b1-afa9-eb507b800ad3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:08.730299 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5fdac6c1-d03d-41b1-afa9-eb507b800ad3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:08.750187 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5fdac6c1-d03d-41b1-afa9-eb507b800ad3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:08.751496 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5fdac6c1-d03d-41b1-afa9-eb507b800ad3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:08.752291 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5fdac6c1-d03d-41b1-afa9-eb507b800ad3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:08.752723 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5fdac6c1-d03d-41b1-afa9-eb507b800ad3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:08.761573 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-5b5fd693-19cd-45e2-be3e-072137e6d47a req-511513c1-e4c2-47c8-bf9a-da15b06e75fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25704445-abe8-44bb-89d7-870d193deec0", "tag": "6f2c9abd-c5f4-435c-a94c-84a048ee2e9c"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:08.781091 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-5b5fd693-19cd-45e2-be3e-072137e6d47a req-511513c1-e4c2-47c8-bf9a-da15b06e75fd service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:08.787214 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-5b5fd693-19cd-45e2-be3e-072137e6d47a req-511513c1-e4c2-47c8-bf9a-da15b06e75fd service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:08.809317 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-5b5fd693-19cd-45e2-be3e-072137e6d47a req-511513c1-e4c2-47c8-bf9a-da15b06e75fd service nova] Creating event network-changed:6f2c9abd-c5f4-435c-a94c-84a048ee2e9c for instance 25704445-abe8-44bb-89d7-870d193deec0 on n-h2-846466-12 Aug 04 17:16:08.814706 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5fdac6c1-d03d-41b1-afa9-eb507b800ad3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:16:08.814935 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-5b5fd693-19cd-45e2-be3e-072137e6d47a req-511513c1-e4c2-47c8-bf9a-da15b06e75fd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058111 Aug 04 17:16:08.816389 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2874/5865] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:16:08.979477 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5fdac6c1-d03d-41b1-afa9-eb507b800ad3 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "DELETE /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 204 len: 0 microversion: 2.1 time: 0.257183 Aug 04 17:16:08.980095 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2992/5866] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:16:08 2022] DELETE /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:16:08.996135 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6d1caf2c-1a0e-42aa-827f-22dc16e792c8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:08.997674 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6d1caf2c-1a0e-42aa-827f-22dc16e792c8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:09.013017 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d1caf2c-1a0e-42aa-827f-22dc16e792c8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:09.016926 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d1caf2c-1a0e-42aa-827f-22dc16e792c8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:09.034509 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d1caf2c-1a0e-42aa-827f-22dc16e792c8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:09.035650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d1caf2c-1a0e-42aa-827f-22dc16e792c8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:09.052344 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ccbffeaf-cca6-46fc-a183-2460703cb070 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:09.053732 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ccbffeaf-cca6-46fc-a183-2460703cb070 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e01342e9-793f-4810-adfe-4d2803167d04] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:09.068008 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ccbffeaf-cca6-46fc-a183-2460703cb070 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:09.068499 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ccbffeaf-cca6-46fc-a183-2460703cb070 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:09.069341 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ccbffeaf-cca6-46fc-a183-2460703cb070 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:09.072389 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ccbffeaf-cca6-46fc-a183-2460703cb070 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:09.475458 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6d1caf2c-1a0e-42aa-827f-22dc16e792c8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:09.495761 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6d1caf2c-1a0e-42aa-827f-22dc16e792c8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1579 microversion: 2.1 time: 0.507999 Aug 04 17:16:09.496626 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2875/5867] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:08 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1579 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:09.670194 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ccbffeaf-cca6-46fc-a183-2460703cb070 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:09.682923 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ccbffeaf-cca6-46fc-a183-2460703cb070 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/e01342e9-793f-4810-adfe-4d2803167d04" status: 200 len: 1373 microversion: 2.1 time: 0.634749 Aug 04 17:16:09.693560 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2993/5868] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:09 2022] GET /compute/v2.1/servers/e01342e9-793f-4810-adfe-4d2803167d04 => generated 1373 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:10.522104 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d3ec0981-e386-494f-b562-9ded943c23e0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:10.524122 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d3ec0981-e386-494f-b562-9ded943c23e0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:10.535076 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d3ec0981-e386-494f-b562-9ded943c23e0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:10.535782 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d3ec0981-e386-494f-b562-9ded943c23e0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:10.536746 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d3ec0981-e386-494f-b562-9ded943c23e0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:10.537391 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d3ec0981-e386-494f-b562-9ded943c23e0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:10.716254 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c9d8c622-8861-4df6-b094-c69001fbc071 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:10.725191 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c9d8c622-8861-4df6-b094-c69001fbc071 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e01342e9-793f-4810-adfe-4d2803167d04] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:10.757607 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c9d8c622-8861-4df6-b094-c69001fbc071 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:10.761331 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c9d8c622-8861-4df6-b094-c69001fbc071 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:10.766148 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c9d8c622-8861-4df6-b094-c69001fbc071 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:10.766985 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c9d8c622-8861-4df6-b094-c69001fbc071 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:11.290864 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c9d8c622-8861-4df6-b094-c69001fbc071 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:11.305698 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c9d8c622-8861-4df6-b094-c69001fbc071 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/e01342e9-793f-4810-adfe-4d2803167d04" status: 200 len: 1546 microversion: 2.1 time: 0.595243 Aug 04 17:16:11.307225 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2994/5869] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:10 2022] GET /compute/v2.1/servers/e01342e9-793f-4810-adfe-4d2803167d04 => generated 1546 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:11.336553 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-eec3e31e-d969-46b2-917a-a48557a16691 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:11.337322 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-eec3e31e-d969-46b2-917a-a48557a16691 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e01342e9-793f-4810-adfe-4d2803167d04] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:11.347672 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eec3e31e-d969-46b2-917a-a48557a16691 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:11.350866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eec3e31e-d969-46b2-917a-a48557a16691 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:11.353698 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eec3e31e-d969-46b2-917a-a48557a16691 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:11.353698 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eec3e31e-d969-46b2-917a-a48557a16691 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:11.443509 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d3ec0981-e386-494f-b562-9ded943c23e0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:11.458119 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d3ec0981-e386-494f-b562-9ded943c23e0 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1579 microversion: 2.1 time: 0.937192 Aug 04 17:16:11.463968 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2876/5870] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:10 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1579 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:11.671452 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-32e65362-b349-41a0-b73b-33f3587ff3af req-1f46039b-0031-4e36-b061-fe16ca6a2668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25704445-abe8-44bb-89d7-870d193deec0", "name": "network-vif-deleted", "tag": "6f2c9abd-c5f4-435c-a94c-84a048ee2e9c"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:11.693079 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-32e65362-b349-41a0-b73b-33f3587ff3af req-1f46039b-0031-4e36-b061-fe16ca6a2668 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:11.693581 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-32e65362-b349-41a0-b73b-33f3587ff3af req-1f46039b-0031-4e36-b061-fe16ca6a2668 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:11.758734 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-32e65362-b349-41a0-b73b-33f3587ff3af req-1f46039b-0031-4e36-b061-fe16ca6a2668 service nova] Creating event network-vif-deleted:6f2c9abd-c5f4-435c-a94c-84a048ee2e9c for instance 25704445-abe8-44bb-89d7-870d193deec0 on n-h2-846466-12 Aug 04 17:16:11.765412 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-32e65362-b349-41a0-b73b-33f3587ff3af req-1f46039b-0031-4e36-b061-fe16ca6a2668 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098644 Aug 04 17:16:11.767707 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2877/5871] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:16:12.028634 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-eec3e31e-d969-46b2-917a-a48557a16691 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:12.051294 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-eec3e31e-d969-46b2-917a-a48557a16691 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/e01342e9-793f-4810-adfe-4d2803167d04" status: 200 len: 1546 microversion: 2.1 time: 0.716774 Aug 04 17:16:12.065833 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2995/5872] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:11 2022] GET /compute/v2.1/servers/e01342e9-793f-4810-adfe-4d2803167d04 => generated 1546 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:12.495144 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fbd0bd93-d0cc-4deb-8e06-a2a31a2c83e8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:12.495856 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fbd0bd93-d0cc-4deb-8e06-a2a31a2c83e8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:12.515478 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fbd0bd93-d0cc-4deb-8e06-a2a31a2c83e8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:12.515937 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fbd0bd93-d0cc-4deb-8e06-a2a31a2c83e8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:12.516721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fbd0bd93-d0cc-4deb-8e06-a2a31a2c83e8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:12.517161 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fbd0bd93-d0cc-4deb-8e06-a2a31a2c83e8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:12.677686 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fbd0bd93-d0cc-4deb-8e06-a2a31a2c83e8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:12.691831 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fbd0bd93-d0cc-4deb-8e06-a2a31a2c83e8 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1392 microversion: 2.1 time: 0.207234 Aug 04 17:16:12.692186 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2878/5873] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:12 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1392 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:16:13.713465 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-331d0836-4698-4c39-9f0c-5901ef558e88 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:13.715628 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-331d0836-4698-4c39-9f0c-5901ef558e88 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:13.740982 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-331d0836-4698-4c39-9f0c-5901ef558e88 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:13.741552 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-331d0836-4698-4c39-9f0c-5901ef558e88 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:13.743542 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-331d0836-4698-4c39-9f0c-5901ef558e88 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:13.745555 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-331d0836-4698-4c39-9f0c-5901ef558e88 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:14.047142 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-331d0836-4698-4c39-9f0c-5901ef558e88 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:14.059703 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-331d0836-4698-4c39-9f0c-5901ef558e88 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1392 microversion: 2.1 time: 0.347527 Aug 04 17:16:14.064757 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2996/5874] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:13 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1392 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:15.088393 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b0b7a27c-038c-4619-b627-0f4edf16e25d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:15.089055 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b0b7a27c-038c-4619-b627-0f4edf16e25d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:15.112827 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b0b7a27c-038c-4619-b627-0f4edf16e25d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:15.113456 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b0b7a27c-038c-4619-b627-0f4edf16e25d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:15.114423 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b0b7a27c-038c-4619-b627-0f4edf16e25d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:15.114871 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b0b7a27c-038c-4619-b627-0f4edf16e25d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:15.308531 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b0b7a27c-038c-4619-b627-0f4edf16e25d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:15.317837 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b0b7a27c-038c-4619-b627-0f4edf16e25d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1392 microversion: 2.1 time: 0.233528 Aug 04 17:16:15.318439 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2879/5875] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:15 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1392 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:16.346803 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-551717b0-f8ae-4753-bba9-7adbdf087e9d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:16.347529 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-551717b0-f8ae-4753-bba9-7adbdf087e9d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:16.366575 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-551717b0-f8ae-4753-bba9-7adbdf087e9d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:16.367963 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-551717b0-f8ae-4753-bba9-7adbdf087e9d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:16.370249 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-551717b0-f8ae-4753-bba9-7adbdf087e9d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:16.374533 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-551717b0-f8ae-4753-bba9-7adbdf087e9d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:16.515880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-551717b0-f8ae-4753-bba9-7adbdf087e9d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:16.535559 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-551717b0-f8ae-4753-bba9-7adbdf087e9d tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1392 microversion: 2.1 time: 0.188648 Aug 04 17:16:16.536899 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2997/5876] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:16 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1392 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:17.561902 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-21337bec-14af-4dde-81ab-9798e6203219 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:17.563064 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-21337bec-14af-4dde-81ab-9798e6203219 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:17.586896 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-21337bec-14af-4dde-81ab-9798e6203219 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:17.588289 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-21337bec-14af-4dde-81ab-9798e6203219 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:17.590349 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-21337bec-14af-4dde-81ab-9798e6203219 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:17.592158 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-21337bec-14af-4dde-81ab-9798e6203219 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:17.810452 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-21337bec-14af-4dde-81ab-9798e6203219 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:17.836078 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-21337bec-14af-4dde-81ab-9798e6203219 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1392 microversion: 2.1 time: 0.278420 Aug 04 17:16:17.844237 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2880/5877] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:17 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1392 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:18.865580 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4985e98a-513f-4c98-868d-756917c20f2f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:18.866539 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4985e98a-513f-4c98-868d-756917c20f2f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:18.878177 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4985e98a-513f-4c98-868d-756917c20f2f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:18.884698 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4985e98a-513f-4c98-868d-756917c20f2f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:18.890545 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4985e98a-513f-4c98-868d-756917c20f2f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:18.891567 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4985e98a-513f-4c98-868d-756917c20f2f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:19.045459 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4985e98a-513f-4c98-868d-756917c20f2f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:19.057210 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4985e98a-513f-4c98-868d-756917c20f2f tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1392 microversion: 2.1 time: 0.195220 Aug 04 17:16:19.059319 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2998/5878] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:18 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1392 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:20.090802 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e4f4f820-825f-461f-a66c-111c4dd06f91 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:20.092650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e4f4f820-825f-461f-a66c-111c4dd06f91 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:20.104620 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e4f4f820-825f-461f-a66c-111c4dd06f91 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:20.105634 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e4f4f820-825f-461f-a66c-111c4dd06f91 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:20.107182 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e4f4f820-825f-461f-a66c-111c4dd06f91 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:20.109006 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e4f4f820-825f-461f-a66c-111c4dd06f91 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:20.162684 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e4f4f820-825f-461f-a66c-111c4dd06f91 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:20.163143 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e4f4f820-825f-461f-a66c-111c4dd06f91 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:20.163782 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-e4f4f820-825f-461f-a66c-111c4dd06f91 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lazy-loading 'fault' on Instance uuid 25704445-abe8-44bb-89d7-870d193deec0 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:16:20.244852 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e4f4f820-825f-461f-a66c-111c4dd06f91 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9cab1c1eff47ddb881a2b57bf240f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a0adb69ba24749817a8855effc20ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:20.254602 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e4f4f820-825f-461f-a66c-111c4dd06f91 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 200 len: 1397 microversion: 2.1 time: 0.172879 Aug 04 17:16:20.255981 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2881/5879] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:20 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 1397 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:21.301365 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-145dcaa3-18d7-4c82-b93b-8370e05a0992 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:21.302299 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-145dcaa3-18d7-4c82-b93b-8370e05a0992 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: 25704445-abe8-44bb-89d7-870d193deec0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:21.314276 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-145dcaa3-18d7-4c82-b93b-8370e05a0992 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:21.315468 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-145dcaa3-18d7-4c82-b93b-8370e05a0992 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:21.316391 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-145dcaa3-18d7-4c82-b93b-8370e05a0992 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:21.316925 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-145dcaa3-18d7-4c82-b93b-8370e05a0992 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:21.352538 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-145dcaa3-18d7-4c82-b93b-8370e05a0992 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] HTTP exception thrown: Instance 25704445-abe8-44bb-89d7-870d193deec0 could not be found. Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-145dcaa3-18d7-4c82-b93b-8370e05a0992 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Request method failure captured: Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 HTTP/1.1 Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_saEEOyGnjC2YSw5rO0XXZ0SIXFPgcyNqjoEnoWtNKNr9NN9-nC4VrXak9kuQQxq1he9punHwiXqtbTRNS_i0OM4UCS6bcDxdgTY6YMq4AHl3lv7jEdWuqMUDAU4k5OfnQSgkMml4THPPXJh4YiohQx-XVMfF21_bM4MqtZQZ4iEBI Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 78a0adb69ba24749817a8855effc20ad Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78a0adb69ba24749817a8855effc20ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_78a0adb69ba24749817a8855effc20ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78a0adb69ba24749817a8855effc20ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/78a0adb69ba24749817a8855effc20ad"}]}] Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 78a0adb69ba24749817a8855effc20ad Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-TestVolumeBootPattern-1920412406-project Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: ea9cab1c1eff47ddb881a2b57bf240f3 Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-TestVolumeBootPattern-1920412406-project Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 25704445-abe8-44bb-89d7-870d193deec0 could not be found. Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '25704445-abe8-44bb-89d7-870d193deec0'} Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25704445-abe8-44bb-89d7-870d193deec0 could not be found. Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25704445-abe8-44bb-89d7-870d193deec0 could not be found. Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:21.354421 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:16:21.362863 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:21.362863 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:21.362863 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:21.362863 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:16:21.362863 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:16:21.362863 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25704445-abe8-44bb-89d7-870d193deec0 could not be found. Aug 04 17:16:21.362863 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:16:21.362863 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-145dcaa3-18d7-4c82-b93b-8370e05a0992 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Returning 404 to user: Instance 25704445-abe8-44bb-89d7-870d193deec0 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:16:21.362863 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-145dcaa3-18d7-4c82-b93b-8370e05a0992 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0" status: 404 len: 111 microversion: 2.1 time: 0.066208 Aug 04 17:16:21.362863 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 2999/5880] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:21 2022] GET /compute/v2.1/servers/25704445-abe8-44bb-89d7-870d193deec0 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:16:21.908822 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c7efa39b-2bc2-4201-af2a-4c3ac66affb5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:21.913782 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c7efa39b-2bc2-4201-af2a-4c3ac66affb5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:21.925169 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c7efa39b-2bc2-4201-af2a-4c3ac66affb5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:21.925703 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c7efa39b-2bc2-4201-af2a-4c3ac66affb5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:21.926504 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c7efa39b-2bc2-4201-af2a-4c3ac66affb5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:21.926953 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c7efa39b-2bc2-4201-af2a-4c3ac66affb5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:22.022029 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c7efa39b-2bc2-4201-af2a-4c3ac66affb5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "POST /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c/action" status: 200 len: 24572 microversion: 2.1 time: 0.117314 Aug 04 17:16:22.030446 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2882/5881] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:16:21 2022] POST /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c/action => generated 24572 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 17:16:22.055308 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-419672f4-a805-4f3d-88a7-342db7395df5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:22.055867 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-419672f4-a805-4f3d-88a7-342db7395df5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:22.063144 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-419672f4-a805-4f3d-88a7-342db7395df5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:22.064380 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-419672f4-a805-4f3d-88a7-342db7395df5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:22.065359 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-419672f4-a805-4f3d-88a7-342db7395df5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:22.065940 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-419672f4-a805-4f3d-88a7-342db7395df5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:22.082600 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-419672f4-a805-4f3d-88a7-342db7395df5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] HTTP exception thrown: Instance dc8307a2-4a12-4301-a04f-6ed3bccb7d1a could not be found. Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-419672f4-a805-4f3d-88a7-342db7395df5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Request method failure captured: Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a HTTP/1.1 Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_saEEOyGnjC2YSw5rO0XXZ0SIXFPgcyNqjoEnoWtNKNr9NN9-nC4VrXak9kuQQxq1he9punHwiXqtbTRNS_i0OM4UCS6bcDxdgTY6YMq4AHl3lv7jEdWuqMUDAU4k5OfnQSgkMml4THPPXJh4YiohQx-XVMfF21_bM4MqtZQZ4iEBI Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 78a0adb69ba24749817a8855effc20ad Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78a0adb69ba24749817a8855effc20ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_78a0adb69ba24749817a8855effc20ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78a0adb69ba24749817a8855effc20ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/78a0adb69ba24749817a8855effc20ad"}]}] Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 78a0adb69ba24749817a8855effc20ad Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-TestVolumeBootPattern-1920412406-project Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: ea9cab1c1eff47ddb881a2b57bf240f3 Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-TestVolumeBootPattern-1920412406-project Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance dc8307a2-4a12-4301-a04f-6ed3bccb7d1a could not be found. Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'dc8307a2-4a12-4301-a04f-6ed3bccb7d1a'} Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc8307a2-4a12-4301-a04f-6ed3bccb7d1a could not be found. Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:16:22.084562 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:16:22.088227 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc8307a2-4a12-4301-a04f-6ed3bccb7d1a could not be found. Aug 04 17:16:22.088227 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:16:22.088227 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:22.088227 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:16:22.088227 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:22.088227 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:22.088227 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:22.088227 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:16:22.088227 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:16:22.088227 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc8307a2-4a12-4301-a04f-6ed3bccb7d1a could not be found. Aug 04 17:16:22.088227 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:16:22.089662 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-419672f4-a805-4f3d-88a7-342db7395df5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Returning 404 to user: Instance dc8307a2-4a12-4301-a04f-6ed3bccb7d1a could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:16:22.090873 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-419672f4-a805-4f3d-88a7-342db7395df5 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a" status: 404 len: 111 microversion: 2.1 time: 0.039530 Aug 04 17:16:22.092450 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3000/5882] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:16:22 2022] DELETE /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:16:22.101839 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3236ce76-3fc0-493a-92b3-af497b9fd9ad tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:22.103220 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3236ce76-3fc0-493a-92b3-af497b9fd9ad tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] [instance: dc8307a2-4a12-4301-a04f-6ed3bccb7d1a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:22.112453 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3236ce76-3fc0-493a-92b3-af497b9fd9ad tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:22.112930 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3236ce76-3fc0-493a-92b3-af497b9fd9ad tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:22.113767 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3236ce76-3fc0-493a-92b3-af497b9fd9ad tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:22.114216 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3236ce76-3fc0-493a-92b3-af497b9fd9ad tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:22.133199 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-3236ce76-3fc0-493a-92b3-af497b9fd9ad tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] HTTP exception thrown: Instance dc8307a2-4a12-4301-a04f-6ed3bccb7d1a could not be found. Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3236ce76-3fc0-493a-92b3-af497b9fd9ad tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Request method failure captured: Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a HTTP/1.1 Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_saEEOyGnjC2YSw5rO0XXZ0SIXFPgcyNqjoEnoWtNKNr9NN9-nC4VrXak9kuQQxq1he9punHwiXqtbTRNS_i0OM4UCS6bcDxdgTY6YMq4AHl3lv7jEdWuqMUDAU4k5OfnQSgkMml4THPPXJh4YiohQx-XVMfF21_bM4MqtZQZ4iEBI Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 78a0adb69ba24749817a8855effc20ad Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78a0adb69ba24749817a8855effc20ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_78a0adb69ba24749817a8855effc20ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/78a0adb69ba24749817a8855effc20ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/78a0adb69ba24749817a8855effc20ad"}]}] Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 78a0adb69ba24749817a8855effc20ad Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-TestVolumeBootPattern-1920412406 Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-TestVolumeBootPattern-1920412406-project Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: ea9cab1c1eff47ddb881a2b57bf240f3 Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-TestVolumeBootPattern-1920412406-project Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance dc8307a2-4a12-4301-a04f-6ed3bccb7d1a could not be found. Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'dc8307a2-4a12-4301-a04f-6ed3bccb7d1a'} Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc8307a2-4a12-4301-a04f-6ed3bccb7d1a could not be found. Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc8307a2-4a12-4301-a04f-6ed3bccb7d1a could not be found. Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:22.134964 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:16:22.145522 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:22.145522 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:22.145522 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:22.145522 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:16:22.145522 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:16:22.145522 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc8307a2-4a12-4301-a04f-6ed3bccb7d1a could not be found. Aug 04 17:16:22.145522 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:16:22.145522 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3236ce76-3fc0-493a-92b3-af497b9fd9ad tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Returning 404 to user: Instance dc8307a2-4a12-4301-a04f-6ed3bccb7d1a could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:16:22.145522 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3236ce76-3fc0-493a-92b3-af497b9fd9ad tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a" status: 404 len: 111 microversion: 2.1 time: 0.039289 Aug 04 17:16:22.145522 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2883/5883] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:22 2022] GET /compute/v2.1/servers/dc8307a2-4a12-4301-a04f-6ed3bccb7d1a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:16:28.311352 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3cab3b22-cad4-4d5f-93e7-3c798af6eaf1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] Calling method '.version_select at 0x7f7e77cb7c10>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:28.324206 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:16:28.359953 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3cab3b22-cad4-4d5f-93e7-3c798af6eaf1 tempest-TestVolumeBootPattern-1920412406 tempest-TestVolumeBootPattern-1920412406-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1843310632" status: 202 len: 0 microversion: 2.1 time: 0.064555 Aug 04 17:16:28.361195 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3001/5884] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Aug 4 17:16:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1843310632 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:16:28.432963 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-41bcadd7-82d8-4e2a-a3dc-1317b777be31 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:28.435057 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-41bcadd7-82d8-4e2a-a3dc-1317b777be31 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:28.453811 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-41bcadd7-82d8-4e2a-a3dc-1317b777be31 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:28.454275 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-41bcadd7-82d8-4e2a-a3dc-1317b777be31 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:28.455081 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-41bcadd7-82d8-4e2a-a3dc-1317b777be31 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:28.455555 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-41bcadd7-82d8-4e2a-a3dc-1317b777be31 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:29.460010 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-41bcadd7-82d8-4e2a-a3dc-1317b777be31 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1836 microversion: 2.1 time: 1.025200 Aug 04 17:16:29.462706 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2884/5885] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:28 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1836 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:29.489403 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4f15195e-229d-4631-99e0-275634c14709 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:29.490693 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4f15195e-229d-4631-99e0-275634c14709 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:29.518275 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4f15195e-229d-4631-99e0-275634c14709 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:29.519333 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4f15195e-229d-4631-99e0-275634c14709 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:29.522905 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4f15195e-229d-4631-99e0-275634c14709 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:29.523783 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4f15195e-229d-4631-99e0-275634c14709 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:29.538165 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:16:29.987467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4f15195e-229d-4631-99e0-275634c14709 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:29.999112 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4f15195e-229d-4631-99e0-275634c14709 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1683 microversion: 2.1 time: 0.515754 Aug 04 17:16:29.999705 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3002/5886] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:29 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1683 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:30.125009 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f7cb3ff7-bb30-49e3-a45d-275575c58575 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:30.128695 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f7cb3ff7-bb30-49e3-a45d-275575c58575 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:30.139568 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f7cb3ff7-bb30-49e3-a45d-275575c58575 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:30.141223 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f7cb3ff7-bb30-49e3-a45d-275575c58575 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:30.142359 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f7cb3ff7-bb30-49e3-a45d-275575c58575 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:30.143100 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f7cb3ff7-bb30-49e3-a45d-275575c58575 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:30.213094 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f7cb3ff7-bb30-49e3-a45d-275575c58575 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "POST /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c/action" status: 200 len: 32639 microversion: 2.1 time: 0.096184 Aug 04 17:16:30.228824 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2885/5887] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:16:30 2022] POST /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c/action => generated 32639 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:16:30.452291 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c43c1626-d467-45bd-b03c-02545ab00494 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:30.452879 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c43c1626-d467-45bd-b03c-02545ab00494 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:30.463424 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c43c1626-d467-45bd-b03c-02545ab00494 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:30.464253 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c43c1626-d467-45bd-b03c-02545ab00494 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:30.464756 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c43c1626-d467-45bd-b03c-02545ab00494 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:30.465951 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c43c1626-d467-45bd-b03c-02545ab00494 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:30.505116 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c43c1626-d467-45bd-b03c-02545ab00494 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'fdebc383c01f485cb4bfa2a58b2271ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d1171d8d014eb68ece66e1906b7d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:30.505803 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c43c1626-d467-45bd-b03c-02545ab00494 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] flavor_id is None. Assuming migration. {{(pid=126125) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 04 17:16:30.506210 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c43c1626-d467-45bd-b03c-02545ab00494 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=126125) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 17:16:30.678396 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c43c1626-d467-45bd-b03c-02545ab00494 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c/action" status: 202 len: 0 microversion: 2.1 time: 0.234971 Aug 04 17:16:30.680158 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3003/5888] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:16:30 2022] POST /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:16:30.695826 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1c4db11c-438f-4664-a93f-38915179a0cf tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:30.697078 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1c4db11c-438f-4664-a93f-38915179a0cf tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:30.706647 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c4db11c-438f-4664-a93f-38915179a0cf tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:30.714801 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c4db11c-438f-4664-a93f-38915179a0cf tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:30.716703 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c4db11c-438f-4664-a93f-38915179a0cf tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:30.718243 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c4db11c-438f-4664-a93f-38915179a0cf tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:31.221507 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1c4db11c-438f-4664-a93f-38915179a0cf tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:31.246389 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1c4db11c-438f-4664-a93f-38915179a0cf tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1692 microversion: 2.1 time: 0.554497 Aug 04 17:16:31.248174 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2886/5889] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:30 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1692 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:32.272276 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f9675e7c-de3a-4dd3-8a3d-6303b07f2c63 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:32.273609 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f9675e7c-de3a-4dd3-8a3d-6303b07f2c63 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:32.303288 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9675e7c-de3a-4dd3-8a3d-6303b07f2c63 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:32.304140 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9675e7c-de3a-4dd3-8a3d-6303b07f2c63 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:32.305242 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9675e7c-de3a-4dd3-8a3d-6303b07f2c63 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:32.306106 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9675e7c-de3a-4dd3-8a3d-6303b07f2c63 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:32.825021 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f9675e7c-de3a-4dd3-8a3d-6303b07f2c63 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:32.833507 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f9675e7c-de3a-4dd3-8a3d-6303b07f2c63 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1692 microversion: 2.1 time: 0.565513 Aug 04 17:16:32.834115 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3004/5890] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:32 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1692 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:33.867550 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5ef10817-5de8-45af-911a-fbf001c33524 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:33.869090 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5ef10817-5de8-45af-911a-fbf001c33524 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:33.895412 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ef10817-5de8-45af-911a-fbf001c33524 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:33.895988 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ef10817-5de8-45af-911a-fbf001c33524 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:33.898425 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ef10817-5de8-45af-911a-fbf001c33524 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:33.898879 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ef10817-5de8-45af-911a-fbf001c33524 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:33.902289 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=77 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:16:34.649455 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5ef10817-5de8-45af-911a-fbf001c33524 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:34.661690 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5ef10817-5de8-45af-911a-fbf001c33524 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1692 microversion: 2.1 time: 0.805686 Aug 04 17:16:34.662299 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2887/5891] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:33 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1692 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:35.688119 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e13aadaa-0b12-43de-bb56-86bac04dcb1e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:35.688741 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e13aadaa-0b12-43de-bb56-86bac04dcb1e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:35.697468 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e13aadaa-0b12-43de-bb56-86bac04dcb1e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:35.702059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e13aadaa-0b12-43de-bb56-86bac04dcb1e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:35.705072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e13aadaa-0b12-43de-bb56-86bac04dcb1e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:35.705899 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e13aadaa-0b12-43de-bb56-86bac04dcb1e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:36.169590 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e13aadaa-0b12-43de-bb56-86bac04dcb1e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:36.179830 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e13aadaa-0b12-43de-bb56-86bac04dcb1e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1692 microversion: 2.1 time: 0.497306 Aug 04 17:16:36.196723 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3005/5892] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:35 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1692 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:37.204559 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-498d2c91-d36f-4e97-b3f7-c222325b952d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:37.205249 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-498d2c91-d36f-4e97-b3f7-c222325b952d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:37.210298 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=34 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:16:37.225133 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-498d2c91-d36f-4e97-b3f7-c222325b952d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:37.225619 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-498d2c91-d36f-4e97-b3f7-c222325b952d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:37.226414 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-498d2c91-d36f-4e97-b3f7-c222325b952d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:37.226852 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-498d2c91-d36f-4e97-b3f7-c222325b952d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:37.537031 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-498d2c91-d36f-4e97-b3f7-c222325b952d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:37.549475 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-498d2c91-d36f-4e97-b3f7-c222325b952d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1697 microversion: 2.1 time: 0.349549 Aug 04 17:16:37.563902 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2888/5893] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:37 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1697 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:38.578781 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-11b94eb8-db39-4b2e-b0a1-fb21c839cb37 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:38.579507 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-11b94eb8-db39-4b2e-b0a1-fb21c839cb37 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:38.594034 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-11b94eb8-db39-4b2e-b0a1-fb21c839cb37 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:38.597808 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-11b94eb8-db39-4b2e-b0a1-fb21c839cb37 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:38.598848 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-11b94eb8-db39-4b2e-b0a1-fb21c839cb37 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:38.599439 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-11b94eb8-db39-4b2e-b0a1-fb21c839cb37 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:39.267176 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-11b94eb8-db39-4b2e-b0a1-fb21c839cb37 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:39.277997 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-11b94eb8-db39-4b2e-b0a1-fb21c839cb37 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1697 microversion: 2.1 time: 0.704692 Aug 04 17:16:39.279009 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3006/5894] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:38 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1697 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:40.300520 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0881df3c-e726-44c6-8f89-b0d5bce74d46 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:40.301227 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0881df3c-e726-44c6-8f89-b0d5bce74d46 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:40.310449 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0881df3c-e726-44c6-8f89-b0d5bce74d46 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:40.311208 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0881df3c-e726-44c6-8f89-b0d5bce74d46 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:40.312199 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0881df3c-e726-44c6-8f89-b0d5bce74d46 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:40.312657 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0881df3c-e726-44c6-8f89-b0d5bce74d46 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:41.091374 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0881df3c-e726-44c6-8f89-b0d5bce74d46 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:41.108567 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0881df3c-e726-44c6-8f89-b0d5bce74d46 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1697 microversion: 2.1 time: 0.813051 Aug 04 17:16:41.113670 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2889/5895] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:40 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1697 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:42.160636 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-314f94f1-cd9a-4336-a571-30ffc8d5b4ed tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:42.160636 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-314f94f1-cd9a-4336-a571-30ffc8d5b4ed tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:42.160636 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-314f94f1-cd9a-4336-a571-30ffc8d5b4ed tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:42.160636 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-314f94f1-cd9a-4336-a571-30ffc8d5b4ed tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:42.164416 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-314f94f1-cd9a-4336-a571-30ffc8d5b4ed tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:42.169158 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-314f94f1-cd9a-4336-a571-30ffc8d5b4ed tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:42.642829 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-314f94f1-cd9a-4336-a571-30ffc8d5b4ed tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:42.654523 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-314f94f1-cd9a-4336-a571-30ffc8d5b4ed tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1697 microversion: 2.1 time: 0.524235 Aug 04 17:16:42.655197 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3007/5896] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:42 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1697 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:42.934249 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0461bdf2-a9b8-4514-8243-104666d4c428 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:42.934831 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0461bdf2-a9b8-4514-8243-104666d4c428 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e01342e9-793f-4810-adfe-4d2803167d04] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:42.950973 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0461bdf2-a9b8-4514-8243-104666d4c428 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:42.951843 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0461bdf2-a9b8-4514-8243-104666d4c428 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:42.952966 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0461bdf2-a9b8-4514-8243-104666d4c428 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:42.956659 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0461bdf2-a9b8-4514-8243-104666d4c428 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:43.006927 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0461bdf2-a9b8-4514-8243-104666d4c428 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e01342e9-793f-4810-adfe-4d2803167d04] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:16:43.237716 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0461bdf2-a9b8-4514-8243-104666d4c428 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e01342e9-793f-4810-adfe-4d2803167d04" status: 204 len: 0 microversion: 2.1 time: 0.302490 Aug 04 17:16:43.241389 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2890/5897] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:16:42 2022] DELETE /compute/v2.1/servers/e01342e9-793f-4810-adfe-4d2803167d04 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:16:43.250525 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1fc235c3-14f4-4717-a183-307e94cef216 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:43.251505 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1fc235c3-14f4-4717-a183-307e94cef216 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e01342e9-793f-4810-adfe-4d2803167d04] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:43.275562 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1fc235c3-14f4-4717-a183-307e94cef216 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:43.276211 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1fc235c3-14f4-4717-a183-307e94cef216 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:43.280049 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1fc235c3-14f4-4717-a183-307e94cef216 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:43.282192 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1fc235c3-14f4-4717-a183-307e94cef216 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:43.654765 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1fc235c3-14f4-4717-a183-307e94cef216 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:43.676658 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5000b20e-11e1-493e-89d2-1b76a03e8022 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:43.677720 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5000b20e-11e1-493e-89d2-1b76a03e8022 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:43.689838 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1fc235c3-14f4-4717-a183-307e94cef216 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/e01342e9-793f-4810-adfe-4d2803167d04" status: 200 len: 1552 microversion: 2.1 time: 0.443102 Aug 04 17:16:43.690921 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3008/5898] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:43 2022] GET /compute/v2.1/servers/e01342e9-793f-4810-adfe-4d2803167d04 => generated 1552 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:16:43.707695 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5000b20e-11e1-493e-89d2-1b76a03e8022 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:43.709648 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5000b20e-11e1-493e-89d2-1b76a03e8022 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:43.718704 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5000b20e-11e1-493e-89d2-1b76a03e8022 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:43.723014 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5000b20e-11e1-493e-89d2-1b76a03e8022 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:43.964410 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5000b20e-11e1-493e-89d2-1b76a03e8022 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:43.978234 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5000b20e-11e1-493e-89d2-1b76a03e8022 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1697 microversion: 2.1 time: 0.305644 Aug 04 17:16:43.979374 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2891/5899] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:43 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1697 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:16:44.712233 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-25be6c3d-de8b-4792-aa41-53fa7f80fdf0 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:44.713025 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-25be6c3d-de8b-4792-aa41-53fa7f80fdf0 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e01342e9-793f-4810-adfe-4d2803167d04] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:44.732533 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-25be6c3d-de8b-4792-aa41-53fa7f80fdf0 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:44.738155 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-25be6c3d-de8b-4792-aa41-53fa7f80fdf0 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:44.739214 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-25be6c3d-de8b-4792-aa41-53fa7f80fdf0 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:44.739659 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-25be6c3d-de8b-4792-aa41-53fa7f80fdf0 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:45.030158 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-47683f8b-48e4-45f4-80bf-cc8bb8c1a7ae tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:45.030783 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-47683f8b-48e4-45f4-80bf-cc8bb8c1a7ae tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:45.046213 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-47683f8b-48e4-45f4-80bf-cc8bb8c1a7ae tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:45.046714 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-47683f8b-48e4-45f4-80bf-cc8bb8c1a7ae tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:45.048484 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-47683f8b-48e4-45f4-80bf-cc8bb8c1a7ae tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:45.049485 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-47683f8b-48e4-45f4-80bf-cc8bb8c1a7ae tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:46.162067 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-25be6c3d-de8b-4792-aa41-53fa7f80fdf0 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:46.174952 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-25be6c3d-de8b-4792-aa41-53fa7f80fdf0 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/e01342e9-793f-4810-adfe-4d2803167d04" status: 200 len: 1552 microversion: 2.1 time: 1.466624 Aug 04 17:16:46.176122 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3009/5900] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:44 2022] GET /compute/v2.1/servers/e01342e9-793f-4810-adfe-4d2803167d04 => generated 1552 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:46.255768 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-47683f8b-48e4-45f4-80bf-cc8bb8c1a7ae tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:46.271763 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-47683f8b-48e4-45f4-80bf-cc8bb8c1a7ae tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1697 microversion: 2.1 time: 1.262522 Aug 04 17:16:46.274146 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2892/5901] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:45 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1697 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:47.114211 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-a46040ae-5e8c-4c9d-bc06-e627658c42c5 req-b3f9a03d-f37e-45bc-8fd7-46fa5888a519 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e01342e9-793f-4810-adfe-4d2803167d04", "name": "network-vif-deleted", "tag": "9666cdc6-5dd8-4e03-8516-12e069551413"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:47.166720 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-a46040ae-5e8c-4c9d-bc06-e627658c42c5 req-b3f9a03d-f37e-45bc-8fd7-46fa5888a519 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:47.167411 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-a46040ae-5e8c-4c9d-bc06-e627658c42c5 req-b3f9a03d-f37e-45bc-8fd7-46fa5888a519 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:47.192378 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-a46040ae-5e8c-4c9d-bc06-e627658c42c5 req-b3f9a03d-f37e-45bc-8fd7-46fa5888a519 service nova] Creating event network-vif-deleted:9666cdc6-5dd8-4e03-8516-12e069551413 for instance e01342e9-793f-4810-adfe-4d2803167d04 on n-h1-846466-12 Aug 04 17:16:47.201965 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-a46040ae-5e8c-4c9d-bc06-e627658c42c5 req-b3f9a03d-f37e-45bc-8fd7-46fa5888a519 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088920 Aug 04 17:16:47.202666 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3010/5902] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:16:47.230092 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2f8acbfd-3ecb-4352-b09f-2ff5dbeb77c8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:47.232090 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2f8acbfd-3ecb-4352-b09f-2ff5dbeb77c8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e01342e9-793f-4810-adfe-4d2803167d04] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:47.273650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f8acbfd-3ecb-4352-b09f-2ff5dbeb77c8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:47.274746 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f8acbfd-3ecb-4352-b09f-2ff5dbeb77c8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:47.286688 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f8acbfd-3ecb-4352-b09f-2ff5dbeb77c8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:47.287613 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f8acbfd-3ecb-4352-b09f-2ff5dbeb77c8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:47.295164 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7758ed84-cf24-48d1-8f0a-5e9b5a46ec37 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:47.296156 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7758ed84-cf24-48d1-8f0a-5e9b5a46ec37 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:47.310772 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7758ed84-cf24-48d1-8f0a-5e9b5a46ec37 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:47.311362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7758ed84-cf24-48d1-8f0a-5e9b5a46ec37 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:47.312245 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7758ed84-cf24-48d1-8f0a-5e9b5a46ec37 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:47.312698 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7758ed84-cf24-48d1-8f0a-5e9b5a46ec37 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:47.390992 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f8acbfd-3ecb-4352-b09f-2ff5dbeb77c8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:47.391714 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f8acbfd-3ecb-4352-b09f-2ff5dbeb77c8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:47.392338 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-2f8acbfd-3ecb-4352-b09f-2ff5dbeb77c8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lazy-loading 'fault' on Instance uuid e01342e9-793f-4810-adfe-4d2803167d04 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:16:47.681215 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2f8acbfd-3ecb-4352-b09f-2ff5dbeb77c8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:47.694215 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2f8acbfd-3ecb-4352-b09f-2ff5dbeb77c8 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/e01342e9-793f-4810-adfe-4d2803167d04" status: 200 len: 1338 microversion: 2.1 time: 0.500442 Aug 04 17:16:47.707819 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2893/5903] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:47 2022] GET /compute/v2.1/servers/e01342e9-793f-4810-adfe-4d2803167d04 => generated 1338 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:47.781966 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7758ed84-cf24-48d1-8f0a-5e9b5a46ec37 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:47.791033 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7758ed84-cf24-48d1-8f0a-5e9b5a46ec37 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1697 microversion: 2.1 time: 0.500204 Aug 04 17:16:47.794023 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3011/5904] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:47 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1697 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:16:48.729811 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dcb08fbc-bc27-4e8a-9895-3581eb30ebb6 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:48.731737 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-dcb08fbc-bc27-4e8a-9895-3581eb30ebb6 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e01342e9-793f-4810-adfe-4d2803167d04] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:48.752315 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dcb08fbc-bc27-4e8a-9895-3581eb30ebb6 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:48.753087 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dcb08fbc-bc27-4e8a-9895-3581eb30ebb6 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:48.754222 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dcb08fbc-bc27-4e8a-9895-3581eb30ebb6 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:48.754967 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dcb08fbc-bc27-4e8a-9895-3581eb30ebb6 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:48.820420 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-dcb08fbc-bc27-4e8a-9895-3581eb30ebb6 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] HTTP exception thrown: Instance e01342e9-793f-4810-adfe-4d2803167d04 could not be found. Aug 04 17:16:48.820766 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-65155415-5831-42fd-8a21-c10c6c20227e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:48.822001 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-65155415-5831-42fd-8a21-c10c6c20227e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dcb08fbc-bc27-4e8a-9895-3581eb30ebb6 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Request method failure captured: Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/e01342e9-793f-4810-adfe-4d2803167d04 HTTP/1.1 Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_5v6NcUJlSwUwdPqA9Qzo7Y5lXa2-X0U9uYvxzRetTqQ9hf9PxHi2m5nxA-bBW9lcac5PKShwBrdE3hKXjFwdvu-jAh9VQgr9YLADQ6vivr5hFH_1trtgIv51i7s6J0Qpuo3tCnzX2TI35OwnoUVYmHhywAOMh0ghGDAxG0ahqOwps Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: f2dc5d0512d34a47b06925edfebfce57 Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-TestNetworkBasicOps-103807392 Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f2dc5d0512d34a47b06925edfebfce57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f2dc5d0512d34a47b06925edfebfce57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f2dc5d0512d34a47b06925edfebfce57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f2dc5d0512d34a47b06925edfebfce57"}]}] Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-TestNetworkBasicOps-103807392 Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: f2dc5d0512d34a47b06925edfebfce57 Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-TestNetworkBasicOps-103807392 Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-TestNetworkBasicOps-103807392-project Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 208d51c5701647a39b2ee6a3b999fe27 Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-TestNetworkBasicOps-103807392-project Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance e01342e9-793f-4810-adfe-4d2803167d04 could not be found. Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'e01342e9-793f-4810-adfe-4d2803167d04'} Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e01342e9-793f-4810-adfe-4d2803167d04 could not be found. Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e01342e9-793f-4810-adfe-4d2803167d04 could not be found. Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:48.824791 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:16:48.829067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:48.829067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:48.829067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:48.829067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:16:48.829067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:16:48.829067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e01342e9-793f-4810-adfe-4d2803167d04 could not be found. Aug 04 17:16:48.829067 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:16:48.834017 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dcb08fbc-bc27-4e8a-9895-3581eb30ebb6 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Returning 404 to user: Instance e01342e9-793f-4810-adfe-4d2803167d04 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:16:48.834996 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dcb08fbc-bc27-4e8a-9895-3581eb30ebb6 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/e01342e9-793f-4810-adfe-4d2803167d04" status: 404 len: 111 microversion: 2.1 time: 0.109687 Aug 04 17:16:48.840604 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2894/5905] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:48 2022] GET /compute/v2.1/servers/e01342e9-793f-4810-adfe-4d2803167d04 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:16:48.848791 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-65155415-5831-42fd-8a21-c10c6c20227e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:48.854116 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-65155415-5831-42fd-8a21-c10c6c20227e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:48.855212 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-65155415-5831-42fd-8a21-c10c6c20227e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:48.855977 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-65155415-5831-42fd-8a21-c10c6c20227e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:49.338696 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-65155415-5831-42fd-8a21-c10c6c20227e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:49.350485 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-65155415-5831-42fd-8a21-c10c6c20227e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1697 microversion: 2.1 time: 0.535928 Aug 04 17:16:49.351151 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3012/5906] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:48 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1697 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:16:49.850915 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5d38c105-6748-4945-8244-890a3034a86f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '.version_select at 0x7f7e84135700>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:49.898690 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5d38c105-6748-4945-8244-890a3034a86f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-645596772" status: 202 len: 0 microversion: 2.1 time: 0.051748 Aug 04 17:16:49.899307 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2895/5907] 10.222.0.23 () {58 vars in 1254 bytes} [Thu Aug 4 17:16:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-645596772 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 17:16:50.372836 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cd910b4c-16c5-42b7-b3c0-0f4d8362cd62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:50.373759 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cd910b4c-16c5-42b7-b3c0-0f4d8362cd62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:50.384140 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cd910b4c-16c5-42b7-b3c0-0f4d8362cd62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:50.384577 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cd910b4c-16c5-42b7-b3c0-0f4d8362cd62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:50.385379 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cd910b4c-16c5-42b7-b3c0-0f4d8362cd62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:50.385803 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cd910b4c-16c5-42b7-b3c0-0f4d8362cd62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:50.726548 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cd910b4c-16c5-42b7-b3c0-0f4d8362cd62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:50.746981 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cd910b4c-16c5-42b7-b3c0-0f4d8362cd62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1697 microversion: 2.1 time: 0.377928 Aug 04 17:16:50.747992 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3013/5908] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:50 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1697 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:51.777430 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bb7cc105-c666-4801-8268-91bd2a4ea6ff tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:51.778599 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bb7cc105-c666-4801-8268-91bd2a4ea6ff tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:51.807384 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bb7cc105-c666-4801-8268-91bd2a4ea6ff tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:51.807852 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bb7cc105-c666-4801-8268-91bd2a4ea6ff tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:51.808669 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bb7cc105-c666-4801-8268-91bd2a4ea6ff tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:51.809198 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bb7cc105-c666-4801-8268-91bd2a4ea6ff tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:52.613909 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bb7cc105-c666-4801-8268-91bd2a4ea6ff tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:52.626704 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bb7cc105-c666-4801-8268-91bd2a4ea6ff tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1697 microversion: 2.1 time: 0.860573 Aug 04 17:16:52.627512 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2896/5909] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:51 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1697 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:53.653857 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d2461983-f1aa-4b87-9a8a-07ba3b7ab44b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:53.655871 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d2461983-f1aa-4b87-9a8a-07ba3b7ab44b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:53.691910 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d2461983-f1aa-4b87-9a8a-07ba3b7ab44b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:53.693549 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d2461983-f1aa-4b87-9a8a-07ba3b7ab44b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:53.694951 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d2461983-f1aa-4b87-9a8a-07ba3b7ab44b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:53.696324 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d2461983-f1aa-4b87-9a8a-07ba3b7ab44b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:54.649448 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d2461983-f1aa-4b87-9a8a-07ba3b7ab44b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:54.669206 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d2461983-f1aa-4b87-9a8a-07ba3b7ab44b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1696 microversion: 2.1 time: 1.024590 Aug 04 17:16:54.678674 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3014/5910] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:53 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1696 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:16:54.815118 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-3cfc358d-4490-4a22-b362-de0209d5f03a req-43c6c476-79c5-456a-a9a3-544b6ab29a5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "274b5c58-9bd5-4fd0-8e51-8e52623be12c", "name": "network-vif-unplugged", "status": "completed", "tag": "2cb3c423-6a6f-4b14-9715-f2909f91e90d"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:54.861994 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-3cfc358d-4490-4a22-b362-de0209d5f03a req-43c6c476-79c5-456a-a9a3-544b6ab29a5f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:54.862923 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-3cfc358d-4490-4a22-b362-de0209d5f03a req-43c6c476-79c5-456a-a9a3-544b6ab29a5f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:54.895038 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-3cfc358d-4490-4a22-b362-de0209d5f03a req-43c6c476-79c5-456a-a9a3-544b6ab29a5f service nova] Creating event network-vif-unplugged:2cb3c423-6a6f-4b14-9715-f2909f91e90d for instance 274b5c58-9bd5-4fd0-8e51-8e52623be12c on n-h1-846466-12 Aug 04 17:16:54.915781 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [req-3cfc358d-4490-4a22-b362-de0209d5f03a req-43c6c476-79c5-456a-a9a3-544b6ab29a5f service nova] Instance 274b5c58-9bd5-4fd0-8e51-8e52623be12c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126126) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:16:54.937255 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-3cfc358d-4490-4a22-b362-de0209d5f03a req-43c6c476-79c5-456a-a9a3-544b6ab29a5f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.137693 Aug 04 17:16:54.939022 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2897/5911] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:16:55.711028 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-79c471a4-6df7-463e-adbb-57a23c6dc4e9 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:55.712294 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-79c471a4-6df7-463e-adbb-57a23c6dc4e9 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:55.728710 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-79c471a4-6df7-463e-adbb-57a23c6dc4e9 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:55.729702 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-79c471a4-6df7-463e-adbb-57a23c6dc4e9 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:55.730771 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-79c471a4-6df7-463e-adbb-57a23c6dc4e9 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:55.731458 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-79c471a4-6df7-463e-adbb-57a23c6dc4e9 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:55.979656 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c29bde45-3772-4b51-99e7-c0bca5fd450f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:55.980976 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c29bde45-3772-4b51-99e7-c0bca5fd450f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: 2ee82d9d-5776-43cc-8688-530e478c23cb] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:56.011139 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c29bde45-3772-4b51-99e7-c0bca5fd450f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:56.012682 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c29bde45-3772-4b51-99e7-c0bca5fd450f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:56.016880 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c29bde45-3772-4b51-99e7-c0bca5fd450f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:56.018861 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c29bde45-3772-4b51-99e7-c0bca5fd450f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:56.105642 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c29bde45-3772-4b51-99e7-c0bca5fd450f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: 2ee82d9d-5776-43cc-8688-530e478c23cb] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:16:56.346311 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c29bde45-3772-4b51-99e7-c0bca5fd450f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2ee82d9d-5776-43cc-8688-530e478c23cb" status: 204 len: 0 microversion: 2.1 time: 0.371252 Aug 04 17:16:56.347186 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2898/5912] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:16:55 2022] DELETE /compute/v2.1/servers/2ee82d9d-5776-43cc-8688-530e478c23cb => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:16:56.361065 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6666b9a0-1d48-4882-949c-ce005288ff26 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:56.362153 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6666b9a0-1d48-4882-949c-ce005288ff26 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: 2ee82d9d-5776-43cc-8688-530e478c23cb] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:56.372731 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6666b9a0-1d48-4882-949c-ce005288ff26 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:56.374426 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6666b9a0-1d48-4882-949c-ce005288ff26 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:56.375764 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6666b9a0-1d48-4882-949c-ce005288ff26 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:56.376493 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6666b9a0-1d48-4882-949c-ce005288ff26 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:56.576291 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-79c471a4-6df7-463e-adbb-57a23c6dc4e9 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:56.612555 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-79c471a4-6df7-463e-adbb-57a23c6dc4e9 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1696 microversion: 2.1 time: 0.905787 Aug 04 17:16:56.619966 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3015/5913] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:55 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1696 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:57.083930 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6666b9a0-1d48-4882-949c-ce005288ff26 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:57.094918 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6666b9a0-1d48-4882-949c-ce005288ff26 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee82d9d-5776-43cc-8688-530e478c23cb" status: 200 len: 1668 microversion: 2.1 time: 0.742608 Aug 04 17:16:57.111381 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2899/5914] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:56 2022] GET /compute/v2.1/servers/2ee82d9d-5776-43cc-8688-530e478c23cb => generated 1668 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:57.114682 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-362b5770-e352-4a29-8329-e1591e5c760b req-a2089325-d452-4eb9-b264-2a5602d0e7fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ee82d9d-5776-43cc-8688-530e478c23cb", "tag": "db4e0464-1873-4edc-bf3c-11009c2e1cc9"}, {"name": "network-changed", "server_uuid": "274b5c58-9bd5-4fd0-8e51-8e52623be12c", "tag": "2cb3c423-6a6f-4b14-9715-f2909f91e90d"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:57.137646 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-362b5770-e352-4a29-8329-e1591e5c760b req-a2089325-d452-4eb9-b264-2a5602d0e7fd service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:57.141405 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-362b5770-e352-4a29-8329-e1591e5c760b req-a2089325-d452-4eb9-b264-2a5602d0e7fd service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:57.181815 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-362b5770-e352-4a29-8329-e1591e5c760b req-a2089325-d452-4eb9-b264-2a5602d0e7fd service nova] Creating event network-changed:db4e0464-1873-4edc-bf3c-11009c2e1cc9 for instance 2ee82d9d-5776-43cc-8688-530e478c23cb on n-h1-846466-12 Aug 04 17:16:57.182844 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-362b5770-e352-4a29-8329-e1591e5c760b req-a2089325-d452-4eb9-b264-2a5602d0e7fd service nova] Creating event network-changed:2cb3c423-6a6f-4b14-9715-f2909f91e90d for instance 274b5c58-9bd5-4fd0-8e51-8e52623be12c on n-h1-846466-12 Aug 04 17:16:57.190988 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [req-362b5770-e352-4a29-8329-e1591e5c760b req-a2089325-d452-4eb9-b264-2a5602d0e7fd service nova] Instance 274b5c58-9bd5-4fd0-8e51-8e52623be12c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:16:57.240689 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-362b5770-e352-4a29-8329-e1591e5c760b req-a2089325-d452-4eb9-b264-2a5602d0e7fd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.129274 Aug 04 17:16:57.259710 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3016/5915] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:16:57.637790 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-71abb813-998d-409b-8533-88d65f4b9177 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:57.638846 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-71abb813-998d-409b-8533-88d65f4b9177 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:57.663866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-71abb813-998d-409b-8533-88d65f4b9177 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:57.667697 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-71abb813-998d-409b-8533-88d65f4b9177 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:57.668560 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-71abb813-998d-409b-8533-88d65f4b9177 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:57.676176 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-71abb813-998d-409b-8533-88d65f4b9177 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:57.846495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0e891f00-cc27-4b7d-b8aa-b354000e6a59 tempest-TestAggregatesBasicOps-1382546119 tempest-TestAggregatesBasicOps-1382546119-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-479908267", "availability_zone": "foo_zone"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:57.850074 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:16:57.850074 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 17:16:57.851424 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.aggregate [None req-0e891f00-cc27-4b7d-b8aa-b354000e6a59 tempest-TestAggregatesBasicOps-1382546119 tempest-TestAggregatesBasicOps-1382546119-project-admin] Generated uuid 5b070210-2bc7-4af6-acc7-36c41bda9075 for aggregate {{(pid=126126) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 17:16:57.911230 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0e891f00-cc27-4b7d-b8aa-b354000e6a59 tempest-TestAggregatesBasicOps-1382546119 tempest-TestAggregatesBasicOps-1382546119-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.370529 Aug 04 17:16:57.913023 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2900/5916] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Aug 4 17:16:57 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:16:57.932854 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-870948be-3e5f-4ed0-9cbc-60929bd11c16 tempest-TestAggregatesBasicOps-1382546119 tempest-TestAggregatesBasicOps-1382546119-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:57.936959 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:16:57.936959 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 17:16:57.988268 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-870948be-3e5f-4ed0-9cbc-60929bd11c16 tempest-TestAggregatesBasicOps-1382546119 tempest-TestAggregatesBasicOps-1382546119-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.061319 Aug 04 17:16:57.989776 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2901/5917] 10.222.0.23 () {60 vars in 1194 bytes} [Thu Aug 4 17:16:57 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:16:58.006369 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-915574b8-dfac-4353-b338-ec8d5528c8d7 tempest-TestAggregatesBasicOps-1382546119 tempest-TestAggregatesBasicOps-1382546119-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:58.010431 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:16:58.010431 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 17:16:58.014294 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-915574b8-dfac-4353-b338-ec8d5528c8d7 tempest-TestAggregatesBasicOps-1382546119 tempest-TestAggregatesBasicOps-1382546119-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:58.016948 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-915574b8-dfac-4353-b338-ec8d5528c8d7 tempest-TestAggregatesBasicOps-1382546119 tempest-TestAggregatesBasicOps-1382546119-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:58.020855 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-915574b8-dfac-4353-b338-ec8d5528c8d7 tempest-TestAggregatesBasicOps-1382546119 tempest-TestAggregatesBasicOps-1382546119-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:58.021578 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-915574b8-dfac-4353-b338-ec8d5528c8d7 tempest-TestAggregatesBasicOps-1382546119 tempest-TestAggregatesBasicOps-1382546119-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:58.080596 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-915574b8-dfac-4353-b338-ec8d5528c8d7 tempest-TestAggregatesBasicOps-1382546119 tempest-TestAggregatesBasicOps-1382546119-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.079108 Aug 04 17:16:58.089078 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2902/5918] 10.222.0.23 () {58 vars in 1176 bytes} [Thu Aug 4 17:16:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:16:58.104862 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-26cc3e25-41c1-45b9-a604-b258ab2a60a5 tempest-TestAggregatesBasicOps-1382546119 tempest-TestAggregatesBasicOps-1382546119-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:58.105730 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:16:58.105730 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 17:16:58.121177 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-26cc3e25-41c1-45b9-a604-b258ab2a60a5 tempest-TestAggregatesBasicOps-1382546119 tempest-TestAggregatesBasicOps-1382546119-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.019951 Aug 04 17:16:58.122389 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2903/5919] 10.222.0.23 () {58 vars in 1143 bytes} [Thu Aug 4 17:16:58 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:16:58.142466 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c157a3bf-c6f8-44d4-8a45-eca668a79711 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:58.143113 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c157a3bf-c6f8-44d4-8a45-eca668a79711 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: 2ee82d9d-5776-43cc-8688-530e478c23cb] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:58.166627 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c157a3bf-c6f8-44d4-8a45-eca668a79711 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:58.167133 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c157a3bf-c6f8-44d4-8a45-eca668a79711 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:58.168127 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c157a3bf-c6f8-44d4-8a45-eca668a79711 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:58.168570 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c157a3bf-c6f8-44d4-8a45-eca668a79711 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:58.918594 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-71abb813-998d-409b-8533-88d65f4b9177 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:58.928630 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-71abb813-998d-409b-8533-88d65f4b9177 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1696 microversion: 2.1 time: 1.295801 Aug 04 17:16:58.930241 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3017/5920] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:57 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1696 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:16:58.935773 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-32c707c8-af53-4e5c-a612-b03a7b6f8f6b tempest-TestAggregatesBasicOps-1382546119 tempest-TestAggregatesBasicOps-1382546119-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846466-12"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:58.939178 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:16:58.939178 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 17:16:58.958252 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:16:58.961443 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-32c707c8-af53-4e5c-a612-b03a7b6f8f6b tempest-TestAggregatesBasicOps-1382546119 tempest-TestAggregatesBasicOps-1382546119-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:58.968493 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-32c707c8-af53-4e5c-a612-b03a7b6f8f6b tempest-TestAggregatesBasicOps-1382546119 tempest-TestAggregatesBasicOps-1382546119-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:58.981418 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:16:59.195451 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c157a3bf-c6f8-44d4-8a45-eca668a79711 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:59.223068 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c157a3bf-c6f8-44d4-8a45-eca668a79711 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee82d9d-5776-43cc-8688-530e478c23cb" status: 200 len: 1668 microversion: 2.1 time: 1.098288 Aug 04 17:16:59.224171 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2904/5921] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:58 2022] GET /compute/v2.1/servers/2ee82d9d-5776-43cc-8688-530e478c23cb => generated 1668 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:59.262132 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-9c5bff1c-bf0a-410d-b9d3-eef38ac043f4 req-bdfc0761-1682-4697-bb3c-9d687f155052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee82d9d-5776-43cc-8688-530e478c23cb", "name": "network-vif-deleted", "tag": "db4e0464-1873-4edc-bf3c-11009c2e1cc9"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:59.279670 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-9c5bff1c-bf0a-410d-b9d3-eef38ac043f4 req-bdfc0761-1682-4697-bb3c-9d687f155052 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:59.280600 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-9c5bff1c-bf0a-410d-b9d3-eef38ac043f4 req-bdfc0761-1682-4697-bb3c-9d687f155052 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:59.298211 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-9c5bff1c-bf0a-410d-b9d3-eef38ac043f4 req-bdfc0761-1682-4697-bb3c-9d687f155052 service nova] Creating event network-vif-deleted:db4e0464-1873-4edc-bf3c-11009c2e1cc9 for instance 2ee82d9d-5776-43cc-8688-530e478c23cb on n-h1-846466-12 Aug 04 17:16:59.306828 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-9c5bff1c-bf0a-410d-b9d3-eef38ac043f4 req-bdfc0761-1682-4697-bb3c-9d687f155052 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051495 Aug 04 17:16:59.307893 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2905/5922] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:16:59.610841 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-32c707c8-af53-4e5c-a612-b03a7b6f8f6b tempest-TestAggregatesBasicOps-1382546119 tempest-TestAggregatesBasicOps-1382546119-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.679159 Aug 04 17:16:59.611793 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3018/5923] 10.222.0.23 () {60 vars in 1194 bytes} [Thu Aug 4 17:16:58 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:16:59.627886 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d5b83da8-e5b8-46ea-a1bd-81d67570cf44 tempest-TestAggregatesBasicOps-1382546119 tempest-TestAggregatesBasicOps-1382546119-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:59.629632 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:16:59.629632 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 17:16:59.645955 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d5b83da8-e5b8-46ea-a1bd-81d67570cf44 tempest-TestAggregatesBasicOps-1382546119 tempest-TestAggregatesBasicOps-1382546119-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.025928 Aug 04 17:16:59.648187 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2906/5924] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Aug 4 17:16:59 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:16:59.663882 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b4b56f58-5999-44ec-9051-dfb6e9371478 tempest-TestAggregatesBasicOps-1382546119 tempest-TestAggregatesBasicOps-1382546119-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1398708033", "availability_zone": "foo_zone"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:59.807963 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:16:59.807963 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 17:16:59.922751 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b4b56f58-5999-44ec-9051-dfb6e9371478 tempest-TestAggregatesBasicOps-1382546119 tempest-TestAggregatesBasicOps-1382546119-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 343 microversion: 2.1 time: 0.265720 Aug 04 17:16:59.939269 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3019/5925] 10.222.0.23 () {60 vars in 1173 bytes} [Thu Aug 4 17:16:59 2022] PUT /compute/v2.1/os-aggregates/19 => generated 343 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:16:59.945421 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-573a0aaa-2e39-4216-bf95-fe6a6553774b tempest-TestAggregatesBasicOps-1382546119 tempest-TestAggregatesBasicOps-1382546119-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:59.954534 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:16:59.954534 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 17:16:59.960484 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9fb1a95b-61a1-4a11-abef-74eade7cdd2d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:59.963298 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9fb1a95b-61a1-4a11-abef-74eade7cdd2d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:59.984791 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9fb1a95b-61a1-4a11-abef-74eade7cdd2d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:59.985949 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9fb1a95b-61a1-4a11-abef-74eade7cdd2d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:16:59.988014 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9fb1a95b-61a1-4a11-abef-74eade7cdd2d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:16:59.990282 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9fb1a95b-61a1-4a11-abef-74eade7cdd2d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:00.016695 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-573a0aaa-2e39-4216-bf95-fe6a6553774b tempest-TestAggregatesBasicOps-1382546119 tempest-TestAggregatesBasicOps-1382546119-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 357 microversion: 2.1 time: 0.075115 Aug 04 17:17:00.018159 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2907/5926] 10.222.0.23 () {60 vars in 1194 bytes} [Thu Aug 4 17:16:59 2022] POST /compute/v2.1/os-aggregates/19/action => generated 357 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:17:00.034447 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3805ba67-fda2-49e0-ace6-242df09e3443 tempest-TestAggregatesBasicOps-1382546119 tempest-TestAggregatesBasicOps-1382546119-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:00.035660 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:17:00.035660 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 17:17:00.044795 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3805ba67-fda2-49e0-ace6-242df09e3443 tempest-TestAggregatesBasicOps-1382546119 tempest-TestAggregatesBasicOps-1382546119-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 357 microversion: 2.1 time: 0.014298 Aug 04 17:17:00.046001 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2908/5927] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Aug 4 17:17:00 2022] GET /compute/v2.1/os-aggregates/19 => generated 357 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:17:00.067685 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0781d5ab-8c7a-4e4d-85bc-d08811e31307 tempest-TestAggregatesBasicOps-1382546119 tempest-TestAggregatesBasicOps-1382546119-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846466-12"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:00.078525 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:17:00.078525 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 17:17:00.089702 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0781d5ab-8c7a-4e4d-85bc-d08811e31307 tempest-TestAggregatesBasicOps-1382546119 tempest-TestAggregatesBasicOps-1382546119-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:00.091475 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0781d5ab-8c7a-4e4d-85bc-d08811e31307 tempest-TestAggregatesBasicOps-1382546119 tempest-TestAggregatesBasicOps-1382546119-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:00.115593 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:17:00.451256 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0781d5ab-8c7a-4e4d-85bc-d08811e31307 tempest-TestAggregatesBasicOps-1382546119 tempest-TestAggregatesBasicOps-1382546119-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.391052 Aug 04 17:17:00.453207 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2909/5928] 10.222.0.23 () {60 vars in 1194 bytes} [Thu Aug 4 17:17:00 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:00.460078 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bf1f322a-740c-4d73-9d64-4b6384e5b59b tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:00.461353 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bf1f322a-740c-4d73-9d64-4b6384e5b59b tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: 2ee82d9d-5776-43cc-8688-530e478c23cb] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:00.471348 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf1f322a-740c-4d73-9d64-4b6384e5b59b tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:00.471889 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf1f322a-740c-4d73-9d64-4b6384e5b59b tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:00.472968 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf1f322a-740c-4d73-9d64-4b6384e5b59b tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:00.473432 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf1f322a-740c-4d73-9d64-4b6384e5b59b tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:00.517910 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-bf1f322a-740c-4d73-9d64-4b6384e5b59b tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] HTTP exception thrown: Instance 2ee82d9d-5776-43cc-8688-530e478c23cb could not be found. Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bf1f322a-740c-4d73-9d64-4b6384e5b59b tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Request method failure captured: Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/2ee82d9d-5776-43cc-8688-530e478c23cb HTTP/1.1 Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_5v6NcUJlSwUwdPqA9Qzo7Y5lXa2-X0U9uYvxzRetTqQ9hf9PxHi2m5nxA-bBW9lcac5PKShwBrdE3hKXjFwdvu-jAh9VQgr9YLADQ6vivr5hFH_1trtgIv51i7s6J0Qpuo3tCnzX2TI35OwnoUVYmHhywAOMh0ghGDAxG0ahqOwps Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: f2dc5d0512d34a47b06925edfebfce57 Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-TestNetworkBasicOps-103807392 Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f2dc5d0512d34a47b06925edfebfce57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f2dc5d0512d34a47b06925edfebfce57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f2dc5d0512d34a47b06925edfebfce57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f2dc5d0512d34a47b06925edfebfce57"}]}] Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-TestNetworkBasicOps-103807392 Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: f2dc5d0512d34a47b06925edfebfce57 Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-TestNetworkBasicOps-103807392 Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-TestNetworkBasicOps-103807392-project Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 208d51c5701647a39b2ee6a3b999fe27 Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-TestNetworkBasicOps-103807392-project Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 2ee82d9d-5776-43cc-8688-530e478c23cb could not be found. Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '2ee82d9d-5776-43cc-8688-530e478c23cb'} Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ee82d9d-5776-43cc-8688-530e478c23cb could not be found. Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ee82d9d-5776-43cc-8688-530e478c23cb could not be found. Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:00.520892 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:17:00.527555 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:00.527555 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:00.527555 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:00.527555 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:17:00.527555 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:17:00.527555 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee82d9d-5776-43cc-8688-530e478c23cb could not be found. Aug 04 17:17:00.527555 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:17:00.527555 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bf1f322a-740c-4d73-9d64-4b6384e5b59b tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Returning 404 to user: Instance 2ee82d9d-5776-43cc-8688-530e478c23cb could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:17:00.527555 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bf1f322a-740c-4d73-9d64-4b6384e5b59b tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee82d9d-5776-43cc-8688-530e478c23cb" status: 404 len: 111 microversion: 2.1 time: 0.067755 Aug 04 17:17:00.527555 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2910/5929] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:00 2022] GET /compute/v2.1/servers/2ee82d9d-5776-43cc-8688-530e478c23cb => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:17:00.545332 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-45d3e514-6579-4026-97c9-963d11a579af tempest-TestAggregatesBasicOps-1382546119 tempest-TestAggregatesBasicOps-1382546119-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:00.546279 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:17:00.546279 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 17:17:00.593695 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-45d3e514-6579-4026-97c9-963d11a579af tempest-TestAggregatesBasicOps-1382546119 tempest-TestAggregatesBasicOps-1382546119-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.068727 Aug 04 17:17:00.594859 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2911/5930] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Aug 4 17:17:00 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 17:17:00.946028 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9fb1a95b-61a1-4a11-abef-74eade7cdd2d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:00.954399 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9fb1a95b-61a1-4a11-abef-74eade7cdd2d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1696 microversion: 2.1 time: 1.006724 Aug 04 17:17:00.955840 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3020/5931] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:59 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1696 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:01.203110 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b7e976a0-00ce-4c2b-aaf7-dfef7ef4b3d0 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '.version_select at 0x7f7e89c79430>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:01.272317 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b7e976a0-00ce-4c2b-aaf7-dfef7ef4b3d0 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-114939124" status: 202 len: 0 microversion: 2.1 time: 0.075108 Aug 04 17:17:01.273014 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2912/5932] 10.222.0.23 () {58 vars in 1254 bytes} [Thu Aug 4 17:17:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-114939124 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:17:01.978846 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7a62227b-42d1-429c-84f0-07d8b9956be8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:01.979613 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7a62227b-42d1-429c-84f0-07d8b9956be8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:02.007652 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a62227b-42d1-429c-84f0-07d8b9956be8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:02.007944 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a62227b-42d1-429c-84f0-07d8b9956be8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:02.009064 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a62227b-42d1-429c-84f0-07d8b9956be8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:02.009520 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a62227b-42d1-429c-84f0-07d8b9956be8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:02.428976 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7a62227b-42d1-429c-84f0-07d8b9956be8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:02.439666 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7a62227b-42d1-429c-84f0-07d8b9956be8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1694 microversion: 2.1 time: 0.463833 Aug 04 17:17:02.440331 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3021/5933] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:01 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1694 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:03.484238 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4ce283d5-b065-4ae8-862c-113070871f6b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:03.485442 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4ce283d5-b065-4ae8-862c-113070871f6b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:03.511506 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4ce283d5-b065-4ae8-862c-113070871f6b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:03.517329 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4ce283d5-b065-4ae8-862c-113070871f6b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:03.519645 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4ce283d5-b065-4ae8-862c-113070871f6b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:03.521983 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4ce283d5-b065-4ae8-862c-113070871f6b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:04.242188 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4ce283d5-b065-4ae8-862c-113070871f6b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:04.266458 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4ce283d5-b065-4ae8-862c-113070871f6b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1694 microversion: 2.1 time: 0.788081 Aug 04 17:17:04.268672 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2913/5934] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:03 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1694 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:17:05.295040 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c9532f83-e356-4630-9b0d-842dc05e9441 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:05.295804 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c9532f83-e356-4630-9b0d-842dc05e9441 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:05.306646 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c9532f83-e356-4630-9b0d-842dc05e9441 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:05.307119 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c9532f83-e356-4630-9b0d-842dc05e9441 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:05.307886 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c9532f83-e356-4630-9b0d-842dc05e9441 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:05.317587 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c9532f83-e356-4630-9b0d-842dc05e9441 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:05.926298 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c9532f83-e356-4630-9b0d-842dc05e9441 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:05.939305 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c9532f83-e356-4630-9b0d-842dc05e9441 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1691 microversion: 2.1 time: 0.644652 Aug 04 17:17:05.941863 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3022/5935] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:05 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1691 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:05.965196 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-51822026-9044-405b-8618-763d4cc5a6ee tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:05.965952 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-51822026-9044-405b-8618-763d4cc5a6ee tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:05.976129 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-51822026-9044-405b-8618-763d4cc5a6ee tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:05.979217 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-51822026-9044-405b-8618-763d4cc5a6ee tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:05.982247 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-51822026-9044-405b-8618-763d4cc5a6ee tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:05.982914 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-51822026-9044-405b-8618-763d4cc5a6ee tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:06.267388 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-51822026-9044-405b-8618-763d4cc5a6ee tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "POST /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c/action" status: 202 len: 0 microversion: 2.1 time: 0.306318 Aug 04 17:17:06.268565 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2914/5936] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:17:05 2022] POST /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:17:06.294571 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8b7edce2-d15b-43dc-b3c7-dc0994d4ecdb tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:06.299566 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8b7edce2-d15b-43dc-b3c7-dc0994d4ecdb tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:06.334938 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8b7edce2-d15b-43dc-b3c7-dc0994d4ecdb tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:06.342407 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8b7edce2-d15b-43dc-b3c7-dc0994d4ecdb tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:06.350373 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8b7edce2-d15b-43dc-b3c7-dc0994d4ecdb tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:06.353839 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8b7edce2-d15b-43dc-b3c7-dc0994d4ecdb tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:08.115866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8b7edce2-d15b-43dc-b3c7-dc0994d4ecdb tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:08.134723 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8b7edce2-d15b-43dc-b3c7-dc0994d4ecdb tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1690 microversion: 2.1 time: 1.846717 Aug 04 17:17:08.136695 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3023/5937] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:06 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1690 bytes in 1857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:09.182096 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:17:09.195405 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c2f67807-18b4-4ef6-aff9-2aeecc8fea3a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:09.196567 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c2f67807-18b4-4ef6-aff9-2aeecc8fea3a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:09.200237 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:DELETE=5,nova_api:INSERT=4 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:17:09.267408 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c2f67807-18b4-4ef6-aff9-2aeecc8fea3a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:09.279906 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c2f67807-18b4-4ef6-aff9-2aeecc8fea3a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:09.281341 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c2f67807-18b4-4ef6-aff9-2aeecc8fea3a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:09.287310 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c2f67807-18b4-4ef6-aff9-2aeecc8fea3a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:09.772131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c2f67807-18b4-4ef6-aff9-2aeecc8fea3a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:09.788324 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c2f67807-18b4-4ef6-aff9-2aeecc8fea3a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1690 microversion: 2.1 time: 0.611773 Aug 04 17:17:09.789790 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2915/5938] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:09 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1690 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:10.243028 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-d4c1cfe1-de44-4aa1-ba20-eb64ad36824e req-ccdd6a77-c354-484f-8441-06f0f7982985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "274b5c58-9bd5-4fd0-8e51-8e52623be12c", "name": "network-vif-plugged", "status": "completed", "tag": "2cb3c423-6a6f-4b14-9715-f2909f91e90d"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:10.264831 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-d4c1cfe1-de44-4aa1-ba20-eb64ad36824e req-ccdd6a77-c354-484f-8441-06f0f7982985 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:10.266023 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-d4c1cfe1-de44-4aa1-ba20-eb64ad36824e req-ccdd6a77-c354-484f-8441-06f0f7982985 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:10.314835 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-d4c1cfe1-de44-4aa1-ba20-eb64ad36824e req-ccdd6a77-c354-484f-8441-06f0f7982985 service nova] Creating event network-vif-plugged:2cb3c423-6a6f-4b14-9715-f2909f91e90d for instance 274b5c58-9bd5-4fd0-8e51-8e52623be12c on n-h1-846466-12 Aug 04 17:17:10.328471 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [req-d4c1cfe1-de44-4aa1-ba20-eb64ad36824e req-ccdd6a77-c354-484f-8441-06f0f7982985 service nova] Instance 274b5c58-9bd5-4fd0-8e51-8e52623be12c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:17:10.342948 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-d4c1cfe1-de44-4aa1-ba20-eb64ad36824e req-ccdd6a77-c354-484f-8441-06f0f7982985 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103525 Aug 04 17:17:10.344206 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3024/5939] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:10.821508 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d1a02121-1a57-44ba-8660-363a06c8ee36 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:10.822301 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d1a02121-1a57-44ba-8660-363a06c8ee36 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:10.837570 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d1a02121-1a57-44ba-8660-363a06c8ee36 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:10.838125 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d1a02121-1a57-44ba-8660-363a06c8ee36 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:10.838999 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d1a02121-1a57-44ba-8660-363a06c8ee36 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:10.839523 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d1a02121-1a57-44ba-8660-363a06c8ee36 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:11.191276 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d1a02121-1a57-44ba-8660-363a06c8ee36 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:11.199480 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d1a02121-1a57-44ba-8660-363a06c8ee36 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1690 microversion: 2.1 time: 0.385409 Aug 04 17:17:11.200151 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2916/5940] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:10 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1690 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:12.223569 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-72d58c13-7ccf-4492-aa13-ac97b52677fe tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:12.224180 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-72d58c13-7ccf-4492-aa13-ac97b52677fe tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:12.236243 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-72d58c13-7ccf-4492-aa13-ac97b52677fe tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:12.238500 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-72d58c13-7ccf-4492-aa13-ac97b52677fe tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:12.239867 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-72d58c13-7ccf-4492-aa13-ac97b52677fe tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:12.255825 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-72d58c13-7ccf-4492-aa13-ac97b52677fe tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:12.834020 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-72d58c13-7ccf-4492-aa13-ac97b52677fe tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:12.845473 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-72d58c13-7ccf-4492-aa13-ac97b52677fe tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1690 microversion: 2.1 time: 0.627167 Aug 04 17:17:12.853320 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3025/5941] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:12 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1690 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:13.887313 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-1dcb795f-c3be-4bd8-9aba-49a13806d479 req-68cdadbf-7cae-466f-b90e-a761f5d20d04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "274b5c58-9bd5-4fd0-8e51-8e52623be12c", "name": "network-vif-unplugged", "status": "completed", "tag": "2cb3c423-6a6f-4b14-9715-f2909f91e90d"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:13.895571 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-10cafdb1-2c47-4c54-86b5-802a0b22753f tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:13.896204 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-10cafdb1-2c47-4c54-86b5-802a0b22753f tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:13.912148 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-1dcb795f-c3be-4bd8-9aba-49a13806d479 req-68cdadbf-7cae-466f-b90e-a761f5d20d04 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:13.912589 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-1dcb795f-c3be-4bd8-9aba-49a13806d479 req-68cdadbf-7cae-466f-b90e-a761f5d20d04 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:13.917088 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-10cafdb1-2c47-4c54-86b5-802a0b22753f tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:13.920533 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-10cafdb1-2c47-4c54-86b5-802a0b22753f tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:13.921647 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-10cafdb1-2c47-4c54-86b5-802a0b22753f tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:13.922287 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-10cafdb1-2c47-4c54-86b5-802a0b22753f tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:13.952923 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-1dcb795f-c3be-4bd8-9aba-49a13806d479 req-68cdadbf-7cae-466f-b90e-a761f5d20d04 service nova] Creating event network-vif-unplugged:2cb3c423-6a6f-4b14-9715-f2909f91e90d for instance 274b5c58-9bd5-4fd0-8e51-8e52623be12c on n-h2-846466-12 Aug 04 17:17:13.960119 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [req-1dcb795f-c3be-4bd8-9aba-49a13806d479 req-68cdadbf-7cae-466f-b90e-a761f5d20d04 service nova] Instance 274b5c58-9bd5-4fd0-8e51-8e52623be12c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:17:13.975082 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-1dcb795f-c3be-4bd8-9aba-49a13806d479 req-68cdadbf-7cae-466f-b90e-a761f5d20d04 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092711 Aug 04 17:17:13.976335 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3026/5942] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:14.719338 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-10cafdb1-2c47-4c54-86b5-802a0b22753f tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:14.733971 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-10cafdb1-2c47-4c54-86b5-802a0b22753f tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1690 microversion: 2.1 time: 0.870058 Aug 04 17:17:14.738755 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2917/5943] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:13 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1690 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:15.756866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-77246dfa-d450-4e09-b65a-b60675cd98d5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:15.757609 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-77246dfa-d450-4e09-b65a-b60675cd98d5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:15.774038 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-77246dfa-d450-4e09-b65a-b60675cd98d5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:15.774499 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-77246dfa-d450-4e09-b65a-b60675cd98d5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:15.775282 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-77246dfa-d450-4e09-b65a-b60675cd98d5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:15.780781 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-77246dfa-d450-4e09-b65a-b60675cd98d5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:16.073300 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-ef393b91-63bd-45d1-9974-3c2982259c24 req-863f6ae5-c36b-4e4b-a51b-7d0fe9a2aeb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "274b5c58-9bd5-4fd0-8e51-8e52623be12c", "tag": "2cb3c423-6a6f-4b14-9715-f2909f91e90d"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:16.097057 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-ef393b91-63bd-45d1-9974-3c2982259c24 req-863f6ae5-c36b-4e4b-a51b-7d0fe9a2aeb8 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:16.097865 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-ef393b91-63bd-45d1-9974-3c2982259c24 req-863f6ae5-c36b-4e4b-a51b-7d0fe9a2aeb8 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:16.139055 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-ef393b91-63bd-45d1-9974-3c2982259c24 req-863f6ae5-c36b-4e4b-a51b-7d0fe9a2aeb8 service nova] Creating event network-changed:2cb3c423-6a6f-4b14-9715-f2909f91e90d for instance 274b5c58-9bd5-4fd0-8e51-8e52623be12c on n-h2-846466-12 Aug 04 17:17:16.159565 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [req-ef393b91-63bd-45d1-9974-3c2982259c24 req-863f6ae5-c36b-4e4b-a51b-7d0fe9a2aeb8 service nova] Instance 274b5c58-9bd5-4fd0-8e51-8e52623be12c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126126) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:17:16.193996 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-ef393b91-63bd-45d1-9974-3c2982259c24 req-863f6ae5-c36b-4e4b-a51b-7d0fe9a2aeb8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133068 Aug 04 17:17:16.198902 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2918/5944] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:16.709165 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-77246dfa-d450-4e09-b65a-b60675cd98d5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:16.718497 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-77246dfa-d450-4e09-b65a-b60675cd98d5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1690 microversion: 2.1 time: 0.966635 Aug 04 17:17:16.719101 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3027/5945] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:15 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1690 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:17.742156 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a49589ef-b952-46c5-b49d-4527136b1975 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:17.742765 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a49589ef-b952-46c5-b49d-4527136b1975 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:17.764014 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a49589ef-b952-46c5-b49d-4527136b1975 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:17.764246 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a49589ef-b952-46c5-b49d-4527136b1975 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:17.765268 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a49589ef-b952-46c5-b49d-4527136b1975 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:17.766014 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a49589ef-b952-46c5-b49d-4527136b1975 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:18.564207 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a49589ef-b952-46c5-b49d-4527136b1975 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:18.603737 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a49589ef-b952-46c5-b49d-4527136b1975 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1690 microversion: 2.1 time: 0.866977 Aug 04 17:17:18.606116 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2919/5946] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:17 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1690 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:19.636574 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-08f3aecc-4117-4557-a0c5-a4dda0bd3b2b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:19.637253 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-08f3aecc-4117-4557-a0c5-a4dda0bd3b2b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:19.653549 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-08f3aecc-4117-4557-a0c5-a4dda0bd3b2b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:19.657872 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-08f3aecc-4117-4557-a0c5-a4dda0bd3b2b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:19.663990 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-08f3aecc-4117-4557-a0c5-a4dda0bd3b2b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:19.666624 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-08f3aecc-4117-4557-a0c5-a4dda0bd3b2b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:20.406477 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-08f3aecc-4117-4557-a0c5-a4dda0bd3b2b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:20.418328 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-08f3aecc-4117-4557-a0c5-a4dda0bd3b2b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1690 microversion: 2.1 time: 0.790817 Aug 04 17:17:20.424152 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3028/5947] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:19 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1690 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:21.451069 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-035b1b9c-9048-403b-9029-ca31c8fb19e8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:21.451839 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-035b1b9c-9048-403b-9029-ca31c8fb19e8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:21.493873 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-035b1b9c-9048-403b-9029-ca31c8fb19e8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:21.494950 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-035b1b9c-9048-403b-9029-ca31c8fb19e8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:21.496057 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-035b1b9c-9048-403b-9029-ca31c8fb19e8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:21.496726 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-035b1b9c-9048-403b-9029-ca31c8fb19e8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:22.480675 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-035b1b9c-9048-403b-9029-ca31c8fb19e8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:22.496094 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-035b1b9c-9048-403b-9029-ca31c8fb19e8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1683 microversion: 2.1 time: 1.049505 Aug 04 17:17:22.496766 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2920/5948] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:21 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1683 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:23.114409 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bebfbb06-8554-4840-a9eb-a93cfb9cc9c4 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Action: 'create', calling method: .version_select at 0x7f7e841c95e0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2036697594", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjT3Si8V67jW5+jMwb4chknD3XZdtXbjfQGrqpb5tAbGLKOHPn4xm07OBlaUq/eU6O9FabaVqTBMSVYWWVI6jKNPls8n5M0p0IBlZ14W+zsWQId2qr08xbE9j5QIth9gA=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:23.142003 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-bebfbb06-8554-4840-a9eb-a93cfb9cc9c4 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Getting quotas for project f2dc5d0512d34a47b06925edfebfce57. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:17:23.149421 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-bebfbb06-8554-4840-a9eb-a93cfb9cc9c4 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Getting quotas for user 208d51c5701647a39b2ee6a3b999fe27 and project f2dc5d0512d34a47b06925edfebfce57. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:17:23.198865 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bebfbb06-8554-4840-a9eb-a93cfb9cc9c4 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.088445 Aug 04 17:17:23.199753 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3029/5949] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 17:17:23 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:24.930837 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b50686f7-157e-4dc4-a295-7eaea0bc963f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-876834389", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "40cc97ab-0554-4743-ad78-f5c558aca370"}], "key_name": "tempest-TestNetworkBasicOps-2036697594", "security_groups": [{"name": "tempest-secgroup-smoke-697061118"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:25.187147 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-b50686f7-157e-4dc4-a295-7eaea0bc963f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] validate_networks() for [('40cc97ab-0554-4743-ad78-f5c558aca370', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:17:26.280412 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-b50686f7-157e-4dc4-a295-7eaea0bc963f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:17:26.281124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-b50686f7-157e-4dc4-a295-7eaea0bc963f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:17:26.282336 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-b50686f7-157e-4dc4-a295-7eaea0bc963f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:17:26.283321 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-b50686f7-157e-4dc4-a295-7eaea0bc963f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:17:26.283970 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-b50686f7-157e-4dc4-a295-7eaea0bc963f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:17:26.315538 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b50686f7-157e-4dc4-a295-7eaea0bc963f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:26.317179 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b50686f7-157e-4dc4-a295-7eaea0bc963f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:26.322198 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b50686f7-157e-4dc4-a295-7eaea0bc963f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:26.323710 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b50686f7-157e-4dc4-a295-7eaea0bc963f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:26.450230 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-b50686f7-157e-4dc4-a295-7eaea0bc963f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Getting quotas for project f2dc5d0512d34a47b06925edfebfce57. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:17:26.472456 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-b50686f7-157e-4dc4-a295-7eaea0bc963f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Getting quotas for user 208d51c5701647a39b2ee6a3b999fe27 and project f2dc5d0512d34a47b06925edfebfce57. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:17:26.509649 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b50686f7-157e-4dc4-a295-7eaea0bc963f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:17:26.522456 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b50686f7-157e-4dc4-a295-7eaea0bc963f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:17:26.657235 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b50686f7-157e-4dc4-a295-7eaea0bc963f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.730319 Aug 04 17:17:26.658607 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2921/5950] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:17:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 1732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:17:26.671460 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c8b3be72-ea0e-4c2b-997e-b4038ad8f595 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:26.672493 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c8b3be72-ea0e-4c2b-997e-b4038ad8f595 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:26.884625 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c8b3be72-ea0e-4c2b-997e-b4038ad8f595 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:26.901818 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c8b3be72-ea0e-4c2b-997e-b4038ad8f595 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9" status: 200 len: 1248 microversion: 2.1 time: 0.235463 Aug 04 17:17:26.905992 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3030/5951] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:26 2022] GET /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9 => generated 1248 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:27.929438 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-55631964-c1ca-405b-b721-d61a0c6b5f40 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:27.931076 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-55631964-c1ca-405b-b721-d61a0c6b5f40 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:27.964013 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-55631964-c1ca-405b-b721-d61a0c6b5f40 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:27.964755 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-55631964-c1ca-405b-b721-d61a0c6b5f40 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:27.965693 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-55631964-c1ca-405b-b721-d61a0c6b5f40 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:27.968674 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-55631964-c1ca-405b-b721-d61a0c6b5f40 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:28.198717 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-55631964-c1ca-405b-b721-d61a0c6b5f40 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:28.215262 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-55631964-c1ca-405b-b721-d61a0c6b5f40 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9" status: 200 len: 1252 microversion: 2.1 time: 0.290682 Aug 04 17:17:28.218836 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2922/5952] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:27 2022] GET /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9 => generated 1252 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:29.238962 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-65bf594b-d11b-4186-b784-1b0082be2b74 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:29.240557 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-65bf594b-d11b-4186-b784-1b0082be2b74 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:29.271059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:17:29.293682 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-65bf594b-d11b-4186-b784-1b0082be2b74 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:29.294415 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-65bf594b-d11b-4186-b784-1b0082be2b74 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:29.298513 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-65bf594b-d11b-4186-b784-1b0082be2b74 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:29.299232 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-65bf594b-d11b-4186-b784-1b0082be2b74 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:29.324721 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=54 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:17:29.494833 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-65bf594b-d11b-4186-b784-1b0082be2b74 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:29.513518 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-65bf594b-d11b-4186-b784-1b0082be2b74 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9" status: 200 len: 1308 microversion: 2.1 time: 0.278804 Aug 04 17:17:29.516637 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3031/5953] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:29 2022] GET /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9 => generated 1308 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:29.598403 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-76d81e46-e400-497f-be34-738f660dacd4 req-9701686f-0e25-409b-b305-cb4874393114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "274b5c58-9bd5-4fd0-8e51-8e52623be12c", "name": "network-vif-plugged", "status": "completed", "tag": "2cb3c423-6a6f-4b14-9715-f2909f91e90d"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:29.612394 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-76d81e46-e400-497f-be34-738f660dacd4 req-9701686f-0e25-409b-b305-cb4874393114 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:29.613328 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-76d81e46-e400-497f-be34-738f660dacd4 req-9701686f-0e25-409b-b305-cb4874393114 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:29.629218 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-76d81e46-e400-497f-be34-738f660dacd4 req-9701686f-0e25-409b-b305-cb4874393114 service nova] Creating event network-vif-plugged:2cb3c423-6a6f-4b14-9715-f2909f91e90d for instance 274b5c58-9bd5-4fd0-8e51-8e52623be12c on n-h2-846466-12 Aug 04 17:17:29.635533 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-76d81e46-e400-497f-be34-738f660dacd4 req-9701686f-0e25-409b-b305-cb4874393114 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042581 Aug 04 17:17:29.638583 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2923/5954] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:30.540084 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5a9f6b37-cfb9-4338-8cdb-de5d33c8e95b tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:30.540781 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5a9f6b37-cfb9-4338-8cdb-de5d33c8e95b tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:30.555141 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5a9f6b37-cfb9-4338-8cdb-de5d33c8e95b tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:30.555582 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5a9f6b37-cfb9-4338-8cdb-de5d33c8e95b tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:30.556370 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5a9f6b37-cfb9-4338-8cdb-de5d33c8e95b tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:30.556798 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5a9f6b37-cfb9-4338-8cdb-de5d33c8e95b tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:30.996046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5a9f6b37-cfb9-4338-8cdb-de5d33c8e95b tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:31.008945 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5a9f6b37-cfb9-4338-8cdb-de5d33c8e95b tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9" status: 200 len: 1373 microversion: 2.1 time: 0.472702 Aug 04 17:17:31.012486 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3032/5955] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:30 2022] GET /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9 => generated 1373 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:31.717588 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-ba8ae794-98af-47bb-a1ba-f46a1bcbb1f2 req-00e8c86f-a189-41e7-92f5-18b2ee938c48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9", "tag": "51d288fb-771e-4e0b-8255-3f9cf651acf2"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:31.729217 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-ba8ae794-98af-47bb-a1ba-f46a1bcbb1f2 req-00e8c86f-a189-41e7-92f5-18b2ee938c48 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:31.729949 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-ba8ae794-98af-47bb-a1ba-f46a1bcbb1f2 req-00e8c86f-a189-41e7-92f5-18b2ee938c48 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:31.733700 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:17:31.747561 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-ba8ae794-98af-47bb-a1ba-f46a1bcbb1f2 req-00e8c86f-a189-41e7-92f5-18b2ee938c48 service nova] Creating event network-changed:51d288fb-771e-4e0b-8255-3f9cf651acf2 for instance e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9 on n-h1-846466-12 Aug 04 17:17:31.753778 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-ba8ae794-98af-47bb-a1ba-f46a1bcbb1f2 req-00e8c86f-a189-41e7-92f5-18b2ee938c48 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042139 Aug 04 17:17:31.755321 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2924/5956] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:32.033209 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b3b91221-7a24-4dd3-b947-b5ccd7b18774 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:32.034521 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b3b91221-7a24-4dd3-b947-b5ccd7b18774 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:32.042319 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b3b91221-7a24-4dd3-b947-b5ccd7b18774 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:32.042771 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b3b91221-7a24-4dd3-b947-b5ccd7b18774 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:32.043573 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b3b91221-7a24-4dd3-b947-b5ccd7b18774 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:32.044004 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b3b91221-7a24-4dd3-b947-b5ccd7b18774 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:32.429985 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b3b91221-7a24-4dd3-b947-b5ccd7b18774 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:32.443783 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b3b91221-7a24-4dd3-b947-b5ccd7b18774 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9" status: 200 len: 1373 microversion: 2.1 time: 0.414814 Aug 04 17:17:32.458339 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3033/5957] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:32 2022] GET /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9 => generated 1373 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:33.467973 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-58f4935a-7657-4980-86e8-baeaca48d94f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:33.468548 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-58f4935a-7657-4980-86e8-baeaca48d94f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:33.477438 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58f4935a-7657-4980-86e8-baeaca48d94f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:33.478224 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58f4935a-7657-4980-86e8-baeaca48d94f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:33.479638 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58f4935a-7657-4980-86e8-baeaca48d94f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:33.480355 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58f4935a-7657-4980-86e8-baeaca48d94f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:33.914131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-58f4935a-7657-4980-86e8-baeaca48d94f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:33.932897 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-58f4935a-7657-4980-86e8-baeaca48d94f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9" status: 200 len: 1373 microversion: 2.1 time: 0.469704 Aug 04 17:17:33.970096 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2925/5958] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:33 2022] GET /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9 => generated 1373 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:34.955497 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ebff3c40-c078-42b9-ab09-7878c145a2da tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:34.956770 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ebff3c40-c078-42b9-ab09-7878c145a2da tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:34.963920 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ebff3c40-c078-42b9-ab09-7878c145a2da tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:34.964371 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ebff3c40-c078-42b9-ab09-7878c145a2da tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:34.965149 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ebff3c40-c078-42b9-ab09-7878c145a2da tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:34.965661 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ebff3c40-c078-42b9-ab09-7878c145a2da tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:35.198781 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ebff3c40-c078-42b9-ab09-7878c145a2da tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:35.214008 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ebff3c40-c078-42b9-ab09-7878c145a2da tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9" status: 200 len: 1373 microversion: 2.1 time: 0.262430 Aug 04 17:17:35.230286 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3034/5959] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:34 2022] GET /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9 => generated 1373 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:36.240522 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1d6e7c73-5026-4c3c-882d-077673e8e9f1 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:36.241239 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1d6e7c73-5026-4c3c-882d-077673e8e9f1 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:36.252805 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d6e7c73-5026-4c3c-882d-077673e8e9f1 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:36.254735 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d6e7c73-5026-4c3c-882d-077673e8e9f1 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:36.257841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d6e7c73-5026-4c3c-882d-077673e8e9f1 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:36.258473 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d6e7c73-5026-4c3c-882d-077673e8e9f1 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:36.409981 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:17:36.497610 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:17:36.516883 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1d6e7c73-5026-4c3c-882d-077673e8e9f1 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:36.525621 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1d6e7c73-5026-4c3c-882d-077673e8e9f1 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9" status: 200 len: 1373 microversion: 2.1 time: 0.290912 Aug 04 17:17:36.526417 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2926/5960] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:36 2022] GET /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9 => generated 1373 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:37.547668 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bd859001-158d-478b-9d7b-5fb2ef24e1a7 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:37.548247 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bd859001-158d-478b-9d7b-5fb2ef24e1a7 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:37.550961 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:17:37.557346 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bd859001-158d-478b-9d7b-5fb2ef24e1a7 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:37.557792 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bd859001-158d-478b-9d7b-5fb2ef24e1a7 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:37.558791 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bd859001-158d-478b-9d7b-5fb2ef24e1a7 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:37.559207 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bd859001-158d-478b-9d7b-5fb2ef24e1a7 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:37.720571 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bd859001-158d-478b-9d7b-5fb2ef24e1a7 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:37.730209 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bd859001-158d-478b-9d7b-5fb2ef24e1a7 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9" status: 200 len: 1373 microversion: 2.1 time: 0.186868 Aug 04 17:17:37.743754 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3035/5961] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:37 2022] GET /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9 => generated 1373 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:38.129105 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-bd4e6668-8436-4c95-ba5b-34beee24d0d3 req-b4af9ac2-e017-4834-b15d-74404144ca03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9", "name": "network-vif-plugged", "status": "completed", "tag": "51d288fb-771e-4e0b-8255-3f9cf651acf2"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:38.143334 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-bd4e6668-8436-4c95-ba5b-34beee24d0d3 req-b4af9ac2-e017-4834-b15d-74404144ca03 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:38.143938 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-bd4e6668-8436-4c95-ba5b-34beee24d0d3 req-b4af9ac2-e017-4834-b15d-74404144ca03 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:38.156351 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-bd4e6668-8436-4c95-ba5b-34beee24d0d3 req-b4af9ac2-e017-4834-b15d-74404144ca03 service nova] Creating event network-vif-plugged:51d288fb-771e-4e0b-8255-3f9cf651acf2 for instance e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9 on n-h1-846466-12 Aug 04 17:17:38.162743 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-bd4e6668-8436-4c95-ba5b-34beee24d0d3 req-b4af9ac2-e017-4834-b15d-74404144ca03 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038991 Aug 04 17:17:38.163858 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2927/5962] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:38.751739 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-42ada053-9c5a-4454-a3e8-72f73f1e5291 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:38.753229 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-42ada053-9c5a-4454-a3e8-72f73f1e5291 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:38.762169 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-42ada053-9c5a-4454-a3e8-72f73f1e5291 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:38.762811 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-42ada053-9c5a-4454-a3e8-72f73f1e5291 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:38.763744 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-42ada053-9c5a-4454-a3e8-72f73f1e5291 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:38.764437 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-42ada053-9c5a-4454-a3e8-72f73f1e5291 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:39.010387 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-42ada053-9c5a-4454-a3e8-72f73f1e5291 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:39.019968 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-42ada053-9c5a-4454-a3e8-72f73f1e5291 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9" status: 200 len: 1373 microversion: 2.1 time: 0.272379 Aug 04 17:17:39.034103 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3036/5963] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:38 2022] GET /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9 => generated 1373 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:40.044425 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-54ef844c-1475-4a06-b7c9-105a0f09c79c tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:40.046131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-54ef844c-1475-4a06-b7c9-105a0f09c79c tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:40.048642 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:17:40.057637 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-54ef844c-1475-4a06-b7c9-105a0f09c79c tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:40.058095 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-54ef844c-1475-4a06-b7c9-105a0f09c79c tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:40.058969 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-54ef844c-1475-4a06-b7c9-105a0f09c79c tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:40.059456 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-54ef844c-1475-4a06-b7c9-105a0f09c79c tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:40.419422 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-54ef844c-1475-4a06-b7c9-105a0f09c79c tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:40.428104 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-54ef844c-1475-4a06-b7c9-105a0f09c79c tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9" status: 200 len: 1544 microversion: 2.1 time: 0.389310 Aug 04 17:17:40.429088 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2928/5964] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:40 2022] GET /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9 => generated 1544 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:40.450306 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-70bcfa99-2a27-4cdd-8efa-47df7c65c3b9 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:40.451664 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-70bcfa99-2a27-4cdd-8efa-47df7c65c3b9 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:40.462784 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-70bcfa99-2a27-4cdd-8efa-47df7c65c3b9 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:40.463388 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-70bcfa99-2a27-4cdd-8efa-47df7c65c3b9 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:40.464124 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-70bcfa99-2a27-4cdd-8efa-47df7c65c3b9 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:40.464556 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-70bcfa99-2a27-4cdd-8efa-47df7c65c3b9 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:40.825029 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-70bcfa99-2a27-4cdd-8efa-47df7c65c3b9 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:40.843638 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-70bcfa99-2a27-4cdd-8efa-47df7c65c3b9 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9" status: 200 len: 1544 microversion: 2.1 time: 0.390982 Aug 04 17:17:40.843638 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3037/5965] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:40 2022] GET /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9 => generated 1544 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:44.445131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-b07b1322-46bc-4255-b163-9ac45330611c req-f6987da0-5b57-4edb-9c60-3bf5fe9a0cdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9", "tag": "51d288fb-771e-4e0b-8255-3f9cf651acf2"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:44.474648 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-b07b1322-46bc-4255-b163-9ac45330611c req-f6987da0-5b57-4edb-9c60-3bf5fe9a0cdc service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:44.475760 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-b07b1322-46bc-4255-b163-9ac45330611c req-f6987da0-5b57-4edb-9c60-3bf5fe9a0cdc service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:44.496732 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-b07b1322-46bc-4255-b163-9ac45330611c req-f6987da0-5b57-4edb-9c60-3bf5fe9a0cdc service nova] Creating event network-changed:51d288fb-771e-4e0b-8255-3f9cf651acf2 for instance e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9 on n-h1-846466-12 Aug 04 17:17:44.514481 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-b07b1322-46bc-4255-b163-9ac45330611c req-f6987da0-5b57-4edb-9c60-3bf5fe9a0cdc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088111 Aug 04 17:17:44.515466 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2929/5966] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:46.937299 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ee60ba73-9eb7-4bad-8b79-1a92cf0bd30c tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:46.940339 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ee60ba73-9eb7-4bad-8b79-1a92cf0bd30c tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:46.948063 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ee60ba73-9eb7-4bad-8b79-1a92cf0bd30c tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:46.948802 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ee60ba73-9eb7-4bad-8b79-1a92cf0bd30c tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:46.949908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ee60ba73-9eb7-4bad-8b79-1a92cf0bd30c tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:46.950725 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ee60ba73-9eb7-4bad-8b79-1a92cf0bd30c tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:47.020552 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ee60ba73-9eb7-4bad-8b79-1a92cf0bd30c tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "POST /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c/action" status: 200 len: 63158 microversion: 2.1 time: 0.088972 Aug 04 17:17:47.021340 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3038/5967] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:17:46 2022] POST /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c/action => generated 63158 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:17:53.515730 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4e12a44d-e2d2-4c74-bc11-2c0584f3627b tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:53.517310 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4e12a44d-e2d2-4c74-bc11-2c0584f3627b tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:53.532310 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4e12a44d-e2d2-4c74-bc11-2c0584f3627b tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:53.533506 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4e12a44d-e2d2-4c74-bc11-2c0584f3627b tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:53.535432 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4e12a44d-e2d2-4c74-bc11-2c0584f3627b tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:53.536345 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4e12a44d-e2d2-4c74-bc11-2c0584f3627b tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:53.755366 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4e12a44d-e2d2-4c74-bc11-2c0584f3627b tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1836 microversion: 2.1 time: 0.250645 Aug 04 17:17:53.756024 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2930/5968] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:53 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1836 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:55.334877 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ce1e9e86-0624-4f9d-999f-5c4e521da7f9 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:55.335991 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ce1e9e86-0624-4f9d-999f-5c4e521da7f9 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:55.337801 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-7593b6bb-8070-4557-95f3-f223dc16763a req-6140b36e-a6bc-4c46-8d90-ccf98c62eaaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "274b5c58-9bd5-4fd0-8e51-8e52623be12c", "tag": "2cb3c423-6a6f-4b14-9715-f2909f91e90d"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:55.344774 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ce1e9e86-0624-4f9d-999f-5c4e521da7f9 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:55.345522 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ce1e9e86-0624-4f9d-999f-5c4e521da7f9 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:55.346456 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ce1e9e86-0624-4f9d-999f-5c4e521da7f9 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:55.347046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ce1e9e86-0624-4f9d-999f-5c4e521da7f9 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:55.357931 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-7593b6bb-8070-4557-95f3-f223dc16763a req-6140b36e-a6bc-4c46-8d90-ccf98c62eaaf service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:55.358953 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-7593b6bb-8070-4557-95f3-f223dc16763a req-6140b36e-a6bc-4c46-8d90-ccf98c62eaaf service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:55.382690 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ce1e9e86-0624-4f9d-999f-5c4e521da7f9 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:17:55.389165 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-7593b6bb-8070-4557-95f3-f223dc16763a req-6140b36e-a6bc-4c46-8d90-ccf98c62eaaf service nova] Creating event network-changed:2cb3c423-6a6f-4b14-9715-f2909f91e90d for instance 274b5c58-9bd5-4fd0-8e51-8e52623be12c on n-h2-846466-12 Aug 04 17:17:55.395978 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-7593b6bb-8070-4557-95f3-f223dc16763a req-6140b36e-a6bc-4c46-8d90-ccf98c62eaaf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061590 Aug 04 17:17:55.399903 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2931/5969] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:55.533398 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ce1e9e86-0624-4f9d-999f-5c4e521da7f9 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "DELETE /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 204 len: 0 microversion: 2.1 time: 0.202202 Aug 04 17:17:55.537041 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3039/5970] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:17:55 2022] DELETE /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 17:17:55.545033 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4833afc6-55be-4c78-9b69-bad9737ad25a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:55.548275 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4833afc6-55be-4c78-9b69-bad9737ad25a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:55.566516 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4833afc6-55be-4c78-9b69-bad9737ad25a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:55.567104 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4833afc6-55be-4c78-9b69-bad9737ad25a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:55.568669 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4833afc6-55be-4c78-9b69-bad9737ad25a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:55.569371 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4833afc6-55be-4c78-9b69-bad9737ad25a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:56.126949 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4833afc6-55be-4c78-9b69-bad9737ad25a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:56.135768 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4833afc6-55be-4c78-9b69-bad9737ad25a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1689 microversion: 2.1 time: 0.596159 Aug 04 17:17:56.136674 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2932/5971] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:55 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1689 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:57.158476 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8345af6f-d410-4bed-af77-c7ca14de2941 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:57.159927 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8345af6f-d410-4bed-af77-c7ca14de2941 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:57.168089 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8345af6f-d410-4bed-af77-c7ca14de2941 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:57.168893 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8345af6f-d410-4bed-af77-c7ca14de2941 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:57.170007 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8345af6f-d410-4bed-af77-c7ca14de2941 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:57.170687 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8345af6f-d410-4bed-af77-c7ca14de2941 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:57.539708 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8345af6f-d410-4bed-af77-c7ca14de2941 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:57.555819 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8345af6f-d410-4bed-af77-c7ca14de2941 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 200 len: 1689 microversion: 2.1 time: 0.401559 Aug 04 17:17:57.567204 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3040/5972] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:57 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 1689 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:58.013297 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-22e4cc07-0de5-40cc-8eb5-43ec8d878e8c req-2c1b1982-6f71-4972-b454-2e59c312d379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "274b5c58-9bd5-4fd0-8e51-8e52623be12c", "name": "network-vif-deleted", "tag": "2cb3c423-6a6f-4b14-9715-f2909f91e90d"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:58.063526 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-22e4cc07-0de5-40cc-8eb5-43ec8d878e8c req-2c1b1982-6f71-4972-b454-2e59c312d379 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:58.071573 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-22e4cc07-0de5-40cc-8eb5-43ec8d878e8c req-2c1b1982-6f71-4972-b454-2e59c312d379 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:58.092236 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-22e4cc07-0de5-40cc-8eb5-43ec8d878e8c req-2c1b1982-6f71-4972-b454-2e59c312d379 service nova] Creating event network-vif-deleted:2cb3c423-6a6f-4b14-9715-f2909f91e90d for instance 274b5c58-9bd5-4fd0-8e51-8e52623be12c on n-h2-846466-12 Aug 04 17:17:58.100378 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-22e4cc07-0de5-40cc-8eb5-43ec8d878e8c req-2c1b1982-6f71-4972-b454-2e59c312d379 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091322 Aug 04 17:17:58.101531 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2933/5973] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:17:58.953020 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b8873076-6b8b-40c4-8ccd-2e1701049766 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:58.953688 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b8873076-6b8b-40c4-8ccd-2e1701049766 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 274b5c58-9bd5-4fd0-8e51-8e52623be12c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:58.968867 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8873076-6b8b-40c4-8ccd-2e1701049766 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:58.969901 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8873076-6b8b-40c4-8ccd-2e1701049766 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:58.971260 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8873076-6b8b-40c4-8ccd-2e1701049766 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:17:58.972200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8873076-6b8b-40c4-8ccd-2e1701049766 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:17:58.990134 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-b8873076-6b8b-40c4-8ccd-2e1701049766 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] HTTP exception thrown: Instance 274b5c58-9bd5-4fd0-8e51-8e52623be12c could not be found. Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b8873076-6b8b-40c4-8ccd-2e1701049766 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Request method failure captured: Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c HTTP/1.1 Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_4YOThE04EgY2ZC-6Z4P4BLZorNPrwNYsXnudJ3q-g4O8Bpo6oQ4TtL_No6KcEehCahXC1c1rl575Jd3mS3Ei78aQ8uVNhdiDOypdyIumzQRzdLDSRFfSIpFDGraNFEgTS8aTaqqN8uid7ehZJahj9lTM6cYwjw3-kHQng3DwqKDNs Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: a080cbeb5c3a435a880e48ea64dbea70 Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1931304919 Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a080cbeb5c3a435a880e48ea64dbea70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a080cbeb5c3a435a880e48ea64dbea70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a080cbeb5c3a435a880e48ea64dbea70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a080cbeb5c3a435a880e48ea64dbea70"}]}] Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1931304919 Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: a080cbeb5c3a435a880e48ea64dbea70 Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1931304919 Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-TestNetworkAdvancedServerOps-1931304919-project Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: e4c6be7b0d164da98f08be0c35f843a2 Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1931304919-project Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 274b5c58-9bd5-4fd0-8e51-8e52623be12c could not be found. Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '274b5c58-9bd5-4fd0-8e51-8e52623be12c'} Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 274b5c58-9bd5-4fd0-8e51-8e52623be12c could not be found. Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 274b5c58-9bd5-4fd0-8e51-8e52623be12c could not be found. Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:17:58.992533 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:58.997461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:17:58.997461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:58.997461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:58.997461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:58.997461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:17:58.997461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:17:58.997461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 274b5c58-9bd5-4fd0-8e51-8e52623be12c could not be found. Aug 04 17:17:58.997461 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:17:58.999355 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b8873076-6b8b-40c4-8ccd-2e1701049766 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Returning 404 to user: Instance 274b5c58-9bd5-4fd0-8e51-8e52623be12c could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:17:59.000764 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b8873076-6b8b-40c4-8ccd-2e1701049766 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c" status: 404 len: 111 microversion: 2.1 time: 0.426010 Aug 04 17:17:59.002107 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3041/5974] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:58 2022] GET /compute/v2.1/servers/274b5c58-9bd5-4fd0-8e51-8e52623be12c => generated 111 bytes in 428 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:18:06.016121 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-654e1e14-b3fb-44e5-a53f-76afe64084fb tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '.version_select at 0x7f7e84b62160>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:06.072001 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-654e1e14-b3fb-44e5-a53f-76afe64084fb tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1557178140" status: 202 len: 0 microversion: 2.1 time: 0.069415 Aug 04 17:18:06.075617 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2934/5975] 10.222.0.23 () {58 vars in 1284 bytes} [Thu Aug 4 17:18:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1557178140 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 17:18:06.118547 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-96a8bbaf-0918-4b64-82d1-828bcef2a41e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Action: 'create', calling method: .version_select at 0x7f7e841c91f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2040918659", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlNXiZkUNy8yEMkEkpJk1YE9jvjT9GT5Y0T9bOj3rNIk9ViK+35Jc/G/n870f5thNKmKOaMkuMUqqV/RA6wCBNai40xEKiRvmFlTA7wAX5ugnjWsZJcLRSnacj1jCXSEw=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:06.126309 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:18:06.141485 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-96a8bbaf-0918-4b64-82d1-828bcef2a41e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Getting quotas for project a080cbeb5c3a435a880e48ea64dbea70. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:18:06.149941 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-96a8bbaf-0918-4b64-82d1-828bcef2a41e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Getting quotas for user e4c6be7b0d164da98f08be0c35f843a2 and project a080cbeb5c3a435a880e48ea64dbea70. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:18:06.190879 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-96a8bbaf-0918-4b64-82d1-828bcef2a41e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.077076 Aug 04 17:18:06.192093 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3042/5976] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 17:18:06 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:18:07.184012 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-32c3c297-faf8-42a8-8131-39e69d0f2985 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:07.191502 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-32c3c297-faf8-42a8-8131-39e69d0f2985 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:07.199539 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-32c3c297-faf8-42a8-8131-39e69d0f2985 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:07.200205 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-32c3c297-faf8-42a8-8131-39e69d0f2985 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:07.201520 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-32c3c297-faf8-42a8-8131-39e69d0f2985 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:07.202216 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-32c3c297-faf8-42a8-8131-39e69d0f2985 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:07.233036 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=40 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:18:07.285138 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-32c3c297-faf8-42a8-8131-39e69d0f2985 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "POST /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9/action" status: 200 len: 24555 microversion: 2.1 time: 0.108882 Aug 04 17:18:07.287131 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2935/5977] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:18:07 2022] POST /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9/action => generated 24555 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:18:14.359205 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:18:14.700284 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d2767e89-64dc-4f79-919b-9a7d7f1031d5 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:14.703047 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:18:14.703047 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 17:18:14.705801 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d2767e89-64dc-4f79-919b-9a7d7f1031d5 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:14.706796 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d2767e89-64dc-4f79-919b-9a7d7f1031d5 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:14.717057 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d2767e89-64dc-4f79-919b-9a7d7f1031d5 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:14.718424 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d2767e89-64dc-4f79-919b-9a7d7f1031d5 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:14.809469 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d2767e89-64dc-4f79-919b-9a7d7f1031d5 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.455587 Aug 04 17:18:14.827483 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3043/5978] 10.222.0.23 () {58 vars in 1185 bytes} [Thu Aug 4 17:18:14 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:18:15.037813 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cb8f04b1-b7e2-4891-af4d-7d1540e1384d tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1877997562", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "availability_zone": "nova:n-h1-846466-12", "networks": [{"uuid": "2b83759a-a49b-437c-8ecb-0bc23d70c36a"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:15.072024 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:18:15.278171 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-cb8f04b1-b7e2-4891-af4d-7d1540e1384d tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] validate_networks() for [('2b83759a-a49b-437c-8ecb-0bc23d70c36a', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:18:15.885046 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-cb8f04b1-b7e2-4891-af4d-7d1540e1384d tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:18:15.886231 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-cb8f04b1-b7e2-4891-af4d-7d1540e1384d tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:18:15.886884 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-cb8f04b1-b7e2-4891-af4d-7d1540e1384d tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:18:15.888023 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-cb8f04b1-b7e2-4891-af4d-7d1540e1384d tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:18:15.888710 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-cb8f04b1-b7e2-4891-af4d-7d1540e1384d tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:18:15.910298 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cb8f04b1-b7e2-4891-af4d-7d1540e1384d tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:15.910785 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cb8f04b1-b7e2-4891-af4d-7d1540e1384d tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:15.911698 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cb8f04b1-b7e2-4891-af4d-7d1540e1384d tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:15.912158 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cb8f04b1-b7e2-4891-af4d-7d1540e1384d tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:15.945471 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-cb8f04b1-b7e2-4891-af4d-7d1540e1384d tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Getting quotas for project 6c6915a1d3814029ad0a0ceb2013228f. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:18:15.953090 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-cb8f04b1-b7e2-4891-af4d-7d1540e1384d tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Getting quotas for user 2673f2716b5943f49c34a6d2068e64f7 and project 6c6915a1d3814029ad0a0ceb2013228f. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:18:15.970720 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cb8f04b1-b7e2-4891-af4d-7d1540e1384d tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:18:15.974535 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cb8f04b1-b7e2-4891-af4d-7d1540e1384d tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: 8a39e22a-9e6b-4302-90cc-726be76ccdc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:18:16.075386 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cb8f04b1-b7e2-4891-af4d-7d1540e1384d tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.045645 Aug 04 17:18:16.083669 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2936/5979] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:18:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 17:18:16.102038 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-90a6090c-69d9-4d5a-a0d9-0505c7e4bb15 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:16.107674 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-90a6090c-69d9-4d5a-a0d9-0505c7e4bb15 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: 8a39e22a-9e6b-4302-90cc-726be76ccdc7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:16.175917 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:18:16.525082 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-90a6090c-69d9-4d5a-a0d9-0505c7e4bb15 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7" status: 200 len: 1329 microversion: 2.1 time: 0.425670 Aug 04 17:18:16.531334 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3044/5980] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:16 2022] GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7 => generated 1329 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:17.551649 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8ff095d2-558f-4951-a324-7c4938e1d5fd tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:17.553068 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8ff095d2-558f-4951-a324-7c4938e1d5fd tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: 8a39e22a-9e6b-4302-90cc-726be76ccdc7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:17.575750 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8ff095d2-558f-4951-a324-7c4938e1d5fd tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:17.583036 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8ff095d2-558f-4951-a324-7c4938e1d5fd tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:17.584354 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8ff095d2-558f-4951-a324-7c4938e1d5fd tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:17.584917 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8ff095d2-558f-4951-a324-7c4938e1d5fd tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:17.789210 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8ff095d2-558f-4951-a324-7c4938e1d5fd tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7" status: 200 len: 1338 microversion: 2.1 time: 0.242298 Aug 04 17:18:17.802635 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2937/5981] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:17 2022] GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7 => generated 1338 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:18.291742 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7ba66c0d-8ea0-4a9f-9e52-30ab49966702 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:18.325518 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7ba66c0d-8ea0-4a9f-9e52-30ab49966702 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:18.356516 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ba66c0d-8ea0-4a9f-9e52-30ab49966702 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:18.357883 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ba66c0d-8ea0-4a9f-9e52-30ab49966702 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:18.366012 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ba66c0d-8ea0-4a9f-9e52-30ab49966702 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:18.367161 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7ba66c0d-8ea0-4a9f-9e52-30ab49966702 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:18.486782 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7ba66c0d-8ea0-4a9f-9e52-30ab49966702 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "POST /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9/action" status: 200 len: 32623 microversion: 2.1 time: 0.203382 Aug 04 17:18:18.487740 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3045/5982] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:18:18 2022] POST /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9/action => generated 32623 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 17:18:18.608739 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7f6266f3-477b-4b53-8e88-6e7b32789c62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-804384271", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "3ddbb771-bbcc-4503-84c1-4b2f8ba31292"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2040918659", "security_groups": [{"name": "tempest-secgroup-smoke-850142102"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:18.838615 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-abfc4dc6-1374-4d9b-95e1-f665b91b59e0 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:18.839453 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-abfc4dc6-1374-4d9b-95e1-f665b91b59e0 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: 8a39e22a-9e6b-4302-90cc-726be76ccdc7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:18.872825 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-abfc4dc6-1374-4d9b-95e1-f665b91b59e0 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:18.874576 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-abfc4dc6-1374-4d9b-95e1-f665b91b59e0 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:18.876500 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-abfc4dc6-1374-4d9b-95e1-f665b91b59e0 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:18.877207 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-abfc4dc6-1374-4d9b-95e1-f665b91b59e0 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:18.965018 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-7f6266f3-477b-4b53-8e88-6e7b32789c62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] validate_networks() for [('3ddbb771-bbcc-4503-84c1-4b2f8ba31292', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:18:19.410304 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-abfc4dc6-1374-4d9b-95e1-f665b91b59e0 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7" status: 200 len: 1424 microversion: 2.1 time: 0.601901 Aug 04 17:18:19.411588 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3046/5983] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:18 2022] GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7 => generated 1424 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:18:20.435095 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-13421fac-801f-4f27-9d8f-3947a7ab4ab2 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:20.436718 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-13421fac-801f-4f27-9d8f-3947a7ab4ab2 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: 8a39e22a-9e6b-4302-90cc-726be76ccdc7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:20.461838 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-13421fac-801f-4f27-9d8f-3947a7ab4ab2 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:20.462345 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-13421fac-801f-4f27-9d8f-3947a7ab4ab2 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:20.463183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-13421fac-801f-4f27-9d8f-3947a7ab4ab2 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:20.463872 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-13421fac-801f-4f27-9d8f-3947a7ab4ab2 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:20.659538 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-7f6266f3-477b-4b53-8e88-6e7b32789c62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:18:20.663617 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-7f6266f3-477b-4b53-8e88-6e7b32789c62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:18:20.668890 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-7f6266f3-477b-4b53-8e88-6e7b32789c62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:18:20.669980 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-7f6266f3-477b-4b53-8e88-6e7b32789c62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:18:20.673734 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-7f6266f3-477b-4b53-8e88-6e7b32789c62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:18:20.679327 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-13421fac-801f-4f27-9d8f-3947a7ab4ab2 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7" status: 200 len: 1424 microversion: 2.1 time: 0.250183 Aug 04 17:18:20.697933 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3047/5984] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:20 2022] GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7 => generated 1424 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:18:20.737656 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f6266f3-477b-4b53-8e88-6e7b32789c62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:20.740616 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f6266f3-477b-4b53-8e88-6e7b32789c62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:20.744059 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f6266f3-477b-4b53-8e88-6e7b32789c62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:20.745940 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f6266f3-477b-4b53-8e88-6e7b32789c62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:20.829426 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-7f6266f3-477b-4b53-8e88-6e7b32789c62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Getting quotas for project a080cbeb5c3a435a880e48ea64dbea70. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:18:20.843809 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-7f6266f3-477b-4b53-8e88-6e7b32789c62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Getting quotas for user e4c6be7b0d164da98f08be0c35f843a2 and project a080cbeb5c3a435a880e48ea64dbea70. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:18:20.905598 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7f6266f3-477b-4b53-8e88-6e7b32789c62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:18:20.914667 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7f6266f3-477b-4b53-8e88-6e7b32789c62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:18:21.110951 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7f6266f3-477b-4b53-8e88-6e7b32789c62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.507220 Aug 04 17:18:21.116502 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2938/5985] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:18:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 2513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:18:21.150420 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4ad99e29-f351-47e5-ae74-549c2fd96cce tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:21.156569 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4ad99e29-f351-47e5-ae74-549c2fd96cce tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:21.380093 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4ad99e29-f351-47e5-ae74-549c2fd96cce tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:21.391593 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4ad99e29-f351-47e5-ae74-549c2fd96cce tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab" status: 200 len: 1266 microversion: 2.1 time: 0.262543 Aug 04 17:18:21.396329 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3048/5986] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:21 2022] GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab => generated 1266 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:21.713103 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-81b1b6cf-8fba-49af-80b7-9255590c2555 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:21.716223 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-81b1b6cf-8fba-49af-80b7-9255590c2555 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: 8a39e22a-9e6b-4302-90cc-726be76ccdc7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:21.791976 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-81b1b6cf-8fba-49af-80b7-9255590c2555 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:21.796389 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-81b1b6cf-8fba-49af-80b7-9255590c2555 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:21.802190 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-81b1b6cf-8fba-49af-80b7-9255590c2555 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:21.803580 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-81b1b6cf-8fba-49af-80b7-9255590c2555 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:22.433459 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2d227580-c8e5-476a-ba35-90042147c6ad tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:22.434276 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2d227580-c8e5-476a-ba35-90042147c6ad tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:22.447347 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d227580-c8e5-476a-ba35-90042147c6ad tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:22.447782 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d227580-c8e5-476a-ba35-90042147c6ad tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:22.448739 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d227580-c8e5-476a-ba35-90042147c6ad tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:22.449260 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d227580-c8e5-476a-ba35-90042147c6ad tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:22.738163 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2d227580-c8e5-476a-ba35-90042147c6ad tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:22.747898 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2d227580-c8e5-476a-ba35-90042147c6ad tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab" status: 200 len: 1270 microversion: 2.1 time: 0.319027 Aug 04 17:18:22.759389 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3049/5987] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:22 2022] GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab => generated 1270 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:23.098378 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-81b1b6cf-8fba-49af-80b7-9255590c2555 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7" status: 200 len: 1466 microversion: 2.1 time: 1.396275 Aug 04 17:18:23.101340 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2939/5988] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:21 2022] GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7 => generated 1466 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:23.135144 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b8cd1f0a-b551-40d5-8523-7892dfd0980e tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:23.136575 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b8cd1f0a-b551-40d5-8523-7892dfd0980e tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:23.153384 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8cd1f0a-b551-40d5-8523-7892dfd0980e tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:23.154156 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8cd1f0a-b551-40d5-8523-7892dfd0980e tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:23.155747 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8cd1f0a-b551-40d5-8523-7892dfd0980e tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:23.156430 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8cd1f0a-b551-40d5-8523-7892dfd0980e tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:23.285150 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b8cd1f0a-b551-40d5-8523-7892dfd0980e tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:18:23.340930 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-7c2e5818-9fc5-4253-b38c-f79aba10a463 req-c032ec63-62fc-4763-99eb-d6625ad29302 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9", "tag": "51d288fb-771e-4e0b-8255-3f9cf651acf2"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:23.387972 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-7c2e5818-9fc5-4253-b38c-f79aba10a463 req-c032ec63-62fc-4763-99eb-d6625ad29302 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:23.388511 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-7c2e5818-9fc5-4253-b38c-f79aba10a463 req-c032ec63-62fc-4763-99eb-d6625ad29302 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:23.437942 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-7c2e5818-9fc5-4253-b38c-f79aba10a463 req-c032ec63-62fc-4763-99eb-d6625ad29302 service nova] Creating event network-changed:51d288fb-771e-4e0b-8255-3f9cf651acf2 for instance e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9 on n-h1-846466-12 Aug 04 17:18:23.455199 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-7c2e5818-9fc5-4253-b38c-f79aba10a463 req-c032ec63-62fc-4763-99eb-d6625ad29302 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122722 Aug 04 17:18:23.460380 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2940/5989] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:18:23.540767 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b8cd1f0a-b551-40d5-8523-7892dfd0980e tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9" status: 204 len: 0 microversion: 2.1 time: 0.408964 Aug 04 17:18:23.554608 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-aa163b73-cc6d-4e31-b013-8f10371b7f1f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:23.555352 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-aa163b73-cc6d-4e31-b013-8f10371b7f1f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:23.557392 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3050/5990] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:18:23 2022] DELETE /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:18:23.568668 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aa163b73-cc6d-4e31-b013-8f10371b7f1f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:23.569128 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aa163b73-cc6d-4e31-b013-8f10371b7f1f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:23.575898 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aa163b73-cc6d-4e31-b013-8f10371b7f1f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:23.577039 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-aa163b73-cc6d-4e31-b013-8f10371b7f1f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:23.797258 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d503d8e7-94f0-4354-b598-aa9242dde4db tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:23.798007 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d503d8e7-94f0-4354-b598-aa9242dde4db tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:23.816340 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d503d8e7-94f0-4354-b598-aa9242dde4db tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:23.816898 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d503d8e7-94f0-4354-b598-aa9242dde4db tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:23.817799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d503d8e7-94f0-4354-b598-aa9242dde4db tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:23.818501 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d503d8e7-94f0-4354-b598-aa9242dde4db tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:24.023797 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d503d8e7-94f0-4354-b598-aa9242dde4db tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:24.038180 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d503d8e7-94f0-4354-b598-aa9242dde4db tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab" status: 200 len: 1324 microversion: 2.1 time: 0.245456 Aug 04 17:18:24.039134 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3051/5991] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:23 2022] GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab => generated 1324 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:18:24.123658 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3c4c3484-5d83-4f04-84ab-9bde998c7ed8 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:24.124556 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3c4c3484-5d83-4f04-84ab-9bde998c7ed8 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: 8a39e22a-9e6b-4302-90cc-726be76ccdc7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:24.134879 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3c4c3484-5d83-4f04-84ab-9bde998c7ed8 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:24.136378 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3c4c3484-5d83-4f04-84ab-9bde998c7ed8 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:24.137480 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3c4c3484-5d83-4f04-84ab-9bde998c7ed8 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:24.138154 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3c4c3484-5d83-4f04-84ab-9bde998c7ed8 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:24.138608 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-aa163b73-cc6d-4e31-b013-8f10371b7f1f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:24.180541 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-aa163b73-cc6d-4e31-b013-8f10371b7f1f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9" status: 200 len: 1669 microversion: 2.1 time: 0.632762 Aug 04 17:18:24.185214 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2941/5992] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:23 2022] GET /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9 => generated 1669 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:24.648012 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3c4c3484-5d83-4f04-84ab-9bde998c7ed8 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7" status: 200 len: 1466 microversion: 2.1 time: 0.529680 Aug 04 17:18:24.664550 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3052/5993] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:24 2022] GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7 => generated 1466 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:18:25.081840 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ef659314-4b58-4840-b71e-b21edc161981 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:25.082945 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ef659314-4b58-4840-b71e-b21edc161981 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:25.095742 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ef659314-4b58-4840-b71e-b21edc161981 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:25.096861 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ef659314-4b58-4840-b71e-b21edc161981 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:25.098106 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ef659314-4b58-4840-b71e-b21edc161981 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:25.098881 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ef659314-4b58-4840-b71e-b21edc161981 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:25.209221 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ad29f6a7-9bc7-4b6a-be63-64a949ce44da tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:25.210714 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ad29f6a7-9bc7-4b6a-be63-64a949ce44da tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:25.220744 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:18:25.225159 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad29f6a7-9bc7-4b6a-be63-64a949ce44da tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:25.226607 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad29f6a7-9bc7-4b6a-be63-64a949ce44da tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:25.228211 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad29f6a7-9bc7-4b6a-be63-64a949ce44da tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:25.229226 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad29f6a7-9bc7-4b6a-be63-64a949ce44da tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:25.288538 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ef659314-4b58-4840-b71e-b21edc161981 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:25.300349 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ef659314-4b58-4840-b71e-b21edc161981 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab" status: 200 len: 1324 microversion: 2.1 time: 0.225829 Aug 04 17:18:25.305170 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2942/5994] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:25 2022] GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab => generated 1324 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:25.501834 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-9b0a71e4-eb54-43b9-b14b-5fdc8f5dabf2 req-d5d39944-aaa7-44e9-95ef-df7f7c5631b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a39e22a-9e6b-4302-90cc-726be76ccdc7", "tag": "8fc66c97-231f-4ac0-8de4-7e24ac24cd9f"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:25.517176 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-9b0a71e4-eb54-43b9-b14b-5fdc8f5dabf2 req-d5d39944-aaa7-44e9-95ef-df7f7c5631b9 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:25.517950 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-9b0a71e4-eb54-43b9-b14b-5fdc8f5dabf2 req-d5d39944-aaa7-44e9-95ef-df7f7c5631b9 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:25.531554 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-9b0a71e4-eb54-43b9-b14b-5fdc8f5dabf2 req-d5d39944-aaa7-44e9-95ef-df7f7c5631b9 service nova] Creating event network-changed:8fc66c97-231f-4ac0-8de4-7e24ac24cd9f for instance 8a39e22a-9e6b-4302-90cc-726be76ccdc7 on n-h1-846466-12 Aug 04 17:18:25.537868 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-9b0a71e4-eb54-43b9-b14b-5fdc8f5dabf2 req-d5d39944-aaa7-44e9-95ef-df7f7c5631b9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043760 Aug 04 17:18:25.538961 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2943/5995] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:18:25.672906 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c98b1152-0075-457e-a124-0d78075b57d4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:25.673854 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c98b1152-0075-457e-a124-0d78075b57d4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: 8a39e22a-9e6b-4302-90cc-726be76ccdc7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:25.696075 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c98b1152-0075-457e-a124-0d78075b57d4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:25.700885 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c98b1152-0075-457e-a124-0d78075b57d4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:25.701474 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ad29f6a7-9bc7-4b6a-be63-64a949ce44da tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:25.709242 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c98b1152-0075-457e-a124-0d78075b57d4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:25.710807 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c98b1152-0075-457e-a124-0d78075b57d4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:25.724103 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ad29f6a7-9bc7-4b6a-be63-64a949ce44da tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9" status: 200 len: 1669 microversion: 2.1 time: 0.519490 Aug 04 17:18:25.724103 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3053/5996] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:25 2022] GET /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9 => generated 1669 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:26.051781 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c98b1152-0075-457e-a124-0d78075b57d4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7" status: 200 len: 1466 microversion: 2.1 time: 0.383808 Aug 04 17:18:26.052813 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2944/5997] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:25 2022] GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7 => generated 1466 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:26.325884 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f66d44bf-6340-4e16-8686-362905cbb4ce tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:26.326827 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f66d44bf-6340-4e16-8686-362905cbb4ce tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:26.336031 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f66d44bf-6340-4e16-8686-362905cbb4ce tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:26.336672 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f66d44bf-6340-4e16-8686-362905cbb4ce tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:26.337739 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f66d44bf-6340-4e16-8686-362905cbb4ce tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:26.338350 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f66d44bf-6340-4e16-8686-362905cbb4ce tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:26.593752 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f66d44bf-6340-4e16-8686-362905cbb4ce tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:26.610296 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f66d44bf-6340-4e16-8686-362905cbb4ce tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab" status: 200 len: 1391 microversion: 2.1 time: 0.287950 Aug 04 17:18:26.620336 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3054/5998] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:26 2022] GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab => generated 1391 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:26.634843 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-9f4d2fc8-b7da-4885-a9e3-49b0aa18a7c3 req-d201c007-2e7a-44e7-ae44-807c41ddb8c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9", "name": "network-vif-deleted", "tag": "51d288fb-771e-4e0b-8255-3f9cf651acf2"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:26.660245 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-9f4d2fc8-b7da-4885-a9e3-49b0aa18a7c3 req-d201c007-2e7a-44e7-ae44-807c41ddb8c4 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:26.660706 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-9f4d2fc8-b7da-4885-a9e3-49b0aa18a7c3 req-d201c007-2e7a-44e7-ae44-807c41ddb8c4 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:26.701703 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-9f4d2fc8-b7da-4885-a9e3-49b0aa18a7c3 req-d201c007-2e7a-44e7-ae44-807c41ddb8c4 service nova] Creating event network-vif-deleted:51d288fb-771e-4e0b-8255-3f9cf651acf2 for instance e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9 on n-h1-846466-12 Aug 04 17:18:26.710323 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-9f4d2fc8-b7da-4885-a9e3-49b0aa18a7c3 req-d201c007-2e7a-44e7-ae44-807c41ddb8c4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089262 Aug 04 17:18:26.711880 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2945/5999] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:18:26.777388 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e6f1561b-67c6-47a3-8469-8144d97ab0ca tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:26.783791 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e6f1561b-67c6-47a3-8469-8144d97ab0ca tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:26.798212 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e6f1561b-67c6-47a3-8469-8144d97ab0ca tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:26.799385 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e6f1561b-67c6-47a3-8469-8144d97ab0ca tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:26.801937 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e6f1561b-67c6-47a3-8469-8144d97ab0ca tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:26.802873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e6f1561b-67c6-47a3-8469-8144d97ab0ca tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:26.964063 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e6f1561b-67c6-47a3-8469-8144d97ab0ca tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208d51c5701647a39b2ee6a3b999fe27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2dc5d0512d34a47b06925edfebfce57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:26.996776 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e6f1561b-67c6-47a3-8469-8144d97ab0ca tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9" status: 200 len: 1483 microversion: 2.1 time: 0.253536 Aug 04 17:18:27.002785 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3055/6000] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:26 2022] GET /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9 => generated 1483 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:27.083331 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c4ce42f3-a02f-4507-9de8-2550503ae5e9 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:27.084689 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c4ce42f3-a02f-4507-9de8-2550503ae5e9 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: 8a39e22a-9e6b-4302-90cc-726be76ccdc7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:27.095205 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4ce42f3-a02f-4507-9de8-2550503ae5e9 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:27.096764 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4ce42f3-a02f-4507-9de8-2550503ae5e9 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:27.098631 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4ce42f3-a02f-4507-9de8-2550503ae5e9 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:27.099546 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4ce42f3-a02f-4507-9de8-2550503ae5e9 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:27.305821 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c4ce42f3-a02f-4507-9de8-2550503ae5e9 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7" status: 200 len: 1466 microversion: 2.1 time: 0.227711 Aug 04 17:18:27.306430 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2946/6001] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:27 2022] GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7 => generated 1466 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:27.634186 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-97d91252-587d-43c6-b5f1-e8bca77070b1 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:27.635374 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-97d91252-587d-43c6-b5f1-e8bca77070b1 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:27.648383 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-97d91252-587d-43c6-b5f1-e8bca77070b1 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:27.649275 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-97d91252-587d-43c6-b5f1-e8bca77070b1 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:27.651046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-97d91252-587d-43c6-b5f1-e8bca77070b1 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:27.651707 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-97d91252-587d-43c6-b5f1-e8bca77070b1 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:27.936754 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-97d91252-587d-43c6-b5f1-e8bca77070b1 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:27.958420 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-97d91252-587d-43c6-b5f1-e8bca77070b1 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab" status: 200 len: 1391 microversion: 2.1 time: 0.329646 Aug 04 17:18:27.971027 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3056/6002] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:27 2022] GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab => generated 1391 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:28.034127 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c6992070-0ed9-4ccb-97c6-b3ba390671d9 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:28.035474 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c6992070-0ed9-4ccb-97c6-b3ba390671d9 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] [instance: e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:28.049566 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c6992070-0ed9-4ccb-97c6-b3ba390671d9 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:28.053710 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c6992070-0ed9-4ccb-97c6-b3ba390671d9 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:28.058014 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c6992070-0ed9-4ccb-97c6-b3ba390671d9 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:28.058758 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c6992070-0ed9-4ccb-97c6-b3ba390671d9 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:28.090290 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-c6992070-0ed9-4ccb-97c6-b3ba390671d9 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] HTTP exception thrown: Instance e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9 could not be found. Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c6992070-0ed9-4ccb-97c6-b3ba390671d9 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Request method failure captured: Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9 HTTP/1.1 Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_5v6NcUJlSwUwdPqA9Qzo7Y5lXa2-X0U9uYvxzRetTqQ9hf9PxHi2m5nxA-bBW9lcac5PKShwBrdE3hKXjFwdvu-jAh9VQgr9YLADQ6vivr5hFH_1trtgIv51i7s6J0Qpuo3tCnzX2TI35OwnoUVYmHhywAOMh0ghGDAxG0ahqOwps Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: f2dc5d0512d34a47b06925edfebfce57 Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-TestNetworkBasicOps-103807392 Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f2dc5d0512d34a47b06925edfebfce57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f2dc5d0512d34a47b06925edfebfce57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f2dc5d0512d34a47b06925edfebfce57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f2dc5d0512d34a47b06925edfebfce57"}]}] Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-TestNetworkBasicOps-103807392 Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: f2dc5d0512d34a47b06925edfebfce57 Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-TestNetworkBasicOps-103807392 Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-TestNetworkBasicOps-103807392-project Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 208d51c5701647a39b2ee6a3b999fe27 Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-TestNetworkBasicOps-103807392-project Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9 could not be found. Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9'} Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9 could not be found. Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9 could not be found. Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:28.092417 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:18:28.097272 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:28.097272 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:28.097272 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:28.097272 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:18:28.097272 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:18:28.097272 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9 could not be found. Aug 04 17:18:28.097272 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:18:28.099124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c6992070-0ed9-4ccb-97c6-b3ba390671d9 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Returning 404 to user: Instance e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:18:28.100248 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c6992070-0ed9-4ccb-97c6-b3ba390671d9 tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "GET /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9" status: 404 len: 111 microversion: 2.1 time: 0.074098 Aug 04 17:18:28.104107 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2947/6003] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:28 2022] GET /compute/v2.1/servers/e98bd1e7-6d31-4fb6-8ca2-00fcb0912ea9 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:18:28.333012 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f0eb724c-6eff-4df9-802e-919c98f0b6a3 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:28.333676 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f0eb724c-6eff-4df9-802e-919c98f0b6a3 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: 8a39e22a-9e6b-4302-90cc-726be76ccdc7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:28.353550 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f0eb724c-6eff-4df9-802e-919c98f0b6a3 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:28.354007 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f0eb724c-6eff-4df9-802e-919c98f0b6a3 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:28.354828 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f0eb724c-6eff-4df9-802e-919c98f0b6a3 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:28.355264 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f0eb724c-6eff-4df9-802e-919c98f0b6a3 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:28.754938 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-a53f26d5-77f7-499f-8796-ffd251806eeb req-26395de3-8bdd-4949-a2e3-7b1fff36c403 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab", "tag": "661f3496-b7c1-46e5-a11c-44ddf7c3619b"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:28.787125 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a53f26d5-77f7-499f-8796-ffd251806eeb req-26395de3-8bdd-4949-a2e3-7b1fff36c403 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:28.788521 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a53f26d5-77f7-499f-8796-ffd251806eeb req-26395de3-8bdd-4949-a2e3-7b1fff36c403 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:28.815894 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-a53f26d5-77f7-499f-8796-ffd251806eeb req-26395de3-8bdd-4949-a2e3-7b1fff36c403 service nova] Creating event network-changed:661f3496-b7c1-46e5-a11c-44ddf7c3619b for instance eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab on n-h2-846466-12 Aug 04 17:18:28.826525 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-a53f26d5-77f7-499f-8796-ffd251806eeb req-26395de3-8bdd-4949-a2e3-7b1fff36c403 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078591 Aug 04 17:18:28.829273 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2948/6004] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:18:29.012384 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cbbfd4c7-0a2e-45cb-8bc7-0e18d0c01d48 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:29.015842 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cbbfd4c7-0a2e-45cb-8bc7-0e18d0c01d48 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:29.043227 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cbbfd4c7-0a2e-45cb-8bc7-0e18d0c01d48 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:29.052500 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cbbfd4c7-0a2e-45cb-8bc7-0e18d0c01d48 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:29.054357 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cbbfd4c7-0a2e-45cb-8bc7-0e18d0c01d48 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:29.055768 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cbbfd4c7-0a2e-45cb-8bc7-0e18d0c01d48 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:29.197700 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f0eb724c-6eff-4df9-802e-919c98f0b6a3 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7" status: 200 len: 1466 microversion: 2.1 time: 0.869291 Aug 04 17:18:29.206687 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3057/6005] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:28 2022] GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7 => generated 1466 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:18:29.252007 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7a384e1f-05e7-4505-b6b5-bd5376d1a41f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] Calling method '.version_select at 0x7f7e848e5040>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:29.283437 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7a384e1f-05e7-4505-b6b5-bd5376d1a41f tempest-TestNetworkBasicOps-103807392 tempest-TestNetworkBasicOps-103807392-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2036697594" status: 202 len: 0 microversion: 2.1 time: 0.037019 Aug 04 17:18:29.284576 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3058/6006] 10.222.0.23 () {58 vars in 1257 bytes} [Thu Aug 4 17:18:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2036697594 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:18:29.509929 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cbbfd4c7-0a2e-45cb-8bc7-0e18d0c01d48 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:29.528859 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cbbfd4c7-0a2e-45cb-8bc7-0e18d0c01d48 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab" status: 200 len: 1391 microversion: 2.1 time: 0.532997 Aug 04 17:18:29.529951 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2949/6007] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:28 2022] GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab => generated 1391 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:30.220530 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-364cd0f0-e79d-47c9-8628-a15deb49e864 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:30.221760 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-364cd0f0-e79d-47c9-8628-a15deb49e864 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: 8a39e22a-9e6b-4302-90cc-726be76ccdc7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:30.237448 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-364cd0f0-e79d-47c9-8628-a15deb49e864 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:30.237883 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-364cd0f0-e79d-47c9-8628-a15deb49e864 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:30.238687 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-364cd0f0-e79d-47c9-8628-a15deb49e864 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:30.253338 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-364cd0f0-e79d-47c9-8628-a15deb49e864 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:30.557611 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8a3db251-825f-463e-b39f-d6b61b2e7e79 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:30.559081 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8a3db251-825f-463e-b39f-d6b61b2e7e79 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:30.567553 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a3db251-825f-463e-b39f-d6b61b2e7e79 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:30.569074 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a3db251-825f-463e-b39f-d6b61b2e7e79 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:30.570174 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a3db251-825f-463e-b39f-d6b61b2e7e79 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:30.570868 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a3db251-825f-463e-b39f-d6b61b2e7e79 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:30.625899 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-364cd0f0-e79d-47c9-8628-a15deb49e864 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7" status: 200 len: 1466 microversion: 2.1 time: 0.410625 Aug 04 17:18:30.626832 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3059/6008] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:30 2022] GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7 => generated 1466 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:30.781301 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=4 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:18:30.833429 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8a3db251-825f-463e-b39f-d6b61b2e7e79 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:30.841820 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8a3db251-825f-463e-b39f-d6b61b2e7e79 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab" status: 200 len: 1391 microversion: 2.1 time: 0.288247 Aug 04 17:18:30.842632 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2950/6009] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:30 2022] GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab => generated 1391 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:31.650945 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fed30281-9e2f-4506-9804-2244d7e5cc4b tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:31.653046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fed30281-9e2f-4506-9804-2244d7e5cc4b tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: 8a39e22a-9e6b-4302-90cc-726be76ccdc7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:31.663554 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:18:31.667624 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fed30281-9e2f-4506-9804-2244d7e5cc4b tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:31.668211 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fed30281-9e2f-4506-9804-2244d7e5cc4b tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:31.669375 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fed30281-9e2f-4506-9804-2244d7e5cc4b tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:31.672093 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fed30281-9e2f-4506-9804-2244d7e5cc4b tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:31.882899 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5b06a1f6-54c1-4337-9492-23528dce408a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:31.885529 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5b06a1f6-54c1-4337-9492-23528dce408a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:31.892761 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=12 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:18:31.896170 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5b06a1f6-54c1-4337-9492-23528dce408a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:31.897253 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5b06a1f6-54c1-4337-9492-23528dce408a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:31.898337 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5b06a1f6-54c1-4337-9492-23528dce408a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:31.899032 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5b06a1f6-54c1-4337-9492-23528dce408a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:31.899151 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fed30281-9e2f-4506-9804-2244d7e5cc4b tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7" status: 200 len: 1466 microversion: 2.1 time: 0.255469 Aug 04 17:18:31.901892 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3060/6010] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:31 2022] GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7 => generated 1466 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:32.229480 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5b06a1f6-54c1-4337-9492-23528dce408a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:32.246506 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5b06a1f6-54c1-4337-9492-23528dce408a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab" status: 200 len: 1391 microversion: 2.1 time: 0.382950 Aug 04 17:18:32.248294 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2951/6011] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:31 2022] GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab => generated 1391 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:32.926703 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c61aa60d-d08b-408b-af28-63b2c628a250 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:32.927943 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c61aa60d-d08b-408b-af28-63b2c628a250 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: 8a39e22a-9e6b-4302-90cc-726be76ccdc7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:32.936712 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c61aa60d-d08b-408b-af28-63b2c628a250 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:32.937951 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c61aa60d-d08b-408b-af28-63b2c628a250 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:32.938922 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c61aa60d-d08b-408b-af28-63b2c628a250 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:32.939505 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c61aa60d-d08b-408b-af28-63b2c628a250 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:33.013657 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-88f88105-81d6-474a-aa5b-e841f64e3af6 req-a0d858c5-3105-43fa-a3fd-9c435cb92d08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a39e22a-9e6b-4302-90cc-726be76ccdc7", "name": "network-vif-plugged", "status": "completed", "tag": "8fc66c97-231f-4ac0-8de4-7e24ac24cd9f"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:33.029582 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-88f88105-81d6-474a-aa5b-e841f64e3af6 req-a0d858c5-3105-43fa-a3fd-9c435cb92d08 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:33.030504 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-88f88105-81d6-474a-aa5b-e841f64e3af6 req-a0d858c5-3105-43fa-a3fd-9c435cb92d08 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:33.047313 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-88f88105-81d6-474a-aa5b-e841f64e3af6 req-a0d858c5-3105-43fa-a3fd-9c435cb92d08 service nova] Creating event network-vif-plugged:8fc66c97-231f-4ac0-8de4-7e24ac24cd9f for instance 8a39e22a-9e6b-4302-90cc-726be76ccdc7 on n-h1-846466-12 Aug 04 17:18:33.061254 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-88f88105-81d6-474a-aa5b-e841f64e3af6 req-a0d858c5-3105-43fa-a3fd-9c435cb92d08 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048031 Aug 04 17:18:33.062153 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2952/6012] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:18:33.269330 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f0a8b4b1-51a3-46e1-baf3-55eb42fce847 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:33.270140 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f0a8b4b1-51a3-46e1-baf3-55eb42fce847 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:33.281043 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f0a8b4b1-51a3-46e1-baf3-55eb42fce847 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:33.283860 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f0a8b4b1-51a3-46e1-baf3-55eb42fce847 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:33.285859 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f0a8b4b1-51a3-46e1-baf3-55eb42fce847 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:33.286716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f0a8b4b1-51a3-46e1-baf3-55eb42fce847 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:33.632685 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:18:33.644059 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c61aa60d-d08b-408b-af28-63b2c628a250 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7" status: 200 len: 1466 microversion: 2.1 time: 0.721149 Aug 04 17:18:33.645034 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3061/6013] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:32 2022] GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7 => generated 1466 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:33.872426 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f0a8b4b1-51a3-46e1-baf3-55eb42fce847 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:33.880663 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f0a8b4b1-51a3-46e1-baf3-55eb42fce847 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab" status: 200 len: 1391 microversion: 2.1 time: 0.615959 Aug 04 17:18:33.884357 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2953/6014] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:33 2022] GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab => generated 1391 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:18:34.664666 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c3e37503-a331-4ffc-82be-26c5633ce1d8 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:34.666201 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c3e37503-a331-4ffc-82be-26c5633ce1d8 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: 8a39e22a-9e6b-4302-90cc-726be76ccdc7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:34.676280 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3e37503-a331-4ffc-82be-26c5633ce1d8 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:34.677375 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3e37503-a331-4ffc-82be-26c5633ce1d8 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:34.679140 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3e37503-a331-4ffc-82be-26c5633ce1d8 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:34.679943 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3e37503-a331-4ffc-82be-26c5633ce1d8 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:34.903764 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ef2ffa16-ce65-43af-ac3a-d88766296a55 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:34.905661 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ef2ffa16-ce65-43af-ac3a-d88766296a55 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:34.913463 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ef2ffa16-ce65-43af-ac3a-d88766296a55 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:34.914248 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ef2ffa16-ce65-43af-ac3a-d88766296a55 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:34.915950 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ef2ffa16-ce65-43af-ac3a-d88766296a55 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:34.916424 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ef2ffa16-ce65-43af-ac3a-d88766296a55 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:34.955945 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c3e37503-a331-4ffc-82be-26c5633ce1d8 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7" status: 200 len: 1651 microversion: 2.1 time: 0.295050 Aug 04 17:18:34.962398 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3062/6015] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:34 2022] GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7 => generated 1651 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:34.991218 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-90744dec-26b9-4006-bce1-8838c88784da tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:34.991927 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-90744dec-26b9-4006-bce1-8838c88784da tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: 8a39e22a-9e6b-4302-90cc-726be76ccdc7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:35.001587 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-90744dec-26b9-4006-bce1-8838c88784da tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:35.001709 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-90744dec-26b9-4006-bce1-8838c88784da tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:35.002445 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-90744dec-26b9-4006-bce1-8838c88784da tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:35.003376 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-90744dec-26b9-4006-bce1-8838c88784da tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:35.162754 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ef2ffa16-ce65-43af-ac3a-d88766296a55 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:35.174325 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ef2ffa16-ce65-43af-ac3a-d88766296a55 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab" status: 200 len: 1391 microversion: 2.1 time: 0.274679 Aug 04 17:18:35.175806 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2954/6016] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:34 2022] GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab => generated 1391 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:35.182138 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-708844cc-c88a-43ea-a701-aa06e589d710 req-92e97a34-c516-4013-887f-72f3c2158632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab", "name": "network-vif-plugged", "status": "completed", "tag": "661f3496-b7c1-46e5-a11c-44ddf7c3619b"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:35.204883 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-708844cc-c88a-43ea-a701-aa06e589d710 req-92e97a34-c516-4013-887f-72f3c2158632 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:35.206032 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-708844cc-c88a-43ea-a701-aa06e589d710 req-92e97a34-c516-4013-887f-72f3c2158632 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:35.227496 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-708844cc-c88a-43ea-a701-aa06e589d710 req-92e97a34-c516-4013-887f-72f3c2158632 service nova] Creating event network-vif-plugged:661f3496-b7c1-46e5-a11c-44ddf7c3619b for instance eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab on n-h2-846466-12 Aug 04 17:18:35.234584 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-708844cc-c88a-43ea-a701-aa06e589d710 req-92e97a34-c516-4013-887f-72f3c2158632 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057107 Aug 04 17:18:35.235492 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2955/6017] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:18:35.239509 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-90744dec-26b9-4006-bce1-8838c88784da tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7" status: 200 len: 1651 microversion: 2.1 time: 0.256775 Aug 04 17:18:35.240648 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3063/6018] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:34 2022] GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7 => generated 1651 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:35.278380 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1ddc9b1d-f4ba-48d8-a480-9cba6b050146 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:35.279201 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1ddc9b1d-f4ba-48d8-a480-9cba6b050146 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: 8a39e22a-9e6b-4302-90cc-726be76ccdc7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:35.297449 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1ddc9b1d-f4ba-48d8-a480-9cba6b050146 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:35.298359 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1ddc9b1d-f4ba-48d8-a480-9cba6b050146 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:35.299615 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1ddc9b1d-f4ba-48d8-a480-9cba6b050146 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:35.300069 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1ddc9b1d-f4ba-48d8-a480-9cba6b050146 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:35.468437 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1ddc9b1d-f4ba-48d8-a480-9cba6b050146 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7" status: 200 len: 1651 microversion: 2.1 time: 0.200971 Aug 04 17:18:35.469171 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2956/6019] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:35 2022] GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7 => generated 1651 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:35.671584 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-41c7b47a-a0ab-48d2-a54a-21c57ffb1476 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1195939488", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "availability_zone": "nova:n-h2-846466-12", "networks": [{"uuid": "2b83759a-a49b-437c-8ecb-0bc23d70c36a"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:35.778344 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-41c7b47a-a0ab-48d2-a54a-21c57ffb1476 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] validate_networks() for [('2b83759a-a49b-437c-8ecb-0bc23d70c36a', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:18:36.201267 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cbeab8e1-3927-41ed-8481-e41b8b6fc744 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:36.202688 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cbeab8e1-3927-41ed-8481-e41b8b6fc744 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:36.210755 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cbeab8e1-3927-41ed-8481-e41b8b6fc744 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:36.211524 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cbeab8e1-3927-41ed-8481-e41b8b6fc744 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:36.212358 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cbeab8e1-3927-41ed-8481-e41b8b6fc744 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:36.212808 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cbeab8e1-3927-41ed-8481-e41b8b6fc744 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:36.305633 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-41c7b47a-a0ab-48d2-a54a-21c57ffb1476 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:18:36.308268 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-41c7b47a-a0ab-48d2-a54a-21c57ffb1476 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:18:36.308941 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-41c7b47a-a0ab-48d2-a54a-21c57ffb1476 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:18:36.309556 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-41c7b47a-a0ab-48d2-a54a-21c57ffb1476 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:18:36.309966 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-41c7b47a-a0ab-48d2-a54a-21c57ffb1476 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:18:36.313572 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:18:36.353700 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-41c7b47a-a0ab-48d2-a54a-21c57ffb1476 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:36.359194 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-41c7b47a-a0ab-48d2-a54a-21c57ffb1476 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:36.360411 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-41c7b47a-a0ab-48d2-a54a-21c57ffb1476 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:36.360870 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-41c7b47a-a0ab-48d2-a54a-21c57ffb1476 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:36.414585 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-41c7b47a-a0ab-48d2-a54a-21c57ffb1476 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Getting quotas for project 6c6915a1d3814029ad0a0ceb2013228f. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:18:36.422097 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-41c7b47a-a0ab-48d2-a54a-21c57ffb1476 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Getting quotas for user 2673f2716b5943f49c34a6d2068e64f7 and project 6c6915a1d3814029ad0a0ceb2013228f. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:18:36.438943 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-41c7b47a-a0ab-48d2-a54a-21c57ffb1476 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:18:36.441884 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-41c7b47a-a0ab-48d2-a54a-21c57ffb1476 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: d0637996-45d7-49d0-a755-f85e78e90ba7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:18:36.500706 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cbeab8e1-3927-41ed-8481-e41b8b6fc744 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:36.514292 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cbeab8e1-3927-41ed-8481-e41b8b6fc744 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab" status: 200 len: 1391 microversion: 2.1 time: 0.321275 Aug 04 17:18:36.516265 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2957/6020] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:36 2022] GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab => generated 1391 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:36.520709 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-41c7b47a-a0ab-48d2-a54a-21c57ffb1476 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.852935 Aug 04 17:18:36.521380 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3064/6021] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:18:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:18:36.534577 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-19084100-5975-4b15-a494-6258f4c5fa3f tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:36.535844 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-19084100-5975-4b15-a494-6258f4c5fa3f tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: d0637996-45d7-49d0-a755-f85e78e90ba7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:36.608341 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-19084100-5975-4b15-a494-6258f4c5fa3f tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/d0637996-45d7-49d0-a755-f85e78e90ba7" status: 200 len: 1329 microversion: 2.1 time: 0.078758 Aug 04 17:18:36.609555 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2958/6022] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:36 2022] GET /compute/v2.1/servers/d0637996-45d7-49d0-a755-f85e78e90ba7 => generated 1329 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:37.537347 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-be2c8402-e687-4384-acaa-078ab5fd292e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:37.538132 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-be2c8402-e687-4384-acaa-078ab5fd292e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:37.545846 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be2c8402-e687-4384-acaa-078ab5fd292e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:37.546664 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be2c8402-e687-4384-acaa-078ab5fd292e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:37.547446 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be2c8402-e687-4384-acaa-078ab5fd292e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:37.547870 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be2c8402-e687-4384-acaa-078ab5fd292e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:37.631226 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8a20f8e7-0a97-4c19-bc5e-88ec559c86de tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:37.632386 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8a20f8e7-0a97-4c19-bc5e-88ec559c86de tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: d0637996-45d7-49d0-a755-f85e78e90ba7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:37.646388 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a20f8e7-0a97-4c19-bc5e-88ec559c86de tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:37.646843 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a20f8e7-0a97-4c19-bc5e-88ec559c86de tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:37.650671 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a20f8e7-0a97-4c19-bc5e-88ec559c86de tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:37.651312 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8a20f8e7-0a97-4c19-bc5e-88ec559c86de tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:37.695172 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=100 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:18:37.761937 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-be2c8402-e687-4384-acaa-078ab5fd292e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:37.770618 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-be2c8402-e687-4384-acaa-078ab5fd292e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab" status: 200 len: 1562 microversion: 2.1 time: 0.238299 Aug 04 17:18:37.771546 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3065/6023] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:37 2022] GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab => generated 1562 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:37.773454 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8a20f8e7-0a97-4c19-bc5e-88ec559c86de tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/d0637996-45d7-49d0-a755-f85e78e90ba7" status: 200 len: 1418 microversion: 2.1 time: 0.149306 Aug 04 17:18:37.774039 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2959/6024] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:37 2022] GET /compute/v2.1/servers/d0637996-45d7-49d0-a755-f85e78e90ba7 => generated 1418 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:37.791472 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-debf7d4a-77cf-4834-acda-0e0bfb030775 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:37.791999 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-debf7d4a-77cf-4834-acda-0e0bfb030775 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:37.798965 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-debf7d4a-77cf-4834-acda-0e0bfb030775 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:37.799410 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-debf7d4a-77cf-4834-acda-0e0bfb030775 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:37.800185 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-debf7d4a-77cf-4834-acda-0e0bfb030775 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:37.800611 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-debf7d4a-77cf-4834-acda-0e0bfb030775 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:37.963890 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-debf7d4a-77cf-4834-acda-0e0bfb030775 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:37.974524 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-debf7d4a-77cf-4834-acda-0e0bfb030775 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab" status: 200 len: 1562 microversion: 2.1 time: 0.187084 Aug 04 17:18:37.989945 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3066/6025] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:37 2022] GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab => generated 1562 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:38.795942 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-776fe162-8fec-410f-8c95-f2361b7b8bc6 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:38.796533 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-776fe162-8fec-410f-8c95-f2361b7b8bc6 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: d0637996-45d7-49d0-a755-f85e78e90ba7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:38.813658 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-776fe162-8fec-410f-8c95-f2361b7b8bc6 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:38.814194 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-776fe162-8fec-410f-8c95-f2361b7b8bc6 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:38.815049 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-776fe162-8fec-410f-8c95-f2361b7b8bc6 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:38.815502 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-776fe162-8fec-410f-8c95-f2361b7b8bc6 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:39.130625 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-776fe162-8fec-410f-8c95-f2361b7b8bc6 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/d0637996-45d7-49d0-a755-f85e78e90ba7" status: 200 len: 1466 microversion: 2.1 time: 0.339453 Aug 04 17:18:39.133013 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2960/6026] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:38 2022] GET /compute/v2.1/servers/d0637996-45d7-49d0-a755-f85e78e90ba7 => generated 1466 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:39.675377 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-93117159-a3a1-432c-ba7d-105bc634c5b2 req-91645013-27bb-4da1-bf1a-f5859f3504b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0637996-45d7-49d0-a755-f85e78e90ba7", "tag": "6becb0eb-f276-4081-bb56-310baf163629"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:39.712630 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-93117159-a3a1-432c-ba7d-105bc634c5b2 req-91645013-27bb-4da1-bf1a-f5859f3504b2 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:39.713076 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-93117159-a3a1-432c-ba7d-105bc634c5b2 req-91645013-27bb-4da1-bf1a-f5859f3504b2 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:39.751064 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-93117159-a3a1-432c-ba7d-105bc634c5b2 req-91645013-27bb-4da1-bf1a-f5859f3504b2 service nova] Creating event network-changed:6becb0eb-f276-4081-bb56-310baf163629 for instance d0637996-45d7-49d0-a755-f85e78e90ba7 on n-h2-846466-12 Aug 04 17:18:39.776569 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-93117159-a3a1-432c-ba7d-105bc634c5b2 req-91645013-27bb-4da1-bf1a-f5859f3504b2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099179 Aug 04 17:18:39.781913 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3067/6027] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:18:40.156422 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-afae14a2-d659-455e-b303-6691f97b86fc tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:40.158819 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-afae14a2-d659-455e-b303-6691f97b86fc tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: d0637996-45d7-49d0-a755-f85e78e90ba7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:40.170804 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-afae14a2-d659-455e-b303-6691f97b86fc tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:40.173086 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-afae14a2-d659-455e-b303-6691f97b86fc tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:40.174683 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-afae14a2-d659-455e-b303-6691f97b86fc tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:40.175392 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-afae14a2-d659-455e-b303-6691f97b86fc tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:41.018487 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-afae14a2-d659-455e-b303-6691f97b86fc tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/d0637996-45d7-49d0-a755-f85e78e90ba7" status: 200 len: 1466 microversion: 2.1 time: 0.867179 Aug 04 17:18:41.019306 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2961/6028] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:40 2022] GET /compute/v2.1/servers/d0637996-45d7-49d0-a755-f85e78e90ba7 => generated 1466 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:42.040607 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a253ae2a-3b7e-45dc-bde8-2a2eab2d268b tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:42.042080 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a253ae2a-3b7e-45dc-bde8-2a2eab2d268b tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: d0637996-45d7-49d0-a755-f85e78e90ba7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:42.053939 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a253ae2a-3b7e-45dc-bde8-2a2eab2d268b tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:42.054668 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a253ae2a-3b7e-45dc-bde8-2a2eab2d268b tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:42.055621 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a253ae2a-3b7e-45dc-bde8-2a2eab2d268b tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:42.056210 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a253ae2a-3b7e-45dc-bde8-2a2eab2d268b tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:42.575424 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a253ae2a-3b7e-45dc-bde8-2a2eab2d268b tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/d0637996-45d7-49d0-a755-f85e78e90ba7" status: 200 len: 1466 microversion: 2.1 time: 0.538903 Aug 04 17:18:42.576731 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3068/6029] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:42 2022] GET /compute/v2.1/servers/d0637996-45d7-49d0-a755-f85e78e90ba7 => generated 1466 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:43.025645 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7b7c2183-d81d-4fc7-8a87-2f4876810a46 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:43.026434 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7b7c2183-d81d-4fc7-8a87-2f4876810a46 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:43.036960 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b7c2183-d81d-4fc7-8a87-2f4876810a46 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:43.037508 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b7c2183-d81d-4fc7-8a87-2f4876810a46 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:43.038386 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b7c2183-d81d-4fc7-8a87-2f4876810a46 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:43.038838 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b7c2183-d81d-4fc7-8a87-2f4876810a46 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:43.200696 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-3e420edb-6da2-408b-a878-3ce19d2a274a req-147a4ac8-ef55-49f0-99f0-5b1dabb66938 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab", "tag": "661f3496-b7c1-46e5-a11c-44ddf7c3619b"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:43.213810 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-3e420edb-6da2-408b-a878-3ce19d2a274a req-147a4ac8-ef55-49f0-99f0-5b1dabb66938 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:43.214507 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-3e420edb-6da2-408b-a878-3ce19d2a274a req-147a4ac8-ef55-49f0-99f0-5b1dabb66938 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:43.233488 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-3e420edb-6da2-408b-a878-3ce19d2a274a req-147a4ac8-ef55-49f0-99f0-5b1dabb66938 service nova] Creating event network-changed:661f3496-b7c1-46e5-a11c-44ddf7c3619b for instance eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab on n-h2-846466-12 Aug 04 17:18:43.240897 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-3e420edb-6da2-408b-a878-3ce19d2a274a req-147a4ac8-ef55-49f0-99f0-5b1dabb66938 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.212580 Aug 04 17:18:43.241828 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3069/6030] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:18:43.263683 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7b7c2183-d81d-4fc7-8a87-2f4876810a46 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:43.275134 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7b7c2183-d81d-4fc7-8a87-2f4876810a46 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab" status: 200 len: 1680 microversion: 2.1 time: 0.252717 Aug 04 17:18:43.275928 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2962/6031] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:43 2022] GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab => generated 1680 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:43.598333 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0245c9dc-e2f7-4cf1-bcb6-2e1c3a7857c1 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:43.599329 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0245c9dc-e2f7-4cf1-bcb6-2e1c3a7857c1 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: d0637996-45d7-49d0-a755-f85e78e90ba7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:43.611372 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0245c9dc-e2f7-4cf1-bcb6-2e1c3a7857c1 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:43.614284 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0245c9dc-e2f7-4cf1-bcb6-2e1c3a7857c1 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:43.616850 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0245c9dc-e2f7-4cf1-bcb6-2e1c3a7857c1 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:43.617350 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0245c9dc-e2f7-4cf1-bcb6-2e1c3a7857c1 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:43.947091 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0245c9dc-e2f7-4cf1-bcb6-2e1c3a7857c1 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/d0637996-45d7-49d0-a755-f85e78e90ba7" status: 200 len: 1466 microversion: 2.1 time: 0.353801 Aug 04 17:18:43.950171 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3070/6032] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:43 2022] GET /compute/v2.1/servers/d0637996-45d7-49d0-a755-f85e78e90ba7 => generated 1466 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:44.970571 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b8261583-365d-439c-86c9-9c7c21eb822b tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:44.971201 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b8261583-365d-439c-86c9-9c7c21eb822b tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: d0637996-45d7-49d0-a755-f85e78e90ba7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:44.985623 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b8261583-365d-439c-86c9-9c7c21eb822b tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:44.988764 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b8261583-365d-439c-86c9-9c7c21eb822b tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:44.989666 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b8261583-365d-439c-86c9-9c7c21eb822b tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:44.990285 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b8261583-365d-439c-86c9-9c7c21eb822b tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:45.193465 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b8261583-365d-439c-86c9-9c7c21eb822b tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/d0637996-45d7-49d0-a755-f85e78e90ba7" status: 200 len: 1466 microversion: 2.1 time: 0.226771 Aug 04 17:18:45.195102 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2963/6033] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:44 2022] GET /compute/v2.1/servers/d0637996-45d7-49d0-a755-f85e78e90ba7 => generated 1466 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:45.951870 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-60cb4352-8319-4174-8e9e-f8b9806660b1 req-e5fc7c93-f5be-45af-ba9f-5188d6f5de26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0637996-45d7-49d0-a755-f85e78e90ba7", "name": "network-vif-plugged", "status": "completed", "tag": "6becb0eb-f276-4081-bb56-310baf163629"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:45.971129 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-60cb4352-8319-4174-8e9e-f8b9806660b1 req-e5fc7c93-f5be-45af-ba9f-5188d6f5de26 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:45.971878 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-60cb4352-8319-4174-8e9e-f8b9806660b1 req-e5fc7c93-f5be-45af-ba9f-5188d6f5de26 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:45.987542 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-60cb4352-8319-4174-8e9e-f8b9806660b1 req-e5fc7c93-f5be-45af-ba9f-5188d6f5de26 service nova] Creating event network-vif-plugged:6becb0eb-f276-4081-bb56-310baf163629 for instance d0637996-45d7-49d0-a755-f85e78e90ba7 on n-h2-846466-12 Aug 04 17:18:45.993458 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-60cb4352-8319-4174-8e9e-f8b9806660b1 req-e5fc7c93-f5be-45af-ba9f-5188d6f5de26 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045624 Aug 04 17:18:45.994803 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3071/6034] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:18:46.214753 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1d6b9eb6-09da-4528-861b-aebb4f6b5a74 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:46.231646 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1d6b9eb6-09da-4528-861b-aebb4f6b5a74 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: d0637996-45d7-49d0-a755-f85e78e90ba7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:46.255914 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:18:46.258276 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d6b9eb6-09da-4528-861b-aebb4f6b5a74 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:46.259096 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d6b9eb6-09da-4528-861b-aebb4f6b5a74 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:46.260196 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d6b9eb6-09da-4528-861b-aebb4f6b5a74 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:46.261932 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d6b9eb6-09da-4528-861b-aebb4f6b5a74 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:46.445112 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1d6b9eb6-09da-4528-861b-aebb4f6b5a74 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/d0637996-45d7-49d0-a755-f85e78e90ba7" status: 200 len: 1466 microversion: 2.1 time: 0.234030 Aug 04 17:18:46.446462 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2964/6035] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:46 2022] GET /compute/v2.1/servers/d0637996-45d7-49d0-a755-f85e78e90ba7 => generated 1466 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:47.463835 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:18:47.465599 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:18:47.471790 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-52f0f99e-2815-4677-85f5-63044dae02f4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:47.472584 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-52f0f99e-2815-4677-85f5-63044dae02f4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: d0637996-45d7-49d0-a755-f85e78e90ba7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:47.481030 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-52f0f99e-2815-4677-85f5-63044dae02f4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:47.482248 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-52f0f99e-2815-4677-85f5-63044dae02f4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:47.483321 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-52f0f99e-2815-4677-85f5-63044dae02f4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:47.483960 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-52f0f99e-2815-4677-85f5-63044dae02f4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:47.832326 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-52f0f99e-2815-4677-85f5-63044dae02f4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/d0637996-45d7-49d0-a755-f85e78e90ba7" status: 200 len: 1466 microversion: 2.1 time: 0.369438 Aug 04 17:18:47.849405 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3072/6036] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:47 2022] GET /compute/v2.1/servers/d0637996-45d7-49d0-a755-f85e78e90ba7 => generated 1466 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:48.856026 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-929846a5-7130-4a6b-84e3-79d63db6f59d tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:48.857402 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-929846a5-7130-4a6b-84e3-79d63db6f59d tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: d0637996-45d7-49d0-a755-f85e78e90ba7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:48.860157 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:18:48.881649 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-929846a5-7130-4a6b-84e3-79d63db6f59d tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:48.882017 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-929846a5-7130-4a6b-84e3-79d63db6f59d tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:48.883043 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-929846a5-7130-4a6b-84e3-79d63db6f59d tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:48.883641 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-929846a5-7130-4a6b-84e3-79d63db6f59d tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:49.172819 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-929846a5-7130-4a6b-84e3-79d63db6f59d tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/d0637996-45d7-49d0-a755-f85e78e90ba7" status: 200 len: 1652 microversion: 2.1 time: 0.320568 Aug 04 17:18:49.187198 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2965/6037] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:48 2022] GET /compute/v2.1/servers/d0637996-45d7-49d0-a755-f85e78e90ba7 => generated 1652 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:49.199268 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-12bc491d-b314-4728-b4d0-01e4a75692e5 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:49.199878 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-12bc491d-b314-4728-b4d0-01e4a75692e5 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: d0637996-45d7-49d0-a755-f85e78e90ba7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:49.208718 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-12bc491d-b314-4728-b4d0-01e4a75692e5 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:49.209485 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-12bc491d-b314-4728-b4d0-01e4a75692e5 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:49.211169 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-12bc491d-b314-4728-b4d0-01e4a75692e5 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:49.211751 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-12bc491d-b314-4728-b4d0-01e4a75692e5 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:49.449659 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-12bc491d-b314-4728-b4d0-01e4a75692e5 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/d0637996-45d7-49d0-a755-f85e78e90ba7" status: 200 len: 1652 microversion: 2.1 time: 0.254975 Aug 04 17:18:49.461305 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3073/6038] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:49 2022] GET /compute/v2.1/servers/d0637996-45d7-49d0-a755-f85e78e90ba7 => generated 1652 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:49.470302 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-374f039b-5365-4ae9-9834-ea41af7b31c4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:49.471333 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-374f039b-5365-4ae9-9834-ea41af7b31c4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: d0637996-45d7-49d0-a755-f85e78e90ba7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:49.480260 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-374f039b-5365-4ae9-9834-ea41af7b31c4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:49.486988 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-374f039b-5365-4ae9-9834-ea41af7b31c4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:49.488231 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-374f039b-5365-4ae9-9834-ea41af7b31c4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:49.488873 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-374f039b-5365-4ae9-9834-ea41af7b31c4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:49.741878 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-374f039b-5365-4ae9-9834-ea41af7b31c4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/d0637996-45d7-49d0-a755-f85e78e90ba7" status: 200 len: 1652 microversion: 2.1 time: 0.275581 Aug 04 17:18:49.742957 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2966/6039] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:49 2022] GET /compute/v2.1/servers/d0637996-45d7-49d0-a755-f85e78e90ba7 => generated 1652 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:18:49.766143 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3f1f5c8c-a4f9-4bea-a0a8-541009aef36d tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:49.767014 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3f1f5c8c-a4f9-4bea-a0a8-541009aef36d tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: d0637996-45d7-49d0-a755-f85e78e90ba7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:49.780561 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3f1f5c8c-a4f9-4bea-a0a8-541009aef36d tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:49.783820 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3f1f5c8c-a4f9-4bea-a0a8-541009aef36d tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:49.785872 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3f1f5c8c-a4f9-4bea-a0a8-541009aef36d tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:49.786667 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3f1f5c8c-a4f9-4bea-a0a8-541009aef36d tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:49.828374 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3f1f5c8c-a4f9-4bea-a0a8-541009aef36d tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: d0637996-45d7-49d0-a755-f85e78e90ba7] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:18:49.942949 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3f1f5c8c-a4f9-4bea-a0a8-541009aef36d tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "DELETE /compute/v2.1/servers/d0637996-45d7-49d0-a755-f85e78e90ba7" status: 204 len: 0 microversion: 2.1 time: 0.182592 Aug 04 17:18:49.955194 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a104260e-9740-4d72-a2ee-3c95f9ff500f tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:49.956253 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a104260e-9740-4d72-a2ee-3c95f9ff500f tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: d0637996-45d7-49d0-a755-f85e78e90ba7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:49.959850 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3074/6040] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:18:49 2022] DELETE /compute/v2.1/servers/d0637996-45d7-49d0-a755-f85e78e90ba7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:18:49.964064 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a104260e-9740-4d72-a2ee-3c95f9ff500f tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:49.964663 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a104260e-9740-4d72-a2ee-3c95f9ff500f tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:49.965589 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a104260e-9740-4d72-a2ee-3c95f9ff500f tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:49.966194 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a104260e-9740-4d72-a2ee-3c95f9ff500f tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:50.118799 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a104260e-9740-4d72-a2ee-3c95f9ff500f tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/d0637996-45d7-49d0-a755-f85e78e90ba7" status: 200 len: 1658 microversion: 2.1 time: 0.169658 Aug 04 17:18:50.119412 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2967/6041] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:49 2022] GET /compute/v2.1/servers/d0637996-45d7-49d0-a755-f85e78e90ba7 => generated 1658 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:51.141348 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dd769d25-2d54-411a-8532-2fa125795bc3 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:51.142047 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dd769d25-2d54-411a-8532-2fa125795bc3 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: d0637996-45d7-49d0-a755-f85e78e90ba7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:51.151895 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dd769d25-2d54-411a-8532-2fa125795bc3 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:51.152299 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dd769d25-2d54-411a-8532-2fa125795bc3 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:51.153385 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dd769d25-2d54-411a-8532-2fa125795bc3 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:51.154058 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dd769d25-2d54-411a-8532-2fa125795bc3 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:51.370529 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dd769d25-2d54-411a-8532-2fa125795bc3 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/d0637996-45d7-49d0-a755-f85e78e90ba7" status: 200 len: 1658 microversion: 2.1 time: 0.233757 Aug 04 17:18:51.371462 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3075/6042] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:51 2022] GET /compute/v2.1/servers/d0637996-45d7-49d0-a755-f85e78e90ba7 => generated 1658 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:51.916405 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-89155252-a3ef-441d-9aa9-7ea56d6916a0 req-d21b2459-c6b5-40ac-a7ba-4b7abdf48997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0637996-45d7-49d0-a755-f85e78e90ba7", "name": "network-vif-deleted", "tag": "6becb0eb-f276-4081-bb56-310baf163629"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:51.931655 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-89155252-a3ef-441d-9aa9-7ea56d6916a0 req-d21b2459-c6b5-40ac-a7ba-4b7abdf48997 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:51.932121 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-89155252-a3ef-441d-9aa9-7ea56d6916a0 req-d21b2459-c6b5-40ac-a7ba-4b7abdf48997 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:51.964627 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-89155252-a3ef-441d-9aa9-7ea56d6916a0 req-d21b2459-c6b5-40ac-a7ba-4b7abdf48997 service nova] Creating event network-vif-deleted:6becb0eb-f276-4081-bb56-310baf163629 for instance d0637996-45d7-49d0-a755-f85e78e90ba7 on n-h2-846466-12 Aug 04 17:18:51.982677 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-89155252-a3ef-441d-9aa9-7ea56d6916a0 req-d21b2459-c6b5-40ac-a7ba-4b7abdf48997 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073527 Aug 04 17:18:51.984756 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2968/6043] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:18:52.392491 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2a6adbef-fb45-44ac-b1e0-23cbf72335a1 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:52.393300 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2a6adbef-fb45-44ac-b1e0-23cbf72335a1 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: d0637996-45d7-49d0-a755-f85e78e90ba7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:52.400319 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2a6adbef-fb45-44ac-b1e0-23cbf72335a1 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:52.400820 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2a6adbef-fb45-44ac-b1e0-23cbf72335a1 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:52.402191 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2a6adbef-fb45-44ac-b1e0-23cbf72335a1 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:52.402799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2a6adbef-fb45-44ac-b1e0-23cbf72335a1 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:52.440091 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2a6adbef-fb45-44ac-b1e0-23cbf72335a1 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:52.440871 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2a6adbef-fb45-44ac-b1e0-23cbf72335a1 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:52.441729 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-2a6adbef-fb45-44ac-b1e0-23cbf72335a1 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lazy-loading 'fault' on Instance uuid d0637996-45d7-49d0-a755-f85e78e90ba7 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:18:52.501553 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2a6adbef-fb45-44ac-b1e0-23cbf72335a1 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/d0637996-45d7-49d0-a755-f85e78e90ba7" status: 200 len: 1456 microversion: 2.1 time: 0.112864 Aug 04 17:18:52.503852 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3076/6044] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:52 2022] GET /compute/v2.1/servers/d0637996-45d7-49d0-a755-f85e78e90ba7 => generated 1456 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:18:53.527224 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e160e58a-4be9-490d-8ecd-40e4b7f780a4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:53.529014 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e160e58a-4be9-490d-8ecd-40e4b7f780a4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: d0637996-45d7-49d0-a755-f85e78e90ba7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:53.536297 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e160e58a-4be9-490d-8ecd-40e4b7f780a4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:53.537242 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e160e58a-4be9-490d-8ecd-40e4b7f780a4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:53.538175 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e160e58a-4be9-490d-8ecd-40e4b7f780a4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:53.538645 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e160e58a-4be9-490d-8ecd-40e4b7f780a4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:53.558452 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-e160e58a-4be9-490d-8ecd-40e4b7f780a4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] HTTP exception thrown: Instance d0637996-45d7-49d0-a755-f85e78e90ba7 could not be found. Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e160e58a-4be9-490d-8ecd-40e4b7f780a4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Request method failure captured: Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/d0637996-45d7-49d0-a755-f85e78e90ba7 HTTP/1.1 Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_9WOFtZObSyIs0mHEbW69sEDXlpGKLkqd9p-Jz1BKwRjs14sUDIY9noMego81zh9mrOKBxRJ7Bh1H3t5lAkuwQTtrB9c7ttyEBe694oO3EzDav_RBDxzcF4PFJKGN1ZuJjKdZez86yD2RWDcQcTElNSME9EEUmFurw4c_sT5l8XTEc Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 6c6915a1d3814029ad0a0ceb2013228f Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-TestServerMultinode-1843114145 Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader,admin Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader,admin Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6c6915a1d3814029ad0a0ceb2013228f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6c6915a1d3814029ad0a0ceb2013228f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6c6915a1d3814029ad0a0ceb2013228f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6c6915a1d3814029ad0a0ceb2013228f"}]}] Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-TestServerMultinode-1843114145 Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 6c6915a1d3814029ad0a0ceb2013228f Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-TestServerMultinode-1843114145 Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-TestServerMultinode-1843114145-project-admin Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 2673f2716b5943f49c34a6d2068e64f7 Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-TestServerMultinode-1843114145-project-admin Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance d0637996-45d7-49d0-a755-f85e78e90ba7 could not be found. Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'd0637996-45d7-49d0-a755-f85e78e90ba7'} Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0637996-45d7-49d0-a755-f85e78e90ba7 could not be found. Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0637996-45d7-49d0-a755-f85e78e90ba7 could not be found. Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:53.560226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:18:53.564226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:53.564226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:53.564226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:53.564226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:18:53.564226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:18:53.564226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0637996-45d7-49d0-a755-f85e78e90ba7 could not be found. Aug 04 17:18:53.564226 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:18:53.566308 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e160e58a-4be9-490d-8ecd-40e4b7f780a4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Returning 404 to user: Instance d0637996-45d7-49d0-a755-f85e78e90ba7 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:18:53.567477 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e160e58a-4be9-490d-8ecd-40e4b7f780a4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/d0637996-45d7-49d0-a755-f85e78e90ba7" status: 404 len: 111 microversion: 2.1 time: 0.045769 Aug 04 17:18:53.568424 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2969/6045] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:53 2022] GET /compute/v2.1/servers/d0637996-45d7-49d0-a755-f85e78e90ba7 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:18:53.577112 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-aa1f7b6b-5da7-4e02-9e90-56bc991a823a tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:53.577811 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-aa1f7b6b-5da7-4e02-9e90-56bc991a823a tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: 8a39e22a-9e6b-4302-90cc-726be76ccdc7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:53.585928 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aa1f7b6b-5da7-4e02-9e90-56bc991a823a tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:53.586424 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aa1f7b6b-5da7-4e02-9e90-56bc991a823a tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:53.587217 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aa1f7b6b-5da7-4e02-9e90-56bc991a823a tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:53.587823 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aa1f7b6b-5da7-4e02-9e90-56bc991a823a tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:53.631408 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-aa1f7b6b-5da7-4e02-9e90-56bc991a823a tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: 8a39e22a-9e6b-4302-90cc-726be76ccdc7] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:18:53.717900 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:18:53.792023 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-aa1f7b6b-5da7-4e02-9e90-56bc991a823a tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "DELETE /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7" status: 204 len: 0 microversion: 2.1 time: 0.218489 Aug 04 17:18:53.792632 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3077/6046] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:18:53 2022] DELETE /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:18:53.801412 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-597a106f-25ea-44b2-a6be-082ba3f5a0ee tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:53.802147 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-597a106f-25ea-44b2-a6be-082ba3f5a0ee tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: 8a39e22a-9e6b-4302-90cc-726be76ccdc7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:53.811119 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-597a106f-25ea-44b2-a6be-082ba3f5a0ee tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:53.811610 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-597a106f-25ea-44b2-a6be-082ba3f5a0ee tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:53.812699 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-597a106f-25ea-44b2-a6be-082ba3f5a0ee tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:53.813454 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-597a106f-25ea-44b2-a6be-082ba3f5a0ee tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:53.965055 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-597a106f-25ea-44b2-a6be-082ba3f5a0ee tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7" status: 200 len: 1657 microversion: 2.1 time: 0.167582 Aug 04 17:18:53.965670 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2970/6047] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:53 2022] GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7 => generated 1657 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:18:54.987195 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f9072cf6-b69d-4ae1-86fc-392aa2f3cad4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:54.987892 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f9072cf6-b69d-4ae1-86fc-392aa2f3cad4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: 8a39e22a-9e6b-4302-90cc-726be76ccdc7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:54.996604 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9072cf6-b69d-4ae1-86fc-392aa2f3cad4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:54.997212 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9072cf6-b69d-4ae1-86fc-392aa2f3cad4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:54.998269 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9072cf6-b69d-4ae1-86fc-392aa2f3cad4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:54.998704 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f9072cf6-b69d-4ae1-86fc-392aa2f3cad4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:55.153549 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f9072cf6-b69d-4ae1-86fc-392aa2f3cad4 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7" status: 200 len: 1657 microversion: 2.1 time: 0.170218 Aug 04 17:18:55.154374 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3078/6048] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:54 2022] GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7 => generated 1657 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:18:55.886001 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-950f32e4-7c69-42ef-bb99-6ec2d7a8f6f4 req-5d2e8dc0-0ae2-4e67-be84-5bdb563e8f7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a39e22a-9e6b-4302-90cc-726be76ccdc7", "name": "network-vif-deleted", "tag": "8fc66c97-231f-4ac0-8de4-7e24ac24cd9f"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:55.896617 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-950f32e4-7c69-42ef-bb99-6ec2d7a8f6f4 req-5d2e8dc0-0ae2-4e67-be84-5bdb563e8f7d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:55.897060 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-950f32e4-7c69-42ef-bb99-6ec2d7a8f6f4 req-5d2e8dc0-0ae2-4e67-be84-5bdb563e8f7d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:55.908939 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-950f32e4-7c69-42ef-bb99-6ec2d7a8f6f4 req-5d2e8dc0-0ae2-4e67-be84-5bdb563e8f7d service nova] Creating event network-vif-deleted:8fc66c97-231f-4ac0-8de4-7e24ac24cd9f for instance 8a39e22a-9e6b-4302-90cc-726be76ccdc7 on n-h1-846466-12 Aug 04 17:18:55.913904 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-950f32e4-7c69-42ef-bb99-6ec2d7a8f6f4 req-5d2e8dc0-0ae2-4e67-be84-5bdb563e8f7d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.192678 Aug 04 17:18:55.914512 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2971/6049] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:18:56.180947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f64b830f-2c95-4984-91fa-ef12918ee74f tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:56.181867 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f64b830f-2c95-4984-91fa-ef12918ee74f tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: 8a39e22a-9e6b-4302-90cc-726be76ccdc7] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:56.189764 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f64b830f-2c95-4984-91fa-ef12918ee74f tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:56.190204 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f64b830f-2c95-4984-91fa-ef12918ee74f tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:56.191155 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f64b830f-2c95-4984-91fa-ef12918ee74f tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:56.191749 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f64b830f-2c95-4984-91fa-ef12918ee74f tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:56.230304 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f64b830f-2c95-4984-91fa-ef12918ee74f tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:56.230920 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f64b830f-2c95-4984-91fa-ef12918ee74f tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:56.231200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-f64b830f-2c95-4984-91fa-ef12918ee74f tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lazy-loading 'fault' on Instance uuid 8a39e22a-9e6b-4302-90cc-726be76ccdc7 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:18:56.298047 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f64b830f-2c95-4984-91fa-ef12918ee74f tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7" status: 200 len: 1456 microversion: 2.1 time: 0.121180 Aug 04 17:18:56.299462 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3079/6050] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:56 2022] GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7 => generated 1456 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:57.322331 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b7a99b95-ea98-4275-9f8d-9bd619ac00b9 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:57.323023 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b7a99b95-ea98-4275-9f8d-9bd619ac00b9 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] [instance: 8a39e22a-9e6b-4302-90cc-726be76ccdc7] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:57.330609 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7a99b95-ea98-4275-9f8d-9bd619ac00b9 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:57.331046 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7a99b95-ea98-4275-9f8d-9bd619ac00b9 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:57.331843 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7a99b95-ea98-4275-9f8d-9bd619ac00b9 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:18:57.332295 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7a99b95-ea98-4275-9f8d-9bd619ac00b9 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:18:57.347599 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-b7a99b95-ea98-4275-9f8d-9bd619ac00b9 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] HTTP exception thrown: Instance 8a39e22a-9e6b-4302-90cc-726be76ccdc7 could not be found. Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b7a99b95-ea98-4275-9f8d-9bd619ac00b9 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Request method failure captured: Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7 HTTP/1.1 Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi6_9WOFtZObSyIs0mHEbW69sEDXlpGKLkqd9p-Jz1BKwRjs14sUDIY9noMego81zh9mrOKBxRJ7Bh1H3t5lAkuwQTtrB9c7ttyEBe694oO3EzDav_RBDxzcF4PFJKGN1ZuJjKdZez86yD2RWDcQcTElNSME9EEUmFurw4c_sT5l8XTEc Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 6c6915a1d3814029ad0a0ceb2013228f Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-TestServerMultinode-1843114145 Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader,admin Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader,admin Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6c6915a1d3814029ad0a0ceb2013228f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6c6915a1d3814029ad0a0ceb2013228f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6c6915a1d3814029ad0a0ceb2013228f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6c6915a1d3814029ad0a0ceb2013228f"}]}] Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-TestServerMultinode-1843114145 Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 6c6915a1d3814029ad0a0ceb2013228f Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-TestServerMultinode-1843114145 Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-TestServerMultinode-1843114145-project-admin Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 2673f2716b5943f49c34a6d2068e64f7 Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-TestServerMultinode-1843114145-project-admin Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 8a39e22a-9e6b-4302-90cc-726be76ccdc7 could not be found. Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '8a39e22a-9e6b-4302-90cc-726be76ccdc7'} Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a39e22a-9e6b-4302-90cc-726be76ccdc7 could not be found. Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a39e22a-9e6b-4302-90cc-726be76ccdc7 could not be found. Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:57.349541 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:18:57.354990 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:57.354990 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:57.354990 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:57.354990 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:18:57.354990 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:18:57.354990 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a39e22a-9e6b-4302-90cc-726be76ccdc7 could not be found. Aug 04 17:18:57.354990 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:18:57.354990 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b7a99b95-ea98-4275-9f8d-9bd619ac00b9 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] Returning 404 to user: Instance 8a39e22a-9e6b-4302-90cc-726be76ccdc7 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:18:57.354990 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b7a99b95-ea98-4275-9f8d-9bd619ac00b9 tempest-TestServerMultinode-1843114145 tempest-TestServerMultinode-1843114145-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7" status: 404 len: 111 microversion: 2.1 time: 0.033998 Aug 04 17:18:57.354990 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2972/6051] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:57 2022] GET /compute/v2.1/servers/8a39e22a-9e6b-4302-90cc-726be76ccdc7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:19:02.606507 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c2070713-dbac-440e-ba11-1bbd7e3fa23c tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:19:02.610218 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c2070713-dbac-440e-ba11-1bbd7e3fa23c tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:02.627479 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2070713-dbac-440e-ba11-1bbd7e3fa23c tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:02.635105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2070713-dbac-440e-ba11-1bbd7e3fa23c tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:02.635996 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2070713-dbac-440e-ba11-1bbd7e3fa23c tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:02.637450 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2070713-dbac-440e-ba11-1bbd7e3fa23c tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:02.707490 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c2070713-dbac-440e-ba11-1bbd7e3fa23c tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "POST /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab/action" status: 200 len: 24571 microversion: 2.1 time: 0.105222 Aug 04 17:19:02.716582 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3080/6052] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:19:02 2022] POST /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab/action => generated 24571 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:19:13.741271 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-46557cd0-931f-4b10-ba69-137a2495881b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:13.741988 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-46557cd0-931f-4b10-ba69-137a2495881b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:13.744910 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=17 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:19:13.745644 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=67 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:19:13.752543 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-46557cd0-931f-4b10-ba69-137a2495881b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:13.753013 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-46557cd0-931f-4b10-ba69-137a2495881b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:13.753823 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-46557cd0-931f-4b10-ba69-137a2495881b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:13.754272 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-46557cd0-931f-4b10-ba69-137a2495881b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:13.927112 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-46557cd0-931f-4b10-ba69-137a2495881b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:13.935773 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-46557cd0-931f-4b10-ba69-137a2495881b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab" status: 200 len: 1680 microversion: 2.1 time: 0.198549 Aug 04 17:19:13.936395 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2973/6053] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:13 2022] GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab => generated 1680 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:14.043078 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8f1815f7-1448-4ee4-a42d-a6005c961259 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:19:14.045508 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8f1815f7-1448-4ee4-a42d-a6005c961259 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:14.048752 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:19:14.049457 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:19:14.055638 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8f1815f7-1448-4ee4-a42d-a6005c961259 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:14.056091 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8f1815f7-1448-4ee4-a42d-a6005c961259 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:14.056884 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8f1815f7-1448-4ee4-a42d-a6005c961259 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:14.057344 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8f1815f7-1448-4ee4-a42d-a6005c961259 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:14.113045 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8f1815f7-1448-4ee4-a42d-a6005c961259 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "POST /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab/action" status: 200 len: 32647 microversion: 2.1 time: 0.074275 Aug 04 17:19:14.113820 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3081/6054] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:19:14 2022] POST /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab/action => generated 32647 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 17:19:14.256273 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-92948e01-582f-482b-9afa-54749ae65d68 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:14.256906 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-92948e01-582f-482b-9afa-54749ae65d68 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:14.267337 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-92948e01-582f-482b-9afa-54749ae65d68 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:14.268010 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-92948e01-582f-482b-9afa-54749ae65d68 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:14.268909 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-92948e01-582f-482b-9afa-54749ae65d68 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:14.270399 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-92948e01-582f-482b-9afa-54749ae65d68 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:14.434619 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-92948e01-582f-482b-9afa-54749ae65d68 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab" status: 200 len: 1833 microversion: 2.1 time: 0.181904 Aug 04 17:19:14.437330 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2974/6055] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:14 2022] GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab => generated 1833 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:14.466419 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a8e3ba33-ceac-4bd8-88d6-68225b60e454 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:19:14.470278 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a8e3ba33-ceac-4bd8-88d6-68225b60e454 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:14.478050 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8e3ba33-ceac-4bd8-88d6-68225b60e454 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:14.478493 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8e3ba33-ceac-4bd8-88d6-68225b60e454 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:14.479264 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8e3ba33-ceac-4bd8-88d6-68225b60e454 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:14.479688 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8e3ba33-ceac-4bd8-88d6-68225b60e454 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:14.507558 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-a8e3ba33-ceac-4bd8-88d6-68225b60e454 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lazy-loading 'flavor' on Instance uuid eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:19:14.522208 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a8e3ba33-ceac-4bd8-88d6-68225b60e454 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Going to try to live migrate instance to another host {{(pid=126125) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 17:19:16.342843 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a8e3ba33-ceac-4bd8-88d6-68225b60e454 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab/action" status: 202 len: 0 microversion: 2.1 time: 1.881062 Aug 04 17:19:16.344087 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3082/6056] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:19:14 2022] POST /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab/action => generated 0 bytes in 1883 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:19:16.355682 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9ab841fd-8cd1-4031-b27a-458ec033f683 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:16.356901 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9ab841fd-8cd1-4031-b27a-458ec033f683 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:16.368567 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9ab841fd-8cd1-4031-b27a-458ec033f683 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:16.369625 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9ab841fd-8cd1-4031-b27a-458ec033f683 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:16.370748 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9ab841fd-8cd1-4031-b27a-458ec033f683 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:16.371361 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9ab841fd-8cd1-4031-b27a-458ec033f683 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:16.541832 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9ab841fd-8cd1-4031-b27a-458ec033f683 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:16.550874 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9ab841fd-8cd1-4031-b27a-458ec033f683 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab" status: 200 len: 1690 microversion: 2.1 time: 0.200814 Aug 04 17:19:16.551482 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2975/6057] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:16 2022] GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab => generated 1690 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:17.574590 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f84e0fb2-d8e0-4e09-a5aa-f0eaa7eea6fe tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:17.575252 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f84e0fb2-d8e0-4e09-a5aa-f0eaa7eea6fe tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:17.587730 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f84e0fb2-d8e0-4e09-a5aa-f0eaa7eea6fe tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:17.587923 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f84e0fb2-d8e0-4e09-a5aa-f0eaa7eea6fe tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:17.588907 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f84e0fb2-d8e0-4e09-a5aa-f0eaa7eea6fe tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:17.589544 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f84e0fb2-d8e0-4e09-a5aa-f0eaa7eea6fe tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:17.761858 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f84e0fb2-d8e0-4e09-a5aa-f0eaa7eea6fe tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:17.772467 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f84e0fb2-d8e0-4e09-a5aa-f0eaa7eea6fe tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab" status: 200 len: 1690 microversion: 2.1 time: 0.202399 Aug 04 17:19:17.772712 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-a5189a65-31af-4bda-bd59-cf30999f1983 req-b74c1959-9a69-4c07-839f-c037dacbd99e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab", "name": "network-vif-unplugged", "status": "completed", "tag": "661f3496-b7c1-46e5-a11c-44ddf7c3619b"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:19:17.784715 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a5189a65-31af-4bda-bd59-cf30999f1983 req-b74c1959-9a69-4c07-839f-c037dacbd99e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:17.785567 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a5189a65-31af-4bda-bd59-cf30999f1983 req-b74c1959-9a69-4c07-839f-c037dacbd99e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:17.787384 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3083/6058] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:17 2022] GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab => generated 1690 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:19:17.797884 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-a5189a65-31af-4bda-bd59-cf30999f1983 req-b74c1959-9a69-4c07-839f-c037dacbd99e service nova] Creating event network-vif-unplugged:661f3496-b7c1-46e5-a11c-44ddf7c3619b for instance eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab on n-h2-846466-12 Aug 04 17:19:17.803405 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-a5189a65-31af-4bda-bd59-cf30999f1983 req-b74c1959-9a69-4c07-839f-c037dacbd99e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034518 Aug 04 17:19:17.804632 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2976/6059] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:19:18.796016 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ee6afb4c-a8ab-4bef-98e1-f3b1e612a9cf tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:18.796016 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ee6afb4c-a8ab-4bef-98e1-f3b1e612a9cf tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:18.804700 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ee6afb4c-a8ab-4bef-98e1-f3b1e612a9cf tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:18.805494 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ee6afb4c-a8ab-4bef-98e1-f3b1e612a9cf tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:18.806282 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ee6afb4c-a8ab-4bef-98e1-f3b1e612a9cf tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:18.806931 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ee6afb4c-a8ab-4bef-98e1-f3b1e612a9cf tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:19.001105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ee6afb4c-a8ab-4bef-98e1-f3b1e612a9cf tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:19.009910 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ee6afb4c-a8ab-4bef-98e1-f3b1e612a9cf tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab" status: 200 len: 1690 microversion: 2.1 time: 0.219507 Aug 04 17:19:19.010604 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3084/6060] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:18 2022] GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab => generated 1690 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:19.834596 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-b6a306bc-e76c-464e-8885-bf1910c716dc req-e28b9ab8-f983-48e4-8c89-fc568983e2ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab", "tag": "661f3496-b7c1-46e5-a11c-44ddf7c3619b"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:19:19.853327 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-b6a306bc-e76c-464e-8885-bf1910c716dc req-e28b9ab8-f983-48e4-8c89-fc568983e2ff service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:19.854177 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-b6a306bc-e76c-464e-8885-bf1910c716dc req-e28b9ab8-f983-48e4-8c89-fc568983e2ff service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:19.873336 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-b6a306bc-e76c-464e-8885-bf1910c716dc req-e28b9ab8-f983-48e4-8c89-fc568983e2ff service nova] Creating event network-changed:661f3496-b7c1-46e5-a11c-44ddf7c3619b for instance eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab on n-h2-846466-12 Aug 04 17:19:19.881311 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-b6a306bc-e76c-464e-8885-bf1910c716dc req-e28b9ab8-f983-48e4-8c89-fc568983e2ff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051530 Aug 04 17:19:19.882334 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2977/6061] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:19:20.034117 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9e139127-15d2-41ee-a7ab-43a4b9f3c797 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:20.035412 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9e139127-15d2-41ee-a7ab-43a4b9f3c797 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:20.042471 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9e139127-15d2-41ee-a7ab-43a4b9f3c797 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:20.042921 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9e139127-15d2-41ee-a7ab-43a4b9f3c797 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:20.043714 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9e139127-15d2-41ee-a7ab-43a4b9f3c797 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:20.044276 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9e139127-15d2-41ee-a7ab-43a4b9f3c797 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:20.278060 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9e139127-15d2-41ee-a7ab-43a4b9f3c797 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:20.291691 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9e139127-15d2-41ee-a7ab-43a4b9f3c797 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab" status: 200 len: 1690 microversion: 2.1 time: 0.262753 Aug 04 17:19:20.292827 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3085/6062] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:20 2022] GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab => generated 1690 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:21.315882 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d4127966-1701-4473-b68a-de1555f138bd tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:21.316593 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d4127966-1701-4473-b68a-de1555f138bd tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:21.324623 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d4127966-1701-4473-b68a-de1555f138bd tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:21.325016 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d4127966-1701-4473-b68a-de1555f138bd tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:21.325833 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d4127966-1701-4473-b68a-de1555f138bd tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:21.326273 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d4127966-1701-4473-b68a-de1555f138bd tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:21.472162 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d4127966-1701-4473-b68a-de1555f138bd tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:21.480093 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d4127966-1701-4473-b68a-de1555f138bd tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab" status: 200 len: 1690 microversion: 2.1 time: 0.168886 Aug 04 17:19:21.480684 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2978/6063] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:21 2022] GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:22.501851 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c9c77530-ddd2-49c6-a6d4-77380ca37051 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:22.502480 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c9c77530-ddd2-49c6-a6d4-77380ca37051 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:22.510142 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c9c77530-ddd2-49c6-a6d4-77380ca37051 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:22.510601 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c9c77530-ddd2-49c6-a6d4-77380ca37051 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:22.512341 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c9c77530-ddd2-49c6-a6d4-77380ca37051 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:22.513180 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c9c77530-ddd2-49c6-a6d4-77380ca37051 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:22.672686 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c9c77530-ddd2-49c6-a6d4-77380ca37051 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:22.684345 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c9c77530-ddd2-49c6-a6d4-77380ca37051 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab" status: 200 len: 1690 microversion: 2.1 time: 0.186517 Aug 04 17:19:22.684937 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3086/6064] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:22 2022] GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab => generated 1690 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:23.707292 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5706bf22-986d-4977-a790-5fbc05b1f3c2 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:23.708090 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5706bf22-986d-4977-a790-5fbc05b1f3c2 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:23.715435 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5706bf22-986d-4977-a790-5fbc05b1f3c2 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:23.716189 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5706bf22-986d-4977-a790-5fbc05b1f3c2 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:23.717056 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5706bf22-986d-4977-a790-5fbc05b1f3c2 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:23.717725 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5706bf22-986d-4977-a790-5fbc05b1f3c2 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:24.300221 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5706bf22-986d-4977-a790-5fbc05b1f3c2 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:24.310369 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5706bf22-986d-4977-a790-5fbc05b1f3c2 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab" status: 200 len: 1690 microversion: 2.1 time: 0.607494 Aug 04 17:19:24.323695 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2979/6065] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:23 2022] GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab => generated 1690 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:25.332818 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f038277e-5c5e-4934-9a70-4b4aadbca2c4 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:25.334120 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f038277e-5c5e-4934-9a70-4b4aadbca2c4 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:25.341660 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f038277e-5c5e-4934-9a70-4b4aadbca2c4 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:25.342089 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f038277e-5c5e-4934-9a70-4b4aadbca2c4 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:25.342899 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f038277e-5c5e-4934-9a70-4b4aadbca2c4 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:25.343337 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f038277e-5c5e-4934-9a70-4b4aadbca2c4 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:25.505974 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f038277e-5c5e-4934-9a70-4b4aadbca2c4 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:25.514440 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f038277e-5c5e-4934-9a70-4b4aadbca2c4 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab" status: 200 len: 1680 microversion: 2.1 time: 0.185610 Aug 04 17:19:25.515033 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3087/6066] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:25 2022] GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab => generated 1680 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:25.536145 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-af50fd08-6d95-4d35-bac0-fae73ee3d685 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:25.536781 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-af50fd08-6d95-4d35-bac0-fae73ee3d685 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:25.544799 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-af50fd08-6d95-4d35-bac0-fae73ee3d685 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:25.545514 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-af50fd08-6d95-4d35-bac0-fae73ee3d685 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:25.546653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-af50fd08-6d95-4d35-bac0-fae73ee3d685 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:25.547255 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-af50fd08-6d95-4d35-bac0-fae73ee3d685 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:25.698634 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-af50fd08-6d95-4d35-bac0-fae73ee3d685 tempest-TestNetworkAdvancedServerOps-1808621093 tempest-TestNetworkAdvancedServerOps-1808621093-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab" status: 200 len: 1833 microversion: 2.1 time: 0.166448 Aug 04 17:19:25.699249 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2980/6067] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:25 2022] GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab => generated 1833 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:25.720767 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6fd36998-8633-4bdd-bcdd-75a5238624fc tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:25.721413 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6fd36998-8633-4bdd-bcdd-75a5238624fc tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:25.728467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6fd36998-8633-4bdd-bcdd-75a5238624fc tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:25.728911 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6fd36998-8633-4bdd-bcdd-75a5238624fc tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:25.729793 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6fd36998-8633-4bdd-bcdd-75a5238624fc tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:25.730240 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6fd36998-8633-4bdd-bcdd-75a5238624fc tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:25.891565 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6fd36998-8633-4bdd-bcdd-75a5238624fc tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:25.900085 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6fd36998-8633-4bdd-bcdd-75a5238624fc tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab" status: 200 len: 1680 microversion: 2.1 time: 0.183246 Aug 04 17:19:25.909634 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3088/6068] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:25 2022] GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:26.027600 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-01165706-0fe6-4f80-81ed-91f6313dec02 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:19:26.029950 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-01165706-0fe6-4f80-81ed-91f6313dec02 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:26.036604 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-01165706-0fe6-4f80-81ed-91f6313dec02 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:26.037064 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-01165706-0fe6-4f80-81ed-91f6313dec02 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:26.037911 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-01165706-0fe6-4f80-81ed-91f6313dec02 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:26.038360 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-01165706-0fe6-4f80-81ed-91f6313dec02 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:26.102096 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-01165706-0fe6-4f80-81ed-91f6313dec02 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "POST /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab/action" status: 200 len: 38592 microversion: 2.1 time: 0.078482 Aug 04 17:19:26.103186 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2981/6069] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:19:26 2022] POST /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab/action => generated 38592 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:19:27.180988 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-7d5c8447-dba1-4bc8-b21e-83b3ac0ca925 req-9aab1500-0c9c-47fe-aa8f-2253679bec10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab", "tag": "661f3496-b7c1-46e5-a11c-44ddf7c3619b"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:19:27.182051 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0027ab97-c7c3-415d-b4cb-59e6ba440d18 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:27.182623 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0027ab97-c7c3-415d-b4cb-59e6ba440d18 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:27.196908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0027ab97-c7c3-415d-b4cb-59e6ba440d18 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:27.197455 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0027ab97-c7c3-415d-b4cb-59e6ba440d18 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:27.198144 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0027ab97-c7c3-415d-b4cb-59e6ba440d18 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:27.198579 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0027ab97-c7c3-415d-b4cb-59e6ba440d18 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:27.206323 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-7d5c8447-dba1-4bc8-b21e-83b3ac0ca925 req-9aab1500-0c9c-47fe-aa8f-2253679bec10 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:27.206763 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-7d5c8447-dba1-4bc8-b21e-83b3ac0ca925 req-9aab1500-0c9c-47fe-aa8f-2253679bec10 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:27.224558 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-7d5c8447-dba1-4bc8-b21e-83b3ac0ca925 req-9aab1500-0c9c-47fe-aa8f-2253679bec10 service nova] Creating event network-changed:661f3496-b7c1-46e5-a11c-44ddf7c3619b for instance eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab on n-h1-846466-12 Aug 04 17:19:27.231331 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-7d5c8447-dba1-4bc8-b21e-83b3ac0ca925 req-9aab1500-0c9c-47fe-aa8f-2253679bec10 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056049 Aug 04 17:19:27.236588 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2982/6070] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:19:27.242146 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0027ab97-c7c3-415d-b4cb-59e6ba440d18 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:19:27.351182 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0027ab97-c7c3-415d-b4cb-59e6ba440d18 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "DELETE /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab" status: 204 len: 0 microversion: 2.1 time: 0.181372 Aug 04 17:19:27.352356 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3089/6071] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:19:27 2022] DELETE /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:19:27.362452 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7ff1d74c-85b6-4c7d-914a-ed39e0cec44e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:27.363208 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7ff1d74c-85b6-4c7d-914a-ed39e0cec44e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:27.373340 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7ff1d74c-85b6-4c7d-914a-ed39e0cec44e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:27.374075 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7ff1d74c-85b6-4c7d-914a-ed39e0cec44e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:27.375453 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7ff1d74c-85b6-4c7d-914a-ed39e0cec44e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:27.376368 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7ff1d74c-85b6-4c7d-914a-ed39e0cec44e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:27.536228 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7ff1d74c-85b6-4c7d-914a-ed39e0cec44e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:27.545579 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7ff1d74c-85b6-4c7d-914a-ed39e0cec44e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab" status: 200 len: 1686 microversion: 2.1 time: 0.188633 Aug 04 17:19:27.546181 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2983/6072] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:27 2022] GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab => generated 1686 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:19:28.568428 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-46a5ad60-9227-454d-a5b9-9aab879a2e27 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:28.569269 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-46a5ad60-9227-454d-a5b9-9aab879a2e27 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:28.576531 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46a5ad60-9227-454d-a5b9-9aab879a2e27 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:28.577116 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46a5ad60-9227-454d-a5b9-9aab879a2e27 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:28.578130 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46a5ad60-9227-454d-a5b9-9aab879a2e27 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:28.578731 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46a5ad60-9227-454d-a5b9-9aab879a2e27 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:28.612540 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46a5ad60-9227-454d-a5b9-9aab879a2e27 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:28.612980 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46a5ad60-9227-454d-a5b9-9aab879a2e27 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:28.613452 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-46a5ad60-9227-454d-a5b9-9aab879a2e27 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lazy-loading 'fault' on Instance uuid eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:19:28.659563 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-46a5ad60-9227-454d-a5b9-9aab879a2e27 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:28.667454 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-46a5ad60-9227-454d-a5b9-9aab879a2e27 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab" status: 200 len: 1356 microversion: 2.1 time: 0.103320 Aug 04 17:19:28.668053 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3090/6073] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:28 2022] GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab => generated 1356 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:29.247730 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-9c996ddd-d02d-4e40-84f2-bbac5ebc914a req-9f55bafb-6fd9-4e15-8306-0eac03918248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab", "name": "network-vif-deleted", "tag": "661f3496-b7c1-46e5-a11c-44ddf7c3619b"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:19:29.259255 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-9c996ddd-d02d-4e40-84f2-bbac5ebc914a req-9f55bafb-6fd9-4e15-8306-0eac03918248 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:29.259675 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-9c996ddd-d02d-4e40-84f2-bbac5ebc914a req-9f55bafb-6fd9-4e15-8306-0eac03918248 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:29.272207 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-9c996ddd-d02d-4e40-84f2-bbac5ebc914a req-9f55bafb-6fd9-4e15-8306-0eac03918248 service nova] Creating event network-vif-deleted:661f3496-b7c1-46e5-a11c-44ddf7c3619b for instance eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab on n-h1-846466-12 Aug 04 17:19:29.277769 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-9c996ddd-d02d-4e40-84f2-bbac5ebc914a req-9f55bafb-6fd9-4e15-8306-0eac03918248 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033934 Aug 04 17:19:29.278527 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2984/6074] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:19:29.689568 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9f28e2e3-baa4-4159-9444-ee5937d2ccbb tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:29.690213 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9f28e2e3-baa4-4159-9444-ee5937d2ccbb tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:29.697984 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9f28e2e3-baa4-4159-9444-ee5937d2ccbb tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:29.698294 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9f28e2e3-baa4-4159-9444-ee5937d2ccbb tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:29.699056 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9f28e2e3-baa4-4159-9444-ee5937d2ccbb tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:29.699482 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9f28e2e3-baa4-4159-9444-ee5937d2ccbb tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:29.715608 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-9f28e2e3-baa4-4159-9444-ee5937d2ccbb tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] HTTP exception thrown: Instance eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab could not be found. Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9f28e2e3-baa4-4159-9444-ee5937d2ccbb tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Request method failure captured: Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab HTTP/1.1 Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_4YOThE04EgY2ZC-6Z4P4BLZorNPrwNYsXnudJ3q-g4O8Bpo6oQ4TtL_No6KcEehCahXC1c1rl575Jd3mS3Ei78aQ8uVNhdiDOypdyIumzQRzdLDSRFfSIpFDGraNFEgTS8aTaqqN8uid7ehZJahj9lTM6cYwjw3-kHQng3DwqKDNs Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: a080cbeb5c3a435a880e48ea64dbea70 Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1931304919 Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a080cbeb5c3a435a880e48ea64dbea70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a080cbeb5c3a435a880e48ea64dbea70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a080cbeb5c3a435a880e48ea64dbea70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a080cbeb5c3a435a880e48ea64dbea70"}]}] Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1931304919 Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: a080cbeb5c3a435a880e48ea64dbea70 Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1931304919 Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-TestNetworkAdvancedServerOps-1931304919-project Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: e4c6be7b0d164da98f08be0c35f843a2 Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1931304919-project Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab could not be found. Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab'} Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab could not be found. Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab could not be found. Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:19:29.717302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:19:29.724012 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:19:29.724012 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:19:29.724012 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:19:29.724012 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:19:29.724012 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:19:29.724012 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:19:29.724012 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab could not be found. Aug 04 17:19:29.724012 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:19:29.724012 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9f28e2e3-baa4-4159-9444-ee5937d2ccbb tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Returning 404 to user: Instance eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:19:29.724012 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9f28e2e3-baa4-4159-9444-ee5937d2ccbb tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab" status: 404 len: 111 microversion: 2.1 time: 0.033235 Aug 04 17:19:29.724012 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3091/6075] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:29 2022] GET /compute/v2.1/servers/eb0db7b8-de0d-4ce6-b5d7-6e5b4808baab => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:19:33.504911 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ca4a5e35-c99d-4b6b-bc73-2ae71a37485f tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '.version_select at 0x7f7e77ec71f0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:33.535018 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ca4a5e35-c99d-4b6b-bc73-2ae71a37485f tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2040918659" status: 202 len: 0 microversion: 2.1 time: 0.034859 Aug 04 17:19:33.540040 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2985/6076] 10.222.0.23 () {58 vars in 1284 bytes} [Thu Aug 4 17:19:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2040918659 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:19:33.567398 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4c89bde0-6069-49e1-869a-7677ad0d6f25 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Action: 'create', calling method: .version_select at 0x7f7e84660550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-286565168", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJ3BQQg5L/9V4IJ8uDXJzkLx7S7ynsnXRXfkKEM/D7F7TYx/5Goht+Rrr8zxmHKE6n+HXHuvkPHRznNYh29dq8PPWJa8KhF9YUv7GcZuR2BFRRyHCv0glUkccAXhDbeCg=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:19:33.584554 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-4c89bde0-6069-49e1-869a-7677ad0d6f25 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Getting quotas for project a080cbeb5c3a435a880e48ea64dbea70. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:19:33.591288 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-4c89bde0-6069-49e1-869a-7677ad0d6f25 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Getting quotas for user e4c6be7b0d164da98f08be0c35f843a2 and project a080cbeb5c3a435a880e48ea64dbea70. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:19:33.617841 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4c89bde0-6069-49e1-869a-7677ad0d6f25 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.055587 Aug 04 17:19:33.618573 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3092/6077] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 17:19:33 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:19:41.141091 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=54 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:19:41.145799 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c4c3c73a-6679-41ac-8fd6-05e4df69ef62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1398959116", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "1e5ab18a-cdb9-4e38-be4f-ee8c267275dc"}], "key_name": "tempest-TestNetworkAdvancedServerOps-286565168", "security_groups": [{"name": "tempest-secgroup-smoke-531547868"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:19:41.338495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-c4c3c73a-6679-41ac-8fd6-05e4df69ef62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] validate_networks() for [('1e5ab18a-cdb9-4e38-be4f-ee8c267275dc', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:19:41.908094 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-c4c3c73a-6679-41ac-8fd6-05e4df69ef62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:19:41.908924 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-c4c3c73a-6679-41ac-8fd6-05e4df69ef62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:19:41.909904 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-c4c3c73a-6679-41ac-8fd6-05e4df69ef62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:19:41.910747 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-c4c3c73a-6679-41ac-8fd6-05e4df69ef62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:19:41.911402 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-c4c3c73a-6679-41ac-8fd6-05e4df69ef62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:19:41.924145 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4c3c73a-6679-41ac-8fd6-05e4df69ef62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:41.924998 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4c3c73a-6679-41ac-8fd6-05e4df69ef62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:41.926165 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4c3c73a-6679-41ac-8fd6-05e4df69ef62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:41.926703 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4c3c73a-6679-41ac-8fd6-05e4df69ef62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:41.955942 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-c4c3c73a-6679-41ac-8fd6-05e4df69ef62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Getting quotas for project a080cbeb5c3a435a880e48ea64dbea70. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:19:41.963124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-c4c3c73a-6679-41ac-8fd6-05e4df69ef62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Getting quotas for user e4c6be7b0d164da98f08be0c35f843a2 and project a080cbeb5c3a435a880e48ea64dbea70. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:19:41.983564 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c4c3c73a-6679-41ac-8fd6-05e4df69ef62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:19:41.986333 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c4c3c73a-6679-41ac-8fd6-05e4df69ef62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:19:42.043940 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c4c3c73a-6679-41ac-8fd6-05e4df69ef62 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.904790 Aug 04 17:19:42.045072 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2986/6078] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:19:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:19:42.055727 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:19:42.065429 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f8be82ff-e4c6-4a01-ac15-368f92ac6f08 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:42.068623 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f8be82ff-e4c6-4a01-ac15-368f92ac6f08 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:42.167558 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f8be82ff-e4c6-4a01-ac15-368f92ac6f08 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:42.178642 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f8be82ff-e4c6-4a01-ac15-368f92ac6f08 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c" status: 200 len: 1266 microversion: 2.1 time: 0.124949 Aug 04 17:19:42.179979 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3093/6079] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:42 2022] GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c => generated 1266 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:43.209067 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f262cd18-8db8-46a2-90bc-320b04650b2e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:43.209648 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f262cd18-8db8-46a2-90bc-320b04650b2e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:43.226445 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f262cd18-8db8-46a2-90bc-320b04650b2e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:43.226918 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f262cd18-8db8-46a2-90bc-320b04650b2e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:43.228067 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f262cd18-8db8-46a2-90bc-320b04650b2e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:43.228227 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f262cd18-8db8-46a2-90bc-320b04650b2e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:43.301061 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f262cd18-8db8-46a2-90bc-320b04650b2e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:43.322632 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f262cd18-8db8-46a2-90bc-320b04650b2e tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c" status: 200 len: 1318 microversion: 2.1 time: 0.117897 Aug 04 17:19:43.323600 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2987/6080] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:43 2022] GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c => generated 1318 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:19:44.343853 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-18d81c1e-979d-4493-80dd-92eb9e3b48c2 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:44.349943 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-18d81c1e-979d-4493-80dd-92eb9e3b48c2 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:44.352955 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:19:44.384235 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-18d81c1e-979d-4493-80dd-92eb9e3b48c2 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:44.385003 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-18d81c1e-979d-4493-80dd-92eb9e3b48c2 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:44.386132 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-18d81c1e-979d-4493-80dd-92eb9e3b48c2 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:44.387609 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-18d81c1e-979d-4493-80dd-92eb9e3b48c2 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:44.559667 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-18d81c1e-979d-4493-80dd-92eb9e3b48c2 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:44.571631 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-18d81c1e-979d-4493-80dd-92eb9e3b48c2 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c" status: 200 len: 1324 microversion: 2.1 time: 0.231743 Aug 04 17:19:44.591761 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3094/6081] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:44 2022] GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c => generated 1324 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:45.601473 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e0aea7d5-bf3b-4168-9aa9-6bf3c554b2bf tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:45.602209 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e0aea7d5-bf3b-4168-9aa9-6bf3c554b2bf tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:45.607091 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:19:45.615369 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e0aea7d5-bf3b-4168-9aa9-6bf3c554b2bf tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:45.616168 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e0aea7d5-bf3b-4168-9aa9-6bf3c554b2bf tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:45.617190 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e0aea7d5-bf3b-4168-9aa9-6bf3c554b2bf tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:45.617874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e0aea7d5-bf3b-4168-9aa9-6bf3c554b2bf tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:45.852206 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e0aea7d5-bf3b-4168-9aa9-6bf3c554b2bf tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:45.861571 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e0aea7d5-bf3b-4168-9aa9-6bf3c554b2bf tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c" status: 200 len: 1391 microversion: 2.1 time: 0.265435 Aug 04 17:19:45.862556 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2988/6082] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:45 2022] GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c => generated 1391 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:45.962751 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-94af2b3f-e020-48d3-8430-3822792c6500 req-6b773103-e8a8-4583-9279-e86126e5d9f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "265ba8fa-15d2-4a47-9292-ee7511d1e79c", "tag": "fbc94cae-3384-4684-8f8a-c028cae6b93c"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:19:45.977165 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-94af2b3f-e020-48d3-8430-3822792c6500 req-6b773103-e8a8-4583-9279-e86126e5d9f7 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:45.977912 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-94af2b3f-e020-48d3-8430-3822792c6500 req-6b773103-e8a8-4583-9279-e86126e5d9f7 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:45.993555 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-94af2b3f-e020-48d3-8430-3822792c6500 req-6b773103-e8a8-4583-9279-e86126e5d9f7 service nova] Creating event network-changed:fbc94cae-3384-4684-8f8a-c028cae6b93c for instance 265ba8fa-15d2-4a47-9292-ee7511d1e79c on n-h2-846466-12 Aug 04 17:19:46.000394 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-94af2b3f-e020-48d3-8430-3822792c6500 req-6b773103-e8a8-4583-9279-e86126e5d9f7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044267 Aug 04 17:19:46.002223 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3095/6083] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:19:46.884007 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a434a29b-537a-4630-99af-fb8e562ead35 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:46.884609 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a434a29b-537a-4630-99af-fb8e562ead35 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:46.893800 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a434a29b-537a-4630-99af-fb8e562ead35 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:46.894386 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a434a29b-537a-4630-99af-fb8e562ead35 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:46.895275 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a434a29b-537a-4630-99af-fb8e562ead35 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:46.895740 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a434a29b-537a-4630-99af-fb8e562ead35 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:47.139627 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a434a29b-537a-4630-99af-fb8e562ead35 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:47.155612 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a434a29b-537a-4630-99af-fb8e562ead35 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c" status: 200 len: 1391 microversion: 2.1 time: 0.275228 Aug 04 17:19:47.156724 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2989/6084] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:46 2022] GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c => generated 1391 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:48.178694 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f15f1e89-8296-4153-955a-b4323b60353a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:48.179586 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f15f1e89-8296-4153-955a-b4323b60353a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:48.188266 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f15f1e89-8296-4153-955a-b4323b60353a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:48.188796 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f15f1e89-8296-4153-955a-b4323b60353a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:48.189651 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f15f1e89-8296-4153-955a-b4323b60353a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:48.190088 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f15f1e89-8296-4153-955a-b4323b60353a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:48.518360 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f15f1e89-8296-4153-955a-b4323b60353a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:48.532105 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f15f1e89-8296-4153-955a-b4323b60353a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c" status: 200 len: 1391 microversion: 2.1 time: 0.357944 Aug 04 17:19:48.532915 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3096/6085] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:48 2022] GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c => generated 1391 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:49.568451 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a6d83f7a-af80-4724-bf3f-b910dc88d6e5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:49.569663 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a6d83f7a-af80-4724-bf3f-b910dc88d6e5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:49.577426 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6d83f7a-af80-4724-bf3f-b910dc88d6e5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:49.578042 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6d83f7a-af80-4724-bf3f-b910dc88d6e5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:49.579144 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6d83f7a-af80-4724-bf3f-b910dc88d6e5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:49.579797 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6d83f7a-af80-4724-bf3f-b910dc88d6e5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:49.757645 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a6d83f7a-af80-4724-bf3f-b910dc88d6e5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:49.771143 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a6d83f7a-af80-4724-bf3f-b910dc88d6e5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c" status: 200 len: 1391 microversion: 2.1 time: 0.214021 Aug 04 17:19:49.772485 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2990/6086] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:49 2022] GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c => generated 1391 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:50.798783 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d5c5176b-364e-48b9-a89f-e2d6bab61eac tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:50.799518 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d5c5176b-364e-48b9-a89f-e2d6bab61eac tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:50.807234 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d5c5176b-364e-48b9-a89f-e2d6bab61eac tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:50.807615 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d5c5176b-364e-48b9-a89f-e2d6bab61eac tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:50.808386 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d5c5176b-364e-48b9-a89f-e2d6bab61eac tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:50.808825 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d5c5176b-364e-48b9-a89f-e2d6bab61eac tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:50.972353 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d5c5176b-364e-48b9-a89f-e2d6bab61eac tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:50.981707 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d5c5176b-364e-48b9-a89f-e2d6bab61eac tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c" status: 200 len: 1391 microversion: 2.1 time: 0.187042 Aug 04 17:19:50.987417 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3097/6087] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:50 2022] GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c => generated 1391 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:52.017130 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-561f506b-bbb7-452b-b75d-5c15e1a02672 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:52.017947 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-561f506b-bbb7-452b-b75d-5c15e1a02672 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:52.022192 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:19:52.023776 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:19:52.034872 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-561f506b-bbb7-452b-b75d-5c15e1a02672 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:52.035887 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-561f506b-bbb7-452b-b75d-5c15e1a02672 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:52.037356 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-561f506b-bbb7-452b-b75d-5c15e1a02672 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:52.038299 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-561f506b-bbb7-452b-b75d-5c15e1a02672 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:52.254797 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-3e524fdd-42e3-4ed0-84af-c78ec16619fa req-553ae6cd-99fa-4cba-8da8-2b8e29d68396 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "265ba8fa-15d2-4a47-9292-ee7511d1e79c", "name": "network-vif-plugged", "status": "completed", "tag": "fbc94cae-3384-4684-8f8a-c028cae6b93c"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:19:52.264253 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-561f506b-bbb7-452b-b75d-5c15e1a02672 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:52.273631 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:19:52.277270 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-3e524fdd-42e3-4ed0-84af-c78ec16619fa req-553ae6cd-99fa-4cba-8da8-2b8e29d68396 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:52.277844 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-3e524fdd-42e3-4ed0-84af-c78ec16619fa req-553ae6cd-99fa-4cba-8da8-2b8e29d68396 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:52.279533 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-561f506b-bbb7-452b-b75d-5c15e1a02672 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c" status: 200 len: 1391 microversion: 2.1 time: 0.269716 Aug 04 17:19:52.280818 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2991/6088] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:52 2022] GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c => generated 1391 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:52.303450 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-3e524fdd-42e3-4ed0-84af-c78ec16619fa req-553ae6cd-99fa-4cba-8da8-2b8e29d68396 service nova] Creating event network-vif-plugged:fbc94cae-3384-4684-8f8a-c028cae6b93c for instance 265ba8fa-15d2-4a47-9292-ee7511d1e79c on n-h2-846466-12 Aug 04 17:19:52.309722 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-3e524fdd-42e3-4ed0-84af-c78ec16619fa req-553ae6cd-99fa-4cba-8da8-2b8e29d68396 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060013 Aug 04 17:19:52.313229 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3098/6089] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:19:53.310917 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b470e811-e3d2-470c-aa2c-b32ef6741a4b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:53.311567 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b470e811-e3d2-470c-aa2c-b32ef6741a4b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:53.319312 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b470e811-e3d2-470c-aa2c-b32ef6741a4b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:53.319866 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b470e811-e3d2-470c-aa2c-b32ef6741a4b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:53.320732 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b470e811-e3d2-470c-aa2c-b32ef6741a4b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:53.321247 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b470e811-e3d2-470c-aa2c-b32ef6741a4b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:53.472426 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b470e811-e3d2-470c-aa2c-b32ef6741a4b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:53.490745 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b470e811-e3d2-470c-aa2c-b32ef6741a4b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c" status: 200 len: 1391 microversion: 2.1 time: 0.183857 Aug 04 17:19:53.491342 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2992/6090] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:53 2022] GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c => generated 1391 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:54.513020 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-561c0fb7-2aba-4461-9f1d-e9c15c94ddf7 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:54.514116 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-561c0fb7-2aba-4461-9f1d-e9c15c94ddf7 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:54.521465 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-561c0fb7-2aba-4461-9f1d-e9c15c94ddf7 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:54.521966 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-561c0fb7-2aba-4461-9f1d-e9c15c94ddf7 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:54.522947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-561c0fb7-2aba-4461-9f1d-e9c15c94ddf7 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:54.523390 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-561c0fb7-2aba-4461-9f1d-e9c15c94ddf7 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:54.697762 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-561c0fb7-2aba-4461-9f1d-e9c15c94ddf7 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:54.707043 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-561c0fb7-2aba-4461-9f1d-e9c15c94ddf7 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c" status: 200 len: 1563 microversion: 2.1 time: 0.199105 Aug 04 17:19:54.707661 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3099/6091] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:54 2022] GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c => generated 1563 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:19:54.727795 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-39f4f46a-ad32-4bd2-ba93-76660cf5b4ea tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:54.728496 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-39f4f46a-ad32-4bd2-ba93-76660cf5b4ea tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:54.736426 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39f4f46a-ad32-4bd2-ba93-76660cf5b4ea tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:54.736882 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39f4f46a-ad32-4bd2-ba93-76660cf5b4ea tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:54.737720 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39f4f46a-ad32-4bd2-ba93-76660cf5b4ea tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:54.738344 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39f4f46a-ad32-4bd2-ba93-76660cf5b4ea tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:54.902726 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-39f4f46a-ad32-4bd2-ba93-76660cf5b4ea tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:54.911615 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-39f4f46a-ad32-4bd2-ba93-76660cf5b4ea tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c" status: 200 len: 1563 microversion: 2.1 time: 0.187838 Aug 04 17:19:54.912246 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2993/6092] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:54 2022] GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c => generated 1563 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:56.825799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7a144443-2fb3-4726-98d3-14e964c93c6b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:56.827211 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7a144443-2fb3-4726-98d3-14e964c93c6b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:56.828277 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-a9b39288-4e94-4fe1-918b-c154a155b49a req-f4d88a46-32dd-4e24-a3c1-a5874dc4418c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "265ba8fa-15d2-4a47-9292-ee7511d1e79c", "tag": "fbc94cae-3384-4684-8f8a-c028cae6b93c"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:19:56.836092 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a144443-2fb3-4726-98d3-14e964c93c6b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:56.836892 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a144443-2fb3-4726-98d3-14e964c93c6b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:56.837992 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a144443-2fb3-4726-98d3-14e964c93c6b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:56.838494 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a144443-2fb3-4726-98d3-14e964c93c6b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:56.858111 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a9b39288-4e94-4fe1-918b-c154a155b49a req-f4d88a46-32dd-4e24-a3c1-a5874dc4418c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:19:56.859902 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a9b39288-4e94-4fe1-918b-c154a155b49a req-f4d88a46-32dd-4e24-a3c1-a5874dc4418c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:19:56.886945 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-a9b39288-4e94-4fe1-918b-c154a155b49a req-f4d88a46-32dd-4e24-a3c1-a5874dc4418c service nova] Creating event network-changed:fbc94cae-3384-4684-8f8a-c028cae6b93c for instance 265ba8fa-15d2-4a47-9292-ee7511d1e79c on n-h2-846466-12 Aug 04 17:19:56.895293 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-a9b39288-4e94-4fe1-918b-c154a155b49a req-f4d88a46-32dd-4e24-a3c1-a5874dc4418c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070240 Aug 04 17:19:56.901470 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2994/6093] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:19:57.164052 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7a144443-2fb3-4726-98d3-14e964c93c6b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:57.178214 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7a144443-2fb3-4726-98d3-14e964c93c6b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c" status: 200 len: 1563 microversion: 2.1 time: 0.356898 Aug 04 17:19:57.179492 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3100/6094] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:56 2022] GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c => generated 1563 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:19.592259 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=13 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:20:19.593014 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=46 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:20:19.597823 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-58bef445-2673-4221-a7a8-76a82ab54262 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:20:19.600173 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-58bef445-2673-4221-a7a8-76a82ab54262 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:19.607721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58bef445-2673-4221-a7a8-76a82ab54262 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:20:19.608154 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58bef445-2673-4221-a7a8-76a82ab54262 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:20:19.608939 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58bef445-2673-4221-a7a8-76a82ab54262 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:20:19.609402 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58bef445-2673-4221-a7a8-76a82ab54262 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:20:19.670635 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-58bef445-2673-4221-a7a8-76a82ab54262 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "POST /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c/action" status: 200 len: 24569 microversion: 2.1 time: 0.080289 Aug 04 17:20:19.671338 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2995/6095] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:20:19 2022] POST /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c/action => generated 24569 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:20:26.022602 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6011162d-84fe-4fdd-8480-2548bbedc935 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:20:26.026321 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6011162d-84fe-4fdd-8480-2548bbedc935 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:26.028786 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=13 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:20:26.030037 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=34 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:20:26.039134 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6011162d-84fe-4fdd-8480-2548bbedc935 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:20:26.039764 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6011162d-84fe-4fdd-8480-2548bbedc935 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:20:26.040966 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6011162d-84fe-4fdd-8480-2548bbedc935 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:20:26.041677 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6011162d-84fe-4fdd-8480-2548bbedc935 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:20:26.128771 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-6011162d-84fe-4fdd-8480-2548bbedc935 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:20:26.129201 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-6011162d-84fe-4fdd-8480-2548bbedc935 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:20:26.129701 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-6011162d-84fe-4fdd-8480-2548bbedc935 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:20:26.130101 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-6011162d-84fe-4fdd-8480-2548bbedc935 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:20:26.130510 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-6011162d-84fe-4fdd-8480-2548bbedc935 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:20:26.193754 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6011162d-84fe-4fdd-8480-2548bbedc935 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:26.200100 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6011162d-84fe-4fdd-8480-2548bbedc935 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:20:26.200549 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6011162d-84fe-4fdd-8480-2548bbedc935 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:20:26.201350 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6011162d-84fe-4fdd-8480-2548bbedc935 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:20:26.201774 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6011162d-84fe-4fdd-8480-2548bbedc935 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:20:26.238245 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6011162d-84fe-4fdd-8480-2548bbedc935 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "POST /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c/action" status: 202 len: 1137 microversion: 2.1 time: 0.221576 Aug 04 17:20:26.239200 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3101/6096] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:20:26 2022] POST /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c/action => generated 1137 bytes in 223 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 17:20:26.258445 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-761a1ddc-8563-4d78-b9f4-9cccc08c276b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:26.260402 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-761a1ddc-8563-4d78-b9f4-9cccc08c276b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:26.276828 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-761a1ddc-8563-4d78-b9f4-9cccc08c276b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:20:26.277542 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-761a1ddc-8563-4d78-b9f4-9cccc08c276b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:20:26.278491 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-761a1ddc-8563-4d78-b9f4-9cccc08c276b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:20:26.279349 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-761a1ddc-8563-4d78-b9f4-9cccc08c276b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:20:26.448822 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-761a1ddc-8563-4d78-b9f4-9cccc08c276b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:26.458523 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-761a1ddc-8563-4d78-b9f4-9cccc08c276b tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c" status: 200 len: 1690 microversion: 2.1 time: 0.205039 Aug 04 17:20:26.470180 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2996/6097] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:26 2022] GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c => generated 1690 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:27.490441 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b0595280-a8aa-49e2-a3ac-b30a87041bfd tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:27.491064 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b0595280-a8aa-49e2-a3ac-b30a87041bfd tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:27.499128 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0595280-a8aa-49e2-a3ac-b30a87041bfd tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:20:27.499544 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0595280-a8aa-49e2-a3ac-b30a87041bfd tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:20:27.500337 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0595280-a8aa-49e2-a3ac-b30a87041bfd tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:20:27.500789 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0595280-a8aa-49e2-a3ac-b30a87041bfd tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:20:27.658918 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b0595280-a8aa-49e2-a3ac-b30a87041bfd tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:27.667863 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b0595280-a8aa-49e2-a3ac-b30a87041bfd tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c" status: 200 len: 1690 microversion: 2.1 time: 0.181870 Aug 04 17:20:27.668712 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3102/6098] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:27 2022] GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c => generated 1690 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:28.692120 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4cc75a62-f603-4bde-a6ef-fd82466cf14c tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:28.693634 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4cc75a62-f603-4bde-a6ef-fd82466cf14c tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:28.707712 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4cc75a62-f603-4bde-a6ef-fd82466cf14c tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:20:28.708538 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4cc75a62-f603-4bde-a6ef-fd82466cf14c tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:20:28.710183 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4cc75a62-f603-4bde-a6ef-fd82466cf14c tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:20:28.710989 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4cc75a62-f603-4bde-a6ef-fd82466cf14c tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:20:28.880709 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4cc75a62-f603-4bde-a6ef-fd82466cf14c tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:28.888954 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4cc75a62-f603-4bde-a6ef-fd82466cf14c tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c" status: 200 len: 1690 microversion: 2.1 time: 0.202562 Aug 04 17:20:28.889926 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2997/6099] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:28 2022] GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c => generated 1690 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:20:29.910747 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d984b37a-2fb1-4e79-9dda-303ea5ef65ab tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:29.911383 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d984b37a-2fb1-4e79-9dda-303ea5ef65ab tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:29.919782 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d984b37a-2fb1-4e79-9dda-303ea5ef65ab tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:20:29.920226 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d984b37a-2fb1-4e79-9dda-303ea5ef65ab tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:20:29.920992 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d984b37a-2fb1-4e79-9dda-303ea5ef65ab tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:20:29.921464 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d984b37a-2fb1-4e79-9dda-303ea5ef65ab tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:20:30.074083 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d984b37a-2fb1-4e79-9dda-303ea5ef65ab tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:30.083981 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d984b37a-2fb1-4e79-9dda-303ea5ef65ab tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c" status: 200 len: 1690 microversion: 2.1 time: 0.177575 Aug 04 17:20:30.084825 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3103/6100] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:29 2022] GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c => generated 1690 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:31.107161 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ffc8a145-6c34-4715-b27b-259ebfb0ccb5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:31.107772 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ffc8a145-6c34-4715-b27b-259ebfb0ccb5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:31.116008 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ffc8a145-6c34-4715-b27b-259ebfb0ccb5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:20:31.116474 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ffc8a145-6c34-4715-b27b-259ebfb0ccb5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:20:31.117315 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ffc8a145-6c34-4715-b27b-259ebfb0ccb5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:20:31.117767 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ffc8a145-6c34-4715-b27b-259ebfb0ccb5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:20:31.278268 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ffc8a145-6c34-4715-b27b-259ebfb0ccb5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:31.286828 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ffc8a145-6c34-4715-b27b-259ebfb0ccb5 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c" status: 200 len: 1690 microversion: 2.1 time: 0.183827 Aug 04 17:20:31.287586 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2998/6101] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:31 2022] GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c => generated 1690 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:32.308277 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5daa7469-e5bc-4016-a171-72bec12f8a99 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:32.308835 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5daa7469-e5bc-4016-a171-72bec12f8a99 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:32.317662 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5daa7469-e5bc-4016-a171-72bec12f8a99 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:20:32.318134 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5daa7469-e5bc-4016-a171-72bec12f8a99 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:20:32.318924 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5daa7469-e5bc-4016-a171-72bec12f8a99 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:20:32.319359 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5daa7469-e5bc-4016-a171-72bec12f8a99 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:20:32.459944 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5daa7469-e5bc-4016-a171-72bec12f8a99 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:32.468655 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5daa7469-e5bc-4016-a171-72bec12f8a99 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c" status: 200 len: 1690 microversion: 2.1 time: 0.164215 Aug 04 17:20:32.469246 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3104/6102] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:32 2022] GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:33.491584 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-eceac280-598a-45b4-9483-f362cf3df9d3 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:33.492249 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-eceac280-598a-45b4-9483-f362cf3df9d3 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:33.499792 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eceac280-598a-45b4-9483-f362cf3df9d3 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:20:33.500247 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eceac280-598a-45b4-9483-f362cf3df9d3 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:20:33.501021 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eceac280-598a-45b4-9483-f362cf3df9d3 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:20:33.501659 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eceac280-598a-45b4-9483-f362cf3df9d3 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:20:33.656736 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-eceac280-598a-45b4-9483-f362cf3df9d3 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:33.665131 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-eceac280-598a-45b4-9483-f362cf3df9d3 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c" status: 200 len: 1690 microversion: 2.1 time: 0.178187 Aug 04 17:20:33.665765 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 2999/6103] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:33 2022] GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c => generated 1690 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:34.688591 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8d86b40d-c93a-448e-bc3d-808238944320 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:34.690401 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8d86b40d-c93a-448e-bc3d-808238944320 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:34.700034 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8d86b40d-c93a-448e-bc3d-808238944320 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:20:34.702460 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8d86b40d-c93a-448e-bc3d-808238944320 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:20:34.707829 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8d86b40d-c93a-448e-bc3d-808238944320 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:20:34.708391 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8d86b40d-c93a-448e-bc3d-808238944320 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:20:34.871750 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8d86b40d-c93a-448e-bc3d-808238944320 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:34.881359 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8d86b40d-c93a-448e-bc3d-808238944320 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c" status: 200 len: 1690 microversion: 2.1 time: 0.197252 Aug 04 17:20:34.881821 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3105/6104] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:34 2022] GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c => generated 1690 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:20:35.903319 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3f682d37-51c5-4456-8b79-6e3f6b72a6e8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:35.903970 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3f682d37-51c5-4456-8b79-6e3f6b72a6e8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:35.913306 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3f682d37-51c5-4456-8b79-6e3f6b72a6e8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:20:35.914029 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3f682d37-51c5-4456-8b79-6e3f6b72a6e8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:20:35.914994 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3f682d37-51c5-4456-8b79-6e3f6b72a6e8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:20:35.915566 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3f682d37-51c5-4456-8b79-6e3f6b72a6e8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:20:36.106631 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3f682d37-51c5-4456-8b79-6e3f6b72a6e8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:36.120211 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3f682d37-51c5-4456-8b79-6e3f6b72a6e8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c" status: 200 len: 1690 microversion: 2.1 time: 0.220770 Aug 04 17:20:36.121683 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3000/6105] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:35 2022] GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c => generated 1690 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:37.147429 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2ae16a10-6aec-415c-ab11-76a5d94d616a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:37.148852 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2ae16a10-6aec-415c-ab11-76a5d94d616a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:37.163705 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2ae16a10-6aec-415c-ab11-76a5d94d616a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:20:37.165525 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2ae16a10-6aec-415c-ab11-76a5d94d616a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:20:37.166520 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2ae16a10-6aec-415c-ab11-76a5d94d616a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:20:37.166936 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2ae16a10-6aec-415c-ab11-76a5d94d616a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:20:37.362545 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2ae16a10-6aec-415c-ab11-76a5d94d616a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:37.376549 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2ae16a10-6aec-415c-ab11-76a5d94d616a tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c" status: 200 len: 1690 microversion: 2.1 time: 0.235191 Aug 04 17:20:37.377598 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3106/6106] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:37 2022] GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c => generated 1690 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:38.403780 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1dadeced-99a6-453c-8a27-0ce255ca1595 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:38.404546 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1dadeced-99a6-453c-8a27-0ce255ca1595 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:38.411870 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1dadeced-99a6-453c-8a27-0ce255ca1595 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:20:38.412328 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1dadeced-99a6-453c-8a27-0ce255ca1595 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:20:38.413142 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1dadeced-99a6-453c-8a27-0ce255ca1595 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:20:38.413638 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1dadeced-99a6-453c-8a27-0ce255ca1595 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:20:38.579062 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1dadeced-99a6-453c-8a27-0ce255ca1595 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:38.588018 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1dadeced-99a6-453c-8a27-0ce255ca1595 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c" status: 200 len: 1696 microversion: 2.1 time: 0.192478 Aug 04 17:20:38.588610 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3001/6107] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:38 2022] GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c => generated 1696 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:39.613601 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-08f50508-d26f-4bca-9ded-40268bf42e70 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:39.614359 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-08f50508-d26f-4bca-9ded-40268bf42e70 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:39.622417 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-08f50508-d26f-4bca-9ded-40268bf42e70 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:20:39.622870 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-08f50508-d26f-4bca-9ded-40268bf42e70 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:20:39.623709 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-08f50508-d26f-4bca-9ded-40268bf42e70 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:20:39.624081 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-08f50508-d26f-4bca-9ded-40268bf42e70 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:20:39.782860 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-08f50508-d26f-4bca-9ded-40268bf42e70 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:39.793405 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-08f50508-d26f-4bca-9ded-40268bf42e70 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c" status: 200 len: 1696 microversion: 2.1 time: 0.184769 Aug 04 17:20:39.793908 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3107/6108] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:39 2022] GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c => generated 1696 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:40.817771 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c9d54cfa-815c-4f7d-938c-f2fb05ac9957 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:40.818500 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c9d54cfa-815c-4f7d-938c-f2fb05ac9957 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:40.827617 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9d54cfa-815c-4f7d-938c-f2fb05ac9957 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:20:40.828278 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9d54cfa-815c-4f7d-938c-f2fb05ac9957 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:20:40.829312 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9d54cfa-815c-4f7d-938c-f2fb05ac9957 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:20:40.830766 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c9d54cfa-815c-4f7d-938c-f2fb05ac9957 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:20:41.054269 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c9d54cfa-815c-4f7d-938c-f2fb05ac9957 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:41.069590 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c9d54cfa-815c-4f7d-938c-f2fb05ac9957 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c" status: 200 len: 1681 microversion: 2.1 time: 0.256645 Aug 04 17:20:41.069869 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3002/6109] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:40 2022] GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c => generated 1681 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:20:42.544942 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-b24a45af-ba9b-4f44-98d8-fe51d81f0144 req-2b13257d-6b81-4942-bee9-d9f4d1090e1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "265ba8fa-15d2-4a47-9292-ee7511d1e79c", "name": "network-vif-plugged", "status": "completed", "tag": "fbc94cae-3384-4684-8f8a-c028cae6b93c"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:20:42.564960 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-b24a45af-ba9b-4f44-98d8-fe51d81f0144 req-2b13257d-6b81-4942-bee9-d9f4d1090e1b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:20:42.566399 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-b24a45af-ba9b-4f44-98d8-fe51d81f0144 req-2b13257d-6b81-4942-bee9-d9f4d1090e1b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:20:42.591010 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-b24a45af-ba9b-4f44-98d8-fe51d81f0144 req-2b13257d-6b81-4942-bee9-d9f4d1090e1b service nova] Creating event network-vif-plugged:fbc94cae-3384-4684-8f8a-c028cae6b93c for instance 265ba8fa-15d2-4a47-9292-ee7511d1e79c on n-h2-846466-12 Aug 04 17:20:42.602820 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-b24a45af-ba9b-4f44-98d8-fe51d81f0144 req-2b13257d-6b81-4942-bee9-d9f4d1090e1b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060993 Aug 04 17:20:42.604924 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3108/6110] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:21:05.308786 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c8731725-8085-4945-94b1-c766afb2ce8d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:21:05.311144 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c8731725-8085-4945-94b1-c766afb2ce8d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:05.314343 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=16 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:21:05.315564 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=46 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:21:05.325274 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c8731725-8085-4945-94b1-c766afb2ce8d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:21:05.325668 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c8731725-8085-4945-94b1-c766afb2ce8d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:21:05.326449 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c8731725-8085-4945-94b1-c766afb2ce8d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:21:05.326887 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c8731725-8085-4945-94b1-c766afb2ce8d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:21:05.380272 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c8731725-8085-4945-94b1-c766afb2ce8d tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "POST /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c/action" status: 200 len: 24559 microversion: 2.1 time: 0.075219 Aug 04 17:21:05.387294 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3003/6111] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:21:05 2022] POST /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c/action => generated 24559 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:21:12.704796 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-10803a1c-3f91-4b29-be07-a5ec2e014368 req-938cc34c-b06d-4962-b72c-bca655419405 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "265ba8fa-15d2-4a47-9292-ee7511d1e79c", "tag": "fbc94cae-3384-4684-8f8a-c028cae6b93c"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:21:12.707013 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=20 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:21:12.707798 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:21:12.712707 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e33c9582-be3f-49f8-b71f-e122e69ed1c8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:12.713476 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e33c9582-be3f-49f8-b71f-e122e69ed1c8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:12.724451 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e33c9582-be3f-49f8-b71f-e122e69ed1c8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:21:12.725054 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e33c9582-be3f-49f8-b71f-e122e69ed1c8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:21:12.725883 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e33c9582-be3f-49f8-b71f-e122e69ed1c8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:21:12.726321 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e33c9582-be3f-49f8-b71f-e122e69ed1c8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:21:12.728497 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-10803a1c-3f91-4b29-be07-a5ec2e014368 req-938cc34c-b06d-4962-b72c-bca655419405 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:21:12.729150 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-10803a1c-3f91-4b29-be07-a5ec2e014368 req-938cc34c-b06d-4962-b72c-bca655419405 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:21:12.743110 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-10803a1c-3f91-4b29-be07-a5ec2e014368 req-938cc34c-b06d-4962-b72c-bca655419405 service nova] Creating event network-changed:fbc94cae-3384-4684-8f8a-c028cae6b93c for instance 265ba8fa-15d2-4a47-9292-ee7511d1e79c on n-h2-846466-12 Aug 04 17:21:12.749752 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-10803a1c-3f91-4b29-be07-a5ec2e014368 req-938cc34c-b06d-4962-b72c-bca655419405 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049508 Aug 04 17:21:12.750937 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3004/6112] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:21:12.757908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e33c9582-be3f-49f8-b71f-e122e69ed1c8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:21:12.858444 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e33c9582-be3f-49f8-b71f-e122e69ed1c8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "DELETE /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c" status: 204 len: 0 microversion: 2.1 time: 0.155829 Aug 04 17:21:12.863454 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3109/6113] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:21:12 2022] DELETE /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:21:12.869274 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3fc21f5b-d80c-42e9-9e30-00346fd52fbe tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:12.871097 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3fc21f5b-d80c-42e9-9e30-00346fd52fbe tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:12.898043 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3fc21f5b-d80c-42e9-9e30-00346fd52fbe tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:21:12.898879 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3fc21f5b-d80c-42e9-9e30-00346fd52fbe tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:21:12.900380 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3fc21f5b-d80c-42e9-9e30-00346fd52fbe tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:21:12.901462 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3fc21f5b-d80c-42e9-9e30-00346fd52fbe tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:21:13.102025 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3fc21f5b-d80c-42e9-9e30-00346fd52fbe tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:13.113353 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3fc21f5b-d80c-42e9-9e30-00346fd52fbe tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c" status: 200 len: 1687 microversion: 2.1 time: 0.248171 Aug 04 17:21:13.126987 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3005/6114] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:21:12 2022] GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c => generated 1687 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:21:14.310487 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cebfafe8-ffdd-49d4-b45e-f810a53e2cd2 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:14.311849 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cebfafe8-ffdd-49d4-b45e-f810a53e2cd2 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:14.320773 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cebfafe8-ffdd-49d4-b45e-f810a53e2cd2 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:21:14.321362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cebfafe8-ffdd-49d4-b45e-f810a53e2cd2 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:21:14.323649 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cebfafe8-ffdd-49d4-b45e-f810a53e2cd2 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:21:14.324448 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cebfafe8-ffdd-49d4-b45e-f810a53e2cd2 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:21:14.530481 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cebfafe8-ffdd-49d4-b45e-f810a53e2cd2 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c6be7b0d164da98f08be0c35f843a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a080cbeb5c3a435a880e48ea64dbea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:14.540334 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cebfafe8-ffdd-49d4-b45e-f810a53e2cd2 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c" status: 200 len: 1687 microversion: 2.1 time: 0.234399 Aug 04 17:21:14.540974 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3110/6115] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:21:14 2022] GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c => generated 1687 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:21:15.040151 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-335e6dee-dac3-4826-a6c5-40a72d5b00c8 req-d3a977b8-bb42-4b8d-b529-56f88f2eaf4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "265ba8fa-15d2-4a47-9292-ee7511d1e79c", "name": "network-vif-deleted", "tag": "fbc94cae-3384-4684-8f8a-c028cae6b93c"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:21:15.053083 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-335e6dee-dac3-4826-a6c5-40a72d5b00c8 req-d3a977b8-bb42-4b8d-b529-56f88f2eaf4a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:21:15.053083 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-335e6dee-dac3-4826-a6c5-40a72d5b00c8 req-d3a977b8-bb42-4b8d-b529-56f88f2eaf4a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:21:15.067288 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-335e6dee-dac3-4826-a6c5-40a72d5b00c8 req-d3a977b8-bb42-4b8d-b529-56f88f2eaf4a service nova] Creating event network-vif-deleted:fbc94cae-3384-4684-8f8a-c028cae6b93c for instance 265ba8fa-15d2-4a47-9292-ee7511d1e79c on n-h2-846466-12 Aug 04 17:21:15.072765 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-335e6dee-dac3-4826-a6c5-40a72d5b00c8 req-d3a977b8-bb42-4b8d-b529-56f88f2eaf4a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036791 Aug 04 17:21:15.073554 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3006/6116] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:21:15.564175 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5b934efe-4c27-415a-8980-c254fe78b0f8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:15.565070 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5b934efe-4c27-415a-8980-c254fe78b0f8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] [instance: 265ba8fa-15d2-4a47-9292-ee7511d1e79c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:15.573212 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5b934efe-4c27-415a-8980-c254fe78b0f8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:21:15.573641 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5b934efe-4c27-415a-8980-c254fe78b0f8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:21:15.574424 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5b934efe-4c27-415a-8980-c254fe78b0f8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:21:15.574857 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5b934efe-4c27-415a-8980-c254fe78b0f8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:21:15.598536 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-5b934efe-4c27-415a-8980-c254fe78b0f8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] HTTP exception thrown: Instance 265ba8fa-15d2-4a47-9292-ee7511d1e79c could not be found. Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5b934efe-4c27-415a-8980-c254fe78b0f8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Request method failure captured: Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c HTTP/1.1 Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi6_4YOThE04EgY2ZC-6Z4P4BLZorNPrwNYsXnudJ3q-g4O8Bpo6oQ4TtL_No6KcEehCahXC1c1rl575Jd3mS3Ei78aQ8uVNhdiDOypdyIumzQRzdLDSRFfSIpFDGraNFEgTS8aTaqqN8uid7ehZJahj9lTM6cYwjw3-kHQng3DwqKDNs Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: a080cbeb5c3a435a880e48ea64dbea70 Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1931304919 Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a080cbeb5c3a435a880e48ea64dbea70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a080cbeb5c3a435a880e48ea64dbea70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a080cbeb5c3a435a880e48ea64dbea70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a080cbeb5c3a435a880e48ea64dbea70"}]}] Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1931304919 Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: a080cbeb5c3a435a880e48ea64dbea70 Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1931304919 Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-TestNetworkAdvancedServerOps-1931304919-project Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: e4c6be7b0d164da98f08be0c35f843a2 Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1931304919-project Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 265ba8fa-15d2-4a47-9292-ee7511d1e79c could not be found. Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '265ba8fa-15d2-4a47-9292-ee7511d1e79c'} Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 265ba8fa-15d2-4a47-9292-ee7511d1e79c could not be found. Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 265ba8fa-15d2-4a47-9292-ee7511d1e79c could not be found. Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:21:15.601884 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:21:15.606888 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:21:15.606888 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:21:15.606888 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:21:15.606888 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:21:15.606888 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:21:15.606888 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:21:15.606888 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 265ba8fa-15d2-4a47-9292-ee7511d1e79c could not be found. Aug 04 17:21:15.606888 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:21:15.606888 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5b934efe-4c27-415a-8980-c254fe78b0f8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Returning 404 to user: Instance 265ba8fa-15d2-4a47-9292-ee7511d1e79c could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:21:15.606888 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5b934efe-4c27-415a-8980-c254fe78b0f8 tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c" status: 404 len: 111 microversion: 2.1 time: 0.045086 Aug 04 17:21:15.606888 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3111/6117] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:21:15 2022] GET /compute/v2.1/servers/265ba8fa-15d2-4a47-9292-ee7511d1e79c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:21:19.229828 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-63ecee5f-8a53-429d-84e7-e80e5c1040be tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] Calling method '.version_select at 0x7f7e847ed160>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:19.270894 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-63ecee5f-8a53-429d-84e7-e80e5c1040be tempest-TestNetworkAdvancedServerOps-1931304919 tempest-TestNetworkAdvancedServerOps-1931304919-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-286565168" status: 202 len: 0 microversion: 2.1 time: 0.045994 Aug 04 17:21:19.271526 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3007/6118] 10.222.0.23 () {58 vars in 1281 bytes} [Thu Aug 4 17:21:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-286565168 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:22:16.545719 n-d-846466-12 devstack@n-api.service[126126]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:22:16.546784 n-d-846466-12 devstack@n-api.service[126126]: Thu Aug 4 17:22:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 17:23:49.613364 n-d-846466-12 devstack@n-api.service[126125]: ERROR oslo.messaging._drivers.impl_rabbit [-] [97b8321f-6d0d-4fc2-ae68-3784c532bfbe] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 17:23:49.614882 n-d-846466-12 devstack@n-api.service[126125]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c495d468-47e4-4499-8c55-19f21dc1fcfb] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 17:23:49.616118 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:23:49.617271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:23:49.777218 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-63bc348d-c0d0-41d5-8661-90c6a76757a8 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-135808534", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:23:50.015008 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-63bc348d-c0d0-41d5-8661-90c6a76757a8 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] validate_networks() for None {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:23:50.298902 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-63bc348d-c0d0-41d5-8661-90c6a76757a8 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:23:50.299320 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-63bc348d-c0d0-41d5-8661-90c6a76757a8 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:23:50.300002 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-63bc348d-c0d0-41d5-8661-90c6a76757a8 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:23:50.300479 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-63bc348d-c0d0-41d5-8661-90c6a76757a8 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:23:50.300952 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-63bc348d-c0d0-41d5-8661-90c6a76757a8 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:23:50.311271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-63bc348d-c0d0-41d5-8661-90c6a76757a8 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:23:50.311874 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-63bc348d-c0d0-41d5-8661-90c6a76757a8 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:23:50.312718 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-63bc348d-c0d0-41d5-8661-90c6a76757a8 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:23:50.313187 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-63bc348d-c0d0-41d5-8661-90c6a76757a8 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:23:50.331762 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-63bc348d-c0d0-41d5-8661-90c6a76757a8 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Getting quotas for project 4707e7d51b9348fa9f7a64b11d3bf1f8. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:23:50.338227 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-63bc348d-c0d0-41d5-8661-90c6a76757a8 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Getting quotas for user 2ed81b73e145498f9ef4feb0d95caf83 and project 4707e7d51b9348fa9f7a64b11d3bf1f8. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:23:50.352877 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-63bc348d-c0d0-41d5-8661-90c6a76757a8 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:23:50.355228 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-63bc348d-c0d0-41d5-8661-90c6a76757a8 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] [instance: 390c9068-383b-4714-9e4c-9315acffcddc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:23:50.400359 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-63bc348d-c0d0-41d5-8661-90c6a76757a8 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.789997 Aug 04 17:23:50.401015 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3112/6119] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:23:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:23:50.411279 n-d-846466-12 devstack@n-api.service[126126]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a8e78df9-6788-4147-abd6-cf6b1b6d2122] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 17:23:50.412782 n-d-846466-12 devstack@n-api.service[126126]: ERROR oslo.messaging._drivers.impl_rabbit [-] [37914f2f-7143-4f4b-83fb-439e96d93d23] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 17:23:50.413157 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=14 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:23:50.414107 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:23:50.418857 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-364f9628-9875-4cba-b3f8-9847afcbed03 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:23:50.419606 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-364f9628-9875-4cba-b3f8-9847afcbed03 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] [instance: 390c9068-383b-4714-9e4c-9315acffcddc] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:23:50.604259 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-364f9628-9875-4cba-b3f8-9847afcbed03 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed81b73e145498f9ef4feb0d95caf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4707e7d51b9348fa9f7a64b11d3bf1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:23:50.612783 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-364f9628-9875-4cba-b3f8-9847afcbed03 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] 10.222.0.23 "GET /compute/v2.1/servers/390c9068-383b-4714-9e4c-9315acffcddc" status: 200 len: 1221 microversion: 2.1 time: 0.203275 Aug 04 17:23:50.613884 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3008/6120] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:23:50 2022] GET /compute/v2.1/servers/390c9068-383b-4714-9e4c-9315acffcddc => generated 1221 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:23:51.636939 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d1cd073e-b076-44ec-9fa0-bf526076e737 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:23:51.637654 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d1cd073e-b076-44ec-9fa0-bf526076e737 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] [instance: 390c9068-383b-4714-9e4c-9315acffcddc] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:23:51.647642 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d1cd073e-b076-44ec-9fa0-bf526076e737 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:23:51.648107 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d1cd073e-b076-44ec-9fa0-bf526076e737 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:23:51.648974 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d1cd073e-b076-44ec-9fa0-bf526076e737 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:23:51.649441 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d1cd073e-b076-44ec-9fa0-bf526076e737 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:23:51.653649 n-d-846466-12 devstack@n-api.service[126125]: INFO oslo.messaging._drivers.impl_rabbit [-] [97b8321f-6d0d-4fc2-ae68-3784c532bfbe] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 35016. Aug 04 17:23:51.657123 n-d-846466-12 devstack@n-api.service[126125]: INFO oslo.messaging._drivers.impl_rabbit [-] [c495d468-47e4-4499-8c55-19f21dc1fcfb] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 35018. Aug 04 17:23:51.738293 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d1cd073e-b076-44ec-9fa0-bf526076e737 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed81b73e145498f9ef4feb0d95caf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4707e7d51b9348fa9f7a64b11d3bf1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:23:51.747006 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d1cd073e-b076-44ec-9fa0-bf526076e737 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] 10.222.0.23 "GET /compute/v2.1/servers/390c9068-383b-4714-9e4c-9315acffcddc" status: 200 len: 1281 microversion: 2.1 time: 0.115470 Aug 04 17:23:51.747825 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3113/6121] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:23:51 2022] GET /compute/v2.1/servers/390c9068-383b-4714-9e4c-9315acffcddc => generated 1281 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:23:52.770789 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-698a534a-ed00-48c5-a5c7-37192e5c7a71 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:23:52.772117 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-698a534a-ed00-48c5-a5c7-37192e5c7a71 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] [instance: 390c9068-383b-4714-9e4c-9315acffcddc] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:23:52.782681 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-698a534a-ed00-48c5-a5c7-37192e5c7a71 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:23:52.783139 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-698a534a-ed00-48c5-a5c7-37192e5c7a71 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:23:52.783910 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-698a534a-ed00-48c5-a5c7-37192e5c7a71 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:23:52.784347 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-698a534a-ed00-48c5-a5c7-37192e5c7a71 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:23:52.791492 n-d-846466-12 devstack@n-api.service[126126]: INFO oslo.messaging._drivers.impl_rabbit [-] [37914f2f-7143-4f4b-83fb-439e96d93d23] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 35024. Aug 04 17:23:52.806362 n-d-846466-12 devstack@n-api.service[126126]: INFO oslo.messaging._drivers.impl_rabbit [-] [a8e78df9-6788-4147-abd6-cf6b1b6d2122] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 35022. Aug 04 17:23:53.027196 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-698a534a-ed00-48c5-a5c7-37192e5c7a71 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed81b73e145498f9ef4feb0d95caf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4707e7d51b9348fa9f7a64b11d3bf1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:23:53.038394 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-698a534a-ed00-48c5-a5c7-37192e5c7a71 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] 10.222.0.23 "GET /compute/v2.1/servers/390c9068-383b-4714-9e4c-9315acffcddc" status: 200 len: 1321 microversion: 2.1 time: 0.271999 Aug 04 17:23:53.039011 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3009/6122] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:23:52 2022] GET /compute/v2.1/servers/390c9068-383b-4714-9e4c-9315acffcddc => generated 1321 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:23:53.791202 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-f64efb11-c251-47ea-bddf-dfa2aab793c7 req-95d45070-b3ac-48ff-b7c8-4e6e5c176ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "390c9068-383b-4714-9e4c-9315acffcddc", "tag": "299d1692-2db4-4b03-97d9-37880773a06f"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:23:53.802125 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-f64efb11-c251-47ea-bddf-dfa2aab793c7 req-95d45070-b3ac-48ff-b7c8-4e6e5c176ea1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:23:53.802560 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-f64efb11-c251-47ea-bddf-dfa2aab793c7 req-95d45070-b3ac-48ff-b7c8-4e6e5c176ea1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:23:53.814584 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-f64efb11-c251-47ea-bddf-dfa2aab793c7 req-95d45070-b3ac-48ff-b7c8-4e6e5c176ea1 service nova] Creating event network-changed:299d1692-2db4-4b03-97d9-37880773a06f for instance 390c9068-383b-4714-9e4c-9315acffcddc on n-h1-846466-12 Aug 04 17:23:53.818198 n-d-846466-12 devstack@n-api.service[126125]: ERROR oslo.messaging._drivers.impl_rabbit [req-f64efb11-c251-47ea-bddf-dfa2aab793c7 req-95d45070-b3ac-48ff-b7c8-4e6e5c176ea1 service nova] [d49ad9fb-543a-4aa2-afde-68418c892368] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 17:23:54.060053 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7fd5e0f8-d795-4e78-ae0c-c2d1745cb0aa tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:23:54.060701 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7fd5e0f8-d795-4e78-ae0c-c2d1745cb0aa tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] [instance: 390c9068-383b-4714-9e4c-9315acffcddc] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:23:54.067934 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7fd5e0f8-d795-4e78-ae0c-c2d1745cb0aa tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:23:54.068374 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7fd5e0f8-d795-4e78-ae0c-c2d1745cb0aa tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:23:54.069145 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7fd5e0f8-d795-4e78-ae0c-c2d1745cb0aa tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:23:54.069614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7fd5e0f8-d795-4e78-ae0c-c2d1745cb0aa tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:23:54.238884 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7fd5e0f8-d795-4e78-ae0c-c2d1745cb0aa tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed81b73e145498f9ef4feb0d95caf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4707e7d51b9348fa9f7a64b11d3bf1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:23:54.246978 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7fd5e0f8-d795-4e78-ae0c-c2d1745cb0aa tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] 10.222.0.23 "GET /compute/v2.1/servers/390c9068-383b-4714-9e4c-9315acffcddc" status: 200 len: 1321 microversion: 2.1 time: 0.190896 Aug 04 17:23:54.248543 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3010/6123] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:23:54 2022] GET /compute/v2.1/servers/390c9068-383b-4714-9e4c-9315acffcddc => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:23:54.828119 n-d-846466-12 devstack@n-api.service[126125]: INFO oslo.messaging._drivers.impl_rabbit [req-f64efb11-c251-47ea-bddf-dfa2aab793c7 req-95d45070-b3ac-48ff-b7c8-4e6e5c176ea1 service nova] [d49ad9fb-543a-4aa2-afde-68418c892368] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 35034. Aug 04 17:23:54.831962 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-f64efb11-c251-47ea-bddf-dfa2aab793c7 req-95d45070-b3ac-48ff-b7c8-4e6e5c176ea1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.125617 Aug 04 17:23:54.832568 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3114/6124] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:23:55.269898 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-40d493fc-c465-4265-9d8a-06316c32ef8c tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:23:55.270520 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-40d493fc-c465-4265-9d8a-06316c32ef8c tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] [instance: 390c9068-383b-4714-9e4c-9315acffcddc] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:23:55.277663 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-40d493fc-c465-4265-9d8a-06316c32ef8c tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:23:55.278157 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-40d493fc-c465-4265-9d8a-06316c32ef8c tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:23:55.279019 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-40d493fc-c465-4265-9d8a-06316c32ef8c tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:23:55.279513 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-40d493fc-c465-4265-9d8a-06316c32ef8c tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:23:55.422078 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-40d493fc-c465-4265-9d8a-06316c32ef8c tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed81b73e145498f9ef4feb0d95caf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4707e7d51b9348fa9f7a64b11d3bf1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:23:55.433708 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-40d493fc-c465-4265-9d8a-06316c32ef8c tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] 10.222.0.23 "GET /compute/v2.1/servers/390c9068-383b-4714-9e4c-9315acffcddc" status: 200 len: 1321 microversion: 2.1 time: 0.167895 Aug 04 17:23:55.434569 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3011/6125] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:23:55 2022] GET /compute/v2.1/servers/390c9068-383b-4714-9e4c-9315acffcddc => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:23:56.463478 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5a852f19-1642-4879-8599-243de650bcd3 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:23:56.464194 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5a852f19-1642-4879-8599-243de650bcd3 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] [instance: 390c9068-383b-4714-9e4c-9315acffcddc] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:23:56.475946 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5a852f19-1642-4879-8599-243de650bcd3 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:23:56.476526 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5a852f19-1642-4879-8599-243de650bcd3 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:23:56.477262 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5a852f19-1642-4879-8599-243de650bcd3 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:23:56.477730 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5a852f19-1642-4879-8599-243de650bcd3 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:23:56.509632 n-d-846466-12 devstack@n-api.service[126126]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:23:56.510249 n-d-846466-12 devstack@n-api.service[126126]: Thu Aug 4 17:23:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 17:23:56.629262 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5a852f19-1642-4879-8599-243de650bcd3 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed81b73e145498f9ef4feb0d95caf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4707e7d51b9348fa9f7a64b11d3bf1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:23:56.637621 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5a852f19-1642-4879-8599-243de650bcd3 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] 10.222.0.23 "GET /compute/v2.1/servers/390c9068-383b-4714-9e4c-9315acffcddc" status: 200 len: 1321 microversion: 2.1 time: 0.180551 Aug 04 17:23:56.638416 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3115/6126] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:23:56 2022] GET /compute/v2.1/servers/390c9068-383b-4714-9e4c-9315acffcddc => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:23:57.661902 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-44277df0-53e3-40ca-a4f4-0c736ac0c2de tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:23:57.662526 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-44277df0-53e3-40ca-a4f4-0c736ac0c2de tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] [instance: 390c9068-383b-4714-9e4c-9315acffcddc] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:23:57.671693 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-44277df0-53e3-40ca-a4f4-0c736ac0c2de tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:23:57.672164 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-44277df0-53e3-40ca-a4f4-0c736ac0c2de tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:23:57.672933 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-44277df0-53e3-40ca-a4f4-0c736ac0c2de tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:23:57.673406 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-44277df0-53e3-40ca-a4f4-0c736ac0c2de tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:23:57.815995 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-44277df0-53e3-40ca-a4f4-0c736ac0c2de tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed81b73e145498f9ef4feb0d95caf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4707e7d51b9348fa9f7a64b11d3bf1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:23:57.827057 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-44277df0-53e3-40ca-a4f4-0c736ac0c2de tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] 10.222.0.23 "GET /compute/v2.1/servers/390c9068-383b-4714-9e4c-9315acffcddc" status: 200 len: 1321 microversion: 2.1 time: 0.170900 Aug 04 17:23:57.827636 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3012/6127] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:23:57 2022] GET /compute/v2.1/servers/390c9068-383b-4714-9e4c-9315acffcddc => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:23:58.234606 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-cdf18715-749d-4d7a-b537-328a1ed878ab req-1a2c14cb-ba6e-4f0e-b082-5f99c5b51fbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "390c9068-383b-4714-9e4c-9315acffcddc", "name": "network-vif-plugged", "status": "completed", "tag": "299d1692-2db4-4b03-97d9-37880773a06f"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:23:58.246229 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-cdf18715-749d-4d7a-b537-328a1ed878ab req-1a2c14cb-ba6e-4f0e-b082-5f99c5b51fbc service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:23:58.247008 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-cdf18715-749d-4d7a-b537-328a1ed878ab req-1a2c14cb-ba6e-4f0e-b082-5f99c5b51fbc service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:23:58.261172 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-cdf18715-749d-4d7a-b537-328a1ed878ab req-1a2c14cb-ba6e-4f0e-b082-5f99c5b51fbc service nova] Creating event network-vif-plugged:299d1692-2db4-4b03-97d9-37880773a06f for instance 390c9068-383b-4714-9e4c-9315acffcddc on n-h1-846466-12 Aug 04 17:23:58.268552 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-cdf18715-749d-4d7a-b537-328a1ed878ab req-1a2c14cb-ba6e-4f0e-b082-5f99c5b51fbc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108769 Aug 04 17:23:58.270306 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3116/6128] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:23:58.851633 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6f70fc9a-0727-4e92-bb8e-744de2dccc1d tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:23:58.852466 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6f70fc9a-0727-4e92-bb8e-744de2dccc1d tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] [instance: 390c9068-383b-4714-9e4c-9315acffcddc] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:23:58.863659 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6f70fc9a-0727-4e92-bb8e-744de2dccc1d tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:23:58.864288 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6f70fc9a-0727-4e92-bb8e-744de2dccc1d tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:23:58.865455 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6f70fc9a-0727-4e92-bb8e-744de2dccc1d tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:23:58.866016 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6f70fc9a-0727-4e92-bb8e-744de2dccc1d tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:23:59.004725 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6f70fc9a-0727-4e92-bb8e-744de2dccc1d tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed81b73e145498f9ef4feb0d95caf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4707e7d51b9348fa9f7a64b11d3bf1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:23:59.012713 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6f70fc9a-0727-4e92-bb8e-744de2dccc1d tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] 10.222.0.23 "GET /compute/v2.1/servers/390c9068-383b-4714-9e4c-9315acffcddc" status: 200 len: 1321 microversion: 2.1 time: 0.167623 Aug 04 17:23:59.013804 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3013/6129] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:23:58 2022] GET /compute/v2.1/servers/390c9068-383b-4714-9e4c-9315acffcddc => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:00.035978 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bcaae12e-cb55-44ac-99bc-5981373156e1 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:00.036719 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bcaae12e-cb55-44ac-99bc-5981373156e1 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] [instance: 390c9068-383b-4714-9e4c-9315acffcddc] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:00.044815 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bcaae12e-cb55-44ac-99bc-5981373156e1 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:00.045263 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bcaae12e-cb55-44ac-99bc-5981373156e1 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:00.046090 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bcaae12e-cb55-44ac-99bc-5981373156e1 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:00.046507 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bcaae12e-cb55-44ac-99bc-5981373156e1 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:00.195271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bcaae12e-cb55-44ac-99bc-5981373156e1 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed81b73e145498f9ef4feb0d95caf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4707e7d51b9348fa9f7a64b11d3bf1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:00.207672 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bcaae12e-cb55-44ac-99bc-5981373156e1 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] 10.222.0.23 "GET /compute/v2.1/servers/390c9068-383b-4714-9e4c-9315acffcddc" status: 200 len: 1470 microversion: 2.1 time: 0.176400 Aug 04 17:24:00.208232 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3117/6130] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:00 2022] GET /compute/v2.1/servers/390c9068-383b-4714-9e4c-9315acffcddc => generated 1470 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:00.299004 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9a9bc249-ab38-4a27-a225-87af2ae47f70 tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Calling method '.version_select at 0x7f7e77ec73a0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:00.377039 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9a9bc249-ab38-4a27-a225-87af2ae47f70 tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/5cd0adb8936a4d6badfd9668d1587c74" status: 200 len: 371 microversion: 2.1 time: 0.149548 Aug 04 17:24:00.377670 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3014/6131] 10.222.0.23 () {58 vars in 1242 bytes} [Thu Aug 4 17:24:00 2022] GET /compute/v2.1/os-quota-sets/5cd0adb8936a4d6badfd9668d1587c74 => generated 371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:24:00.389866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0937427c-ecb9-4f82-931b-02550d456ee8 tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-6485409", "id": 1540862284, "os-flavor-access:is_public": "True"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:24:00.393002 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:24:00.393002 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 17:24:00.396395 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:24:00.397063 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:24:00.413450 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0937427c-ecb9-4f82-931b-02550d456ee8 tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.027149 Aug 04 17:24:00.414959 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3118/6132] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:24:00 2022] POST /compute/v2.1/flavors => generated 435 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:24:00.426846 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0957490f-991a-44e3-9391-f1a09abd8b36 tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1540862284"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:24:00.429138 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0957490f-991a-44e3-9391-f1a09abd8b36 tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] [instance: 390c9068-383b-4714-9e4c-9315acffcddc] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:00.436865 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0957490f-991a-44e3-9391-f1a09abd8b36 tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:00.437349 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0957490f-991a-44e3-9391-f1a09abd8b36 tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:00.438136 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0957490f-991a-44e3-9391-f1a09abd8b36 tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:00.438574 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0957490f-991a-44e3-9391-f1a09abd8b36 tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:00.594335 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0957490f-991a-44e3-9391-f1a09abd8b36 tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0fdd990fbca14860906f32c6a5426f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd0adb8936a4d6badfd9668d1587c74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:00.601716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0957490f-991a-44e3-9391-f1a09abd8b36 tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] [instance: 390c9068-383b-4714-9e4c-9315acffcddc] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-6485409 {{(pid=126126) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 17:24:00.608759 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0957490f-991a-44e3-9391-f1a09abd8b36 tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:00.609242 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0957490f-991a-44e3-9391-f1a09abd8b36 tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:00.610155 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0957490f-991a-44e3-9391-f1a09abd8b36 tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:00.610602 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0957490f-991a-44e3-9391-f1a09abd8b36 tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:00.631694 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-0957490f-991a-44e3-9391-f1a09abd8b36 tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Getting quotas for project 4707e7d51b9348fa9f7a64b11d3bf1f8. Resources: {'ram', 'cores'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:24:00.636760 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-0957490f-991a-44e3-9391-f1a09abd8b36 tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Getting quotas for user 2ed81b73e145498f9ef4feb0d95caf83 and project 4707e7d51b9348fa9f7a64b11d3bf1f8. Resources: {'ram', 'cores'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:24:00.650442 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.compute.api [None req-0957490f-991a-44e3-9391-f1a09abd8b36 tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] ram quota exceeded for 5cd0adb8936a4d6badfd9668d1587c74, tried to resize instance. Aug 04 17:24:00.650986 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-0957490f-991a-44e3-9391-f1a09abd8b36 tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0957490f-991a-44e3-9391-f1a09abd8b36 tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Request method failure captured: Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers/390c9068-383b-4714-9e4c-9315acffcddc/action HTTP/1.1 Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 39 Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi7ACl2FXLQizrPpyG1TrCxhfpd5wGtOEAqk7tmEN_THEqBJHqU8lQZgaIu_4XEpLzZJBGrteNMIGSKDZKUNHbVvtdqAyUDXoeeBi2AL0qssjgRhyRFiHAH4rFWoyS0OoSEQyB5Pz-KSD4NotsOHbYEw2JuCTvw8rfV4T3zRFdWaUAMq8 Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 5cd0adb8936a4d6badfd9668d1587c74 Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-281111821 Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader,admin Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader,admin Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5cd0adb8936a4d6badfd9668d1587c74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5cd0adb8936a4d6badfd9668d1587c74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5cd0adb8936a4d6badfd9668d1587c74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5cd0adb8936a4d6badfd9668d1587c74"}]}] Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersAdminNegativeTestJSON-281111821 Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 5cd0adb8936a4d6badfd9668d1587c74 Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-281111821 Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersAdminNegativeTestJSON-281111821-project-admin Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 0fdd990fbca14860906f32c6a5426f63 Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersAdminNegativeTestJSON-281111821-project-admin Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: {"resize": {"flavorRef": "1540862284"}} Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '390c9068-383b-4714-9e4c-9315acffcddc', 'body': {'resize': {'flavorRef': '1540862284'}}} Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3823, in _check_quota_for_upsize Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:24:00.658617 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4192, in resize Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3841, in _check_quota_for_upsize Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0957490f-991a-44e3-9391-f1a09abd8b36 tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0957490f-991a-44e3-9391-f1a09abd8b36 tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/390c9068-383b-4714-9e4c-9315acffcddc/action" status: 403 len: 118 microversion: 2.1 time: 0.237447 Aug 04 17:24:00.664731 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3015/6133] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:24:00 2022] POST /compute/v2.1/servers/390c9068-383b-4714-9e4c-9315acffcddc/action => generated 118 bytes in 239 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:24:00.669362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c01305bd-2898-4937-9852-274b218efe89 tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:00.670196 n-d-846466-12 devstack@n-api.service[126125]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:24:00.670196 n-d-846466-12 devstack@n-api.service[126125]: warnings.warn(msg) Aug 04 17:24:00.690318 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c01305bd-2898-4937-9852-274b218efe89 tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1540862284" status: 202 len: 0 microversion: 2.1 time: 0.024770 Aug 04 17:24:00.690905 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3119/6134] 10.222.0.23 () {58 vars in 1161 bytes} [Thu Aug 4 17:24:00 2022] DELETE /compute/v2.1/flavors/1540862284 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:24:00.702156 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f2c8d6e6-a51f-424f-836a-3887325dd4f3 tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:00.722790 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f2c8d6e6-a51f-424f-836a-3887325dd4f3 tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025946 Aug 04 17:24:00.723367 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3016/6135] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 17:24:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:00.743241 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ff2e2af5-0945-462c-bcdd-70af6f6c8f3a tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Calling method '.version_select at 0x7f7e84d5c4c0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:00.825057 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ff2e2af5-0945-462c-bcdd-70af6f6c8f3a tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/5cd0adb8936a4d6badfd9668d1587c74" status: 200 len: 371 microversion: 2.1 time: 0.085546 Aug 04 17:24:00.825781 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3120/6136] 10.222.0.23 () {58 vars in 1242 bytes} [Thu Aug 4 17:24:00 2022] GET /compute/v2.1/os-quota-sets/5cd0adb8936a4d6badfd9668d1587c74 => generated 371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:24:00.842790 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4014d69d-60f8-4b31-843c-adf7b3315859 tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1824095717", "id": 1856338237, "os-flavor-access:is_public": "True"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:24:00.847405 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:24:00.847405 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 17:24:00.867889 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4014d69d-60f8-4b31-843c-adf7b3315859 tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.031064 Aug 04 17:24:00.868492 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3017/6137] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:24:00 2022] POST /compute/v2.1/flavors => generated 437 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:24:00.881102 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1265056f-7352-4e86-91b6-78a9cc21545f tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1856338237"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:24:00.883436 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1265056f-7352-4e86-91b6-78a9cc21545f tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] [instance: 390c9068-383b-4714-9e4c-9315acffcddc] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:00.890945 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1265056f-7352-4e86-91b6-78a9cc21545f tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:00.891425 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1265056f-7352-4e86-91b6-78a9cc21545f tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:00.892249 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1265056f-7352-4e86-91b6-78a9cc21545f tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:00.892679 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1265056f-7352-4e86-91b6-78a9cc21545f tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:01.045757 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1265056f-7352-4e86-91b6-78a9cc21545f tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0fdd990fbca14860906f32c6a5426f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd0adb8936a4d6badfd9668d1587c74', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:01.052512 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1265056f-7352-4e86-91b6-78a9cc21545f tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] [instance: 390c9068-383b-4714-9e4c-9315acffcddc] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1824095717 {{(pid=126125) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 17:24:01.059400 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1265056f-7352-4e86-91b6-78a9cc21545f tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:01.060121 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1265056f-7352-4e86-91b6-78a9cc21545f tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:01.060749 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1265056f-7352-4e86-91b6-78a9cc21545f tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:01.061162 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1265056f-7352-4e86-91b6-78a9cc21545f tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:01.085066 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-1265056f-7352-4e86-91b6-78a9cc21545f tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Getting quotas for project 4707e7d51b9348fa9f7a64b11d3bf1f8. Resources: {'ram', 'cores'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:24:01.090371 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-1265056f-7352-4e86-91b6-78a9cc21545f tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Getting quotas for user 2ed81b73e145498f9ef4feb0d95caf83 and project 4707e7d51b9348fa9f7a64b11d3bf1f8. Resources: {'ram', 'cores'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:24:01.108645 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.compute.api [None req-1265056f-7352-4e86-91b6-78a9cc21545f tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] cores quota exceeded for 5cd0adb8936a4d6badfd9668d1587c74, tried to resize instance. Aug 04 17:24:01.109184 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-1265056f-7352-4e86-91b6-78a9cc21545f tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1265056f-7352-4e86-91b6-78a9cc21545f tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Request method failure captured: Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers/390c9068-383b-4714-9e4c-9315acffcddc/action HTTP/1.1 Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 39 Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi7ACl2FXLQizrPpyG1TrCxhfpd5wGtOEAqk7tmEN_THEqBJHqU8lQZgaIu_4XEpLzZJBGrteNMIGSKDZKUNHbVvtdqAyUDXoeeBi2AL0qssjgRhyRFiHAH4rFWoyS0OoSEQyB5Pz-KSD4NotsOHbYEw2JuCTvw8rfV4T3zRFdWaUAMq8 Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 5cd0adb8936a4d6badfd9668d1587c74 Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-281111821 Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader,admin Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader,admin Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5cd0adb8936a4d6badfd9668d1587c74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5cd0adb8936a4d6badfd9668d1587c74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5cd0adb8936a4d6badfd9668d1587c74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5cd0adb8936a4d6badfd9668d1587c74"}]}] Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersAdminNegativeTestJSON-281111821 Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 5cd0adb8936a4d6badfd9668d1587c74 Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-281111821 Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersAdminNegativeTestJSON-281111821-project-admin Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 0fdd990fbca14860906f32c6a5426f63 Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersAdminNegativeTestJSON-281111821-project-admin Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: {"resize": {"flavorRef": "1856338237"}} Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '390c9068-383b-4714-9e4c-9315acffcddc', 'body': {'resize': {'flavorRef': '1856338237'}}} Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3823, in _check_quota_for_upsize Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:24:01.111329 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4192, in resize Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3841, in _check_quota_for_upsize Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1265056f-7352-4e86-91b6-78a9cc21545f tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1265056f-7352-4e86-91b6-78a9cc21545f tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/390c9068-383b-4714-9e4c-9315acffcddc/action" status: 403 len: 113 microversion: 2.1 time: 0.236070 Aug 04 17:24:01.116659 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3121/6138] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:24:00 2022] POST /compute/v2.1/servers/390c9068-383b-4714-9e4c-9315acffcddc/action => generated 113 bytes in 237 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:24:01.121858 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8f94ad7e-5521-461f-8798-a8765d945697 tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:01.123124 n-d-846466-12 devstack@n-api.service[126126]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:24:01.123124 n-d-846466-12 devstack@n-api.service[126126]: warnings.warn(msg) Aug 04 17:24:01.144390 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8f94ad7e-5521-461f-8798-a8765d945697 tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1856338237" status: 202 len: 0 microversion: 2.1 time: 0.026145 Aug 04 17:24:01.144992 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3018/6139] 10.222.0.23 () {58 vars in 1161 bytes} [Thu Aug 4 17:24:01 2022] DELETE /compute/v2.1/flavors/1856338237 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:24:01.153920 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0a4e1ecb-fe0d-441a-a0fb-183300cb1c0c tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:01.174848 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0a4e1ecb-fe0d-441a-a0fb-183300cb1c0c tempest-ServersAdminNegativeTestJSON-281111821 tempest-ServersAdminNegativeTestJSON-281111821-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025074 Aug 04 17:24:01.175454 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3122/6140] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Aug 4 17:24:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:24:01.196834 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-82e20c4f-0560-4df3-a8be-6345444b10f1 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:01.197382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-82e20c4f-0560-4df3-a8be-6345444b10f1 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] [instance: 390c9068-383b-4714-9e4c-9315acffcddc] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:01.203823 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-82e20c4f-0560-4df3-a8be-6345444b10f1 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:01.204273 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-82e20c4f-0560-4df3-a8be-6345444b10f1 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:01.205047 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-82e20c4f-0560-4df3-a8be-6345444b10f1 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:01.205518 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-82e20c4f-0560-4df3-a8be-6345444b10f1 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:01.232716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-82e20c4f-0560-4df3-a8be-6345444b10f1 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] [instance: 390c9068-383b-4714-9e4c-9315acffcddc] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:24:01.303706 n-d-846466-12 devstack@n-api.service[126126]: ERROR oslo.messaging._drivers.impl_rabbit [None req-82e20c4f-0560-4df3-a8be-6345444b10f1 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] [d3bb4d03-d13d-441b-aab3-022bc8634dec] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 17:24:02.311595 n-d-846466-12 devstack@n-api.service[126126]: INFO oslo.messaging._drivers.impl_rabbit [None req-82e20c4f-0560-4df3-a8be-6345444b10f1 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] [d3bb4d03-d13d-441b-aab3-022bc8634dec] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 35088. Aug 04 17:24:02.338892 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-82e20c4f-0560-4df3-a8be-6345444b10f1 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] 10.222.0.23 "DELETE /compute/v2.1/servers/390c9068-383b-4714-9e4c-9315acffcddc" status: 204 len: 0 microversion: 2.1 time: 1.146587 Aug 04 17:24:02.343263 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3019/6141] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:24:01 2022] DELETE /compute/v2.1/servers/390c9068-383b-4714-9e4c-9315acffcddc => generated 0 bytes in 1148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:24:02.350799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-01159348-f6a3-41d8-806c-17d602849120 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:02.351413 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-01159348-f6a3-41d8-806c-17d602849120 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] [instance: 390c9068-383b-4714-9e4c-9315acffcddc] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:02.360269 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-01159348-f6a3-41d8-806c-17d602849120 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:02.360744 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-01159348-f6a3-41d8-806c-17d602849120 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:02.361563 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-01159348-f6a3-41d8-806c-17d602849120 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:02.362019 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-01159348-f6a3-41d8-806c-17d602849120 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:02.524497 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-01159348-f6a3-41d8-806c-17d602849120 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed81b73e145498f9ef4feb0d95caf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4707e7d51b9348fa9f7a64b11d3bf1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:02.532796 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-01159348-f6a3-41d8-806c-17d602849120 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] 10.222.0.23 "GET /compute/v2.1/servers/390c9068-383b-4714-9e4c-9315acffcddc" status: 200 len: 1476 microversion: 2.1 time: 0.187436 Aug 04 17:24:02.533406 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3123/6142] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:02 2022] GET /compute/v2.1/servers/390c9068-383b-4714-9e4c-9315acffcddc => generated 1476 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:03.556629 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-45d1464f-876a-411c-b619-c431e7ce3f33 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:03.557216 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-45d1464f-876a-411c-b619-c431e7ce3f33 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] [instance: 390c9068-383b-4714-9e4c-9315acffcddc] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:03.565842 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-45d1464f-876a-411c-b619-c431e7ce3f33 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:03.566304 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-45d1464f-876a-411c-b619-c431e7ce3f33 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:03.567114 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-45d1464f-876a-411c-b619-c431e7ce3f33 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:03.567562 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-45d1464f-876a-411c-b619-c431e7ce3f33 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:03.720152 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-45d1464f-876a-411c-b619-c431e7ce3f33 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed81b73e145498f9ef4feb0d95caf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4707e7d51b9348fa9f7a64b11d3bf1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:03.728972 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-45d1464f-876a-411c-b619-c431e7ce3f33 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] 10.222.0.23 "GET /compute/v2.1/servers/390c9068-383b-4714-9e4c-9315acffcddc" status: 200 len: 1476 microversion: 2.1 time: 0.176769 Aug 04 17:24:03.729591 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3020/6143] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:03 2022] GET /compute/v2.1/servers/390c9068-383b-4714-9e4c-9315acffcddc => generated 1476 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:04.284191 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-33ca555a-f9c9-4654-89a9-841c07e8b9d6 req-0162b355-566e-4dab-a4cb-0967ff27dd67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "390c9068-383b-4714-9e4c-9315acffcddc", "name": "network-vif-deleted", "tag": "299d1692-2db4-4b03-97d9-37880773a06f"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:24:04.295879 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-33ca555a-f9c9-4654-89a9-841c07e8b9d6 req-0162b355-566e-4dab-a4cb-0967ff27dd67 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:04.296332 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-33ca555a-f9c9-4654-89a9-841c07e8b9d6 req-0162b355-566e-4dab-a4cb-0967ff27dd67 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:04.315721 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-33ca555a-f9c9-4654-89a9-841c07e8b9d6 req-0162b355-566e-4dab-a4cb-0967ff27dd67 service nova] Creating event network-vif-deleted:299d1692-2db4-4b03-97d9-37880773a06f for instance 390c9068-383b-4714-9e4c-9315acffcddc on n-h1-846466-12 Aug 04 17:24:04.320628 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-33ca555a-f9c9-4654-89a9-841c07e8b9d6 req-0162b355-566e-4dab-a4cb-0967ff27dd67 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040371 Aug 04 17:24:04.321356 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3124/6144] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:24:04.750528 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-65d14636-7342-4cb4-aaa5-b440b162ab53 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:04.751259 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-65d14636-7342-4cb4-aaa5-b440b162ab53 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] [instance: 390c9068-383b-4714-9e4c-9315acffcddc] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:04.759137 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65d14636-7342-4cb4-aaa5-b440b162ab53 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:04.759337 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65d14636-7342-4cb4-aaa5-b440b162ab53 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:04.760047 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65d14636-7342-4cb4-aaa5-b440b162ab53 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:04.760490 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65d14636-7342-4cb4-aaa5-b440b162ab53 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:04.796818 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65d14636-7342-4cb4-aaa5-b440b162ab53 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:04.797974 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65d14636-7342-4cb4-aaa5-b440b162ab53 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:04.798471 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-65d14636-7342-4cb4-aaa5-b440b162ab53 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lazy-loading 'fault' on Instance uuid 390c9068-383b-4714-9e4c-9315acffcddc {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:24:04.842053 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-65d14636-7342-4cb4-aaa5-b440b162ab53 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed81b73e145498f9ef4feb0d95caf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4707e7d51b9348fa9f7a64b11d3bf1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:04.850038 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-65d14636-7342-4cb4-aaa5-b440b162ab53 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] 10.222.0.23 "GET /compute/v2.1/servers/390c9068-383b-4714-9e4c-9315acffcddc" status: 200 len: 1311 microversion: 2.1 time: 0.103524 Aug 04 17:24:04.850619 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3021/6145] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:04 2022] GET /compute/v2.1/servers/390c9068-383b-4714-9e4c-9315acffcddc => generated 1311 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:05.872864 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4d768f0c-8cd4-4f64-86e8-74725d5d72a6 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:05.873554 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4d768f0c-8cd4-4f64-86e8-74725d5d72a6 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] [instance: 390c9068-383b-4714-9e4c-9315acffcddc] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:05.880506 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d768f0c-8cd4-4f64-86e8-74725d5d72a6 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:05.880960 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d768f0c-8cd4-4f64-86e8-74725d5d72a6 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:05.881742 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d768f0c-8cd4-4f64-86e8-74725d5d72a6 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:05.882169 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d768f0c-8cd4-4f64-86e8-74725d5d72a6 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:05.896702 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-4d768f0c-8cd4-4f64-86e8-74725d5d72a6 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] HTTP exception thrown: Instance 390c9068-383b-4714-9e4c-9315acffcddc could not be found. Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4d768f0c-8cd4-4f64-86e8-74725d5d72a6 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Request method failure captured: Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/390c9068-383b-4714-9e4c-9315acffcddc HTTP/1.1 Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi7ACkRIz5q-bzMlBalIfn1Ggx0ZHJpXU5yT4WL8p2uY_oTyRfxTgUhH_-xId9dOb3BSsGYu0UfNcv7M_facY9N1oHVO6bpwWzzQnRKkj0uVXHHHI-XNSFh7x9y0cbVp5kyarQeEV2qgl4bMp5zrl9ejzVe2IJtsm-HmwIWsGIwVyNp_A Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 4707e7d51b9348fa9f7a64b11d3bf1f8 Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1412749902 Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4707e7d51b9348fa9f7a64b11d3bf1f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4707e7d51b9348fa9f7a64b11d3bf1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4707e7d51b9348fa9f7a64b11d3bf1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4707e7d51b9348fa9f7a64b11d3bf1f8"}]}] Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1412749902 Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 4707e7d51b9348fa9f7a64b11d3bf1f8 Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1412749902 Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersAdminNegativeTestJSON-1412749902-project Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 2ed81b73e145498f9ef4feb0d95caf83 Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1412749902-project Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 390c9068-383b-4714-9e4c-9315acffcddc could not be found. Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '390c9068-383b-4714-9e4c-9315acffcddc'} Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 390c9068-383b-4714-9e4c-9315acffcddc could not be found. Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 390c9068-383b-4714-9e4c-9315acffcddc could not be found. Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:24:05.898369 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:24:05.903944 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:24:05.903944 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:24:05.903944 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:24:05.903944 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:24:05.903944 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:24:05.903944 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:24:05.903944 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 390c9068-383b-4714-9e4c-9315acffcddc could not be found. Aug 04 17:24:05.903944 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:24:05.903944 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4d768f0c-8cd4-4f64-86e8-74725d5d72a6 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] Returning 404 to user: Instance 390c9068-383b-4714-9e4c-9315acffcddc could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:24:05.903944 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4d768f0c-8cd4-4f64-86e8-74725d5d72a6 tempest-ServersAdminNegativeTestJSON-1412749902 tempest-ServersAdminNegativeTestJSON-1412749902-project] 10.222.0.23 "GET /compute/v2.1/servers/390c9068-383b-4714-9e4c-9315acffcddc" status: 404 len: 111 microversion: 2.1 time: 0.032162 Aug 04 17:24:05.903944 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3125/6146] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:05 2022] GET /compute/v2.1/servers/390c9068-383b-4714-9e4c-9315acffcddc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:24:12.228666 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=4 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:24:12.229791 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:24:12.376378 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f8e07c23-050a-4bfe-a0a2-333b29eaa89a tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1275618365", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "4201224f-8bef-48a2-acdf-5884812245da"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:24:12.434410 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-f8e07c23-050a-4bfe-a0a2-333b29eaa89a tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] validate_networks() for [('4201224f-8bef-48a2-acdf-5884812245da', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:24:12.860395 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-f8e07c23-050a-4bfe-a0a2-333b29eaa89a tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:24:12.860816 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-f8e07c23-050a-4bfe-a0a2-333b29eaa89a tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:24:12.861345 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-f8e07c23-050a-4bfe-a0a2-333b29eaa89a tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:24:12.861725 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-f8e07c23-050a-4bfe-a0a2-333b29eaa89a tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:24:12.862142 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-f8e07c23-050a-4bfe-a0a2-333b29eaa89a tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:24:12.871689 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f8e07c23-050a-4bfe-a0a2-333b29eaa89a tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:12.872142 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f8e07c23-050a-4bfe-a0a2-333b29eaa89a tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:12.872940 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f8e07c23-050a-4bfe-a0a2-333b29eaa89a tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:12.873428 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f8e07c23-050a-4bfe-a0a2-333b29eaa89a tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:12.892342 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-f8e07c23-050a-4bfe-a0a2-333b29eaa89a tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Getting quotas for project 66d2c5298f274b42a52821d298f9aee5. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:24:12.898668 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-f8e07c23-050a-4bfe-a0a2-333b29eaa89a tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Getting quotas for user 58931fcbf39143bf989eef3a27a3a1b7 and project 66d2c5298f274b42a52821d298f9aee5. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:24:12.914388 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f8e07c23-050a-4bfe-a0a2-333b29eaa89a tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:24:12.916591 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f8e07c23-050a-4bfe-a0a2-333b29eaa89a tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:24:12.966422 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f8e07c23-050a-4bfe-a0a2-333b29eaa89a tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.743325 Aug 04 17:24:12.974284 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3022/6147] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:24:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:24:12.980082 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1e9f8d31-bf6a-4894-a5d9-f1e1631e02c3 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:12.980707 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1e9f8d31-bf6a-4894-a5d9-f1e1631e02c3 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:12.987365 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:24:12.988318 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:24:13.047490 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1e9f8d31-bf6a-4894-a5d9-f1e1631e02c3 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:13.054744 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1e9f8d31-bf6a-4894-a5d9-f1e1631e02c3 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1215 microversion: 2.1 time: 0.078940 Aug 04 17:24:13.055665 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3126/6148] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:12 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1215 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:14.076994 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4d62c391-7101-47ee-845d-f710f64ecaa9 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:14.077633 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4d62c391-7101-47ee-845d-f710f64ecaa9 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:14.085932 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4d62c391-7101-47ee-845d-f710f64ecaa9 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:14.086401 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4d62c391-7101-47ee-845d-f710f64ecaa9 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:14.087181 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4d62c391-7101-47ee-845d-f710f64ecaa9 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:14.087623 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4d62c391-7101-47ee-845d-f710f64ecaa9 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:14.159300 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4d62c391-7101-47ee-845d-f710f64ecaa9 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:14.167435 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4d62c391-7101-47ee-845d-f710f64ecaa9 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1267 microversion: 2.1 time: 0.095302 Aug 04 17:24:14.168188 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3023/6149] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:14 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1267 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:15.192485 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-786ad49b-3101-4c39-9e1a-52c7a82b1453 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:15.193322 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-786ad49b-3101-4c39-9e1a-52c7a82b1453 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:15.202612 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-786ad49b-3101-4c39-9e1a-52c7a82b1453 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:15.203475 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-786ad49b-3101-4c39-9e1a-52c7a82b1453 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:15.204157 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-786ad49b-3101-4c39-9e1a-52c7a82b1453 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:15.205407 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-786ad49b-3101-4c39-9e1a-52c7a82b1453 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:15.432557 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-786ad49b-3101-4c39-9e1a-52c7a82b1453 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:15.442719 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-786ad49b-3101-4c39-9e1a-52c7a82b1453 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1315 microversion: 2.1 time: 0.256932 Aug 04 17:24:15.456429 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3127/6150] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:15 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:15.730778 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-6de41afe-f0df-463a-81df-d438f5b7df3d req-d3d37803-2976-4f6e-a334-5bec58a4b2c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa0fc355-e74b-48b4-b709-e7c2282eb7d2", "tag": "b55e3708-f226-4991-9743-c7bb14fbfb9a"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:24:15.742891 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-6de41afe-f0df-463a-81df-d438f5b7df3d req-d3d37803-2976-4f6e-a334-5bec58a4b2c5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:15.743340 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-6de41afe-f0df-463a-81df-d438f5b7df3d req-d3d37803-2976-4f6e-a334-5bec58a4b2c5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:15.766528 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-6de41afe-f0df-463a-81df-d438f5b7df3d req-d3d37803-2976-4f6e-a334-5bec58a4b2c5 service nova] Creating event network-changed:b55e3708-f226-4991-9743-c7bb14fbfb9a for instance aa0fc355-e74b-48b4-b709-e7c2282eb7d2 on n-h1-846466-12 Aug 04 17:24:15.772389 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-6de41afe-f0df-463a-81df-d438f5b7df3d req-d3d37803-2976-4f6e-a334-5bec58a4b2c5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047161 Aug 04 17:24:15.773157 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3024/6151] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:24:16.465393 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1267e379-1388-445e-a04f-91e1d489e7a6 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:16.466005 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1267e379-1388-445e-a04f-91e1d489e7a6 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:16.473407 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1267e379-1388-445e-a04f-91e1d489e7a6 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:16.473862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1267e379-1388-445e-a04f-91e1d489e7a6 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:16.474645 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1267e379-1388-445e-a04f-91e1d489e7a6 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:16.475076 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1267e379-1388-445e-a04f-91e1d489e7a6 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:16.611724 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1267e379-1388-445e-a04f-91e1d489e7a6 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:16.619830 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1267e379-1388-445e-a04f-91e1d489e7a6 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1315 microversion: 2.1 time: 0.159301 Aug 04 17:24:16.620660 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3128/6152] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:16 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:17.642345 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6d1c6be9-3131-4485-9221-f62ef9e94658 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:17.643729 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6d1c6be9-3131-4485-9221-f62ef9e94658 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:17.651232 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d1c6be9-3131-4485-9221-f62ef9e94658 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:17.651681 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d1c6be9-3131-4485-9221-f62ef9e94658 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:17.652483 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d1c6be9-3131-4485-9221-f62ef9e94658 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:17.652926 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d1c6be9-3131-4485-9221-f62ef9e94658 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:18.055854 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6d1c6be9-3131-4485-9221-f62ef9e94658 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:18.065101 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6d1c6be9-3131-4485-9221-f62ef9e94658 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1315 microversion: 2.1 time: 0.428115 Aug 04 17:24:18.065749 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3025/6153] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:17 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:19.087074 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-257f9dfb-e3b7-48b3-a4b9-ff354474a652 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:19.087714 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-257f9dfb-e3b7-48b3-a4b9-ff354474a652 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:19.095068 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-257f9dfb-e3b7-48b3-a4b9-ff354474a652 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:19.095611 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-257f9dfb-e3b7-48b3-a4b9-ff354474a652 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:19.096367 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-257f9dfb-e3b7-48b3-a4b9-ff354474a652 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:19.096907 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-257f9dfb-e3b7-48b3-a4b9-ff354474a652 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:19.241459 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-257f9dfb-e3b7-48b3-a4b9-ff354474a652 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:19.249315 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-257f9dfb-e3b7-48b3-a4b9-ff354474a652 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1315 microversion: 2.1 time: 0.166221 Aug 04 17:24:19.249914 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3129/6154] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:19 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:20.271288 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-460c855f-ba4e-4b7f-985e-4436bcd04088 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:20.271907 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-460c855f-ba4e-4b7f-985e-4436bcd04088 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:20.279523 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-460c855f-ba4e-4b7f-985e-4436bcd04088 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:20.279960 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-460c855f-ba4e-4b7f-985e-4436bcd04088 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:20.280723 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-460c855f-ba4e-4b7f-985e-4436bcd04088 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:20.281152 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-460c855f-ba4e-4b7f-985e-4436bcd04088 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:20.297757 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-4920ea2e-e921-4f7a-a926-df5f1756a4db req-88086a46-fb88-42b5-b757-3bde5677ff33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0fc355-e74b-48b4-b709-e7c2282eb7d2", "name": "network-vif-plugged", "status": "completed", "tag": "b55e3708-f226-4991-9743-c7bb14fbfb9a"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:24:20.308578 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:24:20.313236 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-4920ea2e-e921-4f7a-a926-df5f1756a4db req-88086a46-fb88-42b5-b757-3bde5677ff33 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:20.313722 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-4920ea2e-e921-4f7a-a926-df5f1756a4db req-88086a46-fb88-42b5-b757-3bde5677ff33 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:20.319003 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=66 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:24:20.328862 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-4920ea2e-e921-4f7a-a926-df5f1756a4db req-88086a46-fb88-42b5-b757-3bde5677ff33 service nova] Creating event network-vif-plugged:b55e3708-f226-4991-9743-c7bb14fbfb9a for instance aa0fc355-e74b-48b4-b709-e7c2282eb7d2 on n-h1-846466-12 Aug 04 17:24:20.335125 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-4920ea2e-e921-4f7a-a926-df5f1756a4db req-88086a46-fb88-42b5-b757-3bde5677ff33 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043146 Aug 04 17:24:20.335763 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3130/6155] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:24:20.457810 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-460c855f-ba4e-4b7f-985e-4436bcd04088 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:20.460426 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:24:20.469055 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-460c855f-ba4e-4b7f-985e-4436bcd04088 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1315 microversion: 2.1 time: 0.201782 Aug 04 17:24:20.470010 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3026/6156] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:20 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:21.495260 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0681b313-1c30-45a2-bcd9-0a89d5912842 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:21.496146 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0681b313-1c30-45a2-bcd9-0a89d5912842 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:21.503111 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0681b313-1c30-45a2-bcd9-0a89d5912842 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:21.503377 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0681b313-1c30-45a2-bcd9-0a89d5912842 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:21.504175 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0681b313-1c30-45a2-bcd9-0a89d5912842 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:21.504568 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0681b313-1c30-45a2-bcd9-0a89d5912842 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:21.651869 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0681b313-1c30-45a2-bcd9-0a89d5912842 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:21.662314 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0681b313-1c30-45a2-bcd9-0a89d5912842 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1315 microversion: 2.1 time: 0.174694 Aug 04 17:24:21.663045 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3131/6157] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:21 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:22.684845 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-676d0413-0780-46ee-95cc-94c237a32845 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:22.685533 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-676d0413-0780-46ee-95cc-94c237a32845 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:22.688542 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:24:22.696656 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-676d0413-0780-46ee-95cc-94c237a32845 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:22.697208 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-676d0413-0780-46ee-95cc-94c237a32845 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:22.698089 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-676d0413-0780-46ee-95cc-94c237a32845 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:22.698532 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-676d0413-0780-46ee-95cc-94c237a32845 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:22.838491 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-676d0413-0780-46ee-95cc-94c237a32845 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:22.846980 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-676d0413-0780-46ee-95cc-94c237a32845 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1501 microversion: 2.1 time: 0.166485 Aug 04 17:24:22.847537 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3027/6158] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:22 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1501 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:22.867521 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a316128b-cf54-407a-8c25-0c1d52cb505e tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:24:22.870467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a316128b-cf54-407a-8c25-0c1d52cb505e tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:22.878192 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a316128b-cf54-407a-8c25-0c1d52cb505e tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:22.878626 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a316128b-cf54-407a-8c25-0c1d52cb505e tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:22.879390 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a316128b-cf54-407a-8c25-0c1d52cb505e tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:22.879841 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a316128b-cf54-407a-8c25-0c1d52cb505e tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:22.910389 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a316128b-cf54-407a-8c25-0c1d52cb505e tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:22.916992 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a316128b-cf54-407a-8c25-0c1d52cb505e tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Old instance type m1.heat2, new instance type m1.heat {{(pid=126125) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 17:24:22.923701 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-a316128b-cf54-407a-8c25-0c1d52cb505e tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:24:22.924117 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-a316128b-cf54-407a-8c25-0c1d52cb505e tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:24:22.924793 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-a316128b-cf54-407a-8c25-0c1d52cb505e tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:24:22.925200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-a316128b-cf54-407a-8c25-0c1d52cb505e tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:24:22.925627 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-a316128b-cf54-407a-8c25-0c1d52cb505e tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:24:22.994987 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a316128b-cf54-407a-8c25-0c1d52cb505e tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "POST /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2/action" status: 202 len: 0 microversion: 2.1 time: 0.131428 Aug 04 17:24:22.995751 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3132/6159] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:24:22 2022] POST /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:24:23.004882 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8ad54c48-4aee-42a1-b2d7-9011d0b72193 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:23.005544 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8ad54c48-4aee-42a1-b2d7-9011d0b72193 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:23.007483 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:24:23.008532 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:24:23.014430 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8ad54c48-4aee-42a1-b2d7-9011d0b72193 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:23.014884 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8ad54c48-4aee-42a1-b2d7-9011d0b72193 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:23.015664 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8ad54c48-4aee-42a1-b2d7-9011d0b72193 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:23.016136 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8ad54c48-4aee-42a1-b2d7-9011d0b72193 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:23.154352 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8ad54c48-4aee-42a1-b2d7-9011d0b72193 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:23.165293 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8ad54c48-4aee-42a1-b2d7-9011d0b72193 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1510 microversion: 2.1 time: 0.164970 Aug 04 17:24:23.165901 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3028/6160] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:22 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:24.187929 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-923ff13a-6886-4cb4-b22b-407c979bd738 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:24.188538 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-923ff13a-6886-4cb4-b22b-407c979bd738 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:24.190696 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:24:24.198336 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-923ff13a-6886-4cb4-b22b-407c979bd738 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:24.198803 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-923ff13a-6886-4cb4-b22b-407c979bd738 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:24.199574 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-923ff13a-6886-4cb4-b22b-407c979bd738 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:24.200004 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-923ff13a-6886-4cb4-b22b-407c979bd738 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:24.341315 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-923ff13a-6886-4cb4-b22b-407c979bd738 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:24.349551 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-923ff13a-6886-4cb4-b22b-407c979bd738 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1510 microversion: 2.1 time: 0.165771 Aug 04 17:24:24.350133 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3133/6161] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:24 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:25.370180 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-45865594-0c91-40c1-b32e-14bc2a3a6be4 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:25.370838 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-45865594-0c91-40c1-b32e-14bc2a3a6be4 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:25.378506 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-45865594-0c91-40c1-b32e-14bc2a3a6be4 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:25.378960 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-45865594-0c91-40c1-b32e-14bc2a3a6be4 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:25.379747 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-45865594-0c91-40c1-b32e-14bc2a3a6be4 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:25.380191 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-45865594-0c91-40c1-b32e-14bc2a3a6be4 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:25.517311 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-45865594-0c91-40c1-b32e-14bc2a3a6be4 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:25.526096 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-45865594-0c91-40c1-b32e-14bc2a3a6be4 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1515 microversion: 2.1 time: 0.159917 Aug 04 17:24:25.526696 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3029/6162] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:25 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:26.550254 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0ebd8bb7-f827-4702-8dec-630475c88e13 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:26.550868 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0ebd8bb7-f827-4702-8dec-630475c88e13 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:26.561017 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ebd8bb7-f827-4702-8dec-630475c88e13 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:26.561613 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ebd8bb7-f827-4702-8dec-630475c88e13 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:26.562687 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ebd8bb7-f827-4702-8dec-630475c88e13 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:26.563263 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ebd8bb7-f827-4702-8dec-630475c88e13 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:26.726916 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0ebd8bb7-f827-4702-8dec-630475c88e13 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:26.734793 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0ebd8bb7-f827-4702-8dec-630475c88e13 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1515 microversion: 2.1 time: 0.190982 Aug 04 17:24:26.735338 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3134/6163] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:26 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1515 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:27.756131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8d2aeb97-4f09-478f-a050-30bf80345d0e tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:27.756780 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8d2aeb97-4f09-478f-a050-30bf80345d0e tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:27.764392 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8d2aeb97-4f09-478f-a050-30bf80345d0e tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:27.764847 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8d2aeb97-4f09-478f-a050-30bf80345d0e tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:27.765683 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8d2aeb97-4f09-478f-a050-30bf80345d0e tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:27.766132 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8d2aeb97-4f09-478f-a050-30bf80345d0e tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:27.912421 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8d2aeb97-4f09-478f-a050-30bf80345d0e tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:27.920579 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8d2aeb97-4f09-478f-a050-30bf80345d0e tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1515 microversion: 2.1 time: 0.168405 Aug 04 17:24:27.921172 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3030/6164] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:27 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:28.942156 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-aa9998b2-e808-4e4f-9d9f-44cfa94e5080 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:28.942818 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-aa9998b2-e808-4e4f-9d9f-44cfa94e5080 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:28.950942 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aa9998b2-e808-4e4f-9d9f-44cfa94e5080 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:28.951392 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aa9998b2-e808-4e4f-9d9f-44cfa94e5080 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:28.952170 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aa9998b2-e808-4e4f-9d9f-44cfa94e5080 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:28.952600 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aa9998b2-e808-4e4f-9d9f-44cfa94e5080 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:29.101096 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-aa9998b2-e808-4e4f-9d9f-44cfa94e5080 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:29.109257 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-aa9998b2-e808-4e4f-9d9f-44cfa94e5080 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1515 microversion: 2.1 time: 0.171375 Aug 04 17:24:29.109843 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3135/6165] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:28 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:30.131247 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8ffb0d83-7372-4421-9f1a-31b69f3a2c38 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:30.131908 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8ffb0d83-7372-4421-9f1a-31b69f3a2c38 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:30.139290 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8ffb0d83-7372-4421-9f1a-31b69f3a2c38 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:30.139749 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8ffb0d83-7372-4421-9f1a-31b69f3a2c38 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:30.140516 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8ffb0d83-7372-4421-9f1a-31b69f3a2c38 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:30.140961 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8ffb0d83-7372-4421-9f1a-31b69f3a2c38 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:30.291300 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8ffb0d83-7372-4421-9f1a-31b69f3a2c38 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:30.299708 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8ffb0d83-7372-4421-9f1a-31b69f3a2c38 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1515 microversion: 2.1 time: 0.172543 Aug 04 17:24:30.300297 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3031/6166] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:30 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:31.321776 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b26b39b0-e2d2-4290-b020-84bc83419e2e tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:31.322389 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b26b39b0-e2d2-4290-b020-84bc83419e2e tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:31.330181 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b26b39b0-e2d2-4290-b020-84bc83419e2e tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:31.330621 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b26b39b0-e2d2-4290-b020-84bc83419e2e tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:31.331377 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b26b39b0-e2d2-4290-b020-84bc83419e2e tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:31.331799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b26b39b0-e2d2-4290-b020-84bc83419e2e tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:31.488571 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b26b39b0-e2d2-4290-b020-84bc83419e2e tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:31.498099 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b26b39b0-e2d2-4290-b020-84bc83419e2e tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1515 microversion: 2.1 time: 0.180362 Aug 04 17:24:31.498646 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3136/6167] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:31 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:32.519654 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-405769bf-b992-4e63-9eb8-a1f099d21ff9 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:32.520235 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-405769bf-b992-4e63-9eb8-a1f099d21ff9 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:32.527618 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-405769bf-b992-4e63-9eb8-a1f099d21ff9 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:32.528074 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-405769bf-b992-4e63-9eb8-a1f099d21ff9 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:32.528835 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-405769bf-b992-4e63-9eb8-a1f099d21ff9 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:32.529274 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-405769bf-b992-4e63-9eb8-a1f099d21ff9 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:32.670402 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-405769bf-b992-4e63-9eb8-a1f099d21ff9 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:32.680811 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-405769bf-b992-4e63-9eb8-a1f099d21ff9 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1515 microversion: 2.1 time: 0.165827 Aug 04 17:24:32.681427 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3032/6168] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:32 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:33.702971 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-adbefcf5-764d-4242-80c2-4be52acd08fb tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:33.703776 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-adbefcf5-764d-4242-80c2-4be52acd08fb tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:33.711652 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-adbefcf5-764d-4242-80c2-4be52acd08fb tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:33.712110 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-adbefcf5-764d-4242-80c2-4be52acd08fb tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:33.712861 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-adbefcf5-764d-4242-80c2-4be52acd08fb tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:33.713293 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-adbefcf5-764d-4242-80c2-4be52acd08fb tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:33.856756 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-adbefcf5-764d-4242-80c2-4be52acd08fb tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:33.865399 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-adbefcf5-764d-4242-80c2-4be52acd08fb tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1515 microversion: 2.1 time: 0.166096 Aug 04 17:24:33.866270 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3137/6169] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:33 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:34.888851 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6d4adddb-f9bb-4045-b0c1-8f918672f0df tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:34.889544 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6d4adddb-f9bb-4045-b0c1-8f918672f0df tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:34.896657 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d4adddb-f9bb-4045-b0c1-8f918672f0df tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:34.897119 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d4adddb-f9bb-4045-b0c1-8f918672f0df tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:34.898151 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d4adddb-f9bb-4045-b0c1-8f918672f0df tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:34.898578 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d4adddb-f9bb-4045-b0c1-8f918672f0df tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:35.050211 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6d4adddb-f9bb-4045-b0c1-8f918672f0df tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:35.058852 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6d4adddb-f9bb-4045-b0c1-8f918672f0df tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1515 microversion: 2.1 time: 0.175480 Aug 04 17:24:35.059560 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3033/6170] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:34 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:36.080508 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c94efb3b-bd5e-4c18-944d-d55fcf7ae36c tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:36.081151 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c94efb3b-bd5e-4c18-944d-d55fcf7ae36c tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:36.088880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c94efb3b-bd5e-4c18-944d-d55fcf7ae36c tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:36.089316 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c94efb3b-bd5e-4c18-944d-d55fcf7ae36c tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:36.090150 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c94efb3b-bd5e-4c18-944d-d55fcf7ae36c tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:36.090577 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c94efb3b-bd5e-4c18-944d-d55fcf7ae36c tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:36.230773 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c94efb3b-bd5e-4c18-944d-d55fcf7ae36c tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:36.239164 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c94efb3b-bd5e-4c18-944d-d55fcf7ae36c tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1515 microversion: 2.1 time: 0.162696 Aug 04 17:24:36.239768 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3138/6171] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:36 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:37.261875 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-305e8b75-286b-4544-bb6b-130418907b7b tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:37.262512 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-305e8b75-286b-4544-bb6b-130418907b7b tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:37.270599 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-305e8b75-286b-4544-bb6b-130418907b7b tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:37.271045 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-305e8b75-286b-4544-bb6b-130418907b7b tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:37.271827 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-305e8b75-286b-4544-bb6b-130418907b7b tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:37.272287 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-305e8b75-286b-4544-bb6b-130418907b7b tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:37.424286 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-305e8b75-286b-4544-bb6b-130418907b7b tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:37.432069 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-305e8b75-286b-4544-bb6b-130418907b7b tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1515 microversion: 2.1 time: 0.174382 Aug 04 17:24:37.432613 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3034/6172] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:37 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:38.453643 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9181a1cd-0407-4fb8-aba1-4452dc07fd82 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:38.454306 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9181a1cd-0407-4fb8-aba1-4452dc07fd82 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:38.461881 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9181a1cd-0407-4fb8-aba1-4452dc07fd82 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:38.462610 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9181a1cd-0407-4fb8-aba1-4452dc07fd82 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:38.463370 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9181a1cd-0407-4fb8-aba1-4452dc07fd82 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:38.463809 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9181a1cd-0407-4fb8-aba1-4452dc07fd82 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:38.607657 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9181a1cd-0407-4fb8-aba1-4452dc07fd82 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:38.618722 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9181a1cd-0407-4fb8-aba1-4452dc07fd82 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1515 microversion: 2.1 time: 0.169141 Aug 04 17:24:38.619295 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3139/6173] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:38 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:39.641742 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3872342e-f678-4c08-94a0-22acba060a26 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:39.642377 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3872342e-f678-4c08-94a0-22acba060a26 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:39.650187 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3872342e-f678-4c08-94a0-22acba060a26 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:39.650765 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3872342e-f678-4c08-94a0-22acba060a26 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:39.651974 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3872342e-f678-4c08-94a0-22acba060a26 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:39.651974 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3872342e-f678-4c08-94a0-22acba060a26 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:39.808746 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3872342e-f678-4c08-94a0-22acba060a26 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:39.821410 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3872342e-f678-4c08-94a0-22acba060a26 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1515 microversion: 2.1 time: 0.184105 Aug 04 17:24:39.822412 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3035/6174] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:39 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1515 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:40.844970 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2d91ceca-ea52-4017-af84-4d4ff13029a2 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:40.845898 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2d91ceca-ea52-4017-af84-4d4ff13029a2 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:40.855671 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d91ceca-ea52-4017-af84-4d4ff13029a2 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:40.856116 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d91ceca-ea52-4017-af84-4d4ff13029a2 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:40.856892 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d91ceca-ea52-4017-af84-4d4ff13029a2 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:40.857337 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2d91ceca-ea52-4017-af84-4d4ff13029a2 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:41.030017 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2d91ceca-ea52-4017-af84-4d4ff13029a2 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:41.040699 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2d91ceca-ea52-4017-af84-4d4ff13029a2 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1515 microversion: 2.1 time: 0.200142 Aug 04 17:24:41.041661 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3140/6175] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:40 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1515 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:42.063394 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-38f64a5e-c51e-401a-b946-729906ad1281 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:42.063975 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-38f64a5e-c51e-401a-b946-729906ad1281 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:42.071706 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-38f64a5e-c51e-401a-b946-729906ad1281 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:42.072177 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-38f64a5e-c51e-401a-b946-729906ad1281 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:42.073329 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-38f64a5e-c51e-401a-b946-729906ad1281 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:42.073778 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-38f64a5e-c51e-401a-b946-729906ad1281 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:42.214673 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-38f64a5e-c51e-401a-b946-729906ad1281 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:42.226919 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-38f64a5e-c51e-401a-b946-729906ad1281 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1515 microversion: 2.1 time: 0.167239 Aug 04 17:24:42.227692 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3036/6176] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:42 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:43.249458 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1f182b60-49d4-4ef6-945a-fa43ecb32aac tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:43.250056 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1f182b60-49d4-4ef6-945a-fa43ecb32aac tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:43.258055 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f182b60-49d4-4ef6-945a-fa43ecb32aac tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:43.258055 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f182b60-49d4-4ef6-945a-fa43ecb32aac tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:43.258800 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f182b60-49d4-4ef6-945a-fa43ecb32aac tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:43.259230 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f182b60-49d4-4ef6-945a-fa43ecb32aac tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:43.406285 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1f182b60-49d4-4ef6-945a-fa43ecb32aac tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:43.417565 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1f182b60-49d4-4ef6-945a-fa43ecb32aac tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1515 microversion: 2.1 time: 0.172623 Aug 04 17:24:43.418146 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3141/6177] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:43 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:44.453050 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fe1015b3-cd1a-43a4-8f70-ada28f73679f tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:44.453707 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fe1015b3-cd1a-43a4-8f70-ada28f73679f tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:44.461267 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fe1015b3-cd1a-43a4-8f70-ada28f73679f tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:44.461752 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fe1015b3-cd1a-43a4-8f70-ada28f73679f tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:44.462525 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fe1015b3-cd1a-43a4-8f70-ada28f73679f tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:44.462968 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fe1015b3-cd1a-43a4-8f70-ada28f73679f tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:44.606259 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fe1015b3-cd1a-43a4-8f70-ada28f73679f tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:44.617101 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fe1015b3-cd1a-43a4-8f70-ada28f73679f tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1515 microversion: 2.1 time: 0.168375 Aug 04 17:24:44.617889 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3037/6178] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:44 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:45.639939 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1bd93376-0ac6-43f4-a420-cc865cb81a17 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:45.640551 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1bd93376-0ac6-43f4-a420-cc865cb81a17 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:45.648364 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1bd93376-0ac6-43f4-a420-cc865cb81a17 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:45.648842 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1bd93376-0ac6-43f4-a420-cc865cb81a17 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:45.649624 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1bd93376-0ac6-43f4-a420-cc865cb81a17 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:45.650062 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1bd93376-0ac6-43f4-a420-cc865cb81a17 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:45.797365 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1bd93376-0ac6-43f4-a420-cc865cb81a17 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:45.809180 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1bd93376-0ac6-43f4-a420-cc865cb81a17 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1515 microversion: 2.1 time: 0.173423 Aug 04 17:24:45.809991 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3142/6179] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:45 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:46.839501 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-702ca6e1-e54c-4423-a80a-f9d81ee9dc89 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:46.840126 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-702ca6e1-e54c-4423-a80a-f9d81ee9dc89 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:46.849673 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-702ca6e1-e54c-4423-a80a-f9d81ee9dc89 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:46.850129 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-702ca6e1-e54c-4423-a80a-f9d81ee9dc89 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:46.850899 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-702ca6e1-e54c-4423-a80a-f9d81ee9dc89 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:46.851342 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-702ca6e1-e54c-4423-a80a-f9d81ee9dc89 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:47.008130 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-702ca6e1-e54c-4423-a80a-f9d81ee9dc89 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:47.017457 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-702ca6e1-e54c-4423-a80a-f9d81ee9dc89 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1515 microversion: 2.1 time: 0.184334 Aug 04 17:24:47.018049 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3038/6180] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:46 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1515 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:48.043093 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7a0684be-1632-4da0-b036-f65810c6659c tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:48.043744 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7a0684be-1632-4da0-b036-f65810c6659c tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:48.052429 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a0684be-1632-4da0-b036-f65810c6659c tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:48.052890 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a0684be-1632-4da0-b036-f65810c6659c tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:48.053701 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a0684be-1632-4da0-b036-f65810c6659c tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:48.054133 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7a0684be-1632-4da0-b036-f65810c6659c tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:48.204761 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7a0684be-1632-4da0-b036-f65810c6659c tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:48.212796 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7a0684be-1632-4da0-b036-f65810c6659c tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1515 microversion: 2.1 time: 0.176090 Aug 04 17:24:48.213613 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3143/6181] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:48 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:49.234992 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-88816df2-1e7d-41cf-af9e-50da2e5ee6b5 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:49.236046 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-88816df2-1e7d-41cf-af9e-50da2e5ee6b5 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:49.243745 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-88816df2-1e7d-41cf-af9e-50da2e5ee6b5 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:49.244204 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-88816df2-1e7d-41cf-af9e-50da2e5ee6b5 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:49.244986 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-88816df2-1e7d-41cf-af9e-50da2e5ee6b5 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:49.245459 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-88816df2-1e7d-41cf-af9e-50da2e5ee6b5 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:49.398205 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-88816df2-1e7d-41cf-af9e-50da2e5ee6b5 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:49.406577 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-88816df2-1e7d-41cf-af9e-50da2e5ee6b5 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1515 microversion: 2.1 time: 0.175849 Aug 04 17:24:49.407163 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3039/6182] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:49 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:50.427514 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e1e7faf3-9d95-4189-9c75-9f631dee61a8 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:50.428102 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e1e7faf3-9d95-4189-9c75-9f631dee61a8 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:50.435306 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e1e7faf3-9d95-4189-9c75-9f631dee61a8 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:50.435752 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e1e7faf3-9d95-4189-9c75-9f631dee61a8 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:50.436512 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e1e7faf3-9d95-4189-9c75-9f631dee61a8 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:50.436946 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e1e7faf3-9d95-4189-9c75-9f631dee61a8 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:50.439648 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:24:50.579942 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e1e7faf3-9d95-4189-9c75-9f631dee61a8 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:50.588137 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e1e7faf3-9d95-4189-9c75-9f631dee61a8 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1515 microversion: 2.1 time: 0.164705 Aug 04 17:24:50.588694 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3144/6183] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:50 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:51.611407 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e170e864-caf4-4408-a29c-8ed2259a3ac9 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:51.612032 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e170e864-caf4-4408-a29c-8ed2259a3ac9 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:51.619716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e170e864-caf4-4408-a29c-8ed2259a3ac9 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:51.620173 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e170e864-caf4-4408-a29c-8ed2259a3ac9 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:51.620936 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e170e864-caf4-4408-a29c-8ed2259a3ac9 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:51.621404 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e170e864-caf4-4408-a29c-8ed2259a3ac9 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:51.765708 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e170e864-caf4-4408-a29c-8ed2259a3ac9 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:51.772433 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e170e864-caf4-4408-a29c-8ed2259a3ac9 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1515 microversion: 2.1 time: 0.165238 Aug 04 17:24:51.773012 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3040/6184] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:51 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:52.794719 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d490ba2e-cd38-4f70-8bb7-635e35ca3dd8 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:52.795386 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d490ba2e-cd38-4f70-8bb7-635e35ca3dd8 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:52.797467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=34 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:24:52.803431 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d490ba2e-cd38-4f70-8bb7-635e35ca3dd8 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:52.803880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d490ba2e-cd38-4f70-8bb7-635e35ca3dd8 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:52.804707 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d490ba2e-cd38-4f70-8bb7-635e35ca3dd8 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:52.805139 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d490ba2e-cd38-4f70-8bb7-635e35ca3dd8 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:52.945238 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d490ba2e-cd38-4f70-8bb7-635e35ca3dd8 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:52.953503 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d490ba2e-cd38-4f70-8bb7-635e35ca3dd8 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1514 microversion: 2.1 time: 0.163032 Aug 04 17:24:52.954221 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3145/6185] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:52 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:53.107492 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-f7e6c1bd-0856-4e07-ab1f-ecc49dc15740 req-fa3449b2-aaee-430d-b6ca-3249f9205b9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0fc355-e74b-48b4-b709-e7c2282eb7d2", "name": "network-vif-unplugged", "status": "completed", "tag": "b55e3708-f226-4991-9743-c7bb14fbfb9a"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:24:53.113704 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=28 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:24:53.119452 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f7e6c1bd-0856-4e07-ab1f-ecc49dc15740 req-fa3449b2-aaee-430d-b6ca-3249f9205b9e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:53.119919 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f7e6c1bd-0856-4e07-ab1f-ecc49dc15740 req-fa3449b2-aaee-430d-b6ca-3249f9205b9e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:53.122892 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=86 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:24:53.135756 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-f7e6c1bd-0856-4e07-ab1f-ecc49dc15740 req-fa3449b2-aaee-430d-b6ca-3249f9205b9e service nova] Creating event network-vif-unplugged:b55e3708-f226-4991-9743-c7bb14fbfb9a for instance aa0fc355-e74b-48b4-b709-e7c2282eb7d2 on n-h2-846466-12 Aug 04 17:24:53.142371 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [req-f7e6c1bd-0856-4e07-ab1f-ecc49dc15740 req-fa3449b2-aaee-430d-b6ca-3249f9205b9e service nova] Instance aa0fc355-e74b-48b4-b709-e7c2282eb7d2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126126) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:24:53.154463 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-f7e6c1bd-0856-4e07-ab1f-ecc49dc15740 req-fa3449b2-aaee-430d-b6ca-3249f9205b9e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.124072 Aug 04 17:24:53.155317 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3041/6186] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:24:53.976637 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-58874e0b-071d-417a-a958-98a05619e993 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:53.977245 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-58874e0b-071d-417a-a958-98a05619e993 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:53.984825 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58874e0b-071d-417a-a958-98a05619e993 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:53.985270 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58874e0b-071d-417a-a958-98a05619e993 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:53.986059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58874e0b-071d-417a-a958-98a05619e993 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:53.986485 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-58874e0b-071d-417a-a958-98a05619e993 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:54.138377 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-58874e0b-071d-417a-a958-98a05619e993 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:54.146746 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-58874e0b-071d-417a-a958-98a05619e993 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1512 microversion: 2.1 time: 0.174144 Aug 04 17:24:54.147330 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3146/6187] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:53 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1512 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:55.170342 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ad592a75-91a9-434f-9afc-0d95dc6713b2 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:55.170945 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-f968d95f-157f-4866-bd1c-4498086360aa req-52cee23b-c971-496e-92f3-8a36b5eeeb1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa0fc355-e74b-48b4-b709-e7c2282eb7d2", "tag": "b55e3708-f226-4991-9743-c7bb14fbfb9a"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:24:55.171345 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ad592a75-91a9-434f-9afc-0d95dc6713b2 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:55.177943 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad592a75-91a9-434f-9afc-0d95dc6713b2 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:55.178405 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad592a75-91a9-434f-9afc-0d95dc6713b2 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:55.179893 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad592a75-91a9-434f-9afc-0d95dc6713b2 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:55.180336 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad592a75-91a9-434f-9afc-0d95dc6713b2 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:55.181394 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-f968d95f-157f-4866-bd1c-4498086360aa req-52cee23b-c971-496e-92f3-8a36b5eeeb1c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:55.181826 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-f968d95f-157f-4866-bd1c-4498086360aa req-52cee23b-c971-496e-92f3-8a36b5eeeb1c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:55.194954 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-f968d95f-157f-4866-bd1c-4498086360aa req-52cee23b-c971-496e-92f3-8a36b5eeeb1c service nova] Creating event network-changed:b55e3708-f226-4991-9743-c7bb14fbfb9a for instance aa0fc355-e74b-48b4-b709-e7c2282eb7d2 on n-h2-846466-12 Aug 04 17:24:55.201273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [req-f968d95f-157f-4866-bd1c-4498086360aa req-52cee23b-c971-496e-92f3-8a36b5eeeb1c service nova] Instance aa0fc355-e74b-48b4-b709-e7c2282eb7d2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:24:55.215799 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-f968d95f-157f-4866-bd1c-4498086360aa req-52cee23b-c971-496e-92f3-8a36b5eeeb1c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049141 Aug 04 17:24:55.216734 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3147/6188] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:24:55.412276 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ad592a75-91a9-434f-9afc-0d95dc6713b2 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:55.420513 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ad592a75-91a9-434f-9afc-0d95dc6713b2 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1512 microversion: 2.1 time: 0.255742 Aug 04 17:24:55.421429 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3042/6189] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:55 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1512 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:56.443935 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a7ed1740-4a8f-4f27-9ccf-3feaf58aba0a tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:56.444606 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a7ed1740-4a8f-4f27-9ccf-3feaf58aba0a tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:56.452266 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a7ed1740-4a8f-4f27-9ccf-3feaf58aba0a tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:56.452733 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a7ed1740-4a8f-4f27-9ccf-3feaf58aba0a tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:56.453996 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a7ed1740-4a8f-4f27-9ccf-3feaf58aba0a tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:56.454378 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a7ed1740-4a8f-4f27-9ccf-3feaf58aba0a tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:56.608111 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a7ed1740-4a8f-4f27-9ccf-3feaf58aba0a tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:56.616611 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a7ed1740-4a8f-4f27-9ccf-3feaf58aba0a tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1509 microversion: 2.1 time: 0.177613 Aug 04 17:24:56.617186 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3148/6190] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:56 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1509 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:56.638096 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e82608cd-2bd3-4222-b1af-464705e9b6b1 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:56.638926 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e82608cd-2bd3-4222-b1af-464705e9b6b1 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:56.647444 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e82608cd-2bd3-4222-b1af-464705e9b6b1 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:56.647895 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e82608cd-2bd3-4222-b1af-464705e9b6b1 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:56.648656 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e82608cd-2bd3-4222-b1af-464705e9b6b1 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:56.649078 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e82608cd-2bd3-4222-b1af-464705e9b6b1 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:56.676300 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e82608cd-2bd3-4222-b1af-464705e9b6b1 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:24:56.733336 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.compute.api [None req-e82608cd-2bd3-4222-b1af-464705e9b6b1 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Found an unconfirmed migration during delete, id: 16, status: finished Aug 04 17:24:58.292748 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e82608cd-2bd3-4222-b1af-464705e9b6b1 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "DELETE /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 204 len: 0 microversion: 2.1 time: 1.658746 Aug 04 17:24:58.293823 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3043/6191] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:24:56 2022] DELETE /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 0 bytes in 1661 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:24:58.302524 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9c035cfa-9adb-4bfd-bf97-7323c6cb6762 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:58.303185 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9c035cfa-9adb-4bfd-bf97-7323c6cb6762 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:58.310920 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c035cfa-9adb-4bfd-bf97-7323c6cb6762 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:58.311364 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c035cfa-9adb-4bfd-bf97-7323c6cb6762 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:58.312132 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c035cfa-9adb-4bfd-bf97-7323c6cb6762 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:58.312553 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c035cfa-9adb-4bfd-bf97-7323c6cb6762 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:58.450628 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9c035cfa-9adb-4bfd-bf97-7323c6cb6762 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:58.459103 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9c035cfa-9adb-4bfd-bf97-7323c6cb6762 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1501 microversion: 2.1 time: 0.161192 Aug 04 17:24:58.459696 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3149/6192] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:58 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1501 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:59.480914 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-337bde13-5121-4674-95fe-bcd62824c7f8 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:59.481786 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-337bde13-5121-4674-95fe-bcd62824c7f8 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:59.489271 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-337bde13-5121-4674-95fe-bcd62824c7f8 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:59.490544 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-337bde13-5121-4674-95fe-bcd62824c7f8 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:59.491379 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-337bde13-5121-4674-95fe-bcd62824c7f8 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:59.491829 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-337bde13-5121-4674-95fe-bcd62824c7f8 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:59.520413 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-430846a3-4bf1-48d0-bcfa-72869b6e84c4 req-473a7634-dce1-4399-af16-ac4e4ba49160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0fc355-e74b-48b4-b709-e7c2282eb7d2", "name": "network-vif-plugged", "status": "completed", "tag": "b55e3708-f226-4991-9743-c7bb14fbfb9a"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:24:59.539992 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-430846a3-4bf1-48d0-bcfa-72869b6e84c4 req-473a7634-dce1-4399-af16-ac4e4ba49160 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:24:59.540601 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-430846a3-4bf1-48d0-bcfa-72869b6e84c4 req-473a7634-dce1-4399-af16-ac4e4ba49160 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:24:59.556652 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-430846a3-4bf1-48d0-bcfa-72869b6e84c4 req-473a7634-dce1-4399-af16-ac4e4ba49160 service nova] Creating event network-vif-plugged:b55e3708-f226-4991-9743-c7bb14fbfb9a for instance aa0fc355-e74b-48b4-b709-e7c2282eb7d2 on n-h2-846466-12 Aug 04 17:24:59.562653 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-430846a3-4bf1-48d0-bcfa-72869b6e84c4 req-473a7634-dce1-4399-af16-ac4e4ba49160 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048766 Aug 04 17:24:59.563366 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3150/6193] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:24:59.637619 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-337bde13-5121-4674-95fe-bcd62824c7f8 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58931fcbf39143bf989eef3a27a3a1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d2c5298f274b42a52821d298f9aee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:59.647946 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-337bde13-5121-4674-95fe-bcd62824c7f8 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 200 len: 1501 microversion: 2.1 time: 0.170746 Aug 04 17:24:59.648735 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3044/6194] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:59 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 1501 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:00.130141 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-825be616-0179-4a65-a936-3b7da99a6676 req-894082ac-0607-47ae-a82b-6ecb9098c620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0fc355-e74b-48b4-b709-e7c2282eb7d2", "name": "network-vif-deleted", "tag": "b55e3708-f226-4991-9743-c7bb14fbfb9a"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:25:00.140526 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-825be616-0179-4a65-a936-3b7da99a6676 req-894082ac-0607-47ae-a82b-6ecb9098c620 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:00.141062 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-825be616-0179-4a65-a936-3b7da99a6676 req-894082ac-0607-47ae-a82b-6ecb9098c620 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:00.155111 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-825be616-0179-4a65-a936-3b7da99a6676 req-894082ac-0607-47ae-a82b-6ecb9098c620 service nova] Creating event network-vif-deleted:b55e3708-f226-4991-9743-c7bb14fbfb9a for instance aa0fc355-e74b-48b4-b709-e7c2282eb7d2 on n-h2-846466-12 Aug 04 17:25:00.161031 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-825be616-0179-4a65-a936-3b7da99a6676 req-894082ac-0607-47ae-a82b-6ecb9098c620 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034929 Aug 04 17:25:00.161866 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3151/6195] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:25:00.668609 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3609325d-265d-4666-a412-45349cb51f13 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:00.669322 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3609325d-265d-4666-a412-45349cb51f13 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:00.676731 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3609325d-265d-4666-a412-45349cb51f13 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:00.677190 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3609325d-265d-4666-a412-45349cb51f13 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:00.678053 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3609325d-265d-4666-a412-45349cb51f13 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:00.678509 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3609325d-265d-4666-a412-45349cb51f13 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:00.699694 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-3609325d-265d-4666-a412-45349cb51f13 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] HTTP exception thrown: Instance aa0fc355-e74b-48b4-b709-e7c2282eb7d2 could not be found. Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3609325d-265d-4666-a412-45349cb51f13 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Request method failure captured: Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 HTTP/1.1 Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi7AC88_3mXFNBVA58vSc9gzyAOAIU3aAw0oCRJ291MKLYLCmu0s68GXO_cWn9fxE9GhYm51yIQ7IYZ-MiVShBWqs6tvk3fauOqrFNBdtyLYTPFYlwjL_-43-G5i-Ot0XKY0hYktmdxNd-djcSk7lSUuWtrmy7CU2kn_7CvB-wrr9J6qk Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 66d2c5298f274b42a52821d298f9aee5 Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-DeleteServersTestJSON-1156725931 Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/66d2c5298f274b42a52821d298f9aee5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_66d2c5298f274b42a52821d298f9aee5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/66d2c5298f274b42a52821d298f9aee5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/66d2c5298f274b42a52821d298f9aee5"}]}] Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-DeleteServersTestJSON-1156725931 Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 66d2c5298f274b42a52821d298f9aee5 Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-DeleteServersTestJSON-1156725931 Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-DeleteServersTestJSON-1156725931-project Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 58931fcbf39143bf989eef3a27a3a1b7 Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-DeleteServersTestJSON-1156725931-project Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance aa0fc355-e74b-48b4-b709-e7c2282eb7d2 could not be found. Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'aa0fc355-e74b-48b4-b709-e7c2282eb7d2'} Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa0fc355-e74b-48b4-b709-e7c2282eb7d2 could not be found. Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa0fc355-e74b-48b4-b709-e7c2282eb7d2 could not be found. Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:25:00.703203 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:25:00.708889 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:25:00.708889 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:25:00.708889 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:25:00.708889 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:25:00.708889 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:25:00.708889 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa0fc355-e74b-48b4-b709-e7c2282eb7d2 could not be found. Aug 04 17:25:00.708889 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:25:00.708889 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3609325d-265d-4666-a412-45349cb51f13 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Returning 404 to user: Instance aa0fc355-e74b-48b4-b709-e7c2282eb7d2 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:25:00.708889 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3609325d-265d-4666-a412-45349cb51f13 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 404 len: 111 microversion: 2.1 time: 0.039051 Aug 04 17:25:00.708889 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3045/6196] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:00 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:25:00.719892 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a091f6b3-7bc6-416e-8639-7f864323948f tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:00.720514 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a091f6b3-7bc6-416e-8639-7f864323948f tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:00.727639 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a091f6b3-7bc6-416e-8639-7f864323948f tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:00.728077 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a091f6b3-7bc6-416e-8639-7f864323948f tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:00.728836 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a091f6b3-7bc6-416e-8639-7f864323948f tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:00.729323 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a091f6b3-7bc6-416e-8639-7f864323948f tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:00.744218 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-a091f6b3-7bc6-416e-8639-7f864323948f tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] HTTP exception thrown: Instance aa0fc355-e74b-48b4-b709-e7c2282eb7d2 could not be found. Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a091f6b3-7bc6-416e-8639-7f864323948f tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Request method failure captured: Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 HTTP/1.1 Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi7AC88_3mXFNBVA58vSc9gzyAOAIU3aAw0oCRJ291MKLYLCmu0s68GXO_cWn9fxE9GhYm51yIQ7IYZ-MiVShBWqs6tvk3fauOqrFNBdtyLYTPFYlwjL_-43-G5i-Ot0XKY0hYktmdxNd-djcSk7lSUuWtrmy7CU2kn_7CvB-wrr9J6qk Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 66d2c5298f274b42a52821d298f9aee5 Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-DeleteServersTestJSON-1156725931 Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/66d2c5298f274b42a52821d298f9aee5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_66d2c5298f274b42a52821d298f9aee5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/66d2c5298f274b42a52821d298f9aee5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/66d2c5298f274b42a52821d298f9aee5"}]}] Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-DeleteServersTestJSON-1156725931 Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 66d2c5298f274b42a52821d298f9aee5 Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-DeleteServersTestJSON-1156725931 Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-DeleteServersTestJSON-1156725931-project Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 58931fcbf39143bf989eef3a27a3a1b7 Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-DeleteServersTestJSON-1156725931-project Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance aa0fc355-e74b-48b4-b709-e7c2282eb7d2 could not be found. Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'aa0fc355-e74b-48b4-b709-e7c2282eb7d2'} Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa0fc355-e74b-48b4-b709-e7c2282eb7d2 could not be found. Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:25:00.745979 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:25:00.751152 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa0fc355-e74b-48b4-b709-e7c2282eb7d2 could not be found. Aug 04 17:25:00.751152 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:25:00.751152 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:25:00.751152 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:25:00.751152 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:25:00.751152 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:25:00.751152 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:25:00.751152 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:25:00.751152 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:25:00.751152 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa0fc355-e74b-48b4-b709-e7c2282eb7d2 could not be found. Aug 04 17:25:00.751152 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:25:00.751152 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a091f6b3-7bc6-416e-8639-7f864323948f tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Returning 404 to user: Instance aa0fc355-e74b-48b4-b709-e7c2282eb7d2 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:25:00.751152 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a091f6b3-7bc6-416e-8639-7f864323948f tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "DELETE /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 404 len: 111 microversion: 2.1 time: 0.032725 Aug 04 17:25:00.751152 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3152/6197] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:25:00 2022] DELETE /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:25:00.759431 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c3f08e4c-f06d-4626-8b59-0651cd8caae8 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:00.760060 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c3f08e4c-f06d-4626-8b59-0651cd8caae8 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] [instance: aa0fc355-e74b-48b4-b709-e7c2282eb7d2] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:00.766475 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c3f08e4c-f06d-4626-8b59-0651cd8caae8 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:00.766939 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c3f08e4c-f06d-4626-8b59-0651cd8caae8 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:00.767706 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c3f08e4c-f06d-4626-8b59-0651cd8caae8 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:00.768155 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c3f08e4c-f06d-4626-8b59-0651cd8caae8 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:00.782740 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-c3f08e4c-f06d-4626-8b59-0651cd8caae8 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] HTTP exception thrown: Instance aa0fc355-e74b-48b4-b709-e7c2282eb7d2 could not be found. Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c3f08e4c-f06d-4626-8b59-0651cd8caae8 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Request method failure captured: Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 HTTP/1.1 Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi7AC88_3mXFNBVA58vSc9gzyAOAIU3aAw0oCRJ291MKLYLCmu0s68GXO_cWn9fxE9GhYm51yIQ7IYZ-MiVShBWqs6tvk3fauOqrFNBdtyLYTPFYlwjL_-43-G5i-Ot0XKY0hYktmdxNd-djcSk7lSUuWtrmy7CU2kn_7CvB-wrr9J6qk Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 66d2c5298f274b42a52821d298f9aee5 Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-DeleteServersTestJSON-1156725931 Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/66d2c5298f274b42a52821d298f9aee5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_66d2c5298f274b42a52821d298f9aee5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/66d2c5298f274b42a52821d298f9aee5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/66d2c5298f274b42a52821d298f9aee5"}]}] Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-DeleteServersTestJSON-1156725931 Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 66d2c5298f274b42a52821d298f9aee5 Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-DeleteServersTestJSON-1156725931 Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-DeleteServersTestJSON-1156725931-project Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 58931fcbf39143bf989eef3a27a3a1b7 Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-DeleteServersTestJSON-1156725931-project Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance aa0fc355-e74b-48b4-b709-e7c2282eb7d2 could not be found. Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'aa0fc355-e74b-48b4-b709-e7c2282eb7d2'} Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa0fc355-e74b-48b4-b709-e7c2282eb7d2 could not be found. Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa0fc355-e74b-48b4-b709-e7c2282eb7d2 could not be found. Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:25:00.784419 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:25:00.789730 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:25:00.789730 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:25:00.789730 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:25:00.789730 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:25:00.789730 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:25:00.789730 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa0fc355-e74b-48b4-b709-e7c2282eb7d2 could not be found. Aug 04 17:25:00.789730 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:25:00.789730 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c3f08e4c-f06d-4626-8b59-0651cd8caae8 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] Returning 404 to user: Instance aa0fc355-e74b-48b4-b709-e7c2282eb7d2 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:25:00.789730 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c3f08e4c-f06d-4626-8b59-0651cd8caae8 tempest-DeleteServersTestJSON-1156725931 tempest-DeleteServersTestJSON-1156725931-project] 10.222.0.23 "GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2" status: 404 len: 111 microversion: 2.1 time: 0.031493 Aug 04 17:25:00.789730 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3046/6198] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:00 2022] GET /compute/v2.1/servers/aa0fc355-e74b-48b4-b709-e7c2282eb7d2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:25:09.900146 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-245252f9-c317-4971-9d7b-e9cc3bf2ee10 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-429006886", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "46f94fe5-b444-4955-9a90-d3107840b2d3"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:25:09.962311 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-245252f9-c317-4971-9d7b-e9cc3bf2ee10 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] validate_networks() for [('46f94fe5-b444-4955-9a90-d3107840b2d3', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:25:10.735025 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=39 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:25:10.744436 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-245252f9-c317-4971-9d7b-e9cc3bf2ee10 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:25:10.744854 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-245252f9-c317-4971-9d7b-e9cc3bf2ee10 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:25:10.745389 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-245252f9-c317-4971-9d7b-e9cc3bf2ee10 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:25:10.745801 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-245252f9-c317-4971-9d7b-e9cc3bf2ee10 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:25:10.746240 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-245252f9-c317-4971-9d7b-e9cc3bf2ee10 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:25:10.759407 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-245252f9-c317-4971-9d7b-e9cc3bf2ee10 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:10.759407 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-245252f9-c317-4971-9d7b-e9cc3bf2ee10 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:10.759864 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-245252f9-c317-4971-9d7b-e9cc3bf2ee10 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:10.760633 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-245252f9-c317-4971-9d7b-e9cc3bf2ee10 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:10.786574 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-245252f9-c317-4971-9d7b-e9cc3bf2ee10 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Getting quotas for project 0b37e2d7733f49c793191c605ed144a3. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:25:10.794031 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-245252f9-c317-4971-9d7b-e9cc3bf2ee10 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Getting quotas for user ed877f47f8ff48fbacf893156ff08d21 and project 0b37e2d7733f49c793191c605ed144a3. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:25:10.811032 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-245252f9-c317-4971-9d7b-e9cc3bf2ee10 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:25:10.813498 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-245252f9-c317-4971-9d7b-e9cc3bf2ee10 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:25:10.863924 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-245252f9-c317-4971-9d7b-e9cc3bf2ee10 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.096071 Aug 04 17:25:10.864739 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3153/6199] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:25:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:25:10.876124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f2ed1a23-a41c-47b0-a4b3-b0d8a3814e3f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:10.877565 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f2ed1a23-a41c-47b0-a4b3-b0d8a3814e3f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:10.881352 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:25:10.882383 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:25:10.944199 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f2ed1a23-a41c-47b0-a4b3-b0d8a3814e3f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:10.952730 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f2ed1a23-a41c-47b0-a4b3-b0d8a3814e3f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1217 microversion: 2.1 time: 0.080472 Aug 04 17:25:10.958418 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3047/6200] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:10 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:11.976837 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ff9e25ef-22e9-444c-a847-4dff4f7ca294 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:11.977544 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ff9e25ef-22e9-444c-a847-4dff4f7ca294 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:11.988411 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ff9e25ef-22e9-444c-a847-4dff4f7ca294 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:11.989156 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ff9e25ef-22e9-444c-a847-4dff4f7ca294 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:11.990867 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ff9e25ef-22e9-444c-a847-4dff4f7ca294 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:11.991449 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ff9e25ef-22e9-444c-a847-4dff4f7ca294 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:12.096725 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ff9e25ef-22e9-444c-a847-4dff4f7ca294 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:12.107657 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ff9e25ef-22e9-444c-a847-4dff4f7ca294 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1277 microversion: 2.1 time: 0.136008 Aug 04 17:25:12.109716 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3154/6201] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:11 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1277 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:13.130889 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9ad6626a-f487-4096-845d-0671b6b65de9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:13.133172 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9ad6626a-f487-4096-845d-0671b6b65de9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:13.142893 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9ad6626a-f487-4096-845d-0671b6b65de9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:13.143773 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9ad6626a-f487-4096-845d-0671b6b65de9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:13.145178 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9ad6626a-f487-4096-845d-0671b6b65de9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:13.145943 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9ad6626a-f487-4096-845d-0671b6b65de9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:13.366489 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9ad6626a-f487-4096-845d-0671b6b65de9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:13.375703 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9ad6626a-f487-4096-845d-0671b6b65de9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1317 microversion: 2.1 time: 0.249238 Aug 04 17:25:13.376415 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3048/6202] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:13 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1317 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:13.658062 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-9424a80d-0ba6-423a-bcfe-3f4aba71274e req-1c5541e3-d85e-469b-b0cf-c22653544323 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bf59992-9f2d-494c-a846-af3cf6d6a364", "tag": "ce003aa3-0c87-4f76-9f42-4a7d8eeb981a"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:25:13.670968 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-9424a80d-0ba6-423a-bcfe-3f4aba71274e req-1c5541e3-d85e-469b-b0cf-c22653544323 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:13.671758 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-9424a80d-0ba6-423a-bcfe-3f4aba71274e req-1c5541e3-d85e-469b-b0cf-c22653544323 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:13.683740 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-9424a80d-0ba6-423a-bcfe-3f4aba71274e req-1c5541e3-d85e-469b-b0cf-c22653544323 service nova] Creating event network-changed:ce003aa3-0c87-4f76-9f42-4a7d8eeb981a for instance 3bf59992-9f2d-494c-a846-af3cf6d6a364 on n-h1-846466-12 Aug 04 17:25:13.688933 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-9424a80d-0ba6-423a-bcfe-3f4aba71274e req-1c5541e3-d85e-469b-b0cf-c22653544323 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035231 Aug 04 17:25:13.689536 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3155/6203] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:25:14.399471 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2f28fb8a-2c5a-44a9-9563-de36e0221bbd tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:14.400076 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2f28fb8a-2c5a-44a9-9563-de36e0221bbd tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:14.407607 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f28fb8a-2c5a-44a9-9563-de36e0221bbd tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:14.408063 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f28fb8a-2c5a-44a9-9563-de36e0221bbd tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:14.408830 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f28fb8a-2c5a-44a9-9563-de36e0221bbd tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:14.409268 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f28fb8a-2c5a-44a9-9563-de36e0221bbd tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:14.557315 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2f28fb8a-2c5a-44a9-9563-de36e0221bbd tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:14.565297 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2f28fb8a-2c5a-44a9-9563-de36e0221bbd tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1317 microversion: 2.1 time: 0.170741 Aug 04 17:25:14.565893 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3049/6204] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:14 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:15.587659 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-354b866b-aa01-4186-922a-c65157f04fa8 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:15.588358 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-354b866b-aa01-4186-922a-c65157f04fa8 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:15.594968 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-354b866b-aa01-4186-922a-c65157f04fa8 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:15.595413 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-354b866b-aa01-4186-922a-c65157f04fa8 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:15.596192 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-354b866b-aa01-4186-922a-c65157f04fa8 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:15.596675 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-354b866b-aa01-4186-922a-c65157f04fa8 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:15.765067 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-354b866b-aa01-4186-922a-c65157f04fa8 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:15.773429 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-354b866b-aa01-4186-922a-c65157f04fa8 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1317 microversion: 2.1 time: 0.190822 Aug 04 17:25:15.774019 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3156/6205] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:15 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:16.794779 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0d7dd658-eb57-4e88-91f0-b0e0a04f3566 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:16.795416 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0d7dd658-eb57-4e88-91f0-b0e0a04f3566 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:16.803145 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0d7dd658-eb57-4e88-91f0-b0e0a04f3566 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:16.803641 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0d7dd658-eb57-4e88-91f0-b0e0a04f3566 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:16.804564 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0d7dd658-eb57-4e88-91f0-b0e0a04f3566 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:16.805020 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0d7dd658-eb57-4e88-91f0-b0e0a04f3566 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:16.947154 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0d7dd658-eb57-4e88-91f0-b0e0a04f3566 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:16.954892 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0d7dd658-eb57-4e88-91f0-b0e0a04f3566 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1317 microversion: 2.1 time: 0.164099 Aug 04 17:25:16.955457 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3050/6206] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:16 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:25:17.978256 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5a7745e2-5511-43c3-92ae-498b2aab8c7d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:17.978833 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5a7745e2-5511-43c3-92ae-498b2aab8c7d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:17.986121 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5a7745e2-5511-43c3-92ae-498b2aab8c7d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:17.986558 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5a7745e2-5511-43c3-92ae-498b2aab8c7d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:17.987345 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5a7745e2-5511-43c3-92ae-498b2aab8c7d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:17.987775 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5a7745e2-5511-43c3-92ae-498b2aab8c7d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:18.132252 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5a7745e2-5511-43c3-92ae-498b2aab8c7d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:18.145718 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5a7745e2-5511-43c3-92ae-498b2aab8c7d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1317 microversion: 2.1 time: 0.172735 Aug 04 17:25:18.146476 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3157/6207] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:17 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:18.584246 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-71911ae2-9448-4174-afe1-d8d141debccc req-6a9531c1-750a-4ebb-8ffb-ae5b0d7054c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bf59992-9f2d-494c-a846-af3cf6d6a364", "name": "network-vif-plugged", "status": "completed", "tag": "ce003aa3-0c87-4f76-9f42-4a7d8eeb981a"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:25:18.595947 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-71911ae2-9448-4174-afe1-d8d141debccc req-6a9531c1-750a-4ebb-8ffb-ae5b0d7054c8 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:18.596381 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-71911ae2-9448-4174-afe1-d8d141debccc req-6a9531c1-750a-4ebb-8ffb-ae5b0d7054c8 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:18.608432 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-71911ae2-9448-4174-afe1-d8d141debccc req-6a9531c1-750a-4ebb-8ffb-ae5b0d7054c8 service nova] Creating event network-vif-plugged:ce003aa3-0c87-4f76-9f42-4a7d8eeb981a for instance 3bf59992-9f2d-494c-a846-af3cf6d6a364 on n-h1-846466-12 Aug 04 17:25:18.613682 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-71911ae2-9448-4174-afe1-d8d141debccc req-6a9531c1-750a-4ebb-8ffb-ae5b0d7054c8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033355 Aug 04 17:25:18.614307 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3051/6208] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:25:19.168701 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b75fe2e8-97ac-4501-ad5c-8a60f8bf72a8 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:19.169298 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b75fe2e8-97ac-4501-ad5c-8a60f8bf72a8 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:19.178885 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b75fe2e8-97ac-4501-ad5c-8a60f8bf72a8 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:19.179349 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b75fe2e8-97ac-4501-ad5c-8a60f8bf72a8 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:19.180209 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b75fe2e8-97ac-4501-ad5c-8a60f8bf72a8 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:19.180610 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b75fe2e8-97ac-4501-ad5c-8a60f8bf72a8 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:19.325055 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b75fe2e8-97ac-4501-ad5c-8a60f8bf72a8 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:19.336711 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b75fe2e8-97ac-4501-ad5c-8a60f8bf72a8 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1317 microversion: 2.1 time: 0.171866 Aug 04 17:25:19.337352 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3158/6209] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:19 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:20.364580 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-beb96b83-4d5d-4ee4-ba86-ff9b69e5bd4f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:20.365306 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-beb96b83-4d5d-4ee4-ba86-ff9b69e5bd4f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:20.372976 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-beb96b83-4d5d-4ee4-ba86-ff9b69e5bd4f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:20.373488 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-beb96b83-4d5d-4ee4-ba86-ff9b69e5bd4f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:20.374274 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-beb96b83-4d5d-4ee4-ba86-ff9b69e5bd4f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:20.374702 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-beb96b83-4d5d-4ee4-ba86-ff9b69e5bd4f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:20.525530 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-beb96b83-4d5d-4ee4-ba86-ff9b69e5bd4f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:20.533984 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-beb96b83-4d5d-4ee4-ba86-ff9b69e5bd4f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1506 microversion: 2.1 time: 0.175421 Aug 04 17:25:20.534585 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3052/6210] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:20 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1506 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:20.566070 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-037f48f8-0edb-45ed-a95f-983ee768aa33 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:20.567088 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-037f48f8-0edb-45ed-a95f-983ee768aa33 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:20.579928 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-037f48f8-0edb-45ed-a95f-983ee768aa33 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:20.580735 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-037f48f8-0edb-45ed-a95f-983ee768aa33 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:20.582136 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-037f48f8-0edb-45ed-a95f-983ee768aa33 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:20.582803 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-037f48f8-0edb-45ed-a95f-983ee768aa33 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:20.727357 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-037f48f8-0edb-45ed-a95f-983ee768aa33 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:20.735763 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-037f48f8-0edb-45ed-a95f-983ee768aa33 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1506 microversion: 2.1 time: 0.176580 Aug 04 17:25:20.736338 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3159/6211] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:20 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1506 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:20.756567 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-55f8d8e9-65b4-4333-8dc7-f44def1a74da tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:25:20.759112 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-55f8d8e9-65b4-4333-8dc7-f44def1a74da tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:20.766396 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-55f8d8e9-65b4-4333-8dc7-f44def1a74da tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:20.766767 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-55f8d8e9-65b4-4333-8dc7-f44def1a74da tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:20.767571 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-55f8d8e9-65b4-4333-8dc7-f44def1a74da tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:20.768011 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-55f8d8e9-65b4-4333-8dc7-f44def1a74da tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:20.839722 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-55f8d8e9-65b4-4333-8dc7-f44def1a74da tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "PUT /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1078 microversion: 2.1 time: 0.087088 Aug 04 17:25:20.840361 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3053/6212] 10.222.0.23 () {60 vars in 1256 bytes} [Thu Aug 4 17:25:20 2022] PUT /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1078 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:20.860559 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d1ce8621-86bd-4660-afdf-ead1d5bafc4a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:20.861428 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d1ce8621-86bd-4660-afdf-ead1d5bafc4a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:20.864441 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:25:20.865112 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:25:20.874731 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d1ce8621-86bd-4660-afdf-ead1d5bafc4a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:20.875218 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d1ce8621-86bd-4660-afdf-ead1d5bafc4a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:20.876415 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d1ce8621-86bd-4660-afdf-ead1d5bafc4a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:20.877092 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d1ce8621-86bd-4660-afdf-ead1d5bafc4a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:21.028939 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d1ce8621-86bd-4660-afdf-ead1d5bafc4a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:21.037097 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d1ce8621-86bd-4660-afdf-ead1d5bafc4a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1504 microversion: 2.1 time: 0.183140 Aug 04 17:25:21.037708 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3160/6213] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:20 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1504 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:21.057559 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-67a9cb5d-c82e-4edc-a000-76c878f81e8f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:21.058261 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-67a9cb5d-c82e-4edc-a000-76c878f81e8f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:21.060381 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:25:21.066411 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-67a9cb5d-c82e-4edc-a000-76c878f81e8f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:21.066869 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-67a9cb5d-c82e-4edc-a000-76c878f81e8f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:21.067651 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-67a9cb5d-c82e-4edc-a000-76c878f81e8f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:21.068109 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-67a9cb5d-c82e-4edc-a000-76c878f81e8f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:21.214281 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-67a9cb5d-c82e-4edc-a000-76c878f81e8f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:21.222578 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-67a9cb5d-c82e-4edc-a000-76c878f81e8f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1504 microversion: 2.1 time: 0.169133 Aug 04 17:25:21.223152 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3054/6214] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:21 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:21.243139 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6358c5d6-3935-4735-8015-474a4116218a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:25:21.245849 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6358c5d6-3935-4735-8015-474a4116218a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:21.253271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6358c5d6-3935-4735-8015-474a4116218a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:21.253741 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6358c5d6-3935-4735-8015-474a4116218a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:21.254833 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6358c5d6-3935-4735-8015-474a4116218a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:21.254957 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6358c5d6-3935-4735-8015-474a4116218a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:21.288510 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6358c5d6-3935-4735-8015-474a4116218a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:21.295602 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6358c5d6-3935-4735-8015-474a4116218a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Old instance type m1.heat2, new instance type m1.heat {{(pid=126125) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 17:25:21.302752 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-6358c5d6-3935-4735-8015-474a4116218a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:25:21.303227 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-6358c5d6-3935-4735-8015-474a4116218a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:25:21.303849 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-6358c5d6-3935-4735-8015-474a4116218a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:25:21.304298 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-6358c5d6-3935-4735-8015-474a4116218a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:25:21.304828 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-6358c5d6-3935-4735-8015-474a4116218a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:25:21.377670 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6358c5d6-3935-4735-8015-474a4116218a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "POST /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364/action" status: 202 len: 0 microversion: 2.1 time: 0.138415 Aug 04 17:25:21.378473 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3161/6215] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:25:21 2022] POST /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:25:21.387355 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-79399b9d-083b-406d-b7a8-d4e2899f99f5 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:21.387971 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-79399b9d-083b-406d-b7a8-d4e2899f99f5 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:21.396110 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-79399b9d-083b-406d-b7a8-d4e2899f99f5 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:21.396632 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-79399b9d-083b-406d-b7a8-d4e2899f99f5 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:21.397524 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-79399b9d-083b-406d-b7a8-d4e2899f99f5 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:21.398035 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-79399b9d-083b-406d-b7a8-d4e2899f99f5 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:21.540624 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-79399b9d-083b-406d-b7a8-d4e2899f99f5 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:21.548946 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-79399b9d-083b-406d-b7a8-d4e2899f99f5 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1515 microversion: 2.1 time: 0.165882 Aug 04 17:25:21.549600 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3055/6216] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:21 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:22.571516 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e671374a-0b7f-4e91-82b3-79bbf7824e3a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:22.572107 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e671374a-0b7f-4e91-82b3-79bbf7824e3a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:22.579431 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e671374a-0b7f-4e91-82b3-79bbf7824e3a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:22.579878 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e671374a-0b7f-4e91-82b3-79bbf7824e3a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:22.580633 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e671374a-0b7f-4e91-82b3-79bbf7824e3a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:22.581049 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e671374a-0b7f-4e91-82b3-79bbf7824e3a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:22.742687 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e671374a-0b7f-4e91-82b3-79bbf7824e3a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:22.751031 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e671374a-0b7f-4e91-82b3-79bbf7824e3a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1515 microversion: 2.1 time: 0.183627 Aug 04 17:25:22.751613 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3162/6217] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:22 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:23.773488 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e47f782b-f43b-42e9-b524-75d9aba73dfc tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:23.774116 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e47f782b-f43b-42e9-b524-75d9aba73dfc tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:23.781222 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e47f782b-f43b-42e9-b524-75d9aba73dfc tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:23.781702 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e47f782b-f43b-42e9-b524-75d9aba73dfc tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:23.782468 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e47f782b-f43b-42e9-b524-75d9aba73dfc tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:23.782903 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e47f782b-f43b-42e9-b524-75d9aba73dfc tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:23.922236 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e47f782b-f43b-42e9-b524-75d9aba73dfc tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:23.930350 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e47f782b-f43b-42e9-b524-75d9aba73dfc tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1520 microversion: 2.1 time: 0.161359 Aug 04 17:25:23.931009 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3056/6218] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:23 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:24.952588 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6d125afe-9e17-4046-9266-07b2598edb18 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:24.953226 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6d125afe-9e17-4046-9266-07b2598edb18 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:24.956025 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:25:24.961723 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d125afe-9e17-4046-9266-07b2598edb18 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:24.962168 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d125afe-9e17-4046-9266-07b2598edb18 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:24.962939 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d125afe-9e17-4046-9266-07b2598edb18 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:24.963368 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6d125afe-9e17-4046-9266-07b2598edb18 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:25.121844 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6d125afe-9e17-4046-9266-07b2598edb18 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:25.134709 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6d125afe-9e17-4046-9266-07b2598edb18 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1520 microversion: 2.1 time: 0.185831 Aug 04 17:25:25.135556 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3163/6219] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:24 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:26.157462 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fe0937c3-13e9-404e-aa45-93eeec8e721b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:26.158248 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fe0937c3-13e9-404e-aa45-93eeec8e721b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:26.165648 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fe0937c3-13e9-404e-aa45-93eeec8e721b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:26.166105 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fe0937c3-13e9-404e-aa45-93eeec8e721b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:26.166875 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fe0937c3-13e9-404e-aa45-93eeec8e721b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:26.167339 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fe0937c3-13e9-404e-aa45-93eeec8e721b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:26.314045 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fe0937c3-13e9-404e-aa45-93eeec8e721b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:26.322371 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fe0937c3-13e9-404e-aa45-93eeec8e721b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1520 microversion: 2.1 time: 0.168985 Aug 04 17:25:26.322949 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3057/6220] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:26 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:27.345232 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6a9b5677-5def-4bf8-943e-7a217f72a466 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:27.345900 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6a9b5677-5def-4bf8-943e-7a217f72a466 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:27.353594 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a9b5677-5def-4bf8-943e-7a217f72a466 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:27.354053 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a9b5677-5def-4bf8-943e-7a217f72a466 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:27.354813 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a9b5677-5def-4bf8-943e-7a217f72a466 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:27.355230 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a9b5677-5def-4bf8-943e-7a217f72a466 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:27.496751 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6a9b5677-5def-4bf8-943e-7a217f72a466 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:27.504795 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6a9b5677-5def-4bf8-943e-7a217f72a466 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1520 microversion: 2.1 time: 0.163855 Aug 04 17:25:27.505427 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3164/6221] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:27 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:28.526900 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c890a4a9-cefa-4a09-8e5e-39954282c760 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:28.527512 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c890a4a9-cefa-4a09-8e5e-39954282c760 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:28.535149 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c890a4a9-cefa-4a09-8e5e-39954282c760 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:28.535608 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c890a4a9-cefa-4a09-8e5e-39954282c760 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:28.536385 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c890a4a9-cefa-4a09-8e5e-39954282c760 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:28.536811 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c890a4a9-cefa-4a09-8e5e-39954282c760 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:28.679739 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c890a4a9-cefa-4a09-8e5e-39954282c760 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:28.688532 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c890a4a9-cefa-4a09-8e5e-39954282c760 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1520 microversion: 2.1 time: 0.165623 Aug 04 17:25:28.689126 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3058/6222] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:28 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:29.710225 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fb33bb5e-715f-40dd-8a56-fb79e7fdef59 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:29.710868 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fb33bb5e-715f-40dd-8a56-fb79e7fdef59 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:29.718951 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fb33bb5e-715f-40dd-8a56-fb79e7fdef59 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:29.719426 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fb33bb5e-715f-40dd-8a56-fb79e7fdef59 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:29.720203 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fb33bb5e-715f-40dd-8a56-fb79e7fdef59 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:29.720635 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fb33bb5e-715f-40dd-8a56-fb79e7fdef59 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:29.867399 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fb33bb5e-715f-40dd-8a56-fb79e7fdef59 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:29.879682 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fb33bb5e-715f-40dd-8a56-fb79e7fdef59 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1520 microversion: 2.1 time: 0.173259 Aug 04 17:25:29.880584 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3165/6223] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:29 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:30.905410 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b179ccd6-94b9-45c0-ab3b-4cb13bf9eb3d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:30.906094 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b179ccd6-94b9-45c0-ab3b-4cb13bf9eb3d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:30.913567 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b179ccd6-94b9-45c0-ab3b-4cb13bf9eb3d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:30.914132 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b179ccd6-94b9-45c0-ab3b-4cb13bf9eb3d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:30.914911 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b179ccd6-94b9-45c0-ab3b-4cb13bf9eb3d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:30.915353 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b179ccd6-94b9-45c0-ab3b-4cb13bf9eb3d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:31.063647 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b179ccd6-94b9-45c0-ab3b-4cb13bf9eb3d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:31.075561 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b179ccd6-94b9-45c0-ab3b-4cb13bf9eb3d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1520 microversion: 2.1 time: 0.174194 Aug 04 17:25:31.076173 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3059/6224] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:30 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:32.097417 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5b0b24aa-5595-4891-b156-3e549811ed48 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:32.098059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5b0b24aa-5595-4891-b156-3e549811ed48 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:32.105897 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5b0b24aa-5595-4891-b156-3e549811ed48 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:32.106331 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5b0b24aa-5595-4891-b156-3e549811ed48 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:32.107110 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5b0b24aa-5595-4891-b156-3e549811ed48 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:32.107540 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5b0b24aa-5595-4891-b156-3e549811ed48 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:32.258072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5b0b24aa-5595-4891-b156-3e549811ed48 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:32.266438 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5b0b24aa-5595-4891-b156-3e549811ed48 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1520 microversion: 2.1 time: 0.172760 Aug 04 17:25:32.266988 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3166/6225] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:32 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:33.288203 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-abc86711-3c16-43ee-a365-6d1d5ae462b8 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:33.288797 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-abc86711-3c16-43ee-a365-6d1d5ae462b8 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:33.296548 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-abc86711-3c16-43ee-a365-6d1d5ae462b8 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:33.297000 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-abc86711-3c16-43ee-a365-6d1d5ae462b8 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:33.297821 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-abc86711-3c16-43ee-a365-6d1d5ae462b8 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:33.298618 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-abc86711-3c16-43ee-a365-6d1d5ae462b8 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:33.439806 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-abc86711-3c16-43ee-a365-6d1d5ae462b8 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:33.447835 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-abc86711-3c16-43ee-a365-6d1d5ae462b8 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1520 microversion: 2.1 time: 0.163587 Aug 04 17:25:33.448390 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3060/6226] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:33 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:34.470139 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bc8ef29e-96a0-4783-a732-cb61fe360749 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:34.471370 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bc8ef29e-96a0-4783-a732-cb61fe360749 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:34.479268 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bc8ef29e-96a0-4783-a732-cb61fe360749 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:34.479813 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bc8ef29e-96a0-4783-a732-cb61fe360749 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:34.480679 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bc8ef29e-96a0-4783-a732-cb61fe360749 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:34.481108 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bc8ef29e-96a0-4783-a732-cb61fe360749 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:34.627450 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bc8ef29e-96a0-4783-a732-cb61fe360749 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:34.635864 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bc8ef29e-96a0-4783-a732-cb61fe360749 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1520 microversion: 2.1 time: 0.170468 Aug 04 17:25:34.636496 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3167/6227] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:34 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:35.659420 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bf262ed7-f1ee-4c34-9f92-2e048fdd9c7f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:35.660078 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bf262ed7-f1ee-4c34-9f92-2e048fdd9c7f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:35.667433 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf262ed7-f1ee-4c34-9f92-2e048fdd9c7f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:35.667861 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf262ed7-f1ee-4c34-9f92-2e048fdd9c7f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:35.668624 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf262ed7-f1ee-4c34-9f92-2e048fdd9c7f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:35.669067 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf262ed7-f1ee-4c34-9f92-2e048fdd9c7f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:35.827978 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bf262ed7-f1ee-4c34-9f92-2e048fdd9c7f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:35.836812 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bf262ed7-f1ee-4c34-9f92-2e048fdd9c7f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1520 microversion: 2.1 time: 0.181665 Aug 04 17:25:35.837427 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3061/6228] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:35 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:35.932944 n-d-846466-12 devstack@n-api.service[126125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:25:35.933559 n-d-846466-12 devstack@n-api.service[126125]: Thu Aug 4 17:25:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 17:25:36.858351 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-093cb014-023e-454c-a03d-981f3e31399a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:36.858954 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-093cb014-023e-454c-a03d-981f3e31399a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:36.866751 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-093cb014-023e-454c-a03d-981f3e31399a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:36.867189 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-093cb014-023e-454c-a03d-981f3e31399a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:36.867953 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-093cb014-023e-454c-a03d-981f3e31399a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:36.868493 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-093cb014-023e-454c-a03d-981f3e31399a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:37.005944 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-093cb014-023e-454c-a03d-981f3e31399a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:37.013737 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-093cb014-023e-454c-a03d-981f3e31399a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1520 microversion: 2.1 time: 0.159310 Aug 04 17:25:37.014309 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3168/6229] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:36 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:38.036173 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c8574392-5451-42a3-9386-f22cab4ae11e tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:38.036961 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c8574392-5451-42a3-9386-f22cab4ae11e tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:38.044371 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c8574392-5451-42a3-9386-f22cab4ae11e tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:38.044835 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c8574392-5451-42a3-9386-f22cab4ae11e tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:38.045645 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c8574392-5451-42a3-9386-f22cab4ae11e tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:38.046094 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c8574392-5451-42a3-9386-f22cab4ae11e tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:38.180239 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c8574392-5451-42a3-9386-f22cab4ae11e tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:38.188096 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c8574392-5451-42a3-9386-f22cab4ae11e tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1520 microversion: 2.1 time: 0.155935 Aug 04 17:25:38.188704 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3062/6230] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:38 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:39.209361 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4bda1f09-ea99-4501-be19-710cd8351238 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:39.210002 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4bda1f09-ea99-4501-be19-710cd8351238 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:39.217401 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4bda1f09-ea99-4501-be19-710cd8351238 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:39.217862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4bda1f09-ea99-4501-be19-710cd8351238 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:39.218631 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4bda1f09-ea99-4501-be19-710cd8351238 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:39.219049 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4bda1f09-ea99-4501-be19-710cd8351238 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:39.238931 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:25:39.368780 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4bda1f09-ea99-4501-be19-710cd8351238 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:39.376724 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4bda1f09-ea99-4501-be19-710cd8351238 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1520 microversion: 2.1 time: 0.171487 Aug 04 17:25:39.377405 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3169/6231] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:39 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:40.398898 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a715fcc6-3051-405a-bf39-c2c7f37159b0 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:40.399543 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a715fcc6-3051-405a-bf39-c2c7f37159b0 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:40.406967 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a715fcc6-3051-405a-bf39-c2c7f37159b0 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:40.407450 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a715fcc6-3051-405a-bf39-c2c7f37159b0 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:40.408396 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a715fcc6-3051-405a-bf39-c2c7f37159b0 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:40.408888 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a715fcc6-3051-405a-bf39-c2c7f37159b0 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:40.544680 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a715fcc6-3051-405a-bf39-c2c7f37159b0 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:40.553966 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a715fcc6-3051-405a-bf39-c2c7f37159b0 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1520 microversion: 2.1 time: 0.159275 Aug 04 17:25:40.554572 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3063/6232] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:40 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:41.576129 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a88bd1dd-140c-45de-bde2-140299364d80 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:41.577147 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a88bd1dd-140c-45de-bde2-140299364d80 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:41.588596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a88bd1dd-140c-45de-bde2-140299364d80 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:41.589184 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a88bd1dd-140c-45de-bde2-140299364d80 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:41.590248 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a88bd1dd-140c-45de-bde2-140299364d80 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:41.590943 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a88bd1dd-140c-45de-bde2-140299364d80 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:41.759071 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a88bd1dd-140c-45de-bde2-140299364d80 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:41.767151 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a88bd1dd-140c-45de-bde2-140299364d80 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1520 microversion: 2.1 time: 0.195345 Aug 04 17:25:41.768443 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3170/6233] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:41 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:42.790497 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-05177f63-e0de-4db5-9115-f569470b2368 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:42.791181 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-05177f63-e0de-4db5-9115-f569470b2368 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:42.794032 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=37 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:25:42.800019 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-05177f63-e0de-4db5-9115-f569470b2368 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:42.800478 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-05177f63-e0de-4db5-9115-f569470b2368 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:42.801269 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-05177f63-e0de-4db5-9115-f569470b2368 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:42.801743 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-05177f63-e0de-4db5-9115-f569470b2368 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:42.804737 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:25:42.943749 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-05177f63-e0de-4db5-9115-f569470b2368 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:42.951675 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-05177f63-e0de-4db5-9115-f569470b2368 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1520 microversion: 2.1 time: 0.165195 Aug 04 17:25:42.952278 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3064/6234] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:42 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:43.972760 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3cf572a8-c829-4e98-bec0-8d45add68f2b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:43.973584 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3cf572a8-c829-4e98-bec0-8d45add68f2b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:43.981896 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3cf572a8-c829-4e98-bec0-8d45add68f2b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:43.982347 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3cf572a8-c829-4e98-bec0-8d45add68f2b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:43.983142 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3cf572a8-c829-4e98-bec0-8d45add68f2b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:43.983577 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3cf572a8-c829-4e98-bec0-8d45add68f2b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:44.151942 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3cf572a8-c829-4e98-bec0-8d45add68f2b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:44.160364 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3cf572a8-c829-4e98-bec0-8d45add68f2b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1520 microversion: 2.1 time: 0.191776 Aug 04 17:25:44.160961 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3171/6235] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:43 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:45.181921 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e247dd29-390a-4082-ae0c-80f0a8315ea4 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:45.182562 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e247dd29-390a-4082-ae0c-80f0a8315ea4 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:45.191360 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e247dd29-390a-4082-ae0c-80f0a8315ea4 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:45.191820 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e247dd29-390a-4082-ae0c-80f0a8315ea4 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:45.192625 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e247dd29-390a-4082-ae0c-80f0a8315ea4 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:45.193065 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e247dd29-390a-4082-ae0c-80f0a8315ea4 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:45.356439 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e247dd29-390a-4082-ae0c-80f0a8315ea4 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:45.367249 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e247dd29-390a-4082-ae0c-80f0a8315ea4 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1520 microversion: 2.1 time: 0.189158 Aug 04 17:25:45.367915 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3065/6236] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:45 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:46.388700 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e45a4e9b-46d4-456b-a0e0-947e565ecd84 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:46.389422 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e45a4e9b-46d4-456b-a0e0-947e565ecd84 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:46.397795 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e45a4e9b-46d4-456b-a0e0-947e565ecd84 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:46.398260 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e45a4e9b-46d4-456b-a0e0-947e565ecd84 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:46.399059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e45a4e9b-46d4-456b-a0e0-947e565ecd84 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:46.399470 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e45a4e9b-46d4-456b-a0e0-947e565ecd84 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:46.549930 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e45a4e9b-46d4-456b-a0e0-947e565ecd84 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:46.559159 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e45a4e9b-46d4-456b-a0e0-947e565ecd84 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1520 microversion: 2.1 time: 0.174306 Aug 04 17:25:46.559752 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3172/6237] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:46 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:47.581123 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-879c3f2f-5b90-4a87-8a93-de884751fd31 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:47.581987 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-879c3f2f-5b90-4a87-8a93-de884751fd31 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:47.589711 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-879c3f2f-5b90-4a87-8a93-de884751fd31 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:47.590337 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-879c3f2f-5b90-4a87-8a93-de884751fd31 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:47.590946 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-879c3f2f-5b90-4a87-8a93-de884751fd31 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:47.591378 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-879c3f2f-5b90-4a87-8a93-de884751fd31 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:47.742413 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-879c3f2f-5b90-4a87-8a93-de884751fd31 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:47.751510 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-879c3f2f-5b90-4a87-8a93-de884751fd31 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1520 microversion: 2.1 time: 0.174881 Aug 04 17:25:47.752147 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3066/6238] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:47 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:48.773327 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ba362378-d722-4c49-92d7-82a60df752c1 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:48.774188 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ba362378-d722-4c49-92d7-82a60df752c1 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:48.782826 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba362378-d722-4c49-92d7-82a60df752c1 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:48.783268 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba362378-d722-4c49-92d7-82a60df752c1 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:48.784392 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba362378-d722-4c49-92d7-82a60df752c1 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:48.785053 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba362378-d722-4c49-92d7-82a60df752c1 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:48.930659 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ba362378-d722-4c49-92d7-82a60df752c1 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:48.938622 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ba362378-d722-4c49-92d7-82a60df752c1 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1520 microversion: 2.1 time: 0.170066 Aug 04 17:25:48.939209 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3173/6239] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:48 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:49.962743 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f7acee0f-9beb-48a3-9cdf-0f3476e25726 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:49.963445 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f7acee0f-9beb-48a3-9cdf-0f3476e25726 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:49.970782 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f7acee0f-9beb-48a3-9cdf-0f3476e25726 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:49.971309 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f7acee0f-9beb-48a3-9cdf-0f3476e25726 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:49.972088 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f7acee0f-9beb-48a3-9cdf-0f3476e25726 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:49.972531 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f7acee0f-9beb-48a3-9cdf-0f3476e25726 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:50.116950 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f7acee0f-9beb-48a3-9cdf-0f3476e25726 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:50.125420 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f7acee0f-9beb-48a3-9cdf-0f3476e25726 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1520 microversion: 2.1 time: 0.166496 Aug 04 17:25:50.126027 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3067/6240] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:49 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:51.150850 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-50582d5f-d4cb-4d1c-aee5-f30324bd3cb1 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:51.151936 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-50582d5f-d4cb-4d1c-aee5-f30324bd3cb1 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:51.160235 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50582d5f-d4cb-4d1c-aee5-f30324bd3cb1 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:51.160738 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50582d5f-d4cb-4d1c-aee5-f30324bd3cb1 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:51.161549 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50582d5f-d4cb-4d1c-aee5-f30324bd3cb1 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:51.161974 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50582d5f-d4cb-4d1c-aee5-f30324bd3cb1 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:51.318908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-50582d5f-d4cb-4d1c-aee5-f30324bd3cb1 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:51.327631 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-50582d5f-d4cb-4d1c-aee5-f30324bd3cb1 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1519 microversion: 2.1 time: 0.181072 Aug 04 17:25:51.328244 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3174/6241] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:51 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1519 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:51.382975 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-f985ba44-8058-48a9-bd43-a5d0d497b049 req-da126ef2-fa1a-45b7-ae50-9931cae7098b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bf59992-9f2d-494c-a846-af3cf6d6a364", "name": "network-vif-unplugged", "status": "completed", "tag": "ce003aa3-0c87-4f76-9f42-4a7d8eeb981a"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:25:51.394121 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f985ba44-8058-48a9-bd43-a5d0d497b049 req-da126ef2-fa1a-45b7-ae50-9931cae7098b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:51.395078 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f985ba44-8058-48a9-bd43-a5d0d497b049 req-da126ef2-fa1a-45b7-ae50-9931cae7098b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:51.408526 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-f985ba44-8058-48a9-bd43-a5d0d497b049 req-da126ef2-fa1a-45b7-ae50-9931cae7098b service nova] Creating event network-vif-unplugged:ce003aa3-0c87-4f76-9f42-4a7d8eeb981a for instance 3bf59992-9f2d-494c-a846-af3cf6d6a364 on n-h2-846466-12 Aug 04 17:25:51.414988 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [req-f985ba44-8058-48a9-bd43-a5d0d497b049 req-da126ef2-fa1a-45b7-ae50-9931cae7098b service nova] Instance 3bf59992-9f2d-494c-a846-af3cf6d6a364 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126126) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:25:51.427560 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-f985ba44-8058-48a9-bd43-a5d0d497b049 req-da126ef2-fa1a-45b7-ae50-9931cae7098b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048393 Aug 04 17:25:51.428429 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3068/6242] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:25:52.351543 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2f6f276e-9f6b-40f4-af8c-e12dd9b4b8f9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:52.352160 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2f6f276e-9f6b-40f4-af8c-e12dd9b4b8f9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:52.358836 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2f6f276e-9f6b-40f4-af8c-e12dd9b4b8f9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:52.359274 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2f6f276e-9f6b-40f4-af8c-e12dd9b4b8f9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:52.360045 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2f6f276e-9f6b-40f4-af8c-e12dd9b4b8f9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:52.360471 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2f6f276e-9f6b-40f4-af8c-e12dd9b4b8f9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:52.520421 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2f6f276e-9f6b-40f4-af8c-e12dd9b4b8f9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:52.528618 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2f6f276e-9f6b-40f4-af8c-e12dd9b4b8f9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1517 microversion: 2.1 time: 0.181101 Aug 04 17:25:52.529231 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3175/6243] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:52 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1517 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:53.446718 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-5c940ba7-2d70-4083-9294-60335bd86e82 req-fc2ed240-a738-4698-9d85-b7976e8985e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bf59992-9f2d-494c-a846-af3cf6d6a364", "tag": "ce003aa3-0c87-4f76-9f42-4a7d8eeb981a"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:25:53.457317 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-5c940ba7-2d70-4083-9294-60335bd86e82 req-fc2ed240-a738-4698-9d85-b7976e8985e6 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:53.457783 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-5c940ba7-2d70-4083-9294-60335bd86e82 req-fc2ed240-a738-4698-9d85-b7976e8985e6 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:53.471429 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-5c940ba7-2d70-4083-9294-60335bd86e82 req-fc2ed240-a738-4698-9d85-b7976e8985e6 service nova] Creating event network-changed:ce003aa3-0c87-4f76-9f42-4a7d8eeb981a for instance 3bf59992-9f2d-494c-a846-af3cf6d6a364 on n-h2-846466-12 Aug 04 17:25:53.477810 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [req-5c940ba7-2d70-4083-9294-60335bd86e82 req-fc2ed240-a738-4698-9d85-b7976e8985e6 service nova] Instance 3bf59992-9f2d-494c-a846-af3cf6d6a364 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126126) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:25:53.490207 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-5c940ba7-2d70-4083-9294-60335bd86e82 req-fc2ed240-a738-4698-9d85-b7976e8985e6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048785 Aug 04 17:25:53.490826 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3069/6244] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:25:53.550679 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b2abbfc7-fac6-4a1b-bca4-86dd95909c59 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:53.551265 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b2abbfc7-fac6-4a1b-bca4-86dd95909c59 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:53.558362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2abbfc7-fac6-4a1b-bca4-86dd95909c59 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:53.558811 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2abbfc7-fac6-4a1b-bca4-86dd95909c59 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:53.559604 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2abbfc7-fac6-4a1b-bca4-86dd95909c59 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:53.560041 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2abbfc7-fac6-4a1b-bca4-86dd95909c59 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:53.810526 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b2abbfc7-fac6-4a1b-bca4-86dd95909c59 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:53.821180 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b2abbfc7-fac6-4a1b-bca4-86dd95909c59 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1517 microversion: 2.1 time: 0.274543 Aug 04 17:25:53.829631 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3176/6245] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:53 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1517 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:54.844694 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-521d9a78-183a-4d0f-ab85-6f10bde23e6d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:54.845271 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-521d9a78-183a-4d0f-ab85-6f10bde23e6d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:54.853021 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-521d9a78-183a-4d0f-ab85-6f10bde23e6d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:54.853531 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-521d9a78-183a-4d0f-ab85-6f10bde23e6d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:54.854306 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-521d9a78-183a-4d0f-ab85-6f10bde23e6d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:54.854743 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-521d9a78-183a-4d0f-ab85-6f10bde23e6d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:54.992677 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-521d9a78-183a-4d0f-ab85-6f10bde23e6d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:55.004743 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-521d9a78-183a-4d0f-ab85-6f10bde23e6d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1514 microversion: 2.1 time: 0.164863 Aug 04 17:25:55.005718 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3070/6246] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:54 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:55.030405 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2de6b1d8-69d1-4753-b510-89181521999d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:25:55.031063 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2de6b1d8-69d1-4753-b510-89181521999d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:55.034035 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=28 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:25:55.040057 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2de6b1d8-69d1-4753-b510-89181521999d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:55.040503 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2de6b1d8-69d1-4753-b510-89181521999d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:55.041319 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2de6b1d8-69d1-4753-b510-89181521999d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:55.041766 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2de6b1d8-69d1-4753-b510-89181521999d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:55.113975 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2de6b1d8-69d1-4753-b510-89181521999d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "POST /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364/action" status: 204 len: 0 microversion: 2.1 time: 0.087203 Aug 04 17:25:55.114761 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3177/6247] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:25:55 2022] POST /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364/action => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:25:55.124930 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e10c1886-6f08-479d-8c03-4dc3e6c65e12 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:55.125574 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e10c1886-6f08-479d-8c03-4dc3e6c65e12 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:55.132196 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e10c1886-6f08-479d-8c03-4dc3e6c65e12 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:55.132649 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e10c1886-6f08-479d-8c03-4dc3e6c65e12 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:55.133448 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e10c1886-6f08-479d-8c03-4dc3e6c65e12 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:55.133886 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e10c1886-6f08-479d-8c03-4dc3e6c65e12 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:55.731418 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e10c1886-6f08-479d-8c03-4dc3e6c65e12 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:55.740248 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e10c1886-6f08-479d-8c03-4dc3e6c65e12 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1514 microversion: 2.1 time: 0.620387 Aug 04 17:25:55.740828 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3071/6248] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:55 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1514 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:56.767353 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-536a7b16-a670-47a0-83b3-6d8f3f06e3f0 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:56.768622 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-536a7b16-a670-47a0-83b3-6d8f3f06e3f0 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:56.780616 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-536a7b16-a670-47a0-83b3-6d8f3f06e3f0 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:56.781435 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-536a7b16-a670-47a0-83b3-6d8f3f06e3f0 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:56.782805 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-536a7b16-a670-47a0-83b3-6d8f3f06e3f0 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:56.783592 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-536a7b16-a670-47a0-83b3-6d8f3f06e3f0 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:56.947595 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-536a7b16-a670-47a0-83b3-6d8f3f06e3f0 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:56.955759 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-536a7b16-a670-47a0-83b3-6d8f3f06e3f0 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1514 microversion: 2.1 time: 0.197671 Aug 04 17:25:56.956350 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3178/6249] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:56 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1514 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:57.824922 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-9c6077ae-c590-4680-ac2c-279125a40275 req-29a0b825-85d0-42c1-b9fe-0d754d50b103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bf59992-9f2d-494c-a846-af3cf6d6a364", "name": "network-vif-plugged", "status": "completed", "tag": "ce003aa3-0c87-4f76-9f42-4a7d8eeb981a"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:25:57.838459 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-9c6077ae-c590-4680-ac2c-279125a40275 req-29a0b825-85d0-42c1-b9fe-0d754d50b103 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:57.839022 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-9c6077ae-c590-4680-ac2c-279125a40275 req-29a0b825-85d0-42c1-b9fe-0d754d50b103 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:57.850534 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-9c6077ae-c590-4680-ac2c-279125a40275 req-29a0b825-85d0-42c1-b9fe-0d754d50b103 service nova] Creating event network-vif-plugged:ce003aa3-0c87-4f76-9f42-4a7d8eeb981a for instance 3bf59992-9f2d-494c-a846-af3cf6d6a364 on n-h2-846466-12 Aug 04 17:25:57.855732 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-9c6077ae-c590-4680-ac2c-279125a40275 req-29a0b825-85d0-42c1-b9fe-0d754d50b103 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035759 Aug 04 17:25:57.856511 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3072/6250] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:25:57.978549 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bc0de2e6-78b1-470e-a9ce-39555f1841f0 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:57.979427 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bc0de2e6-78b1-470e-a9ce-39555f1841f0 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:57.987632 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bc0de2e6-78b1-470e-a9ce-39555f1841f0 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:57.988076 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bc0de2e6-78b1-470e-a9ce-39555f1841f0 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:57.988855 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bc0de2e6-78b1-470e-a9ce-39555f1841f0 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:57.989325 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bc0de2e6-78b1-470e-a9ce-39555f1841f0 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:58.134677 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bc0de2e6-78b1-470e-a9ce-39555f1841f0 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:58.143075 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bc0de2e6-78b1-470e-a9ce-39555f1841f0 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1506 microversion: 2.1 time: 0.168930 Aug 04 17:25:58.143712 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3179/6251] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:57 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:58.165222 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6d62108c-05d1-4f42-93e8-2b16fbc08abc tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:58.165959 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6d62108c-05d1-4f42-93e8-2b16fbc08abc tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:58.172562 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d62108c-05d1-4f42-93e8-2b16fbc08abc tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:58.173015 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d62108c-05d1-4f42-93e8-2b16fbc08abc tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:58.173833 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d62108c-05d1-4f42-93e8-2b16fbc08abc tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:58.174496 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d62108c-05d1-4f42-93e8-2b16fbc08abc tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:58.324499 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6d62108c-05d1-4f42-93e8-2b16fbc08abc tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:58.333816 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6d62108c-05d1-4f42-93e8-2b16fbc08abc tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1506 microversion: 2.1 time: 0.172826 Aug 04 17:25:58.334329 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3073/6252] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:58 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1506 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:58.365150 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b9fdc504-854d-414b-93ba-877a16f5457a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Action: 'create', calling method: .version_select at 0x7f7e77f871f0>, body: {"keypair": {"name": "tempest-keypair-1087895423", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTIJJJV8y0D+idXwxjOSbl89/gDxfGdlFEuxg/5gEbU554TK5wmaaspJMqoVpQwG7rBOzHxmqY2V8IX3KU+RvrpmbZMEeKaPBROgBulTSJOQICzQN8js9KukuOoBQfXxw=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:25:58.382511 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-b9fdc504-854d-414b-93ba-877a16f5457a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Getting quotas for project 0b37e2d7733f49c793191c605ed144a3. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:25:58.388484 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-b9fdc504-854d-414b-93ba-877a16f5457a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Getting quotas for user ed877f47f8ff48fbacf893156ff08d21 and project 0b37e2d7733f49c793191c605ed144a3. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:25:58.424513 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b9fdc504-854d-414b-93ba-877a16f5457a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.064347 Aug 04 17:25:58.425436 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3180/6253] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 17:25:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:25:59.820545 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3f747d60-67e2-4231-a08d-fc097a7addc5 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:59.821252 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3f747d60-67e2-4231-a08d-fc097a7addc5 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:59.828582 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3f747d60-67e2-4231-a08d-fc097a7addc5 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:59.829029 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3f747d60-67e2-4231-a08d-fc097a7addc5 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:59.829839 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3f747d60-67e2-4231-a08d-fc097a7addc5 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:25:59.830274 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3f747d60-67e2-4231-a08d-fc097a7addc5 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:25:59.979447 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3f747d60-67e2-4231-a08d-fc097a7addc5 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:59.988416 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3f747d60-67e2-4231-a08d-fc097a7addc5 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 200 len: 1506 microversion: 2.1 time: 0.174035 Aug 04 17:25:59.989027 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3074/6254] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:59 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 1506 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:00.010001 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-77d3d8c8-d791-45ce-a51c-fa3508c9c7e7 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:00.010646 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-77d3d8c8-d791-45ce-a51c-fa3508c9c7e7 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:00.017826 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-77d3d8c8-d791-45ce-a51c-fa3508c9c7e7 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:00.018319 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-77d3d8c8-d791-45ce-a51c-fa3508c9c7e7 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:00.019282 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-77d3d8c8-d791-45ce-a51c-fa3508c9c7e7 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:00.020092 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-77d3d8c8-d791-45ce-a51c-fa3508c9c7e7 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:00.047660 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-77d3d8c8-d791-45ce-a51c-fa3508c9c7e7 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:26:00.137013 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-77d3d8c8-d791-45ce-a51c-fa3508c9c7e7 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 204 len: 0 microversion: 2.1 time: 0.131610 Aug 04 17:26:00.138239 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3181/6255] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:26:00 2022] DELETE /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:26:00.211349 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9da13e55-b393-4876-8211-7b74a3752e99 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-380894122", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "46f94fe5-b444-4955-9a90-d3107840b2d3"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:26:00.272689 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-9da13e55-b393-4876-8211-7b74a3752e99 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] validate_networks() for [('46f94fe5-b444-4955-9a90-d3107840b2d3', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:26:00.711764 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9da13e55-b393-4876-8211-7b74a3752e99 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:26:00.712489 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9da13e55-b393-4876-8211-7b74a3752e99 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:26:00.713409 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9da13e55-b393-4876-8211-7b74a3752e99 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:26:00.714143 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9da13e55-b393-4876-8211-7b74a3752e99 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:26:00.714930 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9da13e55-b393-4876-8211-7b74a3752e99 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:26:00.728436 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9da13e55-b393-4876-8211-7b74a3752e99 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:00.728894 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9da13e55-b393-4876-8211-7b74a3752e99 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:00.729743 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9da13e55-b393-4876-8211-7b74a3752e99 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:00.730197 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9da13e55-b393-4876-8211-7b74a3752e99 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:00.749202 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-9da13e55-b393-4876-8211-7b74a3752e99 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Getting quotas for project 0b37e2d7733f49c793191c605ed144a3. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:26:00.756661 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-9da13e55-b393-4876-8211-7b74a3752e99 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Getting quotas for user ed877f47f8ff48fbacf893156ff08d21 and project 0b37e2d7733f49c793191c605ed144a3. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:26:00.771050 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9da13e55-b393-4876-8211-7b74a3752e99 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:26:00.773460 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9da13e55-b393-4876-8211-7b74a3752e99 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:26:00.822408 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9da13e55-b393-4876-8211-7b74a3752e99 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614839 Aug 04 17:26:00.823543 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3075/6256] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:26:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 17:26:00.843228 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4b91121f-aff6-4554-a5c0-6b2a3509ed8a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:00.844164 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4b91121f-aff6-4554-a5c0-6b2a3509ed8a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:00.905253 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4b91121f-aff6-4554-a5c0-6b2a3509ed8a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:00.914273 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4b91121f-aff6-4554-a5c0-6b2a3509ed8a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1217 microversion: 2.1 time: 0.078793 Aug 04 17:26:00.915182 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3182/6257] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:00 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:01.943906 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d9ff05cf-7ada-42f5-8911-35551b484c9a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:01.944487 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d9ff05cf-7ada-42f5-8911-35551b484c9a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:01.959322 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d9ff05cf-7ada-42f5-8911-35551b484c9a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:01.962378 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d9ff05cf-7ada-42f5-8911-35551b484c9a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:01.963281 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d9ff05cf-7ada-42f5-8911-35551b484c9a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:01.963799 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d9ff05cf-7ada-42f5-8911-35551b484c9a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:02.116063 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d9ff05cf-7ada-42f5-8911-35551b484c9a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:02.134112 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d9ff05cf-7ada-42f5-8911-35551b484c9a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1277 microversion: 2.1 time: 0.197406 Aug 04 17:26:02.148408 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3076/6258] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:01 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1277 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:02.232055 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-302a924a-7bc5-47a0-a5dd-e9b59d5f29d2 req-3215a67a-cb6a-4dd1-a193-fa4f699521ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bf59992-9f2d-494c-a846-af3cf6d6a364", "name": "network-vif-deleted", "tag": "ce003aa3-0c87-4f76-9f42-4a7d8eeb981a"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:26:02.277538 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-302a924a-7bc5-47a0-a5dd-e9b59d5f29d2 req-3215a67a-cb6a-4dd1-a193-fa4f699521ea service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:02.277990 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-302a924a-7bc5-47a0-a5dd-e9b59d5f29d2 req-3215a67a-cb6a-4dd1-a193-fa4f699521ea service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:02.296591 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-302a924a-7bc5-47a0-a5dd-e9b59d5f29d2 req-3215a67a-cb6a-4dd1-a193-fa4f699521ea service nova] Creating event network-vif-deleted:ce003aa3-0c87-4f76-9f42-4a7d8eeb981a for instance 3bf59992-9f2d-494c-a846-af3cf6d6a364 on n-h2-846466-12 Aug 04 17:26:02.308844 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-302a924a-7bc5-47a0-a5dd-e9b59d5f29d2 req-3215a67a-cb6a-4dd1-a193-fa4f699521ea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080629 Aug 04 17:26:02.338091 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3183/6259] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:26:03.161414 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-09497ea1-1e30-48ed-a560-f33bffa7507f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:03.163444 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-09497ea1-1e30-48ed-a560-f33bffa7507f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:03.179914 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-09497ea1-1e30-48ed-a560-f33bffa7507f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:03.181059 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-09497ea1-1e30-48ed-a560-f33bffa7507f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:03.182724 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-09497ea1-1e30-48ed-a560-f33bffa7507f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:03.183410 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-09497ea1-1e30-48ed-a560-f33bffa7507f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:03.451545 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-09497ea1-1e30-48ed-a560-f33bffa7507f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:03.466418 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-09497ea1-1e30-48ed-a560-f33bffa7507f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1317 microversion: 2.1 time: 0.312870 Aug 04 17:26:03.468085 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3077/6260] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:03 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1317 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:26:03.846863 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-d2a6451c-a997-4860-9ef6-8e4686214358 req-1849993c-da2f-43a1-97e1-a38edcbcd7b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9042616-7bed-4a4e-92a2-1d33096f4a41", "tag": "b29e24f4-1334-4cb5-be97-4c585b9fda5e"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:26:03.862972 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-d2a6451c-a997-4860-9ef6-8e4686214358 req-1849993c-da2f-43a1-97e1-a38edcbcd7b5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:03.863290 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-d2a6451c-a997-4860-9ef6-8e4686214358 req-1849993c-da2f-43a1-97e1-a38edcbcd7b5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:03.888652 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-d2a6451c-a997-4860-9ef6-8e4686214358 req-1849993c-da2f-43a1-97e1-a38edcbcd7b5 service nova] Creating event network-changed:b29e24f4-1334-4cb5-be97-4c585b9fda5e for instance e9042616-7bed-4a4e-92a2-1d33096f4a41 on n-h1-846466-12 Aug 04 17:26:03.894321 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-d2a6451c-a997-4860-9ef6-8e4686214358 req-1849993c-da2f-43a1-97e1-a38edcbcd7b5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053442 Aug 04 17:26:03.895653 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3184/6261] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:26:04.500710 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5fdd7b7e-bb7f-419e-9d21-88f819c8fa21 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:04.501352 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5fdd7b7e-bb7f-419e-9d21-88f819c8fa21 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:04.508921 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5fdd7b7e-bb7f-419e-9d21-88f819c8fa21 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:04.509427 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5fdd7b7e-bb7f-419e-9d21-88f819c8fa21 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:04.510204 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5fdd7b7e-bb7f-419e-9d21-88f819c8fa21 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:04.510642 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5fdd7b7e-bb7f-419e-9d21-88f819c8fa21 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:04.673525 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5fdd7b7e-bb7f-419e-9d21-88f819c8fa21 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:04.684853 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5fdd7b7e-bb7f-419e-9d21-88f819c8fa21 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1317 microversion: 2.1 time: 0.188015 Aug 04 17:26:04.685490 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3078/6262] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:04 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:05.707895 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dc445cc8-7f31-4848-8114-bb54b856d192 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:05.708603 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dc445cc8-7f31-4848-8114-bb54b856d192 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:05.715436 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dc445cc8-7f31-4848-8114-bb54b856d192 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:05.715888 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dc445cc8-7f31-4848-8114-bb54b856d192 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:05.716675 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dc445cc8-7f31-4848-8114-bb54b856d192 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:05.717108 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dc445cc8-7f31-4848-8114-bb54b856d192 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:05.946476 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dc445cc8-7f31-4848-8114-bb54b856d192 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:05.954958 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dc445cc8-7f31-4848-8114-bb54b856d192 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1317 microversion: 2.1 time: 0.252324 Aug 04 17:26:05.955880 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3185/6263] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:05 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:06.979372 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9327fe36-9ff0-4312-b898-60c91675d42b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:06.980348 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9327fe36-9ff0-4312-b898-60c91675d42b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:06.992225 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9327fe36-9ff0-4312-b898-60c91675d42b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:06.992923 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9327fe36-9ff0-4312-b898-60c91675d42b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:06.994235 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9327fe36-9ff0-4312-b898-60c91675d42b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:06.994907 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9327fe36-9ff0-4312-b898-60c91675d42b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:07.150283 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9327fe36-9ff0-4312-b898-60c91675d42b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:07.159826 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9327fe36-9ff0-4312-b898-60c91675d42b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1317 microversion: 2.1 time: 0.186122 Aug 04 17:26:07.160574 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3079/6264] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:06 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:08.183352 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a1782d37-56d1-4727-ac34-a812e3a83a7d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:08.183970 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a1782d37-56d1-4727-ac34-a812e3a83a7d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:08.191743 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a1782d37-56d1-4727-ac34-a812e3a83a7d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:08.192181 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a1782d37-56d1-4727-ac34-a812e3a83a7d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:08.192942 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a1782d37-56d1-4727-ac34-a812e3a83a7d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:08.194013 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a1782d37-56d1-4727-ac34-a812e3a83a7d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:08.339281 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a1782d37-56d1-4727-ac34-a812e3a83a7d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:08.341750 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:26:08.349030 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a1782d37-56d1-4727-ac34-a812e3a83a7d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1317 microversion: 2.1 time: 0.169706 Aug 04 17:26:08.349639 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3186/6265] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:08 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:08.824874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-cdae36cb-e439-4edf-bb41-bab8cb35a3b0 req-f9c0cae0-30c7-43c0-9954-c2fcc5c10975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9042616-7bed-4a4e-92a2-1d33096f4a41", "name": "network-vif-plugged", "status": "completed", "tag": "b29e24f4-1334-4cb5-be97-4c585b9fda5e"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:26:08.837095 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-cdae36cb-e439-4edf-bb41-bab8cb35a3b0 req-f9c0cae0-30c7-43c0-9954-c2fcc5c10975 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:08.837572 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-cdae36cb-e439-4edf-bb41-bab8cb35a3b0 req-f9c0cae0-30c7-43c0-9954-c2fcc5c10975 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:08.849403 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-cdae36cb-e439-4edf-bb41-bab8cb35a3b0 req-f9c0cae0-30c7-43c0-9954-c2fcc5c10975 service nova] Creating event network-vif-plugged:b29e24f4-1334-4cb5-be97-4c585b9fda5e for instance e9042616-7bed-4a4e-92a2-1d33096f4a41 on n-h1-846466-12 Aug 04 17:26:08.854457 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-cdae36cb-e439-4edf-bb41-bab8cb35a3b0 req-f9c0cae0-30c7-43c0-9954-c2fcc5c10975 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033311 Aug 04 17:26:08.855059 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3080/6266] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:26:09.372770 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-91e99fea-e26b-4b37-8aec-de3e3bfa7270 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:09.373615 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-91e99fea-e26b-4b37-8aec-de3e3bfa7270 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:09.382502 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-91e99fea-e26b-4b37-8aec-de3e3bfa7270 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:09.382946 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-91e99fea-e26b-4b37-8aec-de3e3bfa7270 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:09.383724 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-91e99fea-e26b-4b37-8aec-de3e3bfa7270 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:09.384154 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-91e99fea-e26b-4b37-8aec-de3e3bfa7270 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:09.542268 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-91e99fea-e26b-4b37-8aec-de3e3bfa7270 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:09.554979 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-91e99fea-e26b-4b37-8aec-de3e3bfa7270 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1317 microversion: 2.1 time: 0.185775 Aug 04 17:26:09.556041 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3187/6267] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:09 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:10.591391 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e7741d2c-b9f7-4d5d-9c9f-d3e559965fd3 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:10.592107 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e7741d2c-b9f7-4d5d-9c9f-d3e559965fd3 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:10.602024 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e7741d2c-b9f7-4d5d-9c9f-d3e559965fd3 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:10.602493 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e7741d2c-b9f7-4d5d-9c9f-d3e559965fd3 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:10.603731 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e7741d2c-b9f7-4d5d-9c9f-d3e559965fd3 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:10.604298 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e7741d2c-b9f7-4d5d-9c9f-d3e559965fd3 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:10.737848 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:26:10.757544 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e7741d2c-b9f7-4d5d-9c9f-d3e559965fd3 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:10.764042 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:26:10.766761 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e7741d2c-b9f7-4d5d-9c9f-d3e559965fd3 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1506 microversion: 2.1 time: 0.180754 Aug 04 17:26:10.767362 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3081/6268] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:10 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1506 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:10.788766 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7b7f8585-c474-4bdd-8d59-323f571a497d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:10.789396 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7b7f8585-c474-4bdd-8d59-323f571a497d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:10.796117 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b7f8585-c474-4bdd-8d59-323f571a497d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:10.796556 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b7f8585-c474-4bdd-8d59-323f571a497d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:10.797360 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b7f8585-c474-4bdd-8d59-323f571a497d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:10.797782 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b7f8585-c474-4bdd-8d59-323f571a497d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:10.910220 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:26:10.963242 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7b7f8585-c474-4bdd-8d59-323f571a497d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:10.971618 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7b7f8585-c474-4bdd-8d59-323f571a497d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1506 microversion: 2.1 time: 0.187516 Aug 04 17:26:10.972215 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3188/6269] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:10 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1506 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:26:10.994069 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9d497a20-6905-492d-af1a-4cc85560e61f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:26:10.996368 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9d497a20-6905-492d-af1a-4cc85560e61f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:11.003900 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d497a20-6905-492d-af1a-4cc85560e61f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:11.004352 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d497a20-6905-492d-af1a-4cc85560e61f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:11.005335 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d497a20-6905-492d-af1a-4cc85560e61f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:11.005730 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d497a20-6905-492d-af1a-4cc85560e61f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:11.088519 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9d497a20-6905-492d-af1a-4cc85560e61f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:11.095814 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9d497a20-6905-492d-af1a-4cc85560e61f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Old instance type m1.heat2, new instance type m1.heat {{(pid=126126) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 17:26:11.104873 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9d497a20-6905-492d-af1a-4cc85560e61f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:26:11.105546 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9d497a20-6905-492d-af1a-4cc85560e61f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:26:11.106230 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9d497a20-6905-492d-af1a-4cc85560e61f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:26:11.106653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9d497a20-6905-492d-af1a-4cc85560e61f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:26:11.107094 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9d497a20-6905-492d-af1a-4cc85560e61f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:26:11.180430 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=100 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:26:11.230491 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9d497a20-6905-492d-af1a-4cc85560e61f tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "POST /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41/action" status: 202 len: 0 microversion: 2.1 time: 0.240401 Aug 04 17:26:11.231138 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3082/6270] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:26:10 2022] POST /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:26:11.240661 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7b3b7da0-8da3-4d2b-a2cc-6fb219c8ea1d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:11.241822 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7b3b7da0-8da3-4d2b-a2cc-6fb219c8ea1d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:11.249401 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b3b7da0-8da3-4d2b-a2cc-6fb219c8ea1d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:11.249862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b3b7da0-8da3-4d2b-a2cc-6fb219c8ea1d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:11.250661 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b3b7da0-8da3-4d2b-a2cc-6fb219c8ea1d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:11.251089 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b3b7da0-8da3-4d2b-a2cc-6fb219c8ea1d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:11.410616 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7b3b7da0-8da3-4d2b-a2cc-6fb219c8ea1d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:11.423057 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7b3b7da0-8da3-4d2b-a2cc-6fb219c8ea1d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1513 microversion: 2.1 time: 0.187010 Aug 04 17:26:11.423899 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3189/6271] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:11 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1513 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:12.447049 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7f23606d-26d3-466a-afa4-450eb2efac1d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:12.447787 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7f23606d-26d3-466a-afa4-450eb2efac1d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:12.455387 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f23606d-26d3-466a-afa4-450eb2efac1d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:12.456042 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f23606d-26d3-466a-afa4-450eb2efac1d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:12.456855 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f23606d-26d3-466a-afa4-450eb2efac1d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:12.457301 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f23606d-26d3-466a-afa4-450eb2efac1d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:12.605429 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7f23606d-26d3-466a-afa4-450eb2efac1d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:12.618993 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7f23606d-26d3-466a-afa4-450eb2efac1d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1513 microversion: 2.1 time: 0.176588 Aug 04 17:26:12.619944 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3083/6272] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:12 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1513 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:13.641371 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e9439715-768e-4063-9674-7e48dbbc1674 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:13.642252 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e9439715-768e-4063-9674-7e48dbbc1674 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:13.650581 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e9439715-768e-4063-9674-7e48dbbc1674 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:13.651028 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e9439715-768e-4063-9674-7e48dbbc1674 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:13.651812 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e9439715-768e-4063-9674-7e48dbbc1674 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:13.652275 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e9439715-768e-4063-9674-7e48dbbc1674 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:13.815632 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e9439715-768e-4063-9674-7e48dbbc1674 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:13.825064 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e9439715-768e-4063-9674-7e48dbbc1674 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1518 microversion: 2.1 time: 0.187710 Aug 04 17:26:13.825710 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3190/6273] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:13 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1518 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:14.856680 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-210af448-065e-4375-828d-0e87474bac16 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:14.857819 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-210af448-065e-4375-828d-0e87474bac16 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:14.861363 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:26:14.868325 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-210af448-065e-4375-828d-0e87474bac16 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:14.868776 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-210af448-065e-4375-828d-0e87474bac16 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:14.869582 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-210af448-065e-4375-828d-0e87474bac16 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:14.870020 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-210af448-065e-4375-828d-0e87474bac16 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:15.011145 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-210af448-065e-4375-828d-0e87474bac16 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:15.019681 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-210af448-065e-4375-828d-0e87474bac16 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1518 microversion: 2.1 time: 0.167761 Aug 04 17:26:15.020622 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3084/6274] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:14 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1518 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:16.042020 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1014883f-86fa-4211-b61b-3c954704615b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:16.042644 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1014883f-86fa-4211-b61b-3c954704615b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:16.050622 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1014883f-86fa-4211-b61b-3c954704615b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:16.051059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1014883f-86fa-4211-b61b-3c954704615b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:16.051833 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1014883f-86fa-4211-b61b-3c954704615b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:16.052257 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1014883f-86fa-4211-b61b-3c954704615b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:16.199325 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1014883f-86fa-4211-b61b-3c954704615b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:16.207308 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1014883f-86fa-4211-b61b-3c954704615b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1518 microversion: 2.1 time: 0.169985 Aug 04 17:26:16.207928 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3191/6275] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:16 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:17.228608 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cdbcb46e-da62-45c3-aa2b-ec74d68469b9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:17.229258 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cdbcb46e-da62-45c3-aa2b-ec74d68469b9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:17.237265 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cdbcb46e-da62-45c3-aa2b-ec74d68469b9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:17.237784 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cdbcb46e-da62-45c3-aa2b-ec74d68469b9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:17.238909 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cdbcb46e-da62-45c3-aa2b-ec74d68469b9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:17.239391 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cdbcb46e-da62-45c3-aa2b-ec74d68469b9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:17.390565 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cdbcb46e-da62-45c3-aa2b-ec74d68469b9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:17.399328 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cdbcb46e-da62-45c3-aa2b-ec74d68469b9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1518 microversion: 2.1 time: 0.174702 Aug 04 17:26:17.399900 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3085/6276] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:17 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1518 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:18.423111 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3b5f1921-8bac-4ccd-b316-40424a18bad9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:18.423765 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3b5f1921-8bac-4ccd-b316-40424a18bad9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:18.432539 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b5f1921-8bac-4ccd-b316-40424a18bad9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:18.433096 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b5f1921-8bac-4ccd-b316-40424a18bad9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:18.434271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b5f1921-8bac-4ccd-b316-40424a18bad9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:18.434831 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b5f1921-8bac-4ccd-b316-40424a18bad9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:18.581334 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3b5f1921-8bac-4ccd-b316-40424a18bad9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:18.590874 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3b5f1921-8bac-4ccd-b316-40424a18bad9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1518 microversion: 2.1 time: 0.172473 Aug 04 17:26:18.591760 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3192/6277] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:18 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1518 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:19.613835 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-345a8679-edec-42e8-84d6-114c6cdc0b45 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:19.614474 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-345a8679-edec-42e8-84d6-114c6cdc0b45 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:19.622875 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-345a8679-edec-42e8-84d6-114c6cdc0b45 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:19.623342 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-345a8679-edec-42e8-84d6-114c6cdc0b45 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:19.624131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-345a8679-edec-42e8-84d6-114c6cdc0b45 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:19.624574 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-345a8679-edec-42e8-84d6-114c6cdc0b45 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:20.119830 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-345a8679-edec-42e8-84d6-114c6cdc0b45 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:20.128158 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-345a8679-edec-42e8-84d6-114c6cdc0b45 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1518 microversion: 2.1 time: 0.518298 Aug 04 17:26:20.128744 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3086/6278] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:19 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1518 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:26:21.150692 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-aed0a023-7c06-49e2-b899-78b2640c98cc tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:21.151361 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-aed0a023-7c06-49e2-b899-78b2640c98cc tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:21.164344 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aed0a023-7c06-49e2-b899-78b2640c98cc tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:21.164856 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aed0a023-7c06-49e2-b899-78b2640c98cc tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:21.165866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aed0a023-7c06-49e2-b899-78b2640c98cc tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:21.166473 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aed0a023-7c06-49e2-b899-78b2640c98cc tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:21.312333 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-aed0a023-7c06-49e2-b899-78b2640c98cc tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:21.323803 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-aed0a023-7c06-49e2-b899-78b2640c98cc tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1518 microversion: 2.1 time: 0.176815 Aug 04 17:26:21.324416 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3193/6279] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:21 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1518 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:22.348840 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5c52a9e9-503b-4205-bfa4-32e909d3b157 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:22.349502 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5c52a9e9-503b-4205-bfa4-32e909d3b157 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:22.359115 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5c52a9e9-503b-4205-bfa4-32e909d3b157 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:22.359664 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5c52a9e9-503b-4205-bfa4-32e909d3b157 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:22.360718 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5c52a9e9-503b-4205-bfa4-32e909d3b157 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:22.361154 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5c52a9e9-503b-4205-bfa4-32e909d3b157 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:22.507670 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5c52a9e9-503b-4205-bfa4-32e909d3b157 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:22.516152 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5c52a9e9-503b-4205-bfa4-32e909d3b157 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1518 microversion: 2.1 time: 0.173079 Aug 04 17:26:22.516737 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3087/6280] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:22 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1518 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:23.538074 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8325eb1e-4971-42e8-9d69-4db1895b8654 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:23.538644 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8325eb1e-4971-42e8-9d69-4db1895b8654 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:23.546496 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8325eb1e-4971-42e8-9d69-4db1895b8654 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:23.546943 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8325eb1e-4971-42e8-9d69-4db1895b8654 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:23.547751 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8325eb1e-4971-42e8-9d69-4db1895b8654 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:23.548208 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8325eb1e-4971-42e8-9d69-4db1895b8654 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:23.694954 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8325eb1e-4971-42e8-9d69-4db1895b8654 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:23.704452 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8325eb1e-4971-42e8-9d69-4db1895b8654 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1518 microversion: 2.1 time: 0.170552 Aug 04 17:26:23.705107 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3194/6281] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:23 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:24.726907 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-07543e29-0c65-4512-9e83-c08afd62bf5c tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:24.727523 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-07543e29-0c65-4512-9e83-c08afd62bf5c tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:24.737045 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-07543e29-0c65-4512-9e83-c08afd62bf5c tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:24.737666 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-07543e29-0c65-4512-9e83-c08afd62bf5c tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:24.738509 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-07543e29-0c65-4512-9e83-c08afd62bf5c tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:24.739134 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-07543e29-0c65-4512-9e83-c08afd62bf5c tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:24.888490 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-07543e29-0c65-4512-9e83-c08afd62bf5c tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:24.897423 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-07543e29-0c65-4512-9e83-c08afd62bf5c tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1518 microversion: 2.1 time: 0.174790 Aug 04 17:26:24.898053 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3088/6282] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:24 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1518 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:25.920217 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-403fd0a9-7f13-417f-8e66-517f227fac18 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:25.920887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-403fd0a9-7f13-417f-8e66-517f227fac18 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:25.923707 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:26:25.929413 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-403fd0a9-7f13-417f-8e66-517f227fac18 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:25.929863 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-403fd0a9-7f13-417f-8e66-517f227fac18 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:25.930633 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-403fd0a9-7f13-417f-8e66-517f227fac18 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:25.931066 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-403fd0a9-7f13-417f-8e66-517f227fac18 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:26.089117 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-403fd0a9-7f13-417f-8e66-517f227fac18 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:26.097627 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-403fd0a9-7f13-417f-8e66-517f227fac18 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1518 microversion: 2.1 time: 0.181724 Aug 04 17:26:26.098207 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3195/6283] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:25 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1518 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:27.119125 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-639cb082-e50f-46c9-b86b-91929b70db10 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:27.119909 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-639cb082-e50f-46c9-b86b-91929b70db10 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:27.128150 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-639cb082-e50f-46c9-b86b-91929b70db10 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:27.128608 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-639cb082-e50f-46c9-b86b-91929b70db10 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:27.129434 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-639cb082-e50f-46c9-b86b-91929b70db10 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:27.129879 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-639cb082-e50f-46c9-b86b-91929b70db10 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:27.269737 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-639cb082-e50f-46c9-b86b-91929b70db10 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:27.277765 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-639cb082-e50f-46c9-b86b-91929b70db10 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1518 microversion: 2.1 time: 0.162532 Aug 04 17:26:27.278559 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3089/6284] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:27 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:28.304447 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7f7d227b-775f-46cd-bc74-d63b0ea5797b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:28.305103 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7f7d227b-775f-46cd-bc74-d63b0ea5797b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:28.313322 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7f7d227b-775f-46cd-bc74-d63b0ea5797b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:28.313762 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7f7d227b-775f-46cd-bc74-d63b0ea5797b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:28.314577 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7f7d227b-775f-46cd-bc74-d63b0ea5797b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:28.314980 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7f7d227b-775f-46cd-bc74-d63b0ea5797b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:28.495475 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7f7d227b-775f-46cd-bc74-d63b0ea5797b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:28.504411 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7f7d227b-775f-46cd-bc74-d63b0ea5797b tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1518 microversion: 2.1 time: 0.203408 Aug 04 17:26:28.504411 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3196/6285] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:28 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1518 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:29.526708 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3ea4a5ad-9ab8-40d5-b271-c3ea9ed3aafe tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:29.527402 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3ea4a5ad-9ab8-40d5-b271-c3ea9ed3aafe tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:29.535174 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ea4a5ad-9ab8-40d5-b271-c3ea9ed3aafe tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:29.535684 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ea4a5ad-9ab8-40d5-b271-c3ea9ed3aafe tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:29.536458 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ea4a5ad-9ab8-40d5-b271-c3ea9ed3aafe tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:29.536892 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ea4a5ad-9ab8-40d5-b271-c3ea9ed3aafe tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:29.682003 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3ea4a5ad-9ab8-40d5-b271-c3ea9ed3aafe tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:29.696858 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3ea4a5ad-9ab8-40d5-b271-c3ea9ed3aafe tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1518 microversion: 2.1 time: 0.174178 Aug 04 17:26:29.697755 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3090/6286] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:29 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1518 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:30.719856 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-779c3674-129c-4a17-9a73-50753221d164 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:30.720658 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-779c3674-129c-4a17-9a73-50753221d164 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:30.728079 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-779c3674-129c-4a17-9a73-50753221d164 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:30.728525 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-779c3674-129c-4a17-9a73-50753221d164 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:30.729349 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-779c3674-129c-4a17-9a73-50753221d164 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:30.729760 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-779c3674-129c-4a17-9a73-50753221d164 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:30.870620 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-779c3674-129c-4a17-9a73-50753221d164 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:30.878606 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-779c3674-129c-4a17-9a73-50753221d164 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1518 microversion: 2.1 time: 0.163463 Aug 04 17:26:30.879213 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3197/6287] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:30 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:31.902344 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7d52e6f0-81f4-479f-ba46-ed0d76e0486c tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:31.903033 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7d52e6f0-81f4-479f-ba46-ed0d76e0486c tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:31.910853 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7d52e6f0-81f4-479f-ba46-ed0d76e0486c tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:31.911308 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7d52e6f0-81f4-479f-ba46-ed0d76e0486c tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:31.912080 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7d52e6f0-81f4-479f-ba46-ed0d76e0486c tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:31.912515 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7d52e6f0-81f4-479f-ba46-ed0d76e0486c tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:32.077451 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7d52e6f0-81f4-479f-ba46-ed0d76e0486c tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:32.086280 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7d52e6f0-81f4-479f-ba46-ed0d76e0486c tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1518 microversion: 2.1 time: 0.189491 Aug 04 17:26:32.086858 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3091/6288] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:31 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1518 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:33.110318 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-10ab961b-2ab3-4de3-90a6-04d66eb41d83 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:33.110928 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-10ab961b-2ab3-4de3-90a6-04d66eb41d83 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:33.118604 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-10ab961b-2ab3-4de3-90a6-04d66eb41d83 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:33.119047 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-10ab961b-2ab3-4de3-90a6-04d66eb41d83 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:33.119805 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-10ab961b-2ab3-4de3-90a6-04d66eb41d83 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:33.120232 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-10ab961b-2ab3-4de3-90a6-04d66eb41d83 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:33.258494 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-10ab961b-2ab3-4de3-90a6-04d66eb41d83 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:33.267205 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-10ab961b-2ab3-4de3-90a6-04d66eb41d83 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1518 microversion: 2.1 time: 0.161026 Aug 04 17:26:33.267793 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3198/6289] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:33 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:34.289068 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f6a30f69-2950-4959-ace5-2a3931ad9ede tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:34.289737 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f6a30f69-2950-4959-ace5-2a3931ad9ede tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:34.298574 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6a30f69-2950-4959-ace5-2a3931ad9ede tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:34.299025 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6a30f69-2950-4959-ace5-2a3931ad9ede tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:34.299842 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6a30f69-2950-4959-ace5-2a3931ad9ede tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:34.300254 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6a30f69-2950-4959-ace5-2a3931ad9ede tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:34.448875 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f6a30f69-2950-4959-ace5-2a3931ad9ede tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:34.457317 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f6a30f69-2950-4959-ace5-2a3931ad9ede tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1518 microversion: 2.1 time: 0.172428 Aug 04 17:26:34.457918 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3092/6290] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:34 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1518 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:35.479380 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2217100f-23f1-44d2-a25b-fa6b218396e9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:35.480020 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2217100f-23f1-44d2-a25b-fa6b218396e9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:35.488289 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2217100f-23f1-44d2-a25b-fa6b218396e9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:35.488734 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2217100f-23f1-44d2-a25b-fa6b218396e9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:35.489542 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2217100f-23f1-44d2-a25b-fa6b218396e9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:35.489969 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2217100f-23f1-44d2-a25b-fa6b218396e9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:35.632887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2217100f-23f1-44d2-a25b-fa6b218396e9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:35.641262 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2217100f-23f1-44d2-a25b-fa6b218396e9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1518 microversion: 2.1 time: 0.165766 Aug 04 17:26:35.641918 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3199/6291] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:35 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:36.663810 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-449c9c3b-01c5-4270-a91c-2e93cbe8b586 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:36.664425 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-449c9c3b-01c5-4270-a91c-2e93cbe8b586 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:36.672468 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-449c9c3b-01c5-4270-a91c-2e93cbe8b586 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:36.672898 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-449c9c3b-01c5-4270-a91c-2e93cbe8b586 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:36.673758 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-449c9c3b-01c5-4270-a91c-2e93cbe8b586 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:36.674196 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-449c9c3b-01c5-4270-a91c-2e93cbe8b586 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:36.829231 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-449c9c3b-01c5-4270-a91c-2e93cbe8b586 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:36.840378 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-449c9c3b-01c5-4270-a91c-2e93cbe8b586 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1518 microversion: 2.1 time: 0.180325 Aug 04 17:26:36.841034 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3093/6292] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:36 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1518 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:37.863281 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-efbb1765-3856-4cd3-8fc1-756cd4d1a259 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:37.864099 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-efbb1765-3856-4cd3-8fc1-756cd4d1a259 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:37.871465 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-efbb1765-3856-4cd3-8fc1-756cd4d1a259 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:37.871910 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-efbb1765-3856-4cd3-8fc1-756cd4d1a259 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:37.872678 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-efbb1765-3856-4cd3-8fc1-756cd4d1a259 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:37.873107 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-efbb1765-3856-4cd3-8fc1-756cd4d1a259 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:38.010004 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-efbb1765-3856-4cd3-8fc1-756cd4d1a259 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:38.018659 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-efbb1765-3856-4cd3-8fc1-756cd4d1a259 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1518 microversion: 2.1 time: 0.159704 Aug 04 17:26:38.019452 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3200/6293] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:37 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:39.041079 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2bce09eb-7378-4083-bba4-347b2dfb6187 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:39.041841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2bce09eb-7378-4083-bba4-347b2dfb6187 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:39.049765 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2bce09eb-7378-4083-bba4-347b2dfb6187 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:39.050218 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2bce09eb-7378-4083-bba4-347b2dfb6187 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:39.050990 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2bce09eb-7378-4083-bba4-347b2dfb6187 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:39.051423 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2bce09eb-7378-4083-bba4-347b2dfb6187 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:39.197784 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2bce09eb-7378-4083-bba4-347b2dfb6187 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:39.207329 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2bce09eb-7378-4083-bba4-347b2dfb6187 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1518 microversion: 2.1 time: 0.170125 Aug 04 17:26:39.207924 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3094/6294] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:39 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:40.234860 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-92aaef67-b169-49fc-b352-db14bac45d9d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:40.235899 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-92aaef67-b169-49fc-b352-db14bac45d9d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:40.243134 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-92aaef67-b169-49fc-b352-db14bac45d9d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:40.243607 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-92aaef67-b169-49fc-b352-db14bac45d9d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:40.244406 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-92aaef67-b169-49fc-b352-db14bac45d9d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:40.244808 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-92aaef67-b169-49fc-b352-db14bac45d9d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:40.247553 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=86 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:26:40.430898 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-92aaef67-b169-49fc-b352-db14bac45d9d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:40.439129 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-92aaef67-b169-49fc-b352-db14bac45d9d tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1518 microversion: 2.1 time: 0.210071 Aug 04 17:26:40.439764 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3201/6295] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:40 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1518 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:41.012566 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-bed870f8-a8dc-4770-b577-18980dfff126 req-10901f80-30fd-4705-b076-dade758b243f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9042616-7bed-4a4e-92a2-1d33096f4a41", "name": "network-vif-unplugged", "status": "completed", "tag": "b29e24f4-1334-4cb5-be97-4c585b9fda5e"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:26:41.023933 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-bed870f8-a8dc-4770-b577-18980dfff126 req-10901f80-30fd-4705-b076-dade758b243f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:41.024381 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-bed870f8-a8dc-4770-b577-18980dfff126 req-10901f80-30fd-4705-b076-dade758b243f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:41.037804 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-bed870f8-a8dc-4770-b577-18980dfff126 req-10901f80-30fd-4705-b076-dade758b243f service nova] Creating event network-vif-unplugged:b29e24f4-1334-4cb5-be97-4c585b9fda5e for instance e9042616-7bed-4a4e-92a2-1d33096f4a41 on n-h2-846466-12 Aug 04 17:26:41.044120 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [req-bed870f8-a8dc-4770-b577-18980dfff126 req-10901f80-30fd-4705-b076-dade758b243f service nova] Instance e9042616-7bed-4a4e-92a2-1d33096f4a41 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126126) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:26:41.056542 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-bed870f8-a8dc-4770-b577-18980dfff126 req-10901f80-30fd-4705-b076-dade758b243f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047633 Aug 04 17:26:41.057191 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3095/6296] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:26:41.460580 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-986d9a79-4820-4e06-aa85-14dea3305e50 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:41.461158 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-986d9a79-4820-4e06-aa85-14dea3305e50 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:41.468639 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-986d9a79-4820-4e06-aa85-14dea3305e50 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:41.469067 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-986d9a79-4820-4e06-aa85-14dea3305e50 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:41.469962 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-986d9a79-4820-4e06-aa85-14dea3305e50 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:41.470388 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-986d9a79-4820-4e06-aa85-14dea3305e50 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:41.614205 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-986d9a79-4820-4e06-aa85-14dea3305e50 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:41.622118 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-986d9a79-4820-4e06-aa85-14dea3305e50 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1517 microversion: 2.1 time: 0.165565 Aug 04 17:26:41.622814 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3202/6297] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:41 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:42.648715 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7dd13764-1dd9-4772-b634-c24df0e2c945 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:42.649484 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7dd13764-1dd9-4772-b634-c24df0e2c945 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:42.656747 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7dd13764-1dd9-4772-b634-c24df0e2c945 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:42.657473 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7dd13764-1dd9-4772-b634-c24df0e2c945 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:42.658489 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7dd13764-1dd9-4772-b634-c24df0e2c945 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:42.658904 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7dd13764-1dd9-4772-b634-c24df0e2c945 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:42.664345 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:26:42.821248 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7dd13764-1dd9-4772-b634-c24df0e2c945 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:42.835068 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7dd13764-1dd9-4772-b634-c24df0e2c945 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1515 microversion: 2.1 time: 0.191735 Aug 04 17:26:42.835360 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3096/6298] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:42 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1515 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:43.085239 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-d2bc3b91-c5cd-4435-a747-13644051b18f req-d1926e4b-33ce-4f2d-8110-ebe6b6e0bbc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9042616-7bed-4a4e-92a2-1d33096f4a41", "tag": "b29e24f4-1334-4cb5-be97-4c585b9fda5e"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:26:43.095852 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-d2bc3b91-c5cd-4435-a747-13644051b18f req-d1926e4b-33ce-4f2d-8110-ebe6b6e0bbc1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:43.096281 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-d2bc3b91-c5cd-4435-a747-13644051b18f req-d1926e4b-33ce-4f2d-8110-ebe6b6e0bbc1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:43.111600 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-d2bc3b91-c5cd-4435-a747-13644051b18f req-d1926e4b-33ce-4f2d-8110-ebe6b6e0bbc1 service nova] Creating event network-changed:b29e24f4-1334-4cb5-be97-4c585b9fda5e for instance e9042616-7bed-4a4e-92a2-1d33096f4a41 on n-h2-846466-12 Aug 04 17:26:43.117778 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [req-d2bc3b91-c5cd-4435-a747-13644051b18f req-d1926e4b-33ce-4f2d-8110-ebe6b6e0bbc1 service nova] Instance e9042616-7bed-4a4e-92a2-1d33096f4a41 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:26:43.128998 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-d2bc3b91-c5cd-4435-a747-13644051b18f req-d1926e4b-33ce-4f2d-8110-ebe6b6e0bbc1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047477 Aug 04 17:26:43.129690 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3203/6299] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:26:43.859121 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ad38315a-0229-48a4-8a46-40741a90bf61 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:43.859830 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ad38315a-0229-48a4-8a46-40741a90bf61 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:43.867655 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad38315a-0229-48a4-8a46-40741a90bf61 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:43.868230 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad38315a-0229-48a4-8a46-40741a90bf61 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:43.869060 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad38315a-0229-48a4-8a46-40741a90bf61 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:43.869355 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad38315a-0229-48a4-8a46-40741a90bf61 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:44.017763 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ad38315a-0229-48a4-8a46-40741a90bf61 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:44.027521 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ad38315a-0229-48a4-8a46-40741a90bf61 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1512 microversion: 2.1 time: 0.172403 Aug 04 17:26:44.028299 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3097/6300] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:43 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:44.049407 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2f83a371-e768-49fd-b516-e3dd42a5d0a9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:26:44.050032 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2f83a371-e768-49fd-b516-e3dd42a5d0a9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:44.057694 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2f83a371-e768-49fd-b516-e3dd42a5d0a9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:44.058153 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2f83a371-e768-49fd-b516-e3dd42a5d0a9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:44.058971 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2f83a371-e768-49fd-b516-e3dd42a5d0a9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:44.059411 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2f83a371-e768-49fd-b516-e3dd42a5d0a9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:44.398040 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2f83a371-e768-49fd-b516-e3dd42a5d0a9 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "POST /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41/action" status: 204 len: 0 microversion: 2.1 time: 0.352977 Aug 04 17:26:44.398775 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3204/6301] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:26:44 2022] POST /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41/action => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:26:44.409311 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6501f2aa-a589-4138-bb03-779bfd6d3244 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:44.410162 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6501f2aa-a589-4138-bb03-779bfd6d3244 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:44.417870 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6501f2aa-a589-4138-bb03-779bfd6d3244 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:44.418624 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6501f2aa-a589-4138-bb03-779bfd6d3244 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:44.419700 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6501f2aa-a589-4138-bb03-779bfd6d3244 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:44.420405 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6501f2aa-a589-4138-bb03-779bfd6d3244 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:44.677465 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6501f2aa-a589-4138-bb03-779bfd6d3244 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:44.688350 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6501f2aa-a589-4138-bb03-779bfd6d3244 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1512 microversion: 2.1 time: 0.284127 Aug 04 17:26:44.688967 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3098/6302] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:44 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1512 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:45.714363 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8c82ad0a-4574-4b01-aff2-64cc3b15a91e tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:45.715518 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8c82ad0a-4574-4b01-aff2-64cc3b15a91e tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:45.727297 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8c82ad0a-4574-4b01-aff2-64cc3b15a91e tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:45.728025 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8c82ad0a-4574-4b01-aff2-64cc3b15a91e tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:45.729318 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8c82ad0a-4574-4b01-aff2-64cc3b15a91e tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:45.730018 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8c82ad0a-4574-4b01-aff2-64cc3b15a91e tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:45.889820 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8c82ad0a-4574-4b01-aff2-64cc3b15a91e tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:45.899259 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8c82ad0a-4574-4b01-aff2-64cc3b15a91e tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1504 microversion: 2.1 time: 0.193538 Aug 04 17:26:45.899859 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3205/6303] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:45 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1504 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:45.922956 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fdd7e16e-5065-421e-bb2d-2b6bc4e02237 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:45.924620 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fdd7e16e-5065-421e-bb2d-2b6bc4e02237 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:45.929031 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=30 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:26:45.933199 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fdd7e16e-5065-421e-bb2d-2b6bc4e02237 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:45.933687 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fdd7e16e-5065-421e-bb2d-2b6bc4e02237 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:45.934504 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fdd7e16e-5065-421e-bb2d-2b6bc4e02237 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:45.934945 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fdd7e16e-5065-421e-bb2d-2b6bc4e02237 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:46.018792 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-077aa906-9ff4-4f52-80ec-317db48bdddf req-c5517cc1-d914-40b1-bab6-b1c3cb6103aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9042616-7bed-4a4e-92a2-1d33096f4a41", "name": "network-vif-plugged", "status": "completed", "tag": "b29e24f4-1334-4cb5-be97-4c585b9fda5e"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:26:46.032280 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-077aa906-9ff4-4f52-80ec-317db48bdddf req-c5517cc1-d914-40b1-bab6-b1c3cb6103aa service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:46.032496 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-077aa906-9ff4-4f52-80ec-317db48bdddf req-c5517cc1-d914-40b1-bab6-b1c3cb6103aa service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:46.045393 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-077aa906-9ff4-4f52-80ec-317db48bdddf req-c5517cc1-d914-40b1-bab6-b1c3cb6103aa service nova] Creating event network-vif-plugged:b29e24f4-1334-4cb5-be97-4c585b9fda5e for instance e9042616-7bed-4a4e-92a2-1d33096f4a41 on n-h2-846466-12 Aug 04 17:26:46.051699 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-077aa906-9ff4-4f52-80ec-317db48bdddf req-c5517cc1-d914-40b1-bab6-b1c3cb6103aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036870 Aug 04 17:26:46.052639 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3206/6304] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:26:46.086072 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fdd7e16e-5065-421e-bb2d-2b6bc4e02237 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:46.095127 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fdd7e16e-5065-421e-bb2d-2b6bc4e02237 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1504 microversion: 2.1 time: 0.178092 Aug 04 17:26:46.095769 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3099/6305] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:45 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:46.117550 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5356f925-555f-496d-ab7b-4be97c69011c tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:46.118249 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5356f925-555f-496d-ab7b-4be97c69011c tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:46.125501 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5356f925-555f-496d-ab7b-4be97c69011c tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:46.126023 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5356f925-555f-496d-ab7b-4be97c69011c tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:46.126827 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5356f925-555f-496d-ab7b-4be97c69011c tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:46.127255 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5356f925-555f-496d-ab7b-4be97c69011c tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:46.287205 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5356f925-555f-496d-ab7b-4be97c69011c tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:46.296652 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5356f925-555f-496d-ab7b-4be97c69011c tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1504 microversion: 2.1 time: 0.183360 Aug 04 17:26:46.297384 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3207/6306] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:46 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1504 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:46.317242 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-af162bf8-fd64-4880-bbe4-08a4f513a567 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:46.317793 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-af162bf8-fd64-4880-bbe4-08a4f513a567 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:46.324526 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-af162bf8-fd64-4880-bbe4-08a4f513a567 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:46.324986 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-af162bf8-fd64-4880-bbe4-08a4f513a567 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:46.325865 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-af162bf8-fd64-4880-bbe4-08a4f513a567 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:46.326301 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-af162bf8-fd64-4880-bbe4-08a4f513a567 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:46.354810 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-af162bf8-fd64-4880-bbe4-08a4f513a567 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:26:46.451147 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-af162bf8-fd64-4880-bbe4-08a4f513a567 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 204 len: 0 microversion: 2.1 time: 0.137629 Aug 04 17:26:46.451827 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3100/6307] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:26:46 2022] DELETE /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:26:46.472942 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a7b3d1af-e05c-4b92-93aa-b9c4bfde1abc tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:46.473754 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a7b3d1af-e05c-4b92-93aa-b9c4bfde1abc tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:46.483316 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a7b3d1af-e05c-4b92-93aa-b9c4bfde1abc tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:46.484096 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a7b3d1af-e05c-4b92-93aa-b9c4bfde1abc tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:46.485635 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a7b3d1af-e05c-4b92-93aa-b9c4bfde1abc tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:46.486392 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a7b3d1af-e05c-4b92-93aa-b9c4bfde1abc tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:46.526558 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a7b3d1af-e05c-4b92-93aa-b9c4bfde1abc tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:26:46.581971 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.compute.api [None req-a7b3d1af-e05c-4b92-93aa-b9c4bfde1abc tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Instance is already in deleting state, ignoring this request Aug 04 17:26:46.582943 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a7b3d1af-e05c-4b92-93aa-b9c4bfde1abc tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 204 len: 0 microversion: 2.1 time: 0.117073 Aug 04 17:26:46.583694 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3208/6308] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:26:46 2022] DELETE /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:26:46.593215 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cbc89dd2-512b-46f7-81b3-4dfb1ba43479 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:46.593998 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cbc89dd2-512b-46f7-81b3-4dfb1ba43479 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:46.601077 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cbc89dd2-512b-46f7-81b3-4dfb1ba43479 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:46.601558 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cbc89dd2-512b-46f7-81b3-4dfb1ba43479 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:46.602434 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cbc89dd2-512b-46f7-81b3-4dfb1ba43479 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:46.602900 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cbc89dd2-512b-46f7-81b3-4dfb1ba43479 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:46.761845 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cbc89dd2-512b-46f7-81b3-4dfb1ba43479 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:46.775779 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cbc89dd2-512b-46f7-81b3-4dfb1ba43479 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1510 microversion: 2.1 time: 0.186446 Aug 04 17:26:46.776616 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3101/6309] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:46 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1510 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:26:47.803798 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b19fd19b-54f6-439f-9c06-603f3b63835a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:47.804436 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b19fd19b-54f6-439f-9c06-603f3b63835a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:47.812504 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b19fd19b-54f6-439f-9c06-603f3b63835a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:47.812954 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b19fd19b-54f6-439f-9c06-603f3b63835a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:47.813923 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b19fd19b-54f6-439f-9c06-603f3b63835a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:47.814445 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b19fd19b-54f6-439f-9c06-603f3b63835a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:47.969936 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b19fd19b-54f6-439f-9c06-603f3b63835a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed877f47f8ff48fbacf893156ff08d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b37e2d7733f49c793191c605ed144a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:47.978711 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b19fd19b-54f6-439f-9c06-603f3b63835a tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 200 len: 1510 microversion: 2.1 time: 0.178953 Aug 04 17:26:47.979421 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3209/6310] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:47 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 1510 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:48.345791 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-3a01d0fc-fb72-4131-837b-92a80f6b6f99 req-cc00911e-1056-4d0a-b19b-56035d800fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9042616-7bed-4a4e-92a2-1d33096f4a41", "name": "network-vif-deleted", "tag": "b29e24f4-1334-4cb5-be97-4c585b9fda5e"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:26:48.360984 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-3a01d0fc-fb72-4131-837b-92a80f6b6f99 req-cc00911e-1056-4d0a-b19b-56035d800fc8 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:48.362135 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-3a01d0fc-fb72-4131-837b-92a80f6b6f99 req-cc00911e-1056-4d0a-b19b-56035d800fc8 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:48.384110 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-3a01d0fc-fb72-4131-837b-92a80f6b6f99 req-cc00911e-1056-4d0a-b19b-56035d800fc8 service nova] Creating event network-vif-deleted:b29e24f4-1334-4cb5-be97-4c585b9fda5e for instance e9042616-7bed-4a4e-92a2-1d33096f4a41 on n-h2-846466-12 Aug 04 17:26:48.391015 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-3a01d0fc-fb72-4131-837b-92a80f6b6f99 req-cc00911e-1056-4d0a-b19b-56035d800fc8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052057 Aug 04 17:26:48.391664 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3102/6311] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:26:49.000575 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cc825e46-d071-4394-92d0-b7f9676b7138 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:49.001339 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cc825e46-d071-4394-92d0-b7f9676b7138 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: e9042616-7bed-4a4e-92a2-1d33096f4a41] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:49.008479 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cc825e46-d071-4394-92d0-b7f9676b7138 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:49.008909 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cc825e46-d071-4394-92d0-b7f9676b7138 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:49.009707 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cc825e46-d071-4394-92d0-b7f9676b7138 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:49.010145 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cc825e46-d071-4394-92d0-b7f9676b7138 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:49.027127 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-cc825e46-d071-4394-92d0-b7f9676b7138 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] HTTP exception thrown: Instance e9042616-7bed-4a4e-92a2-1d33096f4a41 could not be found. Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cc825e46-d071-4394-92d0-b7f9676b7138 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Request method failure captured: Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 HTTP/1.1 Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi7AD1tCEA3-Zywl2mMilhMY0XN63wC3uOijTwrlbwBQkd56UUUYCu8-eDBTyK5hxfBmDw4BQp9B7r3JoSpYyvNg2PyffgAWtPNzbrBC2OQZLxVlMr5zp3oZCuzg2b89v-gg4hPslQ_X7hv2VkVi7705GaTiDr4D_mQWnzhuXJUbcz--E Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 0b37e2d7733f49c793191c605ed144a3 Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerDiskConfigTestJSON-936166117 Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0b37e2d7733f49c793191c605ed144a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0b37e2d7733f49c793191c605ed144a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0b37e2d7733f49c793191c605ed144a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0b37e2d7733f49c793191c605ed144a3"}]}] Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerDiskConfigTestJSON-936166117 Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 0b37e2d7733f49c793191c605ed144a3 Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-936166117 Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerDiskConfigTestJSON-936166117-project Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: ed877f47f8ff48fbacf893156ff08d21 Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerDiskConfigTestJSON-936166117-project Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance e9042616-7bed-4a4e-92a2-1d33096f4a41 could not be found. Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'e9042616-7bed-4a4e-92a2-1d33096f4a41'} Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9042616-7bed-4a4e-92a2-1d33096f4a41 could not be found. Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9042616-7bed-4a4e-92a2-1d33096f4a41 could not be found. Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:26:49.028970 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:26:49.035351 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:26:49.035351 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:26:49.035351 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:26:49.035351 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:26:49.035351 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:26:49.035351 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9042616-7bed-4a4e-92a2-1d33096f4a41 could not be found. Aug 04 17:26:49.035351 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:26:49.035351 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cc825e46-d071-4394-92d0-b7f9676b7138 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Returning 404 to user: Instance e9042616-7bed-4a4e-92a2-1d33096f4a41 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:26:49.035351 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cc825e46-d071-4394-92d0-b7f9676b7138 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41" status: 404 len: 111 microversion: 2.1 time: 0.034112 Aug 04 17:26:49.035351 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3210/6312] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:48 2022] GET /compute/v2.1/servers/e9042616-7bed-4a4e-92a2-1d33096f4a41 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:26:49.040533 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-96b13fd6-028e-47c2-9bb4-cf412e642f52 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '.version_select at 0x7f7e841be8b0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:49.068620 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-96b13fd6-028e-47c2-9bb4-cf412e642f52 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1087895423" status: 202 len: 0 microversion: 2.1 time: 0.032404 Aug 04 17:26:49.069400 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3103/6313] 10.222.0.23 () {58 vars in 1221 bytes} [Thu Aug 4 17:26:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1087895423 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:26:49.995226 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-27abf872-060c-4ae0-83cc-7e8506a7cce0 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:49.995918 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-27abf872-060c-4ae0-83cc-7e8506a7cce0 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:50.004294 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-27abf872-060c-4ae0-83cc-7e8506a7cce0 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:50.004950 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-27abf872-060c-4ae0-83cc-7e8506a7cce0 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:50.005517 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-27abf872-060c-4ae0-83cc-7e8506a7cce0 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:50.005941 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-27abf872-060c-4ae0-83cc-7e8506a7cce0 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:50.020886 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-27abf872-060c-4ae0-83cc-7e8506a7cce0 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] HTTP exception thrown: Instance 3bf59992-9f2d-494c-a846-af3cf6d6a364 could not be found. Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-27abf872-060c-4ae0-83cc-7e8506a7cce0 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Request method failure captured: Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 HTTP/1.1 Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi7AD1tCEA3-Zywl2mMilhMY0XN63wC3uOijTwrlbwBQkd56UUUYCu8-eDBTyK5hxfBmDw4BQp9B7r3JoSpYyvNg2PyffgAWtPNzbrBC2OQZLxVlMr5zp3oZCuzg2b89v-gg4hPslQ_X7hv2VkVi7705GaTiDr4D_mQWnzhuXJUbcz--E Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 0b37e2d7733f49c793191c605ed144a3 Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerDiskConfigTestJSON-936166117 Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0b37e2d7733f49c793191c605ed144a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0b37e2d7733f49c793191c605ed144a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0b37e2d7733f49c793191c605ed144a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0b37e2d7733f49c793191c605ed144a3"}]}] Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerDiskConfigTestJSON-936166117 Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 0b37e2d7733f49c793191c605ed144a3 Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-936166117 Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerDiskConfigTestJSON-936166117-project Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: ed877f47f8ff48fbacf893156ff08d21 Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerDiskConfigTestJSON-936166117-project Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 3bf59992-9f2d-494c-a846-af3cf6d6a364 could not be found. Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '3bf59992-9f2d-494c-a846-af3cf6d6a364'} Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bf59992-9f2d-494c-a846-af3cf6d6a364 could not be found. Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:26:50.022483 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:26:50.027732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bf59992-9f2d-494c-a846-af3cf6d6a364 could not be found. Aug 04 17:26:50.027732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:26:50.027732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:26:50.027732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:26:50.027732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:26:50.027732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:26:50.027732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:26:50.027732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:26:50.027732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:26:50.027732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bf59992-9f2d-494c-a846-af3cf6d6a364 could not be found. Aug 04 17:26:50.027732 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:26:50.027732 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-27abf872-060c-4ae0-83cc-7e8506a7cce0 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Returning 404 to user: Instance 3bf59992-9f2d-494c-a846-af3cf6d6a364 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:26:50.027732 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-27abf872-060c-4ae0-83cc-7e8506a7cce0 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 404 len: 111 microversion: 2.1 time: 0.034561 Aug 04 17:26:50.027732 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3211/6314] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:26:49 2022] DELETE /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:26:50.033937 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9487fd0c-9788-4a89-b59d-49cbc3a581c7 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:50.034708 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9487fd0c-9788-4a89-b59d-49cbc3a581c7 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] [instance: 3bf59992-9f2d-494c-a846-af3cf6d6a364] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:50.041795 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9487fd0c-9788-4a89-b59d-49cbc3a581c7 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:50.042373 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9487fd0c-9788-4a89-b59d-49cbc3a581c7 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:50.043188 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9487fd0c-9788-4a89-b59d-49cbc3a581c7 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:26:50.043623 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9487fd0c-9788-4a89-b59d-49cbc3a581c7 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:26:50.057516 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-9487fd0c-9788-4a89-b59d-49cbc3a581c7 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] HTTP exception thrown: Instance 3bf59992-9f2d-494c-a846-af3cf6d6a364 could not be found. Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9487fd0c-9788-4a89-b59d-49cbc3a581c7 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Request method failure captured: Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 HTTP/1.1 Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi7AD1tCEA3-Zywl2mMilhMY0XN63wC3uOijTwrlbwBQkd56UUUYCu8-eDBTyK5hxfBmDw4BQp9B7r3JoSpYyvNg2PyffgAWtPNzbrBC2OQZLxVlMr5zp3oZCuzg2b89v-gg4hPslQ_X7hv2VkVi7705GaTiDr4D_mQWnzhuXJUbcz--E Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 0b37e2d7733f49c793191c605ed144a3 Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServerDiskConfigTestJSON-936166117 Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0b37e2d7733f49c793191c605ed144a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0b37e2d7733f49c793191c605ed144a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0b37e2d7733f49c793191c605ed144a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0b37e2d7733f49c793191c605ed144a3"}]}] Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServerDiskConfigTestJSON-936166117 Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 0b37e2d7733f49c793191c605ed144a3 Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-936166117 Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServerDiskConfigTestJSON-936166117-project Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: ed877f47f8ff48fbacf893156ff08d21 Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServerDiskConfigTestJSON-936166117-project Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 3bf59992-9f2d-494c-a846-af3cf6d6a364 could not be found. Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '3bf59992-9f2d-494c-a846-af3cf6d6a364'} Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bf59992-9f2d-494c-a846-af3cf6d6a364 could not be found. Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bf59992-9f2d-494c-a846-af3cf6d6a364 could not be found. Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:26:50.059152 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:26:50.064735 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:26:50.064735 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:26:50.064735 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:26:50.064735 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:26:50.064735 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:26:50.064735 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bf59992-9f2d-494c-a846-af3cf6d6a364 could not be found. Aug 04 17:26:50.064735 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:26:50.064735 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9487fd0c-9788-4a89-b59d-49cbc3a581c7 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] Returning 404 to user: Instance 3bf59992-9f2d-494c-a846-af3cf6d6a364 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:26:50.064735 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9487fd0c-9788-4a89-b59d-49cbc3a581c7 tempest-ServerDiskConfigTestJSON-936166117 tempest-ServerDiskConfigTestJSON-936166117-project] 10.222.0.23 "GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364" status: 404 len: 111 microversion: 2.1 time: 0.031905 Aug 04 17:26:50.064735 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3104/6315] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:50 2022] GET /compute/v2.1/servers/3bf59992-9f2d-494c-a846-af3cf6d6a364 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:26:59.068020 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b3997b18-2f18-4674-93ac-691bec78387c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Action: 'create', calling method: .version_select at 0x7f7e77ffa550>, body: {"keypair": {"name": "tempest-keypair-495351782", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbZ03YOwcR0Ajxfd3xTDP5I37AZbsLSg5p2cn6lKP4ZQ0xb/4W7PKZ7lBmnmeIzEVjZM6jSZ2t2aP6Ngqi2QmHo/vUo5oJUAlGlBBoswjwYJtJD3hFreGQbFIjuls2Cuw=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:26:59.078102 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=34 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:26:59.088322 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-b3997b18-2f18-4674-93ac-691bec78387c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Getting quotas for project 9fa3479e48da461eb31ba242143690c6. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:26:59.094973 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-b3997b18-2f18-4674-93ac-691bec78387c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Getting quotas for user dd0d0aebe00643899de4edd08345e3fd and project 9fa3479e48da461eb31ba242143690c6. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:26:59.124573 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b3997b18-2f18-4674-93ac-691bec78387c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.209418 Aug 04 17:26:59.125141 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3212/6316] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 17:26:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:27:00.498727 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-36f45fc9-b765-4e0c-86d6-36703ec57c24 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1398303252", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0574ddc3-153c-4baf-a31a-673b773c4799"}], "security_groups": [{"name": "tempest-securitygroup--2108948134"}], "key_name": "tempest-keypair-495351782", "user_data": "}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:27:00.508119 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:27:00.509017 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:27:00.635131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-36f45fc9-b765-4e0c-86d6-36703ec57c24 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] validate_networks() for [('0574ddc3-153c-4baf-a31a-673b773c4799', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:27:01.047814 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-36f45fc9-b765-4e0c-86d6-36703ec57c24 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:27:01.048247 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-36f45fc9-b765-4e0c-86d6-36703ec57c24 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:27:01.048738 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-36f45fc9-b765-4e0c-86d6-36703ec57c24 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:27:01.049173 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-36f45fc9-b765-4e0c-86d6-36703ec57c24 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:27:01.049786 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-36f45fc9-b765-4e0c-86d6-36703ec57c24 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:27:01.059650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-36f45fc9-b765-4e0c-86d6-36703ec57c24 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:01.060104 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-36f45fc9-b765-4e0c-86d6-36703ec57c24 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:01.061008 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-36f45fc9-b765-4e0c-86d6-36703ec57c24 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:01.061374 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-36f45fc9-b765-4e0c-86d6-36703ec57c24 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:01.085160 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-36f45fc9-b765-4e0c-86d6-36703ec57c24 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Getting quotas for project 9fa3479e48da461eb31ba242143690c6. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:27:01.091616 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-36f45fc9-b765-4e0c-86d6-36703ec57c24 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Getting quotas for user dd0d0aebe00643899de4edd08345e3fd and project 9fa3479e48da461eb31ba242143690c6. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:27:01.107498 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-36f45fc9-b765-4e0c-86d6-36703ec57c24 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:27:01.109966 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-36f45fc9-b765-4e0c-86d6-36703ec57c24 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:27:01.160083 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-36f45fc9-b765-4e0c-86d6-36703ec57c24 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.665953 Aug 04 17:27:01.161252 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3105/6317] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:27:00 2022] POST /compute/v2.1/servers => generated 409 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:27:01.173084 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-29da899e-3054-4559-b0a4-6267b10758e8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:01.176551 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-29da899e-3054-4559-b0a4-6267b10758e8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:01.179624 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:27:01.240110 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-29da899e-3054-4559-b0a4-6267b10758e8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:01.247765 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-29da899e-3054-4559-b0a4-6267b10758e8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1238 microversion: 2.1 time: 0.078500 Aug 04 17:27:01.248898 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3213/6318] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:27:01 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1238 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:27:02.272080 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7539a89a-7a67-4037-a724-b6dfb74bb6af tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:02.272805 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7539a89a-7a67-4037-a724-b6dfb74bb6af tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:02.286315 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7539a89a-7a67-4037-a724-b6dfb74bb6af tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:02.286986 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7539a89a-7a67-4037-a724-b6dfb74bb6af tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:02.288068 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7539a89a-7a67-4037-a724-b6dfb74bb6af tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:02.288734 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7539a89a-7a67-4037-a724-b6dfb74bb6af tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:02.390002 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7539a89a-7a67-4037-a724-b6dfb74bb6af tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:02.409657 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7539a89a-7a67-4037-a724-b6dfb74bb6af tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1298 microversion: 2.1 time: 0.144138 Aug 04 17:27:02.425142 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3106/6319] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:27:02 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1298 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:27:03.433780 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-120050e0-9e99-40bd-8157-d587cd7e1090 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:03.434460 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-120050e0-9e99-40bd-8157-d587cd7e1090 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:03.442141 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-120050e0-9e99-40bd-8157-d587cd7e1090 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:03.442637 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-120050e0-9e99-40bd-8157-d587cd7e1090 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:03.443633 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-120050e0-9e99-40bd-8157-d587cd7e1090 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:03.444240 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-120050e0-9e99-40bd-8157-d587cd7e1090 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:03.677887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-120050e0-9e99-40bd-8157-d587cd7e1090 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:03.685966 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-120050e0-9e99-40bd-8157-d587cd7e1090 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1364 microversion: 2.1 time: 0.256853 Aug 04 17:27:03.686574 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3214/6320] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:27:03 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1364 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:27:03.986674 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-dc6dd144-3a66-4a9c-8656-0df2cf3e1b3e req-1f1eb2f1-099b-4e90-a3f6-08b0cafd8a83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b549cf7-cc44-4762-809c-08bcbb81e620", "tag": "97ddf934-ca4d-4377-8596-673071aadb56"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:27:04.002879 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-dc6dd144-3a66-4a9c-8656-0df2cf3e1b3e req-1f1eb2f1-099b-4e90-a3f6-08b0cafd8a83 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:04.003649 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-dc6dd144-3a66-4a9c-8656-0df2cf3e1b3e req-1f1eb2f1-099b-4e90-a3f6-08b0cafd8a83 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:04.024067 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-dc6dd144-3a66-4a9c-8656-0df2cf3e1b3e req-1f1eb2f1-099b-4e90-a3f6-08b0cafd8a83 service nova] Creating event network-changed:97ddf934-ca4d-4377-8596-673071aadb56 for instance 3b549cf7-cc44-4762-809c-08bcbb81e620 on n-h1-846466-12 Aug 04 17:27:04.029632 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-dc6dd144-3a66-4a9c-8656-0df2cf3e1b3e req-1f1eb2f1-099b-4e90-a3f6-08b0cafd8a83 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048720 Aug 04 17:27:04.030426 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3107/6321] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:27:04.706770 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ad80c011-297f-4092-aa1e-805ff623fcc7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:04.707365 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ad80c011-297f-4092-aa1e-805ff623fcc7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:04.714913 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad80c011-297f-4092-aa1e-805ff623fcc7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:04.715358 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad80c011-297f-4092-aa1e-805ff623fcc7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:04.716145 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad80c011-297f-4092-aa1e-805ff623fcc7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:04.716594 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ad80c011-297f-4092-aa1e-805ff623fcc7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:04.856469 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ad80c011-297f-4092-aa1e-805ff623fcc7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:04.866706 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ad80c011-297f-4092-aa1e-805ff623fcc7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1364 microversion: 2.1 time: 0.164311 Aug 04 17:27:04.867425 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3215/6322] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:27:04 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:27:05.893262 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-05b44add-2338-44ac-ad5a-3a573f168e77 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:05.893939 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-05b44add-2338-44ac-ad5a-3a573f168e77 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:05.901680 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-05b44add-2338-44ac-ad5a-3a573f168e77 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:05.902113 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-05b44add-2338-44ac-ad5a-3a573f168e77 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:05.902905 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-05b44add-2338-44ac-ad5a-3a573f168e77 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:05.903415 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-05b44add-2338-44ac-ad5a-3a573f168e77 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:06.349745 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-05b44add-2338-44ac-ad5a-3a573f168e77 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:06.358806 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-05b44add-2338-44ac-ad5a-3a573f168e77 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1364 microversion: 2.1 time: 0.471406 Aug 04 17:27:06.359406 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3108/6323] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:27:05 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1364 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:27:07.382658 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ef8a4489-88ae-4f00-a384-c235be6368b6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:07.383378 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ef8a4489-88ae-4f00-a384-c235be6368b6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:07.391860 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef8a4489-88ae-4f00-a384-c235be6368b6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:07.392321 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef8a4489-88ae-4f00-a384-c235be6368b6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:07.393314 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef8a4489-88ae-4f00-a384-c235be6368b6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:07.393765 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ef8a4489-88ae-4f00-a384-c235be6368b6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:07.541000 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ef8a4489-88ae-4f00-a384-c235be6368b6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:07.550492 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ef8a4489-88ae-4f00-a384-c235be6368b6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1364 microversion: 2.1 time: 0.172391 Aug 04 17:27:07.551337 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3216/6324] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:27:07 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:27:08.576537 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2828c430-bee6-432b-a68c-7d59801f1ca3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:08.577126 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2828c430-bee6-432b-a68c-7d59801f1ca3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:08.588576 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2828c430-bee6-432b-a68c-7d59801f1ca3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:08.588969 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2828c430-bee6-432b-a68c-7d59801f1ca3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:08.590478 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2828c430-bee6-432b-a68c-7d59801f1ca3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:08.590968 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2828c430-bee6-432b-a68c-7d59801f1ca3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:08.744103 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2828c430-bee6-432b-a68c-7d59801f1ca3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:08.757258 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2828c430-bee6-432b-a68c-7d59801f1ca3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1364 microversion: 2.1 time: 0.186178 Aug 04 17:27:08.757989 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3109/6325] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:27:08 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1364 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:27:09.202415 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-5a9a1cc3-e777-483b-8784-94aef8701ec7 req-8225d109-826a-4897-87d0-065aa5628b83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b549cf7-cc44-4762-809c-08bcbb81e620", "name": "network-vif-plugged", "status": "completed", "tag": "97ddf934-ca4d-4377-8596-673071aadb56"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:27:09.214543 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-5a9a1cc3-e777-483b-8784-94aef8701ec7 req-8225d109-826a-4897-87d0-065aa5628b83 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:09.215025 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-5a9a1cc3-e777-483b-8784-94aef8701ec7 req-8225d109-826a-4897-87d0-065aa5628b83 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:09.229951 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-5a9a1cc3-e777-483b-8784-94aef8701ec7 req-8225d109-826a-4897-87d0-065aa5628b83 service nova] Creating event network-vif-plugged:97ddf934-ca4d-4377-8596-673071aadb56 for instance 3b549cf7-cc44-4762-809c-08bcbb81e620 on n-h1-846466-12 Aug 04 17:27:09.235178 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-5a9a1cc3-e777-483b-8784-94aef8701ec7 req-8225d109-826a-4897-87d0-065aa5628b83 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036756 Aug 04 17:27:09.235789 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3217/6326] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:27:09.781901 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-97fb0334-b668-4b08-84d7-0ab44b315e27 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:09.782638 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-97fb0334-b668-4b08-84d7-0ab44b315e27 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:09.790038 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-97fb0334-b668-4b08-84d7-0ab44b315e27 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:09.790486 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-97fb0334-b668-4b08-84d7-0ab44b315e27 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:09.791255 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-97fb0334-b668-4b08-84d7-0ab44b315e27 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:09.791689 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-97fb0334-b668-4b08-84d7-0ab44b315e27 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:09.937348 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-97fb0334-b668-4b08-84d7-0ab44b315e27 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:09.946011 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-97fb0334-b668-4b08-84d7-0ab44b315e27 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1364 microversion: 2.1 time: 0.168126 Aug 04 17:27:09.946581 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3110/6327] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:27:09 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:27:10.968050 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8a3206e3-626a-4ffd-aecb-eb80613c811e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:10.968796 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8a3206e3-626a-4ffd-aecb-eb80613c811e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:10.975566 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8a3206e3-626a-4ffd-aecb-eb80613c811e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:10.976009 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8a3206e3-626a-4ffd-aecb-eb80613c811e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:10.976761 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8a3206e3-626a-4ffd-aecb-eb80613c811e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:10.977190 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8a3206e3-626a-4ffd-aecb-eb80613c811e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:11.137810 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8a3206e3-626a-4ffd-aecb-eb80613c811e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:11.149812 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8a3206e3-626a-4ffd-aecb-eb80613c811e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1551 microversion: 2.1 time: 0.186513 Aug 04 17:27:11.150345 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3218/6328] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:27:10 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1551 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:27:11.175660 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f9b4b7fb-71f3-4f91-9d14-a760fcf888bd tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:11.176265 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f9b4b7fb-71f3-4f91-9d14-a760fcf888bd tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:11.179073 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:27:11.179775 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:27:11.186805 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f9b4b7fb-71f3-4f91-9d14-a760fcf888bd tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:11.187259 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f9b4b7fb-71f3-4f91-9d14-a760fcf888bd tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:11.188074 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f9b4b7fb-71f3-4f91-9d14-a760fcf888bd tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:11.188520 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f9b4b7fb-71f3-4f91-9d14-a760fcf888bd tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:11.282621 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f9b4b7fb-71f3-4f91-9d14-a760fcf888bd tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110857 Aug 04 17:27:11.283246 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3111/6329] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Aug 4 17:27:11 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:27:12.692415 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-c2536207-bc8a-4470-a748-893bd21d0768 req-94536cde-b2f7-41ad-b0b0-ae4195294bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b549cf7-cc44-4762-809c-08bcbb81e620", "tag": "97ddf934-ca4d-4377-8596-673071aadb56"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:27:12.697890 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:27:12.705610 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-c2536207-bc8a-4470-a748-893bd21d0768 req-94536cde-b2f7-41ad-b0b0-ae4195294bf5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:12.706054 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-c2536207-bc8a-4470-a748-893bd21d0768 req-94536cde-b2f7-41ad-b0b0-ae4195294bf5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:12.718274 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-c2536207-bc8a-4470-a748-893bd21d0768 req-94536cde-b2f7-41ad-b0b0-ae4195294bf5 service nova] Creating event network-changed:97ddf934-ca4d-4377-8596-673071aadb56 for instance 3b549cf7-cc44-4762-809c-08bcbb81e620 on n-h1-846466-12 Aug 04 17:27:12.723622 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-c2536207-bc8a-4470-a748-893bd21d0768 req-94536cde-b2f7-41ad-b0b0-ae4195294bf5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035008 Aug 04 17:27:12.724606 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3219/6330] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:27:48.679659 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:27:48.680915 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=32 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:27:48.686420 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-06ffa37f-93d0-45ef-b0f2-8bf7a4628af0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:48.687094 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-06ffa37f-93d0-45ef-b0f2-8bf7a4628af0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:48.694566 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-06ffa37f-93d0-45ef-b0f2-8bf7a4628af0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:48.695012 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-06ffa37f-93d0-45ef-b0f2-8bf7a4628af0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:48.695777 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-06ffa37f-93d0-45ef-b0f2-8bf7a4628af0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:48.696230 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-06ffa37f-93d0-45ef-b0f2-8bf7a4628af0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:48.845516 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-06ffa37f-93d0-45ef-b0f2-8bf7a4628af0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:48.853893 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-06ffa37f-93d0-45ef-b0f2-8bf7a4628af0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1670 microversion: 2.1 time: 0.176179 Aug 04 17:27:48.854465 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3112/6331] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:27:48 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1670 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:27:48.873517 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:27:48.874799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=28 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:27:48.879115 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b5b3c911-25a9-45bc-af73-5ffc3cbcdf6e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:48.879865 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b5b3c911-25a9-45bc-af73-5ffc3cbcdf6e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:48.887451 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b5b3c911-25a9-45bc-af73-5ffc3cbcdf6e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:48.887890 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b5b3c911-25a9-45bc-af73-5ffc3cbcdf6e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:48.888647 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b5b3c911-25a9-45bc-af73-5ffc3cbcdf6e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:48.889077 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b5b3c911-25a9-45bc-af73-5ffc3cbcdf6e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:49.038753 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b5b3c911-25a9-45bc-af73-5ffc3cbcdf6e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:49.046700 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b5b3c911-25a9-45bc-af73-5ffc3cbcdf6e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1670 microversion: 2.1 time: 0.175239 Aug 04 17:27:49.047249 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3220/6332] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:27:48 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1670 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:27:49.067090 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6cd8ae7a-909e-45c1-8f4b-df3aa8c35eff tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:49.067703 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6cd8ae7a-909e-45c1-8f4b-df3aa8c35eff tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:49.074270 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6cd8ae7a-909e-45c1-8f4b-df3aa8c35eff tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:49.074728 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6cd8ae7a-909e-45c1-8f4b-df3aa8c35eff tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:49.075492 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6cd8ae7a-909e-45c1-8f4b-df3aa8c35eff tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:49.075931 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6cd8ae7a-909e-45c1-8f4b-df3aa8c35eff tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:49.231965 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6cd8ae7a-909e-45c1-8f4b-df3aa8c35eff tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:49.242519 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6cd8ae7a-909e-45c1-8f4b-df3aa8c35eff tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1670 microversion: 2.1 time: 0.179744 Aug 04 17:27:49.243097 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3113/6333] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:27:49 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1670 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:27:49.265050 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bc12b15e-54e9-4e6b-94d0-bca0534302b7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:27:49.267504 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bc12b15e-54e9-4e6b-94d0-bca0534302b7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:49.274927 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bc12b15e-54e9-4e6b-94d0-bca0534302b7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:49.275364 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bc12b15e-54e9-4e6b-94d0-bca0534302b7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:49.276138 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bc12b15e-54e9-4e6b-94d0-bca0534302b7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:49.276564 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bc12b15e-54e9-4e6b-94d0-bca0534302b7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:49.308423 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bc12b15e-54e9-4e6b-94d0-bca0534302b7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:49.315230 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bc12b15e-54e9-4e6b-94d0-bca0534302b7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Old instance type m1.heat2, new instance type m1.heat {{(pid=126125) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 17:27:49.322143 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-bc12b15e-54e9-4e6b-94d0-bca0534302b7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:27:49.322547 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-bc12b15e-54e9-4e6b-94d0-bca0534302b7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:27:49.323020 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-bc12b15e-54e9-4e6b-94d0-bca0534302b7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:27:49.323442 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-bc12b15e-54e9-4e6b-94d0-bca0534302b7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:27:49.323845 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-bc12b15e-54e9-4e6b-94d0-bca0534302b7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:27:49.412075 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bc12b15e-54e9-4e6b-94d0-bca0534302b7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "POST /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620/action" status: 202 len: 0 microversion: 2.1 time: 0.152172 Aug 04 17:27:49.412075 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3221/6334] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:27:49 2022] POST /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:27:49.420558 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8dbe6e0a-c5ec-4e53-993f-1babdeabfd60 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:49.421964 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8dbe6e0a-c5ec-4e53-993f-1babdeabfd60 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:49.428613 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8dbe6e0a-c5ec-4e53-993f-1babdeabfd60 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:49.429066 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8dbe6e0a-c5ec-4e53-993f-1babdeabfd60 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:49.429986 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8dbe6e0a-c5ec-4e53-993f-1babdeabfd60 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:49.430451 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8dbe6e0a-c5ec-4e53-993f-1babdeabfd60 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:49.588329 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8dbe6e0a-c5ec-4e53-993f-1babdeabfd60 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:49.596297 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8dbe6e0a-c5ec-4e53-993f-1babdeabfd60 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1679 microversion: 2.1 time: 0.179663 Aug 04 17:27:49.597083 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3114/6335] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:27:49 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1679 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:27:50.618839 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-96289f2e-00d7-4a35-8bca-ceaeec0eb950 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:50.619499 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-96289f2e-00d7-4a35-8bca-ceaeec0eb950 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:50.627074 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-96289f2e-00d7-4a35-8bca-ceaeec0eb950 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:50.627518 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-96289f2e-00d7-4a35-8bca-ceaeec0eb950 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:50.628352 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-96289f2e-00d7-4a35-8bca-ceaeec0eb950 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:50.628759 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-96289f2e-00d7-4a35-8bca-ceaeec0eb950 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:50.782647 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-96289f2e-00d7-4a35-8bca-ceaeec0eb950 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:50.791103 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-96289f2e-00d7-4a35-8bca-ceaeec0eb950 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1679 microversion: 2.1 time: 0.177066 Aug 04 17:27:50.791739 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3222/6336] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:27:50 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:27:51.813798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-801a4d99-deef-4d12-ac66-630a222b702c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:51.814460 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-801a4d99-deef-4d12-ac66-630a222b702c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:51.822238 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-801a4d99-deef-4d12-ac66-630a222b702c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:51.822697 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-801a4d99-deef-4d12-ac66-630a222b702c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:51.823489 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-801a4d99-deef-4d12-ac66-630a222b702c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:51.823933 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-801a4d99-deef-4d12-ac66-630a222b702c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:51.973050 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-801a4d99-deef-4d12-ac66-630a222b702c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:51.981733 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-801a4d99-deef-4d12-ac66-630a222b702c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1684 microversion: 2.1 time: 0.172319 Aug 04 17:27:51.982329 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3115/6337] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:27:51 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1684 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:27:53.003921 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4c2e5c0e-65af-4d25-bc8a-59453f4de540 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:53.004652 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4c2e5c0e-65af-4d25-bc8a-59453f4de540 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:53.011138 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4c2e5c0e-65af-4d25-bc8a-59453f4de540 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:53.011637 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4c2e5c0e-65af-4d25-bc8a-59453f4de540 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:53.012647 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4c2e5c0e-65af-4d25-bc8a-59453f4de540 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:53.013132 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4c2e5c0e-65af-4d25-bc8a-59453f4de540 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:53.165812 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4c2e5c0e-65af-4d25-bc8a-59453f4de540 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:53.174516 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4c2e5c0e-65af-4d25-bc8a-59453f4de540 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1684 microversion: 2.1 time: 0.175213 Aug 04 17:27:53.175123 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3223/6338] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:27:52 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1684 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:27:54.196549 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9da12c4b-2ed5-48c8-9bc0-e80795878841 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:54.197177 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9da12c4b-2ed5-48c8-9bc0-e80795878841 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:54.204429 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9da12c4b-2ed5-48c8-9bc0-e80795878841 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:54.204895 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9da12c4b-2ed5-48c8-9bc0-e80795878841 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:54.205696 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9da12c4b-2ed5-48c8-9bc0-e80795878841 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:54.206122 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9da12c4b-2ed5-48c8-9bc0-e80795878841 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:54.357925 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9da12c4b-2ed5-48c8-9bc0-e80795878841 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:54.366805 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9da12c4b-2ed5-48c8-9bc0-e80795878841 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1684 microversion: 2.1 time: 0.174105 Aug 04 17:27:54.367427 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3116/6339] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:27:54 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1684 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:27:55.388547 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c1c73505-094a-42f4-a344-c597e5731c5e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:55.389423 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c1c73505-094a-42f4-a344-c597e5731c5e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:55.398307 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c1c73505-094a-42f4-a344-c597e5731c5e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:55.398775 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c1c73505-094a-42f4-a344-c597e5731c5e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:55.399548 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c1c73505-094a-42f4-a344-c597e5731c5e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:55.399972 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c1c73505-094a-42f4-a344-c597e5731c5e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:55.555234 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c1c73505-094a-42f4-a344-c597e5731c5e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:55.563381 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c1c73505-094a-42f4-a344-c597e5731c5e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1684 microversion: 2.1 time: 0.178705 Aug 04 17:27:55.563959 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3224/6340] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:27:55 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1684 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:27:56.586785 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-93478197-64b1-4d8a-92c8-adba10dcbcb4 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:56.587523 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-93478197-64b1-4d8a-92c8-adba10dcbcb4 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:56.594255 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-93478197-64b1-4d8a-92c8-adba10dcbcb4 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:56.594706 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-93478197-64b1-4d8a-92c8-adba10dcbcb4 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:56.595481 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-93478197-64b1-4d8a-92c8-adba10dcbcb4 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:56.595916 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-93478197-64b1-4d8a-92c8-adba10dcbcb4 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:56.738743 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-93478197-64b1-4d8a-92c8-adba10dcbcb4 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:56.747254 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-93478197-64b1-4d8a-92c8-adba10dcbcb4 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1684 microversion: 2.1 time: 0.165523 Aug 04 17:27:56.748038 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3117/6341] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:27:56 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1684 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:27:57.772252 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c0b8a704-9ce0-42ff-bd15-96099742c3fd tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:57.772996 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c0b8a704-9ce0-42ff-bd15-96099742c3fd tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:57.780582 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0b8a704-9ce0-42ff-bd15-96099742c3fd tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:57.781028 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0b8a704-9ce0-42ff-bd15-96099742c3fd tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:57.781825 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0b8a704-9ce0-42ff-bd15-96099742c3fd tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:57.782255 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0b8a704-9ce0-42ff-bd15-96099742c3fd tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:57.925897 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c0b8a704-9ce0-42ff-bd15-96099742c3fd tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:57.934447 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c0b8a704-9ce0-42ff-bd15-96099742c3fd tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1684 microversion: 2.1 time: 0.166854 Aug 04 17:27:57.935058 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3225/6342] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:27:57 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1684 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:27:58.957916 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a788ccf3-3814-47f6-b8cf-631c39207858 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:58.958624 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a788ccf3-3814-47f6-b8cf-631c39207858 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:58.965965 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a788ccf3-3814-47f6-b8cf-631c39207858 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:58.966435 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a788ccf3-3814-47f6-b8cf-631c39207858 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:58.967206 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a788ccf3-3814-47f6-b8cf-631c39207858 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:27:58.967651 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a788ccf3-3814-47f6-b8cf-631c39207858 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:27:59.228823 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a788ccf3-3814-47f6-b8cf-631c39207858 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:59.237137 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a788ccf3-3814-47f6-b8cf-631c39207858 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1684 microversion: 2.1 time: 0.283179 Aug 04 17:27:59.237782 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3118/6343] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:27:58 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1684 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:00.260202 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d3e3b0c9-3ce8-453f-9d11-f8a9b8b0b6d4 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:00.261427 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d3e3b0c9-3ce8-453f-9d11-f8a9b8b0b6d4 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:00.270364 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d3e3b0c9-3ce8-453f-9d11-f8a9b8b0b6d4 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:00.271214 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d3e3b0c9-3ce8-453f-9d11-f8a9b8b0b6d4 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:00.272245 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d3e3b0c9-3ce8-453f-9d11-f8a9b8b0b6d4 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:00.272928 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d3e3b0c9-3ce8-453f-9d11-f8a9b8b0b6d4 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:00.419613 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d3e3b0c9-3ce8-453f-9d11-f8a9b8b0b6d4 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:00.431824 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d3e3b0c9-3ce8-453f-9d11-f8a9b8b0b6d4 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1684 microversion: 2.1 time: 0.175479 Aug 04 17:28:00.432610 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3226/6344] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:00 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1684 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:01.458197 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-772cdf91-0ecc-4626-90c1-cd1a35a8f552 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:01.458924 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-772cdf91-0ecc-4626-90c1-cd1a35a8f552 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:01.466914 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-772cdf91-0ecc-4626-90c1-cd1a35a8f552 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:01.467341 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-772cdf91-0ecc-4626-90c1-cd1a35a8f552 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:01.468290 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-772cdf91-0ecc-4626-90c1-cd1a35a8f552 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:01.468730 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-772cdf91-0ecc-4626-90c1-cd1a35a8f552 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:01.626681 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-772cdf91-0ecc-4626-90c1-cd1a35a8f552 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:01.638456 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-772cdf91-0ecc-4626-90c1-cd1a35a8f552 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1684 microversion: 2.1 time: 0.183903 Aug 04 17:28:01.639020 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3119/6345] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:01 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1684 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:02.662332 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e24a684c-089f-4f05-b6ad-f4abbdaa7f99 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:02.663610 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e24a684c-089f-4f05-b6ad-f4abbdaa7f99 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:02.672515 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e24a684c-089f-4f05-b6ad-f4abbdaa7f99 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:02.672980 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e24a684c-089f-4f05-b6ad-f4abbdaa7f99 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:02.673869 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e24a684c-089f-4f05-b6ad-f4abbdaa7f99 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:02.674206 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e24a684c-089f-4f05-b6ad-f4abbdaa7f99 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:02.816786 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e24a684c-089f-4f05-b6ad-f4abbdaa7f99 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:02.824695 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e24a684c-089f-4f05-b6ad-f4abbdaa7f99 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1684 microversion: 2.1 time: 0.168090 Aug 04 17:28:02.825258 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3227/6346] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:02 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:03.851722 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b640e632-735e-4b3f-9cb4-0ba16dadaeec tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:03.852374 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b640e632-735e-4b3f-9cb4-0ba16dadaeec tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:03.861570 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b640e632-735e-4b3f-9cb4-0ba16dadaeec tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:03.862060 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b640e632-735e-4b3f-9cb4-0ba16dadaeec tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:03.862841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b640e632-735e-4b3f-9cb4-0ba16dadaeec tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:03.863288 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b640e632-735e-4b3f-9cb4-0ba16dadaeec tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:04.010671 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b640e632-735e-4b3f-9cb4-0ba16dadaeec tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:04.019800 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b640e632-735e-4b3f-9cb4-0ba16dadaeec tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1684 microversion: 2.1 time: 0.174512 Aug 04 17:28:04.020413 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3120/6347] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:03 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1684 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:05.049271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0196add4-96ec-4e8f-b468-7d6c185327a0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:05.049956 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0196add4-96ec-4e8f-b468-7d6c185327a0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:05.058924 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0196add4-96ec-4e8f-b468-7d6c185327a0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:05.059366 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0196add4-96ec-4e8f-b468-7d6c185327a0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:05.060630 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0196add4-96ec-4e8f-b468-7d6c185327a0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:05.061744 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0196add4-96ec-4e8f-b468-7d6c185327a0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:05.218055 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0196add4-96ec-4e8f-b468-7d6c185327a0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:05.226218 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0196add4-96ec-4e8f-b468-7d6c185327a0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1684 microversion: 2.1 time: 0.181643 Aug 04 17:28:05.226820 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3228/6348] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:05 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1684 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:06.252291 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-391d8755-6f56-4eff-8366-5aea402e86c3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:06.252905 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-391d8755-6f56-4eff-8366-5aea402e86c3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:06.260981 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-391d8755-6f56-4eff-8366-5aea402e86c3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:06.261513 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-391d8755-6f56-4eff-8366-5aea402e86c3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:06.262296 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-391d8755-6f56-4eff-8366-5aea402e86c3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:06.262740 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-391d8755-6f56-4eff-8366-5aea402e86c3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:06.407380 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-391d8755-6f56-4eff-8366-5aea402e86c3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:06.415617 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-391d8755-6f56-4eff-8366-5aea402e86c3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1684 microversion: 2.1 time: 0.167700 Aug 04 17:28:06.416215 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3121/6349] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:06 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:07.441646 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6216c408-e80a-4c06-9d9c-4dbb3e01ecf2 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:07.442244 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6216c408-e80a-4c06-9d9c-4dbb3e01ecf2 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:07.452380 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6216c408-e80a-4c06-9d9c-4dbb3e01ecf2 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:07.452950 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6216c408-e80a-4c06-9d9c-4dbb3e01ecf2 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:07.454038 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6216c408-e80a-4c06-9d9c-4dbb3e01ecf2 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:07.454574 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6216c408-e80a-4c06-9d9c-4dbb3e01ecf2 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:07.603194 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6216c408-e80a-4c06-9d9c-4dbb3e01ecf2 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:07.613131 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6216c408-e80a-4c06-9d9c-4dbb3e01ecf2 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1684 microversion: 2.1 time: 0.176812 Aug 04 17:28:07.613719 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3229/6350] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:07 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1684 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:08.634877 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2208ec2b-d414-408b-b4ca-6d5561d1cee7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:08.635573 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2208ec2b-d414-408b-b4ca-6d5561d1cee7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:08.643665 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2208ec2b-d414-408b-b4ca-6d5561d1cee7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:08.644178 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2208ec2b-d414-408b-b4ca-6d5561d1cee7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:08.644964 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2208ec2b-d414-408b-b4ca-6d5561d1cee7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:08.645433 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2208ec2b-d414-408b-b4ca-6d5561d1cee7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:08.785470 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2208ec2b-d414-408b-b4ca-6d5561d1cee7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:08.793732 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2208ec2b-d414-408b-b4ca-6d5561d1cee7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1684 microversion: 2.1 time: 0.163087 Aug 04 17:28:08.794313 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3122/6351] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:08 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:09.288370 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-f2154a5c-9a4f-4c20-bdac-cd2ab6eb5ca3 req-a5a47977-5e57-4602-b8ca-c3df912306be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b549cf7-cc44-4762-809c-08bcbb81e620", "name": "network-vif-unplugged", "status": "completed", "tag": "97ddf934-ca4d-4377-8596-673071aadb56"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:28:09.300044 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-f2154a5c-9a4f-4c20-bdac-cd2ab6eb5ca3 req-a5a47977-5e57-4602-b8ca-c3df912306be service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:09.300485 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-f2154a5c-9a4f-4c20-bdac-cd2ab6eb5ca3 req-a5a47977-5e57-4602-b8ca-c3df912306be service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:09.313513 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-f2154a5c-9a4f-4c20-bdac-cd2ab6eb5ca3 req-a5a47977-5e57-4602-b8ca-c3df912306be service nova] Creating event network-vif-unplugged:97ddf934-ca4d-4377-8596-673071aadb56 for instance 3b549cf7-cc44-4762-809c-08bcbb81e620 on n-h2-846466-12 Aug 04 17:28:09.319641 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [req-f2154a5c-9a4f-4c20-bdac-cd2ab6eb5ca3 req-a5a47977-5e57-4602-b8ca-c3df912306be service nova] Instance 3b549cf7-cc44-4762-809c-08bcbb81e620 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:28:09.331810 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-f2154a5c-9a4f-4c20-bdac-cd2ab6eb5ca3 req-a5a47977-5e57-4602-b8ca-c3df912306be service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047518 Aug 04 17:28:09.332658 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3230/6352] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:28:09.815741 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a559cc56-aea8-4906-8fc1-d3f8bd75e485 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:09.816397 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a559cc56-aea8-4906-8fc1-d3f8bd75e485 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:09.824423 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a559cc56-aea8-4906-8fc1-d3f8bd75e485 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:09.824874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a559cc56-aea8-4906-8fc1-d3f8bd75e485 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:09.825695 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a559cc56-aea8-4906-8fc1-d3f8bd75e485 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:09.826403 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a559cc56-aea8-4906-8fc1-d3f8bd75e485 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:09.972684 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a559cc56-aea8-4906-8fc1-d3f8bd75e485 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:09.981110 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a559cc56-aea8-4906-8fc1-d3f8bd75e485 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1683 microversion: 2.1 time: 0.169440 Aug 04 17:28:09.981787 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3123/6353] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:09 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:11.005836 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7bd66eac-fa25-4d1c-b79d-d4fc533155d6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:11.006627 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7bd66eac-fa25-4d1c-b79d-d4fc533155d6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:11.013621 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7bd66eac-fa25-4d1c-b79d-d4fc533155d6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:11.014068 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7bd66eac-fa25-4d1c-b79d-d4fc533155d6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:11.014932 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7bd66eac-fa25-4d1c-b79d-d4fc533155d6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:11.015283 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7bd66eac-fa25-4d1c-b79d-d4fc533155d6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:11.167761 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7bd66eac-fa25-4d1c-b79d-d4fc533155d6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:11.175936 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7bd66eac-fa25-4d1c-b79d-d4fc533155d6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1681 microversion: 2.1 time: 0.175521 Aug 04 17:28:11.176490 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3231/6354] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:10 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:11.371482 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-b93f871a-6781-4533-99fb-27385a0956dc req-a13093af-0e8b-4e4b-af02-139fedd94d5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b549cf7-cc44-4762-809c-08bcbb81e620", "tag": "97ddf934-ca4d-4377-8596-673071aadb56"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:28:11.382207 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-b93f871a-6781-4533-99fb-27385a0956dc req-a13093af-0e8b-4e4b-af02-139fedd94d5d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:11.382647 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-b93f871a-6781-4533-99fb-27385a0956dc req-a13093af-0e8b-4e4b-af02-139fedd94d5d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:11.394405 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-b93f871a-6781-4533-99fb-27385a0956dc req-a13093af-0e8b-4e4b-af02-139fedd94d5d service nova] Creating event network-changed:97ddf934-ca4d-4377-8596-673071aadb56 for instance 3b549cf7-cc44-4762-809c-08bcbb81e620 on n-h2-846466-12 Aug 04 17:28:11.400415 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [req-b93f871a-6781-4533-99fb-27385a0956dc req-a13093af-0e8b-4e4b-af02-139fedd94d5d service nova] Instance 3b549cf7-cc44-4762-809c-08bcbb81e620 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126126) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:28:11.412879 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-b93f871a-6781-4533-99fb-27385a0956dc req-a13093af-0e8b-4e4b-af02-139fedd94d5d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044818 Aug 04 17:28:11.413562 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3124/6355] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:28:12.202371 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8e6072ef-e645-4763-97cf-72873a22c5b5 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:12.203169 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8e6072ef-e645-4763-97cf-72873a22c5b5 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:12.212263 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8e6072ef-e645-4763-97cf-72873a22c5b5 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:12.212810 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8e6072ef-e645-4763-97cf-72873a22c5b5 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:12.213773 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8e6072ef-e645-4763-97cf-72873a22c5b5 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:12.214323 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8e6072ef-e645-4763-97cf-72873a22c5b5 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:12.388072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8e6072ef-e645-4763-97cf-72873a22c5b5 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:12.398369 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8e6072ef-e645-4763-97cf-72873a22c5b5 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1678 microversion: 2.1 time: 0.200275 Aug 04 17:28:12.398973 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3232/6356] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:12 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1678 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:12.421421 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d768c8e4-2a6e-47ef-a16f-74a14bc4fd10 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:28:12.422398 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d768c8e4-2a6e-47ef-a16f-74a14bc4fd10 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:12.431653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d768c8e4-2a6e-47ef-a16f-74a14bc4fd10 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:12.432273 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d768c8e4-2a6e-47ef-a16f-74a14bc4fd10 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:12.433070 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d768c8e4-2a6e-47ef-a16f-74a14bc4fd10 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:12.434142 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d768c8e4-2a6e-47ef-a16f-74a14bc4fd10 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:12.502245 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d768c8e4-2a6e-47ef-a16f-74a14bc4fd10 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "POST /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620/action" status: 204 len: 0 microversion: 2.1 time: 0.085485 Aug 04 17:28:12.502978 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3125/6357] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:28:12 2022] POST /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620/action => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:28:12.511163 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-94380185-defb-4477-bd15-7745e2c633ab tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:12.511799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-94380185-defb-4477-bd15-7745e2c633ab tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:12.518206 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-94380185-defb-4477-bd15-7745e2c633ab tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:12.518872 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-94380185-defb-4477-bd15-7745e2c633ab tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:12.519844 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-94380185-defb-4477-bd15-7745e2c633ab tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:12.520453 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-94380185-defb-4477-bd15-7745e2c633ab tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:12.748047 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-94380185-defb-4477-bd15-7745e2c633ab tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:12.757393 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-94380185-defb-4477-bd15-7745e2c633ab tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1678 microversion: 2.1 time: 0.250079 Aug 04 17:28:12.758087 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3233/6358] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:12 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1678 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:13.785480 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ddbb679c-77f9-4ca4-bbcb-e9dd05ca5ad9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:13.786301 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ddbb679c-77f9-4ca4-bbcb-e9dd05ca5ad9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:13.796177 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ddbb679c-77f9-4ca4-bbcb-e9dd05ca5ad9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:13.796877 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ddbb679c-77f9-4ca4-bbcb-e9dd05ca5ad9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:13.798209 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ddbb679c-77f9-4ca4-bbcb-e9dd05ca5ad9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:13.798643 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ddbb679c-77f9-4ca4-bbcb-e9dd05ca5ad9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:13.950536 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ddbb679c-77f9-4ca4-bbcb-e9dd05ca5ad9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:13.959113 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ddbb679c-77f9-4ca4-bbcb-e9dd05ca5ad9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1678 microversion: 2.1 time: 0.181655 Aug 04 17:28:13.959743 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3126/6359] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:13 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1678 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:14.341423 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-74442189-aa96-4404-9b19-239f6df7efa9 req-36804247-5f4f-4039-896c-2e114b8a8b38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b549cf7-cc44-4762-809c-08bcbb81e620", "name": "network-vif-plugged", "status": "completed", "tag": "97ddf934-ca4d-4377-8596-673071aadb56"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:28:14.355321 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-74442189-aa96-4404-9b19-239f6df7efa9 req-36804247-5f4f-4039-896c-2e114b8a8b38 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:14.355866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-74442189-aa96-4404-9b19-239f6df7efa9 req-36804247-5f4f-4039-896c-2e114b8a8b38 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:14.369758 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-74442189-aa96-4404-9b19-239f6df7efa9 req-36804247-5f4f-4039-896c-2e114b8a8b38 service nova] Creating event network-vif-plugged:97ddf934-ca4d-4377-8596-673071aadb56 for instance 3b549cf7-cc44-4762-809c-08bcbb81e620 on n-h2-846466-12 Aug 04 17:28:14.375615 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-74442189-aa96-4404-9b19-239f6df7efa9 req-36804247-5f4f-4039-896c-2e114b8a8b38 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038211 Aug 04 17:28:14.376846 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3234/6360] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:28:14.984503 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-65285bc4-05fe-416a-8c02-b04c1ea6ed8f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:14.985544 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-65285bc4-05fe-416a-8c02-b04c1ea6ed8f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:14.995161 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65285bc4-05fe-416a-8c02-b04c1ea6ed8f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:14.995741 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65285bc4-05fe-416a-8c02-b04c1ea6ed8f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:14.996846 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65285bc4-05fe-416a-8c02-b04c1ea6ed8f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:14.997516 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65285bc4-05fe-416a-8c02-b04c1ea6ed8f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:15.139668 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-65285bc4-05fe-416a-8c02-b04c1ea6ed8f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:15.142936 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:28:15.150433 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-65285bc4-05fe-416a-8c02-b04c1ea6ed8f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1670 microversion: 2.1 time: 0.171793 Aug 04 17:28:15.151018 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3127/6361] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:14 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1670 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:15.173341 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d06fc581-a06e-406c-863f-c6f838ad23b4 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:15.174071 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d06fc581-a06e-406c-863f-c6f838ad23b4 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:15.180901 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d06fc581-a06e-406c-863f-c6f838ad23b4 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:15.181527 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d06fc581-a06e-406c-863f-c6f838ad23b4 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:15.182297 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d06fc581-a06e-406c-863f-c6f838ad23b4 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:15.182728 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d06fc581-a06e-406c-863f-c6f838ad23b4 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:15.334020 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d06fc581-a06e-406c-863f-c6f838ad23b4 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:15.342156 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d06fc581-a06e-406c-863f-c6f838ad23b4 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1670 microversion: 2.1 time: 0.174124 Aug 04 17:28:15.342917 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3235/6362] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:15 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1670 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:15.362702 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a546efca-44ce-44bb-92f4-68231993ecae tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:15.363320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a546efca-44ce-44bb-92f4-68231993ecae tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:15.370686 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a546efca-44ce-44bb-92f4-68231993ecae tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:15.371140 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a546efca-44ce-44bb-92f4-68231993ecae tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:15.371919 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a546efca-44ce-44bb-92f4-68231993ecae tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:15.372361 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a546efca-44ce-44bb-92f4-68231993ecae tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:15.520726 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a546efca-44ce-44bb-92f4-68231993ecae tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:15.529411 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a546efca-44ce-44bb-92f4-68231993ecae tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1670 microversion: 2.1 time: 0.170797 Aug 04 17:28:15.530018 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3128/6363] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:15 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1670 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:15.550501 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1199de9b-2549-441f-872f-84aa7ac68a8d tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:15.551339 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1199de9b-2549-441f-872f-84aa7ac68a8d tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:15.560139 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1199de9b-2549-441f-872f-84aa7ac68a8d tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:15.560642 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1199de9b-2549-441f-872f-84aa7ac68a8d tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:15.561451 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1199de9b-2549-441f-872f-84aa7ac68a8d tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:15.561881 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1199de9b-2549-441f-872f-84aa7ac68a8d tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:15.566244 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:28:15.598356 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1199de9b-2549-441f-872f-84aa7ac68a8d tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:28:15.692559 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1199de9b-2549-441f-872f-84aa7ac68a8d tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 204 len: 0 microversion: 2.1 time: 0.145317 Aug 04 17:28:15.694596 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3236/6364] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:28:15 2022] DELETE /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:28:15.704594 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-20eb2a99-0163-431e-8fff-23d578868df7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:15.705237 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-20eb2a99-0163-431e-8fff-23d578868df7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:15.711509 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-20eb2a99-0163-431e-8fff-23d578868df7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:15.711961 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-20eb2a99-0163-431e-8fff-23d578868df7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:15.712720 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-20eb2a99-0163-431e-8fff-23d578868df7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:15.713158 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-20eb2a99-0163-431e-8fff-23d578868df7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:15.865313 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-20eb2a99-0163-431e-8fff-23d578868df7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:15.873533 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-20eb2a99-0163-431e-8fff-23d578868df7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1676 microversion: 2.1 time: 0.173072 Aug 04 17:28:15.874103 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3129/6365] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:15 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:28:16.896609 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ebb825f9-703f-457d-a402-030eb8bf09a6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:16.897514 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ebb825f9-703f-457d-a402-030eb8bf09a6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:16.904930 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ebb825f9-703f-457d-a402-030eb8bf09a6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:16.905396 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ebb825f9-703f-457d-a402-030eb8bf09a6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:16.906163 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ebb825f9-703f-457d-a402-030eb8bf09a6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:16.906586 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ebb825f9-703f-457d-a402-030eb8bf09a6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:17.061870 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ebb825f9-703f-457d-a402-030eb8bf09a6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:17.070426 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ebb825f9-703f-457d-a402-030eb8bf09a6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1676 microversion: 2.1 time: 0.178851 Aug 04 17:28:17.071009 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3237/6366] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:16 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1676 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:17.989920 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-5990cee5-c93e-4e0d-9d7b-2da8f5e4d7d5 req-847ecffc-bfa3-4a46-8737-52aaa6dd5502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b549cf7-cc44-4762-809c-08bcbb81e620", "name": "network-vif-deleted", "tag": "97ddf934-ca4d-4377-8596-673071aadb56"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:28:18.001811 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-5990cee5-c93e-4e0d-9d7b-2da8f5e4d7d5 req-847ecffc-bfa3-4a46-8737-52aaa6dd5502 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:18.002471 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-5990cee5-c93e-4e0d-9d7b-2da8f5e4d7d5 req-847ecffc-bfa3-4a46-8737-52aaa6dd5502 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:18.014935 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-5990cee5-c93e-4e0d-9d7b-2da8f5e4d7d5 req-847ecffc-bfa3-4a46-8737-52aaa6dd5502 service nova] Creating event network-vif-deleted:97ddf934-ca4d-4377-8596-673071aadb56 for instance 3b549cf7-cc44-4762-809c-08bcbb81e620 on n-h2-846466-12 Aug 04 17:28:18.020710 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-5990cee5-c93e-4e0d-9d7b-2da8f5e4d7d5 req-847ecffc-bfa3-4a46-8737-52aaa6dd5502 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034580 Aug 04 17:28:18.021713 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3130/6367] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:28:18.093218 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-60f4eadc-aa43-4e27-a7b7-089565796c66 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:18.093903 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-60f4eadc-aa43-4e27-a7b7-089565796c66 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:18.103012 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-60f4eadc-aa43-4e27-a7b7-089565796c66 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:18.103677 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-60f4eadc-aa43-4e27-a7b7-089565796c66 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:18.104966 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-60f4eadc-aa43-4e27-a7b7-089565796c66 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:18.105746 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-60f4eadc-aa43-4e27-a7b7-089565796c66 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:18.145601 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-60f4eadc-aa43-4e27-a7b7-089565796c66 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:18.146692 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-60f4eadc-aa43-4e27-a7b7-089565796c66 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:18.147316 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-60f4eadc-aa43-4e27-a7b7-089565796c66 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lazy-loading 'fault' on Instance uuid 3b549cf7-cc44-4762-809c-08bcbb81e620 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:28:18.195704 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-60f4eadc-aa43-4e27-a7b7-089565796c66 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:18.203581 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-60f4eadc-aa43-4e27-a7b7-089565796c66 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 200 len: 1328 microversion: 2.1 time: 0.115129 Aug 04 17:28:18.204434 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3238/6368] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:18 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 1328 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:19.230705 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-57104842-1c8a-49c6-b2e4-709c1b79375a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:19.231413 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-57104842-1c8a-49c6-b2e4-709c1b79375a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:19.234343 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=39 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:28:19.241733 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-57104842-1c8a-49c6-b2e4-709c1b79375a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:19.242309 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-57104842-1c8a-49c6-b2e4-709c1b79375a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:19.242982 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-57104842-1c8a-49c6-b2e4-709c1b79375a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:19.243428 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-57104842-1c8a-49c6-b2e4-709c1b79375a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:19.260547 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-57104842-1c8a-49c6-b2e4-709c1b79375a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] HTTP exception thrown: Instance 3b549cf7-cc44-4762-809c-08bcbb81e620 could not be found. Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-57104842-1c8a-49c6-b2e4-709c1b79375a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Request method failure captured: Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 HTTP/1.1 Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi7AFiltLP9EvcwVpFCa2h6tq19pMq_32JMtbXN51DOjApDm4jayRdzcaHrSSvhfA_fIVFHE8QZgkPi4lki3zEP2UZCg1aFWM1RMSCACgdYoFYi89kiTnRN1cdwnfZRtBXt50OfsjmdprRxr5_GXWBGj1IhGtf3jvIm_b3rzVGsscSyQY Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 9fa3479e48da461eb31ba242143690c6 Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServerActionsTestJSON-75947691 Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fa3479e48da461eb31ba242143690c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9fa3479e48da461eb31ba242143690c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fa3479e48da461eb31ba242143690c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9fa3479e48da461eb31ba242143690c6"}]}] Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServerActionsTestJSON-75947691 Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 9fa3479e48da461eb31ba242143690c6 Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServerActionsTestJSON-75947691 Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServerActionsTestJSON-75947691-project Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: dd0d0aebe00643899de4edd08345e3fd Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServerActionsTestJSON-75947691-project Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 3b549cf7-cc44-4762-809c-08bcbb81e620 could not be found. Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '3b549cf7-cc44-4762-809c-08bcbb81e620'} Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b549cf7-cc44-4762-809c-08bcbb81e620 could not be found. Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b549cf7-cc44-4762-809c-08bcbb81e620 could not be found. Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:28:19.262270 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:28:19.267805 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:28:19.267805 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:28:19.267805 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:28:19.267805 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:28:19.267805 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:28:19.267805 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b549cf7-cc44-4762-809c-08bcbb81e620 could not be found. Aug 04 17:28:19.267805 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:28:19.267805 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-57104842-1c8a-49c6-b2e4-709c1b79375a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Returning 404 to user: Instance 3b549cf7-cc44-4762-809c-08bcbb81e620 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:28:19.267805 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-57104842-1c8a-49c6-b2e4-709c1b79375a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 404 len: 111 microversion: 2.1 time: 0.041015 Aug 04 17:28:19.267805 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3131/6369] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:19 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:28:19.284432 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5db46aba-89b7-4654-b3c3-7cf50626f68e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:19.284432 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5db46aba-89b7-4654-b3c3-7cf50626f68e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:19.287361 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:28:19.292954 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5db46aba-89b7-4654-b3c3-7cf50626f68e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:19.293429 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5db46aba-89b7-4654-b3c3-7cf50626f68e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:19.294260 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5db46aba-89b7-4654-b3c3-7cf50626f68e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:19.294691 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5db46aba-89b7-4654-b3c3-7cf50626f68e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:19.309209 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-5db46aba-89b7-4654-b3c3-7cf50626f68e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] HTTP exception thrown: Instance 3b549cf7-cc44-4762-809c-08bcbb81e620 could not be found. Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5db46aba-89b7-4654-b3c3-7cf50626f68e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Request method failure captured: Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 HTTP/1.1 Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi7AFiltLP9EvcwVpFCa2h6tq19pMq_32JMtbXN51DOjApDm4jayRdzcaHrSSvhfA_fIVFHE8QZgkPi4lki3zEP2UZCg1aFWM1RMSCACgdYoFYi89kiTnRN1cdwnfZRtBXt50OfsjmdprRxr5_GXWBGj1IhGtf3jvIm_b3rzVGsscSyQY Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 9fa3479e48da461eb31ba242143690c6 Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerActionsTestJSON-75947691 Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fa3479e48da461eb31ba242143690c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9fa3479e48da461eb31ba242143690c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fa3479e48da461eb31ba242143690c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9fa3479e48da461eb31ba242143690c6"}]}] Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerActionsTestJSON-75947691 Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 9fa3479e48da461eb31ba242143690c6 Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerActionsTestJSON-75947691 Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerActionsTestJSON-75947691-project Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: dd0d0aebe00643899de4edd08345e3fd Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerActionsTestJSON-75947691-project Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 3b549cf7-cc44-4762-809c-08bcbb81e620 could not be found. Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '3b549cf7-cc44-4762-809c-08bcbb81e620'} Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b549cf7-cc44-4762-809c-08bcbb81e620 could not be found. Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b549cf7-cc44-4762-809c-08bcbb81e620 could not be found. Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:28:19.310893 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:28:19.317330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:28:19.317330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:28:19.317330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:28:19.317330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:28:19.317330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:28:19.317330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b549cf7-cc44-4762-809c-08bcbb81e620 could not be found. Aug 04 17:28:19.317330 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:28:19.317330 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5db46aba-89b7-4654-b3c3-7cf50626f68e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Returning 404 to user: Instance 3b549cf7-cc44-4762-809c-08bcbb81e620 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:28:19.317330 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5db46aba-89b7-4654-b3c3-7cf50626f68e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 404 len: 111 microversion: 2.1 time: 0.033826 Aug 04 17:28:19.317330 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3239/6370] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:19 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:28:19.370381 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1ac42881-e0db-4f79-b357-d0d1e8cc92f1 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-757949303", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "0574ddc3-153c-4baf-a31a-673b773c4799"}], "security_groups": [{"name": "tempest-securitygroup--2108948134"}], "key_name": "tempest-keypair-495351782", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:28:19.505725 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-1ac42881-e0db-4f79-b357-d0d1e8cc92f1 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] validate_networks() for [('0574ddc3-153c-4baf-a31a-673b773c4799', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:28:19.915161 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-1ac42881-e0db-4f79-b357-d0d1e8cc92f1 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:28:19.915752 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-1ac42881-e0db-4f79-b357-d0d1e8cc92f1 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:28:19.916462 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-1ac42881-e0db-4f79-b357-d0d1e8cc92f1 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:28:19.917057 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-1ac42881-e0db-4f79-b357-d0d1e8cc92f1 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:28:19.917731 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-1ac42881-e0db-4f79-b357-d0d1e8cc92f1 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:28:19.931281 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1ac42881-e0db-4f79-b357-d0d1e8cc92f1 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:19.932027 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1ac42881-e0db-4f79-b357-d0d1e8cc92f1 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:19.932976 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1ac42881-e0db-4f79-b357-d0d1e8cc92f1 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:19.933634 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1ac42881-e0db-4f79-b357-d0d1e8cc92f1 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:19.953512 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-1ac42881-e0db-4f79-b357-d0d1e8cc92f1 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Getting quotas for project 9fa3479e48da461eb31ba242143690c6. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:28:19.959470 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-1ac42881-e0db-4f79-b357-d0d1e8cc92f1 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Getting quotas for user dd0d0aebe00643899de4edd08345e3fd and project 9fa3479e48da461eb31ba242143690c6. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:28:19.973822 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1ac42881-e0db-4f79-b357-d0d1e8cc92f1 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:28:19.976194 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1ac42881-e0db-4f79-b357-d0d1e8cc92f1 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:28:20.026739 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1ac42881-e0db-4f79-b357-d0d1e8cc92f1 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.660399 Aug 04 17:28:20.027389 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3132/6371] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:28:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:28:20.039258 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-62c104bb-5891-4f4c-8c26-4d0dec8f8eb7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:20.040026 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-62c104bb-5891-4f4c-8c26-4d0dec8f8eb7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:20.095640 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-62c104bb-5891-4f4c-8c26-4d0dec8f8eb7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:20.102879 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-62c104bb-5891-4f4c-8c26-4d0dec8f8eb7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1237 microversion: 2.1 time: 0.067752 Aug 04 17:28:20.104143 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3240/6372] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:20 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:21.125834 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bca050ef-e041-4102-af63-e746ca1d3bec tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:21.126527 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bca050ef-e041-4102-af63-e746ca1d3bec tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:21.134253 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bca050ef-e041-4102-af63-e746ca1d3bec tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:21.134743 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bca050ef-e041-4102-af63-e746ca1d3bec tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:21.135493 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bca050ef-e041-4102-af63-e746ca1d3bec tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:21.135937 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bca050ef-e041-4102-af63-e746ca1d3bec tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:21.201832 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bca050ef-e041-4102-af63-e746ca1d3bec tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:21.210221 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bca050ef-e041-4102-af63-e746ca1d3bec tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1307 microversion: 2.1 time: 0.089664 Aug 04 17:28:21.210853 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3133/6373] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:21 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1307 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:22.232762 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b8175330-d78c-41e0-ae9e-967d62045647 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:22.233751 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b8175330-d78c-41e0-ae9e-967d62045647 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:22.240628 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8175330-d78c-41e0-ae9e-967d62045647 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:22.241141 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8175330-d78c-41e0-ae9e-967d62045647 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:22.242394 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8175330-d78c-41e0-ae9e-967d62045647 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:22.242864 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b8175330-d78c-41e0-ae9e-967d62045647 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:22.381490 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b8175330-d78c-41e0-ae9e-967d62045647 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:22.389476 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b8175330-d78c-41e0-ae9e-967d62045647 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1363 microversion: 2.1 time: 0.161017 Aug 04 17:28:22.390042 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3241/6374] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:22 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:22.483063 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-55178f83-ed54-454d-b499-7ba6e047d07d req-31d20771-55f5-474d-bfd0-6c29ea7788eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5a493ec-0c95-4de8-b936-c1ca011c7e64", "tag": "3465a349-10f4-459a-9dfc-7801a11864e3"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:28:22.495441 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-55178f83-ed54-454d-b499-7ba6e047d07d req-31d20771-55f5-474d-bfd0-6c29ea7788eb service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:22.496012 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-55178f83-ed54-454d-b499-7ba6e047d07d req-31d20771-55f5-474d-bfd0-6c29ea7788eb service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:22.508618 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-55178f83-ed54-454d-b499-7ba6e047d07d req-31d20771-55f5-474d-bfd0-6c29ea7788eb service nova] Creating event network-changed:3465a349-10f4-459a-9dfc-7801a11864e3 for instance f5a493ec-0c95-4de8-b936-c1ca011c7e64 on n-h2-846466-12 Aug 04 17:28:22.514076 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-55178f83-ed54-454d-b499-7ba6e047d07d req-31d20771-55f5-474d-bfd0-6c29ea7788eb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035309 Aug 04 17:28:22.514693 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3134/6375] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:28:23.412097 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d53ddb66-140a-403c-822c-831b3bf707c6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:23.412738 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d53ddb66-140a-403c-822c-831b3bf707c6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:23.420409 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d53ddb66-140a-403c-822c-831b3bf707c6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:23.420890 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d53ddb66-140a-403c-822c-831b3bf707c6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:23.421695 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d53ddb66-140a-403c-822c-831b3bf707c6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:23.422129 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d53ddb66-140a-403c-822c-831b3bf707c6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:23.577717 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d53ddb66-140a-403c-822c-831b3bf707c6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:23.586755 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d53ddb66-140a-403c-822c-831b3bf707c6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1363 microversion: 2.1 time: 0.178852 Aug 04 17:28:23.587336 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3242/6376] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:23 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:24.610671 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fc9e92c7-f588-488d-bc18-f848e3436db8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:24.611495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fc9e92c7-f588-488d-bc18-f848e3436db8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:24.620178 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fc9e92c7-f588-488d-bc18-f848e3436db8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:24.620867 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fc9e92c7-f588-488d-bc18-f848e3436db8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:24.622154 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fc9e92c7-f588-488d-bc18-f848e3436db8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:24.622742 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fc9e92c7-f588-488d-bc18-f848e3436db8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:24.784523 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fc9e92c7-f588-488d-bc18-f848e3436db8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:24.796150 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fc9e92c7-f588-488d-bc18-f848e3436db8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1363 microversion: 2.1 time: 0.190978 Aug 04 17:28:24.796863 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3135/6377] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:24 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:25.818878 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-423808bf-b3f8-4d81-89d2-a71058f019da tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:25.819683 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-423808bf-b3f8-4d81-89d2-a71058f019da tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:25.826986 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-423808bf-b3f8-4d81-89d2-a71058f019da tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:25.827453 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-423808bf-b3f8-4d81-89d2-a71058f019da tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:25.828195 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-423808bf-b3f8-4d81-89d2-a71058f019da tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:25.828631 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-423808bf-b3f8-4d81-89d2-a71058f019da tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:25.984478 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-423808bf-b3f8-4d81-89d2-a71058f019da tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:25.996609 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-423808bf-b3f8-4d81-89d2-a71058f019da tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1363 microversion: 2.1 time: 0.181747 Aug 04 17:28:25.997439 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3243/6378] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:25 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:27.022839 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2800337b-a68d-4d88-b436-55082cc9472f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:27.023491 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2800337b-a68d-4d88-b436-55082cc9472f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:27.031011 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2800337b-a68d-4d88-b436-55082cc9472f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:27.031457 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2800337b-a68d-4d88-b436-55082cc9472f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:27.032263 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2800337b-a68d-4d88-b436-55082cc9472f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:27.032707 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2800337b-a68d-4d88-b436-55082cc9472f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:27.178151 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2800337b-a68d-4d88-b436-55082cc9472f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:27.186186 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2800337b-a68d-4d88-b436-55082cc9472f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1363 microversion: 2.1 time: 0.168751 Aug 04 17:28:27.186753 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3136/6379] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:27 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:28.220170 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-329070e1-9d20-4f2b-b769-810c39fb30af tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:28.220170 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-329070e1-9d20-4f2b-b769-810c39fb30af tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:28.225890 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-329070e1-9d20-4f2b-b769-810c39fb30af tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:28.226344 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-329070e1-9d20-4f2b-b769-810c39fb30af tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:28.227124 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-329070e1-9d20-4f2b-b769-810c39fb30af tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:28.227584 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-329070e1-9d20-4f2b-b769-810c39fb30af tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:28.381395 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-329070e1-9d20-4f2b-b769-810c39fb30af tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:28.389186 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-329070e1-9d20-4f2b-b769-810c39fb30af tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1363 microversion: 2.1 time: 0.177431 Aug 04 17:28:28.389792 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3244/6380] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:28 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:28.414893 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-e3fd70f5-befb-44c9-b7a0-c971219f6c35 req-08b028f3-b185-4c2c-a749-da9323720937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5a493ec-0c95-4de8-b936-c1ca011c7e64", "name": "network-vif-plugged", "status": "completed", "tag": "3465a349-10f4-459a-9dfc-7801a11864e3"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:28:28.426032 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-e3fd70f5-befb-44c9-b7a0-c971219f6c35 req-08b028f3-b185-4c2c-a749-da9323720937 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:28.426478 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-e3fd70f5-befb-44c9-b7a0-c971219f6c35 req-08b028f3-b185-4c2c-a749-da9323720937 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:28.440316 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-e3fd70f5-befb-44c9-b7a0-c971219f6c35 req-08b028f3-b185-4c2c-a749-da9323720937 service nova] Creating event network-vif-plugged:3465a349-10f4-459a-9dfc-7801a11864e3 for instance f5a493ec-0c95-4de8-b936-c1ca011c7e64 on n-h2-846466-12 Aug 04 17:28:28.446365 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-e3fd70f5-befb-44c9-b7a0-c971219f6c35 req-08b028f3-b185-4c2c-a749-da9323720937 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035748 Aug 04 17:28:28.447173 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3137/6381] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:28:29.413805 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5e9067ce-d3f4-4536-84a7-137fae0afd3f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:29.414419 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5e9067ce-d3f4-4536-84a7-137fae0afd3f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:29.422104 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5e9067ce-d3f4-4536-84a7-137fae0afd3f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:29.422546 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5e9067ce-d3f4-4536-84a7-137fae0afd3f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:29.423319 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5e9067ce-d3f4-4536-84a7-137fae0afd3f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:29.423746 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5e9067ce-d3f4-4536-84a7-137fae0afd3f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:29.579011 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5e9067ce-d3f4-4536-84a7-137fae0afd3f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:29.587922 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5e9067ce-d3f4-4536-84a7-137fae0afd3f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1363 microversion: 2.1 time: 0.179692 Aug 04 17:28:29.589709 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3245/6382] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:29 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:30.611224 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:28:30.611649 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:28:30.618074 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9d3a5098-184d-4f4a-9dd8-802362df00b8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:30.618966 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9d3a5098-184d-4f4a-9dd8-802362df00b8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:30.626503 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d3a5098-184d-4f4a-9dd8-802362df00b8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:30.626956 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d3a5098-184d-4f4a-9dd8-802362df00b8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:30.627727 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d3a5098-184d-4f4a-9dd8-802362df00b8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:30.628169 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d3a5098-184d-4f4a-9dd8-802362df00b8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:30.774534 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9d3a5098-184d-4f4a-9dd8-802362df00b8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:30.782487 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9d3a5098-184d-4f4a-9dd8-802362df00b8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1550 microversion: 2.1 time: 0.174809 Aug 04 17:28:30.783058 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3138/6383] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:30 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1550 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:30.806122 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-67a685be-92f2-46bc-8bd4-380072ebe4a9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:30.806711 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-67a685be-92f2-46bc-8bd4-380072ebe4a9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:30.808498 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:28:30.815243 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-67a685be-92f2-46bc-8bd4-380072ebe4a9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:30.815684 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-67a685be-92f2-46bc-8bd4-380072ebe4a9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:30.816449 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-67a685be-92f2-46bc-8bd4-380072ebe4a9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:30.816877 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-67a685be-92f2-46bc-8bd4-380072ebe4a9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:30.902636 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-67a685be-92f2-46bc-8bd4-380072ebe4a9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100896 Aug 04 17:28:30.903260 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3246/6384] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Aug 4 17:28:30 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:28:32.251827 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-9e80e685-b2c4-47c8-a415-4079ce3f7ab0 req-2347707a-c7be-4864-be1d-7d674f46e021 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5a493ec-0c95-4de8-b936-c1ca011c7e64", "tag": "3465a349-10f4-459a-9dfc-7801a11864e3"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:28:32.266812 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-9e80e685-b2c4-47c8-a415-4079ce3f7ab0 req-2347707a-c7be-4864-be1d-7d674f46e021 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:28:32.267780 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-9e80e685-b2c4-47c8-a415-4079ce3f7ab0 req-2347707a-c7be-4864-be1d-7d674f46e021 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:28:32.280867 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-9e80e685-b2c4-47c8-a415-4079ce3f7ab0 req-2347707a-c7be-4864-be1d-7d674f46e021 service nova] Creating event network-changed:3465a349-10f4-459a-9dfc-7801a11864e3 for instance f5a493ec-0c95-4de8-b936-c1ca011c7e64 on n-h2-846466-12 Aug 04 17:28:32.286432 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-9e80e685-b2c4-47c8-a415-4079ce3f7ab0 req-2347707a-c7be-4864-be1d-7d674f46e021 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038187 Aug 04 17:28:32.287339 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3139/6385] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:28:56.521671 n-d-846466-12 devstack@n-api.service[126126]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:28:56.522432 n-d-846466-12 devstack@n-api.service[126126]: Thu Aug 4 17:28:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 17:29:06.181228 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0beb1fea-8a88-4533-be51-ba1a4519dcb2 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:29:06.185410 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=17 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:29:06.186237 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:29:06.192921 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0beb1fea-8a88-4533-be51-ba1a4519dcb2 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:06.193455 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0beb1fea-8a88-4533-be51-ba1a4519dcb2 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:06.225305 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0beb1fea-8a88-4533-be51-ba1a4519dcb2 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Going to try to stop instance {{(pid=126125) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 17:29:06.273271 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0beb1fea-8a88-4533-be51-ba1a4519dcb2 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "POST /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64/action" status: 202 len: 0 microversion: 2.1 time: 0.095731 Aug 04 17:29:06.273982 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3247/6386] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:29:06 2022] POST /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:29:06.281155 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:29:06.282473 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=49 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:29:06.287155 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a323cb7e-12c0-455b-b467-c556fcccc650 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:06.287888 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a323cb7e-12c0-455b-b467-c556fcccc650 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:06.296901 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a323cb7e-12c0-455b-b467-c556fcccc650 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:06.297378 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a323cb7e-12c0-455b-b467-c556fcccc650 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:06.298166 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a323cb7e-12c0-455b-b467-c556fcccc650 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:06.298609 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a323cb7e-12c0-455b-b467-c556fcccc650 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:06.519801 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a323cb7e-12c0-455b-b467-c556fcccc650 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:06.529513 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a323cb7e-12c0-455b-b467-c556fcccc650 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1679 microversion: 2.1 time: 0.250242 Aug 04 17:29:06.530131 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3140/6387] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:06 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1679 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:07.553059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d54b153b-8e54-4ab1-83c7-7be0bd1c808a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:07.553713 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d54b153b-8e54-4ab1-83c7-7be0bd1c808a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:07.561218 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d54b153b-8e54-4ab1-83c7-7be0bd1c808a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:07.561699 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d54b153b-8e54-4ab1-83c7-7be0bd1c808a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:07.562454 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d54b153b-8e54-4ab1-83c7-7be0bd1c808a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:07.562913 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d54b153b-8e54-4ab1-83c7-7be0bd1c808a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:07.761180 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d54b153b-8e54-4ab1-83c7-7be0bd1c808a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:07.769126 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d54b153b-8e54-4ab1-83c7-7be0bd1c808a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1679 microversion: 2.1 time: 0.221603 Aug 04 17:29:07.769740 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3248/6388] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:07 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1679 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:08.791188 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-34936538-be69-4c2f-ab3b-cf1e8ce24cd0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:08.792012 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-34936538-be69-4c2f-ab3b-cf1e8ce24cd0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:08.799555 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-34936538-be69-4c2f-ab3b-cf1e8ce24cd0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:08.800005 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-34936538-be69-4c2f-ab3b-cf1e8ce24cd0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:08.800787 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-34936538-be69-4c2f-ab3b-cf1e8ce24cd0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:08.801227 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-34936538-be69-4c2f-ab3b-cf1e8ce24cd0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:08.937787 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-34936538-be69-4c2f-ab3b-cf1e8ce24cd0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:08.945564 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-34936538-be69-4c2f-ab3b-cf1e8ce24cd0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1679 microversion: 2.1 time: 0.158572 Aug 04 17:29:08.946125 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3141/6389] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:08 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:09.968963 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-35e0d57f-c5ca-476a-848e-5b171eac3efa tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:09.969653 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-35e0d57f-c5ca-476a-848e-5b171eac3efa tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:09.978729 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-35e0d57f-c5ca-476a-848e-5b171eac3efa tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:09.979548 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-35e0d57f-c5ca-476a-848e-5b171eac3efa tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:09.979994 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-35e0d57f-c5ca-476a-848e-5b171eac3efa tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:09.980392 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-35e0d57f-c5ca-476a-848e-5b171eac3efa tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:10.128030 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-35e0d57f-c5ca-476a-848e-5b171eac3efa tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:10.140058 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-35e0d57f-c5ca-476a-848e-5b171eac3efa tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1679 microversion: 2.1 time: 0.175151 Aug 04 17:29:10.140788 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3249/6390] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:09 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:11.167699 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-65f9d259-604f-457d-9b3d-09fc6ebf6d51 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:11.168393 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-65f9d259-604f-457d-9b3d-09fc6ebf6d51 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:11.175561 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65f9d259-604f-457d-9b3d-09fc6ebf6d51 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:11.176028 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65f9d259-604f-457d-9b3d-09fc6ebf6d51 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:11.176799 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65f9d259-604f-457d-9b3d-09fc6ebf6d51 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:11.177240 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-65f9d259-604f-457d-9b3d-09fc6ebf6d51 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:11.325854 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-65f9d259-604f-457d-9b3d-09fc6ebf6d51 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:11.333905 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-65f9d259-604f-457d-9b3d-09fc6ebf6d51 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1679 microversion: 2.1 time: 0.171897 Aug 04 17:29:11.334487 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3142/6391] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:11 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:12.356503 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2164bc70-310e-4ba4-9c06-43387d70370d tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:12.357204 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2164bc70-310e-4ba4-9c06-43387d70370d tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:12.365560 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2164bc70-310e-4ba4-9c06-43387d70370d tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:12.366031 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2164bc70-310e-4ba4-9c06-43387d70370d tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:12.366810 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2164bc70-310e-4ba4-9c06-43387d70370d tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:12.367323 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2164bc70-310e-4ba4-9c06-43387d70370d tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:12.520578 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2164bc70-310e-4ba4-9c06-43387d70370d tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:12.529514 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2164bc70-310e-4ba4-9c06-43387d70370d tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1679 microversion: 2.1 time: 0.177480 Aug 04 17:29:12.530106 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3250/6392] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:12 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:13.551709 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0742aff5-e9d3-495e-b8f0-665291f41a7b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:13.552311 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0742aff5-e9d3-495e-b8f0-665291f41a7b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:13.560357 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0742aff5-e9d3-495e-b8f0-665291f41a7b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:13.560813 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0742aff5-e9d3-495e-b8f0-665291f41a7b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:13.561611 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0742aff5-e9d3-495e-b8f0-665291f41a7b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:13.562050 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0742aff5-e9d3-495e-b8f0-665291f41a7b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:13.728596 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0742aff5-e9d3-495e-b8f0-665291f41a7b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:13.737733 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0742aff5-e9d3-495e-b8f0-665291f41a7b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1679 microversion: 2.1 time: 0.190347 Aug 04 17:29:13.738311 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3143/6393] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:13 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1679 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:14.760471 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-89d2ce33-8c67-4528-9e80-08d0509c8899 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:14.761097 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-89d2ce33-8c67-4528-9e80-08d0509c8899 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:14.768562 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-89d2ce33-8c67-4528-9e80-08d0509c8899 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:14.769008 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-89d2ce33-8c67-4528-9e80-08d0509c8899 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:14.769814 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-89d2ce33-8c67-4528-9e80-08d0509c8899 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:14.770242 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-89d2ce33-8c67-4528-9e80-08d0509c8899 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:14.917643 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-89d2ce33-8c67-4528-9e80-08d0509c8899 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:14.925840 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-89d2ce33-8c67-4528-9e80-08d0509c8899 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1679 microversion: 2.1 time: 0.169131 Aug 04 17:29:14.926573 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3251/6394] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:14 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:15.948135 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a6fed4b4-6aa6-4d14-8f0b-26845e740807 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:15.948802 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a6fed4b4-6aa6-4d14-8f0b-26845e740807 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:15.956552 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6fed4b4-6aa6-4d14-8f0b-26845e740807 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:15.957002 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6fed4b4-6aa6-4d14-8f0b-26845e740807 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:15.958636 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6fed4b4-6aa6-4d14-8f0b-26845e740807 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:15.958636 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6fed4b4-6aa6-4d14-8f0b-26845e740807 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:16.102016 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a6fed4b4-6aa6-4d14-8f0b-26845e740807 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:16.110979 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a6fed4b4-6aa6-4d14-8f0b-26845e740807 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1679 microversion: 2.1 time: 0.166665 Aug 04 17:29:16.111587 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3144/6395] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:15 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:17.132529 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c55474c6-5386-4d12-812f-a88c5395722e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:17.133771 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c55474c6-5386-4d12-812f-a88c5395722e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:17.141749 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c55474c6-5386-4d12-812f-a88c5395722e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:17.142213 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c55474c6-5386-4d12-812f-a88c5395722e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:17.143010 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c55474c6-5386-4d12-812f-a88c5395722e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:17.143450 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c55474c6-5386-4d12-812f-a88c5395722e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:17.286850 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c55474c6-5386-4d12-812f-a88c5395722e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:17.295288 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c55474c6-5386-4d12-812f-a88c5395722e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1679 microversion: 2.1 time: 0.166810 Aug 04 17:29:17.295960 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3252/6396] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:17 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:18.316549 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-35e2b5cf-54cb-4aa0-b6d3-9fa28d7c3b0a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:18.317166 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-35e2b5cf-54cb-4aa0-b6d3-9fa28d7c3b0a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:18.325082 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-35e2b5cf-54cb-4aa0-b6d3-9fa28d7c3b0a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:18.325555 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-35e2b5cf-54cb-4aa0-b6d3-9fa28d7c3b0a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:18.326375 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-35e2b5cf-54cb-4aa0-b6d3-9fa28d7c3b0a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:18.326794 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-35e2b5cf-54cb-4aa0-b6d3-9fa28d7c3b0a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:18.486579 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-35e2b5cf-54cb-4aa0-b6d3-9fa28d7c3b0a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:18.494545 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-35e2b5cf-54cb-4aa0-b6d3-9fa28d7c3b0a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1679 microversion: 2.1 time: 0.181972 Aug 04 17:29:18.495107 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3145/6397] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:18 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:19.518626 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fffef8a9-449b-4c75-9c5f-ab62e4b008c7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:19.519191 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fffef8a9-449b-4c75-9c5f-ab62e4b008c7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:19.527264 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fffef8a9-449b-4c75-9c5f-ab62e4b008c7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:19.527681 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fffef8a9-449b-4c75-9c5f-ab62e4b008c7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:19.528468 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fffef8a9-449b-4c75-9c5f-ab62e4b008c7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:19.528900 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fffef8a9-449b-4c75-9c5f-ab62e4b008c7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:19.670676 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fffef8a9-449b-4c75-9c5f-ab62e4b008c7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:19.678873 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fffef8a9-449b-4c75-9c5f-ab62e4b008c7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1679 microversion: 2.1 time: 0.164757 Aug 04 17:29:19.679483 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3253/6398] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:19 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:20.701557 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-718fb035-dd1e-4c21-9b1e-fc3752891a4c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:20.702242 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-718fb035-dd1e-4c21-9b1e-fc3752891a4c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:20.710114 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-718fb035-dd1e-4c21-9b1e-fc3752891a4c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:20.710726 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-718fb035-dd1e-4c21-9b1e-fc3752891a4c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:20.711695 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-718fb035-dd1e-4c21-9b1e-fc3752891a4c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:20.712135 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-718fb035-dd1e-4c21-9b1e-fc3752891a4c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:20.881991 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-718fb035-dd1e-4c21-9b1e-fc3752891a4c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:20.891667 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-718fb035-dd1e-4c21-9b1e-fc3752891a4c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1679 microversion: 2.1 time: 0.194636 Aug 04 17:29:20.892300 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3146/6399] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:20 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1679 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:21.914256 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2faea8f1-dcb2-4046-8a33-61d94bd51bab tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:21.915319 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2faea8f1-dcb2-4046-8a33-61d94bd51bab tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:21.923201 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2faea8f1-dcb2-4046-8a33-61d94bd51bab tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:21.923706 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2faea8f1-dcb2-4046-8a33-61d94bd51bab tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:21.924634 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2faea8f1-dcb2-4046-8a33-61d94bd51bab tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:21.925124 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2faea8f1-dcb2-4046-8a33-61d94bd51bab tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:22.063126 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2faea8f1-dcb2-4046-8a33-61d94bd51bab tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:22.073010 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2faea8f1-dcb2-4046-8a33-61d94bd51bab tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1656 microversion: 2.1 time: 0.163169 Aug 04 17:29:22.073643 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3254/6400] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:21 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1656 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:22.094968 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0a75d446-415a-4063-8b29-1eedd2b99e63 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:29:22.097258 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0a75d446-415a-4063-8b29-1eedd2b99e63 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:22.106506 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0a75d446-415a-4063-8b29-1eedd2b99e63 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:22.106970 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0a75d446-415a-4063-8b29-1eedd2b99e63 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:22.107739 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0a75d446-415a-4063-8b29-1eedd2b99e63 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:22.108181 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0a75d446-415a-4063-8b29-1eedd2b99e63 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:22.149009 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0a75d446-415a-4063-8b29-1eedd2b99e63 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:22.156605 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0a75d446-415a-4063-8b29-1eedd2b99e63 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Old instance type m1.heat2, new instance type m1.heat {{(pid=126126) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 17:29:22.164869 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-0a75d446-415a-4063-8b29-1eedd2b99e63 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:29:22.165154 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-0a75d446-415a-4063-8b29-1eedd2b99e63 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:29:22.165683 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-0a75d446-415a-4063-8b29-1eedd2b99e63 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:29:22.166117 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-0a75d446-415a-4063-8b29-1eedd2b99e63 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:29:22.166530 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-0a75d446-415a-4063-8b29-1eedd2b99e63 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:29:22.241320 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0a75d446-415a-4063-8b29-1eedd2b99e63 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "POST /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64/action" status: 202 len: 0 microversion: 2.1 time: 0.150671 Aug 04 17:29:22.242348 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3147/6401] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:29:22 2022] POST /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:29:22.254800 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b2086b2d-49cc-4734-9426-732c5eda0b47 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:22.255934 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b2086b2d-49cc-4734-9426-732c5eda0b47 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:22.267464 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2086b2d-49cc-4734-9426-732c5eda0b47 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:22.268546 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2086b2d-49cc-4734-9426-732c5eda0b47 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:22.269950 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2086b2d-49cc-4734-9426-732c5eda0b47 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:22.270714 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2086b2d-49cc-4734-9426-732c5eda0b47 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:22.433638 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b2086b2d-49cc-4734-9426-732c5eda0b47 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:22.442554 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b2086b2d-49cc-4734-9426-732c5eda0b47 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1679 microversion: 2.1 time: 0.195603 Aug 04 17:29:22.443132 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3255/6402] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:22 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1679 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:23.466302 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9b6de05f-ee0c-4fa2-a267-acb007e2ae28 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:23.467825 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9b6de05f-ee0c-4fa2-a267-acb007e2ae28 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:23.474494 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9b6de05f-ee0c-4fa2-a267-acb007e2ae28 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:23.474965 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9b6de05f-ee0c-4fa2-a267-acb007e2ae28 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:23.475752 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9b6de05f-ee0c-4fa2-a267-acb007e2ae28 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:23.476181 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9b6de05f-ee0c-4fa2-a267-acb007e2ae28 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:23.642087 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9b6de05f-ee0c-4fa2-a267-acb007e2ae28 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:23.651404 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9b6de05f-ee0c-4fa2-a267-acb007e2ae28 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1679 microversion: 2.1 time: 0.190924 Aug 04 17:29:23.651976 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3148/6403] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:23 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1679 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:24.674187 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-50bab32c-b67a-4625-ac01-248423a80f8e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:24.674826 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-50bab32c-b67a-4625-ac01-248423a80f8e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:24.682345 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50bab32c-b67a-4625-ac01-248423a80f8e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:24.682795 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50bab32c-b67a-4625-ac01-248423a80f8e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:24.684042 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50bab32c-b67a-4625-ac01-248423a80f8e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:24.684204 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50bab32c-b67a-4625-ac01-248423a80f8e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:24.842990 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-50bab32c-b67a-4625-ac01-248423a80f8e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:24.851439 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-50bab32c-b67a-4625-ac01-248423a80f8e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1684 microversion: 2.1 time: 0.181246 Aug 04 17:29:24.852289 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3256/6404] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:24 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1684 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:25.875410 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4f490130-799e-45a7-b05e-adadfc718642 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:25.876087 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4f490130-799e-45a7-b05e-adadfc718642 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:25.883619 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4f490130-799e-45a7-b05e-adadfc718642 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:25.884124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4f490130-799e-45a7-b05e-adadfc718642 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:25.884908 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4f490130-799e-45a7-b05e-adadfc718642 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:25.885382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4f490130-799e-45a7-b05e-adadfc718642 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:26.030506 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4f490130-799e-45a7-b05e-adadfc718642 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:26.039500 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4f490130-799e-45a7-b05e-adadfc718642 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1684 microversion: 2.1 time: 0.168024 Aug 04 17:29:26.040096 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3149/6405] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:25 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:27.063596 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7f19a702-5d1e-4ed0-adbc-318e122c0299 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:27.064182 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7f19a702-5d1e-4ed0-adbc-318e122c0299 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:27.074885 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f19a702-5d1e-4ed0-adbc-318e122c0299 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:27.075224 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f19a702-5d1e-4ed0-adbc-318e122c0299 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:27.077233 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f19a702-5d1e-4ed0-adbc-318e122c0299 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:27.077767 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f19a702-5d1e-4ed0-adbc-318e122c0299 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:27.086146 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-d5384333-3736-462f-9f31-43f3ba1f4c8a req-251cc62e-48aa-4764-84b0-d6aa009d1320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5a493ec-0c95-4de8-b936-c1ca011c7e64", "name": "network-vif-unplugged", "status": "completed", "tag": "3465a349-10f4-459a-9dfc-7801a11864e3"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:29:27.096482 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-d5384333-3736-462f-9f31-43f3ba1f4c8a req-251cc62e-48aa-4764-84b0-d6aa009d1320 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:27.096933 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-d5384333-3736-462f-9f31-43f3ba1f4c8a req-251cc62e-48aa-4764-84b0-d6aa009d1320 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:27.109649 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-d5384333-3736-462f-9f31-43f3ba1f4c8a req-251cc62e-48aa-4764-84b0-d6aa009d1320 service nova] Creating event network-vif-unplugged:3465a349-10f4-459a-9dfc-7801a11864e3 for instance f5a493ec-0c95-4de8-b936-c1ca011c7e64 on n-h1-846466-12 Aug 04 17:29:27.116246 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [req-d5384333-3736-462f-9f31-43f3ba1f4c8a req-251cc62e-48aa-4764-84b0-d6aa009d1320 service nova] Instance f5a493ec-0c95-4de8-b936-c1ca011c7e64 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:29:27.128637 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-d5384333-3736-462f-9f31-43f3ba1f4c8a req-251cc62e-48aa-4764-84b0-d6aa009d1320 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123002 Aug 04 17:29:27.129268 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3257/6406] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:29:27.392579 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7f19a702-5d1e-4ed0-adbc-318e122c0299 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:27.400958 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7f19a702-5d1e-4ed0-adbc-318e122c0299 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1683 microversion: 2.1 time: 0.342647 Aug 04 17:29:27.417551 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3150/6407] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:27 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1683 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:29:28.428746 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-66a28b80-c53b-4105-aeaf-a2ff19276c3b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:28.429526 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-66a28b80-c53b-4105-aeaf-a2ff19276c3b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:28.436888 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-66a28b80-c53b-4105-aeaf-a2ff19276c3b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:28.437393 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-66a28b80-c53b-4105-aeaf-a2ff19276c3b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:28.438198 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-66a28b80-c53b-4105-aeaf-a2ff19276c3b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:28.438668 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-66a28b80-c53b-4105-aeaf-a2ff19276c3b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:28.592820 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-66a28b80-c53b-4105-aeaf-a2ff19276c3b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:28.601166 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-66a28b80-c53b-4105-aeaf-a2ff19276c3b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1681 microversion: 2.1 time: 0.177903 Aug 04 17:29:28.601808 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3258/6408] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:28 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:29:29.157260 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-9cecf2b4-206d-475d-8e1a-d1ad03c88f98 req-62c089a0-41da-402a-9133-3b184702e989 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5a493ec-0c95-4de8-b936-c1ca011c7e64", "tag": "3465a349-10f4-459a-9dfc-7801a11864e3"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:29:29.169489 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-9cecf2b4-206d-475d-8e1a-d1ad03c88f98 req-62c089a0-41da-402a-9133-3b184702e989 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:29.169955 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-9cecf2b4-206d-475d-8e1a-d1ad03c88f98 req-62c089a0-41da-402a-9133-3b184702e989 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:29.183268 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-9cecf2b4-206d-475d-8e1a-d1ad03c88f98 req-62c089a0-41da-402a-9133-3b184702e989 service nova] Creating event network-changed:3465a349-10f4-459a-9dfc-7801a11864e3 for instance f5a493ec-0c95-4de8-b936-c1ca011c7e64 on n-h1-846466-12 Aug 04 17:29:29.190857 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [req-9cecf2b4-206d-475d-8e1a-d1ad03c88f98 req-62c089a0-41da-402a-9133-3b184702e989 service nova] Instance f5a493ec-0c95-4de8-b936-c1ca011c7e64 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126126) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:29:29.203875 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-9cecf2b4-206d-475d-8e1a-d1ad03c88f98 req-62c089a0-41da-402a-9133-3b184702e989 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052512 Aug 04 17:29:29.204753 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3151/6409] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:29:29.624559 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-aab3506e-c296-40c9-b061-9f88e58a0ea3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:29.626589 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-aab3506e-c296-40c9-b061-9f88e58a0ea3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:29.639059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aab3506e-c296-40c9-b061-9f88e58a0ea3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:29.639629 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aab3506e-c296-40c9-b061-9f88e58a0ea3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:29.640746 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aab3506e-c296-40c9-b061-9f88e58a0ea3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:29.641271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aab3506e-c296-40c9-b061-9f88e58a0ea3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:29.919647 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-aab3506e-c296-40c9-b061-9f88e58a0ea3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:29.929094 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-aab3506e-c296-40c9-b061-9f88e58a0ea3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1681 microversion: 2.1 time: 0.308804 Aug 04 17:29:29.929687 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3259/6410] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:29 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1681 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:30.955483 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b6a2e5c0-f680-494c-b331-9d9729027a9d tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:30.956346 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b6a2e5c0-f680-494c-b331-9d9729027a9d tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:30.964507 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b6a2e5c0-f680-494c-b331-9d9729027a9d tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:30.964966 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b6a2e5c0-f680-494c-b331-9d9729027a9d tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:30.966157 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b6a2e5c0-f680-494c-b331-9d9729027a9d tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:30.966732 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b6a2e5c0-f680-494c-b331-9d9729027a9d tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:31.136590 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b6a2e5c0-f680-494c-b331-9d9729027a9d tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:31.145726 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b6a2e5c0-f680-494c-b331-9d9729027a9d tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1677 microversion: 2.1 time: 0.195725 Aug 04 17:29:31.146229 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3152/6411] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:30 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1677 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:31.168375 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5b1165f8-0597-45f9-883e-e6a6f0f33c40 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:29:31.169642 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5b1165f8-0597-45f9-883e-e6a6f0f33c40 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:31.178238 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5b1165f8-0597-45f9-883e-e6a6f0f33c40 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:31.178680 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5b1165f8-0597-45f9-883e-e6a6f0f33c40 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:31.179484 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5b1165f8-0597-45f9-883e-e6a6f0f33c40 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:31.179914 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5b1165f8-0597-45f9-883e-e6a6f0f33c40 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:31.255350 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5b1165f8-0597-45f9-883e-e6a6f0f33c40 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "POST /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64/action" status: 204 len: 0 microversion: 2.1 time: 0.090841 Aug 04 17:29:31.256196 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3260/6412] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:29:31 2022] POST /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64/action => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:29:31.270024 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fbccc878-4a15-4f7b-8f72-255e96190b9f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:31.271833 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fbccc878-4a15-4f7b-8f72-255e96190b9f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:31.283883 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fbccc878-4a15-4f7b-8f72-255e96190b9f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:31.284734 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fbccc878-4a15-4f7b-8f72-255e96190b9f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:31.286181 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fbccc878-4a15-4f7b-8f72-255e96190b9f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:31.286907 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fbccc878-4a15-4f7b-8f72-255e96190b9f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:31.485828 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fbccc878-4a15-4f7b-8f72-255e96190b9f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:31.497029 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fbccc878-4a15-4f7b-8f72-255e96190b9f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1677 microversion: 2.1 time: 0.235458 Aug 04 17:29:31.498279 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3153/6413] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:31 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1677 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:32.522058 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-eb1ac509-1477-4f41-959c-ce0c71765646 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:32.523070 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-eb1ac509-1477-4f41-959c-ce0c71765646 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:32.530799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eb1ac509-1477-4f41-959c-ce0c71765646 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:32.531349 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eb1ac509-1477-4f41-959c-ce0c71765646 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:32.532153 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eb1ac509-1477-4f41-959c-ce0c71765646 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:32.532851 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eb1ac509-1477-4f41-959c-ce0c71765646 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:32.727231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-eb1ac509-1477-4f41-959c-ce0c71765646 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:32.729784 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:29:32.738611 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-eb1ac509-1477-4f41-959c-ce0c71765646 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1677 microversion: 2.1 time: 0.222044 Aug 04 17:29:32.739264 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3261/6414] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:32 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1677 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:33.761891 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f76aab38-beb9-4184-a904-021882df6513 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:33.763290 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f76aab38-beb9-4184-a904-021882df6513 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:33.771668 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f76aab38-beb9-4184-a904-021882df6513 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:33.772123 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f76aab38-beb9-4184-a904-021882df6513 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:33.772945 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f76aab38-beb9-4184-a904-021882df6513 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:33.773417 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f76aab38-beb9-4184-a904-021882df6513 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:33.958366 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f76aab38-beb9-4184-a904-021882df6513 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:33.991574 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f76aab38-beb9-4184-a904-021882df6513 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1656 microversion: 2.1 time: 0.234829 Aug 04 17:29:34.005522 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3154/6415] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:33 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1656 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:34.013988 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5ff6623d-c715-46ba-ab74-dce0f65f7143 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:34.014740 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5ff6623d-c715-46ba-ab74-dce0f65f7143 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:34.022168 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ff6623d-c715-46ba-ab74-dce0f65f7143 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:34.022687 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ff6623d-c715-46ba-ab74-dce0f65f7143 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:34.023488 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ff6623d-c715-46ba-ab74-dce0f65f7143 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:34.024670 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5ff6623d-c715-46ba-ab74-dce0f65f7143 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:34.034132 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-94d56bca-321e-4bef-807a-c872108b8ecc req-40b1eed1-fd29-423d-b29d-7833bd6c47ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5a493ec-0c95-4de8-b936-c1ca011c7e64", "name": "network-vif-plugged", "status": "completed", "tag": "3465a349-10f4-459a-9dfc-7801a11864e3"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:29:34.045378 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-94d56bca-321e-4bef-807a-c872108b8ecc req-40b1eed1-fd29-423d-b29d-7833bd6c47ba service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:34.045833 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-94d56bca-321e-4bef-807a-c872108b8ecc req-40b1eed1-fd29-423d-b29d-7833bd6c47ba service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:34.051629 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:29:34.058892 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-94d56bca-321e-4bef-807a-c872108b8ecc req-40b1eed1-fd29-423d-b29d-7833bd6c47ba service nova] Creating event network-vif-plugged:3465a349-10f4-459a-9dfc-7801a11864e3 for instance f5a493ec-0c95-4de8-b936-c1ca011c7e64 on n-h1-846466-12 Aug 04 17:29:34.064443 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-94d56bca-321e-4bef-807a-c872108b8ecc req-40b1eed1-fd29-423d-b29d-7833bd6c47ba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120735 Aug 04 17:29:34.065083 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3262/6416] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:29:34.174879 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5ff6623d-c715-46ba-ab74-dce0f65f7143 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:34.183648 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5ff6623d-c715-46ba-ab74-dce0f65f7143 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1656 microversion: 2.1 time: 0.174218 Aug 04 17:29:34.184254 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3155/6417] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:34 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1656 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:34.208405 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0d102c24-3902-40c4-bdd3-3f9cb4cb9805 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:29:34.218266 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0d102c24-3902-40c4-bdd3-3f9cb4cb9805 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:34.218787 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0d102c24-3902-40c4-bdd3-3f9cb4cb9805 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:34.244630 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0d102c24-3902-40c4-bdd3-3f9cb4cb9805 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Going to try to start instance {{(pid=126125) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 17:29:34.304374 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0d102c24-3902-40c4-bdd3-3f9cb4cb9805 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "POST /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64/action" status: 202 len: 0 microversion: 2.1 time: 0.099749 Aug 04 17:29:34.305050 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3263/6418] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:29:34 2022] POST /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:29:34.314772 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c732e45d-5014-4cfe-875e-54f8a7e42040 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:34.315508 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c732e45d-5014-4cfe-875e-54f8a7e42040 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:34.327040 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c732e45d-5014-4cfe-875e-54f8a7e42040 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:34.327754 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c732e45d-5014-4cfe-875e-54f8a7e42040 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:34.329008 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c732e45d-5014-4cfe-875e-54f8a7e42040 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:34.329816 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c732e45d-5014-4cfe-875e-54f8a7e42040 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:34.534246 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c732e45d-5014-4cfe-875e-54f8a7e42040 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:34.542734 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c732e45d-5014-4cfe-875e-54f8a7e42040 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1665 microversion: 2.1 time: 0.232218 Aug 04 17:29:34.543449 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3156/6419] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:34 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1665 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:29:35.566101 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5766f1dc-5028-4aeb-bc8a-23c6468909af tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:35.566925 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5766f1dc-5028-4aeb-bc8a-23c6468909af tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:35.573913 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5766f1dc-5028-4aeb-bc8a-23c6468909af tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:35.574555 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5766f1dc-5028-4aeb-bc8a-23c6468909af tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:35.575514 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5766f1dc-5028-4aeb-bc8a-23c6468909af tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:35.576136 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5766f1dc-5028-4aeb-bc8a-23c6468909af tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:35.719596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5766f1dc-5028-4aeb-bc8a-23c6468909af tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:35.731254 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5766f1dc-5028-4aeb-bc8a-23c6468909af tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1669 microversion: 2.1 time: 0.170242 Aug 04 17:29:35.731824 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3264/6420] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:35 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1669 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:35.751879 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-49d4a9f6-dfd9-411b-b653-f25658c99fdf tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:35.752444 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-49d4a9f6-dfd9-411b-b653-f25658c99fdf tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:35.759932 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-49d4a9f6-dfd9-411b-b653-f25658c99fdf tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:35.760391 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-49d4a9f6-dfd9-411b-b653-f25658c99fdf tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:35.761153 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-49d4a9f6-dfd9-411b-b653-f25658c99fdf tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:35.761630 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-49d4a9f6-dfd9-411b-b653-f25658c99fdf tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:35.789320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-49d4a9f6-dfd9-411b-b653-f25658c99fdf tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:29:35.873799 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-49d4a9f6-dfd9-411b-b653-f25658c99fdf tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 204 len: 0 microversion: 2.1 time: 0.125449 Aug 04 17:29:35.874766 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3157/6421] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:29:35 2022] DELETE /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 17:29:35.883338 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4af849d4-cc71-4c85-b77a-5c0cc33a85a8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:35.883953 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4af849d4-cc71-4c85-b77a-5c0cc33a85a8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:35.890903 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4af849d4-cc71-4c85-b77a-5c0cc33a85a8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:35.891350 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4af849d4-cc71-4c85-b77a-5c0cc33a85a8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:35.892116 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4af849d4-cc71-4c85-b77a-5c0cc33a85a8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:35.892546 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4af849d4-cc71-4c85-b77a-5c0cc33a85a8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:36.037387 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4af849d4-cc71-4c85-b77a-5c0cc33a85a8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:36.049318 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4af849d4-cc71-4c85-b77a-5c0cc33a85a8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1675 microversion: 2.1 time: 0.169741 Aug 04 17:29:36.050271 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3265/6422] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:35 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:37.076628 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-212d9c83-281e-4615-bfb0-8873aeec11b6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:37.077392 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-212d9c83-281e-4615-bfb0-8873aeec11b6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:37.081870 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:29:37.091496 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-212d9c83-281e-4615-bfb0-8873aeec11b6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:37.092333 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-212d9c83-281e-4615-bfb0-8873aeec11b6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:37.094168 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-212d9c83-281e-4615-bfb0-8873aeec11b6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:37.094316 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-212d9c83-281e-4615-bfb0-8873aeec11b6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:37.250721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-212d9c83-281e-4615-bfb0-8873aeec11b6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:37.259087 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-212d9c83-281e-4615-bfb0-8873aeec11b6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1675 microversion: 2.1 time: 0.188022 Aug 04 17:29:37.259664 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3158/6423] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:37 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1675 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:38.281598 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0ce2c084-6bfa-4ec3-9751-a23eee008dab tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:38.282221 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0ce2c084-6bfa-4ec3-9751-a23eee008dab tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:38.285184 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=39 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:29:38.291221 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ce2c084-6bfa-4ec3-9751-a23eee008dab tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:38.291676 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ce2c084-6bfa-4ec3-9751-a23eee008dab tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:38.292461 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ce2c084-6bfa-4ec3-9751-a23eee008dab tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:38.292900 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0ce2c084-6bfa-4ec3-9751-a23eee008dab tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:38.400262 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0ce2c084-6bfa-4ec3-9751-a23eee008dab tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:38.409068 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0ce2c084-6bfa-4ec3-9751-a23eee008dab tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 200 len: 1607 microversion: 2.1 time: 0.131528 Aug 04 17:29:38.410361 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3266/6424] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:38 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 1607 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:38.641862 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-f6ffd767-6d2a-43f8-ad3e-a15119b5be59 req-ac022331-532c-45b2-af45-302ad46a0b82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5a493ec-0c95-4de8-b936-c1ca011c7e64", "name": "network-vif-deleted", "tag": "3465a349-10f4-459a-9dfc-7801a11864e3"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:29:38.654419 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f6ffd767-6d2a-43f8-ad3e-a15119b5be59 req-ac022331-532c-45b2-af45-302ad46a0b82 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:38.654419 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f6ffd767-6d2a-43f8-ad3e-a15119b5be59 req-ac022331-532c-45b2-af45-302ad46a0b82 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:38.665703 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-f6ffd767-6d2a-43f8-ad3e-a15119b5be59 req-ac022331-532c-45b2-af45-302ad46a0b82 service nova] Creating event network-vif-deleted:3465a349-10f4-459a-9dfc-7801a11864e3 for instance f5a493ec-0c95-4de8-b936-c1ca011c7e64 on n-h1-846466-12 Aug 04 17:29:38.671372 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-f6ffd767-6d2a-43f8-ad3e-a15119b5be59 req-ac022331-532c-45b2-af45-302ad46a0b82 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033477 Aug 04 17:29:38.672183 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3159/6425] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:29:39.441726 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-54920add-8772-406f-a9ec-c468e8e681fa tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:39.443078 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-54920add-8772-406f-a9ec-c468e8e681fa tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:39.451187 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-54920add-8772-406f-a9ec-c468e8e681fa tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:39.451627 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-54920add-8772-406f-a9ec-c468e8e681fa tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:39.452406 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-54920add-8772-406f-a9ec-c468e8e681fa tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:39.452836 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-54920add-8772-406f-a9ec-c468e8e681fa tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:39.468232 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-54920add-8772-406f-a9ec-c468e8e681fa tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] HTTP exception thrown: Instance f5a493ec-0c95-4de8-b936-c1ca011c7e64 could not be found. Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-54920add-8772-406f-a9ec-c468e8e681fa tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Request method failure captured: Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 HTTP/1.1 Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi7AFiltLP9EvcwVpFCa2h6tq19pMq_32JMtbXN51DOjApDm4jayRdzcaHrSSvhfA_fIVFHE8QZgkPi4lki3zEP2UZCg1aFWM1RMSCACgdYoFYi89kiTnRN1cdwnfZRtBXt50OfsjmdprRxr5_GXWBGj1IhGtf3jvIm_b3rzVGsscSyQY Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 9fa3479e48da461eb31ba242143690c6 Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerActionsTestJSON-75947691 Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fa3479e48da461eb31ba242143690c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9fa3479e48da461eb31ba242143690c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fa3479e48da461eb31ba242143690c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9fa3479e48da461eb31ba242143690c6"}]}] Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerActionsTestJSON-75947691 Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 9fa3479e48da461eb31ba242143690c6 Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerActionsTestJSON-75947691 Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerActionsTestJSON-75947691-project Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: dd0d0aebe00643899de4edd08345e3fd Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerActionsTestJSON-75947691-project Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance f5a493ec-0c95-4de8-b936-c1ca011c7e64 could not be found. Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'f5a493ec-0c95-4de8-b936-c1ca011c7e64'} Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5a493ec-0c95-4de8-b936-c1ca011c7e64 could not be found. Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5a493ec-0c95-4de8-b936-c1ca011c7e64 could not be found. Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:29:39.470132 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:29:39.475352 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:29:39.475352 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:29:39.475352 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:29:39.475352 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:29:39.475352 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:29:39.475352 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5a493ec-0c95-4de8-b936-c1ca011c7e64 could not be found. Aug 04 17:29:39.475352 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:29:39.475352 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-54920add-8772-406f-a9ec-c468e8e681fa tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Returning 404 to user: Instance f5a493ec-0c95-4de8-b936-c1ca011c7e64 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:29:39.475352 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-54920add-8772-406f-a9ec-c468e8e681fa tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 404 len: 111 microversion: 2.1 time: 0.034854 Aug 04 17:29:39.475352 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3267/6426] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:39 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:29:39.492720 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f714bf4a-987b-4ba8-a6f4-55c3c22c6a3c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:39.493883 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f714bf4a-987b-4ba8-a6f4-55c3c22c6a3c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:39.504952 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f714bf4a-987b-4ba8-a6f4-55c3c22c6a3c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:39.505794 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f714bf4a-987b-4ba8-a6f4-55c3c22c6a3c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:39.506397 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f714bf4a-987b-4ba8-a6f4-55c3c22c6a3c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:39.506799 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f714bf4a-987b-4ba8-a6f4-55c3c22c6a3c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:39.522668 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-f714bf4a-987b-4ba8-a6f4-55c3c22c6a3c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] HTTP exception thrown: Instance f5a493ec-0c95-4de8-b936-c1ca011c7e64 could not be found. Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f714bf4a-987b-4ba8-a6f4-55c3c22c6a3c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Request method failure captured: Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 HTTP/1.1 Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi7AFiltLP9EvcwVpFCa2h6tq19pMq_32JMtbXN51DOjApDm4jayRdzcaHrSSvhfA_fIVFHE8QZgkPi4lki3zEP2UZCg1aFWM1RMSCACgdYoFYi89kiTnRN1cdwnfZRtBXt50OfsjmdprRxr5_GXWBGj1IhGtf3jvIm_b3rzVGsscSyQY Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 9fa3479e48da461eb31ba242143690c6 Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServerActionsTestJSON-75947691 Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fa3479e48da461eb31ba242143690c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9fa3479e48da461eb31ba242143690c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fa3479e48da461eb31ba242143690c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9fa3479e48da461eb31ba242143690c6"}]}] Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServerActionsTestJSON-75947691 Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 9fa3479e48da461eb31ba242143690c6 Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServerActionsTestJSON-75947691 Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServerActionsTestJSON-75947691-project Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: dd0d0aebe00643899de4edd08345e3fd Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServerActionsTestJSON-75947691-project Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance f5a493ec-0c95-4de8-b936-c1ca011c7e64 could not be found. Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'f5a493ec-0c95-4de8-b936-c1ca011c7e64'} Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5a493ec-0c95-4de8-b936-c1ca011c7e64 could not be found. Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5a493ec-0c95-4de8-b936-c1ca011c7e64 could not be found. Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:29:39.524385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:29:39.529211 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:29:39.529211 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:29:39.529211 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:29:39.529211 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:29:39.529211 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:29:39.529211 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5a493ec-0c95-4de8-b936-c1ca011c7e64 could not be found. Aug 04 17:29:39.529211 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:29:39.529211 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f714bf4a-987b-4ba8-a6f4-55c3c22c6a3c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Returning 404 to user: Instance f5a493ec-0c95-4de8-b936-c1ca011c7e64 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:29:39.529211 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f714bf4a-987b-4ba8-a6f4-55c3c22c6a3c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 404 len: 111 microversion: 2.1 time: 0.037757 Aug 04 17:29:39.529211 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3160/6427] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:39 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:29:39.578858 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-55159d03-ed04-4c91-adeb-8cc8081da576 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1813972445", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "0574ddc3-153c-4baf-a31a-673b773c4799"}], "security_groups": [{"name": "tempest-securitygroup--2108948134"}], "key_name": "tempest-keypair-495351782", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:29:39.697492 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-55159d03-ed04-4c91-adeb-8cc8081da576 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] validate_networks() for [('0574ddc3-153c-4baf-a31a-673b773c4799', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:29:40.181100 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-55159d03-ed04-4c91-adeb-8cc8081da576 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:29:40.181682 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-55159d03-ed04-4c91-adeb-8cc8081da576 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:29:40.182159 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-55159d03-ed04-4c91-adeb-8cc8081da576 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:29:40.182564 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-55159d03-ed04-4c91-adeb-8cc8081da576 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:29:40.182972 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-55159d03-ed04-4c91-adeb-8cc8081da576 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:29:40.193073 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-55159d03-ed04-4c91-adeb-8cc8081da576 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:40.193573 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-55159d03-ed04-4c91-adeb-8cc8081da576 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:40.194371 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-55159d03-ed04-4c91-adeb-8cc8081da576 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:40.194803 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-55159d03-ed04-4c91-adeb-8cc8081da576 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:40.215936 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-55159d03-ed04-4c91-adeb-8cc8081da576 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Getting quotas for project 9fa3479e48da461eb31ba242143690c6. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:29:40.221516 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-55159d03-ed04-4c91-adeb-8cc8081da576 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Getting quotas for user dd0d0aebe00643899de4edd08345e3fd and project 9fa3479e48da461eb31ba242143690c6. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:29:40.234850 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-55159d03-ed04-4c91-adeb-8cc8081da576 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:29:40.237189 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-55159d03-ed04-4c91-adeb-8cc8081da576 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:29:40.287455 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-55159d03-ed04-4c91-adeb-8cc8081da576 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.712935 Aug 04 17:29:40.288316 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3268/6428] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:29:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:29:40.300129 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-85b9cc8b-e433-4bda-a3b6-4fd74cbd9a88 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:40.300904 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-85b9cc8b-e433-4bda-a3b6-4fd74cbd9a88 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:40.373302 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-85b9cc8b-e433-4bda-a3b6-4fd74cbd9a88 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:40.384577 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-85b9cc8b-e433-4bda-a3b6-4fd74cbd9a88 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1238 microversion: 2.1 time: 0.088365 Aug 04 17:29:40.385158 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3161/6429] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:40 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1238 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:41.408884 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5d228b69-edb2-43af-8bb4-10a991e85262 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:41.409712 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5d228b69-edb2-43af-8bb4-10a991e85262 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:41.417158 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5d228b69-edb2-43af-8bb4-10a991e85262 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:41.417915 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5d228b69-edb2-43af-8bb4-10a991e85262 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:41.418950 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5d228b69-edb2-43af-8bb4-10a991e85262 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:41.419558 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5d228b69-edb2-43af-8bb4-10a991e85262 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:41.485736 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5d228b69-edb2-43af-8bb4-10a991e85262 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:41.494334 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5d228b69-edb2-43af-8bb4-10a991e85262 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1298 microversion: 2.1 time: 0.090561 Aug 04 17:29:41.495269 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3269/6430] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:41 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1298 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:42.516917 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5fb0357d-167b-4a75-85e7-7fcf2c021130 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:42.517595 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5fb0357d-167b-4a75-85e7-7fcf2c021130 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:42.525199 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5fb0357d-167b-4a75-85e7-7fcf2c021130 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:42.525721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5fb0357d-167b-4a75-85e7-7fcf2c021130 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:42.526501 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5fb0357d-167b-4a75-85e7-7fcf2c021130 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:42.526968 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5fb0357d-167b-4a75-85e7-7fcf2c021130 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:42.676509 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5fb0357d-167b-4a75-85e7-7fcf2c021130 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:42.684938 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5fb0357d-167b-4a75-85e7-7fcf2c021130 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1364 microversion: 2.1 time: 0.171863 Aug 04 17:29:42.685370 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3162/6431] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:42 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:42.852785 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-b0b4ebd5-64f3-41ae-b622-8d8cc764cf2d req-5a2ffdb1-52fc-4371-b32d-474d97d8f9ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "786b5805-feed-4d1c-99fe-c6e1407e30e4", "tag": "2e349370-2da6-4c8c-96ba-f3961765fe22"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:29:42.868690 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-b0b4ebd5-64f3-41ae-b622-8d8cc764cf2d req-5a2ffdb1-52fc-4371-b32d-474d97d8f9ce service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:42.869173 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-b0b4ebd5-64f3-41ae-b622-8d8cc764cf2d req-5a2ffdb1-52fc-4371-b32d-474d97d8f9ce service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:42.881582 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-b0b4ebd5-64f3-41ae-b622-8d8cc764cf2d req-5a2ffdb1-52fc-4371-b32d-474d97d8f9ce service nova] Creating event network-changed:2e349370-2da6-4c8c-96ba-f3961765fe22 for instance 786b5805-feed-4d1c-99fe-c6e1407e30e4 on n-h2-846466-12 Aug 04 17:29:42.886855 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-b0b4ebd5-64f3-41ae-b622-8d8cc764cf2d req-5a2ffdb1-52fc-4371-b32d-474d97d8f9ce service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037903 Aug 04 17:29:42.887616 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3270/6432] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:29:43.708737 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-93cff9e3-5f48-49e5-b214-862ac7bcb5ae tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:43.709412 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-93cff9e3-5f48-49e5-b214-862ac7bcb5ae tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:43.716898 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-93cff9e3-5f48-49e5-b214-862ac7bcb5ae tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:43.717320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-93cff9e3-5f48-49e5-b214-862ac7bcb5ae tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:43.718116 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-93cff9e3-5f48-49e5-b214-862ac7bcb5ae tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:43.718548 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-93cff9e3-5f48-49e5-b214-862ac7bcb5ae tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:43.861816 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-93cff9e3-5f48-49e5-b214-862ac7bcb5ae tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:43.869246 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-93cff9e3-5f48-49e5-b214-862ac7bcb5ae tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1364 microversion: 2.1 time: 0.164038 Aug 04 17:29:43.870276 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3163/6433] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:43 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:44.899154 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cdc97ff3-6de4-4bc2-a552-7c9329ceb410 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:44.900424 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cdc97ff3-6de4-4bc2-a552-7c9329ceb410 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:44.913540 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cdc97ff3-6de4-4bc2-a552-7c9329ceb410 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:44.914332 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cdc97ff3-6de4-4bc2-a552-7c9329ceb410 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:44.915694 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cdc97ff3-6de4-4bc2-a552-7c9329ceb410 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:44.916826 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cdc97ff3-6de4-4bc2-a552-7c9329ceb410 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:45.078100 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cdc97ff3-6de4-4bc2-a552-7c9329ceb410 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:45.086105 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cdc97ff3-6de4-4bc2-a552-7c9329ceb410 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1364 microversion: 2.1 time: 0.196922 Aug 04 17:29:45.086603 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3271/6434] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:44 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1364 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:46.108309 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5270fe29-f666-4445-a253-c632631094a3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:46.109013 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5270fe29-f666-4445-a253-c632631094a3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:46.117129 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5270fe29-f666-4445-a253-c632631094a3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:46.117630 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5270fe29-f666-4445-a253-c632631094a3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:46.118446 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5270fe29-f666-4445-a253-c632631094a3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:46.118898 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5270fe29-f666-4445-a253-c632631094a3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:46.279475 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5270fe29-f666-4445-a253-c632631094a3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:46.290016 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5270fe29-f666-4445-a253-c632631094a3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1364 microversion: 2.1 time: 0.185609 Aug 04 17:29:46.291089 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3164/6435] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:46 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1364 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:47.102517 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-b42a8c66-d199-4b55-b0c2-2929508f0146 req-9ee8d779-7dc9-4444-8e46-e4114c610cbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "786b5805-feed-4d1c-99fe-c6e1407e30e4", "name": "network-vif-plugged", "status": "completed", "tag": "2e349370-2da6-4c8c-96ba-f3961765fe22"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:29:47.115132 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-b42a8c66-d199-4b55-b0c2-2929508f0146 req-9ee8d779-7dc9-4444-8e46-e4114c610cbd service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:47.115565 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-b42a8c66-d199-4b55-b0c2-2929508f0146 req-9ee8d779-7dc9-4444-8e46-e4114c610cbd service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:47.129137 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-b42a8c66-d199-4b55-b0c2-2929508f0146 req-9ee8d779-7dc9-4444-8e46-e4114c610cbd service nova] Creating event network-vif-plugged:2e349370-2da6-4c8c-96ba-f3961765fe22 for instance 786b5805-feed-4d1c-99fe-c6e1407e30e4 on n-h2-846466-12 Aug 04 17:29:47.135608 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-b42a8c66-d199-4b55-b0c2-2929508f0146 req-9ee8d779-7dc9-4444-8e46-e4114c610cbd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036857 Aug 04 17:29:47.136297 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3272/6436] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:29:47.315091 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1eb10ad0-d4f6-43fc-be1e-280f30cf030a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:47.315741 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1eb10ad0-d4f6-43fc-be1e-280f30cf030a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:47.323973 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1eb10ad0-d4f6-43fc-be1e-280f30cf030a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:47.324619 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1eb10ad0-d4f6-43fc-be1e-280f30cf030a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:47.326181 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1eb10ad0-d4f6-43fc-be1e-280f30cf030a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:47.326635 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1eb10ad0-d4f6-43fc-be1e-280f30cf030a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:47.490720 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1eb10ad0-d4f6-43fc-be1e-280f30cf030a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:47.499401 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1eb10ad0-d4f6-43fc-be1e-280f30cf030a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1364 microversion: 2.1 time: 0.188226 Aug 04 17:29:47.499981 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3165/6437] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:47 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:48.522973 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-710ddd62-d84a-48c7-9dfa-2c14d8dcfaec tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:48.523573 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-710ddd62-d84a-48c7-9dfa-2c14d8dcfaec tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:48.530400 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-710ddd62-d84a-48c7-9dfa-2c14d8dcfaec tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:48.531156 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-710ddd62-d84a-48c7-9dfa-2c14d8dcfaec tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:48.532021 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-710ddd62-d84a-48c7-9dfa-2c14d8dcfaec tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:48.532494 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-710ddd62-d84a-48c7-9dfa-2c14d8dcfaec tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:48.684687 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-710ddd62-d84a-48c7-9dfa-2c14d8dcfaec tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:48.697090 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-710ddd62-d84a-48c7-9dfa-2c14d8dcfaec tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1551 microversion: 2.1 time: 0.179883 Aug 04 17:29:48.697903 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3273/6438] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:48 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1551 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:48.721442 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ec6dbda5-7091-47aa-869a-0a14910006a8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:48.722469 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ec6dbda5-7091-47aa-869a-0a14910006a8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:48.732926 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ec6dbda5-7091-47aa-869a-0a14910006a8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:48.733400 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ec6dbda5-7091-47aa-869a-0a14910006a8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:48.734183 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ec6dbda5-7091-47aa-869a-0a14910006a8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:48.734624 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ec6dbda5-7091-47aa-869a-0a14910006a8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:48.829912 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ec6dbda5-7091-47aa-869a-0a14910006a8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114096 Aug 04 17:29:48.830510 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3166/6439] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Aug 4 17:29:48 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:29:49.837732 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-0560dd57-0d77-4719-8e96-35c26b92044e req-c4181501-33aa-4ece-9498-4e02f51e70e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "786b5805-feed-4d1c-99fe-c6e1407e30e4", "tag": "2e349370-2da6-4c8c-96ba-f3961765fe22"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:29:49.851193 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-0560dd57-0d77-4719-8e96-35c26b92044e req-c4181501-33aa-4ece-9498-4e02f51e70e9 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:29:49.851790 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-0560dd57-0d77-4719-8e96-35c26b92044e req-c4181501-33aa-4ece-9498-4e02f51e70e9 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:29:49.865914 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-0560dd57-0d77-4719-8e96-35c26b92044e req-c4181501-33aa-4ece-9498-4e02f51e70e9 service nova] Creating event network-changed:2e349370-2da6-4c8c-96ba-f3961765fe22 for instance 786b5805-feed-4d1c-99fe-c6e1407e30e4 on n-h2-846466-12 Aug 04 17:29:49.872217 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-0560dd57-0d77-4719-8e96-35c26b92044e req-c4181501-33aa-4ece-9498-4e02f51e70e9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037985 Aug 04 17:29:49.873969 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3274/6440] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:30:22.789731 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:30:22.790585 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=19 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:30:22.791230 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:30:22.795236 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-03b1fe4f-e68f-42a8-bba4-6488cb29d88e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:30:22.797904 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-03b1fe4f-e68f-42a8-bba4-6488cb29d88e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:22.806100 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03b1fe4f-e68f-42a8-bba4-6488cb29d88e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:22.806758 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03b1fe4f-e68f-42a8-bba4-6488cb29d88e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:22.807183 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03b1fe4f-e68f-42a8-bba4-6488cb29d88e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:22.807616 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03b1fe4f-e68f-42a8-bba4-6488cb29d88e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:22.840124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-03b1fe4f-e68f-42a8-bba4-6488cb29d88e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:22.846724 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-03b1fe4f-e68f-42a8-bba4-6488cb29d88e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Old instance type m1.heat2, new instance type m1.heat {{(pid=126126) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 17:30:22.853780 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-03b1fe4f-e68f-42a8-bba4-6488cb29d88e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:30:22.854199 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-03b1fe4f-e68f-42a8-bba4-6488cb29d88e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:30:22.854676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-03b1fe4f-e68f-42a8-bba4-6488cb29d88e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:30:22.855080 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-03b1fe4f-e68f-42a8-bba4-6488cb29d88e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:30:22.855492 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-03b1fe4f-e68f-42a8-bba4-6488cb29d88e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:30:22.927915 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-03b1fe4f-e68f-42a8-bba4-6488cb29d88e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "POST /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4/action" status: 202 len: 0 microversion: 2.1 time: 0.140088 Aug 04 17:30:22.928825 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3167/6441] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:30:22 2022] POST /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 17:30:22.934284 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:30:22.935728 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:30:22.937901 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:30:22.938541 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:30:22.943162 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f28cb358-efad-4841-a22e-2da51c38ba47 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:22.943959 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f28cb358-efad-4841-a22e-2da51c38ba47 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:22.952959 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f28cb358-efad-4841-a22e-2da51c38ba47 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:22.953521 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f28cb358-efad-4841-a22e-2da51c38ba47 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:22.954304 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f28cb358-efad-4841-a22e-2da51c38ba47 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:22.954731 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f28cb358-efad-4841-a22e-2da51c38ba47 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:23.246003 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f28cb358-efad-4841-a22e-2da51c38ba47 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:23.254546 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f28cb358-efad-4841-a22e-2da51c38ba47 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1679 microversion: 2.1 time: 0.321114 Aug 04 17:30:23.255108 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3275/6442] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:22 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1679 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:24.277447 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-89614c79-add9-461f-8215-1db93895a002 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:24.278162 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-89614c79-add9-461f-8215-1db93895a002 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:24.287465 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-89614c79-add9-461f-8215-1db93895a002 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:24.288093 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-89614c79-add9-461f-8215-1db93895a002 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:24.289372 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-89614c79-add9-461f-8215-1db93895a002 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:24.289970 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-89614c79-add9-461f-8215-1db93895a002 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:24.572810 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-89614c79-add9-461f-8215-1db93895a002 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:24.581518 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-89614c79-add9-461f-8215-1db93895a002 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1679 microversion: 2.1 time: 0.308614 Aug 04 17:30:24.582082 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3168/6443] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:24 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1679 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:25.603781 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1727bf80-4795-488d-888d-26a7e2d88f67 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:25.604429 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1727bf80-4795-488d-888d-26a7e2d88f67 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:25.612409 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1727bf80-4795-488d-888d-26a7e2d88f67 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:25.612851 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1727bf80-4795-488d-888d-26a7e2d88f67 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:25.613670 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1727bf80-4795-488d-888d-26a7e2d88f67 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:25.614102 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1727bf80-4795-488d-888d-26a7e2d88f67 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:25.764331 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1727bf80-4795-488d-888d-26a7e2d88f67 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:25.773576 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1727bf80-4795-488d-888d-26a7e2d88f67 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1684 microversion: 2.1 time: 0.173777 Aug 04 17:30:25.774164 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3276/6444] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:25 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1684 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:26.796541 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f5c68cfc-b120-4d4e-8b3c-414875396d2c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:26.797704 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f5c68cfc-b120-4d4e-8b3c-414875396d2c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:26.805324 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f5c68cfc-b120-4d4e-8b3c-414875396d2c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:26.805766 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f5c68cfc-b120-4d4e-8b3c-414875396d2c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:26.806508 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f5c68cfc-b120-4d4e-8b3c-414875396d2c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:26.806979 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f5c68cfc-b120-4d4e-8b3c-414875396d2c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:26.969147 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f5c68cfc-b120-4d4e-8b3c-414875396d2c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:26.977627 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f5c68cfc-b120-4d4e-8b3c-414875396d2c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1684 microversion: 2.1 time: 0.185083 Aug 04 17:30:26.978204 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3169/6445] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:26 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1684 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:27.999587 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0e47ab96-2cc9-4e01-863c-a66537af082c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:28.000227 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0e47ab96-2cc9-4e01-863c-a66537af082c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:28.007846 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0e47ab96-2cc9-4e01-863c-a66537af082c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:28.008293 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0e47ab96-2cc9-4e01-863c-a66537af082c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:28.009070 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0e47ab96-2cc9-4e01-863c-a66537af082c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:28.009539 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0e47ab96-2cc9-4e01-863c-a66537af082c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:28.152947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0e47ab96-2cc9-4e01-863c-a66537af082c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:28.161988 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0e47ab96-2cc9-4e01-863c-a66537af082c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1684 microversion: 2.1 time: 0.166326 Aug 04 17:30:28.162719 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3277/6446] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:27 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1684 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:29.184841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8134b760-23ac-4ba3-a217-bb5c9425fb31 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:29.185524 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8134b760-23ac-4ba3-a217-bb5c9425fb31 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:29.193199 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8134b760-23ac-4ba3-a217-bb5c9425fb31 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:29.193684 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8134b760-23ac-4ba3-a217-bb5c9425fb31 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:29.194465 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8134b760-23ac-4ba3-a217-bb5c9425fb31 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:29.194908 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8134b760-23ac-4ba3-a217-bb5c9425fb31 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:29.338423 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8134b760-23ac-4ba3-a217-bb5c9425fb31 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:29.349109 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8134b760-23ac-4ba3-a217-bb5c9425fb31 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1684 microversion: 2.1 time: 0.168153 Aug 04 17:30:29.349734 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3170/6447] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:29 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:30.378714 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d280db8a-8c57-427b-84fb-e17cbc6fc1e3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:30.379348 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d280db8a-8c57-427b-84fb-e17cbc6fc1e3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:30.386841 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d280db8a-8c57-427b-84fb-e17cbc6fc1e3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:30.387294 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d280db8a-8c57-427b-84fb-e17cbc6fc1e3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:30.388081 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d280db8a-8c57-427b-84fb-e17cbc6fc1e3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:30.388511 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d280db8a-8c57-427b-84fb-e17cbc6fc1e3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:30.542748 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d280db8a-8c57-427b-84fb-e17cbc6fc1e3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:30.551419 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d280db8a-8c57-427b-84fb-e17cbc6fc1e3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1684 microversion: 2.1 time: 0.178633 Aug 04 17:30:30.552233 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3278/6448] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:30 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1684 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:31.573622 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-86ebd2c4-aab1-4799-97b3-f4a05c450b31 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:31.574218 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-86ebd2c4-aab1-4799-97b3-f4a05c450b31 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:31.581958 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-86ebd2c4-aab1-4799-97b3-f4a05c450b31 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:31.582619 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-86ebd2c4-aab1-4799-97b3-f4a05c450b31 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:31.583399 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-86ebd2c4-aab1-4799-97b3-f4a05c450b31 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:31.583832 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-86ebd2c4-aab1-4799-97b3-f4a05c450b31 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:31.734861 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-86ebd2c4-aab1-4799-97b3-f4a05c450b31 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:31.747321 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-86ebd2c4-aab1-4799-97b3-f4a05c450b31 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1684 microversion: 2.1 time: 0.177980 Aug 04 17:30:31.747989 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3171/6449] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:31 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1684 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:32.771488 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3819f804-f805-43e8-87f8-0bcf1abbbb71 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:32.772510 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3819f804-f805-43e8-87f8-0bcf1abbbb71 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:32.781582 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3819f804-f805-43e8-87f8-0bcf1abbbb71 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:32.782171 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3819f804-f805-43e8-87f8-0bcf1abbbb71 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:32.783341 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3819f804-f805-43e8-87f8-0bcf1abbbb71 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:32.783792 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3819f804-f805-43e8-87f8-0bcf1abbbb71 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:32.935982 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3819f804-f805-43e8-87f8-0bcf1abbbb71 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:32.944388 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3819f804-f805-43e8-87f8-0bcf1abbbb71 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1684 microversion: 2.1 time: 0.176971 Aug 04 17:30:32.945010 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3279/6450] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:32 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1684 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:33.966676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1a61d85e-5ef8-4da0-b6a6-ed45cfcd761c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:33.967343 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1a61d85e-5ef8-4da0-b6a6-ed45cfcd761c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:33.975075 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1a61d85e-5ef8-4da0-b6a6-ed45cfcd761c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:33.975385 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1a61d85e-5ef8-4da0-b6a6-ed45cfcd761c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:33.976160 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1a61d85e-5ef8-4da0-b6a6-ed45cfcd761c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:33.976599 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1a61d85e-5ef8-4da0-b6a6-ed45cfcd761c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:34.123326 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1a61d85e-5ef8-4da0-b6a6-ed45cfcd761c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:34.133984 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1a61d85e-5ef8-4da0-b6a6-ed45cfcd761c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1684 microversion: 2.1 time: 0.171198 Aug 04 17:30:34.134561 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3172/6451] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:33 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1684 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:35.158849 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f0768c5c-4561-4757-86ab-d618035a6fbb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:35.159504 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f0768c5c-4561-4757-86ab-d618035a6fbb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:35.170488 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f0768c5c-4561-4757-86ab-d618035a6fbb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:35.171057 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f0768c5c-4561-4757-86ab-d618035a6fbb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:35.172199 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f0768c5c-4561-4757-86ab-d618035a6fbb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:35.172772 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f0768c5c-4561-4757-86ab-d618035a6fbb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:35.326641 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f0768c5c-4561-4757-86ab-d618035a6fbb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:35.336644 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f0768c5c-4561-4757-86ab-d618035a6fbb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1684 microversion: 2.1 time: 0.183959 Aug 04 17:30:35.337255 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3280/6452] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:35 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1684 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:36.362382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7dd0c401-f7a8-45d1-8996-e938b925755c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:36.363182 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7dd0c401-f7a8-45d1-8996-e938b925755c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:36.377431 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7dd0c401-f7a8-45d1-8996-e938b925755c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:36.377892 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7dd0c401-f7a8-45d1-8996-e938b925755c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:36.378822 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7dd0c401-f7a8-45d1-8996-e938b925755c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:36.379238 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7dd0c401-f7a8-45d1-8996-e938b925755c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:36.530160 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7dd0c401-f7a8-45d1-8996-e938b925755c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:36.539861 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7dd0c401-f7a8-45d1-8996-e938b925755c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1684 microversion: 2.1 time: 0.181389 Aug 04 17:30:36.540437 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3173/6453] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:36 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1684 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:37.564241 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c651a40b-ca9e-4dbb-bbcb-5e47ede7c6c8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:37.564820 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c651a40b-ca9e-4dbb-bbcb-5e47ede7c6c8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:37.572246 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c651a40b-ca9e-4dbb-bbcb-5e47ede7c6c8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:37.572697 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c651a40b-ca9e-4dbb-bbcb-5e47ede7c6c8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:37.573502 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c651a40b-ca9e-4dbb-bbcb-5e47ede7c6c8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:37.573930 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c651a40b-ca9e-4dbb-bbcb-5e47ede7c6c8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:37.720112 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c651a40b-ca9e-4dbb-bbcb-5e47ede7c6c8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:37.728503 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c651a40b-ca9e-4dbb-bbcb-5e47ede7c6c8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1684 microversion: 2.1 time: 0.168377 Aug 04 17:30:37.729116 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3281/6454] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:37 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:38.751377 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-78eb027b-e981-4e62-84f2-a8c3acba0171 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:38.752028 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-78eb027b-e981-4e62-84f2-a8c3acba0171 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:38.760656 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-78eb027b-e981-4e62-84f2-a8c3acba0171 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:38.761123 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-78eb027b-e981-4e62-84f2-a8c3acba0171 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:38.761957 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-78eb027b-e981-4e62-84f2-a8c3acba0171 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:38.762401 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-78eb027b-e981-4e62-84f2-a8c3acba0171 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:38.907467 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-78eb027b-e981-4e62-84f2-a8c3acba0171 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:38.915506 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-78eb027b-e981-4e62-84f2-a8c3acba0171 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1684 microversion: 2.1 time: 0.168569 Aug 04 17:30:38.916078 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3174/6455] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:38 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:39.938227 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3d089037-1ac2-4a2e-b552-6d94827fe8f8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:39.938881 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3d089037-1ac2-4a2e-b552-6d94827fe8f8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:39.948302 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3d089037-1ac2-4a2e-b552-6d94827fe8f8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:39.948743 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3d089037-1ac2-4a2e-b552-6d94827fe8f8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:39.949549 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3d089037-1ac2-4a2e-b552-6d94827fe8f8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:39.949978 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3d089037-1ac2-4a2e-b552-6d94827fe8f8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:40.103403 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3d089037-1ac2-4a2e-b552-6d94827fe8f8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:40.112484 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3d089037-1ac2-4a2e-b552-6d94827fe8f8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1684 microversion: 2.1 time: 0.178968 Aug 04 17:30:40.113080 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3282/6456] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:39 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1684 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:41.137131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6b7fdacf-1245-475b-9344-a15024572625 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:41.137864 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6b7fdacf-1245-475b-9344-a15024572625 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:41.145868 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6b7fdacf-1245-475b-9344-a15024572625 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:41.146337 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6b7fdacf-1245-475b-9344-a15024572625 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:41.147532 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6b7fdacf-1245-475b-9344-a15024572625 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:41.147970 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6b7fdacf-1245-475b-9344-a15024572625 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:41.297786 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6b7fdacf-1245-475b-9344-a15024572625 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:41.306156 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6b7fdacf-1245-475b-9344-a15024572625 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1684 microversion: 2.1 time: 0.174543 Aug 04 17:30:41.306748 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3175/6457] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:41 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1684 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:42.331821 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9d572b6b-6fbe-494a-8ba2-c44d457f98e8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:42.332431 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9d572b6b-6fbe-494a-8ba2-c44d457f98e8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:42.340376 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9d572b6b-6fbe-494a-8ba2-c44d457f98e8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:42.340784 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9d572b6b-6fbe-494a-8ba2-c44d457f98e8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:42.341577 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9d572b6b-6fbe-494a-8ba2-c44d457f98e8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:42.342008 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9d572b6b-6fbe-494a-8ba2-c44d457f98e8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:42.587903 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9d572b6b-6fbe-494a-8ba2-c44d457f98e8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:42.596942 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9d572b6b-6fbe-494a-8ba2-c44d457f98e8 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1683 microversion: 2.1 time: 0.269140 Aug 04 17:30:42.597601 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3283/6458] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:42 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1683 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:42.909788 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-52fb51c1-1f8b-4b69-8295-e5ca78e58b45 req-7d1a3411-d2fc-47df-b3b7-a86181a20218 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "786b5805-feed-4d1c-99fe-c6e1407e30e4", "name": "network-vif-unplugged", "status": "completed", "tag": "2e349370-2da6-4c8c-96ba-f3961765fe22"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:30:42.920154 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-52fb51c1-1f8b-4b69-8295-e5ca78e58b45 req-7d1a3411-d2fc-47df-b3b7-a86181a20218 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:42.920916 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-52fb51c1-1f8b-4b69-8295-e5ca78e58b45 req-7d1a3411-d2fc-47df-b3b7-a86181a20218 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:42.942619 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-52fb51c1-1f8b-4b69-8295-e5ca78e58b45 req-7d1a3411-d2fc-47df-b3b7-a86181a20218 service nova] Creating event network-vif-unplugged:2e349370-2da6-4c8c-96ba-f3961765fe22 for instance 786b5805-feed-4d1c-99fe-c6e1407e30e4 on n-h1-846466-12 Aug 04 17:30:42.950085 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [req-52fb51c1-1f8b-4b69-8295-e5ca78e58b45 req-7d1a3411-d2fc-47df-b3b7-a86181a20218 service nova] Instance 786b5805-feed-4d1c-99fe-c6e1407e30e4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126126) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:30:42.961631 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-52fb51c1-1f8b-4b69-8295-e5ca78e58b45 req-7d1a3411-d2fc-47df-b3b7-a86181a20218 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112566 Aug 04 17:30:42.962356 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3176/6459] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:30:43.619254 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c0f1cfda-76f8-4e29-a09b-3ca6bd95070f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:43.619986 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c0f1cfda-76f8-4e29-a09b-3ca6bd95070f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:43.627899 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0f1cfda-76f8-4e29-a09b-3ca6bd95070f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:43.628347 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0f1cfda-76f8-4e29-a09b-3ca6bd95070f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:43.629125 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0f1cfda-76f8-4e29-a09b-3ca6bd95070f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:43.629593 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0f1cfda-76f8-4e29-a09b-3ca6bd95070f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:43.924390 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c0f1cfda-76f8-4e29-a09b-3ca6bd95070f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:43.933431 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c0f1cfda-76f8-4e29-a09b-3ca6bd95070f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1683 microversion: 2.1 time: 0.318114 Aug 04 17:30:43.933991 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3284/6460] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:43 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1683 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:44.959244 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0f919152-7430-4580-968b-3683f027325f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:44.959824 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0f919152-7430-4580-968b-3683f027325f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:44.968266 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0f919152-7430-4580-968b-3683f027325f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:44.968725 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0f919152-7430-4580-968b-3683f027325f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:44.969533 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0f919152-7430-4580-968b-3683f027325f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:44.969975 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0f919152-7430-4580-968b-3683f027325f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:45.002595 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-e9d191ac-773a-4b1c-a84d-625bbc22787e req-0fd486e3-8679-4903-90e9-d9e9ea297803 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "786b5805-feed-4d1c-99fe-c6e1407e30e4", "tag": "2e349370-2da6-4c8c-96ba-f3961765fe22"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:30:45.015083 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-e9d191ac-773a-4b1c-a84d-625bbc22787e req-0fd486e3-8679-4903-90e9-d9e9ea297803 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:45.015522 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-e9d191ac-773a-4b1c-a84d-625bbc22787e req-0fd486e3-8679-4903-90e9-d9e9ea297803 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:45.029638 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-e9d191ac-773a-4b1c-a84d-625bbc22787e req-0fd486e3-8679-4903-90e9-d9e9ea297803 service nova] Creating event network-changed:2e349370-2da6-4c8c-96ba-f3961765fe22 for instance 786b5805-feed-4d1c-99fe-c6e1407e30e4 on n-h1-846466-12 Aug 04 17:30:45.036323 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [req-e9d191ac-773a-4b1c-a84d-625bbc22787e req-0fd486e3-8679-4903-90e9-d9e9ea297803 service nova] Instance 786b5805-feed-4d1c-99fe-c6e1407e30e4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:30:45.048774 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-e9d191ac-773a-4b1c-a84d-625bbc22787e req-0fd486e3-8679-4903-90e9-d9e9ea297803 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050856 Aug 04 17:30:45.049665 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3285/6461] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:30:45.138060 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0f919152-7430-4580-968b-3683f027325f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:45.147828 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0f919152-7430-4580-968b-3683f027325f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1681 microversion: 2.1 time: 0.195967 Aug 04 17:30:45.148419 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3177/6462] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:44 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1681 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:46.173243 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-db24c2d3-f626-4277-8432-45b3017f5d39 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:46.174172 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-db24c2d3-f626-4277-8432-45b3017f5d39 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:46.180719 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-db24c2d3-f626-4277-8432-45b3017f5d39 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:46.181250 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-db24c2d3-f626-4277-8432-45b3017f5d39 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:46.182146 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-db24c2d3-f626-4277-8432-45b3017f5d39 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:46.183781 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-db24c2d3-f626-4277-8432-45b3017f5d39 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:46.404575 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-db24c2d3-f626-4277-8432-45b3017f5d39 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:46.415621 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-db24c2d3-f626-4277-8432-45b3017f5d39 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1678 microversion: 2.1 time: 0.248709 Aug 04 17:30:46.416367 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3286/6463] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:46 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1678 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:46.437374 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-618aa8d9-542a-4eb6-9b24-990f6d0502ea tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:30:46.437967 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-618aa8d9-542a-4eb6-9b24-990f6d0502ea tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:46.446851 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-618aa8d9-542a-4eb6-9b24-990f6d0502ea tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:46.447345 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-618aa8d9-542a-4eb6-9b24-990f6d0502ea tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:46.448122 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-618aa8d9-542a-4eb6-9b24-990f6d0502ea tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:46.448932 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-618aa8d9-542a-4eb6-9b24-990f6d0502ea tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:46.496240 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-618aa8d9-542a-4eb6-9b24-990f6d0502ea tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:46.496708 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-618aa8d9-542a-4eb6-9b24-990f6d0502ea tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:46.497581 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-618aa8d9-542a-4eb6-9b24-990f6d0502ea tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:46.498022 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-618aa8d9-542a-4eb6-9b24-990f6d0502ea tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:46.522444 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-618aa8d9-542a-4eb6-9b24-990f6d0502ea tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Getting quotas for project 9fa3479e48da461eb31ba242143690c6. Resources: {'ram', 'cores'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:30:46.529162 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-618aa8d9-542a-4eb6-9b24-990f6d0502ea tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Getting quotas for user dd0d0aebe00643899de4edd08345e3fd and project 9fa3479e48da461eb31ba242143690c6. Resources: {'ram', 'cores'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:30:46.665737 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-618aa8d9-542a-4eb6-9b24-990f6d0502ea tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "POST /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4/action" status: 202 len: 0 microversion: 2.1 time: 0.232522 Aug 04 17:30:46.666429 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3178/6464] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:30:46 2022] POST /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:30:46.678338 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1f8c2b64-fd5e-4048-b5c5-7af3070171ad tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:46.679115 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1f8c2b64-fd5e-4048-b5c5-7af3070171ad tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:46.686660 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f8c2b64-fd5e-4048-b5c5-7af3070171ad tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:46.687220 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f8c2b64-fd5e-4048-b5c5-7af3070171ad tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:46.688729 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f8c2b64-fd5e-4048-b5c5-7af3070171ad tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:46.689240 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f8c2b64-fd5e-4048-b5c5-7af3070171ad tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:46.895245 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1f8c2b64-fd5e-4048-b5c5-7af3070171ad tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:46.903978 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1f8c2b64-fd5e-4048-b5c5-7af3070171ad tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1677 microversion: 2.1 time: 0.232039 Aug 04 17:30:46.904590 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3287/6465] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:46 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1677 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:30:47.930129 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-22824a48-f7f6-49dc-96d8-da42abf5539c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:47.930793 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-22824a48-f7f6-49dc-96d8-da42abf5539c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:47.941392 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-22824a48-f7f6-49dc-96d8-da42abf5539c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:47.941860 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-22824a48-f7f6-49dc-96d8-da42abf5539c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:47.942632 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-22824a48-f7f6-49dc-96d8-da42abf5539c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:47.943076 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-22824a48-f7f6-49dc-96d8-da42abf5539c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:47.961733 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:30:48.094124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-22824a48-f7f6-49dc-96d8-da42abf5539c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:48.102286 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-22824a48-f7f6-49dc-96d8-da42abf5539c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1677 microversion: 2.1 time: 0.177377 Aug 04 17:30:48.102863 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3179/6466] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:47 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:49.131319 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-13000903-3b3f-4d5f-91ba-1c8a437ab7ab tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:49.132008 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-13000903-3b3f-4d5f-91ba-1c8a437ab7ab tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:49.140338 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-13000903-3b3f-4d5f-91ba-1c8a437ab7ab tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:49.140756 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-13000903-3b3f-4d5f-91ba-1c8a437ab7ab tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:49.141610 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-13000903-3b3f-4d5f-91ba-1c8a437ab7ab tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:49.142047 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-13000903-3b3f-4d5f-91ba-1c8a437ab7ab tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:49.298763 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-13000903-3b3f-4d5f-91ba-1c8a437ab7ab tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:49.307280 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-13000903-3b3f-4d5f-91ba-1c8a437ab7ab tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1677 microversion: 2.1 time: 0.179852 Aug 04 17:30:49.308042 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3288/6467] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:49 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1677 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:50.330042 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-208e807d-e08a-4b76-a9f7-9f33c9f4586e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:50.331380 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-208e807d-e08a-4b76-a9f7-9f33c9f4586e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:50.339278 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-208e807d-e08a-4b76-a9f7-9f33c9f4586e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:50.339747 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-208e807d-e08a-4b76-a9f7-9f33c9f4586e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:50.340528 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-208e807d-e08a-4b76-a9f7-9f33c9f4586e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:50.340968 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-208e807d-e08a-4b76-a9f7-9f33c9f4586e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:50.506235 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-208e807d-e08a-4b76-a9f7-9f33c9f4586e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:50.514466 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-208e807d-e08a-4b76-a9f7-9f33c9f4586e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1677 microversion: 2.1 time: 0.190098 Aug 04 17:30:50.515091 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3180/6468] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:50 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1677 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:51.059829 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-6fb4d954-da6f-416d-9b15-6e5b63b8adc4 req-341813d3-20a7-41fa-a513-d6315c97d404 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "786b5805-feed-4d1c-99fe-c6e1407e30e4", "tag": "2e349370-2da6-4c8c-96ba-f3961765fe22"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:30:51.070277 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6fb4d954-da6f-416d-9b15-6e5b63b8adc4 req-341813d3-20a7-41fa-a513-d6315c97d404 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:51.070721 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6fb4d954-da6f-416d-9b15-6e5b63b8adc4 req-341813d3-20a7-41fa-a513-d6315c97d404 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:51.083416 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-6fb4d954-da6f-416d-9b15-6e5b63b8adc4 req-341813d3-20a7-41fa-a513-d6315c97d404 service nova] Creating event network-changed:2e349370-2da6-4c8c-96ba-f3961765fe22 for instance 786b5805-feed-4d1c-99fe-c6e1407e30e4 on n-h2-846466-12 Aug 04 17:30:51.089270 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [req-6fb4d954-da6f-416d-9b15-6e5b63b8adc4 req-341813d3-20a7-41fa-a513-d6315c97d404 service nova] Instance 786b5805-feed-4d1c-99fe-c6e1407e30e4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:30:51.100613 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-6fb4d954-da6f-416d-9b15-6e5b63b8adc4 req-341813d3-20a7-41fa-a513-d6315c97d404 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114264 Aug 04 17:30:51.101448 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3289/6469] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:30:51.539267 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8b2d2cf2-d521-48f8-ac8d-4ae3e0d3a395 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:51.539908 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8b2d2cf2-d521-48f8-ac8d-4ae3e0d3a395 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:51.547386 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8b2d2cf2-d521-48f8-ac8d-4ae3e0d3a395 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:51.547835 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8b2d2cf2-d521-48f8-ac8d-4ae3e0d3a395 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:51.548607 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8b2d2cf2-d521-48f8-ac8d-4ae3e0d3a395 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:51.549044 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8b2d2cf2-d521-48f8-ac8d-4ae3e0d3a395 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:51.754459 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8b2d2cf2-d521-48f8-ac8d-4ae3e0d3a395 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:51.763029 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8b2d2cf2-d521-48f8-ac8d-4ae3e0d3a395 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1677 microversion: 2.1 time: 0.227712 Aug 04 17:30:51.763611 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3181/6470] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:51 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1677 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:52.786078 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-be3a4430-3bf4-4f90-960d-f9351f137d42 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:52.786811 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-be3a4430-3bf4-4f90-960d-f9351f137d42 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:52.793862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be3a4430-3bf4-4f90-960d-f9351f137d42 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:52.794294 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be3a4430-3bf4-4f90-960d-f9351f137d42 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:52.795079 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be3a4430-3bf4-4f90-960d-f9351f137d42 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:52.795501 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be3a4430-3bf4-4f90-960d-f9351f137d42 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:52.946410 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-be3a4430-3bf4-4f90-960d-f9351f137d42 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:52.963777 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-be3a4430-3bf4-4f90-960d-f9351f137d42 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1677 microversion: 2.1 time: 0.183525 Aug 04 17:30:52.964926 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3290/6471] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:52 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1677 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:53.987591 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-80c9e73b-b22c-4784-9a1e-896355a27036 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:53.988641 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-80c9e73b-b22c-4784-9a1e-896355a27036 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:53.991139 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:30:53.997458 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-80c9e73b-b22c-4784-9a1e-896355a27036 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:53.997909 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-80c9e73b-b22c-4784-9a1e-896355a27036 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:53.998717 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-80c9e73b-b22c-4784-9a1e-896355a27036 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:53.999150 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-80c9e73b-b22c-4784-9a1e-896355a27036 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:54.136491 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-80c9e73b-b22c-4784-9a1e-896355a27036 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:54.145502 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-80c9e73b-b22c-4784-9a1e-896355a27036 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1670 microversion: 2.1 time: 0.162257 Aug 04 17:30:54.146547 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3182/6472] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:53 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1670 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:54.167571 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e1f2ad7f-a2ce-42f5-b8c6-731e5f258a80 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:54.168463 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e1f2ad7f-a2ce-42f5-b8c6-731e5f258a80 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:54.171549 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=33 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:30:54.177648 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e1f2ad7f-a2ce-42f5-b8c6-731e5f258a80 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:54.178406 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e1f2ad7f-a2ce-42f5-b8c6-731e5f258a80 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:54.179187 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e1f2ad7f-a2ce-42f5-b8c6-731e5f258a80 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:54.179625 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e1f2ad7f-a2ce-42f5-b8c6-731e5f258a80 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:54.183966 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=93 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:30:54.327050 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e1f2ad7f-a2ce-42f5-b8c6-731e5f258a80 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:54.335520 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e1f2ad7f-a2ce-42f5-b8c6-731e5f258a80 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1670 microversion: 2.1 time: 0.172216 Aug 04 17:30:54.336097 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3291/6473] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:54 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1670 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:54.356482 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c29da44d-4ccd-49a8-b00a-a18ae978c6a1 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:54.357098 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c29da44d-4ccd-49a8-b00a-a18ae978c6a1 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:54.363668 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c29da44d-4ccd-49a8-b00a-a18ae978c6a1 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:54.364114 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c29da44d-4ccd-49a8-b00a-a18ae978c6a1 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:54.364875 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c29da44d-4ccd-49a8-b00a-a18ae978c6a1 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:54.365344 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c29da44d-4ccd-49a8-b00a-a18ae978c6a1 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:54.516863 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c29da44d-4ccd-49a8-b00a-a18ae978c6a1 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:54.526298 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c29da44d-4ccd-49a8-b00a-a18ae978c6a1 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1670 microversion: 2.1 time: 0.173672 Aug 04 17:30:54.526872 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3183/6474] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:54 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1670 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:54.549553 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-014fed80-d09f-4859-a2ea-dcd65e50d98e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:54.550336 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-014fed80-d09f-4859-a2ea-dcd65e50d98e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:54.556758 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-014fed80-d09f-4859-a2ea-dcd65e50d98e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:54.557201 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-014fed80-d09f-4859-a2ea-dcd65e50d98e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:54.557960 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-014fed80-d09f-4859-a2ea-dcd65e50d98e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:54.558413 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-014fed80-d09f-4859-a2ea-dcd65e50d98e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:54.585530 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-014fed80-d09f-4859-a2ea-dcd65e50d98e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:30:54.681702 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-014fed80-d09f-4859-a2ea-dcd65e50d98e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "DELETE /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 204 len: 0 microversion: 2.1 time: 0.138219 Aug 04 17:30:54.682311 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3292/6475] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:30:54 2022] DELETE /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:30:54.691158 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e5659d31-0b7f-46f1-baef-75438e29ba2b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:54.691785 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e5659d31-0b7f-46f1-baef-75438e29ba2b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:54.698241 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5659d31-0b7f-46f1-baef-75438e29ba2b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:54.698705 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5659d31-0b7f-46f1-baef-75438e29ba2b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:54.699481 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5659d31-0b7f-46f1-baef-75438e29ba2b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:54.699930 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e5659d31-0b7f-46f1-baef-75438e29ba2b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:54.846091 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e5659d31-0b7f-46f1-baef-75438e29ba2b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:54.854943 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e5659d31-0b7f-46f1-baef-75438e29ba2b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1676 microversion: 2.1 time: 0.167801 Aug 04 17:30:54.855533 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3184/6476] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:54 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:55.698222 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-570aa668-4741-489f-a881-1490efe1734c req-1cf837df-4701-4455-bead-ad72eab542a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "786b5805-feed-4d1c-99fe-c6e1407e30e4", "name": "network-vif-plugged", "status": "completed", "tag": "2e349370-2da6-4c8c-96ba-f3961765fe22"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:30:55.708371 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-570aa668-4741-489f-a881-1490efe1734c req-1cf837df-4701-4455-bead-ad72eab542a5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:55.708802 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-570aa668-4741-489f-a881-1490efe1734c req-1cf837df-4701-4455-bead-ad72eab542a5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:55.721196 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-570aa668-4741-489f-a881-1490efe1734c req-1cf837df-4701-4455-bead-ad72eab542a5 service nova] Creating event network-vif-plugged:2e349370-2da6-4c8c-96ba-f3961765fe22 for instance 786b5805-feed-4d1c-99fe-c6e1407e30e4 on n-h2-846466-12 Aug 04 17:30:55.726375 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-570aa668-4741-489f-a881-1490efe1734c req-1cf837df-4701-4455-bead-ad72eab542a5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086649 Aug 04 17:30:55.726977 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3293/6477] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:30:55.879423 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7dcc55fd-0174-4bb0-9866-951d165bb519 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:55.880084 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7dcc55fd-0174-4bb0-9866-951d165bb519 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:55.887493 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7dcc55fd-0174-4bb0-9866-951d165bb519 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:55.887912 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7dcc55fd-0174-4bb0-9866-951d165bb519 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:55.888704 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7dcc55fd-0174-4bb0-9866-951d165bb519 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:55.889140 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7dcc55fd-0174-4bb0-9866-951d165bb519 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:56.043805 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7dcc55fd-0174-4bb0-9866-951d165bb519 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:56.054307 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7dcc55fd-0174-4bb0-9866-951d165bb519 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1676 microversion: 2.1 time: 0.179015 Aug 04 17:30:56.055137 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3185/6478] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:55 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1676 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:57.077790 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-777d9db2-e2ab-4cd9-8a33-8330ab62046f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:57.078385 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-777d9db2-e2ab-4cd9-8a33-8330ab62046f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:57.088950 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-777d9db2-e2ab-4cd9-8a33-8330ab62046f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:57.089443 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-777d9db2-e2ab-4cd9-8a33-8330ab62046f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:57.090260 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-777d9db2-e2ab-4cd9-8a33-8330ab62046f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:57.090697 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-777d9db2-e2ab-4cd9-8a33-8330ab62046f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:57.162546 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-777d9db2-e2ab-4cd9-8a33-8330ab62046f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:57.171139 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-777d9db2-e2ab-4cd9-8a33-8330ab62046f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 200 len: 1608 microversion: 2.1 time: 0.099450 Aug 04 17:30:57.171873 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3294/6479] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:57 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 1608 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:57.275233 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-91f42092-94f8-4720-9cc9-46f53f0e64a8 req-9f91f32f-3684-4747-806f-3659178e63ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "786b5805-feed-4d1c-99fe-c6e1407e30e4", "name": "network-vif-deleted", "tag": "2e349370-2da6-4c8c-96ba-f3961765fe22"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:30:57.284573 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:30:57.292799 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-91f42092-94f8-4720-9cc9-46f53f0e64a8 req-9f91f32f-3684-4747-806f-3659178e63ce service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:57.293387 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-91f42092-94f8-4720-9cc9-46f53f0e64a8 req-9f91f32f-3684-4747-806f-3659178e63ce service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:57.315903 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-91f42092-94f8-4720-9cc9-46f53f0e64a8 req-9f91f32f-3684-4747-806f-3659178e63ce service nova] Creating event network-vif-deleted:2e349370-2da6-4c8c-96ba-f3961765fe22 for instance 786b5805-feed-4d1c-99fe-c6e1407e30e4 on n-h2-846466-12 Aug 04 17:30:57.322138 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-91f42092-94f8-4720-9cc9-46f53f0e64a8 req-9f91f32f-3684-4747-806f-3659178e63ce service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051134 Aug 04 17:30:57.322766 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3186/6480] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:30:58.193525 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4d6e6582-871c-4de8-b63c-b9043dc49df4 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:58.194631 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4d6e6582-871c-4de8-b63c-b9043dc49df4 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:58.202455 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d6e6582-871c-4de8-b63c-b9043dc49df4 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:58.202895 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d6e6582-871c-4de8-b63c-b9043dc49df4 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:58.203676 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d6e6582-871c-4de8-b63c-b9043dc49df4 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:58.204102 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d6e6582-871c-4de8-b63c-b9043dc49df4 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:58.220420 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-4d6e6582-871c-4de8-b63c-b9043dc49df4 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] HTTP exception thrown: Instance 786b5805-feed-4d1c-99fe-c6e1407e30e4 could not be found. Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4d6e6582-871c-4de8-b63c-b9043dc49df4 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Request method failure captured: Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 HTTP/1.1 Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi7AFiltLP9EvcwVpFCa2h6tq19pMq_32JMtbXN51DOjApDm4jayRdzcaHrSSvhfA_fIVFHE8QZgkPi4lki3zEP2UZCg1aFWM1RMSCACgdYoFYi89kiTnRN1cdwnfZRtBXt50OfsjmdprRxr5_GXWBGj1IhGtf3jvIm_b3rzVGsscSyQY Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 9fa3479e48da461eb31ba242143690c6 Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerActionsTestJSON-75947691 Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fa3479e48da461eb31ba242143690c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9fa3479e48da461eb31ba242143690c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fa3479e48da461eb31ba242143690c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9fa3479e48da461eb31ba242143690c6"}]}] Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerActionsTestJSON-75947691 Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 9fa3479e48da461eb31ba242143690c6 Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerActionsTestJSON-75947691 Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerActionsTestJSON-75947691-project Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: dd0d0aebe00643899de4edd08345e3fd Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerActionsTestJSON-75947691-project Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 786b5805-feed-4d1c-99fe-c6e1407e30e4 could not be found. Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '786b5805-feed-4d1c-99fe-c6e1407e30e4'} Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 786b5805-feed-4d1c-99fe-c6e1407e30e4 could not be found. Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 786b5805-feed-4d1c-99fe-c6e1407e30e4 could not be found. Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:30:58.222196 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:30:58.228452 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:30:58.228452 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:30:58.228452 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:30:58.228452 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:30:58.228452 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:30:58.228452 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 786b5805-feed-4d1c-99fe-c6e1407e30e4 could not be found. Aug 04 17:30:58.228452 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:30:58.228452 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4d6e6582-871c-4de8-b63c-b9043dc49df4 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Returning 404 to user: Instance 786b5805-feed-4d1c-99fe-c6e1407e30e4 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:30:58.228452 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4d6e6582-871c-4de8-b63c-b9043dc49df4 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 404 len: 111 microversion: 2.1 time: 0.034721 Aug 04 17:30:58.228452 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3295/6481] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:58 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:30:58.242538 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-647fc05b-4c66-452e-b81b-14b8745ffb4c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:58.243264 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-647fc05b-4c66-452e-b81b-14b8745ffb4c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:58.250580 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-647fc05b-4c66-452e-b81b-14b8745ffb4c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:58.251009 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-647fc05b-4c66-452e-b81b-14b8745ffb4c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:58.252047 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-647fc05b-4c66-452e-b81b-14b8745ffb4c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:58.252272 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-647fc05b-4c66-452e-b81b-14b8745ffb4c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:58.270216 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-647fc05b-4c66-452e-b81b-14b8745ffb4c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] HTTP exception thrown: Instance 786b5805-feed-4d1c-99fe-c6e1407e30e4 could not be found. Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-647fc05b-4c66-452e-b81b-14b8745ffb4c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Request method failure captured: Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 HTTP/1.1 Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi7AFiltLP9EvcwVpFCa2h6tq19pMq_32JMtbXN51DOjApDm4jayRdzcaHrSSvhfA_fIVFHE8QZgkPi4lki3zEP2UZCg1aFWM1RMSCACgdYoFYi89kiTnRN1cdwnfZRtBXt50OfsjmdprRxr5_GXWBGj1IhGtf3jvIm_b3rzVGsscSyQY Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 9fa3479e48da461eb31ba242143690c6 Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServerActionsTestJSON-75947691 Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fa3479e48da461eb31ba242143690c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9fa3479e48da461eb31ba242143690c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fa3479e48da461eb31ba242143690c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9fa3479e48da461eb31ba242143690c6"}]}] Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServerActionsTestJSON-75947691 Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 9fa3479e48da461eb31ba242143690c6 Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServerActionsTestJSON-75947691 Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServerActionsTestJSON-75947691-project Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: dd0d0aebe00643899de4edd08345e3fd Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServerActionsTestJSON-75947691-project Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 786b5805-feed-4d1c-99fe-c6e1407e30e4 could not be found. Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '786b5805-feed-4d1c-99fe-c6e1407e30e4'} Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 786b5805-feed-4d1c-99fe-c6e1407e30e4 could not be found. Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 786b5805-feed-4d1c-99fe-c6e1407e30e4 could not be found. Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:30:58.273537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:30:58.279236 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:30:58.279236 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:30:58.279236 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:30:58.279236 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:30:58.279236 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:30:58.279236 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 786b5805-feed-4d1c-99fe-c6e1407e30e4 could not be found. Aug 04 17:30:58.279236 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:30:58.279236 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-647fc05b-4c66-452e-b81b-14b8745ffb4c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Returning 404 to user: Instance 786b5805-feed-4d1c-99fe-c6e1407e30e4 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:30:58.279236 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-647fc05b-4c66-452e-b81b-14b8745ffb4c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 404 len: 111 microversion: 2.1 time: 0.039061 Aug 04 17:30:58.279236 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3187/6482] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:58 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:30:58.328725 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fc7aed8f-2227-4686-80a6-f6a581852ec3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1721861748", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "0574ddc3-153c-4baf-a31a-673b773c4799"}], "security_groups": [{"name": "tempest-securitygroup--2108948134"}], "key_name": "tempest-keypair-495351782", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:30:58.459497 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-fc7aed8f-2227-4686-80a6-f6a581852ec3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] validate_networks() for [('0574ddc3-153c-4baf-a31a-673b773c4799', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:30:58.868582 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-fc7aed8f-2227-4686-80a6-f6a581852ec3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:30:58.869113 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-fc7aed8f-2227-4686-80a6-f6a581852ec3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:30:58.869799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-fc7aed8f-2227-4686-80a6-f6a581852ec3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:30:58.870303 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-fc7aed8f-2227-4686-80a6-f6a581852ec3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:30:58.870915 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-fc7aed8f-2227-4686-80a6-f6a581852ec3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:30:58.883070 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fc7aed8f-2227-4686-80a6-f6a581852ec3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:58.883571 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fc7aed8f-2227-4686-80a6-f6a581852ec3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:58.884367 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fc7aed8f-2227-4686-80a6-f6a581852ec3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:30:58.884811 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fc7aed8f-2227-4686-80a6-f6a581852ec3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:30:58.903588 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-fc7aed8f-2227-4686-80a6-f6a581852ec3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Getting quotas for project 9fa3479e48da461eb31ba242143690c6. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:30:58.909342 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-fc7aed8f-2227-4686-80a6-f6a581852ec3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Getting quotas for user dd0d0aebe00643899de4edd08345e3fd and project 9fa3479e48da461eb31ba242143690c6. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:30:58.923344 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fc7aed8f-2227-4686-80a6-f6a581852ec3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:30:58.930736 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fc7aed8f-2227-4686-80a6-f6a581852ec3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:30:58.976580 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fc7aed8f-2227-4686-80a6-f6a581852ec3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.651788 Aug 04 17:30:58.977352 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3296/6483] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:30:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:30:58.990244 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3e76ce95-74d0-4ca2-a13f-60fa77924f43 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:58.990930 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3e76ce95-74d0-4ca2-a13f-60fa77924f43 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:59.065087 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3e76ce95-74d0-4ca2-a13f-60fa77924f43 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:59.077458 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3e76ce95-74d0-4ca2-a13f-60fa77924f43 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1238 microversion: 2.1 time: 0.092538 Aug 04 17:30:59.078097 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3188/6484] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:58 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1238 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:31:00.102304 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f2c3a172-f5f6-49c6-99dc-aa2754e0f850 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:31:00.103561 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f2c3a172-f5f6-49c6-99dc-aa2754e0f850 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:31:00.114744 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f2c3a172-f5f6-49c6-99dc-aa2754e0f850 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:31:00.116036 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f2c3a172-f5f6-49c6-99dc-aa2754e0f850 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:31:00.117223 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f2c3a172-f5f6-49c6-99dc-aa2754e0f850 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:31:00.118615 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f2c3a172-f5f6-49c6-99dc-aa2754e0f850 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:31:00.204764 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f2c3a172-f5f6-49c6-99dc-aa2754e0f850 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:31:00.214186 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f2c3a172-f5f6-49c6-99dc-aa2754e0f850 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1298 microversion: 2.1 time: 0.117264 Aug 04 17:31:00.215074 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3297/6485] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:31:00 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1298 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:31:01.237187 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-89e6e602-7898-47dd-bf9f-9a4c681b0bee tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:31:01.237857 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-89e6e602-7898-47dd-bf9f-9a4c681b0bee tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:31:01.245842 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-89e6e602-7898-47dd-bf9f-9a4c681b0bee tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:31:01.246272 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-89e6e602-7898-47dd-bf9f-9a4c681b0bee tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:31:01.247239 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-89e6e602-7898-47dd-bf9f-9a4c681b0bee tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:31:01.247639 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-89e6e602-7898-47dd-bf9f-9a4c681b0bee tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:31:01.454079 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-89e6e602-7898-47dd-bf9f-9a4c681b0bee tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:31:01.462522 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-89e6e602-7898-47dd-bf9f-9a4c681b0bee tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1364 microversion: 2.1 time: 0.229513 Aug 04 17:31:01.463171 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3189/6486] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:31:01 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1364 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:31:01.648272 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-0059549e-9521-4eac-a795-c175720e82ff req-87617f95-15f7-4443-bb20-2953d71bdd3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75a63e07-f3ee-430a-83dd-ad8f36d575ce", "tag": "b694a068-c575-43b8-8e89-38fd155d1879"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:31:01.660241 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-0059549e-9521-4eac-a795-c175720e82ff req-87617f95-15f7-4443-bb20-2953d71bdd3d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:31:01.660678 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-0059549e-9521-4eac-a795-c175720e82ff req-87617f95-15f7-4443-bb20-2953d71bdd3d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:31:01.675856 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-0059549e-9521-4eac-a795-c175720e82ff req-87617f95-15f7-4443-bb20-2953d71bdd3d service nova] Creating event network-changed:b694a068-c575-43b8-8e89-38fd155d1879 for instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce on n-h1-846466-12 Aug 04 17:31:01.681244 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-0059549e-9521-4eac-a795-c175720e82ff req-87617f95-15f7-4443-bb20-2953d71bdd3d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038756 Aug 04 17:31:01.681901 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3298/6487] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:31:02.484630 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6191c871-d5c6-49b7-bab4-95c775d4cd83 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:31:02.485264 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6191c871-d5c6-49b7-bab4-95c775d4cd83 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:31:02.493876 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6191c871-d5c6-49b7-bab4-95c775d4cd83 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:31:02.494350 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6191c871-d5c6-49b7-bab4-95c775d4cd83 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:31:02.495186 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6191c871-d5c6-49b7-bab4-95c775d4cd83 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:31:02.495612 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6191c871-d5c6-49b7-bab4-95c775d4cd83 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:31:02.654408 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6191c871-d5c6-49b7-bab4-95c775d4cd83 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:31:02.674220 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6191c871-d5c6-49b7-bab4-95c775d4cd83 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1364 microversion: 2.1 time: 0.193358 Aug 04 17:31:02.674832 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3190/6488] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:31:02 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1364 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:31:03.701221 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4d2ec3d4-b4d1-44f3-99a6-4487b0646b9e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:31:03.702216 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4d2ec3d4-b4d1-44f3-99a6-4487b0646b9e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:31:03.709816 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d2ec3d4-b4d1-44f3-99a6-4487b0646b9e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:31:03.710272 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d2ec3d4-b4d1-44f3-99a6-4487b0646b9e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:31:03.711074 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d2ec3d4-b4d1-44f3-99a6-4487b0646b9e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:31:03.711512 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4d2ec3d4-b4d1-44f3-99a6-4487b0646b9e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:31:04.234231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4d2ec3d4-b4d1-44f3-99a6-4487b0646b9e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:31:04.242980 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4d2ec3d4-b4d1-44f3-99a6-4487b0646b9e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1364 microversion: 2.1 time: 0.546268 Aug 04 17:31:04.243596 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3299/6489] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:31:03 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1364 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:31:05.274124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e9e7c58a-81c1-4269-b5e9-d63156b8740c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:31:05.275089 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e9e7c58a-81c1-4269-b5e9-d63156b8740c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:31:05.283351 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e9e7c58a-81c1-4269-b5e9-d63156b8740c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:31:05.283865 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e9e7c58a-81c1-4269-b5e9-d63156b8740c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:31:05.284572 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e9e7c58a-81c1-4269-b5e9-d63156b8740c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:31:05.285027 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e9e7c58a-81c1-4269-b5e9-d63156b8740c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:31:05.447274 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e9e7c58a-81c1-4269-b5e9-d63156b8740c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:31:05.455605 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e9e7c58a-81c1-4269-b5e9-d63156b8740c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1364 microversion: 2.1 time: 0.194149 Aug 04 17:31:05.456165 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3191/6490] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:31:05 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1364 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:31:06.480437 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-016c0d95-8c17-415f-9e25-340ca0db195c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:31:06.481072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-016c0d95-8c17-415f-9e25-340ca0db195c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:31:06.488617 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-016c0d95-8c17-415f-9e25-340ca0db195c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:31:06.489294 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-016c0d95-8c17-415f-9e25-340ca0db195c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:31:06.490411 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-016c0d95-8c17-415f-9e25-340ca0db195c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:31:06.490852 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-016c0d95-8c17-415f-9e25-340ca0db195c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:31:06.641727 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-016c0d95-8c17-415f-9e25-340ca0db195c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:31:06.650680 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-016c0d95-8c17-415f-9e25-340ca0db195c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1364 microversion: 2.1 time: 0.174226 Aug 04 17:31:06.651298 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3300/6491] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:31:06 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:31:07.672456 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9316f9fa-af45-4fa6-a184-7f5fdca209ee tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:31:07.673124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9316f9fa-af45-4fa6-a184-7f5fdca209ee tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:31:07.680425 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9316f9fa-af45-4fa6-a184-7f5fdca209ee tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:31:07.680863 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9316f9fa-af45-4fa6-a184-7f5fdca209ee tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:31:07.681748 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9316f9fa-af45-4fa6-a184-7f5fdca209ee tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:31:07.682201 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9316f9fa-af45-4fa6-a184-7f5fdca209ee tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:31:07.818316 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9316f9fa-af45-4fa6-a184-7f5fdca209ee tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:31:07.826308 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9316f9fa-af45-4fa6-a184-7f5fdca209ee tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1364 microversion: 2.1 time: 0.157840 Aug 04 17:31:07.826907 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3192/6492] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:31:07 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:31:08.448763 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-2588b4ec-c7b2-481b-a49a-da8e7148ba77 req-5665bd40-79ed-4b92-a0fd-8dee37dd1109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a63e07-f3ee-430a-83dd-ad8f36d575ce", "name": "network-vif-plugged", "status": "completed", "tag": "b694a068-c575-43b8-8e89-38fd155d1879"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:31:08.461907 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-2588b4ec-c7b2-481b-a49a-da8e7148ba77 req-5665bd40-79ed-4b92-a0fd-8dee37dd1109 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:31:08.462344 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-2588b4ec-c7b2-481b-a49a-da8e7148ba77 req-5665bd40-79ed-4b92-a0fd-8dee37dd1109 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:31:08.477722 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-2588b4ec-c7b2-481b-a49a-da8e7148ba77 req-5665bd40-79ed-4b92-a0fd-8dee37dd1109 service nova] Creating event network-vif-plugged:b694a068-c575-43b8-8e89-38fd155d1879 for instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce on n-h1-846466-12 Aug 04 17:31:08.484897 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-2588b4ec-c7b2-481b-a49a-da8e7148ba77 req-5665bd40-79ed-4b92-a0fd-8dee37dd1109 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040682 Aug 04 17:31:08.485951 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3301/6493] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:31:08.850220 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9d9d40fe-4af0-43e7-a869-e5b7860814ac tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:31:08.850871 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9d9d40fe-4af0-43e7-a869-e5b7860814ac tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:31:08.858797 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d9d40fe-4af0-43e7-a869-e5b7860814ac tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:31:08.859357 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d9d40fe-4af0-43e7-a869-e5b7860814ac tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:31:08.860202 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d9d40fe-4af0-43e7-a869-e5b7860814ac tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:31:08.860654 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9d9d40fe-4af0-43e7-a869-e5b7860814ac tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:31:09.030628 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9d9d40fe-4af0-43e7-a869-e5b7860814ac tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:31:09.043006 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9d9d40fe-4af0-43e7-a869-e5b7860814ac tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1364 microversion: 2.1 time: 0.198166 Aug 04 17:31:09.043588 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3193/6494] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:31:08 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1364 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:31:10.066434 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6dcfeb6e-1f08-4e13-bf10-f86fba49e68f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:31:10.067309 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6dcfeb6e-1f08-4e13-bf10-f86fba49e68f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:31:10.069661 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:31:10.070351 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:31:10.078081 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6dcfeb6e-1f08-4e13-bf10-f86fba49e68f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:31:10.078524 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6dcfeb6e-1f08-4e13-bf10-f86fba49e68f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:31:10.079314 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6dcfeb6e-1f08-4e13-bf10-f86fba49e68f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:31:10.079742 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6dcfeb6e-1f08-4e13-bf10-f86fba49e68f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:31:10.234739 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6dcfeb6e-1f08-4e13-bf10-f86fba49e68f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:31:10.243605 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6dcfeb6e-1f08-4e13-bf10-f86fba49e68f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1551 microversion: 2.1 time: 0.181673 Aug 04 17:31:10.244213 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3302/6495] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:31:10 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1551 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:31:10.265457 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3180e5f5-6693-479d-b74e-ff701ed00c60 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:31:10.265990 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3180e5f5-6693-479d-b74e-ff701ed00c60 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:31:10.268086 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:31:10.275408 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3180e5f5-6693-479d-b74e-ff701ed00c60 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:31:10.275864 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3180e5f5-6693-479d-b74e-ff701ed00c60 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:31:10.276664 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3180e5f5-6693-479d-b74e-ff701ed00c60 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:31:10.277113 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3180e5f5-6693-479d-b74e-ff701ed00c60 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:31:10.373156 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3180e5f5-6693-479d-b74e-ff701ed00c60 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111846 Aug 04 17:31:10.373819 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3194/6496] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Aug 4 17:31:10 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:31:11.494446 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-f109647a-b4bc-43be-9d22-6c8441e44b82 req-f7c2e917-d584-44e1-9102-3fd6edfd42e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75a63e07-f3ee-430a-83dd-ad8f36d575ce", "tag": "b694a068-c575-43b8-8e89-38fd155d1879"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:31:11.507928 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-f109647a-b4bc-43be-9d22-6c8441e44b82 req-f7c2e917-d584-44e1-9102-3fd6edfd42e8 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:31:11.508377 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-f109647a-b4bc-43be-9d22-6c8441e44b82 req-f7c2e917-d584-44e1-9102-3fd6edfd42e8 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:31:11.522802 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-f109647a-b4bc-43be-9d22-6c8441e44b82 req-f7c2e917-d584-44e1-9102-3fd6edfd42e8 service nova] Creating event network-changed:b694a068-c575-43b8-8e89-38fd155d1879 for instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce on n-h1-846466-12 Aug 04 17:31:11.528399 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-f109647a-b4bc-43be-9d22-6c8441e44b82 req-f7c2e917-d584-44e1-9102-3fd6edfd42e8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038081 Aug 04 17:31:11.529408 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3303/6497] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:31:50.622019 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=27 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:31:50.622841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=76 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:31:50.627392 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-75dac5fe-887b-4a26-aa3a-248e3743cffb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:31:50.628004 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-75dac5fe-887b-4a26-aa3a-248e3743cffb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:31:50.637888 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-75dac5fe-887b-4a26-aa3a-248e3743cffb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:31:50.638339 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-75dac5fe-887b-4a26-aa3a-248e3743cffb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:31:50.639105 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-75dac5fe-887b-4a26-aa3a-248e3743cffb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:31:50.639544 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-75dac5fe-887b-4a26-aa3a-248e3743cffb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:31:51.082361 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-75dac5fe-887b-4a26-aa3a-248e3743cffb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:31:51.090518 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-75dac5fe-887b-4a26-aa3a-248e3743cffb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1670 microversion: 2.1 time: 0.470557 Aug 04 17:31:51.091250 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3195/6498] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:31:50 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1670 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:31:51.109249 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:31:51.110040 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:31:51.114381 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f3702e3e-b269-4b10-912f-945f05b1bb02 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a85d523-872f-4d8f-8c74-ab60ac4f3624"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:31:51.116812 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f3702e3e-b269-4b10-912f-945f05b1bb02 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:31:51.128809 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3702e3e-b269-4b10-912f-945f05b1bb02 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:31:51.129259 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3702e3e-b269-4b10-912f-945f05b1bb02 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:31:51.130054 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3702e3e-b269-4b10-912f-945f05b1bb02 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:31:51.130485 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3702e3e-b269-4b10-912f-945f05b1bb02 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:31:51.419326 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f3702e3e-b269-4b10-912f-945f05b1bb02 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "POST /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312068 Aug 04 17:31:51.420138 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3304/6499] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Aug 4 17:31:51 2022] POST /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:32:03.498876 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-422e082c-5ac6-45e1-955f-7db883966168 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:32:03.501368 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-422e082c-5ac6-45e1-955f-7db883966168 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:03.503902 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:32:03.504714 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:32:03.511593 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-422e082c-5ac6-45e1-955f-7db883966168 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:03.512049 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-422e082c-5ac6-45e1-955f-7db883966168 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:03.513605 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-422e082c-5ac6-45e1-955f-7db883966168 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:03.514065 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-422e082c-5ac6-45e1-955f-7db883966168 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:03.545717 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-422e082c-5ac6-45e1-955f-7db883966168 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:03.552431 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-422e082c-5ac6-45e1-955f-7db883966168 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Old instance type m1.heat2, new instance type m1.heat {{(pid=126126) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 17:32:03.560218 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-422e082c-5ac6-45e1-955f-7db883966168 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:32:03.560651 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-422e082c-5ac6-45e1-955f-7db883966168 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:32:03.561127 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-422e082c-5ac6-45e1-955f-7db883966168 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:32:03.561629 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-422e082c-5ac6-45e1-955f-7db883966168 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:32:03.562136 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-422e082c-5ac6-45e1-955f-7db883966168 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:32:03.631171 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-422e082c-5ac6-45e1-955f-7db883966168 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "POST /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce/action" status: 202 len: 0 microversion: 2.1 time: 0.136711 Aug 04 17:32:03.632872 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3196/6500] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:32:03 2022] POST /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:32:03.638483 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:32:03.639750 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:32:03.644222 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5db02ef2-dcf1-4535-8b51-1cd14f86aca3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:03.644961 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5db02ef2-dcf1-4535-8b51-1cd14f86aca3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:03.653550 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5db02ef2-dcf1-4535-8b51-1cd14f86aca3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:03.653995 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5db02ef2-dcf1-4535-8b51-1cd14f86aca3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:03.654854 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5db02ef2-dcf1-4535-8b51-1cd14f86aca3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:03.655282 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5db02ef2-dcf1-4535-8b51-1cd14f86aca3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:03.803191 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5db02ef2-dcf1-4535-8b51-1cd14f86aca3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:03.812049 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5db02ef2-dcf1-4535-8b51-1cd14f86aca3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1725 microversion: 2.1 time: 0.175609 Aug 04 17:32:03.812642 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3305/6501] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:03 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:04.835601 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a1f310ff-7995-4810-83f0-76d8f27376e3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:04.836270 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a1f310ff-7995-4810-83f0-76d8f27376e3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:04.843600 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a1f310ff-7995-4810-83f0-76d8f27376e3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:04.844066 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a1f310ff-7995-4810-83f0-76d8f27376e3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:04.844883 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a1f310ff-7995-4810-83f0-76d8f27376e3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:04.845374 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a1f310ff-7995-4810-83f0-76d8f27376e3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:04.992951 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a1f310ff-7995-4810-83f0-76d8f27376e3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:05.001650 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a1f310ff-7995-4810-83f0-76d8f27376e3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1725 microversion: 2.1 time: 0.170976 Aug 04 17:32:05.002419 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3197/6502] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:04 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:06.023765 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-46aca51c-bd1b-42ec-9338-df20c039d457 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:06.024434 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-46aca51c-bd1b-42ec-9338-df20c039d457 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:06.032222 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46aca51c-bd1b-42ec-9338-df20c039d457 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:06.032661 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46aca51c-bd1b-42ec-9338-df20c039d457 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:06.033468 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46aca51c-bd1b-42ec-9338-df20c039d457 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:06.033898 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46aca51c-bd1b-42ec-9338-df20c039d457 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:06.187027 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-46aca51c-bd1b-42ec-9338-df20c039d457 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:06.195675 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-46aca51c-bd1b-42ec-9338-df20c039d457 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1730 microversion: 2.1 time: 0.176280 Aug 04 17:32:06.196281 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3306/6503] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:06 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:07.219985 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5cc97cc2-6283-45b6-b0f9-fa3b50574cb0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:07.220657 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5cc97cc2-6283-45b6-b0f9-fa3b50574cb0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:07.228392 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5cc97cc2-6283-45b6-b0f9-fa3b50574cb0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:07.228846 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5cc97cc2-6283-45b6-b0f9-fa3b50574cb0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:07.229663 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5cc97cc2-6283-45b6-b0f9-fa3b50574cb0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:07.230103 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5cc97cc2-6283-45b6-b0f9-fa3b50574cb0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:07.370741 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5cc97cc2-6283-45b6-b0f9-fa3b50574cb0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:07.379826 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5cc97cc2-6283-45b6-b0f9-fa3b50574cb0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1730 microversion: 2.1 time: 0.165223 Aug 04 17:32:07.380566 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3198/6504] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:07 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:08.403967 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-772aa930-c867-46c9-98d2-61374af3dacc tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:08.406124 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-772aa930-c867-46c9-98d2-61374af3dacc tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:08.414186 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-772aa930-c867-46c9-98d2-61374af3dacc tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:08.414637 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-772aa930-c867-46c9-98d2-61374af3dacc tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:08.415431 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-772aa930-c867-46c9-98d2-61374af3dacc tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:08.415863 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-772aa930-c867-46c9-98d2-61374af3dacc tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:08.566067 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-772aa930-c867-46c9-98d2-61374af3dacc tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:08.574552 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-772aa930-c867-46c9-98d2-61374af3dacc tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1730 microversion: 2.1 time: 0.176624 Aug 04 17:32:08.575203 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3307/6505] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:08 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:09.597117 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-68158992-7cdf-4202-8da5-9a1a126b4807 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:09.597792 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-68158992-7cdf-4202-8da5-9a1a126b4807 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:09.605321 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-68158992-7cdf-4202-8da5-9a1a126b4807 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:09.605790 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-68158992-7cdf-4202-8da5-9a1a126b4807 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:09.606608 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-68158992-7cdf-4202-8da5-9a1a126b4807 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:09.607059 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-68158992-7cdf-4202-8da5-9a1a126b4807 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:09.757983 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-68158992-7cdf-4202-8da5-9a1a126b4807 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:09.767676 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-68158992-7cdf-4202-8da5-9a1a126b4807 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1730 microversion: 2.1 time: 0.175194 Aug 04 17:32:09.768253 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3199/6506] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:09 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:10.789651 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a77676d0-26bb-421e-9603-ec182c7c5593 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:10.790426 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a77676d0-26bb-421e-9603-ec182c7c5593 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:10.801716 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a77676d0-26bb-421e-9603-ec182c7c5593 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:10.802144 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a77676d0-26bb-421e-9603-ec182c7c5593 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:10.803198 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a77676d0-26bb-421e-9603-ec182c7c5593 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:10.803648 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a77676d0-26bb-421e-9603-ec182c7c5593 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:10.954783 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a77676d0-26bb-421e-9603-ec182c7c5593 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:10.967768 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a77676d0-26bb-421e-9603-ec182c7c5593 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1730 microversion: 2.1 time: 0.182205 Aug 04 17:32:10.968520 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3308/6507] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:10 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:11.989858 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8ad518a8-0565-466c-9888-9dc6a6392bcb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:11.990559 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8ad518a8-0565-466c-9888-9dc6a6392bcb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:11.998146 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8ad518a8-0565-466c-9888-9dc6a6392bcb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:11.998719 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8ad518a8-0565-466c-9888-9dc6a6392bcb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:11.999508 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8ad518a8-0565-466c-9888-9dc6a6392bcb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:11.999962 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8ad518a8-0565-466c-9888-9dc6a6392bcb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:12.158194 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8ad518a8-0565-466c-9888-9dc6a6392bcb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:12.166892 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8ad518a8-0565-466c-9888-9dc6a6392bcb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1730 microversion: 2.1 time: 0.181082 Aug 04 17:32:12.167483 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3200/6508] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:11 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:13.188946 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b81445ac-5212-4964-9caa-70fdb4997fb7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:13.189642 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b81445ac-5212-4964-9caa-70fdb4997fb7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:13.198621 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b81445ac-5212-4964-9caa-70fdb4997fb7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:13.199075 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b81445ac-5212-4964-9caa-70fdb4997fb7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:13.199846 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b81445ac-5212-4964-9caa-70fdb4997fb7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:13.200284 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b81445ac-5212-4964-9caa-70fdb4997fb7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:13.345396 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b81445ac-5212-4964-9caa-70fdb4997fb7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:13.357940 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b81445ac-5212-4964-9caa-70fdb4997fb7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1730 microversion: 2.1 time: 0.172568 Aug 04 17:32:13.358844 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3309/6509] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:13 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:14.381323 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5d2016fa-cdc1-4d1e-bada-3c7a5c45c0bc tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:14.381975 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5d2016fa-cdc1-4d1e-bada-3c7a5c45c0bc tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:14.389300 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5d2016fa-cdc1-4d1e-bada-3c7a5c45c0bc tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:14.389738 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5d2016fa-cdc1-4d1e-bada-3c7a5c45c0bc tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:14.390541 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5d2016fa-cdc1-4d1e-bada-3c7a5c45c0bc tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:14.391052 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5d2016fa-cdc1-4d1e-bada-3c7a5c45c0bc tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:14.530458 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5d2016fa-cdc1-4d1e-bada-3c7a5c45c0bc tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:14.539517 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5d2016fa-cdc1-4d1e-bada-3c7a5c45c0bc tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1730 microversion: 2.1 time: 0.162362 Aug 04 17:32:14.540095 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3201/6510] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:14 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:15.568977 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ed7564a8-c9e5-419e-9003-77be8cd2816c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:15.569599 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ed7564a8-c9e5-419e-9003-77be8cd2816c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:15.577186 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ed7564a8-c9e5-419e-9003-77be8cd2816c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:15.577648 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ed7564a8-c9e5-419e-9003-77be8cd2816c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:15.578419 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ed7564a8-c9e5-419e-9003-77be8cd2816c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:15.578854 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ed7564a8-c9e5-419e-9003-77be8cd2816c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:15.727509 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ed7564a8-c9e5-419e-9003-77be8cd2816c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:15.735815 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ed7564a8-c9e5-419e-9003-77be8cd2816c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1730 microversion: 2.1 time: 0.171428 Aug 04 17:32:15.736406 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3310/6511] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:15 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:15.948495 n-d-846466-12 devstack@n-api.service[126125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:32:15.948809 n-d-846466-12 devstack@n-api.service[126125]: Thu Aug 4 17:32:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 17:32:16.535470 n-d-846466-12 devstack@n-api.service[126126]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:32:16.536172 n-d-846466-12 devstack@n-api.service[126126]: Thu Aug 4 17:32:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 17:32:16.759702 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0f196871-2abb-4e0d-a386-056046abdca3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:16.760358 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0f196871-2abb-4e0d-a386-056046abdca3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:16.767944 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0f196871-2abb-4e0d-a386-056046abdca3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:16.768401 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0f196871-2abb-4e0d-a386-056046abdca3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:16.769305 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0f196871-2abb-4e0d-a386-056046abdca3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:16.769683 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0f196871-2abb-4e0d-a386-056046abdca3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:16.939741 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0f196871-2abb-4e0d-a386-056046abdca3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:16.948246 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0f196871-2abb-4e0d-a386-056046abdca3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1730 microversion: 2.1 time: 0.193655 Aug 04 17:32:16.948821 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3202/6512] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:16 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1730 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:32:17.970460 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3439c507-99e2-4e4e-92f4-eccaf1a5ab6b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:17.971159 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3439c507-99e2-4e4e-92f4-eccaf1a5ab6b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:17.982345 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3439c507-99e2-4e4e-92f4-eccaf1a5ab6b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:17.982802 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3439c507-99e2-4e4e-92f4-eccaf1a5ab6b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:17.983584 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3439c507-99e2-4e4e-92f4-eccaf1a5ab6b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:17.984015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3439c507-99e2-4e4e-92f4-eccaf1a5ab6b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:18.134401 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3439c507-99e2-4e4e-92f4-eccaf1a5ab6b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:18.144699 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3439c507-99e2-4e4e-92f4-eccaf1a5ab6b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1730 microversion: 2.1 time: 0.178470 Aug 04 17:32:18.145306 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3311/6513] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:17 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:19.167652 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b7b35742-4a31-4039-ac66-b1425a08602e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:19.168272 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b7b35742-4a31-4039-ac66-b1425a08602e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:19.175659 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7b35742-4a31-4039-ac66-b1425a08602e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:19.176124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7b35742-4a31-4039-ac66-b1425a08602e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:19.176904 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7b35742-4a31-4039-ac66-b1425a08602e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:19.177384 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7b35742-4a31-4039-ac66-b1425a08602e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:19.318708 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b7b35742-4a31-4039-ac66-b1425a08602e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:19.328979 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b7b35742-4a31-4039-ac66-b1425a08602e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1730 microversion: 2.1 time: 0.165422 Aug 04 17:32:19.329486 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3203/6514] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:19 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:20.355007 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1c748711-941e-44dd-bc29-377f2c777bf0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:20.355672 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1c748711-941e-44dd-bc29-377f2c777bf0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:20.364266 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1c748711-941e-44dd-bc29-377f2c777bf0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:20.364706 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1c748711-941e-44dd-bc29-377f2c777bf0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:20.365540 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1c748711-941e-44dd-bc29-377f2c777bf0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:20.365968 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1c748711-941e-44dd-bc29-377f2c777bf0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:20.523114 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1c748711-941e-44dd-bc29-377f2c777bf0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:20.534789 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1c748711-941e-44dd-bc29-377f2c777bf0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1730 microversion: 2.1 time: 0.184335 Aug 04 17:32:20.535688 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3312/6515] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:20 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:21.561145 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-59872800-cefe-49eb-a825-96520ba73d28 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:21.561835 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-59872800-cefe-49eb-a825-96520ba73d28 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:21.572115 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-59872800-cefe-49eb-a825-96520ba73d28 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:21.572579 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-59872800-cefe-49eb-a825-96520ba73d28 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:21.573388 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-59872800-cefe-49eb-a825-96520ba73d28 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:21.573832 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-59872800-cefe-49eb-a825-96520ba73d28 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:21.718566 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-59872800-cefe-49eb-a825-96520ba73d28 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:21.728132 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-59872800-cefe-49eb-a825-96520ba73d28 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1730 microversion: 2.1 time: 0.170974 Aug 04 17:32:21.728715 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3204/6516] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:21 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:22.750251 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6873f919-fd1f-41cf-886c-33943b4bdc89 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:22.750979 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6873f919-fd1f-41cf-886c-33943b4bdc89 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:22.758799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6873f919-fd1f-41cf-886c-33943b4bdc89 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:22.759359 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6873f919-fd1f-41cf-886c-33943b4bdc89 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:22.760143 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6873f919-fd1f-41cf-886c-33943b4bdc89 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:22.760837 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6873f919-fd1f-41cf-886c-33943b4bdc89 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:22.905775 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6873f919-fd1f-41cf-886c-33943b4bdc89 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:22.918861 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6873f919-fd1f-41cf-886c-33943b4bdc89 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1730 microversion: 2.1 time: 0.172461 Aug 04 17:32:22.919773 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3313/6517] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:22 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:23.944081 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7dafaeef-5f74-4ca9-83fd-0c0d3e1fbb96 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:23.945302 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7dafaeef-5f74-4ca9-83fd-0c0d3e1fbb96 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:23.953789 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7dafaeef-5f74-4ca9-83fd-0c0d3e1fbb96 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:23.954311 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7dafaeef-5f74-4ca9-83fd-0c0d3e1fbb96 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:23.955320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7dafaeef-5f74-4ca9-83fd-0c0d3e1fbb96 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:23.955909 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7dafaeef-5f74-4ca9-83fd-0c0d3e1fbb96 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:24.108588 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7dafaeef-5f74-4ca9-83fd-0c0d3e1fbb96 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:24.117194 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7dafaeef-5f74-4ca9-83fd-0c0d3e1fbb96 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1730 microversion: 2.1 time: 0.179432 Aug 04 17:32:24.117856 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3205/6518] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:23 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:25.139022 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1f53fe38-08e5-4950-9383-bbf3d38f250a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:25.139667 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1f53fe38-08e5-4950-9383-bbf3d38f250a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:25.146319 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f53fe38-08e5-4950-9383-bbf3d38f250a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:25.146770 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f53fe38-08e5-4950-9383-bbf3d38f250a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:25.147885 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f53fe38-08e5-4950-9383-bbf3d38f250a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:25.148340 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1f53fe38-08e5-4950-9383-bbf3d38f250a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:25.313733 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1f53fe38-08e5-4950-9383-bbf3d38f250a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:25.323005 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1f53fe38-08e5-4950-9383-bbf3d38f250a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1730 microversion: 2.1 time: 0.188040 Aug 04 17:32:25.323705 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3314/6519] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:25 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:25.819129 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-62ca0496-0161-4b82-b893-735a9dd4ed64 req-ec9ffe91-2da3-461c-a014-837fc575687f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a63e07-f3ee-430a-83dd-ad8f36d575ce", "name": "network-vif-unplugged", "status": "completed", "tag": "b694a068-c575-43b8-8e89-38fd155d1879"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:32:25.831010 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-62ca0496-0161-4b82-b893-735a9dd4ed64 req-ec9ffe91-2da3-461c-a014-837fc575687f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:25.831725 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-62ca0496-0161-4b82-b893-735a9dd4ed64 req-ec9ffe91-2da3-461c-a014-837fc575687f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:25.843918 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-62ca0496-0161-4b82-b893-735a9dd4ed64 req-ec9ffe91-2da3-461c-a014-837fc575687f service nova] Creating event network-vif-unplugged:b694a068-c575-43b8-8e89-38fd155d1879 for instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce on n-h2-846466-12 Aug 04 17:32:25.849992 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [req-62ca0496-0161-4b82-b893-735a9dd4ed64 req-ec9ffe91-2da3-461c-a014-837fc575687f service nova] Instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126126) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:32:25.861526 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-62ca0496-0161-4b82-b893-735a9dd4ed64 req-ec9ffe91-2da3-461c-a014-837fc575687f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099463 Aug 04 17:32:25.862288 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3206/6520] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:32:26.347319 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c027cae2-77aa-43c6-84fc-784794d8e3c7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:26.347980 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c027cae2-77aa-43c6-84fc-784794d8e3c7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:26.356562 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c027cae2-77aa-43c6-84fc-784794d8e3c7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:26.356999 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c027cae2-77aa-43c6-84fc-784794d8e3c7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:26.357968 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c027cae2-77aa-43c6-84fc-784794d8e3c7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:26.358494 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c027cae2-77aa-43c6-84fc-784794d8e3c7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:26.503546 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c027cae2-77aa-43c6-84fc-784794d8e3c7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:26.512956 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c027cae2-77aa-43c6-84fc-784794d8e3c7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1729 microversion: 2.1 time: 0.170706 Aug 04 17:32:26.513588 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3315/6521] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:26 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:27.537002 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c6f8742d-c129-4848-a198-6d272e39400b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:27.537785 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c6f8742d-c129-4848-a198-6d272e39400b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:27.545458 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c6f8742d-c129-4848-a198-6d272e39400b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:27.545949 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c6f8742d-c129-4848-a198-6d272e39400b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:27.546781 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c6f8742d-c129-4848-a198-6d272e39400b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:27.547252 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c6f8742d-c129-4848-a198-6d272e39400b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:27.705955 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c6f8742d-c129-4848-a198-6d272e39400b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:27.714963 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c6f8742d-c129-4848-a198-6d272e39400b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1727 microversion: 2.1 time: 0.183410 Aug 04 17:32:27.715593 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3207/6522] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:27 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1727 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:27.880144 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-480403c3-1a5a-47dd-a810-2d129c0faa19 req-1d88228c-3b56-4c86-88e2-2756b7d767d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75a63e07-f3ee-430a-83dd-ad8f36d575ce", "tag": "b694a068-c575-43b8-8e89-38fd155d1879"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:32:27.892548 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-480403c3-1a5a-47dd-a810-2d129c0faa19 req-1d88228c-3b56-4c86-88e2-2756b7d767d9 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:27.892987 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-480403c3-1a5a-47dd-a810-2d129c0faa19 req-1d88228c-3b56-4c86-88e2-2756b7d767d9 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:27.907557 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-480403c3-1a5a-47dd-a810-2d129c0faa19 req-1d88228c-3b56-4c86-88e2-2756b7d767d9 service nova] Creating event network-changed:b694a068-c575-43b8-8e89-38fd155d1879 for instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce on n-h2-846466-12 Aug 04 17:32:27.914653 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [req-480403c3-1a5a-47dd-a810-2d129c0faa19 req-1d88228c-3b56-4c86-88e2-2756b7d767d9 service nova] Instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:32:27.927520 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-480403c3-1a5a-47dd-a810-2d129c0faa19 req-1d88228c-3b56-4c86-88e2-2756b7d767d9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051028 Aug 04 17:32:27.928241 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3316/6523] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:32:28.737414 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f4599a81-c84b-4c8b-b307-23a783a11f69 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:28.738169 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f4599a81-c84b-4c8b-b307-23a783a11f69 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:28.747198 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f4599a81-c84b-4c8b-b307-23a783a11f69 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:28.747656 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f4599a81-c84b-4c8b-b307-23a783a11f69 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:28.748485 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f4599a81-c84b-4c8b-b307-23a783a11f69 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:28.748938 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f4599a81-c84b-4c8b-b307-23a783a11f69 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:28.900910 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f4599a81-c84b-4c8b-b307-23a783a11f69 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:28.911130 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f4599a81-c84b-4c8b-b307-23a783a11f69 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1727 microversion: 2.1 time: 0.177736 Aug 04 17:32:28.911806 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3208/6524] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:28 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:29.934690 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6782d1fe-aa86-40a5-8375-a6ecd01115cc tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:29.935389 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6782d1fe-aa86-40a5-8375-a6ecd01115cc tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:29.942532 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6782d1fe-aa86-40a5-8375-a6ecd01115cc tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:29.943026 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6782d1fe-aa86-40a5-8375-a6ecd01115cc tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:29.943877 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6782d1fe-aa86-40a5-8375-a6ecd01115cc tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:29.944307 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6782d1fe-aa86-40a5-8375-a6ecd01115cc tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:30.105379 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6782d1fe-aa86-40a5-8375-a6ecd01115cc tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:30.113978 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6782d1fe-aa86-40a5-8375-a6ecd01115cc tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1727 microversion: 2.1 time: 0.185194 Aug 04 17:32:30.114849 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3317/6525] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:29 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1727 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:31.137609 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0296bb5b-ec0a-41b9-b4a0-7fd43d3dc913 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:31.138181 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0296bb5b-ec0a-41b9-b4a0-7fd43d3dc913 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:31.146214 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0296bb5b-ec0a-41b9-b4a0-7fd43d3dc913 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:31.146684 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0296bb5b-ec0a-41b9-b4a0-7fd43d3dc913 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:31.147845 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0296bb5b-ec0a-41b9-b4a0-7fd43d3dc913 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:31.148310 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0296bb5b-ec0a-41b9-b4a0-7fd43d3dc913 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:31.307159 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0296bb5b-ec0a-41b9-b4a0-7fd43d3dc913 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:31.316763 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0296bb5b-ec0a-41b9-b4a0-7fd43d3dc913 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1727 microversion: 2.1 time: 0.183664 Aug 04 17:32:31.317423 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3209/6526] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:31 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1727 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:32.338791 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9809a29a-227c-4090-a305-276d3ca83cd0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:32.339411 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9809a29a-227c-4090-a305-276d3ca83cd0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:32.352765 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9809a29a-227c-4090-a305-276d3ca83cd0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:32.353408 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9809a29a-227c-4090-a305-276d3ca83cd0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:32.354062 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9809a29a-227c-4090-a305-276d3ca83cd0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:32.355372 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9809a29a-227c-4090-a305-276d3ca83cd0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:32.500684 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9809a29a-227c-4090-a305-276d3ca83cd0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:32.509956 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9809a29a-227c-4090-a305-276d3ca83cd0 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1727 microversion: 2.1 time: 0.175617 Aug 04 17:32:32.510542 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3318/6527] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:32 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:33.533625 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2f53e43e-aeaa-4f16-adb0-f1a2694e164c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:33.534199 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2f53e43e-aeaa-4f16-adb0-f1a2694e164c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:33.537150 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=33 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:32:33.544586 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f53e43e-aeaa-4f16-adb0-f1a2694e164c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:33.545043 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f53e43e-aeaa-4f16-adb0-f1a2694e164c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:33.546057 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f53e43e-aeaa-4f16-adb0-f1a2694e164c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:33.546619 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2f53e43e-aeaa-4f16-adb0-f1a2694e164c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:33.549533 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:32:33.691120 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2f53e43e-aeaa-4f16-adb0-f1a2694e164c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:33.701136 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2f53e43e-aeaa-4f16-adb0-f1a2694e164c tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1727 microversion: 2.1 time: 0.171393 Aug 04 17:32:33.701959 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3210/6528] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:33 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:34.724768 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8e2d1e73-0da3-49a5-99df-cf76b52226b9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:34.725445 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8e2d1e73-0da3-49a5-99df-cf76b52226b9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:34.727492 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=29 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:32:34.734152 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8e2d1e73-0da3-49a5-99df-cf76b52226b9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:34.734598 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8e2d1e73-0da3-49a5-99df-cf76b52226b9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:34.735369 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8e2d1e73-0da3-49a5-99df-cf76b52226b9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:34.735816 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8e2d1e73-0da3-49a5-99df-cf76b52226b9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:34.738853 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=83 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:32:34.887743 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8e2d1e73-0da3-49a5-99df-cf76b52226b9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:34.896212 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8e2d1e73-0da3-49a5-99df-cf76b52226b9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1727 microversion: 2.1 time: 0.176407 Aug 04 17:32:34.896797 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3319/6529] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:34 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:35.918622 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b47514b8-5738-49ef-99ad-a3ba9356e4fd tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:35.919300 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b47514b8-5738-49ef-99ad-a3ba9356e4fd tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:35.927178 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b47514b8-5738-49ef-99ad-a3ba9356e4fd tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:35.927639 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b47514b8-5738-49ef-99ad-a3ba9356e4fd tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:35.928438 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b47514b8-5738-49ef-99ad-a3ba9356e4fd tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:35.928881 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b47514b8-5738-49ef-99ad-a3ba9356e4fd tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:36.083018 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b47514b8-5738-49ef-99ad-a3ba9356e4fd tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:36.095386 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b47514b8-5738-49ef-99ad-a3ba9356e4fd tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1727 microversion: 2.1 time: 0.180744 Aug 04 17:32:36.095956 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3211/6530] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:35 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1727 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:37.116656 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-149c4a19-6483-4510-a8bc-abc3ac32b9b5 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:37.117325 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-149c4a19-6483-4510-a8bc-abc3ac32b9b5 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:37.125613 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-149c4a19-6483-4510-a8bc-abc3ac32b9b5 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:37.126061 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-149c4a19-6483-4510-a8bc-abc3ac32b9b5 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:37.126835 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-149c4a19-6483-4510-a8bc-abc3ac32b9b5 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:37.127291 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-149c4a19-6483-4510-a8bc-abc3ac32b9b5 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:37.274823 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-149c4a19-6483-4510-a8bc-abc3ac32b9b5 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:37.287393 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-149c4a19-6483-4510-a8bc-abc3ac32b9b5 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1727 microversion: 2.1 time: 0.174342 Aug 04 17:32:37.288461 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3320/6531] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:37 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:38.311428 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-54f7a2c5-0f18-4282-9581-fc4ae1aa7689 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:38.312093 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-54f7a2c5-0f18-4282-9581-fc4ae1aa7689 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:38.319612 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-54f7a2c5-0f18-4282-9581-fc4ae1aa7689 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:38.320063 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-54f7a2c5-0f18-4282-9581-fc4ae1aa7689 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:38.320839 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-54f7a2c5-0f18-4282-9581-fc4ae1aa7689 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:38.321293 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-54f7a2c5-0f18-4282-9581-fc4ae1aa7689 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:38.463213 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-54f7a2c5-0f18-4282-9581-fc4ae1aa7689 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:38.472274 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-54f7a2c5-0f18-4282-9581-fc4ae1aa7689 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1727 microversion: 2.1 time: 0.165103 Aug 04 17:32:38.472914 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3212/6532] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:38 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:39.495239 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7b3edeaf-8336-48c6-a86f-a1fa100f6ea3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:39.495863 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7b3edeaf-8336-48c6-a86f-a1fa100f6ea3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:39.502524 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b3edeaf-8336-48c6-a86f-a1fa100f6ea3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:39.502967 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b3edeaf-8336-48c6-a86f-a1fa100f6ea3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:39.503729 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b3edeaf-8336-48c6-a86f-a1fa100f6ea3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:39.504165 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b3edeaf-8336-48c6-a86f-a1fa100f6ea3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:39.656983 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7b3edeaf-8336-48c6-a86f-a1fa100f6ea3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:39.666000 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7b3edeaf-8336-48c6-a86f-a1fa100f6ea3 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1724 microversion: 2.1 time: 0.175707 Aug 04 17:32:39.666607 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3321/6533] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:39 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:39.688676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-82452936-4b92-4de7-b15d-0f2a37d3fb48 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:32:39.689348 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-82452936-4b92-4de7-b15d-0f2a37d3fb48 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:39.696606 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-82452936-4b92-4de7-b15d-0f2a37d3fb48 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:39.697076 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-82452936-4b92-4de7-b15d-0f2a37d3fb48 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:39.697902 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-82452936-4b92-4de7-b15d-0f2a37d3fb48 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:39.698358 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-82452936-4b92-4de7-b15d-0f2a37d3fb48 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:39.740729 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-82452936-4b92-4de7-b15d-0f2a37d3fb48 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:39.741190 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-82452936-4b92-4de7-b15d-0f2a37d3fb48 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:39.742036 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-82452936-4b92-4de7-b15d-0f2a37d3fb48 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:39.742462 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-82452936-4b92-4de7-b15d-0f2a37d3fb48 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:39.766202 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-82452936-4b92-4de7-b15d-0f2a37d3fb48 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Getting quotas for project 9fa3479e48da461eb31ba242143690c6. Resources: {'ram', 'cores'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:32:39.771643 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-82452936-4b92-4de7-b15d-0f2a37d3fb48 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Getting quotas for user dd0d0aebe00643899de4edd08345e3fd and project 9fa3479e48da461eb31ba242143690c6. Resources: {'ram', 'cores'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:32:39.882297 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-82452936-4b92-4de7-b15d-0f2a37d3fb48 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "POST /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce/action" status: 202 len: 0 microversion: 2.1 time: 0.198251 Aug 04 17:32:39.882956 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3213/6534] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:32:39 2022] POST /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 17:32:39.891459 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d737fc51-ffa9-40d8-8165-e915fa869972 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:39.892208 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d737fc51-ffa9-40d8-8165-e915fa869972 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:39.899244 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d737fc51-ffa9-40d8-8165-e915fa869972 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:39.899846 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d737fc51-ffa9-40d8-8165-e915fa869972 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:39.900906 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d737fc51-ffa9-40d8-8165-e915fa869972 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:39.901605 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d737fc51-ffa9-40d8-8165-e915fa869972 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:40.059575 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d737fc51-ffa9-40d8-8165-e915fa869972 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:40.069251 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d737fc51-ffa9-40d8-8165-e915fa869972 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1723 microversion: 2.1 time: 0.181623 Aug 04 17:32:40.069873 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3322/6535] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:39 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:41.092819 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-212fe40b-5050-4dc0-9088-d3b51f76afea tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:41.093625 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-212fe40b-5050-4dc0-9088-d3b51f76afea tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:41.103384 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-212fe40b-5050-4dc0-9088-d3b51f76afea tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:41.103838 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-212fe40b-5050-4dc0-9088-d3b51f76afea tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:41.104644 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-212fe40b-5050-4dc0-9088-d3b51f76afea tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:41.105086 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-212fe40b-5050-4dc0-9088-d3b51f76afea tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:41.252526 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-212fe40b-5050-4dc0-9088-d3b51f76afea tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:41.262879 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-212fe40b-5050-4dc0-9088-d3b51f76afea tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1723 microversion: 2.1 time: 0.175535 Aug 04 17:32:41.263763 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3214/6536] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:41 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:41.823179 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-8ba8cbbc-1064-4788-92da-2b20fe6697de req-9b9803f1-aee8-4b9c-9803-9d090860e9f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a63e07-f3ee-430a-83dd-ad8f36d575ce", "name": "network-vif-plugged", "status": "completed", "tag": "b694a068-c575-43b8-8e89-38fd155d1879"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:32:41.837626 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-8ba8cbbc-1064-4788-92da-2b20fe6697de req-9b9803f1-aee8-4b9c-9803-9d090860e9f3 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:41.838430 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-8ba8cbbc-1064-4788-92da-2b20fe6697de req-9b9803f1-aee8-4b9c-9803-9d090860e9f3 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:41.851337 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-8ba8cbbc-1064-4788-92da-2b20fe6697de req-9b9803f1-aee8-4b9c-9803-9d090860e9f3 service nova] Creating event network-vif-plugged:b694a068-c575-43b8-8e89-38fd155d1879 for instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce on n-h2-846466-12 Aug 04 17:32:41.858168 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [req-8ba8cbbc-1064-4788-92da-2b20fe6697de req-9b9803f1-aee8-4b9c-9803-9d090860e9f3 service nova] Instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:32:41.871637 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-8ba8cbbc-1064-4788-92da-2b20fe6697de req-9b9803f1-aee8-4b9c-9803-9d090860e9f3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052752 Aug 04 17:32:41.872182 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3323/6537] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:32:42.286410 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e34274c4-8df3-4760-92b1-d87b2cebf7bb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:42.287030 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e34274c4-8df3-4760-92b1-d87b2cebf7bb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:42.297322 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e34274c4-8df3-4760-92b1-d87b2cebf7bb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:42.297808 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e34274c4-8df3-4760-92b1-d87b2cebf7bb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:42.298602 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e34274c4-8df3-4760-92b1-d87b2cebf7bb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:42.299047 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e34274c4-8df3-4760-92b1-d87b2cebf7bb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:42.449030 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e34274c4-8df3-4760-92b1-d87b2cebf7bb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:42.459113 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e34274c4-8df3-4760-92b1-d87b2cebf7bb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1723 microversion: 2.1 time: 0.176991 Aug 04 17:32:42.459855 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3215/6538] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:42 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:43.482588 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-329ced90-3a5c-4184-9652-5e2780327261 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:43.483333 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-329ced90-3a5c-4184-9652-5e2780327261 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:43.491261 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-329ced90-3a5c-4184-9652-5e2780327261 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:43.491707 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-329ced90-3a5c-4184-9652-5e2780327261 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:43.492482 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-329ced90-3a5c-4184-9652-5e2780327261 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:43.492906 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-329ced90-3a5c-4184-9652-5e2780327261 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:43.629989 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-329ced90-3a5c-4184-9652-5e2780327261 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:43.638747 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-329ced90-3a5c-4184-9652-5e2780327261 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1723 microversion: 2.1 time: 0.160591 Aug 04 17:32:43.639339 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3324/6539] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:43 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:44.660268 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0bc38a0b-5190-4cf6-af76-2c341414df12 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:44.661789 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0bc38a0b-5190-4cf6-af76-2c341414df12 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:44.669327 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0bc38a0b-5190-4cf6-af76-2c341414df12 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:44.669806 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0bc38a0b-5190-4cf6-af76-2c341414df12 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:44.670554 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0bc38a0b-5190-4cf6-af76-2c341414df12 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:44.675528 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0bc38a0b-5190-4cf6-af76-2c341414df12 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:44.840938 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0bc38a0b-5190-4cf6-af76-2c341414df12 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:44.854144 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0bc38a0b-5190-4cf6-af76-2c341414df12 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1723 microversion: 2.1 time: 0.197566 Aug 04 17:32:44.855810 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3216/6540] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:44 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:45.296518 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-ce69dfce-d888-4534-9022-f134060bd32e req-e4304893-67da-4f0e-a6d4-91fb9749c5aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a63e07-f3ee-430a-83dd-ad8f36d575ce", "name": "network-vif-unplugged", "status": "completed", "tag": "b694a068-c575-43b8-8e89-38fd155d1879"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:32:45.307568 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-ce69dfce-d888-4534-9022-f134060bd32e req-e4304893-67da-4f0e-a6d4-91fb9749c5aa service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:45.307940 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-ce69dfce-d888-4534-9022-f134060bd32e req-e4304893-67da-4f0e-a6d4-91fb9749c5aa service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:45.321113 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-ce69dfce-d888-4534-9022-f134060bd32e req-e4304893-67da-4f0e-a6d4-91fb9749c5aa service nova] Creating event network-vif-unplugged:b694a068-c575-43b8-8e89-38fd155d1879 for instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce on n-h1-846466-12 Aug 04 17:32:45.327073 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [req-ce69dfce-d888-4534-9022-f134060bd32e req-e4304893-67da-4f0e-a6d4-91fb9749c5aa service nova] Instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:32:45.338760 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-ce69dfce-d888-4534-9022-f134060bd32e req-e4304893-67da-4f0e-a6d4-91fb9749c5aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046177 Aug 04 17:32:45.340248 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3325/6541] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:32:45.877917 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-395b00f9-c1da-4701-b968-6c8e330cae0a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:45.878633 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-395b00f9-c1da-4701-b968-6c8e330cae0a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:45.886362 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-395b00f9-c1da-4701-b968-6c8e330cae0a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:45.886855 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-395b00f9-c1da-4701-b968-6c8e330cae0a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:45.887612 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-395b00f9-c1da-4701-b968-6c8e330cae0a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:45.888098 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-395b00f9-c1da-4701-b968-6c8e330cae0a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:46.093693 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-395b00f9-c1da-4701-b968-6c8e330cae0a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:46.105427 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-395b00f9-c1da-4701-b968-6c8e330cae0a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1723 microversion: 2.1 time: 0.231436 Aug 04 17:32:46.106362 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3217/6542] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:45 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:47.131740 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f32212d9-7345-4491-a730-c3a8e9e4c11f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:47.132628 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f32212d9-7345-4491-a730-c3a8e9e4c11f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:47.140580 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f32212d9-7345-4491-a730-c3a8e9e4c11f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:47.141038 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f32212d9-7345-4491-a730-c3a8e9e4c11f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:47.141872 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f32212d9-7345-4491-a730-c3a8e9e4c11f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:47.142270 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f32212d9-7345-4491-a730-c3a8e9e4c11f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:47.311250 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f32212d9-7345-4491-a730-c3a8e9e4c11f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:47.320567 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f32212d9-7345-4491-a730-c3a8e9e4c11f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1723 microversion: 2.1 time: 0.195409 Aug 04 17:32:47.321558 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3326/6543] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:47 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:47.358410 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-9e240f58-d2b4-4e20-b52d-88eaff4b4e40 req-ba8660fd-f5c4-4725-81fe-91ca7c3ee8af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75a63e07-f3ee-430a-83dd-ad8f36d575ce", "tag": "b694a068-c575-43b8-8e89-38fd155d1879"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:32:47.371071 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-9e240f58-d2b4-4e20-b52d-88eaff4b4e40 req-ba8660fd-f5c4-4725-81fe-91ca7c3ee8af service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:47.371422 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-9e240f58-d2b4-4e20-b52d-88eaff4b4e40 req-ba8660fd-f5c4-4725-81fe-91ca7c3ee8af service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:47.385342 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-9e240f58-d2b4-4e20-b52d-88eaff4b4e40 req-ba8660fd-f5c4-4725-81fe-91ca7c3ee8af service nova] Creating event network-changed:b694a068-c575-43b8-8e89-38fd155d1879 for instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce on n-h1-846466-12 Aug 04 17:32:47.391817 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [req-9e240f58-d2b4-4e20-b52d-88eaff4b4e40 req-ba8660fd-f5c4-4725-81fe-91ca7c3ee8af service nova] Instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126126) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:32:47.404679 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-9e240f58-d2b4-4e20-b52d-88eaff4b4e40 req-ba8660fd-f5c4-4725-81fe-91ca7c3ee8af service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050049 Aug 04 17:32:47.405514 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3218/6544] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:32:48.353645 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0c5a0c3a-6409-4041-8cae-d0b40c6e2596 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:48.354304 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0c5a0c3a-6409-4041-8cae-d0b40c6e2596 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:48.365000 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0c5a0c3a-6409-4041-8cae-d0b40c6e2596 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:48.365483 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0c5a0c3a-6409-4041-8cae-d0b40c6e2596 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:48.366282 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0c5a0c3a-6409-4041-8cae-d0b40c6e2596 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:48.366734 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0c5a0c3a-6409-4041-8cae-d0b40c6e2596 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:48.924812 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0c5a0c3a-6409-4041-8cae-d0b40c6e2596 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:48.938434 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0c5a0c3a-6409-4041-8cae-d0b40c6e2596 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1723 microversion: 2.1 time: 0.588795 Aug 04 17:32:48.939051 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3327/6545] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:48 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1723 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:49.959179 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:32:49.964004 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d93e6861-e093-4b46-b049-96d6d31515c7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:49.964750 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d93e6861-e093-4b46-b049-96d6d31515c7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:49.972076 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d93e6861-e093-4b46-b049-96d6d31515c7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:49.972619 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d93e6861-e093-4b46-b049-96d6d31515c7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:49.973519 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d93e6861-e093-4b46-b049-96d6d31515c7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:49.973969 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d93e6861-e093-4b46-b049-96d6d31515c7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:50.138983 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d93e6861-e093-4b46-b049-96d6d31515c7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:50.150008 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d93e6861-e093-4b46-b049-96d6d31515c7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1723 microversion: 2.1 time: 0.193049 Aug 04 17:32:50.150719 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3219/6546] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:49 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:51.172518 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-99d0ed3f-0e83-4081-a5d9-d811ea77e1d5 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:51.173257 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-99d0ed3f-0e83-4081-a5d9-d811ea77e1d5 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:51.180794 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-99d0ed3f-0e83-4081-a5d9-d811ea77e1d5 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:51.181240 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-99d0ed3f-0e83-4081-a5d9-d811ea77e1d5 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:51.182046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-99d0ed3f-0e83-4081-a5d9-d811ea77e1d5 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:51.182827 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-99d0ed3f-0e83-4081-a5d9-d811ea77e1d5 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:51.353090 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-99d0ed3f-0e83-4081-a5d9-d811ea77e1d5 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:51.362657 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-99d0ed3f-0e83-4081-a5d9-d811ea77e1d5 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1723 microversion: 2.1 time: 0.194384 Aug 04 17:32:51.363395 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3328/6547] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:51 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:52.385098 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-542a85e4-5aee-482e-97bd-ea7a7c2339b5 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:52.385854 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-542a85e4-5aee-482e-97bd-ea7a7c2339b5 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:52.393318 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-542a85e4-5aee-482e-97bd-ea7a7c2339b5 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:52.393797 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-542a85e4-5aee-482e-97bd-ea7a7c2339b5 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:52.394590 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-542a85e4-5aee-482e-97bd-ea7a7c2339b5 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:52.395036 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-542a85e4-5aee-482e-97bd-ea7a7c2339b5 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:52.546268 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-542a85e4-5aee-482e-97bd-ea7a7c2339b5 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:52.557091 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-542a85e4-5aee-482e-97bd-ea7a7c2339b5 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1723 microversion: 2.1 time: 0.175937 Aug 04 17:32:52.557726 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3220/6548] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:52 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:53.581776 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7d2c342b-4202-424f-836a-54858f7f1fb2 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:53.582402 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7d2c342b-4202-424f-836a-54858f7f1fb2 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:53.590451 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d2c342b-4202-424f-836a-54858f7f1fb2 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:53.590935 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d2c342b-4202-424f-836a-54858f7f1fb2 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:53.591709 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d2c342b-4202-424f-836a-54858f7f1fb2 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:53.592161 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d2c342b-4202-424f-836a-54858f7f1fb2 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:53.739231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7d2c342b-4202-424f-836a-54858f7f1fb2 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:53.749709 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7d2c342b-4202-424f-836a-54858f7f1fb2 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1723 microversion: 2.1 time: 0.171862 Aug 04 17:32:53.750333 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3329/6549] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:53 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:54.774189 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-188d657b-33fc-4764-8a70-ccd49436acdf tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:54.774806 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-188d657b-33fc-4764-8a70-ccd49436acdf tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:54.781669 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-188d657b-33fc-4764-8a70-ccd49436acdf tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:54.782129 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-188d657b-33fc-4764-8a70-ccd49436acdf tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:54.783049 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-188d657b-33fc-4764-8a70-ccd49436acdf tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:54.783495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-188d657b-33fc-4764-8a70-ccd49436acdf tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:54.931479 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-188d657b-33fc-4764-8a70-ccd49436acdf tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:54.940060 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-188d657b-33fc-4764-8a70-ccd49436acdf tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1723 microversion: 2.1 time: 0.170448 Aug 04 17:32:54.940577 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3221/6550] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:54 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:55.962651 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-87cddeb9-705d-40ef-a39c-f6db520ca19a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:55.963296 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-87cddeb9-705d-40ef-a39c-f6db520ca19a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:55.971198 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-87cddeb9-705d-40ef-a39c-f6db520ca19a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:55.971645 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-87cddeb9-705d-40ef-a39c-f6db520ca19a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:55.972417 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-87cddeb9-705d-40ef-a39c-f6db520ca19a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:55.972840 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-87cddeb9-705d-40ef-a39c-f6db520ca19a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:56.123504 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-87cddeb9-705d-40ef-a39c-f6db520ca19a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:56.132862 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-87cddeb9-705d-40ef-a39c-f6db520ca19a tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1723 microversion: 2.1 time: 0.174702 Aug 04 17:32:56.133576 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3330/6551] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:55 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:57.154843 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7555c177-6f80-4583-ad14-c4a3c59c0ce6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:57.155609 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7555c177-6f80-4583-ad14-c4a3c59c0ce6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:57.164148 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7555c177-6f80-4583-ad14-c4a3c59c0ce6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:57.164606 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7555c177-6f80-4583-ad14-c4a3c59c0ce6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:57.165422 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7555c177-6f80-4583-ad14-c4a3c59c0ce6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:57.165866 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7555c177-6f80-4583-ad14-c4a3c59c0ce6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:57.313339 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7555c177-6f80-4583-ad14-c4a3c59c0ce6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:57.322121 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7555c177-6f80-4583-ad14-c4a3c59c0ce6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1723 microversion: 2.1 time: 0.171188 Aug 04 17:32:57.322716 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3222/6552] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:57 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:58.344720 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-59cedf23-8952-433d-b0fa-d8f4d8795cfb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:58.345524 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-59cedf23-8952-433d-b0fa-d8f4d8795cfb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:58.354170 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-59cedf23-8952-433d-b0fa-d8f4d8795cfb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:58.354621 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-59cedf23-8952-433d-b0fa-d8f4d8795cfb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:58.355406 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-59cedf23-8952-433d-b0fa-d8f4d8795cfb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:58.355852 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-59cedf23-8952-433d-b0fa-d8f4d8795cfb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:58.500515 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-59cedf23-8952-433d-b0fa-d8f4d8795cfb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:58.512237 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-59cedf23-8952-433d-b0fa-d8f4d8795cfb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1723 microversion: 2.1 time: 0.171956 Aug 04 17:32:58.512954 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3331/6553] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:58 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:59.537409 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-538b554b-e134-41f2-906d-8e98a5e13ac9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:59.538121 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-538b554b-e134-41f2-906d-8e98a5e13ac9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:59.546002 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-538b554b-e134-41f2-906d-8e98a5e13ac9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:59.546458 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-538b554b-e134-41f2-906d-8e98a5e13ac9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:59.547239 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-538b554b-e134-41f2-906d-8e98a5e13ac9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:59.547682 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-538b554b-e134-41f2-906d-8e98a5e13ac9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:59.704344 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-538b554b-e134-41f2-906d-8e98a5e13ac9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:59.713074 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-538b554b-e134-41f2-906d-8e98a5e13ac9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1716 microversion: 2.1 time: 0.179930 Aug 04 17:32:59.713868 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3223/6554] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:59 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1716 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:59.736249 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e7057395-07cf-43a4-bccd-124950d324c7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:59.737130 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e7057395-07cf-43a4-bccd-124950d324c7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:59.745512 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e7057395-07cf-43a4-bccd-124950d324c7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:59.745963 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e7057395-07cf-43a4-bccd-124950d324c7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:59.747000 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e7057395-07cf-43a4-bccd-124950d324c7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:59.747607 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e7057395-07cf-43a4-bccd-124950d324c7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:59.894538 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e7057395-07cf-43a4-bccd-124950d324c7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:59.904369 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e7057395-07cf-43a4-bccd-124950d324c7 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1716 microversion: 2.1 time: 0.173947 Aug 04 17:32:59.905067 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3332/6555] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:59 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1716 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:59.926777 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b812bf92-5b1b-435e-94ec-bec111ba25e1 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:59.927387 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b812bf92-5b1b-435e-94ec-bec111ba25e1 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:59.934331 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b812bf92-5b1b-435e-94ec-bec111ba25e1 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:59.934788 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b812bf92-5b1b-435e-94ec-bec111ba25e1 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:59.935563 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b812bf92-5b1b-435e-94ec-bec111ba25e1 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:32:59.936006 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b812bf92-5b1b-435e-94ec-bec111ba25e1 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:32:59.938874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:33:00.084577 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b812bf92-5b1b-435e-94ec-bec111ba25e1 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:00.093309 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b812bf92-5b1b-435e-94ec-bec111ba25e1 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1716 microversion: 2.1 time: 0.170653 Aug 04 17:33:00.093914 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3224/6556] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:59 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1716 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:00.119390 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-06edda96-b7d5-41dd-88a0-0d0190a130fb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:00.119896 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-06edda96-b7d5-41dd-88a0-0d0190a130fb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:00.126530 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-06edda96-b7d5-41dd-88a0-0d0190a130fb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:00.126973 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-06edda96-b7d5-41dd-88a0-0d0190a130fb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:00.127756 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-06edda96-b7d5-41dd-88a0-0d0190a130fb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:00.128183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-06edda96-b7d5-41dd-88a0-0d0190a130fb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:00.158192 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-06edda96-b7d5-41dd-88a0-0d0190a130fb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:33:00.258267 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-06edda96-b7d5-41dd-88a0-0d0190a130fb tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "DELETE /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 204 len: 0 microversion: 2.1 time: 0.147192 Aug 04 17:33:00.259250 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3333/6557] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:33:00 2022] DELETE /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:33:00.267915 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f6a96b78-f639-4227-b504-e46fb6337e99 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:00.268536 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f6a96b78-f639-4227-b504-e46fb6337e99 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:00.276106 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6a96b78-f639-4227-b504-e46fb6337e99 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:00.276558 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6a96b78-f639-4227-b504-e46fb6337e99 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:00.277478 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6a96b78-f639-4227-b504-e46fb6337e99 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:00.277917 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6a96b78-f639-4227-b504-e46fb6337e99 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:00.429513 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f6a96b78-f639-4227-b504-e46fb6337e99 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:00.438224 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f6a96b78-f639-4227-b504-e46fb6337e99 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1722 microversion: 2.1 time: 0.174661 Aug 04 17:33:00.438804 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3225/6558] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:00 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:01.460657 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3df40948-93b1-4a4b-9a08-883e128c5167 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:01.461382 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3df40948-93b1-4a4b-9a08-883e128c5167 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:01.468943 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3df40948-93b1-4a4b-9a08-883e128c5167 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:01.469421 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3df40948-93b1-4a4b-9a08-883e128c5167 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:01.470210 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3df40948-93b1-4a4b-9a08-883e128c5167 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:01.470648 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3df40948-93b1-4a4b-9a08-883e128c5167 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:01.620646 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3df40948-93b1-4a4b-9a08-883e128c5167 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:01.623118 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:33:01.630987 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3df40948-93b1-4a4b-9a08-883e128c5167 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1722 microversion: 2.1 time: 0.174678 Aug 04 17:33:01.631604 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3334/6559] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:01 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:02.659988 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e77a5974-a84d-4c2f-ba67-1b57c2b4a88e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:02.665218 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e77a5974-a84d-4c2f-ba67-1b57c2b4a88e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:02.679833 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e77a5974-a84d-4c2f-ba67-1b57c2b4a88e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:02.687243 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e77a5974-a84d-4c2f-ba67-1b57c2b4a88e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:02.689259 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e77a5974-a84d-4c2f-ba67-1b57c2b4a88e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:02.690348 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e77a5974-a84d-4c2f-ba67-1b57c2b4a88e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:02.801682 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e77a5974-a84d-4c2f-ba67-1b57c2b4a88e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:02.815029 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e77a5974-a84d-4c2f-ba67-1b57c2b4a88e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1654 microversion: 2.1 time: 0.164914 Aug 04 17:33:02.829150 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3226/6560] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:02 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1654 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:03.055104 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-a603cb4c-2f00-409b-8652-c67b4cc946ba req-15d5b474-2d44-42f2-9d02-14213d17cf28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a63e07-f3ee-430a-83dd-ad8f36d575ce", "name": "network-vif-deleted", "tag": "b694a068-c575-43b8-8e89-38fd155d1879"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:33:03.085039 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-a603cb4c-2f00-409b-8652-c67b4cc946ba req-15d5b474-2d44-42f2-9d02-14213d17cf28 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:03.088709 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-a603cb4c-2f00-409b-8652-c67b4cc946ba req-15d5b474-2d44-42f2-9d02-14213d17cf28 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:03.105545 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-a603cb4c-2f00-409b-8652-c67b4cc946ba req-15d5b474-2d44-42f2-9d02-14213d17cf28 service nova] Creating event network-vif-deleted:b694a068-c575-43b8-8e89-38fd155d1879 for instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce on n-h1-846466-12 Aug 04 17:33:03.111770 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-a603cb4c-2f00-409b-8652-c67b4cc946ba req-15d5b474-2d44-42f2-9d02-14213d17cf28 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070227 Aug 04 17:33:03.114613 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3335/6561] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:33:03.838188 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ee8708da-5cde-447b-8199-6f98a6a6b12f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:03.839066 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ee8708da-5cde-447b-8199-6f98a6a6b12f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:03.843775 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:33:03.848406 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ee8708da-5cde-447b-8199-6f98a6a6b12f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:03.849026 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ee8708da-5cde-447b-8199-6f98a6a6b12f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:03.850174 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ee8708da-5cde-447b-8199-6f98a6a6b12f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:03.850640 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ee8708da-5cde-447b-8199-6f98a6a6b12f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:03.928120 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ee8708da-5cde-447b-8199-6f98a6a6b12f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:03.938445 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ee8708da-5cde-447b-8199-6f98a6a6b12f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1369 microversion: 2.1 time: 0.105986 Aug 04 17:33:03.953364 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3227/6562] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:03 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1369 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:04.963171 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e0bdeca7-bd33-4b8f-93cf-ba7d6f50cc21 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:04.964018 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e0bdeca7-bd33-4b8f-93cf-ba7d6f50cc21 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:04.966168 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:33:04.972253 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e0bdeca7-bd33-4b8f-93cf-ba7d6f50cc21 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:04.972699 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e0bdeca7-bd33-4b8f-93cf-ba7d6f50cc21 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:04.973519 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e0bdeca7-bd33-4b8f-93cf-ba7d6f50cc21 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:04.973971 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e0bdeca7-bd33-4b8f-93cf-ba7d6f50cc21 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:05.042217 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e0bdeca7-bd33-4b8f-93cf-ba7d6f50cc21 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:05.050871 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e0bdeca7-bd33-4b8f-93cf-ba7d6f50cc21 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1369 microversion: 2.1 time: 0.093652 Aug 04 17:33:05.051477 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3336/6563] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:04 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:06.072759 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-52acde56-b305-4c63-a243-db4f1609366e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:06.073384 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-52acde56-b305-4c63-a243-db4f1609366e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:06.081156 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-52acde56-b305-4c63-a243-db4f1609366e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:06.081665 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-52acde56-b305-4c63-a243-db4f1609366e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:06.082449 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-52acde56-b305-4c63-a243-db4f1609366e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:06.082886 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-52acde56-b305-4c63-a243-db4f1609366e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:06.158851 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-52acde56-b305-4c63-a243-db4f1609366e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:06.168671 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-52acde56-b305-4c63-a243-db4f1609366e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1369 microversion: 2.1 time: 0.100286 Aug 04 17:33:06.169810 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3228/6564] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:06 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:07.190550 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9c6b9b67-ae47-4abd-a8f7-82d799d93c66 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:07.191132 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9c6b9b67-ae47-4abd-a8f7-82d799d93c66 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:07.202819 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c6b9b67-ae47-4abd-a8f7-82d799d93c66 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:07.203299 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c6b9b67-ae47-4abd-a8f7-82d799d93c66 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:07.204072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c6b9b67-ae47-4abd-a8f7-82d799d93c66 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:07.204504 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c6b9b67-ae47-4abd-a8f7-82d799d93c66 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:07.275161 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9c6b9b67-ae47-4abd-a8f7-82d799d93c66 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d0aebe00643899de4edd08345e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa3479e48da461eb31ba242143690c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:07.284147 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9c6b9b67-ae47-4abd-a8f7-82d799d93c66 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 200 len: 1369 microversion: 2.1 time: 0.097550 Aug 04 17:33:07.284978 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3337/6565] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:07 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:08.306776 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2833db98-d1fa-4419-b17b-9b07a848a736 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:08.307431 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2833db98-d1fa-4419-b17b-9b07a848a736 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:08.315067 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2833db98-d1fa-4419-b17b-9b07a848a736 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:08.315508 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2833db98-d1fa-4419-b17b-9b07a848a736 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:08.316297 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2833db98-d1fa-4419-b17b-9b07a848a736 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:08.316738 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2833db98-d1fa-4419-b17b-9b07a848a736 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-2833db98-d1fa-4419-b17b-9b07a848a736 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] HTTP exception thrown: Instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce could not be found. Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2833db98-d1fa-4419-b17b-9b07a848a736 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Request method failure captured: Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce HTTP/1.1 Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi7AFiltLP9EvcwVpFCa2h6tq19pMq_32JMtbXN51DOjApDm4jayRdzcaHrSSvhfA_fIVFHE8QZgkPi4lki3zEP2UZCg1aFWM1RMSCACgdYoFYi89kiTnRN1cdwnfZRtBXt50OfsjmdprRxr5_GXWBGj1IhGtf3jvIm_b3rzVGsscSyQY Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 9fa3479e48da461eb31ba242143690c6 Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServerActionsTestJSON-75947691 Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fa3479e48da461eb31ba242143690c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9fa3479e48da461eb31ba242143690c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fa3479e48da461eb31ba242143690c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9fa3479e48da461eb31ba242143690c6"}]}] Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServerActionsTestJSON-75947691 Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 9fa3479e48da461eb31ba242143690c6 Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServerActionsTestJSON-75947691 Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServerActionsTestJSON-75947691-project Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: dd0d0aebe00643899de4edd08345e3fd Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServerActionsTestJSON-75947691-project Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce could not be found. Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '75a63e07-f3ee-430a-83dd-ad8f36d575ce'} Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce could not be found. Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:33:08.338362 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:33:08.344373 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce could not be found. Aug 04 17:33:08.344373 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:08.344373 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:08.344373 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:08.344373 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:08.344373 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:08.344373 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:08.344373 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:33:08.344373 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:33:08.344373 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce could not be found. Aug 04 17:33:08.344373 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:08.344373 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2833db98-d1fa-4419-b17b-9b07a848a736 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Returning 404 to user: Instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:33:08.344373 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2833db98-d1fa-4419-b17b-9b07a848a736 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 404 len: 111 microversion: 2.1 time: 0.033493 Aug 04 17:33:08.344373 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3229/6566] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:08 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:33:08.398321 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-48c7b8e1-2a5d-43c1-9b16-73f7c0ba9689 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:08.400540 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-48c7b8e1-2a5d-43c1-9b16-73f7c0ba9689 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:08.408246 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-48c7b8e1-2a5d-43c1-9b16-73f7c0ba9689 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:08.408696 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-48c7b8e1-2a5d-43c1-9b16-73f7c0ba9689 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:08.409523 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-48c7b8e1-2a5d-43c1-9b16-73f7c0ba9689 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:08.410068 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-48c7b8e1-2a5d-43c1-9b16-73f7c0ba9689 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:08.426065 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-48c7b8e1-2a5d-43c1-9b16-73f7c0ba9689 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] HTTP exception thrown: Instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce could not be found. Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-48c7b8e1-2a5d-43c1-9b16-73f7c0ba9689 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Request method failure captured: Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce/os-volume_attachments HTTP/1.1 Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi7AFiltLP9EvcwVpFCa2h6tq19pMq_32JMtbXN51DOjApDm4jayRdzcaHrSSvhfA_fIVFHE8QZgkPi4lki3zEP2UZCg1aFWM1RMSCACgdYoFYi89kiTnRN1cdwnfZRtBXt50OfsjmdprRxr5_GXWBGj1IhGtf3jvIm_b3rzVGsscSyQY Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 9fa3479e48da461eb31ba242143690c6 Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerActionsTestJSON-75947691 Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fa3479e48da461eb31ba242143690c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9fa3479e48da461eb31ba242143690c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fa3479e48da461eb31ba242143690c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9fa3479e48da461eb31ba242143690c6"}]}] Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerActionsTestJSON-75947691 Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 9fa3479e48da461eb31ba242143690c6 Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerActionsTestJSON-75947691 Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerActionsTestJSON-75947691-project Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: dd0d0aebe00643899de4edd08345e3fd Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerActionsTestJSON-75947691-project Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce could not be found. Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'server_id': '75a63e07-f3ee-430a-83dd-ad8f36d575ce'} Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce could not be found. Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:33:08.427813 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:33:08.433831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce could not be found. Aug 04 17:33:08.433831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:08.433831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:08.433831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:08.433831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:08.433831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:08.433831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:08.433831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:33:08.433831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:33:08.433831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce could not be found. Aug 04 17:33:08.433831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:08.433831 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-48c7b8e1-2a5d-43c1-9b16-73f7c0ba9689 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Returning 404 to user: Instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:33:08.433831 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-48c7b8e1-2a5d-43c1-9b16-73f7c0ba9689 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035824 Aug 04 17:33:08.433831 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3338/6567] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:33:08 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:33:11.787995 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-42181458-0c76-41ce-bb4a-59c525c420f2 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:11.788594 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-42181458-0c76-41ce-bb4a-59c525c420f2 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:11.796794 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-42181458-0c76-41ce-bb4a-59c525c420f2 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:11.797254 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-42181458-0c76-41ce-bb4a-59c525c420f2 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:11.798070 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-42181458-0c76-41ce-bb4a-59c525c420f2 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:11.798513 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-42181458-0c76-41ce-bb4a-59c525c420f2 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:11.813321 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-42181458-0c76-41ce-bb4a-59c525c420f2 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] HTTP exception thrown: Instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce could not be found. Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-42181458-0c76-41ce-bb4a-59c525c420f2 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Request method failure captured: Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce HTTP/1.1 Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi7AFiltLP9EvcwVpFCa2h6tq19pMq_32JMtbXN51DOjApDm4jayRdzcaHrSSvhfA_fIVFHE8QZgkPi4lki3zEP2UZCg1aFWM1RMSCACgdYoFYi89kiTnRN1cdwnfZRtBXt50OfsjmdprRxr5_GXWBGj1IhGtf3jvIm_b3rzVGsscSyQY Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 9fa3479e48da461eb31ba242143690c6 Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServerActionsTestJSON-75947691 Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fa3479e48da461eb31ba242143690c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9fa3479e48da461eb31ba242143690c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fa3479e48da461eb31ba242143690c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9fa3479e48da461eb31ba242143690c6"}]}] Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServerActionsTestJSON-75947691 Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 9fa3479e48da461eb31ba242143690c6 Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServerActionsTestJSON-75947691 Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServerActionsTestJSON-75947691-project Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: dd0d0aebe00643899de4edd08345e3fd Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServerActionsTestJSON-75947691-project Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce could not be found. Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '75a63e07-f3ee-430a-83dd-ad8f36d575ce'} Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce could not be found. Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:33:11.814844 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:33:11.820762 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce could not be found. Aug 04 17:33:11.820762 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:11.820762 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:11.820762 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:11.820762 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:11.820762 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:11.820762 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:11.820762 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:33:11.820762 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:33:11.820762 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce could not be found. Aug 04 17:33:11.820762 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:11.820762 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-42181458-0c76-41ce-bb4a-59c525c420f2 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Returning 404 to user: Instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:33:11.820762 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-42181458-0c76-41ce-bb4a-59c525c420f2 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "DELETE /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 404 len: 111 microversion: 2.1 time: 0.032326 Aug 04 17:33:11.820762 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3230/6568] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:33:11 2022] DELETE /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:33:11.826576 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-04cab3c2-ea7b-4fae-96bc-be7c171198c6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:11.827502 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-04cab3c2-ea7b-4fae-96bc-be7c171198c6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 75a63e07-f3ee-430a-83dd-ad8f36d575ce] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:11.836222 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-04cab3c2-ea7b-4fae-96bc-be7c171198c6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:11.836756 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-04cab3c2-ea7b-4fae-96bc-be7c171198c6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:11.837842 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-04cab3c2-ea7b-4fae-96bc-be7c171198c6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:11.838364 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-04cab3c2-ea7b-4fae-96bc-be7c171198c6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:11.853973 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-04cab3c2-ea7b-4fae-96bc-be7c171198c6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] HTTP exception thrown: Instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce could not be found. Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-04cab3c2-ea7b-4fae-96bc-be7c171198c6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Request method failure captured: Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce HTTP/1.1 Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi7AFiltLP9EvcwVpFCa2h6tq19pMq_32JMtbXN51DOjApDm4jayRdzcaHrSSvhfA_fIVFHE8QZgkPi4lki3zEP2UZCg1aFWM1RMSCACgdYoFYi89kiTnRN1cdwnfZRtBXt50OfsjmdprRxr5_GXWBGj1IhGtf3jvIm_b3rzVGsscSyQY Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 9fa3479e48da461eb31ba242143690c6 Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerActionsTestJSON-75947691 Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fa3479e48da461eb31ba242143690c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9fa3479e48da461eb31ba242143690c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fa3479e48da461eb31ba242143690c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9fa3479e48da461eb31ba242143690c6"}]}] Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerActionsTestJSON-75947691 Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 9fa3479e48da461eb31ba242143690c6 Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerActionsTestJSON-75947691 Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerActionsTestJSON-75947691-project Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: dd0d0aebe00643899de4edd08345e3fd Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerActionsTestJSON-75947691-project Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce could not be found. Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '75a63e07-f3ee-430a-83dd-ad8f36d575ce'} Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce could not be found. Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce could not be found. Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:11.855688 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:11.861413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:11.861413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:11.861413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:11.861413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:33:11.861413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:33:11.861413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce could not be found. Aug 04 17:33:11.861413 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:11.861413 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-04cab3c2-ea7b-4fae-96bc-be7c171198c6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Returning 404 to user: Instance 75a63e07-f3ee-430a-83dd-ad8f36d575ce could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:33:11.861413 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-04cab3c2-ea7b-4fae-96bc-be7c171198c6 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce" status: 404 len: 111 microversion: 2.1 time: 0.035592 Aug 04 17:33:11.861413 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3339/6569] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:11 2022] GET /compute/v2.1/servers/75a63e07-f3ee-430a-83dd-ad8f36d575ce => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:33:11.868587 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f45f8a52-c814-4ca6-afac-98b8d821f601 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:11.869096 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f45f8a52-c814-4ca6-afac-98b8d821f601 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:11.875907 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f45f8a52-c814-4ca6-afac-98b8d821f601 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:11.876373 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f45f8a52-c814-4ca6-afac-98b8d821f601 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:11.877156 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f45f8a52-c814-4ca6-afac-98b8d821f601 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:11.877639 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f45f8a52-c814-4ca6-afac-98b8d821f601 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:11.893318 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-f45f8a52-c814-4ca6-afac-98b8d821f601 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] HTTP exception thrown: Instance 786b5805-feed-4d1c-99fe-c6e1407e30e4 could not be found. Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f45f8a52-c814-4ca6-afac-98b8d821f601 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Request method failure captured: Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 HTTP/1.1 Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi7AFiltLP9EvcwVpFCa2h6tq19pMq_32JMtbXN51DOjApDm4jayRdzcaHrSSvhfA_fIVFHE8QZgkPi4lki3zEP2UZCg1aFWM1RMSCACgdYoFYi89kiTnRN1cdwnfZRtBXt50OfsjmdprRxr5_GXWBGj1IhGtf3jvIm_b3rzVGsscSyQY Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 9fa3479e48da461eb31ba242143690c6 Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServerActionsTestJSON-75947691 Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fa3479e48da461eb31ba242143690c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9fa3479e48da461eb31ba242143690c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fa3479e48da461eb31ba242143690c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9fa3479e48da461eb31ba242143690c6"}]}] Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServerActionsTestJSON-75947691 Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 9fa3479e48da461eb31ba242143690c6 Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServerActionsTestJSON-75947691 Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServerActionsTestJSON-75947691-project Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: dd0d0aebe00643899de4edd08345e3fd Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServerActionsTestJSON-75947691-project Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 786b5805-feed-4d1c-99fe-c6e1407e30e4 could not be found. Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '786b5805-feed-4d1c-99fe-c6e1407e30e4'} Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 786b5805-feed-4d1c-99fe-c6e1407e30e4 could not be found. Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:33:11.895076 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:33:11.901329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 786b5805-feed-4d1c-99fe-c6e1407e30e4 could not be found. Aug 04 17:33:11.901329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:11.901329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:11.901329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:11.901329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:11.901329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:11.901329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:11.901329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:33:11.901329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:33:11.901329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 786b5805-feed-4d1c-99fe-c6e1407e30e4 could not be found. Aug 04 17:33:11.901329 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:11.901329 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f45f8a52-c814-4ca6-afac-98b8d821f601 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Returning 404 to user: Instance 786b5805-feed-4d1c-99fe-c6e1407e30e4 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:33:11.901329 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f45f8a52-c814-4ca6-afac-98b8d821f601 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "DELETE /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 404 len: 111 microversion: 2.1 time: 0.032205 Aug 04 17:33:11.901329 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3231/6570] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:33:11 2022] DELETE /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:33:11.906050 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-02bc1376-0c0f-4542-b9ab-4fdc8e12a1f9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:11.906665 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-02bc1376-0c0f-4542-b9ab-4fdc8e12a1f9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 786b5805-feed-4d1c-99fe-c6e1407e30e4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:11.913075 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02bc1376-0c0f-4542-b9ab-4fdc8e12a1f9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:11.913714 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02bc1376-0c0f-4542-b9ab-4fdc8e12a1f9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:11.914638 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02bc1376-0c0f-4542-b9ab-4fdc8e12a1f9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:11.915068 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02bc1376-0c0f-4542-b9ab-4fdc8e12a1f9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:11.929136 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-02bc1376-0c0f-4542-b9ab-4fdc8e12a1f9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] HTTP exception thrown: Instance 786b5805-feed-4d1c-99fe-c6e1407e30e4 could not be found. Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-02bc1376-0c0f-4542-b9ab-4fdc8e12a1f9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Request method failure captured: Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 HTTP/1.1 Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi7AFiltLP9EvcwVpFCa2h6tq19pMq_32JMtbXN51DOjApDm4jayRdzcaHrSSvhfA_fIVFHE8QZgkPi4lki3zEP2UZCg1aFWM1RMSCACgdYoFYi89kiTnRN1cdwnfZRtBXt50OfsjmdprRxr5_GXWBGj1IhGtf3jvIm_b3rzVGsscSyQY Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 9fa3479e48da461eb31ba242143690c6 Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerActionsTestJSON-75947691 Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fa3479e48da461eb31ba242143690c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9fa3479e48da461eb31ba242143690c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fa3479e48da461eb31ba242143690c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9fa3479e48da461eb31ba242143690c6"}]}] Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerActionsTestJSON-75947691 Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 9fa3479e48da461eb31ba242143690c6 Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerActionsTestJSON-75947691 Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerActionsTestJSON-75947691-project Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: dd0d0aebe00643899de4edd08345e3fd Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerActionsTestJSON-75947691-project Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 786b5805-feed-4d1c-99fe-c6e1407e30e4 could not be found. Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '786b5805-feed-4d1c-99fe-c6e1407e30e4'} Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 786b5805-feed-4d1c-99fe-c6e1407e30e4 could not be found. Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 786b5805-feed-4d1c-99fe-c6e1407e30e4 could not be found. Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:11.930908 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:11.937030 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:11.937030 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:11.937030 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:11.937030 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:33:11.937030 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:33:11.937030 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 786b5805-feed-4d1c-99fe-c6e1407e30e4 could not be found. Aug 04 17:33:11.937030 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:11.937030 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-02bc1376-0c0f-4542-b9ab-4fdc8e12a1f9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Returning 404 to user: Instance 786b5805-feed-4d1c-99fe-c6e1407e30e4 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:33:11.937030 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-02bc1376-0c0f-4542-b9ab-4fdc8e12a1f9 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4" status: 404 len: 111 microversion: 2.1 time: 0.030328 Aug 04 17:33:11.937030 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3340/6571] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:11 2022] GET /compute/v2.1/servers/786b5805-feed-4d1c-99fe-c6e1407e30e4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:33:11.941252 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-22b877e2-dd56-4314-b723-3d3c2ad1d676 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:11.941857 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-22b877e2-dd56-4314-b723-3d3c2ad1d676 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:11.949010 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-22b877e2-dd56-4314-b723-3d3c2ad1d676 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:11.949497 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-22b877e2-dd56-4314-b723-3d3c2ad1d676 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:11.950291 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-22b877e2-dd56-4314-b723-3d3c2ad1d676 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:11.950735 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-22b877e2-dd56-4314-b723-3d3c2ad1d676 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:11.965788 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-22b877e2-dd56-4314-b723-3d3c2ad1d676 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] HTTP exception thrown: Instance f5a493ec-0c95-4de8-b936-c1ca011c7e64 could not be found. Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-22b877e2-dd56-4314-b723-3d3c2ad1d676 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Request method failure captured: Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 HTTP/1.1 Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi7AFiltLP9EvcwVpFCa2h6tq19pMq_32JMtbXN51DOjApDm4jayRdzcaHrSSvhfA_fIVFHE8QZgkPi4lki3zEP2UZCg1aFWM1RMSCACgdYoFYi89kiTnRN1cdwnfZRtBXt50OfsjmdprRxr5_GXWBGj1IhGtf3jvIm_b3rzVGsscSyQY Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 9fa3479e48da461eb31ba242143690c6 Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServerActionsTestJSON-75947691 Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fa3479e48da461eb31ba242143690c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9fa3479e48da461eb31ba242143690c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fa3479e48da461eb31ba242143690c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9fa3479e48da461eb31ba242143690c6"}]}] Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServerActionsTestJSON-75947691 Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 9fa3479e48da461eb31ba242143690c6 Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServerActionsTestJSON-75947691 Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServerActionsTestJSON-75947691-project Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: dd0d0aebe00643899de4edd08345e3fd Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServerActionsTestJSON-75947691-project Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance f5a493ec-0c95-4de8-b936-c1ca011c7e64 could not be found. Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'f5a493ec-0c95-4de8-b936-c1ca011c7e64'} Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5a493ec-0c95-4de8-b936-c1ca011c7e64 could not be found. Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:33:11.967428 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:33:11.973480 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5a493ec-0c95-4de8-b936-c1ca011c7e64 could not be found. Aug 04 17:33:11.973480 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:11.973480 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:11.973480 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:11.973480 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:11.973480 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:11.973480 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:11.973480 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:33:11.973480 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:33:11.973480 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5a493ec-0c95-4de8-b936-c1ca011c7e64 could not be found. Aug 04 17:33:11.973480 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:11.973480 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-22b877e2-dd56-4314-b723-3d3c2ad1d676 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Returning 404 to user: Instance f5a493ec-0c95-4de8-b936-c1ca011c7e64 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:33:11.973480 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-22b877e2-dd56-4314-b723-3d3c2ad1d676 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 404 len: 111 microversion: 2.1 time: 0.031715 Aug 04 17:33:11.973480 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3232/6572] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:33:11 2022] DELETE /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:33:11.979920 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c886424f-3762-438f-8bfe-92a9efa2be0f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:11.980676 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c886424f-3762-438f-8bfe-92a9efa2be0f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: f5a493ec-0c95-4de8-b936-c1ca011c7e64] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:11.988092 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c886424f-3762-438f-8bfe-92a9efa2be0f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:11.988536 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c886424f-3762-438f-8bfe-92a9efa2be0f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:11.989407 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c886424f-3762-438f-8bfe-92a9efa2be0f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:11.989848 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c886424f-3762-438f-8bfe-92a9efa2be0f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:12.009363 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-c886424f-3762-438f-8bfe-92a9efa2be0f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] HTTP exception thrown: Instance f5a493ec-0c95-4de8-b936-c1ca011c7e64 could not be found. Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c886424f-3762-438f-8bfe-92a9efa2be0f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Request method failure captured: Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 HTTP/1.1 Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi7AFiltLP9EvcwVpFCa2h6tq19pMq_32JMtbXN51DOjApDm4jayRdzcaHrSSvhfA_fIVFHE8QZgkPi4lki3zEP2UZCg1aFWM1RMSCACgdYoFYi89kiTnRN1cdwnfZRtBXt50OfsjmdprRxr5_GXWBGj1IhGtf3jvIm_b3rzVGsscSyQY Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 9fa3479e48da461eb31ba242143690c6 Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerActionsTestJSON-75947691 Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fa3479e48da461eb31ba242143690c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9fa3479e48da461eb31ba242143690c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fa3479e48da461eb31ba242143690c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9fa3479e48da461eb31ba242143690c6"}]}] Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerActionsTestJSON-75947691 Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 9fa3479e48da461eb31ba242143690c6 Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerActionsTestJSON-75947691 Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerActionsTestJSON-75947691-project Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: dd0d0aebe00643899de4edd08345e3fd Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerActionsTestJSON-75947691-project Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance f5a493ec-0c95-4de8-b936-c1ca011c7e64 could not be found. Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'f5a493ec-0c95-4de8-b936-c1ca011c7e64'} Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5a493ec-0c95-4de8-b936-c1ca011c7e64 could not be found. Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5a493ec-0c95-4de8-b936-c1ca011c7e64 could not be found. Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:12.011068 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:12.017100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:12.017100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:12.017100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:12.017100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:33:12.017100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:33:12.017100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5a493ec-0c95-4de8-b936-c1ca011c7e64 could not be found. Aug 04 17:33:12.017100 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:12.017100 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c886424f-3762-438f-8bfe-92a9efa2be0f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Returning 404 to user: Instance f5a493ec-0c95-4de8-b936-c1ca011c7e64 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:33:12.017100 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c886424f-3762-438f-8bfe-92a9efa2be0f tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64" status: 404 len: 111 microversion: 2.1 time: 0.036907 Aug 04 17:33:12.017100 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3341/6573] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:11 2022] GET /compute/v2.1/servers/f5a493ec-0c95-4de8-b936-c1ca011c7e64 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:33:12.021564 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-78694ecd-ea49-4308-a485-a176c7008a3e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:12.022086 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-78694ecd-ea49-4308-a485-a176c7008a3e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:12.038718 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-78694ecd-ea49-4308-a485-a176c7008a3e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:12.039485 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-78694ecd-ea49-4308-a485-a176c7008a3e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:12.040301 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-78694ecd-ea49-4308-a485-a176c7008a3e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:12.040753 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-78694ecd-ea49-4308-a485-a176c7008a3e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:12.056596 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-78694ecd-ea49-4308-a485-a176c7008a3e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] HTTP exception thrown: Instance 3b549cf7-cc44-4762-809c-08bcbb81e620 could not be found. Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-78694ecd-ea49-4308-a485-a176c7008a3e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Request method failure captured: Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 HTTP/1.1 Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi7AFiltLP9EvcwVpFCa2h6tq19pMq_32JMtbXN51DOjApDm4jayRdzcaHrSSvhfA_fIVFHE8QZgkPi4lki3zEP2UZCg1aFWM1RMSCACgdYoFYi89kiTnRN1cdwnfZRtBXt50OfsjmdprRxr5_GXWBGj1IhGtf3jvIm_b3rzVGsscSyQY Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 9fa3479e48da461eb31ba242143690c6 Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServerActionsTestJSON-75947691 Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fa3479e48da461eb31ba242143690c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9fa3479e48da461eb31ba242143690c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fa3479e48da461eb31ba242143690c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9fa3479e48da461eb31ba242143690c6"}]}] Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServerActionsTestJSON-75947691 Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 9fa3479e48da461eb31ba242143690c6 Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServerActionsTestJSON-75947691 Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServerActionsTestJSON-75947691-project Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: dd0d0aebe00643899de4edd08345e3fd Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServerActionsTestJSON-75947691-project Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 3b549cf7-cc44-4762-809c-08bcbb81e620 could not be found. Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '3b549cf7-cc44-4762-809c-08bcbb81e620'} Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b549cf7-cc44-4762-809c-08bcbb81e620 could not be found. Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:33:12.058160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:33:12.063654 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b549cf7-cc44-4762-809c-08bcbb81e620 could not be found. Aug 04 17:33:12.063654 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:12.063654 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:12.063654 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:12.063654 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:12.063654 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:12.063654 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:12.063654 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:33:12.063654 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:33:12.063654 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b549cf7-cc44-4762-809c-08bcbb81e620 could not be found. Aug 04 17:33:12.063654 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:12.063654 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-78694ecd-ea49-4308-a485-a176c7008a3e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Returning 404 to user: Instance 3b549cf7-cc44-4762-809c-08bcbb81e620 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:33:12.063654 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-78694ecd-ea49-4308-a485-a176c7008a3e tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 404 len: 111 microversion: 2.1 time: 0.042211 Aug 04 17:33:12.063654 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3233/6574] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:33:12 2022] DELETE /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:33:12.068347 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-93aacb90-00df-4b49-a623-69919b368444 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:12.068968 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-93aacb90-00df-4b49-a623-69919b368444 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] [instance: 3b549cf7-cc44-4762-809c-08bcbb81e620] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:12.076230 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-93aacb90-00df-4b49-a623-69919b368444 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:12.076696 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-93aacb90-00df-4b49-a623-69919b368444 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:12.077511 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-93aacb90-00df-4b49-a623-69919b368444 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:12.077946 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-93aacb90-00df-4b49-a623-69919b368444 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:12.093626 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-93aacb90-00df-4b49-a623-69919b368444 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] HTTP exception thrown: Instance 3b549cf7-cc44-4762-809c-08bcbb81e620 could not be found. Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-93aacb90-00df-4b49-a623-69919b368444 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Request method failure captured: Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 HTTP/1.1 Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi7AFiltLP9EvcwVpFCa2h6tq19pMq_32JMtbXN51DOjApDm4jayRdzcaHrSSvhfA_fIVFHE8QZgkPi4lki3zEP2UZCg1aFWM1RMSCACgdYoFYi89kiTnRN1cdwnfZRtBXt50OfsjmdprRxr5_GXWBGj1IhGtf3jvIm_b3rzVGsscSyQY Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 9fa3479e48da461eb31ba242143690c6 Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServerActionsTestJSON-75947691 Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fa3479e48da461eb31ba242143690c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9fa3479e48da461eb31ba242143690c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fa3479e48da461eb31ba242143690c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9fa3479e48da461eb31ba242143690c6"}]}] Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServerActionsTestJSON-75947691 Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 9fa3479e48da461eb31ba242143690c6 Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServerActionsTestJSON-75947691 Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServerActionsTestJSON-75947691-project Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: dd0d0aebe00643899de4edd08345e3fd Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServerActionsTestJSON-75947691-project Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 3b549cf7-cc44-4762-809c-08bcbb81e620 could not be found. Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '3b549cf7-cc44-4762-809c-08bcbb81e620'} Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b549cf7-cc44-4762-809c-08bcbb81e620 could not be found. Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b549cf7-cc44-4762-809c-08bcbb81e620 could not be found. Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:12.095204 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:12.100963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:12.100963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:12.100963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:12.100963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:33:12.100963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:33:12.100963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b549cf7-cc44-4762-809c-08bcbb81e620 could not be found. Aug 04 17:33:12.100963 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:12.100963 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-93aacb90-00df-4b49-a623-69919b368444 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Returning 404 to user: Instance 3b549cf7-cc44-4762-809c-08bcbb81e620 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:33:12.100963 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-93aacb90-00df-4b49-a623-69919b368444 tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620" status: 404 len: 111 microversion: 2.1 time: 0.032332 Aug 04 17:33:12.101929 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3342/6575] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:12 2022] GET /compute/v2.1/servers/3b549cf7-cc44-4762-809c-08bcbb81e620 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:33:12.107298 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7be1912a-3625-4c41-9b06-7754abe7112b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] Calling method '.version_select at 0x7f7e7440aca0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:12.133642 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7be1912a-3625-4c41-9b06-7754abe7112b tempest-ServerActionsTestJSON-75947691 tempest-ServerActionsTestJSON-75947691-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-495351782" status: 202 len: 0 microversion: 2.1 time: 0.030096 Aug 04 17:33:12.134246 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3234/6576] 10.222.0.23 () {58 vars in 1218 bytes} [Thu Aug 4 17:33:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-495351782 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:33:22.073584 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=13 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:33:22.082667 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=25 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:33:22.092173 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-15831029-4933-494a-8882-f76ef1ab65a9 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2105058192", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "3282cd37-3889-4afa-af4f-b95b0c544c40"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:33:22.154218 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-15831029-4933-494a-8882-f76ef1ab65a9 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] validate_networks() for [('3282cd37-3889-4afa-af4f-b95b0c544c40', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:33:22.683760 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-15831029-4933-494a-8882-f76ef1ab65a9 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:33:22.684193 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-15831029-4933-494a-8882-f76ef1ab65a9 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:33:22.684667 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-15831029-4933-494a-8882-f76ef1ab65a9 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:33:22.685072 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-15831029-4933-494a-8882-f76ef1ab65a9 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:33:22.685556 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-15831029-4933-494a-8882-f76ef1ab65a9 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:33:22.704737 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-15831029-4933-494a-8882-f76ef1ab65a9 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:22.705227 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-15831029-4933-494a-8882-f76ef1ab65a9 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:22.708265 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-15831029-4933-494a-8882-f76ef1ab65a9 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:22.708994 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-15831029-4933-494a-8882-f76ef1ab65a9 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:22.732769 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-15831029-4933-494a-8882-f76ef1ab65a9 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Getting quotas for project b26d0310fadb4e82be35e2fe70f912d4. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:33:22.742165 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-15831029-4933-494a-8882-f76ef1ab65a9 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Getting quotas for user 6752b6b8e596465c8a99ffd2179a2615 and project b26d0310fadb4e82be35e2fe70f912d4. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:33:22.763591 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-15831029-4933-494a-8882-f76ef1ab65a9 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:33:22.767289 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-15831029-4933-494a-8882-f76ef1ab65a9 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 070df37c-674d-4046-b428-c9a61845c1e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:33:22.819022 n-d-846466-12 devstack@n-api.service[126125]: ERROR oslo.messaging._drivers.impl_rabbit [None req-15831029-4933-494a-8882-f76ef1ab65a9 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [b042ee28-61dd-48b8-9569-21b30cd0d61a] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 17:33:23.828540 n-d-846466-12 devstack@n-api.service[126125]: INFO oslo.messaging._drivers.impl_rabbit [None req-15831029-4933-494a-8882-f76ef1ab65a9 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [b042ee28-61dd-48b8-9569-21b30cd0d61a] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 36790. Aug 04 17:33:23.833983 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-15831029-4933-494a-8882-f76ef1ab65a9 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.872167 Aug 04 17:33:23.835321 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3343/6577] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:33:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:33:23.844299 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=39 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:33:23.845676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:33:23.851405 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1f28becd-db6a-4fc0-9d0e-4813c827a829 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:23.851405 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1f28becd-db6a-4fc0-9d0e-4813c827a829 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 070df37c-674d-4046-b428-c9a61845c1e0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:23.910135 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1f28becd-db6a-4fc0-9d0e-4813c827a829 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6752b6b8e596465c8a99ffd2179a2615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26d0310fadb4e82be35e2fe70f912d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:23.925098 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1f28becd-db6a-4fc0-9d0e-4813c827a829 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0" status: 200 len: 1217 microversion: 2.1 time: 0.082274 Aug 04 17:33:23.926115 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3235/6578] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:23 2022] GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:24.947337 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-12ecb0c0-7bd8-4172-a3b5-ef2fa9eacbfe tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:24.948667 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-12ecb0c0-7bd8-4172-a3b5-ef2fa9eacbfe tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 070df37c-674d-4046-b428-c9a61845c1e0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:25.014617 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-12ecb0c0-7bd8-4172-a3b5-ef2fa9eacbfe tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6752b6b8e596465c8a99ffd2179a2615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26d0310fadb4e82be35e2fe70f912d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:25.025478 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-12ecb0c0-7bd8-4172-a3b5-ef2fa9eacbfe tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0" status: 200 len: 1217 microversion: 2.1 time: 0.083852 Aug 04 17:33:25.029932 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3344/6579] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:24 2022] GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0 => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:26.046371 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1fcef76f-1d4d-47b4-95bf-f8cb06e0a32c tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:26.047058 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1fcef76f-1d4d-47b4-95bf-f8cb06e0a32c tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 070df37c-674d-4046-b428-c9a61845c1e0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:26.108284 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1fcef76f-1d4d-47b4-95bf-f8cb06e0a32c tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6752b6b8e596465c8a99ffd2179a2615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26d0310fadb4e82be35e2fe70f912d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:26.115922 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1fcef76f-1d4d-47b4-95bf-f8cb06e0a32c tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0" status: 200 len: 1217 microversion: 2.1 time: 0.073468 Aug 04 17:33:26.116615 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3236/6580] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:26 2022] GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0 => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:33:27.137602 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-587e68e3-39b7-4560-befa-b66e0dbaf220 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:27.138313 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-587e68e3-39b7-4560-befa-b66e0dbaf220 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 070df37c-674d-4046-b428-c9a61845c1e0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:27.200235 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-587e68e3-39b7-4560-befa-b66e0dbaf220 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6752b6b8e596465c8a99ffd2179a2615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26d0310fadb4e82be35e2fe70f912d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:27.209669 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-587e68e3-39b7-4560-befa-b66e0dbaf220 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0" status: 200 len: 1217 microversion: 2.1 time: 0.075988 Aug 04 17:33:27.210871 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3345/6581] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:27 2022] GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0 => generated 1217 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:28.234655 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c4cb6c5a-ef76-43f1-bc5e-c1e7387be189 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:28.235439 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c4cb6c5a-ef76-43f1-bc5e-c1e7387be189 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 070df37c-674d-4046-b428-c9a61845c1e0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:28.247366 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4cb6c5a-ef76-43f1-bc5e-c1e7387be189 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:28.248139 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4cb6c5a-ef76-43f1-bc5e-c1e7387be189 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:28.249224 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4cb6c5a-ef76-43f1-bc5e-c1e7387be189 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:28.249701 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4cb6c5a-ef76-43f1-bc5e-c1e7387be189 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:28.320126 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c4cb6c5a-ef76-43f1-bc5e-c1e7387be189 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6752b6b8e596465c8a99ffd2179a2615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26d0310fadb4e82be35e2fe70f912d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:28.328155 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c4cb6c5a-ef76-43f1-bc5e-c1e7387be189 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0" status: 200 len: 1221 microversion: 2.1 time: 0.097476 Aug 04 17:33:28.328735 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3237/6582] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:28 2022] GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0 => generated 1221 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:29.349709 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6fc66364-83ec-4ec8-b168-0826ad9d937c tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:29.350324 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6fc66364-83ec-4ec8-b168-0826ad9d937c tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 070df37c-674d-4046-b428-c9a61845c1e0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:29.358543 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6fc66364-83ec-4ec8-b168-0826ad9d937c tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:29.358996 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6fc66364-83ec-4ec8-b168-0826ad9d937c tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:29.359799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6fc66364-83ec-4ec8-b168-0826ad9d937c tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:29.360234 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6fc66364-83ec-4ec8-b168-0826ad9d937c tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:29.433013 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6fc66364-83ec-4ec8-b168-0826ad9d937c tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6752b6b8e596465c8a99ffd2179a2615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26d0310fadb4e82be35e2fe70f912d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:29.441967 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6fc66364-83ec-4ec8-b168-0826ad9d937c tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0" status: 200 len: 1275 microversion: 2.1 time: 0.096195 Aug 04 17:33:29.442532 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3346/6583] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:29 2022] GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0 => generated 1275 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:30.464687 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-57695051-c7b8-4483-b144-37eb975751dc tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:30.465440 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-57695051-c7b8-4483-b144-37eb975751dc tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 070df37c-674d-4046-b428-c9a61845c1e0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:30.473312 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-57695051-c7b8-4483-b144-37eb975751dc tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:30.473749 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-57695051-c7b8-4483-b144-37eb975751dc tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:30.474572 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-57695051-c7b8-4483-b144-37eb975751dc tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:30.475015 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-57695051-c7b8-4483-b144-37eb975751dc tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:30.583523 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-0d48860e-00f5-4d7f-b11d-2f7e641e70ef req-36e86f6a-5cea-44c2-b211-a87f3c1bffaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "070df37c-674d-4046-b428-c9a61845c1e0", "tag": "2a03a958-944a-4106-88f9-95ab5c835897"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:33:30.605959 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-0d48860e-00f5-4d7f-b11d-2f7e641e70ef req-36e86f6a-5cea-44c2-b211-a87f3c1bffaa service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:30.606422 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-0d48860e-00f5-4d7f-b11d-2f7e641e70ef req-36e86f6a-5cea-44c2-b211-a87f3c1bffaa service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:30.620386 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-0d48860e-00f5-4d7f-b11d-2f7e641e70ef req-36e86f6a-5cea-44c2-b211-a87f3c1bffaa service nova] Creating event network-changed:2a03a958-944a-4106-88f9-95ab5c835897 for instance 070df37c-674d-4046-b428-c9a61845c1e0 on n-h1-846466-12 Aug 04 17:33:30.626709 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-0d48860e-00f5-4d7f-b11d-2f7e641e70ef req-36e86f6a-5cea-44c2-b211-a87f3c1bffaa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050032 Aug 04 17:33:30.627631 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3347/6584] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:33:30.720705 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-57695051-c7b8-4483-b144-37eb975751dc tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6752b6b8e596465c8a99ffd2179a2615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26d0310fadb4e82be35e2fe70f912d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:30.728934 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-57695051-c7b8-4483-b144-37eb975751dc tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0" status: 200 len: 1317 microversion: 2.1 time: 0.268297 Aug 04 17:33:30.729655 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3238/6585] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:30 2022] GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0 => generated 1317 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:31.751200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3c5ec68c-e26c-4f36-a579-557f2decc997 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:31.751908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3c5ec68c-e26c-4f36-a579-557f2decc997 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 070df37c-674d-4046-b428-c9a61845c1e0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:31.758911 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3c5ec68c-e26c-4f36-a579-557f2decc997 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:31.759361 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3c5ec68c-e26c-4f36-a579-557f2decc997 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:31.760138 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3c5ec68c-e26c-4f36-a579-557f2decc997 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:31.760573 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3c5ec68c-e26c-4f36-a579-557f2decc997 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:32.347496 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3c5ec68c-e26c-4f36-a579-557f2decc997 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6752b6b8e596465c8a99ffd2179a2615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26d0310fadb4e82be35e2fe70f912d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:32.356755 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3c5ec68c-e26c-4f36-a579-557f2decc997 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0" status: 200 len: 1317 microversion: 2.1 time: 0.610721 Aug 04 17:33:32.357410 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3348/6586] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:31 2022] GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0 => generated 1317 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:33.379090 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-053b6f08-b26f-4fd9-a2d0-a377278577a5 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:33.379722 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-053b6f08-b26f-4fd9-a2d0-a377278577a5 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 070df37c-674d-4046-b428-c9a61845c1e0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:33.387563 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-053b6f08-b26f-4fd9-a2d0-a377278577a5 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:33.388123 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-053b6f08-b26f-4fd9-a2d0-a377278577a5 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:33.388915 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-053b6f08-b26f-4fd9-a2d0-a377278577a5 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:33.389390 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-053b6f08-b26f-4fd9-a2d0-a377278577a5 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:33.527504 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-053b6f08-b26f-4fd9-a2d0-a377278577a5 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6752b6b8e596465c8a99ffd2179a2615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26d0310fadb4e82be35e2fe70f912d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:33.535650 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-053b6f08-b26f-4fd9-a2d0-a377278577a5 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0" status: 200 len: 1317 microversion: 2.1 time: 0.160512 Aug 04 17:33:33.536236 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3239/6587] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:33 2022] GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:34.563949 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a2b15a5f-ae78-462c-9dc4-71b31a162b97 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:34.564927 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a2b15a5f-ae78-462c-9dc4-71b31a162b97 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 070df37c-674d-4046-b428-c9a61845c1e0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:34.568300 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:33:34.578631 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a2b15a5f-ae78-462c-9dc4-71b31a162b97 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:34.579332 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a2b15a5f-ae78-462c-9dc4-71b31a162b97 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:34.580493 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a2b15a5f-ae78-462c-9dc4-71b31a162b97 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:34.581115 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a2b15a5f-ae78-462c-9dc4-71b31a162b97 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:34.732967 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a2b15a5f-ae78-462c-9dc4-71b31a162b97 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6752b6b8e596465c8a99ffd2179a2615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26d0310fadb4e82be35e2fe70f912d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:34.740871 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a2b15a5f-ae78-462c-9dc4-71b31a162b97 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0" status: 200 len: 1317 microversion: 2.1 time: 0.183622 Aug 04 17:33:34.741524 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3349/6588] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:34 2022] GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0 => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:35.763173 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b69fbeb7-07bd-455c-ae74-9b86346d74d1 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:35.763820 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b69fbeb7-07bd-455c-ae74-9b86346d74d1 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 070df37c-674d-4046-b428-c9a61845c1e0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:35.771316 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b69fbeb7-07bd-455c-ae74-9b86346d74d1 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:35.771768 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b69fbeb7-07bd-455c-ae74-9b86346d74d1 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:35.772893 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b69fbeb7-07bd-455c-ae74-9b86346d74d1 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:35.773363 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b69fbeb7-07bd-455c-ae74-9b86346d74d1 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:35.911909 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b69fbeb7-07bd-455c-ae74-9b86346d74d1 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6752b6b8e596465c8a99ffd2179a2615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26d0310fadb4e82be35e2fe70f912d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:35.920669 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b69fbeb7-07bd-455c-ae74-9b86346d74d1 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0" status: 200 len: 1317 microversion: 2.1 time: 0.161483 Aug 04 17:33:35.921259 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3240/6589] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:35 2022] GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:36.942520 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6e09cff5-ff71-4915-a909-26fdb5bd71d7 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:36.943252 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6e09cff5-ff71-4915-a909-26fdb5bd71d7 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 070df37c-674d-4046-b428-c9a61845c1e0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:36.953650 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6e09cff5-ff71-4915-a909-26fdb5bd71d7 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:36.954249 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6e09cff5-ff71-4915-a909-26fdb5bd71d7 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:36.955559 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6e09cff5-ff71-4915-a909-26fdb5bd71d7 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:36.956271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6e09cff5-ff71-4915-a909-26fdb5bd71d7 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:37.108348 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6e09cff5-ff71-4915-a909-26fdb5bd71d7 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6752b6b8e596465c8a99ffd2179a2615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26d0310fadb4e82be35e2fe70f912d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:37.116855 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6e09cff5-ff71-4915-a909-26fdb5bd71d7 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0" status: 200 len: 1317 microversion: 2.1 time: 0.178098 Aug 04 17:33:37.117982 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3350/6590] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:36 2022] GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0 => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:37.279169 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-f5783206-a388-4b05-a52e-6dbecf55a58a req-9bca97e2-42ab-43db-a647-e9205d117164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "070df37c-674d-4046-b428-c9a61845c1e0", "name": "network-vif-plugged", "status": "completed", "tag": "2a03a958-944a-4106-88f9-95ab5c835897"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:33:37.284821 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=4 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:33:37.292561 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f5783206-a388-4b05-a52e-6dbecf55a58a req-9bca97e2-42ab-43db-a647-e9205d117164 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:37.293147 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f5783206-a388-4b05-a52e-6dbecf55a58a req-9bca97e2-42ab-43db-a647-e9205d117164 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:37.306141 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-f5783206-a388-4b05-a52e-6dbecf55a58a req-9bca97e2-42ab-43db-a647-e9205d117164 service nova] Creating event network-vif-plugged:2a03a958-944a-4106-88f9-95ab5c835897 for instance 070df37c-674d-4046-b428-c9a61845c1e0 on n-h1-846466-12 Aug 04 17:33:37.311309 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-f5783206-a388-4b05-a52e-6dbecf55a58a req-9bca97e2-42ab-43db-a647-e9205d117164 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035928 Aug 04 17:33:37.311922 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3241/6591] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:33:38.138465 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-52ce3ec7-7a0a-4fc4-9d3b-95bb19a8e09b tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:38.139131 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-52ce3ec7-7a0a-4fc4-9d3b-95bb19a8e09b tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 070df37c-674d-4046-b428-c9a61845c1e0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:38.141109 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=10 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:33:38.150404 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-52ce3ec7-7a0a-4fc4-9d3b-95bb19a8e09b tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:38.151294 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-52ce3ec7-7a0a-4fc4-9d3b-95bb19a8e09b tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:38.152735 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-52ce3ec7-7a0a-4fc4-9d3b-95bb19a8e09b tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:38.153185 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-52ce3ec7-7a0a-4fc4-9d3b-95bb19a8e09b tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:38.311241 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-52ce3ec7-7a0a-4fc4-9d3b-95bb19a8e09b tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6752b6b8e596465c8a99ffd2179a2615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26d0310fadb4e82be35e2fe70f912d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:38.319244 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-52ce3ec7-7a0a-4fc4-9d3b-95bb19a8e09b tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0" status: 200 len: 1317 microversion: 2.1 time: 0.184891 Aug 04 17:33:38.319811 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3351/6592] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:38 2022] GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0 => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:39.343608 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-83d2ac62-3a98-4f16-8a52-600fe92b4680 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:39.344750 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-83d2ac62-3a98-4f16-8a52-600fe92b4680 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 070df37c-674d-4046-b428-c9a61845c1e0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:39.354290 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-83d2ac62-3a98-4f16-8a52-600fe92b4680 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:39.354984 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-83d2ac62-3a98-4f16-8a52-600fe92b4680 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:39.356061 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-83d2ac62-3a98-4f16-8a52-600fe92b4680 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:39.356823 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-83d2ac62-3a98-4f16-8a52-600fe92b4680 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:39.545015 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-83d2ac62-3a98-4f16-8a52-600fe92b4680 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6752b6b8e596465c8a99ffd2179a2615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26d0310fadb4e82be35e2fe70f912d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:39.558956 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-83d2ac62-3a98-4f16-8a52-600fe92b4680 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0" status: 200 len: 1506 microversion: 2.1 time: 0.222105 Aug 04 17:33:39.560123 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3242/6593] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:39 2022] GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0 => generated 1506 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:39.642018 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b02fd0dc-84c9-45c1-bedd-1bd53864f4bb tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1026454975", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "3282cd37-3889-4afa-af4f-b95b0c544c40"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:33:39.708760 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-b02fd0dc-84c9-45c1-bedd-1bd53864f4bb tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] validate_networks() for [('3282cd37-3889-4afa-af4f-b95b0c544c40', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:33:40.122508 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b02fd0dc-84c9-45c1-bedd-1bd53864f4bb tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:33:40.122925 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b02fd0dc-84c9-45c1-bedd-1bd53864f4bb tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:33:40.123398 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b02fd0dc-84c9-45c1-bedd-1bd53864f4bb tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:33:40.123795 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b02fd0dc-84c9-45c1-bedd-1bd53864f4bb tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:33:40.124221 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b02fd0dc-84c9-45c1-bedd-1bd53864f4bb tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:33:40.135558 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b02fd0dc-84c9-45c1-bedd-1bd53864f4bb tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:40.135992 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b02fd0dc-84c9-45c1-bedd-1bd53864f4bb tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:40.136787 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b02fd0dc-84c9-45c1-bedd-1bd53864f4bb tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:40.137215 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b02fd0dc-84c9-45c1-bedd-1bd53864f4bb tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:40.156424 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-b02fd0dc-84c9-45c1-bedd-1bd53864f4bb tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Getting quotas for project b26d0310fadb4e82be35e2fe70f912d4. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:33:40.162939 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-b02fd0dc-84c9-45c1-bedd-1bd53864f4bb tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Getting quotas for user 6752b6b8e596465c8a99ffd2179a2615 and project b26d0310fadb4e82be35e2fe70f912d4. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:33:40.176630 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b02fd0dc-84c9-45c1-bedd-1bd53864f4bb tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:33:40.179149 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b02fd0dc-84c9-45c1-bedd-1bd53864f4bb tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 04ab3b7d-97bf-4104-afe7-f6f016f2a825] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:33:40.230679 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b02fd0dc-84c9-45c1-bedd-1bd53864f4bb tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.592818 Aug 04 17:33:40.231639 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3352/6594] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:33:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 17:33:40.242857 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f3132e74-a142-4b56-b74b-77170baf24a2 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:40.243844 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f3132e74-a142-4b56-b74b-77170baf24a2 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 04ab3b7d-97bf-4104-afe7-f6f016f2a825] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:40.303219 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f3132e74-a142-4b56-b74b-77170baf24a2 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6752b6b8e596465c8a99ffd2179a2615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26d0310fadb4e82be35e2fe70f912d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:40.310674 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f3132e74-a142-4b56-b74b-77170baf24a2 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/04ab3b7d-97bf-4104-afe7-f6f016f2a825" status: 200 len: 1217 microversion: 2.1 time: 0.071879 Aug 04 17:33:40.311508 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3243/6595] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:40 2022] GET /compute/v2.1/servers/04ab3b7d-97bf-4104-afe7-f6f016f2a825 => generated 1217 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:41.336297 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-01db87bf-fb55-459d-b597-e675c15b9082 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:41.337401 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-01db87bf-fb55-459d-b597-e675c15b9082 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 04ab3b7d-97bf-4104-afe7-f6f016f2a825] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:41.354488 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-01db87bf-fb55-459d-b597-e675c15b9082 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:41.355993 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-01db87bf-fb55-459d-b597-e675c15b9082 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:41.357191 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-01db87bf-fb55-459d-b597-e675c15b9082 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:41.358758 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-01db87bf-fb55-459d-b597-e675c15b9082 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:41.441828 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-01db87bf-fb55-459d-b597-e675c15b9082 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6752b6b8e596465c8a99ffd2179a2615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26d0310fadb4e82be35e2fe70f912d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:41.451065 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-01db87bf-fb55-459d-b597-e675c15b9082 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/04ab3b7d-97bf-4104-afe7-f6f016f2a825" status: 200 len: 1277 microversion: 2.1 time: 0.122592 Aug 04 17:33:41.451676 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3353/6596] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:41 2022] GET /compute/v2.1/servers/04ab3b7d-97bf-4104-afe7-f6f016f2a825 => generated 1277 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:42.473223 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5a2e1efb-7437-48ea-be47-e1e6bcb8d08d tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:42.473848 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5a2e1efb-7437-48ea-be47-e1e6bcb8d08d tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 04ab3b7d-97bf-4104-afe7-f6f016f2a825] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:42.482664 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a2e1efb-7437-48ea-be47-e1e6bcb8d08d tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:42.483111 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a2e1efb-7437-48ea-be47-e1e6bcb8d08d tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:42.483916 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a2e1efb-7437-48ea-be47-e1e6bcb8d08d tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:42.484364 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a2e1efb-7437-48ea-be47-e1e6bcb8d08d tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:42.657001 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5a2e1efb-7437-48ea-be47-e1e6bcb8d08d tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6752b6b8e596465c8a99ffd2179a2615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26d0310fadb4e82be35e2fe70f912d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:42.665816 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5a2e1efb-7437-48ea-be47-e1e6bcb8d08d tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/04ab3b7d-97bf-4104-afe7-f6f016f2a825" status: 200 len: 1317 microversion: 2.1 time: 0.196907 Aug 04 17:33:42.666541 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3244/6597] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:42 2022] GET /compute/v2.1/servers/04ab3b7d-97bf-4104-afe7-f6f016f2a825 => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:42.914958 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-6c421646-555d-45aa-abdd-2044db9035bc req-be9e3c88-8e4b-4494-a668-57adbe2c1c82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04ab3b7d-97bf-4104-afe7-f6f016f2a825", "tag": "e4efd015-d65e-403f-a172-2f798ffc1d08"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:33:42.942923 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6c421646-555d-45aa-abdd-2044db9035bc req-be9e3c88-8e4b-4494-a668-57adbe2c1c82 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:42.943720 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6c421646-555d-45aa-abdd-2044db9035bc req-be9e3c88-8e4b-4494-a668-57adbe2c1c82 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:42.960232 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-6c421646-555d-45aa-abdd-2044db9035bc req-be9e3c88-8e4b-4494-a668-57adbe2c1c82 service nova] Creating event network-changed:e4efd015-d65e-403f-a172-2f798ffc1d08 for instance 04ab3b7d-97bf-4104-afe7-f6f016f2a825 on n-h2-846466-12 Aug 04 17:33:42.966026 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-6c421646-555d-45aa-abdd-2044db9035bc req-be9e3c88-8e4b-4494-a668-57adbe2c1c82 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056239 Aug 04 17:33:42.967300 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3354/6598] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:33:43.688017 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f80893e5-202c-43d5-8e9f-632e0af3fdb1 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:43.688713 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f80893e5-202c-43d5-8e9f-632e0af3fdb1 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 04ab3b7d-97bf-4104-afe7-f6f016f2a825] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:43.700019 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f80893e5-202c-43d5-8e9f-632e0af3fdb1 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:43.700505 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f80893e5-202c-43d5-8e9f-632e0af3fdb1 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:43.701427 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f80893e5-202c-43d5-8e9f-632e0af3fdb1 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:43.701883 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f80893e5-202c-43d5-8e9f-632e0af3fdb1 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:43.855410 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f80893e5-202c-43d5-8e9f-632e0af3fdb1 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6752b6b8e596465c8a99ffd2179a2615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26d0310fadb4e82be35e2fe70f912d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:43.864257 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f80893e5-202c-43d5-8e9f-632e0af3fdb1 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/04ab3b7d-97bf-4104-afe7-f6f016f2a825" status: 200 len: 1317 microversion: 2.1 time: 0.180158 Aug 04 17:33:43.864862 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3245/6599] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:43 2022] GET /compute/v2.1/servers/04ab3b7d-97bf-4104-afe7-f6f016f2a825 => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:33:44.889092 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-90ecda78-c097-4281-9cad-0b81dc504177 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:44.890426 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-90ecda78-c097-4281-9cad-0b81dc504177 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 04ab3b7d-97bf-4104-afe7-f6f016f2a825] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:44.904055 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-90ecda78-c097-4281-9cad-0b81dc504177 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:44.904795 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-90ecda78-c097-4281-9cad-0b81dc504177 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:44.906241 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-90ecda78-c097-4281-9cad-0b81dc504177 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:44.907024 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-90ecda78-c097-4281-9cad-0b81dc504177 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:45.081837 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-90ecda78-c097-4281-9cad-0b81dc504177 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6752b6b8e596465c8a99ffd2179a2615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26d0310fadb4e82be35e2fe70f912d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:45.090088 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-90ecda78-c097-4281-9cad-0b81dc504177 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/04ab3b7d-97bf-4104-afe7-f6f016f2a825" status: 200 len: 1317 microversion: 2.1 time: 0.208214 Aug 04 17:33:45.090678 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3355/6600] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:44 2022] GET /compute/v2.1/servers/04ab3b7d-97bf-4104-afe7-f6f016f2a825 => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:46.112887 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9bc934a0-8773-4a3c-9fb5-b020b9c71c7e tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:46.113821 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9bc934a0-8773-4a3c-9fb5-b020b9c71c7e tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 04ab3b7d-97bf-4104-afe7-f6f016f2a825] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:46.122022 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9bc934a0-8773-4a3c-9fb5-b020b9c71c7e tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:46.122581 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9bc934a0-8773-4a3c-9fb5-b020b9c71c7e tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:46.123370 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9bc934a0-8773-4a3c-9fb5-b020b9c71c7e tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:46.123806 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9bc934a0-8773-4a3c-9fb5-b020b9c71c7e tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:46.285829 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9bc934a0-8773-4a3c-9fb5-b020b9c71c7e tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6752b6b8e596465c8a99ffd2179a2615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26d0310fadb4e82be35e2fe70f912d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:46.299766 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9bc934a0-8773-4a3c-9fb5-b020b9c71c7e tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/04ab3b7d-97bf-4104-afe7-f6f016f2a825" status: 200 len: 1317 microversion: 2.1 time: 0.191502 Aug 04 17:33:46.300805 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3246/6601] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:46 2022] GET /compute/v2.1/servers/04ab3b7d-97bf-4104-afe7-f6f016f2a825 => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:47.322231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c2d552b4-51b5-4a51-8dba-72847ead7c09 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:47.322866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c2d552b4-51b5-4a51-8dba-72847ead7c09 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 04ab3b7d-97bf-4104-afe7-f6f016f2a825] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:47.333703 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2d552b4-51b5-4a51-8dba-72847ead7c09 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:47.334408 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2d552b4-51b5-4a51-8dba-72847ead7c09 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:47.335862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2d552b4-51b5-4a51-8dba-72847ead7c09 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:47.336554 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c2d552b4-51b5-4a51-8dba-72847ead7c09 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:47.504011 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c2d552b4-51b5-4a51-8dba-72847ead7c09 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6752b6b8e596465c8a99ffd2179a2615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26d0310fadb4e82be35e2fe70f912d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:47.512548 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c2d552b4-51b5-4a51-8dba-72847ead7c09 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/04ab3b7d-97bf-4104-afe7-f6f016f2a825" status: 200 len: 1317 microversion: 2.1 time: 0.194462 Aug 04 17:33:47.513146 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3356/6602] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:47 2022] GET /compute/v2.1/servers/04ab3b7d-97bf-4104-afe7-f6f016f2a825 => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:48.229118 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-60fdcfbb-083e-46bd-a4ea-5850882e498f req-cb180a03-e61c-4739-863c-5f003ae8269c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04ab3b7d-97bf-4104-afe7-f6f016f2a825", "name": "network-vif-plugged", "status": "completed", "tag": "e4efd015-d65e-403f-a172-2f798ffc1d08"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:33:48.246682 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-60fdcfbb-083e-46bd-a4ea-5850882e498f req-cb180a03-e61c-4739-863c-5f003ae8269c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:48.247202 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-60fdcfbb-083e-46bd-a4ea-5850882e498f req-cb180a03-e61c-4739-863c-5f003ae8269c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:48.269526 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-60fdcfbb-083e-46bd-a4ea-5850882e498f req-cb180a03-e61c-4739-863c-5f003ae8269c service nova] Creating event network-vif-plugged:e4efd015-d65e-403f-a172-2f798ffc1d08 for instance 04ab3b7d-97bf-4104-afe7-f6f016f2a825 on n-h2-846466-12 Aug 04 17:33:48.276521 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-60fdcfbb-083e-46bd-a4ea-5850882e498f req-cb180a03-e61c-4739-863c-5f003ae8269c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052158 Aug 04 17:33:48.277054 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3247/6603] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:33:48.535587 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9015cb49-ddd3-40b2-899b-6cc4d770fedd tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:48.536167 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9015cb49-ddd3-40b2-899b-6cc4d770fedd tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 04ab3b7d-97bf-4104-afe7-f6f016f2a825] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:48.543669 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9015cb49-ddd3-40b2-899b-6cc4d770fedd tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:48.544115 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9015cb49-ddd3-40b2-899b-6cc4d770fedd tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:48.544908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9015cb49-ddd3-40b2-899b-6cc4d770fedd tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:48.545370 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9015cb49-ddd3-40b2-899b-6cc4d770fedd tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:48.704733 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9015cb49-ddd3-40b2-899b-6cc4d770fedd tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6752b6b8e596465c8a99ffd2179a2615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26d0310fadb4e82be35e2fe70f912d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:48.714189 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9015cb49-ddd3-40b2-899b-6cc4d770fedd tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/04ab3b7d-97bf-4104-afe7-f6f016f2a825" status: 200 len: 1317 microversion: 2.1 time: 0.183246 Aug 04 17:33:48.714831 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3357/6604] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:48 2022] GET /compute/v2.1/servers/04ab3b7d-97bf-4104-afe7-f6f016f2a825 => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:49.736830 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f3f2fbc7-df8d-4b52-9a99-9aed23491a8d tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:49.737569 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f3f2fbc7-df8d-4b52-9a99-9aed23491a8d tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 04ab3b7d-97bf-4104-afe7-f6f016f2a825] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:49.745201 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f3f2fbc7-df8d-4b52-9a99-9aed23491a8d tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:49.745690 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f3f2fbc7-df8d-4b52-9a99-9aed23491a8d tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:49.746459 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f3f2fbc7-df8d-4b52-9a99-9aed23491a8d tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:49.746895 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f3f2fbc7-df8d-4b52-9a99-9aed23491a8d tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:49.904764 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f3f2fbc7-df8d-4b52-9a99-9aed23491a8d tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6752b6b8e596465c8a99ffd2179a2615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26d0310fadb4e82be35e2fe70f912d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:49.914034 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f3f2fbc7-df8d-4b52-9a99-9aed23491a8d tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/04ab3b7d-97bf-4104-afe7-f6f016f2a825" status: 200 len: 1505 microversion: 2.1 time: 0.181548 Aug 04 17:33:49.914411 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3248/6605] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:49 2022] GET /compute/v2.1/servers/04ab3b7d-97bf-4104-afe7-f6f016f2a825 => generated 1505 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:49.935178 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-391b50f6-bf5f-4425-96c9-14dafa2f25e7 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:49.935886 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-391b50f6-bf5f-4425-96c9-14dafa2f25e7 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 04ab3b7d-97bf-4104-afe7-f6f016f2a825] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:49.943940 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-391b50f6-bf5f-4425-96c9-14dafa2f25e7 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:49.944488 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-391b50f6-bf5f-4425-96c9-14dafa2f25e7 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:49.945995 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-391b50f6-bf5f-4425-96c9-14dafa2f25e7 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:49.946433 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-391b50f6-bf5f-4425-96c9-14dafa2f25e7 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:49.978835 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-391b50f6-bf5f-4425-96c9-14dafa2f25e7 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 04ab3b7d-97bf-4104-afe7-f6f016f2a825] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:33:50.074887 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-391b50f6-bf5f-4425-96c9-14dafa2f25e7 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "DELETE /compute/v2.1/servers/04ab3b7d-97bf-4104-afe7-f6f016f2a825" status: 204 len: 0 microversion: 2.1 time: 0.143799 Aug 04 17:33:50.075533 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3358/6606] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:33:49 2022] DELETE /compute/v2.1/servers/04ab3b7d-97bf-4104-afe7-f6f016f2a825 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:33:50.086921 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-00e14bc7-b620-4939-9d97-092cf5ef8770 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:50.087541 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-00e14bc7-b620-4939-9d97-092cf5ef8770 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 04ab3b7d-97bf-4104-afe7-f6f016f2a825] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:50.095024 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-00e14bc7-b620-4939-9d97-092cf5ef8770 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:50.095531 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-00e14bc7-b620-4939-9d97-092cf5ef8770 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:50.096364 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-00e14bc7-b620-4939-9d97-092cf5ef8770 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:50.097067 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-00e14bc7-b620-4939-9d97-092cf5ef8770 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:50.259104 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-00e14bc7-b620-4939-9d97-092cf5ef8770 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6752b6b8e596465c8a99ffd2179a2615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26d0310fadb4e82be35e2fe70f912d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:50.271447 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-00e14bc7-b620-4939-9d97-092cf5ef8770 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/04ab3b7d-97bf-4104-afe7-f6f016f2a825" status: 200 len: 1511 microversion: 2.1 time: 0.190232 Aug 04 17:33:50.272743 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3249/6607] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:50 2022] GET /compute/v2.1/servers/04ab3b7d-97bf-4104-afe7-f6f016f2a825 => generated 1511 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:51.299249 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-477615f2-d75f-449d-996a-9d64c730a595 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:51.299972 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-477615f2-d75f-449d-996a-9d64c730a595 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 04ab3b7d-97bf-4104-afe7-f6f016f2a825] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:51.302605 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:33:51.304763 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:33:51.315039 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-477615f2-d75f-449d-996a-9d64c730a595 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:51.316724 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-477615f2-d75f-449d-996a-9d64c730a595 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:51.316724 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-477615f2-d75f-449d-996a-9d64c730a595 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:51.317066 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-477615f2-d75f-449d-996a-9d64c730a595 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:51.529340 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-477615f2-d75f-449d-996a-9d64c730a595 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6752b6b8e596465c8a99ffd2179a2615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26d0310fadb4e82be35e2fe70f912d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:51.539409 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-477615f2-d75f-449d-996a-9d64c730a595 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/04ab3b7d-97bf-4104-afe7-f6f016f2a825" status: 200 len: 1511 microversion: 2.1 time: 0.244761 Aug 04 17:33:51.540055 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3359/6608] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:51 2022] GET /compute/v2.1/servers/04ab3b7d-97bf-4104-afe7-f6f016f2a825 => generated 1511 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:51.988749 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-fff9ea75-e2e3-46df-89a7-e9239cddd428 req-1532ca43-b26a-40fe-bbfe-4194f9da5530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04ab3b7d-97bf-4104-afe7-f6f016f2a825", "name": "network-vif-deleted", "tag": "e4efd015-d65e-403f-a172-2f798ffc1d08"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:33:52.011806 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:33:52.035214 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-fff9ea75-e2e3-46df-89a7-e9239cddd428 req-1532ca43-b26a-40fe-bbfe-4194f9da5530 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:52.036912 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-fff9ea75-e2e3-46df-89a7-e9239cddd428 req-1532ca43-b26a-40fe-bbfe-4194f9da5530 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:52.060364 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-fff9ea75-e2e3-46df-89a7-e9239cddd428 req-1532ca43-b26a-40fe-bbfe-4194f9da5530 service nova] Creating event network-vif-deleted:e4efd015-d65e-403f-a172-2f798ffc1d08 for instance 04ab3b7d-97bf-4104-afe7-f6f016f2a825 on n-h2-846466-12 Aug 04 17:33:52.079008 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-fff9ea75-e2e3-46df-89a7-e9239cddd428 req-1532ca43-b26a-40fe-bbfe-4194f9da5530 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103534 Aug 04 17:33:52.080137 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3250/6609] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:33:52.567077 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-77af5e4b-910c-4253-8a00-faf190829452 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:52.568231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-77af5e4b-910c-4253-8a00-faf190829452 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 04ab3b7d-97bf-4104-afe7-f6f016f2a825] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:52.575204 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:33:52.587583 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-77af5e4b-910c-4253-8a00-faf190829452 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:52.588331 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-77af5e4b-910c-4253-8a00-faf190829452 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:52.589846 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-77af5e4b-910c-4253-8a00-faf190829452 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:52.590628 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-77af5e4b-910c-4253-8a00-faf190829452 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:52.602292 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:33:52.624479 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-77af5e4b-910c-4253-8a00-faf190829452 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] HTTP exception thrown: Instance 04ab3b7d-97bf-4104-afe7-f6f016f2a825 could not be found. Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-77af5e4b-910c-4253-8a00-faf190829452 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Request method failure captured: Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/04ab3b7d-97bf-4104-afe7-f6f016f2a825 HTTP/1.1 Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi7ALhs2c9QfK3BfgqQ53sbD-S0TmxpsSrHrmDJUdRiSTNXgSCFvTWUH8Y6ImeiSmxv0p9RAhVvVZBhQYxyAThjkMvcElj8pUjkKQwyA4f5pVRcHojaCNDNW3mpAix_B-Gze0oLeLxeaeR8QyiDKYQBgzL87JRPrLWebU6fWvVL-dvn70 Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: b26d0310fadb4e82be35e2fe70f912d4 Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersNegativeTestJSON-1493257359 Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b26d0310fadb4e82be35e2fe70f912d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b26d0310fadb4e82be35e2fe70f912d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b26d0310fadb4e82be35e2fe70f912d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b26d0310fadb4e82be35e2fe70f912d4"}]}] Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersNegativeTestJSON-1493257359 Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: b26d0310fadb4e82be35e2fe70f912d4 Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1493257359 Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersNegativeTestJSON-1493257359-project Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 6752b6b8e596465c8a99ffd2179a2615 Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersNegativeTestJSON-1493257359-project Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 04ab3b7d-97bf-4104-afe7-f6f016f2a825 could not be found. Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '04ab3b7d-97bf-4104-afe7-f6f016f2a825'} Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04ab3b7d-97bf-4104-afe7-f6f016f2a825 could not be found. Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04ab3b7d-97bf-4104-afe7-f6f016f2a825 could not be found. Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:52.627877 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:52.634797 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:52.634797 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:52.634797 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:52.634797 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:33:52.634797 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:33:52.634797 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04ab3b7d-97bf-4104-afe7-f6f016f2a825 could not be found. Aug 04 17:33:52.634797 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:52.634797 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-77af5e4b-910c-4253-8a00-faf190829452 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Returning 404 to user: Instance 04ab3b7d-97bf-4104-afe7-f6f016f2a825 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:33:52.634797 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-77af5e4b-910c-4253-8a00-faf190829452 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/04ab3b7d-97bf-4104-afe7-f6f016f2a825" status: 404 len: 111 microversion: 2.1 time: 0.069988 Aug 04 17:33:52.634797 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3360/6610] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:52 2022] GET /compute/v2.1/servers/04ab3b7d-97bf-4104-afe7-f6f016f2a825 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:33:52.643529 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-04d64368-95d6-4943-8b06-fb407542df48 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:52.644377 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-04d64368-95d6-4943-8b06-fb407542df48 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 070df37c-674d-4046-b428-c9a61845c1e0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:52.654377 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-04d64368-95d6-4943-8b06-fb407542df48 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:52.654951 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-04d64368-95d6-4943-8b06-fb407542df48 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:52.655883 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-04d64368-95d6-4943-8b06-fb407542df48 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:52.656367 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-04d64368-95d6-4943-8b06-fb407542df48 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:52.860992 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-04d64368-95d6-4943-8b06-fb407542df48 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6752b6b8e596465c8a99ffd2179a2615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26d0310fadb4e82be35e2fe70f912d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:52.870019 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-04d64368-95d6-4943-8b06-fb407542df48 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0" status: 200 len: 1506 microversion: 2.1 time: 0.230890 Aug 04 17:33:52.870627 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3251/6611] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:52 2022] GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0 => generated 1506 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:52.892710 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5d5665d2-1458-47cd-bd3e-a6844f0cc0cc tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:33:52.895357 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5d5665d2-1458-47cd-bd3e-a6844f0cc0cc tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 7826a2a1-c887-47da-acae-cc957168a495] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:52.905373 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-5d5665d2-1458-47cd-bd3e-a6844f0cc0cc tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] HTTP exception thrown: Instance 7826a2a1-c887-47da-acae-cc957168a495 could not be found. Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5d5665d2-1458-47cd-bd3e-a6844f0cc0cc tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Request method failure captured: Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers/7826a2a1-c887-47da-acae-cc957168a495/action HTTP/1.1 Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 32 Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi7ALhs2c9QfK3BfgqQ53sbD-S0TmxpsSrHrmDJUdRiSTNXgSCFvTWUH8Y6ImeiSmxv0p9RAhVvVZBhQYxyAThjkMvcElj8pUjkKQwyA4f5pVRcHojaCNDNW3mpAix_B-Gze0oLeLxeaeR8QyiDKYQBgzL87JRPrLWebU6fWvVL-dvn70 Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: b26d0310fadb4e82be35e2fe70f912d4 Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersNegativeTestJSON-1493257359 Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b26d0310fadb4e82be35e2fe70f912d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b26d0310fadb4e82be35e2fe70f912d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b26d0310fadb4e82be35e2fe70f912d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b26d0310fadb4e82be35e2fe70f912d4"}]}] Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersNegativeTestJSON-1493257359 Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: b26d0310fadb4e82be35e2fe70f912d4 Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1493257359 Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersNegativeTestJSON-1493257359-project Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 6752b6b8e596465c8a99ffd2179a2615 Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersNegativeTestJSON-1493257359-project Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: {"resize": {"flavorRef": "452"}} Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 7826a2a1-c887-47da-acae-cc957168a495 could not be found. Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '7826a2a1-c887-47da-acae-cc957168a495', 'body': {'resize': {'flavorRef': '452'}}} Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7826a2a1-c887-47da-acae-cc957168a495 could not be found. Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:33:52.907856 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:33:52.917115 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7826a2a1-c887-47da-acae-cc957168a495 could not be found. Aug 04 17:33:52.917115 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:52.917115 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:52.917115 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:52.917115 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:52.917115 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:52.917115 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:52.917115 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:33:52.917115 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:33:52.917115 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7826a2a1-c887-47da-acae-cc957168a495 could not be found. Aug 04 17:33:52.917115 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:52.917115 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5d5665d2-1458-47cd-bd3e-a6844f0cc0cc tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Returning 404 to user: Instance 7826a2a1-c887-47da-acae-cc957168a495 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:33:52.917115 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5d5665d2-1458-47cd-bd3e-a6844f0cc0cc tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "POST /compute/v2.1/servers/7826a2a1-c887-47da-acae-cc957168a495/action" status: 404 len: 111 microversion: 2.1 time: 0.022415 Aug 04 17:33:52.917115 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3361/6612] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:33:52 2022] POST /compute/v2.1/servers/7826a2a1-c887-47da-acae-cc957168a495/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:33:52.924236 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cf725a78-a5cb-4e18-b097-24097c19d5bc tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:52.924912 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cf725a78-a5cb-4e18-b097-24097c19d5bc tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 070df37c-674d-4046-b428-c9a61845c1e0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:52.936429 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf725a78-a5cb-4e18-b097-24097c19d5bc tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:52.937276 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf725a78-a5cb-4e18-b097-24097c19d5bc tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:52.938756 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf725a78-a5cb-4e18-b097-24097c19d5bc tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:52.939414 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf725a78-a5cb-4e18-b097-24097c19d5bc tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:53.161500 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cf725a78-a5cb-4e18-b097-24097c19d5bc tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6752b6b8e596465c8a99ffd2179a2615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26d0310fadb4e82be35e2fe70f912d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:53.176202 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cf725a78-a5cb-4e18-b097-24097c19d5bc tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0" status: 200 len: 1506 microversion: 2.1 time: 0.257052 Aug 04 17:33:53.177257 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3252/6613] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:52 2022] GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0 => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:33:53.216027 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-48b8395a-b95f-4a0a-88b3-8d4da2bc829a tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:53.217188 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-48b8395a-b95f-4a0a-88b3-8d4da2bc829a tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 070df37c-674d-4046-b428-c9a61845c1e0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:53.231897 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-48b8395a-b95f-4a0a-88b3-8d4da2bc829a tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:53.232675 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-48b8395a-b95f-4a0a-88b3-8d4da2bc829a tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:53.234140 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-48b8395a-b95f-4a0a-88b3-8d4da2bc829a tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:53.234908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-48b8395a-b95f-4a0a-88b3-8d4da2bc829a tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:53.441670 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-48b8395a-b95f-4a0a-88b3-8d4da2bc829a tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6752b6b8e596465c8a99ffd2179a2615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26d0310fadb4e82be35e2fe70f912d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:53.454339 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-48b8395a-b95f-4a0a-88b3-8d4da2bc829a tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0" status: 200 len: 1506 microversion: 2.1 time: 0.246235 Aug 04 17:33:53.454960 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3362/6614] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:53 2022] GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0 => generated 1506 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:53.487715 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2c4c59d4-3052-43d2-9893-99cfd7675e39 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "33db963b-a55a-43e1-b1da-212c36fe76c2"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:33:53.490416 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2c4c59d4-3052-43d2-9893-99cfd7675e39 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 070df37c-674d-4046-b428-c9a61845c1e0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:53.498066 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2c4c59d4-3052-43d2-9893-99cfd7675e39 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:53.498513 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2c4c59d4-3052-43d2-9893-99cfd7675e39 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:53.499304 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2c4c59d4-3052-43d2-9893-99cfd7675e39 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:53.499731 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2c4c59d4-3052-43d2-9893-99cfd7675e39 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:53.551481 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2c4c59d4-3052-43d2-9893-99cfd7675e39 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6752b6b8e596465c8a99ffd2179a2615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26d0310fadb4e82be35e2fe70f912d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:53.557995 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-2c4c59d4-3052-43d2-9893-99cfd7675e39 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] HTTP exception thrown: Flavor 33db963b-a55a-43e1-b1da-212c36fe76c2 could not be found. Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2c4c59d4-3052-43d2-9893-99cfd7675e39 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Request method failure captured: Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: request: POST /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0/action HTTP/1.1 Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 65 Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi7ALhs2c9QfK3BfgqQ53sbD-S0TmxpsSrHrmDJUdRiSTNXgSCFvTWUH8Y6ImeiSmxv0p9RAhVvVZBhQYxyAThjkMvcElj8pUjkKQwyA4f5pVRcHojaCNDNW3mpAix_B-Gze0oLeLxeaeR8QyiDKYQBgzL87JRPrLWebU6fWvVL-dvn70 Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: b26d0310fadb4e82be35e2fe70f912d4 Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersNegativeTestJSON-1493257359 Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b26d0310fadb4e82be35e2fe70f912d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b26d0310fadb4e82be35e2fe70f912d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b26d0310fadb4e82be35e2fe70f912d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b26d0310fadb4e82be35e2fe70f912d4"}]}] Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersNegativeTestJSON-1493257359 Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: b26d0310fadb4e82be35e2fe70f912d4 Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1493257359 Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersNegativeTestJSON-1493257359-project Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 6752b6b8e596465c8a99ffd2179a2615 Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersNegativeTestJSON-1493257359-project Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: {"resize": {"flavorRef": "33db963b-a55a-43e1-b1da-212c36fe76c2"}} Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: exception: Flavor 33db963b-a55a-43e1-b1da-212c36fe76c2 could not be found. Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '070df37c-674d-4046-b428-c9a61845c1e0', 'body': {'resize': {'flavorRef': '33db963b-a55a-43e1-b1da-212c36fe76c2'}}} Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4148, in resize Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 17:33:53.560438 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 17:33:53.566569 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:33:53.566569 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 17:33:53.566569 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 17:33:53.566569 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 33db963b-a55a-43e1-b1da-212c36fe76c2 could not be found. Aug 04 17:33:53.566569 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:53.566569 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:53.566569 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:53.566569 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:53.566569 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:53.566569 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:53.566569 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:33:53.566569 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:33:53.566569 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:33:53.566569 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:33:53.566569 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:33:53.566569 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:33:53.566569 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 04 17:33:53.566569 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 04 17:33:53.566569 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 04 17:33:53.566569 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 17:33:53.566569 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 33db963b-a55a-43e1-b1da-212c36fe76c2 could not be found. Aug 04 17:33:53.566569 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:53.566569 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:53.566569 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:53.566569 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:53.566569 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:53.566569 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:53.566569 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:33:53.566569 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:33:53.566569 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 33db963b-a55a-43e1-b1da-212c36fe76c2 could not be found. Aug 04 17:33:53.566569 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:53.566569 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2c4c59d4-3052-43d2-9893-99cfd7675e39 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Returning 400 to user: Flavor 33db963b-a55a-43e1-b1da-212c36fe76c2 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:33:53.566569 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2c4c59d4-3052-43d2-9893-99cfd7675e39 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "POST /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0/action" status: 400 len: 107 microversion: 2.1 time: 0.079699 Aug 04 17:33:53.566569 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3253/6615] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:33:53 2022] POST /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0/action => generated 107 bytes in 82 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 17:33:53.573837 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d37dcfa7-50ec-4cf8-8081-c3cc333db987 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:53.574606 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d37dcfa7-50ec-4cf8-8081-c3cc333db987 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 070df37c-674d-4046-b428-c9a61845c1e0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:53.582646 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d37dcfa7-50ec-4cf8-8081-c3cc333db987 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:53.583018 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d37dcfa7-50ec-4cf8-8081-c3cc333db987 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:53.583564 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d37dcfa7-50ec-4cf8-8081-c3cc333db987 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:53.584007 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d37dcfa7-50ec-4cf8-8081-c3cc333db987 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:53.742888 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d37dcfa7-50ec-4cf8-8081-c3cc333db987 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6752b6b8e596465c8a99ffd2179a2615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26d0310fadb4e82be35e2fe70f912d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:53.751613 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d37dcfa7-50ec-4cf8-8081-c3cc333db987 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0" status: 200 len: 1506 microversion: 2.1 time: 0.182499 Aug 04 17:33:53.752280 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3363/6616] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:53 2022] GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0 => generated 1506 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:33:53.774643 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3d90fe4d-22e4-4205-a05f-a63ad72a23b0 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:53.775275 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3d90fe4d-22e4-4205-a05f-a63ad72a23b0 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 070df37c-674d-4046-b428-c9a61845c1e0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:53.782210 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3d90fe4d-22e4-4205-a05f-a63ad72a23b0 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:53.782682 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3d90fe4d-22e4-4205-a05f-a63ad72a23b0 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:53.783483 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3d90fe4d-22e4-4205-a05f-a63ad72a23b0 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:53.783939 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3d90fe4d-22e4-4205-a05f-a63ad72a23b0 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:53.947746 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3d90fe4d-22e4-4205-a05f-a63ad72a23b0 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6752b6b8e596465c8a99ffd2179a2615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26d0310fadb4e82be35e2fe70f912d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:53.950685 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=87 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:33:53.958597 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3d90fe4d-22e4-4205-a05f-a63ad72a23b0 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0" status: 200 len: 1506 microversion: 2.1 time: 0.188263 Aug 04 17:33:53.959184 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3254/6617] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:53 2022] GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0 => generated 1506 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:53.980901 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b4b1fef0-d77d-427f-825c-f0181e5d20c2 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b4b1fef0-d77d-427f-825c-f0181e5d20c2 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Request method failure captured: Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: request: POST /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0/action HTTP/1.1 Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 29 Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi7ALhs2c9QfK3BfgqQ53sbD-S0TmxpsSrHrmDJUdRiSTNXgSCFvTWUH8Y6ImeiSmxv0p9RAhVvVZBhQYxyAThjkMvcElj8pUjkKQwyA4f5pVRcHojaCNDNW3mpAix_B-Gze0oLeLxeaeR8QyiDKYQBgzL87JRPrLWebU6fWvVL-dvn70 Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: b26d0310fadb4e82be35e2fe70f912d4 Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersNegativeTestJSON-1493257359 Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b26d0310fadb4e82be35e2fe70f912d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b26d0310fadb4e82be35e2fe70f912d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b26d0310fadb4e82be35e2fe70f912d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b26d0310fadb4e82be35e2fe70f912d4"}]}] Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersNegativeTestJSON-1493257359 Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: b26d0310fadb4e82be35e2fe70f912d4 Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1493257359 Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersNegativeTestJSON-1493257359-project Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 6752b6b8e596465c8a99ffd2179a2615 Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersNegativeTestJSON-1493257359-project Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: {"resize": {"flavorRef": ""}} Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '070df37c-674d-4046-b428-c9a61845c1e0', 'body': {'resize': {'flavorRef': ''}}} Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi '' Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:53.984939 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:53.993114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:53.993114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:53.993114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:53.993114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:53.993114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:33:53.993114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:33:53.993114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 04 17:33:53.993114 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:53.993114 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b4b1fef0-d77d-427f-825c-f0181e5d20c2 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:33:53.993114 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b4b1fef0-d77d-427f-825c-f0181e5d20c2 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "POST /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0/action" status: 400 len: 113 microversion: 2.1 time: 0.010924 Aug 04 17:33:53.993114 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3364/6618] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:33:53 2022] POST /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0/action => generated 113 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:33:53.999655 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cf76e107-d309-4f7b-ac94-befe81d6f4ca tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:54.000284 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cf76e107-d309-4f7b-ac94-befe81d6f4ca tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 070df37c-674d-4046-b428-c9a61845c1e0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:54.002432 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=49 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:33:54.009614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf76e107-d309-4f7b-ac94-befe81d6f4ca tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:54.010069 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf76e107-d309-4f7b-ac94-befe81d6f4ca tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:54.010944 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf76e107-d309-4f7b-ac94-befe81d6f4ca tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:54.011502 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cf76e107-d309-4f7b-ac94-befe81d6f4ca tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:54.219018 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cf76e107-d309-4f7b-ac94-befe81d6f4ca tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6752b6b8e596465c8a99ffd2179a2615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26d0310fadb4e82be35e2fe70f912d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:54.228194 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cf76e107-d309-4f7b-ac94-befe81d6f4ca tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0" status: 200 len: 1506 microversion: 2.1 time: 0.232762 Aug 04 17:33:54.228803 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3255/6619] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:53 2022] GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0 => generated 1506 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:54.274608 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cacb0fc0-c299-49fa-a4a1-94169319bccb tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:54.275489 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cacb0fc0-c299-49fa-a4a1-94169319bccb tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 04ab3b7d-97bf-4104-afe7-f6f016f2a825] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:54.287909 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cacb0fc0-c299-49fa-a4a1-94169319bccb tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:54.289801 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cacb0fc0-c299-49fa-a4a1-94169319bccb tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:54.291261 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cacb0fc0-c299-49fa-a4a1-94169319bccb tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:54.291989 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cacb0fc0-c299-49fa-a4a1-94169319bccb tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:54.324230 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-cacb0fc0-c299-49fa-a4a1-94169319bccb tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] HTTP exception thrown: Instance 04ab3b7d-97bf-4104-afe7-f6f016f2a825 could not be found. Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cacb0fc0-c299-49fa-a4a1-94169319bccb tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Request method failure captured: Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/servers/04ab3b7d-97bf-4104-afe7-f6f016f2a825 HTTP/1.1 Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi7ALhs2c9QfK3BfgqQ53sbD-S0TmxpsSrHrmDJUdRiSTNXgSCFvTWUH8Y6ImeiSmxv0p9RAhVvVZBhQYxyAThjkMvcElj8pUjkKQwyA4f5pVRcHojaCNDNW3mpAix_B-Gze0oLeLxeaeR8QyiDKYQBgzL87JRPrLWebU6fWvVL-dvn70 Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: b26d0310fadb4e82be35e2fe70f912d4 Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-ServersNegativeTestJSON-1493257359 Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b26d0310fadb4e82be35e2fe70f912d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b26d0310fadb4e82be35e2fe70f912d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b26d0310fadb4e82be35e2fe70f912d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b26d0310fadb4e82be35e2fe70f912d4"}]}] Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-ServersNegativeTestJSON-1493257359 Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: b26d0310fadb4e82be35e2fe70f912d4 Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1493257359 Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-ServersNegativeTestJSON-1493257359-project Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 6752b6b8e596465c8a99ffd2179a2615 Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-ServersNegativeTestJSON-1493257359-project Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 04ab3b7d-97bf-4104-afe7-f6f016f2a825 could not be found. Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '04ab3b7d-97bf-4104-afe7-f6f016f2a825'} Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04ab3b7d-97bf-4104-afe7-f6f016f2a825 could not be found. Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:33:54.327373 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:33:54.335122 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04ab3b7d-97bf-4104-afe7-f6f016f2a825 could not be found. Aug 04 17:33:54.335122 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:54.335122 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:54.335122 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:54.335122 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:54.335122 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:54.335122 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:54.335122 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:33:54.335122 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:33:54.335122 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04ab3b7d-97bf-4104-afe7-f6f016f2a825 could not be found. Aug 04 17:33:54.335122 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:33:54.335122 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cacb0fc0-c299-49fa-a4a1-94169319bccb tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Returning 404 to user: Instance 04ab3b7d-97bf-4104-afe7-f6f016f2a825 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:33:54.335122 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cacb0fc0-c299-49fa-a4a1-94169319bccb tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "DELETE /compute/v2.1/servers/04ab3b7d-97bf-4104-afe7-f6f016f2a825" status: 404 len: 111 microversion: 2.1 time: 0.064193 Aug 04 17:33:54.335122 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3365/6620] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:33:54 2022] DELETE /compute/v2.1/servers/04ab3b7d-97bf-4104-afe7-f6f016f2a825 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:33:54.346102 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e1dc693a-fca7-48f8-ba55-16475106b520 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:54.347211 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e1dc693a-fca7-48f8-ba55-16475106b520 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 04ab3b7d-97bf-4104-afe7-f6f016f2a825] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:54.358195 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e1dc693a-fca7-48f8-ba55-16475106b520 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:54.358759 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e1dc693a-fca7-48f8-ba55-16475106b520 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:54.360077 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e1dc693a-fca7-48f8-ba55-16475106b520 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:54.360810 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e1dc693a-fca7-48f8-ba55-16475106b520 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:54.385414 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-e1dc693a-fca7-48f8-ba55-16475106b520 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] HTTP exception thrown: Instance 04ab3b7d-97bf-4104-afe7-f6f016f2a825 could not be found. Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e1dc693a-fca7-48f8-ba55-16475106b520 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Request method failure captured: Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/04ab3b7d-97bf-4104-afe7-f6f016f2a825 HTTP/1.1 Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi7ALhs2c9QfK3BfgqQ53sbD-S0TmxpsSrHrmDJUdRiSTNXgSCFvTWUH8Y6ImeiSmxv0p9RAhVvVZBhQYxyAThjkMvcElj8pUjkKQwyA4f5pVRcHojaCNDNW3mpAix_B-Gze0oLeLxeaeR8QyiDKYQBgzL87JRPrLWebU6fWvVL-dvn70 Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: b26d0310fadb4e82be35e2fe70f912d4 Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersNegativeTestJSON-1493257359 Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b26d0310fadb4e82be35e2fe70f912d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b26d0310fadb4e82be35e2fe70f912d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b26d0310fadb4e82be35e2fe70f912d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b26d0310fadb4e82be35e2fe70f912d4"}]}] Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersNegativeTestJSON-1493257359 Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: b26d0310fadb4e82be35e2fe70f912d4 Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1493257359 Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersNegativeTestJSON-1493257359-project Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 6752b6b8e596465c8a99ffd2179a2615 Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersNegativeTestJSON-1493257359-project Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 04ab3b7d-97bf-4104-afe7-f6f016f2a825 could not be found. Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '04ab3b7d-97bf-4104-afe7-f6f016f2a825'} Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04ab3b7d-97bf-4104-afe7-f6f016f2a825 could not be found. Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04ab3b7d-97bf-4104-afe7-f6f016f2a825 could not be found. Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:54.388381 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:54.393535 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:54.393535 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:54.393535 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:54.393535 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:33:54.393535 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:33:54.393535 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04ab3b7d-97bf-4104-afe7-f6f016f2a825 could not be found. Aug 04 17:33:54.393535 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:54.393535 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e1dc693a-fca7-48f8-ba55-16475106b520 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Returning 404 to user: Instance 04ab3b7d-97bf-4104-afe7-f6f016f2a825 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:33:54.393535 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e1dc693a-fca7-48f8-ba55-16475106b520 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/04ab3b7d-97bf-4104-afe7-f6f016f2a825" status: 404 len: 111 microversion: 2.1 time: 0.052492 Aug 04 17:33:54.393535 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3256/6621] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:54 2022] GET /compute/v2.1/servers/04ab3b7d-97bf-4104-afe7-f6f016f2a825 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:33:54.403455 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3c9cb3dc-b9fd-4fc0-a85e-00409bbafd07 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:54.403955 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3c9cb3dc-b9fd-4fc0-a85e-00409bbafd07 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 070df37c-674d-4046-b428-c9a61845c1e0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:54.419409 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3c9cb3dc-b9fd-4fc0-a85e-00409bbafd07 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:54.419902 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3c9cb3dc-b9fd-4fc0-a85e-00409bbafd07 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:54.421137 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3c9cb3dc-b9fd-4fc0-a85e-00409bbafd07 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:54.421897 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3c9cb3dc-b9fd-4fc0-a85e-00409bbafd07 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:54.469477 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3c9cb3dc-b9fd-4fc0-a85e-00409bbafd07 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 070df37c-674d-4046-b428-c9a61845c1e0] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:33:54.596391 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3c9cb3dc-b9fd-4fc0-a85e-00409bbafd07 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "DELETE /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0" status: 204 len: 0 microversion: 2.1 time: 0.196587 Aug 04 17:33:54.598067 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3366/6622] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:33:54 2022] DELETE /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:33:54.607004 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f506e74b-cb75-4c53-9486-4966f0ba738b tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:54.607644 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f506e74b-cb75-4c53-9486-4966f0ba738b tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 070df37c-674d-4046-b428-c9a61845c1e0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:54.614832 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f506e74b-cb75-4c53-9486-4966f0ba738b tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:54.615520 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f506e74b-cb75-4c53-9486-4966f0ba738b tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:54.616523 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f506e74b-cb75-4c53-9486-4966f0ba738b tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:54.617087 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f506e74b-cb75-4c53-9486-4966f0ba738b tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:54.770699 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f506e74b-cb75-4c53-9486-4966f0ba738b tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6752b6b8e596465c8a99ffd2179a2615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26d0310fadb4e82be35e2fe70f912d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:54.779886 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f506e74b-cb75-4c53-9486-4966f0ba738b tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0" status: 200 len: 1512 microversion: 2.1 time: 0.177188 Aug 04 17:33:54.780497 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3257/6623] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:54 2022] GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0 => generated 1512 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:55.802826 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0271d80e-6a43-4180-991e-7663e36d4075 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:55.804117 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0271d80e-6a43-4180-991e-7663e36d4075 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 070df37c-674d-4046-b428-c9a61845c1e0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:55.813713 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0271d80e-6a43-4180-991e-7663e36d4075 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:55.814317 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0271d80e-6a43-4180-991e-7663e36d4075 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:55.815227 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0271d80e-6a43-4180-991e-7663e36d4075 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:55.815760 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0271d80e-6a43-4180-991e-7663e36d4075 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:55.976071 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0271d80e-6a43-4180-991e-7663e36d4075 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6752b6b8e596465c8a99ffd2179a2615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26d0310fadb4e82be35e2fe70f912d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:55.984489 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0271d80e-6a43-4180-991e-7663e36d4075 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0" status: 200 len: 1512 microversion: 2.1 time: 0.186466 Aug 04 17:33:55.985140 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3367/6624] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:55 2022] GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0 => generated 1512 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:56.697103 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-5648a93f-ffd2-4fd9-b224-81c18fbf1e23 req-51b90472-2fd1-4584-bb7a-241acc5a77e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "070df37c-674d-4046-b428-c9a61845c1e0", "name": "network-vif-deleted", "tag": "2a03a958-944a-4106-88f9-95ab5c835897"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:33:56.709699 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-5648a93f-ffd2-4fd9-b224-81c18fbf1e23 req-51b90472-2fd1-4584-bb7a-241acc5a77e1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:56.711312 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-5648a93f-ffd2-4fd9-b224-81c18fbf1e23 req-51b90472-2fd1-4584-bb7a-241acc5a77e1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:56.727148 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-5648a93f-ffd2-4fd9-b224-81c18fbf1e23 req-51b90472-2fd1-4584-bb7a-241acc5a77e1 service nova] Creating event network-vif-deleted:2a03a958-944a-4106-88f9-95ab5c835897 for instance 070df37c-674d-4046-b428-c9a61845c1e0 on n-h1-846466-12 Aug 04 17:33:56.735094 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-5648a93f-ffd2-4fd9-b224-81c18fbf1e23 req-51b90472-2fd1-4584-bb7a-241acc5a77e1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041214 Aug 04 17:33:56.735094 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3258/6625] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:33:57.007002 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7441065d-4353-4fa3-a943-75b110088bc5 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:57.007869 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7441065d-4353-4fa3-a943-75b110088bc5 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 070df37c-674d-4046-b428-c9a61845c1e0] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:57.016275 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7441065d-4353-4fa3-a943-75b110088bc5 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:57.016726 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7441065d-4353-4fa3-a943-75b110088bc5 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:57.017571 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7441065d-4353-4fa3-a943-75b110088bc5 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:57.018026 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7441065d-4353-4fa3-a943-75b110088bc5 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:57.056741 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7441065d-4353-4fa3-a943-75b110088bc5 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:57.057183 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7441065d-4353-4fa3-a943-75b110088bc5 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:57.057732 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-7441065d-4353-4fa3-a943-75b110088bc5 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lazy-loading 'fault' on Instance uuid 070df37c-674d-4046-b428-c9a61845c1e0 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:33:57.111866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7441065d-4353-4fa3-a943-75b110088bc5 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6752b6b8e596465c8a99ffd2179a2615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26d0310fadb4e82be35e2fe70f912d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:57.121643 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7441065d-4353-4fa3-a943-75b110088bc5 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0" status: 200 len: 1307 microversion: 2.1 time: 0.118863 Aug 04 17:33:57.122498 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3368/6626] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:57 2022] GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0 => generated 1307 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:58.149639 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-77168769-3755-4b49-9fe1-e70abeffda54 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:58.150772 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-77168769-3755-4b49-9fe1-e70abeffda54 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] [instance: 070df37c-674d-4046-b428-c9a61845c1e0] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:58.158388 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-77168769-3755-4b49-9fe1-e70abeffda54 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:58.158846 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-77168769-3755-4b49-9fe1-e70abeffda54 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:58.159647 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-77168769-3755-4b49-9fe1-e70abeffda54 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:33:58.160092 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-77168769-3755-4b49-9fe1-e70abeffda54 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:33:58.176123 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-77168769-3755-4b49-9fe1-e70abeffda54 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] HTTP exception thrown: Instance 070df37c-674d-4046-b428-c9a61845c1e0 could not be found. Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-77168769-3755-4b49-9fe1-e70abeffda54 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Request method failure captured: Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0 HTTP/1.1 Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi7ALhs2c9QfK3BfgqQ53sbD-S0TmxpsSrHrmDJUdRiSTNXgSCFvTWUH8Y6ImeiSmxv0p9RAhVvVZBhQYxyAThjkMvcElj8pUjkKQwyA4f5pVRcHojaCNDNW3mpAix_B-Gze0oLeLxeaeR8QyiDKYQBgzL87JRPrLWebU6fWvVL-dvn70 Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: b26d0310fadb4e82be35e2fe70f912d4 Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-ServersNegativeTestJSON-1493257359 Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b26d0310fadb4e82be35e2fe70f912d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b26d0310fadb4e82be35e2fe70f912d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b26d0310fadb4e82be35e2fe70f912d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b26d0310fadb4e82be35e2fe70f912d4"}]}] Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-ServersNegativeTestJSON-1493257359 Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: b26d0310fadb4e82be35e2fe70f912d4 Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1493257359 Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-ServersNegativeTestJSON-1493257359-project Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 6752b6b8e596465c8a99ffd2179a2615 Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-ServersNegativeTestJSON-1493257359-project Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 070df37c-674d-4046-b428-c9a61845c1e0 could not be found. Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '070df37c-674d-4046-b428-c9a61845c1e0'} Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 070df37c-674d-4046-b428-c9a61845c1e0 could not be found. Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 070df37c-674d-4046-b428-c9a61845c1e0 could not be found. Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:58.178209 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:58.187293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:58.187293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:58.187293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:58.187293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:33:58.187293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:33:58.187293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 070df37c-674d-4046-b428-c9a61845c1e0 could not be found. Aug 04 17:33:58.187293 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:33:58.187293 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-77168769-3755-4b49-9fe1-e70abeffda54 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] Returning 404 to user: Instance 070df37c-674d-4046-b428-c9a61845c1e0 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:33:58.187293 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-77168769-3755-4b49-9fe1-e70abeffda54 tempest-ServersNegativeTestJSON-1493257359 tempest-ServersNegativeTestJSON-1493257359-project] 10.222.0.23 "GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0" status: 404 len: 111 microversion: 2.1 time: 0.037630 Aug 04 17:33:58.187293 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3259/6627] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:58 2022] GET /compute/v2.1/servers/070df37c-674d-4046-b428-c9a61845c1e0 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:34:34.375138 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:34:34.376293 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:34:34.594040 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-54aa7ac7-fc2d-42ae-a49a-07592a1cbecb tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Action: 'create', calling method: .version_select at 0x7f7e841584c0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1871063145", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJROTYMnHmaNIPZ7n57QT449TgZpQmP3CVPftTKpcXMeSGO29Mq737F8uKfqGuOb+Udt3qJIavnaDvlUDIIOkKrmF74Mtj02uisDdEAH24DW6Qx14iag7wweJFNuFTAnxw=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:34:34.611376 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-54aa7ac7-fc2d-42ae-a49a-07592a1cbecb tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Getting quotas for project c1d5eb8380434e358cf156e5fd9875ac. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:34:34.617344 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-54aa7ac7-fc2d-42ae-a49a-07592a1cbecb tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Getting quotas for user 872e40e56b12400a97e44f8a47376a5b and project c1d5eb8380434e358cf156e5fd9875ac. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:34:34.657061 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-54aa7ac7-fc2d-42ae-a49a-07592a1cbecb tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.287345 Aug 04 17:34:34.658759 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3369/6628] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 17:34:34 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:34:34.725184 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5edee80b-f3c9-44ac-8a12-0589858a23fc tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-366467669", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1871063145", "networks": [{"uuid": "4d0275f4-43da-4c97-829d-89e5c87992ff"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:34:34.740557 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=9 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:34:34.742534 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=19 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:34:34.796794 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-5edee80b-f3c9-44ac-8a12-0589858a23fc tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] validate_networks() for [('4d0275f4-43da-4c97-829d-89e5c87992ff', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:34:35.363449 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-5edee80b-f3c9-44ac-8a12-0589858a23fc tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:34:35.363884 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-5edee80b-f3c9-44ac-8a12-0589858a23fc tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:34:35.364361 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-5edee80b-f3c9-44ac-8a12-0589858a23fc tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:34:35.364919 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-5edee80b-f3c9-44ac-8a12-0589858a23fc tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:34:35.366762 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-5edee80b-f3c9-44ac-8a12-0589858a23fc tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:34:35.382200 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5edee80b-f3c9-44ac-8a12-0589858a23fc tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:34:35.382656 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5edee80b-f3c9-44ac-8a12-0589858a23fc tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:34:35.383468 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5edee80b-f3c9-44ac-8a12-0589858a23fc tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:34:35.383913 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5edee80b-f3c9-44ac-8a12-0589858a23fc tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:34:35.401686 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-5edee80b-f3c9-44ac-8a12-0589858a23fc tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Getting quotas for project c1d5eb8380434e358cf156e5fd9875ac. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:34:35.411828 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-5edee80b-f3c9-44ac-8a12-0589858a23fc tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Getting quotas for user 872e40e56b12400a97e44f8a47376a5b and project c1d5eb8380434e358cf156e5fd9875ac. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:34:35.426352 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5edee80b-f3c9-44ac-8a12-0589858a23fc tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:34:35.428873 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5edee80b-f3c9-44ac-8a12-0589858a23fc tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:34:35.493533 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5edee80b-f3c9-44ac-8a12-0589858a23fc tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.775073 Aug 04 17:34:35.494181 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3260/6629] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:34:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:34:35.506862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-da08b943-50e0-4b23-8ec2-efe27f699ff2 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:34:35.508003 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-da08b943-50e0-4b23-8ec2-efe27f699ff2 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:34:35.567096 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-da08b943-50e0-4b23-8ec2-efe27f699ff2 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:34:35.576381 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-da08b943-50e0-4b23-8ec2-efe27f699ff2 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4" status: 200 len: 1262 microversion: 2.1 time: 0.075201 Aug 04 17:34:35.590300 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3370/6630] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:34:35 2022] GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4 => generated 1262 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:34:36.598417 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-86982e87-6278-4b33-8490-6e4ad99c9b46 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:34:36.599141 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-86982e87-6278-4b33-8490-6e4ad99c9b46 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:34:36.609301 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-86982e87-6278-4b33-8490-6e4ad99c9b46 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:34:36.609855 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-86982e87-6278-4b33-8490-6e4ad99c9b46 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:34:36.610658 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-86982e87-6278-4b33-8490-6e4ad99c9b46 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:34:36.611108 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-86982e87-6278-4b33-8490-6e4ad99c9b46 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:34:36.729558 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-86982e87-6278-4b33-8490-6e4ad99c9b46 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:34:36.745577 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-86982e87-6278-4b33-8490-6e4ad99c9b46 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4" status: 200 len: 1322 microversion: 2.1 time: 0.152572 Aug 04 17:34:36.746209 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3261/6631] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:34:36 2022] GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:34:37.767167 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-52e9e328-c27b-4ab6-a1a7-2fdd8711f3d4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:34:37.767917 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-52e9e328-c27b-4ab6-a1a7-2fdd8711f3d4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:34:37.777522 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-52e9e328-c27b-4ab6-a1a7-2fdd8711f3d4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:34:37.778252 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-52e9e328-c27b-4ab6-a1a7-2fdd8711f3d4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:34:37.779287 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-52e9e328-c27b-4ab6-a1a7-2fdd8711f3d4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:34:37.779788 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-52e9e328-c27b-4ab6-a1a7-2fdd8711f3d4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:34:37.988033 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-52e9e328-c27b-4ab6-a1a7-2fdd8711f3d4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:34:37.997309 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-52e9e328-c27b-4ab6-a1a7-2fdd8711f3d4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4" status: 200 len: 1362 microversion: 2.1 time: 0.234607 Aug 04 17:34:37.997976 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3371/6632] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:34:37 2022] GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:34:38.232005 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-8f7fa0c9-3d25-45b3-98e4-7db76ba75d39 req-52c84e5a-ebbb-4129-be82-282329efb038 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4", "tag": "bbca399d-2078-4b63-8664-a2abcdb71a5e"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:34:38.260069 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-8f7fa0c9-3d25-45b3-98e4-7db76ba75d39 req-52c84e5a-ebbb-4129-be82-282329efb038 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:34:38.260523 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-8f7fa0c9-3d25-45b3-98e4-7db76ba75d39 req-52c84e5a-ebbb-4129-be82-282329efb038 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:34:38.286368 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-8f7fa0c9-3d25-45b3-98e4-7db76ba75d39 req-52c84e5a-ebbb-4129-be82-282329efb038 service nova] Creating event network-changed:bbca399d-2078-4b63-8664-a2abcdb71a5e for instance 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4 on n-h1-846466-12 Aug 04 17:34:38.293873 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-8f7fa0c9-3d25-45b3-98e4-7db76ba75d39 req-52c84e5a-ebbb-4129-be82-282329efb038 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066080 Aug 04 17:34:38.295022 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3262/6633] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:34:39.019782 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f6408dc0-c058-4c58-a03e-3eb81f41282f tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:34:39.020610 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f6408dc0-c058-4c58-a03e-3eb81f41282f tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:34:39.028736 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f6408dc0-c058-4c58-a03e-3eb81f41282f tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:34:39.029257 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f6408dc0-c058-4c58-a03e-3eb81f41282f tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:34:39.029980 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f6408dc0-c058-4c58-a03e-3eb81f41282f tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:34:39.030405 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f6408dc0-c058-4c58-a03e-3eb81f41282f tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:34:39.193345 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f6408dc0-c058-4c58-a03e-3eb81f41282f tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:34:39.204109 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f6408dc0-c058-4c58-a03e-3eb81f41282f tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4" status: 200 len: 1362 microversion: 2.1 time: 0.189462 Aug 04 17:34:39.204711 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3372/6634] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:34:39 2022] GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4 => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:34:40.229994 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-469a3947-4a38-418c-8adb-82a65e5463fe tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:34:40.230698 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-469a3947-4a38-418c-8adb-82a65e5463fe tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:34:40.238531 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-469a3947-4a38-418c-8adb-82a65e5463fe tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:34:40.238982 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-469a3947-4a38-418c-8adb-82a65e5463fe tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:34:40.239763 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-469a3947-4a38-418c-8adb-82a65e5463fe tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:34:40.240202 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-469a3947-4a38-418c-8adb-82a65e5463fe tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:34:40.399543 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-469a3947-4a38-418c-8adb-82a65e5463fe tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:34:40.407497 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-469a3947-4a38-418c-8adb-82a65e5463fe tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4" status: 200 len: 1362 microversion: 2.1 time: 0.182360 Aug 04 17:34:40.408077 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3263/6635] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:34:40 2022] GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4 => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:34:41.435544 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-68788268-3019-44eb-9375-5077d8c0f1fd tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:34:41.436077 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-68788268-3019-44eb-9375-5077d8c0f1fd tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:34:41.444640 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-68788268-3019-44eb-9375-5077d8c0f1fd tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:34:41.445095 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-68788268-3019-44eb-9375-5077d8c0f1fd tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:34:41.445902 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-68788268-3019-44eb-9375-5077d8c0f1fd tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:34:41.446346 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-68788268-3019-44eb-9375-5077d8c0f1fd tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:34:41.614728 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-68788268-3019-44eb-9375-5077d8c0f1fd tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:34:41.623203 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-68788268-3019-44eb-9375-5077d8c0f1fd tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4" status: 200 len: 1362 microversion: 2.1 time: 0.191872 Aug 04 17:34:41.623819 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3373/6636] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:34:41 2022] GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:34:42.647283 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f64316f3-2d44-4bbf-833b-ebea33f690c4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:34:42.648242 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f64316f3-2d44-4bbf-833b-ebea33f690c4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:34:42.657430 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f64316f3-2d44-4bbf-833b-ebea33f690c4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:34:42.657891 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f64316f3-2d44-4bbf-833b-ebea33f690c4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:34:42.658667 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f64316f3-2d44-4bbf-833b-ebea33f690c4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:34:42.659135 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f64316f3-2d44-4bbf-833b-ebea33f690c4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:34:42.810539 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f64316f3-2d44-4bbf-833b-ebea33f690c4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:34:42.818486 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f64316f3-2d44-4bbf-833b-ebea33f690c4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4" status: 200 len: 1362 microversion: 2.1 time: 0.177238 Aug 04 17:34:42.819047 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3264/6637] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:34:42 2022] GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:34:43.597898 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-ecdf3467-5a0d-4ed3-9521-c8a05ab07b5d req-8b6a06bd-20a7-4506-a631-7e854356f9ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4", "name": "network-vif-plugged", "status": "completed", "tag": "bbca399d-2078-4b63-8664-a2abcdb71a5e"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:34:43.611649 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-ecdf3467-5a0d-4ed3-9521-c8a05ab07b5d req-8b6a06bd-20a7-4506-a631-7e854356f9ac service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:34:43.612310 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-ecdf3467-5a0d-4ed3-9521-c8a05ab07b5d req-8b6a06bd-20a7-4506-a631-7e854356f9ac service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:34:43.625526 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-ecdf3467-5a0d-4ed3-9521-c8a05ab07b5d req-8b6a06bd-20a7-4506-a631-7e854356f9ac service nova] Creating event network-vif-plugged:bbca399d-2078-4b63-8664-a2abcdb71a5e for instance 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4 on n-h1-846466-12 Aug 04 17:34:43.631610 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-ecdf3467-5a0d-4ed3-9521-c8a05ab07b5d req-8b6a06bd-20a7-4506-a631-7e854356f9ac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037705 Aug 04 17:34:43.632298 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3374/6638] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:34:43.839940 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8e35eccd-8f85-4204-be3a-91a4bbde5728 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:34:43.840485 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8e35eccd-8f85-4204-be3a-91a4bbde5728 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:34:43.847925 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8e35eccd-8f85-4204-be3a-91a4bbde5728 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:34:43.848349 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8e35eccd-8f85-4204-be3a-91a4bbde5728 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:34:43.849118 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8e35eccd-8f85-4204-be3a-91a4bbde5728 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:34:43.849592 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8e35eccd-8f85-4204-be3a-91a4bbde5728 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:34:44.000226 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8e35eccd-8f85-4204-be3a-91a4bbde5728 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:34:44.008117 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8e35eccd-8f85-4204-be3a-91a4bbde5728 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4" status: 200 len: 1362 microversion: 2.1 time: 0.172192 Aug 04 17:34:44.008705 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3265/6639] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:34:43 2022] GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:34:45.034179 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f7e1b69b-f434-45b9-aa92-aec1aa549e22 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:34:45.034817 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f7e1b69b-f434-45b9-aa92-aec1aa549e22 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:34:45.045616 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f7e1b69b-f434-45b9-aa92-aec1aa549e22 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:34:45.046296 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f7e1b69b-f434-45b9-aa92-aec1aa549e22 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:34:45.047305 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f7e1b69b-f434-45b9-aa92-aec1aa549e22 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:34:45.047766 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f7e1b69b-f434-45b9-aa92-aec1aa549e22 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:34:45.213711 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f7e1b69b-f434-45b9-aa92-aec1aa549e22 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:34:45.226065 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f7e1b69b-f434-45b9-aa92-aec1aa549e22 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4" status: 200 len: 1553 microversion: 2.1 time: 0.199160 Aug 04 17:34:45.226656 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3375/6640] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:34:45 2022] GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4 => generated 1553 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:34:45.247144 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-66cb8f2a-bfb4-4b4d-8df7-202f33686651 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:34:45.247930 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-66cb8f2a-bfb4-4b4d-8df7-202f33686651 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:34:45.255833 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-66cb8f2a-bfb4-4b4d-8df7-202f33686651 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:34:45.256294 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-66cb8f2a-bfb4-4b4d-8df7-202f33686651 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:34:45.257075 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-66cb8f2a-bfb4-4b4d-8df7-202f33686651 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:34:45.257546 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-66cb8f2a-bfb4-4b4d-8df7-202f33686651 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:34:45.392126 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:34:45.411576 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-66cb8f2a-bfb4-4b4d-8df7-202f33686651 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:34:45.419729 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-66cb8f2a-bfb4-4b4d-8df7-202f33686651 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4" status: 200 len: 1553 microversion: 2.1 time: 0.176538 Aug 04 17:34:45.420311 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3266/6641] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:34:45 2022] GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4 => generated 1553 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:34:47.105320 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f018d744-0cb8-409c-8f93-45a0bd9928a0 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f9695ef-3a81-417b-9793-6998b06b4451"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:34:47.108999 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f018d744-0cb8-409c-8f93-45a0bd9928a0 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:34:47.112035 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:34:47.119791 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f018d744-0cb8-409c-8f93-45a0bd9928a0 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:34:47.120229 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f018d744-0cb8-409c-8f93-45a0bd9928a0 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:34:47.120990 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f018d744-0cb8-409c-8f93-45a0bd9928a0 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:34:47.121461 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f018d744-0cb8-409c-8f93-45a0bd9928a0 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:34:47.425214 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f018d744-0cb8-409c-8f93-45a0bd9928a0 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "POST /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.325577 Aug 04 17:34:47.425907 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3376/6642] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Aug 4 17:34:47 2022] POST /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4/os-volume_attachments => generated 194 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:34:59.311124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-81e1e568-49e8-4162-937f-8a526bdb08f4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:34:59.311646 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-81e1e568-49e8-4162-937f-8a526bdb08f4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:34:59.313684 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:34:59.314473 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:34:59.315172 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=34 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:34:59.321489 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-81e1e568-49e8-4162-937f-8a526bdb08f4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:34:59.321950 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-81e1e568-49e8-4162-937f-8a526bdb08f4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:34:59.322716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-81e1e568-49e8-4162-937f-8a526bdb08f4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:34:59.323158 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-81e1e568-49e8-4162-937f-8a526bdb08f4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:34:59.410283 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-81e1e568-49e8-4162-937f-8a526bdb08f4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lazy-loading 'services' on Instance uuid 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:34:59.503781 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-81e1e568-49e8-4162-937f-8a526bdb08f4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "DELETE /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4/os-volume_attachments/6f9695ef-3a81-417b-9793-6998b06b4451" status: 202 len: 0 microversion: 2.1 time: 0.196547 Aug 04 17:34:59.504606 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3267/6643] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Aug 4 17:34:59 2022] DELETE /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4/os-volume_attachments/6f9695ef-3a81-417b-9793-6998b06b4451 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:34:59.515721 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:34:59.517033 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:34:59.525873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f2dc9f26-3239-402a-bf42-6847a340db8b tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:34:59.529007 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f2dc9f26-3239-402a-bf42-6847a340db8b tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:34:59.540803 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f2dc9f26-3239-402a-bf42-6847a340db8b tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:34:59.541245 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f2dc9f26-3239-402a-bf42-6847a340db8b tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:34:59.542050 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f2dc9f26-3239-402a-bf42-6847a340db8b tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:34:59.542477 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f2dc9f26-3239-402a-bf42-6847a340db8b tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:34:59.577150 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f2dc9f26-3239-402a-bf42-6847a340db8b tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065211 Aug 04 17:34:59.578000 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3377/6644] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:34:59 2022] GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:35:00.592086 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-671a590a-4f64-4d67-88c8-b83ed3588ce2 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:00.594472 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-671a590a-4f64-4d67-88c8-b83ed3588ce2 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:00.601368 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-671a590a-4f64-4d67-88c8-b83ed3588ce2 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:00.601816 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-671a590a-4f64-4d67-88c8-b83ed3588ce2 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:00.602600 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-671a590a-4f64-4d67-88c8-b83ed3588ce2 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:00.603049 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-671a590a-4f64-4d67-88c8-b83ed3588ce2 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:00.634438 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-671a590a-4f64-4d67-88c8-b83ed3588ce2 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047403 Aug 04 17:35:00.634650 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3268/6645] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:35:00 2022] GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:35:01.648903 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2e28b89b-c8ff-439e-9676-6f4b788a35f7 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:01.651243 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2e28b89b-c8ff-439e-9676-6f4b788a35f7 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:01.659239 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e28b89b-c8ff-439e-9676-6f4b788a35f7 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:01.659686 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e28b89b-c8ff-439e-9676-6f4b788a35f7 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:01.660529 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e28b89b-c8ff-439e-9676-6f4b788a35f7 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:01.660960 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2e28b89b-c8ff-439e-9676-6f4b788a35f7 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:01.697094 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2e28b89b-c8ff-439e-9676-6f4b788a35f7 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053205 Aug 04 17:35:01.698266 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3378/6646] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:35:01 2022] GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:35:02.710340 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6d9ca593-df9e-43f4-9a24-a890fb2ec346 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:02.712643 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6d9ca593-df9e-43f4-9a24-a890fb2ec346 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:02.719629 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d9ca593-df9e-43f4-9a24-a890fb2ec346 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:02.720085 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d9ca593-df9e-43f4-9a24-a890fb2ec346 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:02.721055 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d9ca593-df9e-43f4-9a24-a890fb2ec346 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:02.721526 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d9ca593-df9e-43f4-9a24-a890fb2ec346 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:02.753964 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6d9ca593-df9e-43f4-9a24-a890fb2ec346 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047699 Aug 04 17:35:02.754448 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3269/6647] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:35:02 2022] GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:35:03.766935 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a80c9416-5829-449c-bb50-4f7d82514973 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:03.769122 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a80c9416-5829-449c-bb50-4f7d82514973 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:03.777883 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a80c9416-5829-449c-bb50-4f7d82514973 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:03.778326 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a80c9416-5829-449c-bb50-4f7d82514973 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:03.779092 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a80c9416-5829-449c-bb50-4f7d82514973 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:03.779518 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a80c9416-5829-449c-bb50-4f7d82514973 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:03.812830 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a80c9416-5829-449c-bb50-4f7d82514973 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049937 Aug 04 17:35:03.813648 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3379/6648] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:35:03 2022] GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:35:04.827440 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-04674c66-5d12-4c93-93f6-466359ae8ce6 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:04.830435 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-04674c66-5d12-4c93-93f6-466359ae8ce6 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:04.841009 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-04674c66-5d12-4c93-93f6-466359ae8ce6 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:04.841736 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-04674c66-5d12-4c93-93f6-466359ae8ce6 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:04.842793 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-04674c66-5d12-4c93-93f6-466359ae8ce6 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:04.843472 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-04674c66-5d12-4c93-93f6-466359ae8ce6 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:04.876572 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-04674c66-5d12-4c93-93f6-466359ae8ce6 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055503 Aug 04 17:35:04.877363 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3270/6649] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:35:04 2022] GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:35:04.889645 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6119f736-aec6-48b3-aab4-ddd73cae71ef tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:04.890207 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6119f736-aec6-48b3-aab4-ddd73cae71ef tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:04.896527 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6119f736-aec6-48b3-aab4-ddd73cae71ef tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:04.897389 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6119f736-aec6-48b3-aab4-ddd73cae71ef tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:04.898361 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6119f736-aec6-48b3-aab4-ddd73cae71ef tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:04.898791 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6119f736-aec6-48b3-aab4-ddd73cae71ef tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:04.986743 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-6119f736-aec6-48b3-aab4-ddd73cae71ef tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] HTTP exception thrown: Instance 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4 is not attached to volume 6f9695ef-3a81-417b-9793-6998b06b4451 Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6119f736-aec6-48b3-aab4-ddd73cae71ef tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Request method failure captured: Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4/os-volume_attachments/6f9695ef-3a81-417b-9793-6998b06b4451 HTTP/1.1 Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi7AMllbzwO0-85hyxs6xZP6t2CokgfKPbf7hozwO3ONekzw0p1bIsH2xFTpBN25bgB-F24rjsV1EeRKEzDu3F86NYo_EbWWXbhnVo5Emg3YDaXa9wLo8c6iR4P5bdGdTtCybw-8yRHlsMlRICtd5MI0Wij2lurx9KrOxEtR03Ie-gQys Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: c1d5eb8380434e358cf156e5fd9875ac Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1095111522 Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c1d5eb8380434e358cf156e5fd9875ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c1d5eb8380434e358cf156e5fd9875ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c1d5eb8380434e358cf156e5fd9875ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c1d5eb8380434e358cf156e5fd9875ac"}]}] Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-TestEncryptedCinderVolumes-1095111522 Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: c1d5eb8380434e358cf156e5fd9875ac Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1095111522 Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-TestEncryptedCinderVolumes-1095111522-project Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 872e40e56b12400a97e44f8a47376a5b Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-TestEncryptedCinderVolumes-1095111522-project Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4 is not attached to volume 6f9695ef-3a81-417b-9793-6998b06b4451 Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'server_id': '573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4', 'id': '6f9695ef-3a81-417b-9793-6998b06b4451'} Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6f9695ef-3a81-417b-9793-6998b06b4451. Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4 is not attached to volume 6f9695ef-3a81-417b-9793-6998b06b4451 Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:35:05.004302 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:35:05.008579 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:35:05.008579 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:35:05.008579 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4 is not attached to volume 6f9695ef-3a81-417b-9793-6998b06b4451 Aug 04 17:35:05.008579 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:35:05.008579 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6119f736-aec6-48b3-aab4-ddd73cae71ef tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Returning 404 to user: Instance 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4 is not attached to volume 6f9695ef-3a81-417b-9793-6998b06b4451 {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:35:05.008579 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6119f736-aec6-48b3-aab4-ddd73cae71ef tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "DELETE /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4/os-volume_attachments/6f9695ef-3a81-417b-9793-6998b06b4451" status: 404 len: 154 microversion: 2.1 time: 0.122050 Aug 04 17:35:05.008579 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3380/6650] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Aug 4 17:35:04 2022] DELETE /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4/os-volume_attachments/6f9695ef-3a81-417b-9793-6998b06b4451 => generated 154 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:35:08.391429 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3dfd66d4-1d06-4888-92e9-cfe98e6b0c21 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:08.391964 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3dfd66d4-1d06-4888-92e9-cfe98e6b0c21 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:08.401417 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3dfd66d4-1d06-4888-92e9-cfe98e6b0c21 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:08.401881 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3dfd66d4-1d06-4888-92e9-cfe98e6b0c21 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:08.402661 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3dfd66d4-1d06-4888-92e9-cfe98e6b0c21 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:08.403305 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3dfd66d4-1d06-4888-92e9-cfe98e6b0c21 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:08.430289 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3dfd66d4-1d06-4888-92e9-cfe98e6b0c21 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:35:08.521354 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3dfd66d4-1d06-4888-92e9-cfe98e6b0c21 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "DELETE /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4" status: 204 len: 0 microversion: 2.1 time: 0.134392 Aug 04 17:35:08.522391 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3271/6651] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:35:08 2022] DELETE /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:35:08.531323 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0b7493ad-12f4-4e13-9856-2e14a3b67237 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:08.532054 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0b7493ad-12f4-4e13-9856-2e14a3b67237 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:08.540603 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0b7493ad-12f4-4e13-9856-2e14a3b67237 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:08.541600 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0b7493ad-12f4-4e13-9856-2e14a3b67237 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:08.542495 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0b7493ad-12f4-4e13-9856-2e14a3b67237 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:08.542610 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0b7493ad-12f4-4e13-9856-2e14a3b67237 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:08.682543 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0b7493ad-12f4-4e13-9856-2e14a3b67237 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:08.690516 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0b7493ad-12f4-4e13-9856-2e14a3b67237 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4" status: 200 len: 1559 microversion: 2.1 time: 0.163197 Aug 04 17:35:08.691082 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3381/6652] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:08 2022] GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:35:09.714617 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1ad6c9f0-8914-422b-9b30-c84107fe5a5a tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:09.715319 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1ad6c9f0-8914-422b-9b30-c84107fe5a5a tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:09.722705 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1ad6c9f0-8914-422b-9b30-c84107fe5a5a tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:09.723163 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1ad6c9f0-8914-422b-9b30-c84107fe5a5a tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:09.723926 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1ad6c9f0-8914-422b-9b30-c84107fe5a5a tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:09.724367 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1ad6c9f0-8914-422b-9b30-c84107fe5a5a tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:09.864620 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1ad6c9f0-8914-422b-9b30-c84107fe5a5a tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:09.872730 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1ad6c9f0-8914-422b-9b30-c84107fe5a5a tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4" status: 200 len: 1559 microversion: 2.1 time: 0.162945 Aug 04 17:35:09.873310 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3272/6653] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:09 2022] GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:10.772349 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-bca8080a-aad7-423a-9351-e676794feb95 req-44e67e39-a1f9-4f58-8e55-71563cc8a220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4", "name": "network-vif-deleted", "tag": "bbca399d-2078-4b63-8664-a2abcdb71a5e"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:35:10.790519 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-bca8080a-aad7-423a-9351-e676794feb95 req-44e67e39-a1f9-4f58-8e55-71563cc8a220 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:10.791305 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-bca8080a-aad7-423a-9351-e676794feb95 req-44e67e39-a1f9-4f58-8e55-71563cc8a220 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:10.804907 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-bca8080a-aad7-423a-9351-e676794feb95 req-44e67e39-a1f9-4f58-8e55-71563cc8a220 service nova] Creating event network-vif-deleted:bbca399d-2078-4b63-8664-a2abcdb71a5e for instance 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4 on n-h1-846466-12 Aug 04 17:35:10.810708 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-bca8080a-aad7-423a-9351-e676794feb95 req-44e67e39-a1f9-4f58-8e55-71563cc8a220 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042018 Aug 04 17:35:10.811689 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3382/6654] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:35:10.902227 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9bf6319a-f78b-4bf6-b409-05906c4b1de5 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:10.902762 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9bf6319a-f78b-4bf6-b409-05906c4b1de5 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:10.912246 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9bf6319a-f78b-4bf6-b409-05906c4b1de5 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:10.912740 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9bf6319a-f78b-4bf6-b409-05906c4b1de5 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:10.913572 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9bf6319a-f78b-4bf6-b409-05906c4b1de5 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:10.914020 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9bf6319a-f78b-4bf6-b409-05906c4b1de5 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:10.950796 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9bf6319a-f78b-4bf6-b409-05906c4b1de5 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:10.951269 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9bf6319a-f78b-4bf6-b409-05906c4b1de5 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:10.951729 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-9bf6319a-f78b-4bf6-b409-05906c4b1de5 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lazy-loading 'fault' on Instance uuid 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:35:11.001130 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9bf6319a-f78b-4bf6-b409-05906c4b1de5 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:11.009603 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9bf6319a-f78b-4bf6-b409-05906c4b1de5 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4" status: 200 len: 1352 microversion: 2.1 time: 0.112600 Aug 04 17:35:11.010197 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3273/6655] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:10 2022] GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4 => generated 1352 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:12.041025 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-04ae9c9d-1842-433a-9c81-39be69e62210 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:12.041785 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-04ae9c9d-1842-433a-9c81-39be69e62210 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:12.048749 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-04ae9c9d-1842-433a-9c81-39be69e62210 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:12.049200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-04ae9c9d-1842-433a-9c81-39be69e62210 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:12.050018 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-04ae9c9d-1842-433a-9c81-39be69e62210 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:12.050456 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-04ae9c9d-1842-433a-9c81-39be69e62210 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:12.064474 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-04ae9c9d-1842-433a-9c81-39be69e62210 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] HTTP exception thrown: Instance 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4 could not be found. Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-04ae9c9d-1842-433a-9c81-39be69e62210 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Request method failure captured: Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4 HTTP/1.1 Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi7AMllbzwO0-85hyxs6xZP6t2CokgfKPbf7hozwO3ONekzw0p1bIsH2xFTpBN25bgB-F24rjsV1EeRKEzDu3F86NYo_EbWWXbhnVo5Emg3YDaXa9wLo8c6iR4P5bdGdTtCybw-8yRHlsMlRICtd5MI0Wij2lurx9KrOxEtR03Ie-gQys Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: c1d5eb8380434e358cf156e5fd9875ac Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1095111522 Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c1d5eb8380434e358cf156e5fd9875ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c1d5eb8380434e358cf156e5fd9875ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c1d5eb8380434e358cf156e5fd9875ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c1d5eb8380434e358cf156e5fd9875ac"}]}] Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-TestEncryptedCinderVolumes-1095111522 Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: c1d5eb8380434e358cf156e5fd9875ac Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1095111522 Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-TestEncryptedCinderVolumes-1095111522-project Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 872e40e56b12400a97e44f8a47376a5b Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-TestEncryptedCinderVolumes-1095111522-project Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4 could not be found. Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4'} Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4 could not be found. Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4 could not be found. Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:35:12.066245 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:35:12.069712 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:35:12.069712 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:35:12.069712 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:35:12.069712 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:35:12.069712 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:35:12.069712 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:35:12.069712 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4 could not be found. Aug 04 17:35:12.069712 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:35:12.069712 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-04ae9c9d-1842-433a-9c81-39be69e62210 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Returning 404 to user: Instance 573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:35:12.069712 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-04ae9c9d-1842-433a-9c81-39be69e62210 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4" status: 404 len: 111 microversion: 2.1 time: 0.031986 Aug 04 17:35:12.069712 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3383/6656] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:12 2022] GET /compute/v2.1/servers/573e0f06-2d9b-4c1b-a2d3-f5d536cce2c4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:35:12.076967 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0f8834c2-ea94-4be3-9fa6-e1ea612d2b38 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '.version_select at 0x7f7e84897d30>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:12.101024 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0f8834c2-ea94-4be3-9fa6-e1ea612d2b38 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1871063145" status: 202 len: 0 microversion: 2.1 time: 0.027670 Aug 04 17:35:12.102116 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3274/6657] 10.222.0.23 () {58 vars in 1278 bytes} [Thu Aug 4 17:35:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1871063145 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:35:12.122978 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3893faab-3880-45d4-b483-fd8c26c42d1d tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Action: 'create', calling method: .version_select at 0x7f7e8409f940>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1049951329", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEIsWlYnq1Q/Hs25VVf+f+pDXrR3pGF/hCP5W9yICiozIl5WYGAtEj8+rz7YFzom8XJgggtMzhSDfdLklDBOmXzc9vWMryyfP8dFopZ/2110n54h059sOYJc2DeLG0NLg=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:35:12.140126 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-3893faab-3880-45d4-b483-fd8c26c42d1d tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Getting quotas for project c1d5eb8380434e358cf156e5fd9875ac. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:35:12.145467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-3893faab-3880-45d4-b483-fd8c26c42d1d tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Getting quotas for user 872e40e56b12400a97e44f8a47376a5b and project c1d5eb8380434e358cf156e5fd9875ac. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:35:12.173353 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3893faab-3880-45d4-b483-fd8c26c42d1d tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.054503 Aug 04 17:35:12.173950 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3384/6658] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 17:35:12 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:35:12.230890 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1fddbd2d-535e-4752-a432-651bbc269d38 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-634747354", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1049951329", "networks": [{"uuid": "4d0275f4-43da-4c97-829d-89e5c87992ff"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:35:12.289508 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-1fddbd2d-535e-4752-a432-651bbc269d38 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] validate_networks() for [('4d0275f4-43da-4c97-829d-89e5c87992ff', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:35:12.680421 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-1fddbd2d-535e-4752-a432-651bbc269d38 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:35:12.681245 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-1fddbd2d-535e-4752-a432-651bbc269d38 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:35:12.681757 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-1fddbd2d-535e-4752-a432-651bbc269d38 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:35:12.682185 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-1fddbd2d-535e-4752-a432-651bbc269d38 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:35:12.682605 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-1fddbd2d-535e-4752-a432-651bbc269d38 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:35:12.692438 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1fddbd2d-535e-4752-a432-651bbc269d38 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:12.692907 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1fddbd2d-535e-4752-a432-651bbc269d38 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:12.693749 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1fddbd2d-535e-4752-a432-651bbc269d38 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:12.694220 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1fddbd2d-535e-4752-a432-651bbc269d38 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:12.713809 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-1fddbd2d-535e-4752-a432-651bbc269d38 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Getting quotas for project c1d5eb8380434e358cf156e5fd9875ac. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:35:12.719324 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-1fddbd2d-535e-4752-a432-651bbc269d38 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Getting quotas for user 872e40e56b12400a97e44f8a47376a5b and project c1d5eb8380434e358cf156e5fd9875ac. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:35:12.734953 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1fddbd2d-535e-4752-a432-651bbc269d38 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:35:12.737342 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1fddbd2d-535e-4752-a432-651bbc269d38 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:35:12.786500 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1fddbd2d-535e-4752-a432-651bbc269d38 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.560006 Aug 04 17:35:12.787168 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3275/6659] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:35:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:35:12.798435 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c42e2ae7-28a5-4fb5-a21c-f7b1b5166656 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:12.799085 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c42e2ae7-28a5-4fb5-a21c-f7b1b5166656 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:12.855350 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c42e2ae7-28a5-4fb5-a21c-f7b1b5166656 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:12.862536 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c42e2ae7-28a5-4fb5-a21c-f7b1b5166656 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8" status: 200 len: 1262 microversion: 2.1 time: 0.068119 Aug 04 17:35:12.863148 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3385/6660] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:12 2022] GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8 => generated 1262 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:13.885943 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6530041c-8f29-46c2-bc90-a5959c12b947 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:13.886687 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6530041c-8f29-46c2-bc90-a5959c12b947 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:13.894467 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6530041c-8f29-46c2-bc90-a5959c12b947 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:13.894925 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6530041c-8f29-46c2-bc90-a5959c12b947 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:13.895718 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6530041c-8f29-46c2-bc90-a5959c12b947 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:13.896161 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6530041c-8f29-46c2-bc90-a5959c12b947 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:13.965646 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6530041c-8f29-46c2-bc90-a5959c12b947 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:13.975341 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6530041c-8f29-46c2-bc90-a5959c12b947 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8" status: 200 len: 1314 microversion: 2.1 time: 0.094446 Aug 04 17:35:13.976310 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3276/6661] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:13 2022] GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8 => generated 1314 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:14.999929 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-22f88478-68fc-4466-a05c-7f298d8598af tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:15.000534 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-22f88478-68fc-4466-a05c-7f298d8598af tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:15.008042 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-22f88478-68fc-4466-a05c-7f298d8598af tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:15.008498 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-22f88478-68fc-4466-a05c-7f298d8598af tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:15.009275 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-22f88478-68fc-4466-a05c-7f298d8598af tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:15.009785 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-22f88478-68fc-4466-a05c-7f298d8598af tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:15.154617 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-22f88478-68fc-4466-a05c-7f298d8598af tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:15.163676 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-22f88478-68fc-4466-a05c-7f298d8598af tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8" status: 200 len: 1362 microversion: 2.1 time: 0.167678 Aug 04 17:35:15.164276 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3386/6662] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:14 2022] GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:15.396208 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-d58e70d8-0f85-4d93-866a-335290bcaea6 req-9c3e861b-2271-4370-9bdf-b7431d45337d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "905e2c02-c0ed-45a3-b8b6-26aa077bfdb8", "tag": "34f28b3f-6149-403b-bea0-e6c451fd111b"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:35:15.409040 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-d58e70d8-0f85-4d93-866a-335290bcaea6 req-9c3e861b-2271-4370-9bdf-b7431d45337d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:15.409559 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-d58e70d8-0f85-4d93-866a-335290bcaea6 req-9c3e861b-2271-4370-9bdf-b7431d45337d service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:15.434360 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-d58e70d8-0f85-4d93-866a-335290bcaea6 req-9c3e861b-2271-4370-9bdf-b7431d45337d service nova] Creating event network-changed:34f28b3f-6149-403b-bea0-e6c451fd111b for instance 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8 on n-h2-846466-12 Aug 04 17:35:15.439658 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-d58e70d8-0f85-4d93-866a-335290bcaea6 req-9c3e861b-2271-4370-9bdf-b7431d45337d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047683 Aug 04 17:35:15.440504 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3277/6663] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:35:16.188510 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-24cb433e-5e3f-48e2-a5b2-58c4a517cb05 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:16.192799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-24cb433e-5e3f-48e2-a5b2-58c4a517cb05 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:16.196845 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-24cb433e-5e3f-48e2-a5b2-58c4a517cb05 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:16.197306 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-24cb433e-5e3f-48e2-a5b2-58c4a517cb05 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:16.198138 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-24cb433e-5e3f-48e2-a5b2-58c4a517cb05 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:16.198571 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-24cb433e-5e3f-48e2-a5b2-58c4a517cb05 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:16.343808 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-24cb433e-5e3f-48e2-a5b2-58c4a517cb05 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:16.352024 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-24cb433e-5e3f-48e2-a5b2-58c4a517cb05 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8" status: 200 len: 1362 microversion: 2.1 time: 0.169077 Aug 04 17:35:16.352676 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3387/6664] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:16 2022] GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:17.374992 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bfc0f792-f082-40c1-afc8-cbe1ee52fa33 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:17.375700 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bfc0f792-f082-40c1-afc8-cbe1ee52fa33 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:17.383929 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bfc0f792-f082-40c1-afc8-cbe1ee52fa33 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:17.383929 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bfc0f792-f082-40c1-afc8-cbe1ee52fa33 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:17.384611 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bfc0f792-f082-40c1-afc8-cbe1ee52fa33 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:17.385007 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bfc0f792-f082-40c1-afc8-cbe1ee52fa33 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:17.544226 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bfc0f792-f082-40c1-afc8-cbe1ee52fa33 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:17.555489 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bfc0f792-f082-40c1-afc8-cbe1ee52fa33 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8" status: 200 len: 1362 microversion: 2.1 time: 0.185421 Aug 04 17:35:17.556172 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3278/6665] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:17 2022] GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8 => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:35:18.581646 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b9bcf630-db2f-4197-b464-9559b37dbd32 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:18.582232 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b9bcf630-db2f-4197-b464-9559b37dbd32 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:18.590018 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b9bcf630-db2f-4197-b464-9559b37dbd32 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:18.590469 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b9bcf630-db2f-4197-b464-9559b37dbd32 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:18.591253 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b9bcf630-db2f-4197-b464-9559b37dbd32 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:18.591685 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b9bcf630-db2f-4197-b464-9559b37dbd32 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:18.738368 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b9bcf630-db2f-4197-b464-9559b37dbd32 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:18.747285 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b9bcf630-db2f-4197-b464-9559b37dbd32 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8" status: 200 len: 1362 microversion: 2.1 time: 0.169650 Aug 04 17:35:18.747903 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3388/6666] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:18 2022] GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:19.769500 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e3e7b560-546d-4ffc-9b6e-8229ad8ec02a tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:19.770030 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e3e7b560-546d-4ffc-9b6e-8229ad8ec02a tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:19.778248 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e3e7b560-546d-4ffc-9b6e-8229ad8ec02a tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:19.778934 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e3e7b560-546d-4ffc-9b6e-8229ad8ec02a tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:19.779743 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e3e7b560-546d-4ffc-9b6e-8229ad8ec02a tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:19.780182 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e3e7b560-546d-4ffc-9b6e-8229ad8ec02a tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:19.933094 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e3e7b560-546d-4ffc-9b6e-8229ad8ec02a tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:19.944317 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e3e7b560-546d-4ffc-9b6e-8229ad8ec02a tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8" status: 200 len: 1362 microversion: 2.1 time: 0.178659 Aug 04 17:35:19.945118 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3279/6667] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:19 2022] GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:20.499713 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-cc13c807-fee6-4653-b105-b98b7bbfa204 req-4031b90a-108c-4707-b458-48b6ae59166b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "905e2c02-c0ed-45a3-b8b6-26aa077bfdb8", "name": "network-vif-plugged", "status": "completed", "tag": "34f28b3f-6149-403b-bea0-e6c451fd111b"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:35:20.516051 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-cc13c807-fee6-4653-b105-b98b7bbfa204 req-4031b90a-108c-4707-b458-48b6ae59166b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:20.517577 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-cc13c807-fee6-4653-b105-b98b7bbfa204 req-4031b90a-108c-4707-b458-48b6ae59166b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:20.531543 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-cc13c807-fee6-4653-b105-b98b7bbfa204 req-4031b90a-108c-4707-b458-48b6ae59166b service nova] Creating event network-vif-plugged:34f28b3f-6149-403b-bea0-e6c451fd111b for instance 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8 on n-h2-846466-12 Aug 04 17:35:20.536894 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-cc13c807-fee6-4653-b105-b98b7bbfa204 req-4031b90a-108c-4707-b458-48b6ae59166b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040868 Aug 04 17:35:20.537762 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3389/6668] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:35:20.966863 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5221e739-be81-4394-9211-99cbbee2a319 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:20.967637 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5221e739-be81-4394-9211-99cbbee2a319 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:20.975168 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5221e739-be81-4394-9211-99cbbee2a319 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:20.975680 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5221e739-be81-4394-9211-99cbbee2a319 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:20.976412 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5221e739-be81-4394-9211-99cbbee2a319 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:20.976858 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5221e739-be81-4394-9211-99cbbee2a319 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:21.126023 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5221e739-be81-4394-9211-99cbbee2a319 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:21.137546 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5221e739-be81-4394-9211-99cbbee2a319 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8" status: 200 len: 1362 microversion: 2.1 time: 0.175176 Aug 04 17:35:21.138330 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3280/6669] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:20 2022] GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:22.168394 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5fd274cd-f954-4103-a377-76f234d65161 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:22.169090 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5fd274cd-f954-4103-a377-76f234d65161 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:22.176966 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5fd274cd-f954-4103-a377-76f234d65161 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:22.177450 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5fd274cd-f954-4103-a377-76f234d65161 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:22.178233 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5fd274cd-f954-4103-a377-76f234d65161 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:22.178664 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5fd274cd-f954-4103-a377-76f234d65161 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:22.328286 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5fd274cd-f954-4103-a377-76f234d65161 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:22.336684 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5fd274cd-f954-4103-a377-76f234d65161 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8" status: 200 len: 1554 microversion: 2.1 time: 0.173980 Aug 04 17:35:22.337300 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3390/6670] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:22 2022] GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8 => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:22.358235 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4757e188-1136-41dd-bb5a-c9cf88be539f tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:22.358898 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4757e188-1136-41dd-bb5a-c9cf88be539f tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:22.366906 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4757e188-1136-41dd-bb5a-c9cf88be539f tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:22.367365 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4757e188-1136-41dd-bb5a-c9cf88be539f tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:22.368198 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4757e188-1136-41dd-bb5a-c9cf88be539f tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:22.369216 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4757e188-1136-41dd-bb5a-c9cf88be539f tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:22.517850 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4757e188-1136-41dd-bb5a-c9cf88be539f tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:22.526797 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4757e188-1136-41dd-bb5a-c9cf88be539f tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8" status: 200 len: 1554 microversion: 2.1 time: 0.172630 Aug 04 17:35:22.527399 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3281/6671] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:22 2022] GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8 => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:35:24.083459 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-16035701-6d3a-40a0-b8c2-9085806c53d4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76c43e41-df5a-4adf-a16e-bea726235d53"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:35:24.085999 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-16035701-6d3a-40a0-b8c2-9085806c53d4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:24.088114 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:35:24.095208 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-16035701-6d3a-40a0-b8c2-9085806c53d4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:24.095553 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-16035701-6d3a-40a0-b8c2-9085806c53d4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:24.096404 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-16035701-6d3a-40a0-b8c2-9085806c53d4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:24.096832 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-16035701-6d3a-40a0-b8c2-9085806c53d4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:24.428282 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-16035701-6d3a-40a0-b8c2-9085806c53d4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "POST /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.348644 Aug 04 17:35:24.429415 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3391/6672] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Aug 4 17:35:24 2022] POST /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8/os-volume_attachments => generated 194 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:35:35.192735 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d45526d3-054e-404d-8f7f-2da074e934a6 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:35.193341 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d45526d3-054e-404d-8f7f-2da074e934a6 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:35.195581 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:35:35.196275 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:35:35.197001 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:35:35.197702 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:35:35.203953 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d45526d3-054e-404d-8f7f-2da074e934a6 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:35.204434 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d45526d3-054e-404d-8f7f-2da074e934a6 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:35.205202 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d45526d3-054e-404d-8f7f-2da074e934a6 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:35.205666 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d45526d3-054e-404d-8f7f-2da074e934a6 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:35.393133 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-d45526d3-054e-404d-8f7f-2da074e934a6 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lazy-loading 'services' on Instance uuid 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:35:35.490338 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d45526d3-054e-404d-8f7f-2da074e934a6 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "DELETE /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8/os-volume_attachments/76c43e41-df5a-4adf-a16e-bea726235d53" status: 202 len: 0 microversion: 2.1 time: 0.303011 Aug 04 17:35:35.490927 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3282/6673] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Aug 4 17:35:35 2022] DELETE /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8/os-volume_attachments/76c43e41-df5a-4adf-a16e-bea726235d53 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:35:35.503428 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1401e34f-9838-4544-bd43-546678e97c39 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:35.506656 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1401e34f-9838-4544-bd43-546678e97c39 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:35.509800 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:35:35.510578 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:35:35.518037 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1401e34f-9838-4544-bd43-546678e97c39 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:35.518515 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1401e34f-9838-4544-bd43-546678e97c39 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:35.519373 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1401e34f-9838-4544-bd43-546678e97c39 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:35.520009 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1401e34f-9838-4544-bd43-546678e97c39 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:35.559692 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1401e34f-9838-4544-bd43-546678e97c39 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062253 Aug 04 17:35:35.560271 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3392/6674] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:35:35 2022] GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:35:36.573390 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f0437679-8ed6-47c8-afb1-e148564ccdf7 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:36.575902 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f0437679-8ed6-47c8-afb1-e148564ccdf7 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:36.583489 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f0437679-8ed6-47c8-afb1-e148564ccdf7 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:36.584016 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f0437679-8ed6-47c8-afb1-e148564ccdf7 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:36.584826 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f0437679-8ed6-47c8-afb1-e148564ccdf7 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:36.585275 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f0437679-8ed6-47c8-afb1-e148564ccdf7 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:36.617392 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f0437679-8ed6-47c8-afb1-e148564ccdf7 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048518 Aug 04 17:35:36.618175 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3283/6675] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:35:36 2022] GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:35:37.632128 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-633964e9-7796-4d82-84fb-3c33e3cd2b75 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:37.635389 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-633964e9-7796-4d82-84fb-3c33e3cd2b75 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:37.643284 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-633964e9-7796-4d82-84fb-3c33e3cd2b75 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:37.643711 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-633964e9-7796-4d82-84fb-3c33e3cd2b75 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:37.644640 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-633964e9-7796-4d82-84fb-3c33e3cd2b75 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:37.645179 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-633964e9-7796-4d82-84fb-3c33e3cd2b75 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:37.679550 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-633964e9-7796-4d82-84fb-3c33e3cd2b75 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050564 Aug 04 17:35:37.680190 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3393/6676] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:35:37 2022] GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:35:38.692554 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8764fb87-5baf-4f4d-b4dd-4c8c894678a4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:38.695150 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8764fb87-5baf-4f4d-b4dd-4c8c894678a4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:38.702778 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8764fb87-5baf-4f4d-b4dd-4c8c894678a4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:38.703208 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8764fb87-5baf-4f4d-b4dd-4c8c894678a4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:38.704133 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8764fb87-5baf-4f4d-b4dd-4c8c894678a4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:38.704562 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8764fb87-5baf-4f4d-b4dd-4c8c894678a4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:38.737574 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8764fb87-5baf-4f4d-b4dd-4c8c894678a4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049197 Aug 04 17:35:38.738176 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3284/6677] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:35:38 2022] GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:35:39.751015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d8768b8a-bdab-4de7-8a53-fe06f67819fb tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:39.753370 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d8768b8a-bdab-4de7-8a53-fe06f67819fb tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:39.762046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d8768b8a-bdab-4de7-8a53-fe06f67819fb tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:39.762573 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d8768b8a-bdab-4de7-8a53-fe06f67819fb tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:39.763347 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d8768b8a-bdab-4de7-8a53-fe06f67819fb tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:39.763770 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d8768b8a-bdab-4de7-8a53-fe06f67819fb tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:39.799750 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d8768b8a-bdab-4de7-8a53-fe06f67819fb tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052850 Aug 04 17:35:39.800325 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3394/6678] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:35:39 2022] GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:35:40.811956 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-07cdf393-d3ac-4087-81f8-dec2deafb496 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:40.814277 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-07cdf393-d3ac-4087-81f8-dec2deafb496 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:40.822561 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-07cdf393-d3ac-4087-81f8-dec2deafb496 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:40.823015 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-07cdf393-d3ac-4087-81f8-dec2deafb496 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:40.823803 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-07cdf393-d3ac-4087-81f8-dec2deafb496 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:40.824241 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-07cdf393-d3ac-4087-81f8-dec2deafb496 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:40.856216 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-07cdf393-d3ac-4087-81f8-dec2deafb496 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048071 Aug 04 17:35:40.856923 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3285/6679] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:35:40 2022] GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:35:40.870056 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7d2d15c9-b732-4bc9-a1e3-ede3f1981d6a tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:40.870624 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7d2d15c9-b732-4bc9-a1e3-ede3f1981d6a tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:40.877784 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d2d15c9-b732-4bc9-a1e3-ede3f1981d6a tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:40.878237 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d2d15c9-b732-4bc9-a1e3-ede3f1981d6a tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:40.879002 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d2d15c9-b732-4bc9-a1e3-ede3f1981d6a tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:40.879440 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d2d15c9-b732-4bc9-a1e3-ede3f1981d6a tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:40.962207 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-7d2d15c9-b732-4bc9-a1e3-ede3f1981d6a tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] HTTP exception thrown: Instance 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8 is not attached to volume 76c43e41-df5a-4adf-a16e-bea726235d53 Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7d2d15c9-b732-4bc9-a1e3-ede3f1981d6a tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Request method failure captured: Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8/os-volume_attachments/76c43e41-df5a-4adf-a16e-bea726235d53 HTTP/1.1 Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi7AMllbzwO0-85hyxs6xZP6t2CokgfKPbf7hozwO3ONekzw0p1bIsH2xFTpBN25bgB-F24rjsV1EeRKEzDu3F86NYo_EbWWXbhnVo5Emg3YDaXa9wLo8c6iR4P5bdGdTtCybw-8yRHlsMlRICtd5MI0Wij2lurx9KrOxEtR03Ie-gQys Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: c1d5eb8380434e358cf156e5fd9875ac Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1095111522 Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c1d5eb8380434e358cf156e5fd9875ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c1d5eb8380434e358cf156e5fd9875ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c1d5eb8380434e358cf156e5fd9875ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c1d5eb8380434e358cf156e5fd9875ac"}]}] Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-TestEncryptedCinderVolumes-1095111522 Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: c1d5eb8380434e358cf156e5fd9875ac Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1095111522 Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-TestEncryptedCinderVolumes-1095111522-project Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 872e40e56b12400a97e44f8a47376a5b Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-TestEncryptedCinderVolumes-1095111522-project Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8 is not attached to volume 76c43e41-df5a-4adf-a16e-bea726235d53 Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'server_id': '905e2c02-c0ed-45a3-b8b6-26aa077bfdb8', 'id': '76c43e41-df5a-4adf-a16e-bea726235d53'} Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 76c43e41-df5a-4adf-a16e-bea726235d53. Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8 is not attached to volume 76c43e41-df5a-4adf-a16e-bea726235d53 Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:35:40.963831 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:35:40.968295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:35:40.968295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:35:40.968295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8 is not attached to volume 76c43e41-df5a-4adf-a16e-bea726235d53 Aug 04 17:35:40.968295 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:35:40.968295 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7d2d15c9-b732-4bc9-a1e3-ede3f1981d6a tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Returning 404 to user: Instance 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8 is not attached to volume 76c43e41-df5a-4adf-a16e-bea726235d53 {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:35:40.968295 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7d2d15c9-b732-4bc9-a1e3-ede3f1981d6a tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "DELETE /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8/os-volume_attachments/76c43e41-df5a-4adf-a16e-bea726235d53" status: 404 len: 154 microversion: 2.1 time: 0.099746 Aug 04 17:35:40.968295 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3395/6680] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Aug 4 17:35:40 2022] DELETE /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8/os-volume_attachments/76c43e41-df5a-4adf-a16e-bea726235d53 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:35:44.388798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-56b174fa-41e4-4527-b726-3116b7774c18 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:44.389572 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-56b174fa-41e4-4527-b726-3116b7774c18 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:44.398137 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-56b174fa-41e4-4527-b726-3116b7774c18 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:44.398544 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-56b174fa-41e4-4527-b726-3116b7774c18 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:44.399341 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-56b174fa-41e4-4527-b726-3116b7774c18 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:44.399788 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-56b174fa-41e4-4527-b726-3116b7774c18 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:44.427238 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-56b174fa-41e4-4527-b726-3116b7774c18 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:35:44.523461 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-56b174fa-41e4-4527-b726-3116b7774c18 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "DELETE /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8" status: 204 len: 0 microversion: 2.1 time: 0.138249 Aug 04 17:35:44.524509 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3286/6681] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:35:44 2022] DELETE /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:35:44.533060 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e8af363a-f134-482b-b1b7-7fb9aca488b3 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:44.533728 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e8af363a-f134-482b-b1b7-7fb9aca488b3 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:44.542312 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e8af363a-f134-482b-b1b7-7fb9aca488b3 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:44.542858 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e8af363a-f134-482b-b1b7-7fb9aca488b3 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:44.543693 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e8af363a-f134-482b-b1b7-7fb9aca488b3 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:44.544222 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e8af363a-f134-482b-b1b7-7fb9aca488b3 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:44.689623 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e8af363a-f134-482b-b1b7-7fb9aca488b3 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:44.697955 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e8af363a-f134-482b-b1b7-7fb9aca488b3 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8" status: 200 len: 1560 microversion: 2.1 time: 0.168751 Aug 04 17:35:44.698562 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3396/6682] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:44 2022] GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:45.723290 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-50f6df0f-1c2d-46c9-bffa-a2cb3895607f tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:45.724077 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-50f6df0f-1c2d-46c9-bffa-a2cb3895607f tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:45.732741 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-50f6df0f-1c2d-46c9-bffa-a2cb3895607f tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:45.733179 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-50f6df0f-1c2d-46c9-bffa-a2cb3895607f tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:45.734006 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-50f6df0f-1c2d-46c9-bffa-a2cb3895607f tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:45.734452 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-50f6df0f-1c2d-46c9-bffa-a2cb3895607f tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:45.918954 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-50f6df0f-1c2d-46c9-bffa-a2cb3895607f tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:45.927643 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-50f6df0f-1c2d-46c9-bffa-a2cb3895607f tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8" status: 200 len: 1560 microversion: 2.1 time: 0.210935 Aug 04 17:35:45.928725 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3287/6683] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:45 2022] GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8 => generated 1560 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:46.673163 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-8ed3df37-8382-47ce-95c3-ec83f8eb5a2e req-9b539781-f032-4522-8461-47a6ec2d74bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "905e2c02-c0ed-45a3-b8b6-26aa077bfdb8", "name": "network-vif-deleted", "tag": "34f28b3f-6149-403b-bea0-e6c451fd111b"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:35:46.685801 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-8ed3df37-8382-47ce-95c3-ec83f8eb5a2e req-9b539781-f032-4522-8461-47a6ec2d74bf service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:46.686365 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-8ed3df37-8382-47ce-95c3-ec83f8eb5a2e req-9b539781-f032-4522-8461-47a6ec2d74bf service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:46.700984 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-8ed3df37-8382-47ce-95c3-ec83f8eb5a2e req-9b539781-f032-4522-8461-47a6ec2d74bf service nova] Creating event network-vif-deleted:34f28b3f-6149-403b-bea0-e6c451fd111b for instance 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8 on n-h2-846466-12 Aug 04 17:35:46.708463 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-8ed3df37-8382-47ce-95c3-ec83f8eb5a2e req-9b539781-f032-4522-8461-47a6ec2d74bf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038961 Aug 04 17:35:46.709166 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3397/6684] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:35:46.950543 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b6d4e562-eab2-4434-b535-a08f8c017326 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:46.951099 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b6d4e562-eab2-4434-b535-a08f8c017326 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:46.958701 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b6d4e562-eab2-4434-b535-a08f8c017326 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:46.959938 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b6d4e562-eab2-4434-b535-a08f8c017326 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:46.960746 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b6d4e562-eab2-4434-b535-a08f8c017326 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:46.961202 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b6d4e562-eab2-4434-b535-a08f8c017326 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:46.997098 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b6d4e562-eab2-4434-b535-a08f8c017326 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:46.997584 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b6d4e562-eab2-4434-b535-a08f8c017326 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:46.998055 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-b6d4e562-eab2-4434-b535-a08f8c017326 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lazy-loading 'fault' on Instance uuid 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:35:47.045487 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b6d4e562-eab2-4434-b535-a08f8c017326 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:47.054705 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b6d4e562-eab2-4434-b535-a08f8c017326 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8" status: 200 len: 1352 microversion: 2.1 time: 0.108126 Aug 04 17:35:47.055307 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3288/6685] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:46 2022] GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8 => generated 1352 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:48.084508 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7acb5a52-5676-4755-9f8a-68abe1289794 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:48.085225 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7acb5a52-5676-4755-9f8a-68abe1289794 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:48.094841 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7acb5a52-5676-4755-9f8a-68abe1289794 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:48.095482 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7acb5a52-5676-4755-9f8a-68abe1289794 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:48.096670 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7acb5a52-5676-4755-9f8a-68abe1289794 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:48.097105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7acb5a52-5676-4755-9f8a-68abe1289794 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:48.112070 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-7acb5a52-5676-4755-9f8a-68abe1289794 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] HTTP exception thrown: Instance 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8 could not be found. Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7acb5a52-5676-4755-9f8a-68abe1289794 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Request method failure captured: Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8 HTTP/1.1 Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi7AMllbzwO0-85hyxs6xZP6t2CokgfKPbf7hozwO3ONekzw0p1bIsH2xFTpBN25bgB-F24rjsV1EeRKEzDu3F86NYo_EbWWXbhnVo5Emg3YDaXa9wLo8c6iR4P5bdGdTtCybw-8yRHlsMlRICtd5MI0Wij2lurx9KrOxEtR03Ie-gQys Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: c1d5eb8380434e358cf156e5fd9875ac Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1095111522 Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c1d5eb8380434e358cf156e5fd9875ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c1d5eb8380434e358cf156e5fd9875ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c1d5eb8380434e358cf156e5fd9875ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c1d5eb8380434e358cf156e5fd9875ac"}]}] Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-TestEncryptedCinderVolumes-1095111522 Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: c1d5eb8380434e358cf156e5fd9875ac Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1095111522 Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-TestEncryptedCinderVolumes-1095111522-project Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 872e40e56b12400a97e44f8a47376a5b Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-TestEncryptedCinderVolumes-1095111522-project Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8 could not be found. Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '905e2c02-c0ed-45a3-b8b6-26aa077bfdb8'} Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8 could not be found. Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8 could not be found. Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:35:48.113814 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:35:48.117513 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:35:48.117513 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:35:48.117513 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:35:48.117513 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:35:48.117513 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:35:48.117513 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:35:48.117513 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8 could not be found. Aug 04 17:35:48.117513 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:35:48.117513 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7acb5a52-5676-4755-9f8a-68abe1289794 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Returning 404 to user: Instance 905e2c02-c0ed-45a3-b8b6-26aa077bfdb8 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:35:48.117513 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7acb5a52-5676-4755-9f8a-68abe1289794 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8" status: 404 len: 111 microversion: 2.1 time: 0.038635 Aug 04 17:35:48.117513 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3398/6686] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:48 2022] GET /compute/v2.1/servers/905e2c02-c0ed-45a3-b8b6-26aa077bfdb8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:35:48.124815 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a7966542-2b16-414f-9315-d0e081a004e9 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '.version_select at 0x7f7e77e120d0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:48.156290 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a7966542-2b16-414f-9315-d0e081a004e9 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1049951329" status: 202 len: 0 microversion: 2.1 time: 0.035262 Aug 04 17:35:48.157058 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3289/6687] 10.222.0.23 () {58 vars in 1278 bytes} [Thu Aug 4 17:35:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1049951329 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:35:48.177704 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-95f699d8-497a-448d-bd03-2784613ba67b tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Action: 'create', calling method: .version_select at 0x7f7e841aee50>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1085831663", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXifD+2ie+8XIieY6i9PwyKwaFn+EYpyB0/i68ZTXh7Og6bu6Ib3NCweBehfdQEFNyKQR2nrbOomU2z40hZXpImlEDAvrUY/6hkwJRRF8aU3Dxevsp50afJk4ZPQ2P6uw=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:35:48.193966 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-95f699d8-497a-448d-bd03-2784613ba67b tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Getting quotas for project c1d5eb8380434e358cf156e5fd9875ac. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:35:48.199131 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-95f699d8-497a-448d-bd03-2784613ba67b tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Getting quotas for user 872e40e56b12400a97e44f8a47376a5b and project c1d5eb8380434e358cf156e5fd9875ac. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:35:48.226784 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-95f699d8-497a-448d-bd03-2784613ba67b tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.053314 Aug 04 17:35:48.227543 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3399/6688] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 17:35:48 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:35:48.284790 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9eb895fc-af8f-4fc1-8af3-9922626830c5 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1184559271", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1085831663", "networks": [{"uuid": "4d0275f4-43da-4c97-829d-89e5c87992ff"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:35:48.346032 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-9eb895fc-af8f-4fc1-8af3-9922626830c5 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] validate_networks() for [('4d0275f4-43da-4c97-829d-89e5c87992ff', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:35:48.777690 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9eb895fc-af8f-4fc1-8af3-9922626830c5 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:35:48.778119 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9eb895fc-af8f-4fc1-8af3-9922626830c5 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:35:48.778601 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9eb895fc-af8f-4fc1-8af3-9922626830c5 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:35:48.779013 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9eb895fc-af8f-4fc1-8af3-9922626830c5 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:35:48.779434 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-9eb895fc-af8f-4fc1-8af3-9922626830c5 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:35:48.789451 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9eb895fc-af8f-4fc1-8af3-9922626830c5 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:48.789909 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9eb895fc-af8f-4fc1-8af3-9922626830c5 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:48.790711 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9eb895fc-af8f-4fc1-8af3-9922626830c5 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:48.791152 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9eb895fc-af8f-4fc1-8af3-9922626830c5 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:48.809447 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-9eb895fc-af8f-4fc1-8af3-9922626830c5 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Getting quotas for project c1d5eb8380434e358cf156e5fd9875ac. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:35:48.815290 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-9eb895fc-af8f-4fc1-8af3-9922626830c5 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Getting quotas for user 872e40e56b12400a97e44f8a47376a5b and project c1d5eb8380434e358cf156e5fd9875ac. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:35:48.830163 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9eb895fc-af8f-4fc1-8af3-9922626830c5 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:35:48.832520 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9eb895fc-af8f-4fc1-8af3-9922626830c5 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: d94601b4-2f81-4fc1-ac70-caf59343cb62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:35:48.881170 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9eb895fc-af8f-4fc1-8af3-9922626830c5 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.601658 Aug 04 17:35:48.882186 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3290/6689] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:35:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:35:48.893125 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-da58e602-e008-45cf-9cfd-862309206ef2 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:48.893786 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-da58e602-e008-45cf-9cfd-862309206ef2 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: d94601b4-2f81-4fc1-ac70-caf59343cb62] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:48.951000 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-da58e602-e008-45cf-9cfd-862309206ef2 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:48.958652 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-da58e602-e008-45cf-9cfd-862309206ef2 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62" status: 200 len: 1263 microversion: 2.1 time: 0.069456 Aug 04 17:35:48.959276 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3400/6690] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:48 2022] GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62 => generated 1263 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:49.981856 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-afe69450-77d3-43d9-980c-9c953e0ee37c tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:49.984310 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-afe69450-77d3-43d9-980c-9c953e0ee37c tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: d94601b4-2f81-4fc1-ac70-caf59343cb62] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:49.992509 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-afe69450-77d3-43d9-980c-9c953e0ee37c tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:49.993388 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-afe69450-77d3-43d9-980c-9c953e0ee37c tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:49.994399 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-afe69450-77d3-43d9-980c-9c953e0ee37c tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:49.995042 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-afe69450-77d3-43d9-980c-9c953e0ee37c tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:50.066918 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-afe69450-77d3-43d9-980c-9c953e0ee37c tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:50.075592 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-afe69450-77d3-43d9-980c-9c953e0ee37c tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62" status: 200 len: 1323 microversion: 2.1 time: 0.099262 Aug 04 17:35:50.076185 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3291/6691] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:49 2022] GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62 => generated 1323 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:51.098486 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ba6849b4-86ae-4d07-9f29-eaaf09f10880 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:51.099023 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ba6849b4-86ae-4d07-9f29-eaaf09f10880 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: d94601b4-2f81-4fc1-ac70-caf59343cb62] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:51.106641 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba6849b4-86ae-4d07-9f29-eaaf09f10880 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:51.107093 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba6849b4-86ae-4d07-9f29-eaaf09f10880 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:51.107853 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba6849b4-86ae-4d07-9f29-eaaf09f10880 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:51.108301 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba6849b4-86ae-4d07-9f29-eaaf09f10880 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:51.249488 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ba6849b4-86ae-4d07-9f29-eaaf09f10880 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:51.258247 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ba6849b4-86ae-4d07-9f29-eaaf09f10880 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62" status: 200 len: 1363 microversion: 2.1 time: 0.163538 Aug 04 17:35:51.259501 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3401/6692] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:51 2022] GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:51.390158 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-787ed012-69f5-4019-abac-49ff016ded16 req-d7035e17-0c31-4220-ab8f-eb2e112b1837 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d94601b4-2f81-4fc1-ac70-caf59343cb62", "tag": "26206044-f1eb-4384-8470-017820a0d579"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:35:51.404703 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-787ed012-69f5-4019-abac-49ff016ded16 req-d7035e17-0c31-4220-ab8f-eb2e112b1837 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:51.405089 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-787ed012-69f5-4019-abac-49ff016ded16 req-d7035e17-0c31-4220-ab8f-eb2e112b1837 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:51.418969 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-787ed012-69f5-4019-abac-49ff016ded16 req-d7035e17-0c31-4220-ab8f-eb2e112b1837 service nova] Creating event network-changed:26206044-f1eb-4384-8470-017820a0d579 for instance d94601b4-2f81-4fc1-ac70-caf59343cb62 on n-h2-846466-12 Aug 04 17:35:51.424731 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-787ed012-69f5-4019-abac-49ff016ded16 req-d7035e17-0c31-4220-ab8f-eb2e112b1837 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039696 Aug 04 17:35:51.425378 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3292/6693] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:35:52.282722 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bebc2c38-dfb0-4bce-86c4-20c9eef9280e tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:52.283362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bebc2c38-dfb0-4bce-86c4-20c9eef9280e tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: d94601b4-2f81-4fc1-ac70-caf59343cb62] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:52.292657 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bebc2c38-dfb0-4bce-86c4-20c9eef9280e tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:52.293091 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bebc2c38-dfb0-4bce-86c4-20c9eef9280e tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:52.293904 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bebc2c38-dfb0-4bce-86c4-20c9eef9280e tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:52.294342 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bebc2c38-dfb0-4bce-86c4-20c9eef9280e tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:52.446053 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bebc2c38-dfb0-4bce-86c4-20c9eef9280e tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:52.453968 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bebc2c38-dfb0-4bce-86c4-20c9eef9280e tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62" status: 200 len: 1363 microversion: 2.1 time: 0.177217 Aug 04 17:35:52.454549 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3402/6694] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:52 2022] GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:53.477320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a5bb2d01-b063-4ca2-aa05-8e1a183a6c88 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:53.478034 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a5bb2d01-b063-4ca2-aa05-8e1a183a6c88 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: d94601b4-2f81-4fc1-ac70-caf59343cb62] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:53.488114 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a5bb2d01-b063-4ca2-aa05-8e1a183a6c88 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:53.488943 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a5bb2d01-b063-4ca2-aa05-8e1a183a6c88 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:53.490315 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a5bb2d01-b063-4ca2-aa05-8e1a183a6c88 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:53.490884 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a5bb2d01-b063-4ca2-aa05-8e1a183a6c88 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:53.654510 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a5bb2d01-b063-4ca2-aa05-8e1a183a6c88 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:53.666544 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a5bb2d01-b063-4ca2-aa05-8e1a183a6c88 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62" status: 200 len: 1363 microversion: 2.1 time: 0.193886 Aug 04 17:35:53.667138 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3293/6695] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:53 2022] GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:54.688687 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f7928e45-8d75-496e-a868-5b0a6e2e0df2 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:54.689238 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f7928e45-8d75-496e-a868-5b0a6e2e0df2 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: d94601b4-2f81-4fc1-ac70-caf59343cb62] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:54.697508 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f7928e45-8d75-496e-a868-5b0a6e2e0df2 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:54.697961 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f7928e45-8d75-496e-a868-5b0a6e2e0df2 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:54.699492 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f7928e45-8d75-496e-a868-5b0a6e2e0df2 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:54.699936 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f7928e45-8d75-496e-a868-5b0a6e2e0df2 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:54.837149 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f7928e45-8d75-496e-a868-5b0a6e2e0df2 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:54.844838 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f7928e45-8d75-496e-a868-5b0a6e2e0df2 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62" status: 200 len: 1363 microversion: 2.1 time: 0.160309 Aug 04 17:35:54.845452 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3403/6696] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:54 2022] GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:55.867983 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a6054318-987f-43aa-a009-188d00bc9914 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:55.868624 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a6054318-987f-43aa-a009-188d00bc9914 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: d94601b4-2f81-4fc1-ac70-caf59343cb62] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:55.876310 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6054318-987f-43aa-a009-188d00bc9914 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:55.876783 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6054318-987f-43aa-a009-188d00bc9914 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:55.877597 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6054318-987f-43aa-a009-188d00bc9914 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:55.878053 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a6054318-987f-43aa-a009-188d00bc9914 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:56.028426 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a6054318-987f-43aa-a009-188d00bc9914 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:56.037634 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a6054318-987f-43aa-a009-188d00bc9914 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62" status: 200 len: 1363 microversion: 2.1 time: 0.174481 Aug 04 17:35:56.038192 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3294/6697] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:55 2022] GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:56.808691 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-77630aa2-0464-4488-afda-bc96b81ac277 req-fa16a78b-fc0b-4449-948a-d9c622a230ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d94601b4-2f81-4fc1-ac70-caf59343cb62", "name": "network-vif-plugged", "status": "completed", "tag": "26206044-f1eb-4384-8470-017820a0d579"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:35:56.820405 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-77630aa2-0464-4488-afda-bc96b81ac277 req-fa16a78b-fc0b-4449-948a-d9c622a230ac service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:56.820849 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-77630aa2-0464-4488-afda-bc96b81ac277 req-fa16a78b-fc0b-4449-948a-d9c622a230ac service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:56.833521 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-77630aa2-0464-4488-afda-bc96b81ac277 req-fa16a78b-fc0b-4449-948a-d9c622a230ac service nova] Creating event network-vif-plugged:26206044-f1eb-4384-8470-017820a0d579 for instance d94601b4-2f81-4fc1-ac70-caf59343cb62 on n-h2-846466-12 Aug 04 17:35:56.838878 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-77630aa2-0464-4488-afda-bc96b81ac277 req-fa16a78b-fc0b-4449-948a-d9c622a230ac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096756 Aug 04 17:35:56.839500 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3404/6698] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:35:57.058368 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-697a3a3a-c79a-4a6a-a13f-f5c5d6fae1d8 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:57.058957 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-697a3a3a-c79a-4a6a-a13f-f5c5d6fae1d8 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: d94601b4-2f81-4fc1-ac70-caf59343cb62] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:57.066840 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-697a3a3a-c79a-4a6a-a13f-f5c5d6fae1d8 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:57.067613 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-697a3a3a-c79a-4a6a-a13f-f5c5d6fae1d8 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:57.068560 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-697a3a3a-c79a-4a6a-a13f-f5c5d6fae1d8 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:57.068762 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-697a3a3a-c79a-4a6a-a13f-f5c5d6fae1d8 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:57.216629 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-697a3a3a-c79a-4a6a-a13f-f5c5d6fae1d8 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:57.224711 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-697a3a3a-c79a-4a6a-a13f-f5c5d6fae1d8 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62" status: 200 len: 1363 microversion: 2.1 time: 0.170348 Aug 04 17:35:57.225361 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3295/6699] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:57 2022] GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:58.248155 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e4f06431-514d-44e8-ae2f-737e3549e1d1 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:58.248851 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e4f06431-514d-44e8-ae2f-737e3549e1d1 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: d94601b4-2f81-4fc1-ac70-caf59343cb62] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:58.256464 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e4f06431-514d-44e8-ae2f-737e3549e1d1 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:58.256909 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e4f06431-514d-44e8-ae2f-737e3549e1d1 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:58.258176 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e4f06431-514d-44e8-ae2f-737e3549e1d1 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:58.258590 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e4f06431-514d-44e8-ae2f-737e3549e1d1 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:58.424230 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e4f06431-514d-44e8-ae2f-737e3549e1d1 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:58.432358 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e4f06431-514d-44e8-ae2f-737e3549e1d1 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62" status: 200 len: 1555 microversion: 2.1 time: 0.189623 Aug 04 17:35:58.432903 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3405/6700] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:58 2022] GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62 => generated 1555 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:58.454393 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-76ff97cc-e606-4bdc-a7c9-e20ddd605ac3 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:58.455181 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-76ff97cc-e606-4bdc-a7c9-e20ddd605ac3 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: d94601b4-2f81-4fc1-ac70-caf59343cb62] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:58.462519 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-76ff97cc-e606-4bdc-a7c9-e20ddd605ac3 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:58.462983 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-76ff97cc-e606-4bdc-a7c9-e20ddd605ac3 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:58.463768 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-76ff97cc-e606-4bdc-a7c9-e20ddd605ac3 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:35:58.464210 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-76ff97cc-e606-4bdc-a7c9-e20ddd605ac3 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:35:58.605319 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-76ff97cc-e606-4bdc-a7c9-e20ddd605ac3 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:58.613213 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-76ff97cc-e606-4bdc-a7c9-e20ddd605ac3 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62" status: 200 len: 1555 microversion: 2.1 time: 0.162988 Aug 04 17:35:58.613828 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3296/6701] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:58 2022] GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:36:00.144274 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5374c235-9a48-4e3d-af8a-7f35b53691ea tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acef8ee3-7e18-4bfa-b9d5-11c9e1eed31c"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:36:00.146942 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5374c235-9a48-4e3d-af8a-7f35b53691ea tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: d94601b4-2f81-4fc1-ac70-caf59343cb62] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:36:00.149617 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:36:00.156548 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5374c235-9a48-4e3d-af8a-7f35b53691ea tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:00.156994 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5374c235-9a48-4e3d-af8a-7f35b53691ea tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:00.157904 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5374c235-9a48-4e3d-af8a-7f35b53691ea tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:00.158462 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5374c235-9a48-4e3d-af8a-7f35b53691ea tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:00.437447 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5374c235-9a48-4e3d-af8a-7f35b53691ea tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "POST /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297099 Aug 04 17:36:00.443477 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3406/6702] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Aug 4 17:36:00 2022] POST /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:36:11.225170 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6dc48255-262f-4ae6-b345-18bd252f9bd4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:36:11.225781 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6dc48255-262f-4ae6-b345-18bd252f9bd4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: d94601b4-2f81-4fc1-ac70-caf59343cb62] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:36:11.227693 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:36:11.228389 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:36:11.230245 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:36:11.231166 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:36:11.238707 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6dc48255-262f-4ae6-b345-18bd252f9bd4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:11.239180 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6dc48255-262f-4ae6-b345-18bd252f9bd4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:11.239957 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6dc48255-262f-4ae6-b345-18bd252f9bd4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:11.240396 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6dc48255-262f-4ae6-b345-18bd252f9bd4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:11.338141 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-6dc48255-262f-4ae6-b345-18bd252f9bd4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lazy-loading 'services' on Instance uuid d94601b4-2f81-4fc1-ac70-caf59343cb62 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:36:11.419342 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6dc48255-262f-4ae6-b345-18bd252f9bd4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62/os-volume_attachments/acef8ee3-7e18-4bfa-b9d5-11c9e1eed31c" status: 202 len: 0 microversion: 2.1 time: 0.198068 Aug 04 17:36:11.420061 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3297/6703] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Aug 4 17:36:11 2022] DELETE /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62/os-volume_attachments/acef8ee3-7e18-4bfa-b9d5-11c9e1eed31c => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:36:11.430470 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a8947a1c-b8dd-4c85-b57f-9a958b1af1b3 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:36:11.432965 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a8947a1c-b8dd-4c85-b57f-9a958b1af1b3 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: d94601b4-2f81-4fc1-ac70-caf59343cb62] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:36:11.436583 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:36:11.437407 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:36:11.444241 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8947a1c-b8dd-4c85-b57f-9a958b1af1b3 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:11.444763 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8947a1c-b8dd-4c85-b57f-9a958b1af1b3 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:11.445786 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8947a1c-b8dd-4c85-b57f-9a958b1af1b3 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:11.446218 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a8947a1c-b8dd-4c85-b57f-9a958b1af1b3 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:11.483945 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a8947a1c-b8dd-4c85-b57f-9a958b1af1b3 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057752 Aug 04 17:36:11.484495 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3407/6704] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:36:11 2022] GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:36:12.498291 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e6cd529b-8787-456c-98ca-9a5decc59341 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:36:12.500876 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e6cd529b-8787-456c-98ca-9a5decc59341 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: d94601b4-2f81-4fc1-ac70-caf59343cb62] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:36:12.507981 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e6cd529b-8787-456c-98ca-9a5decc59341 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:12.508440 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e6cd529b-8787-456c-98ca-9a5decc59341 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:12.509219 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e6cd529b-8787-456c-98ca-9a5decc59341 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:12.509690 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e6cd529b-8787-456c-98ca-9a5decc59341 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:12.542400 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e6cd529b-8787-456c-98ca-9a5decc59341 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049286 Aug 04 17:36:12.547175 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3298/6705] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:36:12 2022] GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:36:13.558195 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b00d47d9-0b89-44b2-9d4b-361a72b8484d tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:36:13.561137 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b00d47d9-0b89-44b2-9d4b-361a72b8484d tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: d94601b4-2f81-4fc1-ac70-caf59343cb62] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:36:13.569625 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b00d47d9-0b89-44b2-9d4b-361a72b8484d tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:13.570070 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b00d47d9-0b89-44b2-9d4b-361a72b8484d tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:13.570848 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b00d47d9-0b89-44b2-9d4b-361a72b8484d tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:13.571277 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b00d47d9-0b89-44b2-9d4b-361a72b8484d tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:13.607971 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b00d47d9-0b89-44b2-9d4b-361a72b8484d tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056478 Aug 04 17:36:13.608644 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3408/6706] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:36:13 2022] GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:36:14.621317 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e42a1056-c38e-4d3f-83d4-b2a5cfff336a tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:36:14.623816 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e42a1056-c38e-4d3f-83d4-b2a5cfff336a tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: d94601b4-2f81-4fc1-ac70-caf59343cb62] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:36:14.631849 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e42a1056-c38e-4d3f-83d4-b2a5cfff336a tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:14.632361 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e42a1056-c38e-4d3f-83d4-b2a5cfff336a tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:14.633163 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e42a1056-c38e-4d3f-83d4-b2a5cfff336a tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:14.633633 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e42a1056-c38e-4d3f-83d4-b2a5cfff336a tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:14.667903 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e42a1056-c38e-4d3f-83d4-b2a5cfff336a tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050616 Aug 04 17:36:14.668460 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3299/6707] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:36:14 2022] GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:36:15.680736 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-662fa11b-9688-4909-ba9a-a183a22c38ad tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:36:15.683058 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-662fa11b-9688-4909-ba9a-a183a22c38ad tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: d94601b4-2f81-4fc1-ac70-caf59343cb62] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:36:15.690662 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-662fa11b-9688-4909-ba9a-a183a22c38ad tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:15.691127 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-662fa11b-9688-4909-ba9a-a183a22c38ad tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:15.691896 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-662fa11b-9688-4909-ba9a-a183a22c38ad tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:15.692327 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-662fa11b-9688-4909-ba9a-a183a22c38ad tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:15.727259 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-662fa11b-9688-4909-ba9a-a183a22c38ad tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050670 Aug 04 17:36:15.727838 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3409/6708] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:36:15 2022] GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:36:16.739958 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-11866899-ddc0-4ac7-80b7-5a73ebac69d0 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:36:16.742353 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-11866899-ddc0-4ac7-80b7-5a73ebac69d0 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: d94601b4-2f81-4fc1-ac70-caf59343cb62] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:36:16.750530 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-11866899-ddc0-4ac7-80b7-5a73ebac69d0 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:16.751092 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-11866899-ddc0-4ac7-80b7-5a73ebac69d0 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:16.751875 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-11866899-ddc0-4ac7-80b7-5a73ebac69d0 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:16.752313 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-11866899-ddc0-4ac7-80b7-5a73ebac69d0 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:16.788749 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-11866899-ddc0-4ac7-80b7-5a73ebac69d0 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052835 Aug 04 17:36:16.789331 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3300/6709] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:36:16 2022] GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:36:16.801259 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-37e39c5d-e530-441e-a9c4-e94281173838 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:36:16.802099 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-37e39c5d-e530-441e-a9c4-e94281173838 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: d94601b4-2f81-4fc1-ac70-caf59343cb62] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:36:16.811570 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-37e39c5d-e530-441e-a9c4-e94281173838 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:16.812038 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-37e39c5d-e530-441e-a9c4-e94281173838 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:16.812946 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-37e39c5d-e530-441e-a9c4-e94281173838 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:16.813469 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-37e39c5d-e530-441e-a9c4-e94281173838 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:16.916897 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-37e39c5d-e530-441e-a9c4-e94281173838 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] HTTP exception thrown: Instance d94601b4-2f81-4fc1-ac70-caf59343cb62 is not attached to volume acef8ee3-7e18-4bfa-b9d5-11c9e1eed31c Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-37e39c5d-e530-441e-a9c4-e94281173838 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Request method failure captured: Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: request: DELETE /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62/os-volume_attachments/acef8ee3-7e18-4bfa-b9d5-11c9e1eed31c HTTP/1.1 Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi7AMllbzwO0-85hyxs6xZP6t2CokgfKPbf7hozwO3ONekzw0p1bIsH2xFTpBN25bgB-F24rjsV1EeRKEzDu3F86NYo_EbWWXbhnVo5Emg3YDaXa9wLo8c6iR4P5bdGdTtCybw-8yRHlsMlRICtd5MI0Wij2lurx9KrOxEtR03Ie-gQys Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: c1d5eb8380434e358cf156e5fd9875ac Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1095111522 Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c1d5eb8380434e358cf156e5fd9875ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c1d5eb8380434e358cf156e5fd9875ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c1d5eb8380434e358cf156e5fd9875ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c1d5eb8380434e358cf156e5fd9875ac"}]}] Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-TestEncryptedCinderVolumes-1095111522 Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: c1d5eb8380434e358cf156e5fd9875ac Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1095111522 Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-TestEncryptedCinderVolumes-1095111522-project Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 872e40e56b12400a97e44f8a47376a5b Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-TestEncryptedCinderVolumes-1095111522-project Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance d94601b4-2f81-4fc1-ac70-caf59343cb62 is not attached to volume acef8ee3-7e18-4bfa-b9d5-11c9e1eed31c Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'server_id': 'd94601b4-2f81-4fc1-ac70-caf59343cb62', 'id': 'acef8ee3-7e18-4bfa-b9d5-11c9e1eed31c'} Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id acef8ee3-7e18-4bfa-b9d5-11c9e1eed31c. Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d94601b4-2f81-4fc1-ac70-caf59343cb62 is not attached to volume acef8ee3-7e18-4bfa-b9d5-11c9e1eed31c Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:36:16.918552 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:36:16.923682 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:36:16.923682 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:36:16.923682 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d94601b4-2f81-4fc1-ac70-caf59343cb62 is not attached to volume acef8ee3-7e18-4bfa-b9d5-11c9e1eed31c Aug 04 17:36:16.923682 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:36:16.923682 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-37e39c5d-e530-441e-a9c4-e94281173838 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Returning 404 to user: Instance d94601b4-2f81-4fc1-ac70-caf59343cb62 is not attached to volume acef8ee3-7e18-4bfa-b9d5-11c9e1eed31c {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:36:16.923682 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-37e39c5d-e530-441e-a9c4-e94281173838 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62/os-volume_attachments/acef8ee3-7e18-4bfa-b9d5-11c9e1eed31c" status: 404 len: 154 microversion: 2.1 time: 0.123089 Aug 04 17:36:16.923682 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3410/6710] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Aug 4 17:36:16 2022] DELETE /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62/os-volume_attachments/acef8ee3-7e18-4bfa-b9d5-11c9e1eed31c => generated 154 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:36:20.286448 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-41fe480e-be39-4a08-bbb3-d3d0cc551fbd tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:36:20.287066 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-41fe480e-be39-4a08-bbb3-d3d0cc551fbd tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: d94601b4-2f81-4fc1-ac70-caf59343cb62] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:36:20.294239 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-41fe480e-be39-4a08-bbb3-d3d0cc551fbd tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:20.294907 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-41fe480e-be39-4a08-bbb3-d3d0cc551fbd tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:20.295666 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-41fe480e-be39-4a08-bbb3-d3d0cc551fbd tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:20.296186 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-41fe480e-be39-4a08-bbb3-d3d0cc551fbd tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:20.321912 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-41fe480e-be39-4a08-bbb3-d3d0cc551fbd tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: d94601b4-2f81-4fc1-ac70-caf59343cb62] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:36:20.406292 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-41fe480e-be39-4a08-bbb3-d3d0cc551fbd tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62" status: 204 len: 0 microversion: 2.1 time: 0.123519 Aug 04 17:36:20.407137 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3301/6711] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:36:20 2022] DELETE /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:36:20.416134 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fc262d3f-99f7-433a-b529-a2e4d2d10cc6 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:36:20.416673 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fc262d3f-99f7-433a-b529-a2e4d2d10cc6 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: d94601b4-2f81-4fc1-ac70-caf59343cb62] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:36:20.424479 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fc262d3f-99f7-433a-b529-a2e4d2d10cc6 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:20.425010 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fc262d3f-99f7-433a-b529-a2e4d2d10cc6 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:20.425877 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fc262d3f-99f7-433a-b529-a2e4d2d10cc6 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:20.426365 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fc262d3f-99f7-433a-b529-a2e4d2d10cc6 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:20.570616 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fc262d3f-99f7-433a-b529-a2e4d2d10cc6 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:36:20.579018 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fc262d3f-99f7-433a-b529-a2e4d2d10cc6 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62" status: 200 len: 1561 microversion: 2.1 time: 0.167048 Aug 04 17:36:20.579597 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3411/6712] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:36:20 2022] GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:36:21.603876 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-22ce5572-4872-4670-95e0-5fe104504c5c tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:36:21.604555 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-22ce5572-4872-4670-95e0-5fe104504c5c tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: d94601b4-2f81-4fc1-ac70-caf59343cb62] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:36:21.614522 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-22ce5572-4872-4670-95e0-5fe104504c5c tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:21.615143 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-22ce5572-4872-4670-95e0-5fe104504c5c tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:21.616255 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-22ce5572-4872-4670-95e0-5fe104504c5c tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:21.616861 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-22ce5572-4872-4670-95e0-5fe104504c5c tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:21.760018 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-22ce5572-4872-4670-95e0-5fe104504c5c tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:36:21.771885 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-22ce5572-4872-4670-95e0-5fe104504c5c tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62" status: 200 len: 1561 microversion: 2.1 time: 0.174093 Aug 04 17:36:21.773015 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3302/6713] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:36:21 2022] GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62 => generated 1561 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:36:22.489642 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-09d8b8e4-48d7-4985-87ea-7f9c6c06e1c5 req-1b76dea8-6eda-4543-8c6f-d041a11c7d55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d94601b4-2f81-4fc1-ac70-caf59343cb62", "name": "network-vif-deleted", "tag": "26206044-f1eb-4384-8470-017820a0d579"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:36:22.504252 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-09d8b8e4-48d7-4985-87ea-7f9c6c06e1c5 req-1b76dea8-6eda-4543-8c6f-d041a11c7d55 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:22.504986 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-09d8b8e4-48d7-4985-87ea-7f9c6c06e1c5 req-1b76dea8-6eda-4543-8c6f-d041a11c7d55 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:22.518576 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-09d8b8e4-48d7-4985-87ea-7f9c6c06e1c5 req-1b76dea8-6eda-4543-8c6f-d041a11c7d55 service nova] Creating event network-vif-deleted:26206044-f1eb-4384-8470-017820a0d579 for instance d94601b4-2f81-4fc1-ac70-caf59343cb62 on n-h2-846466-12 Aug 04 17:36:22.526740 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-09d8b8e4-48d7-4985-87ea-7f9c6c06e1c5 req-1b76dea8-6eda-4543-8c6f-d041a11c7d55 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041813 Aug 04 17:36:22.527711 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3412/6714] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:36:22.796684 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8bc8df8a-799a-43f7-a011-39e5be764af7 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:36:22.797452 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8bc8df8a-799a-43f7-a011-39e5be764af7 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: d94601b4-2f81-4fc1-ac70-caf59343cb62] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:36:22.805060 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8bc8df8a-799a-43f7-a011-39e5be764af7 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:22.805536 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8bc8df8a-799a-43f7-a011-39e5be764af7 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:22.806350 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8bc8df8a-799a-43f7-a011-39e5be764af7 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:22.806799 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8bc8df8a-799a-43f7-a011-39e5be764af7 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:22.840441 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8bc8df8a-799a-43f7-a011-39e5be764af7 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:22.840908 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8bc8df8a-799a-43f7-a011-39e5be764af7 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:22.841456 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-8bc8df8a-799a-43f7-a011-39e5be764af7 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lazy-loading 'fault' on Instance uuid d94601b4-2f81-4fc1-ac70-caf59343cb62 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:36:22.887527 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8bc8df8a-799a-43f7-a011-39e5be764af7 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '872e40e56b12400a97e44f8a47376a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d5eb8380434e358cf156e5fd9875ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:36:22.895497 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8bc8df8a-799a-43f7-a011-39e5be764af7 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62" status: 200 len: 1353 microversion: 2.1 time: 0.102897 Aug 04 17:36:22.896319 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3303/6715] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:36:22 2022] GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62 => generated 1353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:36:23.919549 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ea7873be-60c8-4fea-a187-a1989b6528b4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:36:23.920264 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ea7873be-60c8-4fea-a187-a1989b6528b4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] [instance: d94601b4-2f81-4fc1-ac70-caf59343cb62] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:36:23.927280 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ea7873be-60c8-4fea-a187-a1989b6528b4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:23.927724 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ea7873be-60c8-4fea-a187-a1989b6528b4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:23.928485 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ea7873be-60c8-4fea-a187-a1989b6528b4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:23.928913 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ea7873be-60c8-4fea-a187-a1989b6528b4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:23.944236 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-ea7873be-60c8-4fea-a187-a1989b6528b4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] HTTP exception thrown: Instance d94601b4-2f81-4fc1-ac70-caf59343cb62 could not be found. Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ea7873be-60c8-4fea-a187-a1989b6528b4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Request method failure captured: Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62 HTTP/1.1 Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi7AMllbzwO0-85hyxs6xZP6t2CokgfKPbf7hozwO3ONekzw0p1bIsH2xFTpBN25bgB-F24rjsV1EeRKEzDu3F86NYo_EbWWXbhnVo5Emg3YDaXa9wLo8c6iR4P5bdGdTtCybw-8yRHlsMlRICtd5MI0Wij2lurx9KrOxEtR03Ie-gQys Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: c1d5eb8380434e358cf156e5fd9875ac Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1095111522 Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c1d5eb8380434e358cf156e5fd9875ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c1d5eb8380434e358cf156e5fd9875ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c1d5eb8380434e358cf156e5fd9875ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c1d5eb8380434e358cf156e5fd9875ac"}]}] Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-TestEncryptedCinderVolumes-1095111522 Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: c1d5eb8380434e358cf156e5fd9875ac Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1095111522 Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-TestEncryptedCinderVolumes-1095111522-project Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 872e40e56b12400a97e44f8a47376a5b Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-TestEncryptedCinderVolumes-1095111522-project Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance d94601b4-2f81-4fc1-ac70-caf59343cb62 could not be found. Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'd94601b4-2f81-4fc1-ac70-caf59343cb62'} Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d94601b4-2f81-4fc1-ac70-caf59343cb62 could not be found. Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d94601b4-2f81-4fc1-ac70-caf59343cb62 could not be found. Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:36:23.945964 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:36:23.950499 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:36:23.950499 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:36:23.950499 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:36:23.950499 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:36:23.950499 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:36:23.950499 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:36:23.950499 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d94601b4-2f81-4fc1-ac70-caf59343cb62 could not be found. Aug 04 17:36:23.950499 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:36:23.950499 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ea7873be-60c8-4fea-a187-a1989b6528b4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Returning 404 to user: Instance d94601b4-2f81-4fc1-ac70-caf59343cb62 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:36:23.950499 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ea7873be-60c8-4fea-a187-a1989b6528b4 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62" status: 404 len: 111 microversion: 2.1 time: 0.033071 Aug 04 17:36:23.950499 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3413/6716] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:36:23 2022] GET /compute/v2.1/servers/d94601b4-2f81-4fc1-ac70-caf59343cb62 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:36:23.961455 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4f41097e-10a5-4180-b3f4-5f6aeaa0f2d1 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] Calling method '.version_select at 0x7f7e841be1f0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:36:23.989550 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4f41097e-10a5-4180-b3f4-5f6aeaa0f2d1 tempest-TestEncryptedCinderVolumes-1095111522 tempest-TestEncryptedCinderVolumes-1095111522-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1085831663" status: 202 len: 0 microversion: 2.1 time: 0.034831 Aug 04 17:36:23.990157 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3304/6717] 10.222.0.23 () {58 vars in 1278 bytes} [Thu Aug 4 17:36:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1085831663 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:36:51.573205 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7017886d-1f96-43bd-8db1-5675f946b177 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Action: 'create', calling method: .version_select at 0x7f7e847e44c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1113800233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbv0WD8IbW/XT5xXSQInhw5caibFyMPY5EScwnIGoIv/98rtbmcnd9SY+QC/Sw4COePQ94EKh7pf93YauqYU7H07Dchc0UrAiREoJi0e5YVEgt1A+f6hsgb2+vn1N1SiA=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:36:51.580939 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=14 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:36:51.582076 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=34 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:36:51.597153 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-7017886d-1f96-43bd-8db1-5675f946b177 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Getting quotas for project bddca9dabc444e7db049241849b041a1. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:36:51.603105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-7017886d-1f96-43bd-8db1-5675f946b177 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Getting quotas for user 5b122edce41944a09afdc9a84d647536 and project bddca9dabc444e7db049241849b041a1. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:36:51.630845 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7017886d-1f96-43bd-8db1-5675f946b177 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.061635 Aug 04 17:36:51.631429 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3414/6718] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 17:36:51 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:36:51.687720 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:36:51.688800 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:36:51.694441 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fa81de8e-edfb-435d-9c09-e39ade82e6a8 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1098703205", "imageRef": "dcd9b74b-8f69-4758-9a35-43c1ce083294", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1113800233", "networks": [{"uuid": "83214c67-a585-4cd7-907d-d23aeb7cedab"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:36:51.758767 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-fa81de8e-edfb-435d-9c09-e39ade82e6a8 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] validate_networks() for [('83214c67-a585-4cd7-907d-d23aeb7cedab', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:36:52.211148 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-fa81de8e-edfb-435d-9c09-e39ade82e6a8 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:36:52.211578 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-fa81de8e-edfb-435d-9c09-e39ade82e6a8 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:36:52.212023 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-fa81de8e-edfb-435d-9c09-e39ade82e6a8 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:36:52.212676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-fa81de8e-edfb-435d-9c09-e39ade82e6a8 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:36:52.213799 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-fa81de8e-edfb-435d-9c09-e39ade82e6a8 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:36:52.223768 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fa81de8e-edfb-435d-9c09-e39ade82e6a8 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:52.224364 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fa81de8e-edfb-435d-9c09-e39ade82e6a8 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:52.225178 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fa81de8e-edfb-435d-9c09-e39ade82e6a8 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:52.225669 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fa81de8e-edfb-435d-9c09-e39ade82e6a8 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:52.246353 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-fa81de8e-edfb-435d-9c09-e39ade82e6a8 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Getting quotas for project bddca9dabc444e7db049241849b041a1. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:36:52.252435 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-fa81de8e-edfb-435d-9c09-e39ade82e6a8 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Getting quotas for user 5b122edce41944a09afdc9a84d647536 and project bddca9dabc444e7db049241849b041a1. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:36:52.267511 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fa81de8e-edfb-435d-9c09-e39ade82e6a8 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:36:52.269843 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fa81de8e-edfb-435d-9c09-e39ade82e6a8 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dcd9b74b-8f69-4758-9a35-43c1ce083294',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:36:52.320791 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fa81de8e-edfb-435d-9c09-e39ade82e6a8 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.635059 Aug 04 17:36:52.321581 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3305/6719] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:36:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:36:52.338232 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-52d54241-781f-4e57-8140-4fd0859aa777 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:36:52.338851 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-52d54241-781f-4e57-8140-4fd0859aa777 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:36:52.408539 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-52d54241-781f-4e57-8140-4fd0859aa777 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:36:52.415568 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-52d54241-781f-4e57-8140-4fd0859aa777 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42" status: 200 len: 1259 microversion: 2.1 time: 0.081656 Aug 04 17:36:52.416158 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3415/6720] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:36:52 2022] GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42 => generated 1259 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:36:53.439745 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-feb67110-67d3-481e-8e44-e706a1bbb9d9 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:36:53.441100 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-feb67110-67d3-481e-8e44-e706a1bbb9d9 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:36:53.448987 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-feb67110-67d3-481e-8e44-e706a1bbb9d9 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:53.449488 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-feb67110-67d3-481e-8e44-e706a1bbb9d9 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:53.450289 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-feb67110-67d3-481e-8e44-e706a1bbb9d9 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:53.450736 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-feb67110-67d3-481e-8e44-e706a1bbb9d9 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:53.959190 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-feb67110-67d3-481e-8e44-e706a1bbb9d9 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:36:53.984233 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-feb67110-67d3-481e-8e44-e706a1bbb9d9 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42" status: 200 len: 1319 microversion: 2.1 time: 0.549074 Aug 04 17:36:53.986254 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3306/6721] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:36:53 2022] GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42 => generated 1319 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:36:55.023026 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3a3858de-84c8-4e13-81a6-39174f76a37f tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:36:55.023590 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3a3858de-84c8-4e13-81a6-39174f76a37f tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:36:55.032180 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3a3858de-84c8-4e13-81a6-39174f76a37f tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:55.033040 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3a3858de-84c8-4e13-81a6-39174f76a37f tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:55.033823 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3a3858de-84c8-4e13-81a6-39174f76a37f tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:55.034250 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3a3858de-84c8-4e13-81a6-39174f76a37f tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:55.109009 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3a3858de-84c8-4e13-81a6-39174f76a37f tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:36:55.118821 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3a3858de-84c8-4e13-81a6-39174f76a37f tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42" status: 200 len: 1317 microversion: 2.1 time: 0.103074 Aug 04 17:36:55.120153 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3416/6722] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:36:55 2022] GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42 => generated 1317 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:36:56.147323 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c4d9caa8-1950-409c-8f2a-2c175fbd87a9 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:36:56.149244 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c4d9caa8-1950-409c-8f2a-2c175fbd87a9 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:36:56.162742 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4d9caa8-1950-409c-8f2a-2c175fbd87a9 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:56.164879 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4d9caa8-1950-409c-8f2a-2c175fbd87a9 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:56.166619 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4d9caa8-1950-409c-8f2a-2c175fbd87a9 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:56.167619 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4d9caa8-1950-409c-8f2a-2c175fbd87a9 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:56.268644 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c4d9caa8-1950-409c-8f2a-2c175fbd87a9 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:36:56.278557 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c4d9caa8-1950-409c-8f2a-2c175fbd87a9 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42" status: 200 len: 1317 microversion: 2.1 time: 0.139807 Aug 04 17:36:56.279828 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3307/6723] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:36:56 2022] GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42 => generated 1317 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:36:57.311313 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3e680576-b735-471c-b801-7214054ab429 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:36:57.313750 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3e680576-b735-471c-b801-7214054ab429 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:36:57.324111 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3e680576-b735-471c-b801-7214054ab429 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:57.324557 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3e680576-b735-471c-b801-7214054ab429 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:57.325554 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3e680576-b735-471c-b801-7214054ab429 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:57.326094 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3e680576-b735-471c-b801-7214054ab429 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:57.433972 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3e680576-b735-471c-b801-7214054ab429 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:36:57.454536 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3e680576-b735-471c-b801-7214054ab429 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42" status: 200 len: 1317 microversion: 2.1 time: 0.152933 Aug 04 17:36:57.455722 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3417/6724] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:36:57 2022] GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:36:58.479464 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0b01dcca-c422-4454-ba4f-0b7de685d1ae tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:36:58.480457 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0b01dcca-c422-4454-ba4f-0b7de685d1ae tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:36:58.492151 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0b01dcca-c422-4454-ba4f-0b7de685d1ae tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:58.492745 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0b01dcca-c422-4454-ba4f-0b7de685d1ae tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:58.493962 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0b01dcca-c422-4454-ba4f-0b7de685d1ae tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:58.494526 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0b01dcca-c422-4454-ba4f-0b7de685d1ae tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:58.596326 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0b01dcca-c422-4454-ba4f-0b7de685d1ae tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:36:58.611822 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0b01dcca-c422-4454-ba4f-0b7de685d1ae tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42" status: 200 len: 1317 microversion: 2.1 time: 0.137743 Aug 04 17:36:58.625911 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3308/6725] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:36:58 2022] GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:36:59.649789 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-763c2de9-8eab-42e7-b1dc-3fc6d44fec6a tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:36:59.651218 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-763c2de9-8eab-42e7-b1dc-3fc6d44fec6a tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:36:59.664973 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-763c2de9-8eab-42e7-b1dc-3fc6d44fec6a tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:59.665814 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-763c2de9-8eab-42e7-b1dc-3fc6d44fec6a tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:59.667230 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-763c2de9-8eab-42e7-b1dc-3fc6d44fec6a tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:36:59.668014 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-763c2de9-8eab-42e7-b1dc-3fc6d44fec6a tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:36:59.764322 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-763c2de9-8eab-42e7-b1dc-3fc6d44fec6a tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:36:59.776293 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-763c2de9-8eab-42e7-b1dc-3fc6d44fec6a tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42" status: 200 len: 1317 microversion: 2.1 time: 0.135330 Aug 04 17:36:59.776895 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3418/6726] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:36:59 2022] GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42 => generated 1317 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:37:00.813242 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0486a9f3-2bef-4921-b832-ea2770109697 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:37:00.814111 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0486a9f3-2bef-4921-b832-ea2770109697 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:37:00.821709 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0486a9f3-2bef-4921-b832-ea2770109697 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:00.822156 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0486a9f3-2bef-4921-b832-ea2770109697 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:00.823112 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0486a9f3-2bef-4921-b832-ea2770109697 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:00.823592 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0486a9f3-2bef-4921-b832-ea2770109697 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:00.896910 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0486a9f3-2bef-4921-b832-ea2770109697 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:37:00.905765 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0486a9f3-2bef-4921-b832-ea2770109697 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42" status: 200 len: 1317 microversion: 2.1 time: 0.099058 Aug 04 17:37:00.906380 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3309/6727] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:37:00 2022] GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42 => generated 1317 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:37:01.929761 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5362f1c8-cf49-4151-ae08-9c58fcabb42d tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:37:01.930520 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5362f1c8-cf49-4151-ae08-9c58fcabb42d tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:37:01.941441 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5362f1c8-cf49-4151-ae08-9c58fcabb42d tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:01.941898 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5362f1c8-cf49-4151-ae08-9c58fcabb42d tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:01.942763 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5362f1c8-cf49-4151-ae08-9c58fcabb42d tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:01.943199 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5362f1c8-cf49-4151-ae08-9c58fcabb42d tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:02.211707 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5362f1c8-cf49-4151-ae08-9c58fcabb42d tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:37:02.240887 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5362f1c8-cf49-4151-ae08-9c58fcabb42d tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42" status: 200 len: 1359 microversion: 2.1 time: 0.314969 Aug 04 17:37:02.245759 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3419/6728] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:37:01 2022] GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42 => generated 1359 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:37:03.063577 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:37:03.065550 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:37:03.263872 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-17717eff-a5d9-4a3f-98f3-cfe84e086ee3 req-25610023-7441-4edb-8abd-1d8b1a5b76c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d635932e-5842-4d81-96c3-524a0a7ccd42", "tag": "f3a390be-34bc-4dd1-ab06-06f443837447"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:37:03.274844 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-17717eff-a5d9-4a3f-98f3-cfe84e086ee3 req-25610023-7441-4edb-8abd-1d8b1a5b76c2 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:03.275298 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-17717eff-a5d9-4a3f-98f3-cfe84e086ee3 req-25610023-7441-4edb-8abd-1d8b1a5b76c2 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:03.279941 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7eec077f-a46d-42e2-9670-eb7da7595d48 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:37:03.281200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7eec077f-a46d-42e2-9670-eb7da7595d48 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:37:03.284517 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:37:03.290563 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-17717eff-a5d9-4a3f-98f3-cfe84e086ee3 req-25610023-7441-4edb-8abd-1d8b1a5b76c2 service nova] Creating event network-changed:f3a390be-34bc-4dd1-ab06-06f443837447 for instance d635932e-5842-4d81-96c3-524a0a7ccd42 on n-h1-846466-12 Aug 04 17:37:03.290761 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7eec077f-a46d-42e2-9670-eb7da7595d48 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:03.291136 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7eec077f-a46d-42e2-9670-eb7da7595d48 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:03.291926 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7eec077f-a46d-42e2-9670-eb7da7595d48 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:03.292534 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7eec077f-a46d-42e2-9670-eb7da7595d48 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:03.296710 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-17717eff-a5d9-4a3f-98f3-cfe84e086ee3 req-25610023-7441-4edb-8abd-1d8b1a5b76c2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.239521 Aug 04 17:37:03.297747 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3310/6729] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:37:03.531032 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7eec077f-a46d-42e2-9670-eb7da7595d48 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:37:03.539955 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7eec077f-a46d-42e2-9670-eb7da7595d48 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42" status: 200 len: 1359 microversion: 2.1 time: 0.264401 Aug 04 17:37:03.540555 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3420/6730] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:37:03 2022] GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42 => generated 1359 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:37:04.564344 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3ab05867-24e5-4262-9e31-007baea0371d tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:37:04.565162 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3ab05867-24e5-4262-9e31-007baea0371d tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:37:04.572706 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ab05867-24e5-4262-9e31-007baea0371d tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:04.573157 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ab05867-24e5-4262-9e31-007baea0371d tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:04.573952 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ab05867-24e5-4262-9e31-007baea0371d tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:04.574390 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ab05867-24e5-4262-9e31-007baea0371d tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:04.832035 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3ab05867-24e5-4262-9e31-007baea0371d tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:37:04.848427 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3ab05867-24e5-4262-9e31-007baea0371d tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42" status: 200 len: 1359 microversion: 2.1 time: 0.291116 Aug 04 17:37:04.849592 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3311/6731] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:37:04 2022] GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42 => generated 1359 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:37:05.870220 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fe494c0d-3918-4229-805d-268ab2382468 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:37:05.871307 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fe494c0d-3918-4229-805d-268ab2382468 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:37:05.883209 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fe494c0d-3918-4229-805d-268ab2382468 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:05.883786 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fe494c0d-3918-4229-805d-268ab2382468 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:05.884977 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fe494c0d-3918-4229-805d-268ab2382468 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:05.885650 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fe494c0d-3918-4229-805d-268ab2382468 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:06.036067 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fe494c0d-3918-4229-805d-268ab2382468 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:37:06.044230 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fe494c0d-3918-4229-805d-268ab2382468 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42" status: 200 len: 1359 microversion: 2.1 time: 0.178426 Aug 04 17:37:06.044824 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3421/6732] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:37:05 2022] GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:37:07.068036 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-97392672-f02e-440f-a427-fa1150adfd45 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:37:07.068657 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-97392672-f02e-440f-a427-fa1150adfd45 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:37:07.078564 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-97392672-f02e-440f-a427-fa1150adfd45 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:07.079203 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-97392672-f02e-440f-a427-fa1150adfd45 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:07.080208 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-97392672-f02e-440f-a427-fa1150adfd45 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:07.080836 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-97392672-f02e-440f-a427-fa1150adfd45 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:07.231892 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-97392672-f02e-440f-a427-fa1150adfd45 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:37:07.240312 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-97392672-f02e-440f-a427-fa1150adfd45 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42" status: 200 len: 1359 microversion: 2.1 time: 0.177678 Aug 04 17:37:07.240969 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3312/6733] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:37:07 2022] GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:37:08.264364 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6ca8c327-c1ef-4f2e-8aad-efa309325ce3 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:37:08.265844 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6ca8c327-c1ef-4f2e-8aad-efa309325ce3 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:37:08.273979 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6ca8c327-c1ef-4f2e-8aad-efa309325ce3 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:08.274399 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6ca8c327-c1ef-4f2e-8aad-efa309325ce3 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:08.275208 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6ca8c327-c1ef-4f2e-8aad-efa309325ce3 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:08.275653 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6ca8c327-c1ef-4f2e-8aad-efa309325ce3 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:08.445831 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6ca8c327-c1ef-4f2e-8aad-efa309325ce3 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:37:08.456089 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6ca8c327-c1ef-4f2e-8aad-efa309325ce3 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42" status: 200 len: 1359 microversion: 2.1 time: 0.196919 Aug 04 17:37:08.464062 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3422/6734] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:37:08 2022] GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42 => generated 1359 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:37:08.495240 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-6c6b0d67-27e3-4d87-8ca3-2dff2f6d3118 req-e7302f91-901b-4595-947a-67a035d71f72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d635932e-5842-4d81-96c3-524a0a7ccd42", "name": "network-vif-plugged", "status": "completed", "tag": "f3a390be-34bc-4dd1-ab06-06f443837447"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:37:08.508925 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-6c6b0d67-27e3-4d87-8ca3-2dff2f6d3118 req-e7302f91-901b-4595-947a-67a035d71f72 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:08.509276 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-6c6b0d67-27e3-4d87-8ca3-2dff2f6d3118 req-e7302f91-901b-4595-947a-67a035d71f72 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:08.522076 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-6c6b0d67-27e3-4d87-8ca3-2dff2f6d3118 req-e7302f91-901b-4595-947a-67a035d71f72 service nova] Creating event network-vif-plugged:f3a390be-34bc-4dd1-ab06-06f443837447 for instance d635932e-5842-4d81-96c3-524a0a7ccd42 on n-h1-846466-12 Aug 04 17:37:08.527824 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-6c6b0d67-27e3-4d87-8ca3-2dff2f6d3118 req-e7302f91-901b-4595-947a-67a035d71f72 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036871 Aug 04 17:37:08.528451 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3313/6735] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:37:09.478424 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d12b663a-0b4c-4006-893c-978e5181dfd1 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:37:09.479017 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d12b663a-0b4c-4006-893c-978e5181dfd1 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:37:09.486204 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d12b663a-0b4c-4006-893c-978e5181dfd1 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:09.486648 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d12b663a-0b4c-4006-893c-978e5181dfd1 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:09.487514 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d12b663a-0b4c-4006-893c-978e5181dfd1 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:09.488408 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d12b663a-0b4c-4006-893c-978e5181dfd1 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:09.628332 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d12b663a-0b4c-4006-893c-978e5181dfd1 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:37:09.637787 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d12b663a-0b4c-4006-893c-978e5181dfd1 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42" status: 200 len: 1359 microversion: 2.1 time: 0.163224 Aug 04 17:37:09.638361 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3423/6736] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:37:09 2022] GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:37:10.661676 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f5bc91ec-102c-442c-b48d-f6d1a65c5ec3 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:37:10.662409 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f5bc91ec-102c-442c-b48d-f6d1a65c5ec3 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:37:10.669352 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f5bc91ec-102c-442c-b48d-f6d1a65c5ec3 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:10.669816 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f5bc91ec-102c-442c-b48d-f6d1a65c5ec3 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:10.670597 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f5bc91ec-102c-442c-b48d-f6d1a65c5ec3 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:10.671037 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f5bc91ec-102c-442c-b48d-f6d1a65c5ec3 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:10.818288 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f5bc91ec-102c-442c-b48d-f6d1a65c5ec3 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:37:10.826813 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f5bc91ec-102c-442c-b48d-f6d1a65c5ec3 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42" status: 200 len: 1549 microversion: 2.1 time: 0.171014 Aug 04 17:37:10.827442 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3314/6737] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:37:10 2022] GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42 => generated 1549 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:37:10.850210 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c950b79d-3bb9-4366-a0ce-577501e8872e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:37:10.850824 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c950b79d-3bb9-4366-a0ce-577501e8872e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:37:10.858823 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c950b79d-3bb9-4366-a0ce-577501e8872e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:10.859503 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c950b79d-3bb9-4366-a0ce-577501e8872e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:10.860581 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c950b79d-3bb9-4366-a0ce-577501e8872e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:10.861015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c950b79d-3bb9-4366-a0ce-577501e8872e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:11.003146 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c950b79d-3bb9-4366-a0ce-577501e8872e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:37:11.014485 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c950b79d-3bb9-4366-a0ce-577501e8872e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42" status: 200 len: 1549 microversion: 2.1 time: 0.168470 Aug 04 17:37:11.015263 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3424/6738] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:37:10 2022] GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42 => generated 1549 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:37:11.034766 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5325a9ab-2125-43a3-85e2-04362a111af7 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:37:11.040199 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5325a9ab-2125-43a3-85e2-04362a111af7 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:37:11.041093 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5325a9ab-2125-43a3-85e2-04362a111af7 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Searching by: {'deleted': False, 'project_id': 'bddca9dabc444e7db049241849b041a1'} {{(pid=126126) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:37:11.046962 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5325a9ab-2125-43a3-85e2-04362a111af7 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:11.047433 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5325a9ab-2125-43a3-85e2-04362a111af7 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:11.048266 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5325a9ab-2125-43a3-85e2-04362a111af7 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:11.048747 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5325a9ab-2125-43a3-85e2-04362a111af7 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:11.077715 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.multi_cell_list [None req-5325a9ab-2125-43a3-85e2-04362a111af7 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126126) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:37:11.107521 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5325a9ab-2125-43a3-85e2-04362a111af7 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.076602 Aug 04 17:37:11.108139 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3315/6739] 10.222.0.23 () {58 vars in 1125 bytes} [Thu Aug 4 17:37:11 2022] GET /compute/v2.1/servers => generated 343 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:37:11.121943 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f389656d-761e-40fd-a5da-46e6eb080ddb tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:37:11.122530 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f389656d-761e-40fd-a5da-46e6eb080ddb tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:37:11.130786 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f389656d-761e-40fd-a5da-46e6eb080ddb tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:11.130786 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f389656d-761e-40fd-a5da-46e6eb080ddb tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:11.131097 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f389656d-761e-40fd-a5da-46e6eb080ddb tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:11.131272 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f389656d-761e-40fd-a5da-46e6eb080ddb tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:11.280331 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f389656d-761e-40fd-a5da-46e6eb080ddb tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:37:11.288710 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f389656d-761e-40fd-a5da-46e6eb080ddb tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42" status: 200 len: 1549 microversion: 2.1 time: 0.171120 Aug 04 17:37:11.289313 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3425/6740] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:37:11 2022] GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42 => generated 1549 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:37:12.898419 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a276cd7a-719e-4c97-989b-998cf75d0d8a tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fbbeb4fe-c090-42d4-b108-4f5c87b5cacd"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:37:12.900962 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a276cd7a-719e-4c97-989b-998cf75d0d8a tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:37:12.908747 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a276cd7a-719e-4c97-989b-998cf75d0d8a tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:12.909197 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a276cd7a-719e-4c97-989b-998cf75d0d8a tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:12.910017 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a276cd7a-719e-4c97-989b-998cf75d0d8a tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:12.910461 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a276cd7a-719e-4c97-989b-998cf75d0d8a tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:13.200153 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a276cd7a-719e-4c97-989b-998cf75d0d8a tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "POST /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306508 Aug 04 17:37:13.200836 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3316/6741] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Aug 4 17:37:12 2022] POST /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:37:26.399223 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f0df9338-e26d-4ed6-8ad6-dd7c649f26ba tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:37:26.399828 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f0df9338-e26d-4ed6-8ad6-dd7c649f26ba tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:37:26.402098 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:37:26.402751 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=60 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:37:26.408516 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f0df9338-e26d-4ed6-8ad6-dd7c649f26ba tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:26.409160 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f0df9338-e26d-4ed6-8ad6-dd7c649f26ba tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:26.409948 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f0df9338-e26d-4ed6-8ad6-dd7c649f26ba tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:26.410377 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f0df9338-e26d-4ed6-8ad6-dd7c649f26ba tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:26.555298 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f0df9338-e26d-4ed6-8ad6-dd7c649f26ba tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:37:26.568415 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f0df9338-e26d-4ed6-8ad6-dd7c649f26ba tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42" status: 200 len: 1595 microversion: 2.1 time: 0.173557 Aug 04 17:37:26.569312 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3426/6742] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:37:26 2022] GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42 => generated 1595 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:37:28.383173 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-2994535f-82b5-4b02-8543-5c14d2a6ecfd req-8b9510c1-bf4f-46d8-9b85-2ab180a0c75b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d635932e-5842-4d81-96c3-524a0a7ccd42", "tag": "f3a390be-34bc-4dd1-ab06-06f443837447"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:37:28.390533 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:37:28.391719 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:37:28.392366 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:37:28.401480 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-2994535f-82b5-4b02-8543-5c14d2a6ecfd req-8b9510c1-bf4f-46d8-9b85-2ab180a0c75b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:28.402030 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-2994535f-82b5-4b02-8543-5c14d2a6ecfd req-8b9510c1-bf4f-46d8-9b85-2ab180a0c75b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:28.416870 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-2994535f-82b5-4b02-8543-5c14d2a6ecfd req-8b9510c1-bf4f-46d8-9b85-2ab180a0c75b service nova] Creating event network-changed:f3a390be-34bc-4dd1-ab06-06f443837447 for instance d635932e-5842-4d81-96c3-524a0a7ccd42 on n-h1-846466-12 Aug 04 17:37:28.423378 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-2994535f-82b5-4b02-8543-5c14d2a6ecfd req-8b9510c1-bf4f-46d8-9b85-2ab180a0c75b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044606 Aug 04 17:37:28.424649 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3317/6743] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:37:30.134847 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-eed91b6f-ab9e-4e2d-a24a-3ef15910f39f tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1216839715"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:37:30.135428 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-eed91b6f-ab9e-4e2d-a24a-3ef15910f39f tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:37:30.142696 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eed91b6f-ab9e-4e2d-a24a-3ef15910f39f tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:30.143143 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eed91b6f-ab9e-4e2d-a24a-3ef15910f39f tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:30.143978 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eed91b6f-ab9e-4e2d-a24a-3ef15910f39f tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:30.144351 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-eed91b6f-ab9e-4e2d-a24a-3ef15910f39f tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:30.291145 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.network.security_group_api [None req-eed91b6f-ab9e-4e2d-a24a-3ef15910f39f tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Adding security group 61dff319-f1cb-4b6c-bb21-bc5dbc6e32ef to port f3a390be-34bc-4dd1-ab06-06f443837447 Aug 04 17:37:30.641911 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-eed91b6f-ab9e-4e2d-a24a-3ef15910f39f tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "POST /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42/action" status: 202 len: 0 microversion: 2.1 time: 0.512398 Aug 04 17:37:30.642538 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3427/6744] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:37:30 2022] POST /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42/action => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:37:30.655710 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-88e9fa4f-df9d-4d00-af63-9c60cd048088 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:37:30.657117 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-88e9fa4f-df9d-4d00-af63-9c60cd048088 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:37:30.660881 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-142e50da-ccaa-4ae4-b268-8c897e3d9f3c req-0416ec53-b01a-468a-9e0e-4f1aecae3da4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d635932e-5842-4d81-96c3-524a0a7ccd42", "tag": "f3a390be-34bc-4dd1-ab06-06f443837447"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:37:30.664760 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-88e9fa4f-df9d-4d00-af63-9c60cd048088 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:30.666292 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-88e9fa4f-df9d-4d00-af63-9c60cd048088 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:30.667283 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-88e9fa4f-df9d-4d00-af63-9c60cd048088 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:30.667889 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-88e9fa4f-df9d-4d00-af63-9c60cd048088 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:30.673542 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-142e50da-ccaa-4ae4-b268-8c897e3d9f3c req-0416ec53-b01a-468a-9e0e-4f1aecae3da4 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:37:30.674029 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-142e50da-ccaa-4ae4-b268-8c897e3d9f3c req-0416ec53-b01a-468a-9e0e-4f1aecae3da4 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:37:30.696971 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-142e50da-ccaa-4ae4-b268-8c897e3d9f3c req-0416ec53-b01a-468a-9e0e-4f1aecae3da4 service nova] Creating event network-changed:f3a390be-34bc-4dd1-ab06-06f443837447 for instance d635932e-5842-4d81-96c3-524a0a7ccd42 on n-h1-846466-12 Aug 04 17:37:30.703700 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-142e50da-ccaa-4ae4-b268-8c897e3d9f3c req-0416ec53-b01a-468a-9e0e-4f1aecae3da4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047988 Aug 04 17:37:30.706072 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3428/6745] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:37:30.929103 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-88e9fa4f-df9d-4d00-af63-9c60cd048088 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:37:30.938215 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-88e9fa4f-df9d-4d00-af63-9c60cd048088 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42" status: 200 len: 1760 microversion: 2.1 time: 0.288496 Aug 04 17:37:30.938788 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3318/6746] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:37:30 2022] GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42 => generated 1760 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:38:56.032145 n-d-846466-12 devstack@n-api.service[126125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:38:56.032803 n-d-846466-12 devstack@n-api.service[126125]: Thu Aug 4 17:38:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 17:39:09.091261 n-d-846466-12 devstack@n-api.service[126125]: ERROR oslo.messaging._drivers.impl_rabbit [-] [97b8321f-6d0d-4fc2-ae68-3784c532bfbe] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 17:39:09.092480 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:39:09.093240 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=12 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:39:09.098160 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c3dcb59a-2607-41c8-8b2a-8c28a57801d6 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:39:09.100313 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c3dcb59a-2607-41c8-8b2a-8c28a57801d6 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:39:09.108482 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3dcb59a-2607-41c8-8b2a-8c28a57801d6 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:39:09.108936 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3dcb59a-2607-41c8-8b2a-8c28a57801d6 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:39:09.109774 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3dcb59a-2607-41c8-8b2a-8c28a57801d6 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:39:09.110212 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3dcb59a-2607-41c8-8b2a-8c28a57801d6 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:39:09.203254 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c3dcb59a-2607-41c8-8b2a-8c28a57801d6 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "POST /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42/action" status: 202 len: 0 microversion: 2.1 time: 0.113595 Aug 04 17:39:09.203842 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3429/6747] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:39:09 2022] POST /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:39:09.211598 n-d-846466-12 devstack@n-api.service[126126]: ERROR oslo.messaging._drivers.impl_rabbit [-] [37914f2f-7143-4f4b-83fb-439e96d93d23] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 17:39:09.212330 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=4 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:39:09.213099 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=8 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:39:09.217636 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dd9e674b-f44a-44db-af72-a3f4919cf114 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:39:09.223402 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-dd9e674b-f44a-44db-af72-a3f4919cf114 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:39:09.231596 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd9e674b-f44a-44db-af72-a3f4919cf114 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:39:09.232043 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd9e674b-f44a-44db-af72-a3f4919cf114 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:39:09.232872 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd9e674b-f44a-44db-af72-a3f4919cf114 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:39:09.233331 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-dd9e674b-f44a-44db-af72-a3f4919cf114 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:39:09.483403 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-dd9e674b-f44a-44db-af72-a3f4919cf114 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:39:09.495974 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dd9e674b-f44a-44db-af72-a3f4919cf114 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42" status: 200 len: 1762 microversion: 2.1 time: 0.286461 Aug 04 17:39:09.497342 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3319/6748] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:39:09 2022] GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42 => generated 1762 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:39:10.522159 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0cc3bbe3-061c-4166-9895-4ef119eb022d tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:39:10.523200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0cc3bbe3-061c-4166-9895-4ef119eb022d tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:39:10.536538 n-d-846466-12 devstack@n-api.service[126125]: INFO oslo.messaging._drivers.impl_rabbit [-] [97b8321f-6d0d-4fc2-ae68-3784c532bfbe] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 38048. Aug 04 17:39:10.564274 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0cc3bbe3-061c-4166-9895-4ef119eb022d tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:39:10.565201 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0cc3bbe3-061c-4166-9895-4ef119eb022d tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:39:10.568500 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0cc3bbe3-061c-4166-9895-4ef119eb022d tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:39:10.569321 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0cc3bbe3-061c-4166-9895-4ef119eb022d tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:39:10.812973 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0cc3bbe3-061c-4166-9895-4ef119eb022d tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:39:10.821817 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0cc3bbe3-061c-4166-9895-4ef119eb022d tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42" status: 200 len: 1760 microversion: 2.1 time: 0.307867 Aug 04 17:39:10.822415 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3430/6749] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:39:10 2022] GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42 => generated 1760 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:25.604993 n-d-846466-12 devstack@n-api.service[126126]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a8e78df9-6788-4147-abd6-cf6b1b6d2122] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 17:40:25.606410 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:40:25.607178 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:40:25.611483 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-adf3c833-0e8d-4fde-8bcb-7c94a3876465 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1216839715"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:40:25.612031 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-adf3c833-0e8d-4fde-8bcb-7c94a3876465 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:25.620759 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-adf3c833-0e8d-4fde-8bcb-7c94a3876465 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:25.621217 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-adf3c833-0e8d-4fde-8bcb-7c94a3876465 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:25.622056 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-adf3c833-0e8d-4fde-8bcb-7c94a3876465 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:25.622518 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-adf3c833-0e8d-4fde-8bcb-7c94a3876465 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:25.627814 n-d-846466-12 devstack@n-api.service[126126]: INFO oslo.messaging._drivers.impl_rabbit [-] [37914f2f-7143-4f4b-83fb-439e96d93d23] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 38076. Aug 04 17:40:25.768686 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.network.security_group_api [None req-adf3c833-0e8d-4fde-8bcb-7c94a3876465 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Removing security group 61dff319-f1cb-4b6c-bb21-bc5dbc6e32ef from port f3a390be-34bc-4dd1-ab06-06f443837447 Aug 04 17:40:26.096932 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-adf3c833-0e8d-4fde-8bcb-7c94a3876465 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "POST /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42/action" status: 202 len: 0 microversion: 2.1 time: 0.494404 Aug 04 17:40:26.100785 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3320/6750] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:40:25 2022] POST /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:40:26.105583 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:40:26.106509 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:40:26.112200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-4d4fc544-6444-4b38-8f45-a98bd4639168 req-750fc20a-43ce-4972-a314-402003dfb2aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d635932e-5842-4d81-96c3-524a0a7ccd42", "tag": "f3a390be-34bc-4dd1-ab06-06f443837447"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:40:26.122863 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-4d4fc544-6444-4b38-8f45-a98bd4639168 req-750fc20a-43ce-4972-a314-402003dfb2aa service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:26.123440 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-4d4fc544-6444-4b38-8f45-a98bd4639168 req-750fc20a-43ce-4972-a314-402003dfb2aa service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:26.150416 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-4d4fc544-6444-4b38-8f45-a98bd4639168 req-750fc20a-43ce-4972-a314-402003dfb2aa service nova] Creating event network-changed:f3a390be-34bc-4dd1-ab06-06f443837447 for instance d635932e-5842-4d81-96c3-524a0a7ccd42 on n-h1-846466-12 Aug 04 17:40:26.157429 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-4d4fc544-6444-4b38-8f45-a98bd4639168 req-750fc20a-43ce-4972-a314-402003dfb2aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053348 Aug 04 17:40:26.158370 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3431/6751] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:40:27.233111 n-d-846466-12 devstack@n-api.service[126126]: INFO oslo.messaging._drivers.impl_rabbit [-] [a8e78df9-6788-4147-abd6-cf6b1b6d2122] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 38096. Aug 04 17:40:27.285635 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9c0bfd1a-c83a-4e94-9180-9e3e3f2d723f tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:27.287199 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9c0bfd1a-c83a-4e94-9180-9e3e3f2d723f tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:27.293929 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c0bfd1a-c83a-4e94-9180-9e3e3f2d723f tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:27.294302 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c0bfd1a-c83a-4e94-9180-9e3e3f2d723f tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:27.295100 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c0bfd1a-c83a-4e94-9180-9e3e3f2d723f tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:27.295533 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9c0bfd1a-c83a-4e94-9180-9e3e3f2d723f tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:27.296615 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-87ea3729-3743-4f1c-baf5-8b072a4b3f64 req-c4edf45d-6df8-451f-b4b2-fa3494871f73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d635932e-5842-4d81-96c3-524a0a7ccd42", "tag": "f3a390be-34bc-4dd1-ab06-06f443837447"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:40:27.306997 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-87ea3729-3743-4f1c-baf5-8b072a4b3f64 req-c4edf45d-6df8-451f-b4b2-fa3494871f73 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:27.307678 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-87ea3729-3743-4f1c-baf5-8b072a4b3f64 req-c4edf45d-6df8-451f-b4b2-fa3494871f73 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:27.320595 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-87ea3729-3743-4f1c-baf5-8b072a4b3f64 req-c4edf45d-6df8-451f-b4b2-fa3494871f73 service nova] Creating event network-changed:f3a390be-34bc-4dd1-ab06-06f443837447 for instance d635932e-5842-4d81-96c3-524a0a7ccd42 on n-h1-846466-12 Aug 04 17:40:27.326416 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-87ea3729-3743-4f1c-baf5-8b072a4b3f64 req-c4edf45d-6df8-451f-b4b2-fa3494871f73 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105143 Aug 04 17:40:27.327163 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3321/6752] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:40:27.520899 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-9c0bfd1a-c83a-4e94-9180-9e3e3f2d723f tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lazy-loading 'services' on Instance uuid d635932e-5842-4d81-96c3-524a0a7ccd42 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:40:27.613120 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9c0bfd1a-c83a-4e94-9180-9e3e3f2d723f tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42/os-volume_attachments/fbbeb4fe-c090-42d4-b108-4f5c87b5cacd" status: 202 len: 0 microversion: 2.1 time: 0.334641 Aug 04 17:40:27.614113 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3432/6753] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Aug 4 17:40:27 2022] DELETE /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42/os-volume_attachments/fbbeb4fe-c090-42d4-b108-4f5c87b5cacd => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 17:40:27.624120 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-eff12f33-a4bb-4409-ba26-a8766da9312a tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:27.627077 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-eff12f33-a4bb-4409-ba26-a8766da9312a tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:27.634153 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eff12f33-a4bb-4409-ba26-a8766da9312a tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:27.634946 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eff12f33-a4bb-4409-ba26-a8766da9312a tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:27.636128 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eff12f33-a4bb-4409-ba26-a8766da9312a tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:27.636793 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eff12f33-a4bb-4409-ba26-a8766da9312a tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:27.673650 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-eff12f33-a4bb-4409-ba26-a8766da9312a tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054214 Aug 04 17:40:27.674567 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3322/6754] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:40:27 2022] GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:40:28.687737 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-389445dc-f283-48fc-8014-96051248cf50 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:28.690215 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-389445dc-f283-48fc-8014-96051248cf50 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:28.697457 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-389445dc-f283-48fc-8014-96051248cf50 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:28.698007 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-389445dc-f283-48fc-8014-96051248cf50 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:28.698795 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-389445dc-f283-48fc-8014-96051248cf50 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:28.699220 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-389445dc-f283-48fc-8014-96051248cf50 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:28.730796 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-389445dc-f283-48fc-8014-96051248cf50 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048534 Aug 04 17:40:28.731607 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3433/6755] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:40:28 2022] GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:40:29.743786 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a5784f6d-619e-49ae-a6f5-327247873411 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:29.746519 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a5784f6d-619e-49ae-a6f5-327247873411 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:29.753440 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a5784f6d-619e-49ae-a6f5-327247873411 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:29.753895 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a5784f6d-619e-49ae-a6f5-327247873411 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:29.754663 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a5784f6d-619e-49ae-a6f5-327247873411 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:29.755100 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a5784f6d-619e-49ae-a6f5-327247873411 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:29.786239 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a5784f6d-619e-49ae-a6f5-327247873411 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046758 Aug 04 17:40:29.786818 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3323/6756] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:40:29 2022] GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:40:30.800227 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d4c8f461-b6e2-48b4-a7ba-fdf7eb840b1b tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:30.802834 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d4c8f461-b6e2-48b4-a7ba-fdf7eb840b1b tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:30.810818 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d4c8f461-b6e2-48b4-a7ba-fdf7eb840b1b tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:30.811263 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d4c8f461-b6e2-48b4-a7ba-fdf7eb840b1b tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:30.812049 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d4c8f461-b6e2-48b4-a7ba-fdf7eb840b1b tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:30.812486 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d4c8f461-b6e2-48b4-a7ba-fdf7eb840b1b tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:30.843453 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d4c8f461-b6e2-48b4-a7ba-fdf7eb840b1b tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047503 Aug 04 17:40:30.844047 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3434/6757] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:40:30 2022] GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:40:31.856607 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7ad092e5-6e28-491a-8749-30408795ab80 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:31.858920 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7ad092e5-6e28-491a-8749-30408795ab80 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:31.866627 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7ad092e5-6e28-491a-8749-30408795ab80 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:31.867089 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7ad092e5-6e28-491a-8749-30408795ab80 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:31.867874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7ad092e5-6e28-491a-8749-30408795ab80 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:31.868317 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7ad092e5-6e28-491a-8749-30408795ab80 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:31.901341 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7ad092e5-6e28-491a-8749-30408795ab80 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048680 Aug 04 17:40:31.903278 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3324/6758] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:40:31 2022] GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:40:32.915879 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3b74a4c3-dde8-4c52-9b21-dd65283123ea tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:32.918217 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3b74a4c3-dde8-4c52-9b21-dd65283123ea tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:32.926056 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b74a4c3-dde8-4c52-9b21-dd65283123ea tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:32.926507 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b74a4c3-dde8-4c52-9b21-dd65283123ea tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:32.927260 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b74a4c3-dde8-4c52-9b21-dd65283123ea tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:32.927680 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3b74a4c3-dde8-4c52-9b21-dd65283123ea tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:32.957856 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3b74a4c3-dde8-4c52-9b21-dd65283123ea tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045794 Aug 04 17:40:32.958423 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3435/6759] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:40:32 2022] GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:40:32.977796 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-66638478-43ca-45a0-81d1-eb5f430c05ca tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:32.978476 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-66638478-43ca-45a0-81d1-eb5f430c05ca tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:32.986447 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-66638478-43ca-45a0-81d1-eb5f430c05ca tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:32.986911 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-66638478-43ca-45a0-81d1-eb5f430c05ca tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:32.987709 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-66638478-43ca-45a0-81d1-eb5f430c05ca tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:32.988156 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-66638478-43ca-45a0-81d1-eb5f430c05ca tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:33.079143 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-66638478-43ca-45a0-81d1-eb5f430c05ca tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] HTTP exception thrown: Instance d635932e-5842-4d81-96c3-524a0a7ccd42 is not attached to volume fbbeb4fe-c090-42d4-b108-4f5c87b5cacd Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-66638478-43ca-45a0-81d1-eb5f430c05ca tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Request method failure captured: Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42/os-volume_attachments/fbbeb4fe-c090-42d4-b108-4f5c87b5cacd HTTP/1.1 Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi7AOkKOKgA4mOyItmKZeA1rzye1ULpTUFA4p8oFonHIygCNHWj3lZfD-qJ4Qxz5zSyWZxwvNO1gB1MjLX0MYSB7La2QJuNlVHdu-rpeDZGA8HRHUEPRiiS8XtQ_3Iu1lT5M5lXCSViNoHgA_dhzoON9w_1n4JTCq2pRTRvLOei5DJ5tU Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: bddca9dabc444e7db049241849b041a1 Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-TestMinimumBasicScenario-1835807098 Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bddca9dabc444e7db049241849b041a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bddca9dabc444e7db049241849b041a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bddca9dabc444e7db049241849b041a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bddca9dabc444e7db049241849b041a1"}]}] Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-TestMinimumBasicScenario-1835807098 Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: bddca9dabc444e7db049241849b041a1 Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1835807098 Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-TestMinimumBasicScenario-1835807098-project Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 5b122edce41944a09afdc9a84d647536 Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-TestMinimumBasicScenario-1835807098-project Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance d635932e-5842-4d81-96c3-524a0a7ccd42 is not attached to volume fbbeb4fe-c090-42d4-b108-4f5c87b5cacd Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'server_id': 'd635932e-5842-4d81-96c3-524a0a7ccd42', 'id': 'fbbeb4fe-c090-42d4-b108-4f5c87b5cacd'} Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id fbbeb4fe-c090-42d4-b108-4f5c87b5cacd. Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d635932e-5842-4d81-96c3-524a0a7ccd42 is not attached to volume fbbeb4fe-c090-42d4-b108-4f5c87b5cacd Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:40:33.081160 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:40:33.086921 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:40:33.086921 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:40:33.086921 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d635932e-5842-4d81-96c3-524a0a7ccd42 is not attached to volume fbbeb4fe-c090-42d4-b108-4f5c87b5cacd Aug 04 17:40:33.086921 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:40:33.086921 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-66638478-43ca-45a0-81d1-eb5f430c05ca tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Returning 404 to user: Instance d635932e-5842-4d81-96c3-524a0a7ccd42 is not attached to volume fbbeb4fe-c090-42d4-b108-4f5c87b5cacd {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:40:33.086921 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-66638478-43ca-45a0-81d1-eb5f430c05ca tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42/os-volume_attachments/fbbeb4fe-c090-42d4-b108-4f5c87b5cacd" status: 404 len: 154 microversion: 2.1 time: 0.109093 Aug 04 17:40:33.086921 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3325/6760] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Aug 4 17:40:32 2022] DELETE /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42/os-volume_attachments/fbbeb4fe-c090-42d4-b108-4f5c87b5cacd => generated 154 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:40:36.352946 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c17a4588-bc1b-49f8-aaa5-7e32f37a251c tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:36.353630 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c17a4588-bc1b-49f8-aaa5-7e32f37a251c tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:36.361472 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c17a4588-bc1b-49f8-aaa5-7e32f37a251c tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:36.361928 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c17a4588-bc1b-49f8-aaa5-7e32f37a251c tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:36.362711 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c17a4588-bc1b-49f8-aaa5-7e32f37a251c tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:36.363147 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c17a4588-bc1b-49f8-aaa5-7e32f37a251c tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:36.390222 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c17a4588-bc1b-49f8-aaa5-7e32f37a251c tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:40:36.472039 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c17a4588-bc1b-49f8-aaa5-7e32f37a251c tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42" status: 204 len: 0 microversion: 2.1 time: 0.124397 Aug 04 17:40:36.472576 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3436/6761] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:40:36 2022] DELETE /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:40:36.482051 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3ce2a804-c723-44fe-8416-ef91a7019c9e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:36.482781 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3ce2a804-c723-44fe-8416-ef91a7019c9e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:36.491109 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ce2a804-c723-44fe-8416-ef91a7019c9e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:36.491571 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ce2a804-c723-44fe-8416-ef91a7019c9e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:36.492418 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ce2a804-c723-44fe-8416-ef91a7019c9e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:36.492925 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3ce2a804-c723-44fe-8416-ef91a7019c9e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:36.702944 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3ce2a804-c723-44fe-8416-ef91a7019c9e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:36.711320 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3ce2a804-c723-44fe-8416-ef91a7019c9e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42" status: 200 len: 1555 microversion: 2.1 time: 0.233628 Aug 04 17:40:36.711919 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3326/6762] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:36 2022] GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42 => generated 1555 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:37.735095 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7dcdf0ee-cea7-4ef7-9b51-ddcecdea2556 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:37.735804 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7dcdf0ee-cea7-4ef7-9b51-ddcecdea2556 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:37.744229 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7dcdf0ee-cea7-4ef7-9b51-ddcecdea2556 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:37.744678 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7dcdf0ee-cea7-4ef7-9b51-ddcecdea2556 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:37.745548 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7dcdf0ee-cea7-4ef7-9b51-ddcecdea2556 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:37.746202 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7dcdf0ee-cea7-4ef7-9b51-ddcecdea2556 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:37.892784 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7dcdf0ee-cea7-4ef7-9b51-ddcecdea2556 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:37.904500 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7dcdf0ee-cea7-4ef7-9b51-ddcecdea2556 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42" status: 200 len: 1555 microversion: 2.1 time: 0.173947 Aug 04 17:40:37.905360 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3437/6763] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:37 2022] GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42 => generated 1555 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:38.771604 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-fd45730e-f394-40b2-b309-08a91c39dcb6 req-85550879-1e26-42b2-8e3d-7a5c6085fd0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d635932e-5842-4d81-96c3-524a0a7ccd42", "name": "network-vif-deleted", "tag": "f3a390be-34bc-4dd1-ab06-06f443837447"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:40:38.784713 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-fd45730e-f394-40b2-b309-08a91c39dcb6 req-85550879-1e26-42b2-8e3d-7a5c6085fd0b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:38.785233 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-fd45730e-f394-40b2-b309-08a91c39dcb6 req-85550879-1e26-42b2-8e3d-7a5c6085fd0b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:38.799141 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-fd45730e-f394-40b2-b309-08a91c39dcb6 req-85550879-1e26-42b2-8e3d-7a5c6085fd0b service nova] Creating event network-vif-deleted:f3a390be-34bc-4dd1-ab06-06f443837447 for instance d635932e-5842-4d81-96c3-524a0a7ccd42 on n-h1-846466-12 Aug 04 17:40:38.804802 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-fd45730e-f394-40b2-b309-08a91c39dcb6 req-85550879-1e26-42b2-8e3d-7a5c6085fd0b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036939 Aug 04 17:40:38.805453 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3327/6764] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:40:38.928085 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e7f9fbbe-6bb4-4d65-ad61-4baf72945a67 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:38.928945 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e7f9fbbe-6bb4-4d65-ad61-4baf72945a67 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:38.939333 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e7f9fbbe-6bb4-4d65-ad61-4baf72945a67 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:38.939889 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e7f9fbbe-6bb4-4d65-ad61-4baf72945a67 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:38.940779 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e7f9fbbe-6bb4-4d65-ad61-4baf72945a67 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:38.941207 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e7f9fbbe-6bb4-4d65-ad61-4baf72945a67 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:38.977022 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e7f9fbbe-6bb4-4d65-ad61-4baf72945a67 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:38.977398 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e7f9fbbe-6bb4-4d65-ad61-4baf72945a67 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:38.977859 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-e7f9fbbe-6bb4-4d65-ad61-4baf72945a67 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lazy-loading 'fault' on Instance uuid d635932e-5842-4d81-96c3-524a0a7ccd42 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:40:39.028589 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e7f9fbbe-6bb4-4d65-ad61-4baf72945a67 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:39.037173 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e7f9fbbe-6bb4-4d65-ad61-4baf72945a67 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42" status: 200 len: 1349 microversion: 2.1 time: 0.114428 Aug 04 17:40:39.037742 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3438/6765] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:38 2022] GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42 => generated 1349 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:40.060289 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-81d63772-89af-45d5-a5ed-63b4e8096dd3 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:40.061030 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-81d63772-89af-45d5-a5ed-63b4e8096dd3 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: d635932e-5842-4d81-96c3-524a0a7ccd42] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:40.068237 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-81d63772-89af-45d5-a5ed-63b4e8096dd3 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:40.068695 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-81d63772-89af-45d5-a5ed-63b4e8096dd3 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:40.069507 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-81d63772-89af-45d5-a5ed-63b4e8096dd3 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:40.069953 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-81d63772-89af-45d5-a5ed-63b4e8096dd3 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:40.084693 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-81d63772-89af-45d5-a5ed-63b4e8096dd3 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] HTTP exception thrown: Instance d635932e-5842-4d81-96c3-524a0a7ccd42 could not be found. Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-81d63772-89af-45d5-a5ed-63b4e8096dd3 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Request method failure captured: Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42 HTTP/1.1 Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi7AOkKOKgA4mOyItmKZeA1rzye1ULpTUFA4p8oFonHIygCNHWj3lZfD-qJ4Qxz5zSyWZxwvNO1gB1MjLX0MYSB7La2QJuNlVHdu-rpeDZGA8HRHUEPRiiS8XtQ_3Iu1lT5M5lXCSViNoHgA_dhzoON9w_1n4JTCq2pRTRvLOei5DJ5tU Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: bddca9dabc444e7db049241849b041a1 Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-TestMinimumBasicScenario-1835807098 Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bddca9dabc444e7db049241849b041a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bddca9dabc444e7db049241849b041a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bddca9dabc444e7db049241849b041a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bddca9dabc444e7db049241849b041a1"}]}] Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-TestMinimumBasicScenario-1835807098 Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: bddca9dabc444e7db049241849b041a1 Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1835807098 Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-TestMinimumBasicScenario-1835807098-project Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 5b122edce41944a09afdc9a84d647536 Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-TestMinimumBasicScenario-1835807098-project Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance d635932e-5842-4d81-96c3-524a0a7ccd42 could not be found. Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'd635932e-5842-4d81-96c3-524a0a7ccd42'} Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d635932e-5842-4d81-96c3-524a0a7ccd42 could not be found. Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d635932e-5842-4d81-96c3-524a0a7ccd42 could not be found. Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:40:40.086385 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:40:40.090137 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:40:40.090137 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:40:40.090137 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:40:40.090137 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:40:40.090137 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:40:40.090137 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d635932e-5842-4d81-96c3-524a0a7ccd42 could not be found. Aug 04 17:40:40.090137 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:40:40.090137 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-81d63772-89af-45d5-a5ed-63b4e8096dd3 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Returning 404 to user: Instance d635932e-5842-4d81-96c3-524a0a7ccd42 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:40:40.090137 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-81d63772-89af-45d5-a5ed-63b4e8096dd3 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42" status: 404 len: 111 microversion: 2.1 time: 0.033432 Aug 04 17:40:40.090137 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3328/6766] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:40 2022] GET /compute/v2.1/servers/d635932e-5842-4d81-96c3-524a0a7ccd42 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:40:40.097219 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e0141245-e29a-430a-9542-269c65011335 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '.version_select at 0x7f7e89cf2670>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:40.121678 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e0141245-e29a-430a-9542-269c65011335 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1113800233" status: 202 len: 0 microversion: 2.1 time: 0.028308 Aug 04 17:40:40.122713 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3439/6767] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Aug 4 17:40:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1113800233 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:40:49.133749 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4e7a3598-7ffd-4558-9549-e41733f97134 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Action: 'create', calling method: .version_select at 0x7f7e84a9ff70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-631221123", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbXoc41tLFViYUkM1l0j96X/Pyc5RlPUZXGVJD2c8ytp9R2OEHaeKGJzyjPixIJdEjBD0sXQvgs80oAtqO7tdDEWp2I4nD7xYPn9KwruVZQjl34wbMxA9/dyZHGLDsCRA=="}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:40:49.152562 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-4e7a3598-7ffd-4558-9549-e41733f97134 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Getting quotas for project bddca9dabc444e7db049241849b041a1. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:40:49.158854 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-4e7a3598-7ffd-4558-9549-e41733f97134 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Getting quotas for user 5b122edce41944a09afdc9a84d647536 and project bddca9dabc444e7db049241849b041a1. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:40:49.194333 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4e7a3598-7ffd-4558-9549-e41733f97134 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.064602 Aug 04 17:40:49.194949 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3329/6768] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 17:40:49 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:40:49.248915 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:40:49.253169 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f2427d0b-8e56-42f0-9d93-25b029c58de2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-802080046", "imageRef": "197a4d87-fed6-4da1-8c0b-03eaaa57cf48", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-631221123", "networks": [{"uuid": "83214c67-a585-4cd7-907d-d23aeb7cedab"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:40:49.309218 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-f2427d0b-8e56-42f0-9d93-25b029c58de2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] validate_networks() for [('83214c67-a585-4cd7-907d-d23aeb7cedab', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:40:49.806911 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-f2427d0b-8e56-42f0-9d93-25b029c58de2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:40:49.807323 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-f2427d0b-8e56-42f0-9d93-25b029c58de2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:40:49.807823 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-f2427d0b-8e56-42f0-9d93-25b029c58de2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:40:49.808222 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-f2427d0b-8e56-42f0-9d93-25b029c58de2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:40:49.808621 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-f2427d0b-8e56-42f0-9d93-25b029c58de2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:40:49.818787 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f2427d0b-8e56-42f0-9d93-25b029c58de2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:49.819220 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f2427d0b-8e56-42f0-9d93-25b029c58de2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:49.820004 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f2427d0b-8e56-42f0-9d93-25b029c58de2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:49.820429 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f2427d0b-8e56-42f0-9d93-25b029c58de2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:49.838012 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-f2427d0b-8e56-42f0-9d93-25b029c58de2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Getting quotas for project bddca9dabc444e7db049241849b041a1. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:40:49.843661 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-f2427d0b-8e56-42f0-9d93-25b029c58de2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Getting quotas for user 5b122edce41944a09afdc9a84d647536 and project bddca9dabc444e7db049241849b041a1. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:40:49.856613 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f2427d0b-8e56-42f0-9d93-25b029c58de2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:40:49.859026 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f2427d0b-8e56-42f0-9d93-25b029c58de2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='197a4d87-fed6-4da1-8c0b-03eaaa57cf48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:40:49.909900 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f2427d0b-8e56-42f0-9d93-25b029c58de2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.663037 Aug 04 17:40:49.910536 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3440/6769] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:40:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:40:49.921430 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-26e036c4-433b-4811-acec-46b130ad26d2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:49.922045 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-26e036c4-433b-4811-acec-46b130ad26d2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:49.980018 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-26e036c4-433b-4811-acec-46b130ad26d2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:49.987152 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-26e036c4-433b-4811-acec-46b130ad26d2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 200 len: 1257 microversion: 2.1 time: 0.069797 Aug 04 17:40:49.987740 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3330/6770] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:49 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 1257 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:51.011553 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f3e44e29-eb7f-48fc-8843-0808d108bdc2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:51.012266 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f3e44e29-eb7f-48fc-8843-0808d108bdc2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:51.020179 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3e44e29-eb7f-48fc-8843-0808d108bdc2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:51.020735 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3e44e29-eb7f-48fc-8843-0808d108bdc2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:51.021661 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3e44e29-eb7f-48fc-8843-0808d108bdc2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:51.022153 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3e44e29-eb7f-48fc-8843-0808d108bdc2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:51.090213 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f3e44e29-eb7f-48fc-8843-0808d108bdc2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:51.098471 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f3e44e29-eb7f-48fc-8843-0808d108bdc2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 200 len: 1317 microversion: 2.1 time: 0.092506 Aug 04 17:40:51.099347 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3441/6771] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:51 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 1317 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:52.118173 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=40 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:40:52.123070 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f522189f-e045-433a-93a9-7a8c91bcff58 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:52.123709 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f522189f-e045-433a-93a9-7a8c91bcff58 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:52.130533 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f522189f-e045-433a-93a9-7a8c91bcff58 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:52.131277 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f522189f-e045-433a-93a9-7a8c91bcff58 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:52.132156 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f522189f-e045-433a-93a9-7a8c91bcff58 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:52.132860 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f522189f-e045-433a-93a9-7a8c91bcff58 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:52.300464 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f522189f-e045-433a-93a9-7a8c91bcff58 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:52.308925 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f522189f-e045-433a-93a9-7a8c91bcff58 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 200 len: 1357 microversion: 2.1 time: 0.191553 Aug 04 17:40:52.319915 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3331/6772] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:52 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 1357 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:53.331520 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-26904f93-96e9-48ad-807e-8be46cd7eef0 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:53.332271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-26904f93-96e9-48ad-807e-8be46cd7eef0 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:53.339104 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-26904f93-96e9-48ad-807e-8be46cd7eef0 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:53.339543 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-26904f93-96e9-48ad-807e-8be46cd7eef0 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:53.340413 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-26904f93-96e9-48ad-807e-8be46cd7eef0 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:53.340848 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-26904f93-96e9-48ad-807e-8be46cd7eef0 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:53.503099 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-26904f93-96e9-48ad-807e-8be46cd7eef0 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:53.512997 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-26904f93-96e9-48ad-807e-8be46cd7eef0 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 200 len: 1357 microversion: 2.1 time: 0.186059 Aug 04 17:40:53.513766 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3442/6773] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:53 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:54.535125 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b7f3784c-21e2-4d0c-9d1b-c79c27df9870 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:54.536528 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b7f3784c-21e2-4d0c-9d1b-c79c27df9870 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:54.545691 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7f3784c-21e2-4d0c-9d1b-c79c27df9870 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:54.546471 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7f3784c-21e2-4d0c-9d1b-c79c27df9870 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:54.547487 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7f3784c-21e2-4d0c-9d1b-c79c27df9870 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:54.547952 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7f3784c-21e2-4d0c-9d1b-c79c27df9870 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:55.053164 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b7f3784c-21e2-4d0c-9d1b-c79c27df9870 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:55.061617 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b7f3784c-21e2-4d0c-9d1b-c79c27df9870 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 200 len: 1357 microversion: 2.1 time: 0.530535 Aug 04 17:40:55.071565 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3332/6774] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:54 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 1357 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:56.084645 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b2bb0093-91b2-4476-9e86-831dea186e4b tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:56.085243 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b2bb0093-91b2-4476-9e86-831dea186e4b tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:56.092694 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2bb0093-91b2-4476-9e86-831dea186e4b tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:56.093142 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2bb0093-91b2-4476-9e86-831dea186e4b tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:56.094110 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2bb0093-91b2-4476-9e86-831dea186e4b tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:56.094795 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2bb0093-91b2-4476-9e86-831dea186e4b tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:56.250189 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b2bb0093-91b2-4476-9e86-831dea186e4b tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:56.265274 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b2bb0093-91b2-4476-9e86-831dea186e4b tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 200 len: 1357 microversion: 2.1 time: 0.184557 Aug 04 17:40:56.266503 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3443/6775] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:56 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 1357 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:57.289475 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-68b7be0b-d291-41d5-adeb-2987a4c811d4 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:57.290956 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-68b7be0b-d291-41d5-adeb-2987a4c811d4 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:57.293613 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:40:57.306013 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-68b7be0b-d291-41d5-adeb-2987a4c811d4 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:57.307455 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-68b7be0b-d291-41d5-adeb-2987a4c811d4 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:57.309161 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-68b7be0b-d291-41d5-adeb-2987a4c811d4 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:57.309786 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-68b7be0b-d291-41d5-adeb-2987a4c811d4 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:57.474132 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-68b7be0b-d291-41d5-adeb-2987a4c811d4 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:57.485816 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-68b7be0b-d291-41d5-adeb-2987a4c811d4 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 200 len: 1357 microversion: 2.1 time: 0.200264 Aug 04 17:40:57.487382 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3333/6776] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:57 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 1357 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:58.510965 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6f37162c-61f8-42f5-8b12-1a7c979160a4 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:58.511873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6f37162c-61f8-42f5-8b12-1a7c979160a4 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:58.514199 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:40:58.524947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6f37162c-61f8-42f5-8b12-1a7c979160a4 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:58.525329 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6f37162c-61f8-42f5-8b12-1a7c979160a4 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:58.526108 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6f37162c-61f8-42f5-8b12-1a7c979160a4 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:58.526536 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6f37162c-61f8-42f5-8b12-1a7c979160a4 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:58.679787 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6f37162c-61f8-42f5-8b12-1a7c979160a4 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:58.691345 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6f37162c-61f8-42f5-8b12-1a7c979160a4 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 200 len: 1357 microversion: 2.1 time: 0.185406 Aug 04 17:40:58.691929 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3444/6777] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:58 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 1357 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:59.650252 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-b62f63c0-69da-4fd3-b870-7f708ac207c7 req-3814ed34-a6be-40d2-a03f-84d4100f4b09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d19987c-6a7a-427d-b702-f434ee6b3609", "tag": "f9dfef15-2062-45a0-8991-1bfac56bc75a"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:40:59.662657 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-b62f63c0-69da-4fd3-b870-7f708ac207c7 req-3814ed34-a6be-40d2-a03f-84d4100f4b09 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:59.663197 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-b62f63c0-69da-4fd3-b870-7f708ac207c7 req-3814ed34-a6be-40d2-a03f-84d4100f4b09 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:59.679392 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-b62f63c0-69da-4fd3-b870-7f708ac207c7 req-3814ed34-a6be-40d2-a03f-84d4100f4b09 service nova] Creating event network-changed:f9dfef15-2062-45a0-8991-1bfac56bc75a for instance 1d19987c-6a7a-427d-b702-f434ee6b3609 on n-h2-846466-12 Aug 04 17:40:59.684668 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-b62f63c0-69da-4fd3-b870-7f708ac207c7 req-3814ed34-a6be-40d2-a03f-84d4100f4b09 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039197 Aug 04 17:40:59.685313 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3334/6778] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:40:59.713825 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4f460c24-d930-4976-a6f3-d8b1c5bf7ce4 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:59.714648 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4f460c24-d930-4976-a6f3-d8b1c5bf7ce4 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:59.723932 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4f460c24-d930-4976-a6f3-d8b1c5bf7ce4 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:59.724468 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4f460c24-d930-4976-a6f3-d8b1c5bf7ce4 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:59.725311 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4f460c24-d930-4976-a6f3-d8b1c5bf7ce4 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:40:59.725820 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4f460c24-d930-4976-a6f3-d8b1c5bf7ce4 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:40:59.826454 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:40:59.851156 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:40:59.880312 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4f460c24-d930-4976-a6f3-d8b1c5bf7ce4 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:59.893174 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4f460c24-d930-4976-a6f3-d8b1c5bf7ce4 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 200 len: 1357 microversion: 2.1 time: 0.184701 Aug 04 17:40:59.893836 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3445/6779] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:59 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:00.915157 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:41:00.922780 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-62da2771-d09d-4a93-8cc6-f7b2ec00f27c tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:00.924001 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-62da2771-d09d-4a93-8cc6-f7b2ec00f27c tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:00.930792 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-62da2771-d09d-4a93-8cc6-f7b2ec00f27c tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:00.931249 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-62da2771-d09d-4a93-8cc6-f7b2ec00f27c tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:00.932022 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-62da2771-d09d-4a93-8cc6-f7b2ec00f27c tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:00.932463 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-62da2771-d09d-4a93-8cc6-f7b2ec00f27c tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:01.079396 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-62da2771-d09d-4a93-8cc6-f7b2ec00f27c tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:01.087471 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-62da2771-d09d-4a93-8cc6-f7b2ec00f27c tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 200 len: 1357 microversion: 2.1 time: 0.174067 Aug 04 17:41:01.088041 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3335/6780] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:00 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:02.109506 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-50c5d626-668a-407b-b16e-46d5cf76aac1 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:02.110106 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-50c5d626-668a-407b-b16e-46d5cf76aac1 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:02.117419 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50c5d626-668a-407b-b16e-46d5cf76aac1 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:02.117863 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50c5d626-668a-407b-b16e-46d5cf76aac1 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:02.118645 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50c5d626-668a-407b-b16e-46d5cf76aac1 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:02.119050 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-50c5d626-668a-407b-b16e-46d5cf76aac1 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:02.255520 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-50c5d626-668a-407b-b16e-46d5cf76aac1 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:02.263491 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-50c5d626-668a-407b-b16e-46d5cf76aac1 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 200 len: 1357 microversion: 2.1 time: 0.158271 Aug 04 17:41:02.264275 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3446/6781] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:02 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:03.286272 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f6341657-c17d-4a34-a84e-36f4aff61661 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:03.286851 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f6341657-c17d-4a34-a84e-36f4aff61661 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:03.294524 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6341657-c17d-4a34-a84e-36f4aff61661 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:03.294975 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6341657-c17d-4a34-a84e-36f4aff61661 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:03.295747 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6341657-c17d-4a34-a84e-36f4aff61661 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:03.296185 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f6341657-c17d-4a34-a84e-36f4aff61661 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:03.455173 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f6341657-c17d-4a34-a84e-36f4aff61661 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:03.464606 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f6341657-c17d-4a34-a84e-36f4aff61661 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 200 len: 1357 microversion: 2.1 time: 0.182265 Aug 04 17:41:03.465213 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3336/6782] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:03 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:04.486260 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d5f4dc7d-49ad-4e7d-b4b6-b6acd2e883cd tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:04.486838 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d5f4dc7d-49ad-4e7d-b4b6-b6acd2e883cd tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:04.496510 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d5f4dc7d-49ad-4e7d-b4b6-b6acd2e883cd tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:04.497097 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d5f4dc7d-49ad-4e7d-b4b6-b6acd2e883cd tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:04.498211 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d5f4dc7d-49ad-4e7d-b4b6-b6acd2e883cd tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:04.498826 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d5f4dc7d-49ad-4e7d-b4b6-b6acd2e883cd tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:04.647909 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d5f4dc7d-49ad-4e7d-b4b6-b6acd2e883cd tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:04.655872 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d5f4dc7d-49ad-4e7d-b4b6-b6acd2e883cd tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 200 len: 1357 microversion: 2.1 time: 0.173730 Aug 04 17:41:04.656454 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3447/6783] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:04 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:05.680482 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-57d14a47-efac-4389-825c-724502a17a6b tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:05.681634 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-57d14a47-efac-4389-825c-724502a17a6b tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:05.692859 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-57d14a47-efac-4389-825c-724502a17a6b tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:05.693517 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-57d14a47-efac-4389-825c-724502a17a6b tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:05.694735 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-57d14a47-efac-4389-825c-724502a17a6b tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:05.695391 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-57d14a47-efac-4389-825c-724502a17a6b tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:05.846155 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-57d14a47-efac-4389-825c-724502a17a6b tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:05.854167 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-57d14a47-efac-4389-825c-724502a17a6b tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 200 len: 1357 microversion: 2.1 time: 0.180227 Aug 04 17:41:05.854737 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3337/6784] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:05 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:06.159979 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-f33d5271-673d-46a4-b7ad-843a817eccb7 req-c7706454-1f4d-4145-b8f3-8abe6e0785ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d19987c-6a7a-427d-b702-f434ee6b3609", "name": "network-vif-plugged", "status": "completed", "tag": "f9dfef15-2062-45a0-8991-1bfac56bc75a"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:41:06.170618 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-f33d5271-673d-46a4-b7ad-843a817eccb7 req-c7706454-1f4d-4145-b8f3-8abe6e0785ae service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:06.171124 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-f33d5271-673d-46a4-b7ad-843a817eccb7 req-c7706454-1f4d-4145-b8f3-8abe6e0785ae service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:06.183192 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-f33d5271-673d-46a4-b7ad-843a817eccb7 req-c7706454-1f4d-4145-b8f3-8abe6e0785ae service nova] Creating event network-vif-plugged:f9dfef15-2062-45a0-8991-1bfac56bc75a for instance 1d19987c-6a7a-427d-b702-f434ee6b3609 on n-h2-846466-12 Aug 04 17:41:06.188526 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-f33d5271-673d-46a4-b7ad-843a817eccb7 req-c7706454-1f4d-4145-b8f3-8abe6e0785ae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115014 Aug 04 17:41:06.189356 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3448/6785] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:41:06.878533 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-84a4f216-8bc2-4b78-affa-e9f185488a14 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:06.879151 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-84a4f216-8bc2-4b78-affa-e9f185488a14 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:06.889599 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-84a4f216-8bc2-4b78-affa-e9f185488a14 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:06.890173 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-84a4f216-8bc2-4b78-affa-e9f185488a14 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:06.891282 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-84a4f216-8bc2-4b78-affa-e9f185488a14 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:06.891933 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-84a4f216-8bc2-4b78-affa-e9f185488a14 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:07.033067 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-84a4f216-8bc2-4b78-affa-e9f185488a14 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:07.041311 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-84a4f216-8bc2-4b78-affa-e9f185488a14 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 200 len: 1357 microversion: 2.1 time: 0.169084 Aug 04 17:41:07.041932 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3338/6786] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:06 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:08.065873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d6e0555c-4bd8-41c2-bc9f-70b7dd754d85 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:08.066588 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d6e0555c-4bd8-41c2-bc9f-70b7dd754d85 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:08.074966 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d6e0555c-4bd8-41c2-bc9f-70b7dd754d85 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:08.075410 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d6e0555c-4bd8-41c2-bc9f-70b7dd754d85 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:08.076190 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d6e0555c-4bd8-41c2-bc9f-70b7dd754d85 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:08.076601 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d6e0555c-4bd8-41c2-bc9f-70b7dd754d85 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:08.228450 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d6e0555c-4bd8-41c2-bc9f-70b7dd754d85 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:08.236967 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d6e0555c-4bd8-41c2-bc9f-70b7dd754d85 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 200 len: 1547 microversion: 2.1 time: 0.178146 Aug 04 17:41:08.237590 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3449/6787] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:08 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 1547 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:08.260361 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0a33848d-15e8-4fe1-9830-e40b975381ac tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:08.261020 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0a33848d-15e8-4fe1-9830-e40b975381ac tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:08.269692 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0a33848d-15e8-4fe1-9830-e40b975381ac tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:08.270147 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0a33848d-15e8-4fe1-9830-e40b975381ac tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:08.270926 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0a33848d-15e8-4fe1-9830-e40b975381ac tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:08.271367 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0a33848d-15e8-4fe1-9830-e40b975381ac tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:08.414388 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0a33848d-15e8-4fe1-9830-e40b975381ac tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:08.425508 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0a33848d-15e8-4fe1-9830-e40b975381ac tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 200 len: 1547 microversion: 2.1 time: 0.169077 Aug 04 17:41:08.426234 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3339/6788] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:08 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 1547 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:08.449186 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-40b3c583-6414-4a54-a000-43c3b73da52e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:08.456117 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-40b3c583-6414-4a54-a000-43c3b73da52e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:08.457256 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-40b3c583-6414-4a54-a000-43c3b73da52e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Searching by: {'deleted': False, 'project_id': 'bddca9dabc444e7db049241849b041a1'} {{(pid=126125) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:41:08.464982 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-40b3c583-6414-4a54-a000-43c3b73da52e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:08.465436 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-40b3c583-6414-4a54-a000-43c3b73da52e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:08.466240 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-40b3c583-6414-4a54-a000-43c3b73da52e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:08.466677 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-40b3c583-6414-4a54-a000-43c3b73da52e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:08.491497 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.multi_cell_list [None req-40b3c583-6414-4a54-a000-43c3b73da52e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:41:08.521051 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-40b3c583-6414-4a54-a000-43c3b73da52e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.078392 Aug 04 17:41:08.521816 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3450/6789] 10.222.0.23 () {58 vars in 1125 bytes} [Thu Aug 4 17:41:08 2022] GET /compute/v2.1/servers => generated 342 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:41:08.533874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5a36e1a9-c358-4e29-a0b1-457271a15d8e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:08.534494 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5a36e1a9-c358-4e29-a0b1-457271a15d8e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:08.540752 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a36e1a9-c358-4e29-a0b1-457271a15d8e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:08.541233 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a36e1a9-c358-4e29-a0b1-457271a15d8e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:08.542681 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a36e1a9-c358-4e29-a0b1-457271a15d8e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:08.543126 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a36e1a9-c358-4e29-a0b1-457271a15d8e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:08.689376 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5a36e1a9-c358-4e29-a0b1-457271a15d8e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:08.699742 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5a36e1a9-c358-4e29-a0b1-457271a15d8e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 200 len: 1547 microversion: 2.1 time: 0.169914 Aug 04 17:41:08.700348 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3340/6790] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:08 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 1547 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:10.294888 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dab974ac-bc0e-4891-ae26-5cee4378dffd tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c555e17a-210e-4269-b4fb-7aa20671be1d"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:41:10.297264 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dab974ac-bc0e-4891-ae26-5cee4378dffd tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:10.304764 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dab974ac-bc0e-4891-ae26-5cee4378dffd tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:10.305204 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dab974ac-bc0e-4891-ae26-5cee4378dffd tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:10.305985 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dab974ac-bc0e-4891-ae26-5cee4378dffd tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:10.306411 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dab974ac-bc0e-4891-ae26-5cee4378dffd tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:10.577113 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dab974ac-bc0e-4891-ae26-5cee4378dffd tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "POST /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286371 Aug 04 17:41:10.583337 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3451/6791] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Aug 4 17:41:10 2022] POST /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:41:21.449049 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2ba7242b-3140-4726-8694-9e0fec1e88a1 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:21.449697 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2ba7242b-3140-4726-8694-9e0fec1e88a1 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:21.452947 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=15 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:41:21.453608 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=56 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:41:21.459433 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ba7242b-3140-4726-8694-9e0fec1e88a1 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:21.459887 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ba7242b-3140-4726-8694-9e0fec1e88a1 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:21.460659 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ba7242b-3140-4726-8694-9e0fec1e88a1 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:21.461095 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ba7242b-3140-4726-8694-9e0fec1e88a1 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:21.608720 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2ba7242b-3140-4726-8694-9e0fec1e88a1 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:21.617505 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2ba7242b-3140-4726-8694-9e0fec1e88a1 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 200 len: 1593 microversion: 2.1 time: 0.172315 Aug 04 17:41:21.618074 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3341/6792] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:21 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 1593 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:23.424669 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:41:23.426797 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=15 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:41:23.427562 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:41:23.432649 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-e15d9e68-4c95-49b4-98bc-4b36e6caa9b9 req-7cee14a2-89de-4b3c-baab-de62fc28cbda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d19987c-6a7a-427d-b702-f434ee6b3609", "tag": "f9dfef15-2062-45a0-8991-1bfac56bc75a"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:41:23.445997 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-e15d9e68-4c95-49b4-98bc-4b36e6caa9b9 req-7cee14a2-89de-4b3c-baab-de62fc28cbda service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:23.446427 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-e15d9e68-4c95-49b4-98bc-4b36e6caa9b9 req-7cee14a2-89de-4b3c-baab-de62fc28cbda service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:23.459877 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-e15d9e68-4c95-49b4-98bc-4b36e6caa9b9 req-7cee14a2-89de-4b3c-baab-de62fc28cbda service nova] Creating event network-changed:f9dfef15-2062-45a0-8991-1bfac56bc75a for instance 1d19987c-6a7a-427d-b702-f434ee6b3609 on n-h2-846466-12 Aug 04 17:41:23.465749 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-e15d9e68-4c95-49b4-98bc-4b36e6caa9b9 req-7cee14a2-89de-4b3c-baab-de62fc28cbda service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042531 Aug 04 17:41:23.466605 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3452/6793] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:41:24.743087 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b10be083-f272-45d0-9785-19b975fe6e3a tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1532799024"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:41:24.743781 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b10be083-f272-45d0-9785-19b975fe6e3a tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:24.751759 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b10be083-f272-45d0-9785-19b975fe6e3a tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:24.752594 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b10be083-f272-45d0-9785-19b975fe6e3a tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:24.753537 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b10be083-f272-45d0-9785-19b975fe6e3a tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:24.754060 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b10be083-f272-45d0-9785-19b975fe6e3a tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:24.914013 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.network.security_group_api [None req-b10be083-f272-45d0-9785-19b975fe6e3a tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Adding security group f47e98d7-df09-452f-a8b0-55bd64b71343 to port f9dfef15-2062-45a0-8991-1bfac56bc75a Aug 04 17:41:25.284176 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b10be083-f272-45d0-9785-19b975fe6e3a tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "POST /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609/action" status: 202 len: 0 microversion: 2.1 time: 0.545442 Aug 04 17:41:25.284825 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3342/6794] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:41:24 2022] POST /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609/action => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:41:25.301616 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-180d8b83-f517-446a-9250-f852aa9c1765 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:25.303070 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-180d8b83-f517-446a-9250-f852aa9c1765 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:25.319069 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-180d8b83-f517-446a-9250-f852aa9c1765 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:25.320051 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-180d8b83-f517-446a-9250-f852aa9c1765 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:25.321467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-180d8b83-f517-446a-9250-f852aa9c1765 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:25.322935 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-180d8b83-f517-446a-9250-f852aa9c1765 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:25.489025 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-8333cac5-31df-4f87-b651-62849b3299f4 req-221fd89d-37cc-41ca-8aa0-02b11a1b1a29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d19987c-6a7a-427d-b702-f434ee6b3609", "tag": "f9dfef15-2062-45a0-8991-1bfac56bc75a"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:41:25.508596 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-8333cac5-31df-4f87-b651-62849b3299f4 req-221fd89d-37cc-41ca-8aa0-02b11a1b1a29 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:25.510015 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-8333cac5-31df-4f87-b651-62849b3299f4 req-221fd89d-37cc-41ca-8aa0-02b11a1b1a29 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:25.535187 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-8333cac5-31df-4f87-b651-62849b3299f4 req-221fd89d-37cc-41ca-8aa0-02b11a1b1a29 service nova] Creating event network-changed:f9dfef15-2062-45a0-8991-1bfac56bc75a for instance 1d19987c-6a7a-427d-b702-f434ee6b3609 on n-h2-846466-12 Aug 04 17:41:25.547008 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-8333cac5-31df-4f87-b651-62849b3299f4 req-221fd89d-37cc-41ca-8aa0-02b11a1b1a29 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064773 Aug 04 17:41:25.548329 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3343/6795] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:41:25.562840 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-180d8b83-f517-446a-9250-f852aa9c1765 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:25.583085 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-180d8b83-f517-446a-9250-f852aa9c1765 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 200 len: 1759 microversion: 2.1 time: 0.292293 Aug 04 17:41:25.584305 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3453/6796] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:25 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 1759 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:40.589939 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-877d745e-f472-4d5b-a85c-7ef8f5685565 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:41:40.592682 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-877d745e-f472-4d5b-a85c-7ef8f5685565 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:40.598186 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:41:40.598186 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=12 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:41:40.601885 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-877d745e-f472-4d5b-a85c-7ef8f5685565 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:40.602481 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-877d745e-f472-4d5b-a85c-7ef8f5685565 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:40.603254 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-877d745e-f472-4d5b-a85c-7ef8f5685565 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:40.603734 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-877d745e-f472-4d5b-a85c-7ef8f5685565 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:40.688902 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-877d745e-f472-4d5b-a85c-7ef8f5685565 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "POST /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609/action" status: 202 len: 0 microversion: 2.1 time: 0.103029 Aug 04 17:41:40.689598 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3344/6797] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:41:40 2022] POST /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:41:40.698377 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-57385df2-aacd-43db-b583-3eae65790daa tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:40.698982 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-57385df2-aacd-43db-b583-3eae65790daa tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:40.701915 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:41:40.702582 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=8 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:41:40.709471 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-57385df2-aacd-43db-b583-3eae65790daa tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:40.710374 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-57385df2-aacd-43db-b583-3eae65790daa tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:40.711230 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-57385df2-aacd-43db-b583-3eae65790daa tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:40.711768 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-57385df2-aacd-43db-b583-3eae65790daa tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:40.899698 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-57385df2-aacd-43db-b583-3eae65790daa tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:40.908391 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-57385df2-aacd-43db-b583-3eae65790daa tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 200 len: 1751 microversion: 2.1 time: 0.214299 Aug 04 17:41:40.909004 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3454/6798] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:40 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 1751 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:41.984266 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cb60dc2c-3816-4439-a1e6-378a433cc7bf tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:41.984981 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cb60dc2c-3816-4439-a1e6-378a433cc7bf tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:41.991949 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cb60dc2c-3816-4439-a1e6-378a433cc7bf tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:41.992404 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cb60dc2c-3816-4439-a1e6-378a433cc7bf tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:41.993371 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cb60dc2c-3816-4439-a1e6-378a433cc7bf tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:41.993819 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cb60dc2c-3816-4439-a1e6-378a433cc7bf tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:42.152882 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cb60dc2c-3816-4439-a1e6-378a433cc7bf tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:42.166239 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cb60dc2c-3816-4439-a1e6-378a433cc7bf tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 200 len: 1756 microversion: 2.1 time: 0.239253 Aug 04 17:41:42.167186 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3345/6799] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:41 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 1756 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:43.190386 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-81c116c3-27dc-48ee-acb3-bcca00e97469 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:43.191001 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-81c116c3-27dc-48ee-acb3-bcca00e97469 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:43.199068 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-81c116c3-27dc-48ee-acb3-bcca00e97469 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:43.199512 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-81c116c3-27dc-48ee-acb3-bcca00e97469 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:43.200301 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-81c116c3-27dc-48ee-acb3-bcca00e97469 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:43.200734 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-81c116c3-27dc-48ee-acb3-bcca00e97469 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:43.393321 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-81c116c3-27dc-48ee-acb3-bcca00e97469 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:43.403575 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-81c116c3-27dc-48ee-acb3-bcca00e97469 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 200 len: 1756 microversion: 2.1 time: 0.217921 Aug 04 17:41:43.404264 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3455/6800] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:43 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 1756 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:44.426189 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6920863c-1164-442d-85bf-2aa0c48b7527 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:44.426800 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6920863c-1164-442d-85bf-2aa0c48b7527 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:44.436839 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6920863c-1164-442d-85bf-2aa0c48b7527 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:44.437259 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6920863c-1164-442d-85bf-2aa0c48b7527 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:44.438137 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6920863c-1164-442d-85bf-2aa0c48b7527 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:44.438716 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6920863c-1164-442d-85bf-2aa0c48b7527 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:44.601007 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6920863c-1164-442d-85bf-2aa0c48b7527 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:44.610545 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6920863c-1164-442d-85bf-2aa0c48b7527 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 200 len: 1756 microversion: 2.1 time: 0.188344 Aug 04 17:41:44.611105 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3346/6801] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:44 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:45.632590 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ff05e0fb-cd9e-4b02-9817-7b1faf4e6dda tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:45.633172 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ff05e0fb-cd9e-4b02-9817-7b1faf4e6dda tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:45.640976 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ff05e0fb-cd9e-4b02-9817-7b1faf4e6dda tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:45.641480 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ff05e0fb-cd9e-4b02-9817-7b1faf4e6dda tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:45.642227 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ff05e0fb-cd9e-4b02-9817-7b1faf4e6dda tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:45.642651 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ff05e0fb-cd9e-4b02-9817-7b1faf4e6dda tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:45.817981 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ff05e0fb-cd9e-4b02-9817-7b1faf4e6dda tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:45.829661 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ff05e0fb-cd9e-4b02-9817-7b1faf4e6dda tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 200 len: 1756 microversion: 2.1 time: 0.201261 Aug 04 17:41:45.830229 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3456/6802] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:45 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 1756 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:46.851729 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e42ee950-ee65-45b1-a143-0c49c4d8713c tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:46.852383 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e42ee950-ee65-45b1-a143-0c49c4d8713c tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:46.862189 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e42ee950-ee65-45b1-a143-0c49c4d8713c tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:46.862650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e42ee950-ee65-45b1-a143-0c49c4d8713c tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:46.863475 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e42ee950-ee65-45b1-a143-0c49c4d8713c tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:46.863927 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e42ee950-ee65-45b1-a143-0c49c4d8713c tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:47.023164 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e42ee950-ee65-45b1-a143-0c49c4d8713c tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:47.032315 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e42ee950-ee65-45b1-a143-0c49c4d8713c tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 200 len: 1756 microversion: 2.1 time: 0.184637 Aug 04 17:41:47.032924 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3347/6803] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:46 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:48.055186 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-80af5a30-88aa-4bb8-950d-911ea9d48d16 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:48.055806 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-80af5a30-88aa-4bb8-950d-911ea9d48d16 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:48.063466 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-80af5a30-88aa-4bb8-950d-911ea9d48d16 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:48.063909 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-80af5a30-88aa-4bb8-950d-911ea9d48d16 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:48.064693 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-80af5a30-88aa-4bb8-950d-911ea9d48d16 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:48.065141 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-80af5a30-88aa-4bb8-950d-911ea9d48d16 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:48.222123 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-80af5a30-88aa-4bb8-950d-911ea9d48d16 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:48.231816 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-80af5a30-88aa-4bb8-950d-911ea9d48d16 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 200 len: 1756 microversion: 2.1 time: 0.181392 Aug 04 17:41:48.232417 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3457/6804] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:48 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:49.255332 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f8c7b48b-86ad-4c9b-a1d1-8f866129c106 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:49.255982 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f8c7b48b-86ad-4c9b-a1d1-8f866129c106 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:49.262906 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f8c7b48b-86ad-4c9b-a1d1-8f866129c106 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:49.263357 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f8c7b48b-86ad-4c9b-a1d1-8f866129c106 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:49.264134 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f8c7b48b-86ad-4c9b-a1d1-8f866129c106 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:49.264572 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f8c7b48b-86ad-4c9b-a1d1-8f866129c106 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:49.429061 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f8c7b48b-86ad-4c9b-a1d1-8f866129c106 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:49.437635 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f8c7b48b-86ad-4c9b-a1d1-8f866129c106 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 200 len: 1756 microversion: 2.1 time: 0.187198 Aug 04 17:41:49.438228 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3348/6805] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:49 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:50.464396 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d7a5932a-8463-4364-b082-567c88260e20 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:50.465021 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d7a5932a-8463-4364-b082-567c88260e20 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:50.472602 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d7a5932a-8463-4364-b082-567c88260e20 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:50.473053 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d7a5932a-8463-4364-b082-567c88260e20 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:50.473864 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d7a5932a-8463-4364-b082-567c88260e20 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:50.474301 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d7a5932a-8463-4364-b082-567c88260e20 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:50.635651 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d7a5932a-8463-4364-b082-567c88260e20 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:50.644437 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d7a5932a-8463-4364-b082-567c88260e20 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 200 len: 1756 microversion: 2.1 time: 0.184148 Aug 04 17:41:50.645052 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3458/6806] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:50 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:51.666457 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1be7bcc4-f365-4be8-89d0-557466e7e7a3 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:51.667067 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1be7bcc4-f365-4be8-89d0-557466e7e7a3 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:51.676781 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1be7bcc4-f365-4be8-89d0-557466e7e7a3 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:51.677232 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1be7bcc4-f365-4be8-89d0-557466e7e7a3 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:51.678440 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1be7bcc4-f365-4be8-89d0-557466e7e7a3 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:51.679035 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1be7bcc4-f365-4be8-89d0-557466e7e7a3 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:51.857802 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1be7bcc4-f365-4be8-89d0-557466e7e7a3 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:51.867266 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1be7bcc4-f365-4be8-89d0-557466e7e7a3 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 200 len: 1756 microversion: 2.1 time: 0.204788 Aug 04 17:41:51.867824 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3349/6807] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:51 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 1756 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:52.889044 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-591fe23b-d1bc-42fb-9fef-8e39b0150665 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:52.889750 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-591fe23b-d1bc-42fb-9fef-8e39b0150665 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:52.896794 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-591fe23b-d1bc-42fb-9fef-8e39b0150665 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:52.897244 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-591fe23b-d1bc-42fb-9fef-8e39b0150665 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:52.898381 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-591fe23b-d1bc-42fb-9fef-8e39b0150665 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:41:52.898820 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-591fe23b-d1bc-42fb-9fef-8e39b0150665 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:41:53.065397 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-591fe23b-d1bc-42fb-9fef-8e39b0150665 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:53.074233 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-591fe23b-d1bc-42fb-9fef-8e39b0150665 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 200 len: 1759 microversion: 2.1 time: 0.189487 Aug 04 17:41:53.074864 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3459/6808] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:52 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 1759 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:16.573480 n-d-846466-12 devstack@n-api.service[126126]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:42:16.574086 n-d-846466-12 devstack@n-api.service[126126]: Thu Aug 4 17:42:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 17:42:25.458960 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-af4689e5-5df4-495c-8ba8-425c82571539 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1532799024"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:42:25.459671 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-af4689e5-5df4-495c-8ba8-425c82571539 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:25.461808 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=12 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:42:25.462474 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:42:25.468255 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-af4689e5-5df4-495c-8ba8-425c82571539 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:25.468776 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-af4689e5-5df4-495c-8ba8-425c82571539 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:25.469512 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-af4689e5-5df4-495c-8ba8-425c82571539 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:25.469957 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-af4689e5-5df4-495c-8ba8-425c82571539 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:25.618534 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.network.security_group_api [None req-af4689e5-5df4-495c-8ba8-425c82571539 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Removing security group f47e98d7-df09-452f-a8b0-55bd64b71343 from port f9dfef15-2062-45a0-8991-1bfac56bc75a Aug 04 17:42:25.961302 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-af4689e5-5df4-495c-8ba8-425c82571539 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "POST /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609/action" status: 202 len: 0 microversion: 2.1 time: 0.506710 Aug 04 17:42:25.962110 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3350/6809] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:42:25 2022] POST /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:42:25.972387 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=12 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:42:25.974323 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=36 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:42:26.091463 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-9816ff67-0d96-4e8e-9050-94b626f76a92 req-8bc6d0d3-37f9-4b65-8fae-a44209f4b639 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d19987c-6a7a-427d-b702-f434ee6b3609", "tag": "f9dfef15-2062-45a0-8991-1bfac56bc75a"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:42:26.103497 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-9816ff67-0d96-4e8e-9050-94b626f76a92 req-8bc6d0d3-37f9-4b65-8fae-a44209f4b639 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:26.103919 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-9816ff67-0d96-4e8e-9050-94b626f76a92 req-8bc6d0d3-37f9-4b65-8fae-a44209f4b639 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:26.116878 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-9816ff67-0d96-4e8e-9050-94b626f76a92 req-8bc6d0d3-37f9-4b65-8fae-a44209f4b639 service nova] Creating event network-changed:f9dfef15-2062-45a0-8991-1bfac56bc75a for instance 1d19987c-6a7a-427d-b702-f434ee6b3609 on n-h2-846466-12 Aug 04 17:42:26.122663 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-9816ff67-0d96-4e8e-9050-94b626f76a92 req-8bc6d0d3-37f9-4b65-8fae-a44209f4b639 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155338 Aug 04 17:42:26.126540 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3460/6810] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:42:27.515734 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b58b6d49-ced4-40eb-aac8-f8c0af6303fd tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:27.516362 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b58b6d49-ced4-40eb-aac8-f8c0af6303fd tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:27.523267 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b58b6d49-ced4-40eb-aac8-f8c0af6303fd tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:27.523855 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b58b6d49-ced4-40eb-aac8-f8c0af6303fd tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:27.524635 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b58b6d49-ced4-40eb-aac8-f8c0af6303fd tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:27.525177 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b58b6d49-ced4-40eb-aac8-f8c0af6303fd tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:27.612006 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-b58b6d49-ced4-40eb-aac8-f8c0af6303fd tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lazy-loading 'services' on Instance uuid 1d19987c-6a7a-427d-b702-f434ee6b3609 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:42:27.695586 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b58b6d49-ced4-40eb-aac8-f8c0af6303fd tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609/os-volume_attachments/c555e17a-210e-4269-b4fb-7aa20671be1d" status: 202 len: 0 microversion: 2.1 time: 0.184716 Aug 04 17:42:27.696203 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3351/6811] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Aug 4 17:42:27 2022] DELETE /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609/os-volume_attachments/c555e17a-210e-4269-b4fb-7aa20671be1d => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:42:27.705899 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9b9c9245-c0a4-484b-b995-6154675647e0 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:27.708336 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9b9c9245-c0a4-484b-b995-6154675647e0 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:27.715786 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9b9c9245-c0a4-484b-b995-6154675647e0 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:27.716612 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9b9c9245-c0a4-484b-b995-6154675647e0 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:27.717396 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9b9c9245-c0a4-484b-b995-6154675647e0 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:27.717982 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9b9c9245-c0a4-484b-b995-6154675647e0 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:27.753157 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9b9c9245-c0a4-484b-b995-6154675647e0 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051470 Aug 04 17:42:27.753948 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3461/6812] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:42:27 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:42:28.138093 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-48af4859-34a9-4a51-8d39-01460ebfcbca req-35de7df8-71d0-4d67-aaf5-45e34d3101ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d19987c-6a7a-427d-b702-f434ee6b3609", "tag": "f9dfef15-2062-45a0-8991-1bfac56bc75a"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:42:28.149301 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-48af4859-34a9-4a51-8d39-01460ebfcbca req-35de7df8-71d0-4d67-aaf5-45e34d3101ef service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:28.149834 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-48af4859-34a9-4a51-8d39-01460ebfcbca req-35de7df8-71d0-4d67-aaf5-45e34d3101ef service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:28.162354 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-48af4859-34a9-4a51-8d39-01460ebfcbca req-35de7df8-71d0-4d67-aaf5-45e34d3101ef service nova] Creating event network-changed:f9dfef15-2062-45a0-8991-1bfac56bc75a for instance 1d19987c-6a7a-427d-b702-f434ee6b3609 on n-h2-846466-12 Aug 04 17:42:28.168195 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-48af4859-34a9-4a51-8d39-01460ebfcbca req-35de7df8-71d0-4d67-aaf5-45e34d3101ef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034261 Aug 04 17:42:28.168818 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3352/6813] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:42:28.769313 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bba405a4-99d6-4297-8b8b-f152b308ff4c tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:28.771607 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bba405a4-99d6-4297-8b8b-f152b308ff4c tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:28.780155 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bba405a4-99d6-4297-8b8b-f152b308ff4c tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:28.780944 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bba405a4-99d6-4297-8b8b-f152b308ff4c tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:28.782513 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bba405a4-99d6-4297-8b8b-f152b308ff4c tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:28.782992 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bba405a4-99d6-4297-8b8b-f152b308ff4c tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:28.818456 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bba405a4-99d6-4297-8b8b-f152b308ff4c tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055611 Aug 04 17:42:28.819348 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3462/6814] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:42:28 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:42:29.832226 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-70ace272-8057-456a-a7f5-26c89f82243d tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:29.834604 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-70ace272-8057-456a-a7f5-26c89f82243d tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:29.842366 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70ace272-8057-456a-a7f5-26c89f82243d tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:29.842830 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70ace272-8057-456a-a7f5-26c89f82243d tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:29.843739 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70ace272-8057-456a-a7f5-26c89f82243d tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:29.844212 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70ace272-8057-456a-a7f5-26c89f82243d tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:29.875163 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-70ace272-8057-456a-a7f5-26c89f82243d tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047218 Aug 04 17:42:29.875739 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3353/6815] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:42:29 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:42:30.888707 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-697c196f-7f03-41c0-b030-53db93ad9ab2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:30.891466 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-697c196f-7f03-41c0-b030-53db93ad9ab2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:30.899379 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-697c196f-7f03-41c0-b030-53db93ad9ab2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:30.899830 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-697c196f-7f03-41c0-b030-53db93ad9ab2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:30.900643 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-697c196f-7f03-41c0-b030-53db93ad9ab2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:30.901081 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-697c196f-7f03-41c0-b030-53db93ad9ab2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:30.933301 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-697c196f-7f03-41c0-b030-53db93ad9ab2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048769 Aug 04 17:42:30.934148 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3463/6816] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:42:30 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:42:31.946412 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a016f790-7d56-411f-953d-9e169d073dd2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:31.948723 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a016f790-7d56-411f-953d-9e169d073dd2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:31.957042 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a016f790-7d56-411f-953d-9e169d073dd2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:31.957573 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a016f790-7d56-411f-953d-9e169d073dd2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:31.958446 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a016f790-7d56-411f-953d-9e169d073dd2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:31.958954 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a016f790-7d56-411f-953d-9e169d073dd2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:31.990814 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a016f790-7d56-411f-953d-9e169d073dd2 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048434 Aug 04 17:42:31.991407 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3354/6817] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:42:31 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:42:33.003495 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-72111212-cd0a-4ad2-b400-32ce5e1817da tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:33.005780 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-72111212-cd0a-4ad2-b400-32ce5e1817da tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:33.013173 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-72111212-cd0a-4ad2-b400-32ce5e1817da tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:33.013650 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-72111212-cd0a-4ad2-b400-32ce5e1817da tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:33.014414 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-72111212-cd0a-4ad2-b400-32ce5e1817da tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:33.014855 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-72111212-cd0a-4ad2-b400-32ce5e1817da tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:33.046184 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-72111212-cd0a-4ad2-b400-32ce5e1817da tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046930 Aug 04 17:42:33.047421 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3464/6818] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Aug 4 17:42:32 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:42:33.062220 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a18b83e1-4463-42cd-b468-9e6fa6116a10 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:33.062976 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a18b83e1-4463-42cd-b468-9e6fa6116a10 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:33.074528 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a18b83e1-4463-42cd-b468-9e6fa6116a10 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:33.075226 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a18b83e1-4463-42cd-b468-9e6fa6116a10 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:33.076497 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a18b83e1-4463-42cd-b468-9e6fa6116a10 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:33.077493 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a18b83e1-4463-42cd-b468-9e6fa6116a10 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:33.158357 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-a18b83e1-4463-42cd-b468-9e6fa6116a10 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] HTTP exception thrown: Instance 1d19987c-6a7a-427d-b702-f434ee6b3609 is not attached to volume c555e17a-210e-4269-b4fb-7aa20671be1d Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a18b83e1-4463-42cd-b468-9e6fa6116a10 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Request method failure captured: Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: request: DELETE /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609/os-volume_attachments/c555e17a-210e-4269-b4fb-7aa20671be1d HTTP/1.1 Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi7AOkKOKgA4mOyItmKZeA1rzye1ULpTUFA4p8oFonHIygCNHWj3lZfD-qJ4Qxz5zSyWZxwvNO1gB1MjLX0MYSB7La2QJuNlVHdu-rpeDZGA8HRHUEPRiiS8XtQ_3Iu1lT5M5lXCSViNoHgA_dhzoON9w_1n4JTCq2pRTRvLOei5DJ5tU Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: bddca9dabc444e7db049241849b041a1 Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-TestMinimumBasicScenario-1835807098 Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bddca9dabc444e7db049241849b041a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bddca9dabc444e7db049241849b041a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bddca9dabc444e7db049241849b041a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bddca9dabc444e7db049241849b041a1"}]}] Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-TestMinimumBasicScenario-1835807098 Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: bddca9dabc444e7db049241849b041a1 Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1835807098 Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-TestMinimumBasicScenario-1835807098-project Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 5b122edce41944a09afdc9a84d647536 Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-TestMinimumBasicScenario-1835807098-project Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 1d19987c-6a7a-427d-b702-f434ee6b3609 is not attached to volume c555e17a-210e-4269-b4fb-7aa20671be1d Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'server_id': '1d19987c-6a7a-427d-b702-f434ee6b3609', 'id': 'c555e17a-210e-4269-b4fb-7aa20671be1d'} Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c555e17a-210e-4269-b4fb-7aa20671be1d. Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d19987c-6a7a-427d-b702-f434ee6b3609 is not attached to volume c555e17a-210e-4269-b4fb-7aa20671be1d Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:42:33.159757 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:42:33.164331 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:42:33.164331 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:42:33.164331 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d19987c-6a7a-427d-b702-f434ee6b3609 is not attached to volume c555e17a-210e-4269-b4fb-7aa20671be1d Aug 04 17:42:33.164331 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:42:33.164331 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a18b83e1-4463-42cd-b468-9e6fa6116a10 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Returning 404 to user: Instance 1d19987c-6a7a-427d-b702-f434ee6b3609 is not attached to volume c555e17a-210e-4269-b4fb-7aa20671be1d {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:42:33.164331 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a18b83e1-4463-42cd-b468-9e6fa6116a10 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609/os-volume_attachments/c555e17a-210e-4269-b4fb-7aa20671be1d" status: 404 len: 154 microversion: 2.1 time: 0.106574 Aug 04 17:42:33.164331 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3355/6819] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Aug 4 17:42:33 2022] DELETE /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609/os-volume_attachments/c555e17a-210e-4269-b4fb-7aa20671be1d => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:42:36.432095 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4872433f-fcf1-4238-99a8-b7dc00ee6caf tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:36.432629 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4872433f-fcf1-4238-99a8-b7dc00ee6caf tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:36.440059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4872433f-fcf1-4238-99a8-b7dc00ee6caf tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:36.440505 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4872433f-fcf1-4238-99a8-b7dc00ee6caf tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:36.441271 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4872433f-fcf1-4238-99a8-b7dc00ee6caf tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:36.441728 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4872433f-fcf1-4238-99a8-b7dc00ee6caf tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:36.470377 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4872433f-fcf1-4238-99a8-b7dc00ee6caf tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:42:36.556870 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4872433f-fcf1-4238-99a8-b7dc00ee6caf tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 204 len: 0 microversion: 2.1 time: 0.128248 Aug 04 17:42:36.557330 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3465/6820] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:42:36 2022] DELETE /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:42:36.565889 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-58d313d6-eab0-4bc8-a207-24a6b3d2ce79 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:36.566523 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-58d313d6-eab0-4bc8-a207-24a6b3d2ce79 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:36.574471 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58d313d6-eab0-4bc8-a207-24a6b3d2ce79 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:36.574932 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58d313d6-eab0-4bc8-a207-24a6b3d2ce79 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:36.575714 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58d313d6-eab0-4bc8-a207-24a6b3d2ce79 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:36.576161 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-58d313d6-eab0-4bc8-a207-24a6b3d2ce79 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:36.719941 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-58d313d6-eab0-4bc8-a207-24a6b3d2ce79 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:36.728401 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-58d313d6-eab0-4bc8-a207-24a6b3d2ce79 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 200 len: 1553 microversion: 2.1 time: 0.166551 Aug 04 17:42:36.728990 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3356/6821] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:36 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:37.750936 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-03fb7aac-dfa6-4fe1-9cda-d132ac63d310 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:37.751595 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-03fb7aac-dfa6-4fe1-9cda-d132ac63d310 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:37.759596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-03fb7aac-dfa6-4fe1-9cda-d132ac63d310 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:37.760045 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-03fb7aac-dfa6-4fe1-9cda-d132ac63d310 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:37.760822 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-03fb7aac-dfa6-4fe1-9cda-d132ac63d310 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:37.761256 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-03fb7aac-dfa6-4fe1-9cda-d132ac63d310 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:37.899680 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-03fb7aac-dfa6-4fe1-9cda-d132ac63d310 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:37.907835 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-03fb7aac-dfa6-4fe1-9cda-d132ac63d310 tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 200 len: 1553 microversion: 2.1 time: 0.161612 Aug 04 17:42:37.908420 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3466/6822] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:37 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:38.716797 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-13199ad8-053a-48cc-9b53-2d2843e0c2cb req-7640004f-ae9a-4eb8-a672-0e9e9a9f35af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d19987c-6a7a-427d-b702-f434ee6b3609", "name": "network-vif-deleted", "tag": "f9dfef15-2062-45a0-8991-1bfac56bc75a"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:42:38.731964 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-13199ad8-053a-48cc-9b53-2d2843e0c2cb req-7640004f-ae9a-4eb8-a672-0e9e9a9f35af service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:38.732504 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-13199ad8-053a-48cc-9b53-2d2843e0c2cb req-7640004f-ae9a-4eb8-a672-0e9e9a9f35af service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:38.745444 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-13199ad8-053a-48cc-9b53-2d2843e0c2cb req-7640004f-ae9a-4eb8-a672-0e9e9a9f35af service nova] Creating event network-vif-deleted:f9dfef15-2062-45a0-8991-1bfac56bc75a for instance 1d19987c-6a7a-427d-b702-f434ee6b3609 on n-h2-846466-12 Aug 04 17:42:38.750691 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-13199ad8-053a-48cc-9b53-2d2843e0c2cb req-7640004f-ae9a-4eb8-a672-0e9e9a9f35af service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037632 Aug 04 17:42:38.751497 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3357/6823] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:42:38.936822 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d9fd1e00-0053-4293-8a06-346878464ffc tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:38.937419 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d9fd1e00-0053-4293-8a06-346878464ffc tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:38.945254 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d9fd1e00-0053-4293-8a06-346878464ffc tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:38.945736 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d9fd1e00-0053-4293-8a06-346878464ffc tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:38.946516 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d9fd1e00-0053-4293-8a06-346878464ffc tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:38.946970 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d9fd1e00-0053-4293-8a06-346878464ffc tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:38.983802 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d9fd1e00-0053-4293-8a06-346878464ffc tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:38.984251 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d9fd1e00-0053-4293-8a06-346878464ffc tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:38.984729 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-d9fd1e00-0053-4293-8a06-346878464ffc tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lazy-loading 'fault' on Instance uuid 1d19987c-6a7a-427d-b702-f434ee6b3609 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:42:39.034121 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d9fd1e00-0053-4293-8a06-346878464ffc tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b122edce41944a09afdc9a84d647536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddca9dabc444e7db049241849b041a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:39.043892 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d9fd1e00-0053-4293-8a06-346878464ffc tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 200 len: 1347 microversion: 2.1 time: 0.111153 Aug 04 17:42:39.046888 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3467/6824] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:38 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 1347 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:40.068028 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f042e0b5-9821-4bc0-9a83-7ae24480e03e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:40.068737 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f042e0b5-9821-4bc0-9a83-7ae24480e03e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] [instance: 1d19987c-6a7a-427d-b702-f434ee6b3609] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:40.075606 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f042e0b5-9821-4bc0-9a83-7ae24480e03e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:40.076065 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f042e0b5-9821-4bc0-9a83-7ae24480e03e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:40.076833 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f042e0b5-9821-4bc0-9a83-7ae24480e03e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:40.077302 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f042e0b5-9821-4bc0-9a83-7ae24480e03e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:40.092253 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-f042e0b5-9821-4bc0-9a83-7ae24480e03e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] HTTP exception thrown: Instance 1d19987c-6a7a-427d-b702-f434ee6b3609 could not be found. Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f042e0b5-9821-4bc0-9a83-7ae24480e03e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Request method failure captured: Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 HTTP/1.1 Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi7AOkKOKgA4mOyItmKZeA1rzye1ULpTUFA4p8oFonHIygCNHWj3lZfD-qJ4Qxz5zSyWZxwvNO1gB1MjLX0MYSB7La2QJuNlVHdu-rpeDZGA8HRHUEPRiiS8XtQ_3Iu1lT5M5lXCSViNoHgA_dhzoON9w_1n4JTCq2pRTRvLOei5DJ5tU Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: bddca9dabc444e7db049241849b041a1 Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-TestMinimumBasicScenario-1835807098 Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bddca9dabc444e7db049241849b041a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bddca9dabc444e7db049241849b041a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bddca9dabc444e7db049241849b041a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bddca9dabc444e7db049241849b041a1"}]}] Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-TestMinimumBasicScenario-1835807098 Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: bddca9dabc444e7db049241849b041a1 Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1835807098 Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-TestMinimumBasicScenario-1835807098-project Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 5b122edce41944a09afdc9a84d647536 Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-TestMinimumBasicScenario-1835807098-project Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 1d19987c-6a7a-427d-b702-f434ee6b3609 could not be found. Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '1d19987c-6a7a-427d-b702-f434ee6b3609'} Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d19987c-6a7a-427d-b702-f434ee6b3609 could not be found. Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d19987c-6a7a-427d-b702-f434ee6b3609 could not be found. Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:42:40.093985 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:42:40.098354 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:42:40.098354 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:42:40.098354 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:42:40.098354 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:42:40.098354 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:42:40.098354 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d19987c-6a7a-427d-b702-f434ee6b3609 could not be found. Aug 04 17:42:40.098354 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:42:40.098354 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f042e0b5-9821-4bc0-9a83-7ae24480e03e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Returning 404 to user: Instance 1d19987c-6a7a-427d-b702-f434ee6b3609 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:42:40.098354 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f042e0b5-9821-4bc0-9a83-7ae24480e03e tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609" status: 404 len: 111 microversion: 2.1 time: 0.032672 Aug 04 17:42:40.098354 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3358/6825] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:40 2022] GET /compute/v2.1/servers/1d19987c-6a7a-427d-b702-f434ee6b3609 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:42:40.107640 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2bef75ee-e73e-43eb-8df5-022c6909d86f tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] Calling method '.version_select at 0x7f7e77d36700>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:40.140536 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2bef75ee-e73e-43eb-8df5-022c6909d86f tempest-TestMinimumBasicScenario-1835807098 tempest-TestMinimumBasicScenario-1835807098-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-631221123" status: 202 len: 0 microversion: 2.1 time: 0.038996 Aug 04 17:42:40.141218 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3468/6826] 10.222.0.23 () {58 vars in 1269 bytes} [Thu Aug 4 17:42:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-631221123 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:42:49.848433 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f05425d1-c892-4a6e-81f7-52404d6298e8 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Action: 'create', calling method: .version_select at 0x7f7e847ed940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-911310475", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7XoPAAmyLmkIb0/R18F8HzWthGGNYuFtiQ0DpuBktjLfYxYm8weBEMH2hcju90d4CHRupq8xNsTMNUDTbkNoGvc4VKOqHOnGkDEr9wlfsj75DpVhp1q/HySbooqbYGoA=="}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:42:49.866141 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-f05425d1-c892-4a6e-81f7-52404d6298e8 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Getting quotas for project 1e1c6b45635949478b403b8b5db448c9. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:42:49.871772 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-f05425d1-c892-4a6e-81f7-52404d6298e8 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Getting quotas for user 34dd901ba58f407891c63ac17cff7750 and project 1e1c6b45635949478b403b8b5db448c9. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:42:49.907808 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f05425d1-c892-4a6e-81f7-52404d6298e8 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.243918 Aug 04 17:42:49.908877 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3359/6827] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 17:42:49 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:42:56.558322 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:42:56.560167 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:42:56.565005 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-723c670c-fc37-430c-aed6-8d01205af27f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1513641859", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "811653f2-a2d1-4a78-825e-469020193bf8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-911310475", "security_groups": [{"name": "tempest-secgroup-smoke-1510541629"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:42:56.706524 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-723c670c-fc37-430c-aed6-8d01205af27f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] validate_networks() for [('811653f2-a2d1-4a78-825e-469020193bf8', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:42:57.164724 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-723c670c-fc37-430c-aed6-8d01205af27f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:42:57.165420 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-723c670c-fc37-430c-aed6-8d01205af27f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:42:57.166678 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-723c670c-fc37-430c-aed6-8d01205af27f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:42:57.167094 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-723c670c-fc37-430c-aed6-8d01205af27f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:42:57.167658 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-723c670c-fc37-430c-aed6-8d01205af27f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:42:57.177032 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-723c670c-fc37-430c-aed6-8d01205af27f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:57.177514 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-723c670c-fc37-430c-aed6-8d01205af27f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:57.178392 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-723c670c-fc37-430c-aed6-8d01205af27f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:57.178824 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-723c670c-fc37-430c-aed6-8d01205af27f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:57.206084 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-723c670c-fc37-430c-aed6-8d01205af27f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Getting quotas for project 1e1c6b45635949478b403b8b5db448c9. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:42:57.213049 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-723c670c-fc37-430c-aed6-8d01205af27f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Getting quotas for user 34dd901ba58f407891c63ac17cff7750 and project 1e1c6b45635949478b403b8b5db448c9. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:42:57.236252 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-723c670c-fc37-430c-aed6-8d01205af27f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:42:57.238662 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-723c670c-fc37-430c-aed6-8d01205af27f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:42:57.294012 n-d-846466-12 devstack@n-api.service[126125]: ERROR oslo.messaging._drivers.impl_rabbit [None req-723c670c-fc37-430c-aed6-8d01205af27f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [b042ee28-61dd-48b8-9569-21b30cd0d61a] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 17:42:58.301879 n-d-846466-12 devstack@n-api.service[126125]: INFO oslo.messaging._drivers.impl_rabbit [None req-723c670c-fc37-430c-aed6-8d01205af27f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [b042ee28-61dd-48b8-9569-21b30cd0d61a] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 38692. Aug 04 17:42:58.306800 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-723c670c-fc37-430c-aed6-8d01205af27f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.750972 Aug 04 17:42:58.307828 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3469/6828] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:42:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 1752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:42:58.316342 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:42:58.323360 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-dcbdd042-02c1-4687-abc6-be44eeef7c9d tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:58.323999 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-dcbdd042-02c1-4687-abc6-be44eeef7c9d tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:58.330334 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:42:58.390871 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-dcbdd042-02c1-4687-abc6-be44eeef7c9d tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:58.399806 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-dcbdd042-02c1-4687-abc6-be44eeef7c9d tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8" status: 200 len: 1266 microversion: 2.1 time: 0.084275 Aug 04 17:42:58.401918 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3360/6829] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:58 2022] GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:59.422804 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4a23aadc-0c41-44b9-868f-f09d28048324 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:59.423424 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4a23aadc-0c41-44b9-868f-f09d28048324 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:59.432168 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4a23aadc-0c41-44b9-868f-f09d28048324 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:59.432596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4a23aadc-0c41-44b9-868f-f09d28048324 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:59.433632 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4a23aadc-0c41-44b9-868f-f09d28048324 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:42:59.434130 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4a23aadc-0c41-44b9-868f-f09d28048324 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:42:59.505098 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4a23aadc-0c41-44b9-868f-f09d28048324 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:59.513707 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4a23aadc-0c41-44b9-868f-f09d28048324 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8" status: 200 len: 1318 microversion: 2.1 time: 0.095704 Aug 04 17:42:59.514304 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3470/6830] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:59 2022] GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8 => generated 1318 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:00.537835 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4cee2f9f-d85c-4d4d-b5fa-afbae432bcdc tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:00.539112 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4cee2f9f-d85c-4d4d-b5fa-afbae432bcdc tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:00.550838 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4cee2f9f-d85c-4d4d-b5fa-afbae432bcdc tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:00.551298 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4cee2f9f-d85c-4d4d-b5fa-afbae432bcdc tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:00.552278 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4cee2f9f-d85c-4d4d-b5fa-afbae432bcdc tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:00.552895 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4cee2f9f-d85c-4d4d-b5fa-afbae432bcdc tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:00.771680 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4cee2f9f-d85c-4d4d-b5fa-afbae432bcdc tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:00.783307 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4cee2f9f-d85c-4d4d-b5fa-afbae432bcdc tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8" status: 200 len: 1392 microversion: 2.1 time: 0.250360 Aug 04 17:43:00.783672 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3361/6831] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:00 2022] GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8 => generated 1392 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:01.086488 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-54a26d8b-e2a5-42a1-a50e-e0a001b58c47 req-f94b8132-267a-4eca-83fb-95aed98be014 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8", "tag": "4d7fd3be-658f-48f0-9776-ed1122153067"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:43:01.100274 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-54a26d8b-e2a5-42a1-a50e-e0a001b58c47 req-f94b8132-267a-4eca-83fb-95aed98be014 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:01.100774 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-54a26d8b-e2a5-42a1-a50e-e0a001b58c47 req-f94b8132-267a-4eca-83fb-95aed98be014 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:01.115501 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-54a26d8b-e2a5-42a1-a50e-e0a001b58c47 req-f94b8132-267a-4eca-83fb-95aed98be014 service nova] Creating event network-changed:4d7fd3be-658f-48f0-9776-ed1122153067 for instance 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8 on n-h1-846466-12 Aug 04 17:43:01.127795 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-54a26d8b-e2a5-42a1-a50e-e0a001b58c47 req-f94b8132-267a-4eca-83fb-95aed98be014 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045061 Aug 04 17:43:01.129019 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3471/6832] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:43:01.805458 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-335f664f-27e7-4188-b806-57b777e76c2a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:01.806044 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-335f664f-27e7-4188-b806-57b777e76c2a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:01.813244 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-335f664f-27e7-4188-b806-57b777e76c2a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:01.813758 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-335f664f-27e7-4188-b806-57b777e76c2a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:01.814522 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-335f664f-27e7-4188-b806-57b777e76c2a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:01.814963 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-335f664f-27e7-4188-b806-57b777e76c2a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:01.972417 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-335f664f-27e7-4188-b806-57b777e76c2a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:01.982355 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-335f664f-27e7-4188-b806-57b777e76c2a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8" status: 200 len: 1392 microversion: 2.1 time: 0.181434 Aug 04 17:43:01.983470 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3362/6833] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:01 2022] GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8 => generated 1392 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:03.008538 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0c3807f9-98c7-4c63-b3a7-248b68b81064 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:03.009348 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0c3807f9-98c7-4c63-b3a7-248b68b81064 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:03.015896 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0c3807f9-98c7-4c63-b3a7-248b68b81064 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:03.016356 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0c3807f9-98c7-4c63-b3a7-248b68b81064 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:03.017099 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0c3807f9-98c7-4c63-b3a7-248b68b81064 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:03.017591 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0c3807f9-98c7-4c63-b3a7-248b68b81064 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:03.252482 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0c3807f9-98c7-4c63-b3a7-248b68b81064 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:03.266639 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0c3807f9-98c7-4c63-b3a7-248b68b81064 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8" status: 200 len: 1392 microversion: 2.1 time: 0.263145 Aug 04 17:43:03.267824 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3472/6834] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:03 2022] GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8 => generated 1392 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:04.292458 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fec03974-7a20-401d-8a95-726367c6f26a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:04.293070 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fec03974-7a20-401d-8a95-726367c6f26a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:04.300381 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fec03974-7a20-401d-8a95-726367c6f26a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:04.300837 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fec03974-7a20-401d-8a95-726367c6f26a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:04.301635 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fec03974-7a20-401d-8a95-726367c6f26a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:04.302102 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fec03974-7a20-401d-8a95-726367c6f26a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:04.443371 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fec03974-7a20-401d-8a95-726367c6f26a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:04.451358 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fec03974-7a20-401d-8a95-726367c6f26a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8" status: 200 len: 1392 microversion: 2.1 time: 0.165467 Aug 04 17:43:04.451942 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3363/6835] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:04 2022] GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:05.473028 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-30c385fe-5ef4-4783-97a8-cd4ea2e7bdba tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:05.473672 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-30c385fe-5ef4-4783-97a8-cd4ea2e7bdba tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:05.481243 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-30c385fe-5ef4-4783-97a8-cd4ea2e7bdba tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:05.481726 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-30c385fe-5ef4-4783-97a8-cd4ea2e7bdba tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:05.482505 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-30c385fe-5ef4-4783-97a8-cd4ea2e7bdba tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:05.482919 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-30c385fe-5ef4-4783-97a8-cd4ea2e7bdba tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:05.628010 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-30c385fe-5ef4-4783-97a8-cd4ea2e7bdba tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:05.636260 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-30c385fe-5ef4-4783-97a8-cd4ea2e7bdba tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8" status: 200 len: 1392 microversion: 2.1 time: 0.167071 Aug 04 17:43:05.636868 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3473/6836] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:05 2022] GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:43:06.023725 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-962d55e6-adda-46a1-848f-dc7846e78323 req-b115f0ed-76b9-4788-adaa-61745e861f3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8", "name": "network-vif-plugged", "status": "completed", "tag": "4d7fd3be-658f-48f0-9776-ed1122153067"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:43:06.034891 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-962d55e6-adda-46a1-848f-dc7846e78323 req-b115f0ed-76b9-4788-adaa-61745e861f3a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:06.035340 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-962d55e6-adda-46a1-848f-dc7846e78323 req-b115f0ed-76b9-4788-adaa-61745e861f3a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:06.048062 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-962d55e6-adda-46a1-848f-dc7846e78323 req-b115f0ed-76b9-4788-adaa-61745e861f3a service nova] Creating event network-vif-plugged:4d7fd3be-658f-48f0-9776-ed1122153067 for instance 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8 on n-h1-846466-12 Aug 04 17:43:06.053214 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-962d55e6-adda-46a1-848f-dc7846e78323 req-b115f0ed-76b9-4788-adaa-61745e861f3a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033709 Aug 04 17:43:06.053882 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3364/6837] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:43:06.660474 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-de766099-17f4-4276-886b-a8c018017ab6 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:06.661065 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-de766099-17f4-4276-886b-a8c018017ab6 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:06.670338 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-de766099-17f4-4276-886b-a8c018017ab6 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:06.670779 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-de766099-17f4-4276-886b-a8c018017ab6 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:06.671543 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-de766099-17f4-4276-886b-a8c018017ab6 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:06.671968 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-de766099-17f4-4276-886b-a8c018017ab6 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:06.817710 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-de766099-17f4-4276-886b-a8c018017ab6 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:06.826297 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-de766099-17f4-4276-886b-a8c018017ab6 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8" status: 200 len: 1392 microversion: 2.1 time: 0.171643 Aug 04 17:43:06.826965 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3474/6838] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:06 2022] GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8 => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:07.861625 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2d780f71-8b1a-4f87-bb34-98f82a6b9405 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:07.862353 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2d780f71-8b1a-4f87-bb34-98f82a6b9405 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:07.872047 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2d780f71-8b1a-4f87-bb34-98f82a6b9405 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:07.872501 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2d780f71-8b1a-4f87-bb34-98f82a6b9405 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:07.873343 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2d780f71-8b1a-4f87-bb34-98f82a6b9405 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:07.873751 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2d780f71-8b1a-4f87-bb34-98f82a6b9405 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:08.015923 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2d780f71-8b1a-4f87-bb34-98f82a6b9405 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:08.024145 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2d780f71-8b1a-4f87-bb34-98f82a6b9405 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8" status: 200 len: 1563 microversion: 2.1 time: 0.171245 Aug 04 17:43:08.024712 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3365/6839] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:07 2022] GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8 => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:08.046554 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bc867b83-ef0b-47bf-8e09-082ca34d6603 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:08.047109 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bc867b83-ef0b-47bf-8e09-082ca34d6603 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:08.049147 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:43:08.049881 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:43:08.056848 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bc867b83-ef0b-47bf-8e09-082ca34d6603 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:08.057316 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bc867b83-ef0b-47bf-8e09-082ca34d6603 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:08.058101 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bc867b83-ef0b-47bf-8e09-082ca34d6603 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:08.058537 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bc867b83-ef0b-47bf-8e09-082ca34d6603 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:08.198884 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-bc867b83-ef0b-47bf-8e09-082ca34d6603 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:08.207252 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bc867b83-ef0b-47bf-8e09-082ca34d6603 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8" status: 200 len: 1563 microversion: 2.1 time: 0.165655 Aug 04 17:43:08.207823 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3475/6840] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:08 2022] GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8 => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:09.988739 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b09a93c1-2889-4f67-9cb6-0b936187e939 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:09.989499 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b09a93c1-2889-4f67-9cb6-0b936187e939 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:09.990513 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-43124b36-67f9-4d1d-82b0-260b09dc4762 req-0b5280b2-af4a-4fda-b714-e356e4df041f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8", "tag": "4d7fd3be-658f-48f0-9776-ed1122153067"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:43:09.991554 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:43:09.998604 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b09a93c1-2889-4f67-9cb6-0b936187e939 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:09.999383 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b09a93c1-2889-4f67-9cb6-0b936187e939 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:10.000451 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b09a93c1-2889-4f67-9cb6-0b936187e939 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:10.000837 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-43124b36-67f9-4d1d-82b0-260b09dc4762 req-0b5280b2-af4a-4fda-b714-e356e4df041f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:10.001107 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b09a93c1-2889-4f67-9cb6-0b936187e939 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:10.001268 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-43124b36-67f9-4d1d-82b0-260b09dc4762 req-0b5280b2-af4a-4fda-b714-e356e4df041f service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:10.013473 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-43124b36-67f9-4d1d-82b0-260b09dc4762 req-0b5280b2-af4a-4fda-b714-e356e4df041f service nova] Creating event network-changed:4d7fd3be-658f-48f0-9776-ed1122153067 for instance 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8 on n-h1-846466-12 Aug 04 17:43:10.018679 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-43124b36-67f9-4d1d-82b0-260b09dc4762 req-0b5280b2-af4a-4fda-b714-e356e4df041f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031867 Aug 04 17:43:10.019279 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3476/6841] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:43:10.229730 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b09a93c1-2889-4f67-9cb6-0b936187e939 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:10.238392 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b09a93c1-2889-4f67-9cb6-0b936187e939 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8" status: 200 len: 1563 microversion: 2.1 time: 0.254147 Aug 04 17:43:10.238984 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3366/6842] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:09 2022] GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8 => generated 1563 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:33.519614 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:43:33.520412 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=36 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:43:33.526186 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4a96fec6-c12e-4a94-8fdd-7d3559b4555b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:43:33.529534 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4a96fec6-c12e-4a94-8fdd-7d3559b4555b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:33.540738 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4a96fec6-c12e-4a94-8fdd-7d3559b4555b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:33.541296 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4a96fec6-c12e-4a94-8fdd-7d3559b4555b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:33.542273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4a96fec6-c12e-4a94-8fdd-7d3559b4555b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:33.542969 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4a96fec6-c12e-4a94-8fdd-7d3559b4555b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:33.607299 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4a96fec6-c12e-4a94-8fdd-7d3559b4555b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "POST /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8/action" status: 200 len: 24568 microversion: 2.1 time: 0.089941 Aug 04 17:43:33.607964 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3477/6843] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:43:33 2022] POST /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8/action => generated 24568 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:43:44.667489 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-103ecda0-2a11-4489-bbd0-26465d77b3dd tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:43:44.668105 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-103ecda0-2a11-4489-bbd0-26465d77b3dd tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:44.670538 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=15 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:43:44.671331 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=32 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:43:44.677834 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-103ecda0-2a11-4489-bbd0-26465d77b3dd tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:44.678270 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-103ecda0-2a11-4489-bbd0-26465d77b3dd tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:44.679071 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-103ecda0-2a11-4489-bbd0-26465d77b3dd tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:44.679536 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-103ecda0-2a11-4489-bbd0-26465d77b3dd tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:44.759016 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-103ecda0-2a11-4489-bbd0-26465d77b3dd tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "POST /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8/action" status: 202 len: 0 microversion: 2.1 time: 0.095519 Aug 04 17:43:44.760502 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3367/6844] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:43:44 2022] POST /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:43:44.769495 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fac42605-2f6f-4bfb-9524-fbf53b2a4d10 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:44.770190 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fac42605-2f6f-4bfb-9524-fbf53b2a4d10 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:44.773272 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:43:44.773953 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:43:44.779371 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fac42605-2f6f-4bfb-9524-fbf53b2a4d10 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:44.779828 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fac42605-2f6f-4bfb-9524-fbf53b2a4d10 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:44.780625 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fac42605-2f6f-4bfb-9524-fbf53b2a4d10 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:44.781094 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fac42605-2f6f-4bfb-9524-fbf53b2a4d10 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:44.933019 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fac42605-2f6f-4bfb-9524-fbf53b2a4d10 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:44.941353 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fac42605-2f6f-4bfb-9524-fbf53b2a4d10 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8" status: 200 len: 1687 microversion: 2.1 time: 0.176321 Aug 04 17:43:44.941959 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3478/6845] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:44 2022] GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8 => generated 1687 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:45.965639 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d5e27a6c-3668-4769-8dc7-f14b52e96be3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:45.966337 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d5e27a6c-3668-4769-8dc7-f14b52e96be3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:45.973490 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d5e27a6c-3668-4769-8dc7-f14b52e96be3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:45.973940 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d5e27a6c-3668-4769-8dc7-f14b52e96be3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:45.974693 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d5e27a6c-3668-4769-8dc7-f14b52e96be3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:45.975125 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d5e27a6c-3668-4769-8dc7-f14b52e96be3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:46.132810 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d5e27a6c-3668-4769-8dc7-f14b52e96be3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:46.141072 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d5e27a6c-3668-4769-8dc7-f14b52e96be3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8" status: 200 len: 1667 microversion: 2.1 time: 0.180573 Aug 04 17:43:46.141711 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3368/6846] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:45 2022] GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8 => generated 1667 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:47.248437 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-73e27ed9-5d5b-4f35-b090-a37623238a5b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:43:47.251898 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-73e27ed9-5d5b-4f35-b090-a37623238a5b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:47.261835 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-73e27ed9-5d5b-4f35-b090-a37623238a5b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:47.262282 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-73e27ed9-5d5b-4f35-b090-a37623238a5b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:47.263060 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-73e27ed9-5d5b-4f35-b090-a37623238a5b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:47.263495 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-73e27ed9-5d5b-4f35-b090-a37623238a5b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:47.324416 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-73e27ed9-5d5b-4f35-b090-a37623238a5b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "POST /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8/action" status: 200 len: 32638 microversion: 2.1 time: 0.082159 Aug 04 17:43:47.325088 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3479/6847] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:43:47 2022] POST /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8/action => generated 32638 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:43:47.338233 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-98407784-64c2-408d-8272-de306fcd7683 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:43:47.338792 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-98407784-64c2-408d-8272-de306fcd7683 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:47.346235 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-98407784-64c2-408d-8272-de306fcd7683 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:47.346843 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-98407784-64c2-408d-8272-de306fcd7683 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:47.347620 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-98407784-64c2-408d-8272-de306fcd7683 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:47.348066 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-98407784-64c2-408d-8272-de306fcd7683 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:47.422173 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-98407784-64c2-408d-8272-de306fcd7683 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "POST /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8/action" status: 202 len: 0 microversion: 2.1 time: 0.087852 Aug 04 17:43:47.422780 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3369/6848] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:43:47 2022] POST /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 17:43:47.433680 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4be46ddf-aba6-42b0-9842-3e0a893a7797 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:47.434394 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4be46ddf-aba6-42b0-9842-3e0a893a7797 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:47.442793 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4be46ddf-aba6-42b0-9842-3e0a893a7797 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:47.443262 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4be46ddf-aba6-42b0-9842-3e0a893a7797 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:47.444201 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4be46ddf-aba6-42b0-9842-3e0a893a7797 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:47.444670 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4be46ddf-aba6-42b0-9842-3e0a893a7797 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:47.593866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4be46ddf-aba6-42b0-9842-3e0a893a7797 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:47.602645 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4be46ddf-aba6-42b0-9842-3e0a893a7797 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8" status: 200 len: 1674 microversion: 2.1 time: 0.174060 Aug 04 17:43:47.603350 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3480/6849] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:47 2022] GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8 => generated 1674 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:48.625828 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0c54b94a-82f9-497d-8c08-9bc2e9087a8a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:48.627259 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0c54b94a-82f9-497d-8c08-9bc2e9087a8a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:48.634598 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c54b94a-82f9-497d-8c08-9bc2e9087a8a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:48.635051 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c54b94a-82f9-497d-8c08-9bc2e9087a8a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:48.635826 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c54b94a-82f9-497d-8c08-9bc2e9087a8a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:48.636261 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c54b94a-82f9-497d-8c08-9bc2e9087a8a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:48.789928 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0c54b94a-82f9-497d-8c08-9bc2e9087a8a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:48.797970 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0c54b94a-82f9-497d-8c08-9bc2e9087a8a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8" status: 200 len: 1682 microversion: 2.1 time: 0.177329 Aug 04 17:43:48.798533 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3370/6850] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:48 2022] GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8 => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:48.900380 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-44428af6-8f6a-476a-b86c-b6aa157aaede tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:43:48.902658 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-44428af6-8f6a-476a-b86c-b6aa157aaede tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:48.910756 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-44428af6-8f6a-476a-b86c-b6aa157aaede tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:48.911200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-44428af6-8f6a-476a-b86c-b6aa157aaede tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:48.911956 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-44428af6-8f6a-476a-b86c-b6aa157aaede tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:48.912382 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-44428af6-8f6a-476a-b86c-b6aa157aaede tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:48.963094 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-44428af6-8f6a-476a-b86c-b6aa157aaede tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "POST /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8/action" status: 200 len: 38391 microversion: 2.1 time: 0.067128 Aug 04 17:43:48.963754 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3481/6851] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:43:48 2022] POST /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8/action => generated 38391 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:43:50.040362 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6bfe43dd-24fb-4f77-8a19-b206859a3c28 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:50.041719 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6bfe43dd-24fb-4f77-8a19-b206859a3c28 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:50.043231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-c1477d90-ef06-466f-9e76-1af195eddecb req-2249528b-0a05-42c4-97d3-777f33cb494c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8", "tag": "4d7fd3be-658f-48f0-9776-ed1122153067"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:43:50.048856 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6bfe43dd-24fb-4f77-8a19-b206859a3c28 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:50.049629 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6bfe43dd-24fb-4f77-8a19-b206859a3c28 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:50.050616 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6bfe43dd-24fb-4f77-8a19-b206859a3c28 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:50.051259 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6bfe43dd-24fb-4f77-8a19-b206859a3c28 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:50.056081 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-c1477d90-ef06-466f-9e76-1af195eddecb req-2249528b-0a05-42c4-97d3-777f33cb494c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:50.056752 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-c1477d90-ef06-466f-9e76-1af195eddecb req-2249528b-0a05-42c4-97d3-777f33cb494c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:50.069961 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-c1477d90-ef06-466f-9e76-1af195eddecb req-2249528b-0a05-42c4-97d3-777f33cb494c service nova] Creating event network-changed:4d7fd3be-658f-48f0-9776-ed1122153067 for instance 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8 on n-h1-846466-12 Aug 04 17:43:50.075205 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-c1477d90-ef06-466f-9e76-1af195eddecb req-2249528b-0a05-42c4-97d3-777f33cb494c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036040 Aug 04 17:43:50.076130 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3482/6852] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:43:50.078891 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6bfe43dd-24fb-4f77-8a19-b206859a3c28 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:43:50.180306 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6bfe43dd-24fb-4f77-8a19-b206859a3c28 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8" status: 204 len: 0 microversion: 2.1 time: 0.143799 Aug 04 17:43:50.181147 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3371/6853] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:43:50 2022] DELETE /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:43:50.190273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-36c1a2c5-11c2-4c14-a32c-4aa92bdcf3e5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:50.191882 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-36c1a2c5-11c2-4c14-a32c-4aa92bdcf3e5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:50.200978 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-36c1a2c5-11c2-4c14-a32c-4aa92bdcf3e5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:50.201707 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-36c1a2c5-11c2-4c14-a32c-4aa92bdcf3e5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:50.202795 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-36c1a2c5-11c2-4c14-a32c-4aa92bdcf3e5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:50.203383 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-36c1a2c5-11c2-4c14-a32c-4aa92bdcf3e5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:50.370592 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-36c1a2c5-11c2-4c14-a32c-4aa92bdcf3e5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:50.378801 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-36c1a2c5-11c2-4c14-a32c-4aa92bdcf3e5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8" status: 200 len: 1688 microversion: 2.1 time: 0.192796 Aug 04 17:43:50.379427 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3483/6854] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:50 2022] GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8 => generated 1688 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:51.401974 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6b39e48b-697a-4ab5-8567-8edcf7141b0d tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:51.402761 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6b39e48b-697a-4ab5-8567-8edcf7141b0d tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:51.410684 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6b39e48b-697a-4ab5-8567-8edcf7141b0d tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:51.411142 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6b39e48b-697a-4ab5-8567-8edcf7141b0d tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:51.411920 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6b39e48b-697a-4ab5-8567-8edcf7141b0d tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:51.412374 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6b39e48b-697a-4ab5-8567-8edcf7141b0d tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:51.553884 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6b39e48b-697a-4ab5-8567-8edcf7141b0d tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:51.562838 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6b39e48b-697a-4ab5-8567-8edcf7141b0d tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8" status: 200 len: 1688 microversion: 2.1 time: 0.165550 Aug 04 17:43:51.563425 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3372/6855] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:51 2022] GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8 => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:52.392274 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-07c3a994-d10e-4244-97cd-14dd1ddd1438 req-fcaa8c83-9e0f-4e00-bda7-3350373e88f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8", "name": "network-vif-deleted", "tag": "4d7fd3be-658f-48f0-9776-ed1122153067"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:43:52.403365 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-07c3a994-d10e-4244-97cd-14dd1ddd1438 req-fcaa8c83-9e0f-4e00-bda7-3350373e88f6 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:52.403802 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-07c3a994-d10e-4244-97cd-14dd1ddd1438 req-fcaa8c83-9e0f-4e00-bda7-3350373e88f6 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:52.416014 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-07c3a994-d10e-4244-97cd-14dd1ddd1438 req-fcaa8c83-9e0f-4e00-bda7-3350373e88f6 service nova] Creating event network-vif-deleted:4d7fd3be-658f-48f0-9776-ed1122153067 for instance 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8 on n-h1-846466-12 Aug 04 17:43:52.421871 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-07c3a994-d10e-4244-97cd-14dd1ddd1438 req-fcaa8c83-9e0f-4e00-bda7-3350373e88f6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033769 Aug 04 17:43:52.422679 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3484/6856] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:43:52.584334 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b0a75bd3-f594-4876-bd69-d6130d5a0ff4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:52.584894 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b0a75bd3-f594-4876-bd69-d6130d5a0ff4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:52.592393 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b0a75bd3-f594-4876-bd69-d6130d5a0ff4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:52.592848 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b0a75bd3-f594-4876-bd69-d6130d5a0ff4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:52.593717 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b0a75bd3-f594-4876-bd69-d6130d5a0ff4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:52.594114 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b0a75bd3-f594-4876-bd69-d6130d5a0ff4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:52.632932 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b0a75bd3-f594-4876-bd69-d6130d5a0ff4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:52.633412 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b0a75bd3-f594-4876-bd69-d6130d5a0ff4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:52.633905 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-b0a75bd3-f594-4876-bd69-d6130d5a0ff4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lazy-loading 'fault' on Instance uuid 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:43:52.684805 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b0a75bd3-f594-4876-bd69-d6130d5a0ff4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:52.693953 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b0a75bd3-f594-4876-bd69-d6130d5a0ff4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8" status: 200 len: 1356 microversion: 2.1 time: 0.113643 Aug 04 17:43:52.694645 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3373/6857] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:52 2022] GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8 => generated 1356 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:53.717667 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0d3365eb-fede-4eaa-982c-177c6d5ac8f2 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:53.718374 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0d3365eb-fede-4eaa-982c-177c6d5ac8f2 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:53.725629 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0d3365eb-fede-4eaa-982c-177c6d5ac8f2 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:53.726119 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0d3365eb-fede-4eaa-982c-177c6d5ac8f2 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:53.726809 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0d3365eb-fede-4eaa-982c-177c6d5ac8f2 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:43:53.727243 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0d3365eb-fede-4eaa-982c-177c6d5ac8f2 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:43:53.741607 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-0d3365eb-fede-4eaa-982c-177c6d5ac8f2 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] HTTP exception thrown: Instance 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8 could not be found. Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0d3365eb-fede-4eaa-982c-177c6d5ac8f2 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Request method failure captured: Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8 HTTP/1.1 Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi7AUYxl_B7m1vSxbgIk1-lmBUtAUC3FieG1gEJ9GpQoBo_bCn-ZL3cuM6SWlZzV7WGRZWdwyMWqNkt77NBIbpSZwFdt-J-YRA4Zw2vE_lUfkP0eO6XnQW4b5p8QuudRRtMT3Ltdx4GiMtQBuU1yIToc97v7n6WszOki7v99fiq2wiYgc Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 1e1c6b45635949478b403b8b5db448c9 Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-888353230 Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1e1c6b45635949478b403b8b5db448c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1e1c6b45635949478b403b8b5db448c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1e1c6b45635949478b403b8b5db448c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1e1c6b45635949478b403b8b5db448c9"}]}] Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-TestNetworkAdvancedServerOps-888353230 Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 1e1c6b45635949478b403b8b5db448c9 Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-888353230 Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-TestNetworkAdvancedServerOps-888353230-project Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 34dd901ba58f407891c63ac17cff7750 Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-TestNetworkAdvancedServerOps-888353230-project Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8 could not be found. Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': '1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8'} Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8 could not be found. Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8 could not be found. Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:43:53.743272 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:43:53.747913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:43:53.747913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:43:53.747913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:43:53.747913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:43:53.747913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:43:53.747913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:43:53.747913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8 could not be found. Aug 04 17:43:53.747913 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:43:53.747913 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0d3365eb-fede-4eaa-982c-177c6d5ac8f2 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Returning 404 to user: Instance 1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:43:53.747913 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0d3365eb-fede-4eaa-982c-177c6d5ac8f2 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8" status: 404 len: 111 microversion: 2.1 time: 0.033134 Aug 04 17:43:53.747913 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3485/6858] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:53 2022] GET /compute/v2.1/servers/1a31d8f6-2ec6-452d-8f9f-3f5d0aea07c8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:43:57.193578 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b39b741f-d156-4457-a959-8898d5568719 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '.version_select at 0x7f7e84ac89d0>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:57.219904 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b39b741f-d156-4457-a959-8898d5568719 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-911310475" status: 202 len: 0 microversion: 2.1 time: 0.041412 Aug 04 17:43:57.220555 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3374/6859] 10.222.0.23 () {58 vars in 1281 bytes} [Thu Aug 4 17:43:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-911310475 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:43:57.250797 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1e0acaab-5ba0-49c5-9278-99915e671341 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Action: 'create', calling method: .version_select at 0x7f7e770f2ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-65012862", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8AuDYFdaqeka4Dk6cYEL4KU8Eu8sbhq3J2WgQVmZj29ur8i9maGYPoakMqS7/iXY9UQ5mQz8lx5+z6cMCyuERDJWox7fnxW7xpKVPXWhLHekJ1gmVpjjBA2wo0Q4TNaQ=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:43:57.274908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-1e0acaab-5ba0-49c5-9278-99915e671341 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Getting quotas for project 1e1c6b45635949478b403b8b5db448c9. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:43:57.280790 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-1e0acaab-5ba0-49c5-9278-99915e671341 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Getting quotas for user 34dd901ba58f407891c63ac17cff7750 and project 1e1c6b45635949478b403b8b5db448c9. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:43:57.311231 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1e0acaab-5ba0-49c5-9278-99915e671341 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.070573 Aug 04 17:43:57.311969 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3486/6860] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 17:43:57 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:44:03.791423 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-39af266d-9d5d-4276-b3ee-326db5048284 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-927828892", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "80b74ab4-0d80-47df-aa65-d0a557e4ebf8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-65012862", "security_groups": [{"name": "tempest-secgroup-smoke-2090132317"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:44:03.812773 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:44:03.962242 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-39af266d-9d5d-4276-b3ee-326db5048284 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] validate_networks() for [('80b74ab4-0d80-47df-aa65-d0a557e4ebf8', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:44:04.427665 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-39af266d-9d5d-4276-b3ee-326db5048284 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:44:04.428092 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-39af266d-9d5d-4276-b3ee-326db5048284 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:44:04.428753 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-39af266d-9d5d-4276-b3ee-326db5048284 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:44:04.429162 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-39af266d-9d5d-4276-b3ee-326db5048284 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:44:04.429640 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-39af266d-9d5d-4276-b3ee-326db5048284 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:44:04.439057 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39af266d-9d5d-4276-b3ee-326db5048284 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:04.439506 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39af266d-9d5d-4276-b3ee-326db5048284 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:04.440307 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39af266d-9d5d-4276-b3ee-326db5048284 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:04.440753 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39af266d-9d5d-4276-b3ee-326db5048284 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:04.458051 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-39af266d-9d5d-4276-b3ee-326db5048284 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Getting quotas for project 1e1c6b45635949478b403b8b5db448c9. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:44:04.463809 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-39af266d-9d5d-4276-b3ee-326db5048284 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Getting quotas for user 34dd901ba58f407891c63ac17cff7750 and project 1e1c6b45635949478b403b8b5db448c9. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:44:04.477412 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-39af266d-9d5d-4276-b3ee-326db5048284 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:44:04.480359 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-39af266d-9d5d-4276-b3ee-326db5048284 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:44:04.531418 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-39af266d-9d5d-4276-b3ee-326db5048284 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.744285 Aug 04 17:44:04.532329 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3375/6861] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:44:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:44:04.544402 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-466a0810-a082-4be6-95cc-4c4db62cf7f0 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:04.545011 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-466a0810-a082-4be6-95cc-4c4db62cf7f0 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:04.549419 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=32 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:44:04.636415 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-466a0810-a082-4be6-95cc-4c4db62cf7f0 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:04.643757 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-466a0810-a082-4be6-95cc-4c4db62cf7f0 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a" status: 200 len: 1264 microversion: 2.1 time: 0.103293 Aug 04 17:44:04.644735 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3487/6862] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:04 2022] GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a => generated 1264 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:44:05.672442 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-44a0b842-cd6a-4bd2-bbca-aa3fac8f0d36 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:05.673871 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-44a0b842-cd6a-4bd2-bbca-aa3fac8f0d36 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:05.697085 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-44a0b842-cd6a-4bd2-bbca-aa3fac8f0d36 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:05.698006 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-44a0b842-cd6a-4bd2-bbca-aa3fac8f0d36 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:05.699595 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-44a0b842-cd6a-4bd2-bbca-aa3fac8f0d36 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:05.700718 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-44a0b842-cd6a-4bd2-bbca-aa3fac8f0d36 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:05.788934 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-44a0b842-cd6a-4bd2-bbca-aa3fac8f0d36 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:05.796820 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-44a0b842-cd6a-4bd2-bbca-aa3fac8f0d36 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a" status: 200 len: 1334 microversion: 2.1 time: 0.132298 Aug 04 17:44:05.797776 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3376/6863] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:05 2022] GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a => generated 1334 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:44:06.818854 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-59484785-c544-41c3-b5c2-8acfcf0dfc28 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:06.819602 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-59484785-c544-41c3-b5c2-8acfcf0dfc28 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:06.828657 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-59484785-c544-41c3-b5c2-8acfcf0dfc28 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:06.829135 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-59484785-c544-41c3-b5c2-8acfcf0dfc28 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:06.830374 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-59484785-c544-41c3-b5c2-8acfcf0dfc28 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:06.830804 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-59484785-c544-41c3-b5c2-8acfcf0dfc28 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:06.979911 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-59484785-c544-41c3-b5c2-8acfcf0dfc28 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:06.987853 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-59484785-c544-41c3-b5c2-8acfcf0dfc28 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a" status: 200 len: 1390 microversion: 2.1 time: 0.173259 Aug 04 17:44:06.988626 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3488/6864] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:06 2022] GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a => generated 1390 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:44:07.030687 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-f05b16d4-1987-475c-8afe-c5d438de5244 req-46326957-b08d-428a-bcf0-6ad42d2fb3ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3fb8487-9e2d-44fe-a4cd-993cb757b68a", "tag": "8f89c41f-3d66-49a9-824b-7b18bd1f7cce"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:44:07.044964 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f05b16d4-1987-475c-8afe-c5d438de5244 req-46326957-b08d-428a-bcf0-6ad42d2fb3ba service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:07.045470 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-f05b16d4-1987-475c-8afe-c5d438de5244 req-46326957-b08d-428a-bcf0-6ad42d2fb3ba service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:07.059225 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-f05b16d4-1987-475c-8afe-c5d438de5244 req-46326957-b08d-428a-bcf0-6ad42d2fb3ba service nova] Creating event network-changed:8f89c41f-3d66-49a9-824b-7b18bd1f7cce for instance b3fb8487-9e2d-44fe-a4cd-993cb757b68a on n-h2-846466-12 Aug 04 17:44:07.064402 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-f05b16d4-1987-475c-8afe-c5d438de5244 req-46326957-b08d-428a-bcf0-6ad42d2fb3ba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038932 Aug 04 17:44:07.065014 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3377/6865] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:44:08.009187 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f6a33575-759d-4afc-a780-490336630fbd tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:08.009951 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f6a33575-759d-4afc-a780-490336630fbd tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:08.021661 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f6a33575-759d-4afc-a780-490336630fbd tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:08.021893 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f6a33575-759d-4afc-a780-490336630fbd tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:08.023186 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f6a33575-759d-4afc-a780-490336630fbd tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:08.023786 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f6a33575-759d-4afc-a780-490336630fbd tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:08.182834 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f6a33575-759d-4afc-a780-490336630fbd tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:08.194528 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f6a33575-759d-4afc-a780-490336630fbd tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a" status: 200 len: 1390 microversion: 2.1 time: 0.189268 Aug 04 17:44:08.195121 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3489/6866] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:08 2022] GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a => generated 1390 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:44:09.222816 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-73368efd-3af1-4a6f-b0bc-aa8bb341a8c7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:09.223523 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-73368efd-3af1-4a6f-b0bc-aa8bb341a8c7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:09.231798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-73368efd-3af1-4a6f-b0bc-aa8bb341a8c7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:09.232262 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-73368efd-3af1-4a6f-b0bc-aa8bb341a8c7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:09.233060 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-73368efd-3af1-4a6f-b0bc-aa8bb341a8c7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:09.233538 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-73368efd-3af1-4a6f-b0bc-aa8bb341a8c7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:09.405966 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-73368efd-3af1-4a6f-b0bc-aa8bb341a8c7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:09.417845 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-73368efd-3af1-4a6f-b0bc-aa8bb341a8c7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a" status: 200 len: 1390 microversion: 2.1 time: 0.199071 Aug 04 17:44:09.418595 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3378/6867] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:09 2022] GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a => generated 1390 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:44:10.440059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-79051cd8-fe01-4814-a0c4-b64957c90c83 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:10.440672 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-79051cd8-fe01-4814-a0c4-b64957c90c83 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:10.447986 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-79051cd8-fe01-4814-a0c4-b64957c90c83 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:10.448432 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-79051cd8-fe01-4814-a0c4-b64957c90c83 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:10.449203 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-79051cd8-fe01-4814-a0c4-b64957c90c83 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:10.449667 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-79051cd8-fe01-4814-a0c4-b64957c90c83 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:10.595892 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-79051cd8-fe01-4814-a0c4-b64957c90c83 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:10.604412 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-79051cd8-fe01-4814-a0c4-b64957c90c83 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a" status: 200 len: 1390 microversion: 2.1 time: 0.168599 Aug 04 17:44:10.605007 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3490/6868] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:10 2022] GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a => generated 1390 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:44:11.633712 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5c4b394e-e23d-422a-84fe-5be8371457a5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:11.634356 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5c4b394e-e23d-422a-84fe-5be8371457a5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:11.646879 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5c4b394e-e23d-422a-84fe-5be8371457a5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:11.647685 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5c4b394e-e23d-422a-84fe-5be8371457a5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:11.648768 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5c4b394e-e23d-422a-84fe-5be8371457a5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:11.649276 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5c4b394e-e23d-422a-84fe-5be8371457a5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:11.801013 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5c4b394e-e23d-422a-84fe-5be8371457a5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:11.809745 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5c4b394e-e23d-422a-84fe-5be8371457a5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a" status: 200 len: 1390 microversion: 2.1 time: 0.180781 Aug 04 17:44:11.810326 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3379/6869] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:11 2022] GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a => generated 1390 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:44:12.836825 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-271bd665-b3ee-4365-bfaa-fd73eed39eed tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:12.837577 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-271bd665-b3ee-4365-bfaa-fd73eed39eed tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:12.844787 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-271bd665-b3ee-4365-bfaa-fd73eed39eed tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:12.845234 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-271bd665-b3ee-4365-bfaa-fd73eed39eed tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:12.846052 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-271bd665-b3ee-4365-bfaa-fd73eed39eed tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:12.846487 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-271bd665-b3ee-4365-bfaa-fd73eed39eed tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:12.918169 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-515a03fe-d12c-4766-9029-48d283b35b6a req-8263c9c4-3657-4aa4-bf5f-e0454d4afda4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3fb8487-9e2d-44fe-a4cd-993cb757b68a", "name": "network-vif-plugged", "status": "completed", "tag": "8f89c41f-3d66-49a9-824b-7b18bd1f7cce"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:44:12.931460 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-515a03fe-d12c-4766-9029-48d283b35b6a req-8263c9c4-3657-4aa4-bf5f-e0454d4afda4 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:12.932296 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-515a03fe-d12c-4766-9029-48d283b35b6a req-8263c9c4-3657-4aa4-bf5f-e0454d4afda4 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:12.945210 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-515a03fe-d12c-4766-9029-48d283b35b6a req-8263c9c4-3657-4aa4-bf5f-e0454d4afda4 service nova] Creating event network-vif-plugged:8f89c41f-3d66-49a9-824b-7b18bd1f7cce for instance b3fb8487-9e2d-44fe-a4cd-993cb757b68a on n-h2-846466-12 Aug 04 17:44:12.950929 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-515a03fe-d12c-4766-9029-48d283b35b6a req-8263c9c4-3657-4aa4-bf5f-e0454d4afda4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037297 Aug 04 17:44:12.951644 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3380/6870] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:44:12.991995 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-271bd665-b3ee-4365-bfaa-fd73eed39eed tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:13.006603 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-271bd665-b3ee-4365-bfaa-fd73eed39eed tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a" status: 200 len: 1390 microversion: 2.1 time: 0.173933 Aug 04 17:44:13.007210 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3491/6871] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:12 2022] GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a => generated 1390 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:44:14.030398 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d38e8214-afbf-46d8-a633-35e5ee4c2b9e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:14.031095 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d38e8214-afbf-46d8-a633-35e5ee4c2b9e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:14.037984 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d38e8214-afbf-46d8-a633-35e5ee4c2b9e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:14.038389 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d38e8214-afbf-46d8-a633-35e5ee4c2b9e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:14.039158 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d38e8214-afbf-46d8-a633-35e5ee4c2b9e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:14.039627 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d38e8214-afbf-46d8-a633-35e5ee4c2b9e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:14.191346 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d38e8214-afbf-46d8-a633-35e5ee4c2b9e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:14.200204 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d38e8214-afbf-46d8-a633-35e5ee4c2b9e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a" status: 200 len: 1390 microversion: 2.1 time: 0.175249 Aug 04 17:44:14.200972 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3381/6872] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:14 2022] GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a => generated 1390 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:44:15.222280 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f21314fb-8e27-44c5-bbff-70441f3e6a4b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:15.222873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f21314fb-8e27-44c5-bbff-70441f3e6a4b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:15.225718 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:44:15.226319 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:44:15.232427 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f21314fb-8e27-44c5-bbff-70441f3e6a4b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:15.233081 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f21314fb-8e27-44c5-bbff-70441f3e6a4b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:15.233912 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f21314fb-8e27-44c5-bbff-70441f3e6a4b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:15.234353 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f21314fb-8e27-44c5-bbff-70441f3e6a4b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:15.377023 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f21314fb-8e27-44c5-bbff-70441f3e6a4b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:15.385161 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f21314fb-8e27-44c5-bbff-70441f3e6a4b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a" status: 200 len: 1561 microversion: 2.1 time: 0.166933 Aug 04 17:44:15.385822 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3492/6873] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:15 2022] GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:44:15.407434 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-26a7f1f3-6c9d-4634-bd06-9d1f188b2002 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:15.408060 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-26a7f1f3-6c9d-4634-bd06-9d1f188b2002 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:15.410161 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:44:15.411305 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:44:15.413429 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:44:15.421365 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-26a7f1f3-6c9d-4634-bd06-9d1f188b2002 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:15.421808 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-26a7f1f3-6c9d-4634-bd06-9d1f188b2002 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:15.422595 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-26a7f1f3-6c9d-4634-bd06-9d1f188b2002 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:15.423040 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-26a7f1f3-6c9d-4634-bd06-9d1f188b2002 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:15.584005 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-26a7f1f3-6c9d-4634-bd06-9d1f188b2002 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:15.592998 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-26a7f1f3-6c9d-4634-bd06-9d1f188b2002 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a" status: 200 len: 1561 microversion: 2.1 time: 0.190301 Aug 04 17:44:15.593683 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3382/6874] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:15 2022] GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a => generated 1561 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:44:17.665860 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-374b91ab-2f22-4e0f-af29-7ca1bbe26263 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:17.666447 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-374b91ab-2f22-4e0f-af29-7ca1bbe26263 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:17.668683 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-a61c8320-ffc1-48fa-8421-59a342490bd6 req-7163b24b-6f87-4bc9-8989-6a9ff607f868 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3fb8487-9e2d-44fe-a4cd-993cb757b68a", "tag": "8f89c41f-3d66-49a9-824b-7b18bd1f7cce"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:44:17.674403 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-374b91ab-2f22-4e0f-af29-7ca1bbe26263 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:17.675429 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-374b91ab-2f22-4e0f-af29-7ca1bbe26263 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:17.676470 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-374b91ab-2f22-4e0f-af29-7ca1bbe26263 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:17.677116 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-374b91ab-2f22-4e0f-af29-7ca1bbe26263 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:17.680045 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a61c8320-ffc1-48fa-8421-59a342490bd6 req-7163b24b-6f87-4bc9-8989-6a9ff607f868 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:17.680507 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a61c8320-ffc1-48fa-8421-59a342490bd6 req-7163b24b-6f87-4bc9-8989-6a9ff607f868 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:17.693181 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-a61c8320-ffc1-48fa-8421-59a342490bd6 req-7163b24b-6f87-4bc9-8989-6a9ff607f868 service nova] Creating event network-changed:8f89c41f-3d66-49a9-824b-7b18bd1f7cce for instance b3fb8487-9e2d-44fe-a4cd-993cb757b68a on n-h2-846466-12 Aug 04 17:44:17.699146 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-a61c8320-ffc1-48fa-8421-59a342490bd6 req-7163b24b-6f87-4bc9-8989-6a9ff607f868 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033868 Aug 04 17:44:17.700077 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3383/6875] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:44:17.824844 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-374b91ab-2f22-4e0f-af29-7ca1bbe26263 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:17.833617 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-374b91ab-2f22-4e0f-af29-7ca1bbe26263 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a" status: 200 len: 1561 microversion: 2.1 time: 0.171979 Aug 04 17:44:17.834509 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3493/6876] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:17 2022] GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:44:39.106844 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:44:39.107614 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=38 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:44:39.112803 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c4ff8615-8bf6-4706-a26c-d558943c8a8e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:44:39.115169 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c4ff8615-8bf6-4706-a26c-d558943c8a8e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:39.122400 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4ff8615-8bf6-4706-a26c-d558943c8a8e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:39.122861 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4ff8615-8bf6-4706-a26c-d558943c8a8e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:39.123640 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4ff8615-8bf6-4706-a26c-d558943c8a8e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:39.124088 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4ff8615-8bf6-4706-a26c-d558943c8a8e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:39.179809 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c4ff8615-8bf6-4706-a26c-d558943c8a8e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "POST /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a/action" status: 200 len: 24573 microversion: 2.1 time: 0.074689 Aug 04 17:44:39.180656 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3384/6877] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:44:39 2022] POST /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a/action => generated 24573 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:44:50.180407 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ba292c6a-1a04-4f01-9852-43c776b7255f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:44:50.183711 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ba292c6a-1a04-4f01-9852-43c776b7255f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:50.186780 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:44:50.187455 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=36 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:44:50.196050 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba292c6a-1a04-4f01-9852-43c776b7255f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:50.196784 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba292c6a-1a04-4f01-9852-43c776b7255f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:50.197866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba292c6a-1a04-4f01-9852-43c776b7255f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:50.198570 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ba292c6a-1a04-4f01-9852-43c776b7255f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:50.287785 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ba292c6a-1a04-4f01-9852-43c776b7255f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "POST /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a/action" status: 202 len: 0 microversion: 2.1 time: 0.113189 Aug 04 17:44:50.288684 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3494/6878] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:44:50 2022] POST /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:44:50.299125 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ff49c5ef-222a-41c2-bf1c-5730a29811e1 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:50.299912 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ff49c5ef-222a-41c2-bf1c-5730a29811e1 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:50.303074 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:44:50.303843 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=4 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:44:50.309325 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ff49c5ef-222a-41c2-bf1c-5730a29811e1 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:50.309894 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ff49c5ef-222a-41c2-bf1c-5730a29811e1 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:50.310865 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ff49c5ef-222a-41c2-bf1c-5730a29811e1 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:50.311320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ff49c5ef-222a-41c2-bf1c-5730a29811e1 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:50.462436 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ff49c5ef-222a-41c2-bf1c-5730a29811e1 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:50.470331 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ff49c5ef-222a-41c2-bf1c-5730a29811e1 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a" status: 200 len: 1672 microversion: 2.1 time: 0.175652 Aug 04 17:44:50.471122 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3385/6879] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:50 2022] GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a => generated 1672 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:44:51.494617 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-36c6d47b-62a2-4412-a864-671fd8b5f347 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:51.495394 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-36c6d47b-62a2-4412-a864-671fd8b5f347 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:51.502529 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-36c6d47b-62a2-4412-a864-671fd8b5f347 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:51.502970 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-36c6d47b-62a2-4412-a864-671fd8b5f347 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:51.503880 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-36c6d47b-62a2-4412-a864-671fd8b5f347 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:51.504157 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-36c6d47b-62a2-4412-a864-671fd8b5f347 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:51.659149 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-36c6d47b-62a2-4412-a864-671fd8b5f347 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:51.667879 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-36c6d47b-62a2-4412-a864-671fd8b5f347 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a" status: 200 len: 1677 microversion: 2.1 time: 0.179350 Aug 04 17:44:51.668430 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3495/6880] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:51 2022] GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:44:52.690883 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2ecd7fe4-0651-4fe9-841b-60c65d49a27c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:52.691775 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2ecd7fe4-0651-4fe9-841b-60c65d49a27c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:52.700498 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ecd7fe4-0651-4fe9-841b-60c65d49a27c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:52.701848 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ecd7fe4-0651-4fe9-841b-60c65d49a27c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:52.702756 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ecd7fe4-0651-4fe9-841b-60c65d49a27c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:52.703178 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2ecd7fe4-0651-4fe9-841b-60c65d49a27c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:52.852141 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2ecd7fe4-0651-4fe9-841b-60c65d49a27c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:52.861055 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2ecd7fe4-0651-4fe9-841b-60c65d49a27c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a" status: 200 len: 1677 microversion: 2.1 time: 0.175833 Aug 04 17:44:52.861676 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3386/6881] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:52 2022] GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:44:53.883450 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6e753114-dd90-4e17-bacc-3581b08c01a5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:53.884086 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6e753114-dd90-4e17-bacc-3581b08c01a5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:53.891335 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6e753114-dd90-4e17-bacc-3581b08c01a5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:53.891778 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6e753114-dd90-4e17-bacc-3581b08c01a5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:53.892541 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6e753114-dd90-4e17-bacc-3581b08c01a5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:53.892967 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6e753114-dd90-4e17-bacc-3581b08c01a5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:54.056748 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6e753114-dd90-4e17-bacc-3581b08c01a5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:54.065097 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6e753114-dd90-4e17-bacc-3581b08c01a5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a" status: 200 len: 1677 microversion: 2.1 time: 0.185774 Aug 04 17:44:54.065754 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3496/6882] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:53 2022] GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a => generated 1677 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:44:55.090424 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1c658d24-bc9f-49e6-9c58-da2546b78ad4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:55.091053 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1c658d24-bc9f-49e6-9c58-da2546b78ad4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:55.099094 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c658d24-bc9f-49e6-9c58-da2546b78ad4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:55.099553 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c658d24-bc9f-49e6-9c58-da2546b78ad4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:55.100328 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c658d24-bc9f-49e6-9c58-da2546b78ad4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:55.100773 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c658d24-bc9f-49e6-9c58-da2546b78ad4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:55.255017 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1c658d24-bc9f-49e6-9c58-da2546b78ad4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:55.265757 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1c658d24-bc9f-49e6-9c58-da2546b78ad4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a" status: 200 len: 1677 microversion: 2.1 time: 0.180489 Aug 04 17:44:55.266273 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3387/6883] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:55 2022] GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:44:56.288957 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8cd76fef-b2e9-49b1-8e7e-95a9349cbf38 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:56.289842 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8cd76fef-b2e9-49b1-8e7e-95a9349cbf38 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:56.298305 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8cd76fef-b2e9-49b1-8e7e-95a9349cbf38 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:56.298754 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8cd76fef-b2e9-49b1-8e7e-95a9349cbf38 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:56.299550 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8cd76fef-b2e9-49b1-8e7e-95a9349cbf38 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:56.299984 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8cd76fef-b2e9-49b1-8e7e-95a9349cbf38 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:56.450746 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8cd76fef-b2e9-49b1-8e7e-95a9349cbf38 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:56.459049 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8cd76fef-b2e9-49b1-8e7e-95a9349cbf38 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a" status: 200 len: 1677 microversion: 2.1 time: 0.174631 Aug 04 17:44:56.459627 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3497/6884] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:56 2022] GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:44:57.484319 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1032232c-e0b8-4c6e-acb7-900b9dd785f3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:57.484934 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1032232c-e0b8-4c6e-acb7-900b9dd785f3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:57.492234 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1032232c-e0b8-4c6e-acb7-900b9dd785f3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:57.492691 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1032232c-e0b8-4c6e-acb7-900b9dd785f3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:57.493827 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1032232c-e0b8-4c6e-acb7-900b9dd785f3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:57.494445 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1032232c-e0b8-4c6e-acb7-900b9dd785f3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:57.655846 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1032232c-e0b8-4c6e-acb7-900b9dd785f3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:57.664900 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1032232c-e0b8-4c6e-acb7-900b9dd785f3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a" status: 200 len: 1677 microversion: 2.1 time: 0.185078 Aug 04 17:44:57.666104 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3388/6885] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:57 2022] GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a => generated 1677 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:44:58.697937 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b145fe39-dcc9-42ca-b37c-ca089666f6f4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:58.698583 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b145fe39-dcc9-42ca-b37c-ca089666f6f4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:58.706388 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b145fe39-dcc9-42ca-b37c-ca089666f6f4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:58.706870 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b145fe39-dcc9-42ca-b37c-ca089666f6f4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:58.707659 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b145fe39-dcc9-42ca-b37c-ca089666f6f4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:58.708093 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b145fe39-dcc9-42ca-b37c-ca089666f6f4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:58.859397 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b145fe39-dcc9-42ca-b37c-ca089666f6f4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:58.867857 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b145fe39-dcc9-42ca-b37c-ca089666f6f4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a" status: 200 len: 1677 microversion: 2.1 time: 0.174599 Aug 04 17:44:58.868517 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3498/6886] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:58 2022] GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:44:59.892125 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8b9f0f16-c7b4-4f23-a123-082f76ce6074 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:59.892806 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8b9f0f16-c7b4-4f23-a123-082f76ce6074 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:59.900783 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8b9f0f16-c7b4-4f23-a123-082f76ce6074 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:59.901238 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8b9f0f16-c7b4-4f23-a123-082f76ce6074 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:44:59.902058 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8b9f0f16-c7b4-4f23-a123-082f76ce6074 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:44:59.902503 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8b9f0f16-c7b4-4f23-a123-082f76ce6074 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:00.054652 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8b9f0f16-c7b4-4f23-a123-082f76ce6074 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:45:00.065000 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8b9f0f16-c7b4-4f23-a123-082f76ce6074 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a" status: 200 len: 1677 microversion: 2.1 time: 0.177287 Aug 04 17:45:00.065914 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3389/6887] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:59 2022] GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:45:01.090336 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d9df1031-f302-44af-9314-3de434c2dfb4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:45:01.091006 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d9df1031-f302-44af-9314-3de434c2dfb4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:45:01.098905 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d9df1031-f302-44af-9314-3de434c2dfb4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:01.099362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d9df1031-f302-44af-9314-3de434c2dfb4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:01.100155 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d9df1031-f302-44af-9314-3de434c2dfb4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:01.100594 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d9df1031-f302-44af-9314-3de434c2dfb4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:01.260104 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d9df1031-f302-44af-9314-3de434c2dfb4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:45:01.275509 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d9df1031-f302-44af-9314-3de434c2dfb4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a" status: 200 len: 1677 microversion: 2.1 time: 0.189177 Aug 04 17:45:01.276130 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3499/6888] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:45:01 2022] GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a => generated 1677 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:45:02.303226 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f10937f9-8aaa-4841-8301-f073881c4962 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:45:02.304351 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f10937f9-8aaa-4841-8301-f073881c4962 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:45:02.319153 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f10937f9-8aaa-4841-8301-f073881c4962 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:02.319153 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f10937f9-8aaa-4841-8301-f073881c4962 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:02.320495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f10937f9-8aaa-4841-8301-f073881c4962 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:02.321311 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f10937f9-8aaa-4841-8301-f073881c4962 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:02.497762 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f10937f9-8aaa-4841-8301-f073881c4962 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:45:02.509084 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f10937f9-8aaa-4841-8301-f073881c4962 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a" status: 200 len: 1677 microversion: 2.1 time: 0.214027 Aug 04 17:45:02.510161 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3390/6889] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:45:02 2022] GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a => generated 1677 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:45:03.534501 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dae4ffa4-3998-4bdb-8e1e-f23373f50319 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:45:03.535118 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dae4ffa4-3998-4bdb-8e1e-f23373f50319 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:45:03.542876 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dae4ffa4-3998-4bdb-8e1e-f23373f50319 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:03.543323 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dae4ffa4-3998-4bdb-8e1e-f23373f50319 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:03.544107 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dae4ffa4-3998-4bdb-8e1e-f23373f50319 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:03.544539 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dae4ffa4-3998-4bdb-8e1e-f23373f50319 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:03.708602 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dae4ffa4-3998-4bdb-8e1e-f23373f50319 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:45:03.721155 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dae4ffa4-3998-4bdb-8e1e-f23373f50319 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a" status: 200 len: 1677 microversion: 2.1 time: 0.190962 Aug 04 17:45:03.721934 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3500/6890] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:45:03 2022] GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a => generated 1677 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:45:04.747014 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-39cb453c-028c-42f8-aa30-144469a03702 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:45:04.747631 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-39cb453c-028c-42f8-aa30-144469a03702 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:45:04.755615 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39cb453c-028c-42f8-aa30-144469a03702 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:04.756071 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39cb453c-028c-42f8-aa30-144469a03702 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:04.756858 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39cb453c-028c-42f8-aa30-144469a03702 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:04.757307 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-39cb453c-028c-42f8-aa30-144469a03702 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:04.914794 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-39cb453c-028c-42f8-aa30-144469a03702 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:45:04.922673 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-39cb453c-028c-42f8-aa30-144469a03702 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a" status: 200 len: 1677 microversion: 2.1 time: 0.179707 Aug 04 17:45:04.923251 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3391/6891] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:45:04 2022] GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:45:05.944725 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-320bfe3f-f3f4-4e46-b1c3-96f9925b92d0 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:45:05.945517 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-320bfe3f-f3f4-4e46-b1c3-96f9925b92d0 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:45:05.953484 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-320bfe3f-f3f4-4e46-b1c3-96f9925b92d0 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:05.953927 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-320bfe3f-f3f4-4e46-b1c3-96f9925b92d0 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:05.954712 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-320bfe3f-f3f4-4e46-b1c3-96f9925b92d0 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:05.955137 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-320bfe3f-f3f4-4e46-b1c3-96f9925b92d0 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:06.116834 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-320bfe3f-f3f4-4e46-b1c3-96f9925b92d0 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:45:06.127942 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-320bfe3f-f3f4-4e46-b1c3-96f9925b92d0 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a" status: 200 len: 1677 microversion: 2.1 time: 0.187434 Aug 04 17:45:06.128606 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3501/6892] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:45:05 2022] GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a => generated 1677 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:45:07.150877 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-43b4df06-ba82-43a6-a8f3-d4448911aa18 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:45:07.151596 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-43b4df06-ba82-43a6-a8f3-d4448911aa18 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:45:07.159674 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-43b4df06-ba82-43a6-a8f3-d4448911aa18 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:07.160134 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-43b4df06-ba82-43a6-a8f3-d4448911aa18 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:07.160926 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-43b4df06-ba82-43a6-a8f3-d4448911aa18 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:07.161403 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-43b4df06-ba82-43a6-a8f3-d4448911aa18 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:07.317914 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-43b4df06-ba82-43a6-a8f3-d4448911aa18 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:45:07.329345 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-43b4df06-ba82-43a6-a8f3-d4448911aa18 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a" status: 200 len: 1680 microversion: 2.1 time: 0.183024 Aug 04 17:45:07.329969 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3392/6893] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:45:07 2022] GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a => generated 1680 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:45:31.541745 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-bb3e6f36-a84f-44c7-b269-86bf6d3f2886 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:45:31.544247 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-bb3e6f36-a84f-44c7-b269-86bf6d3f2886 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:45:31.547329 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=16 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:45:31.548130 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:45:31.558668 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bb3e6f36-a84f-44c7-b269-86bf6d3f2886 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:31.559273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bb3e6f36-a84f-44c7-b269-86bf6d3f2886 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:31.560489 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bb3e6f36-a84f-44c7-b269-86bf6d3f2886 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:31.561077 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-bb3e6f36-a84f-44c7-b269-86bf6d3f2886 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:31.618113 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-bb3e6f36-a84f-44c7-b269-86bf6d3f2886 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "POST /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a/action" status: 200 len: 69079 microversion: 2.1 time: 0.082799 Aug 04 17:45:31.619483 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3502/6894] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:45:31 2022] POST /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a/action => generated 69079 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:45:38.707345 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-067013f4-44a3-486c-aedd-c6dde54953f8 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:45:38.707899 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-067013f4-44a3-486c-aedd-c6dde54953f8 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:45:38.711295 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-e341df98-6dda-4da1-9920-7c6eea4db8d0 req-51719ecc-a354-438a-9565-ef513c6e84f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3fb8487-9e2d-44fe-a4cd-993cb757b68a", "tag": "8f89c41f-3d66-49a9-824b-7b18bd1f7cce"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:45:38.712186 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=16 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:45:38.713104 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=48 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:45:38.717356 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-067013f4-44a3-486c-aedd-c6dde54953f8 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:38.717876 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-067013f4-44a3-486c-aedd-c6dde54953f8 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:38.718753 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-067013f4-44a3-486c-aedd-c6dde54953f8 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:38.719489 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-067013f4-44a3-486c-aedd-c6dde54953f8 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:38.724539 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-e341df98-6dda-4da1-9920-7c6eea4db8d0 req-51719ecc-a354-438a-9565-ef513c6e84f0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:38.724970 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-e341df98-6dda-4da1-9920-7c6eea4db8d0 req-51719ecc-a354-438a-9565-ef513c6e84f0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:38.738828 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-e341df98-6dda-4da1-9920-7c6eea4db8d0 req-51719ecc-a354-438a-9565-ef513c6e84f0 service nova] Creating event network-changed:8f89c41f-3d66-49a9-824b-7b18bd1f7cce for instance b3fb8487-9e2d-44fe-a4cd-993cb757b68a on n-h2-846466-12 Aug 04 17:45:38.744747 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-e341df98-6dda-4da1-9920-7c6eea4db8d0 req-51719ecc-a354-438a-9565-ef513c6e84f0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038343 Aug 04 17:45:38.745384 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3503/6895] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:45:38.749092 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-067013f4-44a3-486c-aedd-c6dde54953f8 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] Going to try to terminate instance {{(pid=126126) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:45:38.855200 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-067013f4-44a3-486c-aedd-c6dde54953f8 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a" status: 204 len: 0 microversion: 2.1 time: 0.151842 Aug 04 17:45:38.857355 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3393/6896] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:45:38 2022] DELETE /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:45:38.866540 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1842f401-9278-4795-ba93-545e613a5d7c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:45:38.867756 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1842f401-9278-4795-ba93-545e613a5d7c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:45:38.875538 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1842f401-9278-4795-ba93-545e613a5d7c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:38.875982 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1842f401-9278-4795-ba93-545e613a5d7c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:38.876751 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1842f401-9278-4795-ba93-545e613a5d7c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:38.877177 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1842f401-9278-4795-ba93-545e613a5d7c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:39.092174 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1842f401-9278-4795-ba93-545e613a5d7c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:45:39.100801 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1842f401-9278-4795-ba93-545e613a5d7c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a" status: 200 len: 1686 microversion: 2.1 time: 0.238845 Aug 04 17:45:39.101412 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3504/6897] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:45:38 2022] GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a => generated 1686 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:45:40.125050 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0c8feb38-69c7-4745-8043-afc7dff9163e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:45:40.125775 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0c8feb38-69c7-4745-8043-afc7dff9163e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:45:40.134278 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c8feb38-69c7-4745-8043-afc7dff9163e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:40.134737 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c8feb38-69c7-4745-8043-afc7dff9163e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:40.135526 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c8feb38-69c7-4745-8043-afc7dff9163e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:40.135974 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c8feb38-69c7-4745-8043-afc7dff9163e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:40.341026 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0c8feb38-69c7-4745-8043-afc7dff9163e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:45:40.349713 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0c8feb38-69c7-4745-8043-afc7dff9163e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a" status: 200 len: 1686 microversion: 2.1 time: 0.228930 Aug 04 17:45:40.350310 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3394/6898] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:45:40 2022] GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a => generated 1686 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:45:40.889374 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-4851bcec-e2bb-4fdc-a16d-3e5d9aa7e41f req-9593bc9c-2cda-4cad-b723-ef00a001495e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3fb8487-9e2d-44fe-a4cd-993cb757b68a", "name": "network-vif-deleted", "tag": "8f89c41f-3d66-49a9-824b-7b18bd1f7cce"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:45:40.900963 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-4851bcec-e2bb-4fdc-a16d-3e5d9aa7e41f req-9593bc9c-2cda-4cad-b723-ef00a001495e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:40.901440 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-4851bcec-e2bb-4fdc-a16d-3e5d9aa7e41f req-9593bc9c-2cda-4cad-b723-ef00a001495e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:40.914247 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-4851bcec-e2bb-4fdc-a16d-3e5d9aa7e41f req-9593bc9c-2cda-4cad-b723-ef00a001495e service nova] Creating event network-vif-deleted:8f89c41f-3d66-49a9-824b-7b18bd1f7cce for instance b3fb8487-9e2d-44fe-a4cd-993cb757b68a on n-h2-846466-12 Aug 04 17:45:40.919279 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-4851bcec-e2bb-4fdc-a16d-3e5d9aa7e41f req-9593bc9c-2cda-4cad-b723-ef00a001495e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033952 Aug 04 17:45:40.919924 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3505/6899] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:45:41.371684 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0385ba9a-55d9-4be4-a900-516fb7f2365f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:45:41.372454 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0385ba9a-55d9-4be4-a900-516fb7f2365f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: b3fb8487-9e2d-44fe-a4cd-993cb757b68a] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:45:41.381829 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0385ba9a-55d9-4be4-a900-516fb7f2365f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:41.382299 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0385ba9a-55d9-4be4-a900-516fb7f2365f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:41.383124 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0385ba9a-55d9-4be4-a900-516fb7f2365f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:41.383619 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0385ba9a-55d9-4be4-a900-516fb7f2365f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:41.399839 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-0385ba9a-55d9-4be4-a900-516fb7f2365f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] HTTP exception thrown: Instance b3fb8487-9e2d-44fe-a4cd-993cb757b68a could not be found. Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0385ba9a-55d9-4be4-a900-516fb7f2365f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Request method failure captured: Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a HTTP/1.1 Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi7AUYxl_B7m1vSxbgIk1-lmBUtAUC3FieG1gEJ9GpQoBo_bCn-ZL3cuM6SWlZzV7WGRZWdwyMWqNkt77NBIbpSZwFdt-J-YRA4Zw2vE_lUfkP0eO6XnQW4b5p8QuudRRtMT3Ltdx4GiMtQBuU1yIToc97v7n6WszOki7v99fiq2wiYgc Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 1e1c6b45635949478b403b8b5db448c9 Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-888353230 Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1e1c6b45635949478b403b8b5db448c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1e1c6b45635949478b403b8b5db448c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1e1c6b45635949478b403b8b5db448c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1e1c6b45635949478b403b8b5db448c9"}]}] Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-TestNetworkAdvancedServerOps-888353230 Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 1e1c6b45635949478b403b8b5db448c9 Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-888353230 Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-TestNetworkAdvancedServerOps-888353230-project Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 34dd901ba58f407891c63ac17cff7750 Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-TestNetworkAdvancedServerOps-888353230-project Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance b3fb8487-9e2d-44fe-a4cd-993cb757b68a could not be found. Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'b3fb8487-9e2d-44fe-a4cd-993cb757b68a'} Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3fb8487-9e2d-44fe-a4cd-993cb757b68a could not be found. Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3fb8487-9e2d-44fe-a4cd-993cb757b68a could not be found. Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:45:41.401486 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:45:41.406220 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:45:41.406220 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:45:41.406220 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:45:41.406220 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:45:41.406220 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:45:41.406220 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:45:41.406220 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3fb8487-9e2d-44fe-a4cd-993cb757b68a could not be found. Aug 04 17:45:41.406220 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:45:41.406220 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0385ba9a-55d9-4be4-a900-516fb7f2365f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Returning 404 to user: Instance b3fb8487-9e2d-44fe-a4cd-993cb757b68a could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:45:41.406220 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0385ba9a-55d9-4be4-a900-516fb7f2365f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a" status: 404 len: 111 microversion: 2.1 time: 0.035314 Aug 04 17:45:41.406220 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3395/6900] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:45:41 2022] GET /compute/v2.1/servers/b3fb8487-9e2d-44fe-a4cd-993cb757b68a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:45:44.950764 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d349c859-5244-476e-a732-8c12197ed056 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '.version_select at 0x7f7e7704b700>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:45:44.973755 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d349c859-5244-476e-a732-8c12197ed056 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-65012862" status: 202 len: 0 microversion: 2.1 time: 0.028127 Aug 04 17:45:44.974375 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3506/6901] 10.222.0.23 () {58 vars in 1278 bytes} [Thu Aug 4 17:45:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-65012862 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:45:45.007002 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3cc0317a-20e0-493b-a5d9-d2cfb6f4b357 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Action: 'create', calling method: .version_select at 0x7f7e841b1f70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1508681209", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvOtKmNlr0oSZ4zOHdK4b62JRk6hxfR4T036wXG2Po5cEEYvzSpssaicn8+iVJ9cJggCGgd9ZrneQlEw151qmQW/nE/8xiPkRRVJpAlKTzco7fD7QUtny1cGz3+yRhHmA=="}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:45:45.024131 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-3cc0317a-20e0-493b-a5d9-d2cfb6f4b357 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Getting quotas for project 1e1c6b45635949478b403b8b5db448c9. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:45:45.030666 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-3cc0317a-20e0-493b-a5d9-d2cfb6f4b357 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Getting quotas for user 34dd901ba58f407891c63ac17cff7750 and project 1e1c6b45635949478b403b8b5db448c9. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:45:45.059251 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3cc0317a-20e0-493b-a5d9-d2cfb6f4b357 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.056328 Aug 04 17:45:45.059865 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3396/6902] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 17:45:45 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:45:51.229942 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7fe2c8a3-2455-4803-9b4c-08be2ef7b844 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1737406343", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "a51612cd-1368-4332-9e4c-999b03e1ca48"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1508681209", "security_groups": [{"name": "tempest-secgroup-smoke-461670064"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:45:51.241264 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=14 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:45:51.379264 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-7fe2c8a3-2455-4803-9b4c-08be2ef7b844 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] validate_networks() for [('a51612cd-1368-4332-9e4c-999b03e1ca48', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:45:51.892134 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-7fe2c8a3-2455-4803-9b4c-08be2ef7b844 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:45:51.892597 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-7fe2c8a3-2455-4803-9b4c-08be2ef7b844 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:45:51.893134 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-7fe2c8a3-2455-4803-9b4c-08be2ef7b844 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:45:51.893791 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-7fe2c8a3-2455-4803-9b4c-08be2ef7b844 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:45:51.894266 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-7fe2c8a3-2455-4803-9b4c-08be2ef7b844 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:45:51.906451 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7fe2c8a3-2455-4803-9b4c-08be2ef7b844 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:51.907087 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7fe2c8a3-2455-4803-9b4c-08be2ef7b844 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:51.907968 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7fe2c8a3-2455-4803-9b4c-08be2ef7b844 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:51.908422 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7fe2c8a3-2455-4803-9b4c-08be2ef7b844 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:51.928384 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-7fe2c8a3-2455-4803-9b4c-08be2ef7b844 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Getting quotas for project 1e1c6b45635949478b403b8b5db448c9. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:45:51.934619 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-7fe2c8a3-2455-4803-9b4c-08be2ef7b844 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Getting quotas for user 34dd901ba58f407891c63ac17cff7750 and project 1e1c6b45635949478b403b8b5db448c9. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:45:51.948989 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7fe2c8a3-2455-4803-9b4c-08be2ef7b844 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:45:51.951883 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7fe2c8a3-2455-4803-9b4c-08be2ef7b844 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:45:52.008284 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7fe2c8a3-2455-4803-9b4c-08be2ef7b844 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.782235 Aug 04 17:45:52.009065 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3507/6903] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:45:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:45:52.019411 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:45:52.024890 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-72680ca2-5278-4fda-8bab-5f5b87d7bb63 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:45:52.025925 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-72680ca2-5278-4fda-8bab-5f5b87d7bb63 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:45:52.099851 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-72680ca2-5278-4fda-8bab-5f5b87d7bb63 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:45:52.109465 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-72680ca2-5278-4fda-8bab-5f5b87d7bb63 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1267 microversion: 2.1 time: 0.091796 Aug 04 17:45:52.110644 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3397/6904] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:45:52 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1267 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:45:53.131219 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c4c47012-498c-4a38-b167-79ec75ad2b93 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:45:53.145031 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c4c47012-498c-4a38-b167-79ec75ad2b93 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:45:53.154733 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c4c47012-498c-4a38-b167-79ec75ad2b93 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:53.155457 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c4c47012-498c-4a38-b167-79ec75ad2b93 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:53.156237 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c4c47012-498c-4a38-b167-79ec75ad2b93 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:53.156674 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c4c47012-498c-4a38-b167-79ec75ad2b93 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:53.276387 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c4c47012-498c-4a38-b167-79ec75ad2b93 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:45:53.286434 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c4c47012-498c-4a38-b167-79ec75ad2b93 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1319 microversion: 2.1 time: 0.159538 Aug 04 17:45:53.289132 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3508/6905] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:45:53 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:45:54.309270 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ebe05699-1856-41d9-aa6e-b19cb44bae8c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:45:54.309842 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ebe05699-1856-41d9-aa6e-b19cb44bae8c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:45:54.321190 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ebe05699-1856-41d9-aa6e-b19cb44bae8c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:54.321190 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ebe05699-1856-41d9-aa6e-b19cb44bae8c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:54.321750 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ebe05699-1856-41d9-aa6e-b19cb44bae8c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:54.322192 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ebe05699-1856-41d9-aa6e-b19cb44bae8c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:54.487388 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ebe05699-1856-41d9-aa6e-b19cb44bae8c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:45:54.497353 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ebe05699-1856-41d9-aa6e-b19cb44bae8c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1392 microversion: 2.1 time: 0.192848 Aug 04 17:45:54.498311 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3398/6906] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:45:54 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1392 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:45:54.892680 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-010a5865-40a6-44ee-a21c-7777edcb504a req-9b813cda-576b-41f8-8c27-7f5d7aa29c35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd508c34-0a9f-4616-a42f-65eff24f3dd4", "tag": "a70fd347-572e-4c7e-87b6-90e61ae7c08b"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:45:54.903196 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-010a5865-40a6-44ee-a21c-7777edcb504a req-9b813cda-576b-41f8-8c27-7f5d7aa29c35 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:54.903630 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-010a5865-40a6-44ee-a21c-7777edcb504a req-9b813cda-576b-41f8-8c27-7f5d7aa29c35 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:54.915949 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-010a5865-40a6-44ee-a21c-7777edcb504a req-9b813cda-576b-41f8-8c27-7f5d7aa29c35 service nova] Creating event network-changed:a70fd347-572e-4c7e-87b6-90e61ae7c08b for instance fd508c34-0a9f-4616-a42f-65eff24f3dd4 on n-h1-846466-12 Aug 04 17:45:54.921238 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-010a5865-40a6-44ee-a21c-7777edcb504a req-9b813cda-576b-41f8-8c27-7f5d7aa29c35 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097055 Aug 04 17:45:54.921921 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3509/6907] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:45:55.521607 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-42712ebb-eaa2-4d22-91e4-a843ef2c281b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:45:55.522755 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-42712ebb-eaa2-4d22-91e4-a843ef2c281b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:45:55.530362 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-42712ebb-eaa2-4d22-91e4-a843ef2c281b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:55.530821 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-42712ebb-eaa2-4d22-91e4-a843ef2c281b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:55.531602 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-42712ebb-eaa2-4d22-91e4-a843ef2c281b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:55.532064 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-42712ebb-eaa2-4d22-91e4-a843ef2c281b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:55.688525 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-42712ebb-eaa2-4d22-91e4-a843ef2c281b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:45:55.696828 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-42712ebb-eaa2-4d22-91e4-a843ef2c281b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1392 microversion: 2.1 time: 0.180875 Aug 04 17:45:55.697459 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3399/6908] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:45:55 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1392 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:45:56.719683 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-12a5d033-838c-45d5-8df3-5f5d543e2b50 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:45:56.720424 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-12a5d033-838c-45d5-8df3-5f5d543e2b50 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:45:56.728344 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-12a5d033-838c-45d5-8df3-5f5d543e2b50 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:56.729165 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-12a5d033-838c-45d5-8df3-5f5d543e2b50 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:56.729914 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-12a5d033-838c-45d5-8df3-5f5d543e2b50 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:56.730344 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-12a5d033-838c-45d5-8df3-5f5d543e2b50 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:56.876165 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-12a5d033-838c-45d5-8df3-5f5d543e2b50 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:45:56.884250 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-12a5d033-838c-45d5-8df3-5f5d543e2b50 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1392 microversion: 2.1 time: 0.169966 Aug 04 17:45:56.884837 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3510/6909] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:45:56 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:45:57.906052 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0c56ae35-c5e7-463f-be41-d5be2ca0b091 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:45:57.906630 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0c56ae35-c5e7-463f-be41-d5be2ca0b091 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:45:57.913700 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c56ae35-c5e7-463f-be41-d5be2ca0b091 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:57.914211 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c56ae35-c5e7-463f-be41-d5be2ca0b091 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:57.914986 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c56ae35-c5e7-463f-be41-d5be2ca0b091 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:57.915424 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0c56ae35-c5e7-463f-be41-d5be2ca0b091 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:58.056008 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0c56ae35-c5e7-463f-be41-d5be2ca0b091 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:45:58.063704 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0c56ae35-c5e7-463f-be41-d5be2ca0b091 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1392 microversion: 2.1 time: 0.161965 Aug 04 17:45:58.064332 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3400/6910] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:45:57 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:45:59.084602 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4db605db-240d-4fcc-8d40-50b9017612de tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:45:59.085250 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4db605db-240d-4fcc-8d40-50b9017612de tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:45:59.092595 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4db605db-240d-4fcc-8d40-50b9017612de tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:59.093045 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4db605db-240d-4fcc-8d40-50b9017612de tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:59.093838 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4db605db-240d-4fcc-8d40-50b9017612de tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:45:59.094266 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4db605db-240d-4fcc-8d40-50b9017612de tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:45:59.252891 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4db605db-240d-4fcc-8d40-50b9017612de tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:45:59.261549 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4db605db-240d-4fcc-8d40-50b9017612de tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1392 microversion: 2.1 time: 0.180866 Aug 04 17:45:59.262116 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3511/6911] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:45:59 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1392 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:00.286530 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3a9f42ac-ecc5-4975-8269-5f7d87445cc7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:00.287130 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3a9f42ac-ecc5-4975-8269-5f7d87445cc7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:00.295012 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a9f42ac-ecc5-4975-8269-5f7d87445cc7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:00.295469 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a9f42ac-ecc5-4975-8269-5f7d87445cc7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:00.296245 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a9f42ac-ecc5-4975-8269-5f7d87445cc7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:00.296685 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a9f42ac-ecc5-4975-8269-5f7d87445cc7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:00.448042 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3a9f42ac-ecc5-4975-8269-5f7d87445cc7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:00.459280 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3a9f42ac-ecc5-4975-8269-5f7d87445cc7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1392 microversion: 2.1 time: 0.176663 Aug 04 17:46:00.459992 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3401/6912] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:00 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:00.977532 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-cc5f209f-490e-4d11-b77e-afcdef324951 req-72fba724-75a4-4a58-b6b7-c3a817a13622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd508c34-0a9f-4616-a42f-65eff24f3dd4", "name": "network-vif-plugged", "status": "completed", "tag": "a70fd347-572e-4c7e-87b6-90e61ae7c08b"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:46:00.988210 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-cc5f209f-490e-4d11-b77e-afcdef324951 req-72fba724-75a4-4a58-b6b7-c3a817a13622 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:00.988696 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-cc5f209f-490e-4d11-b77e-afcdef324951 req-72fba724-75a4-4a58-b6b7-c3a817a13622 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:01.002389 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-cc5f209f-490e-4d11-b77e-afcdef324951 req-72fba724-75a4-4a58-b6b7-c3a817a13622 service nova] Creating event network-vif-plugged:a70fd347-572e-4c7e-87b6-90e61ae7c08b for instance fd508c34-0a9f-4616-a42f-65eff24f3dd4 on n-h1-846466-12 Aug 04 17:46:01.007956 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-cc5f209f-490e-4d11-b77e-afcdef324951 req-72fba724-75a4-4a58-b6b7-c3a817a13622 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034268 Aug 04 17:46:01.009249 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3512/6913] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:46:01.488149 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-52c6752f-fa27-484a-963f-f63e477b9e7a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:01.488773 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-52c6752f-fa27-484a-963f-f63e477b9e7a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:01.497935 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-52c6752f-fa27-484a-963f-f63e477b9e7a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:01.498410 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-52c6752f-fa27-484a-963f-f63e477b9e7a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:01.499214 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-52c6752f-fa27-484a-963f-f63e477b9e7a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:01.499660 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-52c6752f-fa27-484a-963f-f63e477b9e7a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:01.661209 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-52c6752f-fa27-484a-963f-f63e477b9e7a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:01.670517 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-52c6752f-fa27-484a-963f-f63e477b9e7a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1392 microversion: 2.1 time: 0.188402 Aug 04 17:46:01.671113 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3402/6914] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:01 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1392 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:02.695912 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1dfed8c7-b8f6-4f74-8234-d74e4c51fe1c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:02.696923 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1dfed8c7-b8f6-4f74-8234-d74e4c51fe1c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:02.699275 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:46:02.699990 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:46:02.701820 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:46:02.707995 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1dfed8c7-b8f6-4f74-8234-d74e4c51fe1c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:02.708428 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1dfed8c7-b8f6-4f74-8234-d74e4c51fe1c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:02.709220 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1dfed8c7-b8f6-4f74-8234-d74e4c51fe1c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:02.709697 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1dfed8c7-b8f6-4f74-8234-d74e4c51fe1c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:02.866666 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1dfed8c7-b8f6-4f74-8234-d74e4c51fe1c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:02.878544 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1dfed8c7-b8f6-4f74-8234-d74e4c51fe1c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1565 microversion: 2.1 time: 0.186598 Aug 04 17:46:02.879438 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3513/6915] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:02 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1565 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:02.904056 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-51447108-08e5-4142-b31d-2f65fa47760f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:02.905023 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-51447108-08e5-4142-b31d-2f65fa47760f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:02.907649 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:46:02.914076 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-51447108-08e5-4142-b31d-2f65fa47760f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:02.914522 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-51447108-08e5-4142-b31d-2f65fa47760f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:02.915564 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-51447108-08e5-4142-b31d-2f65fa47760f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:02.916172 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-51447108-08e5-4142-b31d-2f65fa47760f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:03.090593 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-51447108-08e5-4142-b31d-2f65fa47760f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:03.099036 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-51447108-08e5-4142-b31d-2f65fa47760f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1565 microversion: 2.1 time: 0.202056 Aug 04 17:46:03.099624 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3403/6916] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:02 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1565 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:05.254365 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-2b5ee2ec-816c-4192-85b6-108228500fe8 req-c3ab085d-bd0f-4384-a109-cde44f886c4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd508c34-0a9f-4616-a42f-65eff24f3dd4", "tag": "a70fd347-572e-4c7e-87b6-90e61ae7c08b"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:46:05.255463 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-07bbbd45-8e1a-49bf-bdf2-cdfac3bff0e7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:05.256097 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-07bbbd45-8e1a-49bf-bdf2-cdfac3bff0e7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:05.266085 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-07bbbd45-8e1a-49bf-bdf2-cdfac3bff0e7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:05.266782 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-07bbbd45-8e1a-49bf-bdf2-cdfac3bff0e7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:05.267586 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-07bbbd45-8e1a-49bf-bdf2-cdfac3bff0e7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:05.267998 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-07bbbd45-8e1a-49bf-bdf2-cdfac3bff0e7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:05.270593 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-2b5ee2ec-816c-4192-85b6-108228500fe8 req-c3ab085d-bd0f-4384-a109-cde44f886c4b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:05.271172 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-2b5ee2ec-816c-4192-85b6-108228500fe8 req-c3ab085d-bd0f-4384-a109-cde44f886c4b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:05.283976 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-2b5ee2ec-816c-4192-85b6-108228500fe8 req-c3ab085d-bd0f-4384-a109-cde44f886c4b service nova] Creating event network-changed:a70fd347-572e-4c7e-87b6-90e61ae7c08b for instance fd508c34-0a9f-4616-a42f-65eff24f3dd4 on n-h1-846466-12 Aug 04 17:46:05.290828 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-2b5ee2ec-816c-4192-85b6-108228500fe8 req-c3ab085d-bd0f-4384-a109-cde44f886c4b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039824 Aug 04 17:46:05.291791 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3404/6917] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:46:05.417162 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-07bbbd45-8e1a-49bf-bdf2-cdfac3bff0e7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:05.425622 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-07bbbd45-8e1a-49bf-bdf2-cdfac3bff0e7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1565 microversion: 2.1 time: 0.176612 Aug 04 17:46:05.426221 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3514/6918] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:05 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1565 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:28.700821 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:46:28.701653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=38 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:46:28.706147 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-057e7523-9fe1-41e1-ae56-cc2bbc736942 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:46:28.708476 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-057e7523-9fe1-41e1-ae56-cc2bbc736942 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:28.716534 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-057e7523-9fe1-41e1-ae56-cc2bbc736942 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:28.716992 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-057e7523-9fe1-41e1-ae56-cc2bbc736942 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:28.717818 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-057e7523-9fe1-41e1-ae56-cc2bbc736942 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:28.718263 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-057e7523-9fe1-41e1-ae56-cc2bbc736942 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:28.772346 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-057e7523-9fe1-41e1-ae56-cc2bbc736942 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "POST /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4/action" status: 200 len: 24567 microversion: 2.1 time: 0.073018 Aug 04 17:46:28.773072 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3405/6919] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:46:28 2022] POST /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4/action => generated 24567 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:46:39.739715 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b6dad32b-f2da-47d0-aed7-3c1ff9c1ea10 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:46:39.741908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b6dad32b-f2da-47d0-aed7-3c1ff9c1ea10 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:39.744287 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:46:39.744942 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=36 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:46:39.751111 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b6dad32b-f2da-47d0-aed7-3c1ff9c1ea10 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:39.751546 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b6dad32b-f2da-47d0-aed7-3c1ff9c1ea10 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:39.752305 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b6dad32b-f2da-47d0-aed7-3c1ff9c1ea10 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:39.752731 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b6dad32b-f2da-47d0-aed7-3c1ff9c1ea10 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:39.797815 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b6dad32b-f2da-47d0-aed7-3c1ff9c1ea10 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:39.804923 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b6dad32b-f2da-47d0-aed7-3c1ff9c1ea10 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Old instance type m1.heat2, new instance type m1.heat {{(pid=126125) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 17:46:39.811449 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b6dad32b-f2da-47d0-aed7-3c1ff9c1ea10 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:46:39.811851 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b6dad32b-f2da-47d0-aed7-3c1ff9c1ea10 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:46:39.812313 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b6dad32b-f2da-47d0-aed7-3c1ff9c1ea10 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:46:39.812707 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b6dad32b-f2da-47d0-aed7-3c1ff9c1ea10 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:46:39.813106 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b6dad32b-f2da-47d0-aed7-3c1ff9c1ea10 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:46:39.888973 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b6dad32b-f2da-47d0-aed7-3c1ff9c1ea10 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "POST /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4/action" status: 202 len: 0 microversion: 2.1 time: 0.152979 Aug 04 17:46:39.890015 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3515/6920] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:46:39 2022] POST /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:46:39.900087 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bf1e5372-521f-441b-856a-5f629c842dde tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:39.900826 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bf1e5372-521f-441b-856a-5f629c842dde tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:39.903810 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:46:39.904442 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=4 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:46:39.911563 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf1e5372-521f-441b-856a-5f629c842dde tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:39.912003 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf1e5372-521f-441b-856a-5f629c842dde tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:39.912810 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf1e5372-521f-441b-856a-5f629c842dde tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:39.913216 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bf1e5372-521f-441b-856a-5f629c842dde tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:40.061030 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bf1e5372-521f-441b-856a-5f629c842dde tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:40.070526 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bf1e5372-521f-441b-856a-5f629c842dde tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1693 microversion: 2.1 time: 0.175224 Aug 04 17:46:40.071108 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3406/6921] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:39 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1693 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:41.094176 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-aeefc72b-6975-42c8-a5b6-8f0645b063f0 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:41.095155 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-aeefc72b-6975-42c8-a5b6-8f0645b063f0 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:41.102189 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aeefc72b-6975-42c8-a5b6-8f0645b063f0 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:41.102808 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aeefc72b-6975-42c8-a5b6-8f0645b063f0 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:41.103599 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aeefc72b-6975-42c8-a5b6-8f0645b063f0 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:41.104031 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-aeefc72b-6975-42c8-a5b6-8f0645b063f0 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:41.252678 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-aeefc72b-6975-42c8-a5b6-8f0645b063f0 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:41.260881 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-aeefc72b-6975-42c8-a5b6-8f0645b063f0 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1693 microversion: 2.1 time: 0.172007 Aug 04 17:46:41.261515 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3516/6922] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:41 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1693 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:42.285306 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-74845650-c270-4b0e-921a-030281ae2600 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:42.285892 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-74845650-c270-4b0e-921a-030281ae2600 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:42.294606 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-74845650-c270-4b0e-921a-030281ae2600 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:42.295059 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-74845650-c270-4b0e-921a-030281ae2600 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:42.295838 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-74845650-c270-4b0e-921a-030281ae2600 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:42.296281 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-74845650-c270-4b0e-921a-030281ae2600 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:42.444404 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-74845650-c270-4b0e-921a-030281ae2600 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:42.452736 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-74845650-c270-4b0e-921a-030281ae2600 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1698 microversion: 2.1 time: 0.171643 Aug 04 17:46:42.453326 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3407/6923] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:42 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1698 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:43.481516 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fd72221d-462b-447c-af22-a094706e8f6f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:43.482099 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fd72221d-462b-447c-af22-a094706e8f6f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:43.489902 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fd72221d-462b-447c-af22-a094706e8f6f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:43.490354 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fd72221d-462b-447c-af22-a094706e8f6f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:43.491124 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fd72221d-462b-447c-af22-a094706e8f6f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:43.491555 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fd72221d-462b-447c-af22-a094706e8f6f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:43.652339 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fd72221d-462b-447c-af22-a094706e8f6f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:43.660191 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fd72221d-462b-447c-af22-a094706e8f6f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1698 microversion: 2.1 time: 0.182793 Aug 04 17:46:43.660862 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3517/6924] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:43 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1698 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:44.682691 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c6ed15b6-cbd1-4dc2-86de-d78744c328ac tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:44.683373 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c6ed15b6-cbd1-4dc2-86de-d78744c328ac tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:44.690986 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c6ed15b6-cbd1-4dc2-86de-d78744c328ac tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:44.691534 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c6ed15b6-cbd1-4dc2-86de-d78744c328ac tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:44.692320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c6ed15b6-cbd1-4dc2-86de-d78744c328ac tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:44.692762 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c6ed15b6-cbd1-4dc2-86de-d78744c328ac tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:44.839620 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c6ed15b6-cbd1-4dc2-86de-d78744c328ac tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:44.847823 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c6ed15b6-cbd1-4dc2-86de-d78744c328ac tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1698 microversion: 2.1 time: 0.169356 Aug 04 17:46:44.849058 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3408/6925] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:44 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1698 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:45.870206 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-66a50475-0a0e-4d83-939e-394c0cd032ef tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:45.870790 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-66a50475-0a0e-4d83-939e-394c0cd032ef tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:45.879957 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-66a50475-0a0e-4d83-939e-394c0cd032ef tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:45.880405 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-66a50475-0a0e-4d83-939e-394c0cd032ef tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:45.881176 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-66a50475-0a0e-4d83-939e-394c0cd032ef tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:45.881620 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-66a50475-0a0e-4d83-939e-394c0cd032ef tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:46.027053 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-66a50475-0a0e-4d83-939e-394c0cd032ef tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:46.036508 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-66a50475-0a0e-4d83-939e-394c0cd032ef tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1698 microversion: 2.1 time: 0.169810 Aug 04 17:46:46.037544 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3518/6926] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:45 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1698 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:47.064438 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0616ea20-b816-4c9e-9cc5-401ef974f38e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:47.065198 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0616ea20-b816-4c9e-9cc5-401ef974f38e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:47.073198 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0616ea20-b816-4c9e-9cc5-401ef974f38e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:47.073696 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0616ea20-b816-4c9e-9cc5-401ef974f38e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:47.074472 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0616ea20-b816-4c9e-9cc5-401ef974f38e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:47.074915 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0616ea20-b816-4c9e-9cc5-401ef974f38e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:47.242337 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0616ea20-b816-4c9e-9cc5-401ef974f38e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:47.250866 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0616ea20-b816-4c9e-9cc5-401ef974f38e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1698 microversion: 2.1 time: 0.190348 Aug 04 17:46:47.251488 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3409/6927] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:47 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1698 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:48.272801 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-04311f30-5026-4559-b263-52a7ff52f252 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:48.273443 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-04311f30-5026-4559-b263-52a7ff52f252 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:48.280837 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-04311f30-5026-4559-b263-52a7ff52f252 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:48.281316 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-04311f30-5026-4559-b263-52a7ff52f252 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:48.282094 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-04311f30-5026-4559-b263-52a7ff52f252 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:48.282492 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-04311f30-5026-4559-b263-52a7ff52f252 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:48.438180 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-04311f30-5026-4559-b263-52a7ff52f252 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:48.446397 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-04311f30-5026-4559-b263-52a7ff52f252 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1698 microversion: 2.1 time: 0.177933 Aug 04 17:46:48.446981 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3519/6928] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:48 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1698 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:49.468932 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-490c6ad2-fa89-4462-8418-5050462a230f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:49.469733 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-490c6ad2-fa89-4462-8418-5050462a230f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:49.478932 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-490c6ad2-fa89-4462-8418-5050462a230f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:49.479469 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-490c6ad2-fa89-4462-8418-5050462a230f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:49.480689 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-490c6ad2-fa89-4462-8418-5050462a230f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:49.481769 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-490c6ad2-fa89-4462-8418-5050462a230f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:49.648078 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-490c6ad2-fa89-4462-8418-5050462a230f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:49.656770 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-490c6ad2-fa89-4462-8418-5050462a230f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1698 microversion: 2.1 time: 0.192322 Aug 04 17:46:49.657375 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3410/6929] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:49 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1698 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:50.679236 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e7d73a61-1f36-4e45-80ff-38231a48d881 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:50.679864 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e7d73a61-1f36-4e45-80ff-38231a48d881 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:50.688408 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e7d73a61-1f36-4e45-80ff-38231a48d881 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:50.688848 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e7d73a61-1f36-4e45-80ff-38231a48d881 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:50.689706 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e7d73a61-1f36-4e45-80ff-38231a48d881 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:50.690217 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e7d73a61-1f36-4e45-80ff-38231a48d881 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:50.847130 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e7d73a61-1f36-4e45-80ff-38231a48d881 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:50.857881 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e7d73a61-1f36-4e45-80ff-38231a48d881 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1698 microversion: 2.1 time: 0.182775 Aug 04 17:46:50.858869 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3520/6930] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:50 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1698 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:51.880787 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c2883705-f2c1-4598-8649-2181f7a6490f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:51.881460 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c2883705-f2c1-4598-8649-2181f7a6490f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:51.889543 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c2883705-f2c1-4598-8649-2181f7a6490f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:51.890065 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c2883705-f2c1-4598-8649-2181f7a6490f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:51.890886 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c2883705-f2c1-4598-8649-2181f7a6490f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:51.891424 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c2883705-f2c1-4598-8649-2181f7a6490f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:52.045480 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c2883705-f2c1-4598-8649-2181f7a6490f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:52.053245 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c2883705-f2c1-4598-8649-2181f7a6490f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1698 microversion: 2.1 time: 0.177200 Aug 04 17:46:52.053877 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3411/6931] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:51 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1698 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:53.075528 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-02fe8f57-63fc-453a-9e9e-a32b31875fa6 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:53.076267 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-02fe8f57-63fc-453a-9e9e-a32b31875fa6 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:53.084026 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02fe8f57-63fc-453a-9e9e-a32b31875fa6 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:53.084479 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02fe8f57-63fc-453a-9e9e-a32b31875fa6 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:53.085267 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02fe8f57-63fc-453a-9e9e-a32b31875fa6 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:53.085746 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02fe8f57-63fc-453a-9e9e-a32b31875fa6 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:53.231561 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-02fe8f57-63fc-453a-9e9e-a32b31875fa6 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:53.240197 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-02fe8f57-63fc-453a-9e9e-a32b31875fa6 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1698 microversion: 2.1 time: 0.169698 Aug 04 17:46:53.240815 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3521/6932] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:53 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1698 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:54.262606 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8d437f74-44ec-476c-b9cb-3d3aeddfd750 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:54.263313 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8d437f74-44ec-476c-b9cb-3d3aeddfd750 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:54.272625 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8d437f74-44ec-476c-b9cb-3d3aeddfd750 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:54.273094 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8d437f74-44ec-476c-b9cb-3d3aeddfd750 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:54.273898 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8d437f74-44ec-476c-b9cb-3d3aeddfd750 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:54.274341 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8d437f74-44ec-476c-b9cb-3d3aeddfd750 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:54.418056 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8d437f74-44ec-476c-b9cb-3d3aeddfd750 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:54.427163 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8d437f74-44ec-476c-b9cb-3d3aeddfd750 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1698 microversion: 2.1 time: 0.168502 Aug 04 17:46:54.427758 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3412/6933] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:54 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1698 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:55.448512 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d2cf8bca-71ee-4481-a7b5-b82ed092d58f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:55.449127 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d2cf8bca-71ee-4481-a7b5-b82ed092d58f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:55.456744 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d2cf8bca-71ee-4481-a7b5-b82ed092d58f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:55.457188 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d2cf8bca-71ee-4481-a7b5-b82ed092d58f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:55.457989 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d2cf8bca-71ee-4481-a7b5-b82ed092d58f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:55.458422 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d2cf8bca-71ee-4481-a7b5-b82ed092d58f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:55.610421 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d2cf8bca-71ee-4481-a7b5-b82ed092d58f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:55.619840 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d2cf8bca-71ee-4481-a7b5-b82ed092d58f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1698 microversion: 2.1 time: 0.175340 Aug 04 17:46:55.620413 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3522/6934] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:55 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1698 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:56.647565 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-369b9d1a-8c07-4bd1-bd22-a20d896bd464 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:56.648186 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-369b9d1a-8c07-4bd1-bd22-a20d896bd464 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:56.655794 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-369b9d1a-8c07-4bd1-bd22-a20d896bd464 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:56.656336 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-369b9d1a-8c07-4bd1-bd22-a20d896bd464 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:56.657247 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-369b9d1a-8c07-4bd1-bd22-a20d896bd464 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:56.657721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-369b9d1a-8c07-4bd1-bd22-a20d896bd464 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:56.800395 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-369b9d1a-8c07-4bd1-bd22-a20d896bd464 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:56.809402 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-369b9d1a-8c07-4bd1-bd22-a20d896bd464 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1698 microversion: 2.1 time: 0.166262 Aug 04 17:46:56.810066 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3413/6935] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:56 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1698 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:57.831963 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6b4f52c0-542b-44b7-b2c3-8e5b6956e7a4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:57.832565 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6b4f52c0-542b-44b7-b2c3-8e5b6956e7a4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:57.840343 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6b4f52c0-542b-44b7-b2c3-8e5b6956e7a4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:57.840799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6b4f52c0-542b-44b7-b2c3-8e5b6956e7a4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:57.841584 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6b4f52c0-542b-44b7-b2c3-8e5b6956e7a4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:57.841997 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6b4f52c0-542b-44b7-b2c3-8e5b6956e7a4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:57.995134 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6b4f52c0-542b-44b7-b2c3-8e5b6956e7a4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:58.004170 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6b4f52c0-542b-44b7-b2c3-8e5b6956e7a4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1698 microversion: 2.1 time: 0.176234 Aug 04 17:46:58.004800 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3523/6936] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:57 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1698 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:59.026971 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5a2065b7-b526-49a7-85f1-53de13865eb1 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:59.027641 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5a2065b7-b526-49a7-85f1-53de13865eb1 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:59.035134 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a2065b7-b526-49a7-85f1-53de13865eb1 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:59.035609 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a2065b7-b526-49a7-85f1-53de13865eb1 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:59.036387 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a2065b7-b526-49a7-85f1-53de13865eb1 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:46:59.037077 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5a2065b7-b526-49a7-85f1-53de13865eb1 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:46:59.183852 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5a2065b7-b526-49a7-85f1-53de13865eb1 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:59.192712 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5a2065b7-b526-49a7-85f1-53de13865eb1 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1698 microversion: 2.1 time: 0.169613 Aug 04 17:46:59.193321 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3414/6937] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:59 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1698 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:47:00.214148 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9e0f91e9-dfa4-482d-ae6b-b52af042174b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:47:00.214756 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9e0f91e9-dfa4-482d-ae6b-b52af042174b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:47:00.223001 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9e0f91e9-dfa4-482d-ae6b-b52af042174b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:00.223449 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9e0f91e9-dfa4-482d-ae6b-b52af042174b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:00.224233 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9e0f91e9-dfa4-482d-ae6b-b52af042174b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:00.224742 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9e0f91e9-dfa4-482d-ae6b-b52af042174b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:00.373189 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9e0f91e9-dfa4-482d-ae6b-b52af042174b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:47:00.382431 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9e0f91e9-dfa4-482d-ae6b-b52af042174b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1698 microversion: 2.1 time: 0.172225 Aug 04 17:47:00.383024 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3524/6938] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:47:00 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1698 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:47:01.406091 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-123306de-f338-4326-9fa7-1af2c0e4412e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:47:01.406812 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-123306de-f338-4326-9fa7-1af2c0e4412e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:47:01.414352 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-123306de-f338-4326-9fa7-1af2c0e4412e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:01.414808 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-123306de-f338-4326-9fa7-1af2c0e4412e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:01.415586 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-123306de-f338-4326-9fa7-1af2c0e4412e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:01.416024 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-123306de-f338-4326-9fa7-1af2c0e4412e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:01.580224 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-123306de-f338-4326-9fa7-1af2c0e4412e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:47:01.588511 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-123306de-f338-4326-9fa7-1af2c0e4412e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1698 microversion: 2.1 time: 0.186426 Aug 04 17:47:01.589102 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3415/6939] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:47:01 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1698 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:47:02.611937 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a0ec19aa-dde4-4529-b0f2-f6cc310110d3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:47:02.612552 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a0ec19aa-dde4-4529-b0f2-f6cc310110d3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:47:02.622169 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a0ec19aa-dde4-4529-b0f2-f6cc310110d3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:02.622962 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a0ec19aa-dde4-4529-b0f2-f6cc310110d3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:02.624853 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a0ec19aa-dde4-4529-b0f2-f6cc310110d3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:02.625500 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a0ec19aa-dde4-4529-b0f2-f6cc310110d3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:02.786569 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a0ec19aa-dde4-4529-b0f2-f6cc310110d3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:47:02.796273 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a0ec19aa-dde4-4529-b0f2-f6cc310110d3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1698 microversion: 2.1 time: 0.189815 Aug 04 17:47:02.796873 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3525/6940] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:47:02 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1698 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:47:03.824469 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f949a37e-aef1-4574-8569-ee748ee1172a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:47:03.825212 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f949a37e-aef1-4574-8569-ee748ee1172a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:47:03.835173 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f949a37e-aef1-4574-8569-ee748ee1172a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:03.835633 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f949a37e-aef1-4574-8569-ee748ee1172a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:03.836426 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f949a37e-aef1-4574-8569-ee748ee1172a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:03.836909 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f949a37e-aef1-4574-8569-ee748ee1172a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:03.991825 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f949a37e-aef1-4574-8569-ee748ee1172a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:47:04.001159 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f949a37e-aef1-4574-8569-ee748ee1172a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1698 microversion: 2.1 time: 0.183764 Aug 04 17:47:04.001807 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3416/6941] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:47:03 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1698 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:47:04.968109 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-cb74b4f6-d9cf-4f9a-9149-b059bd7aeb36 req-e26339b6-9547-4eaf-b242-4d2a2bf65add service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd508c34-0a9f-4616-a42f-65eff24f3dd4", "name": "network-vif-unplugged", "status": "completed", "tag": "a70fd347-572e-4c7e-87b6-90e61ae7c08b"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:47:04.979705 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-cb74b4f6-d9cf-4f9a-9149-b059bd7aeb36 req-e26339b6-9547-4eaf-b242-4d2a2bf65add service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:04.980171 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-cb74b4f6-d9cf-4f9a-9149-b059bd7aeb36 req-e26339b6-9547-4eaf-b242-4d2a2bf65add service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:04.995405 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-cb74b4f6-d9cf-4f9a-9149-b059bd7aeb36 req-e26339b6-9547-4eaf-b242-4d2a2bf65add service nova] Creating event network-vif-unplugged:a70fd347-572e-4c7e-87b6-90e61ae7c08b for instance fd508c34-0a9f-4616-a42f-65eff24f3dd4 on n-h2-846466-12 Aug 04 17:47:05.002159 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [req-cb74b4f6-d9cf-4f9a-9149-b059bd7aeb36 req-e26339b6-9547-4eaf-b242-4d2a2bf65add service nova] Instance fd508c34-0a9f-4616-a42f-65eff24f3dd4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:47:05.014620 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-cb74b4f6-d9cf-4f9a-9149-b059bd7aeb36 req-e26339b6-9547-4eaf-b242-4d2a2bf65add service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050461 Aug 04 17:47:05.015252 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3526/6942] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:47:05.023705 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e3268514-a199-4fce-a2c2-ff299ee1e6ba tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:47:05.024316 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e3268514-a199-4fce-a2c2-ff299ee1e6ba tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:47:05.031574 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e3268514-a199-4fce-a2c2-ff299ee1e6ba tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:05.032026 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e3268514-a199-4fce-a2c2-ff299ee1e6ba tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:05.032803 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e3268514-a199-4fce-a2c2-ff299ee1e6ba tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:05.033471 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e3268514-a199-4fce-a2c2-ff299ee1e6ba tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:05.313333 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e3268514-a199-4fce-a2c2-ff299ee1e6ba tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:47:05.321694 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e3268514-a199-4fce-a2c2-ff299ee1e6ba tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1697 microversion: 2.1 time: 0.302815 Aug 04 17:47:05.322281 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3417/6943] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:47:05 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1697 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:47:06.345646 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b42abbcf-87fd-43f4-a007-5cd00a0b414e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:47:06.346447 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b42abbcf-87fd-43f4-a007-5cd00a0b414e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:47:06.353457 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b42abbcf-87fd-43f4-a007-5cd00a0b414e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:06.353918 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b42abbcf-87fd-43f4-a007-5cd00a0b414e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:06.354709 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b42abbcf-87fd-43f4-a007-5cd00a0b414e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:06.355135 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b42abbcf-87fd-43f4-a007-5cd00a0b414e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:06.507569 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b42abbcf-87fd-43f4-a007-5cd00a0b414e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:47:06.516673 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b42abbcf-87fd-43f4-a007-5cd00a0b414e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1695 microversion: 2.1 time: 0.176549 Aug 04 17:47:06.517318 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3527/6944] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:47:06 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1695 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:47:07.055399 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-05fffbdd-bb77-46b7-b7cc-0f554f7a1121 req-f44fcbd1-67c9-410f-9e0a-66de34f08eec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd508c34-0a9f-4616-a42f-65eff24f3dd4", "tag": "a70fd347-572e-4c7e-87b6-90e61ae7c08b"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:47:07.073352 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-05fffbdd-bb77-46b7-b7cc-0f554f7a1121 req-f44fcbd1-67c9-410f-9e0a-66de34f08eec service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:07.073850 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-05fffbdd-bb77-46b7-b7cc-0f554f7a1121 req-f44fcbd1-67c9-410f-9e0a-66de34f08eec service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:07.087727 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-05fffbdd-bb77-46b7-b7cc-0f554f7a1121 req-f44fcbd1-67c9-410f-9e0a-66de34f08eec service nova] Creating event network-changed:a70fd347-572e-4c7e-87b6-90e61ae7c08b for instance fd508c34-0a9f-4616-a42f-65eff24f3dd4 on n-h2-846466-12 Aug 04 17:47:07.094300 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [req-05fffbdd-bb77-46b7-b7cc-0f554f7a1121 req-f44fcbd1-67c9-410f-9e0a-66de34f08eec service nova] Instance fd508c34-0a9f-4616-a42f-65eff24f3dd4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846466-12', 'n-h2-846466-12'} {{(pid=126126) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:47:07.105824 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-05fffbdd-bb77-46b7-b7cc-0f554f7a1121 req-f44fcbd1-67c9-410f-9e0a-66de34f08eec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054084 Aug 04 17:47:07.106745 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3418/6945] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:47:07.539881 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c32c66d2-2497-44f6-9abb-8a52d7359523 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:47:07.540716 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c32c66d2-2497-44f6-9abb-8a52d7359523 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:47:07.547984 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c32c66d2-2497-44f6-9abb-8a52d7359523 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:07.548429 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c32c66d2-2497-44f6-9abb-8a52d7359523 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:07.549211 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c32c66d2-2497-44f6-9abb-8a52d7359523 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:07.549672 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c32c66d2-2497-44f6-9abb-8a52d7359523 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:07.802150 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c32c66d2-2497-44f6-9abb-8a52d7359523 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:47:07.810218 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c32c66d2-2497-44f6-9abb-8a52d7359523 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1695 microversion: 2.1 time: 0.274271 Aug 04 17:47:07.810982 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3528/6946] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:47:07 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1695 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:47:08.833386 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2d745c96-0c36-47cb-8a90-3ba08d886348 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:47:08.834105 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2d745c96-0c36-47cb-8a90-3ba08d886348 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:47:08.841555 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2d745c96-0c36-47cb-8a90-3ba08d886348 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:08.842013 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2d745c96-0c36-47cb-8a90-3ba08d886348 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:08.843182 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2d745c96-0c36-47cb-8a90-3ba08d886348 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:08.843751 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2d745c96-0c36-47cb-8a90-3ba08d886348 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:09.001721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2d745c96-0c36-47cb-8a90-3ba08d886348 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:47:09.009970 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2d745c96-0c36-47cb-8a90-3ba08d886348 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1692 microversion: 2.1 time: 0.181781 Aug 04 17:47:09.010359 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3419/6947] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:47:08 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1692 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:47:09.032639 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d656e868-dd43-4bf1-9478-ef17fcb84c4f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:47:09.033254 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d656e868-dd43-4bf1-9478-ef17fcb84c4f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:47:09.041040 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d656e868-dd43-4bf1-9478-ef17fcb84c4f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:09.041501 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d656e868-dd43-4bf1-9478-ef17fcb84c4f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:09.042269 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d656e868-dd43-4bf1-9478-ef17fcb84c4f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:09.042755 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d656e868-dd43-4bf1-9478-ef17fcb84c4f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:09.088796 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:47:09.113648 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d656e868-dd43-4bf1-9478-ef17fcb84c4f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "POST /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4/action" status: 204 len: 0 microversion: 2.1 time: 0.085503 Aug 04 17:47:09.114297 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3529/6948] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:47:09 2022] POST /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4/action => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:47:09.122977 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d7e55e18-8c58-4732-9935-14a574f6cc84 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:47:09.123696 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d7e55e18-8c58-4732-9935-14a574f6cc84 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:47:09.131174 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d7e55e18-8c58-4732-9935-14a574f6cc84 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:09.131876 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d7e55e18-8c58-4732-9935-14a574f6cc84 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:09.132687 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d7e55e18-8c58-4732-9935-14a574f6cc84 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:09.133128 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d7e55e18-8c58-4732-9935-14a574f6cc84 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:09.295530 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d7e55e18-8c58-4732-9935-14a574f6cc84 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:47:09.304804 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d7e55e18-8c58-4732-9935-14a574f6cc84 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1692 microversion: 2.1 time: 0.185751 Aug 04 17:47:09.305629 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3420/6949] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:47:09 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1692 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:47:09.327369 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c3ecad96-43ab-4c07-be9a-397f0ed59589 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:47:09.328203 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c3ecad96-43ab-4c07-be9a-397f0ed59589 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:47:09.335940 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3ecad96-43ab-4c07-be9a-397f0ed59589 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:09.336392 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3ecad96-43ab-4c07-be9a-397f0ed59589 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:09.337197 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3ecad96-43ab-4c07-be9a-397f0ed59589 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:09.337693 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3ecad96-43ab-4c07-be9a-397f0ed59589 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:09.496748 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c3ecad96-43ab-4c07-be9a-397f0ed59589 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:47:09.507660 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c3ecad96-43ab-4c07-be9a-397f0ed59589 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1692 microversion: 2.1 time: 0.184548 Aug 04 17:47:09.508582 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3530/6950] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:47:09 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1692 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:47:10.538877 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ad00f8d3-cb54-4052-928c-8f0e20b06175 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:47:10.539747 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ad00f8d3-cb54-4052-928c-8f0e20b06175 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:47:10.544471 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=31 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:47:10.553031 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad00f8d3-cb54-4052-928c-8f0e20b06175 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:10.553507 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad00f8d3-cb54-4052-928c-8f0e20b06175 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:10.554309 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad00f8d3-cb54-4052-928c-8f0e20b06175 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:10.554753 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ad00f8d3-cb54-4052-928c-8f0e20b06175 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:10.558388 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=89 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:47:10.713818 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ad00f8d3-cb54-4052-928c-8f0e20b06175 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:47:10.722355 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ad00f8d3-cb54-4052-928c-8f0e20b06175 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1684 microversion: 2.1 time: 0.190675 Aug 04 17:47:10.723138 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3421/6951] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:47:10 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1684 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:47:11.847786 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-6084a5dc-07fc-404e-8fbd-7cf397f5be5a req-430111ea-9e04-44e2-a7ee-e00db91a81f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd508c34-0a9f-4616-a42f-65eff24f3dd4", "name": "network-vif-plugged", "status": "completed", "tag": "a70fd347-572e-4c7e-87b6-90e61ae7c08b"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:47:11.853713 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=37 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:47:11.860844 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6084a5dc-07fc-404e-8fbd-7cf397f5be5a req-430111ea-9e04-44e2-a7ee-e00db91a81f8 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:11.861305 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-6084a5dc-07fc-404e-8fbd-7cf397f5be5a req-430111ea-9e04-44e2-a7ee-e00db91a81f8 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:11.873969 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-6084a5dc-07fc-404e-8fbd-7cf397f5be5a req-430111ea-9e04-44e2-a7ee-e00db91a81f8 service nova] Creating event network-vif-plugged:a70fd347-572e-4c7e-87b6-90e61ae7c08b for instance fd508c34-0a9f-4616-a42f-65eff24f3dd4 on n-h2-846466-12 Aug 04 17:47:11.879050 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-6084a5dc-07fc-404e-8fbd-7cf397f5be5a req-430111ea-9e04-44e2-a7ee-e00db91a81f8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112589 Aug 04 17:47:11.879665 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3531/6952] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:47:16.584640 n-d-846466-12 devstack@n-api.service[126126]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:47:16.585523 n-d-846466-12 devstack@n-api.service[126126]: Thu Aug 4 17:47:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 17:47:32.918675 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-35c3a366-cbea-4bb1-8e90-3bb004fb6603 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:47:32.920975 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-35c3a366-cbea-4bb1-8e90-3bb004fb6603 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:47:32.923536 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:47:32.924194 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=5 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:47:32.931067 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-35c3a366-cbea-4bb1-8e90-3bb004fb6603 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:32.931521 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-35c3a366-cbea-4bb1-8e90-3bb004fb6603 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:32.932341 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-35c3a366-cbea-4bb1-8e90-3bb004fb6603 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:32.932854 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-35c3a366-cbea-4bb1-8e90-3bb004fb6603 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:32.990581 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-35c3a366-cbea-4bb1-8e90-3bb004fb6603 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "POST /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4/action" status: 200 len: 24579 microversion: 2.1 time: 0.075688 Aug 04 17:47:32.991283 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3422/6953] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:47:32 2022] POST /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4/action => generated 24579 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:47:40.528567 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:47:40.529463 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:47:40.533032 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-1f12775e-33a0-4758-92ff-d7f8352a602d req-39fc265b-c9ed-4274-984d-eff681ce7d92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd508c34-0a9f-4616-a42f-65eff24f3dd4", "tag": "a70fd347-572e-4c7e-87b6-90e61ae7c08b"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:47:40.534491 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f856affc-f597-4d80-b102-43d387637fa3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:47:40.535095 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f856affc-f597-4d80-b102-43d387637fa3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:47:40.543914 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f856affc-f597-4d80-b102-43d387637fa3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:40.544582 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f856affc-f597-4d80-b102-43d387637fa3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:40.545325 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f856affc-f597-4d80-b102-43d387637fa3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:40.546184 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f856affc-f597-4d80-b102-43d387637fa3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:40.552742 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-1f12775e-33a0-4758-92ff-d7f8352a602d req-39fc265b-c9ed-4274-984d-eff681ce7d92 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:40.553194 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-1f12775e-33a0-4758-92ff-d7f8352a602d req-39fc265b-c9ed-4274-984d-eff681ce7d92 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:40.568172 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-1f12775e-33a0-4758-92ff-d7f8352a602d req-39fc265b-c9ed-4274-984d-eff681ce7d92 service nova] Creating event network-changed:a70fd347-572e-4c7e-87b6-90e61ae7c08b for instance fd508c34-0a9f-4616-a42f-65eff24f3dd4 on n-h2-846466-12 Aug 04 17:47:40.574481 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-1f12775e-33a0-4758-92ff-d7f8352a602d req-39fc265b-c9ed-4274-984d-eff681ce7d92 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045462 Aug 04 17:47:40.575066 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3423/6954] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:47:40.577370 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f856affc-f597-4d80-b102-43d387637fa3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:47:40.670541 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f856affc-f597-4d80-b102-43d387637fa3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 204 len: 0 microversion: 2.1 time: 0.144985 Aug 04 17:47:40.671396 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3532/6955] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:47:40 2022] DELETE /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:47:40.680927 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4de314de-60b1-45aa-b03d-3d2f3b6bb217 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:47:40.681674 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4de314de-60b1-45aa-b03d-3d2f3b6bb217 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:47:40.689001 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4de314de-60b1-45aa-b03d-3d2f3b6bb217 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:40.689968 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4de314de-60b1-45aa-b03d-3d2f3b6bb217 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:40.690758 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4de314de-60b1-45aa-b03d-3d2f3b6bb217 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:40.692235 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4de314de-60b1-45aa-b03d-3d2f3b6bb217 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:40.862518 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-4de314de-60b1-45aa-b03d-3d2f3b6bb217 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:47:40.871110 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4de314de-60b1-45aa-b03d-3d2f3b6bb217 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1690 microversion: 2.1 time: 0.194999 Aug 04 17:47:40.871723 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3424/6956] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:47:40 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1690 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:47:41.894525 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-49d8d210-d8cb-4970-8206-e3cb4b11307d tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:47:41.895290 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-49d8d210-d8cb-4970-8206-e3cb4b11307d tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:47:41.903173 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-49d8d210-d8cb-4970-8206-e3cb4b11307d tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:41.903612 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-49d8d210-d8cb-4970-8206-e3cb4b11307d tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:41.904410 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-49d8d210-d8cb-4970-8206-e3cb4b11307d tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:41.904919 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-49d8d210-d8cb-4970-8206-e3cb4b11307d tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:42.149624 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-49d8d210-d8cb-4970-8206-e3cb4b11307d tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:47:42.158101 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-49d8d210-d8cb-4970-8206-e3cb4b11307d tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 200 len: 1690 microversion: 2.1 time: 0.269052 Aug 04 17:47:42.158804 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3533/6957] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:47:41 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 1690 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:47:42.590814 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-30265c14-d7a7-416a-bb0f-52248aa2e871 req-94987bd2-f5f7-468e-95c8-c0bbb48f8186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd508c34-0a9f-4616-a42f-65eff24f3dd4", "name": "network-vif-deleted", "tag": "a70fd347-572e-4c7e-87b6-90e61ae7c08b"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:47:42.603926 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-30265c14-d7a7-416a-bb0f-52248aa2e871 req-94987bd2-f5f7-468e-95c8-c0bbb48f8186 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:42.604382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-30265c14-d7a7-416a-bb0f-52248aa2e871 req-94987bd2-f5f7-468e-95c8-c0bbb48f8186 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:42.620360 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-30265c14-d7a7-416a-bb0f-52248aa2e871 req-94987bd2-f5f7-468e-95c8-c0bbb48f8186 service nova] Creating event network-vif-deleted:a70fd347-572e-4c7e-87b6-90e61ae7c08b for instance fd508c34-0a9f-4616-a42f-65eff24f3dd4 on n-h2-846466-12 Aug 04 17:47:42.625568 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-30265c14-d7a7-416a-bb0f-52248aa2e871 req-94987bd2-f5f7-468e-95c8-c0bbb48f8186 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039549 Aug 04 17:47:42.626275 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3425/6958] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:47:43.181011 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6153a00e-5549-45ac-aa6a-301a54284e0a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:47:43.181662 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6153a00e-5549-45ac-aa6a-301a54284e0a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: fd508c34-0a9f-4616-a42f-65eff24f3dd4] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:47:43.190302 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6153a00e-5549-45ac-aa6a-301a54284e0a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:43.190806 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6153a00e-5549-45ac-aa6a-301a54284e0a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:43.191580 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6153a00e-5549-45ac-aa6a-301a54284e0a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:43.191984 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6153a00e-5549-45ac-aa6a-301a54284e0a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:43.207704 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.wsgi [None req-6153a00e-5549-45ac-aa6a-301a54284e0a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] HTTP exception thrown: Instance fd508c34-0a9f-4616-a42f-65eff24f3dd4 could not be found. Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6153a00e-5549-45ac-aa6a-301a54284e0a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Request method failure captured: Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: request: GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 HTTP/1.1 Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: Accept: application/json Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: Accept-Encoding: identity Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: Connection: close Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: Content-Length: 0 Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: Content-Type: application/json Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: Host: 10.222.0.23 Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: Openstack-System-Scope: None Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: User-Agent: python-urllib3/1.26.11 Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: X-Auth-Token: gAAAAABi7AUYxl_B7m1vSxbgIk1-lmBUtAUC3FieG1gEJ9GpQoBo_bCn-ZL3cuM6SWlZzV7WGRZWdwyMWqNkt77NBIbpSZwFdt-J-YRA4Zw2vE_lUfkP0eO6XnQW4b5p8QuudRRtMT3Ltdx4GiMtQBuU1yIToc97v7n6WszOki7v99fiq2wiYgc Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Id: None Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: X-Domain-Name: None Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: X-Identity-Status: Confirmed Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: X-Is-Admin-Project: True Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Id: default Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Domain-Name: Default Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Id: 1e1c6b45635949478b403b8b5db448c9 Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-888353230 Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: X-Role: member,reader Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: X-Roles: member,reader Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1e1c6b45635949478b403b8b5db448c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1e1c6b45635949478b403b8b5db448c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1e1c6b45635949478b403b8b5db448c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1e1c6b45635949478b403b8b5db448c9"}]}] Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant: tempest-TestNetworkAdvancedServerOps-888353230 Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Id: 1e1c6b45635949478b403b8b5db448c9 Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-888353230 Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: X-User: tempest-TestNetworkAdvancedServerOps-888353230-project Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Id: default Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: X-User-Domain-Name: Default Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: X-User-Id: 34dd901ba58f407891c63ac17cff7750 Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: X-User-Name: tempest-TestNetworkAdvancedServerOps-888353230-project Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: method: > Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: exception: Instance fd508c34-0a9f-4616-a42f-65eff24f3dd4 could not be found. Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: action_args: {'id': 'fd508c34-0a9f-4616-a42f-65eff24f3dd4'} Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd508c34-0a9f-4616-a42f-65eff24f3dd4 could not be found. Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd508c34-0a9f-4616-a42f-65eff24f3dd4 could not be found. Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:47:43.209495 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:47:43.214264 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:47:43.214264 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:47:43.214264 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:47:43.214264 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:47:43.214264 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:47:43.214264 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:47:43.214264 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd508c34-0a9f-4616-a42f-65eff24f3dd4 could not be found. Aug 04 17:47:43.214264 n-d-846466-12 devstack@n-api.service[126125]: ERROR nova.api.openstack.wsgi Aug 04 17:47:43.214264 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6153a00e-5549-45ac-aa6a-301a54284e0a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Returning 404 to user: Instance fd508c34-0a9f-4616-a42f-65eff24f3dd4 could not be found. {{(pid=126125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:47:43.214264 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6153a00e-5549-45ac-aa6a-301a54284e0a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4" status: 404 len: 111 microversion: 2.1 time: 0.033901 Aug 04 17:47:43.214264 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3534/6959] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:47:43 2022] GET /compute/v2.1/servers/fd508c34-0a9f-4616-a42f-65eff24f3dd4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:47:46.867751 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bd0fa472-87a3-4ed0-a607-69ee1d062a3a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '.version_select at 0x7f7e77d2a790>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:47:46.900475 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bd0fa472-87a3-4ed0-a607-69ee1d062a3a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1508681209" status: 202 len: 0 microversion: 2.1 time: 0.038428 Aug 04 17:47:46.901729 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3426/6960] 10.222.0.23 () {58 vars in 1284 bytes} [Thu Aug 4 17:47:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1508681209 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:47:46.931609 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3360ddb7-fb3c-4937-be49-de684c0664aa tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Action: 'create', calling method: .version_select at 0x7f7e89cd1040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-844853923", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQLEgO+tPLuk2CrTiiEzT41JFIk8FrewSrnpt9vkbfBYxkcPSIZ7c5OIrrVjnpg6yrEpcunsRFqrJ7Op46zSaGS0AtareknkISNP+dE24987LCFE4JRUyUqOHu08ycTUw=="}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:47:46.949747 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-3360ddb7-fb3c-4937-be49-de684c0664aa tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Getting quotas for project 1e1c6b45635949478b403b8b5db448c9. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:47:46.956475 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-3360ddb7-fb3c-4937-be49-de684c0664aa tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Getting quotas for user 34dd901ba58f407891c63ac17cff7750 and project 1e1c6b45635949478b403b8b5db448c9. Resources: {'key_pairs'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:47:46.983580 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3360ddb7-fb3c-4937-be49-de684c0664aa tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.055901 Aug 04 17:47:46.984190 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3535/6961] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 17:47:46 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:47:53.021504 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=14 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:47:53.027159 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3a36f611-052f-4508-876e-3dc3bffd57ee tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-476432175", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "f983c279-4a9b-46ea-895d-5208b0ac6dfe"}], "key_name": "tempest-TestNetworkAdvancedServerOps-844853923", "security_groups": [{"name": "tempest-secgroup-smoke-2087724030"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:47:53.164401 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-3a36f611-052f-4508-876e-3dc3bffd57ee tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] validate_networks() for [('f983c279-4a9b-46ea-895d-5208b0ac6dfe', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:47:53.634296 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-3a36f611-052f-4508-876e-3dc3bffd57ee tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:47:53.634769 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-3a36f611-052f-4508-876e-3dc3bffd57ee tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:47:53.635338 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-3a36f611-052f-4508-876e-3dc3bffd57ee tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:47:53.635805 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-3a36f611-052f-4508-876e-3dc3bffd57ee tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:47:53.636173 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-3a36f611-052f-4508-876e-3dc3bffd57ee tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:47:53.647855 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a36f611-052f-4508-876e-3dc3bffd57ee tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:53.648316 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a36f611-052f-4508-876e-3dc3bffd57ee tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:53.649216 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a36f611-052f-4508-876e-3dc3bffd57ee tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:53.649646 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3a36f611-052f-4508-876e-3dc3bffd57ee tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:53.669760 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-3a36f611-052f-4508-876e-3dc3bffd57ee tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Getting quotas for project 1e1c6b45635949478b403b8b5db448c9. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:47:53.676113 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-3a36f611-052f-4508-876e-3dc3bffd57ee tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Getting quotas for user 34dd901ba58f407891c63ac17cff7750 and project 1e1c6b45635949478b403b8b5db448c9. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:47:53.690907 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3a36f611-052f-4508-876e-3dc3bffd57ee tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:47:53.693317 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3a36f611-052f-4508-876e-3dc3bffd57ee tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:47:53.742087 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3a36f611-052f-4508-876e-3dc3bffd57ee tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.722231 Aug 04 17:47:53.742797 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3427/6962] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:47:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 17:47:53.755006 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5e38ac21-3f1f-4df7-9553-cf4d19b22a74 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:47:53.775088 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5e38ac21-3f1f-4df7-9553-cf4d19b22a74 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:47:53.780921 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:47:53.857084 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5e38ac21-3f1f-4df7-9553-cf4d19b22a74 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:47:53.867525 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5e38ac21-3f1f-4df7-9553-cf4d19b22a74 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9" status: 200 len: 1265 microversion: 2.1 time: 0.116290 Aug 04 17:47:53.869638 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3536/6963] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:47:53 2022] GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9 => generated 1265 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:47:54.894663 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b3e093de-f04d-4747-ab45-5509fc20c15e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:47:54.896241 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b3e093de-f04d-4747-ab45-5509fc20c15e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:47:54.907525 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b3e093de-f04d-4747-ab45-5509fc20c15e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:54.907988 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b3e093de-f04d-4747-ab45-5509fc20c15e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:54.908786 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b3e093de-f04d-4747-ab45-5509fc20c15e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:54.909242 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b3e093de-f04d-4747-ab45-5509fc20c15e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:55.019520 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b3e093de-f04d-4747-ab45-5509fc20c15e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:47:55.031363 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b3e093de-f04d-4747-ab45-5509fc20c15e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9" status: 200 len: 1335 microversion: 2.1 time: 0.144053 Aug 04 17:47:55.032087 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3428/6964] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:47:54 2022] GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9 => generated 1335 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:47:56.052524 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-15ac214a-a18f-45bb-a27b-f3e24cf639bd tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:47:56.053378 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-15ac214a-a18f-45bb-a27b-f3e24cf639bd tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:47:56.062668 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-15ac214a-a18f-45bb-a27b-f3e24cf639bd tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:56.063232 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-15ac214a-a18f-45bb-a27b-f3e24cf639bd tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:56.064518 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-15ac214a-a18f-45bb-a27b-f3e24cf639bd tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:56.065009 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-15ac214a-a18f-45bb-a27b-f3e24cf639bd tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:56.212635 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-15ac214a-a18f-45bb-a27b-f3e24cf639bd tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:47:56.221250 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-15ac214a-a18f-45bb-a27b-f3e24cf639bd tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9" status: 200 len: 1391 microversion: 2.1 time: 0.172732 Aug 04 17:47:56.221866 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3537/6965] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:47:56 2022] GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9 => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:47:56.694263 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-923e45d4-2ecd-4737-a424-10e8b55ebf19 req-b0fbbc56-7f7a-4f23-a312-9ecb278188df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e66a35db-d72f-47c8-957a-9663da1acbd9", "tag": "62530f58-19f4-4954-ae9b-cc5aa1e6e8f1"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:47:56.705784 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-923e45d4-2ecd-4737-a424-10e8b55ebf19 req-b0fbbc56-7f7a-4f23-a312-9ecb278188df service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:56.706560 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-923e45d4-2ecd-4737-a424-10e8b55ebf19 req-b0fbbc56-7f7a-4f23-a312-9ecb278188df service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:56.720757 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-923e45d4-2ecd-4737-a424-10e8b55ebf19 req-b0fbbc56-7f7a-4f23-a312-9ecb278188df service nova] Creating event network-changed:62530f58-19f4-4954-ae9b-cc5aa1e6e8f1 for instance e66a35db-d72f-47c8-957a-9663da1acbd9 on n-h1-846466-12 Aug 04 17:47:56.726729 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-923e45d4-2ecd-4737-a424-10e8b55ebf19 req-b0fbbc56-7f7a-4f23-a312-9ecb278188df service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036306 Aug 04 17:47:56.727897 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3429/6966] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:47:57.243927 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ea8aa74c-7d7c-4093-8dde-0c1ba2240368 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:47:57.244817 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ea8aa74c-7d7c-4093-8dde-0c1ba2240368 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:47:57.253501 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ea8aa74c-7d7c-4093-8dde-0c1ba2240368 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:57.254099 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ea8aa74c-7d7c-4093-8dde-0c1ba2240368 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:57.255524 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ea8aa74c-7d7c-4093-8dde-0c1ba2240368 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:57.256015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ea8aa74c-7d7c-4093-8dde-0c1ba2240368 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:57.398190 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ea8aa74c-7d7c-4093-8dde-0c1ba2240368 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:47:57.406695 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ea8aa74c-7d7c-4093-8dde-0c1ba2240368 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9" status: 200 len: 1391 microversion: 2.1 time: 0.166722 Aug 04 17:47:57.407436 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3538/6967] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:47:57 2022] GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:47:58.429896 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9908e292-d949-45a5-9c37-b49a4b66efff tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:47:58.431245 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9908e292-d949-45a5-9c37-b49a4b66efff tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:47:58.438978 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9908e292-d949-45a5-9c37-b49a4b66efff tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:58.439432 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9908e292-d949-45a5-9c37-b49a4b66efff tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:58.440212 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9908e292-d949-45a5-9c37-b49a4b66efff tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:58.440766 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9908e292-d949-45a5-9c37-b49a4b66efff tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:58.590800 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9908e292-d949-45a5-9c37-b49a4b66efff tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:47:58.598977 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9908e292-d949-45a5-9c37-b49a4b66efff tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9" status: 200 len: 1391 microversion: 2.1 time: 0.174639 Aug 04 17:47:58.599565 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3430/6968] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:47:58 2022] GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9 => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:47:59.621516 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5a32f671-1bf3-433e-add1-ba2e824c8e1f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:47:59.622137 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5a32f671-1bf3-433e-add1-ba2e824c8e1f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:47:59.629981 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5a32f671-1bf3-433e-add1-ba2e824c8e1f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:59.630492 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5a32f671-1bf3-433e-add1-ba2e824c8e1f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:59.631224 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5a32f671-1bf3-433e-add1-ba2e824c8e1f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:47:59.631668 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5a32f671-1bf3-433e-add1-ba2e824c8e1f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:47:59.787619 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5a32f671-1bf3-433e-add1-ba2e824c8e1f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:47:59.797306 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5a32f671-1bf3-433e-add1-ba2e824c8e1f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9" status: 200 len: 1391 microversion: 2.1 time: 0.180486 Aug 04 17:47:59.798010 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3539/6969] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:47:59 2022] GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9 => generated 1391 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:00.822241 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d4d7e759-5927-4af3-8ea2-601c8c17657c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:00.822843 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d4d7e759-5927-4af3-8ea2-601c8c17657c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:00.830713 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d4d7e759-5927-4af3-8ea2-601c8c17657c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:00.831162 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d4d7e759-5927-4af3-8ea2-601c8c17657c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:00.831941 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d4d7e759-5927-4af3-8ea2-601c8c17657c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:00.832384 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d4d7e759-5927-4af3-8ea2-601c8c17657c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:00.995645 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d4d7e759-5927-4af3-8ea2-601c8c17657c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:01.003708 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d4d7e759-5927-4af3-8ea2-601c8c17657c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9" status: 200 len: 1391 microversion: 2.1 time: 0.187400 Aug 04 17:48:01.004300 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3431/6970] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:00 2022] GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9 => generated 1391 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:01.542124 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-c373aac2-6d1d-4995-b112-b454f6466cd0 req-9f546e6d-0fde-4919-b136-a4c774a1c682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e66a35db-d72f-47c8-957a-9663da1acbd9", "name": "network-vif-plugged", "status": "completed", "tag": "62530f58-19f4-4954-ae9b-cc5aa1e6e8f1"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:48:01.555855 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-c373aac2-6d1d-4995-b112-b454f6466cd0 req-9f546e6d-0fde-4919-b136-a4c774a1c682 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:01.556621 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-c373aac2-6d1d-4995-b112-b454f6466cd0 req-9f546e6d-0fde-4919-b136-a4c774a1c682 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:01.570630 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-c373aac2-6d1d-4995-b112-b454f6466cd0 req-9f546e6d-0fde-4919-b136-a4c774a1c682 service nova] Creating event network-vif-plugged:62530f58-19f4-4954-ae9b-cc5aa1e6e8f1 for instance e66a35db-d72f-47c8-957a-9663da1acbd9 on n-h1-846466-12 Aug 04 17:48:01.576583 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-c373aac2-6d1d-4995-b112-b454f6466cd0 req-9f546e6d-0fde-4919-b136-a4c774a1c682 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039317 Aug 04 17:48:01.577230 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3540/6971] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:48:02.032252 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1d8386d8-7f6b-4fce-91e5-5778d02a54b5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:02.033154 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1d8386d8-7f6b-4fce-91e5-5778d02a54b5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:02.041894 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d8386d8-7f6b-4fce-91e5-5778d02a54b5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:02.042365 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d8386d8-7f6b-4fce-91e5-5778d02a54b5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:02.044045 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d8386d8-7f6b-4fce-91e5-5778d02a54b5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:02.044549 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1d8386d8-7f6b-4fce-91e5-5778d02a54b5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:02.195514 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1d8386d8-7f6b-4fce-91e5-5778d02a54b5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:02.204308 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1d8386d8-7f6b-4fce-91e5-5778d02a54b5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9" status: 200 len: 1391 microversion: 2.1 time: 0.176528 Aug 04 17:48:02.204903 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3432/6972] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:02 2022] GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9 => generated 1391 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:03.230795 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2519b9c1-e7ea-44a3-b1bb-ee417fbfa675 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:03.231616 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2519b9c1-e7ea-44a3-b1bb-ee417fbfa675 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:03.241412 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2519b9c1-e7ea-44a3-b1bb-ee417fbfa675 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:03.241973 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2519b9c1-e7ea-44a3-b1bb-ee417fbfa675 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:03.242900 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2519b9c1-e7ea-44a3-b1bb-ee417fbfa675 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:03.243426 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2519b9c1-e7ea-44a3-b1bb-ee417fbfa675 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:03.403522 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2519b9c1-e7ea-44a3-b1bb-ee417fbfa675 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:03.415655 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2519b9c1-e7ea-44a3-b1bb-ee417fbfa675 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9" status: 200 len: 1562 microversion: 2.1 time: 0.192908 Aug 04 17:48:03.416371 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3541/6973] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:03 2022] GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9 => generated 1562 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:48:03.440179 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1807bc2c-6ebc-4966-84cf-9c671ac3ea33 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:03.440803 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1807bc2c-6ebc-4966-84cf-9c671ac3ea33 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:03.444114 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:48:03.450573 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1807bc2c-6ebc-4966-84cf-9c671ac3ea33 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:03.451093 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1807bc2c-6ebc-4966-84cf-9c671ac3ea33 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:03.451882 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1807bc2c-6ebc-4966-84cf-9c671ac3ea33 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:03.452391 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1807bc2c-6ebc-4966-84cf-9c671ac3ea33 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:03.626246 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1807bc2c-6ebc-4966-84cf-9c671ac3ea33 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:03.634991 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1807bc2c-6ebc-4966-84cf-9c671ac3ea33 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9" status: 200 len: 1562 microversion: 2.1 time: 0.199197 Aug 04 17:48:03.635579 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3433/6974] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:03 2022] GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9 => generated 1562 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:05.606580 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-75bf0ad5-ac73-46b5-bb2c-11a5442129b1 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:05.607176 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-fb462fd4-d1b5-423c-82e2-cdf9f28155db req-feeb7aad-9c51-466f-8eee-7620ecd81cea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e66a35db-d72f-47c8-957a-9663da1acbd9", "tag": "62530f58-19f4-4954-ae9b-cc5aa1e6e8f1"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:48:05.607548 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-75bf0ad5-ac73-46b5-bb2c-11a5442129b1 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:05.609637 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:48:05.612919 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:48:05.614031 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:48:05.619351 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-75bf0ad5-ac73-46b5-bb2c-11a5442129b1 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:05.620108 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-75bf0ad5-ac73-46b5-bb2c-11a5442129b1 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:05.620978 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-75bf0ad5-ac73-46b5-bb2c-11a5442129b1 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:05.621966 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-75bf0ad5-ac73-46b5-bb2c-11a5442129b1 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:05.623248 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-fb462fd4-d1b5-423c-82e2-cdf9f28155db req-feeb7aad-9c51-466f-8eee-7620ecd81cea service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:05.623695 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-fb462fd4-d1b5-423c-82e2-cdf9f28155db req-feeb7aad-9c51-466f-8eee-7620ecd81cea service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:05.636463 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-fb462fd4-d1b5-423c-82e2-cdf9f28155db req-feeb7aad-9c51-466f-8eee-7620ecd81cea service nova] Creating event network-changed:62530f58-19f4-4954-ae9b-cc5aa1e6e8f1 for instance e66a35db-d72f-47c8-957a-9663da1acbd9 on n-h1-846466-12 Aug 04 17:48:05.642316 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-fb462fd4-d1b5-423c-82e2-cdf9f28155db req-feeb7aad-9c51-466f-8eee-7620ecd81cea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039339 Aug 04 17:48:05.643262 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3434/6975] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:48:05.795826 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-75bf0ad5-ac73-46b5-bb2c-11a5442129b1 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:05.804954 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-75bf0ad5-ac73-46b5-bb2c-11a5442129b1 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9" status: 200 len: 1562 microversion: 2.1 time: 0.204072 Aug 04 17:48:05.814984 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3542/6976] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:05 2022] GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9 => generated 1562 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:31.099697 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:48:31.100603 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=36 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:48:31.105191 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0ece9c53-e767-4162-b20b-29fdea4bb7ca tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:48:31.107544 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0ece9c53-e767-4162-b20b-29fdea4bb7ca tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:31.114821 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0ece9c53-e767-4162-b20b-29fdea4bb7ca tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:31.115275 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0ece9c53-e767-4162-b20b-29fdea4bb7ca tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:31.116039 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0ece9c53-e767-4162-b20b-29fdea4bb7ca tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:31.116475 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0ece9c53-e767-4162-b20b-29fdea4bb7ca tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:31.170400 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0ece9c53-e767-4162-b20b-29fdea4bb7ca tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "POST /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9/action" status: 200 len: 24565 microversion: 2.1 time: 0.071960 Aug 04 17:48:31.171321 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3435/6977] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:48:31 2022] POST /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9/action => generated 24565 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:48:42.190660 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:48:42.191908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=32 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:48:42.197739 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d91b4ed9-2cd9-4570-b197-fc79060ea9da tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:48:42.207010 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d91b4ed9-2cd9-4570-b197-fc79060ea9da tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:42.207454 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d91b4ed9-2cd9-4570-b197-fc79060ea9da tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:42.232104 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d91b4ed9-2cd9-4570-b197-fc79060ea9da tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Going to try to stop instance {{(pid=126125) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 17:48:42.287454 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d91b4ed9-2cd9-4570-b197-fc79060ea9da tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "POST /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9/action" status: 202 len: 0 microversion: 2.1 time: 0.098450 Aug 04 17:48:42.288303 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3543/6978] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:48:42 2022] POST /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:48:42.304163 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-743eebb9-7ed6-4284-a394-41044af8a1d4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:42.304918 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-743eebb9-7ed6-4284-a394-41044af8a1d4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:42.308011 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:48:42.308690 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=4 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:48:42.316874 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-743eebb9-7ed6-4284-a394-41044af8a1d4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:42.317385 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-743eebb9-7ed6-4284-a394-41044af8a1d4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:42.318174 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-743eebb9-7ed6-4284-a394-41044af8a1d4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:42.318605 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-743eebb9-7ed6-4284-a394-41044af8a1d4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:42.488031 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-743eebb9-7ed6-4284-a394-41044af8a1d4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:42.500465 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-743eebb9-7ed6-4284-a394-41044af8a1d4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9" status: 200 len: 1691 microversion: 2.1 time: 0.204396 Aug 04 17:48:42.501045 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3436/6979] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:42 2022] GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9 => generated 1691 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:43.532616 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4aa092e5-881b-412f-88f1-d4306937b5be tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:43.533185 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4aa092e5-881b-412f-88f1-d4306937b5be tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:43.540857 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4aa092e5-881b-412f-88f1-d4306937b5be tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:43.541332 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4aa092e5-881b-412f-88f1-d4306937b5be tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:43.542093 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4aa092e5-881b-412f-88f1-d4306937b5be tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:43.542550 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4aa092e5-881b-412f-88f1-d4306937b5be tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:43.700345 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4aa092e5-881b-412f-88f1-d4306937b5be tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:43.709824 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4aa092e5-881b-412f-88f1-d4306937b5be tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9" status: 200 len: 1691 microversion: 2.1 time: 0.182488 Aug 04 17:48:43.710410 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3544/6980] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:43 2022] GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9 => generated 1691 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:44.733581 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-03534e19-bd85-4deb-bebc-993ea9ea445a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:44.734352 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-03534e19-bd85-4deb-bebc-993ea9ea445a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:44.744771 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03534e19-bd85-4deb-bebc-993ea9ea445a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:44.745320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03534e19-bd85-4deb-bebc-993ea9ea445a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:44.746423 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03534e19-bd85-4deb-bebc-993ea9ea445a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:44.747046 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03534e19-bd85-4deb-bebc-993ea9ea445a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:44.899941 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-03534e19-bd85-4deb-bebc-993ea9ea445a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:44.910236 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-03534e19-bd85-4deb-bebc-993ea9ea445a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9" status: 200 len: 1691 microversion: 2.1 time: 0.181641 Aug 04 17:48:44.910812 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3437/6981] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:44 2022] GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9 => generated 1691 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:45.933681 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d4a8ea5b-ab48-452f-b4f6-86b0bc303565 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:45.934621 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d4a8ea5b-ab48-452f-b4f6-86b0bc303565 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:45.943919 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d4a8ea5b-ab48-452f-b4f6-86b0bc303565 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:45.944535 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d4a8ea5b-ab48-452f-b4f6-86b0bc303565 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:45.945734 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d4a8ea5b-ab48-452f-b4f6-86b0bc303565 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:45.946369 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d4a8ea5b-ab48-452f-b4f6-86b0bc303565 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:46.099929 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d4a8ea5b-ab48-452f-b4f6-86b0bc303565 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:46.113254 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d4a8ea5b-ab48-452f-b4f6-86b0bc303565 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9" status: 200 len: 1691 microversion: 2.1 time: 0.184457 Aug 04 17:48:46.114210 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3545/6982] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:45 2022] GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9 => generated 1691 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:47.143035 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-017d5f10-d419-4dad-970d-219b19d5058a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:47.143980 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-017d5f10-d419-4dad-970d-219b19d5058a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:47.155259 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-017d5f10-d419-4dad-970d-219b19d5058a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:47.155948 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-017d5f10-d419-4dad-970d-219b19d5058a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:47.157159 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-017d5f10-d419-4dad-970d-219b19d5058a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:47.157690 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-017d5f10-d419-4dad-970d-219b19d5058a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:47.299597 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-017d5f10-d419-4dad-970d-219b19d5058a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:47.310857 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-017d5f10-d419-4dad-970d-219b19d5058a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9" status: 200 len: 1691 microversion: 2.1 time: 0.173586 Aug 04 17:48:47.311493 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3438/6983] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:47 2022] GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9 => generated 1691 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:48.339078 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f1412026-1f40-48f3-87ff-8797fea006cf tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:48.340052 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f1412026-1f40-48f3-87ff-8797fea006cf tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:48.349943 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f1412026-1f40-48f3-87ff-8797fea006cf tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:48.350379 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f1412026-1f40-48f3-87ff-8797fea006cf tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:48.351743 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f1412026-1f40-48f3-87ff-8797fea006cf tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:48.352362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f1412026-1f40-48f3-87ff-8797fea006cf tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:48.511761 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f1412026-1f40-48f3-87ff-8797fea006cf tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:48.520246 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f1412026-1f40-48f3-87ff-8797fea006cf tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9" status: 200 len: 1691 microversion: 2.1 time: 0.185478 Aug 04 17:48:48.520760 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3546/6984] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:48 2022] GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9 => generated 1691 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:49.546018 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-34a2511f-f252-4086-beaa-6319446ccb28 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:49.546586 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-34a2511f-f252-4086-beaa-6319446ccb28 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:49.554643 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-34a2511f-f252-4086-beaa-6319446ccb28 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:49.555141 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-34a2511f-f252-4086-beaa-6319446ccb28 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:49.555926 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-34a2511f-f252-4086-beaa-6319446ccb28 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:49.556365 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-34a2511f-f252-4086-beaa-6319446ccb28 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:49.718186 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-34a2511f-f252-4086-beaa-6319446ccb28 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:49.727230 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-34a2511f-f252-4086-beaa-6319446ccb28 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9" status: 200 len: 1691 microversion: 2.1 time: 0.187849 Aug 04 17:48:49.727808 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3439/6985] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:49 2022] GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9 => generated 1691 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:50.750580 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1a0c66d2-5f16-4b71-9451-dfdb58dd2bda tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:50.751213 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1a0c66d2-5f16-4b71-9451-dfdb58dd2bda tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:50.758657 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1a0c66d2-5f16-4b71-9451-dfdb58dd2bda tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:50.759101 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1a0c66d2-5f16-4b71-9451-dfdb58dd2bda tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:50.759876 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1a0c66d2-5f16-4b71-9451-dfdb58dd2bda tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:50.760303 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1a0c66d2-5f16-4b71-9451-dfdb58dd2bda tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:50.907870 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1a0c66d2-5f16-4b71-9451-dfdb58dd2bda tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:50.920751 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1a0c66d2-5f16-4b71-9451-dfdb58dd2bda tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9" status: 200 len: 1691 microversion: 2.1 time: 0.173937 Aug 04 17:48:50.921710 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3547/6986] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:50 2022] GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9 => generated 1691 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:51.944847 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-950e5aa7-2b09-4521-8360-ad19716f5eb4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:51.945520 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-950e5aa7-2b09-4521-8360-ad19716f5eb4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:51.952897 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-950e5aa7-2b09-4521-8360-ad19716f5eb4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:51.953383 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-950e5aa7-2b09-4521-8360-ad19716f5eb4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:51.954148 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-950e5aa7-2b09-4521-8360-ad19716f5eb4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:51.954582 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-950e5aa7-2b09-4521-8360-ad19716f5eb4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:52.099752 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-950e5aa7-2b09-4521-8360-ad19716f5eb4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:52.108006 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-950e5aa7-2b09-4521-8360-ad19716f5eb4 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9" status: 200 len: 1691 microversion: 2.1 time: 0.167341 Aug 04 17:48:52.108561 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3440/6987] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:51 2022] GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:53.138636 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5c76ba7a-baec-4138-96c9-2affd1e9cd73 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:53.139243 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5c76ba7a-baec-4138-96c9-2affd1e9cd73 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:53.146625 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5c76ba7a-baec-4138-96c9-2affd1e9cd73 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:53.147485 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5c76ba7a-baec-4138-96c9-2affd1e9cd73 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:53.148223 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5c76ba7a-baec-4138-96c9-2affd1e9cd73 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:53.148699 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5c76ba7a-baec-4138-96c9-2affd1e9cd73 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:53.296037 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5c76ba7a-baec-4138-96c9-2affd1e9cd73 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:53.304329 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5c76ba7a-baec-4138-96c9-2affd1e9cd73 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9" status: 200 len: 1691 microversion: 2.1 time: 0.169824 Aug 04 17:48:53.304933 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3548/6988] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:53 2022] GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9 => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:54.326855 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-eb7a377c-71aa-4efb-bf74-71e3ec481750 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:54.327534 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-eb7a377c-71aa-4efb-bf74-71e3ec481750 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:54.335262 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eb7a377c-71aa-4efb-bf74-71e3ec481750 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:54.335726 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eb7a377c-71aa-4efb-bf74-71e3ec481750 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:54.336490 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eb7a377c-71aa-4efb-bf74-71e3ec481750 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:54.337202 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eb7a377c-71aa-4efb-bf74-71e3ec481750 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:54.494401 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-eb7a377c-71aa-4efb-bf74-71e3ec481750 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:54.502903 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-eb7a377c-71aa-4efb-bf74-71e3ec481750 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9" status: 200 len: 1691 microversion: 2.1 time: 0.180357 Aug 04 17:48:54.503632 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3441/6989] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:54 2022] GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9 => generated 1691 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:55.532705 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-69b40491-c483-46d7-8368-d4e14f168489 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:55.533252 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-69b40491-c483-46d7-8368-d4e14f168489 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:55.540637 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-69b40491-c483-46d7-8368-d4e14f168489 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:55.541073 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-69b40491-c483-46d7-8368-d4e14f168489 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:55.541881 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-69b40491-c483-46d7-8368-d4e14f168489 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:55.542400 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-69b40491-c483-46d7-8368-d4e14f168489 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:55.688596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-69b40491-c483-46d7-8368-d4e14f168489 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:55.696316 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-69b40491-c483-46d7-8368-d4e14f168489 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9" status: 200 len: 1691 microversion: 2.1 time: 0.167736 Aug 04 17:48:55.696893 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3549/6990] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:55 2022] GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:56.718800 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3f01456e-bb32-4f0c-84ef-8113c2d009b1 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:56.719417 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3f01456e-bb32-4f0c-84ef-8113c2d009b1 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:56.726795 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3f01456e-bb32-4f0c-84ef-8113c2d009b1 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:56.727263 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3f01456e-bb32-4f0c-84ef-8113c2d009b1 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:56.728046 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3f01456e-bb32-4f0c-84ef-8113c2d009b1 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:56.728503 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3f01456e-bb32-4f0c-84ef-8113c2d009b1 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:56.889585 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3f01456e-bb32-4f0c-84ef-8113c2d009b1 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:56.898942 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3f01456e-bb32-4f0c-84ef-8113c2d009b1 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9" status: 200 len: 1691 microversion: 2.1 time: 0.184174 Aug 04 17:48:56.899513 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3442/6991] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:56 2022] GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9 => generated 1691 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:57.929171 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7169ac12-9880-4c67-a352-07deb789cec2 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:57.929906 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7169ac12-9880-4c67-a352-07deb789cec2 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:57.938184 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7169ac12-9880-4c67-a352-07deb789cec2 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:57.938647 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7169ac12-9880-4c67-a352-07deb789cec2 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:57.939389 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7169ac12-9880-4c67-a352-07deb789cec2 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:57.939818 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7169ac12-9880-4c67-a352-07deb789cec2 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:58.083883 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7169ac12-9880-4c67-a352-07deb789cec2 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:58.096093 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7169ac12-9880-4c67-a352-07deb789cec2 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9" status: 200 len: 1668 microversion: 2.1 time: 0.170619 Aug 04 17:48:58.096897 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3550/6992] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:57 2022] GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9 => generated 1668 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:59.195692 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7dd46cb6-eea5-4563-8c39-2407426a4a5e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:48:59.198809 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7dd46cb6-eea5-4563-8c39-2407426a4a5e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:59.209700 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7dd46cb6-eea5-4563-8c39-2407426a4a5e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:59.210314 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7dd46cb6-eea5-4563-8c39-2407426a4a5e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:59.211433 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7dd46cb6-eea5-4563-8c39-2407426a4a5e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:59.211979 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7dd46cb6-eea5-4563-8c39-2407426a4a5e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:59.284653 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7dd46cb6-eea5-4563-8c39-2407426a4a5e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "POST /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9/action" status: 200 len: 38342 microversion: 2.1 time: 0.095094 Aug 04 17:48:59.287397 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3443/6993] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:48:59 2022] POST /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9/action => generated 38342 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:48:59.298895 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d6965aac-06e7-469d-bd0c-5e44a77f6ec5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:48:59.306436 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d6965aac-06e7-469d-bd0c-5e44a77f6ec5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:59.306879 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d6965aac-06e7-469d-bd0c-5e44a77f6ec5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:59.330564 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d6965aac-06e7-469d-bd0c-5e44a77f6ec5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Going to try to start instance {{(pid=126125) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 17:48:59.385501 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d6965aac-06e7-469d-bd0c-5e44a77f6ec5 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "POST /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9/action" status: 202 len: 0 microversion: 2.1 time: 0.090316 Aug 04 17:48:59.386112 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3551/6994] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:48:59 2022] POST /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:48:59.396164 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0803a00f-3a7e-4a5b-a5a2-125e201f7b1a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:59.396869 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0803a00f-3a7e-4a5b-a5a2-125e201f7b1a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:59.405134 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0803a00f-3a7e-4a5b-a5a2-125e201f7b1a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:59.405626 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0803a00f-3a7e-4a5b-a5a2-125e201f7b1a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:59.406457 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0803a00f-3a7e-4a5b-a5a2-125e201f7b1a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:48:59.407037 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0803a00f-3a7e-4a5b-a5a2-125e201f7b1a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:48:59.565154 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0803a00f-3a7e-4a5b-a5a2-125e201f7b1a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:59.573530 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0803a00f-3a7e-4a5b-a5a2-125e201f7b1a tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9" status: 200 len: 1677 microversion: 2.1 time: 0.181763 Aug 04 17:48:59.574881 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3444/6995] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:59 2022] GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9 => generated 1677 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:49:00.597473 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a56cff57-d22a-46fc-af08-91f2315720a9 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:49:00.598216 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a56cff57-d22a-46fc-af08-91f2315720a9 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:49:00.605812 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a56cff57-d22a-46fc-af08-91f2315720a9 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:00.606546 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a56cff57-d22a-46fc-af08-91f2315720a9 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:00.607354 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a56cff57-d22a-46fc-af08-91f2315720a9 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:00.608398 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a56cff57-d22a-46fc-af08-91f2315720a9 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:00.756489 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a56cff57-d22a-46fc-af08-91f2315720a9 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:49:00.768061 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a56cff57-d22a-46fc-af08-91f2315720a9 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9" status: 200 len: 1681 microversion: 2.1 time: 0.175907 Aug 04 17:49:00.768766 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3552/6996] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:49:00 2022] GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9 => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:49:26.996785 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cb594adf-84e4-415b-9b0f-8ed84ccccf21 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:49:26.999972 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cb594adf-84e4-415b-9b0f-8ed84ccccf21 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:49:27.004484 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=18 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:49:27.005453 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=52 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:49:27.012651 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cb594adf-84e4-415b-9b0f-8ed84ccccf21 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:27.013102 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cb594adf-84e4-415b-9b0f-8ed84ccccf21 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:27.013917 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cb594adf-84e4-415b-9b0f-8ed84ccccf21 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:27.014354 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cb594adf-84e4-415b-9b0f-8ed84ccccf21 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:27.074782 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cb594adf-84e4-415b-9b0f-8ed84ccccf21 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "POST /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9/action" status: 200 len: 62874 microversion: 2.1 time: 0.083150 Aug 04 17:49:27.075469 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3445/6997] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:49:26 2022] POST /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9/action => generated 62874 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:49:34.367269 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8b84eaaa-8ce2-4701-ac16-be6ff7e76662 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:49:34.367874 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8b84eaaa-8ce2-4701-ac16-be6ff7e76662 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:49:34.370539 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=20 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:49:34.371396 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:49:34.379865 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8b84eaaa-8ce2-4701-ac16-be6ff7e76662 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:34.380658 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8b84eaaa-8ce2-4701-ac16-be6ff7e76662 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:34.381659 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8b84eaaa-8ce2-4701-ac16-be6ff7e76662 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:34.382248 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8b84eaaa-8ce2-4701-ac16-be6ff7e76662 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:34.411066 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8b84eaaa-8ce2-4701-ac16-be6ff7e76662 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:49:34.437392 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-aeb3ec96-f9c2-436e-8c24-d3c18bbf997b req-4ca5ff39-8505-48ad-a0b1-a05283e85ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e66a35db-d72f-47c8-957a-9663da1acbd9", "tag": "62530f58-19f4-4954-ae9b-cc5aa1e6e8f1"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:49:34.448773 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-aeb3ec96-f9c2-436e-8c24-d3c18bbf997b req-4ca5ff39-8505-48ad-a0b1-a05283e85ad5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:34.449394 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-aeb3ec96-f9c2-436e-8c24-d3c18bbf997b req-4ca5ff39-8505-48ad-a0b1-a05283e85ad5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:34.461573 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-aeb3ec96-f9c2-436e-8c24-d3c18bbf997b req-4ca5ff39-8505-48ad-a0b1-a05283e85ad5 service nova] Creating event network-changed:62530f58-19f4-4954-ae9b-cc5aa1e6e8f1 for instance e66a35db-d72f-47c8-957a-9663da1acbd9 on n-h1-846466-12 Aug 04 17:49:34.466704 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-aeb3ec96-f9c2-436e-8c24-d3c18bbf997b req-4ca5ff39-8505-48ad-a0b1-a05283e85ad5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100636 Aug 04 17:49:34.467511 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3446/6998] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:49:34.500893 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8b84eaaa-8ce2-4701-ac16-be6ff7e76662 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9" status: 204 len: 0 microversion: 2.1 time: 0.137695 Aug 04 17:49:34.505320 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3553/6999] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:49:34 2022] DELETE /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:49:34.511846 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9e2b2ae5-4110-47f1-9909-f9bf76b6105d tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:49:34.512607 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9e2b2ae5-4110-47f1-9909-f9bf76b6105d tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:49:34.520706 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e2b2ae5-4110-47f1-9909-f9bf76b6105d tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:34.521149 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e2b2ae5-4110-47f1-9909-f9bf76b6105d tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:34.521963 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e2b2ae5-4110-47f1-9909-f9bf76b6105d tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:34.522752 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9e2b2ae5-4110-47f1-9909-f9bf76b6105d tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:34.675113 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9e2b2ae5-4110-47f1-9909-f9bf76b6105d tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:49:34.683460 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9e2b2ae5-4110-47f1-9909-f9bf76b6105d tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9" status: 200 len: 1687 microversion: 2.1 time: 0.176117 Aug 04 17:49:34.684256 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3447/7000] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:49:34 2022] GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9 => generated 1687 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:49:35.707211 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5ab5a110-2448-4d75-b3f4-bf7aa2feb991 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:49:35.707776 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5ab5a110-2448-4d75-b3f4-bf7aa2feb991 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:49:35.715196 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ab5a110-2448-4d75-b3f4-bf7aa2feb991 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:35.715650 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ab5a110-2448-4d75-b3f4-bf7aa2feb991 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:35.716435 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ab5a110-2448-4d75-b3f4-bf7aa2feb991 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:35.716866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5ab5a110-2448-4d75-b3f4-bf7aa2feb991 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:35.878273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5ab5a110-2448-4d75-b3f4-bf7aa2feb991 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:49:35.886140 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5ab5a110-2448-4d75-b3f4-bf7aa2feb991 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9" status: 200 len: 1687 microversion: 2.1 time: 0.183809 Aug 04 17:49:35.886696 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3554/7001] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:49:35 2022] GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9 => generated 1687 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:49:36.634244 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-dbd33063-d323-4eaa-a41f-67fce2c1c829 req-476b987d-2da0-4e67-ad2e-61098e7fa716 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e66a35db-d72f-47c8-957a-9663da1acbd9", "name": "network-vif-deleted", "tag": "62530f58-19f4-4954-ae9b-cc5aa1e6e8f1"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:49:36.646802 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-dbd33063-d323-4eaa-a41f-67fce2c1c829 req-476b987d-2da0-4e67-ad2e-61098e7fa716 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:36.647789 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-dbd33063-d323-4eaa-a41f-67fce2c1c829 req-476b987d-2da0-4e67-ad2e-61098e7fa716 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:36.661082 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-dbd33063-d323-4eaa-a41f-67fce2c1c829 req-476b987d-2da0-4e67-ad2e-61098e7fa716 service nova] Creating event network-vif-deleted:62530f58-19f4-4954-ae9b-cc5aa1e6e8f1 for instance e66a35db-d72f-47c8-957a-9663da1acbd9 on n-h1-846466-12 Aug 04 17:49:36.666697 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-dbd33063-d323-4eaa-a41f-67fce2c1c829 req-476b987d-2da0-4e67-ad2e-61098e7fa716 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036139 Aug 04 17:49:36.667690 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3448/7002] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:49:36.909054 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dbd463ee-ca7f-4f6c-a819-f4ff5f95bfe7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:49:36.909662 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dbd463ee-ca7f-4f6c-a819-f4ff5f95bfe7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:49:36.917182 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dbd463ee-ca7f-4f6c-a819-f4ff5f95bfe7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:36.917717 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dbd463ee-ca7f-4f6c-a819-f4ff5f95bfe7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:36.918496 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dbd463ee-ca7f-4f6c-a819-f4ff5f95bfe7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:36.918950 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dbd463ee-ca7f-4f6c-a819-f4ff5f95bfe7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:36.953837 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dbd463ee-ca7f-4f6c-a819-f4ff5f95bfe7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:36.954305 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dbd463ee-ca7f-4f6c-a819-f4ff5f95bfe7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:36.954732 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-dbd463ee-ca7f-4f6c-a819-f4ff5f95bfe7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lazy-loading 'fault' on Instance uuid e66a35db-d72f-47c8-957a-9663da1acbd9 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:49:36.998618 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dbd463ee-ca7f-4f6c-a819-f4ff5f95bfe7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:49:37.006954 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dbd463ee-ca7f-4f6c-a819-f4ff5f95bfe7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9" status: 200 len: 1505 microversion: 2.1 time: 0.102468 Aug 04 17:49:37.007574 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3555/7003] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:49:36 2022] GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9 => generated 1505 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:49:38.033540 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a29b04bb-310c-4898-a1bc-8322d9023e71 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:49:38.034274 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a29b04bb-310c-4898-a1bc-8322d9023e71 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: e66a35db-d72f-47c8-957a-9663da1acbd9] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:49:38.041324 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a29b04bb-310c-4898-a1bc-8322d9023e71 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:38.041793 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a29b04bb-310c-4898-a1bc-8322d9023e71 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:38.042571 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a29b04bb-310c-4898-a1bc-8322d9023e71 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:38.043019 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a29b04bb-310c-4898-a1bc-8322d9023e71 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:38.058027 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-a29b04bb-310c-4898-a1bc-8322d9023e71 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] HTTP exception thrown: Instance e66a35db-d72f-47c8-957a-9663da1acbd9 could not be found. Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a29b04bb-310c-4898-a1bc-8322d9023e71 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Request method failure captured: Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9 HTTP/1.1 Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi7AUYxl_B7m1vSxbgIk1-lmBUtAUC3FieG1gEJ9GpQoBo_bCn-ZL3cuM6SWlZzV7WGRZWdwyMWqNkt77NBIbpSZwFdt-J-YRA4Zw2vE_lUfkP0eO6XnQW4b5p8QuudRRtMT3Ltdx4GiMtQBuU1yIToc97v7n6WszOki7v99fiq2wiYgc Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 1e1c6b45635949478b403b8b5db448c9 Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-888353230 Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1e1c6b45635949478b403b8b5db448c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1e1c6b45635949478b403b8b5db448c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1e1c6b45635949478b403b8b5db448c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1e1c6b45635949478b403b8b5db448c9"}]}] Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-TestNetworkAdvancedServerOps-888353230 Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 1e1c6b45635949478b403b8b5db448c9 Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-888353230 Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-TestNetworkAdvancedServerOps-888353230-project Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 34dd901ba58f407891c63ac17cff7750 Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-TestNetworkAdvancedServerOps-888353230-project Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance e66a35db-d72f-47c8-957a-9663da1acbd9 could not be found. Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'e66a35db-d72f-47c8-957a-9663da1acbd9'} Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e66a35db-d72f-47c8-957a-9663da1acbd9 could not be found. Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e66a35db-d72f-47c8-957a-9663da1acbd9 could not be found. Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:49:38.059690 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:49:38.064339 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:49:38.064339 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:49:38.064339 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:49:38.064339 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:49:38.064339 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:49:38.064339 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:49:38.064339 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e66a35db-d72f-47c8-957a-9663da1acbd9 could not be found. Aug 04 17:49:38.064339 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:49:38.064339 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a29b04bb-310c-4898-a1bc-8322d9023e71 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Returning 404 to user: Instance e66a35db-d72f-47c8-957a-9663da1acbd9 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:49:38.064339 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a29b04bb-310c-4898-a1bc-8322d9023e71 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9" status: 404 len: 111 microversion: 2.1 time: 0.034539 Aug 04 17:49:38.064339 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3449/7004] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:49:38 2022] GET /compute/v2.1/servers/e66a35db-d72f-47c8-957a-9663da1acbd9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:49:41.586589 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a221121a-af64-437d-aa79-aad9ae22a0d3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '.version_select at 0x7f7e77f87940>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:49:41.612762 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a221121a-af64-437d-aa79-aad9ae22a0d3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-844853923" status: 202 len: 0 microversion: 2.1 time: 0.030177 Aug 04 17:49:41.613772 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3556/7005] 10.222.0.23 () {58 vars in 1281 bytes} [Thu Aug 4 17:49:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-844853923 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:49:41.655500 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6e7fabf0-b355-4bbd-9c53-a2bf60bbe0c9 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Action: 'create', calling method: .version_select at 0x7f7e84b62160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1788839397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUI+PO7csFnCkNLmKQOZ9ymSE28tFdT8nmFD9Hlynif97xHv4hP5j/y+yk2x9gsRDyzCmGAtpyAYZCqJjv/koB4odmqcwKxc2JR6nY1wcFh1wUUEJmvuHNQlXkXSz133A=="}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:49:41.691021 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-6e7fabf0-b355-4bbd-9c53-a2bf60bbe0c9 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Getting quotas for project 1e1c6b45635949478b403b8b5db448c9. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:49:41.698160 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-6e7fabf0-b355-4bbd-9c53-a2bf60bbe0c9 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Getting quotas for user 34dd901ba58f407891c63ac17cff7750 and project 1e1c6b45635949478b403b8b5db448c9. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:49:41.729944 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6e7fabf0-b355-4bbd-9c53-a2bf60bbe0c9 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.079939 Aug 04 17:49:41.730704 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3450/7006] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 17:49:41 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:49:47.875164 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b1d244ce-9eb2-426e-b1d5-2442c317e99e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-692208980", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "networks": [{"uuid": "94da09df-a8f2-4cee-9874-e339a0931815"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1788839397", "security_groups": [{"name": "tempest-secgroup-smoke-598628823"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:49:47.888379 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:49:48.012064 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-b1d244ce-9eb2-426e-b1d5-2442c317e99e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] validate_networks() for [('94da09df-a8f2-4cee-9874-e339a0931815', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:49:48.516601 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b1d244ce-9eb2-426e-b1d5-2442c317e99e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:49:48.517020 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b1d244ce-9eb2-426e-b1d5-2442c317e99e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:49:48.517521 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b1d244ce-9eb2-426e-b1d5-2442c317e99e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:49:48.517937 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b1d244ce-9eb2-426e-b1d5-2442c317e99e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:49:48.518352 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b1d244ce-9eb2-426e-b1d5-2442c317e99e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:49:48.528725 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b1d244ce-9eb2-426e-b1d5-2442c317e99e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:48.529231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b1d244ce-9eb2-426e-b1d5-2442c317e99e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:48.530150 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b1d244ce-9eb2-426e-b1d5-2442c317e99e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:48.530459 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b1d244ce-9eb2-426e-b1d5-2442c317e99e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:48.550514 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-b1d244ce-9eb2-426e-b1d5-2442c317e99e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Getting quotas for project 1e1c6b45635949478b403b8b5db448c9. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:49:48.558839 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-b1d244ce-9eb2-426e-b1d5-2442c317e99e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Getting quotas for user 34dd901ba58f407891c63ac17cff7750 and project 1e1c6b45635949478b403b8b5db448c9. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:49:48.571911 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b1d244ce-9eb2-426e-b1d5-2442c317e99e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:49:48.574321 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b1d244ce-9eb2-426e-b1d5-2442c317e99e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 756e0e0d-2716-442d-a0cd-029bdb59eb35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:49:48.630115 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b1d244ce-9eb2-426e-b1d5-2442c317e99e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.759116 Aug 04 17:49:48.631177 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3557/7007] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:49:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:49:48.640742 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=16 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:49:48.647989 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-adb7f791-572e-4c93-b0ab-9c5811ea8012 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:49:48.648742 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-adb7f791-572e-4c93-b0ab-9c5811ea8012 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 756e0e0d-2716-442d-a0cd-029bdb59eb35] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:49:48.710230 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-adb7f791-572e-4c93-b0ab-9c5811ea8012 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:49:48.717677 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-adb7f791-572e-4c93-b0ab-9c5811ea8012 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35" status: 200 len: 1266 microversion: 2.1 time: 0.079000 Aug 04 17:49:48.718268 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3451/7008] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:49:48 2022] GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35 => generated 1266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:49:49.741347 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0eecb6b2-7df7-4059-a956-aee9a0339799 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:49:49.742660 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0eecb6b2-7df7-4059-a956-aee9a0339799 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 756e0e0d-2716-442d-a0cd-029bdb59eb35] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:49:49.752015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0eecb6b2-7df7-4059-a956-aee9a0339799 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:49.752781 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0eecb6b2-7df7-4059-a956-aee9a0339799 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:49.753611 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0eecb6b2-7df7-4059-a956-aee9a0339799 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:49.754199 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0eecb6b2-7df7-4059-a956-aee9a0339799 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:49.840698 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0eecb6b2-7df7-4059-a956-aee9a0339799 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:49:49.850253 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0eecb6b2-7df7-4059-a956-aee9a0339799 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35" status: 200 len: 1336 microversion: 2.1 time: 0.114037 Aug 04 17:49:49.851170 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3558/7009] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:49:49 2022] GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35 => generated 1336 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:49:50.873418 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d7913abc-419d-4013-a166-293a5fd43422 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:49:50.874054 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d7913abc-419d-4013-a166-293a5fd43422 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 756e0e0d-2716-442d-a0cd-029bdb59eb35] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:49:50.882169 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d7913abc-419d-4013-a166-293a5fd43422 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:50.882655 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d7913abc-419d-4013-a166-293a5fd43422 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:50.883433 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d7913abc-419d-4013-a166-293a5fd43422 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:50.883869 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d7913abc-419d-4013-a166-293a5fd43422 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:51.043245 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d7913abc-419d-4013-a166-293a5fd43422 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:49:51.052504 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d7913abc-419d-4013-a166-293a5fd43422 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35" status: 200 len: 1391 microversion: 2.1 time: 0.183424 Aug 04 17:49:51.053104 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3452/7010] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:49:50 2022] GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35 => generated 1391 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:49:51.186984 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-88037cf5-f449-42c6-9739-1498215f959d req-5b0cb069-01ba-4937-98cd-6ddcad5e0134 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "756e0e0d-2716-442d-a0cd-029bdb59eb35", "tag": "bcc8acc3-d44d-42c1-af6b-7776338504b1"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:49:51.199280 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-88037cf5-f449-42c6-9739-1498215f959d req-5b0cb069-01ba-4937-98cd-6ddcad5e0134 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:51.199716 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-88037cf5-f449-42c6-9739-1498215f959d req-5b0cb069-01ba-4937-98cd-6ddcad5e0134 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:51.212152 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-88037cf5-f449-42c6-9739-1498215f959d req-5b0cb069-01ba-4937-98cd-6ddcad5e0134 service nova] Creating event network-changed:bcc8acc3-d44d-42c1-af6b-7776338504b1 for instance 756e0e0d-2716-442d-a0cd-029bdb59eb35 on n-h2-846466-12 Aug 04 17:49:51.217419 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-88037cf5-f449-42c6-9739-1498215f959d req-5b0cb069-01ba-4937-98cd-6ddcad5e0134 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034500 Aug 04 17:49:51.218003 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3559/7011] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:49:52.074590 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-36c0f8a2-fab9-47a9-a5ae-6f62e5ac2c4b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:49:52.075176 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-36c0f8a2-fab9-47a9-a5ae-6f62e5ac2c4b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 756e0e0d-2716-442d-a0cd-029bdb59eb35] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:49:52.083634 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-36c0f8a2-fab9-47a9-a5ae-6f62e5ac2c4b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:52.084023 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-36c0f8a2-fab9-47a9-a5ae-6f62e5ac2c4b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:52.084809 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-36c0f8a2-fab9-47a9-a5ae-6f62e5ac2c4b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:52.085254 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-36c0f8a2-fab9-47a9-a5ae-6f62e5ac2c4b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:52.231165 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-36c0f8a2-fab9-47a9-a5ae-6f62e5ac2c4b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:49:52.240333 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-36c0f8a2-fab9-47a9-a5ae-6f62e5ac2c4b tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35" status: 200 len: 1391 microversion: 2.1 time: 0.169776 Aug 04 17:49:52.240930 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3453/7012] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:49:52 2022] GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35 => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:49:53.267112 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a7c253d4-1459-443a-ac0a-6905ba9a981e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:49:53.267949 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a7c253d4-1459-443a-ac0a-6905ba9a981e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 756e0e0d-2716-442d-a0cd-029bdb59eb35] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:49:53.275178 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a7c253d4-1459-443a-ac0a-6905ba9a981e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:53.275820 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a7c253d4-1459-443a-ac0a-6905ba9a981e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:53.276380 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a7c253d4-1459-443a-ac0a-6905ba9a981e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:53.276807 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a7c253d4-1459-443a-ac0a-6905ba9a981e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:53.434205 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a7c253d4-1459-443a-ac0a-6905ba9a981e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:49:53.443004 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a7c253d4-1459-443a-ac0a-6905ba9a981e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35" status: 200 len: 1391 microversion: 2.1 time: 0.181493 Aug 04 17:49:53.443931 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3560/7013] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:49:53 2022] GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35 => generated 1391 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:49:54.464539 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3d36fcfb-3317-4967-9d3c-a8c4224af883 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:49:54.465502 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3d36fcfb-3317-4967-9d3c-a8c4224af883 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 756e0e0d-2716-442d-a0cd-029bdb59eb35] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:49:54.474167 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3d36fcfb-3317-4967-9d3c-a8c4224af883 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:54.474631 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3d36fcfb-3317-4967-9d3c-a8c4224af883 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:54.475473 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3d36fcfb-3317-4967-9d3c-a8c4224af883 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:54.476497 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3d36fcfb-3317-4967-9d3c-a8c4224af883 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:54.635093 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3d36fcfb-3317-4967-9d3c-a8c4224af883 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:49:54.643945 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3d36fcfb-3317-4967-9d3c-a8c4224af883 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35" status: 200 len: 1391 microversion: 2.1 time: 0.183477 Aug 04 17:49:54.644509 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3454/7014] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:49:54 2022] GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35 => generated 1391 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:49:55.665957 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-503728a9-2e14-4b38-8c9f-9cc15f612589 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:49:55.666628 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-503728a9-2e14-4b38-8c9f-9cc15f612589 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 756e0e0d-2716-442d-a0cd-029bdb59eb35] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:49:55.676300 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-503728a9-2e14-4b38-8c9f-9cc15f612589 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:55.676815 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-503728a9-2e14-4b38-8c9f-9cc15f612589 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:55.677961 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-503728a9-2e14-4b38-8c9f-9cc15f612589 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:55.678596 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-503728a9-2e14-4b38-8c9f-9cc15f612589 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:55.842770 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-503728a9-2e14-4b38-8c9f-9cc15f612589 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:49:55.851661 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-503728a9-2e14-4b38-8c9f-9cc15f612589 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35" status: 200 len: 1391 microversion: 2.1 time: 0.189595 Aug 04 17:49:55.852260 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3561/7015] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:49:55 2022] GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35 => generated 1391 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:49:56.470725 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-cdd43086-0bcd-4736-a96b-3bd1f969dd19 req-289a8e36-034d-4b27-90d9-32ea63a2abb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "756e0e0d-2716-442d-a0cd-029bdb59eb35", "name": "network-vif-plugged", "status": "completed", "tag": "bcc8acc3-d44d-42c1-af6b-7776338504b1"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:49:56.482281 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-cdd43086-0bcd-4736-a96b-3bd1f969dd19 req-289a8e36-034d-4b27-90d9-32ea63a2abb0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:56.482767 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-cdd43086-0bcd-4736-a96b-3bd1f969dd19 req-289a8e36-034d-4b27-90d9-32ea63a2abb0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:56.496955 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-cdd43086-0bcd-4736-a96b-3bd1f969dd19 req-289a8e36-034d-4b27-90d9-32ea63a2abb0 service nova] Creating event network-vif-plugged:bcc8acc3-d44d-42c1-af6b-7776338504b1 for instance 756e0e0d-2716-442d-a0cd-029bdb59eb35 on n-h2-846466-12 Aug 04 17:49:56.502358 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-cdd43086-0bcd-4736-a96b-3bd1f969dd19 req-289a8e36-034d-4b27-90d9-32ea63a2abb0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035680 Aug 04 17:49:56.502938 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3455/7016] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:49:56.873539 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7108de4d-4fce-45d5-9a52-9740f1b06eaa tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:49:56.874142 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7108de4d-4fce-45d5-9a52-9740f1b06eaa tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 756e0e0d-2716-442d-a0cd-029bdb59eb35] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:49:56.881581 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7108de4d-4fce-45d5-9a52-9740f1b06eaa tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:56.882032 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7108de4d-4fce-45d5-9a52-9740f1b06eaa tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:56.882815 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7108de4d-4fce-45d5-9a52-9740f1b06eaa tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:56.883255 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7108de4d-4fce-45d5-9a52-9740f1b06eaa tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:57.030328 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7108de4d-4fce-45d5-9a52-9740f1b06eaa tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:49:57.038895 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7108de4d-4fce-45d5-9a52-9740f1b06eaa tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35" status: 200 len: 1391 microversion: 2.1 time: 0.169337 Aug 04 17:49:57.039475 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3562/7017] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:49:56 2022] GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35 => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:49:58.061497 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1328805f-7da8-43b0-b0eb-e3f9c8ab4561 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:49:58.062107 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1328805f-7da8-43b0-b0eb-e3f9c8ab4561 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 756e0e0d-2716-442d-a0cd-029bdb59eb35] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:49:58.065233 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:49:58.071863 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1328805f-7da8-43b0-b0eb-e3f9c8ab4561 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:58.072318 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1328805f-7da8-43b0-b0eb-e3f9c8ab4561 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:58.073190 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1328805f-7da8-43b0-b0eb-e3f9c8ab4561 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:58.073595 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1328805f-7da8-43b0-b0eb-e3f9c8ab4561 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:58.218178 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1328805f-7da8-43b0-b0eb-e3f9c8ab4561 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:49:58.226259 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1328805f-7da8-43b0-b0eb-e3f9c8ab4561 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35" status: 200 len: 1564 microversion: 2.1 time: 0.169266 Aug 04 17:49:58.226843 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3456/7018] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:49:58 2022] GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35 => generated 1564 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:49:58.248165 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-94f3b886-b7c8-4ca7-8407-3fcdc528ccc3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:49:58.249488 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-94f3b886-b7c8-4ca7-8407-3fcdc528ccc3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 756e0e0d-2716-442d-a0cd-029bdb59eb35] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:49:58.257669 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-94f3b886-b7c8-4ca7-8407-3fcdc528ccc3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:58.258146 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-94f3b886-b7c8-4ca7-8407-3fcdc528ccc3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:58.258908 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-94f3b886-b7c8-4ca7-8407-3fcdc528ccc3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:49:58.259362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-94f3b886-b7c8-4ca7-8407-3fcdc528ccc3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:49:58.411191 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-94f3b886-b7c8-4ca7-8407-3fcdc528ccc3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:49:58.419307 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-94f3b886-b7c8-4ca7-8407-3fcdc528ccc3 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35" status: 200 len: 1564 microversion: 2.1 time: 0.175065 Aug 04 17:49:58.419904 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3563/7019] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:49:58 2022] GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35 => generated 1564 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:50:00.144150 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c325ebcc-9a39-4d33-a064-e97e1cdc76ea tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:50:00.145060 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c325ebcc-9a39-4d33-a064-e97e1cdc76ea tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 756e0e0d-2716-442d-a0cd-029bdb59eb35] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:00.147875 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:50:00.154244 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-7f82a568-8ca9-4642-8df4-2c96a501c6c8 req-d632a90c-e61b-42de-b282-f01fb54c9aff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "756e0e0d-2716-442d-a0cd-029bdb59eb35", "tag": "bcc8acc3-d44d-42c1-af6b-7776338504b1"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:50:00.160640 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:50:00.164791 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:50:00.170036 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c325ebcc-9a39-4d33-a064-e97e1cdc76ea tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:00.170497 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c325ebcc-9a39-4d33-a064-e97e1cdc76ea tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:00.171285 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c325ebcc-9a39-4d33-a064-e97e1cdc76ea tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:00.171780 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c325ebcc-9a39-4d33-a064-e97e1cdc76ea tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:00.186550 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7f82a568-8ca9-4642-8df4-2c96a501c6c8 req-d632a90c-e61b-42de-b282-f01fb54c9aff service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:00.186994 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7f82a568-8ca9-4642-8df4-2c96a501c6c8 req-d632a90c-e61b-42de-b282-f01fb54c9aff service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:00.200372 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-7f82a568-8ca9-4642-8df4-2c96a501c6c8 req-d632a90c-e61b-42de-b282-f01fb54c9aff service nova] Creating event network-changed:bcc8acc3-d44d-42c1-af6b-7776338504b1 for instance 756e0e0d-2716-442d-a0cd-029bdb59eb35 on n-h2-846466-12 Aug 04 17:50:00.208548 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-7f82a568-8ca9-4642-8df4-2c96a501c6c8 req-d632a90c-e61b-42de-b282-f01fb54c9aff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057179 Aug 04 17:50:00.209225 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3564/7020] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:50:00.330635 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c325ebcc-9a39-4d33-a064-e97e1cdc76ea tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:50:00.338952 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c325ebcc-9a39-4d33-a064-e97e1cdc76ea tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35" status: 200 len: 1564 microversion: 2.1 time: 0.199246 Aug 04 17:50:00.349443 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3457/7021] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:50:00 2022] GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35 => generated 1564 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:50:21.642517 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fcb942d6-656d-49fc-83f4-0020e0fca720 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:50:21.643845 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fcb942d6-656d-49fc-83f4-0020e0fca720 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 756e0e0d-2716-442d-a0cd-029bdb59eb35] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:21.646799 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:50:21.647902 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=36 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:50:21.654634 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fcb942d6-656d-49fc-83f4-0020e0fca720 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:21.655233 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fcb942d6-656d-49fc-83f4-0020e0fca720 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:21.656251 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fcb942d6-656d-49fc-83f4-0020e0fca720 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:21.656723 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fcb942d6-656d-49fc-83f4-0020e0fca720 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:21.714295 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fcb942d6-656d-49fc-83f4-0020e0fca720 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "POST /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35/action" status: 200 len: 24565 microversion: 2.1 time: 0.076559 Aug 04 17:50:21.715292 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3565/7022] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:50:21 2022] POST /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35/action => generated 24565 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:50:32.765607 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1c349259-0b2b-4d94-8d47-21f23e6caf69 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:50:32.766246 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1c349259-0b2b-4d94-8d47-21f23e6caf69 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 756e0e0d-2716-442d-a0cd-029bdb59eb35] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:32.768519 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:50:32.769304 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=32 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:50:32.778504 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c349259-0b2b-4d94-8d47-21f23e6caf69 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:32.778957 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c349259-0b2b-4d94-8d47-21f23e6caf69 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:32.780396 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c349259-0b2b-4d94-8d47-21f23e6caf69 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:32.781177 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c349259-0b2b-4d94-8d47-21f23e6caf69 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:32.809661 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-1c349259-0b2b-4d94-8d47-21f23e6caf69 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lazy-loading 'flavor' on Instance uuid 756e0e0d-2716-442d-a0cd-029bdb59eb35 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:50:32.891508 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1c349259-0b2b-4d94-8d47-21f23e6caf69 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "POST /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35/action" status: 202 len: 0 microversion: 2.1 time: 0.130646 Aug 04 17:50:32.892208 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3458/7023] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:50:32 2022] POST /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:50:32.902197 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-958194d9-f657-4324-8f50-4218e407f55c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:50:32.903610 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-958194d9-f657-4324-8f50-4218e407f55c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 756e0e0d-2716-442d-a0cd-029bdb59eb35] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:32.907116 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=4 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:50:32.907922 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:50:32.915627 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-958194d9-f657-4324-8f50-4218e407f55c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:32.916211 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-958194d9-f657-4324-8f50-4218e407f55c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:32.917087 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-958194d9-f657-4324-8f50-4218e407f55c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:32.917637 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-958194d9-f657-4324-8f50-4218e407f55c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:33.081619 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-958194d9-f657-4324-8f50-4218e407f55c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:50:33.092715 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-958194d9-f657-4324-8f50-4218e407f55c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35" status: 200 len: 1690 microversion: 2.1 time: 0.195419 Aug 04 17:50:33.093343 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3566/7024] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:50:32 2022] GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35 => generated 1690 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:50:34.124816 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ff1dda2a-011d-4cbb-9c50-946ee2b1ea7c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:50:34.125570 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ff1dda2a-011d-4cbb-9c50-946ee2b1ea7c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 756e0e0d-2716-442d-a0cd-029bdb59eb35] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:34.132428 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ff1dda2a-011d-4cbb-9c50-946ee2b1ea7c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:34.132883 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ff1dda2a-011d-4cbb-9c50-946ee2b1ea7c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:34.133682 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ff1dda2a-011d-4cbb-9c50-946ee2b1ea7c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:34.134121 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ff1dda2a-011d-4cbb-9c50-946ee2b1ea7c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:34.296207 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-ff1dda2a-011d-4cbb-9c50-946ee2b1ea7c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:50:34.305203 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ff1dda2a-011d-4cbb-9c50-946ee2b1ea7c tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35" status: 200 len: 1673 microversion: 2.1 time: 0.186691 Aug 04 17:50:34.306001 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3459/7025] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:50:34 2022] GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35 => generated 1673 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:50:35.409267 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3c4d0fc6-fe2b-4231-a156-a67b58041d99 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:50:35.411526 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3c4d0fc6-fe2b-4231-a156-a67b58041d99 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 756e0e0d-2716-442d-a0cd-029bdb59eb35] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:35.420318 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3c4d0fc6-fe2b-4231-a156-a67b58041d99 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:35.420769 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3c4d0fc6-fe2b-4231-a156-a67b58041d99 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:35.421605 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3c4d0fc6-fe2b-4231-a156-a67b58041d99 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:35.422036 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3c4d0fc6-fe2b-4231-a156-a67b58041d99 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:35.475953 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3c4d0fc6-fe2b-4231-a156-a67b58041d99 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "POST /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35/action" status: 200 len: 38370 microversion: 2.1 time: 0.070081 Aug 04 17:50:35.477161 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3567/7026] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:50:35 2022] POST /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35/action => generated 38370 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:50:35.495178 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3010d5cf-0f9b-4804-84df-a22fa8fabf70 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:50:35.495877 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3010d5cf-0f9b-4804-84df-a22fa8fabf70 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 756e0e0d-2716-442d-a0cd-029bdb59eb35] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:35.503568 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3010d5cf-0f9b-4804-84df-a22fa8fabf70 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:35.504042 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3010d5cf-0f9b-4804-84df-a22fa8fabf70 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:35.504802 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3010d5cf-0f9b-4804-84df-a22fa8fabf70 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:35.505349 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3010d5cf-0f9b-4804-84df-a22fa8fabf70 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:35.581116 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3010d5cf-0f9b-4804-84df-a22fa8fabf70 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "POST /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35/action" status: 202 len: 0 microversion: 2.1 time: 0.092111 Aug 04 17:50:35.581718 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3460/7027] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:50:35 2022] POST /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:50:35.593223 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a1b65b5f-1085-445e-b2ae-ecf6ec9b3eed tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:50:35.593944 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a1b65b5f-1085-445e-b2ae-ecf6ec9b3eed tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 756e0e0d-2716-442d-a0cd-029bdb59eb35] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:35.602121 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a1b65b5f-1085-445e-b2ae-ecf6ec9b3eed tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:35.602818 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a1b65b5f-1085-445e-b2ae-ecf6ec9b3eed tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:35.603811 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a1b65b5f-1085-445e-b2ae-ecf6ec9b3eed tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:35.604261 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a1b65b5f-1085-445e-b2ae-ecf6ec9b3eed tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:35.752229 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a1b65b5f-1085-445e-b2ae-ecf6ec9b3eed tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:50:35.760618 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a1b65b5f-1085-445e-b2ae-ecf6ec9b3eed tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35" status: 200 len: 1679 microversion: 2.1 time: 0.171740 Aug 04 17:50:35.761317 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3568/7028] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:50:35 2022] GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:50:36.593622 n-d-846466-12 devstack@n-api.service[126126]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:50:36.594241 n-d-846466-12 devstack@n-api.service[126126]: Thu Aug 4 17:50:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 17:50:36.788039 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a1065801-b020-41af-946e-cb90968dc2aa tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:50:36.788645 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a1065801-b020-41af-946e-cb90968dc2aa tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 756e0e0d-2716-442d-a0cd-029bdb59eb35] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:36.795367 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a1065801-b020-41af-946e-cb90968dc2aa tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:36.795886 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a1065801-b020-41af-946e-cb90968dc2aa tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:36.796705 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a1065801-b020-41af-946e-cb90968dc2aa tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:36.797631 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a1065801-b020-41af-946e-cb90968dc2aa tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:37.288302 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a1065801-b020-41af-946e-cb90968dc2aa tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:50:37.296592 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a1065801-b020-41af-946e-cb90968dc2aa tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35" status: 200 len: 1679 microversion: 2.1 time: 0.514683 Aug 04 17:50:37.297983 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3461/7029] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:50:36 2022] GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35 => generated 1679 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:50:38.322453 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-01ea4814-ab71-4b9c-81f4-7246208f1ce7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:50:38.323261 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-01ea4814-ab71-4b9c-81f4-7246208f1ce7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 756e0e0d-2716-442d-a0cd-029bdb59eb35] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:38.332193 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-01ea4814-ab71-4b9c-81f4-7246208f1ce7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:38.332646 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-01ea4814-ab71-4b9c-81f4-7246208f1ce7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:38.333510 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-01ea4814-ab71-4b9c-81f4-7246208f1ce7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:38.333980 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-01ea4814-ab71-4b9c-81f4-7246208f1ce7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:38.554313 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-01ea4814-ab71-4b9c-81f4-7246208f1ce7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:50:38.566375 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-01ea4814-ab71-4b9c-81f4-7246208f1ce7 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35" status: 200 len: 1682 microversion: 2.1 time: 0.247833 Aug 04 17:50:38.567402 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3569/7030] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:50:38 2022] GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35 => generated 1682 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:50:38.684784 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-4939c701-6e97-421a-91ff-fdc87f004a93 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:50:38.687028 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-4939c701-6e97-421a-91ff-fdc87f004a93 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 756e0e0d-2716-442d-a0cd-029bdb59eb35] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:38.693693 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4939c701-6e97-421a-91ff-fdc87f004a93 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:38.694146 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4939c701-6e97-421a-91ff-fdc87f004a93 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:38.694923 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4939c701-6e97-421a-91ff-fdc87f004a93 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:38.695365 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-4939c701-6e97-421a-91ff-fdc87f004a93 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:38.738768 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-4939c701-6e97-421a-91ff-fdc87f004a93 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "POST /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35/action" status: 200 len: 38370 microversion: 2.1 time: 0.058643 Aug 04 17:50:38.739413 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3462/7031] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:50:38 2022] POST /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35/action => generated 38370 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:50:39.826023 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f3caa2bb-caa1-4712-aa76-90e021affca9 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:50:39.827462 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f3caa2bb-caa1-4712-aa76-90e021affca9 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 756e0e0d-2716-442d-a0cd-029bdb59eb35] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:39.829863 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-5f9cb243-5a83-4620-8e7b-6cfedc5ab803 req-ab982685-2bb3-46d4-92f5-3bf1d1e343de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "756e0e0d-2716-442d-a0cd-029bdb59eb35", "tag": "bcc8acc3-d44d-42c1-af6b-7776338504b1"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:50:39.840433 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3caa2bb-caa1-4712-aa76-90e021affca9 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:39.841714 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3caa2bb-caa1-4712-aa76-90e021affca9 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:39.843262 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3caa2bb-caa1-4712-aa76-90e021affca9 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:39.844062 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3caa2bb-caa1-4712-aa76-90e021affca9 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:39.848868 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-5f9cb243-5a83-4620-8e7b-6cfedc5ab803 req-ab982685-2bb3-46d4-92f5-3bf1d1e343de service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:39.849663 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-5f9cb243-5a83-4620-8e7b-6cfedc5ab803 req-ab982685-2bb3-46d4-92f5-3bf1d1e343de service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:39.869941 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-5f9cb243-5a83-4620-8e7b-6cfedc5ab803 req-ab982685-2bb3-46d4-92f5-3bf1d1e343de service nova] Creating event network-changed:bcc8acc3-d44d-42c1-af6b-7776338504b1 for instance 756e0e0d-2716-442d-a0cd-029bdb59eb35 on n-h2-846466-12 Aug 04 17:50:39.878166 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-5f9cb243-5a83-4620-8e7b-6cfedc5ab803 req-ab982685-2bb3-46d4-92f5-3bf1d1e343de service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054913 Aug 04 17:50:39.879530 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3463/7032] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:50:39.889715 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f3caa2bb-caa1-4712-aa76-90e021affca9 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 756e0e0d-2716-442d-a0cd-029bdb59eb35] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:50:39.991121 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f3caa2bb-caa1-4712-aa76-90e021affca9 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "DELETE /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35" status: 204 len: 0 microversion: 2.1 time: 0.171064 Aug 04 17:50:39.996487 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3570/7033] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:50:39 2022] DELETE /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:50:40.002138 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-000aa1fc-c59f-4bf7-8141-ecef4637b3d2 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:50:40.002930 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-000aa1fc-c59f-4bf7-8141-ecef4637b3d2 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 756e0e0d-2716-442d-a0cd-029bdb59eb35] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:40.011629 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-000aa1fc-c59f-4bf7-8141-ecef4637b3d2 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:40.012139 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-000aa1fc-c59f-4bf7-8141-ecef4637b3d2 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:40.012983 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-000aa1fc-c59f-4bf7-8141-ecef4637b3d2 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:40.013672 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-000aa1fc-c59f-4bf7-8141-ecef4637b3d2 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:40.211052 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-000aa1fc-c59f-4bf7-8141-ecef4637b3d2 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:50:40.219410 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-000aa1fc-c59f-4bf7-8141-ecef4637b3d2 tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35" status: 200 len: 1688 microversion: 2.1 time: 0.222039 Aug 04 17:50:40.220132 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3464/7034] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:50:39 2022] GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35 => generated 1688 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:50:41.244150 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-935b8f63-fda8-4ec4-aa17-a787f5a8c87e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:50:41.245130 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-935b8f63-fda8-4ec4-aa17-a787f5a8c87e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 756e0e0d-2716-442d-a0cd-029bdb59eb35] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:41.252801 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-935b8f63-fda8-4ec4-aa17-a787f5a8c87e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:41.253249 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-935b8f63-fda8-4ec4-aa17-a787f5a8c87e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:41.254066 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-935b8f63-fda8-4ec4-aa17-a787f5a8c87e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:41.254463 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-935b8f63-fda8-4ec4-aa17-a787f5a8c87e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:41.400521 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-935b8f63-fda8-4ec4-aa17-a787f5a8c87e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:50:41.410456 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-935b8f63-fda8-4ec4-aa17-a787f5a8c87e tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35" status: 200 len: 1688 microversion: 2.1 time: 0.171537 Aug 04 17:50:41.411063 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3571/7035] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:50:41 2022] GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35 => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:50:42.050221 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-3d45daad-6e58-4e88-8f99-32725ae764d9 req-206256bf-b98f-4141-b500-7d813d436747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "756e0e0d-2716-442d-a0cd-029bdb59eb35", "name": "network-vif-deleted", "tag": "bcc8acc3-d44d-42c1-af6b-7776338504b1"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:50:42.062453 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-3d45daad-6e58-4e88-8f99-32725ae764d9 req-206256bf-b98f-4141-b500-7d813d436747 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:42.062981 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-3d45daad-6e58-4e88-8f99-32725ae764d9 req-206256bf-b98f-4141-b500-7d813d436747 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:42.074528 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-3d45daad-6e58-4e88-8f99-32725ae764d9 req-206256bf-b98f-4141-b500-7d813d436747 service nova] Creating event network-vif-deleted:bcc8acc3-d44d-42c1-af6b-7776338504b1 for instance 756e0e0d-2716-442d-a0cd-029bdb59eb35 on n-h2-846466-12 Aug 04 17:50:42.079648 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-3d45daad-6e58-4e88-8f99-32725ae764d9 req-206256bf-b98f-4141-b500-7d813d436747 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033461 Aug 04 17:50:42.080260 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3465/7036] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:50:42.433738 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cbf4c35e-416e-44c6-a337-ce970c9461ef tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:50:42.434474 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cbf4c35e-416e-44c6-a337-ce970c9461ef tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 756e0e0d-2716-442d-a0cd-029bdb59eb35] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:42.443231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cbf4c35e-416e-44c6-a337-ce970c9461ef tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:42.443815 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cbf4c35e-416e-44c6-a337-ce970c9461ef tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:42.444707 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cbf4c35e-416e-44c6-a337-ce970c9461ef tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:42.445503 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cbf4c35e-416e-44c6-a337-ce970c9461ef tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:42.487236 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cbf4c35e-416e-44c6-a337-ce970c9461ef tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:42.487963 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cbf4c35e-416e-44c6-a337-ce970c9461ef tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:42.488683 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-cbf4c35e-416e-44c6-a337-ce970c9461ef tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lazy-loading 'fault' on Instance uuid 756e0e0d-2716-442d-a0cd-029bdb59eb35 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:50:42.537525 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cbf4c35e-416e-44c6-a337-ce970c9461ef tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dd901ba58f407891c63ac17cff7750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b45635949478b403b8b5db448c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:50:42.545868 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cbf4c35e-416e-44c6-a337-ce970c9461ef tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35" status: 200 len: 1356 microversion: 2.1 time: 0.117546 Aug 04 17:50:42.547221 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3572/7037] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:50:42 2022] GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35 => generated 1356 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:50:43.571939 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5e56ade6-f154-4156-9d48-e43c9ee05b7f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:50:43.572723 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5e56ade6-f154-4156-9d48-e43c9ee05b7f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] [instance: 756e0e0d-2716-442d-a0cd-029bdb59eb35] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:43.583864 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e56ade6-f154-4156-9d48-e43c9ee05b7f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:43.585152 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e56ade6-f154-4156-9d48-e43c9ee05b7f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:43.586340 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e56ade6-f154-4156-9d48-e43c9ee05b7f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:50:43.586993 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-5e56ade6-f154-4156-9d48-e43c9ee05b7f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:50:43.610178 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-5e56ade6-f154-4156-9d48-e43c9ee05b7f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] HTTP exception thrown: Instance 756e0e0d-2716-442d-a0cd-029bdb59eb35 could not be found. Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5e56ade6-f154-4156-9d48-e43c9ee05b7f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Request method failure captured: Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35 HTTP/1.1 Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi7AUYxl_B7m1vSxbgIk1-lmBUtAUC3FieG1gEJ9GpQoBo_bCn-ZL3cuM6SWlZzV7WGRZWdwyMWqNkt77NBIbpSZwFdt-J-YRA4Zw2vE_lUfkP0eO6XnQW4b5p8QuudRRtMT3Ltdx4GiMtQBuU1yIToc97v7n6WszOki7v99fiq2wiYgc Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 1e1c6b45635949478b403b8b5db448c9 Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-888353230 Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1e1c6b45635949478b403b8b5db448c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1e1c6b45635949478b403b8b5db448c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1e1c6b45635949478b403b8b5db448c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1e1c6b45635949478b403b8b5db448c9"}]}] Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-TestNetworkAdvancedServerOps-888353230 Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 1e1c6b45635949478b403b8b5db448c9 Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-888353230 Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-TestNetworkAdvancedServerOps-888353230-project Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 34dd901ba58f407891c63ac17cff7750 Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-TestNetworkAdvancedServerOps-888353230-project Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 756e0e0d-2716-442d-a0cd-029bdb59eb35 could not be found. Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '756e0e0d-2716-442d-a0cd-029bdb59eb35'} Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 756e0e0d-2716-442d-a0cd-029bdb59eb35 could not be found. Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 756e0e0d-2716-442d-a0cd-029bdb59eb35 could not be found. Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:50:43.611875 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:50:43.617186 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:50:43.617186 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:50:43.617186 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:50:43.617186 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:50:43.617186 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:50:43.617186 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:50:43.617186 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 756e0e0d-2716-442d-a0cd-029bdb59eb35 could not be found. Aug 04 17:50:43.617186 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:50:43.617186 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5e56ade6-f154-4156-9d48-e43c9ee05b7f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Returning 404 to user: Instance 756e0e0d-2716-442d-a0cd-029bdb59eb35 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:50:43.617186 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5e56ade6-f154-4156-9d48-e43c9ee05b7f tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35" status: 404 len: 111 microversion: 2.1 time: 0.048448 Aug 04 17:50:43.617186 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3466/7038] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:50:43 2022] GET /compute/v2.1/servers/756e0e0d-2716-442d-a0cd-029bdb59eb35 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:50:47.140081 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b1d70e3b-554c-44ae-a7e0-0f0917379fdb tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] Calling method '.version_select at 0x7f7e770089d0>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:50:47.170260 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b1d70e3b-554c-44ae-a7e0-0f0917379fdb tempest-TestNetworkAdvancedServerOps-888353230 tempest-TestNetworkAdvancedServerOps-888353230-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1788839397" status: 202 len: 0 microversion: 2.1 time: 0.034168 Aug 04 17:50:47.170867 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3573/7039] 10.222.0.23 () {58 vars in 1284 bytes} [Thu Aug 4 17:50:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1788839397 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:50:58.791101 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=18 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:50:58.792202 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:50:59.023391 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c2596aa7-77ef-4372-a448-91d2d22cc1e1 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Action: 'create', calling method: .version_select at 0x7f7e841b13a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-296685959", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFr+jVMQm3bHfrqvHMI4A1P3HjIhcDpI1K+e/3Ewt5Qc7xLylxK/dUzjPN+12j/fsYsV3Sk5CMKoNKfxsk3yKWSBpEbDZ4wu+DnC719bfP6h01TW6vpQDl8DIEX4Laq5tg=="}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:50:59.042876 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-c2596aa7-77ef-4372-a448-91d2d22cc1e1 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Getting quotas for project 7a49716b74ed4c8c8aed3322f2ddd702. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:50:59.048929 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-c2596aa7-77ef-4372-a448-91d2d22cc1e1 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Getting quotas for user 57d626d2e60945b6a0302ffd18f07267 and project 7a49716b74ed4c8c8aed3322f2ddd702. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:50:59.079381 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c2596aa7-77ef-4372-a448-91d2d22cc1e1 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.295001 Aug 04 17:50:59.080121 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3467/7040] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 17:50:58 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:51:00.203168 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-83cf66be-c963-48f3-a3e6-4ba1316ecd45 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1624317137", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-296685959", "security_groups": [{"name": "tempest-secgroup-smoke-2114571227"}], "networks": [{"uuid": "9b8403b3-e567-45a8-8f60-a863050799f0"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:51:00.214917 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:51:00.215680 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:51:00.325070 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-83cf66be-c963-48f3-a3e6-4ba1316ecd45 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] validate_networks() for [('9b8403b3-e567-45a8-8f60-a863050799f0', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:51:00.850924 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-83cf66be-c963-48f3-a3e6-4ba1316ecd45 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:51:00.851373 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-83cf66be-c963-48f3-a3e6-4ba1316ecd45 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:51:00.852135 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-83cf66be-c963-48f3-a3e6-4ba1316ecd45 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:51:00.852575 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-83cf66be-c963-48f3-a3e6-4ba1316ecd45 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:51:00.852976 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-83cf66be-c963-48f3-a3e6-4ba1316ecd45 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:51:00.863016 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-83cf66be-c963-48f3-a3e6-4ba1316ecd45 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:51:00.863436 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-83cf66be-c963-48f3-a3e6-4ba1316ecd45 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:51:00.864254 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-83cf66be-c963-48f3-a3e6-4ba1316ecd45 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:51:00.864683 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-83cf66be-c963-48f3-a3e6-4ba1316ecd45 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:51:00.883327 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-83cf66be-c963-48f3-a3e6-4ba1316ecd45 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Getting quotas for project 7a49716b74ed4c8c8aed3322f2ddd702. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:51:00.889160 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-83cf66be-c963-48f3-a3e6-4ba1316ecd45 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Getting quotas for user 57d626d2e60945b6a0302ffd18f07267 and project 7a49716b74ed4c8c8aed3322f2ddd702. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:51:00.902064 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-83cf66be-c963-48f3-a3e6-4ba1316ecd45 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:51:00.904443 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-83cf66be-c963-48f3-a3e6-4ba1316ecd45 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:51:00.954606 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-83cf66be-c963-48f3-a3e6-4ba1316ecd45 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.756305 Aug 04 17:51:00.955275 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3574/7041] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:51:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:51:00.967252 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0d2c25a8-dca1-44c0-bb65-c87cc7d54d4b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:00.967862 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0d2c25a8-dca1-44c0-bb65-c87cc7d54d4b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:01.032050 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-0d2c25a8-dca1-44c0-bb65-c87cc7d54d4b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:01.039788 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0d2c25a8-dca1-44c0-bb65-c87cc7d54d4b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1246 microversion: 2.1 time: 0.077392 Aug 04 17:51:01.040623 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3468/7042] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:00 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1246 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:02.060348 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-0233bc2b-d678-40bf-b4c7-2b0b9d381376 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:02.062308 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-0233bc2b-d678-40bf-b4c7-2b0b9d381376 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:02.071316 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0233bc2b-d678-40bf-b4c7-2b0b9d381376 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:51:02.071653 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0233bc2b-d678-40bf-b4c7-2b0b9d381376 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:51:02.072432 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0233bc2b-d678-40bf-b4c7-2b0b9d381376 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:51:02.072855 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-0233bc2b-d678-40bf-b4c7-2b0b9d381376 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:51:02.153444 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-0233bc2b-d678-40bf-b4c7-2b0b9d381376 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:02.162828 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-0233bc2b-d678-40bf-b4c7-2b0b9d381376 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1298 microversion: 2.1 time: 0.106375 Aug 04 17:51:02.164108 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3575/7043] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:02 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1298 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:03.184406 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a52a7000-1fe9-4d5f-9727-3b54d7d08a73 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:03.185190 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a52a7000-1fe9-4d5f-9727-3b54d7d08a73 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:03.192532 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a52a7000-1fe9-4d5f-9727-3b54d7d08a73 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:51:03.193005 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a52a7000-1fe9-4d5f-9727-3b54d7d08a73 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:51:03.193809 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a52a7000-1fe9-4d5f-9727-3b54d7d08a73 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:51:03.194253 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a52a7000-1fe9-4d5f-9727-3b54d7d08a73 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:51:03.376319 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a52a7000-1fe9-4d5f-9727-3b54d7d08a73 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:03.388348 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a52a7000-1fe9-4d5f-9727-3b54d7d08a73 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1372 microversion: 2.1 time: 0.207859 Aug 04 17:51:03.388876 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3469/7044] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:03 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1372 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:04.051464 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-af19d378-3061-4a13-bf4a-d56b7989d9d9 req-1390f9d0-6987-4e90-b401-a2920503b19a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21513c81-acbd-4352-a424-37a6bd8db02c", "tag": "009b7504-36dc-4083-8477-2ead95f9d305"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:51:04.061416 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-af19d378-3061-4a13-bf4a-d56b7989d9d9 req-1390f9d0-6987-4e90-b401-a2920503b19a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:51:04.061869 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-af19d378-3061-4a13-bf4a-d56b7989d9d9 req-1390f9d0-6987-4e90-b401-a2920503b19a service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:51:04.077254 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-af19d378-3061-4a13-bf4a-d56b7989d9d9 req-1390f9d0-6987-4e90-b401-a2920503b19a service nova] Creating event network-changed:009b7504-36dc-4083-8477-2ead95f9d305 for instance 21513c81-acbd-4352-a424-37a6bd8db02c on n-h1-846466-12 Aug 04 17:51:04.082608 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-af19d378-3061-4a13-bf4a-d56b7989d9d9 req-1390f9d0-6987-4e90-b401-a2920503b19a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106237 Aug 04 17:51:04.083204 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3576/7045] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:51:04.411671 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-66f893a9-2990-4799-858a-0ffce86a096f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:04.412817 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-66f893a9-2990-4799-858a-0ffce86a096f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:04.420468 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-66f893a9-2990-4799-858a-0ffce86a096f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:51:04.420943 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-66f893a9-2990-4799-858a-0ffce86a096f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:51:04.421748 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-66f893a9-2990-4799-858a-0ffce86a096f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:51:04.422193 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-66f893a9-2990-4799-858a-0ffce86a096f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:51:04.566200 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-66f893a9-2990-4799-858a-0ffce86a096f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:04.574397 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-66f893a9-2990-4799-858a-0ffce86a096f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1372 microversion: 2.1 time: 0.166690 Aug 04 17:51:04.577328 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3470/7046] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:04 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:05.597652 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-74e6f5e5-a2a2-4dc3-9a1e-760f84bb6187 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:05.598516 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-74e6f5e5-a2a2-4dc3-9a1e-760f84bb6187 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:05.605494 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-74e6f5e5-a2a2-4dc3-9a1e-760f84bb6187 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:51:05.605947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-74e6f5e5-a2a2-4dc3-9a1e-760f84bb6187 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:51:05.606967 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-74e6f5e5-a2a2-4dc3-9a1e-760f84bb6187 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:51:05.607406 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-74e6f5e5-a2a2-4dc3-9a1e-760f84bb6187 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:51:05.757902 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-74e6f5e5-a2a2-4dc3-9a1e-760f84bb6187 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:05.766649 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-74e6f5e5-a2a2-4dc3-9a1e-760f84bb6187 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1372 microversion: 2.1 time: 0.174381 Aug 04 17:51:05.767242 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3577/7047] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:05 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1372 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:06.790759 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c4ea399c-aaef-453e-a0cf-8bfb1a600392 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:06.791328 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c4ea399c-aaef-453e-a0cf-8bfb1a600392 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:06.799998 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4ea399c-aaef-453e-a0cf-8bfb1a600392 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:51:06.800453 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4ea399c-aaef-453e-a0cf-8bfb1a600392 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:51:06.801216 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4ea399c-aaef-453e-a0cf-8bfb1a600392 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:51:06.801689 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c4ea399c-aaef-453e-a0cf-8bfb1a600392 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:51:06.945799 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c4ea399c-aaef-453e-a0cf-8bfb1a600392 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:06.955469 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c4ea399c-aaef-453e-a0cf-8bfb1a600392 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1372 microversion: 2.1 time: 0.170722 Aug 04 17:51:06.956049 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3471/7048] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:06 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:07.979258 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e3dc8d8c-e4ec-4a5e-93f5-6c92fac713ea tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:07.979841 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e3dc8d8c-e4ec-4a5e-93f5-6c92fac713ea tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:07.987787 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3dc8d8c-e4ec-4a5e-93f5-6c92fac713ea tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:51:07.988228 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3dc8d8c-e4ec-4a5e-93f5-6c92fac713ea tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:51:07.988990 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3dc8d8c-e4ec-4a5e-93f5-6c92fac713ea tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:51:07.989452 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e3dc8d8c-e4ec-4a5e-93f5-6c92fac713ea tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:51:08.133850 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e3dc8d8c-e4ec-4a5e-93f5-6c92fac713ea tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:08.142443 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e3dc8d8c-e4ec-4a5e-93f5-6c92fac713ea tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1372 microversion: 2.1 time: 0.167130 Aug 04 17:51:08.143032 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3578/7049] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:07 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:09.165903 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cc7ec6d8-bb02-463e-a17f-b03ce7a26626 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:09.166963 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cc7ec6d8-bb02-463e-a17f-b03ce7a26626 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:09.177771 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cc7ec6d8-bb02-463e-a17f-b03ce7a26626 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:51:09.178258 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cc7ec6d8-bb02-463e-a17f-b03ce7a26626 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:51:09.179032 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cc7ec6d8-bb02-463e-a17f-b03ce7a26626 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:51:09.179485 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cc7ec6d8-bb02-463e-a17f-b03ce7a26626 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:51:09.367607 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cc7ec6d8-bb02-463e-a17f-b03ce7a26626 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:09.380138 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cc7ec6d8-bb02-463e-a17f-b03ce7a26626 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1372 microversion: 2.1 time: 0.216858 Aug 04 17:51:09.380761 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3472/7050] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:09 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1372 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:10.402607 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7895991f-b102-4525-b4d9-a19c553c4871 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:10.403208 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7895991f-b102-4525-b4d9-a19c553c4871 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:10.411242 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7895991f-b102-4525-b4d9-a19c553c4871 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:51:10.411696 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7895991f-b102-4525-b4d9-a19c553c4871 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:51:10.412470 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7895991f-b102-4525-b4d9-a19c553c4871 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:51:10.412910 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7895991f-b102-4525-b4d9-a19c553c4871 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:51:10.420023 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-0a57a4f8-8ff1-4844-b260-bd11957292eb req-cb7d67a8-edbe-4104-9171-da10b2611b08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21513c81-acbd-4352-a424-37a6bd8db02c", "name": "network-vif-plugged", "status": "completed", "tag": "009b7504-36dc-4083-8477-2ead95f9d305"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:51:10.432546 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-0a57a4f8-8ff1-4844-b260-bd11957292eb req-cb7d67a8-edbe-4104-9171-da10b2611b08 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:51:10.432928 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-0a57a4f8-8ff1-4844-b260-bd11957292eb req-cb7d67a8-edbe-4104-9171-da10b2611b08 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:51:10.447613 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-0a57a4f8-8ff1-4844-b260-bd11957292eb req-cb7d67a8-edbe-4104-9171-da10b2611b08 service nova] Creating event network-vif-plugged:009b7504-36dc-4083-8477-2ead95f9d305 for instance 21513c81-acbd-4352-a424-37a6bd8db02c on n-h1-846466-12 Aug 04 17:51:10.453322 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-0a57a4f8-8ff1-4844-b260-bd11957292eb req-cb7d67a8-edbe-4104-9171-da10b2611b08 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037118 Aug 04 17:51:10.453924 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3473/7051] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:51:10.571038 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7895991f-b102-4525-b4d9-a19c553c4871 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:10.579455 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7895991f-b102-4525-b4d9-a19c553c4871 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1372 microversion: 2.1 time: 0.180657 Aug 04 17:51:10.580291 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3579/7052] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:10 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1372 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:11.603837 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f09af4d0-560d-4f70-bf6f-0693695c14c5 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:11.604694 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f09af4d0-560d-4f70-bf6f-0693695c14c5 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:11.607434 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:51:11.616653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f09af4d0-560d-4f70-bf6f-0693695c14c5 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:51:11.617031 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f09af4d0-560d-4f70-bf6f-0693695c14c5 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:51:11.618173 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f09af4d0-560d-4f70-bf6f-0693695c14c5 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:51:11.618804 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f09af4d0-560d-4f70-bf6f-0693695c14c5 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:51:11.774330 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f09af4d0-560d-4f70-bf6f-0693695c14c5 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:11.783244 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f09af4d0-560d-4f70-bf6f-0693695c14c5 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1372 microversion: 2.1 time: 0.186145 Aug 04 17:51:11.783854 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3474/7053] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:11 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1372 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:12.807807 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-be3241e9-e10a-4fc1-8157-50ef6d624bd2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:12.808383 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-be3241e9-e10a-4fc1-8157-50ef6d624bd2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:12.811073 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:51:12.811942 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:51:12.820643 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be3241e9-e10a-4fc1-8157-50ef6d624bd2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:51:12.821089 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be3241e9-e10a-4fc1-8157-50ef6d624bd2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:51:12.821900 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be3241e9-e10a-4fc1-8157-50ef6d624bd2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:51:12.822335 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-be3241e9-e10a-4fc1-8157-50ef6d624bd2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:51:12.987735 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-be3241e9-e10a-4fc1-8157-50ef6d624bd2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:12.995648 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-be3241e9-e10a-4fc1-8157-50ef6d624bd2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1555 microversion: 2.1 time: 0.193438 Aug 04 17:51:12.996229 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3580/7054] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:12 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1555 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:13.016608 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7ffab6a1-5d97-4b3f-9c1d-ddcc9f9a90df tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:13.017236 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7ffab6a1-5d97-4b3f-9c1d-ddcc9f9a90df tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:13.025109 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7ffab6a1-5d97-4b3f-9c1d-ddcc9f9a90df tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:51:13.025597 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7ffab6a1-5d97-4b3f-9c1d-ddcc9f9a90df tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:51:13.026367 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7ffab6a1-5d97-4b3f-9c1d-ddcc9f9a90df tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:51:13.026810 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7ffab6a1-5d97-4b3f-9c1d-ddcc9f9a90df tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:51:13.184654 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7ffab6a1-5d97-4b3f-9c1d-ddcc9f9a90df tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:13.192605 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7ffab6a1-5d97-4b3f-9c1d-ddcc9f9a90df tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1555 microversion: 2.1 time: 0.180277 Aug 04 17:51:13.193440 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3475/7055] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:13 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1555 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:14.963550 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-ac5d02c9-0c03-4376-a7a9-9bb4b06d5348 req-8988cdeb-de5a-4fd6-b932-100d8f119ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21513c81-acbd-4352-a424-37a6bd8db02c", "tag": "009b7504-36dc-4083-8477-2ead95f9d305"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:51:14.974731 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-ac5d02c9-0c03-4376-a7a9-9bb4b06d5348 req-8988cdeb-de5a-4fd6-b932-100d8f119ac0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:51:14.975198 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-ac5d02c9-0c03-4376-a7a9-9bb4b06d5348 req-8988cdeb-de5a-4fd6-b932-100d8f119ac0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:51:14.987404 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-ac5d02c9-0c03-4376-a7a9-9bb4b06d5348 req-8988cdeb-de5a-4fd6-b932-100d8f119ac0 service nova] Creating event network-changed:009b7504-36dc-4083-8477-2ead95f9d305 for instance 21513c81-acbd-4352-a424-37a6bd8db02c on n-h1-846466-12 Aug 04 17:51:14.993104 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-ac5d02c9-0c03-4376-a7a9-9bb4b06d5348 req-8988cdeb-de5a-4fd6-b932-100d8f119ac0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033273 Aug 04 17:51:14.994563 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3581/7056] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:53:12.572953 n-d-846466-12 devstack@n-api.service[126126]: ERROR oslo.messaging._drivers.impl_rabbit [-] [37914f2f-7143-4f4b-83fb-439e96d93d23] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 17:53:12.573609 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:53:12.574261 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=38 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:53:12.578973 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-410552f4-1204-4e12-86fa-c185a6f83ac2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:53:12.579541 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-410552f4-1204-4e12-86fa-c185a6f83ac2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:12.588030 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-410552f4-1204-4e12-86fa-c185a6f83ac2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:12.588484 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-410552f4-1204-4e12-86fa-c185a6f83ac2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:12.589259 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-410552f4-1204-4e12-86fa-c185a6f83ac2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:12.589723 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-410552f4-1204-4e12-86fa-c185a6f83ac2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:12.616565 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-410552f4-1204-4e12-86fa-c185a6f83ac2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lazy-loading 'flavor' on Instance uuid 21513c81-acbd-4352-a424-37a6bd8db02c {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:53:12.831717 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-410552f4-1204-4e12-86fa-c185a6f83ac2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "POST /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c/action" status: 202 len: 0 microversion: 2.1 time: 0.260944 Aug 04 17:53:12.832256 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3476/7057] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:53:12 2022] POST /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:53:12.841136 n-d-846466-12 devstack@n-api.service[126125]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c495d468-47e4-4499-8c55-19f21dc1fcfb] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 17:53:12.842006 n-d-846466-12 devstack@n-api.service[126125]: ERROR oslo.messaging._drivers.impl_rabbit [-] [97b8321f-6d0d-4fc2-ae68-3784c532bfbe] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 17:53:12.842597 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:53:12.843432 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=36 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:53:12.848745 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-15ed06d3-0bc8-4375-9ec9-ab6e09b2dd7e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:12.849472 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-15ed06d3-0bc8-4375-9ec9-ab6e09b2dd7e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:12.858513 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-15ed06d3-0bc8-4375-9ec9-ab6e09b2dd7e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:12.858970 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-15ed06d3-0bc8-4375-9ec9-ab6e09b2dd7e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:12.859745 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-15ed06d3-0bc8-4375-9ec9-ab6e09b2dd7e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:12.860177 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-15ed06d3-0bc8-4375-9ec9-ab6e09b2dd7e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:13.018678 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-15ed06d3-0bc8-4375-9ec9-ab6e09b2dd7e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:13.028576 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-15ed06d3-0bc8-4375-9ec9-ab6e09b2dd7e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1679 microversion: 2.1 time: 0.189426 Aug 04 17:53:13.029146 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3582/7058] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:12 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1679 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:14.057094 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-9efdcd60-4988-4657-be17-22acc0a0a732 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:14.057868 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-9efdcd60-4988-4657-be17-22acc0a0a732 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:14.066770 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9efdcd60-4988-4657-be17-22acc0a0a732 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:14.067214 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9efdcd60-4988-4657-be17-22acc0a0a732 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:14.068001 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9efdcd60-4988-4657-be17-22acc0a0a732 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:14.068439 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-9efdcd60-4988-4657-be17-22acc0a0a732 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:14.074197 n-d-846466-12 devstack@n-api.service[126126]: INFO oslo.messaging._drivers.impl_rabbit [-] [37914f2f-7143-4f4b-83fb-439e96d93d23] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 39868. Aug 04 17:53:14.226793 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-9efdcd60-4988-4657-be17-22acc0a0a732 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:14.234896 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-9efdcd60-4988-4657-be17-22acc0a0a732 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1679 microversion: 2.1 time: 0.184294 Aug 04 17:53:14.235457 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3477/7059] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:14 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1679 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:15.256255 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-752c1c8b-a741-4e9d-a2f0-e8cfc291b716 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:15.256889 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-752c1c8b-a741-4e9d-a2f0-e8cfc291b716 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:15.266488 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-752c1c8b-a741-4e9d-a2f0-e8cfc291b716 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:15.266956 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-752c1c8b-a741-4e9d-a2f0-e8cfc291b716 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:15.267738 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-752c1c8b-a741-4e9d-a2f0-e8cfc291b716 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:15.268188 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-752c1c8b-a741-4e9d-a2f0-e8cfc291b716 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:15.294215 n-d-846466-12 devstack@n-api.service[126125]: INFO oslo.messaging._drivers.impl_rabbit [-] [97b8321f-6d0d-4fc2-ae68-3784c532bfbe] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 39874. Aug 04 17:53:15.294902 n-d-846466-12 devstack@n-api.service[126125]: INFO oslo.messaging._drivers.impl_rabbit [-] [c495d468-47e4-4499-8c55-19f21dc1fcfb] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 39872. Aug 04 17:53:15.423665 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-752c1c8b-a741-4e9d-a2f0-e8cfc291b716 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:15.433087 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-752c1c8b-a741-4e9d-a2f0-e8cfc291b716 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1679 microversion: 2.1 time: 0.181065 Aug 04 17:53:15.433731 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3583/7060] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:15 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:16.455083 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6e80f483-77ae-49dd-b22b-f07131cf36b8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:16.455777 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6e80f483-77ae-49dd-b22b-f07131cf36b8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:16.463570 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e80f483-77ae-49dd-b22b-f07131cf36b8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:16.464026 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e80f483-77ae-49dd-b22b-f07131cf36b8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:16.464805 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e80f483-77ae-49dd-b22b-f07131cf36b8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:16.465249 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6e80f483-77ae-49dd-b22b-f07131cf36b8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:16.605650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6e80f483-77ae-49dd-b22b-f07131cf36b8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:16.613711 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6e80f483-77ae-49dd-b22b-f07131cf36b8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1679 microversion: 2.1 time: 0.162633 Aug 04 17:53:16.614324 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3478/7061] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:16 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:17.644881 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-65323826-8bfc-4dab-b18d-3c0577dd1f1b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:17.645852 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-65323826-8bfc-4dab-b18d-3c0577dd1f1b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:17.654993 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-65323826-8bfc-4dab-b18d-3c0577dd1f1b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:17.655433 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-65323826-8bfc-4dab-b18d-3c0577dd1f1b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:17.656226 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-65323826-8bfc-4dab-b18d-3c0577dd1f1b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:17.656646 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-65323826-8bfc-4dab-b18d-3c0577dd1f1b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:17.802675 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-65323826-8bfc-4dab-b18d-3c0577dd1f1b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:17.812241 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-65323826-8bfc-4dab-b18d-3c0577dd1f1b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1679 microversion: 2.1 time: 0.173484 Aug 04 17:53:17.812820 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3584/7062] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:17 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:18.834017 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2dac6831-e71c-4a33-91fc-b59cb717eb91 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:18.834633 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2dac6831-e71c-4a33-91fc-b59cb717eb91 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:18.842534 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2dac6831-e71c-4a33-91fc-b59cb717eb91 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:18.842987 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2dac6831-e71c-4a33-91fc-b59cb717eb91 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:18.843752 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2dac6831-e71c-4a33-91fc-b59cb717eb91 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:18.844191 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2dac6831-e71c-4a33-91fc-b59cb717eb91 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:18.984725 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2dac6831-e71c-4a33-91fc-b59cb717eb91 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:18.995660 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2dac6831-e71c-4a33-91fc-b59cb717eb91 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1679 microversion: 2.1 time: 0.165687 Aug 04 17:53:18.996408 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3479/7063] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:18 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:20.016326 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dec77268-f3c4-4df4-88a9-655b6d2eb8d4 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:20.016936 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dec77268-f3c4-4df4-88a9-655b6d2eb8d4 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:20.026985 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dec77268-f3c4-4df4-88a9-655b6d2eb8d4 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:20.027513 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dec77268-f3c4-4df4-88a9-655b6d2eb8d4 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:20.028343 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dec77268-f3c4-4df4-88a9-655b6d2eb8d4 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:20.028759 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dec77268-f3c4-4df4-88a9-655b6d2eb8d4 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:20.181786 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dec77268-f3c4-4df4-88a9-655b6d2eb8d4 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:20.192316 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dec77268-f3c4-4df4-88a9-655b6d2eb8d4 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1679 microversion: 2.1 time: 0.179957 Aug 04 17:53:20.192912 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3585/7064] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:20 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1679 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:21.216378 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-13055f46-5144-47f3-a3c8-1f1c013ceb5e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:21.219427 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-13055f46-5144-47f3-a3c8-1f1c013ceb5e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:21.224503 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-13055f46-5144-47f3-a3c8-1f1c013ceb5e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:21.225111 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-13055f46-5144-47f3-a3c8-1f1c013ceb5e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:21.225969 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-13055f46-5144-47f3-a3c8-1f1c013ceb5e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:21.226408 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-13055f46-5144-47f3-a3c8-1f1c013ceb5e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:21.376436 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-13055f46-5144-47f3-a3c8-1f1c013ceb5e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:21.387541 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-13055f46-5144-47f3-a3c8-1f1c013ceb5e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1679 microversion: 2.1 time: 0.175231 Aug 04 17:53:21.388243 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3480/7065] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:21 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:22.414148 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-1afdfb00-b4bd-4d80-bf0a-3df741cebd2e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:22.414768 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-1afdfb00-b4bd-4d80-bf0a-3df741cebd2e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:22.422403 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1afdfb00-b4bd-4d80-bf0a-3df741cebd2e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:22.422844 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1afdfb00-b4bd-4d80-bf0a-3df741cebd2e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:22.423601 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1afdfb00-b4bd-4d80-bf0a-3df741cebd2e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:22.424059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-1afdfb00-b4bd-4d80-bf0a-3df741cebd2e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:22.568586 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-1afdfb00-b4bd-4d80-bf0a-3df741cebd2e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:22.576873 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-1afdfb00-b4bd-4d80-bf0a-3df741cebd2e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1679 microversion: 2.1 time: 0.166803 Aug 04 17:53:22.577459 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3586/7066] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:22 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:23.605941 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b7b4ec5f-8527-440e-8d3e-deae0c1f87ca tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:23.606541 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b7b4ec5f-8527-440e-8d3e-deae0c1f87ca tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:23.614100 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7b4ec5f-8527-440e-8d3e-deae0c1f87ca tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:23.614547 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7b4ec5f-8527-440e-8d3e-deae0c1f87ca tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:23.615317 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7b4ec5f-8527-440e-8d3e-deae0c1f87ca tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:23.615751 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b7b4ec5f-8527-440e-8d3e-deae0c1f87ca tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:23.778876 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b7b4ec5f-8527-440e-8d3e-deae0c1f87ca tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:23.790773 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b7b4ec5f-8527-440e-8d3e-deae0c1f87ca tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1700 microversion: 2.1 time: 0.188594 Aug 04 17:53:23.791943 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3481/7067] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:23 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1700 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:24.814733 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6fdbd166-dbdf-46d9-a6ca-0018fd434673 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:24.815344 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6fdbd166-dbdf-46d9-a6ca-0018fd434673 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:24.822860 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6fdbd166-dbdf-46d9-a6ca-0018fd434673 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:24.823309 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6fdbd166-dbdf-46d9-a6ca-0018fd434673 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:24.824078 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6fdbd166-dbdf-46d9-a6ca-0018fd434673 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:24.824579 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6fdbd166-dbdf-46d9-a6ca-0018fd434673 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:24.965456 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6fdbd166-dbdf-46d9-a6ca-0018fd434673 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:24.973337 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6fdbd166-dbdf-46d9-a6ca-0018fd434673 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1700 microversion: 2.1 time: 0.162568 Aug 04 17:53:24.973916 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3587/7068] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:24 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1700 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:25.996118 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8259cf88-0142-4ac5-8229-62cf19f4d102 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:25.996718 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8259cf88-0142-4ac5-8229-62cf19f4d102 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:26.006928 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8259cf88-0142-4ac5-8229-62cf19f4d102 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:26.007390 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8259cf88-0142-4ac5-8229-62cf19f4d102 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:26.008178 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8259cf88-0142-4ac5-8229-62cf19f4d102 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:26.008610 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8259cf88-0142-4ac5-8229-62cf19f4d102 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:26.173375 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8259cf88-0142-4ac5-8229-62cf19f4d102 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:26.183314 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8259cf88-0142-4ac5-8229-62cf19f4d102 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1695 microversion: 2.1 time: 0.191399 Aug 04 17:53:26.186548 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3482/7069] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:25 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1695 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:27.212555 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f4d18a17-3735-4d49-aab7-34ba66c5dd8e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:27.213552 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f4d18a17-3735-4d49-aab7-34ba66c5dd8e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:27.226663 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f4d18a17-3735-4d49-aab7-34ba66c5dd8e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:27.226663 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f4d18a17-3735-4d49-aab7-34ba66c5dd8e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:27.227458 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f4d18a17-3735-4d49-aab7-34ba66c5dd8e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:27.228565 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f4d18a17-3735-4d49-aab7-34ba66c5dd8e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:27.234624 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-b05c2d53-0c87-465a-a84e-0605bcda0a41 req-4c239bc2-ab92-4b8f-96b7-94bbaf6063da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21513c81-acbd-4352-a424-37a6bd8db02c", "name": "network-vif-plugged", "status": "completed", "tag": "009b7504-36dc-4083-8477-2ead95f9d305"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:53:27.253904 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-b05c2d53-0c87-465a-a84e-0605bcda0a41 req-4c239bc2-ab92-4b8f-96b7-94bbaf6063da service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:27.254806 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-b05c2d53-0c87-465a-a84e-0605bcda0a41 req-4c239bc2-ab92-4b8f-96b7-94bbaf6063da service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:27.283033 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-b05c2d53-0c87-465a-a84e-0605bcda0a41 req-4c239bc2-ab92-4b8f-96b7-94bbaf6063da service nova] Creating event network-vif-plugged:009b7504-36dc-4083-8477-2ead95f9d305 for instance 21513c81-acbd-4352-a424-37a6bd8db02c on n-h1-846466-12 Aug 04 17:53:27.290591 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-b05c2d53-0c87-465a-a84e-0605bcda0a41 req-4c239bc2-ab92-4b8f-96b7-94bbaf6063da service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157105 Aug 04 17:53:27.292932 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3588/7070] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:53:27.401980 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f4d18a17-3735-4d49-aab7-34ba66c5dd8e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:27.411062 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f4d18a17-3735-4d49-aab7-34ba66c5dd8e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1695 microversion: 2.1 time: 0.203530 Aug 04 17:53:27.412352 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3483/7071] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:27 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1695 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:28.433552 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-46b9158a-51ba-4120-a066-ee082f9ba613 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:28.434279 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-46b9158a-51ba-4120-a066-ee082f9ba613 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:28.442622 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46b9158a-51ba-4120-a066-ee082f9ba613 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:28.443354 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46b9158a-51ba-4120-a066-ee082f9ba613 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:28.444149 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46b9158a-51ba-4120-a066-ee082f9ba613 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:28.444618 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-46b9158a-51ba-4120-a066-ee082f9ba613 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:28.618650 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-46b9158a-51ba-4120-a066-ee082f9ba613 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:28.629787 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-46b9158a-51ba-4120-a066-ee082f9ba613 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1695 microversion: 2.1 time: 0.200876 Aug 04 17:53:28.630397 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3589/7072] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:28 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1695 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:29.659919 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7b491f0b-d1a3-488d-b972-714da8f73706 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:29.660828 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7b491f0b-d1a3-488d-b972-714da8f73706 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:29.668306 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b491f0b-d1a3-488d-b972-714da8f73706 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:29.668773 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b491f0b-d1a3-488d-b972-714da8f73706 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:29.669678 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b491f0b-d1a3-488d-b972-714da8f73706 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:29.670800 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7b491f0b-d1a3-488d-b972-714da8f73706 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:29.884163 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7b491f0b-d1a3-488d-b972-714da8f73706 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:29.897587 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7b491f0b-d1a3-488d-b972-714da8f73706 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1695 microversion: 2.1 time: 0.243200 Aug 04 17:53:29.914485 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3484/7073] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:29 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1695 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:53:30.924774 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ed0482b8-d159-49e1-8b33-f9ff47cbb43a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:30.925533 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ed0482b8-d159-49e1-8b33-f9ff47cbb43a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:30.933701 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ed0482b8-d159-49e1-8b33-f9ff47cbb43a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:30.934154 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ed0482b8-d159-49e1-8b33-f9ff47cbb43a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:30.934965 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ed0482b8-d159-49e1-8b33-f9ff47cbb43a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:30.935403 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ed0482b8-d159-49e1-8b33-f9ff47cbb43a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:31.088297 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ed0482b8-d159-49e1-8b33-f9ff47cbb43a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:31.099127 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ed0482b8-d159-49e1-8b33-f9ff47cbb43a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1695 microversion: 2.1 time: 0.176280 Aug 04 17:53:31.099127 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3590/7074] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:30 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1695 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:32.119553 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-da8b7e98-d36e-4078-9ea5-6d4e1f504f82 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:32.121038 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-da8b7e98-d36e-4078-9ea5-6d4e1f504f82 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:32.131737 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-da8b7e98-d36e-4078-9ea5-6d4e1f504f82 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:32.132183 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-da8b7e98-d36e-4078-9ea5-6d4e1f504f82 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:32.132969 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-da8b7e98-d36e-4078-9ea5-6d4e1f504f82 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:32.133435 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-da8b7e98-d36e-4078-9ea5-6d4e1f504f82 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:32.298951 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-da8b7e98-d36e-4078-9ea5-6d4e1f504f82 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:32.307724 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-da8b7e98-d36e-4078-9ea5-6d4e1f504f82 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1695 microversion: 2.1 time: 0.192319 Aug 04 17:53:32.309013 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3485/7075] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:32 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1695 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:33.337874 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2b7f81a8-6dc2-4d3a-a840-193f65c58991 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:33.338719 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2b7f81a8-6dc2-4d3a-a840-193f65c58991 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:33.346906 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2b7f81a8-6dc2-4d3a-a840-193f65c58991 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:33.347494 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2b7f81a8-6dc2-4d3a-a840-193f65c58991 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:33.348382 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2b7f81a8-6dc2-4d3a-a840-193f65c58991 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:33.348920 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2b7f81a8-6dc2-4d3a-a840-193f65c58991 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:33.533699 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2b7f81a8-6dc2-4d3a-a840-193f65c58991 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:33.544843 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2b7f81a8-6dc2-4d3a-a840-193f65c58991 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1695 microversion: 2.1 time: 0.210769 Aug 04 17:53:33.545515 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3591/7076] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:33 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1695 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:34.567731 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a10345b1-1453-45f2-9993-859ea5670fe4 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:34.568315 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a10345b1-1453-45f2-9993-859ea5670fe4 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:34.576203 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a10345b1-1453-45f2-9993-859ea5670fe4 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:34.576663 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a10345b1-1453-45f2-9993-859ea5670fe4 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:34.577485 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a10345b1-1453-45f2-9993-859ea5670fe4 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:34.577927 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a10345b1-1453-45f2-9993-859ea5670fe4 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:34.724894 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a10345b1-1453-45f2-9993-859ea5670fe4 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:34.732983 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a10345b1-1453-45f2-9993-859ea5670fe4 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1695 microversion: 2.1 time: 0.169245 Aug 04 17:53:34.733588 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3486/7077] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:34 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1695 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:35.755666 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-188d6a79-3dfe-4deb-86b2-d8db6433c781 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:35.756299 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-188d6a79-3dfe-4deb-86b2-d8db6433c781 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:35.764094 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-188d6a79-3dfe-4deb-86b2-d8db6433c781 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:35.764652 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-188d6a79-3dfe-4deb-86b2-d8db6433c781 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:35.765317 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-188d6a79-3dfe-4deb-86b2-d8db6433c781 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:35.765987 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-188d6a79-3dfe-4deb-86b2-d8db6433c781 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:35.909841 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-188d6a79-3dfe-4deb-86b2-d8db6433c781 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:35.919964 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-188d6a79-3dfe-4deb-86b2-d8db6433c781 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1677 microversion: 2.1 time: 0.168863 Aug 04 17:53:35.920526 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3592/7078] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:35 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:36.943571 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d85beb84-5cdd-4540-8b5f-0f7efe430df6 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:36.944156 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d85beb84-5cdd-4540-8b5f-0f7efe430df6 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:36.952425 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d85beb84-5cdd-4540-8b5f-0f7efe430df6 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:36.952887 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d85beb84-5cdd-4540-8b5f-0f7efe430df6 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:36.953680 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d85beb84-5cdd-4540-8b5f-0f7efe430df6 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:36.954116 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d85beb84-5cdd-4540-8b5f-0f7efe430df6 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:37.110380 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d85beb84-5cdd-4540-8b5f-0f7efe430df6 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:37.118512 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d85beb84-5cdd-4540-8b5f-0f7efe430df6 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1677 microversion: 2.1 time: 0.179037 Aug 04 17:53:37.119103 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3487/7079] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:36 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:38.150444 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-56f37389-5341-48fa-8a02-c070ba8f4080 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:38.151112 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-56f37389-5341-48fa-8a02-c070ba8f4080 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:38.162140 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-56f37389-5341-48fa-8a02-c070ba8f4080 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:38.162751 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-56f37389-5341-48fa-8a02-c070ba8f4080 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:38.163873 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-56f37389-5341-48fa-8a02-c070ba8f4080 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:38.164476 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-56f37389-5341-48fa-8a02-c070ba8f4080 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:38.315821 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-56f37389-5341-48fa-8a02-c070ba8f4080 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:38.326221 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-56f37389-5341-48fa-8a02-c070ba8f4080 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1620 microversion: 2.1 time: 0.182174 Aug 04 17:53:38.327104 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3593/7080] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:38 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1620 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:38.347253 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7ed73aec-86f0-4f53-bb96-30182f286427 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:53:38.347901 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7ed73aec-86f0-4f53-bb96-30182f286427 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:38.357133 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7ed73aec-86f0-4f53-bb96-30182f286427 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:38.357794 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7ed73aec-86f0-4f53-bb96-30182f286427 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:38.358933 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7ed73aec-86f0-4f53-bb96-30182f286427 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:38.359575 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7ed73aec-86f0-4f53-bb96-30182f286427 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:38.456631 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7ed73aec-86f0-4f53-bb96-30182f286427 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126126) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 17:53:38.538842 n-d-846466-12 devstack@n-api.service[126126]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7ed73aec-86f0-4f53-bb96-30182f286427 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [c6fb61ca-3cc4-42ba-a752-9537fad422ca] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 17:53:39.145865 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-d5d7a532-cbf8-4514-86c1-f9cbd8dec628 req-7ae53cc8-9f60-4b47-94ac-60cd567036e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21513c81-acbd-4352-a424-37a6bd8db02c", "name": "network-vif-unplugged", "status": "completed", "tag": "009b7504-36dc-4083-8477-2ead95f9d305"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:53:39.158947 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-d5d7a532-cbf8-4514-86c1-f9cbd8dec628 req-7ae53cc8-9f60-4b47-94ac-60cd567036e1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:39.159891 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-d5d7a532-cbf8-4514-86c1-f9cbd8dec628 req-7ae53cc8-9f60-4b47-94ac-60cd567036e1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:39.171943 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.compute.server_external_events [req-d5d7a532-cbf8-4514-86c1-f9cbd8dec628 req-7ae53cc8-9f60-4b47-94ac-60cd567036e1 service nova] Unable to find a host for instance 21513c81-acbd-4352-a424-37a6bd8db02c. Dropping event network-vif-unplugged {{(pid=126125) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 04 17:53:39.172834 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-d5d7a532-cbf8-4514-86c1-f9cbd8dec628 req-7ae53cc8-9f60-4b47-94ac-60cd567036e1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031055 Aug 04 17:53:39.173494 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3594/7081] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 04 17:53:39.547472 n-d-846466-12 devstack@n-api.service[126126]: INFO oslo.messaging._drivers.impl_rabbit [None req-7ed73aec-86f0-4f53-bb96-30182f286427 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [c6fb61ca-3cc4-42ba-a752-9537fad422ca] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 39980. Aug 04 17:53:39.551777 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7ed73aec-86f0-4f53-bb96-30182f286427 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "POST /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c/action" status: 202 len: 0 microversion: 2.1 time: 1.208575 Aug 04 17:53:39.555723 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3488/7082] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:53:38 2022] POST /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c/action => generated 0 bytes in 1210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:53:39.561598 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c5b986fb-0827-4476-9dd6-6cd6d4a9e66a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:39.562222 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c5b986fb-0827-4476-9dd6-6cd6d4a9e66a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:39.568511 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c5b986fb-0827-4476-9dd6-6cd6d4a9e66a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:39.568974 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c5b986fb-0827-4476-9dd6-6cd6d4a9e66a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:39.569783 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c5b986fb-0827-4476-9dd6-6cd6d4a9e66a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:39.570219 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c5b986fb-0827-4476-9dd6-6cd6d4a9e66a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:39.714681 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c5b986fb-0827-4476-9dd6-6cd6d4a9e66a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:39.722786 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c5b986fb-0827-4476-9dd6-6cd6d4a9e66a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1628 microversion: 2.1 time: 0.165555 Aug 04 17:53:39.723372 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3595/7083] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:39 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1628 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:40.745395 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d94c428c-3a3b-4e04-8182-ed3a3c30d2b0 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:40.746026 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d94c428c-3a3b-4e04-8182-ed3a3c30d2b0 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:40.753619 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d94c428c-3a3b-4e04-8182-ed3a3c30d2b0 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:40.754073 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d94c428c-3a3b-4e04-8182-ed3a3c30d2b0 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:40.754847 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d94c428c-3a3b-4e04-8182-ed3a3c30d2b0 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:40.755281 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d94c428c-3a3b-4e04-8182-ed3a3c30d2b0 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:40.775051 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:53:40.906797 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-d94c428c-3a3b-4e04-8182-ed3a3c30d2b0 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:40.916647 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d94c428c-3a3b-4e04-8182-ed3a3c30d2b0 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1686 microversion: 2.1 time: 0.176508 Aug 04 17:53:40.917387 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3489/7084] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:40 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1686 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:41.942472 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5fd97bee-45aa-4342-afb7-0d85f262375b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:41.943735 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5fd97bee-45aa-4342-afb7-0d85f262375b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:41.951523 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5fd97bee-45aa-4342-afb7-0d85f262375b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:41.952210 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5fd97bee-45aa-4342-afb7-0d85f262375b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:41.953365 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5fd97bee-45aa-4342-afb7-0d85f262375b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:41.953982 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5fd97bee-45aa-4342-afb7-0d85f262375b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:42.117605 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5fd97bee-45aa-4342-afb7-0d85f262375b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:42.128443 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5fd97bee-45aa-4342-afb7-0d85f262375b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1686 microversion: 2.1 time: 0.189843 Aug 04 17:53:42.129863 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3596/7085] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:41 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1686 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:43.155956 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-b439c543-5ab2-4380-8058-c19d2ec7c21a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:43.157767 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-b439c543-5ab2-4380-8058-c19d2ec7c21a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:43.162701 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:53:43.167538 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b439c543-5ab2-4380-8058-c19d2ec7c21a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:43.168093 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b439c543-5ab2-4380-8058-c19d2ec7c21a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:43.168982 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b439c543-5ab2-4380-8058-c19d2ec7c21a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:43.169632 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-b439c543-5ab2-4380-8058-c19d2ec7c21a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:43.334182 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-b439c543-5ab2-4380-8058-c19d2ec7c21a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:43.342373 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-b439c543-5ab2-4380-8058-c19d2ec7c21a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1686 microversion: 2.1 time: 0.192328 Aug 04 17:53:43.343220 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3490/7086] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:43 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1686 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:44.366510 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fbb208fc-d0fb-4fd8-959a-2d7f4ef12f10 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:44.368577 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fbb208fc-d0fb-4fd8-959a-2d7f4ef12f10 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:44.372552 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=31 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:53:44.379040 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fbb208fc-d0fb-4fd8-959a-2d7f4ef12f10 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:44.379487 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fbb208fc-d0fb-4fd8-959a-2d7f4ef12f10 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:44.380274 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fbb208fc-d0fb-4fd8-959a-2d7f4ef12f10 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:44.380809 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fbb208fc-d0fb-4fd8-959a-2d7f4ef12f10 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:44.383806 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=83 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:53:44.528642 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-fbb208fc-d0fb-4fd8-959a-2d7f4ef12f10 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:44.541681 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fbb208fc-d0fb-4fd8-959a-2d7f4ef12f10 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1686 microversion: 2.1 time: 0.180131 Aug 04 17:53:44.542882 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3597/7087] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:44 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1686 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:45.563910 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fe72523d-1a22-44bb-a044-9b48f2ccd580 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:45.565273 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fe72523d-1a22-44bb-a044-9b48f2ccd580 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:45.572893 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fe72523d-1a22-44bb-a044-9b48f2ccd580 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:45.573338 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fe72523d-1a22-44bb-a044-9b48f2ccd580 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:45.574150 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fe72523d-1a22-44bb-a044-9b48f2ccd580 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:45.574589 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fe72523d-1a22-44bb-a044-9b48f2ccd580 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:45.725313 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fe72523d-1a22-44bb-a044-9b48f2ccd580 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:45.734651 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fe72523d-1a22-44bb-a044-9b48f2ccd580 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1686 microversion: 2.1 time: 0.175117 Aug 04 17:53:45.735618 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3491/7088] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:45 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1686 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:46.758220 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c3f47ffd-7f74-4991-96fa-7996383683e2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:46.759317 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c3f47ffd-7f74-4991-96fa-7996383683e2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:46.773970 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3f47ffd-7f74-4991-96fa-7996383683e2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:46.774572 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3f47ffd-7f74-4991-96fa-7996383683e2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:46.775476 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3f47ffd-7f74-4991-96fa-7996383683e2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:46.776012 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c3f47ffd-7f74-4991-96fa-7996383683e2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:46.941898 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c3f47ffd-7f74-4991-96fa-7996383683e2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:46.950058 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c3f47ffd-7f74-4991-96fa-7996383683e2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1686 microversion: 2.1 time: 0.196239 Aug 04 17:53:46.955238 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3598/7089] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:46 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1686 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:47.971641 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c61583ef-d471-4337-bb4b-bd9074b4f25f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:47.972344 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c61583ef-d471-4337-bb4b-bd9074b4f25f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:47.980077 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c61583ef-d471-4337-bb4b-bd9074b4f25f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:47.980524 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c61583ef-d471-4337-bb4b-bd9074b4f25f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:47.981354 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c61583ef-d471-4337-bb4b-bd9074b4f25f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:47.981952 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c61583ef-d471-4337-bb4b-bd9074b4f25f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:48.135625 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c61583ef-d471-4337-bb4b-bd9074b4f25f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:48.143711 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c61583ef-d471-4337-bb4b-bd9074b4f25f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1686 microversion: 2.1 time: 0.175993 Aug 04 17:53:48.144579 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3492/7090] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:47 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1686 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:49.168467 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-6a98b684-e9ed-4ff0-903c-aea7b9bbad9e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:49.169302 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-6a98b684-e9ed-4ff0-903c-aea7b9bbad9e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:49.179356 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a98b684-e9ed-4ff0-903c-aea7b9bbad9e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:49.179871 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a98b684-e9ed-4ff0-903c-aea7b9bbad9e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:49.180763 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a98b684-e9ed-4ff0-903c-aea7b9bbad9e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:49.181160 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-6a98b684-e9ed-4ff0-903c-aea7b9bbad9e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:49.332499 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-6a98b684-e9ed-4ff0-903c-aea7b9bbad9e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:49.340536 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-6a98b684-e9ed-4ff0-903c-aea7b9bbad9e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1686 microversion: 2.1 time: 0.178386 Aug 04 17:53:49.345490 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3599/7091] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:49 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1686 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:50.364177 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-70fbc0b1-23aa-4ea6-8c50-a4675dc9e5a2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:50.364830 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-70fbc0b1-23aa-4ea6-8c50-a4675dc9e5a2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:50.372465 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70fbc0b1-23aa-4ea6-8c50-a4675dc9e5a2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:50.373021 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70fbc0b1-23aa-4ea6-8c50-a4675dc9e5a2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:50.373855 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70fbc0b1-23aa-4ea6-8c50-a4675dc9e5a2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:50.374314 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-70fbc0b1-23aa-4ea6-8c50-a4675dc9e5a2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:50.517853 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-70fbc0b1-23aa-4ea6-8c50-a4675dc9e5a2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:50.529757 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-70fbc0b1-23aa-4ea6-8c50-a4675dc9e5a2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1686 microversion: 2.1 time: 0.169892 Aug 04 17:53:50.530509 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3493/7092] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:50 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1686 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:51.555494 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9eaf5542-7a8d-4b19-9cdd-7c5cc520a66d tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:51.556080 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9eaf5542-7a8d-4b19-9cdd-7c5cc520a66d tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:51.566176 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9eaf5542-7a8d-4b19-9cdd-7c5cc520a66d tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:51.566690 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9eaf5542-7a8d-4b19-9cdd-7c5cc520a66d tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:51.567834 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9eaf5542-7a8d-4b19-9cdd-7c5cc520a66d tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:51.568473 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9eaf5542-7a8d-4b19-9cdd-7c5cc520a66d tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:51.729045 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9eaf5542-7a8d-4b19-9cdd-7c5cc520a66d tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:51.737998 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9eaf5542-7a8d-4b19-9cdd-7c5cc520a66d tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1686 microversion: 2.1 time: 0.188960 Aug 04 17:53:51.738584 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3600/7093] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:51 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1686 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:52.759697 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-91be6aee-11f0-48bd-a3e1-aacb085c3b0d tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:52.760336 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-91be6aee-11f0-48bd-a3e1-aacb085c3b0d tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:52.768303 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-91be6aee-11f0-48bd-a3e1-aacb085c3b0d tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:52.768786 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-91be6aee-11f0-48bd-a3e1-aacb085c3b0d tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:52.769588 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-91be6aee-11f0-48bd-a3e1-aacb085c3b0d tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:52.770028 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-91be6aee-11f0-48bd-a3e1-aacb085c3b0d tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:52.925038 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-91be6aee-11f0-48bd-a3e1-aacb085c3b0d tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:52.933253 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-91be6aee-11f0-48bd-a3e1-aacb085c3b0d tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1686 microversion: 2.1 time: 0.177567 Aug 04 17:53:52.933931 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3494/7094] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:52 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1686 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:53.956361 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-222b50d7-8ccc-4fda-a468-eb2e8a986744 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:53.957027 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-222b50d7-8ccc-4fda-a468-eb2e8a986744 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:53.964627 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-222b50d7-8ccc-4fda-a468-eb2e8a986744 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:53.965076 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-222b50d7-8ccc-4fda-a468-eb2e8a986744 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:53.965887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-222b50d7-8ccc-4fda-a468-eb2e8a986744 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:53.966316 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-222b50d7-8ccc-4fda-a468-eb2e8a986744 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:54.122089 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-222b50d7-8ccc-4fda-a468-eb2e8a986744 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:54.131638 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-222b50d7-8ccc-4fda-a468-eb2e8a986744 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1686 microversion: 2.1 time: 0.180555 Aug 04 17:53:54.132229 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3601/7095] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:53 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1686 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:55.153094 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7f7c5ef6-642d-4a4b-9bf1-b32ff8ac00c8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:55.153721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7f7c5ef6-642d-4a4b-9bf1-b32ff8ac00c8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:55.161775 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f7c5ef6-642d-4a4b-9bf1-b32ff8ac00c8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:55.162230 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f7c5ef6-642d-4a4b-9bf1-b32ff8ac00c8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:55.163010 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f7c5ef6-642d-4a4b-9bf1-b32ff8ac00c8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:55.163445 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f7c5ef6-642d-4a4b-9bf1-b32ff8ac00c8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:55.291663 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-8bce46ff-6c72-464f-9f98-968bb60d10a0 req-a3ffb002-615e-4f2b-824e-c28afce1e499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21513c81-acbd-4352-a424-37a6bd8db02c", "name": "network-vif-plugged", "status": "completed", "tag": "009b7504-36dc-4083-8477-2ead95f9d305"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:53:55.303955 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-8bce46ff-6c72-464f-9f98-968bb60d10a0 req-a3ffb002-615e-4f2b-824e-c28afce1e499 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:55.305893 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-8bce46ff-6c72-464f-9f98-968bb60d10a0 req-a3ffb002-615e-4f2b-824e-c28afce1e499 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:55.321523 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-8bce46ff-6c72-464f-9f98-968bb60d10a0 req-a3ffb002-615e-4f2b-824e-c28afce1e499 service nova] Creating event network-vif-plugged:009b7504-36dc-4083-8477-2ead95f9d305 for instance 21513c81-acbd-4352-a424-37a6bd8db02c on n-h1-846466-12 Aug 04 17:53:55.327150 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-8bce46ff-6c72-464f-9f98-968bb60d10a0 req-a3ffb002-615e-4f2b-824e-c28afce1e499 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039281 Aug 04 17:53:55.327980 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3602/7096] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:53:55.338176 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7f7c5ef6-642d-4a4b-9bf1-b32ff8ac00c8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:55.346993 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7f7c5ef6-642d-4a4b-9bf1-b32ff8ac00c8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1686 microversion: 2.1 time: 0.197916 Aug 04 17:53:55.347845 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3495/7097] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:55 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1686 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:55.980255 n-d-846466-12 devstack@n-api.service[126125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:53:55.980541 n-d-846466-12 devstack@n-api.service[126125]: Thu Aug 4 17:53:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 17:53:56.371743 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a0212daf-b8e9-4965-84a0-365e42f82639 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:56.372478 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a0212daf-b8e9-4965-84a0-365e42f82639 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:56.380148 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a0212daf-b8e9-4965-84a0-365e42f82639 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:56.380585 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a0212daf-b8e9-4965-84a0-365e42f82639 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:56.381409 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a0212daf-b8e9-4965-84a0-365e42f82639 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:56.381839 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a0212daf-b8e9-4965-84a0-365e42f82639 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:56.529509 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a0212daf-b8e9-4965-84a0-365e42f82639 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:56.538309 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a0212daf-b8e9-4965-84a0-365e42f82639 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1686 microversion: 2.1 time: 0.170942 Aug 04 17:53:56.538876 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3603/7098] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:56 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1686 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:53:56.565667 n-d-846466-12 devstack@n-api.service[126126]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:53:56.566181 n-d-846466-12 devstack@n-api.service[126126]: Thu Aug 4 17:53:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 17:53:57.560093 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a5a87457-7d25-4836-8943-a655491dd7dc tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:57.560759 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-a5a87457-7d25-4836-8943-a655491dd7dc tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:57.568009 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a5a87457-7d25-4836-8943-a655491dd7dc tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:57.568648 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a5a87457-7d25-4836-8943-a655491dd7dc tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:57.569214 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a5a87457-7d25-4836-8943-a655491dd7dc tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:53:57.569703 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-a5a87457-7d25-4836-8943-a655491dd7dc tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:53:57.713441 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-a5a87457-7d25-4836-8943-a655491dd7dc tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:57.722531 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a5a87457-7d25-4836-8943-a655491dd7dc tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1673 microversion: 2.1 time: 0.166665 Aug 04 17:53:57.723110 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3496/7099] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:57 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1673 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:14.297815 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=13 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:55:14.299294 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=37 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:55:14.302342 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=13 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:55:14.303387 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=44 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:55:14.305600 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-acb66fd0-7e51-48cf-84a8-abc2f2e87b5d tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:14.306845 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-acb66fd0-7e51-48cf-84a8-abc2f2e87b5d tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:14.317850 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-acb66fd0-7e51-48cf-84a8-abc2f2e87b5d tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:14.318289 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-acb66fd0-7e51-48cf-84a8-abc2f2e87b5d tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:14.319101 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-acb66fd0-7e51-48cf-84a8-abc2f2e87b5d tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:14.319615 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-acb66fd0-7e51-48cf-84a8-abc2f2e87b5d tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:14.353645 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-acb66fd0-7e51-48cf-84a8-abc2f2e87b5d tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:55:14.375053 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-dcb9b86d-f7ed-482b-8ca0-b04d6940b967 req-953e8f70-bd85-4381-9997-e650d336af9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21513c81-acbd-4352-a424-37a6bd8db02c", "tag": "009b7504-36dc-4083-8477-2ead95f9d305"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:55:14.387539 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-dcb9b86d-f7ed-482b-8ca0-b04d6940b967 req-953e8f70-bd85-4381-9997-e650d336af9b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:14.387984 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-dcb9b86d-f7ed-482b-8ca0-b04d6940b967 req-953e8f70-bd85-4381-9997-e650d336af9b service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:14.402258 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-dcb9b86d-f7ed-482b-8ca0-b04d6940b967 req-953e8f70-bd85-4381-9997-e650d336af9b service nova] Creating event network-changed:009b7504-36dc-4083-8477-2ead95f9d305 for instance 21513c81-acbd-4352-a424-37a6bd8db02c on n-h1-846466-12 Aug 04 17:55:14.408341 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-dcb9b86d-f7ed-482b-8ca0-b04d6940b967 req-953e8f70-bd85-4381-9997-e650d336af9b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116234 Aug 04 17:55:14.411836 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3497/7100] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:55:14.467269 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-acb66fd0-7e51-48cf-84a8-abc2f2e87b5d tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "DELETE /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 204 len: 0 microversion: 2.1 time: 0.176027 Aug 04 17:55:14.468328 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3604/7101] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:55:14 2022] DELETE /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 17:55:14.480298 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6445787c-6f0a-4913-9c3e-bb3544ac5a2f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:14.481071 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6445787c-6f0a-4913-9c3e-bb3544ac5a2f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:14.488046 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6445787c-6f0a-4913-9c3e-bb3544ac5a2f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:14.488611 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6445787c-6f0a-4913-9c3e-bb3544ac5a2f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:14.489522 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6445787c-6f0a-4913-9c3e-bb3544ac5a2f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:14.490039 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6445787c-6f0a-4913-9c3e-bb3544ac5a2f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:14.681044 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6445787c-6f0a-4913-9c3e-bb3544ac5a2f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:14.690118 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6445787c-6f0a-4913-9c3e-bb3544ac5a2f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1679 microversion: 2.1 time: 0.216751 Aug 04 17:55:14.690691 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3498/7102] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:14 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1679 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:15.720706 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-69f23d57-4cb8-43b8-8fb4-14acf70fef14 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:15.721883 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-69f23d57-4cb8-43b8-8fb4-14acf70fef14 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:15.733854 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-69f23d57-4cb8-43b8-8fb4-14acf70fef14 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:15.734579 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-69f23d57-4cb8-43b8-8fb4-14acf70fef14 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:15.735966 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-69f23d57-4cb8-43b8-8fb4-14acf70fef14 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:15.736676 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-69f23d57-4cb8-43b8-8fb4-14acf70fef14 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:15.925107 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-69f23d57-4cb8-43b8-8fb4-14acf70fef14 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:15.938649 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-69f23d57-4cb8-43b8-8fb4-14acf70fef14 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1679 microversion: 2.1 time: 0.226378 Aug 04 17:55:15.939882 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3605/7103] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:15 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1679 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:16.840396 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-14face1b-ce6b-4777-a8c4-51a728ba6e18 req-98cede0f-c121-4040-a07a-4cb8b5a8c4c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21513c81-acbd-4352-a424-37a6bd8db02c", "name": "network-vif-deleted", "tag": "009b7504-36dc-4083-8477-2ead95f9d305"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:55:16.852095 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-14face1b-ce6b-4777-a8c4-51a728ba6e18 req-98cede0f-c121-4040-a07a-4cb8b5a8c4c0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:16.852702 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-14face1b-ce6b-4777-a8c4-51a728ba6e18 req-98cede0f-c121-4040-a07a-4cb8b5a8c4c0 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:16.870175 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-14face1b-ce6b-4777-a8c4-51a728ba6e18 req-98cede0f-c121-4040-a07a-4cb8b5a8c4c0 service nova] Creating event network-vif-deleted:009b7504-36dc-4083-8477-2ead95f9d305 for instance 21513c81-acbd-4352-a424-37a6bd8db02c on n-h1-846466-12 Aug 04 17:55:16.876242 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-14face1b-ce6b-4777-a8c4-51a728ba6e18 req-98cede0f-c121-4040-a07a-4cb8b5a8c4c0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039747 Aug 04 17:55:16.877075 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3499/7104] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:55:16.974913 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-86ae3c9d-a7e5-4898-ab6c-f7682fcdc427 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:16.975685 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-86ae3c9d-a7e5-4898-ab6c-f7682fcdc427 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:16.984963 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-86ae3c9d-a7e5-4898-ab6c-f7682fcdc427 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:16.985500 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-86ae3c9d-a7e5-4898-ab6c-f7682fcdc427 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:16.986381 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-86ae3c9d-a7e5-4898-ab6c-f7682fcdc427 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:16.986809 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-86ae3c9d-a7e5-4898-ab6c-f7682fcdc427 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:17.024195 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-86ae3c9d-a7e5-4898-ab6c-f7682fcdc427 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:17.024998 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-86ae3c9d-a7e5-4898-ab6c-f7682fcdc427 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:17.025494 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-86ae3c9d-a7e5-4898-ab6c-f7682fcdc427 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lazy-loading 'fault' on Instance uuid 21513c81-acbd-4352-a424-37a6bd8db02c {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:55:17.074532 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-86ae3c9d-a7e5-4898-ab6c-f7682fcdc427 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:17.083802 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-86ae3c9d-a7e5-4898-ab6c-f7682fcdc427 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 200 len: 1336 microversion: 2.1 time: 0.112846 Aug 04 17:55:17.084389 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3606/7105] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:16 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 1336 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:18.107224 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0b1b8d09-9a1b-4260-995b-9cb46f586c66 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:18.108067 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-0b1b8d09-9a1b-4260-995b-9cb46f586c66 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 21513c81-acbd-4352-a424-37a6bd8db02c] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:18.119870 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0b1b8d09-9a1b-4260-995b-9cb46f586c66 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:18.120552 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0b1b8d09-9a1b-4260-995b-9cb46f586c66 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:18.121848 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0b1b8d09-9a1b-4260-995b-9cb46f586c66 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:18.122602 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-0b1b8d09-9a1b-4260-995b-9cb46f586c66 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:18.140792 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-0b1b8d09-9a1b-4260-995b-9cb46f586c66 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] HTTP exception thrown: Instance 21513c81-acbd-4352-a424-37a6bd8db02c could not be found. Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0b1b8d09-9a1b-4260-995b-9cb46f586c66 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Request method failure captured: Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c HTTP/1.1 Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi7Ab9qH5yXctdYyjpfakLkYV9r7sr1lqobZ65HmbkKvj7g_pRjWaz45aItg8ftBJht3enmQlLdasRmvJnD8D79clBh0N6tJ46kiY7PCaJO-VgIP-waeKZumseGkt3m7U9Kwx51VNGG3drqvsndXjTIIUHOG3fG4zI2MCnQYxFeNTdHVQ Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 7a49716b74ed4c8c8aed3322f2ddd702 Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-TestShelveInstance-1787388486 Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7a49716b74ed4c8c8aed3322f2ddd702"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7a49716b74ed4c8c8aed3322f2ddd702"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7a49716b74ed4c8c8aed3322f2ddd702"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7a49716b74ed4c8c8aed3322f2ddd702"}]}] Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-TestShelveInstance-1787388486 Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 7a49716b74ed4c8c8aed3322f2ddd702 Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-TestShelveInstance-1787388486 Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-TestShelveInstance-1787388486-project Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 57d626d2e60945b6a0302ffd18f07267 Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-TestShelveInstance-1787388486-project Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 21513c81-acbd-4352-a424-37a6bd8db02c could not be found. Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '21513c81-acbd-4352-a424-37a6bd8db02c'} Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21513c81-acbd-4352-a424-37a6bd8db02c could not be found. Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21513c81-acbd-4352-a424-37a6bd8db02c could not be found. Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:55:18.142537 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:55:18.149931 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:55:18.149931 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:55:18.149931 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:55:18.149931 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:55:18.149931 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:55:18.149931 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21513c81-acbd-4352-a424-37a6bd8db02c could not be found. Aug 04 17:55:18.149931 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:55:18.149931 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-0b1b8d09-9a1b-4260-995b-9cb46f586c66 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Returning 404 to user: Instance 21513c81-acbd-4352-a424-37a6bd8db02c could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:55:18.149931 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-0b1b8d09-9a1b-4260-995b-9cb46f586c66 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c" status: 404 len: 111 microversion: 2.1 time: 0.042379 Aug 04 17:55:18.149931 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3500/7106] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:18 2022] GET /compute/v2.1/servers/21513c81-acbd-4352-a424-37a6bd8db02c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:55:18.341010 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-77e776a9-d586-40a1-8eff-71fd807680de tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '.version_select at 0x7f7e844ad040>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:18.377817 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-77e776a9-d586-40a1-8eff-71fd807680de tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-296685959" status: 202 len: 0 microversion: 2.1 time: 0.041636 Aug 04 17:55:18.383857 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3607/7107] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Aug 4 17:55:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-296685959 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:55:18.413311 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-a600d396-9a17-4592-8fe5-05073d19bba9 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Action: 'create', calling method: .version_select at 0x7f7e77d64dc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-742420629", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/7wCXKLv/Q6+bXyiMVuSpDu84CaW3euNYa7luzbcwZ+V2wJY4CBYmnUr4Rrwzs8z+Sezb7FV8hUnyXJ+QFFmoBUWvhRlbJZUyoewcf6zUbyyPfnFOVOvcYaPY1ZPYeKw=="}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:55:18.431251 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-a600d396-9a17-4592-8fe5-05073d19bba9 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Getting quotas for project 7a49716b74ed4c8c8aed3322f2ddd702. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:55:18.436965 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-a600d396-9a17-4592-8fe5-05073d19bba9 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Getting quotas for user 57d626d2e60945b6a0302ffd18f07267 and project 7a49716b74ed4c8c8aed3322f2ddd702. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:55:18.469417 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-a600d396-9a17-4592-8fe5-05073d19bba9 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.059864 Aug 04 17:55:18.469987 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3501/7108] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 17:55:18 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:55:37.223084 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:55:37.223983 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:55:37.229722 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c76ca91f-3c31-4255-89ff-fdc61ea1d455 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1423937527", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-742420629", "security_groups": [{"name": "tempest-secgroup-smoke-408847857"}], "networks": [{"uuid": "9b8403b3-e567-45a8-8f60-a863050799f0"}], "block_device_mapping_v2": [{"uuid": "f74dc6df-986c-4de4-9d5f-ca5625b5adea", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:55:37.353316 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-c76ca91f-3c31-4255-89ff-fdc61ea1d455 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] validate_networks() for [('9b8403b3-e567-45a8-8f60-a863050799f0', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:55:37.757007 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-c76ca91f-3c31-4255-89ff-fdc61ea1d455 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:55:37.757474 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-c76ca91f-3c31-4255-89ff-fdc61ea1d455 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:55:37.757938 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-c76ca91f-3c31-4255-89ff-fdc61ea1d455 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:55:37.758351 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-c76ca91f-3c31-4255-89ff-fdc61ea1d455 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:55:37.758751 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-c76ca91f-3c31-4255-89ff-fdc61ea1d455 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:55:37.769110 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c76ca91f-3c31-4255-89ff-fdc61ea1d455 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:37.769598 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c76ca91f-3c31-4255-89ff-fdc61ea1d455 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:37.770491 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c76ca91f-3c31-4255-89ff-fdc61ea1d455 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:37.770925 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c76ca91f-3c31-4255-89ff-fdc61ea1d455 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:37.790519 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-c76ca91f-3c31-4255-89ff-fdc61ea1d455 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Getting quotas for project 7a49716b74ed4c8c8aed3322f2ddd702. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:55:37.796493 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-c76ca91f-3c31-4255-89ff-fdc61ea1d455 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Getting quotas for user 57d626d2e60945b6a0302ffd18f07267 and project 7a49716b74ed4c8c8aed3322f2ddd702. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:55:37.871591 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c76ca91f-3c31-4255-89ff-fdc61ea1d455 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:55:37.874487 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c76ca91f-3c31-4255-89ff-fdc61ea1d455 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f74dc6df-986c-4de4-9d5f-ca5625b5adea',volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:55:38.021094 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c76ca91f-3c31-4255-89ff-fdc61ea1d455 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.800161 Aug 04 17:55:38.021805 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3608/7109] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 17:55:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:55:38.035399 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=12 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:55:38.036421 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=4 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:55:38.037297 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:55:38.045172 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-862a86ba-7088-4abb-8627-38f218767dcf tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:38.046833 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-862a86ba-7088-4abb-8627-38f218767dcf tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:38.109392 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-862a86ba-7088-4abb-8627-38f218767dcf tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:38.118248 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-862a86ba-7088-4abb-8627-38f218767dcf tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1088 microversion: 2.1 time: 0.084746 Aug 04 17:55:38.118840 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3502/7110] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:38 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1088 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:39.148822 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-abbc4784-5b12-4d89-a7d1-a340b785e7b8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:39.149586 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-abbc4784-5b12-4d89-a7d1-a340b785e7b8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:39.157664 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-abbc4784-5b12-4d89-a7d1-a340b785e7b8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:39.158118 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-abbc4784-5b12-4d89-a7d1-a340b785e7b8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:39.158904 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-abbc4784-5b12-4d89-a7d1-a340b785e7b8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:39.159415 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-abbc4784-5b12-4d89-a7d1-a340b785e7b8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:39.355728 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-abbc4784-5b12-4d89-a7d1-a340b785e7b8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:39.364584 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-abbc4784-5b12-4d89-a7d1-a340b785e7b8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1204 microversion: 2.1 time: 0.220823 Aug 04 17:55:39.365612 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3609/7111] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:39 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1204 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:40.389000 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-3dc9866b-c5b6-4eab-9a78-aa10d48172ec tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:40.390419 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-3dc9866b-c5b6-4eab-9a78-aa10d48172ec tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:40.399241 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3dc9866b-c5b6-4eab-9a78-aa10d48172ec tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:40.400031 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3dc9866b-c5b6-4eab-9a78-aa10d48172ec tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:40.401077 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3dc9866b-c5b6-4eab-9a78-aa10d48172ec tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:40.401958 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-3dc9866b-c5b6-4eab-9a78-aa10d48172ec tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:40.732140 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-3dc9866b-c5b6-4eab-9a78-aa10d48172ec tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:40.746268 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-3dc9866b-c5b6-4eab-9a78-aa10d48172ec tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1271 microversion: 2.1 time: 0.363176 Aug 04 17:55:40.747279 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3503/7112] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:40 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1271 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:40.832186 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-9a1e37c1-2581-479a-adef-35f945f4bc2b req-ea66a10e-0e90-435f-abee-e06c6cf29f00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b012e5d-40a4-42da-af15-8fcb5484fb99", "tag": "4d60c9e3-03c5-47a5-bf96-19d4a966b516"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:55:40.844850 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-9a1e37c1-2581-479a-adef-35f945f4bc2b req-ea66a10e-0e90-435f-abee-e06c6cf29f00 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:40.845573 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-9a1e37c1-2581-479a-adef-35f945f4bc2b req-ea66a10e-0e90-435f-abee-e06c6cf29f00 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:40.859645 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-9a1e37c1-2581-479a-adef-35f945f4bc2b req-ea66a10e-0e90-435f-abee-e06c6cf29f00 service nova] Creating event network-changed:4d60c9e3-03c5-47a5-bf96-19d4a966b516 for instance 4b012e5d-40a4-42da-af15-8fcb5484fb99 on n-h2-846466-12 Aug 04 17:55:40.866245 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-9a1e37c1-2581-479a-adef-35f945f4bc2b req-ea66a10e-0e90-435f-abee-e06c6cf29f00 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038854 Aug 04 17:55:40.867125 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3610/7113] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:55:41.771324 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-82ee3920-36f0-4c3f-8a09-13109d8b30f5 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:41.772006 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-82ee3920-36f0-4c3f-8a09-13109d8b30f5 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:41.780449 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-82ee3920-36f0-4c3f-8a09-13109d8b30f5 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:41.781222 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-82ee3920-36f0-4c3f-8a09-13109d8b30f5 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:41.782082 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-82ee3920-36f0-4c3f-8a09-13109d8b30f5 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:41.782516 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-82ee3920-36f0-4c3f-8a09-13109d8b30f5 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:41.944655 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-82ee3920-36f0-4c3f-8a09-13109d8b30f5 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:41.953095 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-82ee3920-36f0-4c3f-8a09-13109d8b30f5 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1271 microversion: 2.1 time: 0.185869 Aug 04 17:55:41.953966 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3504/7114] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:41 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1271 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:42.975603 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-27ca25db-f2e9-47d1-b075-74432c9dcd53 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:42.976290 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-27ca25db-f2e9-47d1-b075-74432c9dcd53 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:42.983427 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-27ca25db-f2e9-47d1-b075-74432c9dcd53 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:42.983847 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-27ca25db-f2e9-47d1-b075-74432c9dcd53 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:42.984613 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-27ca25db-f2e9-47d1-b075-74432c9dcd53 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:42.985047 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-27ca25db-f2e9-47d1-b075-74432c9dcd53 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:43.134213 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-27ca25db-f2e9-47d1-b075-74432c9dcd53 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:43.142248 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-27ca25db-f2e9-47d1-b075-74432c9dcd53 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1271 microversion: 2.1 time: 0.171824 Aug 04 17:55:43.142824 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3611/7115] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:42 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1271 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:44.164612 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-97674232-79f6-4dee-b636-42223bace613 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:44.165393 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-97674232-79f6-4dee-b636-42223bace613 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:44.173385 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-97674232-79f6-4dee-b636-42223bace613 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:44.174013 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-97674232-79f6-4dee-b636-42223bace613 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:44.174610 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-97674232-79f6-4dee-b636-42223bace613 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:44.175052 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-97674232-79f6-4dee-b636-42223bace613 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:44.333429 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-97674232-79f6-4dee-b636-42223bace613 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:44.342848 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-97674232-79f6-4dee-b636-42223bace613 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1271 microversion: 2.1 time: 0.182487 Aug 04 17:55:44.343555 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3505/7116] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:44 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1271 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:45.367060 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-02dd594f-a6c7-416d-9525-5bfe3dce8117 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:45.367674 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-02dd594f-a6c7-416d-9525-5bfe3dce8117 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:45.374827 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02dd594f-a6c7-416d-9525-5bfe3dce8117 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:45.375274 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02dd594f-a6c7-416d-9525-5bfe3dce8117 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:45.376058 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02dd594f-a6c7-416d-9525-5bfe3dce8117 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:45.376468 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02dd594f-a6c7-416d-9525-5bfe3dce8117 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:45.537671 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-02dd594f-a6c7-416d-9525-5bfe3dce8117 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:45.547147 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-02dd594f-a6c7-416d-9525-5bfe3dce8117 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1259 microversion: 2.1 time: 0.184236 Aug 04 17:55:45.547747 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3612/7117] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:45 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1259 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:46.570774 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-93806ffe-d46f-4a4f-85d9-aaa6305b6e02 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:46.571694 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-93806ffe-d46f-4a4f-85d9-aaa6305b6e02 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:46.580301 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-93806ffe-d46f-4a4f-85d9-aaa6305b6e02 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:46.580762 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-93806ffe-d46f-4a4f-85d9-aaa6305b6e02 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:46.581580 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-93806ffe-d46f-4a4f-85d9-aaa6305b6e02 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:46.582019 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-93806ffe-d46f-4a4f-85d9-aaa6305b6e02 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:46.736986 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-93806ffe-d46f-4a4f-85d9-aaa6305b6e02 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:46.747507 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-93806ffe-d46f-4a4f-85d9-aaa6305b6e02 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1259 microversion: 2.1 time: 0.182936 Aug 04 17:55:46.748133 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3506/7118] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:46 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:47.768418 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-65a2a98d-b5e7-4a8d-89e1-76c5c0bab77e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:47.769057 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-65a2a98d-b5e7-4a8d-89e1-76c5c0bab77e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:47.776769 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-65a2a98d-b5e7-4a8d-89e1-76c5c0bab77e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:47.777225 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-65a2a98d-b5e7-4a8d-89e1-76c5c0bab77e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:47.778353 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-65a2a98d-b5e7-4a8d-89e1-76c5c0bab77e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:47.779105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-65a2a98d-b5e7-4a8d-89e1-76c5c0bab77e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:47.779909 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:55:47.804262 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=6 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:55:47.935955 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-65a2a98d-b5e7-4a8d-89e1-76c5c0bab77e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:47.944125 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-65a2a98d-b5e7-4a8d-89e1-76c5c0bab77e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1259 microversion: 2.1 time: 0.179711 Aug 04 17:55:47.944702 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3613/7119] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:47 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:48.975002 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-57270949-6237-4594-82a4-21d7f9f2be1c tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:48.975764 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-57270949-6237-4594-82a4-21d7f9f2be1c tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:48.978953 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:55:48.984779 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-57270949-6237-4594-82a4-21d7f9f2be1c tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:48.985238 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-57270949-6237-4594-82a4-21d7f9f2be1c tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:48.986058 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-57270949-6237-4594-82a4-21d7f9f2be1c tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:48.986502 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-57270949-6237-4594-82a4-21d7f9f2be1c tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:49.149019 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-57270949-6237-4594-82a4-21d7f9f2be1c tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:49.160865 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-57270949-6237-4594-82a4-21d7f9f2be1c tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1259 microversion: 2.1 time: 0.191450 Aug 04 17:55:49.161566 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3507/7120] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:48 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1259 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:50.187058 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e9954b00-fd09-4a15-bb14-a4d8bb74c3ba tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:50.187965 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e9954b00-fd09-4a15-bb14-a4d8bb74c3ba tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:50.195591 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e9954b00-fd09-4a15-bb14-a4d8bb74c3ba tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:50.195957 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e9954b00-fd09-4a15-bb14-a4d8bb74c3ba tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:50.196769 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e9954b00-fd09-4a15-bb14-a4d8bb74c3ba tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:50.197200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e9954b00-fd09-4a15-bb14-a4d8bb74c3ba tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:50.347402 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e9954b00-fd09-4a15-bb14-a4d8bb74c3ba tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:50.356122 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e9954b00-fd09-4a15-bb14-a4d8bb74c3ba tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1259 microversion: 2.1 time: 0.174845 Aug 04 17:55:50.356959 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3614/7121] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:50 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:51.376920 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-c8a0287c-4d89-4620-bc83-cdcf8af54adb tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:51.377800 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-c8a0287c-4d89-4620-bc83-cdcf8af54adb tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:51.389224 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c8a0287c-4d89-4620-bc83-cdcf8af54adb tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:51.389784 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c8a0287c-4d89-4620-bc83-cdcf8af54adb tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:51.390587 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c8a0287c-4d89-4620-bc83-cdcf8af54adb tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:51.391007 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-c8a0287c-4d89-4620-bc83-cdcf8af54adb tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:51.538443 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-c8a0287c-4d89-4620-bc83-cdcf8af54adb tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:51.548561 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-c8a0287c-4d89-4620-bc83-cdcf8af54adb tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1259 microversion: 2.1 time: 0.176191 Aug 04 17:55:51.549541 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3508/7122] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:51 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:52.570455 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7d2719f0-15a6-4433-87ac-46d559e69fdf tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:52.571273 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7d2719f0-15a6-4433-87ac-46d559e69fdf tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:52.581481 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d2719f0-15a6-4433-87ac-46d559e69fdf tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:52.582102 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d2719f0-15a6-4433-87ac-46d559e69fdf tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:52.582944 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d2719f0-15a6-4433-87ac-46d559e69fdf tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:52.583505 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7d2719f0-15a6-4433-87ac-46d559e69fdf tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:52.735633 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7d2719f0-15a6-4433-87ac-46d559e69fdf tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:52.743867 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7d2719f0-15a6-4433-87ac-46d559e69fdf tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1259 microversion: 2.1 time: 0.179052 Aug 04 17:55:52.744467 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3615/7123] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:52 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:53.767672 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-2984543a-217c-4434-94a5-45c7cfcfe616 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:53.768255 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-2984543a-217c-4434-94a5-45c7cfcfe616 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:53.776629 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2984543a-217c-4434-94a5-45c7cfcfe616 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:53.777093 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2984543a-217c-4434-94a5-45c7cfcfe616 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:53.777890 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2984543a-217c-4434-94a5-45c7cfcfe616 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:53.778392 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-2984543a-217c-4434-94a5-45c7cfcfe616 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:53.931175 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-2984543a-217c-4434-94a5-45c7cfcfe616 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:53.946442 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-2984543a-217c-4434-94a5-45c7cfcfe616 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1259 microversion: 2.1 time: 0.184018 Aug 04 17:55:53.947044 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3509/7124] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:53 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1259 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:54.421994 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-a920ab57-cd79-40b2-aaab-9847f0bf57c1 req-2f46a6b1-08a3-4b8b-aa9b-7c871e642f49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b012e5d-40a4-42da-af15-8fcb5484fb99", "name": "network-vif-plugged", "status": "completed", "tag": "4d60c9e3-03c5-47a5-bf96-19d4a966b516"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:55:54.433132 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-a920ab57-cd79-40b2-aaab-9847f0bf57c1 req-2f46a6b1-08a3-4b8b-aa9b-7c871e642f49 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:54.433630 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-a920ab57-cd79-40b2-aaab-9847f0bf57c1 req-2f46a6b1-08a3-4b8b-aa9b-7c871e642f49 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:54.445999 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-a920ab57-cd79-40b2-aaab-9847f0bf57c1 req-2f46a6b1-08a3-4b8b-aa9b-7c871e642f49 service nova] Creating event network-vif-plugged:4d60c9e3-03c5-47a5-bf96-19d4a966b516 for instance 4b012e5d-40a4-42da-af15-8fcb5484fb99 on n-h2-846466-12 Aug 04 17:55:54.451015 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-a920ab57-cd79-40b2-aaab-9847f0bf57c1 req-2f46a6b1-08a3-4b8b-aa9b-7c871e642f49 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033162 Aug 04 17:55:54.452189 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3616/7125] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:55:54.969564 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1ed1c67e-9e0e-4199-8abb-f54d3b4b7d4b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:54.970284 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1ed1c67e-9e0e-4199-8abb-f54d3b4b7d4b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:54.977862 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1ed1c67e-9e0e-4199-8abb-f54d3b4b7d4b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:54.978314 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1ed1c67e-9e0e-4199-8abb-f54d3b4b7d4b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:54.979077 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1ed1c67e-9e0e-4199-8abb-f54d3b4b7d4b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:54.979485 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1ed1c67e-9e0e-4199-8abb-f54d3b4b7d4b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:55.126892 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1ed1c67e-9e0e-4199-8abb-f54d3b4b7d4b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:55.134965 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1ed1c67e-9e0e-4199-8abb-f54d3b4b7d4b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1259 microversion: 2.1 time: 0.169761 Aug 04 17:55:55.135546 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3510/7126] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:54 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:56.162462 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-21f5bd54-a108-4f4d-867e-2b392744b419 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:56.163471 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-21f5bd54-a108-4f4d-867e-2b392744b419 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:56.173456 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-21f5bd54-a108-4f4d-867e-2b392744b419 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:56.173930 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-21f5bd54-a108-4f4d-867e-2b392744b419 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:56.174713 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-21f5bd54-a108-4f4d-867e-2b392744b419 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:56.175142 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-21f5bd54-a108-4f4d-867e-2b392744b419 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:56.323318 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-21f5bd54-a108-4f4d-867e-2b392744b419 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:56.331638 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-21f5bd54-a108-4f4d-867e-2b392744b419 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1442 microversion: 2.1 time: 0.177015 Aug 04 17:55:56.332266 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3617/7127] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:56 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1442 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:56.355166 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-77e735e4-61d4-469e-a9f8-6ed167707456 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:56.355752 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-77e735e4-61d4-469e-a9f8-6ed167707456 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:56.366983 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-77e735e4-61d4-469e-a9f8-6ed167707456 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:56.367649 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-77e735e4-61d4-469e-a9f8-6ed167707456 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:56.368734 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-77e735e4-61d4-469e-a9f8-6ed167707456 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:56.369343 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-77e735e4-61d4-469e-a9f8-6ed167707456 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:56.518585 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-77e735e4-61d4-469e-a9f8-6ed167707456 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:56.527765 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-77e735e4-61d4-469e-a9f8-6ed167707456 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1442 microversion: 2.1 time: 0.179044 Aug 04 17:55:56.528351 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3511/7128] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:56 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1442 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:55:58.551148 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-d5fe60ff-d85b-4269-a1e0-32da42b2beed req-aefb7559-b422-42ec-bb3b-67cc2eb3c610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b012e5d-40a4-42da-af15-8fcb5484fb99", "tag": "4d60c9e3-03c5-47a5-bf96-19d4a966b516"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:55:58.561530 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-d5fe60ff-d85b-4269-a1e0-32da42b2beed req-aefb7559-b422-42ec-bb3b-67cc2eb3c610 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:55:58.561967 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-d5fe60ff-d85b-4269-a1e0-32da42b2beed req-aefb7559-b422-42ec-bb3b-67cc2eb3c610 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:55:58.573817 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-d5fe60ff-d85b-4269-a1e0-32da42b2beed req-aefb7559-b422-42ec-bb3b-67cc2eb3c610 service nova] Creating event network-changed:4d60c9e3-03c5-47a5-bf96-19d4a966b516 for instance 4b012e5d-40a4-42da-af15-8fcb5484fb99 on n-h2-846466-12 Aug 04 17:55:58.579109 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-d5fe60ff-d85b-4269-a1e0-32da42b2beed req-aefb7559-b422-42ec-bb3b-67cc2eb3c610 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031580 Aug 04 17:55:58.579776 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3618/7129] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:57:54.773984 n-d-846466-12 devstack@n-api.service[126126]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a8e78df9-6788-4147-abd6-cf6b1b6d2122] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 17:57:54.775216 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=22 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:57:54.776037 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=54 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:57:54.843118 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-082ad61c-53a0-45b1-b47f-13285e614d06 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:57:54.843660 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-082ad61c-53a0-45b1-b47f-13285e614d06 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:54.850536 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-082ad61c-53a0-45b1-b47f-13285e614d06 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:57:54.850992 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-082ad61c-53a0-45b1-b47f-13285e614d06 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:57:54.851782 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-082ad61c-53a0-45b1-b47f-13285e614d06 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:57:54.852471 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-082ad61c-53a0-45b1-b47f-13285e614d06 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:57:54.877133 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.objects.instance [None req-082ad61c-53a0-45b1-b47f-13285e614d06 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lazy-loading 'flavor' on Instance uuid 4b012e5d-40a4-42da-af15-8fcb5484fb99 {{(pid=126126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:57:54.955749 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-082ad61c-53a0-45b1-b47f-13285e614d06 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "POST /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99/action" status: 202 len: 0 microversion: 2.1 time: 0.184331 Aug 04 17:57:54.956359 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3512/7130] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:57:54 2022] POST /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:57:54.963401 n-d-846466-12 devstack@n-api.service[126125]: ERROR oslo.messaging._drivers.impl_rabbit [-] [97b8321f-6d0d-4fc2-ae68-3784c532bfbe] AMQP server on 10.222.0.23:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 04 17:57:54.964197 n-d-846466-12 devstack@n-api.service[126125]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c495d468-47e4-4499-8c55-19f21dc1fcfb] AMQP server on 10.222.0.23:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 04 17:57:54.964740 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:57:54.965530 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=50 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:57:54.970204 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-55787bc8-434d-4f68-94c4-c829b337d4c8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:54.970919 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-55787bc8-434d-4f68-94c4-c829b337d4c8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:54.978859 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-55787bc8-434d-4f68-94c4-c829b337d4c8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:57:54.979309 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-55787bc8-434d-4f68-94c4-c829b337d4c8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:57:54.980148 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-55787bc8-434d-4f68-94c4-c829b337d4c8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:57:54.980605 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-55787bc8-434d-4f68-94c4-c829b337d4c8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:57:55.130071 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-55787bc8-434d-4f68-94c4-c829b337d4c8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:55.138680 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-55787bc8-434d-4f68-94c4-c829b337d4c8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1567 microversion: 2.1 time: 0.177517 Aug 04 17:57:55.139263 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3619/7131] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:54 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:57:56.163650 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-df633b2c-2cb1-4aa3-976d-8cf8747f19b7 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:56.164307 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-df633b2c-2cb1-4aa3-976d-8cf8747f19b7 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:56.172076 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-df633b2c-2cb1-4aa3-976d-8cf8747f19b7 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:57:56.172525 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-df633b2c-2cb1-4aa3-976d-8cf8747f19b7 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:57:56.173312 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-df633b2c-2cb1-4aa3-976d-8cf8747f19b7 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:57:56.173768 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-df633b2c-2cb1-4aa3-976d-8cf8747f19b7 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:57:56.180223 n-d-846466-12 devstack@n-api.service[126126]: INFO oslo.messaging._drivers.impl_rabbit [-] [a8e78df9-6788-4147-abd6-cf6b1b6d2122] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 40410. Aug 04 17:57:56.318283 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-df633b2c-2cb1-4aa3-976d-8cf8747f19b7 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:56.327290 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-df633b2c-2cb1-4aa3-976d-8cf8747f19b7 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1567 microversion: 2.1 time: 0.169242 Aug 04 17:57:56.328114 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3513/7132] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:56 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:57:57.348442 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-af05d183-3be0-4a07-80b8-f50ac145ac29 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:57.349069 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-af05d183-3be0-4a07-80b8-f50ac145ac29 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:57.358628 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-af05d183-3be0-4a07-80b8-f50ac145ac29 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:57:57.359067 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-af05d183-3be0-4a07-80b8-f50ac145ac29 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:57:57.359820 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-af05d183-3be0-4a07-80b8-f50ac145ac29 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:57:57.360267 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-af05d183-3be0-4a07-80b8-f50ac145ac29 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:57:57.365335 n-d-846466-12 devstack@n-api.service[126125]: INFO oslo.messaging._drivers.impl_rabbit [-] [97b8321f-6d0d-4fc2-ae68-3784c532bfbe] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 40414. Aug 04 17:57:57.367622 n-d-846466-12 devstack@n-api.service[126125]: INFO oslo.messaging._drivers.impl_rabbit [-] [c495d468-47e4-4499-8c55-19f21dc1fcfb] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 40416. Aug 04 17:57:57.504220 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-af05d183-3be0-4a07-80b8-f50ac145ac29 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:57.513751 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-af05d183-3be0-4a07-80b8-f50ac145ac29 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1567 microversion: 2.1 time: 0.169174 Aug 04 17:57:57.514410 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3620/7133] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:57 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:57:58.536106 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-caba2498-ce04-4901-9762-c0d4891332c8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:58.536755 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-caba2498-ce04-4901-9762-c0d4891332c8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:58.544278 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-caba2498-ce04-4901-9762-c0d4891332c8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:57:58.544712 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-caba2498-ce04-4901-9762-c0d4891332c8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:57:58.545565 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-caba2498-ce04-4901-9762-c0d4891332c8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:57:58.545983 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-caba2498-ce04-4901-9762-c0d4891332c8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:57:58.688998 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-caba2498-ce04-4901-9762-c0d4891332c8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:58.697191 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-caba2498-ce04-4901-9762-c0d4891332c8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1567 microversion: 2.1 time: 0.165083 Aug 04 17:57:58.697819 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3514/7134] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:58 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:57:59.718726 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-3bf9d03b-b019-4368-bc6e-0353a4738ee3 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:59.719334 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-3bf9d03b-b019-4368-bc6e-0353a4738ee3 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:59.726245 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3bf9d03b-b019-4368-bc6e-0353a4738ee3 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:57:59.726683 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3bf9d03b-b019-4368-bc6e-0353a4738ee3 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:57:59.727489 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3bf9d03b-b019-4368-bc6e-0353a4738ee3 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:57:59.727930 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-3bf9d03b-b019-4368-bc6e-0353a4738ee3 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:57:59.864925 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-3bf9d03b-b019-4368-bc6e-0353a4738ee3 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:59.873101 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-3bf9d03b-b019-4368-bc6e-0353a4738ee3 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1567 microversion: 2.1 time: 0.158334 Aug 04 17:57:59.873708 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3621/7135] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:59 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:58:00.893714 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f57fccd4-a347-4500-9bfc-dcd4288e6efb tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:58:00.894378 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f57fccd4-a347-4500-9bfc-dcd4288e6efb tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:58:00.902320 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f57fccd4-a347-4500-9bfc-dcd4288e6efb tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:00.902788 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f57fccd4-a347-4500-9bfc-dcd4288e6efb tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:00.903551 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f57fccd4-a347-4500-9bfc-dcd4288e6efb tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:00.904019 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-f57fccd4-a347-4500-9bfc-dcd4288e6efb tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:01.052978 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f57fccd4-a347-4500-9bfc-dcd4288e6efb tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:58:01.062052 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f57fccd4-a347-4500-9bfc-dcd4288e6efb tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1567 microversion: 2.1 time: 0.172359 Aug 04 17:58:01.062641 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3515/7136] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:58:00 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:58:02.085300 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-41726f67-393c-44cf-aaa5-fbd6a4db5f40 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:58:02.085923 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-41726f67-393c-44cf-aaa5-fbd6a4db5f40 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:58:02.094567 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-41726f67-393c-44cf-aaa5-fbd6a4db5f40 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:02.095015 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-41726f67-393c-44cf-aaa5-fbd6a4db5f40 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:02.096160 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-41726f67-393c-44cf-aaa5-fbd6a4db5f40 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:02.096603 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-41726f67-393c-44cf-aaa5-fbd6a4db5f40 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:02.256143 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-41726f67-393c-44cf-aaa5-fbd6a4db5f40 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:58:02.269158 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-41726f67-393c-44cf-aaa5-fbd6a4db5f40 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1567 microversion: 2.1 time: 0.189078 Aug 04 17:58:02.270258 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3622/7137] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:58:02 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:58:03.295699 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-8c4df034-9137-44c8-8341-a4a4b650686e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:58:03.296706 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-8c4df034-9137-44c8-8341-a4a4b650686e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:58:03.309349 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8c4df034-9137-44c8-8341-a4a4b650686e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:03.310135 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8c4df034-9137-44c8-8341-a4a4b650686e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:03.311515 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8c4df034-9137-44c8-8341-a4a4b650686e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:03.312122 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-8c4df034-9137-44c8-8341-a4a4b650686e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:03.468768 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-8c4df034-9137-44c8-8341-a4a4b650686e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:58:03.476972 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-8c4df034-9137-44c8-8341-a4a4b650686e tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1567 microversion: 2.1 time: 0.187665 Aug 04 17:58:03.477682 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3516/7138] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:58:03 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:58:04.499351 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-33085c25-e37c-447a-b29a-cd5ffa7f50f1 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:58:04.500256 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-33085c25-e37c-447a-b29a-cd5ffa7f50f1 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:58:04.507469 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-33085c25-e37c-447a-b29a-cd5ffa7f50f1 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:04.507905 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-33085c25-e37c-447a-b29a-cd5ffa7f50f1 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:04.508810 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-33085c25-e37c-447a-b29a-cd5ffa7f50f1 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:04.509248 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-33085c25-e37c-447a-b29a-cd5ffa7f50f1 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:04.674550 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-33085c25-e37c-447a-b29a-cd5ffa7f50f1 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:58:04.683436 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-33085c25-e37c-447a-b29a-cd5ffa7f50f1 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1567 microversion: 2.1 time: 0.188014 Aug 04 17:58:04.684069 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3623/7139] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:58:04 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:58:05.715209 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-436a1797-c3f4-4242-9b96-7a197d992085 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:58:05.716499 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-436a1797-c3f4-4242-9b96-7a197d992085 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:58:05.731217 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-436a1797-c3f4-4242-9b96-7a197d992085 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:05.731987 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-436a1797-c3f4-4242-9b96-7a197d992085 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:05.733116 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-436a1797-c3f4-4242-9b96-7a197d992085 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:05.733612 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-436a1797-c3f4-4242-9b96-7a197d992085 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:05.919469 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-436a1797-c3f4-4242-9b96-7a197d992085 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:58:05.928290 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-436a1797-c3f4-4242-9b96-7a197d992085 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1567 microversion: 2.1 time: 0.224555 Aug 04 17:58:05.928902 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3517/7140] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:58:05 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1567 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:58:06.953244 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4c2548dd-90f1-43f3-9f56-50b7d7cb681a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:58:06.953948 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4c2548dd-90f1-43f3-9f56-50b7d7cb681a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:58:06.961102 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4c2548dd-90f1-43f3-9f56-50b7d7cb681a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:06.961775 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4c2548dd-90f1-43f3-9f56-50b7d7cb681a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:06.963081 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4c2548dd-90f1-43f3-9f56-50b7d7cb681a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:06.963507 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4c2548dd-90f1-43f3-9f56-50b7d7cb681a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:07.522113 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4c2548dd-90f1-43f3-9f56-50b7d7cb681a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:58:07.535438 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4c2548dd-90f1-43f3-9f56-50b7d7cb681a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1567 microversion: 2.1 time: 0.585709 Aug 04 17:58:07.536918 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3624/7141] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:58:06 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1567 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:58:08.562121 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6ec39368-356a-40eb-ba42-3701c225a637 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:58:08.563064 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6ec39368-356a-40eb-ba42-3701c225a637 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:58:08.569670 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6ec39368-356a-40eb-ba42-3701c225a637 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:08.570147 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6ec39368-356a-40eb-ba42-3701c225a637 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:08.571022 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6ec39368-356a-40eb-ba42-3701c225a637 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:08.571480 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6ec39368-356a-40eb-ba42-3701c225a637 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:08.755822 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6ec39368-356a-40eb-ba42-3701c225a637 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:58:08.767257 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6ec39368-356a-40eb-ba42-3701c225a637 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1567 microversion: 2.1 time: 0.210347 Aug 04 17:58:08.776939 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3518/7142] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:58:08 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1567 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:58:09.800846 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e56842e6-fad4-45f0-af14-b02643f978db tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:58:09.801534 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e56842e6-fad4-45f0-af14-b02643f978db tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:58:09.809276 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e56842e6-fad4-45f0-af14-b02643f978db tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:09.809749 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e56842e6-fad4-45f0-af14-b02643f978db tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:09.810530 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e56842e6-fad4-45f0-af14-b02643f978db tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:09.810967 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e56842e6-fad4-45f0-af14-b02643f978db tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:09.963453 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e56842e6-fad4-45f0-af14-b02643f978db tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:58:09.972963 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e56842e6-fad4-45f0-af14-b02643f978db tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1508 microversion: 2.1 time: 0.176018 Aug 04 17:58:09.973680 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3625/7143] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:58:09 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:58:09.998375 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6d97abe1-5604-4aef-aaf9-d573add4cdc8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:58:09.999335 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6d97abe1-5604-4aef-aaf9-d573add4cdc8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:58:10.010892 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d97abe1-5604-4aef-aaf9-d573add4cdc8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:10.011599 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d97abe1-5604-4aef-aaf9-d573add4cdc8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:10.012769 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d97abe1-5604-4aef-aaf9-d573add4cdc8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:10.013437 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6d97abe1-5604-4aef-aaf9-d573add4cdc8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:10.052338 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6d97abe1-5604-4aef-aaf9-d573add4cdc8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126126) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 17:58:10.136653 n-d-846466-12 devstack@n-api.service[126126]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6d97abe1-5604-4aef-aaf9-d573add4cdc8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [c6fb61ca-3cc4-42ba-a752-9537fad422ca] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 17:58:11.115524 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-7970c5b3-78a6-4c2f-aacc-a92d0cc72cfb req-924f5234-02dd-41ff-8f9b-c269ee669422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b012e5d-40a4-42da-af15-8fcb5484fb99", "name": "network-vif-unplugged", "status": "completed", "tag": "4d60c9e3-03c5-47a5-bf96-19d4a966b516"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:58:11.126277 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7970c5b3-78a6-4c2f-aacc-a92d0cc72cfb req-924f5234-02dd-41ff-8f9b-c269ee669422 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:11.126732 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-7970c5b3-78a6-4c2f-aacc-a92d0cc72cfb req-924f5234-02dd-41ff-8f9b-c269ee669422 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:11.143564 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.compute.server_external_events [req-7970c5b3-78a6-4c2f-aacc-a92d0cc72cfb req-924f5234-02dd-41ff-8f9b-c269ee669422 service nova] Unable to find a host for instance 4b012e5d-40a4-42da-af15-8fcb5484fb99. Dropping event network-vif-unplugged {{(pid=126125) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 04 17:58:11.143957 n-d-846466-12 devstack@n-api.service[126126]: INFO oslo.messaging._drivers.impl_rabbit [None req-6d97abe1-5604-4aef-aaf9-d573add4cdc8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [c6fb61ca-3cc4-42ba-a752-9537fad422ca] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 40446. Aug 04 17:58:11.144941 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-7970c5b3-78a6-4c2f-aacc-a92d0cc72cfb req-924f5234-02dd-41ff-8f9b-c269ee669422 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032933 Aug 04 17:58:11.146856 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3626/7144] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 04 17:58:11.147969 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6d97abe1-5604-4aef-aaf9-d573add4cdc8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "POST /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99/action" status: 202 len: 0 microversion: 2.1 time: 1.156485 Aug 04 17:58:11.150020 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3519/7145] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 17:58:09 2022] POST /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99/action => generated 0 bytes in 1159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:58:11.158791 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dbbf40be-a546-4ec1-bbb6-7514d3635025 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:58:11.160551 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dbbf40be-a546-4ec1-bbb6-7514d3635025 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:58:11.169028 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dbbf40be-a546-4ec1-bbb6-7514d3635025 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:11.169631 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dbbf40be-a546-4ec1-bbb6-7514d3635025 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:11.170396 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dbbf40be-a546-4ec1-bbb6-7514d3635025 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:11.170878 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dbbf40be-a546-4ec1-bbb6-7514d3635025 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:11.309893 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-dbbf40be-a546-4ec1-bbb6-7514d3635025 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:58:11.317819 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dbbf40be-a546-4ec1-bbb6-7514d3635025 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1516 microversion: 2.1 time: 0.163916 Aug 04 17:58:11.318398 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3627/7146] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:58:11 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:58:12.343734 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1c020320-5e76-4e8d-a0cc-2104e430fbd3 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:58:12.344798 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1c020320-5e76-4e8d-a0cc-2104e430fbd3 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:58:12.355078 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c020320-5e76-4e8d-a0cc-2104e430fbd3 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:12.355871 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c020320-5e76-4e8d-a0cc-2104e430fbd3 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:12.356758 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c020320-5e76-4e8d-a0cc-2104e430fbd3 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:12.357221 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c020320-5e76-4e8d-a0cc-2104e430fbd3 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:12.514721 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1c020320-5e76-4e8d-a0cc-2104e430fbd3 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:58:12.526584 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1c020320-5e76-4e8d-a0cc-2104e430fbd3 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1518 microversion: 2.1 time: 0.190757 Aug 04 17:58:12.527082 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3520/7147] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:58:12 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1518 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:58:13.553188 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-34419907-6f5a-4370-8378-0aaa836a8cdd tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:58:13.554276 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-34419907-6f5a-4370-8378-0aaa836a8cdd tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:58:13.575059 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-34419907-6f5a-4370-8378-0aaa836a8cdd tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:13.575934 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-34419907-6f5a-4370-8378-0aaa836a8cdd tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:13.577429 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-34419907-6f5a-4370-8378-0aaa836a8cdd tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:13.578158 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-34419907-6f5a-4370-8378-0aaa836a8cdd tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:13.775887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-34419907-6f5a-4370-8378-0aaa836a8cdd tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:58:13.786732 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-34419907-6f5a-4370-8378-0aaa836a8cdd tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1518 microversion: 2.1 time: 0.240682 Aug 04 17:58:13.787519 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3628/7148] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:58:13 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1518 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:58:14.813860 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1842e824-184c-4f8e-9f68-b16bb48999a8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:58:14.814482 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1842e824-184c-4f8e-9f68-b16bb48999a8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:58:14.822022 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1842e824-184c-4f8e-9f68-b16bb48999a8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:14.822481 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1842e824-184c-4f8e-9f68-b16bb48999a8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:14.823291 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1842e824-184c-4f8e-9f68-b16bb48999a8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:14.823740 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1842e824-184c-4f8e-9f68-b16bb48999a8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:14.974719 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1842e824-184c-4f8e-9f68-b16bb48999a8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:58:14.983322 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1842e824-184c-4f8e-9f68-b16bb48999a8 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1518 microversion: 2.1 time: 0.174438 Aug 04 17:58:14.984033 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3521/7149] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:58:14 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1518 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:58:16.005637 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a580b5ed-2bde-43e7-a953-b21be69505be tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:58:16.006603 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a580b5ed-2bde-43e7-a953-b21be69505be tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:58:16.013876 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a580b5ed-2bde-43e7-a953-b21be69505be tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:16.014280 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a580b5ed-2bde-43e7-a953-b21be69505be tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:16.015076 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a580b5ed-2bde-43e7-a953-b21be69505be tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:16.015503 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a580b5ed-2bde-43e7-a953-b21be69505be tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:16.182014 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a580b5ed-2bde-43e7-a953-b21be69505be tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:58:16.196293 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a580b5ed-2bde-43e7-a953-b21be69505be tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1518 microversion: 2.1 time: 0.194656 Aug 04 17:58:16.197705 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3629/7150] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:58:16 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1518 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:58:17.231736 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cd73dc1f-04e2-405b-9854-a2dc78aba2a0 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:58:17.233004 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cd73dc1f-04e2-405b-9854-a2dc78aba2a0 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:58:17.241609 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cd73dc1f-04e2-405b-9854-a2dc78aba2a0 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:17.242311 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cd73dc1f-04e2-405b-9854-a2dc78aba2a0 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:17.244816 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cd73dc1f-04e2-405b-9854-a2dc78aba2a0 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:17.245725 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cd73dc1f-04e2-405b-9854-a2dc78aba2a0 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:17.389851 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cd73dc1f-04e2-405b-9854-a2dc78aba2a0 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:58:17.398118 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cd73dc1f-04e2-405b-9854-a2dc78aba2a0 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1574 microversion: 2.1 time: 0.170561 Aug 04 17:58:17.399355 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3522/7151] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:58:17 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:58:18.421773 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-611e5790-bb22-4b09-89fc-b4b02461212f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:58:18.423067 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-611e5790-bb22-4b09-89fc-b4b02461212f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:58:18.431204 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-611e5790-bb22-4b09-89fc-b4b02461212f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:18.431753 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-611e5790-bb22-4b09-89fc-b4b02461212f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:18.432614 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-611e5790-bb22-4b09-89fc-b4b02461212f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:18.433124 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-611e5790-bb22-4b09-89fc-b4b02461212f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:18.444657 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-493d9025-d546-4e3d-94fd-2e818d495aee req-5408a6d1-b035-4aa1-b9ef-defab1389c17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b012e5d-40a4-42da-af15-8fcb5484fb99", "tag": "4d60c9e3-03c5-47a5-bf96-19d4a966b516"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:58:18.462939 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-493d9025-d546-4e3d-94fd-2e818d495aee req-5408a6d1-b035-4aa1-b9ef-defab1389c17 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:18.463377 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-493d9025-d546-4e3d-94fd-2e818d495aee req-5408a6d1-b035-4aa1-b9ef-defab1389c17 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:18.476399 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-493d9025-d546-4e3d-94fd-2e818d495aee req-5408a6d1-b035-4aa1-b9ef-defab1389c17 service nova] Creating event network-changed:4d60c9e3-03c5-47a5-bf96-19d4a966b516 for instance 4b012e5d-40a4-42da-af15-8fcb5484fb99 on n-h1-846466-12 Aug 04 17:58:18.482168 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-493d9025-d546-4e3d-94fd-2e818d495aee req-5408a6d1-b035-4aa1-b9ef-defab1389c17 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042180 Aug 04 17:58:18.482793 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3523/7152] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:58:18.705896 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-611e5790-bb22-4b09-89fc-b4b02461212f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:58:18.714541 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-611e5790-bb22-4b09-89fc-b4b02461212f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1574 microversion: 2.1 time: 0.298158 Aug 04 17:58:18.715109 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3630/7153] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:58:18 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1574 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:58:19.738381 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-18566d9f-f8ea-4321-96aa-99d1837fb6cc tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:58:19.739447 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-18566d9f-f8ea-4321-96aa-99d1837fb6cc tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:58:19.747660 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-18566d9f-f8ea-4321-96aa-99d1837fb6cc tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:19.748102 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-18566d9f-f8ea-4321-96aa-99d1837fb6cc tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:19.748906 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-18566d9f-f8ea-4321-96aa-99d1837fb6cc tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:19.749410 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-18566d9f-f8ea-4321-96aa-99d1837fb6cc tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:20.016574 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-18566d9f-f8ea-4321-96aa-99d1837fb6cc tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:58:20.025956 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-18566d9f-f8ea-4321-96aa-99d1837fb6cc tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1574 microversion: 2.1 time: 0.293036 Aug 04 17:58:20.029729 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3524/7154] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:58:19 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1574 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:58:21.048694 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-77e9de77-0ebf-4f52-9d3d-8b0a871e424a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:58:21.049417 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-77e9de77-0ebf-4f52-9d3d-8b0a871e424a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:58:21.057205 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-77e9de77-0ebf-4f52-9d3d-8b0a871e424a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:21.057679 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-77e9de77-0ebf-4f52-9d3d-8b0a871e424a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:21.058464 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-77e9de77-0ebf-4f52-9d3d-8b0a871e424a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:21.058895 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-77e9de77-0ebf-4f52-9d3d-8b0a871e424a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:21.231838 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-77e9de77-0ebf-4f52-9d3d-8b0a871e424a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:58:21.241584 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-77e9de77-0ebf-4f52-9d3d-8b0a871e424a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1574 microversion: 2.1 time: 0.197632 Aug 04 17:58:21.242178 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3631/7155] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:58:21 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1574 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:58:22.264827 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fde3d6db-5734-4c2f-ba67-e2b57948f766 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:58:22.265492 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fde3d6db-5734-4c2f-ba67-e2b57948f766 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:58:22.272934 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fde3d6db-5734-4c2f-ba67-e2b57948f766 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:22.273882 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fde3d6db-5734-4c2f-ba67-e2b57948f766 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:22.274938 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fde3d6db-5734-4c2f-ba67-e2b57948f766 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:22.275382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fde3d6db-5734-4c2f-ba67-e2b57948f766 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:22.452119 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fde3d6db-5734-4c2f-ba67-e2b57948f766 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:58:22.460063 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fde3d6db-5734-4c2f-ba67-e2b57948f766 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1574 microversion: 2.1 time: 0.199476 Aug 04 17:58:22.460641 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3525/7156] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:58:22 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1574 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:58:23.484244 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f3393cf9-2def-4e67-b0ee-f375942faf73 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:58:23.484887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f3393cf9-2def-4e67-b0ee-f375942faf73 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:58:23.492420 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3393cf9-2def-4e67-b0ee-f375942faf73 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:23.492866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3393cf9-2def-4e67-b0ee-f375942faf73 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:23.493681 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3393cf9-2def-4e67-b0ee-f375942faf73 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:23.494105 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f3393cf9-2def-4e67-b0ee-f375942faf73 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:23.636529 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f3393cf9-2def-4e67-b0ee-f375942faf73 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:58:23.645888 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f3393cf9-2def-4e67-b0ee-f375942faf73 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1574 microversion: 2.1 time: 0.165229 Aug 04 17:58:23.646325 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3632/7157] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:58:23 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:58:24.667480 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-03e6949b-8321-4879-aa83-2ee28d574510 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:58:24.668072 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-03e6949b-8321-4879-aa83-2ee28d574510 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:58:24.675217 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03e6949b-8321-4879-aa83-2ee28d574510 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:24.675632 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03e6949b-8321-4879-aa83-2ee28d574510 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:24.676392 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03e6949b-8321-4879-aa83-2ee28d574510 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:24.676824 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-03e6949b-8321-4879-aa83-2ee28d574510 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:24.681547 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:58:24.833592 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-03e6949b-8321-4879-aa83-2ee28d574510 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:58:24.848855 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-03e6949b-8321-4879-aa83-2ee28d574510 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1574 microversion: 2.1 time: 0.184847 Aug 04 17:58:24.849945 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3526/7158] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:58:24 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1574 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:58:25.875488 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-967831c8-b34b-4cf0-9a59-37bdb055d4fc tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:58:25.876110 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-967831c8-b34b-4cf0-9a59-37bdb055d4fc tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:58:25.878884 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=29 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:58:25.885245 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-967831c8-b34b-4cf0-9a59-37bdb055d4fc tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:25.885718 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-967831c8-b34b-4cf0-9a59-37bdb055d4fc tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:25.886470 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-967831c8-b34b-4cf0-9a59-37bdb055d4fc tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:25.886918 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-967831c8-b34b-4cf0-9a59-37bdb055d4fc tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:25.889973 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=81 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:58:26.044224 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-967831c8-b34b-4cf0-9a59-37bdb055d4fc tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:58:26.052430 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-967831c8-b34b-4cf0-9a59-37bdb055d4fc tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1574 microversion: 2.1 time: 0.180803 Aug 04 17:58:26.053018 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3633/7159] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:58:25 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1574 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:58:27.077211 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-61cf37c2-7ffe-4f80-b4c3-a55396d4c96a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:58:27.077936 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-61cf37c2-7ffe-4f80-b4c3-a55396d4c96a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:58:27.080458 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:58:27.088441 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-61cf37c2-7ffe-4f80-b4c3-a55396d4c96a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:27.089034 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-61cf37c2-7ffe-4f80-b4c3-a55396d4c96a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:27.090087 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-61cf37c2-7ffe-4f80-b4c3-a55396d4c96a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:27.090853 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-61cf37c2-7ffe-4f80-b4c3-a55396d4c96a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:27.250907 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-61cf37c2-7ffe-4f80-b4c3-a55396d4c96a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:58:27.260980 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-61cf37c2-7ffe-4f80-b4c3-a55396d4c96a tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1574 microversion: 2.1 time: 0.188089 Aug 04 17:58:27.261614 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3527/7160] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:58:27 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1574 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:58:28.287313 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-87e8b894-c222-48ca-b2fd-a26ccbec61a6 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:58:28.289997 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-87e8b894-c222-48ca-b2fd-a26ccbec61a6 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:58:28.298281 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-87e8b894-c222-48ca-b2fd-a26ccbec61a6 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:28.299248 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-87e8b894-c222-48ca-b2fd-a26ccbec61a6 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:28.300290 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-87e8b894-c222-48ca-b2fd-a26ccbec61a6 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:28.300847 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-87e8b894-c222-48ca-b2fd-a26ccbec61a6 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:28.499714 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-87e8b894-c222-48ca-b2fd-a26ccbec61a6 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:58:28.517388 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-87e8b894-c222-48ca-b2fd-a26ccbec61a6 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1574 microversion: 2.1 time: 0.237036 Aug 04 17:58:28.518923 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3634/7161] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:58:28 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1574 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:58:28.603359 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-63ca689b-4556-44fd-ab85-370edae57966 req-8fa98eb8-f7c7-425e-b69e-665ff49fafa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b012e5d-40a4-42da-af15-8fcb5484fb99", "name": "network-vif-plugged", "status": "completed", "tag": "4d60c9e3-03c5-47a5-bf96-19d4a966b516"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:58:28.622516 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-63ca689b-4556-44fd-ab85-370edae57966 req-8fa98eb8-f7c7-425e-b69e-665ff49fafa8 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:28.623312 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-63ca689b-4556-44fd-ab85-370edae57966 req-8fa98eb8-f7c7-425e-b69e-665ff49fafa8 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:28.647782 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-63ca689b-4556-44fd-ab85-370edae57966 req-8fa98eb8-f7c7-425e-b69e-665ff49fafa8 service nova] Creating event network-vif-plugged:4d60c9e3-03c5-47a5-bf96-19d4a966b516 for instance 4b012e5d-40a4-42da-af15-8fcb5484fb99 on n-h1-846466-12 Aug 04 17:58:28.658049 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-63ca689b-4556-44fd-ab85-370edae57966 req-8fa98eb8-f7c7-425e-b69e-665ff49fafa8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160083 Aug 04 17:58:28.659117 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3528/7162] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:58:29.551754 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d2c7233a-112c-4fe1-854b-fa5abdffd4a2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:58:29.552322 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d2c7233a-112c-4fe1-854b-fa5abdffd4a2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:58:29.561318 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d2c7233a-112c-4fe1-854b-fa5abdffd4a2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:29.561777 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d2c7233a-112c-4fe1-854b-fa5abdffd4a2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:29.562569 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d2c7233a-112c-4fe1-854b-fa5abdffd4a2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:29.562998 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d2c7233a-112c-4fe1-854b-fa5abdffd4a2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:29.734569 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d2c7233a-112c-4fe1-854b-fa5abdffd4a2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:58:29.745331 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d2c7233a-112c-4fe1-854b-fa5abdffd4a2 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1574 microversion: 2.1 time: 0.197504 Aug 04 17:58:29.745957 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3635/7163] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:58:29 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1574 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:58:30.769312 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-29efb915-9c35-45d0-8144-d162a21c5a59 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:58:30.770018 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-29efb915-9c35-45d0-8144-d162a21c5a59 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:58:30.777186 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-29efb915-9c35-45d0-8144-d162a21c5a59 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:30.777666 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-29efb915-9c35-45d0-8144-d162a21c5a59 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:30.778429 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-29efb915-9c35-45d0-8144-d162a21c5a59 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:58:30.778885 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-29efb915-9c35-45d0-8144-d162a21c5a59 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:58:30.943635 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-29efb915-9c35-45d0-8144-d162a21c5a59 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:58:30.955672 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-29efb915-9c35-45d0-8144-d162a21c5a59 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1561 microversion: 2.1 time: 0.191238 Aug 04 17:58:30.956604 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3529/7164] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:58:30 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1561 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:58:56.061651 n-d-846466-12 devstack@n-api.service[126125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:58:56.061651 n-d-846466-12 devstack@n-api.service[126125]: Thu Aug 4 17:58:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 17:58:57.021050 n-d-846466-12 devstack@n-api.service[126125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:58:57.021322 n-d-846466-12 devstack@n-api.service[126125]: Thu Aug 4 17:58:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 17:59:50.678847 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=5 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:59:50.679731 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=17 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:59:50.682844 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=5 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:59:50.683852 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=18 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:59:50.684701 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-fbe0693c-7766-41f4-b752-428c9680454b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:50.685249 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fbe0693c-7766-41f4-b752-428c9680454b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:50.693805 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fbe0693c-7766-41f4-b752-428c9680454b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:59:50.694026 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fbe0693c-7766-41f4-b752-428c9680454b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:59:50.694800 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fbe0693c-7766-41f4-b752-428c9680454b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:59:50.695226 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-fbe0693c-7766-41f4-b752-428c9680454b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:59:50.726422 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-fbe0693c-7766-41f4-b752-428c9680454b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:59:50.744074 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-b66580a3-21d5-4c46-bc63-804504695048 req-79454a26-e1f7-429d-8087-4a8d787ad4da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b012e5d-40a4-42da-af15-8fcb5484fb99", "tag": "4d60c9e3-03c5-47a5-bf96-19d4a966b516"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:59:50.754538 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-b66580a3-21d5-4c46-bc63-804504695048 req-79454a26-e1f7-429d-8087-4a8d787ad4da service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:59:50.754982 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-b66580a3-21d5-4c46-bc63-804504695048 req-79454a26-e1f7-429d-8087-4a8d787ad4da service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:59:50.768593 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-b66580a3-21d5-4c46-bc63-804504695048 req-79454a26-e1f7-429d-8087-4a8d787ad4da service nova] Creating event network-changed:4d60c9e3-03c5-47a5-bf96-19d4a966b516 for instance 4b012e5d-40a4-42da-af15-8fcb5484fb99 on n-h1-846466-12 Aug 04 17:59:50.775148 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-b66580a3-21d5-4c46-bc63-804504695048 req-79454a26-e1f7-429d-8087-4a8d787ad4da service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094197 Aug 04 17:59:50.776166 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3530/7165] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:59:50.822094 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-fbe0693c-7766-41f4-b752-428c9680454b tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 204 len: 0 microversion: 2.1 time: 0.145365 Aug 04 17:59:50.823045 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3636/7166] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 17:59:50 2022] DELETE /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:59:50.834083 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-876e84a4-ddf0-4fe2-903f-bb337e683fe7 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:50.835684 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-876e84a4-ddf0-4fe2-903f-bb337e683fe7 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:50.843722 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-876e84a4-ddf0-4fe2-903f-bb337e683fe7 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:59:50.844177 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-876e84a4-ddf0-4fe2-903f-bb337e683fe7 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:59:50.845011 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-876e84a4-ddf0-4fe2-903f-bb337e683fe7 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:59:50.845504 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-876e84a4-ddf0-4fe2-903f-bb337e683fe7 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:59:50.994177 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-876e84a4-ddf0-4fe2-903f-bb337e683fe7 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:51.002229 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-876e84a4-ddf0-4fe2-903f-bb337e683fe7 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1567 microversion: 2.1 time: 0.172743 Aug 04 17:59:51.002870 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3531/7167] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:50 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:52.025168 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b73d3f27-aef4-428c-a9ce-324f9d810d16 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:52.025763 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b73d3f27-aef4-428c-a9ce-324f9d810d16 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:52.033407 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b73d3f27-aef4-428c-a9ce-324f9d810d16 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:59:52.033859 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b73d3f27-aef4-428c-a9ce-324f9d810d16 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:59:52.034642 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b73d3f27-aef4-428c-a9ce-324f9d810d16 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:59:52.035074 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b73d3f27-aef4-428c-a9ce-324f9d810d16 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:59:52.257103 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b73d3f27-aef4-428c-a9ce-324f9d810d16 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:52.265644 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b73d3f27-aef4-428c-a9ce-324f9d810d16 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1567 microversion: 2.1 time: 0.246068 Aug 04 17:59:52.266234 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3637/7168] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:52 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:53.049241 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-969285c6-8c06-4982-b5bf-ba592cf711a9 req-96d63459-6e1e-4be8-9d1d-59835daefc69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b012e5d-40a4-42da-af15-8fcb5484fb99", "name": "network-vif-deleted", "tag": "4d60c9e3-03c5-47a5-bf96-19d4a966b516"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:59:53.060759 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-969285c6-8c06-4982-b5bf-ba592cf711a9 req-96d63459-6e1e-4be8-9d1d-59835daefc69 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:59:53.061213 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-969285c6-8c06-4982-b5bf-ba592cf711a9 req-96d63459-6e1e-4be8-9d1d-59835daefc69 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:59:53.073897 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-969285c6-8c06-4982-b5bf-ba592cf711a9 req-96d63459-6e1e-4be8-9d1d-59835daefc69 service nova] Creating event network-vif-deleted:4d60c9e3-03c5-47a5-bf96-19d4a966b516 for instance 4b012e5d-40a4-42da-af15-8fcb5484fb99 on n-h1-846466-12 Aug 04 17:59:53.079527 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-969285c6-8c06-4982-b5bf-ba592cf711a9 req-96d63459-6e1e-4be8-9d1d-59835daefc69 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034001 Aug 04 17:59:53.080889 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3532/7169] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 17:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:59:53.289688 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-7b501c2b-d321-4348-aebb-c5bd64e75083 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:53.290393 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-7b501c2b-d321-4348-aebb-c5bd64e75083 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:53.296986 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b501c2b-d321-4348-aebb-c5bd64e75083 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:59:53.297557 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b501c2b-d321-4348-aebb-c5bd64e75083 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:59:53.298407 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b501c2b-d321-4348-aebb-c5bd64e75083 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:59:53.298916 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-7b501c2b-d321-4348-aebb-c5bd64e75083 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:59:53.379005 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-7b501c2b-d321-4348-aebb-c5bd64e75083 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:53.379442 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-7b501c2b-d321-4348-aebb-c5bd64e75083 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1219 microversion: 2.1 time: 0.094850 Aug 04 17:59:53.380381 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3638/7170] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:53 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:54.402326 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-619cd11f-8cb6-4bd9-b978-543d9fb35dd5 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:54.403030 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-619cd11f-8cb6-4bd9-b978-543d9fb35dd5 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:54.409720 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-619cd11f-8cb6-4bd9-b978-543d9fb35dd5 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:59:54.410178 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-619cd11f-8cb6-4bd9-b978-543d9fb35dd5 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:59:54.410946 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-619cd11f-8cb6-4bd9-b978-543d9fb35dd5 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:59:54.411384 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-619cd11f-8cb6-4bd9-b978-543d9fb35dd5 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:59:54.480913 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-619cd11f-8cb6-4bd9-b978-543d9fb35dd5 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:54.489602 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-619cd11f-8cb6-4bd9-b978-543d9fb35dd5 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1219 microversion: 2.1 time: 0.092888 Aug 04 17:59:54.490158 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3533/7171] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:54 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:55.511269 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8951ca14-7df9-4476-811b-ee3ec4d38893 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:55.511981 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8951ca14-7df9-4476-811b-ee3ec4d38893 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:55.519925 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8951ca14-7df9-4476-811b-ee3ec4d38893 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:59:55.520268 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8951ca14-7df9-4476-811b-ee3ec4d38893 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:59:55.521071 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8951ca14-7df9-4476-811b-ee3ec4d38893 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:59:55.521640 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8951ca14-7df9-4476-811b-ee3ec4d38893 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:59:55.590093 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8951ca14-7df9-4476-811b-ee3ec4d38893 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:55.598825 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8951ca14-7df9-4476-811b-ee3ec4d38893 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1219 microversion: 2.1 time: 0.091524 Aug 04 17:59:55.599511 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3639/7172] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:55 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:56.625093 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-eaed61b5-d9b5-4ee1-be06-59b6b07c7a94 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:56.625964 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-eaed61b5-d9b5-4ee1-be06-59b6b07c7a94 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:56.633955 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eaed61b5-d9b5-4ee1-be06-59b6b07c7a94 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:59:56.635224 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eaed61b5-d9b5-4ee1-be06-59b6b07c7a94 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:59:56.635224 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eaed61b5-d9b5-4ee1-be06-59b6b07c7a94 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:59:56.635699 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-eaed61b5-d9b5-4ee1-be06-59b6b07c7a94 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:59:56.717391 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-eaed61b5-d9b5-4ee1-be06-59b6b07c7a94 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:56.727201 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-eaed61b5-d9b5-4ee1-be06-59b6b07c7a94 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1219 microversion: 2.1 time: 0.107035 Aug 04 17:59:56.727787 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3534/7173] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:56 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1219 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:57.750543 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-27788735-4cc4-4a15-90db-9d9a6f581b4f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:57.751327 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-27788735-4cc4-4a15-90db-9d9a6f581b4f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:57.760021 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-27788735-4cc4-4a15-90db-9d9a6f581b4f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:59:57.760862 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-27788735-4cc4-4a15-90db-9d9a6f581b4f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:59:57.762598 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-27788735-4cc4-4a15-90db-9d9a6f581b4f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:59:57.762598 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-27788735-4cc4-4a15-90db-9d9a6f581b4f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:59:57.798452 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-27788735-4cc4-4a15-90db-9d9a6f581b4f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:59:57.798905 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-27788735-4cc4-4a15-90db-9d9a6f581b4f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:59:57.799362 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-27788735-4cc4-4a15-90db-9d9a6f581b4f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lazy-loading 'fault' on Instance uuid 4b012e5d-40a4-42da-af15-8fcb5484fb99 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:59:57.843093 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-27788735-4cc4-4a15-90db-9d9a6f581b4f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d626d2e60945b6a0302ffd18f07267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a49716b74ed4c8c8aed3322f2ddd702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:57.852772 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-27788735-4cc4-4a15-90db-9d9a6f581b4f tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 200 len: 1178 microversion: 2.1 time: 0.108154 Aug 04 17:59:57.853385 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3640/7174] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:57 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 1178 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:58.874192 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ea1a2804-feff-479d-ab61-619902bbf0f5 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:58.875464 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-ea1a2804-feff-479d-ab61-619902bbf0f5 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [instance: 4b012e5d-40a4-42da-af15-8fcb5484fb99] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:58.883018 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea1a2804-feff-479d-ab61-619902bbf0f5 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:59:58.883477 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea1a2804-feff-479d-ab61-619902bbf0f5 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:59:58.884268 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea1a2804-feff-479d-ab61-619902bbf0f5 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 17:59:58.884714 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-ea1a2804-feff-479d-ab61-619902bbf0f5 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 17:59:58.900268 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-ea1a2804-feff-479d-ab61-619902bbf0f5 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] HTTP exception thrown: Instance 4b012e5d-40a4-42da-af15-8fcb5484fb99 could not be found. Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ea1a2804-feff-479d-ab61-619902bbf0f5 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Request method failure captured: Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 HTTP/1.1 Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi7Ab9qH5yXctdYyjpfakLkYV9r7sr1lqobZ65HmbkKvj7g_pRjWaz45aItg8ftBJht3enmQlLdasRmvJnD8D79clBh0N6tJ46kiY7PCaJO-VgIP-waeKZumseGkt3m7U9Kwx51VNGG3drqvsndXjTIIUHOG3fG4zI2MCnQYxFeNTdHVQ Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 7a49716b74ed4c8c8aed3322f2ddd702 Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-TestShelveInstance-1787388486 Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7a49716b74ed4c8c8aed3322f2ddd702"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7a49716b74ed4c8c8aed3322f2ddd702"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7a49716b74ed4c8c8aed3322f2ddd702"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7a49716b74ed4c8c8aed3322f2ddd702"}]}] Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-TestShelveInstance-1787388486 Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 7a49716b74ed4c8c8aed3322f2ddd702 Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-TestShelveInstance-1787388486 Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-TestShelveInstance-1787388486-project Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: 57d626d2e60945b6a0302ffd18f07267 Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-TestShelveInstance-1787388486-project Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 4b012e5d-40a4-42da-af15-8fcb5484fb99 could not be found. Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '4b012e5d-40a4-42da-af15-8fcb5484fb99'} Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b012e5d-40a4-42da-af15-8fcb5484fb99 could not be found. Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b012e5d-40a4-42da-af15-8fcb5484fb99 could not be found. Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:59:58.902044 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:59:58.907174 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:59:58.907174 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:59:58.907174 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:59:58.907174 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:59:58.907174 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:59:58.907174 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b012e5d-40a4-42da-af15-8fcb5484fb99 could not be found. Aug 04 17:59:58.907174 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 17:59:58.907174 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-ea1a2804-feff-479d-ab61-619902bbf0f5 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Returning 404 to user: Instance 4b012e5d-40a4-42da-af15-8fcb5484fb99 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:59:58.907174 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-ea1a2804-feff-479d-ab61-619902bbf0f5 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99" status: 404 len: 111 microversion: 2.1 time: 0.033385 Aug 04 17:59:58.907174 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3535/7175] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:58 2022] GET /compute/v2.1/servers/4b012e5d-40a4-42da-af15-8fcb5484fb99 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:59:59.087672 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-43ed3d86-d0fc-4f9f-a659-2f6e7f008485 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] Calling method '.version_select at 0x7f7e76e26790>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:59.100745 n-d-846466-12 devstack@n-api.service[126125]: ERROR oslo.messaging._drivers.impl_rabbit [None req-43ed3d86-d0fc-4f9f-a659-2f6e7f008485 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [7901653b-d177-4be8-a7d9-f7b86b4b6ebf] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 18:00:00.112219 n-d-846466-12 devstack@n-api.service[126125]: INFO oslo.messaging._drivers.impl_rabbit [None req-43ed3d86-d0fc-4f9f-a659-2f6e7f008485 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] [7901653b-d177-4be8-a7d9-f7b86b4b6ebf] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 40568. Aug 04 18:00:00.134117 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-43ed3d86-d0fc-4f9f-a659-2f6e7f008485 tempest-TestShelveInstance-1787388486 tempest-TestShelveInstance-1787388486-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-742420629" status: 202 len: 0 microversion: 2.1 time: 1.051208 Aug 04 18:00:00.134714 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3641/7176] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Aug 4 17:59:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-742420629 => generated 0 bytes in 1053 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 18:00:19.138675 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=12 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:00:19.139471 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=24 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:00:19.355644 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d2dea8d2-8629-4ff1-853b-4f608c4a201f tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Action: 'create', calling method: .version_select at 0x7f7e84a3de50>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-2018912339", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8eaYB35QB3HSJEnlOQNwKhvuEPXxwxU3GXTROM+FYwnFqKFYbxdT/FxJjXxyLW/5Irvli+hzh+lbPmyezhhB2870J4bMMwOCfnCWuseWgxB5DUJOaSmIQmEo3JJi2/pA=="}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:00:19.373819 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-d2dea8d2-8629-4ff1-853b-4f608c4a201f tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Getting quotas for project 99db1802d31046fe822c3820e380391a. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 18:00:19.379989 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-d2dea8d2-8629-4ff1-853b-4f608c4a201f tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Getting quotas for user d1b18e344bf0409c9a4ba68cf713138b and project 99db1802d31046fe822c3820e380391a. Resources: {'key_pairs'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 18:00:19.395066 n-d-846466-12 devstack@n-api.service[126126]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d2dea8d2-8629-4ff1-853b-4f608c4a201f tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [ae93d3fb-f0e8-499d-b6dd-482ae3e16f7b] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 18:00:20.405370 n-d-846466-12 devstack@n-api.service[126126]: INFO oslo.messaging._drivers.impl_rabbit [None req-d2dea8d2-8629-4ff1-853b-4f608c4a201f tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [ae93d3fb-f0e8-499d-b6dd-482ae3e16f7b] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 40670. Aug 04 18:00:20.425079 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d2dea8d2-8629-4ff1-853b-4f608c4a201f tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 1.292216 Aug 04 18:00:20.425724 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3536/7177] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Aug 4 18:00:19 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:00:21.536023 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:00:21.537537 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:00:21.543382 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b2a1b35d-0b45-4491-9f6b-0f6942bc4c2d tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1160457654", "imageRef": "58d80c01-1581-4a2f-bbb0-c2eaf1affa00", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-2018912339", "security_groups": [{"name": "tempest-secgroup-smoke-1880473052"}], "networks": [{"uuid": "c74c550a-a548-4c06-b168-dbe2e70bc436"}]}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:00:21.678807 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.network.neutron [None req-b2a1b35d-0b45-4491-9f6b-0f6942bc4c2d tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] validate_networks() for [('c74c550a-a548-4c06-b168-dbe2e70bc436', None, None, None, None, None)] {{(pid=126125) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 18:00:22.272227 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b2a1b35d-0b45-4491-9f6b-0f6942bc4c2d tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Flavor limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 18:00:22.272647 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b2a1b35d-0b45-4491-9f6b-0f6942bc4c2d tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Image limits 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 18:00:22.273116 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b2a1b35d-0b45-4491-9f6b-0f6942bc4c2d tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Flavor pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 18:00:22.273860 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b2a1b35d-0b45-4491-9f6b-0f6942bc4c2d tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Image pref 0:0:0 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 18:00:22.274494 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.virt.hardware [None req-b2a1b35d-0b45-4491-9f6b-0f6942bc4c2d tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 18:00:22.284663 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2a1b35d-0b45-4491-9f6b-0f6942bc4c2d tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:00:22.285103 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2a1b35d-0b45-4491-9f6b-0f6942bc4c2d tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:00:22.286231 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2a1b35d-0b45-4491-9f6b-0f6942bc4c2d tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:00:22.286668 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b2a1b35d-0b45-4491-9f6b-0f6942bc4c2d tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:00:22.304791 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-b2a1b35d-0b45-4491-9f6b-0f6942bc4c2d tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Getting quotas for project 99db1802d31046fe822c3820e380391a. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 18:00:22.310345 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.quota [None req-b2a1b35d-0b45-4491-9f6b-0f6942bc4c2d tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Getting quotas for user d1b18e344bf0409c9a4ba68cf713138b and project 99db1802d31046fe822c3820e380391a. Resources: {'ram', 'cores', 'instances'} {{(pid=126125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 18:00:22.322997 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b2a1b35d-0b45-4491-9f6b-0f6942bc4c2d tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Going to run 1 instances... {{(pid=126125) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 18:00:22.325297 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b2a1b35d-0b45-4491-9f6b-0f6942bc4c2d tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: f843cb98-7694-4501-b912-1c1b55f62d62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58d80c01-1581-4a2f-bbb0-c2eaf1affa00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 18:00:22.375426 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b2a1b35d-0b45-4491-9f6b-0f6942bc4c2d tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.841237 Aug 04 18:00:22.376108 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3642/7178] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 18:00:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 18:00:22.398212 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-5e93febc-f3f7-4467-bf6c-a660a1648929 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:00:22.399631 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-5e93febc-f3f7-4467-bf6c-a660a1648929 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: f843cb98-7694-4501-b912-1c1b55f62d62] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:00:22.473687 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-5e93febc-f3f7-4467-bf6c-a660a1648929 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:00:22.484005 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-5e93febc-f3f7-4467-bf6c-a660a1648929 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62" status: 200 len: 1249 microversion: 2.1 time: 0.096335 Aug 04 18:00:22.484568 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3537/7179] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:00:22 2022] GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62 => generated 1249 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:00:23.506676 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4d2238f4-d3df-479c-8b23-c7810b92f0e8 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:00:23.507691 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4d2238f4-d3df-479c-8b23-c7810b92f0e8 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: f843cb98-7694-4501-b912-1c1b55f62d62] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:00:23.567755 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4d2238f4-d3df-479c-8b23-c7810b92f0e8 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:00:23.574938 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4d2238f4-d3df-479c-8b23-c7810b92f0e8 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62" status: 200 len: 1249 microversion: 2.1 time: 0.074446 Aug 04 18:00:23.575514 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3643/7180] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:00:23 2022] GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62 => generated 1249 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:00:24.596232 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-f80425bc-d6ab-44df-b7ea-ac547959a700 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:00:24.596783 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-f80425bc-d6ab-44df-b7ea-ac547959a700 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: f843cb98-7694-4501-b912-1c1b55f62d62] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:00:24.657411 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-f80425bc-d6ab-44df-b7ea-ac547959a700 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:00:24.666131 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-f80425bc-d6ab-44df-b7ea-ac547959a700 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62" status: 200 len: 1249 microversion: 2.1 time: 0.073865 Aug 04 18:00:24.666935 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3538/7181] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:00:24 2022] GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62 => generated 1249 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:00:25.692570 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cde97b8e-5fb4-4072-b67a-585df54f14a2 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:00:25.693412 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cde97b8e-5fb4-4072-b67a-585df54f14a2 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: f843cb98-7694-4501-b912-1c1b55f62d62] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:00:25.758742 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cde97b8e-5fb4-4072-b67a-585df54f14a2 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:00:25.766305 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cde97b8e-5fb4-4072-b67a-585df54f14a2 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62" status: 200 len: 1249 microversion: 2.1 time: 0.077333 Aug 04 18:00:25.766725 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3644/7182] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:00:25 2022] GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62 => generated 1249 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:00:26.787954 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-977c609f-6202-4de7-b74f-e2b4c41769fa tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:00:26.788540 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-977c609f-6202-4de7-b74f-e2b4c41769fa tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: f843cb98-7694-4501-b912-1c1b55f62d62] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:00:26.796560 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-977c609f-6202-4de7-b74f-e2b4c41769fa tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:00:26.797025 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-977c609f-6202-4de7-b74f-e2b4c41769fa tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:00:26.797865 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-977c609f-6202-4de7-b74f-e2b4c41769fa tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:00:26.798311 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-977c609f-6202-4de7-b74f-e2b4c41769fa tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:00:26.865548 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-977c609f-6202-4de7-b74f-e2b4c41769fa tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:00:26.874424 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-977c609f-6202-4de7-b74f-e2b4c41769fa tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62" status: 200 len: 1253 microversion: 2.1 time: 0.090170 Aug 04 18:00:26.875096 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3539/7183] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:00:26 2022] GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62 => generated 1253 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:00:27.895941 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-8343c278-adf6-4cf5-a2b1-007eb1af4773 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:00:27.897237 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-8343c278-adf6-4cf5-a2b1-007eb1af4773 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: f843cb98-7694-4501-b912-1c1b55f62d62] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:00:27.924752 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8343c278-adf6-4cf5-a2b1-007eb1af4773 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:00:27.925523 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8343c278-adf6-4cf5-a2b1-007eb1af4773 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:00:27.926525 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8343c278-adf6-4cf5-a2b1-007eb1af4773 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:00:27.927036 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-8343c278-adf6-4cf5-a2b1-007eb1af4773 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:00:28.014739 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-8343c278-adf6-4cf5-a2b1-007eb1af4773 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:00:28.023355 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-8343c278-adf6-4cf5-a2b1-007eb1af4773 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62" status: 200 len: 1307 microversion: 2.1 time: 0.131472 Aug 04 18:00:28.024947 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3645/7184] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:00:27 2022] GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62 => generated 1307 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:00:29.045431 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e2e84150-0bb5-4cfd-8699-5028112bae08 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:00:29.046518 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e2e84150-0bb5-4cfd-8699-5028112bae08 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: f843cb98-7694-4501-b912-1c1b55f62d62] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:00:29.054370 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e2e84150-0bb5-4cfd-8699-5028112bae08 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:00:29.054812 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e2e84150-0bb5-4cfd-8699-5028112bae08 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:00:29.055859 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e2e84150-0bb5-4cfd-8699-5028112bae08 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:00:29.056300 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e2e84150-0bb5-4cfd-8699-5028112bae08 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:00:29.306588 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-b852b7aa-1965-49fd-a465-3e62bf777030 req-44cb3f20-de52-4bb5-ad08-9c27d353355c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f843cb98-7694-4501-b912-1c1b55f62d62", "tag": "ff4ff4cc-9bd8-47ef-a755-b992f5951f92"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:00:29.320740 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-b852b7aa-1965-49fd-a465-3e62bf777030 req-44cb3f20-de52-4bb5-ad08-9c27d353355c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:00:29.321740 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-b852b7aa-1965-49fd-a465-3e62bf777030 req-44cb3f20-de52-4bb5-ad08-9c27d353355c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:00:29.334037 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-b852b7aa-1965-49fd-a465-3e62bf777030 req-44cb3f20-de52-4bb5-ad08-9c27d353355c service nova] Creating event network-changed:ff4ff4cc-9bd8-47ef-a755-b992f5951f92 for instance f843cb98-7694-4501-b912-1c1b55f62d62 on n-h2-846466-12 Aug 04 18:00:29.339284 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-b852b7aa-1965-49fd-a465-3e62bf777030 req-44cb3f20-de52-4bb5-ad08-9c27d353355c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122427 Aug 04 18:00:29.340218 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3646/7185] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 18:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:00:29.350085 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e2e84150-0bb5-4cfd-8699-5028112bae08 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:00:29.358722 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e2e84150-0bb5-4cfd-8699-5028112bae08 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62" status: 200 len: 1375 microversion: 2.1 time: 0.317537 Aug 04 18:00:29.359318 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3540/7186] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:00:29 2022] GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62 => generated 1375 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:00:30.382410 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-e4eeb3e5-c115-4030-9411-4b0ea0e42f4e tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:00:30.383139 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-e4eeb3e5-c115-4030-9411-4b0ea0e42f4e tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: f843cb98-7694-4501-b912-1c1b55f62d62] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:00:30.390612 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e4eeb3e5-c115-4030-9411-4b0ea0e42f4e tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:00:30.391166 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e4eeb3e5-c115-4030-9411-4b0ea0e42f4e tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:00:30.392032 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e4eeb3e5-c115-4030-9411-4b0ea0e42f4e tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:00:30.392464 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-e4eeb3e5-c115-4030-9411-4b0ea0e42f4e tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:00:30.555445 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-e4eeb3e5-c115-4030-9411-4b0ea0e42f4e tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:00:30.563551 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-e4eeb3e5-c115-4030-9411-4b0ea0e42f4e tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62" status: 200 len: 1375 microversion: 2.1 time: 0.186297 Aug 04 18:00:30.564148 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3647/7187] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:00:30 2022] GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62 => generated 1375 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:00:31.587508 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-bd9c17bb-a0a4-4936-9065-adf5c3fd3419 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:00:31.588118 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-bd9c17bb-a0a4-4936-9065-adf5c3fd3419 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: f843cb98-7694-4501-b912-1c1b55f62d62] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:00:31.596116 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bd9c17bb-a0a4-4936-9065-adf5c3fd3419 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:00:31.596725 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bd9c17bb-a0a4-4936-9065-adf5c3fd3419 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:00:31.597863 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bd9c17bb-a0a4-4936-9065-adf5c3fd3419 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:00:31.598311 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-bd9c17bb-a0a4-4936-9065-adf5c3fd3419 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:00:31.751843 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-bd9c17bb-a0a4-4936-9065-adf5c3fd3419 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:00:31.760545 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-bd9c17bb-a0a4-4936-9065-adf5c3fd3419 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62" status: 200 len: 1375 microversion: 2.1 time: 0.177310 Aug 04 18:00:31.761137 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3541/7188] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:00:31 2022] GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62 => generated 1375 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:00:32.784270 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-2859643e-aae0-4120-946e-d9ba082158fa tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:00:32.784866 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-2859643e-aae0-4120-946e-d9ba082158fa tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: f843cb98-7694-4501-b912-1c1b55f62d62] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:00:32.787761 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:00:32.793943 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2859643e-aae0-4120-946e-d9ba082158fa tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:00:32.794384 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2859643e-aae0-4120-946e-d9ba082158fa tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:00:32.795175 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2859643e-aae0-4120-946e-d9ba082158fa tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:00:32.795615 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-2859643e-aae0-4120-946e-d9ba082158fa tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:00:32.945446 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-2859643e-aae0-4120-946e-d9ba082158fa tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:00:32.953472 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-2859643e-aae0-4120-946e-d9ba082158fa tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62" status: 200 len: 1375 microversion: 2.1 time: 0.173059 Aug 04 18:00:32.954061 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3648/7189] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:00:32 2022] GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62 => generated 1375 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:00:33.966412 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-5743b77a-a7fc-4d36-b9d1-e0ad86becabe req-492322d9-d4db-4aec-b762-7635bcab5169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f843cb98-7694-4501-b912-1c1b55f62d62", "name": "network-vif-plugged", "status": "completed", "tag": "ff4ff4cc-9bd8-47ef-a755-b992f5951f92"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:00:33.974687 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-24603da0-9fa3-4ea0-b4f5-89fa564442cf tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:00:33.975373 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-24603da0-9fa3-4ea0-b4f5-89fa564442cf tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: f843cb98-7694-4501-b912-1c1b55f62d62] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:00:33.979581 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-5743b77a-a7fc-4d36-b9d1-e0ad86becabe req-492322d9-d4db-4aec-b762-7635bcab5169 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:00:33.981168 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-5743b77a-a7fc-4d36-b9d1-e0ad86becabe req-492322d9-d4db-4aec-b762-7635bcab5169 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:00:33.984635 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-24603da0-9fa3-4ea0-b4f5-89fa564442cf tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:00:33.985329 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-24603da0-9fa3-4ea0-b4f5-89fa564442cf tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:00:33.986283 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-24603da0-9fa3-4ea0-b4f5-89fa564442cf tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:00:33.986871 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-24603da0-9fa3-4ea0-b4f5-89fa564442cf tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:00:33.992508 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-5743b77a-a7fc-4d36-b9d1-e0ad86becabe req-492322d9-d4db-4aec-b762-7635bcab5169 service nova] Creating event network-vif-plugged:ff4ff4cc-9bd8-47ef-a755-b992f5951f92 for instance f843cb98-7694-4501-b912-1c1b55f62d62 on n-h2-846466-12 Aug 04 18:00:33.997924 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-5743b77a-a7fc-4d36-b9d1-e0ad86becabe req-492322d9-d4db-4aec-b762-7635bcab5169 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038045 Aug 04 18:00:33.998706 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3542/7190] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 18:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:00:34.173160 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-24603da0-9fa3-4ea0-b4f5-89fa564442cf tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:00:34.181311 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-24603da0-9fa3-4ea0-b4f5-89fa564442cf tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62" status: 200 len: 1375 microversion: 2.1 time: 0.210410 Aug 04 18:00:34.185801 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3649/7191] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:00:33 2022] GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62 => generated 1375 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:00:35.203058 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-307eff44-dde1-4862-94f4-fb45a202b9b4 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:00:35.203753 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-307eff44-dde1-4862-94f4-fb45a202b9b4 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: f843cb98-7694-4501-b912-1c1b55f62d62] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:00:35.205891 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=8 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:00:35.214045 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-307eff44-dde1-4862-94f4-fb45a202b9b4 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:00:35.214801 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-307eff44-dde1-4862-94f4-fb45a202b9b4 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:00:35.215580 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-307eff44-dde1-4862-94f4-fb45a202b9b4 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:00:35.216026 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-307eff44-dde1-4862-94f4-fb45a202b9b4 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:00:35.371848 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-307eff44-dde1-4862-94f4-fb45a202b9b4 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:00:35.380473 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-307eff44-dde1-4862-94f4-fb45a202b9b4 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62" status: 200 len: 1375 microversion: 2.1 time: 0.181615 Aug 04 18:00:35.389327 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3543/7192] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:00:35 2022] GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62 => generated 1375 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:00:36.402063 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-f939da63-a856-4a96-b7e2-21254f502870 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:00:36.402650 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-f939da63-a856-4a96-b7e2-21254f502870 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: f843cb98-7694-4501-b912-1c1b55f62d62] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:00:36.405543 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=10 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:00:36.411360 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f939da63-a856-4a96-b7e2-21254f502870 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:00:36.411881 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f939da63-a856-4a96-b7e2-21254f502870 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:00:36.412701 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f939da63-a856-4a96-b7e2-21254f502870 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:00:36.413337 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-f939da63-a856-4a96-b7e2-21254f502870 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:00:36.557200 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-f939da63-a856-4a96-b7e2-21254f502870 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:00:36.565466 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-f939da63-a856-4a96-b7e2-21254f502870 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62" status: 200 len: 1559 microversion: 2.1 time: 0.167891 Aug 04 18:00:36.566047 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3650/7193] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:00:36 2022] GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:00:36.586205 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-10c519bd-bdc9-4222-af11-ac3f611a3620 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:00:36.586814 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-10c519bd-bdc9-4222-af11-ac3f611a3620 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: f843cb98-7694-4501-b912-1c1b55f62d62] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:00:36.594166 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-10c519bd-bdc9-4222-af11-ac3f611a3620 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:00:36.594620 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-10c519bd-bdc9-4222-af11-ac3f611a3620 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:00:36.595403 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-10c519bd-bdc9-4222-af11-ac3f611a3620 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:00:36.595847 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-10c519bd-bdc9-4222-af11-ac3f611a3620 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:00:36.745658 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-10c519bd-bdc9-4222-af11-ac3f611a3620 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:00:36.753702 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-10c519bd-bdc9-4222-af11-ac3f611a3620 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62" status: 200 len: 1559 microversion: 2.1 time: 0.171833 Aug 04 18:00:36.754215 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3544/7194] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:00:36 2022] GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:00:38.860798 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-84385b9c-a703-4bb1-b398-d0fa0fb04a00 req-e8f4b0ec-1fa9-4cf9-8f3e-5a7fa70ea93e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f843cb98-7694-4501-b912-1c1b55f62d62", "tag": "ff4ff4cc-9bd8-47ef-a755-b992f5951f92"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:00:38.874517 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-84385b9c-a703-4bb1-b398-d0fa0fb04a00 req-e8f4b0ec-1fa9-4cf9-8f3e-5a7fa70ea93e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:00:38.874517 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-84385b9c-a703-4bb1-b398-d0fa0fb04a00 req-e8f4b0ec-1fa9-4cf9-8f3e-5a7fa70ea93e service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:00:38.886180 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-84385b9c-a703-4bb1-b398-d0fa0fb04a00 req-e8f4b0ec-1fa9-4cf9-8f3e-5a7fa70ea93e service nova] Creating event network-changed:ff4ff4cc-9bd8-47ef-a755-b992f5951f92 for instance f843cb98-7694-4501-b912-1c1b55f62d62 on n-h2-846466-12 Aug 04 18:00:38.891508 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-84385b9c-a703-4bb1-b398-d0fa0fb04a00 req-e8f4b0ec-1fa9-4cf9-8f3e-5a7fa70ea93e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034602 Aug 04 18:00:38.892114 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3651/7195] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 18:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:02:33.856114 n-d-846466-12 devstack@n-api.service[126126]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a8e78df9-6788-4147-abd6-cf6b1b6d2122] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 18:02:33.857040 n-d-846466-12 devstack@n-api.service[126126]: ERROR oslo.messaging._drivers.impl_rabbit [-] [37914f2f-7143-4f4b-83fb-439e96d93d23] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 18:02:33.857634 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:02:33.858382 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=32 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:02:33.862646 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1c20257e-74a9-4536-a2c8-f102a804da22 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1930331586"}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:02:33.865013 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1c20257e-74a9-4536-a2c8-f102a804da22 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: f843cb98-7694-4501-b912-1c1b55f62d62] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:33.873162 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c20257e-74a9-4536-a2c8-f102a804da22 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:02:33.873674 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c20257e-74a9-4536-a2c8-f102a804da22 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:02:33.874483 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c20257e-74a9-4536-a2c8-f102a804da22 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:02:33.874954 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1c20257e-74a9-4536-a2c8-f102a804da22 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:02:34.223984 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1c20257e-74a9-4536-a2c8-f102a804da22 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "POST /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62/action" status: 202 len: 0 microversion: 2.1 time: 0.369143 Aug 04 18:02:34.224358 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3545/7196] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 18:02:33 2022] POST /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 04 18:02:40.637517 n-d-846466-12 devstack@n-api.service[126125]: ERROR oslo.messaging._drivers.impl_rabbit [-] [97b8321f-6d0d-4fc2-ae68-3784c532bfbe] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 18:02:40.638312 n-d-846466-12 devstack@n-api.service[126125]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c495d468-47e4-4499-8c55-19f21dc1fcfb] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 18:02:40.639036 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:02:40.639733 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=36 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:02:40.645645 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-afdfd809-8188-4bc1-ad18-c74c480e5200 req-aff136dd-e08f-4697-9e26-61361515e6e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f843cb98-7694-4501-b912-1c1b55f62d62", "name": "network-vif-plugged", "status": "completed", "tag": "ff4ff4cc-9bd8-47ef-a755-b992f5951f92"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:02:40.689867 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-afdfd809-8188-4bc1-ad18-c74c480e5200 req-aff136dd-e08f-4697-9e26-61361515e6e7 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:02:40.689867 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-afdfd809-8188-4bc1-ad18-c74c480e5200 req-aff136dd-e08f-4697-9e26-61361515e6e7 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:02:40.689867 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-afdfd809-8188-4bc1-ad18-c74c480e5200 req-aff136dd-e08f-4697-9e26-61361515e6e7 service nova] Creating event network-vif-plugged:ff4ff4cc-9bd8-47ef-a755-b992f5951f92 for instance f843cb98-7694-4501-b912-1c1b55f62d62 on n-h2-846466-12 Aug 04 18:02:40.689867 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-afdfd809-8188-4bc1-ad18-c74c480e5200 req-aff136dd-e08f-4697-9e26-61361515e6e7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053116 Aug 04 18:02:40.690192 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3652/7197] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 18:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:02:47.832683 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:02:47.833480 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:02:47.838819 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-629b579b-98c0-4055-bb28-21dcf7feb7f1 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1650040238", "imageRef": "cae1ca28-1310-4cb1-ab9f-72fb9ead0d5c", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-2018912339", "security_groups": [{"name": "tempest-secgroup-smoke-1880473052"}], "networks": [{"uuid": "c74c550a-a548-4c06-b168-dbe2e70bc436"}]}} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:02:47.867488 n-d-846466-12 devstack@n-api.service[126126]: INFO oslo.messaging._drivers.impl_rabbit [-] [37914f2f-7143-4f4b-83fb-439e96d93d23] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 40944. Aug 04 18:02:47.868462 n-d-846466-12 devstack@n-api.service[126126]: INFO oslo.messaging._drivers.impl_rabbit [-] [a8e78df9-6788-4147-abd6-cf6b1b6d2122] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 40942. Aug 04 18:02:47.964977 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.network.neutron [None req-629b579b-98c0-4055-bb28-21dcf7feb7f1 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] validate_networks() for [('c74c550a-a548-4c06-b168-dbe2e70bc436', None, None, None, None, None)] {{(pid=126126) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 18:02:48.417578 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-629b579b-98c0-4055-bb28-21dcf7feb7f1 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Flavor limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 18:02:48.417975 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-629b579b-98c0-4055-bb28-21dcf7feb7f1 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Image limits 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 18:02:48.418636 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-629b579b-98c0-4055-bb28-21dcf7feb7f1 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Flavor pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 18:02:48.419088 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-629b579b-98c0-4055-bb28-21dcf7feb7f1 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Image pref 0:0:0 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 18:02:48.419516 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.virt.hardware [None req-629b579b-98c0-4055-bb28-21dcf7feb7f1 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 18:02:48.429494 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-629b579b-98c0-4055-bb28-21dcf7feb7f1 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:02:48.429956 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-629b579b-98c0-4055-bb28-21dcf7feb7f1 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:02:48.430768 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-629b579b-98c0-4055-bb28-21dcf7feb7f1 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:02:48.431223 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-629b579b-98c0-4055-bb28-21dcf7feb7f1 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:02:48.448942 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-629b579b-98c0-4055-bb28-21dcf7feb7f1 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Getting quotas for project 99db1802d31046fe822c3820e380391a. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 18:02:48.448942 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.quota [None req-629b579b-98c0-4055-bb28-21dcf7feb7f1 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Getting quotas for user d1b18e344bf0409c9a4ba68cf713138b and project 99db1802d31046fe822c3820e380391a. Resources: {'ram', 'cores', 'instances'} {{(pid=126126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 18:02:48.472778 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-629b579b-98c0-4055-bb28-21dcf7feb7f1 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Going to run 1 instances... {{(pid=126126) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 18:02:48.476818 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-629b579b-98c0-4055-bb28-21dcf7feb7f1 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: 30b511a6-c076-41a3-9b29-59c6448e7fef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cae1ca28-1310-4cb1-ab9f-72fb9ead0d5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 18:02:48.534260 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-629b579b-98c0-4055-bb28-21dcf7feb7f1 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.704946 Aug 04 18:02:48.534922 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3546/7198] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Aug 4 18:02:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 18:02:48.546650 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-440145a8-b697-4c8f-a2ba-bc49cd9fd33b tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:48.547332 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-440145a8-b697-4c8f-a2ba-bc49cd9fd33b tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: 30b511a6-c076-41a3-9b29-59c6448e7fef] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:48.566946 n-d-846466-12 devstack@n-api.service[126125]: INFO oslo.messaging._drivers.impl_rabbit [-] [97b8321f-6d0d-4fc2-ae68-3784c532bfbe] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 40958. Aug 04 18:02:48.569537 n-d-846466-12 devstack@n-api.service[126125]: INFO oslo.messaging._drivers.impl_rabbit [-] [c495d468-47e4-4499-8c55-19f21dc1fcfb] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 40960. Aug 04 18:02:48.676215 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-440145a8-b697-4c8f-a2ba-bc49cd9fd33b tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:48.683734 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-440145a8-b697-4c8f-a2ba-bc49cd9fd33b tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef" status: 200 len: 1249 microversion: 2.1 time: 0.141370 Aug 04 18:02:48.689576 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3653/7199] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:48 2022] GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef => generated 1249 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:49.705699 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-310cd50b-8172-4d1c-9b30-fbc66ee97ac8 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:49.706399 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-310cd50b-8172-4d1c-9b30-fbc66ee97ac8 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: 30b511a6-c076-41a3-9b29-59c6448e7fef] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:49.713660 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-310cd50b-8172-4d1c-9b30-fbc66ee97ac8 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:02:49.714089 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-310cd50b-8172-4d1c-9b30-fbc66ee97ac8 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:02:49.714869 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-310cd50b-8172-4d1c-9b30-fbc66ee97ac8 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:02:49.715311 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-310cd50b-8172-4d1c-9b30-fbc66ee97ac8 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:02:49.783981 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-310cd50b-8172-4d1c-9b30-fbc66ee97ac8 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:49.792324 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-310cd50b-8172-4d1c-9b30-fbc66ee97ac8 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef" status: 200 len: 1309 microversion: 2.1 time: 0.091600 Aug 04 18:02:49.792909 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3547/7200] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:49 2022] GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef => generated 1309 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:50.708603 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [req-48ca592a-32ee-4860-9415-eeb6c0487e45 req-723b8116-8268-4a67-92a5-686634c55faa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f843cb98-7694-4501-b912-1c1b55f62d62", "name": "network-vif-unplugged", "status": "completed", "tag": "ff4ff4cc-9bd8-47ef-a755-b992f5951f92"}]} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:02:50.732598 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:02:50.736556 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-48ca592a-32ee-4860-9415-eeb6c0487e45 req-723b8116-8268-4a67-92a5-686634c55faa service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:02:50.737003 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [req-48ca592a-32ee-4860-9415-eeb6c0487e45 req-723b8116-8268-4a67-92a5-686634c55faa service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:02:50.761384 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.compute.server_external_events [req-48ca592a-32ee-4860-9415-eeb6c0487e45 req-723b8116-8268-4a67-92a5-686634c55faa service nova] Creating event network-vif-unplugged:ff4ff4cc-9bd8-47ef-a755-b992f5951f92 for instance f843cb98-7694-4501-b912-1c1b55f62d62 on n-h2-846466-12 Aug 04 18:02:50.768353 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [req-48ca592a-32ee-4860-9415-eeb6c0487e45 req-723b8116-8268-4a67-92a5-686634c55faa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064286 Aug 04 18:02:50.770513 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3654/7201] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 18:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:02:50.815197 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-e05246d6-80e6-4e8f-976d-73b4502dc9a7 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:50.817679 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-e05246d6-80e6-4e8f-976d-73b4502dc9a7 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: 30b511a6-c076-41a3-9b29-59c6448e7fef] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:50.842988 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e05246d6-80e6-4e8f-976d-73b4502dc9a7 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:02:50.843489 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e05246d6-80e6-4e8f-976d-73b4502dc9a7 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:02:50.844301 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e05246d6-80e6-4e8f-976d-73b4502dc9a7 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:02:50.844754 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-e05246d6-80e6-4e8f-976d-73b4502dc9a7 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:02:51.052959 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-e05246d6-80e6-4e8f-976d-73b4502dc9a7 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:51.062536 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-e05246d6-80e6-4e8f-976d-73b4502dc9a7 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef" status: 200 len: 1375 microversion: 2.1 time: 0.252584 Aug 04 18:02:51.063795 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3548/7202] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:50 2022] GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef => generated 1375 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:52.087042 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-02fe6c74-dd95-4b1a-9aef-4fe7ce2d634d tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:52.088000 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-02fe6c74-dd95-4b1a-9aef-4fe7ce2d634d tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: 30b511a6-c076-41a3-9b29-59c6448e7fef] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:52.095188 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02fe6c74-dd95-4b1a-9aef-4fe7ce2d634d tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:02:52.095632 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02fe6c74-dd95-4b1a-9aef-4fe7ce2d634d tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:02:52.096621 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02fe6c74-dd95-4b1a-9aef-4fe7ce2d634d tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:02:52.097089 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-02fe6c74-dd95-4b1a-9aef-4fe7ce2d634d tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:02:52.253790 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-02fe6c74-dd95-4b1a-9aef-4fe7ce2d634d tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:52.268541 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-02fe6c74-dd95-4b1a-9aef-4fe7ce2d634d tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef" status: 200 len: 1375 microversion: 2.1 time: 0.187200 Aug 04 18:02:52.282257 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3655/7203] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:52 2022] GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef => generated 1375 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:53.291642 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-35dc115a-c225-4b77-9bf9-5515fc352d7d tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:53.293371 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-35dc115a-c225-4b77-9bf9-5515fc352d7d tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: 30b511a6-c076-41a3-9b29-59c6448e7fef] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:53.302826 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-35dc115a-c225-4b77-9bf9-5515fc352d7d tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:02:53.303856 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-35dc115a-c225-4b77-9bf9-5515fc352d7d tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:02:53.305091 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-35dc115a-c225-4b77-9bf9-5515fc352d7d tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:02:53.305966 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-35dc115a-c225-4b77-9bf9-5515fc352d7d tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:02:53.482799 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-35dc115a-c225-4b77-9bf9-5515fc352d7d tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:53.490743 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-35dc115a-c225-4b77-9bf9-5515fc352d7d tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef" status: 200 len: 1375 microversion: 2.1 time: 0.203965 Aug 04 18:02:53.491334 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3549/7204] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:53 2022] GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef => generated 1375 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:02:54.512160 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d575b4f1-7271-450a-aaef-5b56db1e1c85 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:54.513071 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d575b4f1-7271-450a-aaef-5b56db1e1c85 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: 30b511a6-c076-41a3-9b29-59c6448e7fef] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:54.521667 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d575b4f1-7271-450a-aaef-5b56db1e1c85 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:02:54.522111 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d575b4f1-7271-450a-aaef-5b56db1e1c85 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:02:54.522916 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d575b4f1-7271-450a-aaef-5b56db1e1c85 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:02:54.523331 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d575b4f1-7271-450a-aaef-5b56db1e1c85 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:02:54.679375 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d575b4f1-7271-450a-aaef-5b56db1e1c85 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:54.688812 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d575b4f1-7271-450a-aaef-5b56db1e1c85 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef" status: 200 len: 1375 microversion: 2.1 time: 0.180829 Aug 04 18:02:54.689436 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3656/7205] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:54 2022] GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef => generated 1375 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:55.715384 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-7f81c550-b7cd-4dbf-b363-90aba3cd5758 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:55.716588 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-7f81c550-b7cd-4dbf-b363-90aba3cd5758 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: 30b511a6-c076-41a3-9b29-59c6448e7fef] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:55.725383 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f81c550-b7cd-4dbf-b363-90aba3cd5758 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:02:55.725835 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f81c550-b7cd-4dbf-b363-90aba3cd5758 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:02:55.726619 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f81c550-b7cd-4dbf-b363-90aba3cd5758 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:02:55.727051 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-7f81c550-b7cd-4dbf-b363-90aba3cd5758 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:02:55.898061 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-7f81c550-b7cd-4dbf-b363-90aba3cd5758 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:55.906637 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-7f81c550-b7cd-4dbf-b363-90aba3cd5758 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef" status: 200 len: 1375 microversion: 2.1 time: 0.199585 Aug 04 18:02:55.907239 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3550/7206] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:55 2022] GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef => generated 1375 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:56.928375 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-c0f940d2-b989-4ea8-9269-24993d1df5d0 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:56.929006 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-c0f940d2-b989-4ea8-9269-24993d1df5d0 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: 30b511a6-c076-41a3-9b29-59c6448e7fef] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:56.936371 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0f940d2-b989-4ea8-9269-24993d1df5d0 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:02:56.936842 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0f940d2-b989-4ea8-9269-24993d1df5d0 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:02:56.937639 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0f940d2-b989-4ea8-9269-24993d1df5d0 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:02:56.938045 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-c0f940d2-b989-4ea8-9269-24993d1df5d0 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:02:57.104421 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-c0f940d2-b989-4ea8-9269-24993d1df5d0 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:57.112406 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-c0f940d2-b989-4ea8-9269-24993d1df5d0 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef" status: 200 len: 1375 microversion: 2.1 time: 0.188114 Aug 04 18:02:57.113442 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3657/7207] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:56 2022] GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef => generated 1375 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:58.133703 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-af47eb9b-2238-4ddd-87c7-32d37a6cb1e8 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:58.134818 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-af47eb9b-2238-4ddd-87c7-32d37a6cb1e8 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: 30b511a6-c076-41a3-9b29-59c6448e7fef] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:58.142658 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-af47eb9b-2238-4ddd-87c7-32d37a6cb1e8 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:02:58.143278 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-af47eb9b-2238-4ddd-87c7-32d37a6cb1e8 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:02:58.144188 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-af47eb9b-2238-4ddd-87c7-32d37a6cb1e8 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:02:58.144917 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-af47eb9b-2238-4ddd-87c7-32d37a6cb1e8 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:02:58.324479 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-af47eb9b-2238-4ddd-87c7-32d37a6cb1e8 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:58.335770 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-af47eb9b-2238-4ddd-87c7-32d37a6cb1e8 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef" status: 200 len: 1375 microversion: 2.1 time: 0.205982 Aug 04 18:02:58.336389 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3551/7208] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:58 2022] GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef => generated 1375 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:59.367932 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-d783e0b5-d144-484b-b156-0b96b18849c5 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:59.368601 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-d783e0b5-d144-484b-b156-0b96b18849c5 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: 30b511a6-c076-41a3-9b29-59c6448e7fef] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:59.371657 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell0:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:02:59.377782 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d783e0b5-d144-484b-b156-0b96b18849c5 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:02:59.378265 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d783e0b5-d144-484b-b156-0b96b18849c5 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:02:59.379832 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d783e0b5-d144-484b-b156-0b96b18849c5 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:02:59.380545 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-d783e0b5-d144-484b-b156-0b96b18849c5 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:02:59.530917 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-d783e0b5-d144-484b-b156-0b96b18849c5 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:59.542458 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-d783e0b5-d144-484b-b156-0b96b18849c5 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef" status: 200 len: 1375 microversion: 2.1 time: 0.178864 Aug 04 18:02:59.544546 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3658/7209] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:59 2022] GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef => generated 1375 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:59.564356 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-7906ab67-1703-4038-b0bc-b240016cec19 req-63a3f97a-dee7-404e-85d3-88d6613826f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30b511a6-c076-41a3-9b29-59c6448e7fef", "tag": "27c415c9-bef5-4dad-94c2-521b947aeef0"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:02:59.570986 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=2 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:02:59.571671 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell0:SELECT=6 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:02:59.577999 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-7906ab67-1703-4038-b0bc-b240016cec19 req-63a3f97a-dee7-404e-85d3-88d6613826f1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:02:59.578449 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-7906ab67-1703-4038-b0bc-b240016cec19 req-63a3f97a-dee7-404e-85d3-88d6613826f1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:02:59.590659 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-7906ab67-1703-4038-b0bc-b240016cec19 req-63a3f97a-dee7-404e-85d3-88d6613826f1 service nova] Creating event network-changed:27c415c9-bef5-4dad-94c2-521b947aeef0 for instance 30b511a6-c076-41a3-9b29-59c6448e7fef on n-h1-846466-12 Aug 04 18:02:59.596126 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-7906ab67-1703-4038-b0bc-b240016cec19 req-63a3f97a-dee7-404e-85d3-88d6613826f1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035636 Aug 04 18:02:59.596899 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3552/7210] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 18:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:03:00.566597 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-ded511ca-8431-4cd5-8b0a-8e7a3e7f5455 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:03:00.567196 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-ded511ca-8431-4cd5-8b0a-8e7a3e7f5455 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: 30b511a6-c076-41a3-9b29-59c6448e7fef] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:03:00.574646 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ded511ca-8431-4cd5-8b0a-8e7a3e7f5455 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:03:00.575086 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ded511ca-8431-4cd5-8b0a-8e7a3e7f5455 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:03:00.575842 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ded511ca-8431-4cd5-8b0a-8e7a3e7f5455 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:03:00.576268 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-ded511ca-8431-4cd5-8b0a-8e7a3e7f5455 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:03:00.725366 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-ded511ca-8431-4cd5-8b0a-8e7a3e7f5455 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:03:00.734754 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-ded511ca-8431-4cd5-8b0a-8e7a3e7f5455 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef" status: 200 len: 1375 microversion: 2.1 time: 0.171752 Aug 04 18:03:00.735717 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3659/7211] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:03:00 2022] GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef => generated 1375 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:03:01.764819 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-1e55364d-629f-4f05-bc2a-22a881e9430a tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:03:01.765655 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-1e55364d-629f-4f05-bc2a-22a881e9430a tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: 30b511a6-c076-41a3-9b29-59c6448e7fef] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:03:01.772583 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1e55364d-629f-4f05-bc2a-22a881e9430a tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:03:01.773044 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1e55364d-629f-4f05-bc2a-22a881e9430a tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:03:01.774181 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1e55364d-629f-4f05-bc2a-22a881e9430a tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:03:01.774629 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-1e55364d-629f-4f05-bc2a-22a881e9430a tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:03:01.917022 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-1e55364d-629f-4f05-bc2a-22a881e9430a tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:03:01.924997 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-1e55364d-629f-4f05-bc2a-22a881e9430a tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef" status: 200 len: 1375 microversion: 2.1 time: 0.165385 Aug 04 18:03:01.925951 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3553/7212] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:03:01 2022] GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef => generated 1375 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:03:02.946762 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-af9a9f96-23b3-4c03-9b72-7011f08fc88c tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:03:02.947599 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-af9a9f96-23b3-4c03-9b72-7011f08fc88c tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: 30b511a6-c076-41a3-9b29-59c6448e7fef] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:03:02.954986 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-af9a9f96-23b3-4c03-9b72-7011f08fc88c tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:03:02.955435 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-af9a9f96-23b3-4c03-9b72-7011f08fc88c tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:03:02.956190 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-af9a9f96-23b3-4c03-9b72-7011f08fc88c tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:03:02.956661 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-af9a9f96-23b3-4c03-9b72-7011f08fc88c tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:03:03.105305 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-af9a9f96-23b3-4c03-9b72-7011f08fc88c tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:03:03.113397 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-af9a9f96-23b3-4c03-9b72-7011f08fc88c tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef" status: 200 len: 1375 microversion: 2.1 time: 0.170661 Aug 04 18:03:03.113990 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3660/7213] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:03:02 2022] GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef => generated 1375 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:03:04.136380 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-597e93ad-bb61-45cf-99c1-2a01e966c3e4 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:03:04.136993 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-597e93ad-bb61-45cf-99c1-2a01e966c3e4 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: 30b511a6-c076-41a3-9b29-59c6448e7fef] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:03:04.144796 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-597e93ad-bb61-45cf-99c1-2a01e966c3e4 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:03:04.145314 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-597e93ad-bb61-45cf-99c1-2a01e966c3e4 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:03:04.146133 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-597e93ad-bb61-45cf-99c1-2a01e966c3e4 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:03:04.146575 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-597e93ad-bb61-45cf-99c1-2a01e966c3e4 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:03:04.300844 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-597e93ad-bb61-45cf-99c1-2a01e966c3e4 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:03:04.317314 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-597e93ad-bb61-45cf-99c1-2a01e966c3e4 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef" status: 200 len: 1375 microversion: 2.1 time: 0.185162 Aug 04 18:03:04.318092 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3554/7214] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:03:04 2022] GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef => generated 1375 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:03:05.339049 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-cbfa8820-2183-43d0-bcd8-36c7ed1b4df8 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:03:05.339761 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-cbfa8820-2183-43d0-bcd8-36c7ed1b4df8 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: 30b511a6-c076-41a3-9b29-59c6448e7fef] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:03:05.347617 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cbfa8820-2183-43d0-bcd8-36c7ed1b4df8 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:03:05.348107 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cbfa8820-2183-43d0-bcd8-36c7ed1b4df8 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:03:05.349192 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cbfa8820-2183-43d0-bcd8-36c7ed1b4df8 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:03:05.349662 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-cbfa8820-2183-43d0-bcd8-36c7ed1b4df8 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:03:05.505764 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-cbfa8820-2183-43d0-bcd8-36c7ed1b4df8 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:03:05.514867 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-cbfa8820-2183-43d0-bcd8-36c7ed1b4df8 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef" status: 200 len: 1375 microversion: 2.1 time: 0.179646 Aug 04 18:03:05.515346 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3661/7215] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:03:05 2022] GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef => generated 1375 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:03:05.928653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-fa6c57fe-b258-4a30-8dc9-de3a3e719559 req-b634cc68-3533-429e-9dc8-380f413d4444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30b511a6-c076-41a3-9b29-59c6448e7fef", "name": "network-vif-plugged", "status": "completed", "tag": "27c415c9-bef5-4dad-94c2-521b947aeef0"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:03:05.940797 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-fa6c57fe-b258-4a30-8dc9-de3a3e719559 req-b634cc68-3533-429e-9dc8-380f413d4444 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:03:05.941634 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-fa6c57fe-b258-4a30-8dc9-de3a3e719559 req-b634cc68-3533-429e-9dc8-380f413d4444 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:03:05.955248 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-fa6c57fe-b258-4a30-8dc9-de3a3e719559 req-b634cc68-3533-429e-9dc8-380f413d4444 service nova] Creating event network-vif-plugged:27c415c9-bef5-4dad-94c2-521b947aeef0 for instance 30b511a6-c076-41a3-9b29-59c6448e7fef on n-h1-846466-12 Aug 04 18:03:05.960505 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-fa6c57fe-b258-4a30-8dc9-de3a3e719559 req-b634cc68-3533-429e-9dc8-380f413d4444 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035989 Aug 04 18:03:05.961121 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3555/7216] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 18:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:03:06.536919 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-427c2261-bbbd-44a9-95b3-2be13f0932a7 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:03:06.537535 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-427c2261-bbbd-44a9-95b3-2be13f0932a7 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: 30b511a6-c076-41a3-9b29-59c6448e7fef] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:03:06.544826 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-427c2261-bbbd-44a9-95b3-2be13f0932a7 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:03:06.545254 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-427c2261-bbbd-44a9-95b3-2be13f0932a7 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:03:06.546086 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-427c2261-bbbd-44a9-95b3-2be13f0932a7 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:03:06.546550 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-427c2261-bbbd-44a9-95b3-2be13f0932a7 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:03:06.697794 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-427c2261-bbbd-44a9-95b3-2be13f0932a7 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:03:06.706021 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-427c2261-bbbd-44a9-95b3-2be13f0932a7 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef" status: 200 len: 1375 microversion: 2.1 time: 0.173519 Aug 04 18:03:06.706796 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3662/7217] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:03:06 2022] GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef => generated 1375 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:03:07.729885 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-cd95a465-f723-4128-9383-08f8298ddf8a tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:03:07.730572 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-cd95a465-f723-4128-9383-08f8298ddf8a tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: 30b511a6-c076-41a3-9b29-59c6448e7fef] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:03:07.738367 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cd95a465-f723-4128-9383-08f8298ddf8a tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:03:07.738892 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cd95a465-f723-4128-9383-08f8298ddf8a tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:03:07.739775 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cd95a465-f723-4128-9383-08f8298ddf8a tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:03:07.740216 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-cd95a465-f723-4128-9383-08f8298ddf8a tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:03:07.885207 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-cd95a465-f723-4128-9383-08f8298ddf8a tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:03:07.893751 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-cd95a465-f723-4128-9383-08f8298ddf8a tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef" status: 200 len: 1559 microversion: 2.1 time: 0.168955 Aug 04 18:03:07.894457 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3556/7218] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:03:07 2022] GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:03:07.914530 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b0d0aeb0-7cef-4016-a01d-bf96d3eb4b0e tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:03:07.915132 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b0d0aeb0-7cef-4016-a01d-bf96d3eb4b0e tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: 30b511a6-c076-41a3-9b29-59c6448e7fef] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:03:07.922507 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0d0aeb0-7cef-4016-a01d-bf96d3eb4b0e tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:03:07.922957 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0d0aeb0-7cef-4016-a01d-bf96d3eb4b0e tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:03:07.923730 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0d0aeb0-7cef-4016-a01d-bf96d3eb4b0e tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:03:07.924173 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b0d0aeb0-7cef-4016-a01d-bf96d3eb4b0e tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:03:08.077574 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-b0d0aeb0-7cef-4016-a01d-bf96d3eb4b0e tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:03:08.086003 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b0d0aeb0-7cef-4016-a01d-bf96d3eb4b0e tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef" status: 200 len: 1559 microversion: 2.1 time: 0.175284 Aug 04 18:03:08.086602 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3663/7219] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:03:07 2022] GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:03:09.805722 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-1795ad6f-20f3-48cb-a5e1-d9e3e6649bb2 req-420717f5-4820-4d85-8d31-57baa280ca54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30b511a6-c076-41a3-9b29-59c6448e7fef", "tag": "27c415c9-bef5-4dad-94c2-521b947aeef0"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:03:09.816729 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-1795ad6f-20f3-48cb-a5e1-d9e3e6649bb2 req-420717f5-4820-4d85-8d31-57baa280ca54 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:03:09.817304 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-1795ad6f-20f3-48cb-a5e1-d9e3e6649bb2 req-420717f5-4820-4d85-8d31-57baa280ca54 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:03:09.829309 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-1795ad6f-20f3-48cb-a5e1-d9e3e6649bb2 req-420717f5-4820-4d85-8d31-57baa280ca54 service nova] Creating event network-changed:27c415c9-bef5-4dad-94c2-521b947aeef0 for instance 30b511a6-c076-41a3-9b29-59c6448e7fef on n-h1-846466-12 Aug 04 18:03:09.835168 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-1795ad6f-20f3-48cb-a5e1-d9e3e6649bb2 req-420717f5-4820-4d85-8d31-57baa280ca54 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033090 Aug 04 18:03:09.835791 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3557/7220] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 18:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:04:36.704030 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=26 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:04:36.704887 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=56 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:04:36.709048 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-dc1f08d6-a4b3-4ef4-b920-ab60a2453273 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-2092005778"}} {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:04:36.711541 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-dc1f08d6-a4b3-4ef4-b920-ab60a2453273 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: 30b511a6-c076-41a3-9b29-59c6448e7fef] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:36.719375 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dc1f08d6-a4b3-4ef4-b920-ab60a2453273 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:04:36.719820 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dc1f08d6-a4b3-4ef4-b920-ab60a2453273 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:04:36.720600 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dc1f08d6-a4b3-4ef4-b920-ab60a2453273 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:04:36.721031 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-dc1f08d6-a4b3-4ef4-b920-ab60a2453273 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:04:36.930384 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-dc1f08d6-a4b3-4ef4-b920-ab60a2453273 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "POST /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef/action" status: 202 len: 0 microversion: 2.1 time: 0.228102 Aug 04 18:04:36.931050 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3664/7221] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Aug 4 18:04:36 2022] POST /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 18:04:42.324103 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:04:42.327026 n-d-846466-12 devstack@n-api.service[126126]: DEBUG dbcounter [-] [126126] Writing DB stats nova_cell1:SELECT=56 {{(pid=126126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:04:42.419258 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-b230d5c8-13eb-4d49-ba6c-16296f71e11f req-19aa7b71-d442-48f3-9b91-534e2f946cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30b511a6-c076-41a3-9b29-59c6448e7fef", "name": "network-vif-plugged", "status": "completed", "tag": "27c415c9-bef5-4dad-94c2-521b947aeef0"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:04:42.443066 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-b230d5c8-13eb-4d49-ba6c-16296f71e11f req-19aa7b71-d442-48f3-9b91-534e2f946cf5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:04:42.443843 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-b230d5c8-13eb-4d49-ba6c-16296f71e11f req-19aa7b71-d442-48f3-9b91-534e2f946cf5 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:04:42.458557 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-b230d5c8-13eb-4d49-ba6c-16296f71e11f req-19aa7b71-d442-48f3-9b91-534e2f946cf5 service nova] Creating event network-vif-plugged:27c415c9-bef5-4dad-94c2-521b947aeef0 for instance 30b511a6-c076-41a3-9b29-59c6448e7fef on n-h1-846466-12 Aug 04 18:04:42.468116 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-b230d5c8-13eb-4d49-ba6c-16296f71e11f req-19aa7b71-d442-48f3-9b91-534e2f946cf5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150002 Aug 04 18:04:42.469632 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3558/7222] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 18:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:04:51.898079 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_api:SELECT=2 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:04:51.899292 n-d-846466-12 devstack@n-api.service[126125]: DEBUG dbcounter [-] [126125] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:04:51.903895 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-b7de07f2-427a-4529-b061-e0f411c02030 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:51.909697 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b7de07f2-427a-4529-b061-e0f411c02030 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: 30b511a6-c076-41a3-9b29-59c6448e7fef] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:51.919479 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b7de07f2-427a-4529-b061-e0f411c02030 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:04:51.920542 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b7de07f2-427a-4529-b061-e0f411c02030 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:04:51.921503 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b7de07f2-427a-4529-b061-e0f411c02030 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:04:51.922041 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-b7de07f2-427a-4529-b061-e0f411c02030 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:04:51.956695 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-b7de07f2-427a-4529-b061-e0f411c02030 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: 30b511a6-c076-41a3-9b29-59c6448e7fef] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 18:04:51.967917 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-a20e992e-d8ac-4f13-8596-6543b7312e2e req-ddff4dca-9ca1-4f82-9149-c15e48ac46f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30b511a6-c076-41a3-9b29-59c6448e7fef", "tag": "27c415c9-bef5-4dad-94c2-521b947aeef0"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:04:51.980707 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a20e992e-d8ac-4f13-8596-6543b7312e2e req-ddff4dca-9ca1-4f82-9149-c15e48ac46f1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:04:51.981673 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-a20e992e-d8ac-4f13-8596-6543b7312e2e req-ddff4dca-9ca1-4f82-9149-c15e48ac46f1 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:04:51.994485 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-a20e992e-d8ac-4f13-8596-6543b7312e2e req-ddff4dca-9ca1-4f82-9149-c15e48ac46f1 service nova] Creating event network-changed:27c415c9-bef5-4dad-94c2-521b947aeef0 for instance 30b511a6-c076-41a3-9b29-59c6448e7fef on n-h1-846466-12 Aug 04 18:04:52.001256 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-a20e992e-d8ac-4f13-8596-6543b7312e2e req-ddff4dca-9ca1-4f82-9149-c15e48ac46f1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102794 Aug 04 18:04:52.002092 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3559/7223] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 18:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:04:52.076951 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-b7de07f2-427a-4529-b061-e0f411c02030 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "DELETE /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef" status: 204 len: 0 microversion: 2.1 time: 0.180923 Aug 04 18:04:52.078091 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3665/7224] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 18:04:51 2022] DELETE /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 18:04:52.086871 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-6648b4e0-9edd-4b2a-a477-d081cbd8226a tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:52.088112 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-6648b4e0-9edd-4b2a-a477-d081cbd8226a tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: 30b511a6-c076-41a3-9b29-59c6448e7fef] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:52.095048 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6648b4e0-9edd-4b2a-a477-d081cbd8226a tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:04:52.095841 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6648b4e0-9edd-4b2a-a477-d081cbd8226a tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:04:52.096868 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6648b4e0-9edd-4b2a-a477-d081cbd8226a tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:04:52.097333 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-6648b4e0-9edd-4b2a-a477-d081cbd8226a tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:04:52.244220 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-6648b4e0-9edd-4b2a-a477-d081cbd8226a tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:04:52.253456 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-6648b4e0-9edd-4b2a-a477-d081cbd8226a tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef" status: 200 len: 1684 microversion: 2.1 time: 0.170852 Aug 04 18:04:52.254046 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3560/7225] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:04:52 2022] GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef => generated 1684 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:04:53.276935 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5c16b0db-bd57-4d0e-a693-8a1af8416a56 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:53.277708 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5c16b0db-bd57-4d0e-a693-8a1af8416a56 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: 30b511a6-c076-41a3-9b29-59c6448e7fef] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:53.287404 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5c16b0db-bd57-4d0e-a693-8a1af8416a56 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:04:53.287847 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5c16b0db-bd57-4d0e-a693-8a1af8416a56 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:04:53.288610 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5c16b0db-bd57-4d0e-a693-8a1af8416a56 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:04:53.289046 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5c16b0db-bd57-4d0e-a693-8a1af8416a56 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:04:53.430840 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-5c16b0db-bd57-4d0e-a693-8a1af8416a56 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:04:53.438949 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5c16b0db-bd57-4d0e-a693-8a1af8416a56 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef" status: 200 len: 1684 microversion: 2.1 time: 0.167467 Aug 04 18:04:53.439510 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3666/7226] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:04:53 2022] GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:04:54.343688 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-0f46a1e1-b516-433f-9aa6-bbca8700f1f2 req-cf239382-2430-4157-9a30-d3374b9b7475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30b511a6-c076-41a3-9b29-59c6448e7fef", "name": "network-vif-deleted", "tag": "27c415c9-bef5-4dad-94c2-521b947aeef0"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:04:54.357500 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-0f46a1e1-b516-433f-9aa6-bbca8700f1f2 req-cf239382-2430-4157-9a30-d3374b9b7475 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:04:54.358049 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-0f46a1e1-b516-433f-9aa6-bbca8700f1f2 req-cf239382-2430-4157-9a30-d3374b9b7475 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:04:54.371928 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-0f46a1e1-b516-433f-9aa6-bbca8700f1f2 req-cf239382-2430-4157-9a30-d3374b9b7475 service nova] Creating event network-vif-deleted:27c415c9-bef5-4dad-94c2-521b947aeef0 for instance 30b511a6-c076-41a3-9b29-59c6448e7fef on n-h1-846466-12 Aug 04 18:04:54.377880 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-0f46a1e1-b516-433f-9aa6-bbca8700f1f2 req-cf239382-2430-4157-9a30-d3374b9b7475 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037920 Aug 04 18:04:54.378501 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3561/7227] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 18:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:04:54.460618 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-9dedc067-e496-4a39-b360-839874ab66f6 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:54.461209 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-9dedc067-e496-4a39-b360-839874ab66f6 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: 30b511a6-c076-41a3-9b29-59c6448e7fef] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:54.476575 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9dedc067-e496-4a39-b360-839874ab66f6 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:04:54.477193 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9dedc067-e496-4a39-b360-839874ab66f6 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:04:54.478204 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9dedc067-e496-4a39-b360-839874ab66f6 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:04:54.478635 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9dedc067-e496-4a39-b360-839874ab66f6 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:04:54.513555 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9dedc067-e496-4a39-b360-839874ab66f6 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:04:54.514012 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-9dedc067-e496-4a39-b360-839874ab66f6 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:04:54.514449 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-9dedc067-e496-4a39-b360-839874ab66f6 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lazy-loading 'fault' on Instance uuid 30b511a6-c076-41a3-9b29-59c6448e7fef {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 18:04:54.558005 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-9dedc067-e496-4a39-b360-839874ab66f6 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:04:54.566039 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-9dedc067-e496-4a39-b360-839874ab66f6 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef" status: 200 len: 1339 microversion: 2.1 time: 0.109506 Aug 04 18:04:54.566602 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3667/7228] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:04:54 2022] GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef => generated 1339 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:04:55.595441 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-631dfeea-bd49-423c-82b3-beade1a430ec tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:55.596044 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-631dfeea-bd49-423c-82b3-beade1a430ec tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: 30b511a6-c076-41a3-9b29-59c6448e7fef] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:55.604058 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-631dfeea-bd49-423c-82b3-beade1a430ec tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:04:55.604521 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-631dfeea-bd49-423c-82b3-beade1a430ec tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:04:55.605356 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-631dfeea-bd49-423c-82b3-beade1a430ec tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:04:55.605809 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-631dfeea-bd49-423c-82b3-beade1a430ec tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:04:55.620866 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-631dfeea-bd49-423c-82b3-beade1a430ec tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] HTTP exception thrown: Instance 30b511a6-c076-41a3-9b29-59c6448e7fef could not be found. Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-631dfeea-bd49-423c-82b3-beade1a430ec tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Request method failure captured: Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef HTTP/1.1 Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi7AktSWqtoSAhMuErxMMy1HW6TJnObkcPtH1QrRPRNJrL5ulvIMTETGzLQGKUK1LUXYnKkMy50tQD7cznb8NESxhopBO9Lf0lQM1_wSnZOUzqjyNOGzCD4VJ1owbWIL2KGEVvX7zcOd7FTJAYqyc7aa4LrHLyGCJIdxEnOYO4QM2cHzA Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 99db1802d31046fe822c3820e380391a Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-TestSnapshotPattern-1955683679 Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99db1802d31046fe822c3820e380391a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_99db1802d31046fe822c3820e380391a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99db1802d31046fe822c3820e380391a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/99db1802d31046fe822c3820e380391a"}]}] Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-TestSnapshotPattern-1955683679 Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 99db1802d31046fe822c3820e380391a Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-TestSnapshotPattern-1955683679 Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-TestSnapshotPattern-1955683679-project Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: d1b18e344bf0409c9a4ba68cf713138b Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-TestSnapshotPattern-1955683679-project Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance 30b511a6-c076-41a3-9b29-59c6448e7fef could not be found. Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': '30b511a6-c076-41a3-9b29-59c6448e7fef'} Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30b511a6-c076-41a3-9b29-59c6448e7fef could not be found. Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30b511a6-c076-41a3-9b29-59c6448e7fef could not be found. Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:04:55.622653 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 18:04:55.627967 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:04:55.627967 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:04:55.627967 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:04:55.627967 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:04:55.627967 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:04:55.627967 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30b511a6-c076-41a3-9b29-59c6448e7fef could not be found. Aug 04 18:04:55.627967 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 18:04:55.627967 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-631dfeea-bd49-423c-82b3-beade1a430ec tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Returning 404 to user: Instance 30b511a6-c076-41a3-9b29-59c6448e7fef could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:04:55.627967 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-631dfeea-bd49-423c-82b3-beade1a430ec tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef" status: 404 len: 111 microversion: 2.1 time: 0.039771 Aug 04 18:04:55.627967 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3562/7229] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:04:55 2022] GET /compute/v2.1/servers/30b511a6-c076-41a3-9b29-59c6448e7fef => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 18:04:57.130655 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-5dee2ab5-7c19-4b62-a984-7cc92e569c0e tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:57.131193 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5dee2ab5-7c19-4b62-a984-7cc92e569c0e tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: f843cb98-7694-4501-b912-1c1b55f62d62] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:57.134372 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-261fb8aa-d247-4f57-9bc4-47eafbe976f6 req-6b035048-f37f-4375-95d9-ca37ba4b42a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f843cb98-7694-4501-b912-1c1b55f62d62", "tag": "ff4ff4cc-9bd8-47ef-a755-b992f5951f92"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:04:57.138921 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5dee2ab5-7c19-4b62-a984-7cc92e569c0e tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:04:57.139396 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5dee2ab5-7c19-4b62-a984-7cc92e569c0e tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:04:57.140190 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5dee2ab5-7c19-4b62-a984-7cc92e569c0e tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:04:57.140627 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-5dee2ab5-7c19-4b62-a984-7cc92e569c0e tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:04:57.148930 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-261fb8aa-d247-4f57-9bc4-47eafbe976f6 req-6b035048-f37f-4375-95d9-ca37ba4b42a9 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:04:57.149537 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-261fb8aa-d247-4f57-9bc4-47eafbe976f6 req-6b035048-f37f-4375-95d9-ca37ba4b42a9 service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:04:57.160882 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-261fb8aa-d247-4f57-9bc4-47eafbe976f6 req-6b035048-f37f-4375-95d9-ca37ba4b42a9 service nova] Creating event network-changed:ff4ff4cc-9bd8-47ef-a755-b992f5951f92 for instance f843cb98-7694-4501-b912-1c1b55f62d62 on n-h2-846466-12 Aug 04 18:04:57.166512 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-261fb8aa-d247-4f57-9bc4-47eafbe976f6 req-6b035048-f37f-4375-95d9-ca37ba4b42a9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035787 Aug 04 18:04:57.167319 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3563/7230] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 18:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:04:57.168190 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-5dee2ab5-7c19-4b62-a984-7cc92e569c0e tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: f843cb98-7694-4501-b912-1c1b55f62d62] Going to try to terminate instance {{(pid=126125) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 18:04:57.272289 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-5dee2ab5-7c19-4b62-a984-7cc92e569c0e tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62" status: 204 len: 0 microversion: 2.1 time: 0.145327 Aug 04 18:04:57.273746 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3668/7231] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Aug 4 18:04:57 2022] DELETE /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 18:04:57.283495 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-fbc6df10-244d-45d7-b2a7-36bdbc212fb1 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:57.284218 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-fbc6df10-244d-45d7-b2a7-36bdbc212fb1 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: f843cb98-7694-4501-b912-1c1b55f62d62] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:57.291594 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fbc6df10-244d-45d7-b2a7-36bdbc212fb1 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:04:57.292055 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fbc6df10-244d-45d7-b2a7-36bdbc212fb1 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:04:57.292856 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fbc6df10-244d-45d7-b2a7-36bdbc212fb1 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:04:57.293317 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-fbc6df10-244d-45d7-b2a7-36bdbc212fb1 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:04:57.476416 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.policy [None req-fbc6df10-244d-45d7-b2a7-36bdbc212fb1 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126126) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:04:57.485158 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-fbc6df10-244d-45d7-b2a7-36bdbc212fb1 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62" status: 200 len: 1684 microversion: 2.1 time: 0.206134 Aug 04 18:04:57.486274 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3564/7232] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:04:57 2022] GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62 => generated 1684 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:04:58.508153 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-4065354e-cde1-4794-86bf-dd1a6c9a4306 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:58.509404 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-4065354e-cde1-4794-86bf-dd1a6c9a4306 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: f843cb98-7694-4501-b912-1c1b55f62d62] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:58.516951 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4065354e-cde1-4794-86bf-dd1a6c9a4306 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:04:58.517427 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4065354e-cde1-4794-86bf-dd1a6c9a4306 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:04:58.518229 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4065354e-cde1-4794-86bf-dd1a6c9a4306 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:04:58.518663 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-4065354e-cde1-4794-86bf-dd1a6c9a4306 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:04:58.700797 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-4065354e-cde1-4794-86bf-dd1a6c9a4306 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:04:58.709157 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-4065354e-cde1-4794-86bf-dd1a6c9a4306 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62" status: 200 len: 1684 microversion: 2.1 time: 0.205536 Aug 04 18:04:58.709823 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3669/7233] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:04:58 2022] GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62 => generated 1684 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:04:59.333250 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [req-62883bd1-5890-4e54-984c-3a36577f8891 req-a803950f-f691-4b01-a8f2-ba6bebf93c9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f843cb98-7694-4501-b912-1c1b55f62d62", "name": "network-vif-deleted", "tag": "ff4ff4cc-9bd8-47ef-a755-b992f5951f92"}]} {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:04:59.351221 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-62883bd1-5890-4e54-984c-3a36577f8891 req-a803950f-f691-4b01-a8f2-ba6bebf93c9c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:04:59.351884 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [req-62883bd1-5890-4e54-984c-3a36577f8891 req-a803950f-f691-4b01-a8f2-ba6bebf93c9c service nova] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:04:59.369835 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.compute.server_external_events [req-62883bd1-5890-4e54-984c-3a36577f8891 req-a803950f-f691-4b01-a8f2-ba6bebf93c9c service nova] Creating event network-vif-deleted:ff4ff4cc-9bd8-47ef-a755-b992f5951f92 for instance f843cb98-7694-4501-b912-1c1b55f62d62 on n-h2-846466-12 Aug 04 18:04:59.375417 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [req-62883bd1-5890-4e54-984c-3a36577f8891 req-a803950f-f691-4b01-a8f2-ba6bebf93c9c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046263 Aug 04 18:04:59.376027 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3565/7234] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Aug 4 18:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:04:59.733161 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-a3898266-f826-4a7d-b562-451a8324d52e tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:59.733905 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.compute.api [None req-a3898266-f826-4a7d-b562-451a8324d52e tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: f843cb98-7694-4501-b912-1c1b55f62d62] Fetching instance by UUID {{(pid=126125) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:59.742497 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a3898266-f826-4a7d-b562-451a8324d52e tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:04:59.743278 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a3898266-f826-4a7d-b562-451a8324d52e tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:04:59.753031 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a3898266-f826-4a7d-b562-451a8324d52e tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:04:59.754749 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a3898266-f826-4a7d-b562-451a8324d52e tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:04:59.800708 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a3898266-f826-4a7d-b562-451a8324d52e tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:04:59.801373 n-d-846466-12 devstack@n-api.service[126125]: DEBUG oslo_concurrency.lockutils [None req-a3898266-f826-4a7d-b562-451a8324d52e tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:04:59.801976 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.objects.instance [None req-a3898266-f826-4a7d-b562-451a8324d52e tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lazy-loading 'fault' on Instance uuid f843cb98-7694-4501-b912-1c1b55f62d62 {{(pid=126125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 18:04:59.866865 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.policy [None req-a3898266-f826-4a7d-b562-451a8324d52e tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b18e344bf0409c9a4ba68cf713138b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99db1802d31046fe822c3820e380391a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126125) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:04:59.881904 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-a3898266-f826-4a7d-b562-451a8324d52e tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62" status: 200 len: 1339 microversion: 2.1 time: 0.154343 Aug 04 18:04:59.896749 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3670/7235] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:04:59 2022] GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62 => generated 1339 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:05:00.906121 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d7cca98e-29fc-430a-83f1-bbc73bf46c23 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '>' {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:00.907681 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.compute.api [None req-d7cca98e-29fc-430a-83f1-bbc73bf46c23 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [instance: f843cb98-7694-4501-b912-1c1b55f62d62] Fetching instance by UUID {{(pid=126126) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:05:00.914995 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d7cca98e-29fc-430a-83f1-bbc73bf46c23 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:05:00.915474 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d7cca98e-29fc-430a-83f1-bbc73bf46c23 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:05:00.916275 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d7cca98e-29fc-430a-83f1-bbc73bf46c23 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 18:05:00.916717 n-d-846466-12 devstack@n-api.service[126126]: DEBUG oslo_concurrency.lockutils [None req-d7cca98e-29fc-430a-83f1-bbc73bf46c23 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Lock "e056d029-674a-446e-ac9e-5108621d9db2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 18:05:00.932233 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.wsgi [None req-d7cca98e-29fc-430a-83f1-bbc73bf46c23 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] HTTP exception thrown: Instance f843cb98-7694-4501-b912-1c1b55f62d62 could not be found. Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d7cca98e-29fc-430a-83f1-bbc73bf46c23 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Request method failure captured: Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: request: GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62 HTTP/1.1 Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: Accept: application/json Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: Accept-Encoding: identity Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: Connection: close Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: Content-Length: 0 Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: Content-Type: application/json Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: Host: 10.222.0.23 Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: Openstack-System-Scope: None Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: User-Agent: python-urllib3/1.26.11 Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: X-Auth-Token: gAAAAABi7AktSWqtoSAhMuErxMMy1HW6TJnObkcPtH1QrRPRNJrL5ulvIMTETGzLQGKUK1LUXYnKkMy50tQD7cznb8NESxhopBO9Lf0lQM1_wSnZOUzqjyNOGzCD4VJ1owbWIL2KGEVvX7zcOd7FTJAYqyc7aa4LrHLyGCJIdxEnOYO4QM2cHzA Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Id: None Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: X-Domain-Name: None Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: X-Identity-Status: Confirmed Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: X-Is-Admin-Project: True Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Id: default Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Domain-Name: Default Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Id: 99db1802d31046fe822c3820e380391a Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: X-Project-Name: tempest-TestSnapshotPattern-1955683679 Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: X-Role: member,reader Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: X-Roles: member,reader Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99db1802d31046fe822c3820e380391a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_99db1802d31046fe822c3820e380391a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99db1802d31046fe822c3820e380391a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/99db1802d31046fe822c3820e380391a"}]}] Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant: tempest-TestSnapshotPattern-1955683679 Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Id: 99db1802d31046fe822c3820e380391a Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: X-Tenant-Name: tempest-TestSnapshotPattern-1955683679 Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: X-User: tempest-TestSnapshotPattern-1955683679-project Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Id: default Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: X-User-Domain-Name: Default Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: X-User-Id: d1b18e344bf0409c9a4ba68cf713138b Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: X-User-Name: tempest-TestSnapshotPattern-1955683679-project Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: method: > Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: exception: Instance f843cb98-7694-4501-b912-1c1b55f62d62 could not be found. Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: action_args: {'id': 'f843cb98-7694-4501-b912-1c1b55f62d62'} Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: {{(pid=126126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f843cb98-7694-4501-b912-1c1b55f62d62 could not be found. Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f843cb98-7694-4501-b912-1c1b55f62d62 could not be found. Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:05:00.934139 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 18:05:00.942027 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:05:00.942027 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:05:00.942027 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:05:00.942027 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:05:00.942027 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:05:00.942027 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f843cb98-7694-4501-b912-1c1b55f62d62 could not be found. Aug 04 18:05:00.942027 n-d-846466-12 devstack@n-api.service[126126]: ERROR nova.api.openstack.wsgi Aug 04 18:05:00.942027 n-d-846466-12 devstack@n-api.service[126126]: DEBUG nova.api.openstack.wsgi [None req-d7cca98e-29fc-430a-83f1-bbc73bf46c23 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Returning 404 to user: Instance f843cb98-7694-4501-b912-1c1b55f62d62 could not be found. {{(pid=126126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:05:00.942027 n-d-846466-12 devstack@n-api.service[126126]: INFO nova.api.openstack.requestlog [None req-d7cca98e-29fc-430a-83f1-bbc73bf46c23 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62" status: 404 len: 111 microversion: 2.1 time: 0.034439 Aug 04 18:05:00.942027 n-d-846466-12 devstack@n-api.service[126126]: [pid: 126126|app: 0|req: 3566/7236] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Aug 4 18:05:00 2022] GET /compute/v2.1/servers/f843cb98-7694-4501-b912-1c1b55f62d62 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 18:05:01.123724 n-d-846466-12 devstack@n-api.service[126125]: DEBUG nova.api.openstack.wsgi [None req-08e156c9-b71e-403a-b8f5-84b83a929c00 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] Calling method '.version_select at 0x7f7e76d96430>' {{(pid=126125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:01.131955 n-d-846466-12 devstack@n-api.service[126125]: ERROR oslo.messaging._drivers.impl_rabbit [None req-08e156c9-b71e-403a-b8f5-84b83a929c00 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [7901653b-d177-4be8-a7d9-f7b86b4b6ebf] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 18:05:02.146688 n-d-846466-12 devstack@n-api.service[126125]: INFO oslo.messaging._drivers.impl_rabbit [None req-08e156c9-b71e-403a-b8f5-84b83a929c00 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] [7901653b-d177-4be8-a7d9-f7b86b4b6ebf] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 41324. Aug 04 18:05:02.466528 n-d-846466-12 devstack@n-api.service[126125]: INFO nova.api.openstack.requestlog [None req-08e156c9-b71e-403a-b8f5-84b83a929c00 tempest-TestSnapshotPattern-1955683679 tempest-TestSnapshotPattern-1955683679-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-2018912339" status: 202 len: 0 microversion: 2.1 time: 1.346821 Aug 04 18:05:02.467241 n-d-846466-12 devstack@n-api.service[126125]: [pid: 126125|app: 0|req: 3671/7237] 10.222.0.23 () {58 vars in 1257 bytes} [Thu Aug 4 18:05:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-2018912339 => generated 0 bytes in 1349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 18:05:36.075657 n-d-846466-12 devstack@n-api.service[126125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:05:36.076415 n-d-846466-12 devstack@n-api.service[126125]: Thu Aug 4 18:05:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:05:36.584988 n-d-846466-12 devstack@n-api.service[126126]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:05:36.585623 n-d-846466-12 devstack@n-api.service[126126]: Thu Aug 4 18:05:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:05:36.622030 n-d-846466-12 devstack@n-api.service[126126]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:05:36.622289 n-d-846466-12 devstack@n-api.service[126126]: Thu Aug 4 18:05:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:07:38.736542 n-d-846466-12 devstack@n-api.service[126126]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:07:38.737486 n-d-846466-12 devstack@n-api.service[126126]: Thu Aug 4 18:07:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:08:56.084740 n-d-846466-12 devstack@n-api.service[126125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:08:56.085403 n-d-846466-12 devstack@n-api.service[126125]: Thu Aug 4 18:08:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:08:56.595678 n-d-846466-12 devstack@n-api.service[126126]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:08:56.595678 n-d-846466-12 devstack@n-api.service[126126]: Thu Aug 4 18:08:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:08:56.631112 n-d-846466-12 devstack@n-api.service[126126]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:08:56.631380 n-d-846466-12 devstack@n-api.service[126126]: Thu Aug 4 18:08:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:10:36.005579 n-d-846466-12 devstack@n-api.service[126125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:10:36.006168 n-d-846466-12 devstack@n-api.service[126125]: Thu Aug 4 18:10:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:10:37.040919 n-d-846466-12 devstack@n-api.service[126125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:10:37.041703 n-d-846466-12 devstack@n-api.service[126125]: Thu Aug 4 18:10:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:10:58.751804 n-d-846466-12 devstack@n-api.service[126126]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:10:58.752650 n-d-846466-12 devstack@n-api.service[126126]: Thu Aug 4 18:10:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:12:16.094591 n-d-846466-12 devstack@n-api.service[126125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:12:16.095287 n-d-846466-12 devstack@n-api.service[126125]: Thu Aug 4 18:12:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:12:16.604105 n-d-846466-12 devstack@n-api.service[126126]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:12:16.604874 n-d-846466-12 devstack@n-api.service[126126]: Thu Aug 4 18:12:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:12:16.639711 n-d-846466-12 devstack@n-api.service[126126]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:12:16.639998 n-d-846466-12 devstack@n-api.service[126126]: Thu Aug 4 18:12:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!